-- Logs begin at Sat 2022-07-02 20:01:19 UTC, end at Sat 2022-07-02 22:26:41 UTC. -- Jul 02 20:43:10.398800 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Jul 02 20:43:10.406265 ncdv-master-1 devstack@keystone.service[91063]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 02 20:43:10.409293 ncdv-master-1 devstack@keystone.service[91063]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 2 20:43:10 2022] *** Jul 02 20:43:10.409293 ncdv-master-1 devstack@keystone.service[91063]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 02 20:43:10.409293 ncdv-master-1 devstack@keystone.service[91063]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 02 20:43:10.409293 ncdv-master-1 devstack@keystone.service[91063]: nodename: ncdv-master-1 Jul 02 20:43:10.409293 ncdv-master-1 devstack@keystone.service[91063]: machine: x86_64 Jul 02 20:43:10.409293 ncdv-master-1 devstack@keystone.service[91063]: clock source: unix Jul 02 20:43:10.409293 ncdv-master-1 devstack@keystone.service[91063]: pcre jit disabled Jul 02 20:43:10.409293 ncdv-master-1 devstack@keystone.service[91063]: detected number of CPU cores: 4 Jul 02 20:43:10.409293 ncdv-master-1 devstack@keystone.service[91063]: current working directory: / Jul 02 20:43:10.409293 ncdv-master-1 devstack@keystone.service[91063]: detected binary path: /usr/bin/uwsgi-core Jul 02 20:43:10.409832 ncdv-master-1 devstack@keystone.service[91063]: your processes number limit is 47680 Jul 02 20:43:10.409832 ncdv-master-1 devstack@keystone.service[91063]: your memory page size is 4096 bytes Jul 02 20:43:10.409832 ncdv-master-1 devstack@keystone.service[91063]: detected max file descriptor number: 2048 Jul 02 20:43:10.409832 ncdv-master-1 devstack@keystone.service[91063]: lock engine: pthread robust mutexes Jul 02 20:43:10.409832 ncdv-master-1 devstack@keystone.service[91063]: thunder lock: enabled Jul 02 20:43:10.409832 ncdv-master-1 devstack@keystone.service[91063]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 02 20:43:10.409832 ncdv-master-1 devstack@keystone.service[91063]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 02 20:43:10.469785 ncdv-master-1 devstack@keystone.service[91063]: Python main interpreter initialized at 0x56249b9399c0 Jul 02 20:43:10.469785 ncdv-master-1 devstack@keystone.service[91063]: python threads support enabled Jul 02 20:43:10.469785 ncdv-master-1 devstack@keystone.service[91063]: your server socket listen backlog is limited to 100 connections Jul 02 20:43:10.469785 ncdv-master-1 devstack@keystone.service[91063]: your mercy for graceful operations on workers is 90 seconds Jul 02 20:43:10.470193 ncdv-master-1 devstack@keystone.service[91063]: mapped 403077 bytes (393 KB) for 2 cores Jul 02 20:43:10.470193 ncdv-master-1 devstack@keystone.service[91063]: *** Operational MODE: preforking *** Jul 02 20:43:10.470495 ncdv-master-1 devstack@keystone.service[91063]: *** uWSGI is running in multiple interpreter mode *** Jul 02 20:43:10.470495 ncdv-master-1 devstack@keystone.service[91063]: spawned uWSGI master process (pid: 91063) Jul 02 20:43:10.470727 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. Jul 02 20:43:10.471608 ncdv-master-1 devstack@keystone.service[91063]: spawned uWSGI worker 1 (pid: 91077, cores: 1) Jul 02 20:43:10.471608 ncdv-master-1 devstack@keystone.service[91063]: spawned uWSGI worker 2 (pid: 91078, cores: 1) Jul 02 20:43:10.471757 ncdv-master-1 devstack@keystone.service[91063]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 02 20:43:16.145495 ncdv-master-1 devstack@keystone.service[91077]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 20:43:16.145495 ncdv-master-1 devstack@keystone.service[91077]: from cryptography.utils import int_from_bytes Jul 02 20:43:16.146276 ncdv-master-1 devstack@keystone.service[91077]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 20:43:16.146276 ncdv-master-1 devstack@keystone.service[91077]: from cryptography.utils import int_from_bytes Jul 02 20:43:16.146380 ncdv-master-1 devstack@keystone.service[91078]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 20:43:16.146380 ncdv-master-1 devstack@keystone.service[91078]: from cryptography.utils import int_from_bytes Jul 02 20:43:16.146790 ncdv-master-1 devstack@keystone.service[91078]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 20:43:16.146790 ncdv-master-1 devstack@keystone.service[91078]: from cryptography.utils import int_from_bytes Jul 02 20:43:16.195805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 02 20:43:16.195987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 02 20:43:16.196177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] command line args: [] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 02 20:43:16.196436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 02 20:43:16.196572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 02 20:43:16.196656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ================================================================================ {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 02 20:43:16.196724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 02 20:43:16.196790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] command line args: [] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 02 20:43:16.196854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] admin_token = **** {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.197072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 02 20:43:16.197175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] config_dir = [] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.197252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.197317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ================================================================================ {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 02 20:43:16.197382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] config_source = [] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.197518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] admin_token = **** {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.197663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] debug = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.197753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] config_dir = [] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.197817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.197996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.198060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] config_source = [] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.198205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.198293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] debug = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.198361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.198421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.198596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.198751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.198831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.198939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.199068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] list_limit = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.199185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.199259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] log_config_append = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.199434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.199558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.199633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] log_dir = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.199695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] list_limit = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.199758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] log_file = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.199823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] log_config_append = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.200007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.200129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.200215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] log_dir = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.200276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.200341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] log_file = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.200467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.200553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.200708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.200808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.200871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.201054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.201157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.201293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.201393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.201465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.201525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.201662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.201785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.201867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.201938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.202150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.202273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.202347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.202422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.202584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.202684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.202846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.202977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.203055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.203130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.203296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.203561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.203681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.203759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] publish_errors = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.203848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.203929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.204218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.204338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.204497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.204580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] publish_errors = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.204652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.204769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.204844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.204969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.205064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] standard_threads = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.205138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.205259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.205335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.205524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.205653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.205735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.205807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] standard_threads = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.205877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] use_journal = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.205953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] use_json = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.206077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.206155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] use_stderr = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.206227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.206301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] use_syslog = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.206408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.206536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.206634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] use_journal = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.206714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.206786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] use_json = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.206938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] use_stderr = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.207060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.207215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] use_syslog = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.207306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.207385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:43:16.207463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.207535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.207628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.207802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.207925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.208055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.208158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.208335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.208469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.208597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.208781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.208917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.209034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.209121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.209308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.209445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.209532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.209607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.209772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.209906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.209986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.210073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.210223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.210312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.210472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.210553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.210701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.210869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.210947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.211021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.211193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.211276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.211430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.211519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.211665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.211749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.211914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.211997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.212197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.212289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.212438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.212527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.212683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.212765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.212911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.213005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.213140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.213222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.213368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.213450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.213600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.213695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.213845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.213968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.214072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.214173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.214298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.214413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.214509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.214604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.214766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.214881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.214997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.215114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.215193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.215305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.215464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.215545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.215668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.215744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.215914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.216003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.216171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.216254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.216410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.216486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.216601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.216675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.216819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.216938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.217030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.217108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.217277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.217360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.217523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.217605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.217730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.217806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.217967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.218049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.218196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.218280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.218424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.218552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.218634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.218706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.218884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.218967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.219112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.219193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.219341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.219424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.219556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.219674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.219788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.219873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.220020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.220139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.220279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.220362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.220504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.220582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.220743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.220821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.220972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.221050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.221206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.221292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.221432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.221518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.221681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.221759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.221912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.221997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.222139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.222218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.222371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.222458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.222602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.222681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.222848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.222927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.223085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.223172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.223322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.223402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.223564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.223642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.223796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.223875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.224131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.224216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.224370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.224450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.224608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.224686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.224843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.224920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.225077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.225146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.225314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.225394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.225549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.225628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.225781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.225861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.226022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.226107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.226253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.226338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.226487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.226565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.226721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.226806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.226958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.227043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.227194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.227273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.227427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.227505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.227668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.227822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.227898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.227968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.228157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.228239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.228393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.228484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.228622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.228713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.228850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.228929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.229082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.229160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.229312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.229398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.229541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.229626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.229772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.229851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.230002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.230091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.230230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.230308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.230470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.230549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.230705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.230793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.230954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.231034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.231189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.231266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.231416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] auth.external = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.231510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.231643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.231722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.231931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.232008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.232175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.232250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] auth.external = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.232402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] auth.password = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.232554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.232633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] auth.token = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.232705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.232852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.232932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.233094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.233175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] auth.password = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.233338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.233417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] auth.token = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.233565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.233644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.233809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.233890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.234052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.234133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.234279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.234357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.234511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] credential.caching = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.234592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.234758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.234837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.234990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.235068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.235226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] credential.caching = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.235306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.235460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.235539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.235700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.235779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.235932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.236012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.236217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.236300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.236461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.236540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.236697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.236777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.236947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.237026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.237207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.237284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.237446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.237527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.237703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.237781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.237944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.238022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.238195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.238276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.238428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] federation.caching = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.238507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.238660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.238740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.238906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.238988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.239147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.239227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] federation.caching = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.239374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.239454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.239641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.239723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.239877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.239955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.240133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.240217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.240379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.240466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.240615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.240693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.240849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.240926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.241090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.241170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.241319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] identity.caching = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.241406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.241564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.241644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.241811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.241892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.242042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.242120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] identity.caching = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.242274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.242354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.242519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.242600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.242745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.242824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.242978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.243064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.243221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.243299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.243449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.243527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.243681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.243767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.243910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.243989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.244159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.244239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.244398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.244489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.244641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.244721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.244881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.244959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.245129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.245221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.245370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.245448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.245620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.245698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.245854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.245939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.246085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.246166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.246310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.246389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.246552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.246639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.246780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.246865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.247014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.247100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.247249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.247352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.247492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.247590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.247722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.247807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.247952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.248071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.248216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.248295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.248461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.248539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.248690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.248782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.248932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.249012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.249174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.249254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.249401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.249490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.249632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.249712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.249857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.249936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.250096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.250183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.250328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.250407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.250556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.250634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.250787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.250872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.251021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.251101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.251260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.251338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.251500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.251623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.251725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.251803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.251950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.252081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.252218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.252312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.252461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.252539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.252690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.252768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.252921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.253007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.253151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.253233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.253377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.253457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.253611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.253699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.253845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.253923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.254078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.254157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.254319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.254406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.254563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.254642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.254806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.254884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.255034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.255113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.255332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.255412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.255566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.255646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.255797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.255878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.256027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.256128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.256272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.256350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.256515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.256596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.256754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.256832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.256984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.257070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.257224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.257304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.257463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.257543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.257687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.257767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.257925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.258006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.258155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.258234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.258384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.258464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.258614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.258695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.258842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.258922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.259078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.259155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.259316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.259397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.259546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.259631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.259790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.259868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.260027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.260166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.260288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.260367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.260517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.260595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.260751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.260832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.260982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.261061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.261222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.261302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.261457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.261536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.261688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.261768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.261920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.262000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.262155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] resource.caching = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.262235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.262395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.262474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.262633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.262712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.262862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.262941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] resource.caching = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.263108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.263188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.263353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.263432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.263582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.263663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.263824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.263904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.264074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.264157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.264306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.264383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.264530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] role.caching = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.264610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.264774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] role.driver = sql {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.264854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.265000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.265080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.265237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] role.caching = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.265315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.265478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.265556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] role.driver = sql {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.265707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.265786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.265957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.266036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.266200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.266278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.266443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.266524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.266686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.266765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.266929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.267012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.267155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.267237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.267397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.267477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.267640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.267727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.267872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.267950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.268140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.268220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.268388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.268530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.268638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.268765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.268886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.269013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.269259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.269350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.269502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.269580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.269745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.269824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.269982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.270070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.270232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.270312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.270480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.270558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.270713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.270798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.270967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.271053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.271195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.271275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.271422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.271509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.271669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.271749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.271905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.271984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.272164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.272260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.272397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.272476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.272629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.272715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.272854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.272942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.273096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] token.caching = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.273175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.273328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.273407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.273573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.273654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.273804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.273883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] token.caching = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.274039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.274117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.274285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.274364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.274518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.274597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.274756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.274836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.274993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.275074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.275236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.275314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.275466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.275544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.275699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.275780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.275929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.276010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.276195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.276275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.276437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.276519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.276660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.276737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.276896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.276975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.277154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.277234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.277386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.277467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.connection = **** {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.277629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.277718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.277885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.277964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.278118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.278199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.connection = **** {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.278355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.278443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.278587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.278667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.278817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.278905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.279047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.279126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.279275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.279354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.279515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.279602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.279749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.279829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.279987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.280084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.280244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.280334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.280485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.280564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.280713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.280792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.280952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.281039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.281186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.281266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.281422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.281502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.281651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.281737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.281811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91078) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 02 20:43:16.281883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.282110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.282352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:43:16.282521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 02 20:43:16.310968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.311190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.311403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.311490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.311682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.311907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.319933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.320644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.347305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.347558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.348748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.349006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.400023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.400284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.448176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.448386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.449054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.449306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.513372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.513568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.513796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.513946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.514038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.514115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.514190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.514264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.514421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.514549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.514711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.514915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.537123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.537275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.537361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.537441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.537515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.537668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.537799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.537883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.537972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.538080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.538171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.538339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.538481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.538554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.549279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.549652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.562064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.562266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.562362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.562491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.562583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.562712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.562811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.562930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.563019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.563145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.563233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.563356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91078) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.563454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.563611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91077) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:43:16.580674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.580877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 02 20:43:16.581207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.581460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.581559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 02 20:43:16.581691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 02 20:43:16.581817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.581939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.582063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.582261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 02 20:43:16.582345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.582409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.582471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.582538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.582625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.582910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.593385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.593660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.593918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.594043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.594170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.594265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.594501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.594803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.602361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.603664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.605583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.605850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.606123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.606395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.606666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.606919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.607180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.607555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.607823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.608130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.608489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.609409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.609823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.610254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.610695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.611113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.611476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.611832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.612457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.612896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.613365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.613825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.638870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.640624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.640897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.642153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.643902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.644205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.646230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.646502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.646782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.649577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.649854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.650135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.654024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.654298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.657476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.657760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.658745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.659137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.659410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.659689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.659937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.660252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.660517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.660780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.662264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.662670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.662951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.663240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.663499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.663770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.664072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.664330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.679307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.679580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.683392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.683670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.686126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.689776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.689929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.690024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.693659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.693953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.695043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.698655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.698985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.702379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.702611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.702745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.702910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.703205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.703478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.703756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.706401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.706697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.706979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.707266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.707544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.707832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.722705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.722986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.723244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.723481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.726961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.727238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.727509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.727772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.731462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.733173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.733407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.735808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.736462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.736707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.737004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.737290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.737556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.739315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.739315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.740880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.741161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.741451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.741742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.742030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.750907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.751178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.751451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.751727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.751997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.752267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.752564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.755516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.755793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.756056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.756370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.756652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.756927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.757211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.770421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.773811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.775458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.777109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.778695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.778820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.780340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.780607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.780878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.782087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.783701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.785360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.785639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.785934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.788271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.789866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.793060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.793349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.793474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.793621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.793892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.795062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.798315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.798603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.798890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.799173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.802985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.803263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.803667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.808703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.808988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.809377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.811841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91078) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.812135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.812405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.812678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.812936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.813204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.813467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.813731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.813991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.814259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.814520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.814770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.815025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.815289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91078) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.817384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91077) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:43:16.817668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.817966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.818249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.818532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.818816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.819089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.819355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.819622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.819885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.820190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.820453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.820726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.821000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91077) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:43:16.852995 ncdv-master-1 devstack@keystone.service[91078]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56249b9399c0 pid: 91078 (default app) Jul 02 20:43:16.856204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98c117-b1a3-478b-97bb-d777bcf34a63 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:16.856486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98c117-b1a3-478b-97bb-d777bcf34a63 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:16.856758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98c117-b1a3-478b-97bb-d777bcf34a63 None None] PATH_INFO: `/v3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:16.858818 ncdv-master-1 devstack@keystone.service[91077]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56249b9399c0 pid: 91077 (default app) Jul 02 20:43:16.861001 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Sat Jul 2 20:43:16 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:24.978028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f156a07-347d-4f32-ae10-74fabd000ca2 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:24.978627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f156a07-347d-4f32-ae10-74fabd000ca2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:24.978627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f156a07-347d-4f32-ae10-74fabd000ca2 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:24.982993 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:43:24.991936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa8ff8-884b-44d1-a180-924dd2bab1ac None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:24.992431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa8ff8-884b-44d1-a180-924dd2bab1ac None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:24.992583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa8ff8-884b-44d1-a180-924dd2bab1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:25.070461 ncdv-master-1 devstack@keystone.service[91078]: INFO dbcounter [None req-b0aa8ff8-884b-44d1-a180-924dd2bab1ac None None] Registered counter for database keystone Jul 02 20:43:25.091893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG oslo_db.sqlalchemy.engines [None req-b0aa8ff8-884b-44d1-a180-924dd2bab1ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91078) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 20:43:25.099683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writer thread running {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 20:43:25.399844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG passlib.handlers.bcrypt [None req-b0aa8ff8-884b-44d1-a180-924dd2bab1ac None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91078) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 02 20:43:25.400220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG passlib.handlers.bcrypt [None req-b0aa8ff8-884b-44d1-a180-924dd2bab1ac None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91078) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 02 20:43:25.455907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b0aa8ff8-884b-44d1-a180-924dd2bab1ac None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:25.457530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b0aa8ff8-884b-44d1-a180-924dd2bab1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:25.589277 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 599 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 02 20:43:25.768844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f156a07-347d-4f32-ae10-74fabd000ca2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:25.859090 ncdv-master-1 devstack@keystone.service[91077]: INFO dbcounter [None req-4f156a07-347d-4f32-ae10-74fabd000ca2 None None] Registered counter for database keystone Jul 02 20:43:25.880845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG oslo_db.sqlalchemy.engines [None req-4f156a07-347d-4f32-ae10-74fabd000ca2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 20:43:25.890073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writer thread running {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 20:43:26.114551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f156a07-347d-4f32-ae10-74fabd000ca2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:26.119400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17daa9f6-1406-4b82-813c-81600cd8c4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:26.120073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daa9f6-1406-4b82-813c-81600cd8c4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:26.120378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daa9f6-1406-4b82-813c-81600cd8c4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:26.120661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daa9f6-1406-4b82-813c-81600cd8c4a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:26.129245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17daa9f6-1406-4b82-813c-81600cd8c4a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:26.178600 ncdv-master-1 devstack@keystone.service[91077]: WARNING keystone.common.rbac_enforcer.enforcer [None req-17daa9f6-1406-4b82-813c-81600cd8c4a1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 02 20:43:26.178945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17daa9f6-1406-4b82-813c-81600cd8c4a1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:26.189508 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Sat Jul 2 20:43:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 20:43:26.195899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa8ff8-884b-44d1-a180-924dd2bab1ac None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:26.211225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa8ff8-884b-44d1-a180-924dd2bab1ac None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:26.216931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e5a92-b3ee-457d-88e5-208b6a8641ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:26.218039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e5a92-b3ee-457d-88e5-208b6a8641ea admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:26.218319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e5a92-b3ee-457d-88e5-208b6a8641ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:26.218593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e5a92-b3ee-457d-88e5-208b6a8641ea admin admin] PATH_INFO: `/v3/projects/d4c9de22f7474b6f9c2ca908dc6ecd1f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:26.220278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e5a92-b3ee-457d-88e5-208b6a8641ea admin admin] RBAC: Authorizing `identity:get_project(project_id=d4c9de22f7474b6f9c2ca908dc6ecd1f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:26.272089 ncdv-master-1 devstack@keystone.service[91078]: WARNING keystone.common.rbac_enforcer.enforcer [None req-895e5a92-b3ee-457d-88e5-208b6a8641ea admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 02 20:43:26.272449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e5a92-b3ee-457d-88e5-208b6a8641ea admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:26.277178 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Sat Jul 2 20:43:26 2022] GET /identity/v3/projects/d4c9de22f7474b6f9c2ca908dc6ecd1f => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:28.547931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4056c8c-ddec-4605-8cec-9831e682b11f None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:28.548864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4056c8c-ddec-4605-8cec-9831e682b11f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:28.548864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4056c8c-ddec-4605-8cec-9831e682b11f None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:28.554077 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:28.560069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926f263-8236-42a9-8203-17ecd35b0bab None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:28.560496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926f263-8236-42a9-8203-17ecd35b0bab None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:28.560666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926f263-8236-42a9-8203-17ecd35b0bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:28.581628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8926f263-8236-42a9-8203-17ecd35b0bab None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:28.583279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8926f263-8236-42a9-8203-17ecd35b0bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:28.591974 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 02 20:43:28.616402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4056c8c-ddec-4605-8cec-9831e682b11f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:28.632310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4056c8c-ddec-4605-8cec-9831e682b11f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:28.638088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80aac0-71de-4b1d-94b3-5d866c512307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:28.638723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80aac0-71de-4b1d-94b3-5d866c512307 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:28.639008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80aac0-71de-4b1d-94b3-5d866c512307 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:28.639250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80aac0-71de-4b1d-94b3-5d866c512307 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:28.647919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80aac0-71de-4b1d-94b3-5d866c512307 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:28.649755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80aac0-71de-4b1d-94b3-5d866c512307 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:28.658911 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Sat Jul 2 20:43:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 20:43:28.667225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926f263-8236-42a9-8203-17ecd35b0bab None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:28.679947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926f263-8236-42a9-8203-17ecd35b0bab None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:28.686051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69a269-3dbb-4248-adb8-bb5170d96bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:28.686915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69a269-3dbb-4248-adb8-bb5170d96bde admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:28.687194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69a269-3dbb-4248-adb8-bb5170d96bde admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:28.687476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69a269-3dbb-4248-adb8-bb5170d96bde admin admin] PATH_INFO: `/v3/users/a7a87f488da04c6c9c5276b1487113d6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:28.689027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69a269-3dbb-4248-adb8-bb5170d96bde admin admin] RBAC: Authorizing `identity:get_user(user_id=a7a87f488da04c6c9c5276b1487113d6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:28.690900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69a269-3dbb-4248-adb8-bb5170d96bde admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:28.692522 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Sat Jul 2 20:43:28 2022] GET /identity/v3/users/a7a87f488da04c6c9c5276b1487113d6 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:31.028378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14492a02-4f28-4c8d-9729-03bfc77a5bbf None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:31.028946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14492a02-4f28-4c8d-9729-03bfc77a5bbf None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:31.028946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14492a02-4f28-4c8d-9729-03bfc77a5bbf None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:31.030291 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:43:31.035473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbbf61-cc3f-4957-8fa2-c38cb4263efe None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:31.035899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbbf61-cc3f-4957-8fa2-c38cb4263efe None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:31.036103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbbf61-cc3f-4957-8fa2-c38cb4263efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:31.045315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fe2d0-eddc-40ac-8e34-32520cf19294 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:31.045600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fe2d0-eddc-40ac-8e34-32520cf19294 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:31.045873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fe2d0-eddc-40ac-8e34-32520cf19294 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:31.047149 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:43:31.051999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4842b-4249-43b4-b68f-2ea1e3c19050 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:31.052316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4842b-4249-43b4-b68f-2ea1e3c19050 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:31.052588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4842b-4249-43b4-b68f-2ea1e3c19050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:31.054213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f0cbbf61-cc3f-4957-8fa2-c38cb4263efe None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:31.055734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f0cbbf61-cc3f-4957-8fa2-c38cb4263efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:31.093859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG passlib.handlers.bcrypt [None req-03f4842b-4249-43b4-b68f-2ea1e3c19050 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91077) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 02 20:43:31.094297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG passlib.handlers.bcrypt [None req-03f4842b-4249-43b4-b68f-2ea1e3c19050 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91077) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 02 20:43:31.139052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-03f4842b-4249-43b4-b68f-2ea1e3c19050 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:31.140617 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:31.140755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-03f4842b-4249-43b4-b68f-2ea1e3c19050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:31.165429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbbf61-cc3f-4957-8fa2-c38cb4263efe None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:31.191442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:31.244472 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:43:31.267959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4842b-4249-43b4-b68f-2ea1e3c19050 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:31.274265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbbf61-cc3f-4957-8fa2-c38cb4263efe None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:31.308332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80789235-4961-4d2e-a666-4a08f5f6ce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:31.309051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80789235-4961-4d2e-a666-4a08f5f6ce05 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:31.309334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80789235-4961-4d2e-a666-4a08f5f6ce05 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:31.309596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80789235-4961-4d2e-a666-4a08f5f6ce05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:31.321394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80789235-4961-4d2e-a666-4a08f5f6ce05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:43:31.332763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-80789235-4961-4d2e-a666-4a08f5f6ce05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:43:31.332763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:43:31.332763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:43:31.332763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:43:31.332763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:43:31.332763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:43:31.332763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:43:31.332763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:43:31.332763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:43:31.332763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:43:31.332763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:43:31.332763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:43:31.332763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:43:31.332763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:43:31.332763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:43:31.332763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:43:31.334364 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:43:31.334364 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:43:31.334364 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:43:31.334364 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:43:31.334364 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:43:31.334364 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:43:31.334364 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:43:31.334364 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:43:31.334364 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:43:31.334364 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:43:31.334364 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:43:31.334364 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:43:31.334364 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:43:31.334364 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:43:31.334364 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:43:31.334364 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:43:31.335590 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:43:31.335590 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:43:31.335590 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:43:31.335590 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:43:31.335590 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:43:31.335590 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:43:31.335590 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:43:31.335590 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:43:31.335590 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:43:31.335590 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:43:31.335590 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:43:31.335590 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:43:31.335590 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:43:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:43:31.341451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80789235-4961-4d2e-a666-4a08f5f6ce05 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:31.386934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4842b-4249-43b4-b68f-2ea1e3c19050 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:31.389420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:31.423820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:31.425790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c049b-7afc-400b-8112-e4b21e47ff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:31.426741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c049b-7afc-400b-8112-e4b21e47ff68 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:31.427012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c049b-7afc-400b-8112-e4b21e47ff68 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:31.427283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c049b-7afc-400b-8112-e4b21e47ff68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:31.442559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80789235-4961-4d2e-a666-4a08f5f6ce05 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:31.476785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121a4b9-8b89-4be8-845c-c2be3c61622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:31.477447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121a4b9-8b89-4be8-845c-c2be3c61622d None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:31.477732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121a4b9-8b89-4be8-845c-c2be3c61622d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:31.478012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121a4b9-8b89-4be8-845c-c2be3c61622d None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:31.478770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121a4b9-8b89-4be8-845c-c2be3c61622d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:31.479079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121a4b9-8b89-4be8-845c-c2be3c61622d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:31.480527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121a4b9-8b89-4be8-845c-c2be3c61622d None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:31.491997 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:43:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:31.493420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c049b-7afc-400b-8112-e4b21e47ff68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:31.494925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c049b-7afc-400b-8112-e4b21e47ff68 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:31.497449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121a4b9-8b89-4be8-845c-c2be3c61622d None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:31.598429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121a4b9-8b89-4be8-845c-c2be3c61622d None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:31.603073 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:43:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 20:43:31.609261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c049b-7afc-400b-8112-e4b21e47ff68 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:31.612810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:31.639020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf48d8-d1eb-4516-b00a-15024138da52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:31.639897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf48d8-d1eb-4516-b00a-15024138da52 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:31.640209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf48d8-d1eb-4516-b00a-15024138da52 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:31.640473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf48d8-d1eb-4516-b00a-15024138da52 None admin] PATH_INFO: `/v3/users/a7a87f488da04c6c9c5276b1487113d6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:31.641700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf48d8-d1eb-4516-b00a-15024138da52 None admin] RBAC: Authorizing `identity:get_user(user_id=a7a87f488da04c6c9c5276b1487113d6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:31.643698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf48d8-d1eb-4516-b00a-15024138da52 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:31.645486 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 9/17] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:43:31 2022] GET /identity/v3/users/a7a87f488da04c6c9c5276b1487113d6 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:43:31.650907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf48d8-d1eb-4516-b00a-15024138da52 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:31.665951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:31.709292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c049b-7afc-400b-8112-e4b21e47ff68 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:31.743051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f4d0f-fb0b-4a19-b5b9-b118854af202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:31.743842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f4d0f-fb0b-4a19-b5b9-b118854af202 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:31.744131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f4d0f-fb0b-4a19-b5b9-b118854af202 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:31.744410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f4d0f-fb0b-4a19-b5b9-b118854af202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:31.750877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf48d8-d1eb-4516-b00a-15024138da52 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:31.762694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f4d0f-fb0b-4a19-b5b9-b118854af202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:31.764196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f4d0f-fb0b-4a19-b5b9-b118854af202 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:31.787178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c25e4-21e2-49fe-b6eb-59923523e142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:31.787973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c25e4-21e2-49fe-b6eb-59923523e142 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:31.788279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c25e4-21e2-49fe-b6eb-59923523e142 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:31.788550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c25e4-21e2-49fe-b6eb-59923523e142 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:31.789769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c25e4-21e2-49fe-b6eb-59923523e142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:31.791239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c25e4-21e2-49fe-b6eb-59923523e142 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:31.791335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-c02f4d0f-fb0b-4a19-b5b9-b118854af202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:43:31.791335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:43:31.791335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:43:31.791335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:43:31.791335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:43:31.791335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:43:31.791335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:43:31.791335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:43:31.791335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:43:31.791335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:43:31.791335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:43:31.791335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:43:31.791335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:43:31.791335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:43:31.791335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:43:31.792267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:43:31.792267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:43:31.792267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:43:31.792267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:43:31.792267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:43:31.792267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:43:31.792267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:43:31.792267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:43:31.792267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:43:31.792267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:43:31.792267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:43:31.792267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:43:31.792267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:43:31.792267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:43:31.792267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:43:31.792267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:43:31.792267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:43:31.793156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:43:31.793156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:43:31.793156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:43:31.793156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:43:31.793156 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 9/18] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:43:31.793427 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 10/19] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:43:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:31.798331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f4d0f-fb0b-4a19-b5b9-b118854af202 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:31.798582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c25e4-21e2-49fe-b6eb-59923523e142 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:31.854422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:31.878664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:31.897242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c25e4-21e2-49fe-b6eb-59923523e142 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:31.899666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f4d0f-fb0b-4a19-b5b9-b118854af202 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:31.930590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc741f-82fd-41b7-a398-e4df65eae884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:31.931244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc741f-82fd-41b7-a398-e4df65eae884 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:31.931529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc741f-82fd-41b7-a398-e4df65eae884 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:31.931802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc741f-82fd-41b7-a398-e4df65eae884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:31.932673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc741f-82fd-41b7-a398-e4df65eae884 None admin] RBAC: Adding query filter params (role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.domain.id=default, user.id=a7a87f488da04c6c9c5276b1487113d6) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:31.932983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc741f-82fd-41b7-a398-e4df65eae884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:31.933826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e654d-133e-4ee3-a04f-3e5c50753fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:31.934455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc741f-82fd-41b7-a398-e4df65eae884 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:31.934564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e654d-133e-4ee3-a04f-3e5c50753fe2 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:31.934744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e654d-133e-4ee3-a04f-3e5c50753fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:31.935017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e654d-133e-4ee3-a04f-3e5c50753fe2 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:31.935730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e654d-133e-4ee3-a04f-3e5c50753fe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:31.936031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e654d-133e-4ee3-a04f-3e5c50753fe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:31.937439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e654d-133e-4ee3-a04f-3e5c50753fe2 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:31.941192 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1322 bytes} [Sat Jul 2 20:43:31 2022] GET /identity/v3/role_assignments?user.id=a7a87f488da04c6c9c5276b1487113d6&scope.domain.id=default&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:43:31.956901 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:43:34.835745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734ca51-8a90-442f-aa39-dc4bb59023d7 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:34.836779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734ca51-8a90-442f-aa39-dc4bb59023d7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:34.837259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734ca51-8a90-442f-aa39-dc4bb59023d7 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:34.838816 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:34.844205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbae874-323c-4db7-9828-be9f88469613 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:34.845014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbae874-323c-4db7-9828-be9f88469613 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:34.845474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbae874-323c-4db7-9828-be9f88469613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:34.869058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-efbae874-323c-4db7-9828-be9f88469613 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:34.870608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-efbae874-323c-4db7-9828-be9f88469613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:34.963558 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:35.005186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734ca51-8a90-442f-aa39-dc4bb59023d7 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:35.152711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734ca51-8a90-442f-aa39-dc4bb59023d7 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:35.173691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab7a4e-350f-47b5-9f4e-d3977d7d8213 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:35.174288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab7a4e-350f-47b5-9f4e-d3977d7d8213 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:35.174744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab7a4e-350f-47b5-9f4e-d3977d7d8213 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:35.176389 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 12/24] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:43:35.188437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ce11c-b6bc-41b5-bb98-aca8308f55e1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:35.188988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ce11c-b6bc-41b5-bb98-aca8308f55e1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:35.189466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ce11c-b6bc-41b5-bb98-aca8308f55e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:35.214505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ec9ce11c-b6bc-41b5-bb98-aca8308f55e1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:35.216706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ec9ce11c-b6bc-41b5-bb98-aca8308f55e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:35.232845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6caee0-c4bd-4921-82c6-5df8d254ef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:35.233984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6caee0-c4bd-4921-82c6-5df8d254ef0c None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:35.234473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6caee0-c4bd-4921-82c6-5df8d254ef0c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:35.234940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6caee0-c4bd-4921-82c6-5df8d254ef0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:35.256329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6caee0-c4bd-4921-82c6-5df8d254ef0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:35.259665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6caee0-c4bd-4921-82c6-5df8d254ef0c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:35.266989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:35.294374 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-8b6caee0-c4bd-4921-82c6-5df8d254ef0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:43:35.294374 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:43:35.294374 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:43:35.294374 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:43:35.294374 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:43:35.294374 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:43:35.294374 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:43:35.294374 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:43:35.294374 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:43:35.294374 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:43:35.294374 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:43:35.294374 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:43:35.294374 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:43:35.294374 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:43:35.294374 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:43:35.295276 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:43:35.295276 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:43:35.295276 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:43:35.295276 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:43:35.295276 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:43:35.295276 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:43:35.295276 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:43:35.295276 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:43:35.295276 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:43:35.295276 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:43:35.295276 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:43:35.295276 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:43:35.295276 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:43:35.295276 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:43:35.295276 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:43:35.295276 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:43:35.295276 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:43:35.296589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:43:35.296589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:43:35.296589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:43:35.296589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:43:35.296589 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 13/25] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:43:35.297265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d6f83-919b-4e7a-8620-01b9eb41e8a5 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:35.297557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d6f83-919b-4e7a-8620-01b9eb41e8a5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:35.297836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d6f83-919b-4e7a-8620-01b9eb41e8a5 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:35.299109 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 14/26] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:35.301833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:35.305421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196f039-ecde-4a90-bf9f-73ed460f56be None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:35.306007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196f039-ecde-4a90-bf9f-73ed460f56be None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:35.306434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196f039-ecde-4a90-bf9f-73ed460f56be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:35.334547 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 13/27] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:35.336001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ce11c-b6bc-41b5-bb98-aca8308f55e1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:35.345359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0196f039-ecde-4a90-bf9f-73ed460f56be None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:35.346531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0196f039-ecde-4a90-bf9f-73ed460f56be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:35.474222 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 15/28] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:35.475094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196f039-ecde-4a90-bf9f-73ed460f56be None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:35.525626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ce11c-b6bc-41b5-bb98-aca8308f55e1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:35.613624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754f8fa-6072-4670-83b7-eaac28d3b274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:35.614242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754f8fa-6072-4670-83b7-eaac28d3b274 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:35.614526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754f8fa-6072-4670-83b7-eaac28d3b274 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:35.614854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754f8fa-6072-4670-83b7-eaac28d3b274 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:35.615611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754f8fa-6072-4670-83b7-eaac28d3b274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:35.616099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754f8fa-6072-4670-83b7-eaac28d3b274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:35.617685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754f8fa-6072-4670-83b7-eaac28d3b274 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:35.618749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196f039-ecde-4a90-bf9f-73ed460f56be None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:35.635921 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 14/29] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:35.637178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754f8fa-6072-4670-83b7-eaac28d3b274 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:35.657089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:35.671399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f49809-e70b-47d8-b877-d9da0e8b7022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:35.672541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f49809-e70b-47d8-b877-d9da0e8b7022 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:35.673150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f49809-e70b-47d8-b877-d9da0e8b7022 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:35.673581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f49809-e70b-47d8-b877-d9da0e8b7022 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:35.687526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f49809-e70b-47d8-b877-d9da0e8b7022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:43:35.689373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:35.697791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-56f49809-e70b-47d8-b877-d9da0e8b7022 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:43:35.697791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:43:35.697791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:43:35.697791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:43:35.697791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:43:35.697791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:43:35.697791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:43:35.697791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:43:35.697791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:43:35.697791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:43:35.697791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:43:35.697791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:43:35.697791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:43:35.697791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:43:35.697791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:43:35.697791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:43:35.698880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:43:35.698880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:43:35.698880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:43:35.698880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:43:35.698880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:43:35.698880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:43:35.698880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:43:35.698880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:43:35.698880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:43:35.698880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:43:35.698880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:43:35.698880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:43:35.698880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:43:35.698880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:43:35.698880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:43:35.698880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:43:35.699827 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:43:35.699827 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:43:35.699827 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:43:35.699827 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:43:35.699827 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:43:35.699827 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:43:35.699827 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:43:35.699827 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:43:35.699827 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:43:35.699827 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:43:35.699827 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:43:35.699827 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:43:35.702600 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 16/30] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:43:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:43:35.704533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f27ee-e9fc-479b-bde7-925959911db5 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:35.704960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f27ee-e9fc-479b-bde7-925959911db5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:35.705523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f27ee-e9fc-479b-bde7-925959911db5 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:35.707554 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 17/31] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:35.708566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f27ee-e9fc-479b-bde7-925959911db5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:35.765328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754f8fa-6072-4670-83b7-eaac28d3b274 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:35.807320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df414077-db2e-4e76-90d7-1cc386432915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:35.808270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df414077-db2e-4e76-90d7-1cc386432915 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:35.808950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df414077-db2e-4e76-90d7-1cc386432915 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:35.809383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df414077-db2e-4e76-90d7-1cc386432915 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:35.810730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df414077-db2e-4e76-90d7-1cc386432915 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:35.812781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df414077-db2e-4e76-90d7-1cc386432915 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:35.834373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f27ee-e9fc-479b-bde7-925959911db5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:35.878920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209c91f-92a5-417f-8444-b3ba1580ab51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:35.879716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209c91f-92a5-417f-8444-b3ba1580ab51 None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:35.880289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209c91f-92a5-417f-8444-b3ba1580ab51 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:35.880762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209c91f-92a5-417f-8444-b3ba1580ab51 None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:35.881767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209c91f-92a5-417f-8444-b3ba1580ab51 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:35.883491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209c91f-92a5-417f-8444-b3ba1580ab51 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:35.970501 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 15/32] 10.222.0.43 () {60 vars in 1131 bytes} [Sat Jul 2 20:43:35 2022] POST /identity/v3/roles => generated 225 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:43:35.971450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df414077-db2e-4e76-90d7-1cc386432915 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:36.030738 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 18/33] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Jul 2 20:43:35 2022] POST /identity/v3/projects => generated 301 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:43:36.032947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d6885-e1a8-4e63-b2a0-97ea88617885 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:36.033674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d6885-e1a8-4e63-b2a0-97ea88617885 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:36.034194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d6885-e1a8-4e63-b2a0-97ea88617885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:36.072544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ad1d6885-e1a8-4e63-b2a0-97ea88617885 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:36.081019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ad1d6885-e1a8-4e63-b2a0-97ea88617885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:36.127230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:36.135445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:36.144405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df414077-db2e-4e76-90d7-1cc386432915 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:36.173897 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 19/34] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:36.175164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdcb00-21e3-4bcd-a063-9ca0d9eaaa2e None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:36.175504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdcb00-21e3-4bcd-a063-9ca0d9eaaa2e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:36.175881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdcb00-21e3-4bcd-a063-9ca0d9eaaa2e None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:36.177440 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 20/35] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:36.178435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16c889-68f5-4bfa-be1c-99d7eb2cf3ec None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:36.178730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16c889-68f5-4bfa-be1c-99d7eb2cf3ec None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:36.179012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16c889-68f5-4bfa-be1c-99d7eb2cf3ec None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:36.180878 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 21/36] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:36.186257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ee208-f28a-4c5b-a8f5-4f78a3e21649 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:36.186551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ee208-f28a-4c5b-a8f5-4f78a3e21649 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:36.186840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ee208-f28a-4c5b-a8f5-4f78a3e21649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:36.190109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ce96f-fbcb-4d26-a3b0-a7eb1d413d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:36.191065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ce96f-fbcb-4d26-a3b0-a7eb1d413d3e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:36.191726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ce96f-fbcb-4d26-a3b0-a7eb1d413d3e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:36.192227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ce96f-fbcb-4d26-a3b0-a7eb1d413d3e None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:36.193268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ce96f-fbcb-4d26-a3b0-a7eb1d413d3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:36.193828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ce96f-fbcb-4d26-a3b0-a7eb1d413d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:36.195622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ce96f-fbcb-4d26-a3b0-a7eb1d413d3e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:36.205471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-391ee208-f28a-4c5b-a8f5-4f78a3e21649 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:36.206773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-391ee208-f28a-4c5b-a8f5-4f78a3e21649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:36.210259 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 16/37] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:43:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:36.212838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edf8a6-a840-4b49-9fa4-d22bbc6c3ae8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:36.213131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edf8a6-a840-4b49-9fa4-d22bbc6c3ae8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:36.213410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edf8a6-a840-4b49-9fa4-d22bbc6c3ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:36.233259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-87edf8a6-a840-4b49-9fa4-d22bbc6c3ae8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:36.236922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-87edf8a6-a840-4b49-9fa4-d22bbc6c3ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:36.297490 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 22/38] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:36.299237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ee208-f28a-4c5b-a8f5-4f78a3e21649 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:36.318241 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 17/39] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:36.319207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edf8a6-a840-4b49-9fa4-d22bbc6c3ae8 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:36.407560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:36.407806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:36.412988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ee208-f28a-4c5b-a8f5-4f78a3e21649 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:36.421735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edf8a6-a840-4b49-9fa4-d22bbc6c3ae8 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:36.447579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad19c9b-3430-40ac-a040-6f14d631f7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:36.448289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad19c9b-3430-40ac-a040-6f14d631f7b4 None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:36.448570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad19c9b-3430-40ac-a040-6f14d631f7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:36.448872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad19c9b-3430-40ac-a040-6f14d631f7b4 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:36.449608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad19c9b-3430-40ac-a040-6f14d631f7b4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:36.451156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad19c9b-3430-40ac-a040-6f14d631f7b4 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:36.455464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41cfa2f-e2c6-4671-9514-23d2f60c3cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:36.456413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cfa2f-e2c6-4671-9514-23d2f60c3cbf None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:36.456665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cfa2f-e2c6-4671-9514-23d2f60c3cbf None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:36.457028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cfa2f-e2c6-4671-9514-23d2f60c3cbf None admin] PATH_INFO: `/v3/users/a7a87f488da04c6c9c5276b1487113d6` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:36.458583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41cfa2f-e2c6-4671-9514-23d2f60c3cbf None admin] RBAC: Authorizing `identity:get_user(user_id=a7a87f488da04c6c9c5276b1487113d6)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:36.460008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41cfa2f-e2c6-4671-9514-23d2f60c3cbf None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:36.461678 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 18/40] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:43:36 2022] GET /identity/v3/users/a7a87f488da04c6c9c5276b1487113d6 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:36.462417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41cfa2f-e2c6-4671-9514-23d2f60c3cbf None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:36.474269 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 23/41] 10.222.0.43 () {60 vars in 1131 bytes} [Sat Jul 2 20:43:36 2022] POST /identity/v3/roles => generated 219 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:43:36.474269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad19c9b-3430-40ac-a040-6f14d631f7b4 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:36.578748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41cfa2f-e2c6-4671-9514-23d2f60c3cbf None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:36.581379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad19c9b-3430-40ac-a040-6f14d631f7b4 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:36.616078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d0130-45fd-44b3-ae8b-8af6df0b77b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:36.616329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb203e0-b892-4f77-9cef-7db0ac24ea67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:36.616887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb203e0-b892-4f77-9cef-7db0ac24ea67 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:36.617168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb203e0-b892-4f77-9cef-7db0ac24ea67 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:36.617442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb203e0-b892-4f77-9cef-7db0ac24ea67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:36.617756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d0130-45fd-44b3-ae8b-8af6df0b77b2 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:36.618219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d0130-45fd-44b3-ae8b-8af6df0b77b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:36.618664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb203e0-b892-4f77-9cef-7db0ac24ea67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:36.618766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d0130-45fd-44b3-ae8b-8af6df0b77b2 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:36.619683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d0130-45fd-44b3-ae8b-8af6df0b77b2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:36.620197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb203e0-b892-4f77-9cef-7db0ac24ea67 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:36.621517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d0130-45fd-44b3-ae8b-8af6df0b77b2 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:36.622056 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 24/42] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:43:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:36.622749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb203e0-b892-4f77-9cef-7db0ac24ea67 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:36.643558 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 19/43] 10.222.0.43 () {60 vars in 1131 bytes} [Sat Jul 2 20:43:36 2022] POST /identity/v3/roles => generated 223 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:43:36.644987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d0130-45fd-44b3-ae8b-8af6df0b77b2 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:36.659781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:36.672904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:36.759154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb203e0-b892-4f77-9cef-7db0ac24ea67 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:36.798806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d0130-45fd-44b3-ae8b-8af6df0b77b2 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:36.801320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e2044-7ff3-410b-bf9e-c69d6402fa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:36.802173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e2044-7ff3-410b-bf9e-c69d6402fa37 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:36.802451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e2044-7ff3-410b-bf9e-c69d6402fa37 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:36.802726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e2044-7ff3-410b-bf9e-c69d6402fa37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:36.803999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e2044-7ff3-410b-bf9e-c69d6402fa37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:36.805840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e2044-7ff3-410b-bf9e-c69d6402fa37 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:36.807729 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 25/44] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:43:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:36.813238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e2044-7ff3-410b-bf9e-c69d6402fa37 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:36.838901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe1fe1-b576-4fdb-b724-6ca41b2b1fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:36.840092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe1fe1-b576-4fdb-b724-6ca41b2b1fa4 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:36.840379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe1fe1-b576-4fdb-b724-6ca41b2b1fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:36.840654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe1fe1-b576-4fdb-b724-6ca41b2b1fa4 None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:36.841379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe1fe1-b576-4fdb-b724-6ca41b2b1fa4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:36.842855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe1fe1-b576-4fdb-b724-6ca41b2b1fa4 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:36.875591 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 20/45] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Jul 2 20:43:36 2022] POST /identity/v3/projects => generated 312 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:43:36.933113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:36.941274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e2044-7ff3-410b-bf9e-c69d6402fa37 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:36.977845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef258d-a2bd-4e63-9541-3520842a9df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:36.978739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef258d-a2bd-4e63-9541-3520842a9df3 None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:36.979022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef258d-a2bd-4e63-9541-3520842a9df3 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:36.979306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef258d-a2bd-4e63-9541-3520842a9df3 None admin] PATH_INFO: `/v3/domains/default/users/a7a87f488da04c6c9c5276b1487113d6/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:36.981503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef258d-a2bd-4e63-9541-3520842a9df3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a7a87f488da04c6c9c5276b1487113d6, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:36.983009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef258d-a2bd-4e63-9541-3520842a9df3 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:36.999788 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 26/46] 10.222.0.43 () {58 vars in 1361 bytes} [Sat Jul 2 20:43:36 2022] PUT /identity/v3/domains/default/users/a7a87f488da04c6c9c5276b1487113d6/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 20:43:39.142225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08625ee-9c1c-456c-bb86-d5e4f591e63a None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:39.142788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08625ee-9c1c-456c-bb86-d5e4f591e63a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:39.142788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08625ee-9c1c-456c-bb86-d5e4f591e63a None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:39.144232 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 21/47] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:39.149454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa54d5b-7168-45ca-9752-0f8bf7c7e53c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:39.149913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa54d5b-7168-45ca-9752-0f8bf7c7e53c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:39.150011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa54d5b-7168-45ca-9752-0f8bf7c7e53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:39.167953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2fa54d5b-7168-45ca-9752-0f8bf7c7e53c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:39.169193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2fa54d5b-7168-45ca-9752-0f8bf7c7e53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:39.238109 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 27/48] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:39.255382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519de3b7-ccb7-4756-be23-5d836baea769 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:39.255784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519de3b7-ccb7-4756-be23-5d836baea769 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:39.256276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519de3b7-ccb7-4756-be23-5d836baea769 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:39.258453 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 22/49] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:39.263523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519de3b7-ccb7-4756-be23-5d836baea769 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:39.263660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1feaeb-a1cb-459e-853c-c1d66b977197 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:39.263951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1feaeb-a1cb-459e-853c-c1d66b977197 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:39.264262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1feaeb-a1cb-459e-853c-c1d66b977197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:39.280759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8e1feaeb-a1cb-459e-853c-c1d66b977197 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:39.281949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8e1feaeb-a1cb-459e-853c-c1d66b977197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:39.348419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:39.349212 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 28/50] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:39.378755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1feaeb-a1cb-459e-853c-c1d66b977197 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:39.389431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519de3b7-ccb7-4756-be23-5d836baea769 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:39.393746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:39.424463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf717fe-c120-4133-8ba7-0c482f392c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:39.425357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf717fe-c120-4133-8ba7-0c482f392c5e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:39.425640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf717fe-c120-4133-8ba7-0c482f392c5e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:39.426035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf717fe-c120-4133-8ba7-0c482f392c5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:39.427413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf717fe-c120-4133-8ba7-0c482f392c5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:39.428904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf717fe-c120-4133-8ba7-0c482f392c5e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:39.430855 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 23/51] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:43:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:39.436348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf717fe-c120-4133-8ba7-0c482f392c5e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:39.481609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1feaeb-a1cb-459e-853c-c1d66b977197 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:39.515369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2805d08-18e1-401e-afc5-4e34b66449ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:39.516431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2805d08-18e1-401e-afc5-4e34b66449ab None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:39.516711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2805d08-18e1-401e-afc5-4e34b66449ab None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:39.516988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2805d08-18e1-401e-afc5-4e34b66449ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:39.527019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2805d08-18e1-401e-afc5-4e34b66449ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:43:39.533632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf717fe-c120-4133-8ba7-0c482f392c5e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:39.534610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-d2805d08-18e1-401e-afc5-4e34b66449ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:43:39.534610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:43:39.534610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:43:39.534610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:43:39.534610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:43:39.534610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:43:39.534610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:43:39.534610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:43:39.534610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:43:39.534610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:43:39.534610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:43:39.534610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:43:39.534610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:43:39.534610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:43:39.534610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:43:39.534610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:43:39.535543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:43:39.535543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:43:39.535543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:43:39.535543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:43:39.535543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:43:39.535543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:43:39.535543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:43:39.535543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:43:39.535543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:43:39.535543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:43:39.535543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:43:39.535543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:43:39.535543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:43:39.535543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:43:39.535543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:43:39.535543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:43:39.536506 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:43:39.536506 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:43:39.536506 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:43:39.536506 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:43:39.536506 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:43:39.536506 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:43:39.536506 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:43:39.536506 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:43:39.536506 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:43:39.536506 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:43:39.536506 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:43:39.536506 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:43:39.536506 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 29/52] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:43:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:43:39.541779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2805d08-18e1-401e-afc5-4e34b66449ab None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:39.574274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b84ae-e9e1-4c35-b1a1-3385bb24715a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:39.574929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b84ae-e9e1-4c35-b1a1-3385bb24715a None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:39.575209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b84ae-e9e1-4c35-b1a1-3385bb24715a None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:39.575488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b84ae-e9e1-4c35-b1a1-3385bb24715a None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:39.576232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b84ae-e9e1-4c35-b1a1-3385bb24715a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:39.577672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b84ae-e9e1-4c35-b1a1-3385bb24715a None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:39.581804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:39.603317 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 24/53] 10.222.0.43 () {60 vars in 1140 bytes} [Sat Jul 2 20:43:39 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:43:39.618697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:39.647129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2805d08-18e1-401e-afc5-4e34b66449ab None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:39.691770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d5123-3450-4ba6-8f51-409b70004600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:39.692497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d5123-3450-4ba6-8f51-409b70004600 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:39.692781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d5123-3450-4ba6-8f51-409b70004600 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:39.693059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d5123-3450-4ba6-8f51-409b70004600 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:39.693873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d5123-3450-4ba6-8f51-409b70004600 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:39.694185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d5123-3450-4ba6-8f51-409b70004600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:39.695670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d5123-3450-4ba6-8f51-409b70004600 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:39.705519 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 30/54] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:43:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:43:39.711888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b84ae-e9e1-4c35-b1a1-3385bb24715a None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:39.830824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b84ae-e9e1-4c35-b1a1-3385bb24715a None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:39.865087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69820fe7-fe4a-49ba-a45f-497e0d579ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:39.865888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69820fe7-fe4a-49ba-a45f-497e0d579ea4 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:39.866164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69820fe7-fe4a-49ba-a45f-497e0d579ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:39.866436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69820fe7-fe4a-49ba-a45f-497e0d579ea4 None admin] PATH_INFO: `/v3/users/a7a87f488da04c6c9c5276b1487113d6` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:39.867649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69820fe7-fe4a-49ba-a45f-497e0d579ea4 None admin] RBAC: Authorizing `identity:get_user(user_id=a7a87f488da04c6c9c5276b1487113d6)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:39.869149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69820fe7-fe4a-49ba-a45f-497e0d579ea4 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:39.870822 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 25/55] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:43:39 2022] GET /identity/v3/users/a7a87f488da04c6c9c5276b1487113d6 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:39.876365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d5123-3450-4ba6-8f51-409b70004600 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:39.978856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d5123-3450-4ba6-8f51-409b70004600 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:40.016720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4da3c1-d6c7-4715-883b-410eaaf2f7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:40.017517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4da3c1-d6c7-4715-883b-410eaaf2f7b1 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:40.017794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4da3c1-d6c7-4715-883b-410eaaf2f7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:40.018067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4da3c1-d6c7-4715-883b-410eaaf2f7b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:40.019575 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4da3c1-d6c7-4715-883b-410eaaf2f7b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:40.021069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4da3c1-d6c7-4715-883b-410eaaf2f7b1 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:40.022686 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 31/56] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:43:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:40.028601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69820fe7-fe4a-49ba-a45f-497e0d579ea4 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:40.086497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:40.134798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69820fe7-fe4a-49ba-a45f-497e0d579ea4 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:40.169223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ce303-31c4-4051-9799-84816508922f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:40.169858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ce303-31c4-4051-9799-84816508922f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:40.170167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ce303-31c4-4051-9799-84816508922f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:40.170440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ce303-31c4-4051-9799-84816508922f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:40.171252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ce303-31c4-4051-9799-84816508922f None admin] RBAC: Adding query filter params (role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.domain.id=default, user.id=a7a87f488da04c6c9c5276b1487113d6) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:40.171560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ce303-31c4-4051-9799-84816508922f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:40.173076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ce303-31c4-4051-9799-84816508922f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:40.182730 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 26/57] 10.222.0.43 () {56 vars in 1322 bytes} [Sat Jul 2 20:43:40 2022] GET /identity/v3/role_assignments?user.id=a7a87f488da04c6c9c5276b1487113d6&scope.domain.id=default&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:41.926991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9bbad-e210-44fa-89ad-e34ef6c8353b None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:41.927859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9bbad-e210-44fa-89ad-e34ef6c8353b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:41.928001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9bbad-e210-44fa-89ad-e34ef6c8353b None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:41.930613 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 32/58] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:41.939356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9f945-4cdb-4df6-99b1-745d99b622fe None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:41.940130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9f945-4cdb-4df6-99b1-745d99b622fe None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:41.940388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9f945-4cdb-4df6-99b1-745d99b622fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:41.958231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-99d9f945-4cdb-4df6-99b1-745d99b622fe None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:41.959455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-99d9f945-4cdb-4df6-99b1-745d99b622fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:42.031481 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 27/59] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:42.057787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9bbad-e210-44fa-89ad-e34ef6c8353b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:42.062046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:42.171621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9bbad-e210-44fa-89ad-e34ef6c8353b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:42.207704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157baed1-f5e9-495b-8b3f-62e2bf27daf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:42.208451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157baed1-f5e9-495b-8b3f-62e2bf27daf7 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:42.208731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157baed1-f5e9-495b-8b3f-62e2bf27daf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:42.209007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157baed1-f5e9-495b-8b3f-62e2bf27daf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:42.210295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157baed1-f5e9-495b-8b3f-62e2bf27daf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:42.211777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157baed1-f5e9-495b-8b3f-62e2bf27daf7 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:42.213453 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 33/60] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:43:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:42.221961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9f945-4cdb-4df6-99b1-745d99b622fe None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:42.274128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:42.328864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9f945-4cdb-4df6-99b1-745d99b622fe None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:42.367919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e8e17-d925-449a-9303-9b672193aa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:42.368626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e8e17-d925-449a-9303-9b672193aa47 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:42.368910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e8e17-d925-449a-9303-9b672193aa47 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:42.369191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e8e17-d925-449a-9303-9b672193aa47 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:42.369919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e8e17-d925-449a-9303-9b672193aa47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:42.371400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e8e17-d925-449a-9303-9b672193aa47 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:42.402767 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 28/61] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Jul 2 20:43:42 2022] POST /identity/v3/users => generated 275 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:43:45.878717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042d0a4-e423-4590-85a7-b05068973dd8 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:45.879749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042d0a4-e423-4590-85a7-b05068973dd8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:45.880262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042d0a4-e423-4590-85a7-b05068973dd8 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:45.882122 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 34/62] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:45.887294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cc384-16df-4721-ae49-4806b465d41c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:45.888152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cc384-16df-4721-ae49-4806b465d41c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:45.888639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cc384-16df-4721-ae49-4806b465d41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:45.910632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-934cc384-16df-4721-ae49-4806b465d41c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:45.911853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-934cc384-16df-4721-ae49-4806b465d41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:46.002329 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 29/63] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:46.041879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042d0a4-e423-4590-85a7-b05068973dd8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:46.070554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2b4b9-a9a6-42c4-82e4-40b53795baab None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:46.070962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2b4b9-a9a6-42c4-82e4-40b53795baab None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:46.071244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2b4b9-a9a6-42c4-82e4-40b53795baab None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:46.073110 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 30/64] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:43:46.080249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b1aed-87f8-4c44-8e11-b596705e0540 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:46.080785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b1aed-87f8-4c44-8e11-b596705e0540 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:46.082831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b1aed-87f8-4c44-8e11-b596705e0540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:46.108444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-663b1aed-87f8-4c44-8e11-b596705e0540 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:46.110430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-663b1aed-87f8-4c44-8e11-b596705e0540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:46.138191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:46.147388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:46.185264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042d0a4-e423-4590-85a7-b05068973dd8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:46.194651 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 31/65] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:46.196605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd42e2-f741-408a-97b7-45712fe816eb None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:46.197124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd42e2-f741-408a-97b7-45712fe816eb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:46.197625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd42e2-f741-408a-97b7-45712fe816eb None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:46.203605 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 32/66] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:46.205430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b45229-6512-48b4-b76d-04950dbb9432 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:46.205933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b45229-6512-48b4-b76d-04950dbb9432 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:46.206437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b45229-6512-48b4-b76d-04950dbb9432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:46.236799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-77b45229-6512-48b4-b76d-04950dbb9432 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:46.239133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-77b45229-6512-48b4-b76d-04950dbb9432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:46.244642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f0aea-72ac-490d-8762-5d31244c0b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:46.245537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f0aea-72ac-490d-8762-5d31244c0b14 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:46.245914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f0aea-72ac-490d-8762-5d31244c0b14 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:46.246262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f0aea-72ac-490d-8762-5d31244c0b14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:46.260126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f0aea-72ac-490d-8762-5d31244c0b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:43:46.270559 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-732f0aea-72ac-490d-8762-5d31244c0b14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:43:46.270559 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:43:46.270559 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:43:46.270559 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:43:46.270559 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:43:46.270559 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:43:46.270559 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:43:46.270559 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:43:46.270559 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:43:46.270559 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:43:46.270559 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:43:46.270559 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:43:46.270559 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:43:46.270559 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:43:46.270559 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:43:46.270559 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:43:46.271440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:43:46.271440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:43:46.271440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:43:46.271440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:43:46.271440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:43:46.271440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:43:46.271440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:43:46.271440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:43:46.271440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:43:46.271440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:43:46.271440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:43:46.271440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:43:46.271440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:43:46.271440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:43:46.271440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:43:46.271440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:43:46.272270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:43:46.272270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:43:46.272270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:43:46.272270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:43:46.272270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:43:46.272270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:43:46.272270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:43:46.272270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:43:46.272270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:43:46.272270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:43:46.272270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:43:46.272270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:43:46.272270 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 35/67] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:43:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:43:46.272948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f0aea-72ac-490d-8762-5d31244c0b14 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:46.322466 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 33/68] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:46.323621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b45229-6512-48b4-b76d-04950dbb9432 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:46.387682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f0aea-72ac-490d-8762-5d31244c0b14 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:46.419886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:46.425470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f03a6-53c3-4a8f-9af8-b9bd65d2b0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:46.426791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f03a6-53c3-4a8f-9af8-b9bd65d2b0e4 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:46.427448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f03a6-53c3-4a8f-9af8-b9bd65d2b0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:46.427899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f03a6-53c3-4a8f-9af8-b9bd65d2b0e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:46.433081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:46.439613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b45229-6512-48b4-b76d-04950dbb9432 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:46.441645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f03a6-53c3-4a8f-9af8-b9bd65d2b0e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:43:46.451596 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-0f7f03a6-53c3-4a8f-9af8-b9bd65d2b0e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:43:46.451596 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:43:46.451596 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:43:46.451596 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:43:46.451596 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:43:46.451596 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:43:46.451596 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:43:46.451596 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:43:46.451596 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:43:46.451596 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:43:46.451596 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:43:46.451596 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:43:46.451596 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:43:46.451596 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:43:46.451596 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:43:46.451596 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:43:46.452486 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:43:46.452486 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:43:46.452486 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:43:46.452486 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:43:46.452486 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:43:46.452486 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:43:46.452486 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:43:46.452486 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:43:46.452486 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:43:46.452486 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:43:46.452486 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:43:46.452486 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:43:46.452486 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:43:46.452486 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:43:46.452486 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:43:46.452486 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:43:46.453293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:43:46.453293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:43:46.453293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:43:46.453293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:43:46.453293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:43:46.453293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:43:46.453293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:43:46.453293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:43:46.453293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:43:46.453293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:43:46.453293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:43:46.453293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:43:46.453293 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 36/69] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:43:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:43:46.454661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f03a6-53c3-4a8f-9af8-b9bd65d2b0e4 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:46.476866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786437f-a3b7-4f72-a0b8-ccb01bb5acd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:46.477548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786437f-a3b7-4f72-a0b8-ccb01bb5acd5 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:46.477838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786437f-a3b7-4f72-a0b8-ccb01bb5acd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:46.478119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786437f-a3b7-4f72-a0b8-ccb01bb5acd5 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:46.478868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786437f-a3b7-4f72-a0b8-ccb01bb5acd5 None admin] RBAC: Adding query filter params (name=member) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:46.479349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786437f-a3b7-4f72-a0b8-ccb01bb5acd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:46.480937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786437f-a3b7-4f72-a0b8-ccb01bb5acd5 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:46.490325 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 34/70] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:43:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:46.491852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661f0e7-d380-4586-ba1f-b02f46dde5cc None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:46.492175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661f0e7-d380-4586-ba1f-b02f46dde5cc None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:46.492461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661f0e7-d380-4586-ba1f-b02f46dde5cc None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:46.493689 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 35/71] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:46.494513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661f0e7-d380-4586-ba1f-b02f46dde5cc None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:46.567432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f03a6-53c3-4a8f-9af8-b9bd65d2b0e4 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:46.601062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661f0e7-d380-4586-ba1f-b02f46dde5cc None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:46.602504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1e528-0ba1-4c8f-8a32-16ad62fe339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:46.603319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1e528-0ba1-4c8f-8a32-16ad62fe339a None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:46.603606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1e528-0ba1-4c8f-8a32-16ad62fe339a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:46.603883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1e528-0ba1-4c8f-8a32-16ad62fe339a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:46.616315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1e528-0ba1-4c8f-8a32-16ad62fe339a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:43:46.624465 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-e3a1e528-0ba1-4c8f-8a32-16ad62fe339a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:43:46.624465 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:43:46.624465 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:43:46.624465 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:43:46.624465 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:43:46.624465 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:43:46.624465 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:43:46.624465 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:43:46.624465 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:43:46.624465 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:43:46.624465 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:43:46.624465 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:43:46.624465 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:43:46.624465 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:43:46.624465 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:43:46.624465 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:43:46.625344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:43:46.625344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:43:46.625344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:43:46.625344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:43:46.625344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:43:46.625344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:43:46.625344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:43:46.625344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:43:46.625344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:43:46.625344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:43:46.625344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:43:46.625344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:43:46.625344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:43:46.625344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:43:46.625344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:43:46.625344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:43:46.626268 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:43:46.626268 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:43:46.626268 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:43:46.626268 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:43:46.626268 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:43:46.626268 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:43:46.626268 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:43:46.626268 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:43:46.626268 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:43:46.626268 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:43:46.626268 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:43:46.626268 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:43:46.626268 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 37/72] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:43:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:43:46.627674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1e528-0ba1-4c8f-8a32-16ad62fe339a None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:46.638840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e311cc0-3ddc-4984-be01-6ba97cbce80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:46.639511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e311cc0-3ddc-4984-be01-6ba97cbce80d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:46.639798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e311cc0-3ddc-4984-be01-6ba97cbce80d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:46.640104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e311cc0-3ddc-4984-be01-6ba97cbce80d None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:46.640860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e311cc0-3ddc-4984-be01-6ba97cbce80d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:46.641174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e311cc0-3ddc-4984-be01-6ba97cbce80d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:46.642582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e311cc0-3ddc-4984-be01-6ba97cbce80d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:46.655645 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 36/73] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:43:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:46.655645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60d579-b6b5-43c7-9094-4201b0c15b41 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:46.655645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60d579-b6b5-43c7-9094-4201b0c15b41 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:46.655645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60d579-b6b5-43c7-9094-4201b0c15b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:46.671261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3a60d579-b6b5-43c7-9094-4201b0c15b41 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:46.672425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3a60d579-b6b5-43c7-9094-4201b0c15b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:46.678531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:46.686884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:46.725903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1e528-0ba1-4c8f-8a32-16ad62fe339a None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:46.738123 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 37/74] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:46.739624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b8f82-89b4-4309-b778-d786174f5d21 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:46.739920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b8f82-89b4-4309-b778-d786174f5d21 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:46.740234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b8f82-89b4-4309-b778-d786174f5d21 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:46.741456 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 38/75] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:46.742365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b8f82-89b4-4309-b778-d786174f5d21 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:46.774575 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f7d2c-1243-482e-b3da-d469674ab449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:46.775460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f7d2c-1243-482e-b3da-d469674ab449 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:46.775741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f7d2c-1243-482e-b3da-d469674ab449 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:46.776022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f7d2c-1243-482e-b3da-d469674ab449 None admin] PATH_INFO: `/v3/users/01308079b08d469b8f639c49f9b8e1a7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:46.790227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f7d2c-1243-482e-b3da-d469674ab449 None admin] RBAC: Authorizing `identity:get_user(user_id=01308079b08d469b8f639c49f9b8e1a7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:46.791720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f7d2c-1243-482e-b3da-d469674ab449 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:46.793455 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 38/76] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:43:46 2022] GET /identity/v3/users/01308079b08d469b8f639c49f9b8e1a7 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:46.796887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f7d2c-1243-482e-b3da-d469674ab449 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:46.847608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b8f82-89b4-4309-b778-d786174f5d21 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:46.881632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a286ff6-2de5-43d0-ad77-350c420952a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:46.882313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a286ff6-2de5-43d0-ad77-350c420952a6 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:46.882591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a286ff6-2de5-43d0-ad77-350c420952a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:46.882863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a286ff6-2de5-43d0-ad77-350c420952a6 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:46.883603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a286ff6-2de5-43d0-ad77-350c420952a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:46.883904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a286ff6-2de5-43d0-ad77-350c420952a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:46.885319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a286ff6-2de5-43d0-ad77-350c420952a6 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:46.893475 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 39/77] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:43:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:46.894655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a55288-7035-4751-922b-6de179d395c2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:46.894946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a55288-7035-4751-922b-6de179d395c2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:46.895217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a55288-7035-4751-922b-6de179d395c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:46.900080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f7d2c-1243-482e-b3da-d469674ab449 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:46.911022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:46.912093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-68a55288-7035-4751-922b-6de179d395c2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:46.913756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-68a55288-7035-4751-922b-6de179d395c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:46.921905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:46.935797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f78d3-3ccf-4b90-8858-e02f37182c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:46.936697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f78d3-3ccf-4b90-8858-e02f37182c63 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:46.936980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f78d3-3ccf-4b90-8858-e02f37182c63 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:46.937255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f78d3-3ccf-4b90-8858-e02f37182c63 None admin] PATH_INFO: `/v3/users/a7a87f488da04c6c9c5276b1487113d6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:46.938443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f78d3-3ccf-4b90-8858-e02f37182c63 None admin] RBAC: Authorizing `identity:get_user(user_id=a7a87f488da04c6c9c5276b1487113d6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:46.939894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f78d3-3ccf-4b90-8858-e02f37182c63 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:46.941784 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 39/78] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:43:46 2022] GET /identity/v3/users/a7a87f488da04c6c9c5276b1487113d6 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:46.942423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f78d3-3ccf-4b90-8858-e02f37182c63 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:46.990674 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 40/79] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:46.991533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a55288-7035-4751-922b-6de179d395c2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:47.055123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f78d3-3ccf-4b90-8858-e02f37182c63 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:47.090894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63fed8-ebfa-48d9-a703-1c5c4e70aed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:47.091699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63fed8-ebfa-48d9-a703-1c5c4e70aed4 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:47.091983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63fed8-ebfa-48d9-a703-1c5c4e70aed4 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:47.092307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63fed8-ebfa-48d9-a703-1c5c4e70aed4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:47.093497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63fed8-ebfa-48d9-a703-1c5c4e70aed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:47.094953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63fed8-ebfa-48d9-a703-1c5c4e70aed4 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:47.096698 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 40/80] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:43:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:47.097531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63fed8-ebfa-48d9-a703-1c5c4e70aed4 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:47.106759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a55288-7035-4751-922b-6de179d395c2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:47.141885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98fd82-7528-4970-a747-7270dce47755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:47.142531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98fd82-7528-4970-a747-7270dce47755 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:47.142813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98fd82-7528-4970-a747-7270dce47755 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:47.143088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98fd82-7528-4970-a747-7270dce47755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:47.143428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:47.154979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:47.196170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63fed8-ebfa-48d9-a703-1c5c4e70aed4 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:47.210947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98fd82-7528-4970-a747-7270dce47755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:47.212475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98fd82-7528-4970-a747-7270dce47755 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:47.230110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b987ac-7265-4ae1-be3b-93d0fbfbd917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:47.230996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b987ac-7265-4ae1-be3b-93d0fbfbd917 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:47.231282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b987ac-7265-4ae1-be3b-93d0fbfbd917 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:47.231561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b987ac-7265-4ae1-be3b-93d0fbfbd917 None admin] PATH_INFO: `/v3/users/01308079b08d469b8f639c49f9b8e1a7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:47.232783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b987ac-7265-4ae1-be3b-93d0fbfbd917 None admin] RBAC: Authorizing `identity:get_user(user_id=01308079b08d469b8f639c49f9b8e1a7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:47.234245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b987ac-7265-4ae1-be3b-93d0fbfbd917 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:47.235896 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 41/81] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:43:47 2022] GET /identity/v3/users/01308079b08d469b8f639c49f9b8e1a7 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:47.236682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b987ac-7265-4ae1-be3b-93d0fbfbd917 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:47.312169 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 41/82] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:43:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:43:47.313439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98fd82-7528-4970-a747-7270dce47755 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:47.338111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b987ac-7265-4ae1-be3b-93d0fbfbd917 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:47.356871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:47.363583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:47.377946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e6d84-6f69-462f-a500-929788a2bea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:47.378609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e6d84-6f69-462f-a500-929788a2bea0 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:47.378899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e6d84-6f69-462f-a500-929788a2bea0 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:47.379180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e6d84-6f69-462f-a500-929788a2bea0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:47.419243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98fd82-7528-4970-a747-7270dce47755 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:47.446249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e6d84-6f69-462f-a500-929788a2bea0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:47.447682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e6d84-6f69-462f-a500-929788a2bea0 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:47.454500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145162d-4ae0-46f9-b719-b1dfcca9ef4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:47.455291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145162d-4ae0-46f9-b719-b1dfcca9ef4e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:47.455628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145162d-4ae0-46f9-b719-b1dfcca9ef4e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:47.455986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145162d-4ae0-46f9-b719-b1dfcca9ef4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:47.467236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145162d-4ae0-46f9-b719-b1dfcca9ef4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:43:47.476330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-a145162d-4ae0-46f9-b719-b1dfcca9ef4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:43:47.476330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:43:47.476330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:43:47.476330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:43:47.476330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:43:47.476330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:43:47.476330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:43:47.476330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:43:47.476330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:43:47.476330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:43:47.476330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:43:47.476330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:43:47.476330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:43:47.476330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:43:47.476330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:43:47.476330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:43:47.477228 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:43:47.477228 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:43:47.477228 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:43:47.477228 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:43:47.477228 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:43:47.477228 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:43:47.477228 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:43:47.477228 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:43:47.477228 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:43:47.477228 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:43:47.477228 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:43:47.477228 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:43:47.477228 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:43:47.477228 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:43:47.477228 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:43:47.477228 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:43:47.478018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:43:47.478018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:43:47.478018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:43:47.478018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:43:47.478018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:43:47.478018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:43:47.478018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:43:47.478018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:43:47.478018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:43:47.478018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:43:47.478018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:43:47.478018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:43:47.478018 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 42/83] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:43:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:43:47.478673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145162d-4ae0-46f9-b719-b1dfcca9ef4e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:47.548688 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 42/84] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:43:47.549849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e6d84-6f69-462f-a500-929788a2bea0 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:47.565274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:47.581640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145162d-4ae0-46f9-b719-b1dfcca9ef4e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:47.583211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:47.615193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6876b-b08a-45b3-a38a-e2f3a7fca651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:47.615861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6876b-b08a-45b3-a38a-e2f3a7fca651 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:47.616280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6876b-b08a-45b3-a38a-e2f3a7fca651 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:47.616586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6876b-b08a-45b3-a38a-e2f3a7fca651 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:47.617313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6876b-b08a-45b3-a38a-e2f3a7fca651 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:47.618809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6876b-b08a-45b3-a38a-e2f3a7fca651 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:47.638071 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 43/85] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Jul 2 20:43:47 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:43:47.638849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6876b-b08a-45b3-a38a-e2f3a7fca651 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:47.650854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e6d84-6f69-462f-a500-929788a2bea0 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:47.689570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf736ee-b9d0-481c-b925-2a22761547a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:47.690382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf736ee-b9d0-481c-b925-2a22761547a5 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:47.690668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf736ee-b9d0-481c-b925-2a22761547a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:47.690938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf736ee-b9d0-481c-b925-2a22761547a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:47.755944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6876b-b08a-45b3-a38a-e2f3a7fca651 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:47.767351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf736ee-b9d0-481c-b925-2a22761547a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:47.768908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf736ee-b9d0-481c-b925-2a22761547a5 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:47.786102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:47.792670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd056e32-0b61-48c9-b9d5-083dca7472c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:47.793558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd056e32-0b61-48c9-b9d5-083dca7472c6 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:47.793838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd056e32-0b61-48c9-b9d5-083dca7472c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:47.794109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd056e32-0b61-48c9-b9d5-083dca7472c6 None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:47.795393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd056e32-0b61-48c9-b9d5-083dca7472c6 None admin] RBAC: Authorizing `identity:get_project(project_id=7b6fb712e361438587cb7af5e9fdce33)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:47.796880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd056e32-0b61-48c9-b9d5-083dca7472c6 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:47.798885 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 44/86] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:43:47 2022] GET /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:47.799410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd056e32-0b61-48c9-b9d5-083dca7472c6 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:47.834779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:47.899547 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 43/87] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:43:47.900877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf736ee-b9d0-481c-b925-2a22761547a5 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:47.933009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd056e32-0b61-48c9-b9d5-083dca7472c6 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:47.981004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0026351-efa8-4618-ad15-38fe09bcefd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:47.982038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0026351-efa8-4618-ad15-38fe09bcefd2 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:47.982415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0026351-efa8-4618-ad15-38fe09bcefd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:47.982814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0026351-efa8-4618-ad15-38fe09bcefd2 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:47.983578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0026351-efa8-4618-ad15-38fe09bcefd2 None admin] RBAC: Adding query filter params (name=member) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:47.983920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0026351-efa8-4618-ad15-38fe09bcefd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:47.985368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0026351-efa8-4618-ad15-38fe09bcefd2 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:47.995100 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 45/88] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:43:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:47.995776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0026351-efa8-4618-ad15-38fe09bcefd2 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:48.032169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf736ee-b9d0-481c-b925-2a22761547a5 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:48.044432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:48.065750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37638b6-675e-44dd-826a-6d40d8f2f30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:48.066624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37638b6-675e-44dd-826a-6d40d8f2f30c None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:48.066907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37638b6-675e-44dd-826a-6d40d8f2f30c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:48.067184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37638b6-675e-44dd-826a-6d40d8f2f30c None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:48.068414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37638b6-675e-44dd-826a-6d40d8f2f30c None admin] RBAC: Authorizing `identity:get_project(project_id=7b6fb712e361438587cb7af5e9fdce33)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:48.069880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37638b6-675e-44dd-826a-6d40d8f2f30c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:48.071961 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 44/89] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:43:47 2022] GET /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:48.072762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37638b6-675e-44dd-826a-6d40d8f2f30c None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:48.118405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:48.134607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0026351-efa8-4618-ad15-38fe09bcefd2 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:48.182192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e291a9-c882-403e-9722-d51245c1b02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:48.183099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e291a9-c882-403e-9722-d51245c1b02b None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:48.183404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e291a9-c882-403e-9722-d51245c1b02b None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:48.183706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e291a9-c882-403e-9722-d51245c1b02b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:48.184837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e291a9-c882-403e-9722-d51245c1b02b None admin] RBAC: Adding query filter params (role.id=dd546359e98c4932adc5eef83b817e81, scope.project.id=7b6fb712e361438587cb7af5e9fdce33, user.id=01308079b08d469b8f639c49f9b8e1a7) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:48.185156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e291a9-c882-403e-9722-d51245c1b02b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:48.187302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e291a9-c882-403e-9722-d51245c1b02b None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:48.191999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37638b6-675e-44dd-826a-6d40d8f2f30c None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:48.194465 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 46/90] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:43:47 2022] GET /identity/v3/role_assignments?user.id=01308079b08d469b8f639c49f9b8e1a7&scope.project.id=7b6fb712e361438587cb7af5e9fdce33&role.id=dd546359e98c4932adc5eef83b817e81 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:48.196732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e291a9-c882-403e-9722-d51245c1b02b None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:48.265632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16761850-870b-4ab5-a560-1cb848e50b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:48.267513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16761850-870b-4ab5-a560-1cb848e50b7b None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:48.268290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16761850-870b-4ab5-a560-1cb848e50b7b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:48.271144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16761850-870b-4ab5-a560-1cb848e50b7b None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:48.272865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16761850-870b-4ab5-a560-1cb848e50b7b None admin] RBAC: Authorizing `identity:get_project(project_id=7b6fb712e361438587cb7af5e9fdce33)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:48.277905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16761850-870b-4ab5-a560-1cb848e50b7b None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:48.282996 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 45/91] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:43:48 2022] GET /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:48.284458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16761850-870b-4ab5-a560-1cb848e50b7b None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:48.386610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:48.411792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e291a9-c882-403e-9722-d51245c1b02b None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:48.467562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16761850-870b-4ab5-a560-1cb848e50b7b None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:48.468262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a6fb7-596b-47c5-8fb5-8972aba326e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:48.469621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a6fb7-596b-47c5-8fb5-8972aba326e7 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:48.470089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a6fb7-596b-47c5-8fb5-8972aba326e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:48.471533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a6fb7-596b-47c5-8fb5-8972aba326e7 None admin] PATH_INFO: `/v3/users/01308079b08d469b8f639c49f9b8e1a7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:48.472985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a6fb7-596b-47c5-8fb5-8972aba326e7 None admin] RBAC: Authorizing `identity:get_user(user_id=01308079b08d469b8f639c49f9b8e1a7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:48.474675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a6fb7-596b-47c5-8fb5-8972aba326e7 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:48.477073 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 47/92] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:43:48 2022] GET /identity/v3/users/01308079b08d469b8f639c49f9b8e1a7 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:48.478165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a6fb7-596b-47c5-8fb5-8972aba326e7 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:48.506919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36080d-5ff6-4c6a-80a1-b00eb29d7087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:48.507637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:48.508512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36080d-5ff6-4c6a-80a1-b00eb29d7087 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:48.508640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36080d-5ff6-4c6a-80a1-b00eb29d7087 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:48.508936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36080d-5ff6-4c6a-80a1-b00eb29d7087 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:48.509826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36080d-5ff6-4c6a-80a1-b00eb29d7087 None admin] RBAC: Adding query filter params (role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.project.id=7b6fb712e361438587cb7af5e9fdce33, user.id=a7a87f488da04c6c9c5276b1487113d6) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:48.510185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36080d-5ff6-4c6a-80a1-b00eb29d7087 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:48.511807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36080d-5ff6-4c6a-80a1-b00eb29d7087 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:48.519225 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 46/93] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:43:48 2022] GET /identity/v3/role_assignments?user.id=a7a87f488da04c6c9c5276b1487113d6&scope.project.id=7b6fb712e361438587cb7af5e9fdce33&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:48.519857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36080d-5ff6-4c6a-80a1-b00eb29d7087 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:48.647424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a6fb7-596b-47c5-8fb5-8972aba326e7 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:48.716655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f5723-993a-4a49-b163-a418804aa9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:48.717878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f5723-993a-4a49-b163-a418804aa9f1 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:48.718618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f5723-993a-4a49-b163-a418804aa9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:48.719133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f5723-993a-4a49-b163-a418804aa9f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:48.720169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f5723-993a-4a49-b163-a418804aa9f1 None admin] RBAC: Adding query filter params (role.id=74cf644f6b8f49ce86fffcde317f8883, scope.project.id=7b6fb712e361438587cb7af5e9fdce33, user.id=01308079b08d469b8f639c49f9b8e1a7) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:48.720689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f5723-993a-4a49-b163-a418804aa9f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:48.730145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f5723-993a-4a49-b163-a418804aa9f1 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:48.736894 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 48/94] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:43:48 2022] GET /identity/v3/role_assignments?user.id=01308079b08d469b8f639c49f9b8e1a7&scope.project.id=7b6fb712e361438587cb7af5e9fdce33&role.id=74cf644f6b8f49ce86fffcde317f8883 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:48.738223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36080d-5ff6-4c6a-80a1-b00eb29d7087 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:48.770263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:48.805167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c8cf3-110a-4705-85a0-82d8481118a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:48.805869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c8cf3-110a-4705-85a0-82d8481118a5 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:48.806156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c8cf3-110a-4705-85a0-82d8481118a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:48.806437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c8cf3-110a-4705-85a0-82d8481118a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:48.898906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c8cf3-110a-4705-85a0-82d8481118a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:48.900359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c8cf3-110a-4705-85a0-82d8481118a5 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:49.021548 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 47/95] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:43:49.027463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f5723-993a-4a49-b163-a418804aa9f1 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:49.146236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:49.168519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f5723-993a-4a49-b163-a418804aa9f1 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:49.214677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b3753-c6bf-4755-b3ce-3d27bc1e43e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:49.215566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b3753-c6bf-4755-b3ce-3d27bc1e43e3 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:49.215845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b3753-c6bf-4755-b3ce-3d27bc1e43e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:49.216203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b3753-c6bf-4755-b3ce-3d27bc1e43e3 None admin] PATH_INFO: `/v3/projects/9850be07090e4c8ba576673c9d00bce3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:49.217469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b3753-c6bf-4755-b3ce-3d27bc1e43e3 None admin] RBAC: Authorizing `identity:get_project(project_id=9850be07090e4c8ba576673c9d00bce3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:49.218928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b3753-c6bf-4755-b3ce-3d27bc1e43e3 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:49.220687 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 49/96] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:43:49 2022] GET /identity/v3/projects/9850be07090e4c8ba576673c9d00bce3 => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:49.226573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c8cf3-110a-4705-85a0-82d8481118a5 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:49.245537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:49.355739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c8cf3-110a-4705-85a0-82d8481118a5 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:49.406599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9eadcf-31bf-40c9-b9c1-9bc6c506d665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:49.407268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9eadcf-31bf-40c9-b9c1-9bc6c506d665 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:49.407556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9eadcf-31bf-40c9-b9c1-9bc6c506d665 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:49.407838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9eadcf-31bf-40c9-b9c1-9bc6c506d665 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:49.408698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9eadcf-31bf-40c9-b9c1-9bc6c506d665 None admin] RBAC: Adding query filter params (role.id=dd546359e98c4932adc5eef83b817e81, scope.project.id=9850be07090e4c8ba576673c9d00bce3, user.id=01308079b08d469b8f639c49f9b8e1a7) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:49.409081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9eadcf-31bf-40c9-b9c1-9bc6c506d665 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:49.410560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9eadcf-31bf-40c9-b9c1-9bc6c506d665 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:49.416520 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 48/97] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:43:49 2022] GET /identity/v3/role_assignments?user.id=01308079b08d469b8f639c49f9b8e1a7&scope.project.id=9850be07090e4c8ba576673c9d00bce3&role.id=dd546359e98c4932adc5eef83b817e81 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:50.866563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e28257-77e1-47bd-a033-164aa49b78b5 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:50.867194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e28257-77e1-47bd-a033-164aa49b78b5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:50.867194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e28257-77e1-47bd-a033-164aa49b78b5 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:50.868535 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 50/98] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:50.874011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb9883-e9df-461a-a09e-2cca4e49f81b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:50.874432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb9883-e9df-461a-a09e-2cca4e49f81b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:50.874602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb9883-e9df-461a-a09e-2cca4e49f81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:50.895858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2afb9883-e9df-461a-a09e-2cca4e49f81b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:50.897100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2afb9883-e9df-461a-a09e-2cca4e49f81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:50.982415 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 49/99] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:51.020879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e28257-77e1-47bd-a033-164aa49b78b5 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:51.151375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e28257-77e1-47bd-a033-164aa49b78b5 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:51.153378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ea7fb-0fbb-4c21-8422-c30bc624f862 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:51.153914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ea7fb-0fbb-4c21-8422-c30bc624f862 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:51.154202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ea7fb-0fbb-4c21-8422-c30bc624f862 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:51.155927 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 50/100] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:51.164793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e229f-6ced-4e71-8283-91a0fbb9e788 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:51.165337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e229f-6ced-4e71-8283-91a0fbb9e788 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:51.165831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e229f-6ced-4e71-8283-91a0fbb9e788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:51.193852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2b4e229f-6ced-4e71-8283-91a0fbb9e788 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:51.195055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2b4e229f-6ced-4e71-8283-91a0fbb9e788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:51.199421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b74674-fbaa-475c-88b9-3b1855cc6f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:51.200251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b74674-fbaa-475c-88b9-3b1855cc6f51 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:51.200537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b74674-fbaa-475c-88b9-3b1855cc6f51 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:51.200818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b74674-fbaa-475c-88b9-3b1855cc6f51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:51.202673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b74674-fbaa-475c-88b9-3b1855cc6f51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:51.204145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b74674-fbaa-475c-88b9-3b1855cc6f51 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:51.204355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:51.210758 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 51/101] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:43:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:51.211619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b74674-fbaa-475c-88b9-3b1855cc6f51 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:51.248572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:51.326661 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 51/102] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:43:51.328296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f61bb-209a-4528-b7a4-713a284260b1 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:51.328591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f61bb-209a-4528-b7a4-713a284260b1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:51.328871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f61bb-209a-4528-b7a4-713a284260b1 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:51.330307 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 52/103] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:51.336078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde976f-cf69-45c4-a01a-d774ac2d6cdd None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:51.336369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde976f-cf69-45c4-a01a-d774ac2d6cdd None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:51.336652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde976f-cf69-45c4-a01a-d774ac2d6cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:51.355917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6bde976f-cf69-45c4-a01a-d774ac2d6cdd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:51.357211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6bde976f-cf69-45c4-a01a-d774ac2d6cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:51.387204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b74674-fbaa-475c-88b9-3b1855cc6f51 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:51.431062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112eaacb-69a0-4f15-addd-1a324e9784f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:51.431891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eaacb-69a0-4f15-addd-1a324e9784f1 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:51.432297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eaacb-69a0-4f15-addd-1a324e9784f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:51.432910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eaacb-69a0-4f15-addd-1a324e9784f1 None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:51.434161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112eaacb-69a0-4f15-addd-1a324e9784f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:51.436363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112eaacb-69a0-4f15-addd-1a324e9784f1 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:51.441335 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 53/104] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:43:51.442372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde976f-cf69-45c4-a01a-d774ac2d6cdd None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:51.498748 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 52/105] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Jul 2 20:43:51 2022] POST /identity/v3/projects => generated 302 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:43:51.499623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112eaacb-69a0-4f15-addd-1a324e9784f1 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:51.558262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:51.641012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde976f-cf69-45c4-a01a-d774ac2d6cdd None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:51.671237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:51.719006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27c91e-db43-4f50-844e-77c004b58e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:51.720784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27c91e-db43-4f50-844e-77c004b58e9b None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:51.721462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27c91e-db43-4f50-844e-77c004b58e9b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:51.721767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27c91e-db43-4f50-844e-77c004b58e9b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:51.730940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112eaacb-69a0-4f15-addd-1a324e9784f1 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:51.733568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27c91e-db43-4f50-844e-77c004b58e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:43:51.742514 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-6a27c91e-db43-4f50-844e-77c004b58e9b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:43:51.742514 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:43:51.742514 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:43:51.742514 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:43:51.742514 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:43:51.742514 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:43:51.742514 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:43:51.742514 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:43:51.742514 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:43:51.742514 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:43:51.742514 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:43:51.742514 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:43:51.742514 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:43:51.742514 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:43:51.742514 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:43:51.742514 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:43:51.743478 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:43:51.743478 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:43:51.743478 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:43:51.743478 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:43:51.743478 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:43:51.743478 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:43:51.743478 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:43:51.743478 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:43:51.743478 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:43:51.743478 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:43:51.743478 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:43:51.743478 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:43:51.743478 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:43:51.743478 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:43:51.743478 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:43:51.743478 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:43:51.744543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:43:51.744543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:43:51.744543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:43:51.744543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:43:51.744543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:43:51.744543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:43:51.744543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:43:51.744543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:43:51.744543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:43:51.744543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:43:51.744543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:43:51.744543 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:43:51.747243 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 54/106] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:43:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:43:51.755022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27c91e-db43-4f50-844e-77c004b58e9b None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:51.808811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6af31-121c-469f-99d0-ef92395c1949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:51.809732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6af31-121c-469f-99d0-ef92395c1949 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:51.810016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6af31-121c-469f-99d0-ef92395c1949 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:51.810292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6af31-121c-469f-99d0-ef92395c1949 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:51.833982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6af31-121c-469f-99d0-ef92395c1949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:43:51.841888 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-9fb6af31-121c-469f-99d0-ef92395c1949 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:43:51.841888 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:43:51.841888 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:43:51.841888 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:43:51.841888 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:43:51.841888 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:43:51.841888 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:43:51.841888 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:43:51.841888 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:43:51.841888 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:43:51.841888 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:43:51.841888 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:43:51.841888 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:43:51.841888 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:43:51.841888 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:43:51.841888 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:43:51.842760 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:43:51.842760 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:43:51.842760 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:43:51.842760 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:43:51.842760 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:43:51.842760 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:43:51.842760 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:43:51.842760 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:43:51.842760 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:43:51.842760 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:43:51.842760 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:43:51.842760 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:43:51.842760 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:43:51.842760 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:43:51.842760 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:43:51.842760 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:43:51.843568 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:43:51.843568 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:43:51.843568 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:43:51.843568 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:43:51.843568 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:43:51.843568 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:43:51.843568 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:43:51.843568 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:43:51.843568 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:43:51.843568 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:43:51.843568 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:43:51.843568 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:43:51.843568 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 53/107] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:43:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:43:51.862452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6af31-121c-469f-99d0-ef92395c1949 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:51.882218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27c91e-db43-4f50-844e-77c004b58e9b None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:51.914460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:51.926752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66efb3c-0e4a-4209-814e-64f79a48a2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:51.927438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66efb3c-0e4a-4209-814e-64f79a48a2d9 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:51.927725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66efb3c-0e4a-4209-814e-64f79a48a2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:51.928005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66efb3c-0e4a-4209-814e-64f79a48a2d9 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:51.928779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66efb3c-0e4a-4209-814e-64f79a48a2d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:51.929430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66efb3c-0e4a-4209-814e-64f79a48a2d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:51.930812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66efb3c-0e4a-4209-814e-64f79a48a2d9 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:51.951652 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 55/108] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:43:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:43:51.957584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66efb3c-0e4a-4209-814e-64f79a48a2d9 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:52.098138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6af31-121c-469f-99d0-ef92395c1949 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:52.112786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66efb3c-0e4a-4209-814e-64f79a48a2d9 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:52.168584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:52.175654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93080fa7-f859-4e1e-8899-719976f9135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:52.176724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93080fa7-f859-4e1e-8899-719976f9135f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:52.177164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93080fa7-f859-4e1e-8899-719976f9135f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:52.177579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93080fa7-f859-4e1e-8899-719976f9135f None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:52.178466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93080fa7-f859-4e1e-8899-719976f9135f None admin] RBAC: Adding query filter params (name=member) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:52.179244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93080fa7-f859-4e1e-8899-719976f9135f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:52.180761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58e11c-b73f-48f9-a53f-ed2f5a4e4002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:52.181032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93080fa7-f859-4e1e-8899-719976f9135f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:52.181670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58e11c-b73f-48f9-a53f-ed2f5a4e4002 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:52.181957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58e11c-b73f-48f9-a53f-ed2f5a4e4002 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:52.182236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58e11c-b73f-48f9-a53f-ed2f5a4e4002 None admin] PATH_INFO: `/v3/users/f6b4da9871f6467eb6e321ff49597215` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:52.191124 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 54/109] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:43:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:43:52.200392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93080fa7-f859-4e1e-8899-719976f9135f None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:52.209652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58e11c-b73f-48f9-a53f-ed2f5a4e4002 None admin] RBAC: Authorizing `identity:get_user(user_id=f6b4da9871f6467eb6e321ff49597215)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:52.211362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58e11c-b73f-48f9-a53f-ed2f5a4e4002 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:52.213323 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 56/110] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:43:51 2022] GET /identity/v3/users/f6b4da9871f6467eb6e321ff49597215 => generated 289 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:52.218962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58e11c-b73f-48f9-a53f-ed2f5a4e4002 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:52.313068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93080fa7-f859-4e1e-8899-719976f9135f None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:52.347867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:52.349230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc28e2-0402-42e8-8413-88299d15ceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:52.350535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc28e2-0402-42e8-8413-88299d15ceb4 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:52.351071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc28e2-0402-42e8-8413-88299d15ceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:52.351489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc28e2-0402-42e8-8413-88299d15ceb4 None admin] PATH_INFO: `/v3/users/01308079b08d469b8f639c49f9b8e1a7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:52.352876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc28e2-0402-42e8-8413-88299d15ceb4 None admin] RBAC: Authorizing `identity:get_user(user_id=01308079b08d469b8f639c49f9b8e1a7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:52.354495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc28e2-0402-42e8-8413-88299d15ceb4 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:52.356331 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 55/111] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:43:52 2022] GET /identity/v3/users/01308079b08d469b8f639c49f9b8e1a7 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:43:52.357688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac64ba-a8ca-4e44-b1d5-da5156c4b18a None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:52.358115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac64ba-a8ca-4e44-b1d5-da5156c4b18a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:52.358560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac64ba-a8ca-4e44-b1d5-da5156c4b18a None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:52.360242 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 56/112] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:52.370073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563db56-7050-4ab2-ac26-ddac8c91ea9f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:52.370364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563db56-7050-4ab2-ac26-ddac8c91ea9f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:52.370642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563db56-7050-4ab2-ac26-ddac8c91ea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:52.392642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3563db56-7050-4ab2-ac26-ddac8c91ea9f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:52.393981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3563db56-7050-4ab2-ac26-ddac8c91ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:52.425044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58e11c-b73f-48f9-a53f-ed2f5a4e4002 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:52.457667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:52.465951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faa9c5-5368-4601-8ea6-fd7083a09e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:52.466810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faa9c5-5368-4601-8ea6-fd7083a09e83 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:52.467258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faa9c5-5368-4601-8ea6-fd7083a09e83 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:52.467674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faa9c5-5368-4601-8ea6-fd7083a09e83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:52.470011 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 57/113] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:52.471889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebc560-20ae-40e0-845c-10f9723847a3 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:52.472425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebc560-20ae-40e0-845c-10f9723847a3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:52.472934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebc560-20ae-40e0-845c-10f9723847a3 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:52.478666 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 58/114] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:52.480641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebc560-20ae-40e0-845c-10f9723847a3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:52.570681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73faa9c5-5368-4601-8ea6-fd7083a09e83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:52.572243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73faa9c5-5368-4601-8ea6-fd7083a09e83 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:52.594086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebc560-20ae-40e0-845c-10f9723847a3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:52.623115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:52.633000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef00d8-5170-462d-869b-1f5eeaa9588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:52.634485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef00d8-5170-462d-869b-1f5eeaa9588d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:52.634972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef00d8-5170-462d-869b-1f5eeaa9588d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:52.635474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef00d8-5170-462d-869b-1f5eeaa9588d None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:52.637081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef00d8-5170-462d-869b-1f5eeaa9588d None admin] RBAC: Authorizing `identity:get_project(project_id=7b6fb712e361438587cb7af5e9fdce33)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:52.638871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef00d8-5170-462d-869b-1f5eeaa9588d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:52.641734 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 59/115] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:43:52 2022] GET /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:52.643525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed6638-0483-46e3-a01e-f56d57c7d66d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:52.644018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed6638-0483-46e3-a01e-f56d57c7d66d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:52.644526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed6638-0483-46e3-a01e-f56d57c7d66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:52.665685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3bed6638-0483-46e3-a01e-f56d57c7d66d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:52.667434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3bed6638-0483-46e3-a01e-f56d57c7d66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:52.686136 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 57/116] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:43:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 20:43:52.690877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faa9c5-5368-4601-8ea6-fd7083a09e83 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:52.735284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:52.748534 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 60/117] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:52.753398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed6638-0483-46e3-a01e-f56d57c7d66d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:52.799027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faa9c5-5368-4601-8ea6-fd7083a09e83 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:52.835633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcc64d-71e6-43a5-a765-ea1575c17334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:52.836604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcc64d-71e6-43a5-a765-ea1575c17334 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:52.836893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcc64d-71e6-43a5-a765-ea1575c17334 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:52.837174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcc64d-71e6-43a5-a765-ea1575c17334 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:52.848203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcc64d-71e6-43a5-a765-ea1575c17334 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:43:52.856984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-84dcc64d-71e6-43a5-a765-ea1575c17334 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:43:52.856984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:43:52.856984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:43:52.856984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:43:52.856984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:43:52.856984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:43:52.856984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:43:52.856984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:43:52.856984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:43:52.856984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:43:52.856984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:43:52.856984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:43:52.856984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:43:52.856984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:43:52.856984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:43:52.856984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:43:52.857917 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:43:52.857917 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:43:52.857917 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:43:52.857917 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:43:52.857917 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:43:52.857917 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:43:52.857917 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:43:52.857917 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:43:52.857917 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:43:52.857917 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:43:52.857917 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:43:52.857917 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:43:52.857917 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:43:52.857917 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:43:52.857917 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:43:52.857917 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:43:52.858700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:43:52.858700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:43:52.858700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:43:52.858700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:43:52.858700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:43:52.858700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:43:52.858700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:43:52.858700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:43:52.858700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:43:52.858700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:43:52.858700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:43:52.858700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:43:52.858700 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 58/118] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:43:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:43:52.859351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcc64d-71e6-43a5-a765-ea1575c17334 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:52.876741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:52.880850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed6638-0483-46e3-a01e-f56d57c7d66d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:52.920183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d789d-299d-49de-8e8c-76e9a6c07004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:52.921082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d789d-299d-49de-8e8c-76e9a6c07004 None admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:52.921366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d789d-299d-49de-8e8c-76e9a6c07004 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:52.921643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d789d-299d-49de-8e8c-76e9a6c07004 None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33/users/01308079b08d469b8f639c49f9b8e1a7/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:52.923705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d789d-299d-49de-8e8c-76e9a6c07004 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b6fb712e361438587cb7af5e9fdce33, user_id=01308079b08d469b8f639c49f9b8e1a7, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:52.925209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d789d-299d-49de-8e8c-76e9a6c07004 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:52.941255 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 61/119] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:43:52 2022] PUT /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33/users/01308079b08d469b8f639c49f9b8e1a7/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:43:52.944894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d789d-299d-49de-8e8c-76e9a6c07004 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:52.984477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcc64d-71e6-43a5-a765-ea1575c17334 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:53.004255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:53.029614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e2aad-1799-483b-a0ee-1f3da43fe963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:53.030624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e2aad-1799-483b-a0ee-1f3da43fe963 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:53.031166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e2aad-1799-483b-a0ee-1f3da43fe963 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:53.031457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e2aad-1799-483b-a0ee-1f3da43fe963 None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:53.034027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e2aad-1799-483b-a0ee-1f3da43fe963 None admin] RBAC: Authorizing `identity:get_project(project_id=7b6fb712e361438587cb7af5e9fdce33)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:53.035605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e2aad-1799-483b-a0ee-1f3da43fe963 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:53.040215 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 59/120] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:43:52 2022] GET /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:53.041484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e2aad-1799-483b-a0ee-1f3da43fe963 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:53.074298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d789d-299d-49de-8e8c-76e9a6c07004 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:53.122062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92533451-fa33-4ee7-a8ba-feed6ae9f798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:53.123711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92533451-fa33-4ee7-a8ba-feed6ae9f798 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:53.124210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92533451-fa33-4ee7-a8ba-feed6ae9f798 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:53.124678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92533451-fa33-4ee7-a8ba-feed6ae9f798 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:53.138588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92533451-fa33-4ee7-a8ba-feed6ae9f798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:43:53.147447 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-92533451-fa33-4ee7-a8ba-feed6ae9f798 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:43:53.147447 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:43:53.147447 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:43:53.147447 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:43:53.147447 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:43:53.147447 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:43:53.147447 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:43:53.147447 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:43:53.147447 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:43:53.147447 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:43:53.147447 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:43:53.147447 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:43:53.147447 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:43:53.147447 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:43:53.147447 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:43:53.147447 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:43:53.148428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:43:53.148428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:43:53.148428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:43:53.148428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:43:53.148428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:43:53.148428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:43:53.148428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:43:53.148428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:43:53.148428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:43:53.148428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:43:53.148428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:43:53.148428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:43:53.148428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:43:53.148428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:43:53.148428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:43:53.148428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:43:53.149197 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:43:53.149197 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:43:53.149197 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:43:53.149197 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:43:53.149197 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:43:53.149197 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:43:53.149197 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:43:53.149197 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:43:53.149197 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:43:53.149197 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:43:53.149197 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:43:53.149197 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:43:53.151832 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 62/121] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:43:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:43:53.153538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f66a9-3b0c-49ef-bf5c-4440a63987de None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:53.154015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f66a9-3b0c-49ef-bf5c-4440a63987de None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:53.154487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f66a9-3b0c-49ef-bf5c-4440a63987de None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:53.156122 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 63/122] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:53.161129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f66a9-3b0c-49ef-bf5c-4440a63987de None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:53.162826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:53.195219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e2aad-1799-483b-a0ee-1f3da43fe963 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:53.235652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b62a4-4692-475c-b206-43dba96e287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:53.242952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b62a4-4692-475c-b206-43dba96e287e None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:53.242952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b62a4-4692-475c-b206-43dba96e287e None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:53.242952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b62a4-4692-475c-b206-43dba96e287e None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:53.242952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b62a4-4692-475c-b206-43dba96e287e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:53.242952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b62a4-4692-475c-b206-43dba96e287e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:53.242952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b62a4-4692-475c-b206-43dba96e287e None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:53.252886 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 60/123] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:43:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:53.253859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b62a4-4692-475c-b206-43dba96e287e None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:53.285400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f66a9-3b0c-49ef-bf5c-4440a63987de None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:53.296993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:53.324481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90face16-280e-4926-8ec8-1def32e79cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:53.325244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90face16-280e-4926-8ec8-1def32e79cc5 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:53.325626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90face16-280e-4926-8ec8-1def32e79cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:53.325990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90face16-280e-4926-8ec8-1def32e79cc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:53.326927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90face16-280e-4926-8ec8-1def32e79cc5 None admin] RBAC: Adding query filter params (role.id=626342454d8044849bcbaa4f6d292aed, scope.project.id=7b6fb712e361438587cb7af5e9fdce33, user.id=f6b4da9871f6467eb6e321ff49597215) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:53.327301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90face16-280e-4926-8ec8-1def32e79cc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:53.329032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90face16-280e-4926-8ec8-1def32e79cc5 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:53.335589 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 64/124] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:43:53 2022] GET /identity/v3/role_assignments?user.id=f6b4da9871f6467eb6e321ff49597215&scope.project.id=7b6fb712e361438587cb7af5e9fdce33&role.id=626342454d8044849bcbaa4f6d292aed => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:53.340062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e5deb-f88a-431c-b8a7-06596f0591c1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:53.340062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e5deb-f88a-431c-b8a7-06596f0591c1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:53.340062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e5deb-f88a-431c-b8a7-06596f0591c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:53.375754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fd0e5deb-f88a-431c-b8a7-06596f0591c1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:53.377053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fd0e5deb-f88a-431c-b8a7-06596f0591c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:53.428316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b62a4-4692-475c-b206-43dba96e287e None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:53.497488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12121037-5c6a-45a8-92c6-a8a29da7e808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:53.498232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12121037-5c6a-45a8-92c6-a8a29da7e808 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:53.498523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12121037-5c6a-45a8-92c6-a8a29da7e808 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:53.498783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12121037-5c6a-45a8-92c6-a8a29da7e808 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:53.499531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12121037-5c6a-45a8-92c6-a8a29da7e808 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:53.499832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12121037-5c6a-45a8-92c6-a8a29da7e808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:53.501734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12121037-5c6a-45a8-92c6-a8a29da7e808 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:53.512457 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 65/125] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:53.518582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e5deb-f88a-431c-b8a7-06596f0591c1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:53.519479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:53.526076 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 61/126] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:43:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:53.531863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12121037-5c6a-45a8-92c6-a8a29da7e808 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:53.693035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e5deb-f88a-431c-b8a7-06596f0591c1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:53.696502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:53.722867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12121037-5c6a-45a8-92c6-a8a29da7e808 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:53.758900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b70ef4-cabd-4d7e-84a0-00fff04551d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:53.759789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b70ef4-cabd-4d7e-84a0-00fff04551d3 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:53.760081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b70ef4-cabd-4d7e-84a0-00fff04551d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:53.760356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b70ef4-cabd-4d7e-84a0-00fff04551d3 None admin] PATH_INFO: `/v3/users/01308079b08d469b8f639c49f9b8e1a7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:53.761708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b70ef4-cabd-4d7e-84a0-00fff04551d3 None admin] RBAC: Authorizing `identity:get_user(user_id=01308079b08d469b8f639c49f9b8e1a7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:53.763180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b70ef4-cabd-4d7e-84a0-00fff04551d3 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:53.767452 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 66/127] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:43:53 2022] GET /identity/v3/users/01308079b08d469b8f639c49f9b8e1a7 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:53.769858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b70ef4-cabd-4d7e-84a0-00fff04551d3 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:53.786651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c74e2-5c77-41db-ad3a-a4b5b14310fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:53.787593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c74e2-5c77-41db-ad3a-a4b5b14310fb None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:53.787876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c74e2-5c77-41db-ad3a-a4b5b14310fb None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:53.788183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c74e2-5c77-41db-ad3a-a4b5b14310fb None admin] PATH_INFO: `/v3/users/a7a87f488da04c6c9c5276b1487113d6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:53.791223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c74e2-5c77-41db-ad3a-a4b5b14310fb None admin] RBAC: Authorizing `identity:get_user(user_id=a7a87f488da04c6c9c5276b1487113d6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:53.793961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c74e2-5c77-41db-ad3a-a4b5b14310fb None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:53.796225 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 62/128] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:43:53 2022] GET /identity/v3/users/a7a87f488da04c6c9c5276b1487113d6 => generated 247 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:53.797060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c74e2-5c77-41db-ad3a-a4b5b14310fb None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:53.922084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:53.949467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b70ef4-cabd-4d7e-84a0-00fff04551d3 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:53.984286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c74e2-5c77-41db-ad3a-a4b5b14310fb None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:54.016661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cec3e-7b02-4801-a4c8-9a0bc66a9ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:54.018708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cec3e-7b02-4801-a4c8-9a0bc66a9ba5 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:54.022050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cec3e-7b02-4801-a4c8-9a0bc66a9ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:54.022503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cec3e-7b02-4801-a4c8-9a0bc66a9ba5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:54.035215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cec3e-7b02-4801-a4c8-9a0bc66a9ba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:43:54.044358 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-f08cec3e-7b02-4801-a4c8-9a0bc66a9ba5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:43:54.044358 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:43:54.044358 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:43:54.044358 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:43:54.044358 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:43:54.044358 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:43:54.044358 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:43:54.044358 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:43:54.044358 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:43:54.044358 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:43:54.044358 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:43:54.044358 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:43:54.044358 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:43:54.044358 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:43:54.044358 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:43:54.044358 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:43:54.045269 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:43:54.045269 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:43:54.045269 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:43:54.045269 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:43:54.045269 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:43:54.045269 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:43:54.045269 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:43:54.045269 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:43:54.045269 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:43:54.045269 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:43:54.045269 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:43:54.045269 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:43:54.045269 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:43:54.045269 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:43:54.045269 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:43:54.045269 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:43:54.046057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:43:54.046057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:43:54.046057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:43:54.046057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:43:54.046057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:43:54.046057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:43:54.046057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:43:54.046057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:43:54.046057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:43:54.046057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:43:54.046057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:43:54.046057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:43:54.048207 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 67/129] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:43:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:43:54.049776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cec3e-7b02-4801-a4c8-9a0bc66a9ba5 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:54.065651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89dbfee-5d1d-4189-b803-328e3d1651b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:54.066537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dbfee-5d1d-4189-b803-328e3d1651b7 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:54.066820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dbfee-5d1d-4189-b803-328e3d1651b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:54.067096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dbfee-5d1d-4189-b803-328e3d1651b7 None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:54.072768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89dbfee-5d1d-4189-b803-328e3d1651b7 None admin] RBAC: Authorizing `identity:get_project(project_id=7b6fb712e361438587cb7af5e9fdce33)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:54.074235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89dbfee-5d1d-4189-b803-328e3d1651b7 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:54.076304 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 63/130] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:43:53 2022] GET /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:54.077296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89dbfee-5d1d-4189-b803-328e3d1651b7 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:54.096398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:54.249304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cec3e-7b02-4801-a4c8-9a0bc66a9ba5 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:54.295413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89dbfee-5d1d-4189-b803-328e3d1651b7 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:54.322936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989c11f-4fbe-4108-83cf-06c79ce1ebed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:54.323811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989c11f-4fbe-4108-83cf-06c79ce1ebed None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:54.324120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989c11f-4fbe-4108-83cf-06c79ce1ebed None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:54.324457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989c11f-4fbe-4108-83cf-06c79ce1ebed None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:54.326054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989c11f-4fbe-4108-83cf-06c79ce1ebed None admin] RBAC: Authorizing `identity:get_project(project_id=7b6fb712e361438587cb7af5e9fdce33)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:54.327845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989c11f-4fbe-4108-83cf-06c79ce1ebed None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:54.329861 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 68/131] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:43:54 2022] GET /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:54.330675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989c11f-4fbe-4108-83cf-06c79ce1ebed None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:54.364265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aca2fc-f405-46ff-87ac-1eb1acbf6969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:54.364986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aca2fc-f405-46ff-87ac-1eb1acbf6969 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:54.365271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aca2fc-f405-46ff-87ac-1eb1acbf6969 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:54.365549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aca2fc-f405-46ff-87ac-1eb1acbf6969 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:54.366306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aca2fc-f405-46ff-87ac-1eb1acbf6969 None admin] RBAC: Adding query filter params (name=member) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:54.366612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aca2fc-f405-46ff-87ac-1eb1acbf6969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:54.368060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aca2fc-f405-46ff-87ac-1eb1acbf6969 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:54.373247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:54.383860 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 64/132] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:43:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:54.384715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aca2fc-f405-46ff-87ac-1eb1acbf6969 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:54.458669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:54.462878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989c11f-4fbe-4108-83cf-06c79ce1ebed None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:54.493680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aca2fc-f405-46ff-87ac-1eb1acbf6969 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:54.505617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb7138-a310-40fd-aa5b-22c22391ae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:54.506718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb7138-a310-40fd-aa5b-22c22391ae3f None admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:54.507002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb7138-a310-40fd-aa5b-22c22391ae3f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:54.507280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb7138-a310-40fd-aa5b-22c22391ae3f None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33/users/01308079b08d469b8f639c49f9b8e1a7/roles/74cf644f6b8f49ce86fffcde317f8883` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:54.510520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb7138-a310-40fd-aa5b-22c22391ae3f None admin] RBAC: Authorizing `identity:create_grant(project_id=7b6fb712e361438587cb7af5e9fdce33, user_id=01308079b08d469b8f639c49f9b8e1a7, role_id=74cf644f6b8f49ce86fffcde317f8883)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:54.512621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb7138-a310-40fd-aa5b-22c22391ae3f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:54.532283 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 69/133] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:43:54 2022] PUT /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33/users/01308079b08d469b8f639c49f9b8e1a7/roles/74cf644f6b8f49ce86fffcde317f8883 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:43:54.533889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c310c7a-13e4-4e29-8410-82a8b47846a6 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:54.534175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c310c7a-13e4-4e29-8410-82a8b47846a6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:54.534450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c310c7a-13e4-4e29-8410-82a8b47846a6 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:54.535744 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 70/134] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:54.536619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c310c7a-13e4-4e29-8410-82a8b47846a6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:54.541006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85898ef4-7db5-4167-aaef-c5d303be06f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:54.542047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85898ef4-7db5-4167-aaef-c5d303be06f1 None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:54.542728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85898ef4-7db5-4167-aaef-c5d303be06f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:54.543019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85898ef4-7db5-4167-aaef-c5d303be06f1 None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33/users/a7a87f488da04c6c9c5276b1487113d6/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:54.549749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85898ef4-7db5-4167-aaef-c5d303be06f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b6fb712e361438587cb7af5e9fdce33, user_id=a7a87f488da04c6c9c5276b1487113d6, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:54.552324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85898ef4-7db5-4167-aaef-c5d303be06f1 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:54.581875 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 65/135] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:43:54 2022] PUT /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33/users/a7a87f488da04c6c9c5276b1487113d6/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:43:54.583242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6248de-1058-4d0c-9e93-e1c89d7b9412 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:54.583836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6248de-1058-4d0c-9e93-e1c89d7b9412 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:54.584146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6248de-1058-4d0c-9e93-e1c89d7b9412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:54.618821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ec6248de-1058-4d0c-9e93-e1c89d7b9412 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:54.620127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ec6248de-1058-4d0c-9e93-e1c89d7b9412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:54.742797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:54.763462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c310c7a-13e4-4e29-8410-82a8b47846a6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:54.785979 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 66/136] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:54.814337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8784c4-f0ac-4028-b09f-23529ab28b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:54.815371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8784c4-f0ac-4028-b09f-23529ab28b84 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:54.815662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8784c4-f0ac-4028-b09f-23529ab28b84 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:54.815938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8784c4-f0ac-4028-b09f-23529ab28b84 None admin] PATH_INFO: `/v3/users/01308079b08d469b8f639c49f9b8e1a7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:54.817270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8784c4-f0ac-4028-b09f-23529ab28b84 None admin] RBAC: Authorizing `identity:get_user(user_id=01308079b08d469b8f639c49f9b8e1a7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:54.818910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8784c4-f0ac-4028-b09f-23529ab28b84 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:54.821020 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 71/137] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:43:54 2022] GET /identity/v3/users/01308079b08d469b8f639c49f9b8e1a7 => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:54.827618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6248de-1058-4d0c-9e93-e1c89d7b9412 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:54.843311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8784c4-f0ac-4028-b09f-23529ab28b84 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:54.880747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:54.981862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8784c4-f0ac-4028-b09f-23529ab28b84 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:55.011863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6248de-1058-4d0c-9e93-e1c89d7b9412 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:55.035610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4396c-a3ce-4ee1-a57c-a176ae2a17c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:55.036425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4396c-a3ce-4ee1-a57c-a176ae2a17c4 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:55.036705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4396c-a3ce-4ee1-a57c-a176ae2a17c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:55.036979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4396c-a3ce-4ee1-a57c-a176ae2a17c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:55.038309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4396c-a3ce-4ee1-a57c-a176ae2a17c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:55.042154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4396c-a3ce-4ee1-a57c-a176ae2a17c4 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:55.043689 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 72/138] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:43:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:55.050804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4396c-a3ce-4ee1-a57c-a176ae2a17c4 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:55.058508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe58e58-915f-4db5-be2a-7a7736731e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:55.059693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe58e58-915f-4db5-be2a-7a7736731e1f None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:55.061453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe58e58-915f-4db5-be2a-7a7736731e1f None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:55.061932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe58e58-915f-4db5-be2a-7a7736731e1f None admin] PATH_INFO: `/v3/projects/9850be07090e4c8ba576673c9d00bce3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:55.063455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe58e58-915f-4db5-be2a-7a7736731e1f None admin] RBAC: Authorizing `identity:get_project(project_id=9850be07090e4c8ba576673c9d00bce3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:55.065313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe58e58-915f-4db5-be2a-7a7736731e1f None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:55.067633 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 67/139] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:43:54 2022] GET /identity/v3/projects/9850be07090e4c8ba576673c9d00bce3 => generated 312 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:55.073873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe58e58-915f-4db5-be2a-7a7736731e1f None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:55.169204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:55.177154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4396c-a3ce-4ee1-a57c-a176ae2a17c4 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:55.184408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:55.252796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc66df-4cb0-4efc-8c04-29a6dea80644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:55.254190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc66df-4cb0-4efc-8c04-29a6dea80644 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:55.254671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc66df-4cb0-4efc-8c04-29a6dea80644 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:55.255142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc66df-4cb0-4efc-8c04-29a6dea80644 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:55.256139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc66df-4cb0-4efc-8c04-29a6dea80644 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:55.257818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc66df-4cb0-4efc-8c04-29a6dea80644 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:55.275730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe58e58-915f-4db5-be2a-7a7736731e1f None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:55.287572 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 73/140] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Jul 2 20:43:55 2022] POST /identity/v3/users => generated 283 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:43:55.327199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996ac83-f894-46ef-be3f-84c210b2a958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:55.328639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996ac83-f894-46ef-be3f-84c210b2a958 None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:55.329133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996ac83-f894-46ef-be3f-84c210b2a958 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:55.329621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996ac83-f894-46ef-be3f-84c210b2a958 None admin] PATH_INFO: `/v3/projects/9850be07090e4c8ba576673c9d00bce3/users/01308079b08d469b8f639c49f9b8e1a7/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:55.334086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996ac83-f894-46ef-be3f-84c210b2a958 None admin] RBAC: Authorizing `identity:create_grant(project_id=9850be07090e4c8ba576673c9d00bce3, user_id=01308079b08d469b8f639c49f9b8e1a7, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:55.336033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996ac83-f894-46ef-be3f-84c210b2a958 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:55.361909 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 68/141] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:43:55 2022] PUT /identity/v3/projects/9850be07090e4c8ba576673c9d00bce3/users/01308079b08d469b8f639c49f9b8e1a7/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 20:43:55.851144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f0fbd-177a-4e21-9667-d784284b3a3b None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:55.851846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f0fbd-177a-4e21-9667-d784284b3a3b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:55.852353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f0fbd-177a-4e21-9667-d784284b3a3b None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:55.853942 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 74/142] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:55.859543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af52ca7-567f-49fb-8d74-a56d7bbd88ad None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:55.860128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af52ca7-567f-49fb-8d74-a56d7bbd88ad None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:55.860610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af52ca7-567f-49fb-8d74-a56d7bbd88ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:55.879654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9af52ca7-567f-49fb-8d74-a56d7bbd88ad None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:55.881214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9af52ca7-567f-49fb-8d74-a56d7bbd88ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:55.968859 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 69/143] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:56.013016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f0fbd-177a-4e21-9667-d784284b3a3b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:56.015692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67f2b1-f6d1-4443-b2a5-fad34805bea6 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:56.016494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67f2b1-f6d1-4443-b2a5-fad34805bea6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:56.016973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67f2b1-f6d1-4443-b2a5-fad34805bea6 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:56.019517 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 70/144] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:56.025501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef62e6-ae3d-4bfc-a622-4a8782bba527 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:56.026050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef62e6-ae3d-4bfc-a622-4a8782bba527 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:56.027007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef62e6-ae3d-4bfc-a622-4a8782bba527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:56.052734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0aef62e6-ae3d-4bfc-a622-4a8782bba527 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:56.054590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0aef62e6-ae3d-4bfc-a622-4a8782bba527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:56.141006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:56.192984 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 71/145] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:43:56.213577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f0fbd-177a-4e21-9667-d784284b3a3b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:56.220229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef62e6-ae3d-4bfc-a622-4a8782bba527 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:56.268117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fedb51-4c57-44a3-ac39-d5d346cdfdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:56.269990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fedb51-4c57-44a3-ac39-d5d346cdfdfd None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:56.270473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fedb51-4c57-44a3-ac39-d5d346cdfdfd None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:56.271195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fedb51-4c57-44a3-ac39-d5d346cdfdfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:56.287063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fedb51-4c57-44a3-ac39-d5d346cdfdfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:43:56.299847 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-57fedb51-4c57-44a3-ac39-d5d346cdfdfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:43:56.299847 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:43:56.299847 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:43:56.299847 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:43:56.299847 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:43:56.299847 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:43:56.299847 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:43:56.299847 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:43:56.299847 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:43:56.299847 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:43:56.299847 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:43:56.299847 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:43:56.299847 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:43:56.299847 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:43:56.299847 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:43:56.299847 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:43:56.300826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:43:56.300826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:43:56.300826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:43:56.300826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:43:56.300826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:43:56.300826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:43:56.300826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:43:56.300826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:43:56.300826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:43:56.300826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:43:56.300826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:43:56.300826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:43:56.300826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:43:56.300826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:43:56.300826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:43:56.300826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:43:56.301655 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:43:56.301655 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:43:56.301655 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:43:56.301655 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:43:56.301655 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:43:56.301655 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:43:56.301655 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:43:56.301655 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:43:56.301655 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:43:56.301655 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:43:56.301655 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:43:56.301655 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:43:56.306319 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 75/146] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:43:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:43:56.312204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fedb51-4c57-44a3-ac39-d5d346cdfdfd None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:56.333836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:56.410420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef62e6-ae3d-4bfc-a622-4a8782bba527 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:56.440283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fedb51-4c57-44a3-ac39-d5d346cdfdfd None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:56.450011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3da48a-900e-4a13-998a-f7b3ecce51cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:56.450826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3da48a-900e-4a13-998a-f7b3ecce51cd None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:56.451101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3da48a-900e-4a13-998a-f7b3ecce51cd None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:56.451373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3da48a-900e-4a13-998a-f7b3ecce51cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:56.462754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3da48a-900e-4a13-998a-f7b3ecce51cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:43:56.471490 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-5a3da48a-900e-4a13-998a-f7b3ecce51cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:43:56.471490 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:43:56.471490 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:43:56.471490 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:43:56.471490 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:43:56.471490 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:43:56.471490 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:43:56.471490 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:43:56.471490 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:43:56.471490 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:43:56.471490 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:43:56.471490 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:43:56.471490 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:43:56.471490 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:43:56.471490 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:43:56.471490 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:43:56.472452 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:43:56.472452 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:43:56.472452 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:43:56.472452 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:43:56.472452 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:43:56.472452 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:43:56.472452 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:43:56.472452 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:43:56.472452 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:43:56.472452 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:43:56.472452 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:43:56.472452 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:43:56.472452 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:43:56.472452 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:43:56.472452 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:43:56.472452 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:43:56.473252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:43:56.473252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:43:56.473252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:43:56.473252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:43:56.473252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:43:56.473252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:43:56.473252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:43:56.473252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:43:56.473252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:43:56.473252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:43:56.473252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:43:56.473252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:43:56.473252 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 72/147] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:43:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:43:56.478778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3da48a-900e-4a13-998a-f7b3ecce51cd None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:56.484241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776f033-6baa-4fbc-93ee-6f1ed8bb1552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:56.485231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776f033-6baa-4fbc-93ee-6f1ed8bb1552 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:56.485755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776f033-6baa-4fbc-93ee-6f1ed8bb1552 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:56.486231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776f033-6baa-4fbc-93ee-6f1ed8bb1552 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:56.487248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776f033-6baa-4fbc-93ee-6f1ed8bb1552 None admin] RBAC: Adding query filter params (name=member) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:56.487760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776f033-6baa-4fbc-93ee-6f1ed8bb1552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:56.489581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776f033-6baa-4fbc-93ee-6f1ed8bb1552 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:56.499421 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 76/148] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:43:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:43:56.504912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776f033-6baa-4fbc-93ee-6f1ed8bb1552 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:56.518108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:56.585349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3da48a-900e-4a13-998a-f7b3ecce51cd None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:56.623633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:56.631957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f79ceb-fb21-4df1-990e-21029f9fa6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:56.632646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f79ceb-fb21-4df1-990e-21029f9fa6e7 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:56.632924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f79ceb-fb21-4df1-990e-21029f9fa6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:56.633195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f79ceb-fb21-4df1-990e-21029f9fa6e7 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:56.633938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f79ceb-fb21-4df1-990e-21029f9fa6e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:56.634240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f79ceb-fb21-4df1-990e-21029f9fa6e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:56.635645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f79ceb-fb21-4df1-990e-21029f9fa6e7 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:56.644461 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 73/149] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:43:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:43:56.650126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f79ceb-fb21-4df1-990e-21029f9fa6e7 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:56.659092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776f033-6baa-4fbc-93ee-6f1ed8bb1552 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:56.697414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a88d58-bdf5-4e23-95e7-0075a935e643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:56.698791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a88d58-bdf5-4e23-95e7-0075a935e643 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:56.699270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a88d58-bdf5-4e23-95e7-0075a935e643 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:56.699736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a88d58-bdf5-4e23-95e7-0075a935e643 None admin] PATH_INFO: `/v3/users/01308079b08d469b8f639c49f9b8e1a7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:56.701311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a88d58-bdf5-4e23-95e7-0075a935e643 None admin] RBAC: Authorizing `identity:get_user(user_id=01308079b08d469b8f639c49f9b8e1a7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:56.703159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a88d58-bdf5-4e23-95e7-0075a935e643 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:56.705196 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 77/150] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:43:56 2022] GET /identity/v3/users/01308079b08d469b8f639c49f9b8e1a7 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:43:56.711202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a88d58-bdf5-4e23-95e7-0075a935e643 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:56.750504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:56.754140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f79ceb-fb21-4df1-990e-21029f9fa6e7 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:56.790030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b5bc6-d297-469b-b054-40fe77e3fa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:56.790916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b5bc6-d297-469b-b054-40fe77e3fa65 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:56.791192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b5bc6-d297-469b-b054-40fe77e3fa65 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:56.791460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b5bc6-d297-469b-b054-40fe77e3fa65 None admin] PATH_INFO: `/v3/users/f6b4da9871f6467eb6e321ff49597215` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:56.793014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b5bc6-d297-469b-b054-40fe77e3fa65 None admin] RBAC: Authorizing `identity:get_user(user_id=f6b4da9871f6467eb6e321ff49597215)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:56.794475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b5bc6-d297-469b-b054-40fe77e3fa65 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:56.796754 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 74/151] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:43:56 2022] GET /identity/v3/users/f6b4da9871f6467eb6e321ff49597215 => generated 289 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:43:56.802855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b5bc6-d297-469b-b054-40fe77e3fa65 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:56.871470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a88d58-bdf5-4e23-95e7-0075a935e643 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:56.917234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b5bc6-d297-469b-b054-40fe77e3fa65 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:56.927358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25aa7f-1849-4066-83e7-f2456ed2737f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:56.928412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25aa7f-1849-4066-83e7-f2456ed2737f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:56.929203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25aa7f-1849-4066-83e7-f2456ed2737f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:56.929876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25aa7f-1849-4066-83e7-f2456ed2737f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:56.947942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:56.969982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450923a0-35b8-4af3-a4ad-03fc2f7056bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:56.970972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450923a0-35b8-4af3-a4ad-03fc2f7056bd None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:56.971251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450923a0-35b8-4af3-a4ad-03fc2f7056bd None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:56.971518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450923a0-35b8-4af3-a4ad-03fc2f7056bd None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:56.973746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450923a0-35b8-4af3-a4ad-03fc2f7056bd None admin] RBAC: Authorizing `identity:get_project(project_id=7b6fb712e361438587cb7af5e9fdce33)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:56.975203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450923a0-35b8-4af3-a4ad-03fc2f7056bd None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:56.985181 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 75/152] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:43:56 2022] GET /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:57.013675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450923a0-35b8-4af3-a4ad-03fc2f7056bd None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:57.049377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25aa7f-1849-4066-83e7-f2456ed2737f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:57.050850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25aa7f-1849-4066-83e7-f2456ed2737f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:57.100370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:57.169060 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 78/153] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 20:43:57.175520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25aa7f-1849-4066-83e7-f2456ed2737f None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:57.225947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:57.239153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450923a0-35b8-4af3-a4ad-03fc2f7056bd None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:57.286212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea603f37-2189-493e-9c74-e40153654ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:57.287125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea603f37-2189-493e-9c74-e40153654ef6 None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:57.287406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea603f37-2189-493e-9c74-e40153654ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:57.287680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea603f37-2189-493e-9c74-e40153654ef6 None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33/users/f6b4da9871f6467eb6e321ff49597215/roles/626342454d8044849bcbaa4f6d292aed` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:57.293475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea603f37-2189-493e-9c74-e40153654ef6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b6fb712e361438587cb7af5e9fdce33, user_id=f6b4da9871f6467eb6e321ff49597215, role_id=626342454d8044849bcbaa4f6d292aed)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:57.294965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea603f37-2189-493e-9c74-e40153654ef6 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:57.306363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25aa7f-1849-4066-83e7-f2456ed2737f None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:57.322388 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 76/154] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:43:57 2022] PUT /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33/users/f6b4da9871f6467eb6e321ff49597215/roles/626342454d8044849bcbaa4f6d292aed => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:43:57.358596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a75bac-c20a-4324-8746-b2467378f4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:57.359492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a75bac-c20a-4324-8746-b2467378f4df None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:57.359775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a75bac-c20a-4324-8746-b2467378f4df None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:57.360119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a75bac-c20a-4324-8746-b2467378f4df None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:57.364868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a75bac-c20a-4324-8746-b2467378f4df None admin] RBAC: Authorizing `identity:get_project(project_id=7b6fb712e361438587cb7af5e9fdce33)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:57.366354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a75bac-c20a-4324-8746-b2467378f4df None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:57.368741 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 79/155] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:43:57 2022] GET /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:57.374643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea603f37-2189-493e-9c74-e40153654ef6 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:57.496939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:57.507296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea603f37-2189-493e-9c74-e40153654ef6 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:57.547677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a17aae-43db-4292-b314-5d16362c2fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:57.548367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a17aae-43db-4292-b314-5d16362c2fdf None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:57.548646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a17aae-43db-4292-b314-5d16362c2fdf None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:57.548957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a17aae-43db-4292-b314-5d16362c2fdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:57.549790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a17aae-43db-4292-b314-5d16362c2fdf None admin] RBAC: Adding query filter params (role.id=dd546359e98c4932adc5eef83b817e81, scope.project.id=7b6fb712e361438587cb7af5e9fdce33, user.id=01308079b08d469b8f639c49f9b8e1a7) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:57.550100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a17aae-43db-4292-b314-5d16362c2fdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:57.551569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a17aae-43db-4292-b314-5d16362c2fdf None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:57.562724 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 77/156] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:43:57 2022] GET /identity/v3/role_assignments?user.id=01308079b08d469b8f639c49f9b8e1a7&scope.project.id=7b6fb712e361438587cb7af5e9fdce33&role.id=dd546359e98c4932adc5eef83b817e81 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:58.823649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3ba4d-92de-4d7c-92c8-4fbab82d5754 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:58.824224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3ba4d-92de-4d7c-92c8-4fbab82d5754 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:58.824224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3ba4d-92de-4d7c-92c8-4fbab82d5754 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:58.825585 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 80/157] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:58.831050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e5884-2282-4a3b-b312-ef308bfcb613 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:58.831458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e5884-2282-4a3b-b312-ef308bfcb613 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:58.831671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e5884-2282-4a3b-b312-ef308bfcb613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:58.861310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8b1e5884-2282-4a3b-b312-ef308bfcb613 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:58.862496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8b1e5884-2282-4a3b-b312-ef308bfcb613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:58.958535 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 78/158] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:43:58.994957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3ba4d-92de-4d7c-92c8-4fbab82d5754 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:59.138816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3ba4d-92de-4d7c-92c8-4fbab82d5754 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:59.148875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8b170-fbc7-49f0-885e-98d983ca3032 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:59.149222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8b170-fbc7-49f0-885e-98d983ca3032 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:59.149430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8b170-fbc7-49f0-885e-98d983ca3032 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:59.150487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:59.151077 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 79/159] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:59.158861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c5700-f93d-4541-a7b8-66caa58c3130 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:59.159142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c5700-f93d-4541-a7b8-66caa58c3130 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:59.159418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c5700-f93d-4541-a7b8-66caa58c3130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:59.190329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-627c5700-f93d-4541-a7b8-66caa58c3130 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:59.191506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-627c5700-f93d-4541-a7b8-66caa58c3130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:59.192751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd6b17-ff18-4564-8e62-971a18176ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:59.193580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd6b17-ff18-4564-8e62-971a18176ffc None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:59.193861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd6b17-ff18-4564-8e62-971a18176ffc None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:59.194134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd6b17-ff18-4564-8e62-971a18176ffc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:59.212927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd6b17-ff18-4564-8e62-971a18176ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:43:59.221811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-77dd6b17-ff18-4564-8e62-971a18176ffc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:43:59.221811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:43:59.221811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:43:59.221811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:43:59.221811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:43:59.221811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:43:59.221811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:43:59.221811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:43:59.221811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:43:59.221811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:43:59.221811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:43:59.221811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:43:59.221811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:43:59.221811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:43:59.221811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:43:59.221811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:43:59.222750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:43:59.222750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:43:59.222750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:43:59.222750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:43:59.222750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:43:59.222750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:43:59.222750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:43:59.222750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:43:59.222750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:43:59.222750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:43:59.222750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:43:59.222750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:43:59.222750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:43:59.222750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:43:59.222750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:43:59.222750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:43:59.223540 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:43:59.223540 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:43:59.223540 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:43:59.223540 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:43:59.223540 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:43:59.223540 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:43:59.223540 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:43:59.223540 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:43:59.223540 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:43:59.223540 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:43:59.223540 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:43:59.223540 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:43:59.223540 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 81/160] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:43:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:43:59.231881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd6b17-ff18-4564-8e62-971a18176ffc None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:59.357512 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 80/161] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:43:59.374247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd6b17-ff18-4564-8e62-971a18176ffc None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:59.418057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e8af7-0b5b-4dde-9088-e20b9fd8eb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:59.418726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e8af7-0b5b-4dde-9088-e20b9fd8eb9e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:59.419010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e8af7-0b5b-4dde-9088-e20b9fd8eb9e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:59.419285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e8af7-0b5b-4dde-9088-e20b9fd8eb9e None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:59.420055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e8af7-0b5b-4dde-9088-e20b9fd8eb9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:59.420368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e8af7-0b5b-4dde-9088-e20b9fd8eb9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:59.421753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e8af7-0b5b-4dde-9088-e20b9fd8eb9e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:59.426780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c5700-f93d-4541-a7b8-66caa58c3130 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:59.435291 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 82/162] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:43:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:43:59.446777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e8af7-0b5b-4dde-9088-e20b9fd8eb9e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:59.464615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:59.528418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:59.634835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c5700-f93d-4541-a7b8-66caa58c3130 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:59.680531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e8af7-0b5b-4dde-9088-e20b9fd8eb9e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:59.719566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2314a5-28b7-4862-ab72-8f8309233ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:59.720505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2314a5-28b7-4862-ab72-8f8309233ea3 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:59.720790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2314a5-28b7-4862-ab72-8f8309233ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:59.721067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2314a5-28b7-4862-ab72-8f8309233ea3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:59.741895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2314a5-28b7-4862-ab72-8f8309233ea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:43:59.744888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819e908-db24-4c6b-8e0b-53fdd79c4904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:59.745574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819e908-db24-4c6b-8e0b-53fdd79c4904 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:59.745834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819e908-db24-4c6b-8e0b-53fdd79c4904 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:59.746261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819e908-db24-4c6b-8e0b-53fdd79c4904 None admin] PATH_INFO: `/v3/users/01308079b08d469b8f639c49f9b8e1a7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:59.750712 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-cb2314a5-28b7-4862-ab72-8f8309233ea3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:43:59.750712 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:43:59.750712 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:43:59.750712 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:43:59.750712 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:43:59.750712 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:43:59.750712 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:43:59.750712 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:43:59.750712 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:43:59.750712 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:43:59.750712 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:43:59.750712 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:43:59.750712 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:43:59.750712 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:43:59.750712 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:43:59.750712 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:43:59.751979 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:43:59.751979 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:43:59.751979 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:43:59.751979 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:43:59.751979 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:43:59.751979 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:43:59.751979 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:43:59.751979 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:43:59.751979 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:43:59.751979 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:43:59.751979 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:43:59.751979 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:43:59.751979 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:43:59.751979 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:43:59.751979 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:43:59.751979 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:43:59.752820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:43:59.752820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:43:59.752820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:43:59.752820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:43:59.752820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:43:59.752820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:43:59.752820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:43:59.752820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:43:59.752820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:43:59.752820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:43:59.752820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:43:59.752820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:43:59.753469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819e908-db24-4c6b-8e0b-53fdd79c4904 None admin] RBAC: Authorizing `identity:get_user(user_id=01308079b08d469b8f639c49f9b8e1a7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:59.754627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819e908-db24-4c6b-8e0b-53fdd79c4904 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:59.756685 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 83/163] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:43:59 2022] GET /identity/v3/users/01308079b08d469b8f639c49f9b8e1a7 => generated 275 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:43:59.757009 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 81/164] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:43:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:43:59.762996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819e908-db24-4c6b-8e0b-53fdd79c4904 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:59.763579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2314a5-28b7-4862-ab72-8f8309233ea3 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:59.893387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:59.913544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2314a5-28b7-4862-ab72-8f8309233ea3 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:59.929158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:59.934217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819e908-db24-4c6b-8e0b-53fdd79c4904 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:59.965366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba438588-dda3-4ce8-bcb6-cfd973e9daa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:59.966673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba438588-dda3-4ce8-bcb6-cfd973e9daa7 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:59.966959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba438588-dda3-4ce8-bcb6-cfd973e9daa7 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:59.967230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba438588-dda3-4ce8-bcb6-cfd973e9daa7 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:59.967986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba438588-dda3-4ce8-bcb6-cfd973e9daa7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:43:59.968318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba438588-dda3-4ce8-bcb6-cfd973e9daa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:59.969765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba438588-dda3-4ce8-bcb6-cfd973e9daa7 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:59.984154 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 82/165] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:43:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:43:59.990004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba438588-dda3-4ce8-bcb6-cfd973e9daa7 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:59.995201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a81821-3094-4203-83b8-6e4d27a4468d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:59.995872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a81821-3094-4203-83b8-6e4d27a4468d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:59.996197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a81821-3094-4203-83b8-6e4d27a4468d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:59.996476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a81821-3094-4203-83b8-6e4d27a4468d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:00.125867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a81821-3094-4203-83b8-6e4d27a4468d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:00.127514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a81821-3094-4203-83b8-6e4d27a4468d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:00.207528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba438588-dda3-4ce8-bcb6-cfd973e9daa7 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:00.280260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3244d-b594-48fa-8118-07b846e6b8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:00.281257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3244d-b594-48fa-8118-07b846e6b8c8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:00.281537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3244d-b594-48fa-8118-07b846e6b8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:00.281805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3244d-b594-48fa-8118-07b846e6b8c8 None admin] PATH_INFO: `/v3/users/a7a87f488da04c6c9c5276b1487113d6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:00.285108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3244d-b594-48fa-8118-07b846e6b8c8 None admin] RBAC: Authorizing `identity:get_user(user_id=a7a87f488da04c6c9c5276b1487113d6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:00.286616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3244d-b594-48fa-8118-07b846e6b8c8 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:00.289292 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 83/166] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:43:59 2022] GET /identity/v3/users/a7a87f488da04c6c9c5276b1487113d6 => generated 247 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:00.292237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df74ba2-9406-4c09-9e2f-a86ca179d88e None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:00.292523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df74ba2-9406-4c09-9e2f-a86ca179d88e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:00.292798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df74ba2-9406-4c09-9e2f-a86ca179d88e None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:00.295193 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 84/167] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:00.301656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877a4f2-e807-49db-9888-b7e9e5e5c255 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:00.301992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877a4f2-e807-49db-9888-b7e9e5e5c255 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:00.302202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877a4f2-e807-49db-9888-b7e9e5e5c255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:00.309672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:00.317459 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 84/168] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:43:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:00.319000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a81821-3094-4203-83b8-6e4d27a4468d None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:00.349854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a877a4f2-e807-49db-9888-b7e9e5e5c255 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:00.351056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a877a4f2-e807-49db-9888-b7e9e5e5c255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:00.358635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:00.476598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a81821-3094-4203-83b8-6e4d27a4468d None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:00.486436 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 85/169] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:00.487196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877a4f2-e807-49db-9888-b7e9e5e5c255 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:00.539939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6f42e-161d-4a4e-9976-e1c13cbb2690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:00.540621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6f42e-161d-4a4e-9976-e1c13cbb2690 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:00.540903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6f42e-161d-4a4e-9976-e1c13cbb2690 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:00.541175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6f42e-161d-4a4e-9976-e1c13cbb2690 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:00.630782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877a4f2-e807-49db-9888-b7e9e5e5c255 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:00.632534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:00.635919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6f42e-161d-4a4e-9976-e1c13cbb2690 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:00.638869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6f42e-161d-4a4e-9976-e1c13cbb2690 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:00.669714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8b90a-7c9c-421e-83f5-c3bc2b7a6d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:00.670578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8b90a-7c9c-421e-83f5-c3bc2b7a6d70 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:00.670856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8b90a-7c9c-421e-83f5-c3bc2b7a6d70 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:00.671134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8b90a-7c9c-421e-83f5-c3bc2b7a6d70 None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:00.672334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8b90a-7c9c-421e-83f5-c3bc2b7a6d70 None admin] RBAC: Authorizing `identity:get_project(project_id=7b6fb712e361438587cb7af5e9fdce33)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:00.673851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8b90a-7c9c-421e-83f5-c3bc2b7a6d70 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:00.675713 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 86/170] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:00 2022] GET /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:00.676958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b1aeb-91c3-47be-9e61-b86136b39794 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:00.677208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b1aeb-91c3-47be-9e61-b86136b39794 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:00.677484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b1aeb-91c3-47be-9e61-b86136b39794 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:00.680182 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 87/171] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:00.680182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b1aeb-91c3-47be-9e61-b86136b39794 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:00.689271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:00.750792 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 85/172] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:00.752552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d29c5c-1e66-430a-a615-8a32d93a0000 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:00.752840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d29c5c-1e66-430a-a615-8a32d93a0000 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:00.753117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d29c5c-1e66-430a-a615-8a32d93a0000 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:00.756111 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 86/173] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:00.756111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cb8ac-2903-40fd-88a4-d9c8636ddcaa None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:00.756111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cb8ac-2903-40fd-88a4-d9c8636ddcaa None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:00.756111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cb8ac-2903-40fd-88a4-d9c8636ddcaa None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:00.760424 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 87/174] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:00.760424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cb8ac-2903-40fd-88a4-d9c8636ddcaa None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:00.790601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b1aeb-91c3-47be-9e61-b86136b39794 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:00.826690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d86f8a-3fc8-4630-8e86-3f2f61250da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:00.827488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d86f8a-3fc8-4630-8e86-3f2f61250da9 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:00.827818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d86f8a-3fc8-4630-8e86-3f2f61250da9 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:00.828184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d86f8a-3fc8-4630-8e86-3f2f61250da9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:00.839603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d86f8a-3fc8-4630-8e86-3f2f61250da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:00.848073 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-a9d86f8a-3fc8-4630-8e86-3f2f61250da9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:00.848073 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:00.848073 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:00.848073 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:00.848073 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:00.848073 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:00.848073 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:00.848073 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:00.848073 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:00.848073 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:00.848073 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:00.848073 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:00.848073 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:00.848073 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:00.848073 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:00.848073 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:00.848990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:00.848990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:00.848990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:00.848990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:00.848990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:00.848990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:00.848990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:00.848990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:00.848990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:00.848990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:00.848990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:00.848990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:00.848990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:00.848990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:00.848990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:00.848990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:00.849803 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:00.849803 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:00.849803 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:00.849803 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:00.849803 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:00.849803 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:00.849803 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:00.849803 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:00.849803 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:00.849803 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:00.849803 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:00.849803 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:00.849803 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 88/175] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:00.850711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91f914-45e2-4a10-917f-fa03f8ce2823 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:00.850895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91f914-45e2-4a10-917f-fa03f8ce2823 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:00.851113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91f914-45e2-4a10-917f-fa03f8ce2823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:00.864310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:00.868679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cb8ac-2903-40fd-88a4-d9c8636ddcaa None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:00.869772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4c91f914-45e2-4a10-917f-fa03f8ce2823 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:00.871508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4c91f914-45e2-4a10-917f-fa03f8ce2823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:00.906147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b4c43-583e-4d74-9b7a-266991a83c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:00.907035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b4c43-583e-4d74-9b7a-266991a83c4c None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:00.907454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b4c43-583e-4d74-9b7a-266991a83c4c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:00.907731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b4c43-583e-4d74-9b7a-266991a83c4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:00.908660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b4c43-583e-4d74-9b7a-266991a83c4c None admin] RBAC: Adding query filter params (role.id=74cf644f6b8f49ce86fffcde317f8883, scope.project.id=7b6fb712e361438587cb7af5e9fdce33, user.id=01308079b08d469b8f639c49f9b8e1a7) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:00.909003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b4c43-583e-4d74-9b7a-266991a83c4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:00.910592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b4c43-583e-4d74-9b7a-266991a83c4c None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:00.924077 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 88/176] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:44:00 2022] GET /identity/v3/role_assignments?user.id=01308079b08d469b8f639c49f9b8e1a7&scope.project.id=7b6fb712e361438587cb7af5e9fdce33&role.id=74cf644f6b8f49ce86fffcde317f8883 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:00.924077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b4c43-583e-4d74-9b7a-266991a83c4c None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:00.948547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:00.958449 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 89/177] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:00.965904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9184c5-4b32-4104-9839-c756432b61d9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:00.966214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9184c5-4b32-4104-9839-c756432b61d9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:00.966467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9184c5-4b32-4104-9839-c756432b61d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:01.001328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4a9184c5-4b32-4104-9839-c756432b61d9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:01.002640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4a9184c5-4b32-4104-9839-c756432b61d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:01.065790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b4c43-583e-4d74-9b7a-266991a83c4c None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:01.082875 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 90/178] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:01.084030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae295-b632-4557-b14b-87bfc96a8c75 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:01.084553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae295-b632-4557-b14b-87bfc96a8c75 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:01.084833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae295-b632-4557-b14b-87bfc96a8c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:01.106781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b65ae295-b632-4557-b14b-87bfc96a8c75 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:01.108005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b65ae295-b632-4557-b14b-87bfc96a8c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:01.120872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b18d3-83c7-4d99-9c76-3dfb578c4982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:01.121771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b18d3-83c7-4d99-9c76-3dfb578c4982 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:01.122048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b18d3-83c7-4d99-9c76-3dfb578c4982 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:01.122318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b18d3-83c7-4d99-9c76-3dfb578c4982 None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:01.123638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b18d3-83c7-4d99-9c76-3dfb578c4982 None admin] RBAC: Authorizing `identity:get_project(project_id=7b6fb712e361438587cb7af5e9fdce33)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:01.125201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b18d3-83c7-4d99-9c76-3dfb578c4982 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:01.127382 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 89/179] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:00 2022] GET /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:01.128081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b18d3-83c7-4d99-9c76-3dfb578c4982 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:01.161993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:01.200420 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 91/180] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:01.208097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ae295-b632-4557-b14b-87bfc96a8c75 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:01.250285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b18d3-83c7-4d99-9c76-3dfb578c4982 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:01.269251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:01.295103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6a745-3813-47b7-a26f-7830a4688bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:01.295779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6a745-3813-47b7-a26f-7830a4688bac None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:01.296128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6a745-3813-47b7-a26f-7830a4688bac None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:01.296675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6a745-3813-47b7-a26f-7830a4688bac None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:01.297427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6a745-3813-47b7-a26f-7830a4688bac None admin] RBAC: Adding query filter params (name=member) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:01.297731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6a745-3813-47b7-a26f-7830a4688bac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:01.299695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6a745-3813-47b7-a26f-7830a4688bac None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:01.310800 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 90/181] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:01.311795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6a745-3813-47b7-a26f-7830a4688bac None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:01.318795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ae295-b632-4557-b14b-87bfc96a8c75 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:01.354942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974fdba-70d1-4d3e-ad56-84dd61432ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:01.355736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974fdba-70d1-4d3e-ad56-84dd61432ae8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:01.356011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974fdba-70d1-4d3e-ad56-84dd61432ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:01.356310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974fdba-70d1-4d3e-ad56-84dd61432ae8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:01.367115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974fdba-70d1-4d3e-ad56-84dd61432ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:01.374762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-1974fdba-70d1-4d3e-ad56-84dd61432ae8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:44:01.374762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:01.374762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:01.374762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:01.374762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:01.374762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:01.374762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:01.374762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:01.374762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:01.374762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:01.374762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:01.374762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:01.374762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:01.374762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:01.374762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:01.374762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:01.375688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:01.375688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:01.375688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:01.375688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:01.375688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:01.375688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:01.375688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:01.375688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:01.375688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:01.375688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:01.375688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:01.375688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:01.375688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:01.375688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:01.375688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:01.375688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:01.381826 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:01.381826 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:01.381826 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:01.381826 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:01.381826 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:01.381826 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:01.381826 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:01.381826 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:01.381826 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:01.381826 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:01.381826 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:44:01.381826 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:01.381826 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 92/182] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:44:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:01.381826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974fdba-70d1-4d3e-ad56-84dd61432ae8 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:01.417632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:01.425352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6a745-3813-47b7-a26f-7830a4688bac None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:01.461575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d17470-1afa-43da-913f-79c5cf72d983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:01.462370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d17470-1afa-43da-913f-79c5cf72d983 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:01.462649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d17470-1afa-43da-913f-79c5cf72d983 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:01.462923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d17470-1afa-43da-913f-79c5cf72d983 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:01.464106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d17470-1afa-43da-913f-79c5cf72d983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:01.465586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d17470-1afa-43da-913f-79c5cf72d983 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:01.467204 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 91/183] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:01.471315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d17470-1afa-43da-913f-79c5cf72d983 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:01.482278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974fdba-70d1-4d3e-ad56-84dd61432ae8 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:01.497822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:01.516388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42052f-33b4-490d-b560-84910c9a0f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:01.517280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42052f-33b4-490d-b560-84910c9a0f0f None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:01.517561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42052f-33b4-490d-b560-84910c9a0f0f None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:01.517833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42052f-33b4-490d-b560-84910c9a0f0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:01.518649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42052f-33b4-490d-b560-84910c9a0f0f None admin] RBAC: Adding query filter params (role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.project.id=7b6fb712e361438587cb7af5e9fdce33, user.id=a7a87f488da04c6c9c5276b1487113d6) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:01.518960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42052f-33b4-490d-b560-84910c9a0f0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:01.520501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42052f-33b4-490d-b560-84910c9a0f0f None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:01.526271 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 93/184] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:44:01 2022] GET /identity/v3/role_assignments?user.id=a7a87f488da04c6c9c5276b1487113d6&scope.project.id=7b6fb712e361438587cb7af5e9fdce33&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:01.526928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42052f-33b4-490d-b560-84910c9a0f0f None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:01.579687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d17470-1afa-43da-913f-79c5cf72d983 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:01.617832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5d492-e651-47b6-a9b2-d514d8eea4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:01.618657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5d492-e651-47b6-a9b2-d514d8eea4a8 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:01.618935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5d492-e651-47b6-a9b2-d514d8eea4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:01.619206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5d492-e651-47b6-a9b2-d514d8eea4a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:01.630816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5d492-e651-47b6-a9b2-d514d8eea4a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:01.639252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-23b5d492-e651-47b6-a9b2-d514d8eea4a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:01.639252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:01.639252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:01.639252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:01.639252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:01.639252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:01.639252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:01.639252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:01.639252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:01.639252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:01.639252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:01.639252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:01.639252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:01.639252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:01.639252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:01.639252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:01.640357 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:01.640357 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:01.640357 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:01.640357 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:01.640357 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:01.640357 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:01.640357 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:01.640357 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:01.640357 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:01.640357 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:01.640357 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:01.640357 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:01.640357 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:01.640357 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:01.640357 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:01.640357 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:01.641199 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:01.641199 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:01.641199 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:01.641199 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:01.641199 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:01.641199 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:01.641199 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:01.641199 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:01.641199 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:01.641199 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:01.641199 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:01.641199 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:01.641199 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 92/185] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:44:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:01.643210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5d492-e651-47b6-a9b2-d514d8eea4a8 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:01.658242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42052f-33b4-490d-b560-84910c9a0f0f None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:01.675069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:01.699648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f28d27-73de-4e3c-91f0-70cdef4d230a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:01.700567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f28d27-73de-4e3c-91f0-70cdef4d230a None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:01.700806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f28d27-73de-4e3c-91f0-70cdef4d230a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:01.701086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f28d27-73de-4e3c-91f0-70cdef4d230a None admin] PATH_INFO: `/v3/users/01308079b08d469b8f639c49f9b8e1a7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:01.702367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f28d27-73de-4e3c-91f0-70cdef4d230a None admin] RBAC: Authorizing `identity:get_user(user_id=01308079b08d469b8f639c49f9b8e1a7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:01.703832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f28d27-73de-4e3c-91f0-70cdef4d230a None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:01.705789 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 94/186] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:01 2022] GET /identity/v3/users/01308079b08d469b8f639c49f9b8e1a7 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:01.706998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4189a-c6cb-4c99-99b0-4552ca9ce33b None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:01.707280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4189a-c6cb-4c99-99b0-4552ca9ce33b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:01.707555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4189a-c6cb-4c99-99b0-4552ca9ce33b None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:01.708814 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 95/187] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:01.709552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4189a-c6cb-4c99-99b0-4552ca9ce33b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:01.772217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:01.774625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5d492-e651-47b6-a9b2-d514d8eea4a8 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:01.810371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23621bd2-a706-492d-80bf-1762ed2f8ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:01.811033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23621bd2-a706-492d-80bf-1762ed2f8ebf None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:01.811317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23621bd2-a706-492d-80bf-1762ed2f8ebf None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:01.811595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23621bd2-a706-492d-80bf-1762ed2f8ebf None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:01.812376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23621bd2-a706-492d-80bf-1762ed2f8ebf None admin] RBAC: Adding query filter params (name=admin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:01.812686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23621bd2-a706-492d-80bf-1762ed2f8ebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:01.814121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23621bd2-a706-492d-80bf-1762ed2f8ebf None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:01.822540 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 93/188] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:01.823334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23621bd2-a706-492d-80bf-1762ed2f8ebf None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:01.829378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4189a-c6cb-4c99-99b0-4552ca9ce33b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:01.861812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065187bd-f35c-41ce-a041-5f2e110067eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:01.862475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065187bd-f35c-41ce-a041-5f2e110067eb None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:01.862756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065187bd-f35c-41ce-a041-5f2e110067eb None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:01.863028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065187bd-f35c-41ce-a041-5f2e110067eb None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:01.863735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065187bd-f35c-41ce-a041-5f2e110067eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:01.865235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065187bd-f35c-41ce-a041-5f2e110067eb None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:01.890910 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 96/189] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Jul 2 20:44:01 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:44:01.890910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065187bd-f35c-41ce-a041-5f2e110067eb None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:01.918879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:01.938264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23621bd2-a706-492d-80bf-1762ed2f8ebf None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:01.982195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52f646-7705-4dac-a993-67e0b181a73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:01.983305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52f646-7705-4dac-a993-67e0b181a73b None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:01.983593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52f646-7705-4dac-a993-67e0b181a73b None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:01.983873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52f646-7705-4dac-a993-67e0b181a73b None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:01.984668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52f646-7705-4dac-a993-67e0b181a73b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:01.984980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52f646-7705-4dac-a993-67e0b181a73b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:01.986558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52f646-7705-4dac-a993-67e0b181a73b None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:01.996085 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 94/190] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:01.997429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd30b1b-3261-4a20-9649-35d26e90571e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:01.997717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd30b1b-3261-4a20-9649-35d26e90571e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:01.997995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd30b1b-3261-4a20-9649-35d26e90571e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:02.008176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065187bd-f35c-41ce-a041-5f2e110067eb None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:02.010729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:02.026702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-dbd30b1b-3261-4a20-9649-35d26e90571e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:02.028201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dbd30b1b-3261-4a20-9649-35d26e90571e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:02.048441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721900f-4d3b-407b-982a-cfbe6732e3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:02.049221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721900f-4d3b-407b-982a-cfbe6732e3fb None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:02.049504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721900f-4d3b-407b-982a-cfbe6732e3fb None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:02.049777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721900f-4d3b-407b-982a-cfbe6732e3fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:02.109128 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 95/191] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:02.109866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd30b1b-3261-4a20-9649-35d26e90571e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:02.138756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721900f-4d3b-407b-982a-cfbe6732e3fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:02.140276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721900f-4d3b-407b-982a-cfbe6732e3fb None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:02.202500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:02.232227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd30b1b-3261-4a20-9649-35d26e90571e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:02.258150 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 97/192] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:02.259013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721900f-4d3b-407b-982a-cfbe6732e3fb None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:02.263541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:02.268237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08614c00-65d7-4081-9d47-91816fbcc74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:02.269273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08614c00-65d7-4081-9d47-91816fbcc74f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:02.269555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08614c00-65d7-4081-9d47-91816fbcc74f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:02.269827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08614c00-65d7-4081-9d47-91816fbcc74f None admin] PATH_INFO: `/v3/users/bc4088f2c5a74c84a964afd1a38e9cce` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:02.286261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08614c00-65d7-4081-9d47-91816fbcc74f None admin] RBAC: Authorizing `identity:get_user(user_id=bc4088f2c5a74c84a964afd1a38e9cce)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:02.287642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08614c00-65d7-4081-9d47-91816fbcc74f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:02.289593 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 96/193] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:02 2022] GET /identity/v3/users/bc4088f2c5a74c84a964afd1a38e9cce => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:02.290258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08614c00-65d7-4081-9d47-91816fbcc74f None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:02.401435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721900f-4d3b-407b-982a-cfbe6732e3fb None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:02.424929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08614c00-65d7-4081-9d47-91816fbcc74f None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:02.452619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65744a6-0a05-432e-9dbc-376ec2486eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:02.453756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65744a6-0a05-432e-9dbc-376ec2486eaa None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:02.454450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65744a6-0a05-432e-9dbc-376ec2486eaa None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:02.454974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65744a6-0a05-432e-9dbc-376ec2486eaa None admin] PATH_INFO: `/v3/users/bc4088f2c5a74c84a964afd1a38e9cce` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:02.456692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65744a6-0a05-432e-9dbc-376ec2486eaa None admin] RBAC: Authorizing `identity:get_user(user_id=bc4088f2c5a74c84a964afd1a38e9cce)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:02.458862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65744a6-0a05-432e-9dbc-376ec2486eaa None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:02.460708 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 98/194] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:02 2022] GET /identity/v3/users/bc4088f2c5a74c84a964afd1a38e9cce => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:02.461301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65744a6-0a05-432e-9dbc-376ec2486eaa None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:02.467735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69bbff-b20e-41da-9c12-d04dd9ef4893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:02.468742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69bbff-b20e-41da-9c12-d04dd9ef4893 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:02.469038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69bbff-b20e-41da-9c12-d04dd9ef4893 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:02.469293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69bbff-b20e-41da-9c12-d04dd9ef4893 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:02.471708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:02.482842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69bbff-b20e-41da-9c12-d04dd9ef4893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:02.491599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-df69bbff-b20e-41da-9c12-d04dd9ef4893 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:44:02.491599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:02.491599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:02.491599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:02.491599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:02.491599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:02.491599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:02.491599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:02.491599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:02.491599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:02.491599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:02.491599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:02.491599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:02.491599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:02.491599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:02.491599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:02.492636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:02.492636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:02.492636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:02.492636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:02.492636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:02.492636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:02.492636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:02.492636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:02.492636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:02.492636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:02.492636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:02.492636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:02.492636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:02.492636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:02.492636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:02.492636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:02.493865 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:02.493865 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:02.493865 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:02.493865 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:02.493865 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:02.493865 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:02.493865 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:02.493865 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:02.493865 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:02.493865 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:02.493865 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:44:02.493865 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:02.495137 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 97/195] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:02.499937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69bbff-b20e-41da-9c12-d04dd9ef4893 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:02.542843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:02.584163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65744a6-0a05-432e-9dbc-376ec2486eaa None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:02.617587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69bbff-b20e-41da-9c12-d04dd9ef4893 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:02.628342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb70a7-ae32-4826-9148-dfc2c673ab94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:02.629217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb70a7-ae32-4826-9148-dfc2c673ab94 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:02.629490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb70a7-ae32-4826-9148-dfc2c673ab94 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:02.629756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb70a7-ae32-4826-9148-dfc2c673ab94 None admin] PATH_INFO: `/v3/projects/9850be07090e4c8ba576673c9d00bce3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:02.631877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb70a7-ae32-4826-9148-dfc2c673ab94 None admin] RBAC: Authorizing `identity:get_project(project_id=9850be07090e4c8ba576673c9d00bce3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:02.633529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb70a7-ae32-4826-9148-dfc2c673ab94 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:02.640518 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 99/196] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:02 2022] GET /identity/v3/projects/9850be07090e4c8ba576673c9d00bce3 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:02.640518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb70a7-ae32-4826-9148-dfc2c673ab94 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:02.670382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafe9f6-3b67-488e-bba7-13cfe9e87281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:02.671041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafe9f6-3b67-488e-bba7-13cfe9e87281 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:02.671321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafe9f6-3b67-488e-bba7-13cfe9e87281 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:02.671592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafe9f6-3b67-488e-bba7-13cfe9e87281 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:02.738042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:02.747565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafe9f6-3b67-488e-bba7-13cfe9e87281 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:02.749087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafe9f6-3b67-488e-bba7-13cfe9e87281 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:02.777595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb70a7-ae32-4826-9148-dfc2c673ab94 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:02.821846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0c72b-9e0b-454b-a1e9-98fa35566003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:02.822993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0c72b-9e0b-454b-a1e9-98fa35566003 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:02.824402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0c72b-9e0b-454b-a1e9-98fa35566003 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:02.824878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0c72b-9e0b-454b-a1e9-98fa35566003 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:02.837857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:02.863489 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 98/197] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:02.864757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafe9f6-3b67-488e-bba7-13cfe9e87281 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:02.907703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0c72b-9e0b-454b-a1e9-98fa35566003 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:02.909801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0c72b-9e0b-454b-a1e9-98fa35566003 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:02.966383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:02.974747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafe9f6-3b67-488e-bba7-13cfe9e87281 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:03.016550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9d0ac-ac13-41e4-ba25-152aa369ae41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:03.017672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9d0ac-ac13-41e4-ba25-152aa369ae41 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:03.018045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9d0ac-ac13-41e4-ba25-152aa369ae41 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:03.018829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9d0ac-ac13-41e4-ba25-152aa369ae41 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:03.019933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9d0ac-ac13-41e4-ba25-152aa369ae41 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:03.020349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9d0ac-ac13-41e4-ba25-152aa369ae41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:03.022094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9d0ac-ac13-41e4-ba25-152aa369ae41 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:03.033674 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 99/198] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:03.036892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9d0ac-ac13-41e4-ba25-152aa369ae41 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:03.044991 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 100/199] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:03.049900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0c72b-9e0b-454b-a1e9-98fa35566003 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:03.102300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:03.164085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9d0ac-ac13-41e4-ba25-152aa369ae41 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:03.182529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0c72b-9e0b-454b-a1e9-98fa35566003 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:03.204296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a44d68-0526-4c90-8014-6d00117a8cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:03.205277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a44d68-0526-4c90-8014-6d00117a8cff None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:03.205789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a44d68-0526-4c90-8014-6d00117a8cff None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:03.206260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a44d68-0526-4c90-8014-6d00117a8cff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:03.207279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a44d68-0526-4c90-8014-6d00117a8cff None admin] RBAC: Adding query filter params (role.id=dd546359e98c4932adc5eef83b817e81, scope.project.id=9850be07090e4c8ba576673c9d00bce3, user.id=01308079b08d469b8f639c49f9b8e1a7) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:03.207817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a44d68-0526-4c90-8014-6d00117a8cff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:03.209615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a44d68-0526-4c90-8014-6d00117a8cff None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:03.220422 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 100/200] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:44:03 2022] GET /identity/v3/role_assignments?user.id=01308079b08d469b8f639c49f9b8e1a7&scope.project.id=9850be07090e4c8ba576673c9d00bce3&role.id=dd546359e98c4932adc5eef83b817e81 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:03.221650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a44d68-0526-4c90-8014-6d00117a8cff None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:03.237534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce30e20-ec13-4f08-8269-32d8995930ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:03.238372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce30e20-ec13-4f08-8269-32d8995930ea None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:03.238657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce30e20-ec13-4f08-8269-32d8995930ea None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:03.238934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce30e20-ec13-4f08-8269-32d8995930ea None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:03.240394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce30e20-ec13-4f08-8269-32d8995930ea None admin] RBAC: Authorizing `identity:get_project(project_id=850e1f68d7b14cafb6e5424ddbee9a91)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:03.241811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce30e20-ec13-4f08-8269-32d8995930ea None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:03.250072 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 101/201] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:03 2022] GET /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:03.250072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce30e20-ec13-4f08-8269-32d8995930ea None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:03.269246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:03.418121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a44d68-0526-4c90-8014-6d00117a8cff None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:03.446308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce30e20-ec13-4f08-8269-32d8995930ea None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:03.471553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:03.498010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26052bc0-ce46-49e6-8e5f-6e37c8e7e8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:03.499559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26052bc0-ce46-49e6-8e5f-6e37c8e7e8ab None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:03.500364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26052bc0-ce46-49e6-8e5f-6e37c8e7e8ab None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:03.501099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26052bc0-ce46-49e6-8e5f-6e37c8e7e8ab None admin] PATH_INFO: `/v3/users/f6b4da9871f6467eb6e321ff49597215` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:03.502764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26052bc0-ce46-49e6-8e5f-6e37c8e7e8ab None admin] RBAC: Authorizing `identity:get_user(user_id=f6b4da9871f6467eb6e321ff49597215)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:03.505081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26052bc0-ce46-49e6-8e5f-6e37c8e7e8ab None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:03.507412 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 101/202] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:03 2022] GET /identity/v3/users/f6b4da9871f6467eb6e321ff49597215 => generated 289 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:03.507668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d5bf1-76fd-4304-a05b-01845e6818a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:03.512067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d5bf1-76fd-4304-a05b-01845e6818a0 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:03.512067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d5bf1-76fd-4304-a05b-01845e6818a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:03.512067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d5bf1-76fd-4304-a05b-01845e6818a0 None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:03.512067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d5bf1-76fd-4304-a05b-01845e6818a0 None admin] RBAC: Authorizing `identity:get_project(project_id=850e1f68d7b14cafb6e5424ddbee9a91)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:03.512067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d5bf1-76fd-4304-a05b-01845e6818a0 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:03.513450 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 102/203] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:03 2022] GET /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:03.513703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26052bc0-ce46-49e6-8e5f-6e37c8e7e8ab None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:03.517274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d5bf1-76fd-4304-a05b-01845e6818a0 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:03.622545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:03.641255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26052bc0-ce46-49e6-8e5f-6e37c8e7e8ab None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:03.642895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d5bf1-76fd-4304-a05b-01845e6818a0 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:03.690899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b24c6-6edb-41a1-8e74-d6707697b9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:03.691214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b24c6-6edb-41a1-8e74-d6707697b9b6 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:03.691762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b24c6-6edb-41a1-8e74-d6707697b9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:03.691762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b24c6-6edb-41a1-8e74-d6707697b9b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:03.692585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b24c6-6edb-41a1-8e74-d6707697b9b6 None admin] RBAC: Adding query filter params (role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91, user.id=bc4088f2c5a74c84a964afd1a38e9cce) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:03.692897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b24c6-6edb-41a1-8e74-d6707697b9b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:03.694470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b24c6-6edb-41a1-8e74-d6707697b9b6 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:03.697046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85ab0b-a396-413b-8e43-ca492d38ea2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:03.698203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85ab0b-a396-413b-8e43-ca492d38ea2a None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:03.699210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85ab0b-a396-413b-8e43-ca492d38ea2a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:03.699963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85ab0b-a396-413b-8e43-ca492d38ea2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:03.701684 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 102/204] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:44:03 2022] GET /identity/v3/role_assignments?user.id=bc4088f2c5a74c84a964afd1a38e9cce&scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:03.702327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b24c6-6edb-41a1-8e74-d6707697b9b6 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:03.764358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:03.796306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85ab0b-a396-413b-8e43-ca492d38ea2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:03.798332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85ab0b-a396-413b-8e43-ca492d38ea2a None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:03.842838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b24c6-6edb-41a1-8e74-d6707697b9b6 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:03.896664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd55c89-c0a3-41af-b3bc-0ffe33c0faa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:03.897339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd55c89-c0a3-41af-b3bc-0ffe33c0faa4 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:03.897621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd55c89-c0a3-41af-b3bc-0ffe33c0faa4 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:03.897893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd55c89-c0a3-41af-b3bc-0ffe33c0faa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:03.898733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd55c89-c0a3-41af-b3bc-0ffe33c0faa4 None admin] RBAC: Adding query filter params (role.id=74cf644f6b8f49ce86fffcde317f8883, scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91, user.id=bc4088f2c5a74c84a964afd1a38e9cce) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:03.899043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd55c89-c0a3-41af-b3bc-0ffe33c0faa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:03.900570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd55c89-c0a3-41af-b3bc-0ffe33c0faa4 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:03.917396 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 103/205] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:44:03 2022] GET /identity/v3/role_assignments?user.id=bc4088f2c5a74c84a964afd1a38e9cce&scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91&role.id=74cf644f6b8f49ce86fffcde317f8883 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:03.973038 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 103/206] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:03.979173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd55c89-c0a3-41af-b3bc-0ffe33c0faa4 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:04.003479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:04.147188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd55c89-c0a3-41af-b3bc-0ffe33c0faa4 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:04.189076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1598a49-8a10-4715-93f3-eb10a518fd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:04.189953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1598a49-8a10-4715-93f3-eb10a518fd40 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:04.190235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1598a49-8a10-4715-93f3-eb10a518fd40 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:04.190507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1598a49-8a10-4715-93f3-eb10a518fd40 None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:04.191700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1598a49-8a10-4715-93f3-eb10a518fd40 None admin] RBAC: Authorizing `identity:get_project(project_id=7b6fb712e361438587cb7af5e9fdce33)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:04.193185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1598a49-8a10-4715-93f3-eb10a518fd40 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:04.194896 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 104/207] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:03 2022] GET /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:04.200952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85ab0b-a396-413b-8e43-ca492d38ea2a None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:04.291001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:04.326370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85ab0b-a396-413b-8e43-ca492d38ea2a None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:04.374838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3218119-9069-47d0-91a1-0bedee2840ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:04.376019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3218119-9069-47d0-91a1-0bedee2840ec None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:04.376665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3218119-9069-47d0-91a1-0bedee2840ec None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:04.377138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3218119-9069-47d0-91a1-0bedee2840ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:04.378200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3218119-9069-47d0-91a1-0bedee2840ec None admin] RBAC: Adding query filter params (role.id=626342454d8044849bcbaa4f6d292aed, scope.project.id=7b6fb712e361438587cb7af5e9fdce33, user.id=f6b4da9871f6467eb6e321ff49597215) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:04.378729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3218119-9069-47d0-91a1-0bedee2840ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:04.380541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3218119-9069-47d0-91a1-0bedee2840ec None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:04.387864 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 104/208] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:44:04 2022] GET /identity/v3/role_assignments?user.id=f6b4da9871f6467eb6e321ff49597215&scope.project.id=7b6fb712e361438587cb7af5e9fdce33&role.id=626342454d8044849bcbaa4f6d292aed => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:04.535143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ad318-c7a0-4174-9d00-72dccd0a9536 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:04.535628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ad318-c7a0-4174-9d00-72dccd0a9536 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:04.535910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ad318-c7a0-4174-9d00-72dccd0a9536 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:04.537744 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 105/209] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:04.543052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd9b16-b238-412e-bedd-ff4aea089bb1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:04.543627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd9b16-b238-412e-bedd-ff4aea089bb1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:04.544257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd9b16-b238-412e-bedd-ff4aea089bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:04.563370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5ffd9b16-b238-412e-bedd-ff4aea089bb1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:04.569412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5ffd9b16-b238-412e-bedd-ff4aea089bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:04.615678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2508a-36ff-4c45-96c9-4ff98e83d898 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:04.615995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2508a-36ff-4c45-96c9-4ff98e83d898 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:04.616308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2508a-36ff-4c45-96c9-4ff98e83d898 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:04.618127 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 106/210] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:04.623329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f419-7891-411c-8bba-b56a8e377f55 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:04.623630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f419-7891-411c-8bba-b56a8e377f55 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:04.623886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f419-7891-411c-8bba-b56a8e377f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:04.652751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5651f419-7891-411c-8bba-b56a8e377f55 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:04.653960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5651f419-7891-411c-8bba-b56a8e377f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:04.657691 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 105/211] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:04.694704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd9b16-b238-412e-bedd-ff4aea089bb1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:04.737015 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 107/212] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:04.765464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651f419-7891-411c-8bba-b56a8e377f55 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:04.778444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:04.788385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:04.812500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd9b16-b238-412e-bedd-ff4aea089bb1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:04.853361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf53a1b-6168-4e98-b133-d8e8d524c610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:04.854757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf53a1b-6168-4e98-b133-d8e8d524c610 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:04.855219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf53a1b-6168-4e98-b133-d8e8d524c610 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:04.855833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf53a1b-6168-4e98-b133-d8e8d524c610 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:04.869966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf53a1b-6168-4e98-b133-d8e8d524c610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:04.880566 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-dbf53a1b-6168-4e98-b133-d8e8d524c610 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:04.880566 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:04.880566 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:04.880566 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:04.880566 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:04.880566 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:04.880566 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:04.880566 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:04.880566 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:04.880566 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:04.880566 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:04.880566 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:04.880566 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:04.880566 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:04.880566 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:04.880566 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:04.881471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:04.881471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:04.881471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:04.881471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:04.881471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:04.881471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:04.881471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:04.881471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:04.881471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:04.881471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:04.881471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:04.881471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:04.881471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:04.881471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:04.881471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:04.881471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:04.882314 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:04.882314 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:04.882314 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:04.882314 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:04.882314 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:04.882314 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:04.882314 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:04.882314 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:04.882314 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:04.882314 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:04.882314 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:04.882314 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:04.884613 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 106/213] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:04.893467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf53a1b-6168-4e98-b133-d8e8d524c610 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:04.896324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651f419-7891-411c-8bba-b56a8e377f55 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:04.942206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe2816-e16c-4815-a6cb-767c02ddb078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:04.943015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe2816-e16c-4815-a6cb-767c02ddb078 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:04.943290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe2816-e16c-4815-a6cb-767c02ddb078 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:04.943561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe2816-e16c-4815-a6cb-767c02ddb078 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:04.945428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe2816-e16c-4815-a6cb-767c02ddb078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:04.946884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe2816-e16c-4815-a6cb-767c02ddb078 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:04.950010 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 108/214] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:04.955640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe2816-e16c-4815-a6cb-767c02ddb078 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:05.029027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf53a1b-6168-4e98-b133-d8e8d524c610 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:05.057782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:05.058874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:05.064736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838208f9-a90f-4714-9841-06473daf328c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:05.065426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838208f9-a90f-4714-9841-06473daf328c None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:05.065805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838208f9-a90f-4714-9841-06473daf328c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:05.066172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838208f9-a90f-4714-9841-06473daf328c None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:05.067019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838208f9-a90f-4714-9841-06473daf328c None admin] RBAC: Adding query filter params (name=member) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:05.067672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838208f9-a90f-4714-9841-06473daf328c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:05.069499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838208f9-a90f-4714-9841-06473daf328c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:05.078697 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 107/215] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:05.081961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe2816-e16c-4815-a6cb-767c02ddb078 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:05.084258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838208f9-a90f-4714-9841-06473daf328c None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:05.119142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3e9fe-b653-4379-b984-d0b24d784fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:05.121509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3e9fe-b653-4379-b984-d0b24d784fe1 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:05.122048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3e9fe-b653-4379-b984-d0b24d784fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:05.122563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3e9fe-b653-4379-b984-d0b24d784fe1 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:05.123574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3e9fe-b653-4379-b984-d0b24d784fe1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:05.125359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3e9fe-b653-4379-b984-d0b24d784fe1 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:05.156211 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 109/216] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Jul 2 20:44:04 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:44:05.194475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838208f9-a90f-4714-9841-06473daf328c None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:05.231794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845aa58-382e-4711-8edc-0f55dfbde8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:05.232719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845aa58-382e-4711-8edc-0f55dfbde8c3 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:05.233003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845aa58-382e-4711-8edc-0f55dfbde8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:05.233276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845aa58-382e-4711-8edc-0f55dfbde8c3 None admin] PATH_INFO: `/v3/users/3f59d8f5b72440c7858c295e9ed899d1` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:05.248813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845aa58-382e-4711-8edc-0f55dfbde8c3 None admin] RBAC: Authorizing `identity:get_user(user_id=3f59d8f5b72440c7858c295e9ed899d1)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:05.250445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845aa58-382e-4711-8edc-0f55dfbde8c3 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:05.252661 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 108/217] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:05 2022] GET /identity/v3/users/3f59d8f5b72440c7858c295e9ed899d1 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:05.258237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3e9fe-b653-4379-b984-d0b24d784fe1 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:05.368195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3e9fe-b653-4379-b984-d0b24d784fe1 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:05.404697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf311565-c997-40a4-adf8-00ef9dd64439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:05.405351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf311565-c997-40a4-adf8-00ef9dd64439 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:05.405647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf311565-c997-40a4-adf8-00ef9dd64439 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:05.405954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf311565-c997-40a4-adf8-00ef9dd64439 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:05.414858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:05.477727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf311565-c997-40a4-adf8-00ef9dd64439 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:05.479198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf311565-c997-40a4-adf8-00ef9dd64439 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:05.583264 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 110/218] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:05.588902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845aa58-382e-4711-8edc-0f55dfbde8c3 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:05.645902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:05.700772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845aa58-382e-4711-8edc-0f55dfbde8c3 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:05.735685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0d6a1-0245-471a-8c1c-22f2fabb75f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:05.736599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0d6a1-0245-471a-8c1c-22f2fabb75f8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:05.736875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0d6a1-0245-471a-8c1c-22f2fabb75f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:05.737139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0d6a1-0245-471a-8c1c-22f2fabb75f8 None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:05.738417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0d6a1-0245-471a-8c1c-22f2fabb75f8 None admin] RBAC: Authorizing `identity:get_project(project_id=850e1f68d7b14cafb6e5424ddbee9a91)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:05.740665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0d6a1-0245-471a-8c1c-22f2fabb75f8 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:05.742516 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 109/219] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:05 2022] GET /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:05.748508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf311565-c997-40a4-adf8-00ef9dd64439 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:05.792030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:05.871840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf311565-c997-40a4-adf8-00ef9dd64439 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:05.914755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db18e73-c40d-4a40-98fd-b51b35577307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:05.915539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db18e73-c40d-4a40-98fd-b51b35577307 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:05.915819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db18e73-c40d-4a40-98fd-b51b35577307 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:05.916123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db18e73-c40d-4a40-98fd-b51b35577307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:05.916955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db18e73-c40d-4a40-98fd-b51b35577307 None admin] RBAC: Adding query filter params (role.id=dd546359e98c4932adc5eef83b817e81, scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91, user.id=3f59d8f5b72440c7858c295e9ed899d1) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:05.917265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db18e73-c40d-4a40-98fd-b51b35577307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:05.918788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db18e73-c40d-4a40-98fd-b51b35577307 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:05.924960 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 111/220] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:44:05 2022] GET /identity/v3/role_assignments?user.id=3f59d8f5b72440c7858c295e9ed899d1&scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91&role.id=dd546359e98c4932adc5eef83b817e81 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:06.502447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293caf63-63d7-4604-8cde-7f6a11793d4b None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:06.502447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293caf63-63d7-4604-8cde-7f6a11793d4b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:06.502447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293caf63-63d7-4604-8cde-7f6a11793d4b None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:06.502447 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 110/221] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:06.508728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e8fbd-5987-4d1e-9a68-1dfe92fe8bba None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:06.509533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e8fbd-5987-4d1e-9a68-1dfe92fe8bba None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:06.509995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e8fbd-5987-4d1e-9a68-1dfe92fe8bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:06.527120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-113e8fbd-5987-4d1e-9a68-1dfe92fe8bba None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:06.528640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-113e8fbd-5987-4d1e-9a68-1dfe92fe8bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:06.597635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d195f-3c05-428f-84af-d12f13ba8d76 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:06.597944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d195f-3c05-428f-84af-d12f13ba8d76 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:06.598183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d195f-3c05-428f-84af-d12f13ba8d76 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:06.599674 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 111/222] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:44:06.600113 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 112/223] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:06.605131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e571c-515c-45eb-872f-5a468ebab3d4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:06.605411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e571c-515c-45eb-872f-5a468ebab3d4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:06.605682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e571c-515c-45eb-872f-5a468ebab3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:06.628964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-da1e571c-515c-45eb-872f-5a468ebab3d4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:06.630777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e8fbd-5987-4d1e-9a68-1dfe92fe8bba None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:06.642003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-da1e571c-515c-45eb-872f-5a468ebab3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:06.686833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:06.764127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e8fbd-5987-4d1e-9a68-1dfe92fe8bba None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:06.798389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6991f-0ad0-4abf-9b17-33e194a45bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:06.799187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6991f-0ad0-4abf-9b17-33e194a45bda None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:06.799462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6991f-0ad0-4abf-9b17-33e194a45bda None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:06.799730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6991f-0ad0-4abf-9b17-33e194a45bda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:06.810843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6991f-0ad0-4abf-9b17-33e194a45bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:06.818692 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-87a6991f-0ad0-4abf-9b17-33e194a45bda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:44:06.818692 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:06.818692 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:06.818692 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:06.818692 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:06.818692 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:06.818692 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:06.818692 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:06.818692 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:06.818692 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:06.818692 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:06.818692 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:06.818692 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:06.818692 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:06.818692 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:06.818692 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:06.819795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:06.819795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:06.819795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:06.819795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:06.819795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:06.819795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:06.819795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:06.819795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:06.819795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:06.819795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:06.819795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:06.819795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:06.819795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:06.819795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:06.819795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:06.819795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:06.820825 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:06.820825 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:06.820825 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:06.820825 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:06.820825 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:06.820825 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:06.820825 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:06.820825 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:06.820825 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:06.820825 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:06.820825 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:44:06.820825 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:06.820825 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 113/224] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:44:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:06.825724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6991f-0ad0-4abf-9b17-33e194a45bda None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:06.838099 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 112/225] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:06.888393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e571c-515c-45eb-872f-5a468ebab3d4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:06.953671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:06.971647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6991f-0ad0-4abf-9b17-33e194a45bda None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:06.991807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:07.020249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd732448-99e4-4bd2-936b-37d4ec747064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:07.020836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd732448-99e4-4bd2-936b-37d4ec747064 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:07.021114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd732448-99e4-4bd2-936b-37d4ec747064 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:07.021385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd732448-99e4-4bd2-936b-37d4ec747064 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:07.022123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd732448-99e4-4bd2-936b-37d4ec747064 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:07.022426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd732448-99e4-4bd2-936b-37d4ec747064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:07.023798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd732448-99e4-4bd2-936b-37d4ec747064 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:07.032923 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 114/226] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:07.039140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd732448-99e4-4bd2-936b-37d4ec747064 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:07.085573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e571c-515c-45eb-872f-5a468ebab3d4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:07.128723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccb6a9-25d8-46c0-aa69-d5ff2fa32a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:07.129589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccb6a9-25d8-46c0-aa69-d5ff2fa32a1a None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:07.129868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccb6a9-25d8-46c0-aa69-d5ff2fa32a1a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:07.130136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccb6a9-25d8-46c0-aa69-d5ff2fa32a1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:07.150904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccb6a9-25d8-46c0-aa69-d5ff2fa32a1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:07.161668 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-1eccb6a9-25d8-46c0-aa69-d5ff2fa32a1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:07.161668 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:07.161668 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:07.161668 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:07.161668 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:07.161668 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:07.161668 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:07.161668 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:07.161668 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:07.161668 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:07.161668 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:07.161668 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:07.161668 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:07.161668 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:07.161668 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:07.161668 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:07.162593 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:07.162593 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:07.162593 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:07.162593 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:07.162593 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:07.162593 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:07.162593 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:07.162593 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:07.162593 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:07.162593 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:07.162593 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:07.162593 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:07.162593 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:07.162593 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:07.162593 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:07.162593 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:07.163426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:07.163426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:07.163426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:07.163426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:07.163426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:07.163426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:07.163426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:07.163426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:07.163426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:07.163426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:07.163426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:07.163426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:07.163426 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 113/227] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:44:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:07.174000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccb6a9-25d8-46c0-aa69-d5ff2fa32a1a None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:07.222182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd732448-99e4-4bd2-936b-37d4ec747064 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:07.301714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10526b7-fa29-46cf-b99f-3d7f9497072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:07.302529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10526b7-fa29-46cf-b99f-3d7f9497072a None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:07.302812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10526b7-fa29-46cf-b99f-3d7f9497072a None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:07.303399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10526b7-fa29-46cf-b99f-3d7f9497072a None admin] PATH_INFO: `/v3/users/bc4088f2c5a74c84a964afd1a38e9cce` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:07.304633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10526b7-fa29-46cf-b99f-3d7f9497072a None admin] RBAC: Authorizing `identity:get_user(user_id=bc4088f2c5a74c84a964afd1a38e9cce)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:07.306081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10526b7-fa29-46cf-b99f-3d7f9497072a None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:07.307789 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 115/228] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:07 2022] GET /identity/v3/users/bc4088f2c5a74c84a964afd1a38e9cce => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:07.317296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10526b7-fa29-46cf-b99f-3d7f9497072a None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:07.321284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccb6a9-25d8-46c0-aa69-d5ff2fa32a1a None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:07.330594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:07.371047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:07.374065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320a774-f35b-47dc-8c6f-c62420cb255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:07.376432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320a774-f35b-47dc-8c6f-c62420cb255d None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:07.376712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320a774-f35b-47dc-8c6f-c62420cb255d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:07.376981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320a774-f35b-47dc-8c6f-c62420cb255d None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:07.377745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320a774-f35b-47dc-8c6f-c62420cb255d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:07.378811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320a774-f35b-47dc-8c6f-c62420cb255d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:07.380871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320a774-f35b-47dc-8c6f-c62420cb255d None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:07.399314 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 114/229] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:07.406695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320a774-f35b-47dc-8c6f-c62420cb255d None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:07.505610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10526b7-fa29-46cf-b99f-3d7f9497072a None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:07.529356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320a774-f35b-47dc-8c6f-c62420cb255d None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:07.565349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e0729-8444-4ea9-b19c-e6649d093b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:07.566146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e0729-8444-4ea9-b19c-e6649d093b82 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:07.566419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e0729-8444-4ea9-b19c-e6649d093b82 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:07.566682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e0729-8444-4ea9-b19c-e6649d093b82 None admin] PATH_INFO: `/v3/users/bc4088f2c5a74c84a964afd1a38e9cce` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:07.567885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e0729-8444-4ea9-b19c-e6649d093b82 None admin] RBAC: Authorizing `identity:get_user(user_id=bc4088f2c5a74c84a964afd1a38e9cce)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:07.569504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e0729-8444-4ea9-b19c-e6649d093b82 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:07.571152 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 115/230] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:07 2022] GET /identity/v3/users/bc4088f2c5a74c84a964afd1a38e9cce => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:07.576656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e0729-8444-4ea9-b19c-e6649d093b82 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:07.585714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b97c5-1e68-41ca-a2e8-969659e62b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:07.587241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b97c5-1e68-41ca-a2e8-969659e62b1d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:07.587719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b97c5-1e68-41ca-a2e8-969659e62b1d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:07.588245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b97c5-1e68-41ca-a2e8-969659e62b1d None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:07.592751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b97c5-1e68-41ca-a2e8-969659e62b1d None admin] RBAC: Authorizing `identity:get_project(project_id=850e1f68d7b14cafb6e5424ddbee9a91)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:07.594435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b97c5-1e68-41ca-a2e8-969659e62b1d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:07.596721 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 116/231] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:07 2022] GET /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91 => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:07.603856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b97c5-1e68-41ca-a2e8-969659e62b1d None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:07.622236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:07.684970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e0729-8444-4ea9-b19c-e6649d093b82 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:07.719098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a4bf3-be4e-49a9-be5d-3dc77012de83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:07.720302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a4bf3-be4e-49a9-be5d-3dc77012de83 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:07.720717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a4bf3-be4e-49a9-be5d-3dc77012de83 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:07.721139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a4bf3-be4e-49a9-be5d-3dc77012de83 None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:07.722452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a4bf3-be4e-49a9-be5d-3dc77012de83 None admin] RBAC: Authorizing `identity:get_project(project_id=850e1f68d7b14cafb6e5424ddbee9a91)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:07.728470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a4bf3-be4e-49a9-be5d-3dc77012de83 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:07.728470 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 116/232] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:07 2022] GET /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:07.739668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a4bf3-be4e-49a9-be5d-3dc77012de83 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:07.814136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:07.832082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b97c5-1e68-41ca-a2e8-969659e62b1d None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:07.889120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424edce-f403-4577-b403-60b85d0df621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:07.890024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424edce-f403-4577-b403-60b85d0df621 None admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:07.890304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424edce-f403-4577-b403-60b85d0df621 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:07.890575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424edce-f403-4577-b403-60b85d0df621 None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91/users/bc4088f2c5a74c84a964afd1a38e9cce/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:07.892610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424edce-f403-4577-b403-60b85d0df621 None admin] RBAC: Authorizing `identity:create_grant(project_id=850e1f68d7b14cafb6e5424ddbee9a91, user_id=bc4088f2c5a74c84a964afd1a38e9cce, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:07.894064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424edce-f403-4577-b403-60b85d0df621 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:07.916924 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 117/233] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:44:07 2022] PUT /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91/users/bc4088f2c5a74c84a964afd1a38e9cce/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 20:44:07.917587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a4bf3-be4e-49a9-be5d-3dc77012de83 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:07.933965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:07.970065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25883eb-cf08-4bff-9d85-f554743cebb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:07.970989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25883eb-cf08-4bff-9d85-f554743cebb5 None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:07.971315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25883eb-cf08-4bff-9d85-f554743cebb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:07.971592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25883eb-cf08-4bff-9d85-f554743cebb5 None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91/users/bc4088f2c5a74c84a964afd1a38e9cce/roles/74cf644f6b8f49ce86fffcde317f8883` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:07.977372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25883eb-cf08-4bff-9d85-f554743cebb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=850e1f68d7b14cafb6e5424ddbee9a91, user_id=bc4088f2c5a74c84a964afd1a38e9cce, role_id=74cf644f6b8f49ce86fffcde317f8883)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:07.978887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25883eb-cf08-4bff-9d85-f554743cebb5 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:08.001708 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 117/234] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:44:07 2022] PUT /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91/users/bc4088f2c5a74c84a964afd1a38e9cce/roles/74cf644f6b8f49ce86fffcde317f8883 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:44:08.183163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be1e2-bc2d-4fb4-a974-b3c7d17ed7c7 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:08.183641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be1e2-bc2d-4fb4-a974-b3c7d17ed7c7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:08.183861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be1e2-bc2d-4fb4-a974-b3c7d17ed7c7 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:08.185495 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 118/235] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:08.191494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c904d0-9e31-4907-a3a4-7254d6ea5a09 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:08.191784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c904d0-9e31-4907-a3a4-7254d6ea5a09 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:08.192083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c904d0-9e31-4907-a3a4-7254d6ea5a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:08.210428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a6c904d0-9e31-4907-a3a4-7254d6ea5a09 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:08.211644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a6c904d0-9e31-4907-a3a4-7254d6ea5a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:08.300030 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 118/236] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:08.314776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2efe55-6aef-4ce1-983a-ee8a1bc404f3 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:08.315077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2efe55-6aef-4ce1-983a-ee8a1bc404f3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:08.315333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2efe55-6aef-4ce1-983a-ee8a1bc404f3 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:08.316804 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 119/237] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:08.322954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70843b63-8c8a-4c34-b03b-48ceb28b0b36 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:08.323244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70843b63-8c8a-4c34-b03b-48ceb28b0b36 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:08.323520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70843b63-8c8a-4c34-b03b-48ceb28b0b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:08.334240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2efe55-6aef-4ce1-983a-ee8a1bc404f3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:08.345027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-70843b63-8c8a-4c34-b03b-48ceb28b0b36 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:08.346172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-70843b63-8c8a-4c34-b03b-48ceb28b0b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:08.421933 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 119/238] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:08.471485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2efe55-6aef-4ce1-983a-ee8a1bc404f3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:08.474016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70843b63-8c8a-4c34-b03b-48ceb28b0b36 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:08.520157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:08.554823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a2115-9df8-4d18-91e3-160285ce7fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:08.555630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a2115-9df8-4d18-91e3-160285ce7fa3 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:08.555905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a2115-9df8-4d18-91e3-160285ce7fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:08.556201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a2115-9df8-4d18-91e3-160285ce7fa3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:08.579169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a2115-9df8-4d18-91e3-160285ce7fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:08.587431 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-be3a2115-9df8-4d18-91e3-160285ce7fa3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:44:08.587431 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:08.587431 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:08.587431 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:08.587431 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:08.587431 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:08.587431 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:08.587431 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:08.587431 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:08.587431 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:08.587431 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:08.587431 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:08.587431 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:08.587431 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:08.587431 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:08.587431 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:08.588828 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:08.588828 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:08.588828 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:08.588828 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:08.588828 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:08.588828 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:08.588828 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:08.588828 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:08.588828 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:08.588828 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:08.588828 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:08.588828 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:08.588828 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:08.588828 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:08.588828 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:08.588828 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:08.589666 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:08.589666 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:08.589666 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:08.589666 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:08.589666 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:08.589666 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:08.589666 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:08.589666 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:08.589666 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:08.589666 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:08.589666 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:44:08.589666 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:08.597478 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 120/239] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:08.605060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a2115-9df8-4d18-91e3-160285ce7fa3 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:08.609334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70843b63-8c8a-4c34-b03b-48ceb28b0b36 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:08.634896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:08.652805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3165f-bdd9-4f94-9626-dfebbd4cdf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:08.653621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3165f-bdd9-4f94-9626-dfebbd4cdf62 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:08.653904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3165f-bdd9-4f94-9626-dfebbd4cdf62 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:08.654182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3165f-bdd9-4f94-9626-dfebbd4cdf62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:08.655491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3165f-bdd9-4f94-9626-dfebbd4cdf62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:08.657169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3165f-bdd9-4f94-9626-dfebbd4cdf62 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:08.658827 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 120/240] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:08.664449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3165f-bdd9-4f94-9626-dfebbd4cdf62 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:08.766187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:08.773405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3165f-bdd9-4f94-9626-dfebbd4cdf62 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:08.808518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aeb13a-566c-41f0-b797-e1a727985f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:08.809195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aeb13a-566c-41f0-b797-e1a727985f0d None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:08.809479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aeb13a-566c-41f0-b797-e1a727985f0d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:08.809752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aeb13a-566c-41f0-b797-e1a727985f0d None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:08.810476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aeb13a-566c-41f0-b797-e1a727985f0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:08.812029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aeb13a-566c-41f0-b797-e1a727985f0d None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:08.837552 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 121/241] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Jul 2 20:44:08 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:44:08.841833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a2115-9df8-4d18-91e3-160285ce7fa3 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:08.886477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adc9e0-20cc-4d10-be5e-c49089cf8959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:08.887084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adc9e0-20cc-4d10-be5e-c49089cf8959 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:08.887366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adc9e0-20cc-4d10-be5e-c49089cf8959 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:08.887643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adc9e0-20cc-4d10-be5e-c49089cf8959 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:08.888492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adc9e0-20cc-4d10-be5e-c49089cf8959 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:08.888803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adc9e0-20cc-4d10-be5e-c49089cf8959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:08.890231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adc9e0-20cc-4d10-be5e-c49089cf8959 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:08.906235 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 121/242] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:08.910742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aeb13a-566c-41f0-b797-e1a727985f0d None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:08.980688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e474c6-79e5-4e9f-9e23-844430a564f0 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:08.980997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e474c6-79e5-4e9f-9e23-844430a564f0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:08.981250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e474c6-79e5-4e9f-9e23-844430a564f0 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:08.982784 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 122/243] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:08.988408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349d754-c510-4cbb-8113-0c411a218368 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:08.988689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349d754-c510-4cbb-8113-0c411a218368 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:08.988960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349d754-c510-4cbb-8113-0c411a218368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:09.023393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2349d754-c510-4cbb-8113-0c411a218368 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:09.024735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2349d754-c510-4cbb-8113-0c411a218368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:09.066260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aeb13a-566c-41f0-b797-e1a727985f0d None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:09.113364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22176f11-1cc7-462a-9c6a-2fab919bba48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:09.114726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22176f11-1cc7-462a-9c6a-2fab919bba48 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:09.115152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22176f11-1cc7-462a-9c6a-2fab919bba48 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:09.115570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22176f11-1cc7-462a-9c6a-2fab919bba48 None admin] PATH_INFO: `/v3/users/7bb2d75d1d5246dcb5e89b517be26a0a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:09.120678 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 123/244] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:44:09.130612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22176f11-1cc7-462a-9c6a-2fab919bba48 None admin] RBAC: Authorizing `identity:get_user(user_id=7bb2d75d1d5246dcb5e89b517be26a0a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:09.132349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22176f11-1cc7-462a-9c6a-2fab919bba48 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:09.134256 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 122/245] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:08 2022] GET /identity/v3/users/7bb2d75d1d5246dcb5e89b517be26a0a => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:09.140115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349d754-c510-4cbb-8113-0c411a218368 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:09.142965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:09.148345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22176f11-1cc7-462a-9c6a-2fab919bba48 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:09.161679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:09.254171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349d754-c510-4cbb-8113-0c411a218368 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:09.255396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22176f11-1cc7-462a-9c6a-2fab919bba48 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:09.293406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bbcc3-d80c-418c-bd08-5aa309f996ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:09.294263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bbcc3-d80c-418c-bd08-5aa309f996ee None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:09.294595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bbcc3-d80c-418c-bd08-5aa309f996ee None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:09.294870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bbcc3-d80c-418c-bd08-5aa309f996ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:09.304655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f2e7e-5058-4f09-b773-497619c8c6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:09.305312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f2e7e-5058-4f09-b773-497619c8c6b0 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:09.305590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f2e7e-5058-4f09-b773-497619c8c6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:09.305906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f2e7e-5058-4f09-b773-497619c8c6b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:09.306845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bbcc3-d80c-418c-bd08-5aa309f996ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:09.316050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-bb8bbcc3-d80c-418c-bd08-5aa309f996ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:09.316050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:09.316050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:09.316050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:09.316050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:09.316050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:09.316050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:09.316050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:09.316050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:09.316050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:09.316050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:09.316050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:09.316050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:09.316050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:09.316050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:09.316050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:09.317044 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:09.317044 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:09.317044 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:09.317044 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:09.317044 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:09.317044 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:09.317044 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:09.317044 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:09.317044 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:09.317044 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:09.317044 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:09.317044 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:09.317044 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:09.317044 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:09.317044 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:09.317044 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:09.317856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:09.317856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:09.317856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:09.317856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:09.317856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:09.317856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:09.317856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:09.317856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:09.317856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:09.317856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:09.317856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:09.317856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:09.317856 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 123/246] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:09.323264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bbcc3-d80c-418c-bd08-5aa309f996ee None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:09.379005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f2e7e-5058-4f09-b773-497619c8c6b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:09.380584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f2e7e-5058-4f09-b773-497619c8c6b0 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:09.392506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:09.392862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:09.433081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bbcc3-d80c-418c-bd08-5aa309f996ee None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:09.481487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3e6d6-94a1-4e61-a89d-453ba2801ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:09.482264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3e6d6-94a1-4e61-a89d-453ba2801ed2 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:09.482548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3e6d6-94a1-4e61-a89d-453ba2801ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:09.482824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3e6d6-94a1-4e61-a89d-453ba2801ed2 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:09.483584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3e6d6-94a1-4e61-a89d-453ba2801ed2 None admin] RBAC: Adding query filter params (name=member) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:09.483893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3e6d6-94a1-4e61-a89d-453ba2801ed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:09.485563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3e6d6-94a1-4e61-a89d-453ba2801ed2 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:09.498158 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 124/247] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:09.501398 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 124/248] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:09.505249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f2e7e-5058-4f09-b773-497619c8c6b0 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:09.508379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3e6d6-94a1-4e61-a89d-453ba2801ed2 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:09.635908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3e6d6-94a1-4e61-a89d-453ba2801ed2 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:09.639841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f2e7e-5058-4f09-b773-497619c8c6b0 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:09.641451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:09.670462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:09.679745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f20bf3-2744-402a-aa22-577b946a50cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:09.680779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f20bf3-2744-402a-aa22-577b946a50cb None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:09.681057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f20bf3-2744-402a-aa22-577b946a50cb None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:09.681394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f20bf3-2744-402a-aa22-577b946a50cb None admin] PATH_INFO: `/v3/users/3f59d8f5b72440c7858c295e9ed899d1` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:09.682513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f20bf3-2744-402a-aa22-577b946a50cb None admin] RBAC: Authorizing `identity:get_user(user_id=3f59d8f5b72440c7858c295e9ed899d1)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:09.683992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f20bf3-2744-402a-aa22-577b946a50cb None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:09.684781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d2a2f-3d94-4bfe-afc7-c92f1e749133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:09.685826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d2a2f-3d94-4bfe-afc7-c92f1e749133 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:09.686237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d2a2f-3d94-4bfe-afc7-c92f1e749133 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:09.686653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d2a2f-3d94-4bfe-afc7-c92f1e749133 None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:09.687982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d2a2f-3d94-4bfe-afc7-c92f1e749133 None admin] RBAC: Authorizing `identity:get_project(project_id=850e1f68d7b14cafb6e5424ddbee9a91)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:09.689666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d2a2f-3d94-4bfe-afc7-c92f1e749133 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:09.690255 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 125/249] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:09 2022] GET /identity/v3/users/3f59d8f5b72440c7858c295e9ed899d1 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:09.691434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f20bf3-2744-402a-aa22-577b946a50cb None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:09.692082 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 125/250] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:09 2022] GET /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:09.697325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d2a2f-3d94-4bfe-afc7-c92f1e749133 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:09.823084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f20bf3-2744-402a-aa22-577b946a50cb None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:09.833922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d2a2f-3d94-4bfe-afc7-c92f1e749133 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:09.860429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bc1d6-5a53-4396-a7de-cbfac8d7178c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:09.861697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bc1d6-5a53-4396-a7de-cbfac8d7178c None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:09.861815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bc1d6-5a53-4396-a7de-cbfac8d7178c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:09.862031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bc1d6-5a53-4396-a7de-cbfac8d7178c None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:09.863243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bc1d6-5a53-4396-a7de-cbfac8d7178c None admin] RBAC: Authorizing `identity:get_project(project_id=850e1f68d7b14cafb6e5424ddbee9a91)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:09.864823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bc1d6-5a53-4396-a7de-cbfac8d7178c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:09.870481 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 126/251] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:09 2022] GET /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:09.876088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bc1d6-5a53-4396-a7de-cbfac8d7178c None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:09.886397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4558c40-63d3-4730-9e1e-3f6192b2b883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:09.887055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4558c40-63d3-4730-9e1e-3f6192b2b883 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:09.887331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4558c40-63d3-4730-9e1e-3f6192b2b883 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:09.887601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4558c40-63d3-4730-9e1e-3f6192b2b883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:09.888458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4558c40-63d3-4730-9e1e-3f6192b2b883 None admin] RBAC: Adding query filter params (role.id=626342454d8044849bcbaa4f6d292aed, scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91, user.id=7bb2d75d1d5246dcb5e89b517be26a0a) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:09.888764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4558c40-63d3-4730-9e1e-3f6192b2b883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:09.890217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4558c40-63d3-4730-9e1e-3f6192b2b883 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:09.901018 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 126/252] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:44:09 2022] GET /identity/v3/role_assignments?user.id=7bb2d75d1d5246dcb5e89b517be26a0a&scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91&role.id=626342454d8044849bcbaa4f6d292aed => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:09.992703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:10.041909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bc1d6-5a53-4396-a7de-cbfac8d7178c None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:10.093052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec63a1c-024d-4f6a-af0b-2fb15e002b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:10.094880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec63a1c-024d-4f6a-af0b-2fb15e002b0a None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:10.095296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec63a1c-024d-4f6a-af0b-2fb15e002b0a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:10.095704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec63a1c-024d-4f6a-af0b-2fb15e002b0a None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91/users/3f59d8f5b72440c7858c295e9ed899d1/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:10.101333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec63a1c-024d-4f6a-af0b-2fb15e002b0a None admin] RBAC: Authorizing `identity:create_grant(project_id=850e1f68d7b14cafb6e5424ddbee9a91, user_id=3f59d8f5b72440c7858c295e9ed899d1, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:10.102942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec63a1c-024d-4f6a-af0b-2fb15e002b0a None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:10.124950 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 127/253] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:44:09 2022] PUT /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91/users/3f59d8f5b72440c7858c295e9ed899d1/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 20:44:11.133547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f705e-f0dd-48b8-a740-b0d90561888e None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:11.134572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f705e-f0dd-48b8-a740-b0d90561888e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:11.135061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f705e-f0dd-48b8-a740-b0d90561888e None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:11.136693 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 127/254] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:11.142093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c6129-bd6b-439a-8777-e8e2a072b309 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:11.142904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c6129-bd6b-439a-8777-e8e2a072b309 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:11.143377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c6129-bd6b-439a-8777-e8e2a072b309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:11.160610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e37c6129-bd6b-439a-8777-e8e2a072b309 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:11.162128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e37c6129-bd6b-439a-8777-e8e2a072b309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:11.172521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3fda1-77ef-4dca-a377-802cd050a220 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:11.172807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3fda1-77ef-4dca-a377-802cd050a220 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:11.173244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3fda1-77ef-4dca-a377-802cd050a220 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:11.174858 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 128/255] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:11.185109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a5c18-b9d8-440d-929a-cbec857b0474 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:11.185621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a5c18-b9d8-440d-929a-cbec857b0474 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:11.186082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a5c18-b9d8-440d-929a-cbec857b0474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:11.209863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-355a5c18-b9d8-440d-929a-cbec857b0474 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:11.211391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-355a5c18-b9d8-440d-929a-cbec857b0474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:11.257292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:11.276587 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 128/256] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:11.319916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c6129-bd6b-439a-8777-e8e2a072b309 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:11.329987 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 129/257] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:11.366206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a5c18-b9d8-440d-929a-cbec857b0474 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:11.402082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:11.483322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c6129-bd6b-439a-8777-e8e2a072b309 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:11.532949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a5c18-b9d8-440d-929a-cbec857b0474 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:11.549364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a4938-6cae-4fb9-9eac-01e82229fa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:11.550184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a4938-6cae-4fb9-9eac-01e82229fa92 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:11.550460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a4938-6cae-4fb9-9eac-01e82229fa92 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:11.550729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a4938-6cae-4fb9-9eac-01e82229fa92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:11.576867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a4938-6cae-4fb9-9eac-01e82229fa92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:11.586444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910c809-311e-4b8a-aa35-761cc4f7d722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:11.587524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910c809-311e-4b8a-aa35-761cc4f7d722 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:11.587997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910c809-311e-4b8a-aa35-761cc4f7d722 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:11.588484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910c809-311e-4b8a-aa35-761cc4f7d722 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:11.593501 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-8b5a4938-6cae-4fb9-9eac-01e82229fa92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:11.593501 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:11.593501 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:11.593501 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:11.593501 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:11.593501 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:11.593501 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:11.593501 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:11.593501 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:11.593501 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:11.593501 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:11.593501 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:11.593501 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:11.593501 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:11.593501 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:11.593501 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:11.594455 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:11.594455 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:11.594455 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:11.594455 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:11.594455 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:11.594455 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:11.594455 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:11.594455 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:11.594455 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:11.594455 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:11.594455 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:11.594455 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:11.594455 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:11.594455 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:11.594455 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:11.594455 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:11.595702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:11.595702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:11.595702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:11.595702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:11.595702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:11.595702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:11.595702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:11.595702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:11.595702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:11.595702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:11.595702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:11.595702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:11.595702 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 129/258] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:44:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:11.600948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a4938-6cae-4fb9-9eac-01e82229fa92 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:11.611509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910c809-311e-4b8a-aa35-761cc4f7d722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:11.628136 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-e910c809-311e-4b8a-aa35-761cc4f7d722 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:44:11.628136 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:11.628136 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:11.628136 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:11.628136 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:11.628136 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:11.628136 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:11.628136 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:11.628136 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:11.628136 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:11.628136 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:11.628136 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:11.628136 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:11.628136 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:11.628136 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:11.628136 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:11.629056 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:11.629056 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:11.629056 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:11.629056 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:11.629056 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:11.629056 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:11.629056 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:11.629056 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:11.629056 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:11.629056 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:11.629056 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:11.629056 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:11.629056 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:11.629056 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:11.629056 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:11.629056 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:11.629868 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:11.629868 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:11.629868 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:11.629868 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:11.629868 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:11.629868 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:11.629868 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:11.629868 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:11.629868 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:11.629868 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:11.629868 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:44:11.629868 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:11.632392 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 130/259] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:44:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:11.637937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910c809-311e-4b8a-aa35-761cc4f7d722 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:11.688094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:11.759876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910c809-311e-4b8a-aa35-761cc4f7d722 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:11.761934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a4938-6cae-4fb9-9eac-01e82229fa92 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:11.796312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:11.804583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c79d5d-cacf-4f4f-9513-acc8b423b052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:11.806338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c79d5d-cacf-4f4f-9513-acc8b423b052 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:11.806817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c79d5d-cacf-4f4f-9513-acc8b423b052 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:11.807319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c79d5d-cacf-4f4f-9513-acc8b423b052 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:11.808306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c79d5d-cacf-4f4f-9513-acc8b423b052 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:11.808806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c79d5d-cacf-4f4f-9513-acc8b423b052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:11.810407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c79d5d-cacf-4f4f-9513-acc8b423b052 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:11.819956 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 131/260] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:11.829244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c79d5d-cacf-4f4f-9513-acc8b423b052 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:11.834089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab96da6-b131-4ae0-9fe2-d52dc3b983b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:11.834771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab96da6-b131-4ae0-9fe2-d52dc3b983b1 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:11.835217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab96da6-b131-4ae0-9fe2-d52dc3b983b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:11.835380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab96da6-b131-4ae0-9fe2-d52dc3b983b1 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:11.836083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab96da6-b131-4ae0-9fe2-d52dc3b983b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:11.836375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab96da6-b131-4ae0-9fe2-d52dc3b983b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:11.837868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab96da6-b131-4ae0-9fe2-d52dc3b983b1 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:11.855447 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 130/261] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:11.862466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab96da6-b131-4ae0-9fe2-d52dc3b983b1 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:12.033597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab96da6-b131-4ae0-9fe2-d52dc3b983b1 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:12.044412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:12.050274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c79d5d-cacf-4f4f-9513-acc8b423b052 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:12.096781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95d168-ff94-42b2-bb0d-06a33717a43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:12.097680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95d168-ff94-42b2-bb0d-06a33717a43b None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:12.097960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95d168-ff94-42b2-bb0d-06a33717a43b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:12.098232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95d168-ff94-42b2-bb0d-06a33717a43b None admin] PATH_INFO: `/v3/users/bc4088f2c5a74c84a964afd1a38e9cce` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:12.099462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95d168-ff94-42b2-bb0d-06a33717a43b None admin] RBAC: Authorizing `identity:get_user(user_id=bc4088f2c5a74c84a964afd1a38e9cce)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:12.101326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95d168-ff94-42b2-bb0d-06a33717a43b None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:12.108546 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 131/262] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:11 2022] GET /identity/v3/users/bc4088f2c5a74c84a964afd1a38e9cce => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:12.116810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95d168-ff94-42b2-bb0d-06a33717a43b None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:12.119161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f6d6f-0241-4976-8037-c3be3f4220b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:12.120301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f6d6f-0241-4976-8037-c3be3f4220b2 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:12.120730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f6d6f-0241-4976-8037-c3be3f4220b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:12.121145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f6d6f-0241-4976-8037-c3be3f4220b2 None admin] PATH_INFO: `/v3/users/bc4088f2c5a74c84a964afd1a38e9cce` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:12.122505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f6d6f-0241-4976-8037-c3be3f4220b2 None admin] RBAC: Authorizing `identity:get_user(user_id=bc4088f2c5a74c84a964afd1a38e9cce)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:12.124177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f6d6f-0241-4976-8037-c3be3f4220b2 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:12.126420 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 132/263] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:11 2022] GET /identity/v3/users/bc4088f2c5a74c84a964afd1a38e9cce => generated 283 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:12.137853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f6d6f-0241-4976-8037-c3be3f4220b2 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:12.200421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:12.284090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f6d6f-0241-4976-8037-c3be3f4220b2 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:12.338231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd61aab-885e-4aec-873a-202a2ca6d3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:12.339175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd61aab-885e-4aec-873a-202a2ca6d3b2 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:12.339907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd61aab-885e-4aec-873a-202a2ca6d3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:12.340366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd61aab-885e-4aec-873a-202a2ca6d3b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:12.365998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95d168-ff94-42b2-bb0d-06a33717a43b None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:12.380486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:12.431531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd61aab-885e-4aec-873a-202a2ca6d3b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:12.436276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd61aab-885e-4aec-873a-202a2ca6d3b2 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:12.505612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f23bee-5143-4ccd-8fdb-6116b66fcd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:12.506485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f23bee-5143-4ccd-8fdb-6116b66fcd3d None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:12.506861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f23bee-5143-4ccd-8fdb-6116b66fcd3d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:12.507238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f23bee-5143-4ccd-8fdb-6116b66fcd3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:12.620119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f23bee-5143-4ccd-8fdb-6116b66fcd3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:12.621831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f23bee-5143-4ccd-8fdb-6116b66fcd3d None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:12.641890 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 133/264] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 20:44:12.647688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afadba-64e1-4d85-964a-27fb958ad13c None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:12.648533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afadba-64e1-4d85-964a-27fb958ad13c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:12.648983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afadba-64e1-4d85-964a-27fb958ad13c None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:12.650744 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 134/265] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:12.651608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afadba-64e1-4d85-964a-27fb958ad13c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:12.712414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:12.759956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:12.810446 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 132/266] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 20:44:12.812678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf65813-d297-4e79-87e9-386b55af05a4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:12.812985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf65813-d297-4e79-87e9-386b55af05a4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:12.813271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf65813-d297-4e79-87e9-386b55af05a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:12.823754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afadba-64e1-4d85-964a-27fb958ad13c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:12.837614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9bf65813-d297-4e79-87e9-386b55af05a4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:12.839057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9bf65813-d297-4e79-87e9-386b55af05a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:12.866456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d940d-cbc0-43eb-8330-162f41d61a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:12.867415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d940d-cbc0-43eb-8330-162f41d61a6f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:12.867697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d940d-cbc0-43eb-8330-162f41d61a6f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:12.867968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d940d-cbc0-43eb-8330-162f41d61a6f None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:12.869184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d940d-cbc0-43eb-8330-162f41d61a6f None admin] RBAC: Authorizing `identity:get_project(project_id=850e1f68d7b14cafb6e5424ddbee9a91)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:12.870863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d940d-cbc0-43eb-8330-162f41d61a6f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:12.872729 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 135/267] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:12 2022] GET /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:12.877942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33092b1e-e99f-48a7-8b24-db473fd332c4 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:12.877942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33092b1e-e99f-48a7-8b24-db473fd332c4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:12.877942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33092b1e-e99f-48a7-8b24-db473fd332c4 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:12.877942 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 136/268] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:12.880531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33092b1e-e99f-48a7-8b24-db473fd332c4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:12.914728 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 133/269] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:12.924062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf65813-d297-4e79-87e9-386b55af05a4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:13.023387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:13.033140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33092b1e-e99f-48a7-8b24-db473fd332c4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:13.048204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf65813-d297-4e79-87e9-386b55af05a4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:13.065654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:13.082366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a841f-87e4-4119-9397-c2cd6791578f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:13.083595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a841f-87e4-4119-9397-c2cd6791578f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:13.084146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a841f-87e4-4119-9397-c2cd6791578f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:13.084634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a841f-87e4-4119-9397-c2cd6791578f None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:13.085059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f22e29-a066-423c-ae29-a265925592e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:13.085816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f22e29-a066-423c-ae29-a265925592e4 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:13.086093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f22e29-a066-423c-ae29-a265925592e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:13.086363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f22e29-a066-423c-ae29-a265925592e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:13.086902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a841f-87e4-4119-9397-c2cd6791578f None admin] RBAC: Authorizing `identity:get_project(project_id=850e1f68d7b14cafb6e5424ddbee9a91)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:13.087236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f22e29-a066-423c-ae29-a265925592e4 None admin] RBAC: Adding query filter params (role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91, user.id=bc4088f2c5a74c84a964afd1a38e9cce) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:13.087549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f22e29-a066-423c-ae29-a265925592e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:13.088998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a841f-87e4-4119-9397-c2cd6791578f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:13.089211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f22e29-a066-423c-ae29-a265925592e4 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:13.091434 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 137/270] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:12 2022] GET /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:13.093538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d8261-d334-4ab2-9df1-ad32552fdd93 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:13.094466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d8261-d334-4ab2-9df1-ad32552fdd93 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:13.094947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d8261-d334-4ab2-9df1-ad32552fdd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:13.096105 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 134/271] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:44:12 2022] GET /identity/v3/role_assignments?user.id=bc4088f2c5a74c84a964afd1a38e9cce&scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:13.105147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f22e29-a066-423c-ae29-a265925592e4 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:13.130884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5f0d8261-d334-4ab2-9df1-ad32552fdd93 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:13.132007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5f0d8261-d334-4ab2-9df1-ad32552fdd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:13.258321 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 138/272] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:13.259227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d8261-d334-4ab2-9df1-ad32552fdd93 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:13.270206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f22e29-a066-423c-ae29-a265925592e4 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:13.325403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821540a-1b89-4310-8cca-66a0a8481de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:13.326496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821540a-1b89-4310-8cca-66a0a8481de4 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:13.326775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821540a-1b89-4310-8cca-66a0a8481de4 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:13.327046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821540a-1b89-4310-8cca-66a0a8481de4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:13.339099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:13.344299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821540a-1b89-4310-8cca-66a0a8481de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:13.355814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-c821540a-1b89-4310-8cca-66a0a8481de4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:13.355814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:13.355814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:13.355814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:13.355814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:13.355814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:13.355814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:13.355814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:13.355814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:13.355814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:13.355814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:13.355814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:13.355814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:13.355814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:13.355814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:13.355814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:13.356884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:13.356884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:13.356884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:13.356884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:13.356884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:13.356884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:13.356884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:13.356884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:13.356884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:13.356884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:13.356884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:13.356884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:13.356884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:13.356884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:13.356884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:13.356884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:13.357717 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:13.357717 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:13.357717 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:13.357717 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:13.357717 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:13.357717 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:13.357717 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:13.357717 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:13.357717 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:13.357717 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:13.357717 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:13.357717 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:13.357717 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 135/273] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:13.358391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3adfd-b2e4-4dcc-8613-f784c5f2a51b None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:13.358811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3adfd-b2e4-4dcc-8613-f784c5f2a51b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:13.358905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3adfd-b2e4-4dcc-8613-f784c5f2a51b None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:13.360230 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 136/274] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:13.360920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3adfd-b2e4-4dcc-8613-f784c5f2a51b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:13.397743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d8261-d334-4ab2-9df1-ad32552fdd93 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:13.420889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:13.443412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74062b64-fd0a-476c-89ab-e1ed7031edaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:13.444126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74062b64-fd0a-476c-89ab-e1ed7031edaa None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:13.444390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74062b64-fd0a-476c-89ab-e1ed7031edaa None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:13.444795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74062b64-fd0a-476c-89ab-e1ed7031edaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:13.445555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74062b64-fd0a-476c-89ab-e1ed7031edaa None admin] RBAC: Adding query filter params (role.id=74cf644f6b8f49ce86fffcde317f8883, scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91, user.id=bc4088f2c5a74c84a964afd1a38e9cce) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:13.445868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74062b64-fd0a-476c-89ab-e1ed7031edaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:13.447343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74062b64-fd0a-476c-89ab-e1ed7031edaa None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:13.459031 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 139/275] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:44:13 2022] GET /identity/v3/role_assignments?user.id=bc4088f2c5a74c84a964afd1a38e9cce&scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91&role.id=74cf644f6b8f49ce86fffcde317f8883 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:13.459031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74062b64-fd0a-476c-89ab-e1ed7031edaa None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:13.507697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3adfd-b2e4-4dcc-8613-f784c5f2a51b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:13.553038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520e7fe-3209-4c1e-80d5-6629f0cecc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:13.554004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520e7fe-3209-4c1e-80d5-6629f0cecc40 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:13.554334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520e7fe-3209-4c1e-80d5-6629f0cecc40 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:13.554684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520e7fe-3209-4c1e-80d5-6629f0cecc40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:13.556876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520e7fe-3209-4c1e-80d5-6629f0cecc40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:13.559029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520e7fe-3209-4c1e-80d5-6629f0cecc40 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:13.561699 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 137/276] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:13.566977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bef74-0418-446f-aa82-54b7b625e87b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:13.566977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bef74-0418-446f-aa82-54b7b625e87b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:13.566977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bef74-0418-446f-aa82-54b7b625e87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:13.583067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0b9bef74-0418-446f-aa82-54b7b625e87b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:13.584323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0b9bef74-0418-446f-aa82-54b7b625e87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:13.595357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74062b64-fd0a-476c-89ab-e1ed7031edaa None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:13.634698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ec9da-fa14-452a-b859-e2623ac0a55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:13.635987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ec9da-fa14-452a-b859-e2623ac0a55a None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:13.636479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ec9da-fa14-452a-b859-e2623ac0a55a None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:13.636950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ec9da-fa14-452a-b859-e2623ac0a55a None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:13.637869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ec9da-fa14-452a-b859-e2623ac0a55a None admin] RBAC: Adding query filter params (name=member) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:13.638346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ec9da-fa14-452a-b859-e2623ac0a55a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:13.640096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ec9da-fa14-452a-b859-e2623ac0a55a None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:13.651258 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 140/277] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:13.652395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ec9da-fa14-452a-b859-e2623ac0a55a None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:13.655689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:13.666723 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 138/278] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:13.669981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bef74-0418-446f-aa82-54b7b625e87b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:13.722652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:13.782159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ec9da-fa14-452a-b859-e2623ac0a55a None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:13.793293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bef74-0418-446f-aa82-54b7b625e87b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:13.816605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76486770-d099-4456-9caf-cc4219db6de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:13.817285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76486770-d099-4456-9caf-cc4219db6de0 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:13.817568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76486770-d099-4456-9caf-cc4219db6de0 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:13.817847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76486770-d099-4456-9caf-cc4219db6de0 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:13.818560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76486770-d099-4456-9caf-cc4219db6de0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:13.821202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76486770-d099-4456-9caf-cc4219db6de0 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:13.829707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aceeda4-2e62-4420-b6ce-54f15b1a13cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:13.830585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aceeda4-2e62-4420-b6ce-54f15b1a13cd None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:13.830857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aceeda4-2e62-4420-b6ce-54f15b1a13cd None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:13.831124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aceeda4-2e62-4420-b6ce-54f15b1a13cd None admin] PATH_INFO: `/v3/users/85b08cd7aea44dd8be1af28afe246282` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:13.847324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aceeda4-2e62-4420-b6ce-54f15b1a13cd None admin] RBAC: Authorizing `identity:get_user(user_id=85b08cd7aea44dd8be1af28afe246282)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:13.848422 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 141/279] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Jul 2 20:44:13 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:44:13.849249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76486770-d099-4456-9caf-cc4219db6de0 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:13.852755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aceeda4-2e62-4420-b6ce-54f15b1a13cd None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:13.859563 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 139/280] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:13 2022] GET /identity/v3/users/85b08cd7aea44dd8be1af28afe246282 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:13.859563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fd9f6-1f73-4cf1-9ec7-436e808d611b None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:13.859563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fd9f6-1f73-4cf1-9ec7-436e808d611b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:13.859563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fd9f6-1f73-4cf1-9ec7-436e808d611b None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:13.859563 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 140/281] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:13.864315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fd9f6-1f73-4cf1-9ec7-436e808d611b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:13.938298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:13.969463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76486770-d099-4456-9caf-cc4219db6de0 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:13.971196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:13.991285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fd9f6-1f73-4cf1-9ec7-436e808d611b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:14.008804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fbf08-95c0-4537-88f4-9ae14b51ce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:14.009616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fbf08-95c0-4537-88f4-9ae14b51ce91 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:14.009896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fbf08-95c0-4537-88f4-9ae14b51ce91 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:14.010171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fbf08-95c0-4537-88f4-9ae14b51ce91 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:14.021544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fbf08-95c0-4537-88f4-9ae14b51ce91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:14.029460 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-037fbf08-95c0-4537-88f4-9ae14b51ce91 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:44:14.029460 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:14.029460 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:14.029460 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:14.029460 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:14.029460 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:14.029460 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:14.029460 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:14.029460 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:14.029460 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:14.029460 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:14.029460 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:14.029460 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:14.029460 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:14.029460 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:14.029460 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:14.030427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:14.030427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:14.030427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:14.030427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:14.030427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:14.030427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:14.030427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:14.030427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:14.030427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:14.030427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:14.030427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:14.030427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:14.030427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:14.030427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:14.030427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:14.030427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:14.031246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:14.031246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:14.031246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:14.031246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:14.031246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:14.031246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:14.031246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:14.031246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:14.031246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:14.031246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:14.031246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:44:14.031246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:14.031246 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 142/282] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:14.036011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c29a48-c814-4b84-9ca5-bdb5b79042a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:14.036185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51668f-becf-446c-ba65-ba9f6655b7cd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:14.036264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c29a48-c814-4b84-9ca5-bdb5b79042a4 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:14.036333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51668f-becf-446c-ba65-ba9f6655b7cd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:14.037207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c29a48-c814-4b84-9ca5-bdb5b79042a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:14.037311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51668f-becf-446c-ba65-ba9f6655b7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:14.037381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c29a48-c814-4b84-9ca5-bdb5b79042a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:14.037381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c29a48-c814-4b84-9ca5-bdb5b79042a4 None admin] RBAC: Adding query filter params (role.id=dd546359e98c4932adc5eef83b817e81, user.id=85b08cd7aea44dd8be1af28afe246282, scope.system=all) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:14.037381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c29a48-c814-4b84-9ca5-bdb5b79042a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:14.037381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c29a48-c814-4b84-9ca5-bdb5b79042a4 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:14.045229 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 141/283] 10.222.0.43 () {56 vars in 1308 bytes} [Sat Jul 2 20:44:13 2022] GET /identity/v3/role_assignments?user.id=85b08cd7aea44dd8be1af28afe246282&scope.system=all&role.id=dd546359e98c4932adc5eef83b817e81 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:14.045976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c29a48-c814-4b84-9ca5-bdb5b79042a4 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:14.054602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fb51668f-becf-446c-ba65-ba9f6655b7cd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:14.056082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fb51668f-becf-446c-ba65-ba9f6655b7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:14.164067 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 143/284] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:14.190642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb51668f-becf-446c-ba65-ba9f6655b7cd None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:14.191641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c29a48-c814-4b84-9ca5-bdb5b79042a4 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:14.218086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:14.246366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7399b4-7869-4d50-b099-5e8118632083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:14.247676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7399b4-7869-4d50-b099-5e8118632083 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:14.247955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7399b4-7869-4d50-b099-5e8118632083 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:14.248256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7399b4-7869-4d50-b099-5e8118632083 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:14.249054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7399b4-7869-4d50-b099-5e8118632083 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:14.249351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7399b4-7869-4d50-b099-5e8118632083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:14.250812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7399b4-7869-4d50-b099-5e8118632083 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:14.262178 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 142/285] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:14.267988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7399b4-7869-4d50-b099-5e8118632083 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:14.316722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:14.328239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb51668f-becf-446c-ba65-ba9f6655b7cd None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:14.364934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ef0a4-da40-4650-8a02-2577a1d9df22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:14.365757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ef0a4-da40-4650-8a02-2577a1d9df22 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:14.366038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ef0a4-da40-4650-8a02-2577a1d9df22 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:14.366306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ef0a4-da40-4650-8a02-2577a1d9df22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:14.378963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ef0a4-da40-4650-8a02-2577a1d9df22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:14.387281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-a23ef0a4-da40-4650-8a02-2577a1d9df22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:14.387281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:14.387281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:14.387281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:14.387281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:14.387281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:14.387281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:14.387281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:14.387281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:14.387281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:14.387281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:14.387281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:14.387281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:14.387281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:14.387281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:14.387281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:14.388259 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:14.388259 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:14.388259 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:14.388259 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:14.388259 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:14.388259 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:14.388259 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:14.388259 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:14.388259 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:14.388259 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:14.388259 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:14.388259 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:14.388259 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:14.388259 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:14.388259 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:14.388259 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:14.389097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:14.389097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:14.389097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:14.389097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:14.389097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:14.389097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:14.389097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:14.389097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:14.389097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:14.389097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:14.389097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:14.389097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:14.392177 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 144/286] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:14.394806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ef0a4-da40-4650-8a02-2577a1d9df22 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:14.402351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7399b4-7869-4d50-b099-5e8118632083 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:14.458752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c54c75-6f9a-4fa4-a0df-c532c083c22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:14.460156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c54c75-6f9a-4fa4-a0df-c532c083c22c None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:14.460582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c54c75-6f9a-4fa4-a0df-c532c083c22c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:14.461131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c54c75-6f9a-4fa4-a0df-c532c083c22c None admin] PATH_INFO: `/v3/users/7bb2d75d1d5246dcb5e89b517be26a0a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:14.463116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c54c75-6f9a-4fa4-a0df-c532c083c22c None admin] RBAC: Authorizing `identity:get_user(user_id=7bb2d75d1d5246dcb5e89b517be26a0a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:14.469681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c54c75-6f9a-4fa4-a0df-c532c083c22c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:14.471866 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 143/287] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:14 2022] GET /identity/v3/users/7bb2d75d1d5246dcb5e89b517be26a0a => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:14.477188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c54c75-6f9a-4fa4-a0df-c532c083c22c None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:14.534835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:14.575083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ef0a4-da40-4650-8a02-2577a1d9df22 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:14.591773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c54c75-6f9a-4fa4-a0df-c532c083c22c None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:14.644591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba686c7e-372d-454c-8845-b92a63bc6d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:14.645264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba686c7e-372d-454c-8845-b92a63bc6d84 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:14.645546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba686c7e-372d-454c-8845-b92a63bc6d84 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:14.645822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba686c7e-372d-454c-8845-b92a63bc6d84 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:14.646578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba686c7e-372d-454c-8845-b92a63bc6d84 None admin] RBAC: Adding query filter params (name=member) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:14.646883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba686c7e-372d-454c-8845-b92a63bc6d84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:14.648753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba686c7e-372d-454c-8845-b92a63bc6d84 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:14.653066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7ac1f-683e-49da-9ecf-e3edfac08401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:14.653936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7ac1f-683e-49da-9ecf-e3edfac08401 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:14.654215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7ac1f-683e-49da-9ecf-e3edfac08401 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:14.654487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7ac1f-683e-49da-9ecf-e3edfac08401 None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:14.655702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7ac1f-683e-49da-9ecf-e3edfac08401 None admin] RBAC: Authorizing `identity:get_project(project_id=850e1f68d7b14cafb6e5424ddbee9a91)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:14.657291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7ac1f-683e-49da-9ecf-e3edfac08401 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:14.661331 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 144/288] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:14 2022] GET /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:14.669080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7ac1f-683e-49da-9ecf-e3edfac08401 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:14.670115 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 145/289] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:14.684373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba686c7e-372d-454c-8845-b92a63bc6d84 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:14.708445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:14.840501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7ac1f-683e-49da-9ecf-e3edfac08401 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:14.871932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:14.878050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba686c7e-372d-454c-8845-b92a63bc6d84 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:14.907234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6e8ff-dc59-40a6-9dbc-18f4704d18b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:14.908642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6e8ff-dc59-40a6-9dbc-18f4704d18b3 None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:14.909985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6e8ff-dc59-40a6-9dbc-18f4704d18b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:14.913073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6e8ff-dc59-40a6-9dbc-18f4704d18b3 None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91/users/7bb2d75d1d5246dcb5e89b517be26a0a/roles/626342454d8044849bcbaa4f6d292aed` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:14.915464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6e8ff-dc59-40a6-9dbc-18f4704d18b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=850e1f68d7b14cafb6e5424ddbee9a91, user_id=7bb2d75d1d5246dcb5e89b517be26a0a, role_id=626342454d8044849bcbaa4f6d292aed)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:14.918073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6e8ff-dc59-40a6-9dbc-18f4704d18b3 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:14.939001 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 145/290] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:44:14 2022] PUT /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91/users/7bb2d75d1d5246dcb5e89b517be26a0a/roles/626342454d8044849bcbaa4f6d292aed => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:44:14.943280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c9766-c08f-49cb-8164-4c7662565615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:14.944514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c9766-c08f-49cb-8164-4c7662565615 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:14.944939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c9766-c08f-49cb-8164-4c7662565615 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:14.945347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c9766-c08f-49cb-8164-4c7662565615 None admin] PATH_INFO: `/v3/users/3f59d8f5b72440c7858c295e9ed899d1` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:14.946886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c9766-c08f-49cb-8164-4c7662565615 None admin] RBAC: Authorizing `identity:get_user(user_id=3f59d8f5b72440c7858c295e9ed899d1)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:14.948720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c9766-c08f-49cb-8164-4c7662565615 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:14.950720 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 146/291] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:14 2022] GET /identity/v3/users/3f59d8f5b72440c7858c295e9ed899d1 => generated 297 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:14.956772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6e8ff-dc59-40a6-9dbc-18f4704d18b3 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:15.064795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6e8ff-dc59-40a6-9dbc-18f4704d18b3 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:15.113019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305f10c-c36b-4e55-a0e1-6cdb4ba8276c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:15.113987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305f10c-c36b-4e55-a0e1-6cdb4ba8276c None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:15.114410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305f10c-c36b-4e55-a0e1-6cdb4ba8276c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:15.114821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305f10c-c36b-4e55-a0e1-6cdb4ba8276c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:15.168542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:15.189153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305f10c-c36b-4e55-a0e1-6cdb4ba8276c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:15.190893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305f10c-c36b-4e55-a0e1-6cdb4ba8276c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:15.290407 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 146/292] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:15.296378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c9766-c08f-49cb-8164-4c7662565615 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:15.397609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:15.422271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c9766-c08f-49cb-8164-4c7662565615 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:15.465550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42568d46-158e-4b9c-b90b-78139d0a66f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:15.466424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42568d46-158e-4b9c-b90b-78139d0a66f4 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:15.466702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42568d46-158e-4b9c-b90b-78139d0a66f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:15.466972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42568d46-158e-4b9c-b90b-78139d0a66f4 None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:15.468174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42568d46-158e-4b9c-b90b-78139d0a66f4 None admin] RBAC: Authorizing `identity:get_project(project_id=850e1f68d7b14cafb6e5424ddbee9a91)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:15.469687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42568d46-158e-4b9c-b90b-78139d0a66f4 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:15.476279 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 147/293] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:15 2022] GET /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:15.477811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305f10c-c36b-4e55-a0e1-6cdb4ba8276c None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:15.562775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:15.585124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305f10c-c36b-4e55-a0e1-6cdb4ba8276c None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:15.619446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6715a-87e1-46fd-85d0-0a68136f8d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:15.620132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6715a-87e1-46fd-85d0-0a68136f8d7f None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:15.620416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6715a-87e1-46fd-85d0-0a68136f8d7f None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:15.620691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6715a-87e1-46fd-85d0-0a68136f8d7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:15.621511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6715a-87e1-46fd-85d0-0a68136f8d7f None admin] RBAC: Adding query filter params (role.id=dd546359e98c4932adc5eef83b817e81, scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91, user.id=3f59d8f5b72440c7858c295e9ed899d1) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:15.621819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6715a-87e1-46fd-85d0-0a68136f8d7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:15.623276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6715a-87e1-46fd-85d0-0a68136f8d7f None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:15.634560 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 147/294] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:44:15 2022] GET /identity/v3/role_assignments?user.id=3f59d8f5b72440c7858c295e9ed899d1&scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91&role.id=dd546359e98c4932adc5eef83b817e81 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:16.693527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c3258-bf45-4b7c-86b8-986e6095a0c8 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:16.694059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c3258-bf45-4b7c-86b8-986e6095a0c8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:16.694059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c3258-bf45-4b7c-86b8-986e6095a0c8 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:16.695703 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 148/295] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:16.700703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5904a4-8bef-41c8-ae85-0f32b77881ba None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:16.701506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5904a4-8bef-41c8-ae85-0f32b77881ba None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:16.701984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5904a4-8bef-41c8-ae85-0f32b77881ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:16.719064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ed5904a4-8bef-41c8-ae85-0f32b77881ba None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:16.720622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ed5904a4-8bef-41c8-ae85-0f32b77881ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:16.769754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4dd2e-c830-4317-b4b7-85563872cfc6 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:16.770303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4dd2e-c830-4317-b4b7-85563872cfc6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:16.770582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4dd2e-c830-4317-b4b7-85563872cfc6 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:16.772125 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 149/296] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:44:16.778813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a8c88-e8d4-4289-a856-972fab625599 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:16.779097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a8c88-e8d4-4289-a856-972fab625599 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:16.779374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a8c88-e8d4-4289-a856-972fab625599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:16.797825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9c8a8c88-e8d4-4289-a856-972fab625599 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:16.797996 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 148/297] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:16.799231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a20a46-ce61-4b7d-91dd-fe01f3f4ae74 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:16.799519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a20a46-ce61-4b7d-91dd-fe01f3f4ae74 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:16.799797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a20a46-ce61-4b7d-91dd-fe01f3f4ae74 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:16.800313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9c8a8c88-e8d4-4289-a856-972fab625599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:16.801315 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 149/298] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:16.806484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621c2df-79f8-4c4d-bcf5-6e6de54273c3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:16.806772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621c2df-79f8-4c4d-bcf5-6e6de54273c3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:16.807054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621c2df-79f8-4c4d-bcf5-6e6de54273c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:16.823303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1621c2df-79f8-4c4d-bcf5-6e6de54273c3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:16.824530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1621c2df-79f8-4c4d-bcf5-6e6de54273c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:16.876179 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 150/299] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:44:16.877502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a8c88-e8d4-4289-a856-972fab625599 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:16.898192 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 150/300] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:44:16.900630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621c2df-79f8-4c4d-bcf5-6e6de54273c3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:16.903048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:16.980323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:17.002663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a8c88-e8d4-4289-a856-972fab625599 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:17.008975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621c2df-79f8-4c4d-bcf5-6e6de54273c3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:17.043298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a21c3-76f8-4d2d-9d86-fe9b68fe34f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:17.044124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a21c3-76f8-4d2d-9d86-fe9b68fe34f3 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:17.044569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a21c3-76f8-4d2d-9d86-fe9b68fe34f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:17.044845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a21c3-76f8-4d2d-9d86-fe9b68fe34f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:17.045446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d88d3b-3e41-4599-bd19-0e61e7ee1d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:17.046299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d88d3b-3e41-4599-bd19-0e61e7ee1d50 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:17.046579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d88d3b-3e41-4599-bd19-0e61e7ee1d50 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:17.046862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d88d3b-3e41-4599-bd19-0e61e7ee1d50 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:17.056558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a21c3-76f8-4d2d-9d86-fe9b68fe34f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:17.058566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d88d3b-3e41-4599-bd19-0e61e7ee1d50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:17.064400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-706a21c3-76f8-4d2d-9d86-fe9b68fe34f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:17.064400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:17.064400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:17.064400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:17.064400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:17.064400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:17.064400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:17.064400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:17.064400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:17.064400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:17.064400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:17.064400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:17.064400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:17.064400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:17.064400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:17.064400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:17.065290 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:17.065290 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:17.065290 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:17.065290 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:17.065290 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:17.065290 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:17.065290 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:17.065290 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:17.065290 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:17.065290 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:17.065290 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:17.065290 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:17.065290 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:17.065290 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:17.065290 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:17.065290 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:17.066100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:17.066100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:17.066100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:17.066100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:17.066100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:17.066100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:17.066100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:17.066100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:17.066100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:17.066100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:17.066100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:17.066100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:17.066100 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 151/301] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:17.066785 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-f1d88d3b-3e41-4599-bd19-0e61e7ee1d50 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:44:17.066785 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:17.066785 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:17.066785 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:17.066785 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:17.066785 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:17.066785 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:17.066785 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:17.066785 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:17.066785 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:17.066785 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:17.066785 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:17.066785 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:17.066785 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:17.066785 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:17.066785 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:17.067610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:17.067610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:17.067610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:17.067610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:17.067610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:17.067610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:17.067610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:17.067610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:17.067610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:17.067610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:17.067610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:17.067610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:17.067610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:17.067610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:17.067610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:17.067610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:17.068497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:17.068497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:17.068497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:17.068497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:17.068497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:17.068497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:17.068497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:17.068497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:17.068497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:17.068497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:17.068497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:44:17.068497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:17.068497 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 151/302] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:17.074029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a21c3-76f8-4d2d-9d86-fe9b68fe34f3 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:17.074886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d88d3b-3e41-4599-bd19-0e61e7ee1d50 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:17.137543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:17.177865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d88d3b-3e41-4599-bd19-0e61e7ee1d50 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:17.182543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a21c3-76f8-4d2d-9d86-fe9b68fe34f3 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:17.213296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec0b1f-acbc-40f7-8875-bcccf663203c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:17.213985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec0b1f-acbc-40f7-8875-bcccf663203c None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:17.214240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec0b1f-acbc-40f7-8875-bcccf663203c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:17.214511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec0b1f-acbc-40f7-8875-bcccf663203c None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:17.215078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ba03f-79e3-49dc-9b21-98e8d8eab2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:17.215252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec0b1f-acbc-40f7-8875-bcccf663203c None admin] RBAC: Adding query filter params (name=member) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:17.215545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec0b1f-acbc-40f7-8875-bcccf663203c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:17.215863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ba03f-79e3-49dc-9b21-98e8d8eab2a5 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:17.217310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ba03f-79e3-49dc-9b21-98e8d8eab2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:17.217310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ba03f-79e3-49dc-9b21-98e8d8eab2a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:17.217467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec0b1f-acbc-40f7-8875-bcccf663203c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:17.217920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ba03f-79e3-49dc-9b21-98e8d8eab2a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:17.219412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ba03f-79e3-49dc-9b21-98e8d8eab2a5 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:17.221054 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 152/303] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:17.221816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ba03f-79e3-49dc-9b21-98e8d8eab2a5 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:17.229427 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 152/304] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:17.230677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec0b1f-acbc-40f7-8875-bcccf663203c None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:17.236993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:17.330618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ba03f-79e3-49dc-9b21-98e8d8eab2a5 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:17.334164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec0b1f-acbc-40f7-8875-bcccf663203c None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:17.358586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:17.366699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfb8f4-32ae-4410-9555-428e21c850b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:17.367367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfb8f4-32ae-4410-9555-428e21c850b4 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:17.367643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfb8f4-32ae-4410-9555-428e21c850b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:17.367913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfb8f4-32ae-4410-9555-428e21c850b4 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:17.368682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dfb8f4-32ae-4410-9555-428e21c850b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:17.369040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dfb8f4-32ae-4410-9555-428e21c850b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:17.370339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dfb8f4-32ae-4410-9555-428e21c850b4 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:17.370450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df954a-2d08-4457-9767-d4a0604f77f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:17.371099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df954a-2d08-4457-9767-d4a0604f77f9 None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:17.371382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df954a-2d08-4457-9767-d4a0604f77f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:17.371658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df954a-2d08-4457-9767-d4a0604f77f9 None admin] PATH_INFO: `/v3/groups` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:17.372355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df954a-2d08-4457-9767-d4a0604f77f9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:17.373794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df954a-2d08-4457-9767-d4a0604f77f9 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:17.379137 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 153/305] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:17.384695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfb8f4-32ae-4410-9555-428e21c850b4 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:17.389572 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 153/306] 10.222.0.43 () {60 vars in 1134 bytes} [Sat Jul 2 20:44:17 2022] POST /identity/v3/groups => generated 229 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:44:17.401154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df954a-2d08-4457-9767-d4a0604f77f9 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:17.474468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:17.520378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfb8f4-32ae-4410-9555-428e21c850b4 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:17.553947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df954a-2d08-4457-9767-d4a0604f77f9 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:17.574734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f66d3-cb64-4e51-b48a-d430fac42026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:17.575911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f66d3-cb64-4e51-b48a-d430fac42026 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:17.576974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f66d3-cb64-4e51-b48a-d430fac42026 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:17.577399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f66d3-cb64-4e51-b48a-d430fac42026 None admin] PATH_INFO: `/v3/users/85b08cd7aea44dd8be1af28afe246282` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:17.579208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f66d3-cb64-4e51-b48a-d430fac42026 None admin] RBAC: Authorizing `identity:get_user(user_id=85b08cd7aea44dd8be1af28afe246282)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:17.581843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f66d3-cb64-4e51-b48a-d430fac42026 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:17.584849 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 154/307] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:17 2022] GET /identity/v3/users/85b08cd7aea44dd8be1af28afe246282 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:17.589816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f66d3-cb64-4e51-b48a-d430fac42026 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:17.596880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e30c2d-cff6-4cec-a6ea-fcbac4a23989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:17.596880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e30c2d-cff6-4cec-a6ea-fcbac4a23989 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:17.597118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e30c2d-cff6-4cec-a6ea-fcbac4a23989 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:17.597192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e30c2d-cff6-4cec-a6ea-fcbac4a23989 None admin] PATH_INFO: `/v3/users/50c6aecd9c454cddb4ce074b0035a9ef` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:17.615815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e30c2d-cff6-4cec-a6ea-fcbac4a23989 None admin] RBAC: Authorizing `identity:get_user(user_id=50c6aecd9c454cddb4ce074b0035a9ef)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:17.617323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e30c2d-cff6-4cec-a6ea-fcbac4a23989 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:17.619064 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 154/308] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:17 2022] GET /identity/v3/users/50c6aecd9c454cddb4ce074b0035a9ef => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:17.625337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e30c2d-cff6-4cec-a6ea-fcbac4a23989 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:17.681932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:17.709819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f66d3-cb64-4e51-b48a-d430fac42026 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:17.743899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb012a-1f5d-4948-981a-b5d9d5a31c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:17.744802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb012a-1f5d-4948-981a-b5d9d5a31c0b None admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:17.745080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb012a-1f5d-4948-981a-b5d9d5a31c0b None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:17.745354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb012a-1f5d-4948-981a-b5d9d5a31c0b None admin] PATH_INFO: `/v3/system/users/85b08cd7aea44dd8be1af28afe246282/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:17.745898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e30c2d-cff6-4cec-a6ea-fcbac4a23989 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:17.747081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb012a-1f5d-4948-981a-b5d9d5a31c0b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=85b08cd7aea44dd8be1af28afe246282, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:17.748538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb012a-1f5d-4948-981a-b5d9d5a31c0b None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:17.757679 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 155/309] 10.222.0.43 () {58 vars in 1334 bytes} [Sat Jul 2 20:44:17 2022] PUT /identity/v3/system/users/85b08cd7aea44dd8be1af28afe246282/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 20:44:17.764469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827eb79-0fab-42cc-a7d8-7e3c37453ee6 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:17.764469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827eb79-0fab-42cc-a7d8-7e3c37453ee6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:17.764469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827eb79-0fab-42cc-a7d8-7e3c37453ee6 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:17.764469 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 156/310] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:17.766591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a1903-20df-49a5-ad77-257f2e20fc07 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:17.766880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a1903-20df-49a5-ad77-257f2e20fc07 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:17.768319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a1903-20df-49a5-ad77-257f2e20fc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:17.788516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:17.792424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0a4a1903-20df-49a5-ad77-257f2e20fc07 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:17.794784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0a4a1903-20df-49a5-ad77-257f2e20fc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:17.797923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea5eb1-8b41-4161-b215-a433b6a67bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:17.799269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea5eb1-8b41-4161-b215-a433b6a67bbd None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:17.799269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea5eb1-8b41-4161-b215-a433b6a67bbd None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:17.799269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea5eb1-8b41-4161-b215-a433b6a67bbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:17.800122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea5eb1-8b41-4161-b215-a433b6a67bbd None admin] RBAC: Adding query filter params (role.id=626342454d8044849bcbaa4f6d292aed, user.id=50c6aecd9c454cddb4ce074b0035a9ef, scope.system=all) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:17.800442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea5eb1-8b41-4161-b215-a433b6a67bbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:17.802003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea5eb1-8b41-4161-b215-a433b6a67bbd None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:17.809308 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 155/311] 10.222.0.43 () {56 vars in 1308 bytes} [Sat Jul 2 20:44:17 2022] GET /identity/v3/role_assignments?user.id=50c6aecd9c454cddb4ce074b0035a9ef&scope.system=all&role.id=626342454d8044849bcbaa4f6d292aed => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:17.887400 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 157/312] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:44:17.913739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea5eb1-8b41-4161-b215-a433b6a67bbd None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:18.033414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea5eb1-8b41-4161-b215-a433b6a67bbd None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:18.041557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:18.069561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc4670-55bf-4656-9c0c-1ce1941fcfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:18.070354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc4670-55bf-4656-9c0c-1ce1941fcfa3 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:18.070637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc4670-55bf-4656-9c0c-1ce1941fcfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:18.070909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc4670-55bf-4656-9c0c-1ce1941fcfa3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:18.084072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc4670-55bf-4656-9c0c-1ce1941fcfa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:18.091022 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-65bc4670-55bf-4656-9c0c-1ce1941fcfa3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:44:18.091022 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:18.091022 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:18.091022 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:18.091022 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:18.091022 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:18.091022 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:18.091022 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:18.091022 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:18.091022 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:18.091022 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:18.091022 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:18.091022 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:18.091022 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:18.091022 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:18.091022 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:18.092119 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:18.092119 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:18.092119 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:18.092119 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:18.092119 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:18.092119 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:18.092119 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:18.092119 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:18.092119 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:18.092119 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:18.092119 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:18.092119 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:18.092119 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:18.092119 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:18.092119 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:18.092119 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:18.092941 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:18.092941 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:18.092941 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:18.092941 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:18.092941 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:18.092941 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:18.092941 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:18.092941 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:18.092941 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:18.092941 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:18.092941 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:44:18.092941 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:18.092941 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 156/313] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:18.102406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a1903-20df-49a5-ad77-257f2e20fc07 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:18.202818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a1903-20df-49a5-ad77-257f2e20fc07 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:18.235268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:18.239247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a525ac0-6e08-41b8-8a43-1abdf635219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:18.240132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a525ac0-6e08-41b8-8a43-1abdf635219c None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:18.240555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a525ac0-6e08-41b8-8a43-1abdf635219c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:18.241199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a525ac0-6e08-41b8-8a43-1abdf635219c None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:18.242138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a525ac0-6e08-41b8-8a43-1abdf635219c None admin] RBAC: Adding query filter params (name=reader) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:18.242579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a525ac0-6e08-41b8-8a43-1abdf635219c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:18.244313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a525ac0-6e08-41b8-8a43-1abdf635219c None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:18.253592 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 158/314] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:18.259476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc4670-55bf-4656-9c0c-1ce1941fcfa3 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:18.371325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc4670-55bf-4656-9c0c-1ce1941fcfa3 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:18.405500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9117e-547f-403c-b2ca-7424a769f935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:18.406488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9117e-547f-403c-b2ca-7424a769f935 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:18.406762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9117e-547f-403c-b2ca-7424a769f935 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:18.407031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9117e-547f-403c-b2ca-7424a769f935 None admin] PATH_INFO: `/v3/users/7bb2d75d1d5246dcb5e89b517be26a0a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:18.408286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9117e-547f-403c-b2ca-7424a769f935 None admin] RBAC: Authorizing `identity:get_user(user_id=7bb2d75d1d5246dcb5e89b517be26a0a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:18.409789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9117e-547f-403c-b2ca-7424a769f935 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:18.411713 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 157/315] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:18 2022] GET /identity/v3/users/7bb2d75d1d5246dcb5e89b517be26a0a => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:18.417313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a525ac0-6e08-41b8-8a43-1abdf635219c None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:18.526769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a525ac0-6e08-41b8-8a43-1abdf635219c None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:18.563194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc36df8-4a98-4b70-b244-74ccd95d427d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:18.564252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc36df8-4a98-4b70-b244-74ccd95d427d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:18.564731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc36df8-4a98-4b70-b244-74ccd95d427d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:18.565197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc36df8-4a98-4b70-b244-74ccd95d427d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:18.626892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:18.634973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc36df8-4a98-4b70-b244-74ccd95d427d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:18.636714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc36df8-4a98-4b70-b244-74ccd95d427d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:18.744213 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 159/316] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:18.748722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9117e-547f-403c-b2ca-7424a769f935 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:18.783890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:18.849177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9117e-547f-403c-b2ca-7424a769f935 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:18.886540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970de5b-7935-4580-be42-9adf71d1f9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:18.887326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970de5b-7935-4580-be42-9adf71d1f9af None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:18.887605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970de5b-7935-4580-be42-9adf71d1f9af None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:18.887874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970de5b-7935-4580-be42-9adf71d1f9af None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:18.889134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970de5b-7935-4580-be42-9adf71d1f9af None admin] RBAC: Authorizing `identity:get_project(project_id=850e1f68d7b14cafb6e5424ddbee9a91)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:18.890668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970de5b-7935-4580-be42-9adf71d1f9af None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:18.892367 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 158/317] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:18 2022] GET /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:18.898634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc36df8-4a98-4b70-b244-74ccd95d427d None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:18.996847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:19.004117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc36df8-4a98-4b70-b244-74ccd95d427d None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:19.041521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb13955-b51e-4e98-9cc9-41f885c82ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:19.042601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb13955-b51e-4e98-9cc9-41f885c82ccb None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:19.043081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb13955-b51e-4e98-9cc9-41f885c82ccb None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:19.043548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb13955-b51e-4e98-9cc9-41f885c82ccb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:19.044616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb13955-b51e-4e98-9cc9-41f885c82ccb None admin] RBAC: Adding query filter params (role.id=626342454d8044849bcbaa4f6d292aed, scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91, user.id=7bb2d75d1d5246dcb5e89b517be26a0a) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:19.045197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb13955-b51e-4e98-9cc9-41f885c82ccb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:19.046947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb13955-b51e-4e98-9cc9-41f885c82ccb None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:19.058416 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 160/318] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:44:18 2022] GET /identity/v3/role_assignments?user.id=7bb2d75d1d5246dcb5e89b517be26a0a&scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91&role.id=626342454d8044849bcbaa4f6d292aed => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:19.831488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d5238-0eb1-4992-95b2-cb06d83bd13d None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:19.832297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d5238-0eb1-4992-95b2-cb06d83bd13d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:19.832297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d5238-0eb1-4992-95b2-cb06d83bd13d None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:19.833616 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 159/319] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:19.838603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39152d62-ec94-4e57-a94a-c6e8085ccaf9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:19.839034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39152d62-ec94-4e57-a94a-c6e8085ccaf9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:19.839202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39152d62-ec94-4e57-a94a-c6e8085ccaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:19.856778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-39152d62-ec94-4e57-a94a-c6e8085ccaf9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:19.857938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-39152d62-ec94-4e57-a94a-c6e8085ccaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:19.933911 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 161/320] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:19.960420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d5238-0eb1-4992-95b2-cb06d83bd13d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:20.066928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d5238-0eb1-4992-95b2-cb06d83bd13d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:20.068522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:20.108273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69fa2b-d91e-484a-af4c-f033c99300ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:20.109067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69fa2b-d91e-484a-af4c-f033c99300ff None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:20.109381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69fa2b-d91e-484a-af4c-f033c99300ff None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:20.109651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69fa2b-d91e-484a-af4c-f033c99300ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:20.110797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69fa2b-d91e-484a-af4c-f033c99300ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:20.112255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69fa2b-d91e-484a-af4c-f033c99300ff None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:20.114059 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 160/321] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:20.119441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39152d62-ec94-4e57-a94a-c6e8085ccaf9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:20.122856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017e174-e37f-4c51-8e41-8ae07105d589 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:20.123145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017e174-e37f-4c51-8e41-8ae07105d589 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:20.123419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017e174-e37f-4c51-8e41-8ae07105d589 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:20.124794 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 161/322] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:20.130719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a3682-be4c-4831-bede-1240fe24e8e2 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:20.131004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a3682-be4c-4831-bede-1240fe24e8e2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:20.131595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a3682-be4c-4831-bede-1240fe24e8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:20.149016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-042a3682-be4c-4831-bede-1240fe24e8e2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:20.150483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-042a3682-be4c-4831-bede-1240fe24e8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:20.215286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:20.217941 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 162/323] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:44:20.219471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0bca3-1a13-4499-8d2a-c619b0511b62 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:20.219757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0bca3-1a13-4499-8d2a-c619b0511b62 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:20.220027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0bca3-1a13-4499-8d2a-c619b0511b62 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:20.221290 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 163/324] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:20.229310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39152d62-ec94-4e57-a94a-c6e8085ccaf9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:20.229578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c430de-af4e-45b1-bc14-0a79503a49fe None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:20.230057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c430de-af4e-45b1-bc14-0a79503a49fe None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:20.230512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c430de-af4e-45b1-bc14-0a79503a49fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:20.247354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-24c430de-af4e-45b1-bc14-0a79503a49fe None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:20.248786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-24c430de-af4e-45b1-bc14-0a79503a49fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:20.262952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc099b1-9baf-4076-b87f-1b01e771f8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:20.263617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc099b1-9baf-4076-b87f-1b01e771f8b8 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:20.263893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc099b1-9baf-4076-b87f-1b01e771f8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:20.264195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc099b1-9baf-4076-b87f-1b01e771f8b8 None admin] PATH_INFO: `/v3/groups` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:20.264888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc099b1-9baf-4076-b87f-1b01e771f8b8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:20.266371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc099b1-9baf-4076-b87f-1b01e771f8b8 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:20.281550 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 162/325] 10.222.0.43 () {60 vars in 1134 bytes} [Sat Jul 2 20:44:20 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:44:20.282161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc099b1-9baf-4076-b87f-1b01e771f8b8 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:20.330843 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 164/326] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:20.354596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c430de-af4e-45b1-bc14-0a79503a49fe None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:20.386863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:20.397720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc099b1-9baf-4076-b87f-1b01e771f8b8 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:20.434780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b84c2-4833-4947-a1b8-d07df535b92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:20.435578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b84c2-4833-4947-a1b8-d07df535b92c None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:20.435856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b84c2-4833-4947-a1b8-d07df535b92c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:20.436193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b84c2-4833-4947-a1b8-d07df535b92c None admin] PATH_INFO: `/v3/roles/member` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:20.449586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b84c2-4833-4947-a1b8-d07df535b92c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:20.458138 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-430b84c2-4833-4947-a1b8-d07df535b92c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:20.458138 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:20.458138 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:20.458138 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:20.458138 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:20.458138 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:20.458138 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:20.458138 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:20.458138 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:20.458138 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:20.458138 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:20.458138 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:20.458138 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:20.458138 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:20.458138 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:20.458138 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:20.459319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:20.459319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:20.459319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:20.459319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:20.459319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:20.459319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:20.459319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:20.459319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:20.459319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:20.459319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:20.459319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:20.459319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:20.459319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:20.459319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:20.459319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:20.459319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:20.460349 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:20.460349 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:20.460349 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:20.460349 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:20.460349 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:20.460349 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:20.460349 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:20.460349 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:20.460349 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:20.460349 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:20.460349 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:20.460349 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:20.464340 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 163/327] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:20.465219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b84c2-4833-4947-a1b8-d07df535b92c None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:20.475546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c430de-af4e-45b1-bc14-0a79503a49fe None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:20.480508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:20.519033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a7825-8f14-4640-874f-ccb1911e0c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:20.519833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a7825-8f14-4640-874f-ccb1911e0c15 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:20.520148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a7825-8f14-4640-874f-ccb1911e0c15 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:20.520424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a7825-8f14-4640-874f-ccb1911e0c15 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:20.532200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a7825-8f14-4640-874f-ccb1911e0c15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:20.539996 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-959a7825-8f14-4640-874f-ccb1911e0c15 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:44:20.539996 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:20.539996 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:20.539996 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:20.539996 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:20.539996 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:20.539996 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:20.539996 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:20.539996 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:20.539996 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:20.539996 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:20.539996 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:20.539996 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:20.539996 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:20.539996 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:20.539996 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:20.540934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:20.540934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:20.540934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:20.540934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:20.540934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:20.540934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:20.540934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:20.540934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:20.540934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:20.540934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:20.540934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:20.540934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:20.540934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:20.540934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:20.540934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:20.540934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:20.541748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:20.541748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:20.541748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:20.541748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:20.541748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:20.541748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:20.541748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:20.541748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:20.541748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:20.541748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:20.541748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:44:20.541748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:20.547296 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 165/328] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:20.548253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a7825-8f14-4640-874f-ccb1911e0c15 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:20.585336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b84c2-4833-4947-a1b8-d07df535b92c None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:20.626367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b9b80-67d3-4580-bf81-ce1052368e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:20.626607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b9b80-67d3-4580-bf81-ce1052368e96 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:20.626894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b9b80-67d3-4580-bf81-ce1052368e96 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:20.627169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b9b80-67d3-4580-bf81-ce1052368e96 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:20.627920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b9b80-67d3-4580-bf81-ce1052368e96 None admin] RBAC: Adding query filter params (name=member) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:20.628264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b9b80-67d3-4580-bf81-ce1052368e96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:20.629724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b9b80-67d3-4580-bf81-ce1052368e96 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:20.639861 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 164/329] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:20.645287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b9b80-67d3-4580-bf81-ce1052368e96 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:20.660773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:20.671875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a7825-8f14-4640-874f-ccb1911e0c15 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:20.708411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9dbca-d8b6-40d3-b6c3-09c36c3c4ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:20.709083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9dbca-d8b6-40d3-b6c3-09c36c3c4ec9 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:20.709362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9dbca-d8b6-40d3-b6c3-09c36c3c4ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:20.709636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9dbca-d8b6-40d3-b6c3-09c36c3c4ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:20.710379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9dbca-d8b6-40d3-b6c3-09c36c3c4ec9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:20.710689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9dbca-d8b6-40d3-b6c3-09c36c3c4ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:20.712099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9dbca-d8b6-40d3-b6c3-09c36c3c4ec9 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:20.721240 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 166/330] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:20.727385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9dbca-d8b6-40d3-b6c3-09c36c3c4ec9 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:20.728064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:20.773849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b9b80-67d3-4580-bf81-ce1052368e96 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:20.816570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd999873-4609-4369-87ff-24239343d514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:20.817451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd999873-4609-4369-87ff-24239343d514 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:20.817730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd999873-4609-4369-87ff-24239343d514 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:20.818003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd999873-4609-4369-87ff-24239343d514 None admin] PATH_INFO: `/v3/users/85b08cd7aea44dd8be1af28afe246282` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:20.819197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd999873-4609-4369-87ff-24239343d514 None admin] RBAC: Authorizing `identity:get_user(user_id=85b08cd7aea44dd8be1af28afe246282)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:20.820694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd999873-4609-4369-87ff-24239343d514 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:20.822692 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 165/331] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:20 2022] GET /identity/v3/users/85b08cd7aea44dd8be1af28afe246282 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:20.834741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd999873-4609-4369-87ff-24239343d514 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:20.866503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9dbca-d8b6-40d3-b6c3-09c36c3c4ec9 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:20.905669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f1cc7-1cd7-493a-b480-c1bea70bacb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:20.906917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f1cc7-1cd7-493a-b480-c1bea70bacb3 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:20.907355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f1cc7-1cd7-493a-b480-c1bea70bacb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:20.907783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f1cc7-1cd7-493a-b480-c1bea70bacb3 None admin] PATH_INFO: `/v3/users/50c6aecd9c454cddb4ce074b0035a9ef` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:20.909179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f1cc7-1cd7-493a-b480-c1bea70bacb3 None admin] RBAC: Authorizing `identity:get_user(user_id=50c6aecd9c454cddb4ce074b0035a9ef)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:20.911138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f1cc7-1cd7-493a-b480-c1bea70bacb3 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:20.913343 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 167/332] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:20 2022] GET /identity/v3/users/50c6aecd9c454cddb4ce074b0035a9ef => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:20.919352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f1cc7-1cd7-493a-b480-c1bea70bacb3 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:20.944300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:20.948143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd999873-4609-4369-87ff-24239343d514 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:20.986853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834e5c5-ddcb-4047-81fc-abe17ec42c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:20.987795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834e5c5-ddcb-4047-81fc-abe17ec42c56 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:20.988272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834e5c5-ddcb-4047-81fc-abe17ec42c56 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:20.988700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834e5c5-ddcb-4047-81fc-abe17ec42c56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:20.989753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834e5c5-ddcb-4047-81fc-abe17ec42c56 None admin] RBAC: Adding query filter params (role.id=dd546359e98c4932adc5eef83b817e81, user.id=85b08cd7aea44dd8be1af28afe246282, scope.system=all) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:20.990216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834e5c5-ddcb-4047-81fc-abe17ec42c56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:20.991924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834e5c5-ddcb-4047-81fc-abe17ec42c56 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:20.997676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:21.007016 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 166/333] 10.222.0.43 () {56 vars in 1308 bytes} [Sat Jul 2 20:44:20 2022] GET /identity/v3/role_assignments?user.id=85b08cd7aea44dd8be1af28afe246282&scope.system=all&role.id=dd546359e98c4932adc5eef83b817e81 => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:21.035572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f1cc7-1cd7-493a-b480-c1bea70bacb3 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:21.073974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed114c-1802-40cc-a017-e8d429a9fcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:21.074853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed114c-1802-40cc-a017-e8d429a9fcd9 None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:21.075136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed114c-1802-40cc-a017-e8d429a9fcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:21.075415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed114c-1802-40cc-a017-e8d429a9fcd9 None admin] PATH_INFO: `/v3/system/users/50c6aecd9c454cddb4ce074b0035a9ef/roles/626342454d8044849bcbaa4f6d292aed` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:21.077040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed114c-1802-40cc-a017-e8d429a9fcd9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=50c6aecd9c454cddb4ce074b0035a9ef, role_id=626342454d8044849bcbaa4f6d292aed)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:21.078535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed114c-1802-40cc-a017-e8d429a9fcd9 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:21.090087 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 168/334] 10.222.0.43 () {58 vars in 1334 bytes} [Sat Jul 2 20:44:20 2022] PUT /identity/v3/system/users/50c6aecd9c454cddb4ce074b0035a9ef/roles/626342454d8044849bcbaa4f6d292aed => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:44:22.939273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6de41-a4ec-4c92-83a9-6f62c9e0f640 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:22.939823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6de41-a4ec-4c92-83a9-6f62c9e0f640 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:22.939823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6de41-a4ec-4c92-83a9-6f62c9e0f640 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:22.941234 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 167/335] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:22.946815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923f7eb-6f76-45b7-bc43-e534ebdcaae9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:22.947753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923f7eb-6f76-45b7-bc43-e534ebdcaae9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:22.948285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923f7eb-6f76-45b7-bc43-e534ebdcaae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:22.973094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7923f7eb-6f76-45b7-bc43-e534ebdcaae9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:22.974733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7923f7eb-6f76-45b7-bc43-e534ebdcaae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:23.062448 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 169/336] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:44:23.100394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6de41-a4ec-4c92-83a9-6f62c9e0f640 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:23.231794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6de41-a4ec-4c92-83a9-6f62c9e0f640 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:23.268565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca839655-37b0-43db-952b-7d3a3d273394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:23.269369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca839655-37b0-43db-952b-7d3a3d273394 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:23.269652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca839655-37b0-43db-952b-7d3a3d273394 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:23.269928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca839655-37b0-43db-952b-7d3a3d273394 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:23.284630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca839655-37b0-43db-952b-7d3a3d273394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:23.292994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-ca839655-37b0-43db-952b-7d3a3d273394 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:23.292994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:23.292994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:23.292994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:23.292994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:23.292994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:23.292994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:23.292994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:23.292994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:23.292994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:23.292994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:23.292994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:23.292994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:23.292994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:23.292994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:23.292994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:23.293959 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:23.293959 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:23.293959 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:23.293959 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:23.293959 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:23.293959 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:23.293959 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:23.293959 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:23.293959 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:23.293959 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:23.293959 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:23.293959 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:23.293959 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:23.293959 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:23.293959 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:23.293959 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:23.294810 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:23.294810 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:23.294810 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:23.294810 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:23.294810 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:23.294810 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:23.294810 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:23.294810 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:23.294810 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:23.294810 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:23.294810 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:23.294810 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:23.294810 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 168/337] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:23.302142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923f7eb-6f76-45b7-bc43-e534ebdcaae9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:23.326355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:23.429339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923f7eb-6f76-45b7-bc43-e534ebdcaae9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:23.468846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14524c9e-7e01-42ea-8e38-c94b560adfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:23.469930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14524c9e-7e01-42ea-8e38-c94b560adfda None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:23.470420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14524c9e-7e01-42ea-8e38-c94b560adfda None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:23.470906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14524c9e-7e01-42ea-8e38-c94b560adfda None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:23.471848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14524c9e-7e01-42ea-8e38-c94b560adfda None admin] RBAC: Adding query filter params (name=member) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:23.472381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14524c9e-7e01-42ea-8e38-c94b560adfda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:23.474095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14524c9e-7e01-42ea-8e38-c94b560adfda None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:23.483830 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 170/338] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:23.489749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca839655-37b0-43db-952b-7d3a3d273394 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:23.566295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:23.625499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca839655-37b0-43db-952b-7d3a3d273394 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:23.643573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c904042-3edb-44d5-a570-cb3f0b0f1ad0 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:23.644348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c904042-3edb-44d5-a570-cb3f0b0f1ad0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:23.644826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c904042-3edb-44d5-a570-cb3f0b0f1ad0 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:23.646665 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 171/339] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:23.652373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc28101-42b7-4930-ab18-45752dc469cf None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:23.652669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc28101-42b7-4930-ab18-45752dc469cf None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:23.652952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc28101-42b7-4930-ab18-45752dc469cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:23.667876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e1ca3-d682-438a-a5cb-791207e84535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:23.668259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e1ca3-d682-438a-a5cb-791207e84535 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:23.668446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e1ca3-d682-438a-a5cb-791207e84535 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:23.668724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e1ca3-d682-438a-a5cb-791207e84535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:23.689122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3bc28101-42b7-4930-ab18-45752dc469cf None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:23.690327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3bc28101-42b7-4930-ab18-45752dc469cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:23.763936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e1ca3-d682-438a-a5cb-791207e84535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:23.765400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e1ca3-d682-438a-a5cb-791207e84535 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:23.831603 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 172/340] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:23.875156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc28101-42b7-4930-ab18-45752dc469cf None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:23.888316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:23.893888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:24.001467 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 169/341] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:24.006958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e1ca3-d682-438a-a5cb-791207e84535 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:24.081476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc28101-42b7-4930-ab18-45752dc469cf None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:24.143696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c05b4c-523f-4288-8336-9526d6b005b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:24.144532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c05b4c-523f-4288-8336-9526d6b005b8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:24.144806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c05b4c-523f-4288-8336-9526d6b005b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:24.145076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c05b4c-523f-4288-8336-9526d6b005b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:24.165036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c05b4c-523f-4288-8336-9526d6b005b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:24.173235 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-a5c05b4c-523f-4288-8336-9526d6b005b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:24.173235 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:24.173235 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:24.173235 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:24.173235 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:24.173235 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:24.173235 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:24.173235 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:24.173235 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:24.173235 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:24.173235 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:24.173235 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:24.173235 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:24.173235 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:24.173235 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:24.173235 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:24.174170 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:24.174170 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:24.174170 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:24.174170 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:24.174170 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:24.174170 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:24.174170 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:24.174170 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:24.174170 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:24.174170 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:24.174170 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:24.174170 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:24.174170 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:24.174170 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:24.174170 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:24.174170 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:24.175000 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:24.175000 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:24.175000 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:24.175000 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:24.175000 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:24.175000 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:24.175000 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:24.175000 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:24.175000 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:24.175000 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:24.175000 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:24.175000 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:24.175000 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 173/342] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:44:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:24.178072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950809e5-6422-4d30-b14c-0ed06071570c None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:24.179221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950809e5-6422-4d30-b14c-0ed06071570c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:24.182209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e1ca3-d682-438a-a5cb-791207e84535 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:24.183731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950809e5-6422-4d30-b14c-0ed06071570c None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:24.185062 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 174/343] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:24 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:24.185785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950809e5-6422-4d30-b14c-0ed06071570c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:24.241765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cf46d-71bf-460e-aa36-e5c22e5bb406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:24.242638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cf46d-71bf-460e-aa36-e5c22e5bb406 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:24.242915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cf46d-71bf-460e-aa36-e5c22e5bb406 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:24.243190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cf46d-71bf-460e-aa36-e5c22e5bb406 None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:24.244638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cf46d-71bf-460e-aa36-e5c22e5bb406 None admin] RBAC: Authorizing `identity:get_project(project_id=7b6fb712e361438587cb7af5e9fdce33)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:24.246071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cf46d-71bf-460e-aa36-e5c22e5bb406 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:24.248820 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 170/344] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:24 2022] GET /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:24.250976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775ba81-4f79-4782-8220-ce6cecb81e57 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:24.251878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775ba81-4f79-4782-8220-ce6cecb81e57 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:24.252658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775ba81-4f79-4782-8220-ce6cecb81e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:24.279927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2775ba81-4f79-4782-8220-ce6cecb81e57 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:24.282670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2775ba81-4f79-4782-8220-ce6cecb81e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:24.312468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:24.312812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:24.379127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950809e5-6422-4d30-b14c-0ed06071570c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:24.408335 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 171/345] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:24.410001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775ba81-4f79-4782-8220-ce6cecb81e57 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:24.445137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52f1dd-06dc-4926-b01c-2ca7f694b66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:24.445834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52f1dd-06dc-4926-b01c-2ca7f694b66a None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:24.446111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52f1dd-06dc-4926-b01c-2ca7f694b66a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:24.446384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52f1dd-06dc-4926-b01c-2ca7f694b66a None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:24.447314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52f1dd-06dc-4926-b01c-2ca7f694b66a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:24.447625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52f1dd-06dc-4926-b01c-2ca7f694b66a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:24.449712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52f1dd-06dc-4926-b01c-2ca7f694b66a None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:24.465696 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 175/346] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:24.467101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52f1dd-06dc-4926-b01c-2ca7f694b66a None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:24.588089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775ba81-4f79-4782-8220-ce6cecb81e57 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:24.657874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52f1dd-06dc-4926-b01c-2ca7f694b66a None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:24.661631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5294c7-c619-4389-9a72-281fab4d4a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:24.663606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5294c7-c619-4389-9a72-281fab4d4a39 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:24.664097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5294c7-c619-4389-9a72-281fab4d4a39 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:24.664512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5294c7-c619-4389-9a72-281fab4d4a39 None admin] PATH_INFO: `/v3/groups/11295bb5c55a4e93bb7da477babc999c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:24.674324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5294c7-c619-4389-9a72-281fab4d4a39 None admin] RBAC: Authorizing `identity:get_group(group_id=11295bb5c55a4e93bb7da477babc999c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:24.676340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5294c7-c619-4389-9a72-281fab4d4a39 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:24.679800 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 172/347] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Jul 2 20:44:24 2022] GET /identity/v3/groups/11295bb5c55a4e93bb7da477babc999c => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:24.680838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5294c7-c619-4389-9a72-281fab4d4a39 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:24.700468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:24.713707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650415b-243b-4ba4-bc52-a78b3c2c7a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:24.714516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650415b-243b-4ba4-bc52-a78b3c2c7a1a None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:24.714796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650415b-243b-4ba4-bc52-a78b3c2c7a1a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:24.715072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650415b-243b-4ba4-bc52-a78b3c2c7a1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:24.720782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:24.728791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650415b-243b-4ba4-bc52-a78b3c2c7a1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:24.737057 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-2650415b-243b-4ba4-bc52-a78b3c2c7a1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:24.737057 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:24.737057 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:24.737057 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:24.737057 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:24.737057 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:24.737057 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:24.737057 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:24.737057 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:24.737057 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:24.737057 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:24.737057 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:24.737057 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:24.737057 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:24.737057 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:24.737057 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:24.738270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:24.738270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:24.738270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:24.738270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:24.738270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:24.738270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:24.738270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:24.738270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:24.738270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:24.738270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:24.738270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:24.738270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:24.738270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:24.738270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:24.738270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:24.738270 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:24.742762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:24.742762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:24.742762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:24.742762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:24.742762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:24.742762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:24.742762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:24.742762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:24.742762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:24.742762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:24.742762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:24.742762 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:24.742762 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 176/348] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:24.742762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d904b-7871-4eea-83db-4471f2647cb2 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:24.743686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d904b-7871-4eea-83db-4471f2647cb2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:24.743686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d904b-7871-4eea-83db-4471f2647cb2 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:24.743686 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 177/349] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:24.743686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d904b-7871-4eea-83db-4471f2647cb2 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:24.830846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5294c7-c619-4389-9a72-281fab4d4a39 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:24.869516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d904b-7871-4eea-83db-4471f2647cb2 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:24.874021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf9486-46ce-4118-b651-064095a56cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:24.874925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf9486-46ce-4118-b651-064095a56cf3 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:24.875345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf9486-46ce-4118-b651-064095a56cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:24.875774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf9486-46ce-4118-b651-064095a56cf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:24.921355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607d3b9-e394-4da3-b4e5-0582ff22ffba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:24.922016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607d3b9-e394-4da3-b4e5-0582ff22ffba None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:24.922308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607d3b9-e394-4da3-b4e5-0582ff22ffba None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:24.922549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607d3b9-e394-4da3-b4e5-0582ff22ffba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:24.923743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607d3b9-e394-4da3-b4e5-0582ff22ffba None admin] RBAC: Adding query filter params (group.id=11295bb5c55a4e93bb7da477babc999c, role.id=dd546359e98c4932adc5eef83b817e81, scope.project.id=7b6fb712e361438587cb7af5e9fdce33) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:24.923743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607d3b9-e394-4da3-b4e5-0582ff22ffba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:24.925300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607d3b9-e394-4da3-b4e5-0582ff22ffba None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:24.935282 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 178/350] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Jul 2 20:44:24 2022] GET /identity/v3/role_assignments?group.id=11295bb5c55a4e93bb7da477babc999c&scope.project.id=7b6fb712e361438587cb7af5e9fdce33&role.id=dd546359e98c4932adc5eef83b817e81 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:24.935976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c57b4d-c19c-4548-91fd-2e4e84277330 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:24.936298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c57b4d-c19c-4548-91fd-2e4e84277330 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:24.936574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c57b4d-c19c-4548-91fd-2e4e84277330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:24.955313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-38c57b4d-c19c-4548-91fd-2e4e84277330 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:24.956682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-38c57b4d-c19c-4548-91fd-2e4e84277330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:24.980720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf9486-46ce-4118-b651-064095a56cf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:24.983382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf9486-46ce-4118-b651-064095a56cf3 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:25.005677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:25.027820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:25.055884 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 179/351] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:25.057130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c57b4d-c19c-4548-91fd-2e4e84277330 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:25.149636 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 173/352] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:25.153311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf9486-46ce-4118-b651-064095a56cf3 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:25.187553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c57b4d-c19c-4548-91fd-2e4e84277330 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:25.226301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6821d-e629-4226-9a4d-8babe5b12b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:25.226876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6821d-e629-4226-9a4d-8babe5b12b7e None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:25.227225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6821d-e629-4226-9a4d-8babe5b12b7e None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:25.227615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6821d-e629-4226-9a4d-8babe5b12b7e None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:25.228470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6821d-e629-4226-9a4d-8babe5b12b7e None admin] RBAC: Adding query filter params (name=member) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:25.228848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6821d-e629-4226-9a4d-8babe5b12b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:25.230633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6821d-e629-4226-9a4d-8babe5b12b7e None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:25.240719 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 180/353] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:25.241487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6821d-e629-4226-9a4d-8babe5b12b7e None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:25.280383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf9486-46ce-4118-b651-064095a56cf3 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:25.292018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:25.304927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:25.330531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f89a0b-bee6-4141-b549-02a16be99abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:25.331595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f89a0b-bee6-4141-b549-02a16be99abb None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:25.335451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f89a0b-bee6-4141-b549-02a16be99abb None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:25.335911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f89a0b-bee6-4141-b549-02a16be99abb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:25.354957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f89a0b-bee6-4141-b549-02a16be99abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:25.365247 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-c7f89a0b-bee6-4141-b549-02a16be99abb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:44:25.365247 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:25.365247 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:25.365247 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:25.365247 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:25.365247 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:25.365247 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:25.365247 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:25.365247 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:25.365247 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:25.365247 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:25.365247 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:25.365247 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:25.365247 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:25.365247 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:25.365247 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:25.366382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:25.366382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:25.366382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:25.366382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:25.366382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:25.366382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:25.366382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:25.366382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:25.366382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:25.366382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:25.366382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:25.366382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:25.366382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:25.366382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:25.366382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:25.366382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:25.367387 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:25.367387 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:25.367387 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:25.367387 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:25.367387 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:25.367387 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:25.367387 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:25.367387 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:25.367387 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:25.367387 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:25.367387 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:44:25.367387 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:25.367387 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 174/354] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:25.367387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f89a0b-bee6-4141-b549-02a16be99abb None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:25.374408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6821d-e629-4226-9a4d-8babe5b12b7e None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:25.415121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a08c8-f083-4c1d-a9fd-c73312ac6c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:25.415998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a08c8-f083-4c1d-a9fd-c73312ac6c18 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:25.416316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a08c8-f083-4c1d-a9fd-c73312ac6c18 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:25.416593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a08c8-f083-4c1d-a9fd-c73312ac6c18 None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:25.417804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a08c8-f083-4c1d-a9fd-c73312ac6c18 None admin] RBAC: Authorizing `identity:get_project(project_id=7b6fb712e361438587cb7af5e9fdce33)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:25.422660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a08c8-f083-4c1d-a9fd-c73312ac6c18 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:25.422660 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 181/355] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:25 2022] GET /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:25.422660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a08c8-f083-4c1d-a9fd-c73312ac6c18 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:25.490569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f89a0b-bee6-4141-b549-02a16be99abb None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:25.531860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b1c6b-229d-48a1-b3d2-70303ddeaea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:25.532651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b1c6b-229d-48a1-b3d2-70303ddeaea2 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:25.532928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b1c6b-229d-48a1-b3d2-70303ddeaea2 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:25.533203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b1c6b-229d-48a1-b3d2-70303ddeaea2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:25.545971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a08c8-f083-4c1d-a9fd-c73312ac6c18 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:25.561525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:25.590337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b461d1-e77a-4057-9903-a3ccf6dd7d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:25.591020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b461d1-e77a-4057-9903-a3ccf6dd7d43 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:25.591394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b461d1-e77a-4057-9903-a3ccf6dd7d43 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:25.591673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b461d1-e77a-4057-9903-a3ccf6dd7d43 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:25.592475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b461d1-e77a-4057-9903-a3ccf6dd7d43 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:25.592783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b461d1-e77a-4057-9903-a3ccf6dd7d43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:25.594356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b461d1-e77a-4057-9903-a3ccf6dd7d43 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:25.595120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:25.606303 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 182/356] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:25.607858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171a64b-4eb4-45ba-8b2a-4a4cef791417 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:25.608199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171a64b-4eb4-45ba-8b2a-4a4cef791417 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:25.608476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171a64b-4eb4-45ba-8b2a-4a4cef791417 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:25.610125 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 183/357] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:25.610910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171a64b-4eb4-45ba-8b2a-4a4cef791417 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:25.643155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b1c6b-229d-48a1-b3d2-70303ddeaea2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:25.644907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b1c6b-229d-48a1-b3d2-70303ddeaea2 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:25.738012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171a64b-4eb4-45ba-8b2a-4a4cef791417 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:25.771203 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 175/358] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:25.776064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d21420-6e4a-43bb-8be8-aa9530cf4658 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:25.776064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d21420-6e4a-43bb-8be8-aa9530cf4658 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:25.776064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d21420-6e4a-43bb-8be8-aa9530cf4658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:25.780261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa63eba-7c49-4785-9134-7013cf23aa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:25.781415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa63eba-7c49-4785-9134-7013cf23aa76 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:25.781860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa63eba-7c49-4785-9134-7013cf23aa76 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:25.782311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa63eba-7c49-4785-9134-7013cf23aa76 None admin] PATH_INFO: `/v3/groups/11295bb5c55a4e93bb7da477babc999c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:25.783683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa63eba-7c49-4785-9134-7013cf23aa76 None admin] RBAC: Authorizing `identity:get_group(group_id=11295bb5c55a4e93bb7da477babc999c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:25.785460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa63eba-7c49-4785-9134-7013cf23aa76 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:25.787283 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 184/359] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Jul 2 20:44:25 2022] GET /identity/v3/groups/11295bb5c55a4e93bb7da477babc999c => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:25.788245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa63eba-7c49-4785-9134-7013cf23aa76 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:25.795676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d1d21420-6e4a-43bb-8be8-aa9530cf4658 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:25.797073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d1d21420-6e4a-43bb-8be8-aa9530cf4658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:25.834984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:25.875014 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 176/360] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:25.875914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d21420-6e4a-43bb-8be8-aa9530cf4658 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:25.886814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:25.916204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa63eba-7c49-4785-9134-7013cf23aa76 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:25.959993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85d1f6-0792-40b6-a813-2d09d17621b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:25.961295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85d1f6-0792-40b6-a813-2d09d17621b7 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:25.961581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85d1f6-0792-40b6-a813-2d09d17621b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:25.961856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85d1f6-0792-40b6-a813-2d09d17621b7 None admin] PATH_INFO: `/v3/users/50c6aecd9c454cddb4ce074b0035a9ef` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:25.963077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85d1f6-0792-40b6-a813-2d09d17621b7 None admin] RBAC: Authorizing `identity:get_user(user_id=50c6aecd9c454cddb4ce074b0035a9ef)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:25.964812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85d1f6-0792-40b6-a813-2d09d17621b7 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:25.966488 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 185/361] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:44:25 2022] GET /identity/v3/users/50c6aecd9c454cddb4ce074b0035a9ef => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:25.967260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85d1f6-0792-40b6-a813-2d09d17621b7 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:26.005744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d21420-6e4a-43bb-8be8-aa9530cf4658 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:26.057688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999715e-96e1-4641-8401-ba6d6bbb7221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:26.058477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999715e-96e1-4641-8401-ba6d6bbb7221 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:26.058752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999715e-96e1-4641-8401-ba6d6bbb7221 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:26.059021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999715e-96e1-4641-8401-ba6d6bbb7221 None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:26.060257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999715e-96e1-4641-8401-ba6d6bbb7221 None admin] RBAC: Authorizing `identity:get_project(project_id=850e1f68d7b14cafb6e5424ddbee9a91)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:26.061872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999715e-96e1-4641-8401-ba6d6bbb7221 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:26.063595 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 177/362] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:25 2022] GET /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:26.065694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf73fa1-b49d-4d8f-9fc3-7d181bff9c06 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:26.065976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf73fa1-b49d-4d8f-9fc3-7d181bff9c06 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:26.066511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf73fa1-b49d-4d8f-9fc3-7d181bff9c06 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:26.067470 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 178/363] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:26.068258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf73fa1-b49d-4d8f-9fc3-7d181bff9c06 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:26.100029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85d1f6-0792-40b6-a813-2d09d17621b7 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:26.113592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:26.143850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eee3c-e749-424c-b7f8-139089008fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:26.144599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eee3c-e749-424c-b7f8-139089008fc4 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:26.144876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eee3c-e749-424c-b7f8-139089008fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:26.145148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eee3c-e749-424c-b7f8-139089008fc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:26.145972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eee3c-e749-424c-b7f8-139089008fc4 None admin] RBAC: Adding query filter params (group.id=11295bb5c55a4e93bb7da477babc999c, role.id=74cf644f6b8f49ce86fffcde317f8883, scope.project.id=7b6fb712e361438587cb7af5e9fdce33) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:26.146277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eee3c-e749-424c-b7f8-139089008fc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:26.147737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eee3c-e749-424c-b7f8-139089008fc4 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:26.153431 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 186/364] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Jul 2 20:44:25 2022] GET /identity/v3/role_assignments?group.id=11295bb5c55a4e93bb7da477babc999c&scope.project.id=7b6fb712e361438587cb7af5e9fdce33&role.id=74cf644f6b8f49ce86fffcde317f8883 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:26.154740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eee3c-e749-424c-b7f8-139089008fc4 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:26.164987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:26.199470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf73fa1-b49d-4d8f-9fc3-7d181bff9c06 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:26.247573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f510b-8df9-4435-8e11-52cdaa4f6cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:26.248680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f510b-8df9-4435-8e11-52cdaa4f6cf6 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:26.248851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f510b-8df9-4435-8e11-52cdaa4f6cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:26.249218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f510b-8df9-4435-8e11-52cdaa4f6cf6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:26.264392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f510b-8df9-4435-8e11-52cdaa4f6cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:26.273339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-106f510b-8df9-4435-8e11-52cdaa4f6cf6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:26.273339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:26.273339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:26.273339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:26.273339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:26.273339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:26.273339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:26.273339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:26.273339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:26.273339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:26.273339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:26.273339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:26.273339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:26.273339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:26.273339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:26.273339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:26.275085 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:26.275085 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:26.275085 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:26.275085 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:26.275085 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:26.275085 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:26.275085 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:26.275085 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:26.275085 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:26.275085 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:26.275085 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:26.275085 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:26.275085 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:26.275085 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:26.275085 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:26.275085 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:26.276699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:26.276699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:26.276699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:26.276699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:26.276699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:26.276699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:26.276699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:26.276699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:26.276699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:26.276699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:26.276699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:26.276699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:26.276699 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 179/365] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:44:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:26.276699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f510b-8df9-4435-8e11-52cdaa4f6cf6 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:26.321237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eee3c-e749-424c-b7f8-139089008fc4 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:26.374062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d147926-a304-46fc-9142-24175b47054f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:26.374776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d147926-a304-46fc-9142-24175b47054f None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:26.375057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d147926-a304-46fc-9142-24175b47054f None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:26.375329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d147926-a304-46fc-9142-24175b47054f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:26.376195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d147926-a304-46fc-9142-24175b47054f None admin] RBAC: Adding query filter params (role.id=626342454d8044849bcbaa4f6d292aed, user.id=50c6aecd9c454cddb4ce074b0035a9ef, scope.system=all) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:26.376504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d147926-a304-46fc-9142-24175b47054f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:26.377989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d147926-a304-46fc-9142-24175b47054f None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:26.395269 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 187/366] 10.222.0.43 () {56 vars in 1308 bytes} [Sat Jul 2 20:44:26 2022] GET /identity/v3/role_assignments?user.id=50c6aecd9c454cddb4ce074b0035a9ef&scope.system=all&role.id=626342454d8044849bcbaa4f6d292aed => generated 510 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:26.396690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51224bbb-fa7b-4ac4-acff-42d19737fc62 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:26.396981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51224bbb-fa7b-4ac4-acff-42d19737fc62 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:26.397481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51224bbb-fa7b-4ac4-acff-42d19737fc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:26.417067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f510b-8df9-4435-8e11-52cdaa4f6cf6 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:26.435164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-51224bbb-fa7b-4ac4-acff-42d19737fc62 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:26.436504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-51224bbb-fa7b-4ac4-acff-42d19737fc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:26.491035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012138b-0454-4ebb-ad5c-002acad55686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:26.492173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012138b-0454-4ebb-ad5c-002acad55686 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:26.492455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012138b-0454-4ebb-ad5c-002acad55686 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:26.492733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012138b-0454-4ebb-ad5c-002acad55686 None admin] PATH_INFO: `/v3/groups/11295bb5c55a4e93bb7da477babc999c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:26.496257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012138b-0454-4ebb-ad5c-002acad55686 None admin] RBAC: Authorizing `identity:get_group(group_id=11295bb5c55a4e93bb7da477babc999c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:26.496439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:26.497737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012138b-0454-4ebb-ad5c-002acad55686 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:26.502235 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 180/367] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Jul 2 20:44:26 2022] GET /identity/v3/groups/11295bb5c55a4e93bb7da477babc999c => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:26.503846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012138b-0454-4ebb-ad5c-002acad55686 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:26.516816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:26.566593 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 188/368] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:26.567818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51224bbb-fa7b-4ac4-acff-42d19737fc62 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:26.684472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012138b-0454-4ebb-ad5c-002acad55686 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:26.693959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51224bbb-fa7b-4ac4-acff-42d19737fc62 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:26.726955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b76e47-eacf-45fd-8be1-02a1eff97571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:26.727627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b76e47-eacf-45fd-8be1-02a1eff97571 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:26.727909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b76e47-eacf-45fd-8be1-02a1eff97571 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:26.728246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b76e47-eacf-45fd-8be1-02a1eff97571 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:26.729176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b76e47-eacf-45fd-8be1-02a1eff97571 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:26.729579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b76e47-eacf-45fd-8be1-02a1eff97571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:26.731049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b76e47-eacf-45fd-8be1-02a1eff97571 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:26.731429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3fc12-2a2d-4616-9b41-8152158b7bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:26.733461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3fc12-2a2d-4616-9b41-8152158b7bbf None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:26.733835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3fc12-2a2d-4616-9b41-8152158b7bbf None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:26.734160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3fc12-2a2d-4616-9b41-8152158b7bbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:26.735099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3fc12-2a2d-4616-9b41-8152158b7bbf None admin] RBAC: Adding query filter params (group.id=11295bb5c55a4e93bb7da477babc999c, role.id=dd546359e98c4932adc5eef83b817e81, scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:26.735405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3fc12-2a2d-4616-9b41-8152158b7bbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:26.736922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3fc12-2a2d-4616-9b41-8152158b7bbf None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:26.741864 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 181/369] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:26.742546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b76e47-eacf-45fd-8be1-02a1eff97571 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:26.743637 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 189/370] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Jul 2 20:44:26 2022] GET /identity/v3/role_assignments?group.id=11295bb5c55a4e93bb7da477babc999c&scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91&role.id=dd546359e98c4932adc5eef83b817e81 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:26.756998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3fc12-2a2d-4616-9b41-8152158b7bbf None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:26.800310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:26.824763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:26.863345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b76e47-eacf-45fd-8be1-02a1eff97571 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:26.902086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3fc12-2a2d-4616-9b41-8152158b7bbf None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:26.912896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbe1d9-4029-48cd-8b72-f2deb97f4c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:26.913710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbe1d9-4029-48cd-8b72-f2deb97f4c0f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:26.913989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbe1d9-4029-48cd-8b72-f2deb97f4c0f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:26.914261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbe1d9-4029-48cd-8b72-f2deb97f4c0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:26.941124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbe1d9-4029-48cd-8b72-f2deb97f4c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:26.943393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9d6dd-0230-4bd7-9c1e-7b517cb81c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:26.944300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9d6dd-0230-4bd7-9c1e-7b517cb81c16 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:26.944714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9d6dd-0230-4bd7-9c1e-7b517cb81c16 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:26.945128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9d6dd-0230-4bd7-9c1e-7b517cb81c16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:26.955434 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-04cbe1d9-4029-48cd-8b72-f2deb97f4c0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:44:26.955434 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:26.955434 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:26.955434 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:26.955434 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:26.955434 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:26.955434 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:26.955434 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:26.955434 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:26.955434 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:26.955434 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:26.955434 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:26.955434 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:26.955434 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:26.955434 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:26.955434 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:26.956667 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:26.956667 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:26.956667 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:26.956667 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:26.956667 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:26.956667 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:26.956667 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:26.956667 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:26.956667 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:26.956667 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:26.956667 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:26.956667 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:26.956667 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:26.956667 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:26.956667 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:26.956667 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:26.958963 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:26.958963 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:26.958963 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:26.958963 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:26.958963 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:26.958963 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:26.958963 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:26.958963 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:26.958963 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:26.958963 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:26.958963 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:44:26.958963 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:26.958963 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 182/371] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:44:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:26.962613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbe1d9-4029-48cd-8b72-f2deb97f4c0f None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:27.028641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9d6dd-0230-4bd7-9c1e-7b517cb81c16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:27.030389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9d6dd-0230-4bd7-9c1e-7b517cb81c16 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:27.063016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:27.137353 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 190/372] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 20:44:27.144935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9d6dd-0230-4bd7-9c1e-7b517cb81c16 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:27.210042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbe1d9-4029-48cd-8b72-f2deb97f4c0f None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:27.251360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:27.262336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de121-ffa8-45e8-9ad7-eaf450fef59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:27.263248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de121-ffa8-45e8-9ad7-eaf450fef59a None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:27.263664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de121-ffa8-45e8-9ad7-eaf450fef59a None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:27.264294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de121-ffa8-45e8-9ad7-eaf450fef59a None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:27.266352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059de121-ffa8-45e8-9ad7-eaf450fef59a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:27.267473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059de121-ffa8-45e8-9ad7-eaf450fef59a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:27.269795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059de121-ffa8-45e8-9ad7-eaf450fef59a None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:27.285629 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 183/373] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:27.295348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de121-ffa8-45e8-9ad7-eaf450fef59a None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:27.378016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9d6dd-0230-4bd7-9c1e-7b517cb81c16 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:27.427786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:27.430466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de121-ffa8-45e8-9ad7-eaf450fef59a None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:27.461120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f9b99-a50a-4bb4-a690-66d7d15580f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:27.461922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f9b99-a50a-4bb4-a690-66d7d15580f1 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:27.462204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f9b99-a50a-4bb4-a690-66d7d15580f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:27.462482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f9b99-a50a-4bb4-a690-66d7d15580f1 None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:27.463693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f9b99-a50a-4bb4-a690-66d7d15580f1 None admin] RBAC: Authorizing `identity:get_project(project_id=850e1f68d7b14cafb6e5424ddbee9a91)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:27.465199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f9b99-a50a-4bb4-a690-66d7d15580f1 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:27.468891 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 191/374] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:27 2022] GET /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91 => generated 302 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:27.474285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f981a4-7acd-4ae0-84bb-6331c8ddf33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:27.475115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f981a4-7acd-4ae0-84bb-6331c8ddf33c None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:27.476177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f9b99-a50a-4bb4-a690-66d7d15580f1 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:27.477341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f981a4-7acd-4ae0-84bb-6331c8ddf33c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:27.481504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f981a4-7acd-4ae0-84bb-6331c8ddf33c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:27.592449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:27.603183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f981a4-7acd-4ae0-84bb-6331c8ddf33c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:27.604554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f981a4-7acd-4ae0-84bb-6331c8ddf33c None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:27.611881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f9b99-a50a-4bb4-a690-66d7d15580f1 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:27.651864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec090bc-d4b0-4d12-b23e-c1ac6a2804c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:27.653669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec090bc-d4b0-4d12-b23e-c1ac6a2804c8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:27.654359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec090bc-d4b0-4d12-b23e-c1ac6a2804c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:27.655016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec090bc-d4b0-4d12-b23e-c1ac6a2804c8 None admin] PATH_INFO: `/v3/groups/11295bb5c55a4e93bb7da477babc999c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:27.656739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec090bc-d4b0-4d12-b23e-c1ac6a2804c8 None admin] RBAC: Authorizing `identity:get_group(group_id=11295bb5c55a4e93bb7da477babc999c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:27.658415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec090bc-d4b0-4d12-b23e-c1ac6a2804c8 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:27.662737 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 192/375] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Jul 2 20:44:27 2022] GET /identity/v3/groups/11295bb5c55a4e93bb7da477babc999c => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:27.669780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec090bc-d4b0-4d12-b23e-c1ac6a2804c8 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:27.801386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:27.804718 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 184/376] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:27.818846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f981a4-7acd-4ae0-84bb-6331c8ddf33c None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:27.889764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec090bc-d4b0-4d12-b23e-c1ac6a2804c8 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:27.944240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33c8d9-7de3-4961-9130-3d875e3d54c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:27.944910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33c8d9-7de3-4961-9130-3d875e3d54c2 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:27.945191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33c8d9-7de3-4961-9130-3d875e3d54c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:27.945467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33c8d9-7de3-4961-9130-3d875e3d54c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:27.946291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33c8d9-7de3-4961-9130-3d875e3d54c2 None admin] RBAC: Adding query filter params (group.id=11295bb5c55a4e93bb7da477babc999c, role.id=74cf644f6b8f49ce86fffcde317f8883, scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:27.946606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33c8d9-7de3-4961-9130-3d875e3d54c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:27.948070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33c8d9-7de3-4961-9130-3d875e3d54c2 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:27.954364 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 193/377] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Jul 2 20:44:27 2022] GET /identity/v3/role_assignments?group.id=11295bb5c55a4e93bb7da477babc999c&scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91&role.id=74cf644f6b8f49ce86fffcde317f8883 => generated 260 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:27.955541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda24a6-f8dc-4197-9eca-f064a1f211cf None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:27.955829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda24a6-f8dc-4197-9eca-f064a1f211cf None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:27.960244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda24a6-f8dc-4197-9eca-f064a1f211cf None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:27.961707 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 194/378] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:27.964853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:27.973933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffefc71-caae-46d3-a89b-8a94a249e1a0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:27.974200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffefc71-caae-46d3-a89b-8a94a249e1a0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:27.974500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffefc71-caae-46d3-a89b-8a94a249e1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:27.983191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f981a4-7acd-4ae0-84bb-6331c8ddf33c None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:28.010649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3ffefc71-caae-46d3-a89b-8a94a249e1a0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:28.011903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3ffefc71-caae-46d3-a89b-8a94a249e1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:28.049367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc8892-61f6-40ac-b557-65181de6d6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:28.050515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc8892-61f6-40ac-b557-65181de6d6d3 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:28.050942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc8892-61f6-40ac-b557-65181de6d6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:28.051363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc8892-61f6-40ac-b557-65181de6d6d3 None admin] PATH_INFO: `/v3/projects/d4c9de22f7474b6f9c2ca908dc6ecd1f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:28.056914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc8892-61f6-40ac-b557-65181de6d6d3 None admin] RBAC: Authorizing `identity:get_project(project_id=d4c9de22f7474b6f9c2ca908dc6ecd1f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:28.058584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc8892-61f6-40ac-b557-65181de6d6d3 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:28.060533 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 185/379] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:27 2022] GET /identity/v3/projects/d4c9de22f7474b6f9c2ca908dc6ecd1f => generated 344 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:28.069535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc8892-61f6-40ac-b557-65181de6d6d3 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:28.087719 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 195/380] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 02 20:44:28.125661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffefc71-caae-46d3-a89b-8a94a249e1a0 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:28.203929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc8892-61f6-40ac-b557-65181de6d6d3 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:28.240422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:28.264899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a09deb-381b-4dda-bea0-14b4994da82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:28.265889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a09deb-381b-4dda-bea0-14b4994da82c None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:28.266232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a09deb-381b-4dda-bea0-14b4994da82c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:28.266569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a09deb-381b-4dda-bea0-14b4994da82c None admin] PATH_INFO: `/v3/groups/594a32b5e847486682e97e68ee836f44` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:28.281024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a09deb-381b-4dda-bea0-14b4994da82c None admin] RBAC: Authorizing `identity:get_group(group_id=594a32b5e847486682e97e68ee836f44)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:28.282529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a09deb-381b-4dda-bea0-14b4994da82c None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:28.284693 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 186/381] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Jul 2 20:44:28 2022] GET /identity/v3/groups/594a32b5e847486682e97e68ee836f44 => generated 229 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:28.289267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffefc71-caae-46d3-a89b-8a94a249e1a0 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:28.290823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a09deb-381b-4dda-bea0-14b4994da82c None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:28.324623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:28.360822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2852e-8af3-4178-9ce3-da109f92499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:28.362003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2852e-8af3-4178-9ce3-da109f92499b None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:28.362462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2852e-8af3-4178-9ce3-da109f92499b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:28.362908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2852e-8af3-4178-9ce3-da109f92499b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:28.388327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2852e-8af3-4178-9ce3-da109f92499b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:28.403307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-18f2852e-8af3-4178-9ce3-da109f92499b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:28.403307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:28.403307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:28.403307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:28.403307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:28.403307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:28.403307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:28.403307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:28.403307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:28.403307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:28.403307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:28.403307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:28.403307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:28.403307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:28.403307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:28.403307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:28.404401 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:28.404401 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:28.404401 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:28.404401 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:28.404401 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:28.404401 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:28.404401 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:28.404401 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:28.404401 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:28.404401 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:28.404401 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:28.404401 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:28.404401 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:28.404401 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:28.404401 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:28.404401 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:28.405218 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:28.405218 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:28.405218 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:28.405218 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:28.405218 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:28.405218 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:28.405218 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:28.405218 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:28.405218 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:28.405218 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:28.405218 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:28.405218 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:28.405218 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 196/382] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:28.413169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2852e-8af3-4178-9ce3-da109f92499b None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:28.424806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a09deb-381b-4dda-bea0-14b4994da82c None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:28.467414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30390388-c5ec-48bb-ae24-38d8349319c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:28.468567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30390388-c5ec-48bb-ae24-38d8349319c4 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:28.469237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30390388-c5ec-48bb-ae24-38d8349319c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:28.469527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30390388-c5ec-48bb-ae24-38d8349319c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:28.470530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30390388-c5ec-48bb-ae24-38d8349319c4 None admin] RBAC: Adding query filter params (group.id=594a32b5e847486682e97e68ee836f44, role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.project.id=d4c9de22f7474b6f9c2ca908dc6ecd1f) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:28.470852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30390388-c5ec-48bb-ae24-38d8349319c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:28.472334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30390388-c5ec-48bb-ae24-38d8349319c4 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:28.478983 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 187/383] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Jul 2 20:44:28 2022] GET /identity/v3/role_assignments?group.id=594a32b5e847486682e97e68ee836f44&scope.project.id=d4c9de22f7474b6f9c2ca908dc6ecd1f&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:28.566356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2852e-8af3-4178-9ce3-da109f92499b None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:28.585513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:28.641205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2e634-d0f0-467e-b1f4-5d554ef7f3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:28.642252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2e634-d0f0-467e-b1f4-5d554ef7f3ef None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:28.642781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2e634-d0f0-467e-b1f4-5d554ef7f3ef None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:28.643266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2e634-d0f0-467e-b1f4-5d554ef7f3ef None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:28.644270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2e634-d0f0-467e-b1f4-5d554ef7f3ef None admin] RBAC: Adding query filter params (name=member) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:28.644781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2e634-d0f0-467e-b1f4-5d554ef7f3ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:28.646393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2e634-d0f0-467e-b1f4-5d554ef7f3ef None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:28.669602 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 197/384] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:28.675699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30390388-c5ec-48bb-ae24-38d8349319c4 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:28.831803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:28.852265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30390388-c5ec-48bb-ae24-38d8349319c4 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:28.896131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1a887-a1c9-4cba-b23a-a80fa7938832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:28.896966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1a887-a1c9-4cba-b23a-a80fa7938832 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:28.897240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1a887-a1c9-4cba-b23a-a80fa7938832 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:28.897509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1a887-a1c9-4cba-b23a-a80fa7938832 None admin] PATH_INFO: `/v3/groups/11295bb5c55a4e93bb7da477babc999c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:28.898679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1a887-a1c9-4cba-b23a-a80fa7938832 None admin] RBAC: Authorizing `identity:get_group(group_id=11295bb5c55a4e93bb7da477babc999c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:28.900146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1a887-a1c9-4cba-b23a-a80fa7938832 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:28.901768 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 188/385] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Jul 2 20:44:28 2022] GET /identity/v3/groups/11295bb5c55a4e93bb7da477babc999c => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:28.907438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2e634-d0f0-467e-b1f4-5d554ef7f3ef None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:29.035026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2e634-d0f0-467e-b1f4-5d554ef7f3ef None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:29.087213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e614a7e-9dca-4069-b860-f781e05a32e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:29.093167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e614a7e-9dca-4069-b860-f781e05a32e3 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:29.093533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e614a7e-9dca-4069-b860-f781e05a32e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:29.093823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e614a7e-9dca-4069-b860-f781e05a32e3 None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:29.100915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e614a7e-9dca-4069-b860-f781e05a32e3 None admin] RBAC: Authorizing `identity:get_project(project_id=7b6fb712e361438587cb7af5e9fdce33)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:29.102460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e614a7e-9dca-4069-b860-f781e05a32e3 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:29.104447 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 198/386] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:28 2022] GET /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:29.110135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1a887-a1c9-4cba-b23a-a80fa7938832 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:29.224139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1a887-a1c9-4cba-b23a-a80fa7938832 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:29.258972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16764c8c-2719-4be8-bd93-2cd939182fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:29.259855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16764c8c-2719-4be8-bd93-2cd939182fe6 None admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:29.260155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16764c8c-2719-4be8-bd93-2cd939182fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:29.260423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16764c8c-2719-4be8-bd93-2cd939182fe6 None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33/groups/11295bb5c55a4e93bb7da477babc999c/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:29.262389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16764c8c-2719-4be8-bd93-2cd939182fe6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b6fb712e361438587cb7af5e9fdce33, group_id=11295bb5c55a4e93bb7da477babc999c, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:29.263836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16764c8c-2719-4be8-bd93-2cd939182fe6 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:29.283668 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 189/387] 10.222.0.43 () {58 vars in 1442 bytes} [Sat Jul 2 20:44:29 2022] PUT /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33/groups/11295bb5c55a4e93bb7da477babc999c/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:44:29.434001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873446a-4bf8-4322-9df3-444b4195a61c None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:29.434547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873446a-4bf8-4322-9df3-444b4195a61c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:29.434626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873446a-4bf8-4322-9df3-444b4195a61c None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:29.436227 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 199/388] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:29.450052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49051d8b-3033-4f6a-be56-14802e123cfc None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:29.450672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49051d8b-3033-4f6a-be56-14802e123cfc None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:29.451168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49051d8b-3033-4f6a-be56-14802e123cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:29.475116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-49051d8b-3033-4f6a-be56-14802e123cfc None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:29.476850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-49051d8b-3033-4f6a-be56-14802e123cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:29.486008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:29.567047 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 190/389] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:29.596001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873446a-4bf8-4322-9df3-444b4195a61c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:29.658720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:29.748279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873446a-4bf8-4322-9df3-444b4195a61c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:29.785171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eaf43f-e4a4-490e-acd2-fbdc1caeb339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:29.785988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaf43f-e4a4-490e-acd2-fbdc1caeb339 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:29.786271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaf43f-e4a4-490e-acd2-fbdc1caeb339 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:29.786548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaf43f-e4a4-490e-acd2-fbdc1caeb339 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:29.798930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eaf43f-e4a4-490e-acd2-fbdc1caeb339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:29.807368 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-c7eaf43f-e4a4-490e-acd2-fbdc1caeb339 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:29.807368 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:29.807368 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:29.807368 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:29.807368 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:29.807368 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:29.807368 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:29.807368 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:29.807368 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:29.807368 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:29.807368 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:29.807368 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:29.807368 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:29.807368 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:29.807368 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:29.807368 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:29.808397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:29.808397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:29.808397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:29.808397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:29.808397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:29.808397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:29.808397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:29.808397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:29.808397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:29.808397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:29.808397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:29.808397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:29.808397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:29.808397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:29.808397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:29.808397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:29.809226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:29.809226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:29.809226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:29.809226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:29.809226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:29.809226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:29.809226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:29.809226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:29.809226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:29.809226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:29.809226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:29.809226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:29.813658 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 200/390] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:44:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:29.815088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49051d8b-3033-4f6a-be56-14802e123cfc None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:29.933373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0c2cf-0b69-4691-b8a6-f664219123ad None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:29.933701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0c2cf-0b69-4691-b8a6-f664219123ad None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:29.933944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0c2cf-0b69-4691-b8a6-f664219123ad None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:29.937821 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 201/391] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:44:29.940453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49051d8b-3033-4f6a-be56-14802e123cfc None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:29.942058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab2b03-1c08-40d6-82b8-2285ba589258 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:29.942340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab2b03-1c08-40d6-82b8-2285ba589258 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:29.942727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab2b03-1c08-40d6-82b8-2285ba589258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:29.962626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d7ab2b03-1c08-40d6-82b8-2285ba589258 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:29.964383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d7ab2b03-1c08-40d6-82b8-2285ba589258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:30.004395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e11503-2ed7-4b39-a2ba-8f0b84b2c479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:30.004995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e11503-2ed7-4b39-a2ba-8f0b84b2c479 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:30.005302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e11503-2ed7-4b39-a2ba-8f0b84b2c479 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:30.005540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e11503-2ed7-4b39-a2ba-8f0b84b2c479 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:30.006290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e11503-2ed7-4b39-a2ba-8f0b84b2c479 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:30.006597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e11503-2ed7-4b39-a2ba-8f0b84b2c479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:30.009794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e11503-2ed7-4b39-a2ba-8f0b84b2c479 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:30.027360 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 191/392] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:30.034451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e11503-2ed7-4b39-a2ba-8f0b84b2c479 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:30.045043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:30.101627 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 202/393] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:44:30.160443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab2b03-1c08-40d6-82b8-2285ba589258 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:30.187199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e11503-2ed7-4b39-a2ba-8f0b84b2c479 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:30.225337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b23f3-8a98-4dc8-97c5-e15370b38cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:30.226357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b23f3-8a98-4dc8-97c5-e15370b38cb7 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:30.226645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b23f3-8a98-4dc8-97c5-e15370b38cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:30.226923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b23f3-8a98-4dc8-97c5-e15370b38cb7 None admin] PATH_INFO: `/v3/groups/11295bb5c55a4e93bb7da477babc999c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:30.228131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b23f3-8a98-4dc8-97c5-e15370b38cb7 None admin] RBAC: Authorizing `identity:get_group(group_id=11295bb5c55a4e93bb7da477babc999c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:30.229699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b23f3-8a98-4dc8-97c5-e15370b38cb7 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:30.236109 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 192/394] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Jul 2 20:44:30 2022] GET /identity/v3/groups/11295bb5c55a4e93bb7da477babc999c => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:30.237570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b23f3-8a98-4dc8-97c5-e15370b38cb7 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:30.245120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:30.315978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:30.350312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b23f3-8a98-4dc8-97c5-e15370b38cb7 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:30.365065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab2b03-1c08-40d6-82b8-2285ba589258 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:30.387037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d67e59-78f7-4969-bb87-a3d63543a3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:30.388231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d67e59-78f7-4969-bb87-a3d63543a3d1 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:30.388657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d67e59-78f7-4969-bb87-a3d63543a3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:30.389079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d67e59-78f7-4969-bb87-a3d63543a3d1 None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:30.390465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d67e59-78f7-4969-bb87-a3d63543a3d1 None admin] RBAC: Authorizing `identity:get_project(project_id=7b6fb712e361438587cb7af5e9fdce33)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:30.392115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d67e59-78f7-4969-bb87-a3d63543a3d1 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:30.394225 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 193/395] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:30 2022] GET /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:30.400810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d67e59-78f7-4969-bb87-a3d63543a3d1 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:30.434713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26415281-3ab5-487d-a12e-6bd9515ec345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:30.436920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26415281-3ab5-487d-a12e-6bd9515ec345 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:30.438089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26415281-3ab5-487d-a12e-6bd9515ec345 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:30.438509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26415281-3ab5-487d-a12e-6bd9515ec345 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:30.462134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26415281-3ab5-487d-a12e-6bd9515ec345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:30.472875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-26415281-3ab5-487d-a12e-6bd9515ec345 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:30.472875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:30.472875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:30.472875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:30.472875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:30.472875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:30.472875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:30.472875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:30.472875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:30.472875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:30.472875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:30.472875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:30.472875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:30.472875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:30.472875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:30.472875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:30.473846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:30.473846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:30.473846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:30.473846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:30.473846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:30.473846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:30.473846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:30.473846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:30.473846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:30.473846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:30.473846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:30.473846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:30.473846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:30.473846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:30.473846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:30.473846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:30.475130 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:30.475130 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:30.475130 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:30.475130 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:30.475130 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:30.475130 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:30.475130 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:30.475130 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:30.475130 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:30.475130 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:30.475130 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:30.475130 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:30.475130 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 203/396] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:30.479912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26415281-3ab5-487d-a12e-6bd9515ec345 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:30.555094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d67e59-78f7-4969-bb87-a3d63543a3d1 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:30.592200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe6727-0cd1-46ad-a1f0-977811102f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:30.593499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe6727-0cd1-46ad-a1f0-977811102f8b None admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:30.593988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe6727-0cd1-46ad-a1f0-977811102f8b None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:30.594424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe6727-0cd1-46ad-a1f0-977811102f8b None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33/groups/11295bb5c55a4e93bb7da477babc999c/roles/74cf644f6b8f49ce86fffcde317f8883` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:30.596900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe6727-0cd1-46ad-a1f0-977811102f8b None admin] RBAC: Authorizing `identity:create_grant(project_id=7b6fb712e361438587cb7af5e9fdce33, group_id=11295bb5c55a4e93bb7da477babc999c, role_id=74cf644f6b8f49ce86fffcde317f8883)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:30.598518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe6727-0cd1-46ad-a1f0-977811102f8b None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:30.610178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:30.616418 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 194/397] 10.222.0.43 () {58 vars in 1442 bytes} [Sat Jul 2 20:44:30 2022] PUT /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33/groups/11295bb5c55a4e93bb7da477babc999c/roles/74cf644f6b8f49ce86fffcde317f8883 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:44:30.689444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:30.697118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26415281-3ab5-487d-a12e-6bd9515ec345 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:30.745823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846c933-db5c-46f2-a24e-c98db621fbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:30.746588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846c933-db5c-46f2-a24e-c98db621fbf8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:30.746871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846c933-db5c-46f2-a24e-c98db621fbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:30.747166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846c933-db5c-46f2-a24e-c98db621fbf8 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:30.748137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846c933-db5c-46f2-a24e-c98db621fbf8 None admin] RBAC: Adding query filter params (name=member) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:30.752166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846c933-db5c-46f2-a24e-c98db621fbf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:30.753964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846c933-db5c-46f2-a24e-c98db621fbf8 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:30.764005 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 204/398] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:30.769382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe6727-0cd1-46ad-a1f0-977811102f8b None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:30.919336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe6727-0cd1-46ad-a1f0-977811102f8b None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:30.963011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0432274-24d0-46ff-a3c8-565302c55d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:30.963874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0432274-24d0-46ff-a3c8-565302c55d8a None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:30.964182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0432274-24d0-46ff-a3c8-565302c55d8a None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:30.964452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0432274-24d0-46ff-a3c8-565302c55d8a None admin] PATH_INFO: `/v3/groups/11295bb5c55a4e93bb7da477babc999c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:30.965617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0432274-24d0-46ff-a3c8-565302c55d8a None admin] RBAC: Authorizing `identity:get_group(group_id=11295bb5c55a4e93bb7da477babc999c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:30.967049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0432274-24d0-46ff-a3c8-565302c55d8a None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:30.969016 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 195/399] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Jul 2 20:44:30 2022] GET /identity/v3/groups/11295bb5c55a4e93bb7da477babc999c => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:30.974307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846c933-db5c-46f2-a24e-c98db621fbf8 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:31.118914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846c933-db5c-46f2-a24e-c98db621fbf8 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:31.159969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b08f9-6bf9-4874-a1dd-d470e5b2b4bf None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:31.160639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b08f9-6bf9-4874-a1dd-d470e5b2b4bf None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:31.161121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b08f9-6bf9-4874-a1dd-d470e5b2b4bf None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:31.162933 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 196/400] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:31.167588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3e519-908b-4417-8975-71604ce283d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:31.168495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3e519-908b-4417-8975-71604ce283d3 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:31.168776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3e519-908b-4417-8975-71604ce283d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:31.169049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3e519-908b-4417-8975-71604ce283d3 None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:31.169300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff94984-b0cc-4545-88e0-edf66cc10505 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:31.169814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff94984-b0cc-4545-88e0-edf66cc10505 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:31.170253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3e519-908b-4417-8975-71604ce283d3 None admin] RBAC: Authorizing `identity:get_project(project_id=850e1f68d7b14cafb6e5424ddbee9a91)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:31.170460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff94984-b0cc-4545-88e0-edf66cc10505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:31.171805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3e519-908b-4417-8975-71604ce283d3 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:31.173767 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 205/401] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:30 2022] GET /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:31.179345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3e519-908b-4417-8975-71604ce283d3 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:31.190347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6ff94984-b0cc-4545-88e0-edf66cc10505 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:31.191833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6ff94984-b0cc-4545-88e0-edf66cc10505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:31.214792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:31.290809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3e519-908b-4417-8975-71604ce283d3 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:31.297381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:31.306889 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 197/402] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:44:31.339559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0bb94-e8e6-4814-ba53-9d30ee6e0e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:31.340821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0bb94-e8e6-4814-ba53-9d30ee6e0e74 None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:31.341314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0bb94-e8e6-4814-ba53-9d30ee6e0e74 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:31.341771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0bb94-e8e6-4814-ba53-9d30ee6e0e74 None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91/groups/11295bb5c55a4e93bb7da477babc999c/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:31.346120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0bb94-e8e6-4814-ba53-9d30ee6e0e74 None admin] RBAC: Authorizing `identity:create_grant(project_id=850e1f68d7b14cafb6e5424ddbee9a91, group_id=11295bb5c55a4e93bb7da477babc999c, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:31.347775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0bb94-e8e6-4814-ba53-9d30ee6e0e74 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:31.365210 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 206/403] 10.222.0.43 () {58 vars in 1442 bytes} [Sat Jul 2 20:44:31 2022] PUT /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91/groups/11295bb5c55a4e93bb7da477babc999c/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 20:44:31.372771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff94984-b0cc-4545-88e0-edf66cc10505 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:31.520102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff94984-b0cc-4545-88e0-edf66cc10505 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:31.556504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb7fb5-6fa0-466c-9e19-b2c5f60c57c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:31.557714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb7fb5-6fa0-466c-9e19-b2c5f60c57c5 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:31.558212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb7fb5-6fa0-466c-9e19-b2c5f60c57c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:31.558706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb7fb5-6fa0-466c-9e19-b2c5f60c57c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:31.569478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb7fb5-6fa0-466c-9e19-b2c5f60c57c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:31.578100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-74cb7fb5-6fa0-466c-9e19-b2c5f60c57c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:31.578100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:31.578100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:31.578100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:31.578100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:31.578100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:31.578100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:31.578100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:31.578100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:31.578100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:31.578100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:31.578100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:31.578100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:31.578100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:31.578100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:31.578100 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:31.579073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:31.579073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:31.579073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:31.579073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:31.579073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:31.579073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:31.579073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:31.579073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:31.579073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:31.579073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:31.579073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:31.579073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:31.579073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:31.579073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:31.579073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:31.579073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:31.579890 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:31.579890 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:31.579890 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:31.579890 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:31.579890 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:31.579890 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:31.579890 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:31.579890 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:31.579890 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:31.579890 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:31.579890 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:31.579890 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:31.582609 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 198/404] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:44:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:31.590602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0bb94-e8e6-4814-ba53-9d30ee6e0e74 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:31.686079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:31.703343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0bb94-e8e6-4814-ba53-9d30ee6e0e74 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:31.705799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5e071-4fbe-42f2-ad29-6ed4aa9e896d None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:31.706082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5e071-4fbe-42f2-ad29-6ed4aa9e896d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:31.706354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5e071-4fbe-42f2-ad29-6ed4aa9e896d None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:31.707791 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 199/405] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:44:31.713450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc7150-5374-4d51-a07b-1a3e35e6d8cb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:31.713734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc7150-5374-4d51-a07b-1a3e35e6d8cb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:31.714014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc7150-5374-4d51-a07b-1a3e35e6d8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:31.745232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a7bc7150-5374-4d51-a07b-1a3e35e6d8cb None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:31.748459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a7bc7150-5374-4d51-a07b-1a3e35e6d8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:31.760321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f937287-a528-4b91-ad05-03923ee73260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:31.760995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f937287-a528-4b91-ad05-03923ee73260 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:31.761272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f937287-a528-4b91-ad05-03923ee73260 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:31.761538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f937287-a528-4b91-ad05-03923ee73260 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:31.762279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f937287-a528-4b91-ad05-03923ee73260 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:31.762844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f937287-a528-4b91-ad05-03923ee73260 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:31.764246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f937287-a528-4b91-ad05-03923ee73260 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:31.780289 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 207/406] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:31.792064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f937287-a528-4b91-ad05-03923ee73260 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:31.863718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:31.902475 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 200/407] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:31.937049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc7150-5374-4d51-a07b-1a3e35e6d8cb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:31.944092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f937287-a528-4b91-ad05-03923ee73260 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:31.976184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95468cf1-3712-4f33-b0b7-e80182d607d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:31.977173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95468cf1-3712-4f33-b0b7-e80182d607d7 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:31.977454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95468cf1-3712-4f33-b0b7-e80182d607d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:31.977725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95468cf1-3712-4f33-b0b7-e80182d607d7 None admin] PATH_INFO: `/v3/groups/11295bb5c55a4e93bb7da477babc999c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:31.978887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95468cf1-3712-4f33-b0b7-e80182d607d7 None admin] RBAC: Authorizing `identity:get_group(group_id=11295bb5c55a4e93bb7da477babc999c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:31.980374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95468cf1-3712-4f33-b0b7-e80182d607d7 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:31.982476 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 208/408] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Jul 2 20:44:31 2022] GET /identity/v3/groups/11295bb5c55a4e93bb7da477babc999c => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:31.992539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95468cf1-3712-4f33-b0b7-e80182d607d7 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:32.028377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:32.101780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc7150-5374-4d51-a07b-1a3e35e6d8cb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:32.137855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cd563-8d35-480f-a027-fb44b986cc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:32.139023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cd563-8d35-480f-a027-fb44b986cc86 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:32.139552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cd563-8d35-480f-a027-fb44b986cc86 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:32.140020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cd563-8d35-480f-a027-fb44b986cc86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:32.151410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cd563-8d35-480f-a027-fb44b986cc86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:32.162496 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-b51cd563-8d35-480f-a027-fb44b986cc86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:44:32.162496 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:32.162496 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:32.162496 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:32.162496 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:32.162496 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:32.162496 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:32.162496 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:32.162496 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:32.162496 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:32.162496 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:32.162496 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:32.162496 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:32.162496 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:32.162496 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:32.162496 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:32.163419 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:32.163419 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:32.163419 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:32.163419 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:32.163419 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:32.163419 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:32.163419 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:32.163419 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:32.163419 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:32.163419 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:32.163419 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:32.163419 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:32.163419 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:32.163419 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:32.163419 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:32.163419 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:32.164275 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:32.164275 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:32.164275 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:32.164275 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:32.164275 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:32.164275 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:32.164275 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:32.164275 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:32.164275 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:32.164275 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:32.164275 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:44:32.164275 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:32.167148 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 201/409] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:44:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:32.173734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cd563-8d35-480f-a027-fb44b986cc86 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:32.240423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:32.286043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95468cf1-3712-4f33-b0b7-e80182d607d7 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:32.289291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cd563-8d35-480f-a027-fb44b986cc86 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:32.342276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675670f-0441-47da-98f2-206ea74a4119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:32.343382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b7715-4e0d-4a87-a303-0066cad6ef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:32.343789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675670f-0441-47da-98f2-206ea74a4119 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:32.344074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b7715-4e0d-4a87-a303-0066cad6ef6f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:32.344499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675670f-0441-47da-98f2-206ea74a4119 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:32.344975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675670f-0441-47da-98f2-206ea74a4119 None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:32.348447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b7715-4e0d-4a87-a303-0066cad6ef6f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:32.349277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675670f-0441-47da-98f2-206ea74a4119 None admin] RBAC: Authorizing `identity:get_project(project_id=850e1f68d7b14cafb6e5424ddbee9a91)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:32.349764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b7715-4e0d-4a87-a303-0066cad6ef6f None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:32.350709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b7715-4e0d-4a87-a303-0066cad6ef6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:32.352380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675670f-0441-47da-98f2-206ea74a4119 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:32.352893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b7715-4e0d-4a87-a303-0066cad6ef6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:32.354441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b7715-4e0d-4a87-a303-0066cad6ef6f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:32.356396 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 209/410] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:31 2022] GET /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91 => generated 302 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:32.362091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675670f-0441-47da-98f2-206ea74a4119 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:32.372761 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 202/411] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:32.389534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b7715-4e0d-4a87-a303-0066cad6ef6f None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:32.461690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:32.483304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675670f-0441-47da-98f2-206ea74a4119 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:32.524922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ed473-4010-4b9e-bb98-47fa34ea4062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:32.526165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ed473-4010-4b9e-bb98-47fa34ea4062 None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:32.526897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ed473-4010-4b9e-bb98-47fa34ea4062 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:32.527181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ed473-4010-4b9e-bb98-47fa34ea4062 None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91/groups/11295bb5c55a4e93bb7da477babc999c/roles/74cf644f6b8f49ce86fffcde317f8883` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:32.530250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ed473-4010-4b9e-bb98-47fa34ea4062 None admin] RBAC: Authorizing `identity:create_grant(project_id=850e1f68d7b14cafb6e5424ddbee9a91, group_id=11295bb5c55a4e93bb7da477babc999c, role_id=74cf644f6b8f49ce86fffcde317f8883)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:32.531710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ed473-4010-4b9e-bb98-47fa34ea4062 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:32.546357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b7715-4e0d-4a87-a303-0066cad6ef6f None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:32.548694 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 210/412] 10.222.0.43 () {58 vars in 1442 bytes} [Sat Jul 2 20:44:32 2022] PUT /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91/groups/11295bb5c55a4e93bb7da477babc999c/roles/74cf644f6b8f49ce86fffcde317f8883 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 20:44:32.550874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f63502-8e7c-4aff-bbb1-f6449ae24b5a None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:32.551465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f63502-8e7c-4aff-bbb1-f6449ae24b5a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:32.551744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f63502-8e7c-4aff-bbb1-f6449ae24b5a None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:32.553295 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 211/413] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:32.559116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429be93-ead9-41ba-9444-11b140664a00 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:32.559399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429be93-ead9-41ba-9444-11b140664a00 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:32.559673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429be93-ead9-41ba-9444-11b140664a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:32.561327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:32.578265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0429be93-ead9-41ba-9444-11b140664a00 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:32.579487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0429be93-ead9-41ba-9444-11b140664a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:32.588193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8e819-915a-40c2-a778-f1637abaea76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:32.589126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8e819-915a-40c2-a778-f1637abaea76 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:32.589405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8e819-915a-40c2-a778-f1637abaea76 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:32.589676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8e819-915a-40c2-a778-f1637abaea76 None admin] PATH_INFO: `/v3/groups/594a32b5e847486682e97e68ee836f44` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:32.590903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8e819-915a-40c2-a778-f1637abaea76 None admin] RBAC: Authorizing `identity:get_group(group_id=594a32b5e847486682e97e68ee836f44)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:32.592388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8e819-915a-40c2-a778-f1637abaea76 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:32.594414 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 203/414] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Jul 2 20:44:32 2022] GET /identity/v3/groups/594a32b5e847486682e97e68ee836f44 => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:32.601322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8e819-915a-40c2-a778-f1637abaea76 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:32.762478 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 212/415] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:32.782665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8e819-915a-40c2-a778-f1637abaea76 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:32.787518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429be93-ead9-41ba-9444-11b140664a00 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:32.825881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80083ed3-4458-420d-b313-ad750265eef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:32.826314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80083ed3-4458-420d-b313-ad750265eef3 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:32.826713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80083ed3-4458-420d-b313-ad750265eef3 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:32.827040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80083ed3-4458-420d-b313-ad750265eef3 None admin] PATH_INFO: `/v3/projects/d4c9de22f7474b6f9c2ca908dc6ecd1f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:32.828513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80083ed3-4458-420d-b313-ad750265eef3 None admin] RBAC: Authorizing `identity:get_project(project_id=d4c9de22f7474b6f9c2ca908dc6ecd1f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:32.830709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80083ed3-4458-420d-b313-ad750265eef3 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:32.834627 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 204/416] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:32 2022] GET /identity/v3/projects/d4c9de22f7474b6f9c2ca908dc6ecd1f => generated 344 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:32.840141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80083ed3-4458-420d-b313-ad750265eef3 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:32.929200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:32.960186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429be93-ead9-41ba-9444-11b140664a00 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:32.973424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:33.001960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9d44d-70f4-4e66-95c4-25ad910ed894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:33.002900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9d44d-70f4-4e66-95c4-25ad910ed894 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:33.003180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9d44d-70f4-4e66-95c4-25ad910ed894 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:33.003449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9d44d-70f4-4e66-95c4-25ad910ed894 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:33.016151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9d44d-70f4-4e66-95c4-25ad910ed894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:33.025834 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-1cf9d44d-70f4-4e66-95c4-25ad910ed894 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:33.025834 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:33.025834 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:33.025834 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:33.025834 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:33.025834 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:33.025834 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:33.025834 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:33.025834 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:33.025834 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:33.025834 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:33.025834 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:33.025834 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:33.025834 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:33.025834 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:33.025834 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:33.026761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:33.026761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:33.026761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:33.026761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:33.026761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:33.026761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:33.026761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:33.026761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:33.026761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:33.026761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:33.026761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:33.026761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:33.026761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:33.026761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:33.026761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:33.026761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:33.027584 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:33.027584 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:33.027584 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:33.027584 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:33.027584 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:33.027584 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:33.027584 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:33.027584 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:33.027584 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:33.027584 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:33.027584 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:33.027584 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:33.027584 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 213/417] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:33.035210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9d44d-70f4-4e66-95c4-25ad910ed894 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:33.108140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80083ed3-4458-420d-b313-ad750265eef3 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:33.149640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c59e99-7485-42f3-a6e2-c8903532466c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:33.151038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c59e99-7485-42f3-a6e2-c8903532466c None admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:33.151528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c59e99-7485-42f3-a6e2-c8903532466c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:33.151988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c59e99-7485-42f3-a6e2-c8903532466c None admin] PATH_INFO: `/v3/projects/d4c9de22f7474b6f9c2ca908dc6ecd1f/groups/594a32b5e847486682e97e68ee836f44/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:33.154582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c59e99-7485-42f3-a6e2-c8903532466c None admin] RBAC: Authorizing `identity:create_grant(project_id=d4c9de22f7474b6f9c2ca908dc6ecd1f, group_id=594a32b5e847486682e97e68ee836f44, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:33.156317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c59e99-7485-42f3-a6e2-c8903532466c None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:33.184466 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 205/418] 10.222.0.43 () {58 vars in 1442 bytes} [Sat Jul 2 20:44:32 2022] PUT /identity/v3/projects/d4c9de22f7474b6f9c2ca908dc6ecd1f/groups/594a32b5e847486682e97e68ee836f44/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:44:33.233208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9d44d-70f4-4e66-95c4-25ad910ed894 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:33.274350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c011082-3778-4fcb-9397-00398643f460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:33.275040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c011082-3778-4fcb-9397-00398643f460 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:33.275323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c011082-3778-4fcb-9397-00398643f460 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:33.275595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c011082-3778-4fcb-9397-00398643f460 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:33.276472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c011082-3778-4fcb-9397-00398643f460 None admin] RBAC: Adding query filter params (name=member) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:33.276788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c011082-3778-4fcb-9397-00398643f460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:33.278266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c011082-3778-4fcb-9397-00398643f460 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:33.280072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:33.291493 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 214/419] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:33.297328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c59e99-7485-42f3-a6e2-c8903532466c None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:33.413908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c59e99-7485-42f3-a6e2-c8903532466c None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:33.421473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:33.455244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c6154-a42e-439d-a2de-273a24b98dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:33.456286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c6154-a42e-439d-a2de-273a24b98dcb None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:33.456749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c6154-a42e-439d-a2de-273a24b98dcb None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:33.457223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c6154-a42e-439d-a2de-273a24b98dcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:33.530450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c6154-a42e-439d-a2de-273a24b98dcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:33.531924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c6154-a42e-439d-a2de-273a24b98dcb None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:33.551894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8c739-ac38-42ed-9ca2-a62c62399d41 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:33.552811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8c739-ac38-42ed-9ca2-a62c62399d41 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:33.553522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8c739-ac38-42ed-9ca2-a62c62399d41 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:33.555694 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 215/420] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:44:33.561458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232eee9-372a-4143-a920-9a78d0066e9c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:33.561818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232eee9-372a-4143-a920-9a78d0066e9c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:33.562158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232eee9-372a-4143-a920-9a78d0066e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:33.599944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8232eee9-372a-4143-a920-9a78d0066e9c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:33.602049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8232eee9-372a-4143-a920-9a78d0066e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:33.641814 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 206/421] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:33.647562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c6154-a42e-439d-a2de-273a24b98dcb None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:33.672418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:33.768814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c6154-a42e-439d-a2de-273a24b98dcb None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:33.810231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10277b32-5edb-49b9-b6bc-c1891429ab92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:33.811854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10277b32-5edb-49b9-b6bc-c1891429ab92 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:33.812160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10277b32-5edb-49b9-b6bc-c1891429ab92 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:33.812434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10277b32-5edb-49b9-b6bc-c1891429ab92 None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:33.816778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10277b32-5edb-49b9-b6bc-c1891429ab92 None admin] RBAC: Authorizing `identity:get_project(project_id=7b6fb712e361438587cb7af5e9fdce33)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:33.818849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10277b32-5edb-49b9-b6bc-c1891429ab92 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:33.820948 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 207/422] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:33 2022] GET /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:33.826468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10277b32-5edb-49b9-b6bc-c1891429ab92 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:33.847943 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 216/423] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:33.885288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232eee9-372a-4143-a920-9a78d0066e9c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:33.909295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:33.937826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10277b32-5edb-49b9-b6bc-c1891429ab92 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:33.983520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a7dcb-1fa9-4d5c-bd7b-42ca1ec855b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:33.984613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a7dcb-1fa9-4d5c-bd7b-42ca1ec855b4 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:33.984891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a7dcb-1fa9-4d5c-bd7b-42ca1ec855b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:33.985163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a7dcb-1fa9-4d5c-bd7b-42ca1ec855b4 None admin] PATH_INFO: `/v3/groups/11295bb5c55a4e93bb7da477babc999c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:33.989948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a7dcb-1fa9-4d5c-bd7b-42ca1ec855b4 None admin] RBAC: Authorizing `identity:get_group(group_id=11295bb5c55a4e93bb7da477babc999c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:33.991399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a7dcb-1fa9-4d5c-bd7b-42ca1ec855b4 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:33.993119 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 208/424] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Jul 2 20:44:33 2022] GET /identity/v3/groups/11295bb5c55a4e93bb7da477babc999c => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:34.002344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a7dcb-1fa9-4d5c-bd7b-42ca1ec855b4 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:34.117401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a7dcb-1fa9-4d5c-bd7b-42ca1ec855b4 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:34.130224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232eee9-372a-4143-a920-9a78d0066e9c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:34.160770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b912a9-274c-43b4-94a4-ae08f161bf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:34.161431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b912a9-274c-43b4-94a4-ae08f161bf18 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:34.161705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b912a9-274c-43b4-94a4-ae08f161bf18 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:34.161977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b912a9-274c-43b4-94a4-ae08f161bf18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:34.162810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b912a9-274c-43b4-94a4-ae08f161bf18 None admin] RBAC: Adding query filter params (group.id=11295bb5c55a4e93bb7da477babc999c, role.id=dd546359e98c4932adc5eef83b817e81, scope.project.id=7b6fb712e361438587cb7af5e9fdce33) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:34.163112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b912a9-274c-43b4-94a4-ae08f161bf18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:34.166503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b912a9-274c-43b4-94a4-ae08f161bf18 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:34.173306 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 209/425] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Jul 2 20:44:34 2022] GET /identity/v3/role_assignments?group.id=11295bb5c55a4e93bb7da477babc999c&scope.project.id=7b6fb712e361438587cb7af5e9fdce33&role.id=dd546359e98c4932adc5eef83b817e81 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:34.200299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:34.215032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb3300-e591-409d-b074-61bc5ed03651 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:34.215372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb3300-e591-409d-b074-61bc5ed03651 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:34.215598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb3300-e591-409d-b074-61bc5ed03651 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:34.221363 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 210/426] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:44:34.223413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b4131-f5ba-4cf8-9e8f-826b2bc3cd35 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:34.223706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b4131-f5ba-4cf8-9e8f-826b2bc3cd35 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:34.223987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b4131-f5ba-4cf8-9e8f-826b2bc3cd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:34.228840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226076fa-586f-466d-afeb-6f4fb316c94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:34.229678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226076fa-586f-466d-afeb-6f4fb316c94b None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:34.229960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226076fa-586f-466d-afeb-6f4fb316c94b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:34.230236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226076fa-586f-466d-afeb-6f4fb316c94b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:34.239439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:34.249898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f93b4131-f5ba-4cf8-9e8f-826b2bc3cd35 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:34.253712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f93b4131-f5ba-4cf8-9e8f-826b2bc3cd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:34.256836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226076fa-586f-466d-afeb-6f4fb316c94b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:34.265230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-226076fa-586f-466d-afeb-6f4fb316c94b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:34.265230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:34.265230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:34.265230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:34.265230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:34.265230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:34.265230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:34.265230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:34.265230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:34.265230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:34.265230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:34.265230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:34.265230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:34.265230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:34.265230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:34.265230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:34.266215 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:34.266215 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:34.266215 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:34.266215 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:34.266215 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:34.266215 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:34.266215 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:34.266215 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:34.266215 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:34.266215 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:34.266215 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:34.266215 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:34.266215 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:34.266215 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:34.266215 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:34.266215 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:34.267031 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:34.267031 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:34.267031 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:34.267031 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:34.267031 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:34.267031 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:34.267031 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:34.267031 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:34.267031 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:34.267031 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:34.267031 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:34.267031 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:34.267031 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 217/427] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:44:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:34.277791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226076fa-586f-466d-afeb-6f4fb316c94b None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:34.368345 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 211/428] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:34.406108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b4131-f5ba-4cf8-9e8f-826b2bc3cd35 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:34.439377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226076fa-586f-466d-afeb-6f4fb316c94b None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:34.484086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e131d-2296-42e3-b4e3-73e1898bd606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:34.484622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e131d-2296-42e3-b4e3-73e1898bd606 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:34.484876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e131d-2296-42e3-b4e3-73e1898bd606 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:34.485148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e131d-2296-42e3-b4e3-73e1898bd606 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:34.485962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e131d-2296-42e3-b4e3-73e1898bd606 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:34.486269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e131d-2296-42e3-b4e3-73e1898bd606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:34.488304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e131d-2296-42e3-b4e3-73e1898bd606 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:34.496995 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 218/429] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:34.502315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e131d-2296-42e3-b4e3-73e1898bd606 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:34.518567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b4131-f5ba-4cf8-9e8f-826b2bc3cd35 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:34.555334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4928c-3c8d-4030-b80d-0952387ae385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:34.556480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4928c-3c8d-4030-b80d-0952387ae385 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:34.556925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4928c-3c8d-4030-b80d-0952387ae385 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:34.557360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4928c-3c8d-4030-b80d-0952387ae385 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:34.560343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:34.561773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:34.571638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4928c-3c8d-4030-b80d-0952387ae385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:34.580221 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-7df4928c-3c8d-4030-b80d-0952387ae385 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:34.580221 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:34.580221 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:34.580221 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:34.580221 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:34.580221 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:34.580221 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:34.580221 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:34.580221 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:34.580221 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:34.580221 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:34.580221 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:34.580221 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:34.580221 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:34.580221 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:34.580221 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:34.581114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:34.581114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:34.581114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:34.581114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:34.581114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:34.581114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:34.581114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:34.581114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:34.581114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:34.581114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:34.581114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:34.581114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:34.581114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:34.581114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:34.581114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:34.581114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:34.581942 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:34.581942 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:34.581942 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:34.581942 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:34.581942 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:34.581942 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:34.581942 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:34.581942 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:34.581942 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:34.581942 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:34.581942 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:44:34.581942 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:34.584722 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 212/430] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:34.594461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4928c-3c8d-4030-b80d-0952387ae385 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:34.622176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e131d-2296-42e3-b4e3-73e1898bd606 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:34.670383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a7c57-8f05-4121-be9d-0e276b708b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:34.671786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a7c57-8f05-4121-be9d-0e276b708b80 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:34.672315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a7c57-8f05-4121-be9d-0e276b708b80 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:34.672790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a7c57-8f05-4121-be9d-0e276b708b80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:34.737788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4928c-3c8d-4030-b80d-0952387ae385 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:34.771083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a7c57-8f05-4121-be9d-0e276b708b80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:34.772596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a7c57-8f05-4121-be9d-0e276b708b80 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:34.788565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682bb85-9139-4b2a-bc0c-b35d351379e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:34.789913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682bb85-9139-4b2a-bc0c-b35d351379e3 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:34.790393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682bb85-9139-4b2a-bc0c-b35d351379e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:34.790903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682bb85-9139-4b2a-bc0c-b35d351379e3 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:34.792705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682bb85-9139-4b2a-bc0c-b35d351379e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:34.793219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682bb85-9139-4b2a-bc0c-b35d351379e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:34.795504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682bb85-9139-4b2a-bc0c-b35d351379e3 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:34.809884 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 213/431] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:44:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:34.816936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682bb85-9139-4b2a-bc0c-b35d351379e3 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:34.836277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:34.901024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:34.907993 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 219/432] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 20:44:34.910261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a7c57-8f05-4121-be9d-0e276b708b80 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:34.967098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682bb85-9139-4b2a-bc0c-b35d351379e3 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:35.013712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9575d7-901b-4828-9a48-561bf20bce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:35.014647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9575d7-901b-4828-9a48-561bf20bce77 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:35.015076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9575d7-901b-4828-9a48-561bf20bce77 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:35.015495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9575d7-901b-4828-9a48-561bf20bce77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:35.030643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a7c57-8f05-4121-be9d-0e276b708b80 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:35.105097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9575d7-901b-4828-9a48-561bf20bce77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:35.106841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9575d7-901b-4828-9a48-561bf20bce77 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:35.172641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:35.206398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1495b5a-9862-4fa1-a729-128dedbd2ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:35.207289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1495b5a-9862-4fa1-a729-128dedbd2ab5 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:35.207568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1495b5a-9862-4fa1-a729-128dedbd2ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:35.210006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1495b5a-9862-4fa1-a729-128dedbd2ab5 None admin] PATH_INFO: `/v3/projects/7b6fb712e361438587cb7af5e9fdce33` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:35.211553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1495b5a-9862-4fa1-a729-128dedbd2ab5 None admin] RBAC: Authorizing `identity:get_project(project_id=7b6fb712e361438587cb7af5e9fdce33)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:35.213193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1495b5a-9862-4fa1-a729-128dedbd2ab5 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:35.219856 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 220/433] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:34 2022] GET /identity/v3/projects/7b6fb712e361438587cb7af5e9fdce33 => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:35.221381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1495b5a-9862-4fa1-a729-128dedbd2ab5 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:35.224496 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 214/434] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 20:44:35.233287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9575d7-901b-4828-9a48-561bf20bce77 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:35.247999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:35.350364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1495b5a-9862-4fa1-a729-128dedbd2ab5 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:35.354593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9575d7-901b-4828-9a48-561bf20bce77 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:35.395114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494743a-d985-4af9-aabf-594690cd5773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:35.396491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494743a-d985-4af9-aabf-594690cd5773 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:35.396943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494743a-d985-4af9-aabf-594690cd5773 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:35.397055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc4ff9-eada-40fe-9d34-205eeb2cb542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:35.397532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494743a-d985-4af9-aabf-594690cd5773 None admin] PATH_INFO: `/v3/groups/11295bb5c55a4e93bb7da477babc999c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:35.398072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc4ff9-eada-40fe-9d34-205eeb2cb542 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:35.398429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc4ff9-eada-40fe-9d34-205eeb2cb542 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:35.398765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc4ff9-eada-40fe-9d34-205eeb2cb542 None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:35.399349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494743a-d985-4af9-aabf-594690cd5773 None admin] RBAC: Authorizing `identity:get_group(group_id=11295bb5c55a4e93bb7da477babc999c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:35.400139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc4ff9-eada-40fe-9d34-205eeb2cb542 None admin] RBAC: Authorizing `identity:get_project(project_id=850e1f68d7b14cafb6e5424ddbee9a91)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:35.401099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494743a-d985-4af9-aabf-594690cd5773 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:35.401707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc4ff9-eada-40fe-9d34-205eeb2cb542 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:35.403347 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 221/435] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Jul 2 20:44:35 2022] GET /identity/v3/groups/11295bb5c55a4e93bb7da477babc999c => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:35.412086 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 215/436] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:35 2022] GET /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:35.413349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494743a-d985-4af9-aabf-594690cd5773 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:35.414134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc4ff9-eada-40fe-9d34-205eeb2cb542 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:35.449038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:35.515642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:35.528262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc4ff9-eada-40fe-9d34-205eeb2cb542 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:35.528775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494743a-d985-4af9-aabf-594690cd5773 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:35.564720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc0767-39c2-401b-919b-cb3e83562745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:35.565161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772601a8-9e10-4589-87b9-f0a63060ef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:35.565533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc0767-39c2-401b-919b-cb3e83562745 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:35.565880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc0767-39c2-401b-919b-cb3e83562745 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:35.566024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772601a8-9e10-4589-87b9-f0a63060ef1c None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:35.566267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc0767-39c2-401b-919b-cb3e83562745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:35.566357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772601a8-9e10-4589-87b9-f0a63060ef1c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:35.566556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772601a8-9e10-4589-87b9-f0a63060ef1c None admin] PATH_INFO: `/v3/groups/11295bb5c55a4e93bb7da477babc999c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:35.567240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc0767-39c2-401b-919b-cb3e83562745 None admin] RBAC: Adding query filter params (group.id=11295bb5c55a4e93bb7da477babc999c, role.id=74cf644f6b8f49ce86fffcde317f8883, scope.project.id=7b6fb712e361438587cb7af5e9fdce33) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:35.567611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc0767-39c2-401b-919b-cb3e83562745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:35.567701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772601a8-9e10-4589-87b9-f0a63060ef1c None admin] RBAC: Authorizing `identity:get_group(group_id=11295bb5c55a4e93bb7da477babc999c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:35.569160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772601a8-9e10-4589-87b9-f0a63060ef1c None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:35.569251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc0767-39c2-401b-919b-cb3e83562745 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:35.575672 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 216/437] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Jul 2 20:44:35 2022] GET /identity/v3/groups/11295bb5c55a4e93bb7da477babc999c => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:35.575672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a9f08-fbf5-41a5-934d-d9bbcdb26633 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:35.575672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a9f08-fbf5-41a5-934d-d9bbcdb26633 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:35.575672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a9f08-fbf5-41a5-934d-d9bbcdb26633 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:35.575672 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 217/438] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:35.578817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a9f08-fbf5-41a5-934d-d9bbcdb26633 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:35.582488 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 222/439] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Jul 2 20:44:35 2022] GET /identity/v3/role_assignments?group.id=11295bb5c55a4e93bb7da477babc999c&scope.project.id=7b6fb712e361438587cb7af5e9fdce33&role.id=74cf644f6b8f49ce86fffcde317f8883 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:35.583788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec7e24-0090-499d-9844-552ecf4e43e8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:35.584113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec7e24-0090-499d-9844-552ecf4e43e8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:35.584391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec7e24-0090-499d-9844-552ecf4e43e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:35.602759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b6ec7e24-0090-499d-9844-552ecf4e43e8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:35.604166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b6ec7e24-0090-499d-9844-552ecf4e43e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:35.683576 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 223/440] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:35.709049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec7e24-0090-499d-9844-552ecf4e43e8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:35.728932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:35.744345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a9f08-fbf5-41a5-934d-d9bbcdb26633 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:35.796930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77280624-0441-452a-81ab-75d4a222b1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:35.797993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77280624-0441-452a-81ab-75d4a222b1f2 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:35.798276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77280624-0441-452a-81ab-75d4a222b1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:35.798551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77280624-0441-452a-81ab-75d4a222b1f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:35.799380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77280624-0441-452a-81ab-75d4a222b1f2 None admin] RBAC: Adding query filter params (group.id=11295bb5c55a4e93bb7da477babc999c, role.id=dd546359e98c4932adc5eef83b817e81, scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:35.799689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77280624-0441-452a-81ab-75d4a222b1f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:35.802710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77280624-0441-452a-81ab-75d4a222b1f2 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:35.807028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:35.810977 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 218/441] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Jul 2 20:44:35 2022] GET /identity/v3/role_assignments?group.id=11295bb5c55a4e93bb7da477babc999c&scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91&role.id=dd546359e98c4932adc5eef83b817e81 => generated 611 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:35.837334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec7e24-0090-499d-9844-552ecf4e43e8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:35.879785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25a87d-6b5c-4c37-b309-cd13e9d2b248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:35.880616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25a87d-6b5c-4c37-b309-cd13e9d2b248 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:35.880895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25a87d-6b5c-4c37-b309-cd13e9d2b248 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:35.881169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25a87d-6b5c-4c37-b309-cd13e9d2b248 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:35.894612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25a87d-6b5c-4c37-b309-cd13e9d2b248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:35.902995 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-8f25a87d-6b5c-4c37-b309-cd13e9d2b248 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:35.902995 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:35.902995 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:35.902995 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:35.902995 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:35.902995 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:35.902995 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:35.902995 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:35.902995 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:35.902995 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:35.902995 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:35.902995 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:35.902995 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:35.902995 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:35.902995 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:35.902995 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:35.903990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:35.903990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:35.903990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:35.903990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:35.903990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:35.903990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:35.903990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:35.903990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:35.903990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:35.903990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:35.903990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:35.903990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:35.903990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:35.903990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:35.903990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:35.903990 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:35.905048 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:35.905048 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:35.905048 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:35.905048 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:35.905048 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:35.905048 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:35.905048 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:35.905048 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:35.905048 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:35.905048 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:35.905048 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:35.905048 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:35.905048 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 224/442] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:44:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:35.913393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77280624-0441-452a-81ab-75d4a222b1f2 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:35.920136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0befd-06a1-49c4-a2a2-2d5eba77a9df None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:35.920687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0befd-06a1-49c4-a2a2-2d5eba77a9df None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:35.920687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0befd-06a1-49c4-a2a2-2d5eba77a9df None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:35.922289 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 225/443] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:35.931072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520b1e5-ebf4-41b0-8c21-eed03f53bf5d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:35.931365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520b1e5-ebf4-41b0-8c21-eed03f53bf5d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:35.931645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520b1e5-ebf4-41b0-8c21-eed03f53bf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:35.954381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9520b1e5-ebf4-41b0-8c21-eed03f53bf5d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:35.955618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9520b1e5-ebf4-41b0-8c21-eed03f53bf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:36.041696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77280624-0441-452a-81ab-75d4a222b1f2 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:36.045143 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 226/444] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:44:36.074572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520b1e5-ebf4-41b0-8c21-eed03f53bf5d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:36.090214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a23aba-28c1-4dbf-94a2-38d638c0e4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:36.091335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a23aba-28c1-4dbf-94a2-38d638c0e4ea None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:36.091622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a23aba-28c1-4dbf-94a2-38d638c0e4ea None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:36.091898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a23aba-28c1-4dbf-94a2-38d638c0e4ea None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:36.092992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a23aba-28c1-4dbf-94a2-38d638c0e4ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:36.093297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a23aba-28c1-4dbf-94a2-38d638c0e4ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:36.095724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a23aba-28c1-4dbf-94a2-38d638c0e4ea None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:36.104821 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 219/445] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:36.111155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a23aba-28c1-4dbf-94a2-38d638c0e4ea None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:36.136298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:36.164451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:36.206788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520b1e5-ebf4-41b0-8c21-eed03f53bf5d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:36.236574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a23aba-28c1-4dbf-94a2-38d638c0e4ea None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:36.246168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48550c-969c-4a3a-b781-c91fd1ec8b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:36.246974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48550c-969c-4a3a-b781-c91fd1ec8b53 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:36.247255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48550c-969c-4a3a-b781-c91fd1ec8b53 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:36.247531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48550c-969c-4a3a-b781-c91fd1ec8b53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:36.259604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48550c-969c-4a3a-b781-c91fd1ec8b53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:36.267375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-7c48550c-969c-4a3a-b781-c91fd1ec8b53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:44:36.267375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:36.267375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:36.267375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:36.267375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:36.267375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:36.267375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:36.267375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:36.267375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:36.267375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:36.267375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:36.267375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:36.267375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:36.267375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:36.267375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:36.267375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:36.268453 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:36.268453 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:36.268453 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:36.268453 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:36.268453 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:36.268453 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:36.268453 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:36.268453 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:36.268453 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:36.268453 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:36.268453 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:36.268453 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:36.268453 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:36.268453 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:36.268453 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:36.268453 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:36.269271 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:36.269271 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:36.269271 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:36.269271 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:36.269271 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:36.269271 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:36.269271 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:36.269271 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:36.269271 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:36.269271 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:36.269271 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:44:36.269271 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:36.269271 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 227/446] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:44:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:36.275606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48550c-969c-4a3a-b781-c91fd1ec8b53 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:36.279749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fb372-3a73-4ec2-9eb6-6fb1fd64b793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:36.280616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fb372-3a73-4ec2-9eb6-6fb1fd64b793 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:36.280894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fb372-3a73-4ec2-9eb6-6fb1fd64b793 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:36.281162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fb372-3a73-4ec2-9eb6-6fb1fd64b793 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:36.349394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fb372-3a73-4ec2-9eb6-6fb1fd64b793 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:36.350787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fb372-3a73-4ec2-9eb6-6fb1fd64b793 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:36.371637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48550c-969c-4a3a-b781-c91fd1ec8b53 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:36.373109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:36.397739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:36.406519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b670a8c-3d04-4204-b4a1-7811e165eb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:36.407232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b670a8c-3d04-4204-b4a1-7811e165eb18 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:36.407510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b670a8c-3d04-4204-b4a1-7811e165eb18 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:36.407785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b670a8c-3d04-4204-b4a1-7811e165eb18 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:36.408565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b670a8c-3d04-4204-b4a1-7811e165eb18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:36.408869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b670a8c-3d04-4204-b4a1-7811e165eb18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:36.410245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b670a8c-3d04-4204-b4a1-7811e165eb18 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:36.418615 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 228/447] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:36.424326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b670a8c-3d04-4204-b4a1-7811e165eb18 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:36.451202 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 220/448] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 20:44:36.456690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fb372-3a73-4ec2-9eb6-6fb1fd64b793 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:36.519666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b670a8c-3d04-4204-b4a1-7811e165eb18 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:36.552774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fb372-3a73-4ec2-9eb6-6fb1fd64b793 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:36.554264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed02a9d-33ec-4ecc-8a0f-cec39cf8c30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:36.554915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed02a9d-33ec-4ecc-8a0f-cec39cf8c30b None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:36.555197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed02a9d-33ec-4ecc-8a0f-cec39cf8c30b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:36.555473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed02a9d-33ec-4ecc-8a0f-cec39cf8c30b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:36.572670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:36.586228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41843ea6-cfa8-4abc-952f-28ab42584513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:36.587099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41843ea6-cfa8-4abc-952f-28ab42584513 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:36.587375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41843ea6-cfa8-4abc-952f-28ab42584513 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:36.587643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41843ea6-cfa8-4abc-952f-28ab42584513 None admin] PATH_INFO: `/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:36.588855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41843ea6-cfa8-4abc-952f-28ab42584513 None admin] RBAC: Authorizing `identity:get_project(project_id=850e1f68d7b14cafb6e5424ddbee9a91)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:36.590295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41843ea6-cfa8-4abc-952f-28ab42584513 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:36.591977 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 221/449] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:36 2022] GET /identity/v3/projects/850e1f68d7b14cafb6e5424ddbee9a91 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:36.597583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41843ea6-cfa8-4abc-952f-28ab42584513 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:36.612137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:36.622961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed02a9d-33ec-4ecc-8a0f-cec39cf8c30b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:36.624521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed02a9d-33ec-4ecc-8a0f-cec39cf8c30b None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:36.696547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41843ea6-cfa8-4abc-952f-28ab42584513 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:36.720293 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 229/450] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:36.725720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed02a9d-33ec-4ecc-8a0f-cec39cf8c30b None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:36.731214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf925d-5a08-4283-ae62-bb47c6e4e85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:36.732084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf925d-5a08-4283-ae62-bb47c6e4e85a None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:36.732375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf925d-5a08-4283-ae62-bb47c6e4e85a None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:36.732673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf925d-5a08-4283-ae62-bb47c6e4e85a None admin] PATH_INFO: `/v3/groups/11295bb5c55a4e93bb7da477babc999c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:36.734302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf925d-5a08-4283-ae62-bb47c6e4e85a None admin] RBAC: Authorizing `identity:get_group(group_id=11295bb5c55a4e93bb7da477babc999c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:36.735744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf925d-5a08-4283-ae62-bb47c6e4e85a None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:36.737672 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 222/451] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Jul 2 20:44:36 2022] GET /identity/v3/groups/11295bb5c55a4e93bb7da477babc999c => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:36.743288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf925d-5a08-4283-ae62-bb47c6e4e85a None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:36.807376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:36.815203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:36.824775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed02a9d-33ec-4ecc-8a0f-cec39cf8c30b None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:36.849390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf925d-5a08-4283-ae62-bb47c6e4e85a None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:36.858221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f8c77-61df-4511-9985-d93b1d4a48f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:36.859098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f8c77-61df-4511-9985-d93b1d4a48f8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:36.859374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f8c77-61df-4511-9985-d93b1d4a48f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:36.859645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f8c77-61df-4511-9985-d93b1d4a48f8 None admin] PATH_INFO: `/v3/projects/d4c9de22f7474b6f9c2ca908dc6ecd1f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:36.860852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f8c77-61df-4511-9985-d93b1d4a48f8 None admin] RBAC: Authorizing `identity:get_project(project_id=d4c9de22f7474b6f9c2ca908dc6ecd1f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:36.862353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f8c77-61df-4511-9985-d93b1d4a48f8 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:36.863978 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 230/452] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:44:36 2022] GET /identity/v3/projects/d4c9de22f7474b6f9c2ca908dc6ecd1f => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:36.869346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f8c77-61df-4511-9985-d93b1d4a48f8 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:36.884812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60bcbf-9cc0-45e7-93e1-8df32a038e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:36.885461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60bcbf-9cc0-45e7-93e1-8df32a038e9b None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:36.885740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60bcbf-9cc0-45e7-93e1-8df32a038e9b None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:36.886019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60bcbf-9cc0-45e7-93e1-8df32a038e9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:36.886837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60bcbf-9cc0-45e7-93e1-8df32a038e9b None admin] RBAC: Adding query filter params (group.id=11295bb5c55a4e93bb7da477babc999c, role.id=74cf644f6b8f49ce86fffcde317f8883, scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:36.887148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60bcbf-9cc0-45e7-93e1-8df32a038e9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:36.888627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60bcbf-9cc0-45e7-93e1-8df32a038e9b None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:36.894501 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 223/453] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Jul 2 20:44:36 2022] GET /identity/v3/role_assignments?group.id=11295bb5c55a4e93bb7da477babc999c&scope.project.id=850e1f68d7b14cafb6e5424ddbee9a91&role.id=74cf644f6b8f49ce86fffcde317f8883 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:36.981315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f8c77-61df-4511-9985-d93b1d4a48f8 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:37.019148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10edf72-a156-4d0d-bc5c-87abd2f2e14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:37.020009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10edf72-a156-4d0d-bc5c-87abd2f2e14c None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:37.020323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10edf72-a156-4d0d-bc5c-87abd2f2e14c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:37.020588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10edf72-a156-4d0d-bc5c-87abd2f2e14c None admin] PATH_INFO: `/v3/groups/594a32b5e847486682e97e68ee836f44` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:37.021769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10edf72-a156-4d0d-bc5c-87abd2f2e14c None admin] RBAC: Authorizing `identity:get_group(group_id=594a32b5e847486682e97e68ee836f44)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:37.023220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10edf72-a156-4d0d-bc5c-87abd2f2e14c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:37.024916 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 231/454] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Jul 2 20:44:36 2022] GET /identity/v3/groups/594a32b5e847486682e97e68ee836f44 => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:37.031094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60bcbf-9cc0-45e7-93e1-8df32a038e9b None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:37.139305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60bcbf-9cc0-45e7-93e1-8df32a038e9b None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:37.159793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:37.174234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c343614-f281-4e54-9fc3-f016bd1414ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:37.174883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c343614-f281-4e54-9fc3-f016bd1414ac None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:37.175165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c343614-f281-4e54-9fc3-f016bd1414ac None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:37.175434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c343614-f281-4e54-9fc3-f016bd1414ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:37.176612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c343614-f281-4e54-9fc3-f016bd1414ac None admin] RBAC: Adding query filter params (group.id=594a32b5e847486682e97e68ee836f44, role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.project.id=d4c9de22f7474b6f9c2ca908dc6ecd1f) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:37.176917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c343614-f281-4e54-9fc3-f016bd1414ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:37.178353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c343614-f281-4e54-9fc3-f016bd1414ac None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:37.184456 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 224/455] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Jul 2 20:44:37 2022] GET /identity/v3/role_assignments?group.id=594a32b5e847486682e97e68ee836f44&scope.project.id=d4c9de22f7474b6f9c2ca908dc6ecd1f&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:39.861224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29ee1a-1576-4d95-90a2-1af3c401f24b None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:39.861754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29ee1a-1576-4d95-90a2-1af3c401f24b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:39.861754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29ee1a-1576-4d95-90a2-1af3c401f24b None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:39.863550 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 232/456] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:39.877706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794e971-e4bc-4c34-8d0c-bd8b7ae49bf3 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:39.878282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794e971-e4bc-4c34-8d0c-bd8b7ae49bf3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:39.878282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794e971-e4bc-4c34-8d0c-bd8b7ae49bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:39.908588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4794e971-e4bc-4c34-8d0c-bd8b7ae49bf3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:39.909824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4794e971-e4bc-4c34-8d0c-bd8b7ae49bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:40.002356 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 225/457] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:40.052266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29ee1a-1576-4d95-90a2-1af3c401f24b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:40.088778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:40.156435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ccab3-afd8-44cc-b67a-dd9e068919bc None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:40.156721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ccab3-afd8-44cc-b67a-dd9e068919bc None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:40.157163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ccab3-afd8-44cc-b67a-dd9e068919bc None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:40.159685 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 226/458] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:44:40.165513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e1f69-b1f5-4e32-a360-bba06a385c87 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:40.165985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e1f69-b1f5-4e32-a360-bba06a385c87 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:40.166404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e1f69-b1f5-4e32-a360-bba06a385c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:40.188901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29ee1a-1576-4d95-90a2-1af3c401f24b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:40.200582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e12e1f69-b1f5-4e32-a360-bba06a385c87 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:40.201820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e12e1f69-b1f5-4e32-a360-bba06a385c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:40.252159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a67815-c834-412a-9fda-92bc2019e7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:40.252966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a67815-c834-412a-9fda-92bc2019e7f5 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:40.253242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a67815-c834-412a-9fda-92bc2019e7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:40.253520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a67815-c834-412a-9fda-92bc2019e7f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:40.269675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a67815-c834-412a-9fda-92bc2019e7f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:40.271358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a67815-c834-412a-9fda-92bc2019e7f5 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:40.290299 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-87a67815-c834-412a-9fda-92bc2019e7f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:40.290299 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:40.290299 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:40.290299 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:40.290299 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:40.290299 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:40.290299 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:40.290299 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:40.290299 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:40.290299 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:40.290299 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:40.290299 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:40.290299 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:40.290299 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:40.290299 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:40.291410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:40.291410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:40.291410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:40.291410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:40.291410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:40.291410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:40.291410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:40.291410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:40.291410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:40.291410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:40.291410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:40.291410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:40.291410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:40.291410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:40.291410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:40.291410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:40.291410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:40.292529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:40.292529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:40.292529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:40.292529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:40.294130 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 233/459] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:40.295731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e99dc-1a67-4b16-9129-d1f243f679b7 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:40.296239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e99dc-1a67-4b16-9129-d1f243f679b7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:40.296686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e99dc-1a67-4b16-9129-d1f243f679b7 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:40.298520 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 234/460] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:40.300375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e99dc-1a67-4b16-9129-d1f243f679b7 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:40.303315 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 227/461] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:44:40.307805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7781fe-7ad6-4b9a-a35a-9798cdf0cfcf None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:40.308133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7781fe-7ad6-4b9a-a35a-9798cdf0cfcf None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:40.308416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7781fe-7ad6-4b9a-a35a-9798cdf0cfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:40.335300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5e7781fe-7ad6-4b9a-a35a-9798cdf0cfcf None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:40.336643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5e7781fe-7ad6-4b9a-a35a-9798cdf0cfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:40.392400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:40.398673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:40.414608 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 228/462] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:44:40.415439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7781fe-7ad6-4b9a-a35a-9798cdf0cfcf None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:40.444819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e99dc-1a67-4b16-9129-d1f243f679b7 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:40.489291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17230ef3-d20b-4014-8e98-2809e5374ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:40.489990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17230ef3-d20b-4014-8e98-2809e5374ba5 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:40.490274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17230ef3-d20b-4014-8e98-2809e5374ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:40.490650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17230ef3-d20b-4014-8e98-2809e5374ba5 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:40.491373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17230ef3-d20b-4014-8e98-2809e5374ba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:40.491682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17230ef3-d20b-4014-8e98-2809e5374ba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:40.493192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17230ef3-d20b-4014-8e98-2809e5374ba5 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:40.515316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7781fe-7ad6-4b9a-a35a-9798cdf0cfcf None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:40.516913 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 235/463] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:40.517947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17230ef3-d20b-4014-8e98-2809e5374ba5 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:40.549679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3305d-018d-4149-85de-d5b318d2f2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:40.550469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3305d-018d-4149-85de-d5b318d2f2cd None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:40.551060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3305d-018d-4149-85de-d5b318d2f2cd None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:40.551346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3305d-018d-4149-85de-d5b318d2f2cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:40.561735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3305d-018d-4149-85de-d5b318d2f2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:40.563199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3305d-018d-4149-85de-d5b318d2f2cd None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:40.581340 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-4ab3305d-018d-4149-85de-d5b318d2f2cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:40.581340 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:40.581340 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:40.581340 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:40.581340 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:40.581340 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:40.581340 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:40.581340 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:40.581340 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:40.581340 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:40.581340 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:40.581340 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:40.581340 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:40.581340 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:40.581340 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:40.582345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:40.582345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:40.582345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:40.582345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:40.582345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:40.582345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:40.582345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:40.582345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:40.582345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:40.582345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:40.582345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:40.582345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:40.582345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:40.582345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:40.582345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:40.582345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:40.582345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:40.583232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:40.583232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:40.583232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:40.583232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:40.583232 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 229/464] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:40.583993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3305d-018d-4149-85de-d5b318d2f2cd None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:40.618761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:40.635528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17230ef3-d20b-4014-8e98-2809e5374ba5 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:40.672400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea838a-930d-4440-9d32-688ada8b68ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:40.673223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea838a-930d-4440-9d32-688ada8b68ae None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:40.673512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea838a-930d-4440-9d32-688ada8b68ae None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:40.673789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea838a-930d-4440-9d32-688ada8b68ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:40.681342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:40.687376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea838a-930d-4440-9d32-688ada8b68ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:40.689041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea838a-930d-4440-9d32-688ada8b68ae None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:40.691034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3305d-018d-4149-85de-d5b318d2f2cd None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:40.708348 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-19ea838a-930d-4440-9d32-688ada8b68ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:40.708348 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:40.708348 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:40.708348 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:40.708348 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:40.708348 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:40.708348 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:40.708348 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:40.708348 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:40.708348 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:40.708348 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:40.708348 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:40.708348 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:40.708348 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:40.708348 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:40.710659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:40.710659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:40.710659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:40.710659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:40.710659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:40.710659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:40.710659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:40.710659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:40.710659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:40.710659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:40.710659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:40.710659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:40.710659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:40.710659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:40.710659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:40.710659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:40.710659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:40.712811 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:40.712811 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:40.712811 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:40.712811 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:40.712811 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 236/465] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:40.717405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea838a-930d-4440-9d32-688ada8b68ae None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:40.724942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39048b8e-e953-49f0-8e43-1cf8f25c4be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:40.725606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39048b8e-e953-49f0-8e43-1cf8f25c4be0 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:40.725881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39048b8e-e953-49f0-8e43-1cf8f25c4be0 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:40.726146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39048b8e-e953-49f0-8e43-1cf8f25c4be0 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:40.726848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39048b8e-e953-49f0-8e43-1cf8f25c4be0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:40.728320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39048b8e-e953-49f0-8e43-1cf8f25c4be0 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:40.761665 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 230/466] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Jul 2 20:44:40 2022] POST /identity/v3/users => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:44:40.762693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39048b8e-e953-49f0-8e43-1cf8f25c4be0 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:40.845591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea838a-930d-4440-9d32-688ada8b68ae None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:40.892762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e1ac7-261b-4e29-b164-805a9f4ac0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:40.894822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e1ac7-261b-4e29-b164-805a9f4ac0ef None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:40.895329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e1ac7-261b-4e29-b164-805a9f4ac0ef None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:40.895779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e1ac7-261b-4e29-b164-805a9f4ac0ef None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:40.897220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e1ac7-261b-4e29-b164-805a9f4ac0ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:40.897698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e1ac7-261b-4e29-b164-805a9f4ac0ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:40.900053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e1ac7-261b-4e29-b164-805a9f4ac0ef None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:40.917899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:40.921748 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 237/467] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:40.925028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a185c9-e982-47e3-839c-060622810ae9 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:40.926036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a185c9-e982-47e3-839c-060622810ae9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:40.926497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a185c9-e982-47e3-839c-060622810ae9 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:40.927859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39048b8e-e953-49f0-8e43-1cf8f25c4be0 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:40.928680 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 238/468] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:40.929619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a185c9-e982-47e3-839c-060622810ae9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:40.984680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d5e8e-f96c-4c46-b8ff-f967f5da09de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:40.985763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d5e8e-f96c-4c46-b8ff-f967f5da09de None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:40.987028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d5e8e-f96c-4c46-b8ff-f967f5da09de None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:40.988191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d5e8e-f96c-4c46-b8ff-f967f5da09de None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:40.989056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d5e8e-f96c-4c46-b8ff-f967f5da09de None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:40.989457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d5e8e-f96c-4c46-b8ff-f967f5da09de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:40.990961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d5e8e-f96c-4c46-b8ff-f967f5da09de None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:41.005739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:41.009755 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 231/469] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:41.011055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677f19d-8b1f-4d00-9dd2-b25bd7068bc3 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:41.011342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677f19d-8b1f-4d00-9dd2-b25bd7068bc3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:41.011618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677f19d-8b1f-4d00-9dd2-b25bd7068bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:41.031033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a677f19d-8b1f-4d00-9dd2-b25bd7068bc3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:41.032280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a677f19d-8b1f-4d00-9dd2-b25bd7068bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:41.073048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a185c9-e982-47e3-839c-060622810ae9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:41.119200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4ff52-e979-42a7-bb65-d8b421cabd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:41.119968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4ff52-e979-42a7-bb65-d8b421cabd77 None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:41.120346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4ff52-e979-42a7-bb65-d8b421cabd77 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:41.120717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4ff52-e979-42a7-bb65-d8b421cabd77 None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:41.121523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4ff52-e979-42a7-bb65-d8b421cabd77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:41.123156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4ff52-e979-42a7-bb65-d8b421cabd77 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:41.125304 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 232/470] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:41.126145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677f19d-8b1f-4d00-9dd2-b25bd7068bc3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:41.170497 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 239/471] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Jul 2 20:44:40 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:44:41.171743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4ff52-e979-42a7-bb65-d8b421cabd77 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:41.207330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:41.244726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677f19d-8b1f-4d00-9dd2-b25bd7068bc3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:41.285127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537f99d-e449-4241-8776-3f9b96a22f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:41.285886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537f99d-e449-4241-8776-3f9b96a22f44 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:41.286170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537f99d-e449-4241-8776-3f9b96a22f44 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:41.286449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537f99d-e449-4241-8776-3f9b96a22f44 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:41.287209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537f99d-e449-4241-8776-3f9b96a22f44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:41.288711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537f99d-e449-4241-8776-3f9b96a22f44 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:41.312451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4ff52-e979-42a7-bb65-d8b421cabd77 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:41.316763 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 233/472] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Jul 2 20:44:41 2022] POST /identity/v3/users => generated 248 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:44:41.321136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:41.366191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8f205-8da5-49a2-97ec-368354335815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:41.367080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8f205-8da5-49a2-97ec-368354335815 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:41.367359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8f205-8da5-49a2-97ec-368354335815 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:41.367687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8f205-8da5-49a2-97ec-368354335815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:41.382912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8f205-8da5-49a2-97ec-368354335815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:41.384484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8f205-8da5-49a2-97ec-368354335815 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:41.412321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-69b8f205-8da5-49a2-97ec-368354335815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:41.412321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:41.412321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:41.412321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:41.412321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:41.412321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:41.412321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:41.412321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:41.412321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:41.412321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:41.412321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:41.412321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:41.412321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:41.412321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:41.412321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:41.413294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:41.413294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:41.413294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:41.413294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:41.413294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:41.413294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:41.413294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:41.413294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:41.413294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:41.413294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:41.413294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:41.413294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:41.413294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:41.413294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:41.413294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:41.413294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:41.413294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:41.414180 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:41.414180 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:41.414180 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:41.414180 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:41.414180 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 240/473] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:41.420211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537f99d-e449-4241-8776-3f9b96a22f44 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:41.558795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537f99d-e449-4241-8776-3f9b96a22f44 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:41.591818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:41.596201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1586dca-5492-4d0d-b397-4ac72b78f6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:41.596885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1586dca-5492-4d0d-b397-4ac72b78f6ad None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:41.598034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1586dca-5492-4d0d-b397-4ac72b78f6ad None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:41.598322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1586dca-5492-4d0d-b397-4ac72b78f6ad None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:41.600474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1586dca-5492-4d0d-b397-4ac72b78f6ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:41.600784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1586dca-5492-4d0d-b397-4ac72b78f6ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:41.602181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1586dca-5492-4d0d-b397-4ac72b78f6ad None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:41.615311 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 234/474] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:41.620888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8f205-8da5-49a2-97ec-368354335815 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:41.737726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8f205-8da5-49a2-97ec-368354335815 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:41.780906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0381f63-2fcf-41c2-9920-332789643a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:41.781944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0381f63-2fcf-41c2-9920-332789643a0f None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:41.782050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce887e03-aea5-41ec-b08d-804685c849dc None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:41.782294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce887e03-aea5-41ec-b08d-804685c849dc None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:41.782578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce887e03-aea5-41ec-b08d-804685c849dc None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:41.782938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0381f63-2fcf-41c2-9920-332789643a0f None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:41.783396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0381f63-2fcf-41c2-9920-332789643a0f None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:41.784327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0381f63-2fcf-41c2-9920-332789643a0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:41.785973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0381f63-2fcf-41c2-9920-332789643a0f None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:41.792086 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 235/475] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:41.792086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b3e8e-5c51-4699-a4bb-d34a11612f80 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:41.792086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b3e8e-5c51-4699-a4bb-d34a11612f80 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:41.792086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b3e8e-5c51-4699-a4bb-d34a11612f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:41.807127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-703b3e8e-5c51-4699-a4bb-d34a11612f80 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:41.808681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-703b3e8e-5c51-4699-a4bb-d34a11612f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:41.816922 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 241/476] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Jul 2 20:44:41 2022] POST /identity/v3/users => generated 249 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:44:41.911265 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 236/477] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:41.952993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0381f63-2fcf-41c2-9920-332789643a0f None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:41.977629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:42.098159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0381f63-2fcf-41c2-9920-332789643a0f None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:42.138949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44ed44-1c94-4c4c-a923-dcb68eda511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:42.139624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44ed44-1c94-4c4c-a923-dcb68eda511c None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:42.139903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44ed44-1c94-4c4c-a923-dcb68eda511c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:42.140210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44ed44-1c94-4c4c-a923-dcb68eda511c None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:42.140967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44ed44-1c94-4c4c-a923-dcb68eda511c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:42.142357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44ed44-1c94-4c4c-a923-dcb68eda511c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:42.150294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.sql.core [None req-7b44ed44-1c94-4c4c-a923-dcb68eda511c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 02 20:44:42.150294 ncdv-master-1 devstack@keystone.service[91078]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 02 20:44:42.150294 ncdv-master-1 devstack@keystone.service[91078]: [parameters: {'id': '2ec3211644714a2d830efd7fa317a474', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 02 20:44:42.150294 ncdv-master-1 devstack@keystone.service[91078]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91078) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 02 20:44:42.166725 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-7b44ed44-1c94-4c4c-a923-dcb68eda511c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 02 20:44:42.166725 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:42.166725 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 20:44:42.166725 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 20:44:42.166725 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 20:44:42.166725 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 20:44:42.166725 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 20:44:42.166725 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 20:44:42.166725 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 20:44:42.166725 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application conn.query(q) Jul 02 20:44:42.166725 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 20:44:42.166725 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 20:44:42.166725 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 20:44:42.166725 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application result.read() Jul 02 20:44:42.166725 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 20:44:42.167645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 20:44:42.167645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 20:44:42.167645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 20:44:42.167645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 20:44:42.167645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 20:44:42.167645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 20:44:42.167645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 20:44:42.167645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 02 20:44:42.167645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:42.167645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 02 20:44:42.167645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:42.167645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:42.167645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 02 20:44:42.167645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 02 20:44:42.167645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 02 20:44:42.167645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return ref.to_dict() Jul 02 20:44:42.167645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 20:44:42.167645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application next(self.gen) Jul 02 20:44:42.168761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 02 20:44:42.168761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application yield resource Jul 02 20:44:42.168761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 20:44:42.168761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application next(self.gen) Jul 02 20:44:42.168761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 02 20:44:42.168761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.session.rollback() Jul 02 20:44:42.168761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 20:44:42.168761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.force_reraise() Jul 02 20:44:42.168761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 20:44:42.168761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise self.value Jul 02 20:44:42.168761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 02 20:44:42.168761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 02 20:44:42.168761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 02 20:44:42.168761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application session.commit() Jul 02 20:44:42.168761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 02 20:44:42.168761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 02 20:44:42.168761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 02 20:44:42.169864 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._prepare_impl() Jul 02 20:44:42.169864 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 02 20:44:42.169864 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.session.flush() Jul 02 20:44:42.169864 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 02 20:44:42.169864 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._flush(objects) Jul 02 20:44:42.169864 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 02 20:44:42.169864 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 02 20:44:42.169864 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 02 20:44:42.169864 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application compat.raise_( Jul 02 20:44:42.169864 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 20:44:42.169864 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception Jul 02 20:44:42.169864 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 02 20:44:42.169864 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application flush_context.execute() Jul 02 20:44:42.169864 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 02 20:44:42.169864 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rec.execute(self) Jul 02 20:44:42.169864 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 02 20:44:42.169864 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 02 20:44:42.170766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 02 20:44:42.170766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 02 20:44:42.170766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 02 20:44:42.170766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 02 20:44:42.170766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 02 20:44:42.170766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 02 20:44:42.170766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 02 20:44:42.170766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 02 20:44:42.170766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 02 20:44:42.170766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 02 20:44:42.170766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 02 20:44:42.170766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 02 20:44:42.170766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 02 20:44:42.170766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 02 20:44:42.170766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 20:44:42.170766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception Jul 02 20:44:42.171683 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 20:44:42.171683 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 20:44:42.171683 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 20:44:42.171683 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 20:44:42.171683 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 20:44:42.171683 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 20:44:42.171683 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 20:44:42.171683 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application conn.query(q) Jul 02 20:44:42.171683 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 20:44:42.171683 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 20:44:42.171683 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 20:44:42.171683 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application result.read() Jul 02 20:44:42.171683 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 20:44:42.171683 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 20:44:42.171683 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 20:44:42.171683 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 20:44:42.172535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 20:44:42.172535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 20:44:42.172535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 20:44:42.172535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 20:44:42.172535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 02 20:44:42.172535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 02 20:44:42.172535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [parameters: {'id': '2ec3211644714a2d830efd7fa317a474', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 02 20:44:42.172535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 02 20:44:42.172535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:42.172535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:44:42.172535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:42.172535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:42.172535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:42.172535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:42.172535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:42.172535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:42.175026 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:42.175026 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:42.175026 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:42.175026 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:42.175026 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:42.175026 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:42.175026 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 02 20:44:42.175026 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 02 20:44:42.175026 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:42.175026 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:42.175026 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 02 20:44:42.175026 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 02 20:44:42.175026 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 02 20:44:42.175026 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 02 20:44:42.175026 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 02 20:44:42.175026 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:42.177229 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 242/478] 10.222.0.43 () {60 vars in 1131 bytes} [Sat Jul 2 20:44:41 2022] POST /identity/v3/roles => generated 144 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:42.177366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b3e8e-5c51-4699-a4bb-d34a11612f80 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:42.294496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b3e8e-5c51-4699-a4bb-d34a11612f80 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:42.313761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:42.332470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fca415-ed49-4bd8-b068-2e109b1cee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:42.333563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fca415-ed49-4bd8-b068-2e109b1cee23 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:42.334040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fca415-ed49-4bd8-b068-2e109b1cee23 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:42.334478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fca415-ed49-4bd8-b068-2e109b1cee23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:42.345175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fca415-ed49-4bd8-b068-2e109b1cee23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:42.354484 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-41fca415-ed49-4bd8-b068-2e109b1cee23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:42.354484 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:42.354484 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:42.354484 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:42.354484 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:42.354484 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:42.354484 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:42.354484 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:42.354484 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:42.354484 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:42.354484 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:42.354484 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:42.354484 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:42.354484 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:42.354484 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:42.354484 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:42.355427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:42.355427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:42.355427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:42.355427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:42.355427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:42.355427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:42.355427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:42.355427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:42.355427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:42.355427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:42.355427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:42.355427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:42.355427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:42.355427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:42.355427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:42.355427 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:42.356291 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:42.356291 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:42.356291 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:42.356291 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:42.356291 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:42.356291 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:42.356291 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:42.356291 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:42.356291 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:42.356291 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:42.356291 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:44:42.356291 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:42.358709 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 237/479] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:44:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:42.364007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44ed44-1c94-4c4c-a923-dcb68eda511c None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:42.452400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:42.471867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44ed44-1c94-4c4c-a923-dcb68eda511c None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:42.512275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e44de-81c5-4e08-80c7-97faf84a62f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:42.512966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e44de-81c5-4e08-80c7-97faf84a62f3 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:42.513248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e44de-81c5-4e08-80c7-97faf84a62f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:42.513553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e44de-81c5-4e08-80c7-97faf84a62f3 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:42.514302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e44de-81c5-4e08-80c7-97faf84a62f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:42.514606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e44de-81c5-4e08-80c7-97faf84a62f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:42.516006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e44de-81c5-4e08-80c7-97faf84a62f3 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:42.527613 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 243/480] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:43.452214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cffe7-b4fa-43ec-b176-1d9f6af1f7ff None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:43.452738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cffe7-b4fa-43ec-b176-1d9f6af1f7ff None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:43.452738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cffe7-b4fa-43ec-b176-1d9f6af1f7ff None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:43.454120 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 238/481] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:43.459526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfe344-0ba5-4a66-b930-6ba43323aa92 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:43.459920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfe344-0ba5-4a66-b930-6ba43323aa92 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:43.460106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfe344-0ba5-4a66-b930-6ba43323aa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:43.485423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9bcfe344-0ba5-4a66-b930-6ba43323aa92 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:43.486624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9bcfe344-0ba5-4a66-b930-6ba43323aa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:43.581015 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 244/482] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:44:43.622683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cffe7-b4fa-43ec-b176-1d9f6af1f7ff None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:43.746557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cffe7-b4fa-43ec-b176-1d9f6af1f7ff None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:43.782901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aead6-de06-4b13-a778-4256efc2f12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:43.783707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aead6-de06-4b13-a778-4256efc2f12f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:43.783990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aead6-de06-4b13-a778-4256efc2f12f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:43.784301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aead6-de06-4b13-a778-4256efc2f12f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:43.795236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226aead6-de06-4b13-a778-4256efc2f12f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:43.803400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-226aead6-de06-4b13-a778-4256efc2f12f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:43.803400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:43.803400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:43.803400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:43.803400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:43.803400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:43.803400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:43.803400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:43.803400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:43.803400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:43.803400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:43.803400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:43.803400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:43.803400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:43.803400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:43.803400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:43.804319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:43.804319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:43.804319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:43.804319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:43.804319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:43.804319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:43.804319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:43.804319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:43.804319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:43.804319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:43.804319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:43.804319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:43.804319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:43.804319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:43.804319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:43.804319 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:43.805556 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:43.805556 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:43.805556 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:43.805556 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:43.805556 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:43.805556 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:43.805556 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:43.805556 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:43.805556 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:43.805556 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:43.805556 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:43.805556 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:43.805556 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 239/483] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:44:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:43.810850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfe344-0ba5-4a66-b930-6ba43323aa92 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:43.891626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:43.939129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfe344-0ba5-4a66-b930-6ba43323aa92 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:43.983580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec019b-d9b1-48e1-aa2c-0d019c3f246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:43.984289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec019b-d9b1-48e1-aa2c-0d019c3f246f None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:43.984622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec019b-d9b1-48e1-aa2c-0d019c3f246f None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:43.984903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec019b-d9b1-48e1-aa2c-0d019c3f246f None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:43.985645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec019b-d9b1-48e1-aa2c-0d019c3f246f None admin] RBAC: Adding query filter params (name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:43.985953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec019b-d9b1-48e1-aa2c-0d019c3f246f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:43.987333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec019b-d9b1-48e1-aa2c-0d019c3f246f None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:43.999810 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 245/484] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:44:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:44.005386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aead6-de06-4b13-a778-4256efc2f12f None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:44.057634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:44.159790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aead6-de06-4b13-a778-4256efc2f12f None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:44.204700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e506572-e7b3-4632-96a0-7fbf80aa8ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:44.205500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e506572-e7b3-4632-96a0-7fbf80aa8ae5 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:44.205780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e506572-e7b3-4632-96a0-7fbf80aa8ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:44.206053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e506572-e7b3-4632-96a0-7fbf80aa8ae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:44.220140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e506572-e7b3-4632-96a0-7fbf80aa8ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:44.221615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e506572-e7b3-4632-96a0-7fbf80aa8ae5 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:44.244453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-9e506572-e7b3-4632-96a0-7fbf80aa8ae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:44.244453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:44.244453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:44.244453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:44.244453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:44.244453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:44.244453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:44.244453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:44.244453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:44.244453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:44.244453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:44.244453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:44.244453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:44.244453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:44.244453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:44.245396 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:44.245396 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:44.245396 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:44.245396 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:44.245396 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:44.245396 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:44.245396 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:44.245396 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:44.245396 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:44.245396 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:44.245396 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:44.245396 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:44.245396 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:44.245396 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:44.245396 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:44.245396 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:44.245396 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:44.246282 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:44.246282 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:44.246282 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:44.246282 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:44.248399 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 240/485] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:44.251381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd5776-baac-407e-8d53-afda3968b992 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:44.251381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd5776-baac-407e-8d53-afda3968b992 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:44.251381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd5776-baac-407e-8d53-afda3968b992 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:44.251381 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 246/486] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:44.258195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd5776-baac-407e-8d53-afda3968b992 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:44.263041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a487e68-484c-44e5-8625-19fb42cdfca5 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:44.263387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a487e68-484c-44e5-8625-19fb42cdfca5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:44.263659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a487e68-484c-44e5-8625-19fb42cdfca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:44.283247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6a487e68-484c-44e5-8625-19fb42cdfca5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:44.284488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6a487e68-484c-44e5-8625-19fb42cdfca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:44.416772 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 241/487] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:44:44.440196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd5776-baac-407e-8d53-afda3968b992 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:44.456469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a487e68-484c-44e5-8625-19fb42cdfca5 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:44.487571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:44.498380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:44.507871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a14950-9705-4a5c-849d-e530255aa6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:44.508507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a14950-9705-4a5c-849d-e530255aa6f6 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:44.508793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a14950-9705-4a5c-849d-e530255aa6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:44.509067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a14950-9705-4a5c-849d-e530255aa6f6 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:44.509789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a14950-9705-4a5c-849d-e530255aa6f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:44.510096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a14950-9705-4a5c-849d-e530255aa6f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:44.512326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a14950-9705-4a5c-849d-e530255aa6f6 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:44.538367 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 247/488] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:44.544547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a14950-9705-4a5c-849d-e530255aa6f6 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:44.643327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a487e68-484c-44e5-8625-19fb42cdfca5 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:44.680163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a14950-9705-4a5c-849d-e530255aa6f6 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:44.693801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdc061-76b6-43b2-a57f-522a806465fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:44.694604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdc061-76b6-43b2-a57f-522a806465fc None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:44.695126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdc061-76b6-43b2-a57f-522a806465fc None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:44.695406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdc061-76b6-43b2-a57f-522a806465fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:44.710283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdc061-76b6-43b2-a57f-522a806465fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:44.719237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-77fdc061-76b6-43b2-a57f-522a806465fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:44.719237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:44.719237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:44.719237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:44.719237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:44.719237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:44.719237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:44.719237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:44.719237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:44.719237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:44.719237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:44.719237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:44.719237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:44.719237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:44.719237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:44.719237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:44.720346 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:44.720346 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:44.720346 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:44.720346 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:44.720346 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:44.720346 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:44.720346 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:44.720346 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:44.720346 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:44.720346 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:44.720346 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:44.720346 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:44.720346 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:44.720346 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:44.720346 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:44.720346 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:44.721339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:44.721339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:44.721339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:44.721339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:44.721339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:44.721339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:44.721339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:44.721339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:44.721339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:44.721339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:44.721339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:44.721339 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:44.721339 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 242/489] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:44:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:44.722329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c4fe2-b81f-4fec-934a-92e37677b770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:44.722445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed175a93-87ee-4846-a1bd-22538cb8757b None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:44.722527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed175a93-87ee-4846-a1bd-22538cb8757b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:44.727166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed175a93-87ee-4846-a1bd-22538cb8757b None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:44.727317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c4fe2-b81f-4fec-934a-92e37677b770 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:44.727317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c4fe2-b81f-4fec-934a-92e37677b770 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:44.727317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c4fe2-b81f-4fec-934a-92e37677b770 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:44.727544 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 243/490] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:44.728732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed175a93-87ee-4846-a1bd-22538cb8757b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:44.737074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c4fe2-b81f-4fec-934a-92e37677b770 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:44.739103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c4fe2-b81f-4fec-934a-92e37677b770 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:44.760444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-dd9c4fe2-b81f-4fec-934a-92e37677b770 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:44:44.760444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:44.760444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:44.760444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:44.760444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:44.760444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:44.760444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:44.760444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:44.760444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:44.760444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:44.760444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:44.760444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:44.760444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:44:44.760444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:44:44.760444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:44:44.760444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:44:44.761759 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:44.761759 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:44.761759 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:44:44.761759 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:44.761759 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:44:44.761759 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:44.761759 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:44.761759 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:44.761759 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:44.761759 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:44.761759 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:44.761759 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:44.761759 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:44.761759 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:44.761759 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:44.761759 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:44.761759 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:44.761759 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:44.763632 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:44.763632 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:44.763632 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:44:44.763632 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:44:44.763632 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:44:44.763632 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:44:44.763632 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:44:44.763632 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:44:44.763632 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:44:44.763632 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:44.763632 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 248/491] 10.222.0.43 () {56 vars in 1093 bytes} [Sat Jul 2 20:44:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:44.764763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05b0ef-1af8-4eff-9868-b03ea878a86a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:44.764763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05b0ef-1af8-4eff-9868-b03ea878a86a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:44.764763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05b0ef-1af8-4eff-9868-b03ea878a86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:44.784489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ad05b0ef-1af8-4eff-9868-b03ea878a86a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:44.785847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ad05b0ef-1af8-4eff-9868-b03ea878a86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:44.834711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:44.838221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:44.857840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed175a93-87ee-4846-a1bd-22538cb8757b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:44.860839 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 249/492] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:44.868898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05b0ef-1af8-4eff-9868-b03ea878a86a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:44.893789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05585b-573a-4bdb-ab70-6d655d36fe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:44.894874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05585b-573a-4bdb-ab70-6d655d36fe24 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:44.895232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05585b-573a-4bdb-ab70-6d655d36fe24 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:44.895426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05585b-573a-4bdb-ab70-6d655d36fe24 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:44.896473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05585b-573a-4bdb-ab70-6d655d36fe24 None admin] RBAC: Adding query filter params (name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:44.896782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05585b-573a-4bdb-ab70-6d655d36fe24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:44.898893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05585b-573a-4bdb-ab70-6d655d36fe24 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:44.913453 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 244/493] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:44:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:44.913453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc67a8-2e70-4d0e-8a0e-88b43491220b None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:44.913453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc67a8-2e70-4d0e-8a0e-88b43491220b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:44.913453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc67a8-2e70-4d0e-8a0e-88b43491220b None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:44.913453 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 245/494] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:44.914657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc67a8-2e70-4d0e-8a0e-88b43491220b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:44.981071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05b0ef-1af8-4eff-9868-b03ea878a86a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:45.018115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c542d-0e26-46c0-ad3a-7b1cc647e578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:45.018710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c542d-0e26-46c0-ad3a-7b1cc647e578 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:45.019027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c542d-0e26-46c0-ad3a-7b1cc647e578 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:45.019296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c542d-0e26-46c0-ad3a-7b1cc647e578 None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:45.020109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c542d-0e26-46c0-ad3a-7b1cc647e578 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:45.020519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c542d-0e26-46c0-ad3a-7b1cc647e578 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:45.021952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc67a8-2e70-4d0e-8a0e-88b43491220b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:45.022069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c542d-0e26-46c0-ad3a-7b1cc647e578 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:45.058293 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 250/495] 10.222.0.43 () {56 vars in 1133 bytes} [Sat Jul 2 20:44:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:45.059572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d964498-7551-4d3d-992d-1d447ccd1536 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:45.059857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d964498-7551-4d3d-992d-1d447ccd1536 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:45.060202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d964498-7551-4d3d-992d-1d447ccd1536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:45.064322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c0e42-5fe6-4a36-bb84-f134b55c156e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:45.065228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c0e42-5fe6-4a36-bb84-f134b55c156e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:45.065604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c0e42-5fe6-4a36-bb84-f134b55c156e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:45.065980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c0e42-5fe6-4a36-bb84-f134b55c156e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:45.078843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4d964498-7551-4d3d-992d-1d447ccd1536 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:45.080278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4d964498-7551-4d3d-992d-1d447ccd1536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:45.080388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c0e42-5fe6-4a36-bb84-f134b55c156e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:45.089703 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-9f0c0e42-5fe6-4a36-bb84-f134b55c156e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:45.089703 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:45.089703 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:45.089703 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:45.089703 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:45.089703 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:45.089703 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:45.089703 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:45.089703 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:45.089703 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:45.089703 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:45.089703 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:45.089703 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:45.089703 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:45.089703 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:45.089703 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:45.090619 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:45.090619 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:45.090619 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:45.090619 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:45.090619 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:45.090619 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:45.090619 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:45.090619 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:45.090619 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:45.090619 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:45.090619 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:45.090619 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:45.090619 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:45.090619 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:45.090619 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:45.090619 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:45.091508 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:45.091508 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:45.091508 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:45.091508 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:45.091508 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:45.091508 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:45.091508 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:45.091508 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:45.091508 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:45.091508 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:45.091508 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:45.091508 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:45.094917 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 246/496] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:44:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:45.095298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c0e42-5fe6-4a36-bb84-f134b55c156e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:45.098900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:45.122300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:45.172211 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 251/497] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:45.173960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d964498-7551-4d3d-992d-1d447ccd1536 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:45.199541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c0e42-5fe6-4a36-bb84-f134b55c156e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:45.233441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de94028-4f6c-41de-b52a-3fe1cfd36de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:45.234730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de94028-4f6c-41de-b52a-3fe1cfd36de1 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:45.235246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de94028-4f6c-41de-b52a-3fe1cfd36de1 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:45.235732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de94028-4f6c-41de-b52a-3fe1cfd36de1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:45.251536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de94028-4f6c-41de-b52a-3fe1cfd36de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:45.254192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de94028-4f6c-41de-b52a-3fe1cfd36de1 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:45.273552 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-6de94028-4f6c-41de-b52a-3fe1cfd36de1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:45.273552 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:45.273552 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:45.273552 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:45.273552 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:45.273552 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:45.273552 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:45.273552 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:45.273552 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:45.273552 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:45.273552 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:45.273552 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:45.273552 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:45.273552 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:45.273552 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:45.274608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:45.274608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:45.274608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:45.274608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:45.274608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:45.274608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:45.274608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:45.274608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:45.274608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:45.274608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:45.274608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:45.274608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:45.274608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:45.274608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:45.274608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:45.274608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:45.274608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:45.275497 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:45.275497 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:45.275497 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:45.275497 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:45.275497 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 247/498] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:45.275497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de94028-4f6c-41de-b52a-3fe1cfd36de1 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:45.288736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d964498-7551-4d3d-992d-1d447ccd1536 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:45.324020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c806a-3885-4f42-b64b-f200a1f422d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:45.324700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c806a-3885-4f42-b64b-f200a1f422d2 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:45.324979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c806a-3885-4f42-b64b-f200a1f422d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:45.325255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c806a-3885-4f42-b64b-f200a1f422d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:45.341772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:45.365219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:45.389058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de94028-4f6c-41de-b52a-3fe1cfd36de1 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:45.396294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c806a-3885-4f42-b64b-f200a1f422d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:45.397587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c806a-3885-4f42-b64b-f200a1f422d2 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:45.423257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d76d0-a1e7-4ede-92f6-38f276637452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:45.423942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d76d0-a1e7-4ede-92f6-38f276637452 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:45.424252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d76d0-a1e7-4ede-92f6-38f276637452 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:45.424523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d76d0-a1e7-4ede-92f6-38f276637452 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:45.425595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d76d0-a1e7-4ede-92f6-38f276637452 None admin] RBAC: Adding query filter params (name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:45.425901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d76d0-a1e7-4ede-92f6-38f276637452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:45.427304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d76d0-a1e7-4ede-92f6-38f276637452 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:45.443599 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 248/499] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:44:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:45.443599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d76d0-a1e7-4ede-92f6-38f276637452 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:45.513470 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 252/500] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:45.513470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c806a-3885-4f42-b64b-f200a1f422d2 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:45.551831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d76d0-a1e7-4ede-92f6-38f276637452 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:45.569336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:45.586950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:45.589329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb22605-5024-4503-a004-b01f597161c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:45.590101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb22605-5024-4503-a004-b01f597161c9 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:45.590380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb22605-5024-4503-a004-b01f597161c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:45.590653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb22605-5024-4503-a004-b01f597161c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:45.606736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb22605-5024-4503-a004-b01f597161c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:45.615862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-fdb22605-5024-4503-a004-b01f597161c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:45.615862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:45.615862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:45.615862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:45.615862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:45.615862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:45.615862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:45.615862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:45.615862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:45.615862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:45.615862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:45.615862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:45.615862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:45.615862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:45.615862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:45.615862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:45.616849 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:45.616849 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:45.616849 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:45.616849 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:45.616849 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:45.616849 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:45.616849 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:45.616849 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:45.616849 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:45.616849 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:45.616849 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:45.616849 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:45.616849 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:45.616849 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:45.616849 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:45.616849 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:45.617669 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:45.617669 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:45.617669 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:45.617669 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:45.617669 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:45.617669 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:45.617669 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:45.617669 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:45.617669 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:45.617669 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:45.617669 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:45.617669 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:45.617669 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 249/501] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:44:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:45.618350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb22605-5024-4503-a004-b01f597161c9 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:45.629674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c806a-3885-4f42-b64b-f200a1f422d2 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:45.670411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f4911-9595-4a7c-8eea-2a4265b9c53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:45.671079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f4911-9595-4a7c-8eea-2a4265b9c53a None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:45.671358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f4911-9595-4a7c-8eea-2a4265b9c53a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:45.671632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f4911-9595-4a7c-8eea-2a4265b9c53a None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:45.672381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f4911-9595-4a7c-8eea-2a4265b9c53a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:45.672694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f4911-9595-4a7c-8eea-2a4265b9c53a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:45.674091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f4911-9595-4a7c-8eea-2a4265b9c53a None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:45.686437 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 253/502] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:45.687210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f4911-9595-4a7c-8eea-2a4265b9c53a None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:45.729599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb22605-5024-4503-a004-b01f597161c9 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:45.767815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856d6fe-b6ca-496b-9d18-9974df680e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:45.768667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856d6fe-b6ca-496b-9d18-9974df680e06 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:45.768945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856d6fe-b6ca-496b-9d18-9974df680e06 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:45.769219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856d6fe-b6ca-496b-9d18-9974df680e06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:45.780005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856d6fe-b6ca-496b-9d18-9974df680e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:45.781492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856d6fe-b6ca-496b-9d18-9974df680e06 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:45.787836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f4911-9595-4a7c-8eea-2a4265b9c53a None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:45.798395 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-4856d6fe-b6ca-496b-9d18-9974df680e06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:45.798395 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:45.798395 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:45.798395 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:45.798395 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:45.798395 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:45.798395 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:45.798395 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:45.798395 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:45.798395 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:45.798395 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:45.798395 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:45.798395 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:45.798395 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:45.798395 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:45.799424 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:45.799424 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:45.799424 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:45.799424 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:45.799424 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:45.799424 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:45.799424 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:45.799424 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:45.799424 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:45.799424 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:45.799424 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:45.799424 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:45.799424 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:45.799424 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:45.799424 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:45.799424 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:45.799424 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:45.800816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:45.800816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:45.800816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:45.800816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:45.800816 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 250/503] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:45.800816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856d6fe-b6ca-496b-9d18-9974df680e06 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:45.818941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:45.825166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34806fe7-0bc0-4fc7-b8a9-63eac4af552b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:45.826019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34806fe7-0bc0-4fc7-b8a9-63eac4af552b None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:45.826298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34806fe7-0bc0-4fc7-b8a9-63eac4af552b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:45.826554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34806fe7-0bc0-4fc7-b8a9-63eac4af552b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:45.829690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:45.836605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34806fe7-0bc0-4fc7-b8a9-63eac4af552b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:45.838065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34806fe7-0bc0-4fc7-b8a9-63eac4af552b None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:45.855423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-34806fe7-0bc0-4fc7-b8a9-63eac4af552b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:45.855423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:45.855423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:45.855423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:45.855423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:45.855423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:45.855423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:45.855423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:45.855423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:45.855423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:45.855423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:45.855423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:45.855423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:45.855423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:45.855423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:45.856308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:45.856308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:45.856308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:45.856308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:45.856308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:45.856308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:45.856308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:45.856308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:45.856308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:45.856308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:45.856308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:45.856308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:45.856308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:45.856308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:45.856308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:45.856308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:45.856308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:45.857251 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:45.857251 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:45.857251 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:45.857251 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:45.857251 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 254/504] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:45.858068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d324453-23f2-4208-95c6-47013d83ecea None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:45.858347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d324453-23f2-4208-95c6-47013d83ecea None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:45.858620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d324453-23f2-4208-95c6-47013d83ecea None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:45.859886 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 255/505] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:45.863127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d324453-23f2-4208-95c6-47013d83ecea None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:45.968381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d324453-23f2-4208-95c6-47013d83ecea None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:46.005484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eca2ab-7f52-4045-855c-241872e80099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:46.006288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eca2ab-7f52-4045-855c-241872e80099 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:46.006562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eca2ab-7f52-4045-855c-241872e80099 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:46.006830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eca2ab-7f52-4045-855c-241872e80099 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:46.014797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eca2ab-7f52-4045-855c-241872e80099 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:46.016344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eca2ab-7f52-4045-855c-241872e80099 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:46.025214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856d6fe-b6ca-496b-9d18-9974df680e06 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:46.030303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-b3eca2ab-7f52-4045-855c-241872e80099 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 02 20:44:46.030303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:46.030303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:46.030303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:46.030303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:46.030303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:46.030303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:46.030303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:46.030303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:46.030303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:46.030303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:46.030303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:46.030303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:44:46.030303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:44:46.030303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:44:46.030303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:44:46.031389 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:46.031389 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:46.031389 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:44:46.031389 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:46.031389 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:44:46.031389 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:46.031389 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:46.031389 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:46.031389 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:46.031389 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:46.031389 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:46.031389 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:46.031389 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:46.031389 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:46.031389 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:46.031389 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:46.031389 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:46.031389 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:46.032385 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:46.032385 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:46.032385 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:44:46.032385 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:44:46.032385 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:44:46.032385 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:44:46.032385 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:44:46.032385 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:44:46.032385 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 02 20:44:46.032385 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:46.032385 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 256/506] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:46.032385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eca2ab-7f52-4045-855c-241872e80099 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:46.064719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57119b-7301-44c4-b96b-6205ab754645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:46.065384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57119b-7301-44c4-b96b-6205ab754645 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:46.065669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57119b-7301-44c4-b96b-6205ab754645 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:46.065942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57119b-7301-44c4-b96b-6205ab754645 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:46.066688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57119b-7301-44c4-b96b-6205ab754645 None admin] RBAC: Adding query filter params (name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:46.066990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57119b-7301-44c4-b96b-6205ab754645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:46.068386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57119b-7301-44c4-b96b-6205ab754645 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:46.077732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:46.077873 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 251/507] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:44:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:46.077873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57119b-7301-44c4-b96b-6205ab754645 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:46.136187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eca2ab-7f52-4045-855c-241872e80099 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:46.170001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4638e0e-aefe-4d88-bd41-695a2d67e7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:46.170661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4638e0e-aefe-4d88-bd41-695a2d67e7ed None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:46.170942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4638e0e-aefe-4d88-bd41-695a2d67e7ed None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:46.171217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4638e0e-aefe-4d88-bd41-695a2d67e7ed None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:46.171936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4638e0e-aefe-4d88-bd41-695a2d67e7ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:46.172272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4638e0e-aefe-4d88-bd41-695a2d67e7ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:46.173715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4638e0e-aefe-4d88-bd41-695a2d67e7ed None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:46.175649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:46.186248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57119b-7301-44c4-b96b-6205ab754645 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:46.186693 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 257/508] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:46.187911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3bfb6-0a9b-429f-9fe3-334b95c0dbd7 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:46.188230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3bfb6-0a9b-429f-9fe3-334b95c0dbd7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:46.188502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3bfb6-0a9b-429f-9fe3-334b95c0dbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:46.204262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-59b3bfb6-0a9b-429f-9fe3-334b95c0dbd7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:46.205494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-59b3bfb6-0a9b-429f-9fe3-334b95c0dbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:46.225360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46977e-7210-4b7b-b24f-b7668d85d406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:46.226124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46977e-7210-4b7b-b24f-b7668d85d406 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:46.226407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46977e-7210-4b7b-b24f-b7668d85d406 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:46.226678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46977e-7210-4b7b-b24f-b7668d85d406 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:46.227395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46977e-7210-4b7b-b24f-b7668d85d406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:46.227706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46977e-7210-4b7b-b24f-b7668d85d406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:46.229119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46977e-7210-4b7b-b24f-b7668d85d406 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:46.240551 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 252/509] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:46.241346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46977e-7210-4b7b-b24f-b7668d85d406 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:46.280835 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 258/510] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:46.281898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3bfb6-0a9b-429f-9fe3-334b95c0dbd7 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:46.313375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:46.353340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46977e-7210-4b7b-b24f-b7668d85d406 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:46.379621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3bfb6-0a9b-429f-9fe3-334b95c0dbd7 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:46.385780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be79ad-b34f-4a4c-9ccd-b63a1afba665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:46.386419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be79ad-b34f-4a4c-9ccd-b63a1afba665 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:46.386712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be79ad-b34f-4a4c-9ccd-b63a1afba665 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:46.386977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be79ad-b34f-4a4c-9ccd-b63a1afba665 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:46.387795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be79ad-b34f-4a4c-9ccd-b63a1afba665 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:46.388161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be79ad-b34f-4a4c-9ccd-b63a1afba665 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:46.389596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be79ad-b34f-4a4c-9ccd-b63a1afba665 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:46.412317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71d725-b44e-4047-ab90-a700591748cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:46.413098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71d725-b44e-4047-ab90-a700591748cb None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:46.413367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71d725-b44e-4047-ab90-a700591748cb None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:46.413634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71d725-b44e-4047-ab90-a700591748cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:46.423320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71d725-b44e-4047-ab90-a700591748cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:46.424802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71d725-b44e-4047-ab90-a700591748cb None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:46.424947 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 253/511] 10.222.0.43 () {56 vars in 1137 bytes} [Sat Jul 2 20:44:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:46.426070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be79ad-b34f-4a4c-9ccd-b63a1afba665 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:46.437915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:46.442823 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-7b71d725-b44e-4047-ab90-a700591748cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:46.442823 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:46.442823 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:46.442823 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:46.442823 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:46.442823 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:46.442823 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:46.442823 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:46.442823 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:46.442823 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:46.442823 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:46.442823 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:46.442823 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:46.442823 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:46.442823 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:46.443742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:46.443742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:46.443742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:46.443742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:46.443742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:46.443742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:46.443742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:46.443742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:46.443742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:46.443742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:46.443742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:46.443742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:46.443742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:46.443742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:46.443742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:46.443742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:46.443742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:46.444651 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:46.444651 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:46.444651 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:46.444651 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:46.444651 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 259/512] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:46.444998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71d725-b44e-4047-ab90-a700591748cb None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:46.528129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:46.532015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be79ad-b34f-4a4c-9ccd-b63a1afba665 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:46.544210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71d725-b44e-4047-ab90-a700591748cb None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:46.567161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe31d2-333c-4d7f-979f-a40e7d285f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:46.567963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe31d2-333c-4d7f-979f-a40e7d285f0c None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:46.568271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe31d2-333c-4d7f-979f-a40e7d285f0c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:46.568542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe31d2-333c-4d7f-979f-a40e7d285f0c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:46.575906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe31d2-333c-4d7f-979f-a40e7d285f0c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:46.577396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe31d2-333c-4d7f-979f-a40e7d285f0c None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:46.582556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d63ded-7f67-4ab3-8266-72761282a335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:46.583336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d63ded-7f67-4ab3-8266-72761282a335 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:46.583687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d63ded-7f67-4ab3-8266-72761282a335 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:46.583958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d63ded-7f67-4ab3-8266-72761282a335 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:46.590512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d63ded-7f67-4ab3-8266-72761282a335 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:46.591967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d63ded-7f67-4ab3-8266-72761282a335 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:46.593156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-9ebe31d2-333c-4d7f-979f-a40e7d285f0c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 20:44:46.593156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:46.593156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:46.593156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:46.593156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:46.593156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:46.593156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:46.593156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:46.593156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:46.593156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:46.593156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:46.593156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:46.593156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:44:46.593156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:44:46.593156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:44:46.593156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:44:46.594112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:46.594112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:46.594112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:44:46.594112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:46.594112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:44:46.594112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:46.594112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:46.594112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:46.594112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:46.594112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:46.594112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:46.594112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:46.594112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:46.594112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:46.594112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:46.594112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:46.594112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:46.594112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:46.595036 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:46.595036 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:46.595036 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:44:46.595036 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:44:46.595036 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:44:46.595036 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:44:46.595036 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:44:46.595036 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:44:46.595036 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 20:44:46.595036 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:46.595036 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 254/513] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:46.595626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe31d2-333c-4d7f-979f-a40e7d285f0c None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:46.608033 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-a4d63ded-7f67-4ab3-8266-72761282a335 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:46.608033 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:46.608033 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:46.608033 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:46.608033 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:46.608033 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:46.608033 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:46.608033 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:46.608033 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:46.608033 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:46.608033 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:46.608033 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:46.608033 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:44:46.608033 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:44:46.608033 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:44:46.608945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:44:46.608945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:46.608945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:46.608945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:46.608945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:46.608945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:46.608945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:46.608945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:46.608945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:46.608945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:46.608945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:46.608945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:46.608945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:46.608945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:46.608945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:46.608945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:46.608945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:46.609799 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:44:46.609799 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:44:46.609799 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:44:46.609799 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:44:46.609799 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:44:46.609799 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:44:46.609799 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:46.609799 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:46.609799 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 260/514] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:46.610435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d63ded-7f67-4ab3-8266-72761282a335 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:46.665609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:46.701121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe31d2-333c-4d7f-979f-a40e7d285f0c None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:46.712893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d63ded-7f67-4ab3-8266-72761282a335 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:46.733891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4192c-950c-4dc6-bc4e-dd5e12c2386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:46.734681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4192c-950c-4dc6-bc4e-dd5e12c2386a None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:46.734965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4192c-950c-4dc6-bc4e-dd5e12c2386a None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:46.735241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4192c-950c-4dc6-bc4e-dd5e12c2386a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:46.746171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4192c-950c-4dc6-bc4e-dd5e12c2386a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:46.746743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e992d-1228-40b4-8920-de373c9c381e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:46.747500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e992d-1228-40b4-8920-de373c9c381e None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:46.747823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4192c-950c-4dc6-bc4e-dd5e12c2386a None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:46.747927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e992d-1228-40b4-8920-de373c9c381e None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:46.748164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e992d-1228-40b4-8920-de373c9c381e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:46.763422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:46.765171 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-bbd4192c-950c-4dc6-bc4e-dd5e12c2386a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:46.765171 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:46.765171 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:46.765171 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:46.765171 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:46.765171 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:46.765171 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:46.765171 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:46.765171 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:46.765171 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:46.765171 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:46.765171 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:46.765171 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:46.765171 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:46.765171 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:46.766079 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:46.766079 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:46.766079 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:46.766079 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:46.766079 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:46.766079 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:46.766079 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:46.766079 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:46.766079 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:46.766079 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:46.766079 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:46.766079 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:46.766079 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:46.766079 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:46.766079 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:46.766079 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:46.766079 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:46.766989 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:46.766989 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:46.766989 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:46.766989 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:46.766989 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 255/515] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:46.767320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4192c-950c-4dc6-bc4e-dd5e12c2386a None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:46.822749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e992d-1228-40b4-8920-de373c9c381e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:46.824276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e992d-1228-40b4-8920-de373c9c381e None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:46.865943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4192c-950c-4dc6-bc4e-dd5e12c2386a None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:46.885230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:46.899542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19da96-9561-4c48-aadc-f3c785a9be5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:46.900179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19da96-9561-4c48-aadc-f3c785a9be5a None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:46.900485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19da96-9561-4c48-aadc-f3c785a9be5a None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:46.900894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19da96-9561-4c48-aadc-f3c785a9be5a None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:46.901599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19da96-9561-4c48-aadc-f3c785a9be5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:46.901897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19da96-9561-4c48-aadc-f3c785a9be5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:46.903254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19da96-9561-4c48-aadc-f3c785a9be5a None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:46.915171 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 256/516] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:46.916191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19da96-9561-4c48-aadc-f3c785a9be5a None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:46.924893 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 261/517] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:46.926042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e992d-1228-40b4-8920-de373c9c381e None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:46.969964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:47.013822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19da96-9561-4c48-aadc-f3c785a9be5a None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:47.022798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e992d-1228-40b4-8920-de373c9c381e None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:47.047612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cebc49-6682-4f2f-90b6-6ad86fee523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:47.048310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cebc49-6682-4f2f-90b6-6ad86fee523a None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:47.048595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cebc49-6682-4f2f-90b6-6ad86fee523a None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:47.048873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cebc49-6682-4f2f-90b6-6ad86fee523a None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:47.049702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cebc49-6682-4f2f-90b6-6ad86fee523a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:47.050011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cebc49-6682-4f2f-90b6-6ad86fee523a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:47.051770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cebc49-6682-4f2f-90b6-6ad86fee523a None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:47.057359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35f90e-efac-4646-8a03-3ecd24e97876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:47.058011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35f90e-efac-4646-8a03-3ecd24e97876 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:47.058289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35f90e-efac-4646-8a03-3ecd24e97876 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:47.058561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35f90e-efac-4646-8a03-3ecd24e97876 None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:47.059334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35f90e-efac-4646-8a03-3ecd24e97876 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:47.059649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35f90e-efac-4646-8a03-3ecd24e97876 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:47.061200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35f90e-efac-4646-8a03-3ecd24e97876 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:47.068787 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 257/518] 10.222.0.43 () {56 vars in 1137 bytes} [Sat Jul 2 20:44:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:47.069587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cebc49-6682-4f2f-90b6-6ad86fee523a None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:47.083412 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 262/519] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:44:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:47.083412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35f90e-efac-4646-8a03-3ecd24e97876 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:47.110668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:47.170027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cebc49-6682-4f2f-90b6-6ad86fee523a None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:47.179073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35f90e-efac-4646-8a03-3ecd24e97876 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:47.181422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:47.206859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a81124-45f6-4e5d-9a55-6a431c7e8b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:47.207520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a81124-45f6-4e5d-9a55-6a431c7e8b60 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:47.207799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a81124-45f6-4e5d-9a55-6a431c7e8b60 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:47.208103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a81124-45f6-4e5d-9a55-6a431c7e8b60 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:47.208828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a81124-45f6-4e5d-9a55-6a431c7e8b60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:47.209133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a81124-45f6-4e5d-9a55-6a431c7e8b60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:47.213796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a81124-45f6-4e5d-9a55-6a431c7e8b60 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:47.213914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66c183-fbb8-4cca-a64e-c4878525b2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:47.214608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66c183-fbb8-4cca-a64e-c4878525b2ca None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:47.214883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66c183-fbb8-4cca-a64e-c4878525b2ca None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:47.215170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66c183-fbb8-4cca-a64e-c4878525b2ca None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:47.222490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66c183-fbb8-4cca-a64e-c4878525b2ca None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:47.223932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66c183-fbb8-4cca-a64e-c4878525b2ca None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:47.225077 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 258/520] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:47.225884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a81124-45f6-4e5d-9a55-6a431c7e8b60 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:47.239161 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-2d66c183-fbb8-4cca-a64e-c4878525b2ca None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 02 20:44:47.239161 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:47.239161 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:47.239161 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:47.239161 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:47.239161 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:47.239161 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:47.239161 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:47.239161 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:47.239161 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:47.239161 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:47.239161 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:47.239161 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:44:47.239161 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:44:47.239161 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:44:47.239161 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:44:47.240303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:47.240303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:47.240303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:44:47.240303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:47.240303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:44:47.240303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:47.240303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:47.240303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:47.240303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:47.240303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:47.240303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:47.240303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:47.240303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:47.240303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:47.240303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:47.240303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:47.240303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:47.240303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:47.245886 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:47.245886 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:47.245886 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:44:47.245886 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:44:47.245886 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:44:47.245886 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:44:47.245886 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:44:47.245886 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:44:47.245886 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 02 20:44:47.245886 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:47.245886 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 263/521] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:44:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:47.245886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66c183-fbb8-4cca-a64e-c4878525b2ca None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:47.322584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:47.326357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a81124-45f6-4e5d-9a55-6a431c7e8b60 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:47.342657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66c183-fbb8-4cca-a64e-c4878525b2ca None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:47.360049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df13d64-19da-4774-859c-cd01d12dd693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:47.360945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df13d64-19da-4774-859c-cd01d12dd693 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:47.361225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df13d64-19da-4774-859c-cd01d12dd693 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:47.361495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df13d64-19da-4774-859c-cd01d12dd693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:47.372325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df13d64-19da-4774-859c-cd01d12dd693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:47.373772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df13d64-19da-4774-859c-cd01d12dd693 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:47.375968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc309f64-7f19-4144-a9dd-80080934dbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:47.376647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc309f64-7f19-4144-a9dd-80080934dbcc None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:47.376932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc309f64-7f19-4144-a9dd-80080934dbcc None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:47.377209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc309f64-7f19-4144-a9dd-80080934dbcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:47.390840 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-0df13d64-19da-4774-859c-cd01d12dd693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:47.390840 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:47.390840 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:47.390840 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:47.390840 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:47.390840 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:47.390840 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:47.390840 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:47.390840 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:47.390840 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:47.390840 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:47.390840 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:47.390840 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:47.390840 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:47.390840 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:47.391725 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:47.391725 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:47.391725 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:47.391725 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:47.391725 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:47.391725 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:47.391725 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:47.391725 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:47.391725 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:47.391725 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:47.391725 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:47.391725 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:47.391725 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:47.391725 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:47.391725 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:47.391725 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:47.391725 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:47.392616 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:47.392616 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:47.392616 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:47.392616 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:47.392616 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 259/522] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:47.392900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df13d64-19da-4774-859c-cd01d12dd693 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:47.412677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:47.450054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc309f64-7f19-4144-a9dd-80080934dbcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:47.451538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc309f64-7f19-4144-a9dd-80080934dbcc None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:47.492662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df13d64-19da-4774-859c-cd01d12dd693 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:47.525622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f7371-35fd-40a6-93b3-c0e6a0cf57a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:47.526261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f7371-35fd-40a6-93b3-c0e6a0cf57a1 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:47.526541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f7371-35fd-40a6-93b3-c0e6a0cf57a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:47.526813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f7371-35fd-40a6-93b3-c0e6a0cf57a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:47.527676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f7371-35fd-40a6-93b3-c0e6a0cf57a1 None admin] RBAC: Adding query filter params (role.id=843bfd29577143dcb23593a75d4ee5a0, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=aa3e290fa5384f9bac3fec771cebf653) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:47.527985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f7371-35fd-40a6-93b3-c0e6a0cf57a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:47.529470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f7371-35fd-40a6-93b3-c0e6a0cf57a1 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:47.534792 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 260/523] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:44:47 2022] GET /identity/v3/role_assignments?user.id=aa3e290fa5384f9bac3fec771cebf653&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=843bfd29577143dcb23593a75d4ee5a0 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:47.535541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f7371-35fd-40a6-93b3-c0e6a0cf57a1 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:47.552692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:47.566886 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 264/524] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:47.567786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc309f64-7f19-4144-a9dd-80080934dbcc None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:47.637316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:47.657693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f7371-35fd-40a6-93b3-c0e6a0cf57a1 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:47.680694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc309f64-7f19-4144-a9dd-80080934dbcc None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:47.701263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435f977-7d29-43c0-9b0e-ea9d7fb214e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:47.701871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435f977-7d29-43c0-9b0e-ea9d7fb214e2 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:47.702220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435f977-7d29-43c0-9b0e-ea9d7fb214e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:47.702485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435f977-7d29-43c0-9b0e-ea9d7fb214e2 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:47.703213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435f977-7d29-43c0-9b0e-ea9d7fb214e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:47.704722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435f977-7d29-43c0-9b0e-ea9d7fb214e2 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:47.718742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf11b4c-1e77-4fb1-bf9f-5a2eaaae901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:47.719413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf11b4c-1e77-4fb1-bf9f-5a2eaaae901a None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:47.719809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf11b4c-1e77-4fb1-bf9f-5a2eaaae901a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:47.721077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf11b4c-1e77-4fb1-bf9f-5a2eaaae901a None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:47.721667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf11b4c-1e77-4fb1-bf9f-5a2eaaae901a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:47.721976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf11b4c-1e77-4fb1-bf9f-5a2eaaae901a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:47.723983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf11b4c-1e77-4fb1-bf9f-5a2eaaae901a None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:47.732288 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 261/525] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Jul 2 20:44:47 2022] POST /identity/v3/users => generated 247 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:44:47.732288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435f977-7d29-43c0-9b0e-ea9d7fb214e2 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:47.745906 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 265/526] 10.222.0.43 () {56 vars in 1139 bytes} [Sat Jul 2 20:44:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:47.747069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf11b4c-1e77-4fb1-bf9f-5a2eaaae901a None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:47.839984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:47.870216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf11b4c-1e77-4fb1-bf9f-5a2eaaae901a None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:47.888876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435f977-7d29-43c0-9b0e-ea9d7fb214e2 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:47.895529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:47.910023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7f3b9-69f7-4a85-8085-7ce528f190a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:47.911141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7f3b9-69f7-4a85-8085-7ce528f190a2 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:47.911611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7f3b9-69f7-4a85-8085-7ce528f190a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:47.912026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7f3b9-69f7-4a85-8085-7ce528f190a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:47.924188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7f3b9-69f7-4a85-8085-7ce528f190a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:47.926220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7f3b9-69f7-4a85-8085-7ce528f190a2 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:47.933435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8ca6d-89f8-44df-bee9-cac5669b0703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:47.934098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8ca6d-89f8-44df-bee9-cac5669b0703 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:47.934929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8ca6d-89f8-44df-bee9-cac5669b0703 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:47.935220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8ca6d-89f8-44df-bee9-cac5669b0703 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:47.936015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8ca6d-89f8-44df-bee9-cac5669b0703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:47.936354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8ca6d-89f8-44df-bee9-cac5669b0703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:47.938210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8ca6d-89f8-44df-bee9-cac5669b0703 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:47.946875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-4da7f3b9-69f7-4a85-8085-7ce528f190a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:47.946875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:47.946875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:47.946875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:47.946875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:47.946875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:47.946875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:47.946875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:47.946875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:47.946875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:47.946875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:47.946875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:47.946875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:47.946875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:47.946875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:47.947836 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:47.947836 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:47.947836 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:47.947836 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:47.947836 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:47.947836 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:47.947836 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:47.947836 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:47.947836 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:47.947836 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:47.947836 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:47.947836 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:47.947836 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:47.947836 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:47.947836 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:47.947836 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:47.947836 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:47.948747 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:47.948747 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:47.948747 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:47.948747 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:47.949571 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 266/527] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:47.950426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7f3b9-69f7-4a85-8085-7ce528f190a2 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:47.952182 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 262/528] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:47.956626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8ca6d-89f8-44df-bee9-cac5669b0703 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:48.076952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7f3b9-69f7-4a85-8085-7ce528f190a2 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:48.088065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8ca6d-89f8-44df-bee9-cac5669b0703 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:48.115871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f163f78-c2d5-46cc-a7d4-4061186d54c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:48.116563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f163f78-c2d5-46cc-a7d4-4061186d54c4 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:48.116843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f163f78-c2d5-46cc-a7d4-4061186d54c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:48.117121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f163f78-c2d5-46cc-a7d4-4061186d54c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:48.123555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:48.132440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae73982-ee7c-4726-a01a-a946c2d37935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:48.133356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae73982-ee7c-4726-a01a-a946c2d37935 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:48.134102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae73982-ee7c-4726-a01a-a946c2d37935 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:48.134386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae73982-ee7c-4726-a01a-a946c2d37935 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:48.135388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae73982-ee7c-4726-a01a-a946c2d37935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:48.135695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae73982-ee7c-4726-a01a-a946c2d37935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:48.137760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae73982-ee7c-4726-a01a-a946c2d37935 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:48.152955 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 263/529] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:48.154016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae73982-ee7c-4726-a01a-a946c2d37935 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:48.170599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:48.205390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f163f78-c2d5-46cc-a7d4-4061186d54c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:48.207084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f163f78-c2d5-46cc-a7d4-4061186d54c4 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:48.286754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae73982-ee7c-4726-a01a-a946c2d37935 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:48.318881 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 267/530] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:48.320005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f163f78-c2d5-46cc-a7d4-4061186d54c4 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:48.328745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5c864-bc75-4045-a94e-010eea7cdba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:48.329554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5c864-bc75-4045-a94e-010eea7cdba8 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:48.329838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5c864-bc75-4045-a94e-010eea7cdba8 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:48.330114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5c864-bc75-4045-a94e-010eea7cdba8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:48.337483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5c864-bc75-4045-a94e-010eea7cdba8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:48.338939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5c864-bc75-4045-a94e-010eea7cdba8 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:48.354365 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-bfa5c864-bc75-4045-a94e-010eea7cdba8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:48.354365 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:48.354365 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:48.354365 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:48.354365 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:48.354365 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:48.354365 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:48.354365 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:48.354365 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:48.354365 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:48.354365 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:48.354365 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:48.354365 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:44:48.354365 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:44:48.354365 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:44:48.355437 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:44:48.355437 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:48.355437 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:48.355437 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:48.355437 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:48.355437 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:48.355437 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:48.355437 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:48.355437 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:48.355437 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:48.355437 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:48.355437 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:48.355437 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:48.355437 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:48.355437 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:48.355437 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:48.355437 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:48.356429 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:44:48.356429 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:44:48.356429 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:44:48.356429 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:44:48.356429 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:44:48.356429 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:44:48.356429 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:48.356429 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:48.360479 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 264/531] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:48.361351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5c864-bc75-4045-a94e-010eea7cdba8 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:48.412499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:48.413058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:48.428307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f163f78-c2d5-46cc-a7d4-4061186d54c4 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:48.463749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785e436-514b-489b-9579-1ea4c3034df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:48.464509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785e436-514b-489b-9579-1ea4c3034df8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:48.464793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785e436-514b-489b-9579-1ea4c3034df8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:48.465073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785e436-514b-489b-9579-1ea4c3034df8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:48.472474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785e436-514b-489b-9579-1ea4c3034df8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:48.474068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785e436-514b-489b-9579-1ea4c3034df8 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:48.476115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5c864-bc75-4045-a94e-010eea7cdba8 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:48.488296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-a785e436-514b-489b-9579-1ea4c3034df8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:48.488296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:48.488296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:48.488296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:48.488296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:48.488296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:48.488296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:48.488296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:48.488296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:48.488296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:48.488296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:48.488296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:48.488296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:44:48.488296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:44:48.488296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:44:48.489168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:44:48.489168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:48.489168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:48.489168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:48.489168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:48.489168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:48.489168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:48.489168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:48.489168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:48.489168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:48.489168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:48.489168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:48.489168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:48.489168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:48.489168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:48.489168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:48.489168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:48.490252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:44:48.490252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:44:48.490252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:44:48.490252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:44:48.490252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:44:48.490252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:44:48.490252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:48.490252 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:48.490252 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 268/532] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:48.490948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785e436-514b-489b-9579-1ea4c3034df8 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:48.519556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55011f-f819-4fd2-baf4-1fda06a5b44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:48.520943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55011f-f819-4fd2-baf4-1fda06a5b44d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:48.521225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55011f-f819-4fd2-baf4-1fda06a5b44d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:48.521499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55011f-f819-4fd2-baf4-1fda06a5b44d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:48.534216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55011f-f819-4fd2-baf4-1fda06a5b44d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:48.535964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55011f-f819-4fd2-baf4-1fda06a5b44d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:48.560813 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-6f55011f-f819-4fd2-baf4-1fda06a5b44d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:48.560813 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:48.560813 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:48.560813 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:48.560813 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:48.560813 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:48.560813 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:48.560813 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:48.560813 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:48.560813 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:48.560813 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:48.560813 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:48.560813 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:48.560813 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:48.560813 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:48.562315 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:48.562315 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:48.562315 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:48.562315 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:48.562315 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:48.562315 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:48.562315 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:48.562315 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:48.562315 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:48.562315 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:48.562315 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:48.562315 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:48.562315 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:48.562315 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:48.562315 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:48.562315 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:48.562315 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:48.563170 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:48.563170 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:48.563170 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:48.563170 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:48.565495 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 265/533] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:48.566507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55011f-f819-4fd2-baf4-1fda06a5b44d None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:48.606364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785e436-514b-489b-9579-1ea4c3034df8 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:48.642455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494812e-01f8-4391-8607-0b7fc98f0a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:48.643254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494812e-01f8-4391-8607-0b7fc98f0a9b None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:48.643524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494812e-01f8-4391-8607-0b7fc98f0a9b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:48.643786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494812e-01f8-4391-8607-0b7fc98f0a9b None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:48.644605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494812e-01f8-4391-8607-0b7fc98f0a9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:48.644913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494812e-01f8-4391-8607-0b7fc98f0a9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:48.646360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494812e-01f8-4391-8607-0b7fc98f0a9b None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:48.648757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:48.664957 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 269/534] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:44:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:48.666261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494812e-01f8-4391-8607-0b7fc98f0a9b None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:48.690962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55011f-f819-4fd2-baf4-1fda06a5b44d None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:48.693767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:48.731383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955b18c-e48a-474a-966e-e4e732f86fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:48.732112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955b18c-e48a-474a-966e-e4e732f86fc2 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:48.732399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955b18c-e48a-474a-966e-e4e732f86fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:48.732672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955b18c-e48a-474a-966e-e4e732f86fc2 None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:48.733459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955b18c-e48a-474a-966e-e4e732f86fc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:48.733767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955b18c-e48a-474a-966e-e4e732f86fc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:48.735632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955b18c-e48a-474a-966e-e4e732f86fc2 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:48.756177 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 266/535] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:44:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:48.757141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955b18c-e48a-474a-966e-e4e732f86fc2 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:48.802288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494812e-01f8-4391-8607-0b7fc98f0a9b None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:48.839356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec1749-0b3d-4976-84f3-823fa61ded4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:48.840015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec1749-0b3d-4976-84f3-823fa61ded4d None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:48.840327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec1749-0b3d-4976-84f3-823fa61ded4d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:48.840605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec1749-0b3d-4976-84f3-823fa61ded4d None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:48.841356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec1749-0b3d-4976-84f3-823fa61ded4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:48.841663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec1749-0b3d-4976-84f3-823fa61ded4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:48.843103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec1749-0b3d-4976-84f3-823fa61ded4d None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:48.859972 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 270/536] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:48.860922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec1749-0b3d-4976-84f3-823fa61ded4d None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:48.870790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955b18c-e48a-474a-966e-e4e732f86fc2 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:48.907204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c93a04-2eec-496c-8d14-aec28428d7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:48.908291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c93a04-2eec-496c-8d14-aec28428d7d9 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:48.908762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c93a04-2eec-496c-8d14-aec28428d7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:48.909219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c93a04-2eec-496c-8d14-aec28428d7d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:48.910549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c93a04-2eec-496c-8d14-aec28428d7d9 None admin] RBAC: Adding query filter params (role.id=843bfd29577143dcb23593a75d4ee5a0, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=3de168a603b0478fa8de67f6d206e1a5) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:48.911098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c93a04-2eec-496c-8d14-aec28428d7d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:48.912756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c93a04-2eec-496c-8d14-aec28428d7d9 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:48.916584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:48.919679 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 267/537] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:44:48 2022] GET /identity/v3/role_assignments?user.id=3de168a603b0478fa8de67f6d206e1a5&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=843bfd29577143dcb23593a75d4ee5a0 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:48.920778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c93a04-2eec-496c-8d14-aec28428d7d9 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:48.954338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:49.000481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec1749-0b3d-4976-84f3-823fa61ded4d None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:49.035344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c93a04-2eec-496c-8d14-aec28428d7d9 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:49.075056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fcda4-f310-48aa-8920-593259d43bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:49.075910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e07ee6-ec96-486a-a347-e2db9f7cdcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:49.076614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e07ee6-ec96-486a-a347-e2db9f7cdcdc None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:49.076720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fcda4-f310-48aa-8920-593259d43bf4 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:49.076893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e07ee6-ec96-486a-a347-e2db9f7cdcdc None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:49.077167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e07ee6-ec96-486a-a347-e2db9f7cdcdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:49.077557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fcda4-f310-48aa-8920-593259d43bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:49.078006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e07ee6-ec96-486a-a347-e2db9f7cdcdc None admin] RBAC: Adding query filter params (role.id=843bfd29577143dcb23593a75d4ee5a0, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=f9ea416fd4d4420b9112507ef1a68bf7) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:49.078181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fcda4-f310-48aa-8920-593259d43bf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:49.078339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e07ee6-ec96-486a-a347-e2db9f7cdcdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:49.079875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e07ee6-ec96-486a-a347-e2db9f7cdcdc None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:49.086946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fcda4-f310-48aa-8920-593259d43bf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:49.089321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fcda4-f310-48aa-8920-593259d43bf4 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:49.096070 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 271/538] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:44:48 2022] GET /identity/v3/role_assignments?user.id=f9ea416fd4d4420b9112507ef1a68bf7&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=843bfd29577143dcb23593a75d4ee5a0 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:49.109841 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-938fcda4-f310-48aa-8920-593259d43bf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:49.109841 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:49.109841 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:49.109841 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:49.109841 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:49.109841 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:49.109841 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:49.109841 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:49.109841 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:49.109841 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:49.109841 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:49.109841 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:49.109841 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:44:49.109841 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:44:49.109841 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:44:49.110800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:44:49.110800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:49.110800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:49.110800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:49.110800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:49.110800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:49.110800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:49.110800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:49.110800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:49.110800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:49.110800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:49.110800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:49.110800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:49.110800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:49.110800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:49.110800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:49.110800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:49.111652 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:44:49.111652 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:44:49.111652 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:44:49.111652 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:44:49.111652 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:44:49.111652 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:44:49.111652 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:49.111652 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:49.113977 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 268/539] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:49.121485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e07ee6-ec96-486a-a347-e2db9f7cdcdc None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:49.273494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e07ee6-ec96-486a-a347-e2db9f7cdcdc None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:49.303046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:49.323347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b55dff-02ff-46d7-ab5e-db1f54127ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:49.324018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55dff-02ff-46d7-ab5e-db1f54127ad0 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:49.324326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55dff-02ff-46d7-ab5e-db1f54127ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:49.324602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55dff-02ff-46d7-ab5e-db1f54127ad0 None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:49.325504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b55dff-02ff-46d7-ab5e-db1f54127ad0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:49.325816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b55dff-02ff-46d7-ab5e-db1f54127ad0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:49.327343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b55dff-02ff-46d7-ab5e-db1f54127ad0 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:49.344123 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 272/540] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:44:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:49.350202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fcda4-f310-48aa-8920-593259d43bf4 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:49.444101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:49.459395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fcda4-f310-48aa-8920-593259d43bf4 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:49.493316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8967ca-5aa0-4c82-b47e-118b54b3ff65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:49.493973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8967ca-5aa0-4c82-b47e-118b54b3ff65 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:49.494258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8967ca-5aa0-4c82-b47e-118b54b3ff65 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:49.494534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8967ca-5aa0-4c82-b47e-118b54b3ff65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:49.495364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8967ca-5aa0-4c82-b47e-118b54b3ff65 None admin] RBAC: Adding query filter params (role.id=843bfd29577143dcb23593a75d4ee5a0, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=684732cf5a004fb084ce0e523398c970) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:49.495877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8967ca-5aa0-4c82-b47e-118b54b3ff65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:49.497457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8967ca-5aa0-4c82-b47e-118b54b3ff65 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:49.504705 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 269/541] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:44:49 2022] GET /identity/v3/role_assignments?user.id=684732cf5a004fb084ce0e523398c970&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=843bfd29577143dcb23593a75d4ee5a0 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:50.087009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb85982-d5d4-492c-8896-0a61d7dfd905 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:50.087549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb85982-d5d4-492c-8896-0a61d7dfd905 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:50.087549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb85982-d5d4-492c-8896-0a61d7dfd905 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:50.089331 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 273/542] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:50.095491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d9471-6eab-4cb4-981a-d3c4d2932190 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:50.095887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d9471-6eab-4cb4-981a-d3c4d2932190 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:50.096107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d9471-6eab-4cb4-981a-d3c4d2932190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:50.122759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-db0d9471-6eab-4cb4-981a-d3c4d2932190 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:50.123988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-db0d9471-6eab-4cb4-981a-d3c4d2932190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:50.199701 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 270/543] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:50.223977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb85982-d5d4-492c-8896-0a61d7dfd905 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:50.342447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb85982-d5d4-492c-8896-0a61d7dfd905 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:50.363887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af5d64-b26a-4bd6-ad95-a768f35555f9 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:50.364505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af5d64-b26a-4bd6-ad95-a768f35555f9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:50.364996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af5d64-b26a-4bd6-ad95-a768f35555f9 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:50.366593 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 271/544] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:44:50.371659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1d848-aaab-4d4e-96ce-d601d5a6b4a8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:50.372226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1d848-aaab-4d4e-96ce-d601d5a6b4a8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:50.372697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1d848-aaab-4d4e-96ce-d601d5a6b4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:50.389574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9ab1d848-aaab-4d4e-96ce-d601d5a6b4a8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:50.389722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7b654-b815-4240-9c9a-9cc7ed99bb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:50.390527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7b654-b815-4240-9c9a-9cc7ed99bb78 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:50.390812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7b654-b815-4240-9c9a-9cc7ed99bb78 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:50.391089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7b654-b815-4240-9c9a-9cc7ed99bb78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:50.391777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9ab1d848-aaab-4d4e-96ce-d601d5a6b4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:50.407850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7b654-b815-4240-9c9a-9cc7ed99bb78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:50.415640 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-9ed7b654-b815-4240-9c9a-9cc7ed99bb78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:50.415640 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:50.415640 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:50.415640 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:50.415640 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:50.415640 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:50.415640 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:50.415640 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:50.415640 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:50.415640 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:50.415640 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:50.415640 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:50.415640 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:50.415640 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:50.415640 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:50.415640 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:50.416577 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:50.416577 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:50.416577 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:50.416577 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:50.416577 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:50.416577 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:50.416577 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:50.416577 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:50.416577 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:50.416577 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:50.416577 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:50.416577 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:50.416577 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:50.416577 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:50.416577 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:50.416577 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:50.417782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:50.417782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:50.417782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:50.417782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:50.417782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:50.417782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:50.417782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:50.417782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:50.417782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:50.417782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:50.417782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:50.417782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:50.417782 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 274/545] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:44:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:50.423278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7b654-b815-4240-9c9a-9cc7ed99bb78 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:50.468148 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 272/546] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:50.487854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1d848-aaab-4d4e-96ce-d601d5a6b4a8 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:50.489181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:50.502314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:50.605002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7b654-b815-4240-9c9a-9cc7ed99bb78 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:50.638353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1d848-aaab-4d4e-96ce-d601d5a6b4a8 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:50.668509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d1ed4-512e-446c-aea9-1ee78358c25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:50.669249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d1ed4-512e-446c-aea9-1ee78358c25e None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:50.669533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d1ed4-512e-446c-aea9-1ee78358c25e None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:50.669811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d1ed4-512e-446c-aea9-1ee78358c25e None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:50.670574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d1ed4-512e-446c-aea9-1ee78358c25e None admin] RBAC: Adding query filter params (name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:50.670884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d1ed4-512e-446c-aea9-1ee78358c25e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:50.672438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d1ed4-512e-446c-aea9-1ee78358c25e None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:50.685329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1776ef-c7a6-4393-a362-993e60bc0605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:50.686546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1776ef-c7a6-4393-a362-993e60bc0605 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:50.687039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1776ef-c7a6-4393-a362-993e60bc0605 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:50.687503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1776ef-c7a6-4393-a362-993e60bc0605 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:50.690297 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 275/547] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:44:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:50.696051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d1ed4-512e-446c-aea9-1ee78358c25e None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:50.710298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1776ef-c7a6-4393-a362-993e60bc0605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:50.718887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-6f1776ef-c7a6-4393-a362-993e60bc0605 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:50.718887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:50.718887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:50.718887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:50.718887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:50.718887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:50.718887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:50.718887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:50.718887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:50.718887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:50.718887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:50.718887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:50.718887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:50.718887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:50.718887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:50.718887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:50.719785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:50.719785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:50.719785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:50.719785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:50.719785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:50.719785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:50.719785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:50.719785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:50.719785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:50.719785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:50.719785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:50.719785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:50.719785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:50.719785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:50.719785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:50.719785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:50.720631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:50.720631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:50.720631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:50.720631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:50.720631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:50.720631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:50.720631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:50.720631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:50.720631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:50.720631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:50.720631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:50.720631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:50.727072 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 273/548] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:44:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:50.744087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1776ef-c7a6-4393-a362-993e60bc0605 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:50.848427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:50.892522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1776ef-c7a6-4393-a362-993e60bc0605 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:50.901095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:50.905317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d1ed4-512e-446c-aea9-1ee78358c25e None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:50.930345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b27df-bc82-4ba8-bc00-7d844707ab5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:50.931456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b27df-bc82-4ba8-bc00-7d844707ab5d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:50.931950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b27df-bc82-4ba8-bc00-7d844707ab5d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:50.932452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b27df-bc82-4ba8-bc00-7d844707ab5d None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:50.933378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b27df-bc82-4ba8-bc00-7d844707ab5d None admin] RBAC: Adding query filter params (name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:50.933865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b27df-bc82-4ba8-bc00-7d844707ab5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:50.935597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b27df-bc82-4ba8-bc00-7d844707ab5d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:50.944592 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 274/549] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:44:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:50.949708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b27df-bc82-4ba8-bc00-7d844707ab5d None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:51.021624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5393f-6f88-4811-a5f5-64d7e41771bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:51.022430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5393f-6f88-4811-a5f5-64d7e41771bf None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:51.022710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5393f-6f88-4811-a5f5-64d7e41771bf None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:51.022978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5393f-6f88-4811-a5f5-64d7e41771bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:51.053300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b27df-bc82-4ba8-bc00-7d844707ab5d None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:51.060981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5393f-6f88-4811-a5f5-64d7e41771bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:51.062417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5393f-6f88-4811-a5f5-64d7e41771bf None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:51.088917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ef12f-5a8f-48d6-bca8-8e8545d353ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:51.090134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ef12f-5a8f-48d6-bca8-8e8545d353ce None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:51.090611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ef12f-5a8f-48d6-bca8-8e8545d353ce None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:51.091144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ef12f-5a8f-48d6-bca8-8e8545d353ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:51.092265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:51.100375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-b7d5393f-6f88-4811-a5f5-64d7e41771bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:51.100375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:51.100375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:51.100375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:51.100375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:51.100375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:51.100375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:51.100375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:51.100375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:51.100375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:51.100375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:51.100375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:51.100375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:51.100375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:51.100375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:51.102483 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:51.102483 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:51.102483 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:51.102483 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:51.102483 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:51.102483 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:51.102483 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:51.102483 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:51.102483 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:51.102483 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:51.102483 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:51.102483 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:51.102483 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:51.102483 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:51.102483 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:51.102483 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:51.102483 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:51.103385 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:51.103385 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:51.103385 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:51.103385 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:51.103385 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 276/550] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:51.107374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5393f-6f88-4811-a5f5-64d7e41771bf None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:51.115878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ef12f-5a8f-48d6-bca8-8e8545d353ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:51.121663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ef12f-5a8f-48d6-bca8-8e8545d353ce None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:51.152118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-ad1ef12f-5a8f-48d6-bca8-8e8545d353ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:51.152118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:51.152118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:51.152118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:51.152118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:51.152118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:51.152118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:51.152118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:51.152118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:51.152118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:51.152118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:51.152118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:51.152118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:51.152118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:51.152118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:51.153037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:51.153037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:51.153037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:51.153037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:51.153037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:51.153037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:51.153037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:51.153037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:51.153037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:51.153037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:51.153037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:51.153037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:51.153037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:51.153037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:51.153037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:51.153037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:51.153037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:51.154145 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:51.154145 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:51.154145 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:51.154145 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:51.154145 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 275/551] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:51.158762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ef12f-5a8f-48d6-bca8-8e8545d353ce None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:51.290175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5393f-6f88-4811-a5f5-64d7e41771bf None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:51.312551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ef12f-5a8f-48d6-bca8-8e8545d353ce None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:51.351647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58356143-1c1a-456b-9dbd-f2986af4abd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:51.352397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58356143-1c1a-456b-9dbd-f2986af4abd0 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:51.352712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58356143-1c1a-456b-9dbd-f2986af4abd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:51.352951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58356143-1c1a-456b-9dbd-f2986af4abd0 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:51.353667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58356143-1c1a-456b-9dbd-f2986af4abd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:51.353975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58356143-1c1a-456b-9dbd-f2986af4abd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:51.355609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58356143-1c1a-456b-9dbd-f2986af4abd0 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:51.369613 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 277/552] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:51.375214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58356143-1c1a-456b-9dbd-f2986af4abd0 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:51.380753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b4c90-804f-488a-b7d7-34ac29bd9f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:51.381433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b4c90-804f-488a-b7d7-34ac29bd9f70 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:51.381710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b4c90-804f-488a-b7d7-34ac29bd9f70 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:51.381983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b4c90-804f-488a-b7d7-34ac29bd9f70 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:51.382709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b4c90-804f-488a-b7d7-34ac29bd9f70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:51.383013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b4c90-804f-488a-b7d7-34ac29bd9f70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:51.384425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b4c90-804f-488a-b7d7-34ac29bd9f70 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:51.390509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:51.397850 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 276/553] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:51.405255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b4c90-804f-488a-b7d7-34ac29bd9f70 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:51.504755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:51.553857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58356143-1c1a-456b-9dbd-f2986af4abd0 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:51.569809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b4c90-804f-488a-b7d7-34ac29bd9f70 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:51.603719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c16765-163d-4caa-afa7-605277daed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:51.604567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c16765-163d-4caa-afa7-605277daed5e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:51.604845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c16765-163d-4caa-afa7-605277daed5e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:51.605121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c16765-163d-4caa-afa7-605277daed5e None admin] PATH_INFO: `/v3/users/swift` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:51.613606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c16765-163d-4caa-afa7-605277daed5e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:51.616033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c16765-163d-4caa-afa7-605277daed5e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:51.637469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-b1c16765-163d-4caa-afa7-605277daed5e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 02 20:44:51.637469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:51.637469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:51.637469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:51.637469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:51.637469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:51.637469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:51.637469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:51.637469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:51.637469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:51.637469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:51.637469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:51.637469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:44:51.637469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:44:51.637469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:44:51.637469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:44:51.638722 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:51.638722 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:51.638722 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:44:51.638722 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:51.638722 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:44:51.638722 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:51.638722 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:51.638722 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:51.638722 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:51.638722 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:51.638722 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:51.638722 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:51.638722 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:51.638722 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:51.638722 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:51.638722 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:51.638722 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:51.638722 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:51.639707 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:51.639707 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:51.639707 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:44:51.639707 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:44:51.639707 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:44:51.639707 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:44:51.639707 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:44:51.639707 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:44:51.639707 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 02 20:44:51.639707 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:51.639707 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 277/554] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:44:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:51.646853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8535c2-9bbd-460c-b443-81ea9ba22104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:51.647932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8535c2-9bbd-460c-b443-81ea9ba22104 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:51.648374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c16765-163d-4caa-afa7-605277daed5e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:51.648635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8535c2-9bbd-460c-b443-81ea9ba22104 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:51.649091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8535c2-9bbd-460c-b443-81ea9ba22104 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:51.669293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8535c2-9bbd-460c-b443-81ea9ba22104 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:51.670990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8535c2-9bbd-460c-b443-81ea9ba22104 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:51.706549 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-4f8535c2-9bbd-460c-b443-81ea9ba22104 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:44:51.706549 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:51.706549 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:51.706549 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:51.706549 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:51.706549 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:51.706549 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:51.706549 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:51.706549 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:51.706549 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:51.706549 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:51.706549 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:51.706549 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:44:51.706549 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:44:51.706549 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:44:51.706549 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:44:51.707777 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:51.707777 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:51.707777 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:44:51.707777 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:51.707777 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:44:51.707777 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:51.707777 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:51.707777 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:51.707777 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:51.707777 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:51.707777 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:51.707777 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:51.707777 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:51.707777 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:51.707777 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:51.707777 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:51.707777 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:51.707777 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:51.709476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:51.709476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:51.709476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:44:51.709476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:44:51.709476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:44:51.709476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:44:51.709476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:44:51.709476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:44:51.709476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:44:51.709476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:51.711946 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 278/555] 10.222.0.43 () {56 vars in 1093 bytes} [Sat Jul 2 20:44:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:51.717276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8535c2-9bbd-460c-b443-81ea9ba22104 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:51.752103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c16765-163d-4caa-afa7-605277daed5e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:51.755506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:51.804073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bfe48-e0df-486a-9cfa-3dee20639781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:51.804073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bfe48-e0df-486a-9cfa-3dee20639781 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:51.804073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bfe48-e0df-486a-9cfa-3dee20639781 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:51.804073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bfe48-e0df-486a-9cfa-3dee20639781 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:51.804547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bfe48-e0df-486a-9cfa-3dee20639781 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:51.804547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bfe48-e0df-486a-9cfa-3dee20639781 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:51.804547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bfe48-e0df-486a-9cfa-3dee20639781 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:51.823064 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 278/556] 10.222.0.43 () {56 vars in 1135 bytes} [Sat Jul 2 20:44:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:51.828782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bfe48-e0df-486a-9cfa-3dee20639781 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:51.885491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:51.946293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8535c2-9bbd-460c-b443-81ea9ba22104 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:52.012786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bfe48-e0df-486a-9cfa-3dee20639781 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:52.016342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f10542-5930-411c-976b-6576b42feea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:52.017023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f10542-5930-411c-976b-6576b42feea1 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:52.017298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f10542-5930-411c-976b-6576b42feea1 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:52.017570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f10542-5930-411c-976b-6576b42feea1 None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:52.018622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f10542-5930-411c-976b-6576b42feea1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:52.018934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f10542-5930-411c-976b-6576b42feea1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:52.024633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f10542-5930-411c-976b-6576b42feea1 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:52.049381 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 279/557] 10.222.0.43 () {56 vars in 1133 bytes} [Sat Jul 2 20:44:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:52.051375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a49ce-90a6-45ae-a133-a530e3d668a1 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:52.051722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a49ce-90a6-45ae-a133-a530e3d668a1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:52.051998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a49ce-90a6-45ae-a133-a530e3d668a1 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:52.053627 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 280/558] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:52.054229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a49ce-90a6-45ae-a133-a530e3d668a1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:52.057315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bbdb4-c15b-4493-b8cd-6926f8050156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:52.057976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bbdb4-c15b-4493-b8cd-6926f8050156 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:52.058252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bbdb4-c15b-4493-b8cd-6926f8050156 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:52.058864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bbdb4-c15b-4493-b8cd-6926f8050156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:52.093945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:52.138179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bbdb4-c15b-4493-b8cd-6926f8050156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:52.139630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bbdb4-c15b-4493-b8cd-6926f8050156 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:52.165775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a49ce-90a6-45ae-a133-a530e3d668a1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:52.195638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:52.203493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff0d82-6f4c-49df-80c8-87c400133581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:52.204722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff0d82-6f4c-49df-80c8-87c400133581 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:52.205454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff0d82-6f4c-49df-80c8-87c400133581 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:52.206139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff0d82-6f4c-49df-80c8-87c400133581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:52.219015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff0d82-6f4c-49df-80c8-87c400133581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:52.221397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff0d82-6f4c-49df-80c8-87c400133581 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:52.240741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-34ff0d82-6f4c-49df-80c8-87c400133581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:52.240741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:52.240741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:52.240741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:52.240741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:52.240741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:52.240741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:52.240741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:52.240741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:52.240741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:52.240741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:52.240741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:52.240741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:52.240741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:52.240741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:52.241706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:52.241706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:52.241706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:52.241706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:52.241706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:52.241706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:52.241706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:52.241706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:52.241706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:52.241706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:52.241706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:52.241706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:52.241706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:52.241706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:52.241706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:52.241706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:52.241706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:52.242597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:52.242597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:52.242597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:52.242597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:52.246560 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 281/559] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:52.247219 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 279/560] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:44:52.248030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c18c1f-cf4e-4e24-adbc-6e0f39425db9 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:52.248338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c18c1f-cf4e-4e24-adbc-6e0f39425db9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:52.248616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c18c1f-cf4e-4e24-adbc-6e0f39425db9 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:52.248779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e3842-5b81-4ce4-b965-97af19d7a5d6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:52.249050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e3842-5b81-4ce4-b965-97af19d7a5d6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:52.249326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e3842-5b81-4ce4-b965-97af19d7a5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:52.250051 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 282/561] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:52.250583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c18c1f-cf4e-4e24-adbc-6e0f39425db9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:52.270364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-655e3842-5b81-4ce4-b965-97af19d7a5d6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:52.271982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-655e3842-5b81-4ce4-b965-97af19d7a5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:52.328002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:52.338883 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 280/562] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:52.339690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e3842-5b81-4ce4-b965-97af19d7a5d6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:52.352516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c18c1f-cf4e-4e24-adbc-6e0f39425db9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:52.389615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161eb8f5-afde-4fd8-8bd6-f3c50c0873e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:52.390275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161eb8f5-afde-4fd8-8bd6-f3c50c0873e1 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:52.390558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161eb8f5-afde-4fd8-8bd6-f3c50c0873e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:52.390837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161eb8f5-afde-4fd8-8bd6-f3c50c0873e1 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:52.391554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161eb8f5-afde-4fd8-8bd6-f3c50c0873e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:52.391859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161eb8f5-afde-4fd8-8bd6-f3c50c0873e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:52.393283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161eb8f5-afde-4fd8-8bd6-f3c50c0873e1 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:52.404505 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 283/563] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:52.405776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a354da7-7a71-4cce-9002-4ad02dc061f7 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:52.406065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a354da7-7a71-4cce-9002-4ad02dc061f7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:52.406344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a354da7-7a71-4cce-9002-4ad02dc061f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:52.423516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5a354da7-7a71-4cce-9002-4ad02dc061f7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:52.425081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5a354da7-7a71-4cce-9002-4ad02dc061f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:52.446389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e3842-5b81-4ce4-b965-97af19d7a5d6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:52.460181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:52.482484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a5796-5cb8-410c-9b3f-4766f99f7180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:52.483324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a5796-5cb8-410c-9b3f-4766f99f7180 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:52.483688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a5796-5cb8-410c-9b3f-4766f99f7180 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:52.483957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a5796-5cb8-410c-9b3f-4766f99f7180 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:52.491784 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 284/564] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:52.493118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bf293-3c17-4c2e-b69c-46e3decb6249 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:52.493405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bf293-3c17-4c2e-b69c-46e3decb6249 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:52.493684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bf293-3c17-4c2e-b69c-46e3decb6249 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:52.494936 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 285/565] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:52.495629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bf293-3c17-4c2e-b69c-46e3decb6249 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:52.500516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a5796-5cb8-410c-9b3f-4766f99f7180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:52.502075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a5796-5cb8-410c-9b3f-4766f99f7180 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:52.523313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-dc5a5796-5cb8-410c-9b3f-4766f99f7180 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:52.523313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:52.523313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:52.523313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:52.523313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:52.523313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:52.523313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:52.523313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:52.523313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:52.523313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:52.523313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:52.523313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:52.523313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:52.523313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:52.523313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:52.524314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:52.524314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:52.524314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:52.524314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:52.524314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:52.524314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:52.524314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:52.524314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:52.524314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:52.524314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:52.524314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:52.524314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:52.524314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:52.524314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:52.524314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:52.524314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:52.524314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:52.525237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:52.525237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:52.525237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:52.525237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:52.525237 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 281/566] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:52.525526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a5796-5cb8-410c-9b3f-4766f99f7180 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:52.569330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:52.610102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bf293-3c17-4c2e-b69c-46e3decb6249 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:52.621296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a5796-5cb8-410c-9b3f-4766f99f7180 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:52.643469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729abaf7-2c0c-4a45-8c95-ce331d000cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:52.644327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729abaf7-2c0c-4a45-8c95-ce331d000cd8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:52.644595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729abaf7-2c0c-4a45-8c95-ce331d000cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:52.644862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729abaf7-2c0c-4a45-8c95-ce331d000cd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:52.654802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729abaf7-2c0c-4a45-8c95-ce331d000cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:52.655132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d7173-16a8-45f2-833f-0f27ce94f600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:52.655921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d7173-16a8-45f2-833f-0f27ce94f600 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:52.656233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d7173-16a8-45f2-833f-0f27ce94f600 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:52.656506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d7173-16a8-45f2-833f-0f27ce94f600 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:52.662498 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-729abaf7-2c0c-4a45-8c95-ce331d000cd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:52.662498 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:52.662498 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:52.662498 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:52.662498 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:52.662498 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:52.662498 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:52.662498 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:52.662498 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:52.662498 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:52.662498 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:52.662498 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:52.662498 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:52.662498 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:52.662498 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:52.662498 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:52.663511 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:52.663511 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:52.663511 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:52.663511 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:52.663511 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:52.663511 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:52.663511 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:52.663511 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:52.663511 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:52.663511 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:52.663511 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:52.663511 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:52.663511 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:52.663511 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:52.663511 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:52.663511 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:52.664698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:52.664698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:52.664698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:52.664698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:52.664698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:52.664698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:52.664698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:52.664698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:52.664698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:52.664698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:52.664698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:52.664698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:52.665371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d7173-16a8-45f2-833f-0f27ce94f600 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:52.665450 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 286/567] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:44:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:52.665520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d7173-16a8-45f2-833f-0f27ce94f600 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:52.665597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fc63a-b0d9-4edc-9df3-e1f3e27ba84c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:52.665597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fc63a-b0d9-4edc-9df3-e1f3e27ba84c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:52.665597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fc63a-b0d9-4edc-9df3-e1f3e27ba84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:52.681944 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-ea4d7173-16a8-45f2-833f-0f27ce94f600 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:52.681944 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:52.681944 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:52.681944 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:52.681944 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:52.681944 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:52.681944 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:52.681944 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:52.681944 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:52.681944 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:52.681944 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:52.681944 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:52.681944 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:44:52.681944 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:44:52.681944 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:44:52.682919 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:44:52.682919 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:52.682919 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:52.682919 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:52.682919 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:52.682919 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:52.682919 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:52.682919 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:52.682919 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:52.682919 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:52.682919 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:52.682919 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:52.682919 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:52.682919 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:52.682919 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:52.682919 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:52.682919 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:52.683811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:44:52.683811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:44:52.683811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:44:52.683811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:44:52.683811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:44:52.683811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:44:52.683811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:52.683811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:52.684815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-616fc63a-b0d9-4edc-9df3-e1f3e27ba84c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:52.684815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-616fc63a-b0d9-4edc-9df3-e1f3e27ba84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:52.684973 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 282/568] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:52.684973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d7173-16a8-45f2-833f-0f27ce94f600 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:52.709811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:52.752023 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 287/569] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:52.752808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fc63a-b0d9-4edc-9df3-e1f3e27ba84c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:52.797689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d7173-16a8-45f2-833f-0f27ce94f600 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:52.800806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:52.833908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbc3dc-953c-4936-bfce-6916831e560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:52.834914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbc3dc-953c-4936-bfce-6916831e560b None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:52.835369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbc3dc-953c-4936-bfce-6916831e560b None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:52.835637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbc3dc-953c-4936-bfce-6916831e560b None admin] PATH_INFO: `/v3/roles/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:52.845474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bbc3dc-953c-4936-bfce-6916831e560b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:52.851833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fc63a-b0d9-4edc-9df3-e1f3e27ba84c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:52.853277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-b8bbc3dc-953c-4936-bfce-6916831e560b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:52.853277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:52.853277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:52.853277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:52.853277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:52.853277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:52.853277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:52.853277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:52.853277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:52.853277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:52.853277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:52.853277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:52.853277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:52.853277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:52.853277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:52.853277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:52.854268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:52.854268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:52.854268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:52.854268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:52.854268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:52.854268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:52.854268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:52.854268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:52.854268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:52.854268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:52.854268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:52.854268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:52.854268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:52.854268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:52.854268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:52.854268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:52.855169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:52.855169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:52.855169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:52.855169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:52.855169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:52.855169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:52.855169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:52.855169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:52.855169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:52.855169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:52.855169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:52.855169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:52.855169 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 283/570] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:44:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:52.855914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbc3dc-953c-4936-bfce-6916831e560b None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:52.890043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb1a2e-f648-45df-96f4-dc4e80c91edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:52.890687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb1a2e-f648-45df-96f4-dc4e80c91edb None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:52.890971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb1a2e-f648-45df-96f4-dc4e80c91edb None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:52.891243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb1a2e-f648-45df-96f4-dc4e80c91edb None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:52.891958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb1a2e-f648-45df-96f4-dc4e80c91edb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:52.892293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb1a2e-f648-45df-96f4-dc4e80c91edb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:52.893708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb1a2e-f648-45df-96f4-dc4e80c91edb None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:52.904878 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 288/571] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:52.905651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb1a2e-f648-45df-96f4-dc4e80c91edb None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:52.930914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:52.960405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbc3dc-953c-4936-bfce-6916831e560b None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:52.993154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab947923-8c3d-45c1-9e68-13a520b1515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:52.993806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab947923-8c3d-45c1-9e68-13a520b1515f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:52.994084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab947923-8c3d-45c1-9e68-13a520b1515f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:52.994354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab947923-8c3d-45c1-9e68-13a520b1515f None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:52.995088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab947923-8c3d-45c1-9e68-13a520b1515f None admin] RBAC: Adding query filter params (name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:52.995393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab947923-8c3d-45c1-9e68-13a520b1515f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:52.996812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab947923-8c3d-45c1-9e68-13a520b1515f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:53.004017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb1a2e-f648-45df-96f4-dc4e80c91edb None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:53.004580 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 284/572] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:44:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:53.005365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab947923-8c3d-45c1-9e68-13a520b1515f None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:53.033489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:53.037607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9c637-1af6-497e-bd0f-1fbc285d7fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:53.038225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9c637-1af6-497e-bd0f-1fbc285d7fa6 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:53.038534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9c637-1af6-497e-bd0f-1fbc285d7fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:53.038803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9c637-1af6-497e-bd0f-1fbc285d7fa6 None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:53.039547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9c637-1af6-497e-bd0f-1fbc285d7fa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:53.039849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9c637-1af6-497e-bd0f-1fbc285d7fa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:53.041339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9c637-1af6-497e-bd0f-1fbc285d7fa6 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:53.053823 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 289/573] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:53.054697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9c637-1af6-497e-bd0f-1fbc285d7fa6 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:53.114127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab947923-8c3d-45c1-9e68-13a520b1515f None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:53.136646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:53.148701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad11d25-3e9b-426a-8b6a-ed30a8695290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:53.149490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad11d25-3e9b-426a-8b6a-ed30a8695290 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:53.149767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad11d25-3e9b-426a-8b6a-ed30a8695290 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:53.150038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad11d25-3e9b-426a-8b6a-ed30a8695290 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:53.155694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9c637-1af6-497e-bd0f-1fbc285d7fa6 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:53.159854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad11d25-3e9b-426a-8b6a-ed30a8695290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:53.167602 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-dad11d25-3e9b-426a-8b6a-ed30a8695290 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:53.167602 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:53.167602 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:53.167602 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:53.167602 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:53.167602 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:53.167602 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:53.167602 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:53.167602 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:53.167602 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:53.167602 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:53.167602 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:53.167602 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:53.167602 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:53.167602 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:53.167602 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:53.168644 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:53.168644 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:53.168644 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:53.168644 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:53.168644 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:53.168644 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:53.168644 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:53.168644 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:53.168644 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:53.168644 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:53.168644 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:53.168644 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:53.168644 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:53.168644 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:53.168644 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:53.168644 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:53.169505 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:53.169505 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:53.169505 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:53.169505 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:53.169505 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:53.169505 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:53.169505 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:53.169505 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:53.169505 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:53.169505 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:53.169505 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:53.169505 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:53.169505 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 285/574] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:53.170210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad11d25-3e9b-426a-8b6a-ed30a8695290 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:53.194428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97369f45-59fc-4639-b6a4-173fd8086567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:53.195097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97369f45-59fc-4639-b6a4-173fd8086567 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:53.195377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97369f45-59fc-4639-b6a4-173fd8086567 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:53.195656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97369f45-59fc-4639-b6a4-173fd8086567 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:53.196412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97369f45-59fc-4639-b6a4-173fd8086567 None admin] RBAC: Adding query filter params (name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:53.196714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97369f45-59fc-4639-b6a4-173fd8086567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:53.198093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97369f45-59fc-4639-b6a4-173fd8086567 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:53.206058 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 290/575] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:53.206831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97369f45-59fc-4639-b6a4-173fd8086567 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:53.255216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:53.270020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad11d25-3e9b-426a-8b6a-ed30a8695290 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:53.303929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97369f45-59fc-4639-b6a4-173fd8086567 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:53.304148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ab0e7-c12d-4adf-824b-11b6971f9537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:53.304948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ab0e7-c12d-4adf-824b-11b6971f9537 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:53.305233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ab0e7-c12d-4adf-824b-11b6971f9537 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:53.305506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ab0e7-c12d-4adf-824b-11b6971f9537 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:53.312064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ab0e7-c12d-4adf-824b-11b6971f9537 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:53.313517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ab0e7-c12d-4adf-824b-11b6971f9537 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:53.327477 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-095ab0e7-c12d-4adf-824b-11b6971f9537 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:53.327477 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:53.327477 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:53.327477 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:53.327477 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:53.327477 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:53.327477 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:53.327477 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:53.327477 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:53.327477 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:53.327477 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:53.327477 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:53.327477 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:44:53.327477 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:44:53.327477 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:44:53.328628 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:44:53.328628 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:53.328628 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:53.328628 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:53.328628 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:53.328628 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:53.328628 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:53.328628 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:53.328628 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:53.328628 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:53.328628 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:53.328628 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:53.328628 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:53.328628 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:53.328628 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:53.328628 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:53.328628 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:53.334758 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:44:53.334758 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:44:53.334758 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:44:53.334758 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:44:53.334758 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:44:53.334758 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:44:53.334758 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:53.334758 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:53.334758 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 286/576] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:53.334758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ab0e7-c12d-4adf-824b-11b6971f9537 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:53.338708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a70860-ba58-4d0a-b780-4dda775cfb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:53.339495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a70860-ba58-4d0a-b780-4dda775cfb11 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:53.339776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a70860-ba58-4d0a-b780-4dda775cfb11 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:53.340063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a70860-ba58-4d0a-b780-4dda775cfb11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:53.350548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a70860-ba58-4d0a-b780-4dda775cfb11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:53.352001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a70860-ba58-4d0a-b780-4dda775cfb11 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:53.354514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:53.369742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-42a70860-ba58-4d0a-b780-4dda775cfb11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:53.369742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:53.369742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:53.369742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:53.369742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:53.369742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:53.369742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:53.369742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:53.369742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:53.369742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:53.369742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:53.369742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:53.369742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:53.369742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:53.369742 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:53.370690 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:53.370690 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:53.370690 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:53.370690 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:53.370690 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:53.370690 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:53.370690 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:53.370690 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:53.370690 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:53.370690 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:53.370690 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:53.370690 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:53.370690 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:53.370690 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:53.370690 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:53.370690 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:53.370690 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:53.371602 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:53.371602 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:53.371602 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:53.371602 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:53.371602 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 291/577] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:53.371927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a70860-ba58-4d0a-b780-4dda775cfb11 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:53.438520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ab0e7-c12d-4adf-824b-11b6971f9537 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:53.472986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb2b02-4c62-4160-8c1e-63f986e9381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:53.473871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb2b02-4c62-4160-8c1e-63f986e9381c None admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:53.474151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb2b02-4c62-4160-8c1e-63f986e9381c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:53.474422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb2b02-4c62-4160-8c1e-63f986e9381c None admin] PATH_INFO: `/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/aa3e290fa5384f9bac3fec771cebf653/roles/843bfd29577143dcb23593a75d4ee5a0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:53.476132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a70860-ba58-4d0a-b780-4dda775cfb11 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:53.489054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb2b02-4c62-4160-8c1e-63f986e9381c None admin] RBAC: Authorizing `identity:create_grant(project_id=001bf63308784f4eb62e64d6f82c8354, user_id=aa3e290fa5384f9bac3fec771cebf653, role_id=843bfd29577143dcb23593a75d4ee5a0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:53.490497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb2b02-4c62-4160-8c1e-63f986e9381c None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:53.493697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:53.505047 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 287/578] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:44:53 2022] PUT /identity/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/aa3e290fa5384f9bac3fec771cebf653/roles/843bfd29577143dcb23593a75d4ee5a0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:44:53.505898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb2b02-4c62-4160-8c1e-63f986e9381c None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:53.515510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6aef45-90a7-4b72-8c8a-0f3e3561aada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:53.516231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6aef45-90a7-4b72-8c8a-0f3e3561aada None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:53.516519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6aef45-90a7-4b72-8c8a-0f3e3561aada None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:53.516792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6aef45-90a7-4b72-8c8a-0f3e3561aada None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:53.517537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6aef45-90a7-4b72-8c8a-0f3e3561aada None admin] RBAC: Adding query filter params (name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:53.517846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6aef45-90a7-4b72-8c8a-0f3e3561aada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:53.519296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6aef45-90a7-4b72-8c8a-0f3e3561aada None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:53.529676 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 292/579] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:53.530703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6aef45-90a7-4b72-8c8a-0f3e3561aada None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:53.607416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:53.641588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb2b02-4c62-4160-8c1e-63f986e9381c None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:53.653542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6aef45-90a7-4b72-8c8a-0f3e3561aada None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:53.679851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28de238-bc9a-44d7-b8fa-484dc8f9e6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:53.681009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28de238-bc9a-44d7-b8fa-484dc8f9e6f1 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:53.681290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28de238-bc9a-44d7-b8fa-484dc8f9e6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:53.681559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28de238-bc9a-44d7-b8fa-484dc8f9e6f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:53.690254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1fc05-5e09-4f78-a4de-355cd82aa36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:53.690916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1fc05-5e09-4f78-a4de-355cd82aa36a None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:53.691193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1fc05-5e09-4f78-a4de-355cd82aa36a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:53.691464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1fc05-5e09-4f78-a4de-355cd82aa36a None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:53.692262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1fc05-5e09-4f78-a4de-355cd82aa36a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:53.692567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1fc05-5e09-4f78-a4de-355cd82aa36a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:53.693778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28de238-bc9a-44d7-b8fa-484dc8f9e6f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:53.694014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1fc05-5e09-4f78-a4de-355cd82aa36a None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:53.695008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28de238-bc9a-44d7-b8fa-484dc8f9e6f1 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:53.709574 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 293/580] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:53.710740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1fc05-5e09-4f78-a4de-355cd82aa36a None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:53.717378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-a28de238-bc9a-44d7-b8fa-484dc8f9e6f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:53.717378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:53.717378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:53.717378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:53.717378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:53.717378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:53.717378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:53.717378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:53.717378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:53.717378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:53.717378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:53.717378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:53.717378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:53.717378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:53.717378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:53.718367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:53.718367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:53.718367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:53.718367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:53.718367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:53.718367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:53.718367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:53.718367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:53.718367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:53.718367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:53.718367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:53.718367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:53.718367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:53.718367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:53.718367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:53.718367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:53.718367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:53.720329 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:53.720329 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:53.720329 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:53.720329 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:53.720329 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 288/581] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:53.720329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28de238-bc9a-44d7-b8fa-484dc8f9e6f1 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:53.772016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:53.822889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1fc05-5e09-4f78-a4de-355cd82aa36a None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:53.828622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28de238-bc9a-44d7-b8fa-484dc8f9e6f1 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:53.841300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:53.860467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f08b4a-6d91-4c0c-8f4f-7efdb971bac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:53.861058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f08b4a-6d91-4c0c-8f4f-7efdb971bac1 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:53.861339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f08b4a-6d91-4c0c-8f4f-7efdb971bac1 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:53.861618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f08b4a-6d91-4c0c-8f4f-7efdb971bac1 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:53.862329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f08b4a-6d91-4c0c-8f4f-7efdb971bac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:53.862636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f08b4a-6d91-4c0c-8f4f-7efdb971bac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:53.864018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f08b4a-6d91-4c0c-8f4f-7efdb971bac1 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:53.864834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07c98c-fd16-44c5-be91-19a0fb1a1009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:53.865626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07c98c-fd16-44c5-be91-19a0fb1a1009 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:53.865905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07c98c-fd16-44c5-be91-19a0fb1a1009 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:53.866233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07c98c-fd16-44c5-be91-19a0fb1a1009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:53.876296 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 294/582] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:53.877070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f08b4a-6d91-4c0c-8f4f-7efdb971bac1 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:53.883681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07c98c-fd16-44c5-be91-19a0fb1a1009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:53.885201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07c98c-fd16-44c5-be91-19a0fb1a1009 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:53.904647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-4e07c98c-fd16-44c5-be91-19a0fb1a1009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:53.904647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:53.904647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:53.904647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:53.904647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:53.904647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:53.904647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:53.904647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:53.904647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:53.904647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:53.904647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:53.904647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:53.904647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:53.904647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:53.904647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:53.905611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:53.905611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:53.905611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:53.905611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:53.905611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:53.905611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:53.905611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:53.905611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:53.905611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:53.905611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:53.905611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:53.905611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:53.905611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:53.905611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:53.905611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:53.905611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:53.905611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:53.906524 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:53.906524 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:53.906524 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:53.906524 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:53.906524 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 289/583] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:53.907554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07c98c-fd16-44c5-be91-19a0fb1a1009 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:53.986854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f08b4a-6d91-4c0c-8f4f-7efdb971bac1 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:54.012811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:54.017050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07c98c-fd16-44c5-be91-19a0fb1a1009 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:54.022899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed65c8e-1019-4bd0-a95b-92ae468676a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:54.023509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed65c8e-1019-4bd0-a95b-92ae468676a7 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:54.023944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed65c8e-1019-4bd0-a95b-92ae468676a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:54.024259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed65c8e-1019-4bd0-a95b-92ae468676a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:54.025081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed65c8e-1019-4bd0-a95b-92ae468676a7 None admin] RBAC: Adding query filter params (role.id=843bfd29577143dcb23593a75d4ee5a0, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=55367f643da048c5ab61ab6325552256) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:54.025399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed65c8e-1019-4bd0-a95b-92ae468676a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:54.026847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed65c8e-1019-4bd0-a95b-92ae468676a7 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:54.032643 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 295/584] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:44:53 2022] GET /identity/v3/role_assignments?user.id=55367f643da048c5ab61ab6325552256&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=843bfd29577143dcb23593a75d4ee5a0 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:54.033727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed65c8e-1019-4bd0-a95b-92ae468676a7 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:54.074131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91824c4-9a89-4cd5-9b1d-d817341cf871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:54.074878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91824c4-9a89-4cd5-9b1d-d817341cf871 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:54.075174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91824c4-9a89-4cd5-9b1d-d817341cf871 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:54.075449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91824c4-9a89-4cd5-9b1d-d817341cf871 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:54.076554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91824c4-9a89-4cd5-9b1d-d817341cf871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:54.076867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91824c4-9a89-4cd5-9b1d-d817341cf871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:54.079331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91824c4-9a89-4cd5-9b1d-d817341cf871 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:54.090439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:54.099237 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 290/585] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:54.100418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91824c4-9a89-4cd5-9b1d-d817341cf871 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:54.164493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed65c8e-1019-4bd0-a95b-92ae468676a7 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:54.203700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610c82b-aab9-4a07-805b-33cd50d0d574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:54.204586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610c82b-aab9-4a07-805b-33cd50d0d574 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:54.204879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610c82b-aab9-4a07-805b-33cd50d0d574 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:54.205159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610c82b-aab9-4a07-805b-33cd50d0d574 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:54.214307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610c82b-aab9-4a07-805b-33cd50d0d574 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:54.215650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91824c4-9a89-4cd5-9b1d-d817341cf871 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:54.216113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610c82b-aab9-4a07-805b-33cd50d0d574 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:54.232205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-4610c82b-aab9-4a07-805b-33cd50d0d574 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 02 20:44:54.232205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:54.232205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:54.232205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:54.232205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:54.232205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:54.232205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:54.232205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:54.232205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:54.232205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:54.232205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:54.232205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:54.232205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:44:54.232205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:44:54.232205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:44:54.232205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:44:54.233261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:54.233261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:54.233261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:44:54.233261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:54.233261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:44:54.233261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:54.233261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:54.233261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:54.233261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:54.233261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:54.233261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:54.233261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:54.233261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:54.233261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:54.233261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:54.233261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:54.233261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:54.233261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:54.234960 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:54.234960 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:54.234960 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:44:54.234960 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:44:54.234960 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:44:54.234960 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:44:54.234960 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:44:54.234960 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:44:54.234960 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 02 20:44:54.234960 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:54.234960 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 296/586] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:54.234960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610c82b-aab9-4a07-805b-33cd50d0d574 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:54.257086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8bd09-d643-48a0-a2f6-05fcfaab0189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:54.258492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8bd09-d643-48a0-a2f6-05fcfaab0189 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:54.258779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8bd09-d643-48a0-a2f6-05fcfaab0189 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:54.259058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8bd09-d643-48a0-a2f6-05fcfaab0189 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:54.259785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8bd09-d643-48a0-a2f6-05fcfaab0189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:54.260113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8bd09-d643-48a0-a2f6-05fcfaab0189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:54.261497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8bd09-d643-48a0-a2f6-05fcfaab0189 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:54.278381 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 291/587] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:54.279661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8bd09-d643-48a0-a2f6-05fcfaab0189 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:54.304293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:54.376671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610c82b-aab9-4a07-805b-33cd50d0d574 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:54.378951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:54.389284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8bd09-d643-48a0-a2f6-05fcfaab0189 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:54.417531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3f37c-c0bf-4858-a733-d602814dcb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:54.418596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f37c-c0bf-4858-a733-d602814dcb21 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:54.418988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f37c-c0bf-4858-a733-d602814dcb21 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:54.419362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f37c-c0bf-4858-a733-d602814dcb21 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:54.427934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3f37c-c0bf-4858-a733-d602814dcb21 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:54.429591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3f37c-c0bf-4858-a733-d602814dcb21 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:54.434546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe4dce-9cf7-455c-a6cb-db9c5bb5486b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:54.435399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe4dce-9cf7-455c-a6cb-db9c5bb5486b None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:54.435843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe4dce-9cf7-455c-a6cb-db9c5bb5486b None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:54.436334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe4dce-9cf7-455c-a6cb-db9c5bb5486b None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:54.437626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe4dce-9cf7-455c-a6cb-db9c5bb5486b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:54.438098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe4dce-9cf7-455c-a6cb-db9c5bb5486b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:54.439667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe4dce-9cf7-455c-a6cb-db9c5bb5486b None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:54.445849 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-ebd3f37c-c0bf-4858-a733-d602814dcb21 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 20:44:54.445849 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:54.445849 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:54.445849 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:54.445849 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:54.445849 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:54.445849 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:54.445849 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:54.445849 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:54.445849 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:54.445849 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:54.445849 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:54.445849 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:44:54.445849 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:44:54.445849 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:44:54.445849 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:44:54.446924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:54.446924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:54.446924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:44:54.446924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:54.446924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:44:54.446924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:54.446924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:54.446924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:54.446924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:54.446924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:54.446924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:54.446924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:54.446924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:54.446924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:54.446924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:54.446924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:54.446924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:54.446924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:54.447915 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:54.447915 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:54.447915 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:44:54.447915 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:44:54.447915 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:44:54.447915 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:44:54.447915 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:44:54.447915 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:44:54.447915 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 20:44:54.447915 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:54.447915 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 297/588] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:44:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:54.448737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3f37c-c0bf-4858-a733-d602814dcb21 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:54.464585 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 292/589] 10.222.0.43 () {56 vars in 1137 bytes} [Sat Jul 2 20:44:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:54.466732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe4dce-9cf7-455c-a6cb-db9c5bb5486b None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:54.560349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3f37c-c0bf-4858-a733-d602814dcb21 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:54.579419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:54.598104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f26ab7-ba70-41e5-9fee-405bcef218ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:54.599128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f26ab7-ba70-41e5-9fee-405bcef218ea None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:54.599507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f26ab7-ba70-41e5-9fee-405bcef218ea None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:54.599900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f26ab7-ba70-41e5-9fee-405bcef218ea None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:54.608554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe4dce-9cf7-455c-a6cb-db9c5bb5486b None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:54.608798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f26ab7-ba70-41e5-9fee-405bcef218ea None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:54.610520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f26ab7-ba70-41e5-9fee-405bcef218ea None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:54.626402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-70f26ab7-ba70-41e5-9fee-405bcef218ea None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 02 20:44:54.626402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:54.626402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:54.626402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:54.626402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:54.626402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:54.626402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:54.626402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:54.626402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:54.626402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:54.626402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:54.626402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:54.626402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:44:54.626402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:44:54.626402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:44:54.626402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:44:54.627626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:54.627626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:54.627626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:44:54.627626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:54.627626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:44:54.627626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:54.627626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:54.627626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:54.627626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:54.627626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:54.627626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:54.627626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:54.627626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:54.627626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:54.627626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:54.627626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:54.627626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:54.627626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:54.628850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:54.628850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:54.628850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:44:54.628850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:44:54.628850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:44:54.628850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:44:54.628850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:44:54.628850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:44:54.628850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 02 20:44:54.628850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:54.635188 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 298/590] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:44:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:54.635188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f26ab7-ba70-41e5-9fee-405bcef218ea None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:54.659033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cec1f-b121-486b-bf0b-1418d525ec7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:54.659976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:54.661690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cec1f-b121-486b-bf0b-1418d525ec7d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:54.662188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cec1f-b121-486b-bf0b-1418d525ec7d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:54.663026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cec1f-b121-486b-bf0b-1418d525ec7d None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:54.664425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cec1f-b121-486b-bf0b-1418d525ec7d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:54.665498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cec1f-b121-486b-bf0b-1418d525ec7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:54.667851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cec1f-b121-486b-bf0b-1418d525ec7d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:54.694464 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 293/591] 10.222.0.43 () {56 vars in 1137 bytes} [Sat Jul 2 20:44:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:54.695685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cec1f-b121-486b-bf0b-1418d525ec7d None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:54.749265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f26ab7-ba70-41e5-9fee-405bcef218ea None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:54.793610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881edd32-bcf0-4e9d-aafe-acf765b2ef6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:54.794701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881edd32-bcf0-4e9d-aafe-acf765b2ef6c None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:54.795132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881edd32-bcf0-4e9d-aafe-acf765b2ef6c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:54.795554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881edd32-bcf0-4e9d-aafe-acf765b2ef6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:54.809061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881edd32-bcf0-4e9d-aafe-acf765b2ef6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:54.811409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881edd32-bcf0-4e9d-aafe-acf765b2ef6c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:54.829698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cec1f-b121-486b-bf0b-1418d525ec7d None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:54.834046 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-881edd32-bcf0-4e9d-aafe-acf765b2ef6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:54.834046 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:54.834046 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:54.834046 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:54.834046 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:54.834046 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:54.834046 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:54.834046 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:54.834046 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:54.834046 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:54.834046 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:54.834046 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:54.834046 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:54.834046 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:54.834046 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:54.835127 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:54.835127 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:54.835127 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:54.835127 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:54.835127 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:54.835127 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:54.835127 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:54.835127 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:54.835127 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:54.835127 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:54.835127 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:54.835127 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:54.835127 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:54.835127 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:54.835127 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:54.835127 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:54.835127 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:54.836277 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:54.836277 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:54.836277 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:54.836277 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:54.838287 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 299/592] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:54.839227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881edd32-bcf0-4e9d-aafe-acf765b2ef6c None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:54.868895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bee565-a4a5-4990-a318-25b52fe7d80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:54.869765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bee565-a4a5-4990-a318-25b52fe7d80b None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:54.870152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bee565-a4a5-4990-a318-25b52fe7d80b None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:54.870522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bee565-a4a5-4990-a318-25b52fe7d80b None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:54.871489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bee565-a4a5-4990-a318-25b52fe7d80b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:54.871955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bee565-a4a5-4990-a318-25b52fe7d80b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:54.873585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bee565-a4a5-4990-a318-25b52fe7d80b None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:54.876270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:54.898175 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 294/593] 10.222.0.43 () {56 vars in 1139 bytes} [Sat Jul 2 20:44:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:54.898175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bee565-a4a5-4990-a318-25b52fe7d80b None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:54.923967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:54.950916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881edd32-bcf0-4e9d-aafe-acf765b2ef6c None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:54.985076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5ca0d-57af-4984-bc5f-3d30233bdc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:54.986158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5ca0d-57af-4984-bc5f-3d30233bdc04 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:54.986617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5ca0d-57af-4984-bc5f-3d30233bdc04 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:54.987067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5ca0d-57af-4984-bc5f-3d30233bdc04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:54.998017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5ca0d-57af-4984-bc5f-3d30233bdc04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:54.999742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5ca0d-57af-4984-bc5f-3d30233bdc04 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:55.005066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bee565-a4a5-4990-a318-25b52fe7d80b None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:55.017412 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-8cf5ca0d-57af-4984-bc5f-3d30233bdc04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:55.017412 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:55.017412 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:55.017412 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:55.017412 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:55.017412 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:55.017412 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:55.017412 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:55.017412 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:55.017412 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:55.017412 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:55.017412 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:55.017412 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:55.017412 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:55.017412 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:55.018321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:55.018321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:55.018321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:55.018321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:55.018321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:55.018321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:55.018321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:55.018321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:55.018321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:55.018321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:55.018321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:55.018321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:55.018321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:55.018321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:55.018321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:55.018321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:55.018321 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:55.019254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:55.019254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:55.019254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:55.019254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:55.021230 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 300/594] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:55.022221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5ca0d-57af-4984-bc5f-3d30233bdc04 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:55.043011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f6bdc-09c6-4670-9b2e-064da0c82891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:55.043771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f6bdc-09c6-4670-9b2e-064da0c82891 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:55.044076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f6bdc-09c6-4670-9b2e-064da0c82891 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:55.044396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f6bdc-09c6-4670-9b2e-064da0c82891 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:55.045578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f6bdc-09c6-4670-9b2e-064da0c82891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:55.045578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f6bdc-09c6-4670-9b2e-064da0c82891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:55.046972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f6bdc-09c6-4670-9b2e-064da0c82891 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:55.060707 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 295/595] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:55.061703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f6bdc-09c6-4670-9b2e-064da0c82891 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:55.127268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5ca0d-57af-4984-bc5f-3d30233bdc04 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:55.127813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:55.154529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:55.165130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021fc53-97c3-4c8b-b457-b346f902558f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:55.166194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021fc53-97c3-4c8b-b457-b346f902558f None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:55.166707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021fc53-97c3-4c8b-b457-b346f902558f None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:55.167196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021fc53-97c3-4c8b-b457-b346f902558f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:55.179081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021fc53-97c3-4c8b-b457-b346f902558f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:55.180873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021fc53-97c3-4c8b-b457-b346f902558f None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:55.181215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f6bdc-09c6-4670-9b2e-064da0c82891 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:55.199162 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-3021fc53-97c3-4c8b-b457-b346f902558f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:55.199162 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:55.199162 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:55.199162 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:55.199162 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:55.199162 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:55.199162 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:55.199162 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:55.199162 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:55.199162 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:55.199162 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:55.199162 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:55.199162 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:55.199162 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:55.199162 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:55.200208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:55.200208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:55.200208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:55.200208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:55.200208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:55.200208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:55.200208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:55.200208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:55.200208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:55.200208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:55.200208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:55.200208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:55.200208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:55.200208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:55.200208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:55.200208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:55.200208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:55.201155 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:55.201155 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:55.201155 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:55.201155 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:55.207687 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 301/596] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:55.209265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021fc53-97c3-4c8b-b457-b346f902558f None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:55.217771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9a606-cd6c-4e89-8ac7-159054369d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:55.218446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9a606-cd6c-4e89-8ac7-159054369d8e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:55.218730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9a606-cd6c-4e89-8ac7-159054369d8e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:55.219006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9a606-cd6c-4e89-8ac7-159054369d8e None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:55.219728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9a606-cd6c-4e89-8ac7-159054369d8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:55.220064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9a606-cd6c-4e89-8ac7-159054369d8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:55.221698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9a606-cd6c-4e89-8ac7-159054369d8e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:55.237355 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 296/597] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:55.238423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9a606-cd6c-4e89-8ac7-159054369d8e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:55.317285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021fc53-97c3-4c8b-b457-b346f902558f None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:55.350303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9a606-cd6c-4e89-8ac7-159054369d8e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:55.352704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93d4ac-b8c5-4d0a-af11-f2835baabc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:55.353761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93d4ac-b8c5-4d0a-af11-f2835baabc86 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:55.354251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93d4ac-b8c5-4d0a-af11-f2835baabc86 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:55.354725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93d4ac-b8c5-4d0a-af11-f2835baabc86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:55.362275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93d4ac-b8c5-4d0a-af11-f2835baabc86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:55.364014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93d4ac-b8c5-4d0a-af11-f2835baabc86 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:55.366408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:55.380303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-8e93d4ac-b8c5-4d0a-af11-f2835baabc86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:55.380303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:55.380303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:55.380303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:55.380303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:55.380303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:55.380303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:55.380303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:55.380303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:55.380303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:55.380303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:55.380303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:55.380303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:44:55.380303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:44:55.380303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:44:55.381294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:44:55.381294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:55.381294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:55.381294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:55.381294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:55.381294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:55.381294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:55.381294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:55.381294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:55.381294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:55.381294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:55.381294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:55.381294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:55.381294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:55.381294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:55.381294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:55.381294 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:55.382230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:44:55.382230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:44:55.382230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:44:55.382230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:44:55.382230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:44:55.382230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:44:55.382230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:55.382230 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:55.384752 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 302/598] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:55.385801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93d4ac-b8c5-4d0a-af11-f2835baabc86 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:55.391158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1e1d7-1d19-4fc1-9851-7718a8d273ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:55.392155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1e1d7-1d19-4fc1-9851-7718a8d273ac None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:55.392343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1e1d7-1d19-4fc1-9851-7718a8d273ac None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:55.392783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1e1d7-1d19-4fc1-9851-7718a8d273ac None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:55.393308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1e1d7-1d19-4fc1-9851-7718a8d273ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:55.393612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1e1d7-1d19-4fc1-9851-7718a8d273ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:55.394994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1e1d7-1d19-4fc1-9851-7718a8d273ac None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:55.412212 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 297/599] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:55.412212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1e1d7-1d19-4fc1-9851-7718a8d273ac None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:55.440912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:55.507554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93d4ac-b8c5-4d0a-af11-f2835baabc86 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:55.521737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1e1d7-1d19-4fc1-9851-7718a8d273ac None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:55.545838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c1096-0dcd-41ae-adf4-948930b36fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:55.546864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c1096-0dcd-41ae-adf4-948930b36fb8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:55.547509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c1096-0dcd-41ae-adf4-948930b36fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:55.547780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c1096-0dcd-41ae-adf4-948930b36fb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:55.555499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c1096-0dcd-41ae-adf4-948930b36fb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:55.557205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c1096-0dcd-41ae-adf4-948930b36fb8 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:55.559563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a8696-97be-425b-be42-a3d3e2145b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:55.560515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a8696-97be-425b-be42-a3d3e2145b70 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:55.560964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a8696-97be-425b-be42-a3d3e2145b70 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:55.561382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a8696-97be-425b-be42-a3d3e2145b70 None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:55.562314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a8696-97be-425b-be42-a3d3e2145b70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:55.562768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a8696-97be-425b-be42-a3d3e2145b70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:55.564367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a8696-97be-425b-be42-a3d3e2145b70 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:55.572695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-715c1096-0dcd-41ae-adf4-948930b36fb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:55.572695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:55.572695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:55.572695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:55.572695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:55.572695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:55.572695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:55.572695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:55.572695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:55.572695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:55.572695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:55.572695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:55.572695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:44:55.572695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:44:55.572695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:44:55.573814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:44:55.573814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:55.573814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:55.573814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:55.573814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:55.573814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:55.573814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:55.573814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:55.573814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:55.573814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:55.573814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:55.573814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:55.573814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:55.573814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:55.573814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:55.573814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:55.573814 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:55.574839 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:44:55.574839 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:44:55.574839 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:44:55.574839 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:44:55.574839 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:44:55.574839 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:44:55.574839 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:55.574839 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:55.575465 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 303/600] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:55.576598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c1096-0dcd-41ae-adf4-948930b36fb8 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:55.581054 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 298/601] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:44:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:55.582204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a8696-97be-425b-be42-a3d3e2145b70 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:55.620611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:55.686708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:55.691008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c1096-0dcd-41ae-adf4-948930b36fb8 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:55.696585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a8696-97be-425b-be42-a3d3e2145b70 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:55.728218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9c30e-6a73-4d2e-bc2a-a66289474199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:55.729288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9c30e-6a73-4d2e-bc2a-a66289474199 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:55.729572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9c30e-6a73-4d2e-bc2a-a66289474199 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:55.729919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9c30e-6a73-4d2e-bc2a-a66289474199 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:55.735059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8747e2-31a0-4886-abd6-2dd9f1d67abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:55.735930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8747e2-31a0-4886-abd6-2dd9f1d67abd None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:55.736417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8747e2-31a0-4886-abd6-2dd9f1d67abd None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:55.736864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8747e2-31a0-4886-abd6-2dd9f1d67abd None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:55.737573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9c30e-6a73-4d2e-bc2a-a66289474199 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:55.738090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8747e2-31a0-4886-abd6-2dd9f1d67abd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:55.738572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8747e2-31a0-4886-abd6-2dd9f1d67abd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:55.739238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9c30e-6a73-4d2e-bc2a-a66289474199 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:55.740376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8747e2-31a0-4886-abd6-2dd9f1d67abd None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:55.753843 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 299/602] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:44:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:55.754613 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-8bb9c30e-6a73-4d2e-bc2a-a66289474199 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:55.754613 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:55.754613 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:55.754613 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:55.754613 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:55.754613 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:55.754613 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:55.754613 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:55.754613 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:55.754613 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:55.754613 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:55.754613 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:55.754613 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:44:55.754613 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:44:55.754613 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:44:55.755526 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:44:55.755526 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:55.755526 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:55.755526 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:55.755526 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:55.755526 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:55.755526 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:55.755526 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:55.755526 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:55.755526 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:55.755526 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:55.755526 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:55.755526 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:55.755526 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:55.755526 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:55.755526 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:55.755526 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:55.756491 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:44:55.756491 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:44:55.756491 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:44:55.756491 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:44:55.756491 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:44:55.756491 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:44:55.756491 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:55.756491 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:55.757790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8747e2-31a0-4886-abd6-2dd9f1d67abd None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:55.760189 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 304/603] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:55.761191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9c30e-6a73-4d2e-bc2a-a66289474199 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:55.879293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:55.887079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8747e2-31a0-4886-abd6-2dd9f1d67abd None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:55.896662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9c30e-6a73-4d2e-bc2a-a66289474199 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:55.922509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa40ae6-e67a-4d79-8dce-8cbd37f7e53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:55.923687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa40ae6-e67a-4d79-8dce-8cbd37f7e53d None admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:55.924143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa40ae6-e67a-4d79-8dce-8cbd37f7e53d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:55.924429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa40ae6-e67a-4d79-8dce-8cbd37f7e53d None admin] PATH_INFO: `/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/3de168a603b0478fa8de67f6d206e1a5/roles/843bfd29577143dcb23593a75d4ee5a0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:55.933381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa15970-0450-4a94-b7c1-ed8236f9e28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:55.934752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa15970-0450-4a94-b7c1-ed8236f9e28a None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:55.935041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa15970-0450-4a94-b7c1-ed8236f9e28a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:55.935316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa15970-0450-4a94-b7c1-ed8236f9e28a None admin] PATH_INFO: `/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/f9ea416fd4d4420b9112507ef1a68bf7/roles/843bfd29577143dcb23593a75d4ee5a0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:55.944014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa40ae6-e67a-4d79-8dce-8cbd37f7e53d None admin] RBAC: Authorizing `identity:create_grant(project_id=001bf63308784f4eb62e64d6f82c8354, user_id=3de168a603b0478fa8de67f6d206e1a5, role_id=843bfd29577143dcb23593a75d4ee5a0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:55.945479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa40ae6-e67a-4d79-8dce-8cbd37f7e53d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:55.952579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa15970-0450-4a94-b7c1-ed8236f9e28a None admin] RBAC: Authorizing `identity:create_grant(project_id=001bf63308784f4eb62e64d6f82c8354, user_id=f9ea416fd4d4420b9112507ef1a68bf7, role_id=843bfd29577143dcb23593a75d4ee5a0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:55.954226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa15970-0450-4a94-b7c1-ed8236f9e28a None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:55.966606 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 300/604] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:44:55 2022] PUT /identity/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/3de168a603b0478fa8de67f6d206e1a5/roles/843bfd29577143dcb23593a75d4ee5a0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:44:55.966606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa40ae6-e67a-4d79-8dce-8cbd37f7e53d None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:55.979203 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 305/605] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:44:55 2022] PUT /identity/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/f9ea416fd4d4420b9112507ef1a68bf7/roles/843bfd29577143dcb23593a75d4ee5a0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:44:55.982791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69706c-fbb8-4791-a85e-aee740a8d5bb None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:55.983685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69706c-fbb8-4791-a85e-aee740a8d5bb None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:55.984259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69706c-fbb8-4791-a85e-aee740a8d5bb None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:55.987625 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 306/606] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:55.997622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1cdbc-45c6-49ff-a084-568d1f213b6b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:55.998171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1cdbc-45c6-49ff-a084-568d1f213b6b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:55.998688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1cdbc-45c6-49ff-a084-568d1f213b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:56.061621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c0a1cdbc-45c6-49ff-a084-568d1f213b6b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:56.063459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c0a1cdbc-45c6-49ff-a084-568d1f213b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:56.066831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:56.094375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa40ae6-e67a-4d79-8dce-8cbd37f7e53d None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:56.136089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bf554-8606-4138-b77c-6ea75f8aba74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:56.136782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bf554-8606-4138-b77c-6ea75f8aba74 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:56.137442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bf554-8606-4138-b77c-6ea75f8aba74 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:56.137780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bf554-8606-4138-b77c-6ea75f8aba74 None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:56.138591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bf554-8606-4138-b77c-6ea75f8aba74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:56.138905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bf554-8606-4138-b77c-6ea75f8aba74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:56.140504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bf554-8606-4138-b77c-6ea75f8aba74 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:56.155453 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 301/607] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:44:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:56.162091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bf554-8606-4138-b77c-6ea75f8aba74 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:56.180601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:56.283763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bf554-8606-4138-b77c-6ea75f8aba74 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:56.325427 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 307/608] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:56.330795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fffc9-2b23-4d97-a56d-517e84dd62d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:56.331786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fffc9-2b23-4d97-a56d-517e84dd62d3 None admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:56.332166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fffc9-2b23-4d97-a56d-517e84dd62d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:56.332508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fffc9-2b23-4d97-a56d-517e84dd62d3 None admin] PATH_INFO: `/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/684732cf5a004fb084ce0e523398c970/roles/843bfd29577143dcb23593a75d4ee5a0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:56.349031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fffc9-2b23-4d97-a56d-517e84dd62d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=001bf63308784f4eb62e64d6f82c8354, user_id=684732cf5a004fb084ce0e523398c970, role_id=843bfd29577143dcb23593a75d4ee5a0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:56.350590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fffc9-2b23-4d97-a56d-517e84dd62d3 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:56.367358 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 302/609] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:44:56 2022] PUT /identity/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/684732cf5a004fb084ce0e523398c970/roles/843bfd29577143dcb23593a75d4ee5a0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 20:44:56.378226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1cdbc-45c6-49ff-a084-568d1f213b6b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:56.436450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b180d81-2202-4c38-8c52-ddb9f53780d8 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:56.436803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b180d81-2202-4c38-8c52-ddb9f53780d8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:56.437010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b180d81-2202-4c38-8c52-ddb9f53780d8 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:56.438789 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 303/610] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:44:56.444517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eea71-16e4-4d9b-a082-e5fe32690a3b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:56.444888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eea71-16e4-4d9b-a082-e5fe32690a3b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:56.445170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eea71-16e4-4d9b-a082-e5fe32690a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:56.464421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c42eea71-16e4-4d9b-a082-e5fe32690a3b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:56.465746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c42eea71-16e4-4d9b-a082-e5fe32690a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:56.520343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1cdbc-45c6-49ff-a084-568d1f213b6b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:56.536004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:56.561130 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 304/611] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:56.579424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17febcdb-b090-44b6-bf72-d3dc11a750e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:56.580265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17febcdb-b090-44b6-bf72-d3dc11a750e7 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:56.580545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17febcdb-b090-44b6-bf72-d3dc11a750e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:56.580814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17febcdb-b090-44b6-bf72-d3dc11a750e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:56.588989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42eea71-16e4-4d9b-a082-e5fe32690a3b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:56.599877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17febcdb-b090-44b6-bf72-d3dc11a750e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:56.607756 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-17febcdb-b090-44b6-bf72-d3dc11a750e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:56.607756 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:56.607756 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:56.607756 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:56.607756 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:56.607756 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:56.607756 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:56.607756 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:56.607756 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:56.607756 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:56.607756 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:56.607756 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:56.607756 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:56.607756 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:56.607756 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:56.607756 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:56.608790 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:56.608790 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:56.608790 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:56.608790 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:56.608790 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:56.608790 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:56.608790 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:56.608790 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:56.608790 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:56.608790 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:56.608790 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:56.608790 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:56.608790 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:56.608790 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:56.608790 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:56.608790 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:56.609698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:56.609698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:56.609698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:56.609698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:56.609698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:56.609698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:56.609698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:56.609698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:56.609698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:56.609698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:56.609698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:56.609698 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:56.611226 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 308/612] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:44:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:56.612920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:56.621101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17febcdb-b090-44b6-bf72-d3dc11a750e7 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:56.745541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17febcdb-b090-44b6-bf72-d3dc11a750e7 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:56.756759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42eea71-16e4-4d9b-a082-e5fe32690a3b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:56.792955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb089326-4288-40b7-9172-b7e443746773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:56.793814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb089326-4288-40b7-9172-b7e443746773 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:56.794314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb089326-4288-40b7-9172-b7e443746773 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:56.794593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb089326-4288-40b7-9172-b7e443746773 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:56.795264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871b048-5553-4e26-9299-1a7403a8f8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:56.796185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871b048-5553-4e26-9299-1a7403a8f8b2 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:56.796660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871b048-5553-4e26-9299-1a7403a8f8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:56.797126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871b048-5553-4e26-9299-1a7403a8f8b2 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:56.798087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871b048-5553-4e26-9299-1a7403a8f8b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:56.798586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871b048-5553-4e26-9299-1a7403a8f8b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:56.804824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871b048-5553-4e26-9299-1a7403a8f8b2 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:56.807803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb089326-4288-40b7-9172-b7e443746773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:56.819072 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 309/613] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:44:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:56.826961 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-fb089326-4288-40b7-9172-b7e443746773 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:56.826961 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:56.826961 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:56.826961 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:56.826961 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:56.826961 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:56.826961 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:56.826961 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:56.826961 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:56.826961 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:56.826961 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:56.826961 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:56.826961 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:56.826961 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:56.826961 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:56.826961 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:56.827992 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:56.827992 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:56.827992 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:56.827992 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:56.827992 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:56.827992 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:56.827992 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:56.827992 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:56.827992 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:56.827992 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:56.827992 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:56.827992 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:56.827992 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:56.827992 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:56.827992 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:56.827992 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:56.828941 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:56.828941 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:56.828941 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:56.828941 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:56.828941 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:56.828941 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:56.828941 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:56.828941 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:56.828941 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:56.828941 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:56.828941 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:56.828941 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:56.828941 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 305/614] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:44:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:56.830641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871b048-5553-4e26-9299-1a7403a8f8b2 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:56.839167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb089326-4288-40b7-9172-b7e443746773 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:56.888418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:56.944079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb089326-4288-40b7-9172-b7e443746773 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:56.973197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:56.989917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3c9b0-e41d-4cb6-b7f1-55b87bcb4638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:56.990604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3c9b0-e41d-4cb6-b7f1-55b87bcb4638 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:56.990885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3c9b0-e41d-4cb6-b7f1-55b87bcb4638 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:56.991158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3c9b0-e41d-4cb6-b7f1-55b87bcb4638 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:56.991905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3c9b0-e41d-4cb6-b7f1-55b87bcb4638 None admin] RBAC: Adding query filter params (name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:56.992261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3c9b0-e41d-4cb6-b7f1-55b87bcb4638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:56.993832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3c9b0-e41d-4cb6-b7f1-55b87bcb4638 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:57.013307 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 306/615] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:44:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:57.019187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3c9b0-e41d-4cb6-b7f1-55b87bcb4638 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:57.094081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871b048-5553-4e26-9299-1a7403a8f8b2 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:57.164916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3c9b0-e41d-4cb6-b7f1-55b87bcb4638 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:57.168773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8797ad-03fd-40a1-b28a-1897ad3720be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:57.169584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8797ad-03fd-40a1-b28a-1897ad3720be None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:57.169865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8797ad-03fd-40a1-b28a-1897ad3720be None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:57.170142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8797ad-03fd-40a1-b28a-1897ad3720be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:57.172151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:57.197150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8797ad-03fd-40a1-b28a-1897ad3720be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:57.198634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8797ad-03fd-40a1-b28a-1897ad3720be None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:57.203625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c67698-6535-430a-bfa3-86d939a1435b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:57.204482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c67698-6535-430a-bfa3-86d939a1435b None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:57.204765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c67698-6535-430a-bfa3-86d939a1435b None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:57.205044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c67698-6535-430a-bfa3-86d939a1435b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:57.229898 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-8d8797ad-03fd-40a1-b28a-1897ad3720be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:57.229898 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:57.229898 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:57.229898 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:57.229898 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:57.229898 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:57.229898 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:57.229898 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:57.229898 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:57.229898 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:57.229898 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:57.229898 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:57.229898 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:57.229898 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:57.229898 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:57.230968 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:57.230968 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:57.230968 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:57.230968 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:57.230968 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:57.230968 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:57.230968 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:57.230968 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:57.230968 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:57.230968 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:57.230968 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:57.230968 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:57.230968 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:57.230968 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:57.230968 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:57.230968 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:57.230968 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:57.231887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:57.231887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:57.231887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:57.231887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:57.231887 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 310/616] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:57.233816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c67698-6535-430a-bfa3-86d939a1435b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:57.235297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c67698-6535-430a-bfa3-86d939a1435b None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:57.240994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8797ad-03fd-40a1-b28a-1897ad3720be None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:57.259684 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-a4c67698-6535-430a-bfa3-86d939a1435b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:57.259684 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:57.259684 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:57.259684 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:57.259684 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:57.259684 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:57.259684 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:57.259684 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:57.259684 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:57.259684 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:57.259684 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:57.259684 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:57.259684 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:57.259684 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:57.259684 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:57.261731 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:57.261731 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:57.261731 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:57.261731 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:57.261731 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:57.261731 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:57.261731 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:57.261731 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:57.261731 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:57.261731 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:57.261731 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:57.261731 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:57.261731 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:57.261731 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:57.261731 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:57.261731 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:57.261731 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:57.263925 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:57.263925 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:57.263925 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:57.263925 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:57.263925 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 307/617] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:57.272944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c67698-6535-430a-bfa3-86d939a1435b None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:57.391189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8797ad-03fd-40a1-b28a-1897ad3720be None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:57.405628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:57.406750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c67698-6535-430a-bfa3-86d939a1435b None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:57.439916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca727611-e0ec-421a-b9ef-fabfa5bb2239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:57.440712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca727611-e0ec-421a-b9ef-fabfa5bb2239 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:57.441006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca727611-e0ec-421a-b9ef-fabfa5bb2239 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:57.441273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca727611-e0ec-421a-b9ef-fabfa5bb2239 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:57.442000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca727611-e0ec-421a-b9ef-fabfa5bb2239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:57.442308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca727611-e0ec-421a-b9ef-fabfa5bb2239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:57.443909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca727611-e0ec-421a-b9ef-fabfa5bb2239 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:57.456723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a21abc-e3f9-442b-b483-b9711050edbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:57.457384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a21abc-e3f9-442b-b483-b9711050edbc None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:57.457662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a21abc-e3f9-442b-b483-b9711050edbc None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:57.457929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a21abc-e3f9-442b-b483-b9711050edbc None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:57.458635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a21abc-e3f9-442b-b483-b9711050edbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:57.458934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a21abc-e3f9-442b-b483-b9711050edbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:57.460313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a21abc-e3f9-442b-b483-b9711050edbc None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:57.474550 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 308/618] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:57.476798 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 311/619] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:57.482482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a21abc-e3f9-442b-b483-b9711050edbc None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:57.484208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca727611-e0ec-421a-b9ef-fabfa5bb2239 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:57.516556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:57.641036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a21abc-e3f9-442b-b483-b9711050edbc None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:57.679187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe9bb7-9f3b-4d12-8347-09f1f5eb63b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:57.680290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe9bb7-9f3b-4d12-8347-09f1f5eb63b8 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:57.680668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe9bb7-9f3b-4d12-8347-09f1f5eb63b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:57.681035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe9bb7-9f3b-4d12-8347-09f1f5eb63b8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:57.689416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe9bb7-9f3b-4d12-8347-09f1f5eb63b8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:57.690988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe9bb7-9f3b-4d12-8347-09f1f5eb63b8 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:57.699759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca727611-e0ec-421a-b9ef-fabfa5bb2239 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:57.706633 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-dfbe9bb7-9f3b-4d12-8347-09f1f5eb63b8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 02 20:44:57.706633 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:57.706633 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:57.706633 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:57.706633 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:57.706633 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:57.706633 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:57.706633 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:57.706633 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:57.706633 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:57.706633 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:57.706633 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:57.706633 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:44:57.706633 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:44:57.706633 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:44:57.706633 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:44:57.707793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:57.707793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:57.707793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:44:57.707793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:57.707793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:44:57.707793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:57.707793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:57.707793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:57.707793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:57.707793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:57.707793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:57.707793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:57.707793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:57.707793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:57.707793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:57.707793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:57.707793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:57.707793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:57.709020 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:57.709020 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:57.709020 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:44:57.709020 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:44:57.709020 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:44:57.709020 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:44:57.709020 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:44:57.709020 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:44:57.709020 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 02 20:44:57.709020 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:57.710945 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 309/620] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:44:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:57.720062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe9bb7-9f3b-4d12-8347-09f1f5eb63b8 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:57.765230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5ab65-2a81-47b1-adfa-5ca4af08b38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:57.766169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5ab65-2a81-47b1-adfa-5ca4af08b38a None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:57.766450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5ab65-2a81-47b1-adfa-5ca4af08b38a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:57.766778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5ab65-2a81-47b1-adfa-5ca4af08b38a None admin] PATH_INFO: `/v3/users/nova` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:57.775365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5ab65-2a81-47b1-adfa-5ca4af08b38a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:57.777317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5ab65-2a81-47b1-adfa-5ca4af08b38a None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:57.793597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-d8c5ab65-2a81-47b1-adfa-5ca4af08b38a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:44:57.793597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:57.793597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:57.793597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:57.793597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:57.793597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:57.793597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:57.793597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:57.793597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:57.793597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:57.793597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:57.793597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:57.793597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:44:57.793597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:44:57.793597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:44:57.793597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:44:57.794600 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:57.794600 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:57.794600 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:44:57.794600 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:57.794600 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:44:57.794600 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:44:57.794600 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:57.794600 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:57.794600 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:57.794600 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:57.794600 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:57.794600 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:57.794600 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:57.794600 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:57.794600 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:57.794600 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:57.794600 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:57.794600 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:57.795565 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:57.795565 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:57.795565 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:44:57.795565 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:44:57.795565 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:44:57.795565 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:44:57.795565 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:44:57.795565 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:44:57.795565 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:44:57.795565 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:57.795565 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 312/621] 10.222.0.43 () {56 vars in 1093 bytes} [Sat Jul 2 20:44:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:57.802005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5ab65-2a81-47b1-adfa-5ca4af08b38a None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:57.847317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:57.864491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:57.887016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe9bb7-9f3b-4d12-8347-09f1f5eb63b8 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:57.922250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88db8c-cfab-455e-9019-6d17306a9592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:57.923116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88db8c-cfab-455e-9019-6d17306a9592 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:57.923445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88db8c-cfab-455e-9019-6d17306a9592 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:57.923726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88db8c-cfab-455e-9019-6d17306a9592 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:57.924907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88db8c-cfab-455e-9019-6d17306a9592 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:57.925218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88db8c-cfab-455e-9019-6d17306a9592 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:57.926696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88db8c-cfab-455e-9019-6d17306a9592 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:57.953175 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 310/622] 10.222.0.43 () {56 vars in 1135 bytes} [Sat Jul 2 20:44:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:57.954645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88db8c-cfab-455e-9019-6d17306a9592 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:58.020288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5ab65-2a81-47b1-adfa-5ca4af08b38a None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:58.064971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88db8c-cfab-455e-9019-6d17306a9592 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:58.100950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af710f0-9c66-49cd-9ecb-41a3f7eeb0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:58.101752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af710f0-9c66-49cd-9ecb-41a3f7eeb0ae None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:58.102029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af710f0-9c66-49cd-9ecb-41a3f7eeb0ae None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:58.102411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af710f0-9c66-49cd-9ecb-41a3f7eeb0ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:58.109392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:58.110714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a700ae-7303-41d9-a912-1992d703bfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:58.111512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a700ae-7303-41d9-a912-1992d703bfc8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:58.111803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a700ae-7303-41d9-a912-1992d703bfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:58.112221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a700ae-7303-41d9-a912-1992d703bfc8 None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:58.113058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af710f0-9c66-49cd-9ecb-41a3f7eeb0ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:58.113172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a700ae-7303-41d9-a912-1992d703bfc8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:58.113439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a700ae-7303-41d9-a912-1992d703bfc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:58.114623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af710f0-9c66-49cd-9ecb-41a3f7eeb0ae None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:58.114988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a700ae-7303-41d9-a912-1992d703bfc8 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:58.133175 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-9af710f0-9c66-49cd-9ecb-41a3f7eeb0ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:58.133175 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:58.133175 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:58.133175 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:58.133175 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:58.133175 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:58.133175 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:58.133175 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:58.133175 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:58.133175 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:58.133175 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:58.133175 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:58.133175 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:58.133175 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:58.133175 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:58.134156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:58.134156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:58.134156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:58.134156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:58.134156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:58.134156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:58.134156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:58.134156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:58.134156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:58.134156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:58.134156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:58.134156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:58.134156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:58.134156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:58.134156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:58.134156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:58.134156 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:58.135081 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:58.135081 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:58.135081 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:58.135081 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:58.135081 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 311/623] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:58.140130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af710f0-9c66-49cd-9ecb-41a3f7eeb0ae None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:58.148099 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 313/624] 10.222.0.43 () {56 vars in 1133 bytes} [Sat Jul 2 20:44:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:58.156487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a700ae-7303-41d9-a912-1992d703bfc8 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:58.246450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af710f0-9c66-49cd-9ecb-41a3f7eeb0ae None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:58.282082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d0fe0-4d41-4a88-b104-603361af8aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:58.282674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d0fe0-4d41-4a88-b104-603361af8aec None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:58.282963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d0fe0-4d41-4a88-b104-603361af8aec None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:58.283244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d0fe0-4d41-4a88-b104-603361af8aec None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:58.284085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d0fe0-4d41-4a88-b104-603361af8aec None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:58.284403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d0fe0-4d41-4a88-b104-603361af8aec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:58.285888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d0fe0-4d41-4a88-b104-603361af8aec None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:58.298048 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 312/625] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:58.304152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d0fe0-4d41-4a88-b104-603361af8aec None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:58.320367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:58.336969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a700ae-7303-41d9-a912-1992d703bfc8 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:58.360494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:58.412628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d0fe0-4d41-4a88-b104-603361af8aec None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:58.436843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d9f31-e047-4613-a316-ba4e95f85698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:58.437631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d9f31-e047-4613-a316-ba4e95f85698 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:58.438037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d9f31-e047-4613-a316-ba4e95f85698 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:58.438429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d9f31-e047-4613-a316-ba4e95f85698 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:58.449546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ceee23-292e-4b8c-ada9-34ad0cd3ac5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:58.451201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ceee23-292e-4b8c-ada9-34ad0cd3ac5e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:58.451797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ceee23-292e-4b8c-ada9-34ad0cd3ac5e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:58.452567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ceee23-292e-4b8c-ada9-34ad0cd3ac5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:58.461650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ceee23-292e-4b8c-ada9-34ad0cd3ac5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:58.463439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ceee23-292e-4b8c-ada9-34ad0cd3ac5e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:58.478696 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-17ceee23-292e-4b8c-ada9-34ad0cd3ac5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:58.478696 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:58.478696 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:58.478696 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:58.478696 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:58.478696 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:58.478696 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:58.478696 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:58.478696 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:58.478696 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:58.478696 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:58.478696 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:58.478696 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:44:58.478696 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:44:58.478696 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:44:58.479844 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:44:58.479844 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:58.479844 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:58.479844 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:58.479844 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:58.479844 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:58.479844 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:58.479844 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:58.479844 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:58.479844 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:58.479844 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:58.479844 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:58.479844 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:58.479844 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:58.479844 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:58.479844 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:58.479844 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:58.481118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:44:58.481118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:44:58.481118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:44:58.481118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:44:58.481118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:44:58.481118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:44:58.481118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:58.481118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:58.483406 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 313/626] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:58.489094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ceee23-292e-4b8c-ada9-34ad0cd3ac5e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:58.550828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d9f31-e047-4613-a316-ba4e95f85698 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:58.552644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d9f31-e047-4613-a316-ba4e95f85698 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:58.665637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:58.680508 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 314/627] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:44:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 20:44:58.687273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d9f31-e047-4613-a316-ba4e95f85698 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:58.742210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ceee23-292e-4b8c-ada9-34ad0cd3ac5e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:58.754498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:58.786241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bc5c1-b70b-452a-a344-e45527711df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:58.788077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bc5c1-b70b-452a-a344-e45527711df3 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:58.789155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bc5c1-b70b-452a-a344-e45527711df3 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:58.789783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bc5c1-b70b-452a-a344-e45527711df3 None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:58.793133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bc5c1-b70b-452a-a344-e45527711df3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:58.793720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bc5c1-b70b-452a-a344-e45527711df3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:58.795369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bc5c1-b70b-452a-a344-e45527711df3 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:58.820685 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 314/628] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:44:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:44:58.827522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bc5c1-b70b-452a-a344-e45527711df3 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:58.870779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d9f31-e047-4613-a316-ba4e95f85698 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:58.915159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a886f-8429-47f4-91d6-d6a7e5177661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:58.915956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a886f-8429-47f4-91d6-d6a7e5177661 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:58.916260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a886f-8429-47f4-91d6-d6a7e5177661 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:58.916530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a886f-8429-47f4-91d6-d6a7e5177661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:58.927207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a886f-8429-47f4-91d6-d6a7e5177661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:58.928699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a886f-8429-47f4-91d6-d6a7e5177661 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:58.946840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-4c9a886f-8429-47f4-91d6-d6a7e5177661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:58.946840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:58.946840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:58.946840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:58.946840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:58.946840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:58.946840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:58.946840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:58.946840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:58.946840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:58.946840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:58.946840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:58.946840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:44:58.946840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:44:58.946840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:44:58.947848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:44:58.947848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:58.947848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:58.947848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:58.947848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:58.947848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:58.947848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:58.947848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:58.947848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:58.947848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:58.947848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:58.947848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:58.947848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:58.947848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:58.947848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:58.947848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:58.947848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:58.948802 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:44:58.948802 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:44:58.948802 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:44:58.948802 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:58.949503 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 315/629] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:44:58.954616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d9c13-91c7-47d7-9158-fe3b1b277cca None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:58.954616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d9c13-91c7-47d7-9158-fe3b1b277cca None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:58.954616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d9c13-91c7-47d7-9158-fe3b1b277cca None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:58.954616 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 316/630] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:58.955199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d9c13-91c7-47d7-9158-fe3b1b277cca None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:58.975944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bc5c1-b70b-452a-a344-e45527711df3 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:59.016929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:59.018785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4c400-0efe-468c-bbce-ca6f86008335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:59.020076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c400-0efe-468c-bbce-ca6f86008335 None admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:59.020663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c400-0efe-468c-bbce-ca6f86008335 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:59.021202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c400-0efe-468c-bbce-ca6f86008335 None admin] PATH_INFO: `/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/55367f643da048c5ab61ab6325552256/roles/843bfd29577143dcb23593a75d4ee5a0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:59.037426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4c400-0efe-468c-bbce-ca6f86008335 None admin] RBAC: Authorizing `identity:create_grant(project_id=001bf63308784f4eb62e64d6f82c8354, user_id=55367f643da048c5ab61ab6325552256, role_id=843bfd29577143dcb23593a75d4ee5a0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:59.039132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4c400-0efe-468c-bbce-ca6f86008335 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:59.060783 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 315/631] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:44:58 2022] PUT /identity/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/55367f643da048c5ab61ab6325552256/roles/843bfd29577143dcb23593a75d4ee5a0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:44:59.062824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c569d75-ea43-4cd1-9a00-061b92f50c24 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:59.063118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c569d75-ea43-4cd1-9a00-061b92f50c24 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:59.064867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c569d75-ea43-4cd1-9a00-061b92f50c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:59.101178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4c569d75-ea43-4cd1-9a00-061b92f50c24 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:59.103872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4c569d75-ea43-4cd1-9a00-061b92f50c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:59.120371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d9c13-91c7-47d7-9158-fe3b1b277cca None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:59.126039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:59.160933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f1c69-6028-4312-b055-e88b8049aac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:59.161656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f1c69-6028-4312-b055-e88b8049aac3 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:59.161945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f1c69-6028-4312-b055-e88b8049aac3 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:59.162226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f1c69-6028-4312-b055-e88b8049aac3 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:59.162967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f1c69-6028-4312-b055-e88b8049aac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:59.163275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f1c69-6028-4312-b055-e88b8049aac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:59.164740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f1c69-6028-4312-b055-e88b8049aac3 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:59.178426 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 317/632] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:59.179856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf4802-a6f4-4f25-9c34-31750d781392 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:59.180181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf4802-a6f4-4f25-9c34-31750d781392 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:59.180460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf4802-a6f4-4f25-9c34-31750d781392 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:59.181855 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 318/633] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:59.185975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf4802-a6f4-4f25-9c34-31750d781392 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:59.203573 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 316/634] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:59.204988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdabece-2a13-49ea-9ed0-353ef2482599 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:59.205364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdabece-2a13-49ea-9ed0-353ef2482599 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:59.205732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdabece-2a13-49ea-9ed0-353ef2482599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:59.233679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3cdabece-2a13-49ea-9ed0-353ef2482599 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:59.234889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3cdabece-2a13-49ea-9ed0-353ef2482599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:59.308843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf4802-a6f4-4f25-9c34-31750d781392 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:59.310558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:59.312737 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 317/635] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:59.313925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dfb53-42ff-41e1-bc04-b21b49f7005b None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:59.315832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dfb53-42ff-41e1-bc04-b21b49f7005b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:59.315832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dfb53-42ff-41e1-bc04-b21b49f7005b None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:59.316030 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 318/636] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:59.316724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dfb53-42ff-41e1-bc04-b21b49f7005b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:59.350212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90565ae2-39df-456f-97f1-aa366fb25576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:59.351020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90565ae2-39df-456f-97f1-aa366fb25576 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:59.351361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90565ae2-39df-456f-97f1-aa366fb25576 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:59.351580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90565ae2-39df-456f-97f1-aa366fb25576 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:59.358625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90565ae2-39df-456f-97f1-aa366fb25576 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:59.360133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90565ae2-39df-456f-97f1-aa366fb25576 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:59.374028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-90565ae2-39df-456f-97f1-aa366fb25576 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:59.374028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:59.374028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:59.374028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:59.374028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:59.374028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:59.374028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:59.374028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:59.374028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:59.374028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:59.374028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:59.374028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:59.374028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:44:59.374028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:44:59.374028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:44:59.375148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:44:59.375148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:59.375148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:59.375148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:59.375148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:59.375148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:59.375148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:59.375148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:59.375148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:59.375148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:59.375148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:59.375148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:59.375148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:59.375148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:59.375148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:59.375148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:59.375148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:59.376101 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:44:59.376101 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:44:59.376101 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:44:59.376101 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:44:59.376101 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:44:59.376101 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:44:59.376101 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:44:59.376101 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:59.376101 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 319/637] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:44:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:59.376611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8eeab5-463f-4dec-a82f-5a92bf33ec2b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:59.377069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8eeab5-463f-4dec-a82f-5a92bf33ec2b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:59.377069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8eeab5-463f-4dec-a82f-5a92bf33ec2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:59.393789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3b8eeab5-463f-4dec-a82f-5a92bf33ec2b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:59.394985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3b8eeab5-463f-4dec-a82f-5a92bf33ec2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:59.413446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:59.443868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dfb53-42ff-41e1-bc04-b21b49f7005b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:59.466292 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 320/638] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:44:59.472918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8eeab5-463f-4dec-a82f-5a92bf33ec2b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:59.480409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f1406-283b-43bc-993d-86f05e60e8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:59.481380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1406-283b-43bc-993d-86f05e60e8a0 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:59.481754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1406-283b-43bc-993d-86f05e60e8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:59.482126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1406-283b-43bc-993d-86f05e60e8a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:59.493945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f1406-283b-43bc-993d-86f05e60e8a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:59.505485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-334f1406-283b-43bc-993d-86f05e60e8a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:59.505485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:59.505485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:59.505485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:59.505485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:59.505485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:59.505485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:59.505485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:59.505485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:59.505485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:59.505485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:59.505485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:59.505485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:59.505485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:59.505485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:59.505485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:59.506470 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:59.506470 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:59.506470 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:59.506470 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:59.506470 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:59.506470 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:59.506470 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:59.506470 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:59.506470 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:59.506470 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:59.506470 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:59.506470 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:59.506470 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:59.506470 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:59.506470 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:59.506470 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:59.507382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:59.507382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:59.507382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:59.507382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:59.507382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:59.507382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:59.507382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:59.507382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:59.507382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:59.507382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:59.507382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:59.507382 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:44:59.508154 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 319/639] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:44:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:59.509167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f1406-283b-43bc-993d-86f05e60e8a0 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:59.580937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:59.591189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8eeab5-463f-4dec-a82f-5a92bf33ec2b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:59.628795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f1406-283b-43bc-993d-86f05e60e8a0 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:59.629681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb3efd-a4b1-4f85-b66d-ba5af8d424b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:59.630481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb3efd-a4b1-4f85-b66d-ba5af8d424b8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:59.630756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb3efd-a4b1-4f85-b66d-ba5af8d424b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:59.631025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb3efd-a4b1-4f85-b66d-ba5af8d424b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:59.642026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb3efd-a4b1-4f85-b66d-ba5af8d424b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:59.650028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-4ddb3efd-a4b1-4f85-b66d-ba5af8d424b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:59.650028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:59.650028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:59.650028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:59.650028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:59.650028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:59.650028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:59.650028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:59.650028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:59.650028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:59.650028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:59.650028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:59.650028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:59.650028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:59.650028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:59.650028 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:59.650984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:59.650984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:59.650984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:59.650984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:59.650984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:59.650984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:59.650984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:59.650984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:59.650984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:59.650984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:59.650984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:59.650984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:59.650984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:59.650984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:59.650984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:59.650984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:59.651843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:59.651843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:59.651843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:59.651843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:59.651843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:59.651843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:59.651843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:59.651843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:59.651843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:59.651843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:59.651843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:59.651843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:59.651843 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 321/640] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:44:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:59.653304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb3efd-a4b1-4f85-b66d-ba5af8d424b8 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:59.668864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81b470-423f-4b82-bada-19989cd08c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:59.669532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81b470-423f-4b82-bada-19989cd08c6e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:59.669813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81b470-423f-4b82-bada-19989cd08c6e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:59.670374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81b470-423f-4b82-bada-19989cd08c6e None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:59.670859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81b470-423f-4b82-bada-19989cd08c6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:59.671165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81b470-423f-4b82-bada-19989cd08c6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:59.672644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81b470-423f-4b82-bada-19989cd08c6e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:59.680867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:59.688085 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 320/641] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:44:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:59.688973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81b470-423f-4b82-bada-19989cd08c6e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:59.763141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb3efd-a4b1-4f85-b66d-ba5af8d424b8 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:59.793293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81b470-423f-4b82-bada-19989cd08c6e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:59.798078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a6ca4-c797-49b7-ba01-ba48d8ff198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:59.798879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a6ca4-c797-49b7-ba01-ba48d8ff198d None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:59.799160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a6ca4-c797-49b7-ba01-ba48d8ff198d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:59.799754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a6ca4-c797-49b7-ba01-ba48d8ff198d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:59.810208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a6ca4-c797-49b7-ba01-ba48d8ff198d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:44:59.818078 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-9a4a6ca4-c797-49b7-ba01-ba48d8ff198d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:59.818078 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:44:59.818078 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:44:59.818078 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:44:59.818078 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:44:59.818078 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:44:59.818078 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:44:59.818078 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:44:59.818078 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:44:59.818078 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:44:59.818078 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:44:59.818078 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:44:59.818078 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:44:59.818078 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:44:59.818078 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:44:59.818078 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:44:59.819154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:44:59.819154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:44:59.819154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:44:59.819154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:44:59.819154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:44:59.819154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:44:59.819154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:44:59.819154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:44:59.819154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:44:59.819154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:44:59.819154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:44:59.819154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:44:59.819154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:44:59.819154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:44:59.819154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:44:59.819154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:44:59.820079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:44:59.820079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:44:59.820079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:44:59.820079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:44:59.820079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:44:59.820079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:44:59.820079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:44:59.820079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:44:59.820079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:44:59.820079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:44:59.820079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:44:59.820079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:44:59.820079 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 322/642] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:44:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:44:59.820079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a6ca4-c797-49b7-ba01-ba48d8ff198d None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:59.835453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd50e29-12aa-44a1-bffc-36516de2e804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:59.836156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:59.837397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd50e29-12aa-44a1-bffc-36516de2e804 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:59.837594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd50e29-12aa-44a1-bffc-36516de2e804 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:59.837902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd50e29-12aa-44a1-bffc-36516de2e804 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:59.838789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd50e29-12aa-44a1-bffc-36516de2e804 None admin] RBAC: Adding query filter params (name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:59.839336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd50e29-12aa-44a1-bffc-36516de2e804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:59.841723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd50e29-12aa-44a1-bffc-36516de2e804 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:59.855154 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 321/643] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:44:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:59.855154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd50e29-12aa-44a1-bffc-36516de2e804 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:59.914367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:59.927009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a6ca4-c797-49b7-ba01-ba48d8ff198d None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:59.958861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd50e29-12aa-44a1-bffc-36516de2e804 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:59.961350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284146a0-257d-4419-9607-a9e7ecc96cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:59.961733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284146a0-257d-4419-9607-a9e7ecc96cd4 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:59.962014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284146a0-257d-4419-9607-a9e7ecc96cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:59.962294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284146a0-257d-4419-9607-a9e7ecc96cd4 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:59.963033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284146a0-257d-4419-9607-a9e7ecc96cd4 None admin] RBAC: Adding query filter params (name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:44:59.963343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284146a0-257d-4419-9607-a9e7ecc96cd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:59.964814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284146a0-257d-4419-9607-a9e7ecc96cd4 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:59.973096 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 323/644] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:44:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:44:59.973878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284146a0-257d-4419-9607-a9e7ecc96cd4 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:00.005969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d7cdd-4ca8-4032-b635-b0541c51ad16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:00.006622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d7cdd-4ca8-4032-b635-b0541c51ad16 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:00.006908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d7cdd-4ca8-4032-b635-b0541c51ad16 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:00.007190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d7cdd-4ca8-4032-b635-b0541c51ad16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:00.008014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d7cdd-4ca8-4032-b635-b0541c51ad16 None admin] RBAC: Adding query filter params (role.id=843bfd29577143dcb23593a75d4ee5a0, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=aa3e290fa5384f9bac3fec771cebf653) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:00.008413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d7cdd-4ca8-4032-b635-b0541c51ad16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:00.009791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d7cdd-4ca8-4032-b635-b0541c51ad16 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:00.024061 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 322/645] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:44:59 2022] GET /identity/v3/role_assignments?user.id=aa3e290fa5384f9bac3fec771cebf653&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=843bfd29577143dcb23593a75d4ee5a0 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:00.024061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d7cdd-4ca8-4032-b635-b0541c51ad16 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:00.066211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:00.109944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284146a0-257d-4419-9607-a9e7ecc96cd4 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:00.155305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e382bd6-3da2-4489-8eef-00f8f1a9778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:00.156330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e382bd6-3da2-4489-8eef-00f8f1a9778c None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:00.157047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e382bd6-3da2-4489-8eef-00f8f1a9778c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:00.157420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e382bd6-3da2-4489-8eef-00f8f1a9778c None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:00.158527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e382bd6-3da2-4489-8eef-00f8f1a9778c None admin] RBAC: Adding query filter params (name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:00.158938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e382bd6-3da2-4489-8eef-00f8f1a9778c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:00.161329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e382bd6-3da2-4489-8eef-00f8f1a9778c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:00.163288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d7cdd-4ca8-4032-b635-b0541c51ad16 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:00.173377 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 324/646] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:44:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:00.174592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e382bd6-3da2-4489-8eef-00f8f1a9778c None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:00.200355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:00.218197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac8ce1-434c-4f39-9d94-1b5a93a3d70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:00.220088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac8ce1-434c-4f39-9d94-1b5a93a3d70e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:00.220385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac8ce1-434c-4f39-9d94-1b5a93a3d70e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:00.220666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac8ce1-434c-4f39-9d94-1b5a93a3d70e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:00.234559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac8ce1-434c-4f39-9d94-1b5a93a3d70e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:00.236191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac8ce1-434c-4f39-9d94-1b5a93a3d70e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:00.257234 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-2dac8ce1-434c-4f39-9d94-1b5a93a3d70e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:00.257234 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:00.257234 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:00.257234 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:00.257234 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:00.257234 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:00.257234 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:00.257234 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:00.257234 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:00.257234 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:00.257234 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:00.257234 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:00.257234 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:00.257234 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:00.257234 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:00.258493 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:00.258493 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:00.258493 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:00.258493 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:00.258493 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:00.258493 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:00.258493 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:00.258493 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:00.258493 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:00.258493 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:00.258493 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:00.258493 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:00.258493 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:00.258493 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:00.258493 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:00.258493 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:00.258493 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:00.259800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:00.259800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:00.259800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:00.259800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:00.259800 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 323/647] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:00.259800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac8ce1-434c-4f39-9d94-1b5a93a3d70e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:00.301273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e382bd6-3da2-4489-8eef-00f8f1a9778c None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:00.343720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07542136-9b19-4c5e-9619-ad740ee15c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:00.344565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07542136-9b19-4c5e-9619-ad740ee15c5a None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:00.344848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07542136-9b19-4c5e-9619-ad740ee15c5a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:00.345121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07542136-9b19-4c5e-9619-ad740ee15c5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:00.349595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:00.360844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07542136-9b19-4c5e-9619-ad740ee15c5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:00.363061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07542136-9b19-4c5e-9619-ad740ee15c5a None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:00.381397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-07542136-9b19-4c5e-9619-ad740ee15c5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:00.381397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:00.381397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:00.381397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:00.381397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:00.381397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:00.381397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:00.381397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:00.381397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:00.381397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:00.381397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:00.381397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:00.381397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:00.381397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:00.381397 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:00.382370 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:00.382370 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:00.382370 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:00.382370 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:00.382370 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:00.382370 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:00.382370 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:00.382370 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:00.382370 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:00.382370 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:00.382370 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:00.382370 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:00.382370 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:00.382370 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:00.382370 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:00.382370 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:00.382370 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:00.383296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:00.383296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:00.383296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:00.383296 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:00.383296 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 325/648] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:00.383895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07542136-9b19-4c5e-9619-ad740ee15c5a None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:00.386949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac8ce1-434c-4f39-9d94-1b5a93a3d70e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:00.424004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad55109-97ea-4a66-ade5-a99f560fef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:00.425056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad55109-97ea-4a66-ade5-a99f560fef3d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:00.425333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad55109-97ea-4a66-ade5-a99f560fef3d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:00.425603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad55109-97ea-4a66-ade5-a99f560fef3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:00.437858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad55109-97ea-4a66-ade5-a99f560fef3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:00.439278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad55109-97ea-4a66-ade5-a99f560fef3d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:00.462281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-6ad55109-97ea-4a66-ade5-a99f560fef3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:00.462281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:00.462281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:00.462281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:00.462281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:00.462281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:00.462281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:00.462281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:00.462281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:00.462281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:00.462281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:00.462281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:00.462281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:00.462281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:00.462281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:00.463438 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:00.463438 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:00.463438 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:00.463438 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:00.463438 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:00.463438 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:00.463438 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:00.463438 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:00.463438 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:00.463438 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:00.463438 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:00.463438 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:00.463438 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:00.463438 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:00.463438 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:00.463438 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:00.463438 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:00.464591 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:00.464591 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:00.464591 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:00.464591 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:00.466530 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 324/649] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:00.467590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad55109-97ea-4a66-ade5-a99f560fef3d None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:00.502551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:00.524934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07542136-9b19-4c5e-9619-ad740ee15c5a None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:00.570219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603647b7-3a97-4ad0-99b3-251ab1e31d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:00.571762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603647b7-3a97-4ad0-99b3-251ab1e31d16 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:00.572224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603647b7-3a97-4ad0-99b3-251ab1e31d16 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:00.572874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603647b7-3a97-4ad0-99b3-251ab1e31d16 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:00.573977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603647b7-3a97-4ad0-99b3-251ab1e31d16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:00.574481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603647b7-3a97-4ad0-99b3-251ab1e31d16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:00.576618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603647b7-3a97-4ad0-99b3-251ab1e31d16 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:00.581153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad55109-97ea-4a66-ade5-a99f560fef3d None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:00.592549 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 326/650] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:00.593581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603647b7-3a97-4ad0-99b3-251ab1e31d16 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:00.630888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847c837-4384-4fe1-b16d-108005b9871f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:00.631811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847c837-4384-4fe1-b16d-108005b9871f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:00.632264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847c837-4384-4fe1-b16d-108005b9871f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:00.632678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847c837-4384-4fe1-b16d-108005b9871f None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:00.633534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847c837-4384-4fe1-b16d-108005b9871f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:00.634009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847c837-4384-4fe1-b16d-108005b9871f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:00.635517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847c837-4384-4fe1-b16d-108005b9871f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:00.646335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:00.653515 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 325/651] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:00.655018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847c837-4384-4fe1-b16d-108005b9871f None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:00.700243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603647b7-3a97-4ad0-99b3-251ab1e31d16 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:00.743743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0ac5c-ca02-49ef-8362-61e52cc56c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:00.744668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0ac5c-ca02-49ef-8362-61e52cc56c13 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:00.745036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0ac5c-ca02-49ef-8362-61e52cc56c13 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:00.745461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0ac5c-ca02-49ef-8362-61e52cc56c13 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:00.746616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0ac5c-ca02-49ef-8362-61e52cc56c13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:00.747072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0ac5c-ca02-49ef-8362-61e52cc56c13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:00.748825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0ac5c-ca02-49ef-8362-61e52cc56c13 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:00.770815 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 327/652] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:00.771849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0ac5c-ca02-49ef-8362-61e52cc56c13 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:00.773349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:00.792664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847c837-4384-4fe1-b16d-108005b9871f None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:00.839291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca227c88-c6b4-459a-90de-0e748b1abd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:00.840672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227c88-c6b4-459a-90de-0e748b1abd6d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:00.841097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227c88-c6b4-459a-90de-0e748b1abd6d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:00.841547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227c88-c6b4-459a-90de-0e748b1abd6d None admin] PATH_INFO: `/v3/users/glance` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:00.851781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca227c88-c6b4-459a-90de-0e748b1abd6d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:00.853914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca227c88-c6b4-459a-90de-0e748b1abd6d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:00.875643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-ca227c88-c6b4-459a-90de-0e748b1abd6d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 02 20:45:00.875643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:00.875643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:00.875643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:00.875643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:00.875643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:00.875643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:00.875643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:00.875643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:00.875643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:00.875643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:00.875643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:00.875643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:00.875643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:00.875643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:00.875643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:00.876885 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:00.876885 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:00.876885 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:00.876885 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:00.876885 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:00.876885 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:00.876885 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:00.876885 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:00.876885 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:00.876885 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:00.876885 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:00.876885 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:00.876885 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:00.876885 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:00.876885 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:00.876885 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:00.876885 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:00.876885 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:00.878069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:00.878069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:00.878069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:00.878069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:00.878069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:00.878069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:00.878069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:00.878069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:00.878069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 02 20:45:00.878069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:00.880971 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 326/653] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:45:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:00.881938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca227c88-c6b4-459a-90de-0e748b1abd6d None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:00.886028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0ac5c-ca02-49ef-8362-61e52cc56c13 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:00.896058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:00.925505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4efa4f-8ed5-4873-8fa0-d27423e0aee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:00.926937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4efa4f-8ed5-4873-8fa0-d27423e0aee0 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:00.927442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4efa4f-8ed5-4873-8fa0-d27423e0aee0 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:00.927941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4efa4f-8ed5-4873-8fa0-d27423e0aee0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:00.938307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4efa4f-8ed5-4873-8fa0-d27423e0aee0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:00.940732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4efa4f-8ed5-4873-8fa0-d27423e0aee0 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:00.959861 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-6f4efa4f-8ed5-4873-8fa0-d27423e0aee0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 20:45:00.959861 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:00.959861 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:00.959861 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:00.959861 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:00.959861 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:00.959861 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:00.959861 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:00.959861 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:00.959861 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:00.959861 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:00.959861 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:00.959861 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:00.959861 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:00.959861 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:00.959861 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:00.960914 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:00.960914 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:00.960914 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:00.960914 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:00.960914 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:00.960914 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:00.960914 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:00.960914 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:00.960914 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:00.960914 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:00.960914 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:00.960914 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:00.960914 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:00.960914 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:00.960914 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:00.960914 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:00.960914 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:00.960914 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:00.961887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:00.961887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:00.961887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:00.961887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:00.961887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:00.961887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:00.961887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:00.961887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:00.961887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 20:45:00.961887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:00.961887 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 328/654] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:45:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:00.961887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4efa4f-8ed5-4873-8fa0-d27423e0aee0 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:01.011509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca227c88-c6b4-459a-90de-0e748b1abd6d None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:01.054418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ff602-978f-4698-afb4-84d65877e5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:01.055224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ff602-978f-4698-afb4-84d65877e5ff None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:01.055506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ff602-978f-4698-afb4-84d65877e5ff None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:01.055781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ff602-978f-4698-afb4-84d65877e5ff None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:01.064741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ff602-978f-4698-afb4-84d65877e5ff None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:01.066212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ff602-978f-4698-afb4-84d65877e5ff None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:01.084876 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-a35ff602-978f-4698-afb4-84d65877e5ff None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 02 20:45:01.084876 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:01.084876 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:01.084876 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:01.084876 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:01.084876 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:01.084876 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:01.084876 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:01.084876 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:01.084876 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:01.084876 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:01.084876 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:01.084876 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:01.084876 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:01.084876 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:01.084876 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:01.085911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:01.085911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:01.085911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:01.085911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:01.085911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:01.085911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:01.085911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:01.085911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:01.085911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:01.085911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:01.085911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:01.085911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:01.085911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:01.085911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:01.085911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:01.085911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:01.085911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:01.085911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:01.086879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:01.086879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:01.086879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:01.086879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:01.086879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:01.086879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:01.086879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:01.086879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:01.086879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 02 20:45:01.086879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:01.091558 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 327/655] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:45:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:01.091691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ff602-978f-4698-afb4-84d65877e5ff None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:01.098487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4efa4f-8ed5-4873-8fa0-d27423e0aee0 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:01.108161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:01.146810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f2de3-3e33-4a01-99ac-18e2b9ce4010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:01.148076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f2de3-3e33-4a01-99ac-18e2b9ce4010 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:01.149018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f2de3-3e33-4a01-99ac-18e2b9ce4010 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:01.149498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f2de3-3e33-4a01-99ac-18e2b9ce4010 None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:01.150942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f2de3-3e33-4a01-99ac-18e2b9ce4010 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:01.151754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f2de3-3e33-4a01-99ac-18e2b9ce4010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:01.153908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f2de3-3e33-4a01-99ac-18e2b9ce4010 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:01.183464 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 329/656] 10.222.0.43 () {56 vars in 1137 bytes} [Sat Jul 2 20:45:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:01.183464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f2de3-3e33-4a01-99ac-18e2b9ce4010 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:01.219477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ff602-978f-4698-afb4-84d65877e5ff None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:01.225329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:01.258390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7639e61-94d3-4685-90c3-f15063fba947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:01.259060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7639e61-94d3-4685-90c3-f15063fba947 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:01.259340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7639e61-94d3-4685-90c3-f15063fba947 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:01.259611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7639e61-94d3-4685-90c3-f15063fba947 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:01.260475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7639e61-94d3-4685-90c3-f15063fba947 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:01.260782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7639e61-94d3-4685-90c3-f15063fba947 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:01.262254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7639e61-94d3-4685-90c3-f15063fba947 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:01.280390 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 328/657] 10.222.0.43 () {56 vars in 1137 bytes} [Sat Jul 2 20:45:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:01.281287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7639e61-94d3-4685-90c3-f15063fba947 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:01.327966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f2de3-3e33-4a01-99ac-18e2b9ce4010 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:01.359978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:01.366014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e90de4-0e79-4cac-b54d-6c803f0fe3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:01.366807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e90de4-0e79-4cac-b54d-6c803f0fe3d5 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:01.367158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e90de4-0e79-4cac-b54d-6c803f0fe3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:01.367512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e90de4-0e79-4cac-b54d-6c803f0fe3d5 None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:01.368455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e90de4-0e79-4cac-b54d-6c803f0fe3d5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:01.368875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e90de4-0e79-4cac-b54d-6c803f0fe3d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:01.370454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e90de4-0e79-4cac-b54d-6c803f0fe3d5 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:01.389371 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 330/658] 10.222.0.43 () {56 vars in 1139 bytes} [Sat Jul 2 20:45:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:01.394691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e90de4-0e79-4cac-b54d-6c803f0fe3d5 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:01.408837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7639e61-94d3-4685-90c3-f15063fba947 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:01.453620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77041db6-3d29-404b-bd9d-f360360bc6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:01.454265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77041db6-3d29-404b-bd9d-f360360bc6f0 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:01.454530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77041db6-3d29-404b-bd9d-f360360bc6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:01.454798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77041db6-3d29-404b-bd9d-f360360bc6f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:01.483364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:01.501357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e90de4-0e79-4cac-b54d-6c803f0fe3d5 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:01.522096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77041db6-3d29-404b-bd9d-f360360bc6f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:01.523547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77041db6-3d29-404b-bd9d-f360360bc6f0 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:01.537599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba0a51-a490-4eef-a073-dbcc9d5a605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:01.538332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba0a51-a490-4eef-a073-dbcc9d5a605d None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:01.538616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba0a51-a490-4eef-a073-dbcc9d5a605d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:01.538896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba0a51-a490-4eef-a073-dbcc9d5a605d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:01.586944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:01.617425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba0a51-a490-4eef-a073-dbcc9d5a605d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:01.618886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba0a51-a490-4eef-a073-dbcc9d5a605d None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:01.627630 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 329/659] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:45:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:45:01.628513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77041db6-3d29-404b-bd9d-f360360bc6f0 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:01.706952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:01.724144 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 331/660] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:45:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:45:01.725519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf023001-2caf-4904-9ced-96efdbb00751 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:01.725803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf023001-2caf-4904-9ced-96efdbb00751 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:01.726034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf023001-2caf-4904-9ced-96efdbb00751 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:01.731585 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 332/661] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:01.731585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf023001-2caf-4904-9ced-96efdbb00751 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:01.738184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77041db6-3d29-404b-bd9d-f360360bc6f0 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:01.776131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a3da4-a4fa-4212-bba9-a787c8909178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:01.777172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a3da4-a4fa-4212-bba9-a787c8909178 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:01.777656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a3da4-a4fa-4212-bba9-a787c8909178 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:01.778128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a3da4-a4fa-4212-bba9-a787c8909178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:01.813768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:01.842215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf023001-2caf-4904-9ced-96efdbb00751 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:01.852525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a3da4-a4fa-4212-bba9-a787c8909178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:01.854005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a3da4-a4fa-4212-bba9-a787c8909178 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:01.877998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569aa097-1da5-4825-a495-9ca62b6bbff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:01.878792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569aa097-1da5-4825-a495-9ca62b6bbff2 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:01.879070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569aa097-1da5-4825-a495-9ca62b6bbff2 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:01.879539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569aa097-1da5-4825-a495-9ca62b6bbff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:01.889576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569aa097-1da5-4825-a495-9ca62b6bbff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:01.890901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569aa097-1da5-4825-a495-9ca62b6bbff2 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:01.908824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-569aa097-1da5-4825-a495-9ca62b6bbff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:01.908824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:01.908824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:01.908824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:01.908824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:01.908824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:01.908824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:01.908824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:01.908824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:01.908824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:01.908824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:01.908824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:01.908824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:01.908824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:01.908824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:01.909868 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:01.909868 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:01.909868 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:01.909868 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:01.909868 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:01.909868 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:01.909868 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:01.909868 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:01.909868 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:01.909868 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:01.909868 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:01.909868 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:01.909868 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:01.909868 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:01.909868 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:01.909868 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:01.909868 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:01.910837 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:01.910837 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:01.910837 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:01.910837 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:01.910837 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 333/662] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:01.912884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569aa097-1da5-4825-a495-9ca62b6bbff2 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:01.951363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:01.967430 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 330/663] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:45:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:45:01.968842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c941d-98d3-4fa3-9902-a375e801ac47 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:01.969126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c941d-98d3-4fa3-9902-a375e801ac47 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:01.969397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c941d-98d3-4fa3-9902-a375e801ac47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:01.987137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ab9c941d-98d3-4fa3-9902-a375e801ac47 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:01.988442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ab9c941d-98d3-4fa3-9902-a375e801ac47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:02.028431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569aa097-1da5-4825-a495-9ca62b6bbff2 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:02.050605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:02.058869 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 331/664] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:45:02.065174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c941d-98d3-4fa3-9902-a375e801ac47 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:02.065993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32b822-2344-4a36-b83d-77e1802771dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:02.066886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32b822-2344-4a36-b83d-77e1802771dc None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:02.067282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32b822-2344-4a36-b83d-77e1802771dc None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:02.067648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32b822-2344-4a36-b83d-77e1802771dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:02.085544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32b822-2344-4a36-b83d-77e1802771dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:02.087021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32b822-2344-4a36-b83d-77e1802771dc None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:02.105330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-fc32b822-2344-4a36-b83d-77e1802771dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:02.105330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:02.105330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:02.105330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:02.105330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:02.105330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:02.105330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:02.105330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:02.105330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:02.105330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:02.105330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:02.105330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:02.105330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:02.105330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:02.105330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:02.106308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:02.106308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:02.106308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:02.106308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:02.106308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:02.106308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:02.106308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:02.106308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:02.106308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:02.106308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:02.106308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:02.106308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:02.106308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:02.106308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:02.106308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:02.106308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:02.106308 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:02.107244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:02.107244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:02.107244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:02.107244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:02.108343 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 334/665] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:02.109380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32b822-2344-4a36-b83d-77e1802771dc None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:02.177437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c941d-98d3-4fa3-9902-a375e801ac47 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:02.197801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:02.210185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32b822-2344-4a36-b83d-77e1802771dc None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:02.218610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b464a-4864-46c5-b5b8-b0b290e35937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:02.219269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b464a-4864-46c5-b5b8-b0b290e35937 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:02.219543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b464a-4864-46c5-b5b8-b0b290e35937 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:02.220070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b464a-4864-46c5-b5b8-b0b290e35937 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:02.220548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b464a-4864-46c5-b5b8-b0b290e35937 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:02.220847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b464a-4864-46c5-b5b8-b0b290e35937 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:02.222276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b464a-4864-46c5-b5b8-b0b290e35937 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:02.238559 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 332/666] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:02.238559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b464a-4864-46c5-b5b8-b0b290e35937 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:02.251565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fdb7d-fae8-40d8-8307-6208bc67820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:02.252564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fdb7d-fae8-40d8-8307-6208bc67820f None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:02.252849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fdb7d-fae8-40d8-8307-6208bc67820f None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:02.253124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fdb7d-fae8-40d8-8307-6208bc67820f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:02.264361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fdb7d-fae8-40d8-8307-6208bc67820f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:02.265869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fdb7d-fae8-40d8-8307-6208bc67820f None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:02.287534 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-be6fdb7d-fae8-40d8-8307-6208bc67820f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:02.287534 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:02.287534 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:02.287534 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:02.287534 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:02.287534 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:02.287534 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:02.287534 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:02.287534 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:02.287534 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:02.287534 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:02.287534 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:02.287534 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:02.287534 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:02.287534 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:02.288765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:02.288765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:02.288765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:02.288765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:02.288765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:02.288765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:02.288765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:02.288765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:02.288765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:02.288765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:02.288765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:02.288765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:02.288765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:02.288765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:02.288765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:02.288765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:02.288765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:02.289694 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:02.289694 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:02.289694 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:02.289694 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:02.289694 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 335/667] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:02.289694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fdb7d-fae8-40d8-8307-6208bc67820f None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:02.302713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:02.354260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b464a-4864-46c5-b5b8-b0b290e35937 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:02.388675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfd914-4c69-4437-b20f-e7ac9d0875d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:02.389483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfd914-4c69-4437-b20f-e7ac9d0875d6 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:02.389768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfd914-4c69-4437-b20f-e7ac9d0875d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:02.390042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfd914-4c69-4437-b20f-e7ac9d0875d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:02.401103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfd914-4c69-4437-b20f-e7ac9d0875d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:02.401595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fdb7d-fae8-40d8-8307-6208bc67820f None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:02.409378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-3ccfd914-4c69-4437-b20f-e7ac9d0875d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:45:02.409378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:02.409378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:02.409378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:02.409378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:02.409378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:02.409378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:02.409378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:02.409378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:02.409378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:02.409378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:02.409378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:02.409378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:02.409378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:02.409378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:02.409378 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:02.410330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:02.410330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:02.410330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:02.410330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:02.410330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:02.410330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:02.410330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:02.410330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:02.410330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:02.410330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:02.410330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:02.410330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:02.410330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:02.410330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:02.410330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:02.410330 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:02.411189 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:02.411189 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:02.411189 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:02.411189 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:02.411189 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:02.411189 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:02.411189 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:02.411189 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:02.411189 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:02.411189 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:02.411189 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:45:02.411189 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:02.415516 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 333/668] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:45:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:02.416398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfd914-4c69-4437-b20f-e7ac9d0875d6 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:02.438408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e323b0-7535-41af-81aa-95a14976926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:02.439101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e323b0-7535-41af-81aa-95a14976926d None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:02.439388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e323b0-7535-41af-81aa-95a14976926d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:02.439664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e323b0-7535-41af-81aa-95a14976926d None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:02.440418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e323b0-7535-41af-81aa-95a14976926d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:02.440731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e323b0-7535-41af-81aa-95a14976926d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:02.442115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e323b0-7535-41af-81aa-95a14976926d None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:02.450827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:02.456339 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 336/669] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:02.457039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e323b0-7535-41af-81aa-95a14976926d None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:02.527914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfd914-4c69-4437-b20f-e7ac9d0875d6 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:02.543836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:02.560135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e323b0-7535-41af-81aa-95a14976926d None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:02.561835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f9117-f79b-4bbe-b85c-65ac10618e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:02.562628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f9117-f79b-4bbe-b85c-65ac10618e0a None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:02.562908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f9117-f79b-4bbe-b85c-65ac10618e0a None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:02.563178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f9117-f79b-4bbe-b85c-65ac10618e0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:02.569762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f9117-f79b-4bbe-b85c-65ac10618e0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:02.571223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f9117-f79b-4bbe-b85c-65ac10618e0a None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:02.585252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-7b2f9117-f79b-4bbe-b85c-65ac10618e0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:02.585252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:02.585252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:02.585252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:02.585252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:02.585252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:02.585252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:02.585252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:02.585252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:02.585252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:02.585252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:02.585252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:02.585252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:02.585252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:02.585252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:02.586301 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:02.586301 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:02.586301 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:02.586301 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:02.586301 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:02.586301 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:02.586301 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:02.586301 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:02.586301 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:02.586301 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:02.586301 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:02.586301 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:02.586301 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:02.586301 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:02.586301 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:02.586301 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:02.586301 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:02.587478 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:02.587478 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:02.587478 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:02.587478 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:02.587478 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:02.587478 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:02.587478 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:02.587478 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:02.587478 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 334/670] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:02.587478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f9117-f79b-4bbe-b85c-65ac10618e0a None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:02.596682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e061aa9-ca14-483d-9e9f-2f3297bfed8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:02.597347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e061aa9-ca14-483d-9e9f-2f3297bfed8d None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:02.597629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e061aa9-ca14-483d-9e9f-2f3297bfed8d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:02.597903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e061aa9-ca14-483d-9e9f-2f3297bfed8d None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:02.598648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e061aa9-ca14-483d-9e9f-2f3297bfed8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:02.598951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e061aa9-ca14-483d-9e9f-2f3297bfed8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:02.600373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e061aa9-ca14-483d-9e9f-2f3297bfed8d None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:02.612712 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 337/671] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:02.613907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e061aa9-ca14-483d-9e9f-2f3297bfed8d None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:02.674739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:02.690106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f9117-f79b-4bbe-b85c-65ac10618e0a None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:02.715570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e061aa9-ca14-483d-9e9f-2f3297bfed8d None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:02.724432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45626d-3f05-4c89-9ee0-87b28ef2df5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:02.725097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45626d-3f05-4c89-9ee0-87b28ef2df5a None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:02.725375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45626d-3f05-4c89-9ee0-87b28ef2df5a None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:02.725651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45626d-3f05-4c89-9ee0-87b28ef2df5a None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:02.726387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45626d-3f05-4c89-9ee0-87b28ef2df5a None admin] RBAC: Adding query filter params (name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:02.726692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45626d-3f05-4c89-9ee0-87b28ef2df5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:02.728082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45626d-3f05-4c89-9ee0-87b28ef2df5a None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:02.735994 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 335/672] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:45:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:02.737223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc0f2c-c02e-4c51-9520-9abd097542e2 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:02.737510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc0f2c-c02e-4c51-9520-9abd097542e2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:02.737793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc0f2c-c02e-4c51-9520-9abd097542e2 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:02.739281 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 336/673] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:02.739996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc0f2c-c02e-4c51-9520-9abd097542e2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:02.750624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fccd11-b039-4eaf-b936-cc5fff49e060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:02.751424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fccd11-b039-4eaf-b936-cc5fff49e060 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:02.751709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fccd11-b039-4eaf-b936-cc5fff49e060 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:02.751983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fccd11-b039-4eaf-b936-cc5fff49e060 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:02.758779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fccd11-b039-4eaf-b936-cc5fff49e060 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:02.760266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fccd11-b039-4eaf-b936-cc5fff49e060 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:02.773845 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-c7fccd11-b039-4eaf-b936-cc5fff49e060 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:02.773845 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:02.773845 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:02.773845 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:02.773845 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:02.773845 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:02.773845 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:02.773845 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:02.773845 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:02.773845 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:02.773845 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:02.773845 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:02.773845 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:02.773845 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:02.773845 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:02.776145 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:02.776145 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:02.776145 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:02.776145 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:02.776145 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:02.776145 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:02.776145 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:02.776145 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:02.776145 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:02.776145 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:02.776145 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:02.776145 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:02.776145 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:02.776145 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:02.776145 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:02.776145 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:02.776145 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:02.777148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:02.777148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:02.777148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:02.777148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:02.777148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:02.777148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:02.777148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:02.777148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:02.777148 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 338/674] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:02.777148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fccd11-b039-4eaf-b936-cc5fff49e060 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:02.784121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:02.846678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc0f2c-c02e-4c51-9520-9abd097542e2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:02.880838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ec530-0588-412c-9ed8-118249edf8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:02.881484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ec530-0588-412c-9ed8-118249edf8ab None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:02.881739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fccd11-b039-4eaf-b936-cc5fff49e060 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:02.881870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ec530-0588-412c-9ed8-118249edf8ab None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:02.882083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ec530-0588-412c-9ed8-118249edf8ab None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:02.882869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ec530-0588-412c-9ed8-118249edf8ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:02.883164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ec530-0588-412c-9ed8-118249edf8ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:02.884646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ec530-0588-412c-9ed8-118249edf8ab None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:02.896436 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 337/675] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:02.897212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ec530-0588-412c-9ed8-118249edf8ab None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:02.901553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:02.916200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125621a3-9248-45df-8ff7-4701b1fc52f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:02.916991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125621a3-9248-45df-8ff7-4701b1fc52f8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:02.917268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125621a3-9248-45df-8ff7-4701b1fc52f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:02.917541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125621a3-9248-45df-8ff7-4701b1fc52f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:02.924373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125621a3-9248-45df-8ff7-4701b1fc52f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:02.925813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125621a3-9248-45df-8ff7-4701b1fc52f8 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:02.939736 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-125621a3-9248-45df-8ff7-4701b1fc52f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:02.939736 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:02.939736 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:02.939736 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:02.939736 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:02.939736 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:02.939736 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:02.939736 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:02.939736 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:02.939736 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:02.939736 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:02.939736 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:02.939736 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:02.939736 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:02.939736 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:02.940832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:02.940832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:02.940832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:02.940832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:02.940832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:02.940832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:02.940832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:02.940832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:02.940832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:02.940832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:02.940832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:02.940832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:02.940832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:02.940832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:02.940832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:02.940832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:02.940832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:02.941752 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:02.941752 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:02.941752 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:02.941752 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:02.941752 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:02.941752 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:02.941752 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:02.941752 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:02.941752 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 339/676] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:02.942581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82788ab-0d26-41d3-bfdf-2eb5e453c42d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:02.942581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82788ab-0d26-41d3-bfdf-2eb5e453c42d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:02.942713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82788ab-0d26-41d3-bfdf-2eb5e453c42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:02.960411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c82788ab-0d26-41d3-bfdf-2eb5e453c42d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:02.961579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c82788ab-0d26-41d3-bfdf-2eb5e453c42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:02.991954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:02.995594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ec530-0588-412c-9ed8-118249edf8ab None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:03.027299 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 340/677] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:45:03.028145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82788ab-0d26-41d3-bfdf-2eb5e453c42d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:03.042341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b219d2e-2380-4f17-9bd4-41b9dfd2320f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:03.043382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b219d2e-2380-4f17-9bd4-41b9dfd2320f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:03.043666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b219d2e-2380-4f17-9bd4-41b9dfd2320f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:03.043938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b219d2e-2380-4f17-9bd4-41b9dfd2320f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:03.056349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b219d2e-2380-4f17-9bd4-41b9dfd2320f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:03.057803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b219d2e-2380-4f17-9bd4-41b9dfd2320f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:03.076982 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-4b219d2e-2380-4f17-9bd4-41b9dfd2320f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:03.076982 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:03.076982 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:03.076982 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:03.076982 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:03.076982 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:03.076982 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:03.076982 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:03.076982 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:03.076982 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:03.076982 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:03.076982 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:03.076982 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:03.076982 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:03.076982 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:03.078003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:03.078003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:03.078003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:03.078003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:03.078003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:03.078003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:03.078003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:03.078003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:03.078003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:03.078003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:03.078003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:03.078003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:03.078003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:03.078003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:03.078003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:03.078003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:03.078003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:03.078922 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:03.078922 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:03.078922 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:03.078922 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:03.078922 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 338/678] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:03.079454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b219d2e-2380-4f17-9bd4-41b9dfd2320f None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:03.129181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82788ab-0d26-41d3-bfdf-2eb5e453c42d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:03.139419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:03.162884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d982760-e8c7-427b-bb43-3dba3df42709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:03.163544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982760-e8c7-427b-bb43-3dba3df42709 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:03.163867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982760-e8c7-427b-bb43-3dba3df42709 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:03.164134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982760-e8c7-427b-bb43-3dba3df42709 None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:03.164941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d982760-e8c7-427b-bb43-3dba3df42709 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:03.165246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d982760-e8c7-427b-bb43-3dba3df42709 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:03.166705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d982760-e8c7-427b-bb43-3dba3df42709 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:03.178900 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 341/679] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:03.179031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b219d2e-2380-4f17-9bd4-41b9dfd2320f None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:03.179508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d982760-e8c7-427b-bb43-3dba3df42709 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:03.215964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8914b9-fa7b-492e-8b0a-950d597ce6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:03.216644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8914b9-fa7b-492e-8b0a-950d597ce6cd None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:03.216923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8914b9-fa7b-492e-8b0a-950d597ce6cd None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:03.217179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8914b9-fa7b-492e-8b0a-950d597ce6cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:03.218012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8914b9-fa7b-492e-8b0a-950d597ce6cd None admin] RBAC: Adding query filter params (role.id=843bfd29577143dcb23593a75d4ee5a0, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=3de168a603b0478fa8de67f6d206e1a5) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:03.218321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8914b9-fa7b-492e-8b0a-950d597ce6cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:03.219803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8914b9-fa7b-492e-8b0a-950d597ce6cd None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:03.225650 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 339/680] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:45:03 2022] GET /identity/v3/role_assignments?user.id=3de168a603b0478fa8de67f6d206e1a5&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=843bfd29577143dcb23593a75d4ee5a0 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:03.232371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8914b9-fa7b-492e-8b0a-950d597ce6cd None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:03.256153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:03.284706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d982760-e8c7-427b-bb43-3dba3df42709 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:03.322739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53face-2a28-4bc8-82d1-beafefe370ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:03.323331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53face-2a28-4bc8-82d1-beafefe370ee None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:03.323610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53face-2a28-4bc8-82d1-beafefe370ee None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:03.323925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53face-2a28-4bc8-82d1-beafefe370ee None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:03.324782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53face-2a28-4bc8-82d1-beafefe370ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:03.325098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53face-2a28-4bc8-82d1-beafefe370ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:03.326571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53face-2a28-4bc8-82d1-beafefe370ee None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:03.345023 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 342/681] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:03.345023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53face-2a28-4bc8-82d1-beafefe370ee None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:03.354761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8914b9-fa7b-492e-8b0a-950d597ce6cd None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:03.375896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:03.392724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732b55c-cb32-44c0-a837-ebefc87fd4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:03.393912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732b55c-cb32-44c0-a837-ebefc87fd4cb None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:03.394476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732b55c-cb32-44c0-a837-ebefc87fd4cb None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:03.395070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732b55c-cb32-44c0-a837-ebefc87fd4cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:03.408344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732b55c-cb32-44c0-a837-ebefc87fd4cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:03.416880 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-4732b55c-cb32-44c0-a837-ebefc87fd4cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:45:03.416880 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:03.416880 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:03.416880 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:03.416880 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:03.416880 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:03.416880 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:03.416880 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:03.416880 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:03.416880 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:03.416880 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:03.416880 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:03.416880 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:03.416880 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:03.416880 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:03.416880 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:03.417945 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:03.417945 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:03.417945 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:03.417945 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:03.417945 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:03.417945 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:03.417945 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:03.417945 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:03.417945 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:03.417945 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:03.417945 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:03.417945 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:03.417945 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:03.417945 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:03.417945 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:03.417945 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:03.419218 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:03.419218 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:03.419218 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:03.419218 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:03.419218 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:03.419218 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:03.419218 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:03.419218 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:03.419218 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:03.419218 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:03.419218 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:45:03.419218 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:03.419218 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 340/682] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:45:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:03.419218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732b55c-cb32-44c0-a837-ebefc87fd4cb None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:03.459351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53face-2a28-4bc8-82d1-beafefe370ee None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:03.504854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b689e0-cb26-480c-acaf-050c043a426e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:03.505521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b689e0-cb26-480c-acaf-050c043a426e None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:03.505800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b689e0-cb26-480c-acaf-050c043a426e None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:03.506073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b689e0-cb26-480c-acaf-050c043a426e None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:03.506890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b689e0-cb26-480c-acaf-050c043a426e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:03.507084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b689e0-cb26-480c-acaf-050c043a426e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:03.507553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:03.508649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b689e0-cb26-480c-acaf-050c043a426e None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:03.522178 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 343/683] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:03.523096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b689e0-cb26-480c-acaf-050c043a426e None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:03.537871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732b55c-cb32-44c0-a837-ebefc87fd4cb None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:03.575171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585b4af-f6a3-4130-a117-3083f0e39062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:03.575960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585b4af-f6a3-4130-a117-3083f0e39062 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:03.579743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585b4af-f6a3-4130-a117-3083f0e39062 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:03.579743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585b4af-f6a3-4130-a117-3083f0e39062 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:03.579743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585b4af-f6a3-4130-a117-3083f0e39062 None admin] RBAC: Adding query filter params (role.id=843bfd29577143dcb23593a75d4ee5a0, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=f9ea416fd4d4420b9112507ef1a68bf7) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:03.579743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585b4af-f6a3-4130-a117-3083f0e39062 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:03.579743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585b4af-f6a3-4130-a117-3083f0e39062 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:03.592079 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 341/684] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:45:03 2022] GET /identity/v3/role_assignments?user.id=f9ea416fd4d4420b9112507ef1a68bf7&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=843bfd29577143dcb23593a75d4ee5a0 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:03.592079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585b4af-f6a3-4130-a117-3083f0e39062 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:03.646621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:03.662112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b689e0-cb26-480c-acaf-050c043a426e None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:03.703349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585b4af-f6a3-4130-a117-3083f0e39062 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:03.710569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d9548-e3f3-47c3-a311-5e2515942864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:03.711401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d9548-e3f3-47c3-a311-5e2515942864 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:03.712481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d9548-e3f3-47c3-a311-5e2515942864 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:03.712855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d9548-e3f3-47c3-a311-5e2515942864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:03.714299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d9548-e3f3-47c3-a311-5e2515942864 None admin] RBAC: Adding query filter params (role.id=843bfd29577143dcb23593a75d4ee5a0, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=684732cf5a004fb084ce0e523398c970) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:03.714931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d9548-e3f3-47c3-a311-5e2515942864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:03.717301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d9548-e3f3-47c3-a311-5e2515942864 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:03.726283 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 344/685] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:45:03 2022] GET /identity/v3/role_assignments?user.id=684732cf5a004fb084ce0e523398c970&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=843bfd29577143dcb23593a75d4ee5a0 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:03.728031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d9548-e3f3-47c3-a311-5e2515942864 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:03.754699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408d773-2642-4981-b04b-bc65a9033c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:03.755714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408d773-2642-4981-b04b-bc65a9033c64 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:03.757635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408d773-2642-4981-b04b-bc65a9033c64 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:03.757921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408d773-2642-4981-b04b-bc65a9033c64 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:03.760005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408d773-2642-4981-b04b-bc65a9033c64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:03.760342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408d773-2642-4981-b04b-bc65a9033c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:03.763663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408d773-2642-4981-b04b-bc65a9033c64 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:03.776626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:03.789253 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 342/686] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:45:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:03.793380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408d773-2642-4981-b04b-bc65a9033c64 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:03.905261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d9548-e3f3-47c3-a311-5e2515942864 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:03.911838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408d773-2642-4981-b04b-bc65a9033c64 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:03.945262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c012c3e-2531-4978-b2cd-457ca35a76d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:03.946164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c012c3e-2531-4978-b2cd-457ca35a76d3 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:03.946449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c012c3e-2531-4978-b2cd-457ca35a76d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:03.946725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c012c3e-2531-4978-b2cd-457ca35a76d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:03.951305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879663e-9a85-4a5b-977a-8c157667da0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:03.952263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879663e-9a85-4a5b-977a-8c157667da0b None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:03.952813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879663e-9a85-4a5b-977a-8c157667da0b None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:03.953092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879663e-9a85-4a5b-977a-8c157667da0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:03.958772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c012c3e-2531-4978-b2cd-457ca35a76d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:03.960324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c012c3e-2531-4978-b2cd-457ca35a76d3 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:03.965648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879663e-9a85-4a5b-977a-8c157667da0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:03.967119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879663e-9a85-4a5b-977a-8c157667da0b None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:03.976208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-8c012c3e-2531-4978-b2cd-457ca35a76d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 02 20:45:03.976208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:03.976208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:03.976208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:03.976208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:03.976208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:03.976208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:03.976208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:03.976208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:03.976208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:03.976208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:03.976208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:03.976208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:03.976208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:03.976208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:03.976208 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:03.977212 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:03.977212 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:03.977212 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:03.977212 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:03.977212 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:03.977212 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:03.977212 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:03.977212 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:03.977212 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:03.977212 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:03.977212 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:03.977212 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:03.977212 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:03.977212 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:03.977212 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:03.977212 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:03.977212 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:03.977212 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:03.978782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:03.978782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:03.978782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:03.978782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:03.978782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:03.978782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:03.978782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:03.978782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:03.978782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 02 20:45:03.978782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:03.978782 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 345/687] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:45:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:03.983154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c012c3e-2531-4978-b2cd-457ca35a76d3 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:03.987090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-1879663e-9a85-4a5b-977a-8c157667da0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:03.987090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:03.987090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:03.987090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:03.987090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:03.987090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:03.987090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:03.987090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:03.987090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:03.987090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:03.987090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:03.987090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:03.987090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:03.987090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:03.987090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:03.988013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:03.988013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:03.988013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:03.988013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:03.988013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:03.988013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:03.988013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:03.988013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:03.988013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:03.988013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:03.988013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:03.988013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:03.988013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:03.988013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:03.988013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:03.988013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:03.988013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:03.989001 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:03.989001 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:03.989001 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:03.989001 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:03.989001 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 343/688] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:03.994311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879663e-9a85-4a5b-977a-8c157667da0b None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:04.005385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:04.063833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:04.117949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c012c3e-2531-4978-b2cd-457ca35a76d3 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:04.149346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879663e-9a85-4a5b-977a-8c157667da0b None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:04.157266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68795a-7bb6-45bb-9302-05d70b16e189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:04.158005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68795a-7bb6-45bb-9302-05d70b16e189 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:04.158387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68795a-7bb6-45bb-9302-05d70b16e189 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:04.158757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68795a-7bb6-45bb-9302-05d70b16e189 None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:04.159747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68795a-7bb6-45bb-9302-05d70b16e189 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:04.160206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68795a-7bb6-45bb-9302-05d70b16e189 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:04.161862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68795a-7bb6-45bb-9302-05d70b16e189 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:04.181249 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 346/689] 10.222.0.43 () {56 vars in 1135 bytes} [Sat Jul 2 20:45:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:04.186883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68795a-7bb6-45bb-9302-05d70b16e189 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:04.191127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d86eb9-5c25-4ccc-a768-91c7595577b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:04.192411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d86eb9-5c25-4ccc-a768-91c7595577b7 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:04.192827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d86eb9-5c25-4ccc-a768-91c7595577b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:04.193250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d86eb9-5c25-4ccc-a768-91c7595577b7 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:04.194098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d86eb9-5c25-4ccc-a768-91c7595577b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:04.194535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d86eb9-5c25-4ccc-a768-91c7595577b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:04.196118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d86eb9-5c25-4ccc-a768-91c7595577b7 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:04.209530 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 344/690] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:04.214379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d86eb9-5c25-4ccc-a768-91c7595577b7 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:04.333850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:04.374985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d86eb9-5c25-4ccc-a768-91c7595577b7 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:04.389838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:04.404245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68795a-7bb6-45bb-9302-05d70b16e189 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:04.438622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc28ae-c5d4-4ad6-8014-45920567e95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:04.439344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc28ae-c5d4-4ad6-8014-45920567e95b None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:04.439623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc28ae-c5d4-4ad6-8014-45920567e95b None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:04.439889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc28ae-c5d4-4ad6-8014-45920567e95b None admin] PATH_INFO: `/v3/users/nova` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:04.455644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc28ae-c5d4-4ad6-8014-45920567e95b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:04.457147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc28ae-c5d4-4ad6-8014-45920567e95b None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:04.479627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-74dc28ae-c5d4-4ad6-8014-45920567e95b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:45:04.479627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:04.479627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:04.479627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:04.479627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:04.479627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:04.479627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:04.479627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:04.479627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:04.479627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:04.479627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:04.479627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:04.479627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:04.479627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:04.479627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:04.479627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:04.480968 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:04.480968 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:04.480968 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:04.480968 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:04.480968 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:04.480968 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:04.480968 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:04.480968 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:04.480968 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:04.480968 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:04.480968 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:04.480968 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:04.480968 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:04.480968 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:04.480968 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:04.480968 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:04.480968 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:04.480968 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:04.482237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:04.482237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:04.482237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:04.482237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:04.482237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:04.482237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:04.482237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:04.482237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:04.482237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:45:04.482237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:04.482237 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 345/691] 10.222.0.43 () {56 vars in 1093 bytes} [Sat Jul 2 20:45:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:04.486701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc28ae-c5d4-4ad6-8014-45920567e95b None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:04.486963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc5da9-7e11-49d5-b8cd-49b3ae8c380a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:04.487903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc5da9-7e11-49d5-b8cd-49b3ae8c380a None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:04.488346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc5da9-7e11-49d5-b8cd-49b3ae8c380a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:04.488758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc5da9-7e11-49d5-b8cd-49b3ae8c380a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:04.611601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc28ae-c5d4-4ad6-8014-45920567e95b None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:04.614059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc5da9-7e11-49d5-b8cd-49b3ae8c380a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:04.615536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc5da9-7e11-49d5-b8cd-49b3ae8c380a None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:04.682424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bdea7-79d0-4fd0-9046-7ec1c5d5e298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:04.683747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bdea7-79d0-4fd0-9046-7ec1c5d5e298 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:04.684028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bdea7-79d0-4fd0-9046-7ec1c5d5e298 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:04.684321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bdea7-79d0-4fd0-9046-7ec1c5d5e298 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:04.685155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bdea7-79d0-4fd0-9046-7ec1c5d5e298 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:04.685462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bdea7-79d0-4fd0-9046-7ec1c5d5e298 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:04.686908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bdea7-79d0-4fd0-9046-7ec1c5d5e298 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:04.734778 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 346/692] 10.222.0.43 () {56 vars in 1133 bytes} [Sat Jul 2 20:45:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:04.746787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bdea7-79d0-4fd0-9046-7ec1c5d5e298 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:04.767367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:04.803708 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 347/693] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 20:45:04.809873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc5da9-7e11-49d5-b8cd-49b3ae8c380a None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:04.813323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:04.924956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc5da9-7e11-49d5-b8cd-49b3ae8c380a None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:04.953889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bdea7-79d0-4fd0-9046-7ec1c5d5e298 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:04.964063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb6f8a-4eb0-49bd-8f67-7023ef19023a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:04.965374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb6f8a-4eb0-49bd-8f67-7023ef19023a None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:04.965951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb6f8a-4eb0-49bd-8f67-7023ef19023a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:04.966237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb6f8a-4eb0-49bd-8f67-7023ef19023a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:04.977726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb6f8a-4eb0-49bd-8f67-7023ef19023a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:04.979445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb6f8a-4eb0-49bd-8f67-7023ef19023a None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:04.999272 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-62eb6f8a-4eb0-49bd-8f67-7023ef19023a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:04.999272 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:04.999272 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:04.999272 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:04.999272 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:04.999272 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:04.999272 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:04.999272 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:04.999272 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:04.999272 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:04.999272 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:04.999272 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:04.999272 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:04.999272 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:04.999272 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:05.000226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:05.000226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:05.000226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:05.000226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:05.000226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:05.000226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:05.000226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:05.000226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:05.000226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:05.000226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:05.000226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:05.000226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:05.000226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:05.000226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:05.000226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:05.000226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:05.000226 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:05.002122 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:05.002122 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:05.002122 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:05.002122 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:05.002122 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 348/694] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:05.006389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb6f8a-4eb0-49bd-8f67-7023ef19023a None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:05.036439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:05.056156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06554141-8c9f-4219-9118-84c50e2b3cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:05.058755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06554141-8c9f-4219-9118-84c50e2b3cca None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:05.059041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06554141-8c9f-4219-9118-84c50e2b3cca None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:05.059316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06554141-8c9f-4219-9118-84c50e2b3cca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:05.134606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb6f8a-4eb0-49bd-8f67-7023ef19023a None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:05.174504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943858a-fc75-4333-b1b6-77434ced95b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:05.175201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943858a-fc75-4333-b1b6-77434ced95b9 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:05.175482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943858a-fc75-4333-b1b6-77434ced95b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:05.175755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943858a-fc75-4333-b1b6-77434ced95b9 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:05.176522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943858a-fc75-4333-b1b6-77434ced95b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:05.176826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943858a-fc75-4333-b1b6-77434ced95b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:05.178234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943858a-fc75-4333-b1b6-77434ced95b9 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:05.192282 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 349/695] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:05.197995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943858a-fc75-4333-b1b6-77434ced95b9 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:05.292656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:05.309412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943858a-fc75-4333-b1b6-77434ced95b9 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:05.312936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06554141-8c9f-4219-9118-84c50e2b3cca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:05.314413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06554141-8c9f-4219-9118-84c50e2b3cca None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:05.346276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e136025-9b66-4359-88fb-69b9996d606c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:05.347075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e136025-9b66-4359-88fb-69b9996d606c None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:05.347447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e136025-9b66-4359-88fb-69b9996d606c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:05.347767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e136025-9b66-4359-88fb-69b9996d606c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:05.355152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e136025-9b66-4359-88fb-69b9996d606c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:05.356716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e136025-9b66-4359-88fb-69b9996d606c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:05.374163 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-0e136025-9b66-4359-88fb-69b9996d606c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:05.374163 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:05.374163 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:05.374163 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:05.374163 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:05.374163 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:05.374163 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:05.374163 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:05.374163 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:05.374163 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:05.374163 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:05.374163 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:05.374163 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:05.374163 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:05.374163 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:05.375100 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:05.375100 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:05.375100 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:05.375100 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:05.375100 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:05.375100 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:05.375100 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:05.375100 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:05.375100 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:05.375100 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:05.375100 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:05.375100 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:05.375100 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:05.375100 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:05.375100 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:05.375100 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:05.375100 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:05.376966 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:05.376966 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:05.376966 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:05.376966 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:05.376966 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:05.376966 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:05.376966 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:05.376966 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:05.376966 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 350/696] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:05.381595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e136025-9b66-4359-88fb-69b9996d606c None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:05.429578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:05.490338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e136025-9b66-4359-88fb-69b9996d606c None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:05.528672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d0945-8e2c-47c4-868b-84487bce5ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:05.529352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d0945-8e2c-47c4-868b-84487bce5ec3 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:05.529634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d0945-8e2c-47c4-868b-84487bce5ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:05.529911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d0945-8e2c-47c4-868b-84487bce5ec3 None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:05.530824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d0945-8e2c-47c4-868b-84487bce5ec3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:05.531134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d0945-8e2c-47c4-868b-84487bce5ec3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:05.532746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d0945-8e2c-47c4-868b-84487bce5ec3 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:05.545884 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 351/697] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:05.552028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d0945-8e2c-47c4-868b-84487bce5ec3 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:05.568388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:05.658164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d0945-8e2c-47c4-868b-84487bce5ec3 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:05.661578 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 347/698] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 915 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:45:05.667652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06554141-8c9f-4219-9118-84c50e2b3cca None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:05.707186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d5e30-dd46-427b-9493-1a65c8a6115b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:05.707955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d5e30-dd46-427b-9493-1a65c8a6115b None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:05.708267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d5e30-dd46-427b-9493-1a65c8a6115b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:05.708542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d5e30-dd46-427b-9493-1a65c8a6115b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:05.709473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d5e30-dd46-427b-9493-1a65c8a6115b None admin] RBAC: Adding query filter params (role.id=843bfd29577143dcb23593a75d4ee5a0, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=55367f643da048c5ab61ab6325552256) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:05.709787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d5e30-dd46-427b-9493-1a65c8a6115b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:05.711242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d5e30-dd46-427b-9493-1a65c8a6115b None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:05.717912 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 352/699] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:45:05 2022] GET /identity/v3/role_assignments?user.id=55367f643da048c5ab61ab6325552256&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=843bfd29577143dcb23593a75d4ee5a0 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:05.784573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b2eb6-a9d5-429d-8686-d8b04c2cbb57 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:05.785196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b2eb6-a9d5-429d-8686-d8b04c2cbb57 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:05.785196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b2eb6-a9d5-429d-8686-d8b04c2cbb57 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:05.786528 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 353/700] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:45:05.801865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce39d87-2c07-444c-8e6e-55539ec48107 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:05.802057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce39d87-2c07-444c-8e6e-55539ec48107 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:05.802323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce39d87-2c07-444c-8e6e-55539ec48107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:05.833426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0ce39d87-2c07-444c-8e6e-55539ec48107 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:05.834660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0ce39d87-2c07-444c-8e6e-55539ec48107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:05.842665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06554141-8c9f-4219-9118-84c50e2b3cca None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:05.880483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:05.884778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e8540-0205-4f40-a720-2d919a9f4c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:05.886188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e8540-0205-4f40-a720-2d919a9f4c2c None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:05.886690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e8540-0205-4f40-a720-2d919a9f4c2c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:05.887144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e8540-0205-4f40-a720-2d919a9f4c2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:05.902796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e8540-0205-4f40-a720-2d919a9f4c2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:05.905555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e8540-0205-4f40-a720-2d919a9f4c2c None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:05.946737 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-687e8540-0205-4f40-a720-2d919a9f4c2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:05.946737 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:05.946737 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:05.946737 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:05.946737 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:05.946737 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:05.946737 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:05.946737 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:05.946737 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:05.946737 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:05.946737 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:05.946737 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:05.946737 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:05.946737 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:05.946737 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:05.947785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:05.947785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:05.947785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:05.947785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:05.947785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:05.947785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:05.947785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:05.947785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:05.947785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:05.947785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:05.947785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:05.947785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:05.947785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:05.947785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:05.947785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:05.947785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:05.947785 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:05.948883 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:05.948883 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:05.948883 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:05.948883 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:05.962986 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 348/701] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:05.968750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e8540-0205-4f40-a720-2d919a9f4c2c None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:05.972948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:05.984737 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 354/702] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:45:06.008747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce39d87-2c07-444c-8e6e-55539ec48107 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:06.116560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce39d87-2c07-444c-8e6e-55539ec48107 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:06.122439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e8540-0205-4f40-a720-2d919a9f4c2c None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:06.155879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97e525-9a03-4824-8c64-0991a92c099f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:06.156777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e525-9a03-4824-8c64-0991a92c099f None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:06.157018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e525-9a03-4824-8c64-0991a92c099f None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:06.157299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e525-9a03-4824-8c64-0991a92c099f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:06.169356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41983759-51de-439a-88f1-39bcdfb6b3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:06.169554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97e525-9a03-4824-8c64-0991a92c099f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:06.170460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41983759-51de-439a-88f1-39bcdfb6b3ec None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:06.170892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97e525-9a03-4824-8c64-0991a92c099f None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:06.171193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41983759-51de-439a-88f1-39bcdfb6b3ec None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:06.171660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41983759-51de-439a-88f1-39bcdfb6b3ec None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:06.172893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41983759-51de-439a-88f1-39bcdfb6b3ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:06.174135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41983759-51de-439a-88f1-39bcdfb6b3ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:06.175704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41983759-51de-439a-88f1-39bcdfb6b3ec None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:06.189703 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 349/703] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:06.194360 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-2f97e525-9a03-4824-8c64-0991a92c099f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:06.194360 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:06.194360 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:06.194360 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:06.194360 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:06.194360 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:06.194360 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:06.194360 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:06.194360 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:06.194360 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:06.194360 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:06.194360 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:06.194360 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:06.194360 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:06.194360 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:06.195301 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:06.195301 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:06.195301 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:06.195301 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:06.195301 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:06.195301 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:06.195301 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:06.195301 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:06.195301 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:06.195301 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:06.195301 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:06.195301 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:06.195301 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:06.195301 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:06.195301 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:06.195301 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:06.195301 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:06.196256 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:06.196256 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:06.196256 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:06.196256 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:06.196256 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 355/704] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:06.198020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41983759-51de-439a-88f1-39bcdfb6b3ec None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:06.198463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97e525-9a03-4824-8c64-0991a92c099f None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:06.256686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:06.265135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:06.332797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97e525-9a03-4824-8c64-0991a92c099f None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:06.353681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41983759-51de-439a-88f1-39bcdfb6b3ec None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:06.371636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a993e96-87d5-46a1-8f31-b8c45c0ce4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:06.372912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a993e96-87d5-46a1-8f31-b8c45c0ce4e1 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:06.373295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a993e96-87d5-46a1-8f31-b8c45c0ce4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:06.373666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a993e96-87d5-46a1-8f31-b8c45c0ce4e1 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:06.374489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a993e96-87d5-46a1-8f31-b8c45c0ce4e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:06.374894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a993e96-87d5-46a1-8f31-b8c45c0ce4e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:06.376621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a993e96-87d5-46a1-8f31-b8c45c0ce4e1 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:06.389115 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 356/705] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:06.394963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a993e96-87d5-46a1-8f31-b8c45c0ce4e1 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:06.397416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82d85f-8757-43eb-a84a-2081a41201a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:06.398663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82d85f-8757-43eb-a84a-2081a41201a9 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:06.400020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82d85f-8757-43eb-a84a-2081a41201a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:06.400503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82d85f-8757-43eb-a84a-2081a41201a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:06.409547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82d85f-8757-43eb-a84a-2081a41201a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:06.411793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82d85f-8757-43eb-a84a-2081a41201a9 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:06.434814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-1e82d85f-8757-43eb-a84a-2081a41201a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:06.434814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:06.434814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:06.434814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:06.434814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:06.434814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:06.434814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:06.434814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:06.434814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:06.434814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:06.434814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:06.434814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:06.434814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:06.434814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:06.434814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:06.436006 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:06.436006 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:06.436006 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:06.436006 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:06.436006 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:06.436006 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:06.436006 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:06.436006 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:06.436006 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:06.436006 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:06.436006 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:06.436006 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:06.436006 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:06.436006 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:06.436006 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:06.436006 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:06.436006 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:06.437200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:06.437200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:06.437200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:06.437200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:06.437200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:06.437200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:06.437200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:06.437200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:06.439355 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 350/706] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:06.445350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82d85f-8757-43eb-a84a-2081a41201a9 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:06.559279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a993e96-87d5-46a1-8f31-b8c45c0ce4e1 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:06.570175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:06.589986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82d85f-8757-43eb-a84a-2081a41201a9 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:06.591620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:06.594763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f471f53-2e3f-42bb-a45e-63127553d0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:06.595448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f471f53-2e3f-42bb-a45e-63127553d0a4 None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:06.595730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f471f53-2e3f-42bb-a45e-63127553d0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:06.596006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f471f53-2e3f-42bb-a45e-63127553d0a4 None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:06.596738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f471f53-2e3f-42bb-a45e-63127553d0a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:06.598230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f471f53-2e3f-42bb-a45e-63127553d0a4 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:06.621552 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 357/707] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Jul 2 20:45:06 2022] POST /identity/v3/users => generated 254 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:45:06.622627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166dbe8-5797-48e0-bd61-1faf5b05ba96 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:06.622911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166dbe8-5797-48e0-bd61-1faf5b05ba96 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:06.623234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166dbe8-5797-48e0-bd61-1faf5b05ba96 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:06.624721 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 358/708] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:06.625602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1f920-5ca7-4892-88d2-3278b184387b None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:06.625864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1f920-5ca7-4892-88d2-3278b184387b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:06.626161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1f920-5ca7-4892-88d2-3278b184387b None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:06.631873 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 359/709] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:06.633332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23241cb-3878-42ae-aafe-1dadf2577c9b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:06.633902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23241cb-3878-42ae-aafe-1dadf2577c9b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:06.634179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23241cb-3878-42ae-aafe-1dadf2577c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:06.647139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d19b6-dcd2-45fe-962d-44b289332a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:06.648403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d19b6-dcd2-45fe-962d-44b289332a26 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:06.648893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d19b6-dcd2-45fe-962d-44b289332a26 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:06.649391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d19b6-dcd2-45fe-962d-44b289332a26 None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:06.650485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d19b6-dcd2-45fe-962d-44b289332a26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:06.651030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d19b6-dcd2-45fe-962d-44b289332a26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:06.653029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d19b6-dcd2-45fe-962d-44b289332a26 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:06.657634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d23241cb-3878-42ae-aafe-1dadf2577c9b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:06.658946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d23241cb-3878-42ae-aafe-1dadf2577c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:06.673152 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 351/710] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:06.676006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309690f9-b87d-447d-8d3b-c01cd7be0217 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:06.676616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309690f9-b87d-447d-8d3b-c01cd7be0217 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:06.677045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309690f9-b87d-447d-8d3b-c01cd7be0217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:06.696863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-309690f9-b87d-447d-8d3b-c01cd7be0217 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:06.698330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-309690f9-b87d-447d-8d3b-c01cd7be0217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:06.755182 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 360/711] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:45:06.756511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23241cb-3878-42ae-aafe-1dadf2577c9b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:06.801413 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 352/712] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:45:06.802396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309690f9-b87d-447d-8d3b-c01cd7be0217 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:06.892735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:06.904826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23241cb-3878-42ae-aafe-1dadf2577c9b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:06.933676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:06.944719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225511a-5a5a-4249-96c6-9cdc080f89f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:06.945008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309690f9-b87d-447d-8d3b-c01cd7be0217 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:06.945697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225511a-5a5a-4249-96c6-9cdc080f89f2 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:06.946034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225511a-5a5a-4249-96c6-9cdc080f89f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:06.946390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225511a-5a5a-4249-96c6-9cdc080f89f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:06.947292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225511a-5a5a-4249-96c6-9cdc080f89f2 None admin] RBAC: Adding query filter params (role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=aa3e290fa5384f9bac3fec771cebf653) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:06.947849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225511a-5a5a-4249-96c6-9cdc080f89f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:06.949490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225511a-5a5a-4249-96c6-9cdc080f89f2 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:06.955635 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 361/713] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:45:06 2022] GET /identity/v3/role_assignments?user.id=aa3e290fa5384f9bac3fec771cebf653&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:06.957294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225511a-5a5a-4249-96c6-9cdc080f89f2 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:06.986869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13c9ba-30ab-4c8a-99c8-d6a5193c6e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:06.988296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13c9ba-30ab-4c8a-99c8-d6a5193c6e0c None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:06.988752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13c9ba-30ab-4c8a-99c8-d6a5193c6e0c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:06.989210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13c9ba-30ab-4c8a-99c8-d6a5193c6e0c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:06.990054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13c9ba-30ab-4c8a-99c8-d6a5193c6e0c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:06.991760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13c9ba-30ab-4c8a-99c8-d6a5193c6e0c None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:07.007910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-ad13c9ba-30ab-4c8a-99c8-d6a5193c6e0c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 20:45:07.007910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:07.007910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:07.007910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:07.007910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:07.007910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:07.007910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:07.007910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:07.007910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 20:45:07.007910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:07.007910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:07.007910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:07.007910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:07.007910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:07.007910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:07.007910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:07.009111 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:07.009111 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:07.009111 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:07.009111 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:07.009111 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:07.009111 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:07.009111 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:07.009111 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:07.009111 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:07.009111 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:07.009111 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:07.009111 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:07.009111 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:07.009111 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:07.009111 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:07.009111 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:07.010028 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:07.010028 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:07.010028 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:07.010028 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:07.010028 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:07.010028 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:07.010028 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:07.010028 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:07.010028 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:07.010028 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:07.010028 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:07.010028 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:07.010028 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:07.010028 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 20:45:07.010028 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:07.013498 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 353/714] 10.222.0.43 () {56 vars in 1129 bytes} [Sat Jul 2 20:45:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:07.019322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13c9ba-30ab-4c8a-99c8-d6a5193c6e0c None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:07.149494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225511a-5a5a-4249-96c6-9cdc080f89f2 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:07.180078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13c9ba-30ab-4c8a-99c8-d6a5193c6e0c None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:07.214249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3106fd-1f82-4bd1-8ccc-5eda771c5787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:07.215062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3106fd-1f82-4bd1-8ccc-5eda771c5787 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:07.215339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3106fd-1f82-4bd1-8ccc-5eda771c5787 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:07.215611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3106fd-1f82-4bd1-8ccc-5eda771c5787 None admin] PATH_INFO: `/v3/services/network` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:07.216289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3106fd-1f82-4bd1-8ccc-5eda771c5787 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:07.217696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3106fd-1f82-4bd1-8ccc-5eda771c5787 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:07.232575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1d8fd-cdcc-49fc-95f2-e661c11b5f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:07.233244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1d8fd-cdcc-49fc-95f2-e661c11b5f57 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:07.233663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1d8fd-cdcc-49fc-95f2-e661c11b5f57 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:07.233950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1d8fd-cdcc-49fc-95f2-e661c11b5f57 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:07.234659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1d8fd-cdcc-49fc-95f2-e661c11b5f57 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:07.234968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1d8fd-cdcc-49fc-95f2-e661c11b5f57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:07.236388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1d8fd-cdcc-49fc-95f2-e661c11b5f57 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:07.241421 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 354/715] 10.222.0.43 () {56 vars in 1124 bytes} [Sat Jul 2 20:45:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:07.244999 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-fa3106fd-1f82-4bd1-8ccc-5eda771c5787 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 20:45:07.244999 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:07.244999 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:07.244999 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:07.244999 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:07.244999 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:07.244999 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:07.244999 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:07.244999 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 20:45:07.244999 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:07.244999 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:07.244999 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:07.244999 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:07.244999 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:07.244999 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:07.244999 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:07.244999 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:07.246105 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:07.246105 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:07.246105 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:07.246105 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:07.246105 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:07.246105 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:07.246105 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:07.246105 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:07.246105 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:07.246105 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:07.246105 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:07.246105 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:07.246105 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:07.246105 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:07.246105 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:07.246105 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:07.246967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:07.246967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:07.246967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:07.246967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:07.246967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:07.246967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:07.246967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:07.246967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:07.246967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:07.246967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:07.246967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:07.246967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:07.246967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 20:45:07.246967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:07.248296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1d8fd-cdcc-49fc-95f2-e661c11b5f57 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:07.252474 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 362/716] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:06 2022] GET /identity/v3/services/network => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:07.258035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3106fd-1f82-4bd1-8ccc-5eda771c5787 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:07.286877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:07.288700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:07.393407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1d8fd-cdcc-49fc-95f2-e661c11b5f57 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:07.431664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa15853-1d13-4890-ad1b-3352063b639e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:07.432370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa15853-1d13-4890-ad1b-3352063b639e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:07.432655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa15853-1d13-4890-ad1b-3352063b639e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:07.433989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa15853-1d13-4890-ad1b-3352063b639e None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:07.434818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa15853-1d13-4890-ad1b-3352063b639e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:07.435138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa15853-1d13-4890-ad1b-3352063b639e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:07.436685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa15853-1d13-4890-ad1b-3352063b639e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:07.443540 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 355/717] 10.222.0.43 () {56 vars in 1124 bytes} [Sat Jul 2 20:45:07 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:07.521106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3106fd-1f82-4bd1-8ccc-5eda771c5787 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:07.585045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d02137-5505-4120-9220-ece1a847c219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:07.585721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d02137-5505-4120-9220-ece1a847c219 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:07.585999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d02137-5505-4120-9220-ece1a847c219 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:07.586271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d02137-5505-4120-9220-ece1a847c219 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:07.586980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d02137-5505-4120-9220-ece1a847c219 None admin] RBAC: Adding query filter params (name=network) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:07.587281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d02137-5505-4120-9220-ece1a847c219 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:07.588718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d02137-5505-4120-9220-ece1a847c219 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:07.600745 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 363/718] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Jul 2 20:45:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:07.606201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa15853-1d13-4890-ad1b-3352063b639e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:07.740610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:07.760340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa15853-1d13-4890-ad1b-3352063b639e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:07.794957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440153a9-751c-44af-b6dd-3a0df90c4b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:07.795937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440153a9-751c-44af-b6dd-3a0df90c4b03 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:07.796414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440153a9-751c-44af-b6dd-3a0df90c4b03 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:07.796834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440153a9-751c-44af-b6dd-3a0df90c4b03 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:07.797675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440153a9-751c-44af-b6dd-3a0df90c4b03 None admin] RBAC: Adding query filter params (type=network) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:07.798136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440153a9-751c-44af-b6dd-3a0df90c4b03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:07.799962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440153a9-751c-44af-b6dd-3a0df90c4b03 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:07.805254 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 356/719] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Jul 2 20:45:07 2022] GET /identity/v3/services?type=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:08.695630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e047b-c616-4b4d-ac35-5d203779ddff None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:08.696185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e047b-c616-4b4d-ac35-5d203779ddff None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:08.696185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e047b-c616-4b4d-ac35-5d203779ddff None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:08.697851 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 364/720] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:08.703350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9fa8b-e0bc-414b-99b5-cf365c6ae931 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:08.703638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9fa8b-e0bc-414b-99b5-cf365c6ae931 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:08.703929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9fa8b-e0bc-414b-99b5-cf365c6ae931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:08.724283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a3a9fa8b-e0bc-414b-99b5-cf365c6ae931 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:08.725487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a3a9fa8b-e0bc-414b-99b5-cf365c6ae931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:08.802737 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 357/721] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:45:08.848473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e047b-c616-4b4d-ac35-5d203779ddff None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:08.973975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:08.992716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e047b-c616-4b4d-ac35-5d203779ddff None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:09.038800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa8220-c930-476e-99b8-c71918e1bf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:09.039631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa8220-c930-476e-99b8-c71918e1bf89 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:09.039910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa8220-c930-476e-99b8-c71918e1bf89 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:09.040262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa8220-c930-476e-99b8-c71918e1bf89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:09.065332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa8220-c930-476e-99b8-c71918e1bf89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:09.073164 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-43aa8220-c930-476e-99b8-c71918e1bf89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:45:09.073164 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:09.073164 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:09.073164 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:09.073164 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:09.073164 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:09.073164 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:09.073164 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:09.073164 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:09.073164 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:09.073164 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:09.073164 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:09.073164 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:09.073164 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:09.073164 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:09.073164 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:09.074303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:09.074303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:09.074303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:09.074303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:09.074303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:09.074303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:09.074303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:09.074303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:09.074303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:09.074303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:09.074303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:09.074303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:09.074303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:09.074303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:09.074303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:09.074303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:09.075190 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:09.075190 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:09.075190 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:09.075190 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:09.075190 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:09.075190 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:09.075190 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:09.075190 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:09.075190 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:09.075190 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:09.075190 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:45:09.075190 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:09.075190 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 365/722] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:45:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:09.089420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9fa8b-e0bc-414b-99b5-cf365c6ae931 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:09.197005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:09.228801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9fa8b-e0bc-414b-99b5-cf365c6ae931 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:09.263708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc755610-f321-4f0d-8ec9-1f3842ba0d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:09.264405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc755610-f321-4f0d-8ec9-1f3842ba0d09 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:09.264687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc755610-f321-4f0d-8ec9-1f3842ba0d09 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:09.264964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc755610-f321-4f0d-8ec9-1f3842ba0d09 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:09.265711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc755610-f321-4f0d-8ec9-1f3842ba0d09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:09.266018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc755610-f321-4f0d-8ec9-1f3842ba0d09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:09.267406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc755610-f321-4f0d-8ec9-1f3842ba0d09 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:09.276411 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 358/723] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:45:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:09.281814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa8220-c930-476e-99b8-c71918e1bf89 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:09.319369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5472b-7ffe-4f15-8fc5-e2ce0f4b2631 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:09.319715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5472b-7ffe-4f15-8fc5-e2ce0f4b2631 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:09.319922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5472b-7ffe-4f15-8fc5-e2ce0f4b2631 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:09.321821 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 359/724] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:45:09.327708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3d8db-2179-4dba-9272-c8cda0f5d240 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:09.327989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3d8db-2179-4dba-9272-c8cda0f5d240 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:09.328301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3d8db-2179-4dba-9272-c8cda0f5d240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:09.357059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d0b3d8db-2179-4dba-9272-c8cda0f5d240 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:09.358234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d0b3d8db-2179-4dba-9272-c8cda0f5d240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:09.461949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa8220-c930-476e-99b8-c71918e1bf89 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:09.492844 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 360/725] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:45:09.518413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719941d3-9a66-41c1-8dc8-c189313b24fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:09.519509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719941d3-9a66-41c1-8dc8-c189313b24fb None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:09.519964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719941d3-9a66-41c1-8dc8-c189313b24fb None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:09.520548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719941d3-9a66-41c1-8dc8-c189313b24fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:09.532006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719941d3-9a66-41c1-8dc8-c189313b24fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:09.533736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719941d3-9a66-41c1-8dc8-c189313b24fb None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:09.540191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3d8db-2179-4dba-9272-c8cda0f5d240 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:09.542955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:09.570535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-719941d3-9a66-41c1-8dc8-c189313b24fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:09.570535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:09.570535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:09.570535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:09.570535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:09.570535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:09.570535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:09.570535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:09.570535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:09.570535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:09.570535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:09.570535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:09.570535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:09.570535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:09.570535 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:09.571546 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:09.571546 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:09.571546 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:09.571546 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:09.571546 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:09.571546 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:09.571546 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:09.571546 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:09.571546 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:09.571546 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:09.571546 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:09.571546 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:09.571546 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:09.571546 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:09.571546 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:09.571546 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:09.571546 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:09.572489 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:09.572489 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:09.572489 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:09.572489 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:09.578313 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 366/726] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:09.584171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719941d3-9a66-41c1-8dc8-c189313b24fb None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:09.646773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:09.686475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3d8db-2179-4dba-9272-c8cda0f5d240 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:09.739330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d46d4-9cf6-4291-9e66-c3799934194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:09.740446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d46d4-9cf6-4291-9e66-c3799934194c None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:09.740862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d46d4-9cf6-4291-9e66-c3799934194c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:09.741277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d46d4-9cf6-4291-9e66-c3799934194c None admin] PATH_INFO: `/v3/roles/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:09.752709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d46d4-9cf6-4291-9e66-c3799934194c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:09.757767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719941d3-9a66-41c1-8dc8-c189313b24fb None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:09.761744 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-bb2d46d4-9cf6-4291-9e66-c3799934194c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:45:09.761744 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:09.761744 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:09.761744 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:09.761744 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:09.761744 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:09.761744 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:09.761744 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:09.761744 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:09.761744 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:09.761744 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:09.761744 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:09.761744 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:09.761744 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:09.761744 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:09.761744 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:09.762894 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:09.762894 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:09.762894 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:09.762894 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:09.762894 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:09.762894 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:09.762894 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:09.762894 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:09.762894 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:09.762894 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:09.762894 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:09.762894 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:09.762894 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:09.762894 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:09.762894 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:09.762894 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:09.763957 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:09.763957 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:09.763957 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:09.763957 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:09.763957 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:09.763957 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:09.763957 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:09.763957 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:09.763957 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:09.763957 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:09.763957 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:45:09.763957 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:09.766384 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 361/727] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:45:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:09.767745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cf92b-8862-44f9-831f-a4b6b320534c None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:09.768183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cf92b-8862-44f9-831f-a4b6b320534c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:09.768603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cf92b-8862-44f9-831f-a4b6b320534c None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:09.770203 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 362/728] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:09.776914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cf92b-8862-44f9-831f-a4b6b320534c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:09.804098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994042dd-8cb9-4fb1-96d5-c3f42764e685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:09.805118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994042dd-8cb9-4fb1-96d5-c3f42764e685 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:09.805627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994042dd-8cb9-4fb1-96d5-c3f42764e685 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:09.806153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994042dd-8cb9-4fb1-96d5-c3f42764e685 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:09.807164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994042dd-8cb9-4fb1-96d5-c3f42764e685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:09.807719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994042dd-8cb9-4fb1-96d5-c3f42764e685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:09.809444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994042dd-8cb9-4fb1-96d5-c3f42764e685 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:09.822987 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 367/729] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:09.824684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87101636-9d71-4503-929d-1f015ce08c47 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:09.825179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87101636-9d71-4503-929d-1f015ce08c47 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:09.825656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87101636-9d71-4503-929d-1f015ce08c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:09.843201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-87101636-9d71-4503-929d-1f015ce08c47 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:09.844725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-87101636-9d71-4503-929d-1f015ce08c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:09.883778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cf92b-8862-44f9-831f-a4b6b320534c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:09.905130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:09.915308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:09.920570 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 368/730] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:45:09.921666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87101636-9d71-4503-929d-1f015ce08c47 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:09.928179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fd58e-b0fc-4922-94ac-928297baa8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:09.928854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fd58e-b0fc-4922-94ac-928297baa8aa None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:09.929140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fd58e-b0fc-4922-94ac-928297baa8aa None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:09.929402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fd58e-b0fc-4922-94ac-928297baa8aa None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:09.930157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fd58e-b0fc-4922-94ac-928297baa8aa None admin] RBAC: Adding query filter params (name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:09.930456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fd58e-b0fc-4922-94ac-928297baa8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:09.931827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fd58e-b0fc-4922-94ac-928297baa8aa None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:09.949920 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 363/731] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:45:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:09.961475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fd58e-b0fc-4922-94ac-928297baa8aa None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:10.032838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87101636-9d71-4503-929d-1f015ce08c47 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:10.068356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fd58e-b0fc-4922-94ac-928297baa8aa None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:10.070543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28e52d-b6de-4a3d-ad3f-ebd42def612e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:10.071621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28e52d-b6de-4a3d-ad3f-ebd42def612e None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:10.072126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28e52d-b6de-4a3d-ad3f-ebd42def612e None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:10.072602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28e52d-b6de-4a3d-ad3f-ebd42def612e None admin] PATH_INFO: `/v3/users/swift` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:10.080716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28e52d-b6de-4a3d-ad3f-ebd42def612e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:10.082592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28e52d-b6de-4a3d-ad3f-ebd42def612e None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:10.103715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abf9c8-68c3-4d34-9d4c-c26039504cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:10.104609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abf9c8-68c3-4d34-9d4c-c26039504cb0 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:10.104947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abf9c8-68c3-4d34-9d4c-c26039504cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:10.105396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abf9c8-68c3-4d34-9d4c-c26039504cb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:10.106183 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-8d28e52d-b6de-4a3d-ad3f-ebd42def612e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 02 20:45:10.106183 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:10.106183 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:10.106183 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:10.106183 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:10.106183 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:10.106183 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:10.106183 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:10.106183 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:10.106183 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:10.106183 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:10.106183 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:10.106183 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:10.106183 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:10.106183 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:10.106183 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:10.107154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:10.107154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:10.107154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:10.107154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:10.107154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:10.107154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:10.107154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:10.107154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:10.107154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:10.107154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:10.107154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:10.107154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:10.107154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:10.107154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:10.107154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:10.107154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:10.107154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:10.107154 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:10.108214 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:10.108214 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:10.108214 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:10.108214 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:10.108214 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:10.108214 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:10.108214 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:10.108214 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:10.108214 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 02 20:45:10.108214 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:10.110922 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 369/732] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:45:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:10.111961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28e52d-b6de-4a3d-ad3f-ebd42def612e None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:10.119484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abf9c8-68c3-4d34-9d4c-c26039504cb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:10.121110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abf9c8-68c3-4d34-9d4c-c26039504cb0 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:10.139851 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-f0abf9c8-68c3-4d34-9d4c-c26039504cb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:10.139851 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:10.139851 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:10.139851 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:10.139851 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:10.139851 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:10.139851 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:10.139851 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:10.139851 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:10.139851 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:10.139851 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:10.139851 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:10.139851 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:10.139851 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:10.139851 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:10.140864 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:10.140864 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:10.140864 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:10.140864 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:10.140864 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:10.140864 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:10.140864 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:10.140864 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:10.140864 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:10.140864 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:10.140864 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:10.140864 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:10.140864 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:10.140864 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:10.140864 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:10.140864 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:10.140864 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:10.141797 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:10.141797 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:10.141797 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:10.141797 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:10.141797 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 364/733] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:10.142515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abf9c8-68c3-4d34-9d4c-c26039504cb0 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:10.169309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:10.193268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:10.225517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28e52d-b6de-4a3d-ad3f-ebd42def612e None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:10.253659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abf9c8-68c3-4d34-9d4c-c26039504cb0 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:10.267149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77a5dc-20c6-40e7-9648-8acbd473fa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:10.268474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77a5dc-20c6-40e7-9648-8acbd473fa24 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:10.268960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77a5dc-20c6-40e7-9648-8acbd473fa24 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:10.269481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77a5dc-20c6-40e7-9648-8acbd473fa24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:10.281121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77a5dc-20c6-40e7-9648-8acbd473fa24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:10.289846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-ee77a5dc-20c6-40e7-9648-8acbd473fa24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:45:10.289846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:10.289846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:10.289846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:10.289846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:10.289846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:10.289846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:10.289846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:10.289846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:10.289846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:10.289846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:10.289846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:10.289846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:10.289846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:10.289846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:10.289846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:10.290874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:10.290874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:10.290874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:10.290874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:10.290874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:10.290874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:10.290874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:10.290874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:10.290874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:10.290874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:10.290874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:10.290874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:10.290874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:10.290874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:10.290874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:10.290874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:10.291763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:10.291763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:10.291763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:10.291763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:10.291763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:10.291763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:10.291763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:10.291763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:10.291763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:10.291763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:10.291763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:45:10.291763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:10.292504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6576b-5de5-43d9-8f10-4ef0c30f4d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:10.292504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6576b-5de5-43d9-8f10-4ef0c30f4d3e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:10.292504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6576b-5de5-43d9-8f10-4ef0c30f4d3e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:10.292504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6576b-5de5-43d9-8f10-4ef0c30f4d3e None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:10.292785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6576b-5de5-43d9-8f10-4ef0c30f4d3e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:10.292785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6576b-5de5-43d9-8f10-4ef0c30f4d3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:10.293994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6576b-5de5-43d9-8f10-4ef0c30f4d3e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:10.294973 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 370/734] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:45:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:10.296112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77a5dc-20c6-40e7-9648-8acbd473fa24 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:10.318567 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 365/735] 10.222.0.43 () {56 vars in 1135 bytes} [Sat Jul 2 20:45:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:10.319426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6576b-5de5-43d9-8f10-4ef0c30f4d3e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:10.403327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77a5dc-20c6-40e7-9648-8acbd473fa24 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:10.415145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:10.425870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6576b-5de5-43d9-8f10-4ef0c30f4d3e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:10.427722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:10.443988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be618fe-1cf4-4077-bfb6-345ce7e77165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:10.444687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be618fe-1cf4-4077-bfb6-345ce7e77165 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:10.445098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be618fe-1cf4-4077-bfb6-345ce7e77165 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:10.445456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be618fe-1cf4-4077-bfb6-345ce7e77165 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:10.446277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be618fe-1cf4-4077-bfb6-345ce7e77165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:10.446683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be618fe-1cf4-4077-bfb6-345ce7e77165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:10.448572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be618fe-1cf4-4077-bfb6-345ce7e77165 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:10.461586 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 371/736] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:10.462645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be618fe-1cf4-4077-bfb6-345ce7e77165 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:10.466298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2707b28-3ee5-4efe-8396-faed9986c9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:10.467236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2707b28-3ee5-4efe-8396-faed9986c9f7 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:10.467751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2707b28-3ee5-4efe-8396-faed9986c9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:10.468233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2707b28-3ee5-4efe-8396-faed9986c9f7 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:10.469261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2707b28-3ee5-4efe-8396-faed9986c9f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:10.469737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2707b28-3ee5-4efe-8396-faed9986c9f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:10.471368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2707b28-3ee5-4efe-8396-faed9986c9f7 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:10.485720 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 366/737] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:45:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:10.486899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2707b28-3ee5-4efe-8396-faed9986c9f7 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:10.576171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be618fe-1cf4-4077-bfb6-345ce7e77165 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:10.602647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2707b28-3ee5-4efe-8396-faed9986c9f7 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:10.616745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5f678-363d-4278-8589-5dfe0f186cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:10.617385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5f678-363d-4278-8589-5dfe0f186cb8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:10.617663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5f678-363d-4278-8589-5dfe0f186cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:10.617957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5f678-363d-4278-8589-5dfe0f186cb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:10.638603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9591a-ebd2-48df-b17e-a158cf9a21b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:10.639415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9591a-ebd2-48df-b17e-a158cf9a21b0 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:10.639694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9591a-ebd2-48df-b17e-a158cf9a21b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:10.639965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9591a-ebd2-48df-b17e-a158cf9a21b0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:10.647922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9591a-ebd2-48df-b17e-a158cf9a21b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:10.649392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9591a-ebd2-48df-b17e-a158cf9a21b0 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:10.662032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:10.663972 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-a2f9591a-ebd2-48df-b17e-a158cf9a21b0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 20:45:10.663972 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:10.663972 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:10.663972 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:10.663972 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:10.663972 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:10.663972 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:10.663972 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:10.663972 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:10.663972 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:10.663972 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:10.663972 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:10.663972 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:10.663972 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:10.663972 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:10.663972 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:10.665025 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:10.665025 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:10.665025 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:10.665025 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:10.665025 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:10.665025 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:10.665025 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:10.665025 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:10.665025 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:10.665025 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:10.665025 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:10.665025 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:10.665025 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:10.665025 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:10.665025 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:10.665025 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:10.665025 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:10.665025 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:10.666342 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:10.666342 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:10.666342 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:10.666342 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:10.666342 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:10.666342 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:10.666342 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:10.666342 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:10.666342 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 20:45:10.666342 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:10.669781 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 367/738] 10.222.0.43 () {56 vars in 1117 bytes} [Sat Jul 2 20:45:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:10.671143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45a157-3ef7-4f7a-8a49-2fe83a170249 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:10.671428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45a157-3ef7-4f7a-8a49-2fe83a170249 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:10.671700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45a157-3ef7-4f7a-8a49-2fe83a170249 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:10.673004 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 368/739] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:10.676823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45a157-3ef7-4f7a-8a49-2fe83a170249 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:10.698292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5f678-363d-4278-8589-5dfe0f186cb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:10.699761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5f678-363d-4278-8589-5dfe0f186cb8 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:10.705224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:10.789553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45a157-3ef7-4f7a-8a49-2fe83a170249 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:10.802067 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 372/740] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:45:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:45:10.802905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5f678-363d-4278-8589-5dfe0f186cb8 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:10.823949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564a036-1052-4767-802a-a82fd8bb976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:10.824767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564a036-1052-4767-802a-a82fd8bb976d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:10.825053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564a036-1052-4767-802a-a82fd8bb976d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:10.825327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564a036-1052-4767-802a-a82fd8bb976d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:10.835957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564a036-1052-4767-802a-a82fd8bb976d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:10.837598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564a036-1052-4767-802a-a82fd8bb976d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:10.854768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-a564a036-1052-4767-802a-a82fd8bb976d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:10.854768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:10.854768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:10.854768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:10.854768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:10.854768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:10.854768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:10.854768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:10.854768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:10.854768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:10.854768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:10.854768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:10.854768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:10.854768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:10.854768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:10.855795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:10.855795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:10.855795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:10.855795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:10.855795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:10.855795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:10.855795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:10.855795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:10.855795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:10.855795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:10.855795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:10.855795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:10.855795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:10.855795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:10.855795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:10.855795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:10.855795 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:10.857046 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:10.857046 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:10.857046 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:10.857046 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:10.857046 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 369/741] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:10.857351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94369c-c722-4839-9c42-0175abecb84a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:10.857446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94369c-c722-4839-9c42-0175abecb84a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:10.857959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94369c-c722-4839-9c42-0175abecb84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:10.873708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4a94369c-c722-4839-9c42-0175abecb84a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:10.874343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:10.874896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4a94369c-c722-4839-9c42-0175abecb84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:10.905669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5f678-363d-4278-8589-5dfe0f186cb8 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:10.939028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc329f7-084a-44b3-8933-0035e573c0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:10.939697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc329f7-084a-44b3-8933-0035e573c0e7 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:10.940000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc329f7-084a-44b3-8933-0035e573c0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:10.940295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc329f7-084a-44b3-8933-0035e573c0e7 None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:10.940698 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 370/742] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:45:10.941136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc329f7-084a-44b3-8933-0035e573c0e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:10.941396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc329f7-084a-44b3-8933-0035e573c0e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:10.941988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64781766-8d0a-4c3b-9306-03fe997e7b3d None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:10.942275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64781766-8d0a-4c3b-9306-03fe997e7b3d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:10.942549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64781766-8d0a-4c3b-9306-03fe997e7b3d None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:10.942839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc329f7-084a-44b3-8933-0035e573c0e7 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:10.943955 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 371/743] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:10.944693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64781766-8d0a-4c3b-9306-03fe997e7b3d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:10.958057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:10.980238 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 373/744] 10.222.0.43 () {56 vars in 1149 bytes} [Sat Jul 2 20:45:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:10.981078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc329f7-084a-44b3-8933-0035e573c0e7 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:11.055719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64781766-8d0a-4c3b-9306-03fe997e7b3d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:11.077185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc329f7-084a-44b3-8933-0035e573c0e7 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:11.092778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a77f38-08cd-4906-9a96-49892bbc3b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:11.093501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a77f38-08cd-4906-9a96-49892bbc3b1c None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:11.093773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a77f38-08cd-4906-9a96-49892bbc3b1c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:11.094038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a77f38-08cd-4906-9a96-49892bbc3b1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:11.104067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a77f38-08cd-4906-9a96-49892bbc3b1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:11.105543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a77f38-08cd-4906-9a96-49892bbc3b1c None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:11.108649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:11.117845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857e3fe-fbdc-424c-9169-a0a7d23deb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:11.118501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857e3fe-fbdc-424c-9169-a0a7d23deb4e None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:11.118783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857e3fe-fbdc-424c-9169-a0a7d23deb4e None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:11.119054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857e3fe-fbdc-424c-9169-a0a7d23deb4e None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:11.119763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857e3fe-fbdc-424c-9169-a0a7d23deb4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:11.120142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857e3fe-fbdc-424c-9169-a0a7d23deb4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:11.121501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857e3fe-fbdc-424c-9169-a0a7d23deb4e None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:11.122730 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-05a77f38-08cd-4906-9a96-49892bbc3b1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:11.122730 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:11.122730 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:11.122730 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:11.122730 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:11.122730 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:11.122730 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:11.122730 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:11.122730 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:11.122730 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:11.122730 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:11.122730 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:11.122730 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:11.122730 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:11.122730 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:11.123759 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:11.123759 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:11.123759 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:11.123759 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:11.123759 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:11.123759 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:11.123759 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:11.123759 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:11.123759 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:11.123759 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:11.123759 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:11.123759 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:11.123759 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:11.123759 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:11.123759 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:11.123759 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:11.123759 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:11.124706 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:11.124706 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:11.124706 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:11.124706 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:11.124706 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 372/745] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:11.125194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b0901-dcc2-4fe9-abb2-f601e5605b43 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:11.125457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b0901-dcc2-4fe9-abb2-f601e5605b43 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:11.125729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b0901-dcc2-4fe9-abb2-f601e5605b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:11.137768 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 374/746] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:11.138557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857e3fe-fbdc-424c-9169-a0a7d23deb4e None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:11.143005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-786b0901-dcc2-4fe9-abb2-f601e5605b43 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:11.144220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-786b0901-dcc2-4fe9-abb2-f601e5605b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:11.196702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:11.210516 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 373/747] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:45:11.211341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b0901-dcc2-4fe9-abb2-f601e5605b43 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:11.243809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857e3fe-fbdc-424c-9169-a0a7d23deb4e None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:11.286536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf4692-1b43-4108-8b7d-3813a06836dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:11.287228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4692-1b43-4108-8b7d-3813a06836dc None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:11.287509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4692-1b43-4108-8b7d-3813a06836dc None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:11.287787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4692-1b43-4108-8b7d-3813a06836dc None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:11.292071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf4692-1b43-4108-8b7d-3813a06836dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:11.292071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf4692-1b43-4108-8b7d-3813a06836dc None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:11.307841 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 375/748] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Jul 2 20:45:11 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:45:11.308697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf4692-1b43-4108-8b7d-3813a06836dc None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:11.336835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b0901-dcc2-4fe9-abb2-f601e5605b43 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:11.370337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:11.387946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b7853-30b3-4595-a841-e8ead0daf632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:11.388741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b7853-30b3-4595-a841-e8ead0daf632 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:11.389084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b7853-30b3-4595-a841-e8ead0daf632 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:11.389422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b7853-30b3-4595-a841-e8ead0daf632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:11.432939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf4692-1b43-4108-8b7d-3813a06836dc None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:11.448371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:11.467289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b7853-30b3-4595-a841-e8ead0daf632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:11.468810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b7853-30b3-4595-a841-e8ead0daf632 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:11.471037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a0667-25d2-4133-8cd4-f344a2b7f810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:11.471721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a0667-25d2-4133-8cd4-f344a2b7f810 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:11.471996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a0667-25d2-4133-8cd4-f344a2b7f810 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:11.472303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a0667-25d2-4133-8cd4-f344a2b7f810 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:11.473031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a0667-25d2-4133-8cd4-f344a2b7f810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:11.473338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a0667-25d2-4133-8cd4-f344a2b7f810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:11.474744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a0667-25d2-4133-8cd4-f344a2b7f810 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:11.492363 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 376/749] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:11.492363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a0667-25d2-4133-8cd4-f344a2b7f810 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:11.581289 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 374/750] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:45:11 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:45:11.582042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b7853-30b3-4595-a841-e8ead0daf632 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:11.604011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a0667-25d2-4133-8cd4-f344a2b7f810 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:11.614909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:11.641724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691b429-50aa-48a6-9fa5-fd1c9a9fcd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:11.642529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691b429-50aa-48a6-9fa5-fd1c9a9fcd72 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:11.642885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691b429-50aa-48a6-9fa5-fd1c9a9fcd72 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:11.643219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691b429-50aa-48a6-9fa5-fd1c9a9fcd72 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:11.651210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691b429-50aa-48a6-9fa5-fd1c9a9fcd72 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:11.654158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691b429-50aa-48a6-9fa5-fd1c9a9fcd72 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:11.668462 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-8691b429-50aa-48a6-9fa5-fd1c9a9fcd72 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:45:11.668462 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:11.668462 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:11.668462 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:11.668462 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:11.668462 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:11.668462 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:11.668462 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:11.668462 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:11.668462 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:11.668462 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:11.668462 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:11.668462 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:11.668462 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:11.668462 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:11.668462 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:11.669662 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:11.669662 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:11.669662 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:11.669662 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:11.669662 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:11.669662 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:11.669662 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:11.669662 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:11.669662 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:11.669662 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:11.669662 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:11.669662 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:11.669662 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:11.669662 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:11.669662 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:11.669662 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:11.669662 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:11.669662 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:11.670677 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:11.670677 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:11.670677 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:11.670677 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:11.670677 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:11.670677 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:11.670677 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:11.670677 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:11.670677 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:45:11.670677 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:11.670677 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 377/751] 10.222.0.43 () {56 vars in 1093 bytes} [Sat Jul 2 20:45:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:11.671298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691b429-50aa-48a6-9fa5-fd1c9a9fcd72 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:11.683195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:11.701981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b7853-30b3-4595-a841-e8ead0daf632 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:11.738852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bfbbd-d6eb-4d1b-977b-ce9b92c28578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:11.739509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bfbbd-d6eb-4d1b-977b-ce9b92c28578 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:11.739786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bfbbd-d6eb-4d1b-977b-ce9b92c28578 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:11.740068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bfbbd-d6eb-4d1b-977b-ce9b92c28578 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:11.740796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bfbbd-d6eb-4d1b-977b-ce9b92c28578 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:11.742163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bfbbd-d6eb-4d1b-977b-ce9b92c28578 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:11.759973 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 375/752] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Jul 2 20:45:11 2022] POST /identity/v3/services => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:45:11.760769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bfbbd-d6eb-4d1b-977b-ce9b92c28578 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:11.813878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691b429-50aa-48a6-9fa5-fd1c9a9fcd72 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:11.864757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3fea1-4284-4de5-a9ca-42a5f345870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:11.865846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3fea1-4284-4de5-a9ca-42a5f345870b None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:11.866125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3fea1-4284-4de5-a9ca-42a5f345870b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:11.866394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3fea1-4284-4de5-a9ca-42a5f345870b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:11.877192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3fea1-4284-4de5-a9ca-42a5f345870b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:11.879448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3fea1-4284-4de5-a9ca-42a5f345870b None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:11.888853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bfbbd-d6eb-4d1b-977b-ce9b92c28578 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:11.899396 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-0db3fea1-4284-4de5-a9ca-42a5f345870b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:11.899396 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:11.899396 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:11.899396 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:11.899396 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:11.899396 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:11.899396 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:11.899396 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:11.899396 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:11.899396 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:11.899396 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:11.899396 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:11.899396 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:11.899396 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:11.899396 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:11.900383 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:11.900383 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:11.900383 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:11.900383 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:11.900383 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:11.900383 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:11.900383 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:11.900383 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:11.900383 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:11.900383 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:11.900383 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:11.900383 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:11.900383 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:11.900383 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:11.900383 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:11.900383 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:11.900383 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:11.901400 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:11.901400 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:11.901400 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:11.901400 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:11.901400 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:11.901400 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:11.901400 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:11.901400 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:11.904373 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 378/753] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:11.905458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3fea1-4284-4de5-a9ca-42a5f345870b None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:11.936471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddcd28-df8a-4d2f-9d27-e30df54873de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:11.937580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddcd28-df8a-4d2f-9d27-e30df54873de None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:11.938002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddcd28-df8a-4d2f-9d27-e30df54873de None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:11.938364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddcd28-df8a-4d2f-9d27-e30df54873de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:11.943406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:11.952190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddcd28-df8a-4d2f-9d27-e30df54873de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:11.954011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddcd28-df8a-4d2f-9d27-e30df54873de None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:11.957446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:11.977585 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-23ddcd28-df8a-4d2f-9d27-e30df54873de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:11.977585 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:11.977585 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:11.977585 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:11.977585 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:11.977585 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:11.977585 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:11.977585 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:11.977585 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:11.977585 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:11.977585 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:11.977585 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:11.977585 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:11.977585 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:11.977585 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:11.978732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:11.978732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:11.978732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:11.978732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:11.978732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:11.978732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:11.978732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:11.978732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:11.978732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:11.978732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:11.978732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:11.978732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:11.978732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:11.978732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:11.978732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:11.978732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:11.978732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:11.980000 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:11.980000 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:11.980000 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:11.980000 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:11.985941 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 376/754] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:11.985941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddcd28-df8a-4d2f-9d27-e30df54873de None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:12.042628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3fea1-4284-4de5-a9ca-42a5f345870b None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:12.091780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3ed7c-aa62-41cf-ae69-69a0188a5b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:12.093041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3ed7c-aa62-41cf-ae69-69a0188a5b64 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:12.093328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3ed7c-aa62-41cf-ae69-69a0188a5b64 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:12.093610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3ed7c-aa62-41cf-ae69-69a0188a5b64 None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:12.094449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3ed7c-aa62-41cf-ae69-69a0188a5b64 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:12.094825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3ed7c-aa62-41cf-ae69-69a0188a5b64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:12.096408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3ed7c-aa62-41cf-ae69-69a0188a5b64 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:12.109293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddcd28-df8a-4d2f-9d27-e30df54873de None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:12.120379 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 379/755] 10.222.0.43 () {56 vars in 1133 bytes} [Sat Jul 2 20:45:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:12.121252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3ed7c-aa62-41cf-ae69-69a0188a5b64 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:12.152746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bbd77-faaf-489f-8469-e71d4080369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:12.153560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bbd77-faaf-489f-8469-e71d4080369d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:12.153955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bbd77-faaf-489f-8469-e71d4080369d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:12.154327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bbd77-faaf-489f-8469-e71d4080369d None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:12.155211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bbd77-faaf-489f-8469-e71d4080369d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:12.155688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bbd77-faaf-489f-8469-e71d4080369d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:12.157323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bbd77-faaf-489f-8469-e71d4080369d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:12.170651 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 377/756] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:12.171649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bbd77-faaf-489f-8469-e71d4080369d None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:12.210523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:12.230082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3ed7c-aa62-41cf-ae69-69a0188a5b64 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:12.236483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:12.265650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601784d-ba41-4200-9442-78cac4a68b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:12.266562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601784d-ba41-4200-9442-78cac4a68b82 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:12.267010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601784d-ba41-4200-9442-78cac4a68b82 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:12.267433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601784d-ba41-4200-9442-78cac4a68b82 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:12.268321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601784d-ba41-4200-9442-78cac4a68b82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:12.268772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601784d-ba41-4200-9442-78cac4a68b82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:12.270354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601784d-ba41-4200-9442-78cac4a68b82 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:12.282184 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 380/757] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:12.283146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601784d-ba41-4200-9442-78cac4a68b82 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:12.285063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bbd77-faaf-489f-8469-e71d4080369d None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:12.322629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7fbc3-485e-4bac-b708-6b82db0537bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:12.323641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7fbc3-485e-4bac-b708-6b82db0537bd None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:12.324011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7fbc3-485e-4bac-b708-6b82db0537bd None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:12.324408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7fbc3-485e-4bac-b708-6b82db0537bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:12.336079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7fbc3-485e-4bac-b708-6b82db0537bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:12.337663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7fbc3-485e-4bac-b708-6b82db0537bd None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:12.357610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-14a7fbc3-485e-4bac-b708-6b82db0537bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:12.357610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:12.357610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:12.357610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:12.357610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:12.357610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:12.357610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:12.357610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:12.357610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:12.357610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:12.357610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:12.357610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:12.357610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:12.357610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:12.357610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:12.358786 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:12.358786 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:12.358786 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:12.358786 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:12.358786 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:12.358786 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:12.358786 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:12.358786 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:12.358786 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:12.358786 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:12.358786 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:12.358786 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:12.358786 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:12.358786 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:12.358786 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:12.358786 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:12.358786 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:12.359909 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:12.359909 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:12.359909 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:12.359909 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:12.361256 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 378/758] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:12.366575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7fbc3-485e-4bac-b708-6b82db0537bd None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:12.391788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601784d-ba41-4200-9442-78cac4a68b82 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:12.427173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811f714-c6b3-4cfd-81a1-c9e3137561c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:12.428093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811f714-c6b3-4cfd-81a1-c9e3137561c1 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:12.428516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811f714-c6b3-4cfd-81a1-c9e3137561c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:12.428938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811f714-c6b3-4cfd-81a1-c9e3137561c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:12.429960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811f714-c6b3-4cfd-81a1-c9e3137561c1 None admin] RBAC: Adding query filter params (role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=55367f643da048c5ab61ab6325552256) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:12.430446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811f714-c6b3-4cfd-81a1-c9e3137561c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:12.432071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811f714-c6b3-4cfd-81a1-c9e3137561c1 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:12.438609 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 381/759] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:45:12 2022] GET /identity/v3/role_assignments?user.id=55367f643da048c5ab61ab6325552256&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:12.439614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811f714-c6b3-4cfd-81a1-c9e3137561c1 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:12.449188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:12.479434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7fbc3-485e-4bac-b708-6b82db0537bd None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:12.491708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:12.548630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58203a20-776a-4b16-bf2c-78dc57510146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:12.549863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58203a20-776a-4b16-bf2c-78dc57510146 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:12.550391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58203a20-776a-4b16-bf2c-78dc57510146 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:12.550957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58203a20-776a-4b16-bf2c-78dc57510146 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:12.553946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811f714-c6b3-4cfd-81a1-c9e3137561c1 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:12.568473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58203a20-776a-4b16-bf2c-78dc57510146 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:12.569958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58203a20-776a-4b16-bf2c-78dc57510146 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:12.594641 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-58203a20-776a-4b16-bf2c-78dc57510146 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:12.594641 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:12.594641 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:12.594641 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:12.594641 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:12.594641 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:12.594641 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:12.594641 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:12.594641 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:12.594641 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:12.594641 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:12.594641 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:12.594641 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:12.594641 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:12.594641 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:12.595636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:12.595636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:12.595636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:12.595636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:12.595636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:12.595636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:12.595636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:12.595636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:12.595636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:12.595636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:12.595636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:12.595636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:12.595636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:12.595636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:12.595636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:12.595636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:12.595636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:12.596599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:12.596599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:12.596599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:12.596599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:12.596599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:12.596599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:12.596599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:12.596599 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:12.597041 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 379/760] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:12.601755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45726e9c-9698-4495-b1e7-27410c77f1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:12.602792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45726e9c-9698-4495-b1e7-27410c77f1a8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:12.603272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45726e9c-9698-4495-b1e7-27410c77f1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:12.603843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45726e9c-9698-4495-b1e7-27410c77f1a8 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:12.605118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45726e9c-9698-4495-b1e7-27410c77f1a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:12.605277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58203a20-776a-4b16-bf2c-78dc57510146 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:12.606108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45726e9c-9698-4495-b1e7-27410c77f1a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:12.608622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45726e9c-9698-4495-b1e7-27410c77f1a8 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:12.624591 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 382/761] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:12.630601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45726e9c-9698-4495-b1e7-27410c77f1a8 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:12.739181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:12.777914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45726e9c-9698-4495-b1e7-27410c77f1a8 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:12.816313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58203a20-776a-4b16-bf2c-78dc57510146 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:12.818999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74856c36-8677-439b-a8c4-f0b2962f3eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:12.819812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74856c36-8677-439b-a8c4-f0b2962f3eba None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:12.820113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74856c36-8677-439b-a8c4-f0b2962f3eba None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:12.820392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74856c36-8677-439b-a8c4-f0b2962f3eba None admin] PATH_INFO: `/v3/projects/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:12.840863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74856c36-8677-439b-a8c4-f0b2962f3eba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:12.842336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74856c36-8677-439b-a8c4-f0b2962f3eba None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:12.862128 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-74856c36-8677-439b-a8c4-f0b2962f3eba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:12.862128 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:12.862128 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:12.862128 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:12.862128 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:12.862128 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:12.862128 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:12.862128 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:12.862128 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:12.862128 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:12.862128 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:12.862128 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:12.862128 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:12.862128 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:12.862128 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:12.863074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:12.863074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:12.863074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:12.863074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:12.863074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:12.863074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:12.863074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:12.863074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:12.863074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:12.863074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:12.863074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:12.863074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:12.863074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:12.863074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:12.863074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:12.863074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:12.863074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:12.863984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:12.863984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:12.863984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:12.863984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:12.863984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:12.863984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:12.863984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:12.863984 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:12.866828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956b696-85d8-44d0-a426-dfcaedeeb128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:12.866828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956b696-85d8-44d0-a426-dfcaedeeb128 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:12.866828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956b696-85d8-44d0-a426-dfcaedeeb128 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:12.866828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956b696-85d8-44d0-a426-dfcaedeeb128 None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:12.867592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956b696-85d8-44d0-a426-dfcaedeeb128 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:12.867898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956b696-85d8-44d0-a426-dfcaedeeb128 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:12.869382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956b696-85d8-44d0-a426-dfcaedeeb128 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:12.877409 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 383/762] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:12.884201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74856c36-8677-439b-a8c4-f0b2962f3eba None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:12.893819 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 380/763] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:12.894805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956b696-85d8-44d0-a426-dfcaedeeb128 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:12.952332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:13.011046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74856c36-8677-439b-a8c4-f0b2962f3eba None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:13.040513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:13.054871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3169d4-cafc-443c-a3c4-1399e6af35c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:13.056551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3169d4-cafc-443c-a3c4-1399e6af35c6 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:13.062049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3169d4-cafc-443c-a3c4-1399e6af35c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:13.062503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3169d4-cafc-443c-a3c4-1399e6af35c6 None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:13.063484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3169d4-cafc-443c-a3c4-1399e6af35c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:13.063945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3169d4-cafc-443c-a3c4-1399e6af35c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:13.065568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3169d4-cafc-443c-a3c4-1399e6af35c6 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:13.090797 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 384/764] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:13.095878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956b696-85d8-44d0-a426-dfcaedeeb128 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:13.097467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3169d4-cafc-443c-a3c4-1399e6af35c6 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:13.140246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe9037-05fb-4d97-8ee8-73d3a567d558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:13.141181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe9037-05fb-4d97-8ee8-73d3a567d558 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:13.141620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe9037-05fb-4d97-8ee8-73d3a567d558 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:13.142141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe9037-05fb-4d97-8ee8-73d3a567d558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:13.144142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe9037-05fb-4d97-8ee8-73d3a567d558 None admin] RBAC: Adding query filter params (role.id=843bfd29577143dcb23593a75d4ee5a0, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=4d4bfe417b4c4896ae5f3fc23e03ef71) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:13.147691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe9037-05fb-4d97-8ee8-73d3a567d558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:13.149353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe9037-05fb-4d97-8ee8-73d3a567d558 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:13.159586 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 381/765] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:45:12 2022] GET /identity/v3/role_assignments?user.id=4d4bfe417b4c4896ae5f3fc23e03ef71&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=843bfd29577143dcb23593a75d4ee5a0 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:13.242772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3169d4-cafc-443c-a3c4-1399e6af35c6 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:13.282950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf35905-a47a-4835-a79c-6d5a262758d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:13.284119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf35905-a47a-4835-a79c-6d5a262758d4 None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:13.284551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf35905-a47a-4835-a79c-6d5a262758d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:13.285000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf35905-a47a-4835-a79c-6d5a262758d4 None admin] PATH_INFO: `/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/aa3e290fa5384f9bac3fec771cebf653/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:13.287145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf35905-a47a-4835-a79c-6d5a262758d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=001bf63308784f4eb62e64d6f82c8354, user_id=aa3e290fa5384f9bac3fec771cebf653, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:13.288780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf35905-a47a-4835-a79c-6d5a262758d4 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:13.315859 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 385/766] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:45:13 2022] PUT /identity/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/aa3e290fa5384f9bac3fec771cebf653/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:45:13.877219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb801f-08ad-476c-96e6-95ee9a9be47d None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:13.877952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb801f-08ad-476c-96e6-95ee9a9be47d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:13.878440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb801f-08ad-476c-96e6-95ee9a9be47d None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:13.880287 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 382/767] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:13.885146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48267d60-ef5e-46a2-a451-539a13e4f9a2 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:13.886074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48267d60-ef5e-46a2-a451-539a13e4f9a2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:13.886567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48267d60-ef5e-46a2-a451-539a13e4f9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:13.909119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-48267d60-ef5e-46a2-a451-539a13e4f9a2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:13.910666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-48267d60-ef5e-46a2-a451-539a13e4f9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:13.965428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:13.992351 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 386/768] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:14.031357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb801f-08ad-476c-96e6-95ee9a9be47d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:14.138506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:14.154815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb801f-08ad-476c-96e6-95ee9a9be47d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:14.200592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d2832-28b3-49e0-944f-28b993e90e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:14.201431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d2832-28b3-49e0-944f-28b993e90e35 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:14.201710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d2832-28b3-49e0-944f-28b993e90e35 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:14.201983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d2832-28b3-49e0-944f-28b993e90e35 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:14.202647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d2832-28b3-49e0-944f-28b993e90e35 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:14.204090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d2832-28b3-49e0-944f-28b993e90e35 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:14.217648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-961d2832-28b3-49e0-944f-28b993e90e35 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 20:45:14.217648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:14.217648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:14.217648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:14.217648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:14.217648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:14.217648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:14.217648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:14.217648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 20:45:14.217648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:14.217648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:14.217648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:14.217648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:14.217648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:14.217648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:14.217648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:14.218690 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:14.218690 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:14.218690 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:14.218690 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:14.218690 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:14.218690 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:14.218690 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:14.218690 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:14.218690 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:14.218690 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:14.218690 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:14.218690 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:14.218690 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:14.218690 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:14.218690 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:14.218690 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:14.219560 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:14.219560 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:14.219560 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:14.219560 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:14.219560 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:14.219560 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:14.219560 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:14.219560 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:14.219560 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:14.219560 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:14.219560 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:14.219560 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:14.219560 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:14.219560 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 20:45:14.219560 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:14.219560 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 383/769] 10.222.0.43 () {56 vars in 1129 bytes} [Sat Jul 2 20:45:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:14.225001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48267d60-ef5e-46a2-a451-539a13e4f9a2 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:14.383315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48267d60-ef5e-46a2-a451-539a13e4f9a2 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:14.434701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2205e8-c103-4ddc-bdc6-5655467630cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:14.435771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2205e8-c103-4ddc-bdc6-5655467630cb None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:14.436285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2205e8-c103-4ddc-bdc6-5655467630cb None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:14.436762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2205e8-c103-4ddc-bdc6-5655467630cb None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:14.437670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2205e8-c103-4ddc-bdc6-5655467630cb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:14.438207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2205e8-c103-4ddc-bdc6-5655467630cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:14.439808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2205e8-c103-4ddc-bdc6-5655467630cb None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:14.448327 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 387/770] 10.222.0.43 () {56 vars in 1124 bytes} [Sat Jul 2 20:45:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:14.454060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d2832-28b3-49e0-944f-28b993e90e35 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:14.555320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c1e0d-970d-41f1-a2b9-4cd8f4527b1a None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:14.555989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c1e0d-970d-41f1-a2b9-4cd8f4527b1a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:14.556491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c1e0d-970d-41f1-a2b9-4cd8f4527b1a None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:14.558433 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 388/771] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:14.565183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91278fe7-ea6d-47c5-ba23-b8ff04e00fc9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:14.565469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91278fe7-ea6d-47c5-ba23-b8ff04e00fc9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:14.565750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91278fe7-ea6d-47c5-ba23-b8ff04e00fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:14.569969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d2832-28b3-49e0-944f-28b993e90e35 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:14.605505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-91278fe7-ea6d-47c5-ba23-b8ff04e00fc9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:14.606700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-91278fe7-ea6d-47c5-ba23-b8ff04e00fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:14.617335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94686352-85e6-4335-b0e5-7e44ae155f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:14.618333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94686352-85e6-4335-b0e5-7e44ae155f61 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:14.618820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94686352-85e6-4335-b0e5-7e44ae155f61 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:14.619308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94686352-85e6-4335-b0e5-7e44ae155f61 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:14.620414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94686352-85e6-4335-b0e5-7e44ae155f61 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:14.620930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94686352-85e6-4335-b0e5-7e44ae155f61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:14.622516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94686352-85e6-4335-b0e5-7e44ae155f61 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:14.638376 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 384/772] 10.222.0.43 () {56 vars in 1124 bytes} [Sat Jul 2 20:45:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:14.643713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94686352-85e6-4335-b0e5-7e44ae155f61 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:14.648349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:14.685870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:14.710409 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 389/773] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:14.735193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91278fe7-ea6d-47c5-ba23-b8ff04e00fc9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:14.809003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94686352-85e6-4335-b0e5-7e44ae155f61 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:14.849048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b434c0-7f66-458d-b38b-bf75bf87827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:14.849736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b434c0-7f66-458d-b38b-bf75bf87827c None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:14.850016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b434c0-7f66-458d-b38b-bf75bf87827c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:14.850292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b434c0-7f66-458d-b38b-bf75bf87827c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:14.851148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b434c0-7f66-458d-b38b-bf75bf87827c None admin] RBAC: Adding query filter params (interface=public, service_id=4090c1a7d59e43e393038660795fbbae, region_id=RegionOne) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:14.851426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b434c0-7f66-458d-b38b-bf75bf87827c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:14.852913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b434c0-7f66-458d-b38b-bf75bf87827c None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:14.866185 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 385/774] 10.222.0.43 () {56 vars in 1251 bytes} [Sat Jul 2 20:45:14 2022] GET /identity/v3/endpoints?service_id=4090c1a7d59e43e393038660795fbbae&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:14.871593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b434c0-7f66-458d-b38b-bf75bf87827c None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:14.901965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91278fe7-ea6d-47c5-ba23-b8ff04e00fc9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:14.942906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec416c0-ba5f-487a-b5a6-eaeed91369ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:14.944110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec416c0-ba5f-487a-b5a6-eaeed91369ec None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:14.944594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec416c0-ba5f-487a-b5a6-eaeed91369ec None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:14.945133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec416c0-ba5f-487a-b5a6-eaeed91369ec None admin] PATH_INFO: `/v3/services/network` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:14.946252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec416c0-ba5f-487a-b5a6-eaeed91369ec None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:14.948178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec416c0-ba5f-487a-b5a6-eaeed91369ec None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:14.960755 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-3ec416c0-ba5f-487a-b5a6-eaeed91369ec None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 20:45:14.960755 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:14.960755 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:14.960755 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:14.960755 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:14.960755 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:14.960755 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:14.960755 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:14.960755 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 20:45:14.960755 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:14.960755 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:14.960755 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:14.960755 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:14.960755 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:14.960755 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:14.960755 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:14.960755 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:14.961838 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:14.961838 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:14.961838 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:14.961838 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:14.961838 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:14.961838 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:14.961838 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:14.961838 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:14.961838 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:14.961838 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:14.961838 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:14.961838 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:14.961838 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:14.961838 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:14.961838 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:14.961838 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:14.962694 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:14.962694 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:14.962694 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:14.962694 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:14.962694 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:14.962694 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:14.962694 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:14.962694 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:14.962694 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:14.962694 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:14.962694 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:14.962694 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:14.962694 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 20:45:14.962694 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:14.966609 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 390/775] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:14 2022] GET /identity/v3/services/network => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:14.972861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec416c0-ba5f-487a-b5a6-eaeed91369ec None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:15.028679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:15.056853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:15.095415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec416c0-ba5f-487a-b5a6-eaeed91369ec None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:15.117994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b434c0-7f66-458d-b38b-bf75bf87827c None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:15.136502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e4468-a84b-49fa-a4cd-0d0371cf829d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:15.137180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e4468-a84b-49fa-a4cd-0d0371cf829d None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:15.137465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e4468-a84b-49fa-a4cd-0d0371cf829d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:15.137747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e4468-a84b-49fa-a4cd-0d0371cf829d None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:15.138456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e4468-a84b-49fa-a4cd-0d0371cf829d None admin] RBAC: Adding query filter params (name=network) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:15.138768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e4468-a84b-49fa-a4cd-0d0371cf829d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:15.140190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e4468-a84b-49fa-a4cd-0d0371cf829d None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:15.150483 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 391/776] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Jul 2 20:45:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:15.158927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e4468-a84b-49fa-a4cd-0d0371cf829d None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:15.178120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917055d-bdcc-4c05-82bb-9e8aaf81f6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:15.179057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917055d-bdcc-4c05-82bb-9e8aaf81f6b4 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:15.179478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917055d-bdcc-4c05-82bb-9e8aaf81f6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:15.179983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917055d-bdcc-4c05-82bb-9e8aaf81f6b4 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:15.180847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917055d-bdcc-4c05-82bb-9e8aaf81f6b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:15.182540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917055d-bdcc-4c05-82bb-9e8aaf81f6b4 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:15.188665 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 386/777] 10.222.0.43 () {56 vars in 1087 bytes} [Sat Jul 2 20:45:14 2022] GET /identity/v3/services => generated 772 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:15.190116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b88eba-c697-420a-9d88-9d65b24e6684 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:15.190544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b88eba-c697-420a-9d88-9d65b24e6684 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:15.191033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b88eba-c697-420a-9d88-9d65b24e6684 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:15.192800 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 387/778] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:15.198191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c65e91-2189-4dd3-85e7-dc43c8c142a1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:15.198864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c65e91-2189-4dd3-85e7-dc43c8c142a1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:15.200023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c65e91-2189-4dd3-85e7-dc43c8c142a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:15.232899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b7c65e91-2189-4dd3-85e7-dc43c8c142a1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:15.236845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b7c65e91-2189-4dd3-85e7-dc43c8c142a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:15.353381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:15.361654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e4468-a84b-49fa-a4cd-0d0371cf829d None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:15.390395 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 388/779] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:15.417507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c65e91-2189-4dd3-85e7-dc43c8c142a1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:15.425259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61a8e0-6700-4e7c-abec-5afbc885b8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:15.426068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61a8e0-6700-4e7c-abec-5afbc885b8df None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:15.426353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61a8e0-6700-4e7c-abec-5afbc885b8df None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:15.426628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61a8e0-6700-4e7c-abec-5afbc885b8df None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:15.427334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61a8e0-6700-4e7c-abec-5afbc885b8df None admin] RBAC: Adding query filter params (type=network) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:15.427640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61a8e0-6700-4e7c-abec-5afbc885b8df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:15.429050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61a8e0-6700-4e7c-abec-5afbc885b8df None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:15.440631 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 392/780] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Jul 2 20:45:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:15.449555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61a8e0-6700-4e7c-abec-5afbc885b8df None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:15.544024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:15.572065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c65e91-2189-4dd3-85e7-dc43c8c142a1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:15.607217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f346b-5799-4548-9792-ecdb87412bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:15.608027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f346b-5799-4548-9792-ecdb87412bf1 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:15.608336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f346b-5799-4548-9792-ecdb87412bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:15.608607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f346b-5799-4548-9792-ecdb87412bf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:15.631480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f346b-5799-4548-9792-ecdb87412bf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:15.643826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61a8e0-6700-4e7c-abec-5afbc885b8df None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:15.646485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-7f0f346b-5799-4548-9792-ecdb87412bf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:45:15.646485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:15.646485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:15.646485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:15.646485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:15.646485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:15.646485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:15.646485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:15.646485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:15.646485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:15.646485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:15.646485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:15.646485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:15.646485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:15.646485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:15.646485 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:15.647469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:15.647469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:15.647469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:15.647469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:15.647469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:15.647469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:15.647469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:15.647469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:15.647469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:15.647469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:15.647469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:15.647469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:15.647469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:15.647469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:15.647469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:15.647469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:15.648369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:15.648369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:15.648369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:15.648369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:15.648369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:15.648369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:15.648369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:15.648369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:15.648369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:15.648369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:15.648369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:45:15.648369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:15.655733 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 389/781] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:45:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:15.660421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f346b-5799-4548-9792-ecdb87412bf1 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:15.728859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce6588-cc3b-46d3-841e-9401afd0e99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:15.729519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce6588-cc3b-46d3-841e-9401afd0e99f None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:15.729806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce6588-cc3b-46d3-841e-9401afd0e99f None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:15.730084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce6588-cc3b-46d3-841e-9401afd0e99f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:15.730880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce6588-cc3b-46d3-841e-9401afd0e99f None admin] RBAC: Adding query filter params (interface=public, service_id=91fcd1c4bb63475fadd0bcf5757c0d51, region_id=RegionOne) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:15.731193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce6588-cc3b-46d3-841e-9401afd0e99f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:15.732630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce6588-cc3b-46d3-841e-9401afd0e99f None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:15.750403 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 393/782] 10.222.0.43 () {56 vars in 1251 bytes} [Sat Jul 2 20:45:15 2022] GET /identity/v3/endpoints?service_id=91fcd1c4bb63475fadd0bcf5757c0d51&interface=public®ion_id=RegionOne => generated 194 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:15.756530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce6588-cc3b-46d3-841e-9401afd0e99f None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:15.779394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f346b-5799-4548-9792-ecdb87412bf1 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:15.816182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dfdb0-43d8-4436-b456-ac7c02119afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:15.816909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dfdb0-43d8-4436-b456-ac7c02119afc None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:15.817190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dfdb0-43d8-4436-b456-ac7c02119afc None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:15.817463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dfdb0-43d8-4436-b456-ac7c02119afc None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:15.818215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7dfdb0-43d8-4436-b456-ac7c02119afc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:15.818519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7dfdb0-43d8-4436-b456-ac7c02119afc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:15.819892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7dfdb0-43d8-4436-b456-ac7c02119afc None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:15.825762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:15.830927 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 390/783] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:45:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:15.836457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dfdb0-43d8-4436-b456-ac7c02119afc None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:15.840814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:15.931388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce6588-cc3b-46d3-841e-9401afd0e99f None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:15.985797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8453e-0b35-45af-a512-cc23287dbd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:15.986980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8453e-0b35-45af-a512-cc23287dbd28 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:15.987266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8453e-0b35-45af-a512-cc23287dbd28 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:15.987541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8453e-0b35-45af-a512-cc23287dbd28 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:15.988243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8453e-0b35-45af-a512-cc23287dbd28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:15.989647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8453e-0b35-45af-a512-cc23287dbd28 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:16.001975 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 394/784] 10.222.0.43 () {56 vars in 1087 bytes} [Sat Jul 2 20:45:15 2022] GET /identity/v3/services => generated 772 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:16.030406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dfdb0-43d8-4436-b456-ac7c02119afc None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:16.067858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2768b-9290-4e0d-955b-30355a709755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:16.068747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2768b-9290-4e0d-955b-30355a709755 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:16.069028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2768b-9290-4e0d-955b-30355a709755 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:16.069299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2768b-9290-4e0d-955b-30355a709755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:16.084643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2768b-9290-4e0d-955b-30355a709755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:16.086503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2768b-9290-4e0d-955b-30355a709755 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:16.105791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-66a2768b-9290-4e0d-955b-30355a709755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:16.105791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:16.105791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:16.105791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:16.105791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:16.105791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:16.105791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:16.105791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:16.105791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:16.105791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:16.105791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:16.105791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:16.105791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:16.105791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:16.105791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:16.106798 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:16.106798 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:16.106798 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:16.106798 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:16.106798 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:16.106798 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:16.106798 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:16.106798 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:16.106798 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:16.106798 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:16.106798 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:16.106798 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:16.106798 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:16.106798 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:16.106798 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:16.106798 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:16.106798 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:16.107724 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:16.107724 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:16.107724 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:16.107724 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:16.107724 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 391/785] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:16.113313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8453e-0b35-45af-a512-cc23287dbd28 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:16.186067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6195a-9be2-4b5a-841e-b86734f8a393 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:16.186406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6195a-9be2-4b5a-841e-b86734f8a393 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:16.186613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6195a-9be2-4b5a-841e-b86734f8a393 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:16.188246 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 392/786] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:45:16.194165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e4910-b62a-473a-9c8a-d01da877a074 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:16.194504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e4910-b62a-473a-9c8a-d01da877a074 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:16.194711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e4910-b62a-473a-9c8a-d01da877a074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:16.216739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-931e4910-b62a-473a-9c8a-d01da877a074 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:16.217964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-931e4910-b62a-473a-9c8a-d01da877a074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:16.241752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:16.260840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8453e-0b35-45af-a512-cc23287dbd28 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:16.277932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:16.305133 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 393/787] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:16.306624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8ce41-59ea-413e-9a45-3b4f377ba4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:16.307362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8ce41-59ea-413e-9a45-3b4f377ba4ec None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:16.307639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8ce41-59ea-413e-9a45-3b4f377ba4ec None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:16.307914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8ce41-59ea-413e-9a45-3b4f377ba4ec None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:16.308704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8ce41-59ea-413e-9a45-3b4f377ba4ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:16.309011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8ce41-59ea-413e-9a45-3b4f377ba4ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:16.310392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8ce41-59ea-413e-9a45-3b4f377ba4ec None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:16.313411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f200c51-02c8-4f1c-8b74-a2ec94b8431d None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:16.313696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f200c51-02c8-4f1c-8b74-a2ec94b8431d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:16.313969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f200c51-02c8-4f1c-8b74-a2ec94b8431d None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:16.315663 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 394/788] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:16 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:16.321008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def90de-229b-41de-82b8-6b3a90c55e40 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:16.321289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def90de-229b-41de-82b8-6b3a90c55e40 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:16.321561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def90de-229b-41de-82b8-6b3a90c55e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:16.323819 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 395/789] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:16.329547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8ce41-59ea-413e-9a45-3b4f377ba4ec None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:16.355170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2def90de-229b-41de-82b8-6b3a90c55e40 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:16.356424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2def90de-229b-41de-82b8-6b3a90c55e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:16.432169 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 395/790] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:45:16.433077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def90de-229b-41de-82b8-6b3a90c55e40 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:16.439975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8ce41-59ea-413e-9a45-3b4f377ba4ec None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:16.484983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902be792-bde5-4a0d-b150-8df71cb805e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:16.485805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902be792-bde5-4a0d-b150-8df71cb805e0 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:16.486083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902be792-bde5-4a0d-b150-8df71cb805e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:16.486356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902be792-bde5-4a0d-b150-8df71cb805e0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:16.494466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902be792-bde5-4a0d-b150-8df71cb805e0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:16.495910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902be792-bde5-4a0d-b150-8df71cb805e0 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:16.511765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-902be792-bde5-4a0d-b150-8df71cb805e0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 02 20:45:16.511765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:16.511765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:16.511765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:16.511765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:16.511765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:16.511765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:16.511765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:16.511765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:16.511765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:16.511765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:16.511765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:16.511765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:16.511765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:16.511765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:16.511765 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:16.512830 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:16.512830 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:16.512830 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:16.512830 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:16.512830 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:16.512830 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:16.512830 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:16.512830 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:16.512830 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:16.512830 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:16.512830 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:16.512830 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:16.512830 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:16.512830 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:16.512830 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:16.512830 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:16.512830 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:16.512830 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:16.513821 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:16.513821 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:16.513821 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:16.513821 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:16.513821 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:16.513821 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:16.513821 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:16.513821 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:16.513821 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 02 20:45:16.513821 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:16.513821 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 396/791] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:45:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:16.518712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902be792-bde5-4a0d-b150-8df71cb805e0 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:16.531914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:16.532704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def90de-229b-41de-82b8-6b3a90c55e40 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:16.547151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:16.569830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf99915-9232-4e1d-93dc-3fd7e2663496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:16.570639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf99915-9232-4e1d-93dc-3fd7e2663496 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:16.570915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf99915-9232-4e1d-93dc-3fd7e2663496 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:16.571183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf99915-9232-4e1d-93dc-3fd7e2663496 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:16.582610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf99915-9232-4e1d-93dc-3fd7e2663496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:16.590791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-ddf99915-9232-4e1d-93dc-3fd7e2663496 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:45:16.590791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:16.590791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:16.590791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:16.590791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:16.590791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:16.590791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:16.590791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:16.590791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:16.590791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:16.590791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:16.590791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:16.590791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:16.590791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:16.590791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:16.590791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:16.593320 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:16.593320 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:16.593320 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:16.593320 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:16.593320 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:16.593320 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:16.593320 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:16.593320 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:16.593320 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:16.593320 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:16.593320 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:16.593320 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:16.593320 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:16.593320 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:16.593320 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:16.593320 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:16.595389 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:16.595389 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:16.595389 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:16.595389 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:16.595389 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:16.595389 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:16.595389 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:16.595389 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:16.595389 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:16.595389 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:16.595389 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:45:16.595389 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:16.600067 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 396/792] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:45:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:16.600067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf99915-9232-4e1d-93dc-3fd7e2663496 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:16.629536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902be792-bde5-4a0d-b150-8df71cb805e0 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:16.672374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85500013-25aa-4ec2-86cc-28f079e001e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:16.673515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85500013-25aa-4ec2-86cc-28f079e001e2 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:16.673771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85500013-25aa-4ec2-86cc-28f079e001e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:16.674053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85500013-25aa-4ec2-86cc-28f079e001e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:16.685973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85500013-25aa-4ec2-86cc-28f079e001e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:16.693805 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-85500013-25aa-4ec2-86cc-28f079e001e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:45:16.693805 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:16.693805 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:16.693805 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:16.693805 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:16.693805 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:16.693805 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:16.693805 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:16.693805 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:16.693805 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:16.693805 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:16.693805 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:16.693805 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:16.693805 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:16.693805 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:16.693805 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:16.696024 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:16.696024 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:16.696024 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:16.696024 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:16.696024 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:16.696024 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:16.696024 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:16.696024 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:16.696024 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:16.696024 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:16.696024 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:16.696024 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:16.696024 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:16.696024 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:16.696024 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:16.696024 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:16.698195 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:16.698195 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:16.698195 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:16.698195 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:16.698195 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:16.698195 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:16.698195 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:16.698195 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:16.698195 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:16.698195 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:16.698195 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:45:16.698195 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:16.698195 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 397/793] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:45:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:16.700837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85500013-25aa-4ec2-86cc-28f079e001e2 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:16.708812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf99915-9232-4e1d-93dc-3fd7e2663496 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:16.743198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f8e18-a668-46f2-9dd4-8522352cf434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:16.743865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f8e18-a668-46f2-9dd4-8522352cf434 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:16.744182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f8e18-a668-46f2-9dd4-8522352cf434 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:16.744455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f8e18-a668-46f2-9dd4-8522352cf434 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:16.745378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f8e18-a668-46f2-9dd4-8522352cf434 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:16.745622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f8e18-a668-46f2-9dd4-8522352cf434 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:16.747388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f8e18-a668-46f2-9dd4-8522352cf434 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:16.765278 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 397/794] 10.222.0.43 () {56 vars in 1135 bytes} [Sat Jul 2 20:45:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:16.766185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f8e18-a668-46f2-9dd4-8522352cf434 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:16.781197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:16.797044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:16.826746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85500013-25aa-4ec2-86cc-28f079e001e2 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:16.861460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed9b75-9e8e-4f1e-9840-7fd837832a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:16.862149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed9b75-9e8e-4f1e-9840-7fd837832a8d None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:16.862394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed9b75-9e8e-4f1e-9840-7fd837832a8d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:16.862666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed9b75-9e8e-4f1e-9840-7fd837832a8d None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:16.863402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed9b75-9e8e-4f1e-9840-7fd837832a8d None admin] RBAC: Adding query filter params (name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:16.863706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed9b75-9e8e-4f1e-9840-7fd837832a8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:16.865156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed9b75-9e8e-4f1e-9840-7fd837832a8d None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:16.878711 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 398/795] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:45:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:16.878711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed9b75-9e8e-4f1e-9840-7fd837832a8d None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:16.895651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f8e18-a668-46f2-9dd4-8522352cf434 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:16.934384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdd1e5-55ce-4346-9ece-dead6b290145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:16.935517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdd1e5-55ce-4346-9ece-dead6b290145 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:16.936131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdd1e5-55ce-4346-9ece-dead6b290145 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:16.936623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdd1e5-55ce-4346-9ece-dead6b290145 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:16.937566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdd1e5-55ce-4346-9ece-dead6b290145 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:16.938163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdd1e5-55ce-4346-9ece-dead6b290145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:16.939918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdd1e5-55ce-4346-9ece-dead6b290145 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:16.949705 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 398/796] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:45:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:16.951118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdd1e5-55ce-4346-9ece-dead6b290145 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:16.979226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed9b75-9e8e-4f1e-9840-7fd837832a8d None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:17.008507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:17.014031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df8233-276f-4559-8b08-21ceeb621588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:17.015545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df8233-276f-4559-8b08-21ceeb621588 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:17.015844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df8233-276f-4559-8b08-21ceeb621588 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:17.016150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df8233-276f-4559-8b08-21ceeb621588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:17.027074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df8233-276f-4559-8b08-21ceeb621588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:17.028794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df8233-276f-4559-8b08-21ceeb621588 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:17.045824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-f6df8233-276f-4559-8b08-21ceeb621588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:17.045824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:17.045824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:17.045824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:17.045824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:17.045824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:17.045824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:17.045824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:17.045824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:17.045824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:17.045824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:17.045824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:17.045824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:17.045824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:17.045824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:17.046753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:17.046753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:17.046753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:17.046753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:17.046753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:17.046753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:17.046753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:17.046753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:17.046753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:17.046753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:17.046753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:17.046753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:17.046753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:17.046753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:17.046753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:17.046753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:17.046753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:17.049079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:17.049079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:17.049079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:17.049079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:17.049079 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 399/797] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:17.049079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df8233-276f-4559-8b08-21ceeb621588 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:17.055047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:17.064740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdd1e5-55ce-4346-9ece-dead6b290145 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:17.100356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e8ece-e77d-4ecb-8b83-67cc94229bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:17.101810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e8ece-e77d-4ecb-8b83-67cc94229bfb None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:17.102317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e8ece-e77d-4ecb-8b83-67cc94229bfb None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:17.102801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e8ece-e77d-4ecb-8b83-67cc94229bfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:17.114492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e8ece-e77d-4ecb-8b83-67cc94229bfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:17.116222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e8ece-e77d-4ecb-8b83-67cc94229bfb None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:17.134072 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-121e8ece-e77d-4ecb-8b83-67cc94229bfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:17.134072 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:17.134072 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:17.134072 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:17.134072 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:17.134072 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:17.134072 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:17.134072 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:17.134072 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:17.134072 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:17.134072 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:17.134072 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:17.134072 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:17.134072 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:17.134072 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:17.135012 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:17.135012 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:17.135012 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:17.135012 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:17.135012 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:17.135012 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:17.135012 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:17.135012 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:17.135012 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:17.135012 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:17.135012 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:17.135012 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:17.135012 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:17.135012 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:17.135012 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:17.135012 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:17.135012 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:17.135962 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:17.135962 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:17.135962 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:17.135962 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:17.143377 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 399/798] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:17.144584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e8ece-e77d-4ecb-8b83-67cc94229bfb None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:17.164894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df8233-276f-4559-8b08-21ceeb621588 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:17.201765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a1def-b228-4f67-9e20-c9277b444e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:17.202890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a1def-b228-4f67-9e20-c9277b444e35 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:17.203002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a1def-b228-4f67-9e20-c9277b444e35 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:17.203233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a1def-b228-4f67-9e20-c9277b444e35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:17.215074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a1def-b228-4f67-9e20-c9277b444e35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:17.216779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a1def-b228-4f67-9e20-c9277b444e35 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:17.235237 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-dd4a1def-b228-4f67-9e20-c9277b444e35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:17.235237 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:17.235237 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:17.235237 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:17.235237 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:17.235237 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:17.235237 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:17.235237 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:17.235237 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:17.235237 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:17.235237 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:17.235237 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:17.235237 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:17.235237 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:17.235237 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:17.236236 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:17.236236 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:17.236236 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:17.236236 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:17.236236 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:17.236236 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:17.236236 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:17.236236 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:17.236236 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:17.236236 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:17.236236 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:17.236236 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:17.236236 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:17.236236 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:17.236236 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:17.236236 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:17.236236 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:17.238288 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:17.238288 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:17.238288 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:17.238288 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:17.238288 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 400/799] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:17.238288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a1def-b228-4f67-9e20-c9277b444e35 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:17.252737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e8ece-e77d-4ecb-8b83-67cc94229bfb None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:17.275782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:17.288080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cae75-f18e-468b-9886-2f588dd876e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:17.288912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cae75-f18e-468b-9886-2f588dd876e3 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:17.289290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cae75-f18e-468b-9886-2f588dd876e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:17.289665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cae75-f18e-468b-9886-2f588dd876e3 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:17.290584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cae75-f18e-468b-9886-2f588dd876e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:17.290993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cae75-f18e-468b-9886-2f588dd876e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:17.292780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cae75-f18e-468b-9886-2f588dd876e3 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:17.308063 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 400/800] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:17.309197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cae75-f18e-468b-9886-2f588dd876e3 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:17.313256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:17.353003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a1def-b228-4f67-9e20-c9277b444e35 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:17.391560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638ca58-dfa3-4151-9c88-2ec97898ded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:17.392570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638ca58-dfa3-4151-9c88-2ec97898ded6 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:17.393171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638ca58-dfa3-4151-9c88-2ec97898ded6 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:17.393672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638ca58-dfa3-4151-9c88-2ec97898ded6 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:17.394955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638ca58-dfa3-4151-9c88-2ec97898ded6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:17.395466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638ca58-dfa3-4151-9c88-2ec97898ded6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:17.397207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638ca58-dfa3-4151-9c88-2ec97898ded6 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:17.410748 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 401/801] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:17.411892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638ca58-dfa3-4151-9c88-2ec97898ded6 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:17.421833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cae75-f18e-468b-9886-2f588dd876e3 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:17.458685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a609f31-bbb6-40c2-98b2-c9de1c3e500e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:17.459348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a609f31-bbb6-40c2-98b2-c9de1c3e500e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:17.459623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a609f31-bbb6-40c2-98b2-c9de1c3e500e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:17.459900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a609f31-bbb6-40c2-98b2-c9de1c3e500e None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:17.460660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a609f31-bbb6-40c2-98b2-c9de1c3e500e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:17.460961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a609f31-bbb6-40c2-98b2-c9de1c3e500e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:17.462471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a609f31-bbb6-40c2-98b2-c9de1c3e500e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:17.474956 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 401/802] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:17.476062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a609f31-bbb6-40c2-98b2-c9de1c3e500e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:17.514180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:17.521966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638ca58-dfa3-4151-9c88-2ec97898ded6 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:17.542432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:17.561522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bcb76-716b-44ad-8706-ab8bc39172d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:17.562780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bcb76-716b-44ad-8706-ab8bc39172d3 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:17.563370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bcb76-716b-44ad-8706-ab8bc39172d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:17.563849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bcb76-716b-44ad-8706-ab8bc39172d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:17.571306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bcb76-716b-44ad-8706-ab8bc39172d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:17.573292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bcb76-716b-44ad-8706-ab8bc39172d3 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:17.581686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a609f31-bbb6-40c2-98b2-c9de1c3e500e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:17.588066 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-525bcb76-716b-44ad-8706-ab8bc39172d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:17.588066 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:17.588066 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:17.588066 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:17.588066 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:17.588066 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:17.588066 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:17.588066 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:17.588066 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:17.588066 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:17.588066 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:17.588066 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:17.588066 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:17.588066 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:17.588066 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:17.589025 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:17.589025 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:17.589025 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:17.589025 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:17.589025 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:17.589025 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:17.589025 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:17.589025 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:17.589025 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:17.589025 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:17.589025 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:17.589025 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:17.589025 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:17.589025 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:17.589025 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:17.589025 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:17.589025 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:17.589967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:17.589967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:17.589967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:17.589967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:17.589967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:17.589967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:17.589967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:17.589967 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:17.593448 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 402/803] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:17.594479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bcb76-716b-44ad-8706-ab8bc39172d3 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:17.628179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1fd8f-1606-48e2-9359-9bbb4dfcad4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:17.629691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1fd8f-1606-48e2-9359-9bbb4dfcad4c None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:17.630379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1fd8f-1606-48e2-9359-9bbb4dfcad4c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:17.631215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1fd8f-1606-48e2-9359-9bbb4dfcad4c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:17.642618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1fd8f-1606-48e2-9359-9bbb4dfcad4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:17.644475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1fd8f-1606-48e2-9359-9bbb4dfcad4c None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:17.664352 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-86e1fd8f-1606-48e2-9359-9bbb4dfcad4c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 20:45:17.664352 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:17.664352 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:17.664352 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:17.664352 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:17.664352 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:17.664352 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:17.664352 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:17.664352 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:17.664352 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:17.664352 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:17.664352 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:17.664352 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:17.664352 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:17.664352 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:17.664352 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:17.665367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:17.665367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:17.665367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:17.665367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:17.665367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:17.665367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:17.665367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:17.665367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:17.665367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:17.665367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:17.665367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:17.665367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:17.665367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:17.665367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:17.665367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:17.665367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:17.665367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:17.665367 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:17.666411 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:17.666411 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:17.666411 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:17.666411 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:17.666411 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:17.666411 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:17.666411 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:17.666411 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:17.666411 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 20:45:17.666411 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:17.668766 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 402/804] 10.222.0.43 () {56 vars in 1117 bytes} [Sat Jul 2 20:45:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:17.669847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1fd8f-1606-48e2-9359-9bbb4dfcad4c None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:17.729047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bcb76-716b-44ad-8706-ab8bc39172d3 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:17.772458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f2727-030a-401c-b7ae-d06ad8a0ba13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:17.773259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f2727-030a-401c-b7ae-d06ad8a0ba13 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:17.773538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f2727-030a-401c-b7ae-d06ad8a0ba13 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:17.773812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f2727-030a-401c-b7ae-d06ad8a0ba13 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:17.785394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f2727-030a-401c-b7ae-d06ad8a0ba13 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:17.787668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f2727-030a-401c-b7ae-d06ad8a0ba13 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:17.796424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1fd8f-1606-48e2-9359-9bbb4dfcad4c None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:17.805342 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-858f2727-030a-401c-b7ae-d06ad8a0ba13 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:45:17.805342 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:17.805342 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:17.805342 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:17.805342 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:17.805342 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:17.805342 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:17.805342 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:17.805342 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:17.805342 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:17.805342 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:17.805342 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:17.805342 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:17.805342 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:17.805342 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:17.805342 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:17.806300 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:17.806300 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:17.806300 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:17.806300 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:17.806300 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:17.806300 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:17.806300 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:17.806300 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:17.806300 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:17.806300 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:17.806300 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:17.806300 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:17.806300 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:17.806300 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:17.806300 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:17.806300 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:17.806300 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:17.806300 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:17.807345 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:17.807345 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:17.807345 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:17.807345 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:17.807345 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:17.807345 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:17.807345 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:17.807345 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:17.807345 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:45:17.807345 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:17.810869 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 403/805] 10.222.0.43 () {56 vars in 1093 bytes} [Sat Jul 2 20:45:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:17.811887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f2727-030a-401c-b7ae-d06ad8a0ba13 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:17.826793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:17.831394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:17.842072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ab5da-b3c2-475a-b477-c00964142369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:17.842734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ab5da-b3c2-475a-b477-c00964142369 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:17.843011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ab5da-b3c2-475a-b477-c00964142369 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:17.843280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ab5da-b3c2-475a-b477-c00964142369 None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:17.844092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ab5da-b3c2-475a-b477-c00964142369 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:17.844403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ab5da-b3c2-475a-b477-c00964142369 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:17.846043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ab5da-b3c2-475a-b477-c00964142369 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:17.860093 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 403/806] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:17.861057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ab5da-b3c2-475a-b477-c00964142369 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:17.921277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f2727-030a-401c-b7ae-d06ad8a0ba13 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:17.956398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb85f17-1213-497c-81b1-9aafe35c4ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:17.957072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb85f17-1213-497c-81b1-9aafe35c4ff9 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:17.957360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb85f17-1213-497c-81b1-9aafe35c4ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:17.957610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb85f17-1213-497c-81b1-9aafe35c4ff9 None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:17.958427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb85f17-1213-497c-81b1-9aafe35c4ff9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:17.958729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb85f17-1213-497c-81b1-9aafe35c4ff9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:17.960204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb85f17-1213-497c-81b1-9aafe35c4ff9 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:17.964624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ab5da-b3c2-475a-b477-c00964142369 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:17.989611 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 404/807] 10.222.0.43 () {56 vars in 1149 bytes} [Sat Jul 2 20:45:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:17.989611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757003ae-bfce-4976-9fa1-7dc0c3282d1a None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:17.989611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757003ae-bfce-4976-9fa1-7dc0c3282d1a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:17.989611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757003ae-bfce-4976-9fa1-7dc0c3282d1a None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:17.989611 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 405/808] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:17.990756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757003ae-bfce-4976-9fa1-7dc0c3282d1a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:18.014873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eecd84-7a0a-4495-839f-4cb81ece11a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:18.015836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eecd84-7a0a-4495-839f-4cb81ece11a3 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:18.016333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eecd84-7a0a-4495-839f-4cb81ece11a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:18.016602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eecd84-7a0a-4495-839f-4cb81ece11a3 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:18.017450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eecd84-7a0a-4495-839f-4cb81ece11a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:18.017741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eecd84-7a0a-4495-839f-4cb81ece11a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:18.019188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eecd84-7a0a-4495-839f-4cb81ece11a3 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:18.042934 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 404/809] 10.222.0.43 () {56 vars in 1133 bytes} [Sat Jul 2 20:45:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:18.042934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eecd84-7a0a-4495-839f-4cb81ece11a3 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:18.081041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:18.095679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:18.112272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757003ae-bfce-4976-9fa1-7dc0c3282d1a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:18.148983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edba75d-a79d-4336-baa7-207ea3730c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:18.149875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edba75d-a79d-4336-baa7-207ea3730c0f None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:18.150152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edba75d-a79d-4336-baa7-207ea3730c0f None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:18.150425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edba75d-a79d-4336-baa7-207ea3730c0f None admin] PATH_INFO: `/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/55367f643da048c5ab61ab6325552256/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:18.152514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edba75d-a79d-4336-baa7-207ea3730c0f None admin] RBAC: Authorizing `identity:create_grant(project_id=001bf63308784f4eb62e64d6f82c8354, user_id=55367f643da048c5ab61ab6325552256, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:18.153961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edba75d-a79d-4336-baa7-207ea3730c0f None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:18.156255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eecd84-7a0a-4495-839f-4cb81ece11a3 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:18.174332 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 406/810] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:45:17 2022] PUT /identity/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/55367f643da048c5ab61ab6325552256/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:45:18.174332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623838b-d9b6-4d4f-965d-1cb49090b6dd None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:18.174332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623838b-d9b6-4d4f-965d-1cb49090b6dd None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:18.174332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623838b-d9b6-4d4f-965d-1cb49090b6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:18.189747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9623838b-d9b6-4d4f-965d-1cb49090b6dd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:18.191060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9623838b-d9b6-4d4f-965d-1cb49090b6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:18.208345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5e34c-414b-4a0f-9054-4b8cfb998db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:18.209212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5e34c-414b-4a0f-9054-4b8cfb998db1 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:18.209493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5e34c-414b-4a0f-9054-4b8cfb998db1 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:18.209767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5e34c-414b-4a0f-9054-4b8cfb998db1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:18.223270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5e34c-414b-4a0f-9054-4b8cfb998db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:18.224787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5e34c-414b-4a0f-9054-4b8cfb998db1 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:18.251681 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-f5a5e34c-414b-4a0f-9054-4b8cfb998db1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:18.251681 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:18.251681 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:18.251681 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:18.251681 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:18.251681 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:18.251681 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:18.251681 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:18.251681 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:18.251681 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:18.251681 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:18.251681 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:18.251681 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:18.251681 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:18.251681 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:18.252717 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:18.252717 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:18.252717 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:18.252717 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:18.252717 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:18.252717 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:18.252717 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:18.252717 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:18.252717 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:18.252717 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:18.252717 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:18.252717 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:18.252717 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:18.252717 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:18.252717 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:18.252717 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:18.252717 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:18.253643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:18.253643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:18.253643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:18.253643 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:18.261659 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 405/811] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:18.261659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5e34c-414b-4a0f-9054-4b8cfb998db1 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:18.285412 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 407/812] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:18.286463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623838b-d9b6-4d4f-965d-1cb49090b6dd None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:18.361570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:18.401433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:18.409307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5e34c-414b-4a0f-9054-4b8cfb998db1 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:18.419557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623838b-d9b6-4d4f-965d-1cb49090b6dd None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:18.450076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d569c2a-163e-4b0b-83c3-3a4b6cc51134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:18.451688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d569c2a-163e-4b0b-83c3-3a4b6cc51134 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:18.452173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d569c2a-163e-4b0b-83c3-3a4b6cc51134 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:18.452646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d569c2a-163e-4b0b-83c3-3a4b6cc51134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:18.458523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de1018-0b87-4564-9a6f-c3bd07219f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:18.459287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de1018-0b87-4564-9a6f-c3bd07219f47 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:18.459640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de1018-0b87-4564-9a6f-c3bd07219f47 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:18.459982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de1018-0b87-4564-9a6f-c3bd07219f47 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:18.460803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de1018-0b87-4564-9a6f-c3bd07219f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:18.461173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de1018-0b87-4564-9a6f-c3bd07219f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:18.462627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de1018-0b87-4564-9a6f-c3bd07219f47 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:18.475053 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 408/813] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:18.475984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de1018-0b87-4564-9a6f-c3bd07219f47 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:18.537068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d569c2a-163e-4b0b-83c3-3a4b6cc51134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:18.538772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d569c2a-163e-4b0b-83c3-3a4b6cc51134 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:18.593206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de1018-0b87-4564-9a6f-c3bd07219f47 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:18.620792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:18.633046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f941ffa-9fab-4c76-91a4-e920f3892df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:18.633883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f941ffa-9fab-4c76-91a4-e920f3892df1 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:18.634423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f941ffa-9fab-4c76-91a4-e920f3892df1 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:18.634423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f941ffa-9fab-4c76-91a4-e920f3892df1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:18.635118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f941ffa-9fab-4c76-91a4-e920f3892df1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:18.636600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f941ffa-9fab-4c76-91a4-e920f3892df1 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:18.640906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:18.653506 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 406/814] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:45:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:45:18.653506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d569c2a-163e-4b0b-83c3-3a4b6cc51134 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:18.653773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-3f941ffa-9fab-4c76-91a4-e920f3892df1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 20:45:18.653773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:18.653773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:18.653773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:18.653773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:18.653773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:18.653773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:18.653773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:18.653773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 20:45:18.653773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:18.653773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:18.653773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:18.653773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:18.653773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:18.653773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:18.653773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:18.654673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:18.654673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:18.654673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:18.654673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:18.654673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:18.654673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:18.654673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:18.654673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:18.654673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:18.654673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:18.654673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:18.654673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:18.654673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:18.654673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:18.654673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:18.654673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:18.655550 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:18.655550 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:18.655550 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:18.655550 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:18.655550 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:18.655550 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:18.655550 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:18.655550 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:18.655550 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:18.655550 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:18.655550 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:18.655550 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:18.655550 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:18.655550 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 20:45:18.655550 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:18.656423 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 409/815] 10.222.0.43 () {56 vars in 1129 bytes} [Sat Jul 2 20:45:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:18.657609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f1a42-55e4-4299-8e1d-c71eb5c9762e None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:18.657896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f1a42-55e4-4299-8e1d-c71eb5c9762e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:18.658174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f1a42-55e4-4299-8e1d-c71eb5c9762e None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:18.663776 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 410/816] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:18.664461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f1a42-55e4-4299-8e1d-c71eb5c9762e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:18.760411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d569c2a-163e-4b0b-83c3-3a4b6cc51134 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:18.777182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f1a42-55e4-4299-8e1d-c71eb5c9762e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:18.795430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad616a-7312-44e4-835e-b8f9cd2a588a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:18.796252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad616a-7312-44e4-835e-b8f9cd2a588a None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:18.796524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad616a-7312-44e4-835e-b8f9cd2a588a None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:18.796801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad616a-7312-44e4-835e-b8f9cd2a588a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:18.803837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad616a-7312-44e4-835e-b8f9cd2a588a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:18.805305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad616a-7312-44e4-835e-b8f9cd2a588a None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:18.810823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9fefc-8d02-49f0-9112-070c08e54739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:18.811610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9fefc-8d02-49f0-9112-070c08e54739 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:18.811884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9fefc-8d02-49f0-9112-070c08e54739 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:18.812175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9fefc-8d02-49f0-9112-070c08e54739 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:18.819186 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-d1ad616a-7312-44e4-835e-b8f9cd2a588a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:18.819186 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:18.819186 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:18.819186 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:18.819186 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:18.819186 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:18.819186 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:18.819186 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:18.819186 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:18.819186 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:18.819186 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:18.819186 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:18.819186 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:18.819186 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:18.819186 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:18.820272 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:18.820272 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:18.820272 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:18.820272 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:18.820272 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:18.820272 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:18.820272 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:18.820272 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:18.820272 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:18.820272 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:18.820272 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:18.820272 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:18.820272 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:18.820272 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:18.820272 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:18.820272 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:18.820272 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:18.821448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:18.821448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:18.821448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:18.821448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:18.821448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:18.821448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:18.821448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:18.821448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:18.821448 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 407/817] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:18.821937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad616a-7312-44e4-835e-b8f9cd2a588a None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:18.827824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9fefc-8d02-49f0-9112-070c08e54739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:18.829304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9fefc-8d02-49f0-9112-070c08e54739 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:18.846405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-6ca9fefc-8d02-49f0-9112-070c08e54739 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:18.846405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:18.846405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:18.846405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:18.846405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:18.846405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:18.846405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:18.846405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:18.846405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:18.846405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:18.846405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:18.846405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:18.846405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:18.846405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:18.846405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:18.847444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:18.847444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:18.847444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:18.847444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:18.847444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:18.847444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:18.847444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:18.847444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:18.847444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:18.847444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:18.847444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:18.847444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:18.847444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:18.847444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:18.847444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:18.847444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:18.847444 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:18.848775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:18.848775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:18.848775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:18.848775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:18.848775 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 411/818] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:18.849082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d1b5f-ee43-4671-a16a-51212ce19425 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:18.849302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d1b5f-ee43-4671-a16a-51212ce19425 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:18.849457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d1b5f-ee43-4671-a16a-51212ce19425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:18.865843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6c1d1b5f-ee43-4671-a16a-51212ce19425 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:18.867008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6c1d1b5f-ee43-4671-a16a-51212ce19425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:18.885904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:18.903854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:18.932733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad616a-7312-44e4-835e-b8f9cd2a588a None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:18.948066 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 412/819] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:18.948066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d1b5f-ee43-4671-a16a-51212ce19425 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:18.982807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc853ab6-7167-4792-be76-68086e9bb340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:18.984369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc853ab6-7167-4792-be76-68086e9bb340 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:18.984654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc853ab6-7167-4792-be76-68086e9bb340 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:18.984932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc853ab6-7167-4792-be76-68086e9bb340 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:18.985631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc853ab6-7167-4792-be76-68086e9bb340 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:18.985935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc853ab6-7167-4792-be76-68086e9bb340 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:18.987395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc853ab6-7167-4792-be76-68086e9bb340 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:18.998455 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 408/820] 10.222.0.43 () {56 vars in 1124 bytes} [Sat Jul 2 20:45:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:18.998455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc853ab6-7167-4792-be76-68086e9bb340 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:19.052100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d1b5f-ee43-4671-a16a-51212ce19425 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:19.089501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bdf12-fab0-4e5d-aee3-12be0b821b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:19.090167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bdf12-fab0-4e5d-aee3-12be0b821b16 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:19.090451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bdf12-fab0-4e5d-aee3-12be0b821b16 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:19.090726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bdf12-fab0-4e5d-aee3-12be0b821b16 None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:19.091494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bdf12-fab0-4e5d-aee3-12be0b821b16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:19.091807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bdf12-fab0-4e5d-aee3-12be0b821b16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:19.094128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bdf12-fab0-4e5d-aee3-12be0b821b16 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:19.106510 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 413/821] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:19.107313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bdf12-fab0-4e5d-aee3-12be0b821b16 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:19.116840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc853ab6-7167-4792-be76-68086e9bb340 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:19.137144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:19.141954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:19.159214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950268b-8aed-4331-bd8b-c7fa01d7167e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:19.160146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950268b-8aed-4331-bd8b-c7fa01d7167e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:19.160456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950268b-8aed-4331-bd8b-c7fa01d7167e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:19.160730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950268b-8aed-4331-bd8b-c7fa01d7167e None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:19.161446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950268b-8aed-4331-bd8b-c7fa01d7167e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:19.161746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950268b-8aed-4331-bd8b-c7fa01d7167e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:19.163116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950268b-8aed-4331-bd8b-c7fa01d7167e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:19.175855 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 409/822] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:19.176738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950268b-8aed-4331-bd8b-c7fa01d7167e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:19.223900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bdf12-fab0-4e5d-aee3-12be0b821b16 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:19.259517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1626c0d-b4c1-48d2-afcf-21577d41da88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:19.260407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1626c0d-b4c1-48d2-afcf-21577d41da88 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:19.260690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1626c0d-b4c1-48d2-afcf-21577d41da88 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:19.260965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1626c0d-b4c1-48d2-afcf-21577d41da88 None admin] PATH_INFO: `/v3/services/network` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:19.261777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1626c0d-b4c1-48d2-afcf-21577d41da88 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:19.263166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1626c0d-b4c1-48d2-afcf-21577d41da88 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:19.272582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950268b-8aed-4331-bd8b-c7fa01d7167e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:19.275766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-f1626c0d-b4c1-48d2-afcf-21577d41da88 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 20:45:19.275766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:19.275766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:19.275766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:19.275766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:19.275766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:19.275766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:19.275766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:19.275766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 20:45:19.275766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:19.275766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:19.275766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:19.275766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:19.275766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:19.275766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:19.275766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:19.275766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:19.276782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:19.276782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:19.276782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:19.276782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:19.276782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:19.276782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:19.276782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:19.276782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:19.276782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:19.276782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:19.276782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:19.276782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:19.276782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:19.276782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:19.276782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:19.276782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:19.277657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:19.277657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:19.277657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:19.277657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:19.277657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:19.277657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:19.277657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:19.277657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:19.277657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:19.277657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:19.277657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:19.277657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:19.277657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 20:45:19.277657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:19.281960 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 414/823] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:19 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:19.282800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1626c0d-b4c1-48d2-afcf-21577d41da88 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:19.308835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce4ba3-ddd3-44b5-81dd-0da05612e3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:19.309491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce4ba3-ddd3-44b5-81dd-0da05612e3ec None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:19.309763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce4ba3-ddd3-44b5-81dd-0da05612e3ec None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:19.310085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce4ba3-ddd3-44b5-81dd-0da05612e3ec None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:19.310712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce4ba3-ddd3-44b5-81dd-0da05612e3ec None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:19.311007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce4ba3-ddd3-44b5-81dd-0da05612e3ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:19.312400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce4ba3-ddd3-44b5-81dd-0da05612e3ec None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:19.322099 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 410/824] 10.222.0.43 () {56 vars in 1124 bytes} [Sat Jul 2 20:45:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:19.322099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce4ba3-ddd3-44b5-81dd-0da05612e3ec None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:19.368048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:19.389722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:19.398401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1626c0d-b4c1-48d2-afcf-21577d41da88 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:19.427489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce4ba3-ddd3-44b5-81dd-0da05612e3ec None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:19.435300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a538645-b199-4616-824f-0c2a887ed259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:19.436251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a538645-b199-4616-824f-0c2a887ed259 None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:19.436527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a538645-b199-4616-824f-0c2a887ed259 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:19.436804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a538645-b199-4616-824f-0c2a887ed259 None admin] PATH_INFO: `/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/4d4bfe417b4c4896ae5f3fc23e03ef71/roles/843bfd29577143dcb23593a75d4ee5a0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:19.454370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a538645-b199-4616-824f-0c2a887ed259 None admin] RBAC: Authorizing `identity:create_grant(project_id=001bf63308784f4eb62e64d6f82c8354, user_id=4d4bfe417b4c4896ae5f3fc23e03ef71, role_id=843bfd29577143dcb23593a75d4ee5a0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:19.456008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a538645-b199-4616-824f-0c2a887ed259 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:19.462832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f6ed7-c0a1-4d87-a0f9-1b6c62a6cbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:19.463739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f6ed7-c0a1-4d87-a0f9-1b6c62a6cbb3 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:19.464021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f6ed7-c0a1-4d87-a0f9-1b6c62a6cbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:19.464324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f6ed7-c0a1-4d87-a0f9-1b6c62a6cbb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:19.470604 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 415/825] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:45:19 2022] PUT /identity/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/4d4bfe417b4c4896ae5f3fc23e03ef71/roles/843bfd29577143dcb23593a75d4ee5a0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:45:19.480368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a538645-b199-4616-824f-0c2a887ed259 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:19.482269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f6ed7-c0a1-4d87-a0f9-1b6c62a6cbb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:19.484184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f6ed7-c0a1-4d87-a0f9-1b6c62a6cbb3 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:19.504207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-717f6ed7-c0a1-4d87-a0f9-1b6c62a6cbb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:19.504207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:19.504207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:19.504207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:19.504207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:19.504207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:19.504207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:19.504207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:19.504207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:19.504207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:19.504207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:19.504207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:19.504207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:19.504207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:19.504207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:19.505207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:19.505207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:19.505207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:19.505207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:19.505207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:19.505207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:19.505207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:19.505207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:19.505207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:19.505207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:19.505207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:19.505207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:19.505207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:19.505207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:19.505207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:19.505207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:19.505207 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:19.506146 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:19.506146 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:19.506146 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:19.506146 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:19.506146 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:19.506146 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:19.506146 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:19.506146 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:19.510877 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 411/826] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:19.512070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f6ed7-c0a1-4d87-a0f9-1b6c62a6cbb3 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:19.600624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a538645-b199-4616-824f-0c2a887ed259 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:19.650819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc93279-6626-4856-a040-e1f969d22389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:19.651711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f6ed7-c0a1-4d87-a0f9-1b6c62a6cbb3 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:19.652239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc93279-6626-4856-a040-e1f969d22389 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:19.652752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc93279-6626-4856-a040-e1f969d22389 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:19.653280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc93279-6626-4856-a040-e1f969d22389 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:19.653986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:19.656652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc93279-6626-4856-a040-e1f969d22389 None admin] RBAC: Adding query filter params (name=network) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:19.657267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc93279-6626-4856-a040-e1f969d22389 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:19.659045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc93279-6626-4856-a040-e1f969d22389 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:19.667608 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 416/827] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Jul 2 20:45:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:19.669062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc93279-6626-4856-a040-e1f969d22389 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:19.680898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:19.694517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc104d5-f7ca-48ff-8f13-cc3cf9965977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:19.695188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc104d5-f7ca-48ff-8f13-cc3cf9965977 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:19.695463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc104d5-f7ca-48ff-8f13-cc3cf9965977 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:19.695731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc104d5-f7ca-48ff-8f13-cc3cf9965977 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:19.696524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc104d5-f7ca-48ff-8f13-cc3cf9965977 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:19.698230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc104d5-f7ca-48ff-8f13-cc3cf9965977 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:19.730314 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 412/828] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Jul 2 20:45:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:45:19.731085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc104d5-f7ca-48ff-8f13-cc3cf9965977 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:19.830350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc93279-6626-4856-a040-e1f969d22389 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:19.877205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc104d5-f7ca-48ff-8f13-cc3cf9965977 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:19.915673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20810b8d-b09f-4280-b7da-3c678081314d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:19.916525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20810b8d-b09f-4280-b7da-3c678081314d None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:19.916806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20810b8d-b09f-4280-b7da-3c678081314d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:19.917079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20810b8d-b09f-4280-b7da-3c678081314d None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:19.917957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20810b8d-b09f-4280-b7da-3c678081314d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:19.918371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20810b8d-b09f-4280-b7da-3c678081314d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:19.919476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adc71c-1e98-4fbc-b6ca-04e0c1286879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:19.919833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20810b8d-b09f-4280-b7da-3c678081314d None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:19.920212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adc71c-1e98-4fbc-b6ca-04e0c1286879 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:19.920497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adc71c-1e98-4fbc-b6ca-04e0c1286879 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:19.920772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adc71c-1e98-4fbc-b6ca-04e0c1286879 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:19.921533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5adc71c-1e98-4fbc-b6ca-04e0c1286879 None admin] RBAC: Adding query filter params (type=network) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:19.921868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5adc71c-1e98-4fbc-b6ca-04e0c1286879 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:19.923856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5adc71c-1e98-4fbc-b6ca-04e0c1286879 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:19.930522 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 413/829] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Jul 2 20:45:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:19.935904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adc71c-1e98-4fbc-b6ca-04e0c1286879 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:19.949889 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 417/830] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:19.956087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20810b8d-b09f-4280-b7da-3c678081314d None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:19.971922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:20.034198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:20.077030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20810b8d-b09f-4280-b7da-3c678081314d None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:20.083337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adc71c-1e98-4fbc-b6ca-04e0c1286879 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:20.115049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6aecaf-6da7-4d1c-8907-0332998b7e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:20.116258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6aecaf-6da7-4d1c-8907-0332998b7e30 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:20.116859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6aecaf-6da7-4d1c-8907-0332998b7e30 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:20.117337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6aecaf-6da7-4d1c-8907-0332998b7e30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:20.118376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6aecaf-6da7-4d1c-8907-0332998b7e30 None admin] RBAC: Adding query filter params (role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=aa3e290fa5384f9bac3fec771cebf653) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:20.118997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6aecaf-6da7-4d1c-8907-0332998b7e30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:20.120898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6aecaf-6da7-4d1c-8907-0332998b7e30 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:20.124871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b17c08-234f-41d2-a22e-2632489a7593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:20.125419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b17c08-234f-41d2-a22e-2632489a7593 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:20.125697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b17c08-234f-41d2-a22e-2632489a7593 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:20.125969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b17c08-234f-41d2-a22e-2632489a7593 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:20.126701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b17c08-234f-41d2-a22e-2632489a7593 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:20.128163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b17c08-234f-41d2-a22e-2632489a7593 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:20.129697 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 418/831] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:45:19 2022] GET /identity/v3/role_assignments?user.id=aa3e290fa5384f9bac3fec771cebf653&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:20.166565 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 414/832] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Jul 2 20:45:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:45:20.635026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1e342-5d12-4308-902e-7cdd014d9514 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:20.635710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1e342-5d12-4308-902e-7cdd014d9514 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:20.636234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1e342-5d12-4308-902e-7cdd014d9514 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:20.638065 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 419/833] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:20.643892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920584c-aef2-41cf-9172-992979777548 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:20.644468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920584c-aef2-41cf-9172-992979777548 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:20.644968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920584c-aef2-41cf-9172-992979777548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:20.663531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8920584c-aef2-41cf-9172-992979777548 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:20.664782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8920584c-aef2-41cf-9172-992979777548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:20.736932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:20.743090 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 415/834] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:20.770942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1e342-5d12-4308-902e-7cdd014d9514 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:20.878075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1e342-5d12-4308-902e-7cdd014d9514 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:20.909289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:20.915710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac23f7-d419-4e4b-898e-3b4658cf7c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:20.916973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac23f7-d419-4e4b-898e-3b4658cf7c50 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:20.917481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac23f7-d419-4e4b-898e-3b4658cf7c50 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:20.918003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac23f7-d419-4e4b-898e-3b4658cf7c50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:20.931405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac23f7-d419-4e4b-898e-3b4658cf7c50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:20.939789 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-97ac23f7-d419-4e4b-898e-3b4658cf7c50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:45:20.939789 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:20.939789 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:20.939789 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:20.939789 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:20.939789 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:20.939789 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:20.939789 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:20.939789 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:20.939789 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:20.939789 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:20.939789 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:20.939789 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:20.939789 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:20.939789 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:20.939789 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:20.940795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:20.940795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:20.940795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:20.940795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:20.940795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:20.940795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:20.940795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:20.940795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:20.940795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:20.940795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:20.940795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:20.940795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:20.940795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:20.940795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:20.940795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:20.940795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:20.941674 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:20.941674 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:20.941674 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:20.941674 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:20.941674 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:20.941674 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:20.941674 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:20.941674 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:20.941674 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:20.941674 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:20.941674 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:45:20.941674 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:20.944438 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 420/835] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:45:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:20.950738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920584c-aef2-41cf-9172-992979777548 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:21.053286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920584c-aef2-41cf-9172-992979777548 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:21.094191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1080ee-9208-4ba8-9089-f86c85fd6cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:21.095114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1080ee-9208-4ba8-9089-f86c85fd6cb4 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:21.095621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1080ee-9208-4ba8-9089-f86c85fd6cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:21.096156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1080ee-9208-4ba8-9089-f86c85fd6cb4 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:21.097105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1080ee-9208-4ba8-9089-f86c85fd6cb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:21.097610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1080ee-9208-4ba8-9089-f86c85fd6cb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:21.099200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1080ee-9208-4ba8-9089-f86c85fd6cb4 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:21.108608 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 416/836] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:45:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:21.114255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac23f7-d419-4e4b-898e-3b4658cf7c50 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:21.218035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac23f7-d419-4e4b-898e-3b4658cf7c50 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:21.253144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13465019-1444-4d9f-91ac-a35e61721b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:21.253985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13465019-1444-4d9f-91ac-a35e61721b32 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:21.254284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13465019-1444-4d9f-91ac-a35e61721b32 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:21.254535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13465019-1444-4d9f-91ac-a35e61721b32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:21.264932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13465019-1444-4d9f-91ac-a35e61721b32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:21.266446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13465019-1444-4d9f-91ac-a35e61721b32 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:21.283856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-13465019-1444-4d9f-91ac-a35e61721b32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:21.283856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:21.283856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:21.283856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:21.283856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:21.283856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:21.283856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:21.283856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:21.283856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:21.283856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:21.283856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:21.283856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:21.283856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:21.283856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:21.283856 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:21.284794 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:21.284794 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:21.284794 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:21.284794 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:21.284794 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:21.284794 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:21.284794 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:21.284794 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:21.284794 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:21.284794 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:21.284794 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:21.284794 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:21.284794 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:21.284794 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:21.284794 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:21.284794 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:21.284794 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:21.285854 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:21.285854 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:21.285854 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:21.285854 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:21.285854 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 421/837] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:21.290742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1080ee-9208-4ba8-9089-f86c85fd6cb4 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:21.353558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:21.398316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1080ee-9208-4ba8-9089-f86c85fd6cb4 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:21.489528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc2544-4179-4e24-b92c-a0ef803f3167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:21.490134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc2544-4179-4e24-b92c-a0ef803f3167 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:21.490415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc2544-4179-4e24-b92c-a0ef803f3167 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:21.490688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc2544-4179-4e24-b92c-a0ef803f3167 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:21.491418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc2544-4179-4e24-b92c-a0ef803f3167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:21.491724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc2544-4179-4e24-b92c-a0ef803f3167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:21.493138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc2544-4179-4e24-b92c-a0ef803f3167 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:21.526731 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 417/838] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:21.532567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13465019-1444-4d9f-91ac-a35e61721b32 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:21.588313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:21.656119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13465019-1444-4d9f-91ac-a35e61721b32 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:21.688946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d51fa-13ce-4f0c-8b65-967dbabe1d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:21.689749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d51fa-13ce-4f0c-8b65-967dbabe1d20 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:21.690026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d51fa-13ce-4f0c-8b65-967dbabe1d20 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:21.690299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d51fa-13ce-4f0c-8b65-967dbabe1d20 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:21.698599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d51fa-13ce-4f0c-8b65-967dbabe1d20 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:21.700073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d51fa-13ce-4f0c-8b65-967dbabe1d20 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:21.716068 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-fb5d51fa-13ce-4f0c-8b65-967dbabe1d20 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 02 20:45:21.716068 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:21.716068 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:21.716068 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:21.716068 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:21.716068 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:21.716068 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:21.716068 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:21.716068 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:21.716068 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:21.716068 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:21.716068 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:21.716068 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:21.716068 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:21.716068 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:21.716068 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:21.717135 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:21.717135 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:21.717135 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:21.717135 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:21.717135 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:21.717135 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:21.717135 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:21.717135 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:21.717135 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:21.717135 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:21.717135 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:21.717135 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:21.717135 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:21.717135 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:21.717135 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:21.717135 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:21.717135 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:21.717135 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:21.718126 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:21.718126 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:21.718126 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:21.718126 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:21.718126 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:21.718126 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:21.718126 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:21.718126 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:21.718126 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 02 20:45:21.718126 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:21.718126 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 422/839] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:45:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:21.726562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc2544-4179-4e24-b92c-a0ef803f3167 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:21.858012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc2544-4179-4e24-b92c-a0ef803f3167 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:21.889214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:21.909670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a353da5-a3fa-4763-8c9f-7128d9c65000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:21.910449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a353da5-a3fa-4763-8c9f-7128d9c65000 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:21.910739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a353da5-a3fa-4763-8c9f-7128d9c65000 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:21.913760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a353da5-a3fa-4763-8c9f-7128d9c65000 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:21.913760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a353da5-a3fa-4763-8c9f-7128d9c65000 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:21.913760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a353da5-a3fa-4763-8c9f-7128d9c65000 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:21.913760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a353da5-a3fa-4763-8c9f-7128d9c65000 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:21.946396 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 418/840] 10.222.0.43 () {56 vars in 1135 bytes} [Sat Jul 2 20:45:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:21.949016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d51fa-13ce-4f0c-8b65-967dbabe1d20 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:22.160018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d51fa-13ce-4f0c-8b65-967dbabe1d20 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:22.163482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:22.220890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec047b-e710-435f-bb0d-14125b9403ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:22.221893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec047b-e710-435f-bb0d-14125b9403ce None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:22.222356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec047b-e710-435f-bb0d-14125b9403ce None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:22.222813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec047b-e710-435f-bb0d-14125b9403ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:22.242056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc5cef-1ce5-4589-9b0b-e908d2bd2337 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:22.242340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc5cef-1ce5-4589-9b0b-e908d2bd2337 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:22.242617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc5cef-1ce5-4589-9b0b-e908d2bd2337 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:22.248196 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 419/841] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:22.249738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093118d-b73b-41e9-9414-b58eaeea3ca5 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:22.250026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093118d-b73b-41e9-9414-b58eaeea3ca5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:22.250303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093118d-b73b-41e9-9414-b58eaeea3ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:22.275647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d093118d-b73b-41e9-9414-b58eaeea3ca5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:22.278885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d093118d-b73b-41e9-9414-b58eaeea3ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:22.345376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec047b-e710-435f-bb0d-14125b9403ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:22.348359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec047b-e710-435f-bb0d-14125b9403ce None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:22.365998 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 420/842] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:22.367429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bb2cd-6636-429d-ada5-5d5a19a14b4a None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:22.367800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bb2cd-6636-429d-ada5-5d5a19a14b4a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:22.368196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bb2cd-6636-429d-ada5-5d5a19a14b4a None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:22.369825 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 421/843] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:22.377972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8ccf9-c74e-4208-b444-559687811bf6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:22.378375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8ccf9-c74e-4208-b444-559687811bf6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:22.378752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8ccf9-c74e-4208-b444-559687811bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:22.398122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a8d8ccf9-c74e-4208-b444-559687811bf6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:22.399564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a8d8ccf9-c74e-4208-b444-559687811bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:22.458279 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 423/844] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:45:21 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:45:22.459045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec047b-e710-435f-bb0d-14125b9403ce None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:22.464527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:22.479855 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 422/845] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:22.480873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8ccf9-c74e-4208-b444-559687811bf6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:22.532121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:22.570788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec047b-e710-435f-bb0d-14125b9403ce None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:22.600416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8ccf9-c74e-4208-b444-559687811bf6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:22.608331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9531d9-b695-43ff-8086-cd4fa59649d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:22.609135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9531d9-b695-43ff-8086-cd4fa59649d5 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:22.609410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9531d9-b695-43ff-8086-cd4fa59649d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:22.609679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9531d9-b695-43ff-8086-cd4fa59649d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:22.620935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9531d9-b695-43ff-8086-cd4fa59649d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:22.628679 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-1b9531d9-b695-43ff-8086-cd4fa59649d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:45:22.628679 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:22.628679 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:22.628679 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:22.628679 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:22.628679 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:22.628679 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:22.628679 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:22.628679 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:22.628679 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:22.628679 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:22.628679 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:22.628679 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:22.628679 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:22.628679 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:22.628679 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:22.629782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:22.629782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:22.629782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:22.629782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:22.629782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:22.629782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:22.629782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:22.629782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:22.629782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:22.629782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:22.629782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:22.629782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:22.629782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:22.629782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:22.629782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:22.629782 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:22.630748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:22.630748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:22.630748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:22.630748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:22.630748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:22.630748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:22.630748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:22.630748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:22.630748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:22.630748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:22.630748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:45:22.630748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:22.635344 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 424/846] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:45:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:22.636211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9531d9-b695-43ff-8086-cd4fa59649d5 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:22.639876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141d74c-dc30-4cd1-b4a8-2128e6820e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:22.641098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141d74c-dc30-4cd1-b4a8-2128e6820e11 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:22.641098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141d74c-dc30-4cd1-b4a8-2128e6820e11 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:22.641291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141d74c-dc30-4cd1-b4a8-2128e6820e11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:22.653701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141d74c-dc30-4cd1-b4a8-2128e6820e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:22.658609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141d74c-dc30-4cd1-b4a8-2128e6820e11 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:22.677952 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-e141d74c-dc30-4cd1-b4a8-2128e6820e11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:22.677952 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:22.677952 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:22.677952 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:22.677952 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:22.677952 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:22.677952 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:22.677952 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:22.677952 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:22.677952 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:22.677952 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:22.677952 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:22.677952 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:22.677952 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:22.677952 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:22.678995 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:22.678995 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:22.678995 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:22.678995 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:22.678995 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:22.678995 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:22.678995 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:22.678995 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:22.678995 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:22.678995 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:22.678995 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:22.678995 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:22.678995 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:22.678995 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:22.678995 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:22.678995 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:22.678995 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:22.679915 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:22.679915 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:22.679915 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:22.679915 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:22.683980 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 423/847] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:22.684856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141d74c-dc30-4cd1-b4a8-2128e6820e11 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:22.711499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:22.754439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9531d9-b695-43ff-8086-cd4fa59649d5 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:22.788619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:22.789386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35a56b-3c64-4e4d-b707-3608db85b05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:22.790187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35a56b-3c64-4e4d-b707-3608db85b05e None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:22.790505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35a56b-3c64-4e4d-b707-3608db85b05e None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:22.790824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35a56b-3c64-4e4d-b707-3608db85b05e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:22.791560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35a56b-3c64-4e4d-b707-3608db85b05e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:22.793017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35a56b-3c64-4e4d-b707-3608db85b05e None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:22.799003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141d74c-dc30-4cd1-b4a8-2128e6820e11 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:22.805451 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-5d35a56b-3c64-4e4d-b707-3608db85b05e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 20:45:22.805451 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:22.805451 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:22.805451 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:22.805451 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:22.805451 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:22.805451 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:22.805451 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:22.805451 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 20:45:22.805451 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:22.805451 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:22.805451 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:22.805451 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:22.805451 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:22.805451 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:22.805451 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:22.805451 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:22.806471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:22.806471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:22.806471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:22.806471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:22.806471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:22.806471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:22.806471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:22.806471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:22.806471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:22.806471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:22.806471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:22.806471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:22.806471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:22.806471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:22.806471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:22.806471 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:22.807344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:22.807344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:22.807344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:22.807344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:22.807344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:22.807344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:22.807344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:22.807344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:22.807344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:22.807344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:22.807344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:22.807344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:22.807344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 20:45:22.807344 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:22.811445 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 425/848] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:45:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:22.812247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35a56b-3c64-4e4d-b707-3608db85b05e None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:22.837299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959c948-616f-4f8a-8b0b-2726cdb5ab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:22.838060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959c948-616f-4f8a-8b0b-2726cdb5ab3f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:22.838345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959c948-616f-4f8a-8b0b-2726cdb5ab3f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:22.838609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959c948-616f-4f8a-8b0b-2726cdb5ab3f None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:22.839348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959c948-616f-4f8a-8b0b-2726cdb5ab3f None admin] RBAC: Adding query filter params (name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:22.839653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959c948-616f-4f8a-8b0b-2726cdb5ab3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:22.841045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959c948-616f-4f8a-8b0b-2726cdb5ab3f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:22.849665 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 424/849] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:45:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:22.849665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959c948-616f-4f8a-8b0b-2726cdb5ab3f None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:22.917508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35a56b-3c64-4e4d-b707-3608db85b05e None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:22.943401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:22.950442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959c948-616f-4f8a-8b0b-2726cdb5ab3f None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:22.952217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fac7a5-31fc-4c66-ac63-0b0aee616cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:22.952946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fac7a5-31fc-4c66-ac63-0b0aee616cee None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:22.953224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fac7a5-31fc-4c66-ac63-0b0aee616cee None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:22.953481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fac7a5-31fc-4c66-ac63-0b0aee616cee None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:22.954197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fac7a5-31fc-4c66-ac63-0b0aee616cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:22.954499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fac7a5-31fc-4c66-ac63-0b0aee616cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:22.955921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fac7a5-31fc-4c66-ac63-0b0aee616cee None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:22.967827 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 426/850] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:22.968581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fac7a5-31fc-4c66-ac63-0b0aee616cee None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:22.986249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfa64c-2deb-4126-baed-3ca87a94ddc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:22.986915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfa64c-2deb-4126-baed-3ca87a94ddc8 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:22.987197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfa64c-2deb-4126-baed-3ca87a94ddc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:22.987477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfa64c-2deb-4126-baed-3ca87a94ddc8 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:22.988219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfa64c-2deb-4126-baed-3ca87a94ddc8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:22.988532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfa64c-2deb-4126-baed-3ca87a94ddc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:22.989902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfa64c-2deb-4126-baed-3ca87a94ddc8 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:22.994677 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 425/851] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:45:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:22.995697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e6444-e8cf-48be-b7d2-0876363f0f2a None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:22.995981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e6444-e8cf-48be-b7d2-0876363f0f2a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:22.996285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e6444-e8cf-48be-b7d2-0876363f0f2a None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:22.997507 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 426/852] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:22.998195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e6444-e8cf-48be-b7d2-0876363f0f2a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:23.017438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:23.070372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fac7a5-31fc-4c66-ac63-0b0aee616cee None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:23.105543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83751b-6687-4922-bc79-7bbdaf62f639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:23.106336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83751b-6687-4922-bc79-7bbdaf62f639 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:23.106600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83751b-6687-4922-bc79-7bbdaf62f639 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:23.106872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83751b-6687-4922-bc79-7bbdaf62f639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:23.107417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e6444-e8cf-48be-b7d2-0876363f0f2a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:23.116716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83751b-6687-4922-bc79-7bbdaf62f639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:23.118174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83751b-6687-4922-bc79-7bbdaf62f639 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:23.135574 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-ce83751b-6687-4922-bc79-7bbdaf62f639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:23.135574 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:23.135574 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:23.135574 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:23.135574 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:23.135574 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:23.135574 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:23.135574 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:23.135574 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:23.135574 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:23.135574 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:23.135574 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:23.135574 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:23.135574 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:23.135574 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:23.136715 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:23.136715 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:23.136715 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:23.136715 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:23.136715 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:23.136715 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:23.136715 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:23.136715 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:23.136715 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:23.136715 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:23.136715 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:23.136715 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:23.136715 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:23.136715 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:23.136715 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:23.136715 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:23.136715 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:23.137631 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:23.137631 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:23.137631 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:23.137631 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:23.137631 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 427/853] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:23.137631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83751b-6687-4922-bc79-7bbdaf62f639 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:23.142609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1def0-e4c9-4492-856e-0a1bfd947262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:23.143405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1def0-e4c9-4492-856e-0a1bfd947262 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:23.143687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1def0-e4c9-4492-856e-0a1bfd947262 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:23.143962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1def0-e4c9-4492-856e-0a1bfd947262 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:23.150867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1def0-e4c9-4492-856e-0a1bfd947262 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:23.152341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1def0-e4c9-4492-856e-0a1bfd947262 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:23.166741 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-36a1def0-e4c9-4492-856e-0a1bfd947262 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:23.166741 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:23.166741 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:23.166741 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:23.166741 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:23.166741 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:23.166741 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:23.166741 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:23.166741 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:23.166741 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:23.166741 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:23.166741 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:23.166741 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:23.166741 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:23.166741 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:23.167683 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:23.167683 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:23.167683 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:23.167683 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:23.167683 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:23.167683 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:23.167683 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:23.167683 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:23.167683 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:23.167683 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:23.167683 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:23.167683 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:23.167683 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:23.167683 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:23.167683 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:23.167683 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:23.167683 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:23.168855 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:23.168855 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:23.168855 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:23.168855 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:23.168855 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:23.168855 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:23.168855 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:23.168855 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:23.168855 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 427/854] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:23.169388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43948a-2b52-4ff5-a3bb-edfaa5036563 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:23.169466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43948a-2b52-4ff5-a3bb-edfaa5036563 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:23.169685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43948a-2b52-4ff5-a3bb-edfaa5036563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:23.184444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:23.187083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fb43948a-2b52-4ff5-a3bb-edfaa5036563 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:23.188542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fb43948a-2b52-4ff5-a3bb-edfaa5036563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:23.241886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83751b-6687-4922-bc79-7bbdaf62f639 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:23.252056 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 428/855] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:23.252899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43948a-2b52-4ff5-a3bb-edfaa5036563 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:23.263172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:23.278461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656697af-b745-4a44-b277-6cf0b6fb489d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:23.279131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656697af-b745-4a44-b277-6cf0b6fb489d None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:23.279411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656697af-b745-4a44-b277-6cf0b6fb489d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:23.279687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656697af-b745-4a44-b277-6cf0b6fb489d None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:23.280432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656697af-b745-4a44-b277-6cf0b6fb489d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:23.280762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656697af-b745-4a44-b277-6cf0b6fb489d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:23.282139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656697af-b745-4a44-b277-6cf0b6fb489d None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:23.286800 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 428/856] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:45:23 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:23.287574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656697af-b745-4a44-b277-6cf0b6fb489d None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:23.359831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43948a-2b52-4ff5-a3bb-edfaa5036563 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:23.399883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85510a-0ffb-40c7-9f61-c5ad65b8fffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:23.400633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85510a-0ffb-40c7-9f61-c5ad65b8fffe None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:23.400881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85510a-0ffb-40c7-9f61-c5ad65b8fffe None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:23.401161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85510a-0ffb-40c7-9f61-c5ad65b8fffe None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:23.401911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85510a-0ffb-40c7-9f61-c5ad65b8fffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:23.402221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85510a-0ffb-40c7-9f61-c5ad65b8fffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:23.403280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656697af-b745-4a44-b277-6cf0b6fb489d None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:23.403612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85510a-0ffb-40c7-9f61-c5ad65b8fffe None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:23.405852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:23.418280 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 429/857] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:23.419175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85510a-0ffb-40c7-9f61-c5ad65b8fffe None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:23.447735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c48317-5f5e-4d18-859c-459c5d9ada93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:23.448434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c48317-5f5e-4d18-859c-459c5d9ada93 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:23.448713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c48317-5f5e-4d18-859c-459c5d9ada93 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:23.448989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c48317-5f5e-4d18-859c-459c5d9ada93 None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:23.449783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c48317-5f5e-4d18-859c-459c5d9ada93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:23.450093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c48317-5f5e-4d18-859c-459c5d9ada93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:23.451574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c48317-5f5e-4d18-859c-459c5d9ada93 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:23.464355 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 429/858] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:23.465226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c48317-5f5e-4d18-859c-459c5d9ada93 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:23.510982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:23.548321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85510a-0ffb-40c7-9f61-c5ad65b8fffe None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:23.575084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c48317-5f5e-4d18-859c-459c5d9ada93 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:23.582710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267403c-137d-47f5-b864-807435f6211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:23.583735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267403c-137d-47f5-b864-807435f6211b None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:23.584155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267403c-137d-47f5-b864-807435f6211b None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:23.584432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267403c-137d-47f5-b864-807435f6211b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:23.585071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267403c-137d-47f5-b864-807435f6211b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:23.586427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267403c-137d-47f5-b864-807435f6211b None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:23.599155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-3267403c-137d-47f5-b864-807435f6211b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 20:45:23.599155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:23.599155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:23.599155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:23.599155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:23.599155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:23.599155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:23.599155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:23.599155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 20:45:23.599155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:23.599155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:23.599155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:23.599155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:23.599155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:23.599155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:23.599155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:23.600600 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:23.600600 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:23.600600 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:23.600600 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:23.600600 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:23.600600 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:23.600600 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:23.600600 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:23.600600 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:23.600600 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:23.600600 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:23.600600 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:23.600600 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:23.600600 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:23.600600 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:23.600600 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:23.601469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:23.601469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:23.601469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:23.601469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:23.601469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:23.601469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:23.601469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:23.601469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:23.601469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:23.601469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:23.601469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:23.601469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:23.601469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:23.601469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 20:45:23.601469 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:23.601469 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 430/859] 10.222.0.43 () {56 vars in 1132 bytes} [Sat Jul 2 20:45:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:23.603129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267403c-137d-47f5-b864-807435f6211b None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:23.616644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfb53e-fe9e-4de8-9c85-3257adf95e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:23.617471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfb53e-fe9e-4de8-9c85-3257adf95e79 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:23.617751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfb53e-fe9e-4de8-9c85-3257adf95e79 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:23.618031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfb53e-fe9e-4de8-9c85-3257adf95e79 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:23.627894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfb53e-fe9e-4de8-9c85-3257adf95e79 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:23.629402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfb53e-fe9e-4de8-9c85-3257adf95e79 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:23.644581 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-9fbfb53e-fe9e-4de8-9c85-3257adf95e79 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 20:45:23.644581 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:23.644581 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:23.644581 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:23.644581 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:23.644581 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:23.644581 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:23.644581 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:23.644581 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:23.644581 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:23.644581 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:23.644581 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:23.644581 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:23.644581 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:23.644581 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:23.644581 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:23.645773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:23.645773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:23.645773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:23.645773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:23.645773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:23.645773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:23.645773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:23.645773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:23.645773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:23.645773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:23.645773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:23.645773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:23.645773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:23.645773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:23.645773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:23.645773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:23.645773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:23.645773 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:23.646846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:23.646846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:23.646846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:23.646846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:23.646846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:23.646846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:23.646846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:23.646846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:23.646846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 20:45:23.646846 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:23.646846 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 430/860] 10.222.0.43 () {56 vars in 1117 bytes} [Sat Jul 2 20:45:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:23.646846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfb53e-fe9e-4de8-9c85-3257adf95e79 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:23.677740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:23.729869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267403c-137d-47f5-b864-807435f6211b None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:23.758843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfb53e-fe9e-4de8-9c85-3257adf95e79 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:23.761065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:23.766544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9c792-06ca-4757-bd02-82f4ebcada7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:23.767303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9c792-06ca-4757-bd02-82f4ebcada7f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:23.767584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9c792-06ca-4757-bd02-82f4ebcada7f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:23.767855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9c792-06ca-4757-bd02-82f4ebcada7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:23.768716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9c792-06ca-4757-bd02-82f4ebcada7f None admin] RBAC: Adding query filter params (role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=55367f643da048c5ab61ab6325552256) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:23.769182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9c792-06ca-4757-bd02-82f4ebcada7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:23.770634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9c792-06ca-4757-bd02-82f4ebcada7f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:23.784088 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 431/861] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:45:23 2022] GET /identity/v3/role_assignments?user.id=55367f643da048c5ab61ab6325552256&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:23.784088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9c792-06ca-4757-bd02-82f4ebcada7f None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:23.805961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4887ea8-73f7-405b-a91c-ba99368f5c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:23.806717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4887ea8-73f7-405b-a91c-ba99368f5c06 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:23.806999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4887ea8-73f7-405b-a91c-ba99368f5c06 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:23.807448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4887ea8-73f7-405b-a91c-ba99368f5c06 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:23.808566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4887ea8-73f7-405b-a91c-ba99368f5c06 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:23.808883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4887ea8-73f7-405b-a91c-ba99368f5c06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:23.810325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4887ea8-73f7-405b-a91c-ba99368f5c06 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:23.817739 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 431/862] 10.222.0.43 () {56 vars in 1126 bytes} [Sat Jul 2 20:45:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:23.823913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4887ea8-73f7-405b-a91c-ba99368f5c06 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:23.905745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9c792-06ca-4757-bd02-82f4ebcada7f None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:23.937324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:23.944754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df6dd8-32b1-41b2-9b24-2212694c40b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:23.945791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df6dd8-32b1-41b2-9b24-2212694c40b7 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:23.946176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df6dd8-32b1-41b2-9b24-2212694c40b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:23.946536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df6dd8-32b1-41b2-9b24-2212694c40b7 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:23.948100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df6dd8-32b1-41b2-9b24-2212694c40b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:23.948874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df6dd8-32b1-41b2-9b24-2212694c40b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:23.950683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df6dd8-32b1-41b2-9b24-2212694c40b7 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:23.954639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4887ea8-73f7-405b-a91c-ba99368f5c06 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:23.975419 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 432/863] 10.222.0.43 () {56 vars in 1149 bytes} [Sat Jul 2 20:45:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:23.980541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df6dd8-32b1-41b2-9b24-2212694c40b7 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:24.000736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaaba41-6747-41fa-a504-b62b94682138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:24.001647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaba41-6747-41fa-a504-b62b94682138 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:24.001759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaba41-6747-41fa-a504-b62b94682138 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:24.001957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaba41-6747-41fa-a504-b62b94682138 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:24.002672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaaba41-6747-41fa-a504-b62b94682138 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:24.002998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaaba41-6747-41fa-a504-b62b94682138 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:24.004447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaaba41-6747-41fa-a504-b62b94682138 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:24.016589 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 432/864] 10.222.0.43 () {56 vars in 1126 bytes} [Sat Jul 2 20:45:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:24.052302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:24.110704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df6dd8-32b1-41b2-9b24-2212694c40b7 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:24.150452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b5506-5199-42ce-a027-a3bf32be4c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:24.151123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b5506-5199-42ce-a027-a3bf32be4c63 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:24.151405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b5506-5199-42ce-a027-a3bf32be4c63 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:24.151680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b5506-5199-42ce-a027-a3bf32be4c63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:24.225357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b5506-5199-42ce-a027-a3bf32be4c63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:24.226816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b5506-5199-42ce-a027-a3bf32be4c63 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:24.288558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:24.331405 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 433/865] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:45:23 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 02 20:45:24.336864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaaba41-6747-41fa-a504-b62b94682138 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:24.442184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaaba41-6747-41fa-a504-b62b94682138 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:24.479273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440424d-1052-4057-8300-816e6545fbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:24.480088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440424d-1052-4057-8300-816e6545fbb2 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:24.480376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440424d-1052-4057-8300-816e6545fbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:24.480654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440424d-1052-4057-8300-816e6545fbb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:24.492067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440424d-1052-4057-8300-816e6545fbb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:24.493525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440424d-1052-4057-8300-816e6545fbb2 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:24.510965 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-a440424d-1052-4057-8300-816e6545fbb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:24.510965 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:24.510965 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:24.510965 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:24.510965 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:24.510965 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:24.510965 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:24.510965 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:24.510965 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:24.510965 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:24.510965 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:24.510965 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:24.510965 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:24.510965 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:24.510965 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:24.511922 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:24.511922 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:24.511922 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:24.511922 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:24.511922 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:24.511922 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:24.511922 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:24.511922 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:24.511922 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:24.511922 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:24.511922 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:24.511922 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:24.511922 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:24.511922 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:24.511922 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:24.511922 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:24.511922 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:24.513874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:24.513874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:24.513874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:24.513874 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:24.513874 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 433/866] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:24.518121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b5506-5199-42ce-a027-a3bf32be4c63 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:24.621001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b5506-5199-42ce-a027-a3bf32be4c63 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:24.655928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd94ac-3b20-4300-a91f-ba06ca08f76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:24.656620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd94ac-3b20-4300-a91f-ba06ca08f76e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:24.656901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd94ac-3b20-4300-a91f-ba06ca08f76e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:24.657174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd94ac-3b20-4300-a91f-ba06ca08f76e None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:24.657891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd94ac-3b20-4300-a91f-ba06ca08f76e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:24.658193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd94ac-3b20-4300-a91f-ba06ca08f76e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:24.659609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd94ac-3b20-4300-a91f-ba06ca08f76e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:24.682865 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 434/867] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:24.688532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440424d-1052-4057-8300-816e6545fbb2 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:24.692471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:24.792810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440424d-1052-4057-8300-816e6545fbb2 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:24.827673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97c897-d277-4360-b945-b2c7a99ff50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:24.828569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97c897-d277-4360-b945-b2c7a99ff50f None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:24.828856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97c897-d277-4360-b945-b2c7a99ff50f None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:24.829136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97c897-d277-4360-b945-b2c7a99ff50f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:24.836492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97c897-d277-4360-b945-b2c7a99ff50f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:24.838027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97c897-d277-4360-b945-b2c7a99ff50f None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:24.856591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-bd97c897-d277-4360-b945-b2c7a99ff50f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:24.856591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:24.856591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:24.856591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:24.856591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:24.856591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:24.856591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:24.856591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:24.856591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:24.856591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:24.856591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:24.856591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:24.856591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:24.856591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:24.856591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:24.857524 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:24.857524 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:24.857524 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:24.857524 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:24.857524 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:24.857524 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:24.857524 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:24.857524 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:24.857524 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:24.857524 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:24.857524 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:24.857524 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:24.857524 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:24.857524 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:24.857524 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:24.857524 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:24.857524 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:24.858482 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:24.858482 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:24.858482 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:24.858482 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:24.858482 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:24.858482 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:24.858482 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:24.858482 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:24.860965 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 434/868] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:24.867019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd94ac-3b20-4300-a91f-ba06ca08f76e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:24.884703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:24.971788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd94ac-3b20-4300-a91f-ba06ca08f76e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:25.009848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00c5dc-f060-499c-9550-591cb5f6ca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:25.010898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00c5dc-f060-499c-9550-591cb5f6ca68 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:25.011382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00c5dc-f060-499c-9550-591cb5f6ca68 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:25.011855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00c5dc-f060-499c-9550-591cb5f6ca68 None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:25.012876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00c5dc-f060-499c-9550-591cb5f6ca68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:25.013385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00c5dc-f060-499c-9550-591cb5f6ca68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:25.015061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00c5dc-f060-499c-9550-591cb5f6ca68 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:25.027846 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 435/869] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:25.037327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97c897-d277-4360-b945-b2c7a99ff50f None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:25.104800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:25.151013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97c897-d277-4360-b945-b2c7a99ff50f None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:25.187405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d54a46-1715-4836-a9fb-86cc4ff4b3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:25.188096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d54a46-1715-4836-a9fb-86cc4ff4b3fc None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:25.188471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d54a46-1715-4836-a9fb-86cc4ff4b3fc None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:25.188757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d54a46-1715-4836-a9fb-86cc4ff4b3fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:25.189606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d54a46-1715-4836-a9fb-86cc4ff4b3fc None admin] RBAC: Adding query filter params (role.id=843bfd29577143dcb23593a75d4ee5a0, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=4d4bfe417b4c4896ae5f3fc23e03ef71) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:25.189921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d54a46-1715-4836-a9fb-86cc4ff4b3fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:25.191382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d54a46-1715-4836-a9fb-86cc4ff4b3fc None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:25.198153 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 435/870] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:45:25 2022] GET /identity/v3/role_assignments?user.id=4d4bfe417b4c4896ae5f3fc23e03ef71&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=843bfd29577143dcb23593a75d4ee5a0 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:25.700987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c96827-07b1-4add-ab14-f249e9110beb None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:25.701582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c96827-07b1-4add-ab14-f249e9110beb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:25.701824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c96827-07b1-4add-ab14-f249e9110beb None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:25.703582 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 436/871] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:25.709087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd174a74-d777-4148-a035-f503b7ad5869 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:25.709537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd174a74-d777-4148-a035-f503b7ad5869 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:25.709851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd174a74-d777-4148-a035-f503b7ad5869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:25.727703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-dd174a74-d777-4148-a035-f503b7ad5869 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:25.729025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dd174a74-d777-4148-a035-f503b7ad5869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:25.800896 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 436/872] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:25.824882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c96827-07b1-4add-ab14-f249e9110beb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:25.904072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:25.931599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c96827-07b1-4add-ab14-f249e9110beb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:25.967674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be791e5a-0631-4eed-81c0-9a7c48858067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:25.968326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be791e5a-0631-4eed-81c0-9a7c48858067 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:25.968606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be791e5a-0631-4eed-81c0-9a7c48858067 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:25.968879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be791e5a-0631-4eed-81c0-9a7c48858067 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:25.969654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be791e5a-0631-4eed-81c0-9a7c48858067 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:25.971094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be791e5a-0631-4eed-81c0-9a7c48858067 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:25.988747 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 437/873] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Jul 2 20:45:25 2022] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:45:26.229669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc195b0a-de5a-4eff-95e5-062063a98118 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:26.230090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc195b0a-de5a-4eff-95e5-062063a98118 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:26.230610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc195b0a-de5a-4eff-95e5-062063a98118 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:26.232491 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 437/874] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:26.238042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4f6a0-9a18-480a-aa50-a3436a1d7d76 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:26.238627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4f6a0-9a18-480a-aa50-a3436a1d7d76 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:26.239114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4f6a0-9a18-480a-aa50-a3436a1d7d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:26.256821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5da4f6a0-9a18-480a-aa50-a3436a1d7d76 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:26.258307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5da4f6a0-9a18-480a-aa50-a3436a1d7d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:26.338630 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 438/875] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:26 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:26.359395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc195b0a-de5a-4eff-95e5-062063a98118 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:26.412201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3198d-230f-4d7e-a235-1bcc4a513da2 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:26.412861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3198d-230f-4d7e-a235-1bcc4a513da2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:26.413354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3198d-230f-4d7e-a235-1bcc4a513da2 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:26.414961 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 439/876] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:26.420765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f3471-f700-4db7-8fb4-6f4ee7c40ca1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:26.421316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f3471-f700-4db7-8fb4-6f4ee7c40ca1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:26.421810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:26.422606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f3471-f700-4db7-8fb4-6f4ee7c40ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:26.442588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-279f3471-f700-4db7-8fb4-6f4ee7c40ca1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:26.444182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-279f3471-f700-4db7-8fb4-6f4ee7c40ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:26.466688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc195b0a-de5a-4eff-95e5-062063a98118 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:26.503848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a128e6d-53e1-4624-9da3-639bced949db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:26.505024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a128e6d-53e1-4624-9da3-639bced949db None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:26.505493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a128e6d-53e1-4624-9da3-639bced949db None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:26.505915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a128e6d-53e1-4624-9da3-639bced949db None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:26.506841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:26.507950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a128e6d-53e1-4624-9da3-639bced949db None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:26.510258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a128e6d-53e1-4624-9da3-639bced949db None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:26.525840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-6a128e6d-53e1-4624-9da3-639bced949db None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 20:45:26.525840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:26.525840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:26.525840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:26.525840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:26.525840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:26.525840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:26.525840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:26.525840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 20:45:26.525840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:26.525840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:26.525840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:26.525840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:26.525840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:26.525840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:26.525840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:26.525840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:26.526938 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:26.526938 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:26.526938 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:26.526938 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:26.526938 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:26.526938 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:26.526938 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:26.526938 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:26.526938 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:26.526938 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:26.526938 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:26.526938 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:26.526938 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:26.526938 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:26.526938 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:26.526938 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:26.527818 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:26.527818 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:26.527818 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:26.527818 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:26.527818 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:26.527818 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:26.527818 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:26.527818 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:26.527818 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:26.527818 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:26.527818 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:26.527818 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:26.527818 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 20:45:26.527818 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:26.528639 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 440/877] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:26 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:26.530783 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 438/878] 10.222.0.43 () {56 vars in 1126 bytes} [Sat Jul 2 20:45:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:26.536703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f3471-f700-4db7-8fb4-6f4ee7c40ca1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:26.547743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a128e6d-53e1-4624-9da3-639bced949db None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:26.647084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f3471-f700-4db7-8fb4-6f4ee7c40ca1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:26.662638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a128e6d-53e1-4624-9da3-639bced949db None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:26.692187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:26.693444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8123d-e737-4045-83c4-1a3ac2ff6f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:26.694143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8123d-e737-4045-83c4-1a3ac2ff6f30 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:26.694556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8123d-e737-4045-83c4-1a3ac2ff6f30 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:26.694865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8123d-e737-4045-83c4-1a3ac2ff6f30 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:26.696464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8123d-e737-4045-83c4-1a3ac2ff6f30 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:26.696729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8123d-e737-4045-83c4-1a3ac2ff6f30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:26.698403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8123d-e737-4045-83c4-1a3ac2ff6f30 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:26.708123 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 441/879] 10.222.0.43 () {56 vars in 1122 bytes} [Sat Jul 2 20:45:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:26.712213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8123d-e737-4045-83c4-1a3ac2ff6f30 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:26.719937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca29fd-d2c2-49ad-add4-886ac3bd23b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:26.720656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca29fd-d2c2-49ad-add4-886ac3bd23b9 None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:26.720939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca29fd-d2c2-49ad-add4-886ac3bd23b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:26.721213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca29fd-d2c2-49ad-add4-886ac3bd23b9 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:26.721986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca29fd-d2c2-49ad-add4-886ac3bd23b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:26.723374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca29fd-d2c2-49ad-add4-886ac3bd23b9 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:26.743657 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 439/880] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Jul 2 20:45:26 2022] POST /identity/v3/services => generated 269 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:45:26.791252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:26.841904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8123d-e737-4045-83c4-1a3ac2ff6f30 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:26.896443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6d0e6-c387-48fc-b10f-d8020ea3b6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:26.897543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6d0e6-c387-48fc-b10f-d8020ea3b6d0 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:26.898019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6d0e6-c387-48fc-b10f-d8020ea3b6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:26.898488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6d0e6-c387-48fc-b10f-d8020ea3b6d0 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:26.899432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6d0e6-c387-48fc-b10f-d8020ea3b6d0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:26.900072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6d0e6-c387-48fc-b10f-d8020ea3b6d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:26.901695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6d0e6-c387-48fc-b10f-d8020ea3b6d0 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:26.907893 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 442/881] 10.222.0.43 () {56 vars in 1122 bytes} [Sat Jul 2 20:45:26 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:27.637567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8674890-bbbb-441e-b0e4-6fda3e59f60a None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:27.637854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8674890-bbbb-441e-b0e4-6fda3e59f60a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:27.638410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8674890-bbbb-441e-b0e4-6fda3e59f60a None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:27.640408 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 440/882] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:27.646139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf74753-6fc9-4ae3-a053-baf2948fe8ef None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:27.646691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf74753-6fc9-4ae3-a053-baf2948fe8ef None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:27.647246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf74753-6fc9-4ae3-a053-baf2948fe8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:27.664890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2cf74753-6fc9-4ae3-a053-baf2948fe8ef None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:27.666415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2cf74753-6fc9-4ae3-a053-baf2948fe8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:27.735910 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 443/883] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:27.762946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8674890-bbbb-441e-b0e4-6fda3e59f60a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:27.875121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8674890-bbbb-441e-b0e4-6fda3e59f60a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:27.910670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d4fc0-b33f-4ea6-bc29-3a0ef3f77fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:27.911893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d4fc0-b33f-4ea6-bc29-3a0ef3f77fcc None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:27.912435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d4fc0-b33f-4ea6-bc29-3a0ef3f77fcc None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:27.912931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d4fc0-b33f-4ea6-bc29-3a0ef3f77fcc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:27.926761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d4fc0-b33f-4ea6-bc29-3a0ef3f77fcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:27.935253 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-b86d4fc0-b33f-4ea6-bc29-3a0ef3f77fcc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 20:45:27.935253 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:27.935253 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:27.935253 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:27.935253 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:27.935253 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:27.935253 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:27.935253 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:27.935253 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:27.935253 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:27.935253 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:27.935253 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:27.935253 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:27.935253 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:27.935253 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:27.935253 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:27.936257 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:27.936257 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:27.936257 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:27.936257 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:27.936257 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:27.936257 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:27.936257 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:27.936257 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:27.936257 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:27.936257 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:27.936257 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:27.936257 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:27.936257 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:27.936257 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:27.936257 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:27.936257 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:27.937174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:27.937174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:27.937174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:27.937174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:27.937174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:27.937174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:27.937174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:27.937174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:27.937174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:27.937174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:27.937174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 20:45:27.937174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:27.937174 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 441/884] 10.222.0.43 () {56 vars in 1120 bytes} [Sat Jul 2 20:45:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:27.944742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf74753-6fc9-4ae3-a053-baf2948fe8ef None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:28.000482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:28.050081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf74753-6fc9-4ae3-a053-baf2948fe8ef None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:28.087165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c82c4-17fd-48d8-a6b3-ded502ad8d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:28.088266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c82c4-17fd-48d8-a6b3-ded502ad8d9e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:28.088794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c82c4-17fd-48d8-a6b3-ded502ad8d9e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:28.089282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c82c4-17fd-48d8-a6b3-ded502ad8d9e None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:28.090233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c82c4-17fd-48d8-a6b3-ded502ad8d9e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:28.090759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c82c4-17fd-48d8-a6b3-ded502ad8d9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:28.092367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c82c4-17fd-48d8-a6b3-ded502ad8d9e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:28.102282 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 444/885] 10.222.0.43 () {56 vars in 1115 bytes} [Sat Jul 2 20:45:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:28.108226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d4fc0-b33f-4ea6-bc29-3a0ef3f77fcc None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:28.154585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:28.217810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d4fc0-b33f-4ea6-bc29-3a0ef3f77fcc None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:28.253997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a89536-03d1-4fcc-8bd7-5a23646ffe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:28.255228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a89536-03d1-4fcc-8bd7-5a23646ffe5b None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:28.255755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a89536-03d1-4fcc-8bd7-5a23646ffe5b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:28.256257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a89536-03d1-4fcc-8bd7-5a23646ffe5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:28.266895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a89536-03d1-4fcc-8bd7-5a23646ffe5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:28.268680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a89536-03d1-4fcc-8bd7-5a23646ffe5b None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:28.287529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-90a89536-03d1-4fcc-8bd7-5a23646ffe5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:28.287529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:28.287529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:28.287529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:28.287529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:28.287529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:28.287529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:28.287529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:28.287529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:28.287529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:28.287529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:28.287529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:28.287529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:28.287529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:28.287529 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:28.288594 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:28.288594 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:28.288594 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:28.288594 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:28.288594 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:28.288594 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:28.288594 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:28.288594 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:28.288594 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:28.288594 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:28.288594 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:28.288594 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:28.288594 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:28.288594 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:28.288594 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:28.288594 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:28.288594 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:28.289519 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:28.289519 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:28.289519 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:28.289519 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:28.291890 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 442/886] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:28.301196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c82c4-17fd-48d8-a6b3-ded502ad8d9e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:28.409760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c82c4-17fd-48d8-a6b3-ded502ad8d9e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:28.417332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:28.446874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df4a50-518d-4dd3-862a-42976533faa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:28.447549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df4a50-518d-4dd3-862a-42976533faa5 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:28.447834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df4a50-518d-4dd3-862a-42976533faa5 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:28.448134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df4a50-518d-4dd3-862a-42976533faa5 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:28.448857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df4a50-518d-4dd3-862a-42976533faa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:28.449160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df4a50-518d-4dd3-862a-42976533faa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:28.450551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df4a50-518d-4dd3-862a-42976533faa5 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:28.463356 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 445/887] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:28.468260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c98ee-5ab7-4b48-abf4-bfc9b8a986f9 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:28.468796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c98ee-5ab7-4b48-abf4-bfc9b8a986f9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:28.469271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c98ee-5ab7-4b48-abf4-bfc9b8a986f9 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:28.470569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df4a50-518d-4dd3-862a-42976533faa5 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:28.471677 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 443/888] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:28.477728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de765e-774c-4e4b-92eb-9ed6f4369931 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:28.478043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de765e-774c-4e4b-92eb-9ed6f4369931 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:28.478315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de765e-774c-4e4b-92eb-9ed6f4369931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:28.502386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-95de765e-774c-4e4b-92eb-9ed6f4369931 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:28.503997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-95de765e-774c-4e4b-92eb-9ed6f4369931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:28.582850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df4a50-518d-4dd3-862a-42976533faa5 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:28.592178 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 444/889] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:45:28.621861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de765e-774c-4e4b-92eb-9ed6f4369931 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:28.632139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5585aba-fe5d-400b-80ba-05243c17f71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:28.633317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5585aba-fe5d-400b-80ba-05243c17f71e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:28.633850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5585aba-fe5d-400b-80ba-05243c17f71e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:28.634392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5585aba-fe5d-400b-80ba-05243c17f71e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:28.642974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5585aba-fe5d-400b-80ba-05243c17f71e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:28.645035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5585aba-fe5d-400b-80ba-05243c17f71e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:28.650828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:28.664636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-f5585aba-fe5d-400b-80ba-05243c17f71e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 20:45:28.664636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:28.664636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:28.664636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:28.664636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:28.664636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:28.664636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:28.664636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:28.664636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:28.664636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:28.664636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:28.664636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:28.664636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:28.664636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:28.664636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:28.664636 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:28.665784 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:28.665784 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:28.665784 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:28.665784 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:28.665784 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:28.665784 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:28.665784 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:28.665784 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:28.665784 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:28.665784 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:28.665784 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:28.665784 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:28.665784 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:28.665784 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:28.665784 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:28.665784 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:28.665784 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:28.665784 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:28.666800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:28.666800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:28.666800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:28.666800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:28.666800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:28.666800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:28.666800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:28.666800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:28.666800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 20:45:28.666800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:28.669699 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 446/890] 10.222.0.43 () {56 vars in 1117 bytes} [Sat Jul 2 20:45:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:28.676297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5585aba-fe5d-400b-80ba-05243c17f71e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:28.706326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:28.746062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de765e-774c-4e4b-92eb-9ed6f4369931 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:28.798728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1a591-fb69-41e3-8611-bead11c28a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:28.801642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1a591-fb69-41e3-8611-bead11c28a3c None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:28.802142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1a591-fb69-41e3-8611-bead11c28a3c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:28.802693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1a591-fb69-41e3-8611-bead11c28a3c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:28.803686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1a591-fb69-41e3-8611-bead11c28a3c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:28.805453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1a591-fb69-41e3-8611-bead11c28a3c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:28.807050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5585aba-fe5d-400b-80ba-05243c17f71e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:28.820029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-07f1a591-fb69-41e3-8611-bead11c28a3c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 20:45:28.820029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:28.820029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:28.820029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:28.820029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:28.820029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:28.820029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:28.820029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:28.820029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 20:45:28.820029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:28.820029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:28.820029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:28.820029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:28.820029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:28.820029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:28.820029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:28.820029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:28.821148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:28.821148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:28.821148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:28.821148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:28.821148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:28.821148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:28.821148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:28.821148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:28.821148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:28.821148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:28.821148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:28.821148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:28.821148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:28.821148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:28.821148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:28.821148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:28.822136 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:28.822136 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:28.822136 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:28.822136 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:28.822136 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:28.822136 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:28.822136 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:28.822136 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:28.822136 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:28.822136 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:28.822136 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:28.822136 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:28.822136 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 20:45:28.822136 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:28.830058 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 445/891] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:45:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:28.832405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1a591-fb69-41e3-8611-bead11c28a3c None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:28.845433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb54b24-0577-46c7-a007-f175542aace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:28.846120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb54b24-0577-46c7-a007-f175542aace3 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:28.846401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb54b24-0577-46c7-a007-f175542aace3 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:28.846673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb54b24-0577-46c7-a007-f175542aace3 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:28.848014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb54b24-0577-46c7-a007-f175542aace3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:28.848366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb54b24-0577-46c7-a007-f175542aace3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:28.850161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb54b24-0577-46c7-a007-f175542aace3 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:28.876208 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 447/892] 10.222.0.43 () {56 vars in 1149 bytes} [Sat Jul 2 20:45:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:28.878318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb54b24-0577-46c7-a007-f175542aace3 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:28.942888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:28.960136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1a591-fb69-41e3-8611-bead11c28a3c None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:28.980228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:28.997525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb54b24-0577-46c7-a007-f175542aace3 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:29.001979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3cce0-880a-48b8-ab4f-8089e6acf217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:29.002739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3cce0-880a-48b8-ab4f-8089e6acf217 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:29.003114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3cce0-880a-48b8-ab4f-8089e6acf217 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:29.003464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3cce0-880a-48b8-ab4f-8089e6acf217 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:29.004346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3cce0-880a-48b8-ab4f-8089e6acf217 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:29.004766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3cce0-880a-48b8-ab4f-8089e6acf217 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:29.006258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3cce0-880a-48b8-ab4f-8089e6acf217 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:29.012081 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 446/893] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:45:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:29.017597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3cce0-880a-48b8-ab4f-8089e6acf217 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:29.041060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242cb4f-6d92-4690-b903-3b4ffb0085f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:29.041701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242cb4f-6d92-4690-b903-3b4ffb0085f7 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:29.041984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242cb4f-6d92-4690-b903-3b4ffb0085f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:29.042253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242cb4f-6d92-4690-b903-3b4ffb0085f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:29.133444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242cb4f-6d92-4690-b903-3b4ffb0085f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:29.135206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242cb4f-6d92-4690-b903-3b4ffb0085f7 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:29.158807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3cce0-880a-48b8-ab4f-8089e6acf217 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:29.201103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f5bd6-8980-414f-be55-b0549982ccef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:29.201795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f5bd6-8980-414f-be55-b0549982ccef None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:29.202075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f5bd6-8980-414f-be55-b0549982ccef None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:29.202350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f5bd6-8980-414f-be55-b0549982ccef None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:29.203049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f5bd6-8980-414f-be55-b0549982ccef None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:29.203356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f5bd6-8980-414f-be55-b0549982ccef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:29.204761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f5bd6-8980-414f-be55-b0549982ccef None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:29.209738 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 447/894] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:45:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:29.210953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903a985-1be3-4019-a78b-cd9d5269fa68 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:29.211233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903a985-1be3-4019-a78b-cd9d5269fa68 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:29.211506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903a985-1be3-4019-a78b-cd9d5269fa68 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:29.213001 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 448/895] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:29.220417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903a985-1be3-4019-a78b-cd9d5269fa68 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:29.231997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:29.240954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:29.250363 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 448/896] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:45:28 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:45:29.251946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaff5e-18a3-44e6-9f15-0086a58cda98 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:29.252446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaff5e-18a3-44e6-9f15-0086a58cda98 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:29.252880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaff5e-18a3-44e6-9f15-0086a58cda98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:29.269679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-edfaff5e-18a3-44e6-9f15-0086a58cda98 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:29.270859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-edfaff5e-18a3-44e6-9f15-0086a58cda98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:29.335133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903a985-1be3-4019-a78b-cd9d5269fa68 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:29.339740 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 449/897] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:29.340637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaff5e-18a3-44e6-9f15-0086a58cda98 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:29.381853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbc8af-423f-4366-b997-b7953d2ebc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:29.382624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbc8af-423f-4366-b997-b7953d2ebc9b None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:29.382940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbc8af-423f-4366-b997-b7953d2ebc9b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:29.383196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbc8af-423f-4366-b997-b7953d2ebc9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:29.384058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbc8af-423f-4366-b997-b7953d2ebc9b None admin] RBAC: Adding query filter params (interface=public, service_id=9758aadd72fc41a7814160bebd51b095, region_id=RegionOne) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:29.384670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbc8af-423f-4366-b997-b7953d2ebc9b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:29.386067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbc8af-423f-4366-b997-b7953d2ebc9b None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:29.391500 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 449/898] 10.222.0.43 () {56 vars in 1251 bytes} [Sat Jul 2 20:45:29 2022] GET /identity/v3/endpoints?service_id=9758aadd72fc41a7814160bebd51b095&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:29.392689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1656b9f-1c47-4a80-ab29-d54331cdd40f None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:29.392984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1656b9f-1c47-4a80-ab29-d54331cdd40f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:29.393243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1656b9f-1c47-4a80-ab29-d54331cdd40f None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:29.394566 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 450/899] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:29.395115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1656b9f-1c47-4a80-ab29-d54331cdd40f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:29.438679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaff5e-18a3-44e6-9f15-0086a58cda98 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:29.452288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:29.476909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d5e40-dc94-4619-a584-6154e1b65183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:29.477365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:29.478329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d5e40-dc94-4619-a584-6154e1b65183 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:29.478699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d5e40-dc94-4619-a584-6154e1b65183 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:29.479065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d5e40-dc94-4619-a584-6154e1b65183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:29.491552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d5e40-dc94-4619-a584-6154e1b65183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:29.493031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d5e40-dc94-4619-a584-6154e1b65183 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:29.497827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1656b9f-1c47-4a80-ab29-d54331cdd40f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:29.510045 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-b95d5e40-dc94-4619-a584-6154e1b65183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:29.510045 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:29.510045 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:29.510045 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:29.510045 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:29.510045 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:29.510045 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:29.510045 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:29.510045 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:29.510045 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:29.510045 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:29.510045 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:29.510045 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:29.510045 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:29.510045 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:29.511118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:29.511118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:29.511118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:29.511118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:29.511118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:29.511118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:29.511118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:29.511118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:29.511118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:29.511118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:29.511118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:29.511118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:29.511118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:29.511118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:29.511118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:29.511118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:29.511118 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:29.512381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:29.512381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:29.512381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:29.512381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:29.512381 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 450/900] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:29.512381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d5e40-dc94-4619-a584-6154e1b65183 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:29.537667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8663f-5818-4bf6-9166-b92d7a7a98f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:29.538483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8663f-5818-4bf6-9166-b92d7a7a98f8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:29.538752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8663f-5818-4bf6-9166-b92d7a7a98f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:29.539029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8663f-5818-4bf6-9166-b92d7a7a98f8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:29.539681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8663f-5818-4bf6-9166-b92d7a7a98f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:29.541186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8663f-5818-4bf6-9166-b92d7a7a98f8 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:29.553763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-d8e8663f-5818-4bf6-9166-b92d7a7a98f8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 20:45:29.553763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:29.553763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:29.553763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:29.553763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:29.553763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:29.553763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:29.553763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:29.553763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 20:45:29.553763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:29.553763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:29.553763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:29.553763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:29.553763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:29.553763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:29.553763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:29.554733 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:29.554733 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:29.554733 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:29.554733 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:29.554733 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:29.554733 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:29.554733 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:29.554733 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:29.554733 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:29.554733 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:29.554733 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:29.554733 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:29.554733 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:29.554733 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:29.554733 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:29.554733 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:29.555604 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:29.555604 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:29.555604 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:29.555604 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:29.555604 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:29.555604 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:29.555604 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:29.555604 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:29.555604 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:29.555604 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:29.555604 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:29.555604 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:29.555604 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:29.555604 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 20:45:29.555604 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:29.555604 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 451/901] 10.222.0.43 () {56 vars in 1132 bytes} [Sat Jul 2 20:45:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:29.556708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a0da2-014e-42b3-bb70-02bd55da8917 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:29.556708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a0da2-014e-42b3-bb70-02bd55da8917 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:29.556708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a0da2-014e-42b3-bb70-02bd55da8917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:29.572983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7c1a0da2-014e-42b3-bb70-02bd55da8917 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:29.574182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7c1a0da2-014e-42b3-bb70-02bd55da8917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:29.615912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d5e40-dc94-4619-a584-6154e1b65183 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:29.640477 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 452/902] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:29.641298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a0da2-014e-42b3-bb70-02bd55da8917 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:29.649045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a26e92-8fd2-4aa5-99ab-764d10e52264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:29.649778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a26e92-8fd2-4aa5-99ab-764d10e52264 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:29.650061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a26e92-8fd2-4aa5-99ab-764d10e52264 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:29.650331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a26e92-8fd2-4aa5-99ab-764d10e52264 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:29.651011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a26e92-8fd2-4aa5-99ab-764d10e52264 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:29.652402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a26e92-8fd2-4aa5-99ab-764d10e52264 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:29.658140 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 451/903] 10.222.0.43 () {56 vars in 1087 bytes} [Sat Jul 2 20:45:29 2022] GET /identity/v3/services => generated 1268 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:45:29.659676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a26e92-8fd2-4aa5-99ab-764d10e52264 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:29.705465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:29.751104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:29.781354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a0da2-014e-42b3-bb70-02bd55da8917 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:29.794455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a26e92-8fd2-4aa5-99ab-764d10e52264 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:29.827152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432c8e9-82a9-466c-95b3-3a237ba3a313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:29.828002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432c8e9-82a9-466c-95b3-3a237ba3a313 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:29.828520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432c8e9-82a9-466c-95b3-3a237ba3a313 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:29.829004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432c8e9-82a9-466c-95b3-3a237ba3a313 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:29.830203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432c8e9-82a9-466c-95b3-3a237ba3a313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:29.830746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432c8e9-82a9-466c-95b3-3a237ba3a313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:29.832481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432c8e9-82a9-466c-95b3-3a237ba3a313 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:29.838803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cb449-0060-483c-bd2b-c22197710a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:29.839610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cb449-0060-483c-bd2b-c22197710a08 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:29.839864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cb449-0060-483c-bd2b-c22197710a08 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:29.840175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cb449-0060-483c-bd2b-c22197710a08 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:29.840901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cb449-0060-483c-bd2b-c22197710a08 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:29.841205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cb449-0060-483c-bd2b-c22197710a08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:29.842603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cb449-0060-483c-bd2b-c22197710a08 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:29.845673 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 453/904] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:29.853244 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 452/905] 10.222.0.43 () {56 vars in 1126 bytes} [Sat Jul 2 20:45:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:29.853446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432c8e9-82a9-466c-95b3-3a237ba3a313 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:29.853544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cb449-0060-483c-bd2b-c22197710a08 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:29.955874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:29.960572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432c8e9-82a9-466c-95b3-3a237ba3a313 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:29.964025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cb449-0060-483c-bd2b-c22197710a08 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:29.996096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1c3bf-0911-43d0-a87b-c77b1f0853df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:29.996773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1c3bf-0911-43d0-a87b-c77b1f0853df None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:29.997056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1c3bf-0911-43d0-a87b-c77b1f0853df None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:29.997334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1c3bf-0911-43d0-a87b-c77b1f0853df None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:29.998067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1c3bf-0911-43d0-a87b-c77b1f0853df None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:29.999439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1c3bf-0911-43d0-a87b-c77b1f0853df None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:30.000639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdf5d3-f5aa-4894-b791-afd910921e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:30.001579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:30.002065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdf5d3-f5aa-4894-b791-afd910921e0f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:30.002815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdf5d3-f5aa-4894-b791-afd910921e0f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:30.003237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdf5d3-f5aa-4894-b791-afd910921e0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:30.012811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdf5d3-f5aa-4894-b791-afd910921e0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:30.014524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdf5d3-f5aa-4894-b791-afd910921e0f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:30.015286 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 454/906] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Jul 2 20:45:29 2022] POST /identity/v3/services => generated 241 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:45:30.016156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1c3bf-0911-43d0-a87b-c77b1f0853df None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:30.041705 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-98bdf5d3-f5aa-4894-b791-afd910921e0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:30.041705 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:30.041705 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:30.041705 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:30.041705 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:30.041705 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:30.041705 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:30.041705 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:30.041705 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:30.041705 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:30.041705 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:30.041705 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:30.041705 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:30.041705 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:30.041705 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:30.042704 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:30.042704 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:30.042704 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:30.042704 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:30.042704 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:30.042704 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:30.042704 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:30.042704 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:30.042704 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:30.042704 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:30.042704 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:30.042704 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:30.042704 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:30.042704 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:30.042704 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:30.042704 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:30.042704 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:30.044376 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:30.044376 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:30.044376 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:30.044376 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:30.044376 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:30.044376 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:30.044376 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:30.044376 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:30.044376 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 453/907] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:30.049739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdf5d3-f5aa-4894-b791-afd910921e0f None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:30.173931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1c3bf-0911-43d0-a87b-c77b1f0853df None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:30.191527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdf5d3-f5aa-4894-b791-afd910921e0f None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:30.225035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ea98e-21b1-421b-8be1-0f7dd9e88555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:30.226021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ea98e-21b1-421b-8be1-0f7dd9e88555 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:30.226405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ea98e-21b1-421b-8be1-0f7dd9e88555 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:30.226690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ea98e-21b1-421b-8be1-0f7dd9e88555 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:30.227422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ea98e-21b1-421b-8be1-0f7dd9e88555 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:30.227805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ea98e-21b1-421b-8be1-0f7dd9e88555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:30.230097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ea98e-21b1-421b-8be1-0f7dd9e88555 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:30.237978 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 455/908] 10.222.0.43 () {56 vars in 1126 bytes} [Sat Jul 2 20:45:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:30.239333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c29664-bb35-41d2-9131-84833ae047e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:30.240285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c29664-bb35-41d2-9131-84833ae047e0 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:30.240770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c29664-bb35-41d2-9131-84833ae047e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:30.241279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c29664-bb35-41d2-9131-84833ae047e0 None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:30.242287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c29664-bb35-41d2-9131-84833ae047e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:30.242855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c29664-bb35-41d2-9131-84833ae047e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:30.244166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ea98e-21b1-421b-8be1-0f7dd9e88555 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:30.244935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c29664-bb35-41d2-9131-84833ae047e0 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:30.259850 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 454/909] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:30.265798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c29664-bb35-41d2-9131-84833ae047e0 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:30.287299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:30.317765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:30.373804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ea98e-21b1-421b-8be1-0f7dd9e88555 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:30.403281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c29664-bb35-41d2-9131-84833ae047e0 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:30.419254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04e142-02f5-4909-b6ac-1abe9fb81fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:30.419927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04e142-02f5-4909-b6ac-1abe9fb81fb4 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:30.420487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04e142-02f5-4909-b6ac-1abe9fb81fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:30.420769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04e142-02f5-4909-b6ac-1abe9fb81fb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:30.422268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04e142-02f5-4909-b6ac-1abe9fb81fb4 None admin] RBAC: Adding query filter params (interface=public, service_id=9d7d4368f9654f6682768f690df07681, region_id=RegionOne) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:30.422587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04e142-02f5-4909-b6ac-1abe9fb81fb4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:30.423984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04e142-02f5-4909-b6ac-1abe9fb81fb4 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:30.431509 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 456/910] 10.222.0.43 () {56 vars in 1251 bytes} [Sat Jul 2 20:45:30 2022] GET /identity/v3/endpoints?service_id=9d7d4368f9654f6682768f690df07681&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:30.437747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04e142-02f5-4909-b6ac-1abe9fb81fb4 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:30.444957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bf39b-0cc9-499a-8475-409bfce1de05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:30.445622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bf39b-0cc9-499a-8475-409bfce1de05 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:30.445899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bf39b-0cc9-499a-8475-409bfce1de05 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:30.446168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bf39b-0cc9-499a-8475-409bfce1de05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:30.447040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bf39b-0cc9-499a-8475-409bfce1de05 None admin] RBAC: Adding query filter params (role.id=1ef9541aff044694894c631ef9e92fcb, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=4d4bfe417b4c4896ae5f3fc23e03ef71) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:30.447512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bf39b-0cc9-499a-8475-409bfce1de05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:30.449102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bf39b-0cc9-499a-8475-409bfce1de05 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:30.455515 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 455/911] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:45:30 2022] GET /identity/v3/role_assignments?user.id=4d4bfe417b4c4896ae5f3fc23e03ef71&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=1ef9541aff044694894c631ef9e92fcb => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:30.553883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04e142-02f5-4909-b6ac-1abe9fb81fb4 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:30.573786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:30.593225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8635a95-9586-4ab8-8b3c-f3de53dc2b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:30.593909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8635a95-9586-4ab8-8b3c-f3de53dc2b1b None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:30.594189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8635a95-9586-4ab8-8b3c-f3de53dc2b1b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:30.594467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8635a95-9586-4ab8-8b3c-f3de53dc2b1b None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:30.595153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8635a95-9586-4ab8-8b3c-f3de53dc2b1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:30.596673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8635a95-9586-4ab8-8b3c-f3de53dc2b1b None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:30.608206 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 457/912] 10.222.0.43 () {56 vars in 1087 bytes} [Sat Jul 2 20:45:30 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 20:45:31.996434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0339f-ff63-4b0d-ba74-9b19f2a43911 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:31.997011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0339f-ff63-4b0d-ba74-9b19f2a43911 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:31.997011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0339f-ff63-4b0d-ba74-9b19f2a43911 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:31.998497 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 456/913] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:32.003824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f06cc-d2bb-48a3-a513-12e86f53a9e4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:32.004645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f06cc-d2bb-48a3-a513-12e86f53a9e4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:32.005194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f06cc-d2bb-48a3-a513-12e86f53a9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:32.023125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-443f06cc-d2bb-48a3-a513-12e86f53a9e4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:32.024757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-443f06cc-d2bb-48a3-a513-12e86f53a9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:32.096697 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 458/914] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:32.120824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0339f-ff63-4b0d-ba74-9b19f2a43911 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:32.206804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:32.235637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0339f-ff63-4b0d-ba74-9b19f2a43911 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:32.275074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b419db4-b5bf-4236-a784-b1568ac07da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:32.275795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b419db4-b5bf-4236-a784-b1568ac07da5 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:32.276095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b419db4-b5bf-4236-a784-b1568ac07da5 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:32.276373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b419db4-b5bf-4236-a784-b1568ac07da5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:32.277020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b419db4-b5bf-4236-a784-b1568ac07da5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:32.278387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b419db4-b5bf-4236-a784-b1568ac07da5 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:32.291016 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-2b419db4-b5bf-4236-a784-b1568ac07da5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 20:45:32.291016 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:32.291016 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:32.291016 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:32.291016 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:32.291016 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:32.291016 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:32.291016 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:32.291016 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 20:45:32.291016 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:32.291016 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:32.291016 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:32.291016 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:32.291016 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:32.291016 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:32.291016 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:32.291016 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:32.292073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:32.292073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:32.292073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:32.292073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:32.292073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:32.292073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:32.292073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:32.292073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:32.292073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:32.292073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:32.292073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:32.292073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:32.292073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:32.292073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:32.292073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:32.292073 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:32.292956 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:32.292956 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:32.292956 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:32.292956 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:32.292956 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:32.292956 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:32.292956 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:32.292956 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:32.292956 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:32.292956 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:32.292956 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:32.292956 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:32.292956 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 20:45:32.292956 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:32.292956 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 457/915] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:45:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:32.299018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f06cc-d2bb-48a3-a513-12e86f53a9e4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:32.403354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f06cc-d2bb-48a3-a513-12e86f53a9e4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:32.417511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:32.439672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ead938-ca07-4cbd-96cf-0dcee627cca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:32.440667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ead938-ca07-4cbd-96cf-0dcee627cca9 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:32.441124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ead938-ca07-4cbd-96cf-0dcee627cca9 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:32.441599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ead938-ca07-4cbd-96cf-0dcee627cca9 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:32.442522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ead938-ca07-4cbd-96cf-0dcee627cca9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:32.443043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ead938-ca07-4cbd-96cf-0dcee627cca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:32.444640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ead938-ca07-4cbd-96cf-0dcee627cca9 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:32.450164 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 459/916] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:45:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:32.456314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b419db4-b5bf-4236-a784-b1568ac07da5 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:32.490189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb59f32-f548-4a0c-b527-968c515da539 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:32.490466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb59f32-f548-4a0c-b527-968c515da539 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:32.491045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb59f32-f548-4a0c-b527-968c515da539 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:32.493055 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 460/917] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:45:32.499439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbf9ff-46d8-4fec-95c0-889c1d3ec8aa None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:32.499727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbf9ff-46d8-4fec-95c0-889c1d3ec8aa None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:32.500005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbf9ff-46d8-4fec-95c0-889c1d3ec8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:32.518588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b4cbf9ff-46d8-4fec-95c0-889c1d3ec8aa None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:32.520074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b4cbf9ff-46d8-4fec-95c0-889c1d3ec8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:32.574645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b419db4-b5bf-4236-a784-b1568ac07da5 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:32.604459 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 461/918] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:32.616689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be67441-86a1-4fdb-a63e-f66f560d4067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:32.617652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be67441-86a1-4fdb-a63e-f66f560d4067 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:32.618149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be67441-86a1-4fdb-a63e-f66f560d4067 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:32.618596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be67441-86a1-4fdb-a63e-f66f560d4067 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:32.619475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be67441-86a1-4fdb-a63e-f66f560d4067 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:32.619929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be67441-86a1-4fdb-a63e-f66f560d4067 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:32.621605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be67441-86a1-4fdb-a63e-f66f560d4067 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:32.623069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbf9ff-46d8-4fec-95c0-889c1d3ec8aa None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:32.628845 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 458/919] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Jul 2 20:45:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:32.634936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be67441-86a1-4fdb-a63e-f66f560d4067 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:32.645304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:32.749252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbf9ff-46d8-4fec-95c0-889c1d3ec8aa None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:32.751902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be67441-86a1-4fdb-a63e-f66f560d4067 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:32.758717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:32.794318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0dad8-698a-444d-8d35-74e80344c145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:32.795210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8329e-3ed4-4479-8f92-4a81be738c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:32.795759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0dad8-698a-444d-8d35-74e80344c145 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:32.795870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8329e-3ed4-4479-8f92-4a81be738c81 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:32.796185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8329e-3ed4-4479-8f92-4a81be738c81 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:32.796462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8329e-3ed4-4479-8f92-4a81be738c81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:32.797110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0dad8-698a-444d-8d35-74e80344c145 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:32.800070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8329e-3ed4-4479-8f92-4a81be738c81 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:32.800070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8329e-3ed4-4479-8f92-4a81be738c81 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:32.801737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0dad8-698a-444d-8d35-74e80344c145 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:32.802768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0dad8-698a-444d-8d35-74e80344c145 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:32.804489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0dad8-698a-444d-8d35-74e80344c145 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:32.818892 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-95c0dad8-698a-444d-8d35-74e80344c145 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 20:45:32.818892 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:32.818892 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:32.818892 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:32.818892 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:32.818892 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:32.818892 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:32.818892 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:32.818892 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 20:45:32.818892 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:32.818892 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:32.818892 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:32.818892 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:32.818892 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:32.818892 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:32.818892 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:32.818892 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:32.819961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:32.819961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:32.819961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:32.819961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:32.819961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:32.819961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:32.819961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:32.819961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:32.819961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:32.819961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:32.819961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:32.819961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:32.819961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:32.819961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:32.819961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:32.819961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:32.820867 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:32.820867 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:32.820867 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:32.820867 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:32.820867 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:32.820867 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:32.820867 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:32.820867 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:32.820867 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:32.820867 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:32.820867 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:32.820867 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:32.820867 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 20:45:32.820867 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:32.828656 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 459/920] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Jul 2 20:45:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:45:32.829245 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 462/921] 10.222.0.43 () {56 vars in 1126 bytes} [Sat Jul 2 20:45:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:32.829608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8329e-3ed4-4479-8f92-4a81be738c81 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:32.849603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8fa36-9f5f-4b58-9dba-9811073a5750 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:32.849917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8fa36-9f5f-4b58-9dba-9811073a5750 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:32.850163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8fa36-9f5f-4b58-9dba-9811073a5750 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:32.858027 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 463/922] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:45:32.858250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7b7f2-f243-485d-91e1-ff4986742779 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:32.858487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7b7f2-f243-485d-91e1-ff4986742779 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:32.858669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7b7f2-f243-485d-91e1-ff4986742779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:32.877376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-65e7b7f2-f243-485d-91e1-ff4986742779 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:32.878488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-65e7b7f2-f243-485d-91e1-ff4986742779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:32.916540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:32.971368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8329e-3ed4-4479-8f92-4a81be738c81 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:32.978230 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 464/923] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:32.982011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13118fe4-ded3-45ca-975f-257becf6f076 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:32.982889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13118fe4-ded3-45ca-975f-257becf6f076 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:32.982889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13118fe4-ded3-45ca-975f-257becf6f076 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:32.984208 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 465/924] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:45:32.989761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe5a96-0e09-4149-81c6-bb3633d5803f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:32.990083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe5a96-0e09-4149-81c6-bb3633d5803f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:32.990309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe5a96-0e09-4149-81c6-bb3633d5803f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:33.008162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ddfe5a96-0e09-4149-81c6-bb3633d5803f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:33.009510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ddfe5a96-0e09-4149-81c6-bb3633d5803f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:33.016159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d68456-5ddf-47dd-962c-06f3b386e660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:33.016885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d68456-5ddf-47dd-962c-06f3b386e660 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:33.017169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d68456-5ddf-47dd-962c-06f3b386e660 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:33.017447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d68456-5ddf-47dd-962c-06f3b386e660 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:33.018239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d68456-5ddf-47dd-962c-06f3b386e660 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:33.018477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d68456-5ddf-47dd-962c-06f3b386e660 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:33.019855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d68456-5ddf-47dd-962c-06f3b386e660 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:33.025734 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 460/925] 10.222.0.43 () {56 vars in 1122 bytes} [Sat Jul 2 20:45:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:33.031053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d68456-5ddf-47dd-962c-06f3b386e660 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:33.096967 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 466/926] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:45:33.097810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe5a96-0e09-4149-81c6-bb3633d5803f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:33.127707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:33.150380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d68456-5ddf-47dd-962c-06f3b386e660 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:33.173980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:33.186102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965c523-9243-4161-a0d9-64628e0b8289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:33.186899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965c523-9243-4161-a0d9-64628e0b8289 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:33.187180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965c523-9243-4161-a0d9-64628e0b8289 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:33.187444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965c523-9243-4161-a0d9-64628e0b8289 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:33.198170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965c523-9243-4161-a0d9-64628e0b8289 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:33.203229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe5a96-0e09-4149-81c6-bb3633d5803f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:33.206381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-4965c523-9243-4161-a0d9-64628e0b8289 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 20:45:33.206381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:33.206381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:33.206381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:33.206381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:33.206381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:33.206381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:33.206381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:33.206381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:33.206381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:33.206381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:33.206381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:33.206381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:33.206381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:33.206381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:33.206381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:33.207377 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:33.207377 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:33.207377 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:33.207377 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:33.207377 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:33.207377 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:33.207377 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:33.207377 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:33.207377 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:33.207377 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:33.207377 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:33.207377 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:33.207377 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:33.207377 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:33.207377 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:33.207377 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:33.214018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:33.214018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:33.214018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:33.214018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:33.214018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:33.214018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:33.214018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:33.214018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:33.214018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:33.214018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:33.214018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 20:45:33.214018 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:33.214018 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 461/927] 10.222.0.43 () {56 vars in 1120 bytes} [Sat Jul 2 20:45:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:33.214018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965c523-9243-4161-a0d9-64628e0b8289 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:33.242611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cb4fd-307d-4c4b-a5b8-da6f91cfdbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:33.243705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cb4fd-307d-4c4b-a5b8-da6f91cfdbc9 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:33.244253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cb4fd-307d-4c4b-a5b8-da6f91cfdbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:33.244679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cb4fd-307d-4c4b-a5b8-da6f91cfdbc9 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:33.245532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cb4fd-307d-4c4b-a5b8-da6f91cfdbc9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:33.245986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cb4fd-307d-4c4b-a5b8-da6f91cfdbc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:33.247526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cb4fd-307d-4c4b-a5b8-da6f91cfdbc9 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:33.253204 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 467/928] 10.222.0.43 () {56 vars in 1122 bytes} [Sat Jul 2 20:45:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:33.254242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cb4fd-307d-4c4b-a5b8-da6f91cfdbc9 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:33.321199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965c523-9243-4161-a0d9-64628e0b8289 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:33.348485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:33.356976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbe825-900a-429d-8dec-4eb8423c62c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:33.357826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbe825-900a-429d-8dec-4eb8423c62c4 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:33.358109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbe825-900a-429d-8dec-4eb8423c62c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:33.358384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbe825-900a-429d-8dec-4eb8423c62c4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:33.359034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbe825-900a-429d-8dec-4eb8423c62c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:33.359141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cb4fd-307d-4c4b-a5b8-da6f91cfdbc9 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:33.360437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbe825-900a-429d-8dec-4eb8423c62c4 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:33.372976 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-82fbe825-900a-429d-8dec-4eb8423c62c4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 20:45:33.372976 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:33.372976 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:33.372976 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:33.372976 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:33.372976 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:33.372976 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:33.372976 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:33.372976 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 20:45:33.372976 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:33.372976 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:33.372976 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:33.372976 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:33.372976 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:33.372976 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:33.372976 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:33.374981 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:33.374981 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:33.374981 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:33.374981 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:33.374981 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:33.374981 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:33.374981 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:33.374981 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:33.374981 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:33.374981 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:33.374981 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:33.374981 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:33.374981 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:33.374981 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:33.374981 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:33.374981 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:33.375843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:33.375843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:33.375843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:33.375843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:33.375843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:33.375843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:33.375843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:33.375843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:33.375843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:33.375843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:33.375843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:33.375843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:33.375843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:33.375843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 20:45:33.375843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:33.375843 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 462/929] 10.222.0.43 () {56 vars in 1132 bytes} [Sat Jul 2 20:45:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:33.376776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbe825-900a-429d-8dec-4eb8423c62c4 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:33.400464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df31634-72bc-4ede-9a3e-04195b2e6012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:33.401139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df31634-72bc-4ede-9a3e-04195b2e6012 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:33.401422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df31634-72bc-4ede-9a3e-04195b2e6012 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:33.401701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df31634-72bc-4ede-9a3e-04195b2e6012 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:33.402465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df31634-72bc-4ede-9a3e-04195b2e6012 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:33.402769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df31634-72bc-4ede-9a3e-04195b2e6012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:33.404167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df31634-72bc-4ede-9a3e-04195b2e6012 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:33.412776 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 468/930] 10.222.0.43 () {56 vars in 1115 bytes} [Sat Jul 2 20:45:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:33.413570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df31634-72bc-4ede-9a3e-04195b2e6012 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:33.431124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:33.489489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbe825-900a-429d-8dec-4eb8423c62c4 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:33.515610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df31634-72bc-4ede-9a3e-04195b2e6012 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:33.526768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27161b1-b1d2-440b-90df-b16bed2bae84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:33.527572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27161b1-b1d2-440b-90df-b16bed2bae84 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:33.527863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27161b1-b1d2-440b-90df-b16bed2bae84 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:33.528164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27161b1-b1d2-440b-90df-b16bed2bae84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:33.528951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27161b1-b1d2-440b-90df-b16bed2bae84 None admin] RBAC: Adding query filter params (interface=public, service_id=7c9929bedc1045d282354cc61b709434, region_id=RegionOne) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:33.529259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27161b1-b1d2-440b-90df-b16bed2bae84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:33.530630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27161b1-b1d2-440b-90df-b16bed2bae84 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:33.536433 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 463/931] 10.222.0.43 () {56 vars in 1251 bytes} [Sat Jul 2 20:45:33 2022] GET /identity/v3/endpoints?service_id=7c9929bedc1045d282354cc61b709434&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:33.537777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27161b1-b1d2-440b-90df-b16bed2bae84 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:33.553920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c5fd9-3eec-49ba-b7fd-7fb95eb47457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:33.554850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c5fd9-3eec-49ba-b7fd-7fb95eb47457 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:33.555464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c5fd9-3eec-49ba-b7fd-7fb95eb47457 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:33.555910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c5fd9-3eec-49ba-b7fd-7fb95eb47457 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:33.557018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c5fd9-3eec-49ba-b7fd-7fb95eb47457 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:33.557539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c5fd9-3eec-49ba-b7fd-7fb95eb47457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:33.559817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c5fd9-3eec-49ba-b7fd-7fb95eb47457 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:33.566023 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 469/932] 10.222.0.43 () {56 vars in 1126 bytes} [Sat Jul 2 20:45:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:33.566175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c5fd9-3eec-49ba-b7fd-7fb95eb47457 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:33.589430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:33.658833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27161b1-b1d2-440b-90df-b16bed2bae84 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:33.670053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:33.680073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c5fd9-3eec-49ba-b7fd-7fb95eb47457 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:33.696677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281d0f2-ca1c-4fa8-8ee1-ff33572c643e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:33.697476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281d0f2-ca1c-4fa8-8ee1-ff33572c643e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:33.697755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281d0f2-ca1c-4fa8-8ee1-ff33572c643e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:33.698030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281d0f2-ca1c-4fa8-8ee1-ff33572c643e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:33.708779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281d0f2-ca1c-4fa8-8ee1-ff33572c643e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:33.710215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281d0f2-ca1c-4fa8-8ee1-ff33572c643e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:33.717783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12630ba3-8213-4742-ad9a-32658a5573f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:33.719011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12630ba3-8213-4742-ad9a-32658a5573f6 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:33.719501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12630ba3-8213-4742-ad9a-32658a5573f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:33.719992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12630ba3-8213-4742-ad9a-32658a5573f6 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:33.721341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12630ba3-8213-4742-ad9a-32658a5573f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:33.723251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12630ba3-8213-4742-ad9a-32658a5573f6 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:33.731735 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-3281d0f2-ca1c-4fa8-8ee1-ff33572c643e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:33.731735 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:33.731735 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:33.731735 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:33.731735 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:33.731735 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:33.731735 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:33.731735 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:33.731735 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:33.731735 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:33.731735 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:33.731735 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:33.731735 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:33.731735 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:33.731735 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:33.732685 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:33.732685 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:33.732685 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:33.732685 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:33.732685 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:33.732685 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:33.732685 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:33.732685 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:33.732685 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:33.732685 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:33.732685 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:33.732685 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:33.732685 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:33.732685 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:33.732685 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:33.732685 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:33.732685 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:33.739147 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:33.739147 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:33.739147 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:33.739147 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:33.739147 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 464/933] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:33.739147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281d0f2-ca1c-4fa8-8ee1-ff33572c643e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:33.740229 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 470/934] 10.222.0.43 () {56 vars in 1087 bytes} [Sat Jul 2 20:45:33 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:45:33.741488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12630ba3-8213-4742-ad9a-32658a5573f6 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:33.859107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:33.879113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281d0f2-ca1c-4fa8-8ee1-ff33572c643e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:33.890988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12630ba3-8213-4742-ad9a-32658a5573f6 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:33.932678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d7611-57c8-4823-b5d4-4fc854dbfc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:33.933865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d7611-57c8-4823-b5d4-4fc854dbfc1b None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:33.934439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d7611-57c8-4823-b5d4-4fc854dbfc1b None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:33.934794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d7611-57c8-4823-b5d4-4fc854dbfc1b None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:33.935674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522f051-d073-41f4-9872-7d1ca13f96ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:33.935906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d7611-57c8-4823-b5d4-4fc854dbfc1b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:33.936298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d7611-57c8-4823-b5d4-4fc854dbfc1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:33.936401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522f051-d073-41f4-9872-7d1ca13f96ba None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:33.936661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522f051-d073-41f4-9872-7d1ca13f96ba None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:33.936938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522f051-d073-41f4-9872-7d1ca13f96ba None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:33.937657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522f051-d073-41f4-9872-7d1ca13f96ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:33.937850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d7611-57c8-4823-b5d4-4fc854dbfc1b None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:33.937970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522f051-d073-41f4-9872-7d1ca13f96ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:33.939636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522f051-d073-41f4-9872-7d1ca13f96ba None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:33.945255 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 465/935] 10.222.0.43 () {56 vars in 1126 bytes} [Sat Jul 2 20:45:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:33.951544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d7611-57c8-4823-b5d4-4fc854dbfc1b None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:33.958362 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 471/936] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:33.966609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522f051-d073-41f4-9872-7d1ca13f96ba None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:34.020455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:34.060849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d7611-57c8-4823-b5d4-4fc854dbfc1b None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:34.088926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522f051-d073-41f4-9872-7d1ca13f96ba None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:34.108560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87195ed6-50d7-49f2-8581-ed863549b02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:34.109607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87195ed6-50d7-49f2-8581-ed863549b02f None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:34.110103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87195ed6-50d7-49f2-8581-ed863549b02f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:34.110582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87195ed6-50d7-49f2-8581-ed863549b02f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:34.111535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87195ed6-50d7-49f2-8581-ed863549b02f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:34.113195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87195ed6-50d7-49f2-8581-ed863549b02f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:34.129882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8efb8-1508-45e2-8d9b-366daddce57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:34.130913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8efb8-1508-45e2-8d9b-366daddce57f None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:34.131205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8efb8-1508-45e2-8d9b-366daddce57f None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:34.132418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8efb8-1508-45e2-8d9b-366daddce57f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:34.140236 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 466/937] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Jul 2 20:45:33 2022] POST /identity/v3/endpoints => generated 347 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:45:34.143403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8efb8-1508-45e2-8d9b-366daddce57f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:34.148212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8efb8-1508-45e2-8d9b-366daddce57f None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:34.168341 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-67b8efb8-1508-45e2-8d9b-366daddce57f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 20:45:34.168341 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:34.168341 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:34.168341 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:34.168341 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:34.168341 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:34.168341 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:34.168341 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:34.168341 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:34.168341 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:34.168341 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:34.168341 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:34.168341 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:34.168341 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:34.168341 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:34.168341 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:34.170233 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:34.170233 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:34.170233 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:34.170233 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:34.170233 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:34.170233 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:34.170233 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:34.170233 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:34.170233 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:34.170233 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:34.170233 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:34.170233 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:34.170233 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:34.170233 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:34.170233 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:34.170233 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:34.170233 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:34.170233 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:34.172005 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:34.172005 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:34.172005 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:34.172005 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:34.172005 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:34.172005 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:34.172005 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:34.172005 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:34.172005 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 20:45:34.172005 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:34.176367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:34.177603 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 472/938] 10.222.0.43 () {56 vars in 1117 bytes} [Sat Jul 2 20:45:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:34.184202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87195ed6-50d7-49f2-8581-ed863549b02f None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:34.281268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:34.313393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87195ed6-50d7-49f2-8581-ed863549b02f None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:34.351077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65833e82-a8c2-4f36-8d4b-9047cd0f8eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:34.351753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65833e82-a8c2-4f36-8d4b-9047cd0f8eac None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:34.352060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65833e82-a8c2-4f36-8d4b-9047cd0f8eac None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:34.352374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65833e82-a8c2-4f36-8d4b-9047cd0f8eac None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:34.353214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65833e82-a8c2-4f36-8d4b-9047cd0f8eac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:34.353519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65833e82-a8c2-4f36-8d4b-9047cd0f8eac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:34.354965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65833e82-a8c2-4f36-8d4b-9047cd0f8eac None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:34.373390 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 467/939] 10.222.0.43 () {56 vars in 1149 bytes} [Sat Jul 2 20:45:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:34.379421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8efb8-1508-45e2-8d9b-366daddce57f None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:34.498052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8efb8-1508-45e2-8d9b-366daddce57f None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:34.534538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9306f0-2d67-463f-b09c-2d5a3ed5fb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:34.535417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9306f0-2d67-463f-b09c-2d5a3ed5fb14 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:34.535732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9306f0-2d67-463f-b09c-2d5a3ed5fb14 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:34.536055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9306f0-2d67-463f-b09c-2d5a3ed5fb14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:34.547503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9306f0-2d67-463f-b09c-2d5a3ed5fb14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:34.549019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9306f0-2d67-463f-b09c-2d5a3ed5fb14 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:34.567388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-cc9306f0-2d67-463f-b09c-2d5a3ed5fb14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:34.567388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:34.567388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:34.567388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:34.567388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:34.567388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:34.567388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:34.567388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:34.567388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:34.567388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:34.567388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:34.567388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:34.567388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:34.567388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:34.567388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:34.568393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:34.568393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:34.568393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:34.568393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:34.568393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:34.568393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:34.568393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:34.568393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:34.568393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:34.568393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:34.568393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:34.568393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:34.568393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:34.568393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:34.568393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:34.568393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:34.568393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:34.569330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:34.569330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:34.569330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:34.569330 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:34.569330 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 473/940] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:34.574698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65833e82-a8c2-4f36-8d4b-9047cd0f8eac None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:34.682173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65833e82-a8c2-4f36-8d4b-9047cd0f8eac None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:34.724882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296ff52-34e8-4e1f-9c79-67870c64e296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:34.725552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296ff52-34e8-4e1f-9c79-67870c64e296 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:34.725837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296ff52-34e8-4e1f-9c79-67870c64e296 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:34.726115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296ff52-34e8-4e1f-9c79-67870c64e296 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:34.726843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296ff52-34e8-4e1f-9c79-67870c64e296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:34.727198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296ff52-34e8-4e1f-9c79-67870c64e296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:34.728620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296ff52-34e8-4e1f-9c79-67870c64e296 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:34.731146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:34.741001 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 468/941] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:34.746617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9306f0-2d67-463f-b09c-2d5a3ed5fb14 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:34.806213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:34.862403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9306f0-2d67-463f-b09c-2d5a3ed5fb14 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:34.900836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67170485-5a49-40bb-b2ba-15052f60f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:34.902240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67170485-5a49-40bb-b2ba-15052f60f157 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:34.902740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67170485-5a49-40bb-b2ba-15052f60f157 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:34.903226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67170485-5a49-40bb-b2ba-15052f60f157 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:34.910645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67170485-5a49-40bb-b2ba-15052f60f157 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:34.912368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67170485-5a49-40bb-b2ba-15052f60f157 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:34.926840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-67170485-5a49-40bb-b2ba-15052f60f157 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:34.926840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:34.926840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:34.926840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:34.926840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:34.926840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:34.926840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:34.926840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:34.926840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:34.926840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:34.926840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:34.926840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:34.926840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:34.926840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:34.926840 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:34.927769 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:34.927769 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:34.927769 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:34.927769 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:34.927769 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:34.927769 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:34.927769 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:34.927769 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:34.927769 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:34.927769 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:34.927769 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:34.927769 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:34.927769 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:34.927769 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:34.927769 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:34.927769 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:34.927769 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:34.928776 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:34.928776 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:34.928776 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:34.928776 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:34.928776 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:34.928776 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:34.928776 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:34.928776 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:34.931011 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 474/942] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:34.936631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296ff52-34e8-4e1f-9c79-67870c64e296 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:35.041627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296ff52-34e8-4e1f-9c79-67870c64e296 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:35.080676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96498dec-ac65-467d-8751-410764276106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:35.081253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96498dec-ac65-467d-8751-410764276106 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:35.081606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96498dec-ac65-467d-8751-410764276106 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:35.081882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96498dec-ac65-467d-8751-410764276106 None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:35.082668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96498dec-ac65-467d-8751-410764276106 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:35.082977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96498dec-ac65-467d-8751-410764276106 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:35.084440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96498dec-ac65-467d-8751-410764276106 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:35.098539 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 469/943] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:35.104388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67170485-5a49-40bb-b2ba-15052f60f157 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:35.212247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67170485-5a49-40bb-b2ba-15052f60f157 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:35.225030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:35.247547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ac2c1-e8e3-4f51-bd54-2a22fcd55f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:35.248491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ac2c1-e8e3-4f51-bd54-2a22fcd55f0c None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:35.248771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ac2c1-e8e3-4f51-bd54-2a22fcd55f0c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:35.249044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ac2c1-e8e3-4f51-bd54-2a22fcd55f0c None admin] PATH_INFO: `/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/4d4bfe417b4c4896ae5f3fc23e03ef71/roles/1ef9541aff044694894c631ef9e92fcb` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:35.251291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ac2c1-e8e3-4f51-bd54-2a22fcd55f0c None admin] RBAC: Authorizing `identity:create_grant(project_id=001bf63308784f4eb62e64d6f82c8354, user_id=4d4bfe417b4c4896ae5f3fc23e03ef71, role_id=1ef9541aff044694894c631ef9e92fcb)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:35.252779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ac2c1-e8e3-4f51-bd54-2a22fcd55f0c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:35.268426 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 475/944] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:45:35 2022] PUT /identity/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/4d4bfe417b4c4896ae5f3fc23e03ef71/roles/1ef9541aff044694894c631ef9e92fcb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:45:35.392884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405eb778-bbef-4248-9ec5-fcf4d88d42ba None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:35.393065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405eb778-bbef-4248-9ec5-fcf4d88d42ba None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:35.393348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405eb778-bbef-4248-9ec5-fcf4d88d42ba None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:35.395072 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 470/945] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:35.400923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57e35c-0b03-4ed4-9209-86b0693d88af None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:35.401222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57e35c-0b03-4ed4-9209-86b0693d88af None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:35.401477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57e35c-0b03-4ed4-9209-86b0693d88af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:35.423519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fa57e35c-0b03-4ed4-9209-86b0693d88af None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:35.424837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fa57e35c-0b03-4ed4-9209-86b0693d88af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:35.495856 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 476/946] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:35.520990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405eb778-bbef-4248-9ec5-fcf4d88d42ba None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:35.581394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:35.628559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405eb778-bbef-4248-9ec5-fcf4d88d42ba None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:35.664876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8a200-3a24-4a86-ab3d-d49b01ac17ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:35.665546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8a200-3a24-4a86-ab3d-d49b01ac17ab None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:35.665824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8a200-3a24-4a86-ab3d-d49b01ac17ab None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:35.666101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8a200-3a24-4a86-ab3d-d49b01ac17ab None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:35.666946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8a200-3a24-4a86-ab3d-d49b01ac17ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:35.668479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8a200-3a24-4a86-ab3d-d49b01ac17ab None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:35.678974 ncdv-master-1 devstack@keystone.service[91077]: WARNING keystone.server.flask.common [None req-a8e8a200-3a24-4a86-ab3d-d49b01ac17ab None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 02 20:45:35.708462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.sql.core [None req-a8e8a200-3a24-4a86-ab3d-d49b01ac17ab None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 02 20:45:35.708462 ncdv-master-1 devstack@keystone.service[91077]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 02 20:45:35.708462 ncdv-master-1 devstack@keystone.service[91077]: [parameters: {'id': 'b3b7e8c788a54025a068ce9ddc6edaf9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 02 20:45:35.708462 ncdv-master-1 devstack@keystone.service[91077]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91077) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 02 20:45:35.738181 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-a8e8a200-3a24-4a86-ab3d-d49b01ac17ab None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b3b7e8c788a54025a068ce9ddc6edaf9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b3b7e8c788a54025a068ce9ddc6edaf9. Jul 02 20:45:35.738181 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:35.738181 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 20:45:35.738181 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 20:45:35.738181 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 20:45:35.738181 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 20:45:35.738181 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 20:45:35.738181 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 20:45:35.738181 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 20:45:35.738181 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application conn.query(q) Jul 02 20:45:35.738181 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 20:45:35.738181 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 20:45:35.738181 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 20:45:35.739129 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application result.read() Jul 02 20:45:35.739129 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 20:45:35.739129 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 20:45:35.739129 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 20:45:35.739129 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 20:45:35.739129 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 20:45:35.739129 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 20:45:35.739129 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 20:45:35.739129 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 20:45:35.739129 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 02 20:45:35.739129 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:35.739129 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 02 20:45:35.739129 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:35.739129 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:35.739129 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 02 20:45:35.739129 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 02 20:45:35.739129 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 02 20:45:35.739129 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 02 20:45:35.740154 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 20:45:35.740154 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application next(self.gen) Jul 02 20:45:35.740154 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 02 20:45:35.740154 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application yield resource Jul 02 20:45:35.740154 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 20:45:35.740154 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application next(self.gen) Jul 02 20:45:35.740154 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 02 20:45:35.740154 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.session.rollback() Jul 02 20:45:35.740154 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 20:45:35.740154 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.force_reraise() Jul 02 20:45:35.740154 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 20:45:35.740154 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise self.value Jul 02 20:45:35.740154 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 02 20:45:35.740154 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 02 20:45:35.740154 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 02 20:45:35.740154 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application session.commit() Jul 02 20:45:35.740154 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 02 20:45:35.741108 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 02 20:45:35.741108 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 02 20:45:35.741108 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._prepare_impl() Jul 02 20:45:35.741108 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 02 20:45:35.741108 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.session.flush() Jul 02 20:45:35.741108 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 02 20:45:35.741108 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._flush(objects) Jul 02 20:45:35.741108 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 02 20:45:35.741108 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 02 20:45:35.741108 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 02 20:45:35.741108 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application compat.raise_( Jul 02 20:45:35.741108 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 20:45:35.741108 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception Jul 02 20:45:35.741108 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 02 20:45:35.741108 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application flush_context.execute() Jul 02 20:45:35.741108 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 02 20:45:35.741108 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rec.execute(self) Jul 02 20:45:35.742034 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 02 20:45:35.742034 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 02 20:45:35.742034 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 02 20:45:35.742034 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 02 20:45:35.742034 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 02 20:45:35.742034 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 02 20:45:35.742034 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 02 20:45:35.742034 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 02 20:45:35.742034 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 02 20:45:35.742034 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 02 20:45:35.742034 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 02 20:45:35.742034 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 02 20:45:35.742034 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 02 20:45:35.742034 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 02 20:45:35.742034 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 02 20:45:35.743647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 02 20:45:35.743647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 20:45:35.743647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception Jul 02 20:45:35.743647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 20:45:35.743647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 20:45:35.743647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 20:45:35.743647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 20:45:35.743647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 20:45:35.743647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 20:45:35.743647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 20:45:35.743647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application conn.query(q) Jul 02 20:45:35.743647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 20:45:35.743647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 20:45:35.743647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 20:45:35.743647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application result.read() Jul 02 20:45:35.743647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 20:45:35.743647 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 20:45:35.745345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 20:45:35.745345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 20:45:35.745345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 20:45:35.745345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 20:45:35.745345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 20:45:35.745345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 20:45:35.745345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 02 20:45:35.745345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 02 20:45:35.745345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [parameters: {'id': 'b3b7e8c788a54025a068ce9ddc6edaf9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 02 20:45:35.745345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 02 20:45:35.745345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:35.745345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:35.745345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:35.745345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:35.745345 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 02 20:45:35.746826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 02 20:45:35.746826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 02 20:45:35.746826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 02 20:45:35.746826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 02 20:45:35.746826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:35.746826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:35.746826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:35.746826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:35.746826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:35.746826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:35.746826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:35.746826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:35.746826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:35.746826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:35.746826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:35.746826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:35.746826 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:35.748631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:35.748631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 02 20:45:35.748631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 02 20:45:35.748631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:35.748631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:35.748631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 02 20:45:35.748631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 02 20:45:35.748631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b3b7e8c788a54025a068ce9ddc6edaf9. Jul 02 20:45:35.748631 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:35.752240 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 471/947] 10.222.0.43 () {60 vars in 1140 bytes} [Sat Jul 2 20:45:35 2022] POST /identity/v3/projects => generated 262 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:35.760118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57e35c-0b03-4ed4-9209-86b0693d88af None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:35.902018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57e35c-0b03-4ed4-9209-86b0693d88af None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:35.910749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:35.940342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badaf01-8a0a-4db1-9b9a-5edbb96aac22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:35.941064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badaf01-8a0a-4db1-9b9a-5edbb96aac22 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:35.941346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badaf01-8a0a-4db1-9b9a-5edbb96aac22 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:35.941621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badaf01-8a0a-4db1-9b9a-5edbb96aac22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:35.948768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badaf01-8a0a-4db1-9b9a-5edbb96aac22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:35.950240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7badaf01-8a0a-4db1-9b9a-5edbb96aac22 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:35.963951 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-7badaf01-8a0a-4db1-9b9a-5edbb96aac22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:35.963951 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:35.963951 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:35.963951 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:35.963951 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:35.963951 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:35.963951 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:35.963951 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:35.963951 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:35.963951 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:35.963951 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:35.963951 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:35.963951 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:35.963951 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:35.963951 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:35.964895 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:35.964895 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:35.964895 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:35.964895 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:35.964895 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:35.964895 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:35.964895 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:35.964895 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:35.964895 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:35.964895 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:35.964895 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:35.964895 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:35.964895 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:35.964895 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:35.964895 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:35.964895 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:35.964895 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:35.965810 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:35.965810 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:35.965810 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:35.965810 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:35.965810 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:35.965810 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:35.965810 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:35.965810 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:35.965810 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 477/948] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:35.971408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8a200-3a24-4a86-ab3d-d49b01ac17ab None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:36.077404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8a200-3a24-4a86-ab3d-d49b01ac17ab None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:36.092515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:36.118683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e6371-1942-4c55-8f63-aa8256ea21ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:36.119355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e6371-1942-4c55-8f63-aa8256ea21ee None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:36.119733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e6371-1942-4c55-8f63-aa8256ea21ee None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:36.120018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e6371-1942-4c55-8f63-aa8256ea21ee None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:36.120813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e6371-1942-4c55-8f63-aa8256ea21ee None admin] RBAC: Adding query filter params (name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:36.121122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e6371-1942-4c55-8f63-aa8256ea21ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:36.123035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e6371-1942-4c55-8f63-aa8256ea21ee None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:36.145753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3eca4-e552-440c-b828-14c882723285 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:36.146314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3eca4-e552-440c-b828-14c882723285 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:36.146314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3eca4-e552-440c-b828-14c882723285 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:36.148836 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 472/950] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Jul 2 20:45:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:36.152396 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 478/950] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:45:36.162045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af5a6f-ec9c-405c-88fe-c08a5a8364f4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:36.162426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af5a6f-ec9c-405c-88fe-c08a5a8364f4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:36.162772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af5a6f-ec9c-405c-88fe-c08a5a8364f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:36.181953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b0af5a6f-ec9c-405c-88fe-c08a5a8364f4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:36.183628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b0af5a6f-ec9c-405c-88fe-c08a5a8364f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:36.261414 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 473/951] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:36.286054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3eca4-e552-440c-b828-14c882723285 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:36.396766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3eca4-e552-440c-b828-14c882723285 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:36.431864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81a7a0-9a10-45f8-ac5e-3a6a95c71145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:36.432720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81a7a0-9a10-45f8-ac5e-3a6a95c71145 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:36.433001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81a7a0-9a10-45f8-ac5e-3a6a95c71145 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:36.433282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81a7a0-9a10-45f8-ac5e-3a6a95c71145 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:36.433929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81a7a0-9a10-45f8-ac5e-3a6a95c71145 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:36.435312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81a7a0-9a10-45f8-ac5e-3a6a95c71145 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:36.448058 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-8d81a7a0-9a10-45f8-ac5e-3a6a95c71145 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 20:45:36.448058 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:36.448058 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:36.448058 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:36.448058 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:36.448058 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:36.448058 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:36.448058 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:36.448058 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 20:45:36.448058 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:36.448058 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:36.448058 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:36.448058 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:36.448058 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:36.448058 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:36.448058 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:36.448058 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:36.449232 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:36.449232 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:36.449232 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:36.449232 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:36.449232 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:36.449232 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:36.449232 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:36.449232 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:36.449232 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:36.449232 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:36.449232 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:36.449232 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:36.449232 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:36.449232 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:36.449232 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:36.449232 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:36.450993 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:36.450993 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:36.450993 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:36.450993 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:36.450993 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:36.450993 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:36.450993 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:36.450993 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:36.450993 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:36.450993 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:36.450993 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:36.450993 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:36.450993 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 20:45:36.450993 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:36.454910 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 479/952] 10.222.0.43 () {56 vars in 1126 bytes} [Sat Jul 2 20:45:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:36.455968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af5a6f-ec9c-405c-88fe-c08a5a8364f4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:36.571720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af5a6f-ec9c-405c-88fe-c08a5a8364f4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:36.573820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:36.609170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302606a-a65a-4998-8d43-9eebd1ae10b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:36.609844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302606a-a65a-4998-8d43-9eebd1ae10b8 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:36.610128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302606a-a65a-4998-8d43-9eebd1ae10b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:36.610404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302606a-a65a-4998-8d43-9eebd1ae10b8 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:36.611115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302606a-a65a-4998-8d43-9eebd1ae10b8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:36.611423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302606a-a65a-4998-8d43-9eebd1ae10b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:36.612829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302606a-a65a-4998-8d43-9eebd1ae10b8 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:36.618394 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 474/953] 10.222.0.43 () {56 vars in 1122 bytes} [Sat Jul 2 20:45:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:36.624376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81a7a0-9a10-45f8-ac5e-3a6a95c71145 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:36.654027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:36.732687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81a7a0-9a10-45f8-ac5e-3a6a95c71145 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:36.746448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefa90a-7702-4062-9d34-4edbd851d000 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:36.746733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefa90a-7702-4062-9d34-4edbd851d000 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:36.746998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefa90a-7702-4062-9d34-4edbd851d000 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:36.748669 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 475/954] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:45:36.753987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67c526-8056-46a5-989a-f5e158334d5c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:36.754275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67c526-8056-46a5-989a-f5e158334d5c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:36.754554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67c526-8056-46a5-989a-f5e158334d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:36.771130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609bf1c-96ee-4875-8c83-184019bcdb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:36.772308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609bf1c-96ee-4875-8c83-184019bcdb57 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:36.772940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609bf1c-96ee-4875-8c83-184019bcdb57 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:36.773424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609bf1c-96ee-4875-8c83-184019bcdb57 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:36.774012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4f67c526-8056-46a5-989a-f5e158334d5c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:36.774631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609bf1c-96ee-4875-8c83-184019bcdb57 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:36.775137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609bf1c-96ee-4875-8c83-184019bcdb57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:36.775260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4f67c526-8056-46a5-989a-f5e158334d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:36.776862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609bf1c-96ee-4875-8c83-184019bcdb57 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:36.787357 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 480/955] 10.222.0.43 () {56 vars in 1122 bytes} [Sat Jul 2 20:45:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:36.788953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609bf1c-96ee-4875-8c83-184019bcdb57 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:36.860261 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 476/956] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:45:36.887404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67c526-8056-46a5-989a-f5e158334d5c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:36.903363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:36.916739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609bf1c-96ee-4875-8c83-184019bcdb57 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:36.960811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d915dc5-37b6-4fef-a301-9a77a338482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:36.961600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d915dc5-37b6-4fef-a301-9a77a338482b None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:36.961887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d915dc5-37b6-4fef-a301-9a77a338482b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:36.962165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d915dc5-37b6-4fef-a301-9a77a338482b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:36.962904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d915dc5-37b6-4fef-a301-9a77a338482b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:36.964354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d915dc5-37b6-4fef-a301-9a77a338482b None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:36.987427 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 481/957] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Jul 2 20:45:36 2022] POST /identity/v3/endpoints => generated 349 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:45:36.996552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:37.003873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67c526-8056-46a5-989a-f5e158334d5c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:37.051161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3011f-0662-44e1-a516-9e4ee9c485f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:37.051981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3011f-0662-44e1-a516-9e4ee9c485f5 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:37.052299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3011f-0662-44e1-a516-9e4ee9c485f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:37.052573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3011f-0662-44e1-a516-9e4ee9c485f5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:37.053234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3011f-0662-44e1-a516-9e4ee9c485f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:37.054654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3011f-0662-44e1-a516-9e4ee9c485f5 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:37.068141 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-19d3011f-0662-44e1-a516-9e4ee9c485f5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 20:45:37.068141 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:37.068141 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:37.068141 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:37.068141 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:37.068141 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:37.068141 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:37.068141 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:37.068141 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 20:45:37.068141 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:37.068141 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:37.068141 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:37.068141 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:37.068141 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:37.068141 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:37.068141 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:37.068141 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:37.069405 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:37.069405 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:37.069405 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:37.069405 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:37.069405 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:37.069405 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:37.069405 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:37.069405 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:37.069405 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:37.069405 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:37.069405 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:37.069405 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:37.069405 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:37.069405 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:37.069405 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:37.069405 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:37.071133 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:37.071133 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:37.071133 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:37.071133 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:37.071133 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:37.071133 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:37.071133 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:37.071133 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:37.071133 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:37.071133 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:37.071133 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:37.071133 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:37.071133 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 20:45:37.071133 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:37.071133 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 477/958] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:37.075472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d915dc5-37b6-4fef-a301-9a77a338482b None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:37.193406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d915dc5-37b6-4fef-a301-9a77a338482b None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:37.231311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d96f6c-2872-43c4-bcff-9bf97242d0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:37.231986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d96f6c-2872-43c4-bcff-9bf97242d0a9 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:37.232303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d96f6c-2872-43c4-bcff-9bf97242d0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:37.232582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d96f6c-2872-43c4-bcff-9bf97242d0a9 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:37.233288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d96f6c-2872-43c4-bcff-9bf97242d0a9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:37.233595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d96f6c-2872-43c4-bcff-9bf97242d0a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:37.234978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d96f6c-2872-43c4-bcff-9bf97242d0a9 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:37.240156 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 482/959] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Jul 2 20:45:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:37.245998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3011f-0662-44e1-a516-9e4ee9c485f5 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:37.350500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3011f-0662-44e1-a516-9e4ee9c485f5 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:37.386555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8050abb-ebb9-4d99-86a6-3eadc94c9763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:37.387614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8050abb-ebb9-4d99-86a6-3eadc94c9763 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:37.388104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8050abb-ebb9-4d99-86a6-3eadc94c9763 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:37.388591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8050abb-ebb9-4d99-86a6-3eadc94c9763 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:37.389470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8050abb-ebb9-4d99-86a6-3eadc94c9763 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:37.389978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8050abb-ebb9-4d99-86a6-3eadc94c9763 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:37.391548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8050abb-ebb9-4d99-86a6-3eadc94c9763 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:37.396879 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 478/960] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Jul 2 20:45:37 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:37.772112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15da7c0-eabc-4c30-b0aa-c2415c89d99d None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:37.772458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15da7c0-eabc-4c30-b0aa-c2415c89d99d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:37.772675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15da7c0-eabc-4c30-b0aa-c2415c89d99d None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:37.774360 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 483/961] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:37.779545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145043d-ce92-4a5c-a2d7-12135a9dd760 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:37.779839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145043d-ce92-4a5c-a2d7-12135a9dd760 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:37.780144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145043d-ce92-4a5c-a2d7-12135a9dd760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:37.798213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1145043d-ce92-4a5c-a2d7-12135a9dd760 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:37.799393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1145043d-ce92-4a5c-a2d7-12135a9dd760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:37.814075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:37.869939 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 479/962] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:37.894313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15da7c0-eabc-4c30-b0aa-c2415c89d99d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:37.907571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:38.005997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15da7c0-eabc-4c30-b0aa-c2415c89d99d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:38.040850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a7c70-b3ad-49f1-95b8-569cee52a6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:38.041914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a7c70-b3ad-49f1-95b8-569cee52a6ca None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:38.042348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a7c70-b3ad-49f1-95b8-569cee52a6ca None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:38.042779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a7c70-b3ad-49f1-95b8-569cee52a6ca None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:38.054954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a7c70-b3ad-49f1-95b8-569cee52a6ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:38.063423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-802a7c70-b3ad-49f1-95b8-569cee52a6ca None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 20:45:38.063423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:38.063423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:38.063423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:38.063423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:38.063423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:38.063423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:38.063423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:38.063423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:38.063423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:38.063423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:38.063423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:38.063423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:38.063423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:38.063423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:38.063423 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:38.064591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:38.064591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:38.064591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:38.064591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:38.064591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:38.064591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:38.064591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:38.064591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:38.064591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:38.064591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:38.064591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:38.064591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:38.064591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:38.064591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:38.064591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:38.064591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:38.065695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:38.065695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:38.065695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:38.065695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:38.065695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:38.065695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:38.065695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:38.065695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:38.065695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:38.065695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:38.065695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 20:45:38.065695 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:38.068166 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 484/963] 10.222.0.43 () {56 vars in 1120 bytes} [Sat Jul 2 20:45:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:38.074152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145043d-ce92-4a5c-a2d7-12135a9dd760 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:38.177869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145043d-ce92-4a5c-a2d7-12135a9dd760 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:38.212751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8813ae-b113-4f88-aaca-8dde286f1c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:38.213421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8813ae-b113-4f88-aaca-8dde286f1c8d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:38.213701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8813ae-b113-4f88-aaca-8dde286f1c8d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:38.213971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8813ae-b113-4f88-aaca-8dde286f1c8d None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:38.214714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8813ae-b113-4f88-aaca-8dde286f1c8d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:38.215019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8813ae-b113-4f88-aaca-8dde286f1c8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:38.216421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8813ae-b113-4f88-aaca-8dde286f1c8d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:38.225357 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 480/964] 10.222.0.43 () {56 vars in 1115 bytes} [Sat Jul 2 20:45:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:38.231790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a7c70-b3ad-49f1-95b8-569cee52a6ca None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:38.305620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:38.342721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a7c70-b3ad-49f1-95b8-569cee52a6ca None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:38.377933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b17d4-0f49-4aed-a919-cdab4539ebde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:38.378730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b17d4-0f49-4aed-a919-cdab4539ebde None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:38.379010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b17d4-0f49-4aed-a919-cdab4539ebde None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:38.379285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b17d4-0f49-4aed-a919-cdab4539ebde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:38.389984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b17d4-0f49-4aed-a919-cdab4539ebde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:38.391471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b17d4-0f49-4aed-a919-cdab4539ebde None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:38.409732 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-776b17d4-0f49-4aed-a919-cdab4539ebde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:38.409732 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:38.409732 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:38.409732 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:38.409732 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:38.409732 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:38.409732 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:38.409732 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:38.409732 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:38.409732 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:38.409732 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:38.409732 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:38.409732 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:38.409732 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:38.409732 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:38.410657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:38.410657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:38.410657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:38.410657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:38.410657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:38.410657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:38.410657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:38.410657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:38.410657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:38.410657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:38.410657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:38.410657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:38.410657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:38.410657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:38.410657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:38.410657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:38.410657 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:38.411609 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:38.411609 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:38.411609 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:38.411609 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:38.411609 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 485/965] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:38.418092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8813ae-b113-4f88-aaca-8dde286f1c8d None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:38.435424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:38.526447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8813ae-b113-4f88-aaca-8dde286f1c8d None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:38.561627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4594c-ab90-482f-8f28-43d644bbecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:38.562633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4594c-ab90-482f-8f28-43d644bbecc9 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:38.563112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4594c-ab90-482f-8f28-43d644bbecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:38.563580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4594c-ab90-482f-8f28-43d644bbecc9 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:38.564533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4594c-ab90-482f-8f28-43d644bbecc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:38.565050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4594c-ab90-482f-8f28-43d644bbecc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:38.566611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4594c-ab90-482f-8f28-43d644bbecc9 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:38.579305 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 481/966] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:38.585162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b17d4-0f49-4aed-a919-cdab4539ebde None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:38.682542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc440ca-c8e2-4bfa-b663-130009f75de0 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:38.682983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc440ca-c8e2-4bfa-b663-130009f75de0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:38.683272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc440ca-c8e2-4bfa-b663-130009f75de0 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:38.684936 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 482/967] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:45:38.689726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471d2ca-6ad1-44c7-b55d-5522d5cbe798 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:38.690018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471d2ca-6ad1-44c7-b55d-5522d5cbe798 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:38.690294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471d2ca-6ad1-44c7-b55d-5522d5cbe798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:38.694610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b17d4-0f49-4aed-a919-cdab4539ebde None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:38.707908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3471d2ca-6ad1-44c7-b55d-5522d5cbe798 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:38.709394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3471d2ca-6ad1-44c7-b55d-5522d5cbe798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:38.722841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:38.737588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4052f-952f-4a9b-8be1-45ad22d52edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:38.738418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4052f-952f-4a9b-8be1-45ad22d52edb None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:38.738703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4052f-952f-4a9b-8be1-45ad22d52edb None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:38.739477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4052f-952f-4a9b-8be1-45ad22d52edb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:38.749938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4052f-952f-4a9b-8be1-45ad22d52edb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:38.751772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4052f-952f-4a9b-8be1-45ad22d52edb None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:38.772169 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-42b4052f-952f-4a9b-8be1-45ad22d52edb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 20:45:38.772169 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:38.772169 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:38.772169 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:38.772169 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:38.772169 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:38.772169 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:38.772169 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:38.772169 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:38.772169 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:38.772169 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:38.772169 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:38.772169 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:38.772169 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:38.772169 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:38.772169 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:38.773210 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:38.773210 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:38.773210 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:38.773210 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:38.773210 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:38.773210 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:38.773210 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:38.773210 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:38.773210 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:38.773210 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:38.773210 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:38.773210 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:38.773210 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:38.773210 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:38.773210 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:38.773210 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:38.773210 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:38.773210 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:38.774307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:38.774307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:38.774307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:38.774307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:38.774307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:38.774307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:38.774307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:38.774307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:38.774307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 20:45:38.774307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:38.774307 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 486/968] 10.222.0.43 () {56 vars in 1117 bytes} [Sat Jul 2 20:45:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:38.779531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4052f-952f-4a9b-8be1-45ad22d52edb None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:38.800767 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 483/969] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:45:38.827338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471d2ca-6ad1-44c7-b55d-5522d5cbe798 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:38.830113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:38.909319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4052f-952f-4a9b-8be1-45ad22d52edb None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:38.940574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471d2ca-6ad1-44c7-b55d-5522d5cbe798 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:38.958515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb722a-bf60-42ff-99e9-ab2caa544925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:38.960153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb722a-bf60-42ff-99e9-ab2caa544925 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:38.960685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb722a-bf60-42ff-99e9-ab2caa544925 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:38.961317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb722a-bf60-42ff-99e9-ab2caa544925 None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:38.962460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb722a-bf60-42ff-99e9-ab2caa544925 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:38.963499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb722a-bf60-42ff-99e9-ab2caa544925 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:38.965790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb722a-bf60-42ff-99e9-ab2caa544925 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:38.977893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac36bf8-33f9-4185-abaa-afc0863e9c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:38.979111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac36bf8-33f9-4185-abaa-afc0863e9c03 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:38.979111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac36bf8-33f9-4185-abaa-afc0863e9c03 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:38.979320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac36bf8-33f9-4185-abaa-afc0863e9c03 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:38.979893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac36bf8-33f9-4185-abaa-afc0863e9c03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:38.981377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac36bf8-33f9-4185-abaa-afc0863e9c03 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:38.993734 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 487/970] 10.222.0.43 () {56 vars in 1149 bytes} [Sat Jul 2 20:45:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:38.994312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb722a-bf60-42ff-99e9-ab2caa544925 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:39.005833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.sql.core [None req-0ac36bf8-33f9-4185-abaa-afc0863e9c03 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 02 20:45:39.005833 ncdv-master-1 devstack@keystone.service[91077]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 02 20:45:39.005833 ncdv-master-1 devstack@keystone.service[91077]: [parameters: {'user_id': 'f0b1a78a2c804987977338ef11e064a5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 02 20:45:39.005833 ncdv-master-1 devstack@keystone.service[91077]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91077) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 02 20:45:39.014299 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-0ac36bf8-33f9-4185-abaa-afc0863e9c03 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 02 20:45:39.014299 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:39.014299 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 20:45:39.014299 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 20:45:39.014299 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 20:45:39.014299 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 20:45:39.014299 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 20:45:39.014299 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 20:45:39.014299 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 20:45:39.014299 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application conn.query(q) Jul 02 20:45:39.014299 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 20:45:39.014299 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 20:45:39.014299 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 20:45:39.014299 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application result.read() Jul 02 20:45:39.014299 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 20:45:39.015232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 20:45:39.015232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 20:45:39.015232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 20:45:39.015232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 20:45:39.015232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 20:45:39.015232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 20:45:39.015232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 20:45:39.015232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 02 20:45:39.015232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:39.015232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 02 20:45:39.015232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:39.015232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:39.015232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 02 20:45:39.015232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 02 20:45:39.015232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 02 20:45:39.015232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 02 20:45:39.015232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 20:45:39.015232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application next(self.gen) Jul 02 20:45:39.016369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 02 20:45:39.016369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application yield resource Jul 02 20:45:39.016369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 20:45:39.016369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application next(self.gen) Jul 02 20:45:39.016369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 02 20:45:39.016369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.session.rollback() Jul 02 20:45:39.016369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 20:45:39.016369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.force_reraise() Jul 02 20:45:39.016369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 20:45:39.016369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise self.value Jul 02 20:45:39.016369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 02 20:45:39.016369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 02 20:45:39.016369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 02 20:45:39.016369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application session.commit() Jul 02 20:45:39.016369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 02 20:45:39.016369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 02 20:45:39.016369 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 02 20:45:39.017336 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._prepare_impl() Jul 02 20:45:39.017336 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 02 20:45:39.017336 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.session.flush() Jul 02 20:45:39.017336 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 02 20:45:39.017336 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._flush(objects) Jul 02 20:45:39.017336 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 02 20:45:39.017336 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 02 20:45:39.017336 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 02 20:45:39.017336 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application compat.raise_( Jul 02 20:45:39.017336 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 20:45:39.017336 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception Jul 02 20:45:39.017336 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 02 20:45:39.017336 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application flush_context.execute() Jul 02 20:45:39.017336 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 02 20:45:39.017336 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rec.execute(self) Jul 02 20:45:39.017336 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 02 20:45:39.017336 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 02 20:45:39.018264 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 02 20:45:39.018264 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 02 20:45:39.018264 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 02 20:45:39.018264 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 02 20:45:39.018264 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 02 20:45:39.018264 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 02 20:45:39.018264 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 02 20:45:39.018264 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 02 20:45:39.018264 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 02 20:45:39.018264 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 02 20:45:39.018264 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 02 20:45:39.018264 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 02 20:45:39.018264 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 02 20:45:39.018264 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 02 20:45:39.018264 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 20:45:39.018264 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception Jul 02 20:45:39.019139 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 20:45:39.019139 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 20:45:39.019139 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 20:45:39.019139 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 20:45:39.019139 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 20:45:39.019139 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 20:45:39.019139 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 20:45:39.019139 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application conn.query(q) Jul 02 20:45:39.019139 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 20:45:39.019139 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 20:45:39.019139 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 20:45:39.019139 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application result.read() Jul 02 20:45:39.019139 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 20:45:39.019139 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 20:45:39.019139 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 20:45:39.019139 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 20:45:39.020013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 20:45:39.020013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 20:45:39.020013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 20:45:39.020013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 20:45:39.020013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 02 20:45:39.020013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 02 20:45:39.020013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f0b1a78a2c804987977338ef11e064a5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 02 20:45:39.020013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 02 20:45:39.020013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:39.020013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:39.020013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:39.020013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:39.020013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:39.020013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:39.020013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:39.022846 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:39.022846 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:39.022846 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:39.022846 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:39.022846 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:39.022846 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:39.022846 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:39.022846 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 02 20:45:39.022846 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 02 20:45:39.022846 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:39.022846 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:39.022846 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:39.022846 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:39.022846 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:39.022846 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:39.022846 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 02 20:45:39.022846 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 02 20:45:39.024258 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 02 20:45:39.024258 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 02 20:45:39.024258 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 02 20:45:39.024258 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 02 20:45:39.024258 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 02 20:45:39.024258 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:39.024258 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 484/971] 10.222.0.43 () {60 vars in 1131 bytes} [Sat Jul 2 20:45:38 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:39.024258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac36bf8-33f9-4185-abaa-afc0863e9c03 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:39.060985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:39.120897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:39.124875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb722a-bf60-42ff-99e9-ab2caa544925 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:39.166048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6824ee-3943-434d-a7f2-a37974a96251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:39.166852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6824ee-3943-434d-a7f2-a37974a96251 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:39.167231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6824ee-3943-434d-a7f2-a37974a96251 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:39.167586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6824ee-3943-434d-a7f2-a37974a96251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:39.173626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac36bf8-33f9-4185-abaa-afc0863e9c03 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:39.220878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62946f78-da6a-4a8b-a168-3ae1cac1ba80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:39.222221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62946f78-da6a-4a8b-a168-3ae1cac1ba80 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:39.222654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62946f78-da6a-4a8b-a168-3ae1cac1ba80 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:39.223320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62946f78-da6a-4a8b-a168-3ae1cac1ba80 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:39.234600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62946f78-da6a-4a8b-a168-3ae1cac1ba80 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:39.237110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62946f78-da6a-4a8b-a168-3ae1cac1ba80 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:39.246521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6824ee-3943-434d-a7f2-a37974a96251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:39.248525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6824ee-3943-434d-a7f2-a37974a96251 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:39.258529 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-62946f78-da6a-4a8b-a168-3ae1cac1ba80 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 20:45:39.258529 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:39.258529 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:39.258529 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:39.258529 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:39.258529 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:39.258529 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:39.258529 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:39.258529 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:39.258529 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:39.258529 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:39.258529 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:39.258529 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:39.258529 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:39.258529 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:39.258529 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:39.259814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:39.259814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:39.259814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:39.259814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:39.259814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:39.259814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:39.259814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:39.259814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:39.259814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:39.259814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:39.259814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:39.259814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:39.259814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:39.259814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:39.259814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:39.259814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:39.259814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:39.259814 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:39.261232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:39.261232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:39.261232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:39.261232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:39.261232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:39.261232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:39.261232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:39.261232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:39.261232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 20:45:39.261232 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:39.261825 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 485/972] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:45:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:39.269953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62946f78-da6a-4a8b-a168-3ae1cac1ba80 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:39.313606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:39.377894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62946f78-da6a-4a8b-a168-3ae1cac1ba80 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:39.394224 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 488/973] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:45:38 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 02 20:45:39.394970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6824ee-3943-434d-a7f2-a37974a96251 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:39.412100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:39.426071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714d297-c434-48b2-be49-ab91439c040d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:39.427942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714d297-c434-48b2-be49-ab91439c040d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:39.428402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714d297-c434-48b2-be49-ab91439c040d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:39.428849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714d297-c434-48b2-be49-ab91439c040d None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:39.430299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714d297-c434-48b2-be49-ab91439c040d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:39.430763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714d297-c434-48b2-be49-ab91439c040d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:39.432616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714d297-c434-48b2-be49-ab91439c040d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:39.481013 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 486/974] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Jul 2 20:45:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:39.487669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8c144-5d36-4332-a70c-1cf61c5f9f35 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:39.487938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8c144-5d36-4332-a70c-1cf61c5f9f35 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:39.488255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8c144-5d36-4332-a70c-1cf61c5f9f35 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:39.489781 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 487/975] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:45:39.495319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836446e-26dd-4189-8bdf-344f12c57ed8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:39.495633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836446e-26dd-4189-8bdf-344f12c57ed8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:39.497307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836446e-26dd-4189-8bdf-344f12c57ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:39.514696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e836446e-26dd-4189-8bdf-344f12c57ed8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:39.515663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6824ee-3943-434d-a7f2-a37974a96251 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:39.516355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e836446e-26dd-4189-8bdf-344f12c57ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:39.557243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ef143-45f1-45c9-8af3-0b37a6617de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:39.558493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ef143-45f1-45c9-8af3-0b37a6617de8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:39.558977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ef143-45f1-45c9-8af3-0b37a6617de8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:39.559473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ef143-45f1-45c9-8af3-0b37a6617de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:39.569487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:39.572610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ef143-45f1-45c9-8af3-0b37a6617de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:39.574951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ef143-45f1-45c9-8af3-0b37a6617de8 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:39.598355 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-7b3ef143-45f1-45c9-8af3-0b37a6617de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:39.598355 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:39.598355 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:39.598355 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:39.598355 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:39.598355 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:39.598355 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:39.598355 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:39.598355 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:39.598355 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:39.598355 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:39.598355 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:39.598355 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:39.598355 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:39.598355 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:39.599366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:39.599366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:39.599366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:39.599366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:39.599366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:39.599366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:39.599366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:39.599366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:39.599366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:39.599366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:39.599366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:39.599366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:39.599366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:39.599366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:39.599366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:39.599366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:39.599366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:39.600375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:39.600375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:39.600375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:39.600375 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:39.602821 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 489/977] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:39.602975 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 488/977] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:45:39.608685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836446e-26dd-4189-8bdf-344f12c57ed8 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:39.627390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ef143-45f1-45c9-8af3-0b37a6617de8 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:39.738796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836446e-26dd-4189-8bdf-344f12c57ed8 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:39.750796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:39.751923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ef143-45f1-45c9-8af3-0b37a6617de8 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:39.781752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bd252-8d4e-4662-8ae6-07b9852de416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:39.782428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bd252-8d4e-4662-8ae6-07b9852de416 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:39.782706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bd252-8d4e-4662-8ae6-07b9852de416 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:39.782980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bd252-8d4e-4662-8ae6-07b9852de416 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:39.783720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8bd252-8d4e-4662-8ae6-07b9852de416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:39.784030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8bd252-8d4e-4662-8ae6-07b9852de416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:39.785455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8bd252-8d4e-4662-8ae6-07b9852de416 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:39.798271 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 489/978] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:39.799468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acc5e1-e323-4312-b93b-0de0ae985297 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:39.799807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acc5e1-e323-4312-b93b-0de0ae985297 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:39.800026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acc5e1-e323-4312-b93b-0de0ae985297 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:39.801328 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 490/979] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:39.803985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8627f1-f9fb-48be-8a0c-38fb13871dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:39.804933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8627f1-f9fb-48be-8a0c-38fb13871dc4 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:39.805059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acc5e1-e323-4312-b93b-0de0ae985297 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:39.805428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8627f1-f9fb-48be-8a0c-38fb13871dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:39.805544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8627f1-f9fb-48be-8a0c-38fb13871dc4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:39.806139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8627f1-f9fb-48be-8a0c-38fb13871dc4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:39.807524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8627f1-f9fb-48be-8a0c-38fb13871dc4 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:39.822166 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-5e8627f1-f9fb-48be-8a0c-38fb13871dc4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 20:45:39.822166 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:39.822166 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:39.822166 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:39.822166 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:39.822166 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:39.822166 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:39.822166 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:39.822166 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 20:45:39.822166 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:39.822166 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:39.822166 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:39.822166 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:39.822166 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:39.822166 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:39.822166 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:39.822166 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:39.823309 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:39.823309 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:39.823309 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:39.823309 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:39.823309 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:39.823309 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:39.823309 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:39.823309 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:39.823309 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:39.823309 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:39.823309 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:39.823309 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:39.823309 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:39.823309 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:39.823309 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:39.823309 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:39.824247 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:39.824247 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:39.824247 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:39.824247 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:39.824247 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:39.824247 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:39.824247 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:39.824247 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:39.824247 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:39.824247 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:39.824247 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:39.824247 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:39.824247 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 20:45:39.824247 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:39.824247 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 490/980] 10.222.0.43 () {56 vars in 1126 bytes} [Sat Jul 2 20:45:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:39.825073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d96ce-d402-4221-9953-3cf3a1bec102 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:39.825073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d96ce-d402-4221-9953-3cf3a1bec102 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:39.825208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d96ce-d402-4221-9953-3cf3a1bec102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:39.841396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ef5d96ce-d402-4221-9953-3cf3a1bec102 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:39.842597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ef5d96ce-d402-4221-9953-3cf3a1bec102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:39.892246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:39.909689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acc5e1-e323-4312-b93b-0de0ae985297 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:39.910277 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 491/981] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:39.911167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d96ce-d402-4221-9953-3cf3a1bec102 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:39.943657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc79cb-e2d0-4cff-b1e7-3896d65f7ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:39.944491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc79cb-e2d0-4cff-b1e7-3896d65f7ba9 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:39.944768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc79cb-e2d0-4cff-b1e7-3896d65f7ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:39.945042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc79cb-e2d0-4cff-b1e7-3896d65f7ba9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:39.951717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc79cb-e2d0-4cff-b1e7-3896d65f7ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:39.953201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc79cb-e2d0-4cff-b1e7-3896d65f7ba9 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:39.968607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-a7bc79cb-e2d0-4cff-b1e7-3896d65f7ba9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:39.968607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:39.968607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:39.968607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:39.968607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:39.968607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:39.968607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:39.968607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:39.968607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:39.968607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:39.968607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:39.968607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:39.968607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:39.968607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:39.968607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:39.969592 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:39.969592 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:39.969592 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:39.969592 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:39.969592 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:39.969592 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:39.969592 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:39.969592 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:39.969592 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:39.969592 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:39.969592 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:39.969592 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:39.969592 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:39.969592 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:39.969592 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:39.969592 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:39.969592 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:39.970506 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:39.970506 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:39.970506 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:39.970506 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:39.970506 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:39.970506 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:39.970506 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:39.970506 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:39.970506 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 491/982] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:39.971006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc79cb-e2d0-4cff-b1e7-3896d65f7ba9 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:40.003528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:40.014966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d96ce-d402-4221-9953-3cf3a1bec102 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:40.049259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff454f64-1861-42d5-9334-0c927dabc5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:40.049933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff454f64-1861-42d5-9334-0c927dabc5f7 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:40.050214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff454f64-1861-42d5-9334-0c927dabc5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:40.050479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff454f64-1861-42d5-9334-0c927dabc5f7 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:40.051187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff454f64-1861-42d5-9334-0c927dabc5f7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:40.051496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff454f64-1861-42d5-9334-0c927dabc5f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:40.052944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff454f64-1861-42d5-9334-0c927dabc5f7 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:40.057636 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 492/983] 10.222.0.43 () {56 vars in 1122 bytes} [Sat Jul 2 20:45:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:40.058409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff454f64-1861-42d5-9334-0c927dabc5f7 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:40.072563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc79cb-e2d0-4cff-b1e7-3896d65f7ba9 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:40.109277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85d9ce-baba-43ac-b7f3-17a0dc1ee44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:40.109938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85d9ce-baba-43ac-b7f3-17a0dc1ee44e None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:40.110228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85d9ce-baba-43ac-b7f3-17a0dc1ee44e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:40.110496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85d9ce-baba-43ac-b7f3-17a0dc1ee44e None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:40.111157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:40.111273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85d9ce-baba-43ac-b7f3-17a0dc1ee44e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:40.112685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85d9ce-baba-43ac-b7f3-17a0dc1ee44e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:40.125640 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 492/984] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Jul 2 20:45:39 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:45:40.126542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85d9ce-baba-43ac-b7f3-17a0dc1ee44e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:40.167326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff454f64-1861-42d5-9334-0c927dabc5f7 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:40.213220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885a59a-4050-4373-89be-5f1f7242b4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:40.214063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885a59a-4050-4373-89be-5f1f7242b4de None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:40.214409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885a59a-4050-4373-89be-5f1f7242b4de None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:40.214694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885a59a-4050-4373-89be-5f1f7242b4de None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:40.215489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885a59a-4050-4373-89be-5f1f7242b4de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:40.215827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885a59a-4050-4373-89be-5f1f7242b4de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:40.217507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885a59a-4050-4373-89be-5f1f7242b4de None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:40.231303 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 493/985] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:40.235334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:40.237914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885a59a-4050-4373-89be-5f1f7242b4de None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:40.247916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85d9ce-baba-43ac-b7f3-17a0dc1ee44e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:40.285825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c585a6c-b228-4931-9abf-a72e78c190f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:40.286413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c585a6c-b228-4931-9abf-a72e78c190f4 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:40.286693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c585a6c-b228-4931-9abf-a72e78c190f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:40.286985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c585a6c-b228-4931-9abf-a72e78c190f4 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:40.287754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c585a6c-b228-4931-9abf-a72e78c190f4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:40.288093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c585a6c-b228-4931-9abf-a72e78c190f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:40.289573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c585a6c-b228-4931-9abf-a72e78c190f4 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:40.300459 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 493/986] 10.222.0.43 () {56 vars in 1122 bytes} [Sat Jul 2 20:45:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:40.301778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c585a6c-b228-4931-9abf-a72e78c190f4 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:40.352976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885a59a-4050-4373-89be-5f1f7242b4de None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:40.360508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:40.390943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10007b4f-e623-44ae-add9-01d8c279a856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:40.391592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10007b4f-e623-44ae-add9-01d8c279a856 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:40.391871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10007b4f-e623-44ae-add9-01d8c279a856 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:40.392323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10007b4f-e623-44ae-add9-01d8c279a856 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:40.393001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10007b4f-e623-44ae-add9-01d8c279a856 None admin] RBAC: Adding query filter params (role.id=1ef9541aff044694894c631ef9e92fcb, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=4d4bfe417b4c4896ae5f3fc23e03ef71) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:40.393306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10007b4f-e623-44ae-add9-01d8c279a856 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:40.395018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10007b4f-e623-44ae-add9-01d8c279a856 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:40.400969 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 494/987] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:45:40 2022] GET /identity/v3/role_assignments?user.id=4d4bfe417b4c4896ae5f3fc23e03ef71&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=1ef9541aff044694894c631ef9e92fcb => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:40.417413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c585a6c-b228-4931-9abf-a72e78c190f4 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:40.456401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135bc0d-6707-40ee-afde-2bfce835ae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:40.457066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135bc0d-6707-40ee-afde-2bfce835ae45 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:40.457354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135bc0d-6707-40ee-afde-2bfce835ae45 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:40.457594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135bc0d-6707-40ee-afde-2bfce835ae45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:40.458393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135bc0d-6707-40ee-afde-2bfce835ae45 None admin] RBAC: Adding query filter params (interface=admin, service_id=7c9929bedc1045d282354cc61b709434, region_id=RegionOne) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:40.458686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135bc0d-6707-40ee-afde-2bfce835ae45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:40.460086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135bc0d-6707-40ee-afde-2bfce835ae45 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:40.466625 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 494/988] 10.222.0.43 () {56 vars in 1249 bytes} [Sat Jul 2 20:45:40 2022] GET /identity/v3/endpoints?service_id=7c9929bedc1045d282354cc61b709434&interface=admin®ion_id=RegionOne => generated 193 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:40.472268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10007b4f-e623-44ae-add9-01d8c279a856 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:40.585536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10007b4f-e623-44ae-add9-01d8c279a856 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:40.623934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550a6b1-948f-4fcb-ae48-e23a4cd69081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:40.624654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550a6b1-948f-4fcb-ae48-e23a4cd69081 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:40.624941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550a6b1-948f-4fcb-ae48-e23a4cd69081 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:40.625219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550a6b1-948f-4fcb-ae48-e23a4cd69081 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:40.625902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550a6b1-948f-4fcb-ae48-e23a4cd69081 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:40.627458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550a6b1-948f-4fcb-ae48-e23a4cd69081 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:40.635060 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 495/989] 10.222.0.43 () {56 vars in 1087 bytes} [Sat Jul 2 20:45:40 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:45:42.441751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97316c61-5645-44cb-9009-433cd72c11e2 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:42.442324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97316c61-5645-44cb-9009-433cd72c11e2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:42.442324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97316c61-5645-44cb-9009-433cd72c11e2 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:42.443618 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 495/990] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:42.449175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0ac3c-4d5c-4ff2-a5a9-3dc18b1fd59f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:42.449620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0ac3c-4d5c-4ff2-a5a9-3dc18b1fd59f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:42.449700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0ac3c-4d5c-4ff2-a5a9-3dc18b1fd59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:42.466949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-afe0ac3c-4d5c-4ff2-a5a9-3dc18b1fd59f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:42.468175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-afe0ac3c-4d5c-4ff2-a5a9-3dc18b1fd59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:42.497020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:42.543637 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 496/991] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:42.567865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97316c61-5645-44cb-9009-433cd72c11e2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:42.593772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:42.688647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97316c61-5645-44cb-9009-433cd72c11e2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:42.726908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56481f-9b0f-4038-ab9b-bd41d7315d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:42.727610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56481f-9b0f-4038-ab9b-bd41d7315d67 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:42.727891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56481f-9b0f-4038-ab9b-bd41d7315d67 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:42.728198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56481f-9b0f-4038-ab9b-bd41d7315d67 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:42.728845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56481f-9b0f-4038-ab9b-bd41d7315d67 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:42.730226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56481f-9b0f-4038-ab9b-bd41d7315d67 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:42.742205 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-4f56481f-9b0f-4038-ab9b-bd41d7315d67 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 20:45:42.742205 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:42.742205 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:42.742205 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:42.742205 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:42.742205 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:42.742205 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:42.742205 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:42.742205 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 20:45:42.742205 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:42.742205 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:42.742205 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:42.742205 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:42.742205 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:42.742205 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:42.742205 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:42.742205 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:42.743220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:42.743220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:42.743220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:42.743220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:42.743220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:42.743220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:42.743220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:42.743220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:42.743220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:42.743220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:42.743220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:42.743220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:42.743220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:42.743220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:42.743220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:42.743220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:42.749383 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:42.749383 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:42.749383 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:42.749383 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:42.749383 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:42.749383 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:42.749383 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:42.749383 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:42.749383 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:42.749383 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:42.749383 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:42.749383 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:42.749383 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 20:45:42.749383 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:42.749383 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 496/992] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:42.750210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0ac3c-4d5c-4ff2-a5a9-3dc18b1fd59f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:42.757901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e86ea-5875-4838-b537-5a54b03e6226 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:42.758206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e86ea-5875-4838-b537-5a54b03e6226 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:42.758546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e86ea-5875-4838-b537-5a54b03e6226 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:42.759928 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 497/993] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:42.767253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf531dcb-c5f9-4f58-934d-28568753d5be None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:42.767535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf531dcb-c5f9-4f58-934d-28568753d5be None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:42.767811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf531dcb-c5f9-4f58-934d-28568753d5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:42.784697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-cf531dcb-c5f9-4f58-934d-28568753d5be None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:42.785880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cf531dcb-c5f9-4f58-934d-28568753d5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:42.857411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0ac3c-4d5c-4ff2-a5a9-3dc18b1fd59f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:42.857835 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 498/994] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:42.880973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf531dcb-c5f9-4f58-934d-28568753d5be None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:42.895029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d817ec0-4cc9-4420-82c8-e40d4b52dc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:42.895700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d817ec0-4cc9-4420-82c8-e40d4b52dc74 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:42.895976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d817ec0-4cc9-4420-82c8-e40d4b52dc74 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:42.896286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d817ec0-4cc9-4420-82c8-e40d4b52dc74 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:42.896987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d817ec0-4cc9-4420-82c8-e40d4b52dc74 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:42.897291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d817ec0-4cc9-4420-82c8-e40d4b52dc74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:42.898704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d817ec0-4cc9-4420-82c8-e40d4b52dc74 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:42.899265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:42.904579 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 497/995] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Jul 2 20:45:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:42.909794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d817ec0-4cc9-4420-82c8-e40d4b52dc74 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:42.937334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:43.001561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf531dcb-c5f9-4f58-934d-28568753d5be None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:43.010595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d817ec0-4cc9-4420-82c8-e40d4b52dc74 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:43.037305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f4268-db1f-4ffa-b829-56699ebcd877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:43.038111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f4268-db1f-4ffa-b829-56699ebcd877 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:43.038396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f4268-db1f-4ffa-b829-56699ebcd877 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:43.038669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f4268-db1f-4ffa-b829-56699ebcd877 None admin] PATH_INFO: `/v3/services/image` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:43.039441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f4268-db1f-4ffa-b829-56699ebcd877 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:43.040859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f4268-db1f-4ffa-b829-56699ebcd877 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:43.045684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf5c02-840c-4ba6-9cd9-f901b203fad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:43.046663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf5c02-840c-4ba6-9cd9-f901b203fad8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:43.046992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf5c02-840c-4ba6-9cd9-f901b203fad8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:43.047271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf5c02-840c-4ba6-9cd9-f901b203fad8 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:43.048078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf5c02-840c-4ba6-9cd9-f901b203fad8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:43.048389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf5c02-840c-4ba6-9cd9-f901b203fad8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:43.049798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf5c02-840c-4ba6-9cd9-f901b203fad8 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:43.053406 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-ea4f4268-db1f-4ffa-b829-56699ebcd877 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 20:45:43.053406 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:43.053406 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:43.053406 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:43.053406 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:43.053406 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:43.053406 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:43.053406 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:43.053406 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 20:45:43.053406 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:43.053406 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:43.053406 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:43.053406 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:43.053406 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:43.053406 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:43.053406 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:43.053406 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:43.054579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:43.054579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:43.054579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:43.054579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:43.054579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:43.054579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:43.054579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:43.054579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:43.054579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:43.054579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:43.054579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:43.054579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:43.054579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:43.054579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:43.054579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:43.054579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:43.055448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:43.055448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:43.055448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:43.055448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:43.055448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:43.055448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:43.055448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:43.055448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:43.055448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:43.055448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:43.055448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:43.055448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:43.055448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 20:45:43.055448 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:43.055448 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 499/996] 10.222.0.43 () {56 vars in 1105 bytes} [Sat Jul 2 20:45:42 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:43.056355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba680428-196b-47c8-83ca-939b0edc3d48 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:43.056355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba680428-196b-47c8-83ca-939b0edc3d48 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:43.056492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba680428-196b-47c8-83ca-939b0edc3d48 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:43.057883 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 500/997] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:43.059485 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 498/998] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Jul 2 20:45:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:43.062942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba680428-196b-47c8-83ca-939b0edc3d48 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:43.063082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf5c02-840c-4ba6-9cd9-f901b203fad8 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:43.145577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:43.156029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:43.164934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf5c02-840c-4ba6-9cd9-f901b203fad8 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:43.170502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba680428-196b-47c8-83ca-939b0edc3d48 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:43.198824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390394b2-9790-4a69-8995-b69643a2b11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:43.199488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390394b2-9790-4a69-8995-b69643a2b11c None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:43.199765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390394b2-9790-4a69-8995-b69643a2b11c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:43.200059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390394b2-9790-4a69-8995-b69643a2b11c None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:43.200759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390394b2-9790-4a69-8995-b69643a2b11c None admin] RBAC: Adding query filter params (name=image) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:43.201059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390394b2-9790-4a69-8995-b69643a2b11c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:43.202439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390394b2-9790-4a69-8995-b69643a2b11c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:43.205749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec87ab-d301-4a64-918e-c4fc209c2a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:43.206402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec87ab-d301-4a64-918e-c4fc209c2a7a None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:43.206687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec87ab-d301-4a64-918e-c4fc209c2a7a None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:43.206966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec87ab-d301-4a64-918e-c4fc209c2a7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:43.207182 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 499/999] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:43.207747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec87ab-d301-4a64-918e-c4fc209c2a7a None admin] RBAC: Adding query filter params (interface=public, service_id=57733e6a53924277a282db26c2e95a3e, region_id=RegionOne) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:43.208082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec87ab-d301-4a64-918e-c4fc209c2a7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:43.208346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e381f1-d35a-41f0-b4fb-ce8caa46c37e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:43.208635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e381f1-d35a-41f0-b4fb-ce8caa46c37e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:43.208906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e381f1-d35a-41f0-b4fb-ce8caa46c37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:43.209519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec87ab-d301-4a64-918e-c4fc209c2a7a None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:43.219318 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 501/1000] 10.222.0.43 () {56 vars in 1251 bytes} [Sat Jul 2 20:45:43 2022] GET /identity/v3/endpoints?service_id=57733e6a53924277a282db26c2e95a3e&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:43.219318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec87ab-d301-4a64-918e-c4fc209c2a7a None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:43.227893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-20e381f1-d35a-41f0-b4fb-ce8caa46c37e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:43.229147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-20e381f1-d35a-41f0-b4fb-ce8caa46c37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:43.296306 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 500/1001] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:43.297259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e381f1-d35a-41f0-b4fb-ce8caa46c37e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:43.314639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec87ab-d301-4a64-918e-c4fc209c2a7a None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:43.349461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab359f1-ee94-4425-9306-4ca1d93c4d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:43.350142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab359f1-ee94-4425-9306-4ca1d93c4d3e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:43.350428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab359f1-ee94-4425-9306-4ca1d93c4d3e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:43.350696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab359f1-ee94-4425-9306-4ca1d93c4d3e None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:43.351428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab359f1-ee94-4425-9306-4ca1d93c4d3e None admin] RBAC: Adding query filter params (type=image) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:43.351736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab359f1-ee94-4425-9306-4ca1d93c4d3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:43.353157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab359f1-ee94-4425-9306-4ca1d93c4d3e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:43.357642 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 502/1002] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:43 2022] GET /identity/v3/services?type=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:43.358428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab359f1-ee94-4425-9306-4ca1d93c4d3e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:43.368752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:43.385056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:43.402740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e381f1-d35a-41f0-b4fb-ce8caa46c37e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:43.442925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f29d76-3243-4bbf-b2d1-8d5c3268704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:43.443628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f29d76-3243-4bbf-b2d1-8d5c3268704d None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:43.443919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f29d76-3243-4bbf-b2d1-8d5c3268704d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:43.444231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f29d76-3243-4bbf-b2d1-8d5c3268704d None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:43.444925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f29d76-3243-4bbf-b2d1-8d5c3268704d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:43.446528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f29d76-3243-4bbf-b2d1-8d5c3268704d None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:43.464071 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 501/1003] 10.222.0.43 () {56 vars in 1087 bytes} [Sat Jul 2 20:45:43 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:45:43.474902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab359f1-ee94-4425-9306-4ca1d93c4d3e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:43.513998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9eb159-1d0d-4928-95c0-acd189b6ed1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:43.514978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eb159-1d0d-4928-95c0-acd189b6ed1e None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:43.515330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eb159-1d0d-4928-95c0-acd189b6ed1e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:43.515673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9eb159-1d0d-4928-95c0-acd189b6ed1e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:43.516463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9eb159-1d0d-4928-95c0-acd189b6ed1e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:43.517965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9eb159-1d0d-4928-95c0-acd189b6ed1e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:43.532190 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-ac9eb159-1d0d-4928-95c0-acd189b6ed1e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 20:45:43.532190 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:43.532190 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:43.532190 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:43.532190 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:43.532190 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:43.532190 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:43.532190 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:43.532190 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 20:45:43.532190 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:43.532190 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:43.532190 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:43.532190 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:43.532190 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:43.532190 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:43.532190 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:43.532190 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:43.533665 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:43.533665 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:43.533665 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:43.533665 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:43.533665 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:43.533665 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:43.533665 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:43.533665 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:43.533665 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:43.533665 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:43.533665 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:43.533665 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:43.533665 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:43.533665 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:43.533665 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:43.533665 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:43.534745 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:43.534745 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:43.534745 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:43.534745 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:43.534745 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:43.534745 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:43.534745 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:43.534745 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:43.534745 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:43.534745 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:43.534745 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:43.534745 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:43.534745 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 20:45:43.534745 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:43.536243 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 503/1004] 10.222.0.43 () {56 vars in 1126 bytes} [Sat Jul 2 20:45:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:43.541252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f29d76-3243-4bbf-b2d1-8d5c3268704d None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:43.660622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f29d76-3243-4bbf-b2d1-8d5c3268704d None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:43.697297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b57e17-7c00-44c4-aae2-4b565c3a9fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:43.697964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b57e17-7c00-44c4-aae2-4b565c3a9fd1 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:43.698244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b57e17-7c00-44c4-aae2-4b565c3a9fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:43.698518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b57e17-7c00-44c4-aae2-4b565c3a9fd1 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:43.699211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b57e17-7c00-44c4-aae2-4b565c3a9fd1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:43.699516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b57e17-7c00-44c4-aae2-4b565c3a9fd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:43.700913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b57e17-7c00-44c4-aae2-4b565c3a9fd1 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:43.706103 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 502/1005] 10.222.0.43 () {56 vars in 1122 bytes} [Sat Jul 2 20:45:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:43.711676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9eb159-1d0d-4928-95c0-acd189b6ed1e None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:43.788898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:43.821221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9eb159-1d0d-4928-95c0-acd189b6ed1e None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:43.854885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768a845-53fb-495c-825c-29551d7c1486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:43.855545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768a845-53fb-495c-825c-29551d7c1486 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:43.855821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768a845-53fb-495c-825c-29551d7c1486 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:43.856118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768a845-53fb-495c-825c-29551d7c1486 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:43.856818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768a845-53fb-495c-825c-29551d7c1486 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:43.857121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768a845-53fb-495c-825c-29551d7c1486 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:43.858486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768a845-53fb-495c-825c-29551d7c1486 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:43.863759 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 504/1006] 10.222.0.43 () {56 vars in 1122 bytes} [Sat Jul 2 20:45:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:43.869341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b57e17-7c00-44c4-aae2-4b565c3a9fd1 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:43.887088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:43.976271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b57e17-7c00-44c4-aae2-4b565c3a9fd1 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:44.011773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278d064-6413-47aa-9ea6-7a49c38fd5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:44.012467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278d064-6413-47aa-9ea6-7a49c38fd5f9 None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:44.014579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278d064-6413-47aa-9ea6-7a49c38fd5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:44.014579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278d064-6413-47aa-9ea6-7a49c38fd5f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:44.014579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278d064-6413-47aa-9ea6-7a49c38fd5f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:44.015125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278d064-6413-47aa-9ea6-7a49c38fd5f9 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:44.037364 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 503/1007] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Jul 2 20:45:43 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:45:45.671537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348942e9-1b38-45b3-8ad0-8a8d2959f3db None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:45.672312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348942e9-1b38-45b3-8ad0-8a8d2959f3db None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:45.672312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348942e9-1b38-45b3-8ad0-8a8d2959f3db None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:45.673449 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 505/1008] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:45.679030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c1b60-b493-4219-af05-cf2d6642ec01 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:45.679614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c1b60-b493-4219-af05-cf2d6642ec01 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:45.679614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c1b60-b493-4219-af05-cf2d6642ec01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:45.696784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e49c1b60-b493-4219-af05-cf2d6642ec01 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:45.697970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e49c1b60-b493-4219-af05-cf2d6642ec01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:45.770434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:45.783627 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 504/1009] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:45 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:45.792189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0de9c5-3a49-4a7f-969b-0a35cdba2ae0 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:45.792554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0de9c5-3a49-4a7f-969b-0a35cdba2ae0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:45.792903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0de9c5-3a49-4a7f-969b-0a35cdba2ae0 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:45.797911 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 506/1010] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:45.800323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ad81a-9719-4fdc-8e33-0bd40b7e7cf0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:45.800615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ad81a-9719-4fdc-8e33-0bd40b7e7cf0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:45.800889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ad81a-9719-4fdc-8e33-0bd40b7e7cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:45.803450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0de9c5-3a49-4a7f-969b-0a35cdba2ae0 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:45.819624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d79ad81a-9719-4fdc-8e33-0bd40b7e7cf0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:45.820903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d79ad81a-9719-4fdc-8e33-0bd40b7e7cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:45.889539 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 505/1011] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:45 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:45:45.908205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0de9c5-3a49-4a7f-969b-0a35cdba2ae0 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:45.913785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ad81a-9719-4fdc-8e33-0bd40b7e7cf0 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:45.948224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa635e8-fc4f-4913-b774-f76924d42287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:45.948817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa635e8-fc4f-4913-b774-f76924d42287 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:45.949115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa635e8-fc4f-4913-b774-f76924d42287 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:45.949386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa635e8-fc4f-4913-b774-f76924d42287 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:45.950191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa635e8-fc4f-4913-b774-f76924d42287 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:45.951593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa635e8-fc4f-4913-b774-f76924d42287 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:45.953923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:45.971331 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 507/1012] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Jul 2 20:45:45 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:45:46.030398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ad81a-9719-4fdc-8e33-0bd40b7e7cf0 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:46.066783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:46.080150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977a2c5-3a0d-4368-bd94-df62b8f66c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:46.080965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977a2c5-3a0d-4368-bd94-df62b8f66c01 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:46.081242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977a2c5-3a0d-4368-bd94-df62b8f66c01 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:46.081512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977a2c5-3a0d-4368-bd94-df62b8f66c01 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:46.082186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977a2c5-3a0d-4368-bd94-df62b8f66c01 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:46.083590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977a2c5-3a0d-4368-bd94-df62b8f66c01 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:46.096343 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-d977a2c5-3a0d-4368-bd94-df62b8f66c01 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 20:45:46.096343 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:46.096343 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:46.096343 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:46.096343 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:46.096343 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:46.096343 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:46.096343 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:46.096343 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 20:45:46.096343 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:46.096343 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:46.096343 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:46.096343 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:46.096343 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:46.096343 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:46.096343 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:46.096343 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:46.097405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:46.097405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:46.097405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:46.097405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:46.097405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:46.097405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:46.097405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:46.097405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:46.097405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:46.097405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:46.097405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:46.097405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:46.097405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:46.097405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:46.097405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:46.097405 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:46.098492 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:46.098492 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:46.098492 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:46.098492 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:46.098492 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:46.098492 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:46.098492 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:46.098492 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:46.098492 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:46.098492 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:46.098492 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:46.098492 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:46.098492 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 20:45:46.098492 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:46.098492 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 506/1013] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:46.105512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa635e8-fc4f-4913-b774-f76924d42287 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:46.219774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa635e8-fc4f-4913-b774-f76924d42287 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:46.254773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9967f-6f29-418d-b006-4b00c84e4efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:46.255848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9967f-6f29-418d-b006-4b00c84e4efe None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:46.256363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9967f-6f29-418d-b006-4b00c84e4efe None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:46.256848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9967f-6f29-418d-b006-4b00c84e4efe None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:46.257775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9967f-6f29-418d-b006-4b00c84e4efe None admin] RBAC: Adding query filter params (name=compute) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:46.258293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9967f-6f29-418d-b006-4b00c84e4efe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:46.259883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9967f-6f29-418d-b006-4b00c84e4efe None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:46.265375 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 508/1014] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Jul 2 20:45:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:46.270950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977a2c5-3a0d-4368-bd94-df62b8f66c01 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:46.366918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f21ef-eff6-433d-8df9-1d0047f83ece None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:46.367274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f21ef-eff6-433d-8df9-1d0047f83ece None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:46.367463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f21ef-eff6-433d-8df9-1d0047f83ece None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:46.368876 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 509/1015] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:45:46.374504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977a2c5-3a0d-4368-bd94-df62b8f66c01 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:46.374653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1068fa7-241d-4620-bf1e-838d1e3ee786 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:46.374907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1068fa7-241d-4620-bf1e-838d1e3ee786 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:46.375185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1068fa7-241d-4620-bf1e-838d1e3ee786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:46.394183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e1068fa7-241d-4620-bf1e-838d1e3ee786 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:46.395420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e1068fa7-241d-4620-bf1e-838d1e3ee786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:46.409029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a534ae9-7360-418a-807e-ae482a769cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:46.409696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a534ae9-7360-418a-807e-ae482a769cb8 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:46.409976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a534ae9-7360-418a-807e-ae482a769cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:46.410249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a534ae9-7360-418a-807e-ae482a769cb8 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:46.410951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a534ae9-7360-418a-807e-ae482a769cb8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:46.411257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a534ae9-7360-418a-807e-ae482a769cb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:46.412760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a534ae9-7360-418a-807e-ae482a769cb8 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:46.417940 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 507/1016] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Jul 2 20:45:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:46.423738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a534ae9-7360-418a-807e-ae482a769cb8 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:46.455617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:46.471559 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 510/1017] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:46 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:46.481180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:46.496444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1068fa7-241d-4620-bf1e-838d1e3ee786 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:46.531265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a534ae9-7360-418a-807e-ae482a769cb8 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:46.568010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012380f-082c-4e92-958d-607ac0eac057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:46.568944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012380f-082c-4e92-958d-607ac0eac057 None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:46.569090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012380f-082c-4e92-958d-607ac0eac057 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:46.569266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012380f-082c-4e92-958d-607ac0eac057 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:46.570043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012380f-082c-4e92-958d-607ac0eac057 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:46.571426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012380f-082c-4e92-958d-607ac0eac057 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:46.591480 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 508/1018] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Jul 2 20:45:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:45:46.606770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1068fa7-241d-4620-bf1e-838d1e3ee786 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:46.651664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcf723-8afe-4632-bef7-621afd88a158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:46.652519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcf723-8afe-4632-bef7-621afd88a158 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:46.652806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcf723-8afe-4632-bef7-621afd88a158 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:46.653085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcf723-8afe-4632-bef7-621afd88a158 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:46.654416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcf723-8afe-4632-bef7-621afd88a158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:46.655912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcf723-8afe-4632-bef7-621afd88a158 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:46.657849 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 511/1019] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:46.663975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012380f-082c-4e92-958d-607ac0eac057 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:46.775119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012380f-082c-4e92-958d-607ac0eac057 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:46.787234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:46.816708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637e70e-5665-4ed1-8658-fde1cc61d442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:46.817380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637e70e-5665-4ed1-8658-fde1cc61d442 None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:46.817665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637e70e-5665-4ed1-8658-fde1cc61d442 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:46.817945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637e70e-5665-4ed1-8658-fde1cc61d442 None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:46.818671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637e70e-5665-4ed1-8658-fde1cc61d442 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:46.820381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637e70e-5665-4ed1-8658-fde1cc61d442 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:46.849108 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 509/1020] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Jul 2 20:45:46 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:45:48.306406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413c42f-0144-41c0-a41a-b4b81329b44e None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:48.306954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413c42f-0144-41c0-a41a-b4b81329b44e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:48.306954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413c42f-0144-41c0-a41a-b4b81329b44e None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:48.308539 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 512/1021] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:48.313729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f9981-73e5-4ff7-aa0a-9b5053743b23 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:48.314149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f9981-73e5-4ff7-aa0a-9b5053743b23 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:48.314227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f9981-73e5-4ff7-aa0a-9b5053743b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:48.330656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c89f9981-73e5-4ff7-aa0a-9b5053743b23 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:48.331823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c89f9981-73e5-4ff7-aa0a-9b5053743b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:48.398494 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 510/1022] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:45:48.422370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413c42f-0144-41c0-a41a-b4b81329b44e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:48.478560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:48.528178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413c42f-0144-41c0-a41a-b4b81329b44e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:48.563020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce2278-fc9c-4716-8820-9e2d32038c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:48.563806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce2278-fc9c-4716-8820-9e2d32038c64 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:48.564104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce2278-fc9c-4716-8820-9e2d32038c64 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:48.564376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce2278-fc9c-4716-8820-9e2d32038c64 None admin] PATH_INFO: `/v3/services/image` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:48.565013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce2278-fc9c-4716-8820-9e2d32038c64 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:48.566360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce2278-fc9c-4716-8820-9e2d32038c64 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:48.578555 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-e5ce2278-fc9c-4716-8820-9e2d32038c64 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 20:45:48.578555 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:48.578555 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:48.578555 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:48.578555 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:48.578555 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:48.578555 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:48.578555 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:48.578555 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 20:45:48.578555 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:48.578555 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:48.578555 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:48.578555 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:48.578555 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:48.578555 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:48.578555 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:48.578555 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:48.580471 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:48.580471 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:48.580471 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:48.580471 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:48.580471 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:48.580471 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:48.580471 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:48.580471 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:48.580471 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:48.580471 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:48.580471 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:48.580471 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:48.580471 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:48.580471 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:48.580471 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:48.580471 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:48.582443 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:48.582443 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:48.582443 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:48.582443 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:48.582443 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:48.582443 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:48.582443 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:48.582443 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:48.582443 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:48.582443 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:48.582443 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:48.582443 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:48.582443 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 20:45:48.582443 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:48.584661 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 513/1023] 10.222.0.43 () {56 vars in 1105 bytes} [Sat Jul 2 20:45:48 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:48.585951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f9981-73e5-4ff7-aa0a-9b5053743b23 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:48.687770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:48.699836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f9981-73e5-4ff7-aa0a-9b5053743b23 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:48.733711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d1d54-9beb-4674-9c88-20ffd4ffd759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:48.734380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d1d54-9beb-4674-9c88-20ffd4ffd759 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:48.734661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d1d54-9beb-4674-9c88-20ffd4ffd759 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:48.734930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d1d54-9beb-4674-9c88-20ffd4ffd759 None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:48.735623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d1d54-9beb-4674-9c88-20ffd4ffd759 None admin] RBAC: Adding query filter params (name=image) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:48.735928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d1d54-9beb-4674-9c88-20ffd4ffd759 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:48.737342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d1d54-9beb-4674-9c88-20ffd4ffd759 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:48.746919 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 511/1024] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:48.748156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce2278-fc9c-4716-8820-9e2d32038c64 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:48.855908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce2278-fc9c-4716-8820-9e2d32038c64 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:48.872090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:48.891191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f1c81-43f5-45de-8bdf-6bbe81895737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:48.891859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f1c81-43f5-45de-8bdf-6bbe81895737 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:48.892164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f1c81-43f5-45de-8bdf-6bbe81895737 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:48.892434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f1c81-43f5-45de-8bdf-6bbe81895737 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:48.893128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f1c81-43f5-45de-8bdf-6bbe81895737 None admin] RBAC: Adding query filter params (type=image) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:48.893434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f1c81-43f5-45de-8bdf-6bbe81895737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:48.894791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f1c81-43f5-45de-8bdf-6bbe81895737 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:48.899975 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 514/1025] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:48.905919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d1d54-9beb-4674-9c88-20ffd4ffd759 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:49.010655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d1d54-9beb-4674-9c88-20ffd4ffd759 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:49.043461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024bf05-f707-4f70-9429-78a95c3de2a7 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:49.043749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024bf05-f707-4f70-9429-78a95c3de2a7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:49.044030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024bf05-f707-4f70-9429-78a95c3de2a7 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:49.046076 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 515/1026] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:45:49.051306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdb059-fe57-4947-8c16-15617ef03b09 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:49.051564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdb059-fe57-4947-8c16-15617ef03b09 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:49.051739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbe5e2-ee80-48a0-adeb-762520e8a842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:49.051854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdb059-fe57-4947-8c16-15617ef03b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:49.052420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbe5e2-ee80-48a0-adeb-762520e8a842 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:49.052699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbe5e2-ee80-48a0-adeb-762520e8a842 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:49.052975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbe5e2-ee80-48a0-adeb-762520e8a842 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:49.053753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbe5e2-ee80-48a0-adeb-762520e8a842 None admin] RBAC: Adding query filter params (interface=public, service_id=821de779161e471eae16494a1d9f0d9e, region_id=RegionOne) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:49.054104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbe5e2-ee80-48a0-adeb-762520e8a842 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:49.055468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbe5e2-ee80-48a0-adeb-762520e8a842 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:49.061378 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 512/1027] 10.222.0.43 () {56 vars in 1251 bytes} [Sat Jul 2 20:45:48 2022] GET /identity/v3/endpoints?service_id=821de779161e471eae16494a1d9f0d9e&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:49.066560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbe5e2-ee80-48a0-adeb-762520e8a842 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:49.070688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c1fdb059-fe57-4947-8c16-15617ef03b09 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:49.071462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c1fdb059-fe57-4947-8c16-15617ef03b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:49.095857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:49.144552 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 516/1028] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:45:49.169020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdb059-fe57-4947-8c16-15617ef03b09 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:49.181275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbe5e2-ee80-48a0-adeb-762520e8a842 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:49.214975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1a3a1-a40c-4beb-83a4-cfe083476dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:49.215633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1a3a1-a40c-4beb-83a4-cfe083476dbf None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:49.215909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1a3a1-a40c-4beb-83a4-cfe083476dbf None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:49.216213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1a3a1-a40c-4beb-83a4-cfe083476dbf None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:49.216878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1a3a1-a40c-4beb-83a4-cfe083476dbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:49.218369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1a3a1-a40c-4beb-83a4-cfe083476dbf None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:49.224703 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 513/1029] 10.222.0.43 () {56 vars in 1087 bytes} [Sat Jul 2 20:45:49 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 20:45:49.225868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547be71-a5f3-46c8-87ca-ad3265c2afd2 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:49.226381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547be71-a5f3-46c8-87ca-ad3265c2afd2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:49.226381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547be71-a5f3-46c8-87ca-ad3265c2afd2 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:49.227613 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 514/1030] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:49.233317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c36f9-098d-47ae-bca4-314aeab4e02f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:49.233610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c36f9-098d-47ae-bca4-314aeab4e02f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:49.233868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c36f9-098d-47ae-bca4-314aeab4e02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:49.257090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bc0c36f9-098d-47ae-bca4-314aeab4e02f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:49.258522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bc0c36f9-098d-47ae-bca4-314aeab4e02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:49.274998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdb059-fe57-4947-8c16-15617ef03b09 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:49.287384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:49.316175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2a659-5023-4813-a41e-53fcbaa9135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:49.317240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2a659-5023-4813-a41e-53fcbaa9135f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:49.317350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2a659-5023-4813-a41e-53fcbaa9135f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:49.317537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2a659-5023-4813-a41e-53fcbaa9135f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:49.330382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2a659-5023-4813-a41e-53fcbaa9135f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:49.338884 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-d4b2a659-5023-4813-a41e-53fcbaa9135f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 20:45:49.338884 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:49.338884 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:49.338884 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:49.338884 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:49.338884 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:49.338884 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:49.338884 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:49.338884 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:49.338884 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:49.338884 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:49.338884 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:49.338884 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:49.338884 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:49.338884 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:49.338884 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:49.339927 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:49.339927 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:49.339927 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:49.339927 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:49.339927 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:49.339927 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:49.339927 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:49.339927 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:49.339927 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:49.339927 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:49.339927 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:49.339927 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:49.339927 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:49.339927 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:49.339927 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:49.339927 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:49.346410 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:49.346410 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:49.346410 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:49.346410 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:49.346410 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:49.346410 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:49.346410 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:49.346410 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:49.346410 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:49.346410 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:49.346410 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 20:45:49.346410 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:49.346410 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 517/1031] 10.222.0.43 () {56 vars in 1120 bytes} [Sat Jul 2 20:45:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:49.347135 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 515/1032] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:49.347540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2a659-5023-4813-a41e-53fcbaa9135f None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:49.368221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c36f9-098d-47ae-bca4-314aeab4e02f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:49.386407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:49.461728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2a659-5023-4813-a41e-53fcbaa9135f None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:49.484989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c36f9-098d-47ae-bca4-314aeab4e02f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:49.494484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35137362-6bc4-41ff-ad88-a655cbc5c3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:49.495149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35137362-6bc4-41ff-ad88-a655cbc5c3e7 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:49.495437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35137362-6bc4-41ff-ad88-a655cbc5c3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:49.495690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35137362-6bc4-41ff-ad88-a655cbc5c3e7 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:49.496456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35137362-6bc4-41ff-ad88-a655cbc5c3e7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:49.496757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35137362-6bc4-41ff-ad88-a655cbc5c3e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:49.498116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35137362-6bc4-41ff-ad88-a655cbc5c3e7 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:49.506406 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 518/1033] 10.222.0.43 () {56 vars in 1115 bytes} [Sat Jul 2 20:45:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:49.512823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35137362-6bc4-41ff-ad88-a655cbc5c3e7 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:49.527122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd77a5-5951-4bae-b638-29ca940882ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:49.527857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd77a5-5951-4bae-b638-29ca940882ab None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:49.528164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd77a5-5951-4bae-b638-29ca940882ab None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:49.528437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd77a5-5951-4bae-b638-29ca940882ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:49.529601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd77a5-5951-4bae-b638-29ca940882ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:49.531059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd77a5-5951-4bae-b638-29ca940882ab None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:49.537356 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 516/1034] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:49.539071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd77a5-5951-4bae-b638-29ca940882ab None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:49.550895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:49.619686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35137362-6bc4-41ff-ad88-a655cbc5c3e7 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:49.626876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:49.654789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd77a5-5951-4bae-b638-29ca940882ab None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:49.662602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4423a-91d1-44d7-8167-4b005670309a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:49.663705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4423a-91d1-44d7-8167-4b005670309a None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:49.663979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4423a-91d1-44d7-8167-4b005670309a None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:49.664272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4423a-91d1-44d7-8167-4b005670309a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:49.675268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4423a-91d1-44d7-8167-4b005670309a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:49.676755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4423a-91d1-44d7-8167-4b005670309a None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:49.691224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34cf32-8498-4a90-9bd9-cdce24782867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:49.691902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34cf32-8498-4a90-9bd9-cdce24782867 None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:49.692221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34cf32-8498-4a90-9bd9-cdce24782867 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:49.692499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34cf32-8498-4a90-9bd9-cdce24782867 None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:49.693878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34cf32-8498-4a90-9bd9-cdce24782867 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:49.694325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-44d4423a-91d1-44d7-8167-4b005670309a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:49.694325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:49.694325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:49.694325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:49.694325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:49.694325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:49.694325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:49.694325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:49.694325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:49.694325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:49.694325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:49.694325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:49.694325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:49.694325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:49.694325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:49.695257 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:49.695257 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:49.695257 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:49.695257 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:49.695257 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:49.695257 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:49.695257 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:49.695257 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:49.695257 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:49.695257 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:49.695257 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:49.695257 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:49.695257 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:49.695257 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:49.695257 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:49.695257 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:49.695257 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:49.696326 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:49.696326 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:49.696326 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:49.696326 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:49.696326 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 519/1035] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:49.700681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34cf32-8498-4a90-9bd9-cdce24782867 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:49.701330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4423a-91d1-44d7-8167-4b005670309a None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:49.731219 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 517/1036] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Jul 2 20:45:49 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:45:49.796850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:49.816097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4423a-91d1-44d7-8167-4b005670309a None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:49.860317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae5051-4404-44ca-add1-fc82f3cb7842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:49.860999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae5051-4404-44ca-add1-fc82f3cb7842 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:49.861283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae5051-4404-44ca-add1-fc82f3cb7842 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:49.861558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae5051-4404-44ca-add1-fc82f3cb7842 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:49.862284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae5051-4404-44ca-add1-fc82f3cb7842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:49.862593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae5051-4404-44ca-add1-fc82f3cb7842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:49.864131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae5051-4404-44ca-add1-fc82f3cb7842 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:49.880429 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 520/1037] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:49.883863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34cf32-8498-4a90-9bd9-cdce24782867 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:49.993461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34cf32-8498-4a90-9bd9-cdce24782867 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:50.028143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcfb68-17de-4d08-9211-308ac1780698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:50.028943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcfb68-17de-4d08-9211-308ac1780698 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:50.029220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcfb68-17de-4d08-9211-308ac1780698 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:50.029489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcfb68-17de-4d08-9211-308ac1780698 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:50.037176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcfb68-17de-4d08-9211-308ac1780698 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:50.038659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcfb68-17de-4d08-9211-308ac1780698 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:50.040411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:50.055151 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-dbfcfb68-17de-4d08-9211-308ac1780698 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:45:50.055151 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:50.055151 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:50.055151 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:50.055151 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:50.055151 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:50.055151 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:50.055151 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:50.055151 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:50.055151 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:50.055151 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:50.055151 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:50.055151 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:50.055151 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:50.055151 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:50.055151 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:50.056415 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:50.056415 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:50.056415 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:50.056415 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:50.056415 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:50.056415 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:50.056415 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:50.056415 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:50.056415 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:50.056415 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:50.056415 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:50.056415 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:50.056415 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:50.056415 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:50.056415 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:50.056415 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:50.056415 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:50.056415 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:50.062328 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:50.062328 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:50.062328 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:50.062328 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:50.062328 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:50.062328 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:50.062328 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:50.062328 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:50.062328 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:45:50.062328 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:50.062328 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 518/1038] 10.222.0.43 () {56 vars in 1093 bytes} [Sat Jul 2 20:45:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:50.064751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae5051-4404-44ca-add1-fc82f3cb7842 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:50.169118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae5051-4404-44ca-add1-fc82f3cb7842 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:50.204580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3542116-4a29-454a-9f26-52f0ac86c526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:50.205250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3542116-4a29-454a-9f26-52f0ac86c526 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:50.205531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3542116-4a29-454a-9f26-52f0ac86c526 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:50.205804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3542116-4a29-454a-9f26-52f0ac86c526 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:50.206632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3542116-4a29-454a-9f26-52f0ac86c526 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:50.206943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3542116-4a29-454a-9f26-52f0ac86c526 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:50.208475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3542116-4a29-454a-9f26-52f0ac86c526 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:50.225950 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 521/1039] 10.222.0.43 () {56 vars in 1133 bytes} [Sat Jul 2 20:45:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:50.231673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcfb68-17de-4d08-9211-308ac1780698 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:50.334080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcfb68-17de-4d08-9211-308ac1780698 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:50.369601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c648c-adeb-476d-832b-ca67b19337dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:50.371104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c648c-adeb-476d-832b-ca67b19337dc None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:50.371612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c648c-adeb-476d-832b-ca67b19337dc None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:50.372118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c648c-adeb-476d-832b-ca67b19337dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:50.440552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:50.445244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c648c-adeb-476d-832b-ca67b19337dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:50.447186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c648c-adeb-476d-832b-ca67b19337dc None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:50.551523 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 519/1040] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:45:50 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:45:50.557369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3542116-4a29-454a-9f26-52f0ac86c526 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:50.560459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:50.668860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3542116-4a29-454a-9f26-52f0ac86c526 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:50.703231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329ef35-d562-44eb-a64f-7d7d72d60b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:50.704017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329ef35-d562-44eb-a64f-7d7d72d60b3f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:50.704320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329ef35-d562-44eb-a64f-7d7d72d60b3f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:50.704595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329ef35-d562-44eb-a64f-7d7d72d60b3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:50.714905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329ef35-d562-44eb-a64f-7d7d72d60b3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:50.716368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329ef35-d562-44eb-a64f-7d7d72d60b3f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:50.733917 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-5329ef35-d562-44eb-a64f-7d7d72d60b3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:50.733917 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:50.733917 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:50.733917 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:50.733917 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:50.733917 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:50.733917 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:50.733917 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:50.733917 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:50.733917 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:50.733917 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:50.733917 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:50.733917 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:50.733917 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:50.733917 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:50.734843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:50.734843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:50.734843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:50.734843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:50.734843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:50.734843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:50.734843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:50.734843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:50.734843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:50.734843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:50.734843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:50.734843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:50.734843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:50.734843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:50.734843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:50.734843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:50.734843 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:50.735793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:50.735793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:50.735793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:50.735793 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:50.739827 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 522/1041] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:50.740891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c648c-adeb-476d-832b-ca67b19337dc None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:50.836708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:50.841315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c648c-adeb-476d-832b-ca67b19337dc None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:50.875874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93fa5f-c760-48d8-832e-4645ee6e9053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:50.876573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93fa5f-c760-48d8-832e-4645ee6e9053 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:50.876849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93fa5f-c760-48d8-832e-4645ee6e9053 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:50.877123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93fa5f-c760-48d8-832e-4645ee6e9053 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:50.877836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93fa5f-c760-48d8-832e-4645ee6e9053 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:50.878138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93fa5f-c760-48d8-832e-4645ee6e9053 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:50.879516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93fa5f-c760-48d8-832e-4645ee6e9053 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:50.895944 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 520/1042] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:50.896947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329ef35-d562-44eb-a64f-7d7d72d60b3f None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:50.956668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:51.002710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329ef35-d562-44eb-a64f-7d7d72d60b3f None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:51.036733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6eede-588e-4a30-9acb-5b528ee5d440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:51.037528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6eede-588e-4a30-9acb-5b528ee5d440 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:51.037804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6eede-588e-4a30-9acb-5b528ee5d440 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:51.038135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6eede-588e-4a30-9acb-5b528ee5d440 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:51.044996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6eede-588e-4a30-9acb-5b528ee5d440 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:51.046753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6eede-588e-4a30-9acb-5b528ee5d440 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:51.063065 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-62c6eede-588e-4a30-9acb-5b528ee5d440 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:51.063065 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:51.063065 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:51.063065 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:51.063065 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:51.063065 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:51.063065 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:51.063065 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:51.063065 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:51.063065 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:51.063065 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:51.063065 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:51.063065 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:51.063065 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:51.063065 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:51.064090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:51.064090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:51.064090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:51.064090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:51.064090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:51.064090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:51.064090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:51.064090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:51.064090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:51.064090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:51.064090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:51.064090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:51.064090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:51.064090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:51.064090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:51.064090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:51.064090 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:51.065026 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:51.065026 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:51.065026 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:51.065026 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:51.065026 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:51.065026 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:51.065026 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:51.065026 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:51.068245 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 523/1043] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:51.070307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93fa5f-c760-48d8-832e-4645ee6e9053 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:51.176159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93fa5f-c760-48d8-832e-4645ee6e9053 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:51.209795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef80bc-e87a-4bac-9183-277abd92c00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:51.210407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef80bc-e87a-4bac-9183-277abd92c00c None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:51.210681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef80bc-e87a-4bac-9183-277abd92c00c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:51.210955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef80bc-e87a-4bac-9183-277abd92c00c None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:51.211724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef80bc-e87a-4bac-9183-277abd92c00c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:51.212032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef80bc-e87a-4bac-9183-277abd92c00c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:51.213513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef80bc-e87a-4bac-9183-277abd92c00c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:51.226308 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 521/1044] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:51.232221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6eede-588e-4a30-9acb-5b528ee5d440 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:51.337791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6eede-588e-4a30-9acb-5b528ee5d440 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:51.351513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:51.372736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72470af9-f12d-4500-8517-65357815b998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:51.373385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72470af9-f12d-4500-8517-65357815b998 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:51.373664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72470af9-f12d-4500-8517-65357815b998 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:51.374044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72470af9-f12d-4500-8517-65357815b998 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:51.374864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72470af9-f12d-4500-8517-65357815b998 None admin] RBAC: Adding query filter params (role.id=1ef9541aff044694894c631ef9e92fcb, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=aa3e290fa5384f9bac3fec771cebf653) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:51.375170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72470af9-f12d-4500-8517-65357815b998 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:51.376637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72470af9-f12d-4500-8517-65357815b998 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:51.382703 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 524/1045] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:45:51 2022] GET /identity/v3/role_assignments?user.id=aa3e290fa5384f9bac3fec771cebf653&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=1ef9541aff044694894c631ef9e92fcb => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:51.535678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47233b-7c58-4da2-b079-a692149d061f None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:51.536250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47233b-7c58-4da2-b079-a692149d061f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:51.536250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47233b-7c58-4da2-b079-a692149d061f None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:51.537734 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 522/1046] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:51.543528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bd1f0-54e1-44fa-9444-3192590772d2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:51.543842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bd1f0-54e1-44fa-9444-3192590772d2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:51.544123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bd1f0-54e1-44fa-9444-3192590772d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:51.562512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-585bd1f0-54e1-44fa-9444-3192590772d2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:51.563687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-585bd1f0-54e1-44fa-9444-3192590772d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:51.633494 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 525/1047] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:51.658468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47233b-7c58-4da2-b079-a692149d061f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:51.679216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:51.765213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47233b-7c58-4da2-b079-a692149d061f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:51.800481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e8e35-7d63-405c-9e13-055055ab2029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:51.801198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e8e35-7d63-405c-9e13-055055ab2029 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:51.801479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e8e35-7d63-405c-9e13-055055ab2029 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:51.801751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e8e35-7d63-405c-9e13-055055ab2029 None admin] PATH_INFO: `/v3/services/image` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:51.802425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e8e35-7d63-405c-9e13-055055ab2029 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:51.803826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e8e35-7d63-405c-9e13-055055ab2029 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:51.815642 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-6f7e8e35-7d63-405c-9e13-055055ab2029 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 20:45:51.815642 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:51.815642 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:45:51.815642 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:45:51.815642 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:45:51.815642 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:45:51.815642 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:45:51.815642 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:51.815642 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 20:45:51.815642 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:51.815642 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:45:51.815642 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:51.815642 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:51.815642 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:51.815642 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:51.815642 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:51.815642 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:51.816871 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:51.816871 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:51.816871 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:51.816871 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:51.816871 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:51.816871 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:51.816871 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:45:51.816871 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:45:51.816871 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:45:51.816871 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:45:51.816871 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:51.816871 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:51.816871 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:51.816871 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:51.816871 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:51.816871 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:51.817761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:51.817761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:51.817761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:51.817761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:51.817761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:51.817761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:51.817761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:51.817761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:51.817761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:51.817761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:51.817761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:45:51.817761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:45:51.817761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 20:45:51.817761 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:51.820529 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 523/1048] 10.222.0.43 () {56 vars in 1105 bytes} [Sat Jul 2 20:45:51 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:51.823390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bd1f0-54e1-44fa-9444-3192590772d2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:51.931244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bd1f0-54e1-44fa-9444-3192590772d2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:51.941367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:51.967312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73effef9-f7bf-41ad-a6c0-0987b1aecd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:51.967986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73effef9-f7bf-41ad-a6c0-0987b1aecd84 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:51.969923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73effef9-f7bf-41ad-a6c0-0987b1aecd84 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:51.969923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73effef9-f7bf-41ad-a6c0-0987b1aecd84 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:51.969923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73effef9-f7bf-41ad-a6c0-0987b1aecd84 None admin] RBAC: Adding query filter params (name=image) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:51.969923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73effef9-f7bf-41ad-a6c0-0987b1aecd84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:51.971080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73effef9-f7bf-41ad-a6c0-0987b1aecd84 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:51.976317 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 526/1049] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:51.982056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e8e35-7d63-405c-9e13-055055ab2029 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:52.067462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:52.097078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e8e35-7d63-405c-9e13-055055ab2029 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:52.103118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccd3b9-e959-42b3-a7cb-40617e7354be None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:52.103383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccd3b9-e959-42b3-a7cb-40617e7354be None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:52.103679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccd3b9-e959-42b3-a7cb-40617e7354be None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:52.105227 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 527/1050] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:52.109908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db93734-8a25-4970-b1a0-c1c0f22d391f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:52.110193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db93734-8a25-4970-b1a0-c1c0f22d391f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:52.110473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db93734-8a25-4970-b1a0-c1c0f22d391f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:52.127012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5db93734-8a25-4970-b1a0-c1c0f22d391f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:52.128337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5db93734-8a25-4970-b1a0-c1c0f22d391f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:52.132531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8485d3-5a21-4673-977b-5076a867b60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:52.133200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8485d3-5a21-4673-977b-5076a867b60b None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:52.133481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8485d3-5a21-4673-977b-5076a867b60b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:52.133760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8485d3-5a21-4673-977b-5076a867b60b None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:52.134465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8485d3-5a21-4673-977b-5076a867b60b None admin] RBAC: Adding query filter params (type=image) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:52.134773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8485d3-5a21-4673-977b-5076a867b60b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:52.136269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8485d3-5a21-4673-977b-5076a867b60b None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:52.141777 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 524/1051] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:52.147432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8485d3-5a21-4673-977b-5076a867b60b None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:52.197073 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 528/1052] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:45:52.222088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db93734-8a25-4970-b1a0-c1c0f22d391f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:52.252535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8485d3-5a21-4673-977b-5076a867b60b None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:52.287322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a54849-ac3a-420b-adb0-25dd14879445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:52.288349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a54849-ac3a-420b-adb0-25dd14879445 None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:52.288807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a54849-ac3a-420b-adb0-25dd14879445 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:52.289291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a54849-ac3a-420b-adb0-25dd14879445 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:52.290032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a54849-ac3a-420b-adb0-25dd14879445 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:52.291411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a54849-ac3a-420b-adb0-25dd14879445 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:52.320151 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 525/1053] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Jul 2 20:45:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:45:52.333551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db93734-8a25-4970-b1a0-c1c0f22d391f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:52.335614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:52.380683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36130fd5-8db9-4731-9f55-8adeafd35a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:52.381490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36130fd5-8db9-4731-9f55-8adeafd35a8b None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:52.381818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36130fd5-8db9-4731-9f55-8adeafd35a8b None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:52.382096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36130fd5-8db9-4731-9f55-8adeafd35a8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:52.394456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36130fd5-8db9-4731-9f55-8adeafd35a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:52.402543 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-36130fd5-8db9-4731-9f55-8adeafd35a8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:45:52.402543 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:52.402543 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:52.402543 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:52.402543 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:52.402543 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:52.402543 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:52.402543 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:52.402543 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:52.402543 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:52.402543 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:52.402543 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:52.402543 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:52.402543 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:52.402543 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:52.402543 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:52.403635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:52.403635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:52.403635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:52.403635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:52.403635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:52.403635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:52.403635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:52.403635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:52.403635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:52.403635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:52.403635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:52.403635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:52.403635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:52.403635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:52.403635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:52.403635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:52.404510 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:52.404510 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:52.404510 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:52.404510 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:52.404510 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:52.404510 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:52.404510 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:52.404510 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:52.404510 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:52.404510 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:52.404510 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:45:52.404510 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:52.404510 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 529/1054] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:45:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:52.413661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a54849-ac3a-420b-adb0-25dd14879445 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:52.416947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:52.528976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a54849-ac3a-420b-adb0-25dd14879445 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:52.564633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1c52d-e6b7-448a-9dfa-c5fe01490f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:52.566017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1c52d-e6b7-448a-9dfa-c5fe01490f9d None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:52.566304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1c52d-e6b7-448a-9dfa-c5fe01490f9d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:52.566585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1c52d-e6b7-448a-9dfa-c5fe01490f9d None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:52.567337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1c52d-e6b7-448a-9dfa-c5fe01490f9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:52.567647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1c52d-e6b7-448a-9dfa-c5fe01490f9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:52.569136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1c52d-e6b7-448a-9dfa-c5fe01490f9d None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:52.578751 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 526/1055] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:45:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:52.584251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36130fd5-8db9-4731-9f55-8adeafd35a8b None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:52.693531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36130fd5-8db9-4731-9f55-8adeafd35a8b None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:52.729573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f24ca8-8f9d-4f13-a5b1-262e0903e421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:52.730456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24ca8-8f9d-4f13-a5b1-262e0903e421 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:52.730733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24ca8-8f9d-4f13-a5b1-262e0903e421 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:52.731012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24ca8-8f9d-4f13-a5b1-262e0903e421 None admin] PATH_INFO: `/v3/users/8ba50672816846429cb9be107ebdeb4f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:52.745091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f24ca8-8f9d-4f13-a5b1-262e0903e421 None admin] RBAC: Authorizing `identity:get_user(user_id=8ba50672816846429cb9be107ebdeb4f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:52.746548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f24ca8-8f9d-4f13-a5b1-262e0903e421 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:52.753984 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 530/1056] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:45:52 2022] GET /identity/v3/users/8ba50672816846429cb9be107ebdeb4f => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:52.755237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1c52d-e6b7-448a-9dfa-c5fe01490f9d None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:52.821659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:52.861726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1c52d-e6b7-448a-9dfa-c5fe01490f9d None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:52.894960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f4e00-2fb6-4ac9-ab8d-0b49a333f64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:52.895609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f4e00-2fb6-4ac9-ab8d-0b49a333f64b None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:52.895891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f4e00-2fb6-4ac9-ab8d-0b49a333f64b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:52.896268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f4e00-2fb6-4ac9-ab8d-0b49a333f64b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:52.962922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f4e00-2fb6-4ac9-ab8d-0b49a333f64b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:52.964440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f4e00-2fb6-4ac9-ab8d-0b49a333f64b None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:53.024088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:53.071317 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 527/1057] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:45:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:45:53.078687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f24ca8-8f9d-4f13-a5b1-262e0903e421 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:53.100647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:53.188072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f24ca8-8f9d-4f13-a5b1-262e0903e421 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:53.222176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaebae6-1134-4986-aef5-ce49924df78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:53.223126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaebae6-1134-4986-aef5-ce49924df78d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:53.223458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaebae6-1134-4986-aef5-ce49924df78d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:53.223735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaebae6-1134-4986-aef5-ce49924df78d None admin] PATH_INFO: `/v3/projects/23c137036dae40ef988057391cd79107` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:53.224976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaebae6-1134-4986-aef5-ce49924df78d None admin] RBAC: Authorizing `identity:get_project(project_id=23c137036dae40ef988057391cd79107)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:53.226493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaebae6-1134-4986-aef5-ce49924df78d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:53.228438 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 531/1058] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:45:53 2022] GET /identity/v3/projects/23c137036dae40ef988057391cd79107 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:53.234462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f4e00-2fb6-4ac9-ab8d-0b49a333f64b None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:53.334347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f4e00-2fb6-4ac9-ab8d-0b49a333f64b None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:53.368564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f252b-458d-478c-8150-c4164f1dd20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:53.369215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f252b-458d-478c-8150-c4164f1dd20a None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:53.369495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f252b-458d-478c-8150-c4164f1dd20a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:53.369771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f252b-458d-478c-8150-c4164f1dd20a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:53.370583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f252b-458d-478c-8150-c4164f1dd20a None admin] RBAC: Adding query filter params (role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.project.id=23c137036dae40ef988057391cd79107, user.id=8ba50672816846429cb9be107ebdeb4f) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:53.370893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f252b-458d-478c-8150-c4164f1dd20a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:53.372364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f252b-458d-478c-8150-c4164f1dd20a None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:53.378059 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 528/1059] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:45:53 2022] GET /identity/v3/role_assignments?user.id=8ba50672816846429cb9be107ebdeb4f&scope.project.id=23c137036dae40ef988057391cd79107&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:53.674294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402823b9-5aee-4a2b-a881-4d234bc900a2 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:53.674841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402823b9-5aee-4a2b-a881-4d234bc900a2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:53.674841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402823b9-5aee-4a2b-a881-4d234bc900a2 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:53.676398 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 532/1060] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:53.682590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856db09-0dd4-4f01-9884-f7a5e99030b5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:53.683039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856db09-0dd4-4f01-9884-f7a5e99030b5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:53.683369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856db09-0dd4-4f01-9884-f7a5e99030b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:53.700695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9856db09-0dd4-4f01-9884-f7a5e99030b5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:53.701911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9856db09-0dd4-4f01-9884-f7a5e99030b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:53.727397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:53.775082 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 529/1061] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:53.799575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402823b9-5aee-4a2b-a881-4d234bc900a2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:53.891248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:53.909823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402823b9-5aee-4a2b-a881-4d234bc900a2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:53.945039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1a641-8c1f-4034-bbac-cf85e695dd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:53.945771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1a641-8c1f-4034-bbac-cf85e695dd91 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:53.946048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1a641-8c1f-4034-bbac-cf85e695dd91 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:53.946321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1a641-8c1f-4034-bbac-cf85e695dd91 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:53.956719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1a641-8c1f-4034-bbac-cf85e695dd91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:53.965219 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-b3f1a641-8c1f-4034-bbac-cf85e695dd91 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 20:45:53.965219 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:53.965219 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:53.965219 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:53.965219 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:53.965219 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:53.965219 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:53.965219 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:53.965219 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:53.965219 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:53.965219 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:53.965219 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:53.965219 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:53.965219 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:53.965219 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:53.965219 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:53.966252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:53.966252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:53.966252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:53.966252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:53.966252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:53.966252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:53.966252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:53.966252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:53.966252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:53.966252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:53.966252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:53.966252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:53.966252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:53.966252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:53.966252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:53.966252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:53.967185 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:53.967185 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:53.967185 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:53.967185 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:53.967185 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:53.967185 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:53.967185 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:53.967185 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:53.967185 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:53.967185 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:53.967185 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 20:45:53.967185 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:53.971687 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 533/1062] 10.222.0.43 () {56 vars in 1120 bytes} [Sat Jul 2 20:45:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:53.972569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856db09-0dd4-4f01-9884-f7a5e99030b5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:54.078546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856db09-0dd4-4f01-9884-f7a5e99030b5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:54.118466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097dc55-d44b-47ed-8311-cf93128cda53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:54.119139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097dc55-d44b-47ed-8311-cf93128cda53 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:54.119423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097dc55-d44b-47ed-8311-cf93128cda53 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:54.119697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097dc55-d44b-47ed-8311-cf93128cda53 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:54.120473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097dc55-d44b-47ed-8311-cf93128cda53 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:54.120781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097dc55-d44b-47ed-8311-cf93128cda53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:54.122163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097dc55-d44b-47ed-8311-cf93128cda53 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:54.130634 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 530/1063] 10.222.0.43 () {56 vars in 1115 bytes} [Sat Jul 2 20:45:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:54.136447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1a641-8c1f-4034-bbac-cf85e695dd91 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:54.244765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1a641-8c1f-4034-bbac-cf85e695dd91 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:54.278497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8006f2-57c5-460f-8c14-dae7df9bee61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:54.279292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8006f2-57c5-460f-8c14-dae7df9bee61 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:54.279603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8006f2-57c5-460f-8c14-dae7df9bee61 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:54.279880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8006f2-57c5-460f-8c14-dae7df9bee61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:54.292030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8006f2-57c5-460f-8c14-dae7df9bee61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:54.293568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8006f2-57c5-460f-8c14-dae7df9bee61 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:54.297064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:54.312712 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-4a8006f2-57c5-460f-8c14-dae7df9bee61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:54.312712 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:54.312712 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:54.312712 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:54.312712 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:54.312712 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:54.312712 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:54.312712 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:54.312712 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:54.312712 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:54.312712 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:54.312712 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:54.312712 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:54.312712 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:54.312712 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:54.313702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:54.313702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:54.313702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:54.313702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:54.313702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:54.313702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:54.313702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:54.313702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:54.313702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:54.313702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:54.313702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:54.313702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:54.313702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:54.313702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:54.313702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:54.313702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:54.313702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:54.314621 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:54.314621 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:54.314621 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:54.314621 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:54.316198 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 534/1064] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:54.319841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097dc55-d44b-47ed-8311-cf93128cda53 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:54.343884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:54.432483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097dc55-d44b-47ed-8311-cf93128cda53 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:54.470824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4f384-0ea6-4b82-a7c0-53b290e4914b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:54.471497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4f384-0ea6-4b82-a7c0-53b290e4914b None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:54.471777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4f384-0ea6-4b82-a7c0-53b290e4914b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:54.472024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4f384-0ea6-4b82-a7c0-53b290e4914b None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:54.472803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4f384-0ea6-4b82-a7c0-53b290e4914b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:54.473112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4f384-0ea6-4b82-a7c0-53b290e4914b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:54.474483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4f384-0ea6-4b82-a7c0-53b290e4914b None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:54.487328 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 531/1065] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:54.493162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8006f2-57c5-460f-8c14-dae7df9bee61 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:54.601839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8006f2-57c5-460f-8c14-dae7df9bee61 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:54.630568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d0e3d-d477-4538-9030-104755fb53e9 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:54.630814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d0e3d-d477-4538-9030-104755fb53e9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:54.631086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d0e3d-d477-4538-9030-104755fb53e9 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:54.632775 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 532/1066] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:45:54.637470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d0e66-a08a-4710-acb7-c1f90896ec92 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:54.637752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d0e66-a08a-4710-acb7-c1f90896ec92 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:54.638020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d0e66-a08a-4710-acb7-c1f90896ec92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:54.640481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014d48-ce95-40f7-9976-36e53ef41443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:54.641298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014d48-ce95-40f7-9976-36e53ef41443 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:54.641585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014d48-ce95-40f7-9976-36e53ef41443 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:54.641860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78014d48-ce95-40f7-9976-36e53ef41443 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:54.651112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78014d48-ce95-40f7-9976-36e53ef41443 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:54.652596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78014d48-ce95-40f7-9976-36e53ef41443 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:54.656432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-431d0e66-a08a-4710-acb7-c1f90896ec92 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:54.657773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-431d0e66-a08a-4710-acb7-c1f90896ec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:54.666748 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-78014d48-ce95-40f7-9976-36e53ef41443 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:45:54.666748 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:54.666748 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:54.666748 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:54.666748 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:54.666748 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:54.666748 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:54.666748 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:54.666748 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:54.666748 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:54.666748 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:54.666748 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:54.666748 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:54.666748 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:54.666748 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:54.666748 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:54.667858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:54.667858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:54.667858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:54.667858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:54.667858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:54.667858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:54.667858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:54.667858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:54.667858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:54.667858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:54.667858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:54.667858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:54.667858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:54.667858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:54.667858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:54.667858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:54.667858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:54.667858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:54.668910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:54.668910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:54.668910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:54.668910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:54.668910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:54.668910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:54.668910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:54.668910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:54.668910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:45:54.668910 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:54.668910 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 535/1067] 10.222.0.43 () {56 vars in 1093 bytes} [Sat Jul 2 20:45:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:54.674523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014d48-ce95-40f7-9976-36e53ef41443 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:54.740233 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 533/1068] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:45:54.748475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:54.763600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d0e66-a08a-4710-acb7-c1f90896ec92 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:54.774959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:54.798003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78014d48-ce95-40f7-9976-36e53ef41443 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:54.834214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10b42d-bde4-4b82-b1df-948558ba1b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:54.835224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10b42d-bde4-4b82-b1df-948558ba1b15 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:54.835739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10b42d-bde4-4b82-b1df-948558ba1b15 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:54.836256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10b42d-bde4-4b82-b1df-948558ba1b15 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:54.837303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10b42d-bde4-4b82-b1df-948558ba1b15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:54.837980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10b42d-bde4-4b82-b1df-948558ba1b15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:54.840553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10b42d-bde4-4b82-b1df-948558ba1b15 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:54.860675 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 536/1069] 10.222.0.43 () {56 vars in 1133 bytes} [Sat Jul 2 20:45:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:54.866229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10b42d-bde4-4b82-b1df-948558ba1b15 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:54.867493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d0e66-a08a-4710-acb7-c1f90896ec92 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:54.901826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f2d72-4c66-453b-bf12-291d421e78dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:54.902476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f2d72-4c66-453b-bf12-291d421e78dd None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:54.903046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f2d72-4c66-453b-bf12-291d421e78dd None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:54.903328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f2d72-4c66-453b-bf12-291d421e78dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:54.966344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10b42d-bde4-4b82-b1df-948558ba1b15 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:54.970222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f2d72-4c66-453b-bf12-291d421e78dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:54.972455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f2d72-4c66-453b-bf12-291d421e78dd None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:54.981221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:54.983844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:55.002522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a7258-5259-420d-949a-3eff54e78161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:55.003305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a7258-5259-420d-949a-3eff54e78161 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:55.003588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a7258-5259-420d-949a-3eff54e78161 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:55.003861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a7258-5259-420d-949a-3eff54e78161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:55.014333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a7258-5259-420d-949a-3eff54e78161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:55.015813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a7258-5259-420d-949a-3eff54e78161 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:55.035611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-397a7258-5259-420d-949a-3eff54e78161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:55.035611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:55.035611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:55.035611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:55.035611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:55.035611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:55.035611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:55.035611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:55.035611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:55.035611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:55.035611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:55.035611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:55.035611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:55.035611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:55.035611 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:55.036612 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:55.036612 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:55.036612 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:55.036612 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:55.036612 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:55.036612 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:55.036612 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:55.036612 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:55.036612 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:55.036612 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:55.036612 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:55.036612 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:55.036612 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:55.036612 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:55.036612 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:55.036612 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:55.036612 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:55.037574 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:55.037574 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:55.037574 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:55.037574 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:55.037574 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 537/1070] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:55.042585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a7258-5259-420d-949a-3eff54e78161 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:55.083674 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 534/1071] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:45:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 02 20:45:55.092273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f2d72-4c66-453b-bf12-291d421e78dd None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:55.152714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a7258-5259-420d-949a-3eff54e78161 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:55.191882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c686910-17de-4448-aa4a-dc8186b17a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:55.192589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c686910-17de-4448-aa4a-dc8186b17a18 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:55.192860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c686910-17de-4448-aa4a-dc8186b17a18 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:55.193136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c686910-17de-4448-aa4a-dc8186b17a18 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:55.193887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c686910-17de-4448-aa4a-dc8186b17a18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:55.194196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c686910-17de-4448-aa4a-dc8186b17a18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:55.195630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c686910-17de-4448-aa4a-dc8186b17a18 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:55.197328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f2d72-4c66-453b-bf12-291d421e78dd None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:55.208100 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 538/1072] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:55.212715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:55.214480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c686910-17de-4448-aa4a-dc8186b17a18 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:55.237183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd4b5b-bbe0-411a-a455-3c7a53e270b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:55.238040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd4b5b-bbe0-411a-a455-3c7a53e270b9 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:55.238254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd4b5b-bbe0-411a-a455-3c7a53e270b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:55.238524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd4b5b-bbe0-411a-a455-3c7a53e270b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:55.248187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:55.249667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd4b5b-bbe0-411a-a455-3c7a53e270b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:55.251052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd4b5b-bbe0-411a-a455-3c7a53e270b9 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:55.268972 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-04dd4b5b-bbe0-411a-a455-3c7a53e270b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:55.268972 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:55.268972 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:55.268972 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:55.268972 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:55.268972 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:55.268972 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:55.268972 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:55.268972 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:55.268972 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:55.268972 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:55.268972 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:55.268972 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:55.268972 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:55.268972 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:55.269929 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:55.269929 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:55.269929 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:55.269929 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:55.269929 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:55.269929 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:55.269929 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:55.269929 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:55.269929 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:55.269929 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:55.269929 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:55.269929 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:55.269929 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:55.269929 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:55.269929 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:55.269929 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:55.269929 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:55.270848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:55.270848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:55.270848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:55.270848 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:55.270848 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 535/1073] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:55.276076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd4b5b-bbe0-411a-a455-3c7a53e270b9 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:55.332220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c686910-17de-4448-aa4a-dc8186b17a18 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:55.366515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25cc78-810a-4ec6-a165-e79a5371d1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:55.367303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25cc78-810a-4ec6-a165-e79a5371d1f4 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:55.367574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25cc78-810a-4ec6-a165-e79a5371d1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:55.367849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25cc78-810a-4ec6-a165-e79a5371d1f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:55.375251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25cc78-810a-4ec6-a165-e79a5371d1f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:55.376767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25cc78-810a-4ec6-a165-e79a5371d1f4 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:55.380069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd4b5b-bbe0-411a-a455-3c7a53e270b9 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:55.391252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-ea25cc78-810a-4ec6-a165-e79a5371d1f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:55.391252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:55.391252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:55.391252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:55.391252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:55.391252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:55.391252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:55.391252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:55.391252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:55.391252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:55.391252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:55.391252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:55.391252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:55.391252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:55.391252 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:55.392366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:55.392366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:55.392366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:55.392366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:55.392366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:55.392366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:55.392366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:55.392366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:55.392366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:55.392366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:55.392366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:55.392366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:55.392366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:55.392366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:55.392366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:55.392366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:55.392366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:55.398155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:55.398155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:55.398155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:55.398155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:55.398155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:55.398155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:55.398155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:55.398155 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:55.398155 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 539/1074] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:55.398155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25cc78-810a-4ec6-a165-e79a5371d1f4 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:55.416364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75226588-7e86-4335-b160-a10a47a4bd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:55.416960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75226588-7e86-4335-b160-a10a47a4bd00 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:55.417244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75226588-7e86-4335-b160-a10a47a4bd00 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:55.417523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75226588-7e86-4335-b160-a10a47a4bd00 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:55.418258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75226588-7e86-4335-b160-a10a47a4bd00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:55.418566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75226588-7e86-4335-b160-a10a47a4bd00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:55.420336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75226588-7e86-4335-b160-a10a47a4bd00 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:55.433173 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 536/1075] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:55.512489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:55.530229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25cc78-810a-4ec6-a165-e79a5371d1f4 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:55.567093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad87f8-27d6-40ab-98f5-bebd564b3f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:55.567765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad87f8-27d6-40ab-98f5-bebd564b3f16 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:55.568063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad87f8-27d6-40ab-98f5-bebd564b3f16 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:55.568344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad87f8-27d6-40ab-98f5-bebd564b3f16 None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:55.569287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad87f8-27d6-40ab-98f5-bebd564b3f16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:55.569598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad87f8-27d6-40ab-98f5-bebd564b3f16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:55.571057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad87f8-27d6-40ab-98f5-bebd564b3f16 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:55.584190 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 540/1076] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:55.590498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75226588-7e86-4335-b160-a10a47a4bd00 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:55.619026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:55.666911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21aa22-45f1-4c66-bc8e-c94fc00af998 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:55.667549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21aa22-45f1-4c66-bc8e-c94fc00af998 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:55.668175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21aa22-45f1-4c66-bc8e-c94fc00af998 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:55.669876 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 541/1077] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:55.676243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640d1ac-dc3f-4eee-9b0d-d961e274c7f6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:55.676243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640d1ac-dc3f-4eee-9b0d-d961e274c7f6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:55.676243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640d1ac-dc3f-4eee-9b0d-d961e274c7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:55.695881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6640d1ac-dc3f-4eee-9b0d-d961e274c7f6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:55.697136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6640d1ac-dc3f-4eee-9b0d-d961e274c7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:55.700308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75226588-7e86-4335-b160-a10a47a4bd00 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:55.738257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea97734-cce2-4cb5-a4f9-83f7f5af3fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:55.739155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea97734-cce2-4cb5-a4f9-83f7f5af3fe2 None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:55.739432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea97734-cce2-4cb5-a4f9-83f7f5af3fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:55.739703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea97734-cce2-4cb5-a4f9-83f7f5af3fe2 None admin] PATH_INFO: `/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/aa3e290fa5384f9bac3fec771cebf653/roles/1ef9541aff044694894c631ef9e92fcb` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:55.741990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea97734-cce2-4cb5-a4f9-83f7f5af3fe2 None admin] RBAC: Authorizing `identity:create_grant(project_id=001bf63308784f4eb62e64d6f82c8354, user_id=aa3e290fa5384f9bac3fec771cebf653, role_id=1ef9541aff044694894c631ef9e92fcb)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:55.743425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea97734-cce2-4cb5-a4f9-83f7f5af3fe2 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:55.758345 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 537/1078] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:45:55 2022] PUT /identity/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/aa3e290fa5384f9bac3fec771cebf653/roles/1ef9541aff044694894c631ef9e92fcb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:45:55.780638 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 542/1079] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:45:55.805261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea97734-cce2-4cb5-a4f9-83f7f5af3fe2 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:55.897539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:55.918297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea97734-cce2-4cb5-a4f9-83f7f5af3fe2 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:55.954562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76808d-1304-4626-b4cd-97e384c7bc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:55.955364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76808d-1304-4626-b4cd-97e384c7bc11 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:55.955647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76808d-1304-4626-b4cd-97e384c7bc11 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:55.955919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76808d-1304-4626-b4cd-97e384c7bc11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:55.966013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76808d-1304-4626-b4cd-97e384c7bc11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:55.973753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-9a76808d-1304-4626-b4cd-97e384c7bc11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:45:55.973753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:55.973753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:55.973753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:55.973753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:55.973753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:55.973753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:55.973753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:55.973753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:55.973753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:55.973753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:55.973753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:55.973753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:55.973753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:55.973753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:55.973753 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:55.974728 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:55.974728 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:55.974728 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:55.974728 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:55.974728 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:55.974728 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:55.974728 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:55.974728 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:55.974728 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:55.974728 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:55.974728 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:55.974728 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:55.974728 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:55.974728 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:55.974728 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:55.974728 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:55.975641 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:55.975641 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:55.975641 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:55.975641 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:55.975641 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:55.975641 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:55.975641 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:55.975641 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:55.975641 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:55.975641 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:55.975641 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:45:55.975641 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:55.975641 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 538/1080] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:45:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:55.981493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640d1ac-dc3f-4eee-9b0d-d961e274c7f6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:56.055138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:56.077499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640d1ac-dc3f-4eee-9b0d-d961e274c7f6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:56.114148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6375aa8-9f7b-4976-970f-629a6446e121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:56.114812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6375aa8-9f7b-4976-970f-629a6446e121 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:56.115092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6375aa8-9f7b-4976-970f-629a6446e121 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:56.115354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6375aa8-9f7b-4976-970f-629a6446e121 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:56.116171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6375aa8-9f7b-4976-970f-629a6446e121 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:56.116471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6375aa8-9f7b-4976-970f-629a6446e121 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:56.117819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6375aa8-9f7b-4976-970f-629a6446e121 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:56.126184 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 543/1081] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:45:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:56.132106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76808d-1304-4626-b4cd-97e384c7bc11 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:56.233626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76808d-1304-4626-b4cd-97e384c7bc11 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:56.267729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d361143-0f27-49ba-967e-c866310db5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:56.268623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d361143-0f27-49ba-967e-c866310db5ce None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:56.268898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d361143-0f27-49ba-967e-c866310db5ce None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:56.269166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d361143-0f27-49ba-967e-c866310db5ce None admin] PATH_INFO: `/v3/users/8ba50672816846429cb9be107ebdeb4f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:56.270333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d361143-0f27-49ba-967e-c866310db5ce None admin] RBAC: Authorizing `identity:get_user(user_id=8ba50672816846429cb9be107ebdeb4f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:56.271767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d361143-0f27-49ba-967e-c866310db5ce None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:56.273616 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 539/1082] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:45:56 2022] GET /identity/v3/users/8ba50672816846429cb9be107ebdeb4f => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:56.279277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6375aa8-9f7b-4976-970f-629a6446e121 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:56.376954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6375aa8-9f7b-4976-970f-629a6446e121 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:56.409711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec0549-0e51-4413-bf2a-4a4b55f25616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:56.410565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec0549-0e51-4413-bf2a-4a4b55f25616 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:56.410839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec0549-0e51-4413-bf2a-4a4b55f25616 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:56.411110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec0549-0e51-4413-bf2a-4a4b55f25616 None admin] PATH_INFO: `/v3/projects/23c137036dae40ef988057391cd79107` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:56.412298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec0549-0e51-4413-bf2a-4a4b55f25616 None admin] RBAC: Authorizing `identity:get_project(project_id=23c137036dae40ef988057391cd79107)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:56.413762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec0549-0e51-4413-bf2a-4a4b55f25616 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:56.415446 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 544/1083] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:45:56 2022] GET /identity/v3/projects/23c137036dae40ef988057391cd79107 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:56.421841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d361143-0f27-49ba-967e-c866310db5ce None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:56.434852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:56.522090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d361143-0f27-49ba-967e-c866310db5ce None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:56.556303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee68819-efa2-4b68-92ee-712f1f1db3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:56.557180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee68819-efa2-4b68-92ee-712f1f1db3ac None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:56.557455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee68819-efa2-4b68-92ee-712f1f1db3ac None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:56.557718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee68819-efa2-4b68-92ee-712f1f1db3ac None admin] PATH_INFO: `/v3/projects/23c137036dae40ef988057391cd79107/users/8ba50672816846429cb9be107ebdeb4f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:56.559671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee68819-efa2-4b68-92ee-712f1f1db3ac None admin] RBAC: Authorizing `identity:create_grant(project_id=23c137036dae40ef988057391cd79107, user_id=8ba50672816846429cb9be107ebdeb4f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:56.561141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee68819-efa2-4b68-92ee-712f1f1db3ac None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:56.575238 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 540/1084] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:45:56 2022] PUT /identity/v3/projects/23c137036dae40ef988057391cd79107/users/8ba50672816846429cb9be107ebdeb4f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:45:58.024665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e006ee5-ce01-42bf-a9b4-a7ac39de8887 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:58.025237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e006ee5-ce01-42bf-a9b4-a7ac39de8887 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:58.025237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e006ee5-ce01-42bf-a9b4-a7ac39de8887 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:58.026583 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 545/1085] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:45:58.031805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac36586-99d2-4b4a-ab1d-8465b0c255ad None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:58.032259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac36586-99d2-4b4a-ab1d-8465b0c255ad None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:58.032374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac36586-99d2-4b4a-ab1d-8465b0c255ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:58.050090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8ac36586-99d2-4b4a-ab1d-8465b0c255ad None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:58.051280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8ac36586-99d2-4b4a-ab1d-8465b0c255ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:58.118467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:58.124243 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 541/1086] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:58.156179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e006ee5-ce01-42bf-a9b4-a7ac39de8887 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:58.165972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:58.263038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e006ee5-ce01-42bf-a9b4-a7ac39de8887 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:58.298099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c54f95-1921-424d-bec5-d57381793992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:58.298821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c54f95-1921-424d-bec5-d57381793992 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:58.299103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c54f95-1921-424d-bec5-d57381793992 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:58.299373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c54f95-1921-424d-bec5-d57381793992 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:58.309944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c54f95-1921-424d-bec5-d57381793992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:58.318097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-38c54f95-1921-424d-bec5-d57381793992 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 20:45:58.318097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:58.318097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:58.318097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:58.318097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:58.318097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:58.318097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:58.318097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:58.318097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:58.318097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:58.318097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:58.318097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:58.318097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:58.318097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:58.318097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:58.318097 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:58.319051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:58.319051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:58.319051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:58.319051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:58.319051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:58.319051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:58.319051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:58.319051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:58.319051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:58.319051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:58.319051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:58.319051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:58.319051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:58.319051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:58.319051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:58.319051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:58.319907 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:58.319907 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:58.319907 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:58.319907 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:58.319907 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:58.319907 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:58.319907 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:58.319907 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:58.319907 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:58.319907 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:58.319907 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 20:45:58.319907 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:58.319907 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 546/1087] 10.222.0.43 () {56 vars in 1120 bytes} [Sat Jul 2 20:45:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:58.325557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac36586-99d2-4b4a-ab1d-8465b0c255ad None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:58.425092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac36586-99d2-4b4a-ab1d-8465b0c255ad None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:58.461453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bda840-3a47-4a61-b30b-a88a7f4627a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:58.462126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bda840-3a47-4a61-b30b-a88a7f4627a7 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:58.462400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bda840-3a47-4a61-b30b-a88a7f4627a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:58.462675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bda840-3a47-4a61-b30b-a88a7f4627a7 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:58.463415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bda840-3a47-4a61-b30b-a88a7f4627a7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:58.463720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bda840-3a47-4a61-b30b-a88a7f4627a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:58.465135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bda840-3a47-4a61-b30b-a88a7f4627a7 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:58.473437 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 542/1088] 10.222.0.43 () {56 vars in 1115 bytes} [Sat Jul 2 20:45:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:58.479265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c54f95-1921-424d-bec5-d57381793992 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:58.551838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:58.587403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c54f95-1921-424d-bec5-d57381793992 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:58.624861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53143c5f-f95b-4497-a6e6-fda4ff415785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:58.625670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53143c5f-f95b-4497-a6e6-fda4ff415785 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:58.625947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53143c5f-f95b-4497-a6e6-fda4ff415785 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:58.626218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53143c5f-f95b-4497-a6e6-fda4ff415785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:58.639775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53143c5f-f95b-4497-a6e6-fda4ff415785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:58.641387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53143c5f-f95b-4497-a6e6-fda4ff415785 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:58.660121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-53143c5f-f95b-4497-a6e6-fda4ff415785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:58.660121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:58.660121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:58.660121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:58.660121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:58.660121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:58.660121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:58.660121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:58.660121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:58.660121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:58.660121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:58.660121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:58.660121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:58.660121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:58.660121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:58.661035 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:58.661035 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:58.661035 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:58.661035 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:58.661035 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:58.661035 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:58.661035 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:58.661035 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:58.661035 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:58.661035 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:58.661035 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:58.661035 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:58.661035 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:58.661035 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:58.661035 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:58.661035 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:58.661035 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:58.662107 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:58.662107 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:58.662107 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:58.662107 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:58.662107 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 547/1089] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:58.667359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bda840-3a47-4a61-b30b-a88a7f4627a7 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:58.734697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:58.779676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bda840-3a47-4a61-b30b-a88a7f4627a7 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:58.813161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9df68f-5bff-48b6-b4f3-ca3158d5ab6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:58.813751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9df68f-5bff-48b6-b4f3-ca3158d5ab6a None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:58.814033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9df68f-5bff-48b6-b4f3-ca3158d5ab6a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:58.814313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9df68f-5bff-48b6-b4f3-ca3158d5ab6a None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:58.815034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9df68f-5bff-48b6-b4f3-ca3158d5ab6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:58.815341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9df68f-5bff-48b6-b4f3-ca3158d5ab6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:58.816789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9df68f-5bff-48b6-b4f3-ca3158d5ab6a None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:58.828689 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 543/1090] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:45:58.834599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53143c5f-f95b-4497-a6e6-fda4ff415785 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:58.853108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828797d-ca08-4011-a6d2-d924d8446bfc None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:58.853393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828797d-ca08-4011-a6d2-d924d8446bfc None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:58.853674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828797d-ca08-4011-a6d2-d924d8446bfc None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:58.855013 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 544/1091] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:45:58.860641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93601ac7-780a-4a78-a030-8f52c64ead41 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:58.860984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93601ac7-780a-4a78-a030-8f52c64ead41 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:58.861259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93601ac7-780a-4a78-a030-8f52c64ead41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:58.879060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-93601ac7-780a-4a78-a030-8f52c64ead41 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:45:58.880287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-93601ac7-780a-4a78-a030-8f52c64ead41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:45:58.936556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53143c5f-f95b-4497-a6e6-fda4ff415785 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:58.946177 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 545/1092] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:45:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:45:58.954049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:58.971118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf8e22-4863-46e7-8f9f-27be1e4eb7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:58.971329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93601ac7-780a-4a78-a030-8f52c64ead41 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:58.971907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf8e22-4863-46e7-8f9f-27be1e4eb7f7 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:58.972221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf8e22-4863-46e7-8f9f-27be1e4eb7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:58.972501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf8e22-4863-46e7-8f9f-27be1e4eb7f7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:58.980587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf8e22-4863-46e7-8f9f-27be1e4eb7f7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:58.982078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf8e22-4863-46e7-8f9f-27be1e4eb7f7 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:58.996474 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-95cf8e22-4863-46e7-8f9f-27be1e4eb7f7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:45:58.996474 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:58.996474 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:58.996474 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:58.996474 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:58.996474 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:58.996474 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:58.996474 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:58.996474 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:58.996474 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:58.996474 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:58.996474 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:58.996474 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:45:58.996474 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:45:58.996474 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:45:58.996474 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:45:58.997635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:58.997635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:58.997635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:45:58.997635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:58.997635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:45:58.997635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:45:58.997635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:58.997635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:58.997635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:58.997635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:58.997635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:58.997635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:58.997635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:58.997635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:58.997635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:58.997635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:58.997635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:58.997635 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:58.998649 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:58.998649 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:58.998649 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:45:58.998649 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:45:58.998649 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:45:58.998649 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:45:58.998649 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:45:58.998649 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:45:58.998649 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:45:58.998649 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:58.998649 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 548/1093] 10.222.0.43 () {56 vars in 1093 bytes} [Sat Jul 2 20:45:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:59.003435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf8e22-4863-46e7-8f9f-27be1e4eb7f7 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:59.030864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:59.079283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93601ac7-780a-4a78-a030-8f52c64ead41 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:59.105829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf8e22-4863-46e7-8f9f-27be1e4eb7f7 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:59.117484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef7a62-e2a1-4cf7-a380-915a1fa0735a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:59.118293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef7a62-e2a1-4cf7-a380-915a1fa0735a None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:59.118577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef7a62-e2a1-4cf7-a380-915a1fa0735a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:59.118850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef7a62-e2a1-4cf7-a380-915a1fa0735a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:59.128915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef7a62-e2a1-4cf7-a380-915a1fa0735a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:45:59.136586 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-aaef7a62-e2a1-4cf7-a380-915a1fa0735a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:45:59.136586 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:59.136586 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:59.136586 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:59.136586 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:59.136586 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:59.136586 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:59.136586 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:59.136586 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:59.136586 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:59.136586 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:59.136586 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:59.136586 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:45:59.136586 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:45:59.136586 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:45:59.136586 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:45:59.137700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:45:59.137700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:45:59.137700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:45:59.137700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:45:59.137700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:59.137700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:59.137700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:59.137700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:59.137700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:59.137700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:59.137700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:59.137700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:59.137700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:59.137700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:59.137700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:59.137700 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:59.139185 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:59.139185 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:59.139185 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:59.139185 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:59.139185 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:45:59.139185 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:45:59.139185 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:45:59.139185 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:45:59.139185 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:45:59.139185 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:45:59.139185 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:45:59.139185 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:45:59.139185 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 546/1094] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:45:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:59.140162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ba375-55e1-4c17-a53e-d8bc76ee34f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:59.140832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ba375-55e1-4c17-a53e-d8bc76ee34f0 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:59.141106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ba375-55e1-4c17-a53e-d8bc76ee34f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:59.141374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ba375-55e1-4c17-a53e-d8bc76ee34f0 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:59.142187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ba375-55e1-4c17-a53e-d8bc76ee34f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:59.142489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ba375-55e1-4c17-a53e-d8bc76ee34f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:59.143730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef7a62-e2a1-4cf7-a380-915a1fa0735a None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:59.143926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ba375-55e1-4c17-a53e-d8bc76ee34f0 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:59.165436 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 549/1095] 10.222.0.43 () {56 vars in 1133 bytes} [Sat Jul 2 20:45:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:59.167975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ba375-55e1-4c17-a53e-d8bc76ee34f0 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:59.203894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:59.247240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef7a62-e2a1-4cf7-a380-915a1fa0735a None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:59.261556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:59.271245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ba375-55e1-4c17-a53e-d8bc76ee34f0 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:59.284521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b390e-b420-41c0-8af5-423f3cc99fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:59.285211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b390e-b420-41c0-8af5-423f3cc99fc4 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:59.285495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b390e-b420-41c0-8af5-423f3cc99fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:59.285774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b390e-b420-41c0-8af5-423f3cc99fc4 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:59.286523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b390e-b420-41c0-8af5-423f3cc99fc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:59.286867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b390e-b420-41c0-8af5-423f3cc99fc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:59.288362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b390e-b420-41c0-8af5-423f3cc99fc4 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:59.297449 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 547/1096] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:45:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:59.303248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b390e-b420-41c0-8af5-423f3cc99fc4 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:59.308533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecfe40-b676-47b6-a4c2-a43753ceb970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:59.309233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecfe40-b676-47b6-a4c2-a43753ceb970 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:59.309512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecfe40-b676-47b6-a4c2-a43753ceb970 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:59.309784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecfe40-b676-47b6-a4c2-a43753ceb970 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:59.376090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecfe40-b676-47b6-a4c2-a43753ceb970 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:59.377495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecfe40-b676-47b6-a4c2-a43753ceb970 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:59.400139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b390e-b420-41c0-8af5-423f3cc99fc4 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:59.410265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:59.433669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3c641-6715-4414-83f5-86af41613eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:59.434537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c641-6715-4414-83f5-86af41613eaa None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:59.434819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c641-6715-4414-83f5-86af41613eaa None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:59.435089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c641-6715-4414-83f5-86af41613eaa None admin] PATH_INFO: `/v3/users/8ba50672816846429cb9be107ebdeb4f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:59.436317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3c641-6715-4414-83f5-86af41613eaa None admin] RBAC: Authorizing `identity:get_user(user_id=8ba50672816846429cb9be107ebdeb4f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:59.437752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3c641-6715-4414-83f5-86af41613eaa None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:59.439524 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 548/1097] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:45:59 2022] GET /identity/v3/users/8ba50672816846429cb9be107ebdeb4f => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:59.445120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3c641-6715-4414-83f5-86af41613eaa None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:59.473813 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 550/1098] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:45:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:45:59.479931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecfe40-b676-47b6-a4c2-a43753ceb970 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:59.491288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:59.549123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3c641-6715-4414-83f5-86af41613eaa None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:59.579463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecfe40-b676-47b6-a4c2-a43753ceb970 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:59.582411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3165f-41ad-4b8d-a227-3b9c057b569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:59.583086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3165f-41ad-4b8d-a227-3b9c057b569c None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:59.583371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3165f-41ad-4b8d-a227-3b9c057b569c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:59.583648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3165f-41ad-4b8d-a227-3b9c057b569c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:59.611981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0452486-cca6-49d4-b627-5386ac86510d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:59.612789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0452486-cca6-49d4-b627-5386ac86510d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:59.613077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0452486-cca6-49d4-b627-5386ac86510d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:59.613348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0452486-cca6-49d4-b627-5386ac86510d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:59.616439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:59.624725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0452486-cca6-49d4-b627-5386ac86510d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:59.626221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0452486-cca6-49d4-b627-5386ac86510d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:59.643243 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-e0452486-cca6-49d4-b627-5386ac86510d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:59.643243 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:59.643243 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:59.643243 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:59.643243 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:59.643243 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:59.643243 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:59.643243 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:59.643243 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:59.643243 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:59.643243 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:59.643243 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:59.643243 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:45:59.643243 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:45:59.643243 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:45:59.644366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:45:59.644366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:59.644366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:59.644366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:59.644366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:59.644366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:59.644366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:59.644366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:59.644366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:59.644366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:59.644366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:59.644366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:59.644366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:59.644366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:59.644366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:59.644366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:59.644366 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:59.645489 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:45:59.645489 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:45:59.645489 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:45:59.645489 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:59.649315 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 551/1099] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:45:59.649433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3165f-41ad-4b8d-a227-3b9c057b569c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:59.650076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0452486-cca6-49d4-b627-5386ac86510d None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:59.650672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3165f-41ad-4b8d-a227-3b9c057b569c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:59.692614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:59.750242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0452486-cca6-49d4-b627-5386ac86510d None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:59.752526 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 549/1100] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:45:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 02 20:45:59.756639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3165f-41ad-4b8d-a227-3b9c057b569c None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:59.784799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1d235-41f2-473f-bc24-99a2f10a4d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:59.785463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1d235-41f2-473f-bc24-99a2f10a4d1d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:59.785745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1d235-41f2-473f-bc24-99a2f10a4d1d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:59.786022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1d235-41f2-473f-bc24-99a2f10a4d1d None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:59.786730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1d235-41f2-473f-bc24-99a2f10a4d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:45:59.787036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1d235-41f2-473f-bc24-99a2f10a4d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:59.788462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1d235-41f2-473f-bc24-99a2f10a4d1d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:59.799848 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 552/1101] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:59.805480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1d235-41f2-473f-bc24-99a2f10a4d1d None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:59.852268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3165f-41ad-4b8d-a227-3b9c057b569c None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:59.852578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:59.889929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336717c-a6fe-4988-8271-0c395efba809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:59.890740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336717c-a6fe-4988-8271-0c395efba809 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:59.890970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336717c-a6fe-4988-8271-0c395efba809 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:59.891273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336717c-a6fe-4988-8271-0c395efba809 None admin] PATH_INFO: `/v3/projects/23c137036dae40ef988057391cd79107` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:59.892437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336717c-a6fe-4988-8271-0c395efba809 None admin] RBAC: Authorizing `identity:get_project(project_id=23c137036dae40ef988057391cd79107)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:59.893871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336717c-a6fe-4988-8271-0c395efba809 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:59.895550 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 550/1102] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:45:59 2022] GET /identity/v3/projects/23c137036dae40ef988057391cd79107 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:45:59.901707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336717c-a6fe-4988-8271-0c395efba809 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:45:59.907414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1d235-41f2-473f-bc24-99a2f10a4d1d None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:45:59.913520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:45:59.942472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d82f9-bdf8-4420-ab8b-96647af5ed81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:45:59.943249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d82f9-bdf8-4420-ab8b-96647af5ed81 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:45:59.943572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d82f9-bdf8-4420-ab8b-96647af5ed81 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:45:59.943844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d82f9-bdf8-4420-ab8b-96647af5ed81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:45:59.950952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d82f9-bdf8-4420-ab8b-96647af5ed81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:45:59.952452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d82f9-bdf8-4420-ab8b-96647af5ed81 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:45:59.966627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-e62d82f9-bdf8-4420-ab8b-96647af5ed81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:59.966627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:45:59.966627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:45:59.966627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:45:59.966627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:45:59.966627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:45:59.966627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:45:59.966627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:45:59.966627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:45:59.966627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:45:59.966627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:45:59.966627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:45:59.966627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:45:59.966627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:45:59.966627 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:45:59.967648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:45:59.967648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:45:59.967648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:45:59.967648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:45:59.967648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:45:59.967648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:45:59.967648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:45:59.967648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:45:59.967648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:45:59.967648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:45:59.967648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:45:59.967648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:45:59.967648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:45:59.967648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:45:59.967648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:45:59.967648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:45:59.967648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:45:59.968958 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:45:59.968958 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:45:59.968958 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:45:59.968958 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:45:59.968958 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:45:59.968958 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:45:59.968958 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:45:59.968958 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:45:59.968958 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 553/1103] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:45:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:45:59.973767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d82f9-bdf8-4420-ab8b-96647af5ed81 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:00.006550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336717c-a6fe-4988-8271-0c395efba809 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:00.040942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304003f8-a942-4c4e-b4ec-8802d51f4af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:00.041601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304003f8-a942-4c4e-b4ec-8802d51f4af1 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:00.041881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304003f8-a942-4c4e-b4ec-8802d51f4af1 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:00.042161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304003f8-a942-4c4e-b4ec-8802d51f4af1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:00.042978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304003f8-a942-4c4e-b4ec-8802d51f4af1 None admin] RBAC: Adding query filter params (role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.project.id=23c137036dae40ef988057391cd79107, user.id=8ba50672816846429cb9be107ebdeb4f) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:46:00.043287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304003f8-a942-4c4e-b4ec-8802d51f4af1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:00.045087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304003f8-a942-4c4e-b4ec-8802d51f4af1 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:00.051352 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 551/1104] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:45:59 2022] GET /identity/v3/role_assignments?user.id=8ba50672816846429cb9be107ebdeb4f&scope.project.id=23c137036dae40ef988057391cd79107&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:46:00.075113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d82f9-bdf8-4420-ab8b-96647af5ed81 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:00.091936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:00.117451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080428f8-b627-4577-8dee-ea6a2ac5fa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:00.118187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080428f8-b627-4577-8dee-ea6a2ac5fa6d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:00.118391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080428f8-b627-4577-8dee-ea6a2ac5fa6d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:00.118651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080428f8-b627-4577-8dee-ea6a2ac5fa6d None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:00.119431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080428f8-b627-4577-8dee-ea6a2ac5fa6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:46:00.119729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080428f8-b627-4577-8dee-ea6a2ac5fa6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:00.121246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080428f8-b627-4577-8dee-ea6a2ac5fa6d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:00.133995 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 554/1105] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:45:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:46:00.140523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304003f8-a942-4c4e-b4ec-8802d51f4af1 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:00.222927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:00.250717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304003f8-a942-4c4e-b4ec-8802d51f4af1 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:00.286148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc41f8-f0b2-4911-855b-c0df2e737f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:00.286809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc41f8-f0b2-4911-855b-c0df2e737f88 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:00.287152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc41f8-f0b2-4911-855b-c0df2e737f88 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:00.287431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc41f8-f0b2-4911-855b-c0df2e737f88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:00.288307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc41f8-f0b2-4911-855b-c0df2e737f88 None admin] RBAC: Adding query filter params (role.id=1ef9541aff044694894c631ef9e92fcb, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=aa3e290fa5384f9bac3fec771cebf653) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:46:00.288606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc41f8-f0b2-4911-855b-c0df2e737f88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:00.290156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc41f8-f0b2-4911-855b-c0df2e737f88 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:00.296575 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 552/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:46:00 2022] GET /identity/v3/role_assignments?user.id=aa3e290fa5384f9bac3fec771cebf653&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=1ef9541aff044694894c631ef9e92fcb => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:02.390431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe759f-47fe-472e-8a91-644c750b4aa9 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:02.390957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe759f-47fe-472e-8a91-644c750b4aa9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:02.390957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe759f-47fe-472e-8a91-644c750b4aa9 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:02.392298 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 555/1107] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:46:02.398781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644995ca-c558-44a8-96c7-0e4190594c0c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:02.399524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644995ca-c558-44a8-96c7-0e4190594c0c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:02.399663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644995ca-c558-44a8-96c7-0e4190594c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:02.422079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-644995ca-c558-44a8-96c7-0e4190594c0c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:02.423247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-644995ca-c558-44a8-96c7-0e4190594c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:02.493755 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 553/1108] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:46:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:46:02.524512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe759f-47fe-472e-8a91-644c750b4aa9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:02.635007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe759f-47fe-472e-8a91-644c750b4aa9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:02.668608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22049144-5924-4b53-b1cd-11cd06903eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:02.669387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22049144-5924-4b53-b1cd-11cd06903eb6 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:02.669987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22049144-5924-4b53-b1cd-11cd06903eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:02.670255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22049144-5924-4b53-b1cd-11cd06903eb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:02.671540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22049144-5924-4b53-b1cd-11cd06903eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:02.673012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22049144-5924-4b53-b1cd-11cd06903eb6 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:02.674607 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 556/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:46:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:02.681013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644995ca-c558-44a8-96c7-0e4190594c0c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:02.767510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:02.804351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644995ca-c558-44a8-96c7-0e4190594c0c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:02.844410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b55d5-1f04-4468-b4a5-62181d19fcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:02.845092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b55d5-1f04-4468-b4a5-62181d19fcb6 None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:02.845369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b55d5-1f04-4468-b4a5-62181d19fcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:02.845645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b55d5-1f04-4468-b4a5-62181d19fcb6 None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:02.846371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b55d5-1f04-4468-b4a5-62181d19fcb6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:02.847872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b55d5-1f04-4468-b4a5-62181d19fcb6 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:02.869315 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 554/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Jul 2 20:46:02 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:46:05.222958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239e299-8ffd-4446-bfab-0677474a604a None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:05.223555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239e299-8ffd-4446-bfab-0677474a604a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:05.223555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239e299-8ffd-4446-bfab-0677474a604a None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:05.225055 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 557/1111] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:46:05.231522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345c1c0-db1b-4549-a01c-96c72bead4c2 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:05.232350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345c1c0-db1b-4549-a01c-96c72bead4c2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:05.232484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345c1c0-db1b-4549-a01c-96c72bead4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:05.259266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a345c1c0-db1b-4549-a01c-96c72bead4c2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:05.260545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a345c1c0-db1b-4549-a01c-96c72bead4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:05.335510 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 555/1112] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:46:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:46:05.366432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239e299-8ffd-4446-bfab-0677474a604a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:05.409056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:05.484956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239e299-8ffd-4446-bfab-0677474a604a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:05.519832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19da74-603d-4104-996b-40d5b33c5b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:05.520706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19da74-603d-4104-996b-40d5b33c5b30 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:05.520978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19da74-603d-4104-996b-40d5b33c5b30 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:05.521247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19da74-603d-4104-996b-40d5b33c5b30 None admin] PATH_INFO: `/v3/roles/74cf644f6b8f49ce86fffcde317f8883` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:05.522815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19da74-603d-4104-996b-40d5b33c5b30 None admin] RBAC: Authorizing `identity:get_role(role_id=74cf644f6b8f49ce86fffcde317f8883)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:05.524216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19da74-603d-4104-996b-40d5b33c5b30 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:05.525582 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 558/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:46:05 2022] GET /identity/v3/roles/74cf644f6b8f49ce86fffcde317f8883 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:05.531749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345c1c0-db1b-4549-a01c-96c72bead4c2 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:05.599220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:05.652826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345c1c0-db1b-4549-a01c-96c72bead4c2 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:05.690886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbac8e-70f2-4653-b351-f1cc72ade121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:05.691747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbac8e-70f2-4653-b351-f1cc72ade121 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:05.692022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbac8e-70f2-4653-b351-f1cc72ade121 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:05.692321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbac8e-70f2-4653-b351-f1cc72ade121 None admin] PATH_INFO: `/v3/users/f5a92b182c884f66810e3612ef46bd74` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:05.705646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbac8e-70f2-4653-b351-f1cc72ade121 None admin] RBAC: Authorizing `identity:get_user(user_id=f5a92b182c884f66810e3612ef46bd74)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:05.707100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbac8e-70f2-4653-b351-f1cc72ade121 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:05.708784 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 556/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:46:05 2022] GET /identity/v3/users/f5a92b182c884f66810e3612ef46bd74 => generated 286 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:05.715279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19da74-603d-4104-996b-40d5b33c5b30 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:05.840472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19da74-603d-4104-996b-40d5b33c5b30 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:05.842819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:05.875852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5384b-a3a7-41ca-8531-de0e6b945655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:05.876523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5384b-a3a7-41ca-8531-de0e6b945655 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:05.876844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5384b-a3a7-41ca-8531-de0e6b945655 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:05.877097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5384b-a3a7-41ca-8531-de0e6b945655 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:05.946090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5384b-a3a7-41ca-8531-de0e6b945655 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:05.947454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5384b-a3a7-41ca-8531-de0e6b945655 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:06.050890 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 559/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:46:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:46:06.057478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbac8e-70f2-4653-b351-f1cc72ade121 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:06.167092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbac8e-70f2-4653-b351-f1cc72ade121 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:06.181026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:06.205989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da676a-83b6-468e-b464-3aa39db9b5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:06.206784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da676a-83b6-468e-b464-3aa39db9b5af None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:06.207059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da676a-83b6-468e-b464-3aa39db9b5af None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:06.207325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da676a-83b6-468e-b464-3aa39db9b5af None admin] PATH_INFO: `/v3/projects/23c137036dae40ef988057391cd79107` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:06.208572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da676a-83b6-468e-b464-3aa39db9b5af None admin] RBAC: Authorizing `identity:get_project(project_id=23c137036dae40ef988057391cd79107)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:06.210054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da676a-83b6-468e-b464-3aa39db9b5af None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:06.211745 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 557/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:46:06 2022] GET /identity/v3/projects/23c137036dae40ef988057391cd79107 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:06.218776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5384b-a3a7-41ca-8531-de0e6b945655 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:06.223446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:06.327961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5384b-a3a7-41ca-8531-de0e6b945655 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:06.365362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad7db9-f0fb-46e2-a131-a5d87fd9221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:06.366063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad7db9-f0fb-46e2-a131-a5d87fd9221f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:06.366341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad7db9-f0fb-46e2-a131-a5d87fd9221f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:06.366615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad7db9-f0fb-46e2-a131-a5d87fd9221f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:06.367462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad7db9-f0fb-46e2-a131-a5d87fd9221f None admin] RBAC: Adding query filter params (role.id=74cf644f6b8f49ce86fffcde317f8883, scope.project.id=23c137036dae40ef988057391cd79107, user.id=f5a92b182c884f66810e3612ef46bd74) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:46:06.367774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad7db9-f0fb-46e2-a131-a5d87fd9221f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:06.369336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad7db9-f0fb-46e2-a131-a5d87fd9221f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:06.375183 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 560/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:46:06 2022] GET /identity/v3/role_assignments?user.id=f5a92b182c884f66810e3612ef46bd74&scope.project.id=23c137036dae40ef988057391cd79107&role.id=74cf644f6b8f49ce86fffcde317f8883 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:08.641777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b6713-984d-4579-b2f4-d2d8e35fd7d2 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:08.642392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b6713-984d-4579-b2f4-d2d8e35fd7d2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:08.642392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b6713-984d-4579-b2f4-d2d8e35fd7d2 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:08.643907 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 558/1118] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:46:08.650712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adbc5a-4d22-40c7-9882-74ddd5c20412 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:08.651387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adbc5a-4d22-40c7-9882-74ddd5c20412 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:08.651580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adbc5a-4d22-40c7-9882-74ddd5c20412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:08.679392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-88adbc5a-4d22-40c7-9882-74ddd5c20412 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:08.680628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-88adbc5a-4d22-40c7-9882-74ddd5c20412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:08.747470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:08.753926 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 561/1119] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:46:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:46:08.785458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b6713-984d-4579-b2f4-d2d8e35fd7d2 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:08.895738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b6713-984d-4579-b2f4-d2d8e35fd7d2 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:08.930964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1039f06-e022-4253-85b2-f095c6cfa30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:08.931820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1039f06-e022-4253-85b2-f095c6cfa30d None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:08.932122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1039f06-e022-4253-85b2-f095c6cfa30d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:08.932396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1039f06-e022-4253-85b2-f095c6cfa30d None admin] PATH_INFO: `/v3/roles/74cf644f6b8f49ce86fffcde317f8883` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:08.933913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1039f06-e022-4253-85b2-f095c6cfa30d None admin] RBAC: Authorizing `identity:get_role(role_id=74cf644f6b8f49ce86fffcde317f8883)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:08.935315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1039f06-e022-4253-85b2-f095c6cfa30d None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:08.936709 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 559/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:46:08 2022] GET /identity/v3/roles/74cf644f6b8f49ce86fffcde317f8883 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:08.943494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adbc5a-4d22-40c7-9882-74ddd5c20412 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:09.056581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adbc5a-4d22-40c7-9882-74ddd5c20412 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:09.097996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11ef30-a84d-404c-b0d3-43783d67b081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:09.098884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11ef30-a84d-404c-b0d3-43783d67b081 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:09.099197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11ef30-a84d-404c-b0d3-43783d67b081 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:09.099470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11ef30-a84d-404c-b0d3-43783d67b081 None admin] PATH_INFO: `/v3/users/f5a92b182c884f66810e3612ef46bd74` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:09.100792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11ef30-a84d-404c-b0d3-43783d67b081 None admin] RBAC: Authorizing `identity:get_user(user_id=f5a92b182c884f66810e3612ef46bd74)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:09.102248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11ef30-a84d-404c-b0d3-43783d67b081 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:09.103880 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 562/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:46:08 2022] GET /identity/v3/users/f5a92b182c884f66810e3612ef46bd74 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:09.110070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1039f06-e022-4253-85b2-f095c6cfa30d None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:09.162048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:09.214011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1039f06-e022-4253-85b2-f095c6cfa30d None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:09.251522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa67d9-c961-44e4-b21e-9461aafdd5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:09.252414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa67d9-c961-44e4-b21e-9461aafdd5cb None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:09.252694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa67d9-c961-44e4-b21e-9461aafdd5cb None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:09.252964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa67d9-c961-44e4-b21e-9461aafdd5cb None admin] PATH_INFO: `/v3/projects/23c137036dae40ef988057391cd79107` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:09.254279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa67d9-c961-44e4-b21e-9461aafdd5cb None admin] RBAC: Authorizing `identity:get_project(project_id=23c137036dae40ef988057391cd79107)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:09.255819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa67d9-c961-44e4-b21e-9461aafdd5cb None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:09.257560 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 560/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:46:09 2022] GET /identity/v3/projects/23c137036dae40ef988057391cd79107 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:09.267423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11ef30-a84d-404c-b0d3-43783d67b081 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:09.339345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:09.383751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11ef30-a84d-404c-b0d3-43783d67b081 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:09.419766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7073f-2884-480e-9358-b17bbc72fee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:09.420607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7073f-2884-480e-9358-b17bbc72fee0 None admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:09.420878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7073f-2884-480e-9358-b17bbc72fee0 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:09.421144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7073f-2884-480e-9358-b17bbc72fee0 None admin] PATH_INFO: `/v3/projects/23c137036dae40ef988057391cd79107/users/f5a92b182c884f66810e3612ef46bd74/roles/74cf644f6b8f49ce86fffcde317f8883` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:09.423786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7073f-2884-480e-9358-b17bbc72fee0 None admin] RBAC: Authorizing `identity:create_grant(project_id=23c137036dae40ef988057391cd79107, user_id=f5a92b182c884f66810e3612ef46bd74, role_id=74cf644f6b8f49ce86fffcde317f8883)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:09.425261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7073f-2884-480e-9358-b17bbc72fee0 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:09.441849 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 563/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:46:09 2022] PUT /identity/v3/projects/23c137036dae40ef988057391cd79107/users/f5a92b182c884f66810e3612ef46bd74/roles/74cf644f6b8f49ce86fffcde317f8883 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:46:11.706750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fb577-ad05-42cd-8de5-908fff922d50 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:11.707625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fb577-ad05-42cd-8de5-908fff922d50 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:11.707625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fb577-ad05-42cd-8de5-908fff922d50 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:11.709407 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 561/1124] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:46:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:46:11.718420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996d29c-2442-4db3-a14a-b266efd56707 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:11.718856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996d29c-2442-4db3-a14a-b266efd56707 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:11.719021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996d29c-2442-4db3-a14a-b266efd56707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:11.744552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8996d29c-2442-4db3-a14a-b266efd56707 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:11.745765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8996d29c-2442-4db3-a14a-b266efd56707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:11.824767 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 564/1125] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:46:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:46:11.850404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fb577-ad05-42cd-8de5-908fff922d50 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:11.965024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fb577-ad05-42cd-8de5-908fff922d50 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:11.981463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:12.003346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58aa311-36bc-48b9-b7a3-b45962427196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:12.004234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aa311-36bc-48b9-b7a3-b45962427196 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:12.004510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aa311-36bc-48b9-b7a3-b45962427196 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:12.004777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aa311-36bc-48b9-b7a3-b45962427196 None admin] PATH_INFO: `/v3/roles/74cf644f6b8f49ce86fffcde317f8883` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:12.006277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58aa311-36bc-48b9-b7a3-b45962427196 None admin] RBAC: Authorizing `identity:get_role(role_id=74cf644f6b8f49ce86fffcde317f8883)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:12.007661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58aa311-36bc-48b9-b7a3-b45962427196 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:12.009116 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 562/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:46:11 2022] GET /identity/v3/roles/74cf644f6b8f49ce86fffcde317f8883 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:12.015209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996d29c-2442-4db3-a14a-b266efd56707 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:12.072504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:12.123547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996d29c-2442-4db3-a14a-b266efd56707 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:12.161591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ec5a6-188b-40d5-be3d-f567b1bd0600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:12.162476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ec5a6-188b-40d5-be3d-f567b1bd0600 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:12.162756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ec5a6-188b-40d5-be3d-f567b1bd0600 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:12.163025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ec5a6-188b-40d5-be3d-f567b1bd0600 None admin] PATH_INFO: `/v3/users/f5a92b182c884f66810e3612ef46bd74` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:12.164367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ec5a6-188b-40d5-be3d-f567b1bd0600 None admin] RBAC: Authorizing `identity:get_user(user_id=f5a92b182c884f66810e3612ef46bd74)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:12.165815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ec5a6-188b-40d5-be3d-f567b1bd0600 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:12.167479 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 565/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:46:12 2022] GET /identity/v3/users/f5a92b182c884f66810e3612ef46bd74 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:12.174824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58aa311-36bc-48b9-b7a3-b45962427196 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:12.287923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58aa311-36bc-48b9-b7a3-b45962427196 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:12.323539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a1a52-d0d5-4861-827c-85ca4f6ce7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:12.324191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a1a52-d0d5-4861-827c-85ca4f6ce7f7 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:12.324472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a1a52-d0d5-4861-827c-85ca4f6ce7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:12.324747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a1a52-d0d5-4861-827c-85ca4f6ce7f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:12.376323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:12.399868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a1a52-d0d5-4861-827c-85ca4f6ce7f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:12.401395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a1a52-d0d5-4861-827c-85ca4f6ce7f7 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:12.502504 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 563/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:46:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:46:12.509498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ec5a6-188b-40d5-be3d-f567b1bd0600 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:12.623364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ec5a6-188b-40d5-be3d-f567b1bd0600 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:12.647909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:12.667051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d3bba-34d9-4ae0-9689-7b885de17a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:12.668435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d3bba-34d9-4ae0-9689-7b885de17a41 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:12.669241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d3bba-34d9-4ae0-9689-7b885de17a41 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:12.669646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d3bba-34d9-4ae0-9689-7b885de17a41 None admin] PATH_INFO: `/v3/projects/23c137036dae40ef988057391cd79107` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:12.671476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d3bba-34d9-4ae0-9689-7b885de17a41 None admin] RBAC: Authorizing `identity:get_project(project_id=23c137036dae40ef988057391cd79107)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:12.673865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d3bba-34d9-4ae0-9689-7b885de17a41 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:12.676544 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 566/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:46:12 2022] GET /identity/v3/projects/23c137036dae40ef988057391cd79107 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:12.683012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a1a52-d0d5-4861-827c-85ca4f6ce7f7 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:12.769485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:12.786224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a1a52-d0d5-4861-827c-85ca4f6ce7f7 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:12.821941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ea204-ae20-42a6-bc04-249377528705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:12.822618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ea204-ae20-42a6-bc04-249377528705 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:12.822910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ea204-ae20-42a6-bc04-249377528705 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:12.823211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ea204-ae20-42a6-bc04-249377528705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:12.824088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ea204-ae20-42a6-bc04-249377528705 None admin] RBAC: Adding query filter params (role.id=74cf644f6b8f49ce86fffcde317f8883, scope.project.id=23c137036dae40ef988057391cd79107, user.id=f5a92b182c884f66810e3612ef46bd74) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:46:12.824455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ea204-ae20-42a6-bc04-249377528705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:12.825942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ea204-ae20-42a6-bc04-249377528705 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:12.831847 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 564/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:46:12 2022] GET /identity/v3/role_assignments?user.id=f5a92b182c884f66810e3612ef46bd74&scope.project.id=23c137036dae40ef988057391cd79107&role.id=74cf644f6b8f49ce86fffcde317f8883 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:15.161340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070dd76-9104-4779-a187-693036b893f3 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:15.161843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070dd76-9104-4779-a187-693036b893f3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:15.161843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070dd76-9104-4779-a187-693036b893f3 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:15.163271 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 567/1131] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:46:15.172757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58367ef9-0623-4f37-b6a4-83dca4adc079 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:15.173201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58367ef9-0623-4f37-b6a4-83dca4adc079 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:15.173353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58367ef9-0623-4f37-b6a4-83dca4adc079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:15.198477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-58367ef9-0623-4f37-b6a4-83dca4adc079 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:15.199676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-58367ef9-0623-4f37-b6a4-83dca4adc079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:15.271304 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 565/1132] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:46:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:46:15.303340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070dd76-9104-4779-a187-693036b893f3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:15.425057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070dd76-9104-4779-a187-693036b893f3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:15.461060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737289be-955f-44bf-8eb3-9e631897d09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:15.461840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737289be-955f-44bf-8eb3-9e631897d09c None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:15.462115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737289be-955f-44bf-8eb3-9e631897d09c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:15.462380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737289be-955f-44bf-8eb3-9e631897d09c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:15.463663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737289be-955f-44bf-8eb3-9e631897d09c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:15.465130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737289be-955f-44bf-8eb3-9e631897d09c None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:15.466772 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 568/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:46:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:15.473156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58367ef9-0623-4f37-b6a4-83dca4adc079 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:15.567534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:15.591422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58367ef9-0623-4f37-b6a4-83dca4adc079 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:15.625834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28847aa8-2d58-4d58-8e0c-b8c8d553178b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:15.626488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28847aa8-2d58-4d58-8e0c-b8c8d553178b None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:15.626758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28847aa8-2d58-4d58-8e0c-b8c8d553178b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:15.627028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28847aa8-2d58-4d58-8e0c-b8c8d553178b None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:15.627719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28847aa8-2d58-4d58-8e0c-b8c8d553178b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:15.629215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28847aa8-2d58-4d58-8e0c-b8c8d553178b None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:15.657354 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 566/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Jul 2 20:46:15 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:46:17.988615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa291b-5634-47be-b4dd-d8acbc73cad4 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:17.989536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa291b-5634-47be-b4dd-d8acbc73cad4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:17.989536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa291b-5634-47be-b4dd-d8acbc73cad4 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:17.991794 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 569/1135] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:46:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:46:17.998221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521a239-b081-496c-9d36-fa6342806409 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:17.998677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521a239-b081-496c-9d36-fa6342806409 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:17.998781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521a239-b081-496c-9d36-fa6342806409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:18.020359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9521a239-b081-496c-9d36-fa6342806409 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:18.021557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9521a239-b081-496c-9d36-fa6342806409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:18.098814 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 567/1136] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:46:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:46:18.125112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa291b-5634-47be-b4dd-d8acbc73cad4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:18.193379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:18.236701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa291b-5634-47be-b4dd-d8acbc73cad4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:18.273522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b269d-de07-4086-a591-b3eb0d84cb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:18.274241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b269d-de07-4086-a591-b3eb0d84cb6f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:18.274518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b269d-de07-4086-a591-b3eb0d84cb6f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:18.274792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b269d-de07-4086-a591-b3eb0d84cb6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:18.276089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b269d-de07-4086-a591-b3eb0d84cb6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:18.277532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b269d-de07-4086-a591-b3eb0d84cb6f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:18.279171 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 570/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:46:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:46:18.285507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521a239-b081-496c-9d36-fa6342806409 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:18.347849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:18.391714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521a239-b081-496c-9d36-fa6342806409 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:18.445261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291848e7-494e-407b-b416-4122f946d528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:18.445931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291848e7-494e-407b-b416-4122f946d528 None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:18.446215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291848e7-494e-407b-b416-4122f946d528 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:18.446490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291848e7-494e-407b-b416-4122f946d528 None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:18.447202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291848e7-494e-407b-b416-4122f946d528 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:18.448790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291848e7-494e-407b-b416-4122f946d528 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:18.473514 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 568/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Jul 2 20:46:18 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:46:20.823343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16777b2a-2928-4d9f-9f4b-44cf5f6fd39b None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:20.824276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16777b2a-2928-4d9f-9f4b-44cf5f6fd39b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:20.824276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16777b2a-2928-4d9f-9f4b-44cf5f6fd39b None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:20.826481 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 571/1139] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:46:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:46:20.832937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2d38b-82ee-41d6-a7f1-a7d6b371df98 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:20.833375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2d38b-82ee-41d6-a7f1-a7d6b371df98 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:20.833559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2d38b-82ee-41d6-a7f1-a7d6b371df98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:20.851995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ebd2d38b-82ee-41d6-a7f1-a7d6b371df98 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:20.853247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ebd2d38b-82ee-41d6-a7f1-a7d6b371df98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:20.938808 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 569/1140] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:46:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:46:20.964340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16777b2a-2928-4d9f-9f4b-44cf5f6fd39b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:21.077125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16777b2a-2928-4d9f-9f4b-44cf5f6fd39b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:21.104452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:21.114198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f9874-811a-44be-8565-05c93ed2eaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:21.114993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f9874-811a-44be-8565-05c93ed2eaf8 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:21.115273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f9874-811a-44be-8565-05c93ed2eaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:21.115545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f9874-811a-44be-8565-05c93ed2eaf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:21.127295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f9874-811a-44be-8565-05c93ed2eaf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:46:21.135022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-bf0f9874-811a-44be-8565-05c93ed2eaf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:46:21.135022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:46:21.135022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:46:21.135022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:46:21.135022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:46:21.135022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:46:21.135022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:46:21.135022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:46:21.135022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:46:21.135022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:46:21.135022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:46:21.135022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:46:21.135022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:46:21.135022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:46:21.135022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:46:21.135022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:46:21.136120 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:46:21.136120 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:46:21.136120 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:46:21.136120 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:46:21.136120 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:46:21.136120 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:46:21.136120 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:46:21.136120 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:46:21.136120 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:46:21.136120 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:46:21.136120 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:46:21.136120 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:46:21.136120 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:46:21.136120 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:46:21.136120 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:46:21.136120 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:46:21.137069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:46:21.137069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:46:21.137069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:46:21.137069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:46:21.137069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:46:21.137069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:46:21.137069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:46:21.137069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:46:21.137069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:46:21.137069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:46:21.137069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:46:21.137069 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:46:21.137069 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 572/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:46:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:46:21.143228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2d38b-82ee-41d6-a7f1-a7d6b371df98 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:21.195565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:21.252869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2d38b-82ee-41d6-a7f1-a7d6b371df98 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:21.291499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34893fa-0af5-489c-9b65-0a2b8375a160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:21.292200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34893fa-0af5-489c-9b65-0a2b8375a160 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:21.292475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34893fa-0af5-489c-9b65-0a2b8375a160 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:21.292750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34893fa-0af5-489c-9b65-0a2b8375a160 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:21.293854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34893fa-0af5-489c-9b65-0a2b8375a160 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:46:21.294158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34893fa-0af5-489c-9b65-0a2b8375a160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:21.295525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34893fa-0af5-489c-9b65-0a2b8375a160 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:21.303799 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 570/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:46:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:21.310062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f9874-811a-44be-8565-05c93ed2eaf8 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:21.421258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f9874-811a-44be-8565-05c93ed2eaf8 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:21.456329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2dc5-c8a9-4c12-ba34-a110e94c5989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:21.457220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2dc5-c8a9-4c12-ba34-a110e94c5989 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:21.457567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2dc5-c8a9-4c12-ba34-a110e94c5989 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:21.457837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2dc5-c8a9-4c12-ba34-a110e94c5989 None admin] PATH_INFO: `/v3/users/0e3154d79751417384cf059994b013ce` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:21.473199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a2dc5-c8a9-4c12-ba34-a110e94c5989 None admin] RBAC: Authorizing `identity:get_user(user_id=0e3154d79751417384cf059994b013ce)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:21.474647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a2dc5-c8a9-4c12-ba34-a110e94c5989 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:21.476327 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 573/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:46:21 2022] GET /identity/v3/users/0e3154d79751417384cf059994b013ce => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:21.485777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34893fa-0af5-489c-9b65-0a2b8375a160 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:21.592378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34893fa-0af5-489c-9b65-0a2b8375a160 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:21.607685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:21.640509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd855a8-02ff-41e6-85ff-c8debc726c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:21.641164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd855a8-02ff-41e6-85ff-c8debc726c7e None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:21.641440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd855a8-02ff-41e6-85ff-c8debc726c7e None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:21.641709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd855a8-02ff-41e6-85ff-c8debc726c7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:21.710340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd855a8-02ff-41e6-85ff-c8debc726c7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:21.711742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd855a8-02ff-41e6-85ff-c8debc726c7e None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:21.813621 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 571/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:46:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:46:21.820483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2dc5-c8a9-4c12-ba34-a110e94c5989 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:21.882641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:21.955597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2dc5-c8a9-4c12-ba34-a110e94c5989 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:21.993255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28831334-d960-494a-a69c-391b40c74e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:21.994038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28831334-d960-494a-a69c-391b40c74e54 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:21.994315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28831334-d960-494a-a69c-391b40c74e54 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:21.994585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28831334-d960-494a-a69c-391b40c74e54 None admin] PATH_INFO: `/v3/projects/070cd30bc4304b1dabf2e53f222f3db8` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:21.995878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28831334-d960-494a-a69c-391b40c74e54 None admin] RBAC: Authorizing `identity:get_project(project_id=070cd30bc4304b1dabf2e53f222f3db8)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:21.997348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28831334-d960-494a-a69c-391b40c74e54 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:21.999041 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 574/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:46:21 2022] GET /identity/v3/projects/070cd30bc4304b1dabf2e53f222f3db8 => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:22.005709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd855a8-02ff-41e6-85ff-c8debc726c7e None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:22.016982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:22.112604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd855a8-02ff-41e6-85ff-c8debc726c7e None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:22.148022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522bc9a-d99a-4e91-a369-d11f0253b9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:22.148701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522bc9a-d99a-4e91-a369-d11f0253b9d1 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:22.148976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522bc9a-d99a-4e91-a369-d11f0253b9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:22.149248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522bc9a-d99a-4e91-a369-d11f0253b9d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:22.150061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522bc9a-d99a-4e91-a369-d11f0253b9d1 None admin] RBAC: Adding query filter params (role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.project.id=070cd30bc4304b1dabf2e53f222f3db8, user.id=0e3154d79751417384cf059994b013ce) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:46:22.150372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522bc9a-d99a-4e91-a369-d11f0253b9d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:22.151819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522bc9a-d99a-4e91-a369-d11f0253b9d1 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:22.157343 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 572/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:46:22 2022] GET /identity/v3/role_assignments?user.id=0e3154d79751417384cf059994b013ce&scope.project.id=070cd30bc4304b1dabf2e53f222f3db8&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:24.422254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a767ad-cf23-43fc-82be-fd31adcd7463 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:24.422859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a767ad-cf23-43fc-82be-fd31adcd7463 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:24.422859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a767ad-cf23-43fc-82be-fd31adcd7463 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:24.424949 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 575/1147] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:46:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:46:24.431104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301e8f8-9670-4bcf-862f-0fc1c06fd761 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:24.431576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301e8f8-9670-4bcf-862f-0fc1c06fd761 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:24.431675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301e8f8-9670-4bcf-862f-0fc1c06fd761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:24.449907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0301e8f8-9670-4bcf-862f-0fc1c06fd761 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:24.451063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0301e8f8-9670-4bcf-862f-0fc1c06fd761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:24.523138 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 573/1148] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:46:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:46:24.547909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a767ad-cf23-43fc-82be-fd31adcd7463 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:24.653185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a767ad-cf23-43fc-82be-fd31adcd7463 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:24.668057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:24.693432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551956c7-d663-4a67-b918-925100e2643d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:24.694191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551956c7-d663-4a67-b918-925100e2643d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:24.694474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551956c7-d663-4a67-b918-925100e2643d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:24.694749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551956c7-d663-4a67-b918-925100e2643d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:24.706003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551956c7-d663-4a67-b918-925100e2643d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:46:24.713858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-551956c7-d663-4a67-b918-925100e2643d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:46:24.713858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:46:24.713858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:46:24.713858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:46:24.713858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:46:24.713858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:46:24.713858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:46:24.713858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:46:24.713858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:46:24.713858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:46:24.713858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:46:24.713858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:46:24.713858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:46:24.713858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:46:24.713858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:46:24.713858 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:46:24.715112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:46:24.715112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:46:24.715112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:46:24.715112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:46:24.715112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:46:24.715112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:46:24.715112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:46:24.715112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:46:24.715112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:46:24.715112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:46:24.715112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:46:24.715112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:46:24.715112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:46:24.715112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:46:24.715112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:46:24.715112 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:46:24.716123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:46:24.716123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:46:24.716123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:46:24.716123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:46:24.716123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:46:24.716123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:46:24.716123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:46:24.716123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:46:24.716123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:46:24.716123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:46:24.716123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:46:24.716123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:46:24.716123 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 576/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:46:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:46:24.721440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301e8f8-9670-4bcf-862f-0fc1c06fd761 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:24.723743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:24.827028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301e8f8-9670-4bcf-862f-0fc1c06fd761 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:24.861807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b09c8-0029-4467-89c3-4341b1d0a91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:24.862458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b09c8-0029-4467-89c3-4341b1d0a91a None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:24.862733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b09c8-0029-4467-89c3-4341b1d0a91a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:24.863009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b09c8-0029-4467-89c3-4341b1d0a91a None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:24.863764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b09c8-0029-4467-89c3-4341b1d0a91a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:46:24.864086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b09c8-0029-4467-89c3-4341b1d0a91a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:24.865469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b09c8-0029-4467-89c3-4341b1d0a91a None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:24.873551 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 574/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:46:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:24.879665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551956c7-d663-4a67-b918-925100e2643d None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:24.982000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551956c7-d663-4a67-b918-925100e2643d None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:25.019012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e26aa3-69d9-4e5c-8553-815140057459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:25.019988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e26aa3-69d9-4e5c-8553-815140057459 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:25.020348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e26aa3-69d9-4e5c-8553-815140057459 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:25.020599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e26aa3-69d9-4e5c-8553-815140057459 None admin] PATH_INFO: `/v3/users/0e3154d79751417384cf059994b013ce` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:25.021842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e26aa3-69d9-4e5c-8553-815140057459 None admin] RBAC: Authorizing `identity:get_user(user_id=0e3154d79751417384cf059994b013ce)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:25.023299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e26aa3-69d9-4e5c-8553-815140057459 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:25.024975 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 577/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:46:24 2022] GET /identity/v3/users/0e3154d79751417384cf059994b013ce => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:25.031041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b09c8-0029-4467-89c3-4341b1d0a91a None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:25.096873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:25.140253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b09c8-0029-4467-89c3-4341b1d0a91a None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:25.187666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f61ad-814e-4263-a22b-59038ac30603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:25.188564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f61ad-814e-4263-a22b-59038ac30603 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:25.188845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f61ad-814e-4263-a22b-59038ac30603 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:25.189118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f61ad-814e-4263-a22b-59038ac30603 None admin] PATH_INFO: `/v3/projects/070cd30bc4304b1dabf2e53f222f3db8` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:25.190353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f61ad-814e-4263-a22b-59038ac30603 None admin] RBAC: Authorizing `identity:get_project(project_id=070cd30bc4304b1dabf2e53f222f3db8)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:25.191812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f61ad-814e-4263-a22b-59038ac30603 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:25.193507 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 575/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:46:25 2022] GET /identity/v3/projects/070cd30bc4304b1dabf2e53f222f3db8 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:25.199694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e26aa3-69d9-4e5c-8553-815140057459 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:25.246666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:25.306182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e26aa3-69d9-4e5c-8553-815140057459 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:25.341640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794833a3-e86b-4c84-8aab-3d14d35c92b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:25.342529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794833a3-e86b-4c84-8aab-3d14d35c92b3 None admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:25.342806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794833a3-e86b-4c84-8aab-3d14d35c92b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:25.343082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794833a3-e86b-4c84-8aab-3d14d35c92b3 None admin] PATH_INFO: `/v3/projects/070cd30bc4304b1dabf2e53f222f3db8/users/0e3154d79751417384cf059994b013ce/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:25.345331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794833a3-e86b-4c84-8aab-3d14d35c92b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=070cd30bc4304b1dabf2e53f222f3db8, user_id=0e3154d79751417384cf059994b013ce, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:25.346779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794833a3-e86b-4c84-8aab-3d14d35c92b3 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:25.365377 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 578/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:46:25 2022] PUT /identity/v3/projects/070cd30bc4304b1dabf2e53f222f3db8/users/0e3154d79751417384cf059994b013ce/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 20:46:27.639017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4651542-9d61-48dd-a4ce-5407bbd0e8f4 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:27.639647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4651542-9d61-48dd-a4ce-5407bbd0e8f4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:27.639647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4651542-9d61-48dd-a4ce-5407bbd0e8f4 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:27.640993 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 576/1154] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:46:27.647880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c761081-8330-4f2e-8b26-ef44be17c9ca None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:27.648673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c761081-8330-4f2e-8b26-ef44be17c9ca None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:27.648885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c761081-8330-4f2e-8b26-ef44be17c9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:27.677640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6c761081-8330-4f2e-8b26-ef44be17c9ca None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:27.678841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6c761081-8330-4f2e-8b26-ef44be17c9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:27.749957 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 579/1155] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:46:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:46:27.788435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4651542-9d61-48dd-a4ce-5407bbd0e8f4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:27.909115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4651542-9d61-48dd-a4ce-5407bbd0e8f4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:27.943137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:27.951459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579fd8a-a356-4a9d-a281-9800c4b4786a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:27.952698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579fd8a-a356-4a9d-a281-9800c4b4786a None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:27.953053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579fd8a-a356-4a9d-a281-9800c4b4786a None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:27.953396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579fd8a-a356-4a9d-a281-9800c4b4786a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:27.970198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579fd8a-a356-4a9d-a281-9800c4b4786a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:46:27.978650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-1579fd8a-a356-4a9d-a281-9800c4b4786a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:46:27.978650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:46:27.978650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:46:27.978650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:46:27.978650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:46:27.978650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:46:27.978650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:46:27.978650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:46:27.978650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:46:27.978650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:46:27.978650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:46:27.978650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:46:27.978650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:46:27.978650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:46:27.978650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:46:27.978650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:46:27.979820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:46:27.979820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:46:27.979820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:46:27.979820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:46:27.979820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:46:27.979820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:46:27.979820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:46:27.979820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:46:27.979820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:46:27.979820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:46:27.979820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:46:27.979820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:46:27.979820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:46:27.979820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:46:27.979820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:46:27.979820 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:46:27.980907 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:46:27.980907 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:46:27.980907 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:46:27.980907 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:46:27.980907 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:46:27.980907 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:46:27.980907 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:46:27.980907 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:46:27.980907 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:46:27.980907 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:46:27.980907 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:46:27.980907 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:46:27.980907 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 577/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:46:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:46:27.986032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c761081-8330-4f2e-8b26-ef44be17c9ca None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:28.018166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:28.091334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c761081-8330-4f2e-8b26-ef44be17c9ca None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:28.128345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab81ed5-1f92-4316-8d1c-f1a1fdcf7aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:28.129013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab81ed5-1f92-4316-8d1c-f1a1fdcf7aa2 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:28.129295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab81ed5-1f92-4316-8d1c-f1a1fdcf7aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:28.129574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab81ed5-1f92-4316-8d1c-f1a1fdcf7aa2 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:28.130320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab81ed5-1f92-4316-8d1c-f1a1fdcf7aa2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:46:28.130628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab81ed5-1f92-4316-8d1c-f1a1fdcf7aa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:28.132006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab81ed5-1f92-4316-8d1c-f1a1fdcf7aa2 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:28.140563 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 580/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:46:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:46:28.146588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579fd8a-a356-4a9d-a281-9800c4b4786a None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:28.253039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579fd8a-a356-4a9d-a281-9800c4b4786a None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:28.290494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f77db-5e60-4604-8bbe-4c72b05d2900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:28.291360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f77db-5e60-4604-8bbe-4c72b05d2900 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:28.291641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f77db-5e60-4604-8bbe-4c72b05d2900 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:28.291920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f77db-5e60-4604-8bbe-4c72b05d2900 None admin] PATH_INFO: `/v3/users/0e3154d79751417384cf059994b013ce` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:28.293534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f77db-5e60-4604-8bbe-4c72b05d2900 None admin] RBAC: Authorizing `identity:get_user(user_id=0e3154d79751417384cf059994b013ce)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:28.295008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f77db-5e60-4604-8bbe-4c72b05d2900 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:28.296664 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 578/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:46:28 2022] GET /identity/v3/users/0e3154d79751417384cf059994b013ce => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:28.304771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab81ed5-1f92-4316-8d1c-f1a1fdcf7aa2 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:28.411878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:28.419623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab81ed5-1f92-4316-8d1c-f1a1fdcf7aa2 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:28.456602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8503071-bbb2-4076-af67-6ce136ffbfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:28.457273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8503071-bbb2-4076-af67-6ce136ffbfcb None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:28.457546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8503071-bbb2-4076-af67-6ce136ffbfcb None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:28.457802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8503071-bbb2-4076-af67-6ce136ffbfcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:28.528279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8503071-bbb2-4076-af67-6ce136ffbfcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:28.529657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8503071-bbb2-4076-af67-6ce136ffbfcb None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:28.623695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:28.633197 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 581/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:46:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:46:28.640020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f77db-5e60-4604-8bbe-4c72b05d2900 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:28.713032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:28.757215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f77db-5e60-4604-8bbe-4c72b05d2900 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:28.793437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d1b45-c6ef-456f-89cc-9b62775c8298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:28.794237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d1b45-c6ef-456f-89cc-9b62775c8298 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:28.794514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d1b45-c6ef-456f-89cc-9b62775c8298 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:28.794789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d1b45-c6ef-456f-89cc-9b62775c8298 None admin] PATH_INFO: `/v3/projects/070cd30bc4304b1dabf2e53f222f3db8` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:28.795985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d1b45-c6ef-456f-89cc-9b62775c8298 None admin] RBAC: Authorizing `identity:get_project(project_id=070cd30bc4304b1dabf2e53f222f3db8)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:28.797469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d1b45-c6ef-456f-89cc-9b62775c8298 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:28.799198 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 579/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:46:28 2022] GET /identity/v3/projects/070cd30bc4304b1dabf2e53f222f3db8 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:28.805731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8503071-bbb2-4076-af67-6ce136ffbfcb None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:28.919805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8503071-bbb2-4076-af67-6ce136ffbfcb None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:28.955779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c3cd2-70d6-4a13-931c-c5fe330136df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:28.956465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c3cd2-70d6-4a13-931c-c5fe330136df None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:28.956746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c3cd2-70d6-4a13-931c-c5fe330136df None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:28.957017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c3cd2-70d6-4a13-931c-c5fe330136df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:28.957841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c3cd2-70d6-4a13-931c-c5fe330136df None admin] RBAC: Adding query filter params (role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.project.id=070cd30bc4304b1dabf2e53f222f3db8, user.id=0e3154d79751417384cf059994b013ce) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:46:28.958152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c3cd2-70d6-4a13-931c-c5fe330136df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:28.959674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c3cd2-70d6-4a13-931c-c5fe330136df None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:28.966579 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 582/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:46:28 2022] GET /identity/v3/role_assignments?user.id=0e3154d79751417384cf059994b013ce&scope.project.id=070cd30bc4304b1dabf2e53f222f3db8&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:31.303797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a445baf-1e0b-46bb-bbd0-3df8f647f3ae None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:31.304401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a445baf-1e0b-46bb-bbd0-3df8f647f3ae None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:31.304401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a445baf-1e0b-46bb-bbd0-3df8f647f3ae None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:31.305752 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 580/1162] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:46:31.312201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc223e9a-b818-44d6-9660-ed791edbbf8b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:31.312881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc223e9a-b818-44d6-9660-ed791edbbf8b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:31.313065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc223e9a-b818-44d6-9660-ed791edbbf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:31.338585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-dc223e9a-b818-44d6-9660-ed791edbbf8b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:31.339927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dc223e9a-b818-44d6-9660-ed791edbbf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:31.399014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:31.413678 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 583/1163] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:46:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:46:31.438429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a445baf-1e0b-46bb-bbd0-3df8f647f3ae None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:31.560817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a445baf-1e0b-46bb-bbd0-3df8f647f3ae None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:31.591849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:31.604327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a49ab-d001-45b9-a534-543b82c0d8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:31.604993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a49ab-d001-45b9-a534-543b82c0d8ef None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:31.605273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a49ab-d001-45b9-a534-543b82c0d8ef None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:31.605547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a49ab-d001-45b9-a534-543b82c0d8ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:31.679418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a49ab-d001-45b9-a534-543b82c0d8ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:31.680915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a49ab-d001-45b9-a534-543b82c0d8ef None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:31.782112 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 581/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:46:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:46:31.789922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc223e9a-b818-44d6-9660-ed791edbbf8b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:31.891069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc223e9a-b818-44d6-9660-ed791edbbf8b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:31.926774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ae321-de01-4dd2-a37d-39497233a16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:31.927586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ae321-de01-4dd2-a37d-39497233a16c None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:31.927861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ae321-de01-4dd2-a37d-39497233a16c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:31.928486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ae321-de01-4dd2-a37d-39497233a16c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:31.936538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ae321-de01-4dd2-a37d-39497233a16c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:31.937920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ae321-de01-4dd2-a37d-39497233a16c None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:31.953091 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-875ae321-de01-4dd2-a37d-39497233a16c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 02 20:46:31.953091 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:46:31.953091 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 20:46:31.953091 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 20:46:31.953091 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:46:31.953091 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:46:31.953091 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:46:31.953091 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:46:31.953091 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 02 20:46:31.953091 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:46:31.953091 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:46:31.953091 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:46:31.953091 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:46:31.953091 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:46:31.953091 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:46:31.953091 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:46:31.953091 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:46:31.954344 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:46:31.954344 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:46:31.954344 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:46:31.954344 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:46:31.954344 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:46:31.954344 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:46:31.954344 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:46:31.954344 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:46:31.954344 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:46:31.954344 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:46:31.954344 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:46:31.954344 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:46:31.954344 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:46:31.954344 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:46:31.954344 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:46:31.954344 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:46:31.955287 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:46:31.955287 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:46:31.955287 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:46:31.955287 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:46:31.955287 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:46:31.955287 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:46:31.955287 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:46:31.955287 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:46:31.955287 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:46:31.955287 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:46:31.955287 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 20:46:31.955287 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:46:31.955287 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 02 20:46:31.955287 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:46:31.955287 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 584/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Sat Jul 2 20:46:31 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:46:31.960724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a49ab-d001-45b9-a534-543b82c0d8ef None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:31.991052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:32.065581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a49ab-d001-45b9-a534-543b82c0d8ef None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:32.104090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3950d-2c1f-4fde-82ab-9937b98f3a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:32.104778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3950d-2c1f-4fde-82ab-9937b98f3a47 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:32.105055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3950d-2c1f-4fde-82ab-9937b98f3a47 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:32.105321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3950d-2c1f-4fde-82ab-9937b98f3a47 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:32.106034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3950d-2c1f-4fde-82ab-9937b98f3a47 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:46:32.106398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3950d-2c1f-4fde-82ab-9937b98f3a47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:32.107795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3950d-2c1f-4fde-82ab-9937b98f3a47 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:32.115217 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 582/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Sat Jul 2 20:46:31 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:34.456121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7d8bf-a7cc-4a93-844c-c5c000fa4953 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:34.457033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7d8bf-a7cc-4a93-844c-c5c000fa4953 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:34.457033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7d8bf-a7cc-4a93-844c-c5c000fa4953 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:34.459196 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 585/1167] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:46:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:46:34.465629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea367d-3193-4f80-9aed-9711331a5497 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:34.466071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea367d-3193-4f80-9aed-9711331a5497 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:34.466293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea367d-3193-4f80-9aed-9711331a5497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:34.486148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e5ea367d-3193-4f80-9aed-9711331a5497 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:34.487473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e5ea367d-3193-4f80-9aed-9711331a5497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:34.562033 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 583/1168] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:46:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:46:34.587229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7d8bf-a7cc-4a93-844c-c5c000fa4953 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:34.645337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:34.724781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7d8bf-a7cc-4a93-844c-c5c000fa4953 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:34.760459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cd4ff-5811-4270-8585-af24d6e413e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:34.761111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cd4ff-5811-4270-8585-af24d6e413e3 None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:34.761387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cd4ff-5811-4270-8585-af24d6e413e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:34.761654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cd4ff-5811-4270-8585-af24d6e413e3 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:34.762422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cd4ff-5811-4270-8585-af24d6e413e3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:34.763808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cd4ff-5811-4270-8585-af24d6e413e3 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:34.781343 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 586/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Sat Jul 2 20:46:34 2022] POST /identity/v3/domains => generated 267 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:46:37.104690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0235c7e-1f5a-4194-b1f7-8f0cd7c60487 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:37.105157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0235c7e-1f5a-4194-b1f7-8f0cd7c60487 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:37.105332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0235c7e-1f5a-4194-b1f7-8f0cd7c60487 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:37.107511 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 584/1170] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:46:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:46:37.115649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97092589-e7dc-45e6-8ada-732fc781fc00 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:37.116063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97092589-e7dc-45e6-8ada-732fc781fc00 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:37.116241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97092589-e7dc-45e6-8ada-732fc781fc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:37.135509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-97092589-e7dc-45e6-8ada-732fc781fc00 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:37.136743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-97092589-e7dc-45e6-8ada-732fc781fc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:37.206951 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 587/1171] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:46:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:46:37.244967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0235c7e-1f5a-4194-b1f7-8f0cd7c60487 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:37.281032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:37.363918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0235c7e-1f5a-4194-b1f7-8f0cd7c60487 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:37.406251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b1049-4439-462e-92b2-33b48a6b17b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:37.407126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b1049-4439-462e-92b2-33b48a6b17b6 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:37.407411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b1049-4439-462e-92b2-33b48a6b17b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:37.407684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b1049-4439-462e-92b2-33b48a6b17b6 None admin] PATH_INFO: `/v3/domains/bf83b14e27b54aac92af227914c94527` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:37.419112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b1049-4439-462e-92b2-33b48a6b17b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bf83b14e27b54aac92af227914c94527)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:37.420631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b1049-4439-462e-92b2-33b48a6b17b6 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:37.422281 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 585/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Sat Jul 2 20:46:37 2022] GET /identity/v3/domains/bf83b14e27b54aac92af227914c94527 => generated 267 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:37.431592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97092589-e7dc-45e6-8ada-732fc781fc00 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:37.474762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:37.542657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97092589-e7dc-45e6-8ada-732fc781fc00 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:37.591931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdef07-ede1-4ce1-8ff7-28cda031f2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:37.592625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdef07-ede1-4ce1-8ff7-28cda031f2af None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:37.592908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdef07-ede1-4ce1-8ff7-28cda031f2af None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:37.593181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdef07-ede1-4ce1-8ff7-28cda031f2af None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:37.593890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdef07-ede1-4ce1-8ff7-28cda031f2af None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:37.595361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdef07-ede1-4ce1-8ff7-28cda031f2af None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:37.622791 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 588/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Jul 2 20:46:37 2022] POST /identity/v3/projects => generated 361 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:46:39.959826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacf35c-1896-4ed0-b3b7-ea237613ac60 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:39.960630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacf35c-1896-4ed0-b3b7-ea237613ac60 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:39.960630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacf35c-1896-4ed0-b3b7-ea237613ac60 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:39.962813 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 586/1174] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:46:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:46:39.968344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3bd45-9eda-40c6-8522-9188781f276a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:39.968768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3bd45-9eda-40c6-8522-9188781f276a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:39.968877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3bd45-9eda-40c6-8522-9188781f276a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:39.986155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-cca3bd45-9eda-40c6-8522-9188781f276a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:39.987322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cca3bd45-9eda-40c6-8522-9188781f276a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:40.058532 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 589/1175] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:46:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:46:40.086281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacf35c-1896-4ed0-b3b7-ea237613ac60 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:40.170621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:40.200354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacf35c-1896-4ed0-b3b7-ea237613ac60 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:40.245196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05429693-195b-4b48-8e2f-4a4fd026f812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:40.246480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05429693-195b-4b48-8e2f-4a4fd026f812 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:40.246957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05429693-195b-4b48-8e2f-4a4fd026f812 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:40.247361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05429693-195b-4b48-8e2f-4a4fd026f812 None admin] PATH_INFO: `/v3/domains/bf83b14e27b54aac92af227914c94527` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:40.249793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05429693-195b-4b48-8e2f-4a4fd026f812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bf83b14e27b54aac92af227914c94527)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:40.252252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05429693-195b-4b48-8e2f-4a4fd026f812 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:40.254883 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 587/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Sat Jul 2 20:46:40 2022] GET /identity/v3/domains/bf83b14e27b54aac92af227914c94527 => generated 267 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:40.263277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3bd45-9eda-40c6-8522-9188781f276a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:40.288627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:40.382225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3bd45-9eda-40c6-8522-9188781f276a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:40.420506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0b878-e5c4-49bb-9043-a22879138f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:40.421160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0b878-e5c4-49bb-9043-a22879138f4e None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:40.421446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0b878-e5c4-49bb-9043-a22879138f4e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:40.421723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0b878-e5c4-49bb-9043-a22879138f4e None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:40.422423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0b878-e5c4-49bb-9043-a22879138f4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:40.423875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0b878-e5c4-49bb-9043-a22879138f4e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:40.446698 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 590/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Jul 2 20:46:40 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:46:42.847555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106e282-b198-4d48-8d03-f61c66fa301d None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:42.848505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106e282-b198-4d48-8d03-f61c66fa301d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:42.848982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106e282-b198-4d48-8d03-f61c66fa301d None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:42.851246 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 588/1178] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:46:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:46:42.859382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6590296-a35c-4107-93f1-a8e9b95b7dca None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:42.859821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6590296-a35c-4107-93f1-a8e9b95b7dca None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:42.859931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6590296-a35c-4107-93f1-a8e9b95b7dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:42.878441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c6590296-a35c-4107-93f1-a8e9b95b7dca None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:42.879717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c6590296-a35c-4107-93f1-a8e9b95b7dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:42.949361 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 591/1179] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:46:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:46:42.975114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106e282-b198-4d48-8d03-f61c66fa301d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:43.093569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106e282-b198-4d48-8d03-f61c66fa301d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:43.129743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dcdc0-956f-4450-950f-6dd6ed1eb457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:43.130461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dcdc0-956f-4450-950f-6dd6ed1eb457 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:43.130743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dcdc0-956f-4450-950f-6dd6ed1eb457 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:43.131018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dcdc0-956f-4450-950f-6dd6ed1eb457 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:43.142113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dcdc0-956f-4450-950f-6dd6ed1eb457 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:46:43.150054 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-ab7dcdc0-956f-4450-950f-6dd6ed1eb457 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:46:43.150054 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:46:43.150054 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:46:43.150054 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:46:43.150054 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:46:43.150054 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:46:43.150054 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:46:43.150054 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:46:43.150054 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:46:43.150054 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:46:43.150054 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:46:43.150054 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:46:43.150054 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:46:43.150054 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:46:43.150054 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:46:43.150054 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:46:43.152015 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:46:43.152015 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:46:43.152015 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:46:43.152015 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:46:43.152015 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:46:43.152015 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:46:43.152015 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:46:43.152015 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:46:43.152015 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:46:43.152015 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:46:43.152015 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:46:43.152015 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:46:43.152015 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:46:43.152015 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:46:43.152015 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:46:43.152015 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:46:43.153205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:46:43.153205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:46:43.153205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:46:43.153205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:46:43.153205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:46:43.153205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:46:43.153205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:46:43.153205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:46:43.153205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:46:43.153205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:46:43.153205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:46:43.153205 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:46:43.153205 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 589/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:46:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:46:43.158070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6590296-a35c-4107-93f1-a8e9b95b7dca None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:43.171003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:43.271234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6590296-a35c-4107-93f1-a8e9b95b7dca None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:43.320611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae1753-cb21-476e-9780-c8bf9de7d34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:43.321278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae1753-cb21-476e-9780-c8bf9de7d34c None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:43.321556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae1753-cb21-476e-9780-c8bf9de7d34c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:43.321823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae1753-cb21-476e-9780-c8bf9de7d34c None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:43.322569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae1753-cb21-476e-9780-c8bf9de7d34c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:46:43.322868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae1753-cb21-476e-9780-c8bf9de7d34c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:43.324282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae1753-cb21-476e-9780-c8bf9de7d34c None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:43.332790 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 592/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:46:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:46:43.342328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dcdc0-956f-4450-950f-6dd6ed1eb457 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:43.363320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:43.470540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dcdc0-956f-4450-950f-6dd6ed1eb457 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:43.510730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc91239-ed6d-413f-a15d-932ca8b59971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:43.511626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc91239-ed6d-413f-a15d-932ca8b59971 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:43.511904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc91239-ed6d-413f-a15d-932ca8b59971 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:43.512209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc91239-ed6d-413f-a15d-932ca8b59971 None admin] PATH_INFO: `/v3/users/b3a634870c604efc8a25cbc824a62b91` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:43.527950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc91239-ed6d-413f-a15d-932ca8b59971 None admin] RBAC: Authorizing `identity:get_user(user_id=b3a634870c604efc8a25cbc824a62b91)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:43.529515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc91239-ed6d-413f-a15d-932ca8b59971 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:43.531281 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 590/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:46:43 2022] GET /identity/v3/users/b3a634870c604efc8a25cbc824a62b91 => generated 311 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:43.538222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae1753-cb21-476e-9780-c8bf9de7d34c None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:43.632695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:43.672702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae1753-cb21-476e-9780-c8bf9de7d34c None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:43.713220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539525aa-a105-4874-bb0e-9f81ce836bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:43.713872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539525aa-a105-4874-bb0e-9f81ce836bd0 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:43.714151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539525aa-a105-4874-bb0e-9f81ce836bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:43.714432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539525aa-a105-4874-bb0e-9f81ce836bd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:43.800953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539525aa-a105-4874-bb0e-9f81ce836bd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:43.802485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539525aa-a105-4874-bb0e-9f81ce836bd0 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:43.882090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:43.921188 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 593/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:46:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:46:43.929164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc91239-ed6d-413f-a15d-932ca8b59971 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:44.013992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:44.053811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc91239-ed6d-413f-a15d-932ca8b59971 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:44.092637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4dff3-433a-49b8-b785-311ce6ebc435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:44.093811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4dff3-433a-49b8-b785-311ce6ebc435 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:44.094008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4dff3-433a-49b8-b785-311ce6ebc435 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:44.094465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4dff3-433a-49b8-b785-311ce6ebc435 None admin] PATH_INFO: `/v3/projects/67d95564ec224f1bb07e100902d47c0f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:44.095995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4dff3-433a-49b8-b785-311ce6ebc435 None admin] RBAC: Authorizing `identity:get_project(project_id=67d95564ec224f1bb07e100902d47c0f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:44.097898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4dff3-433a-49b8-b785-311ce6ebc435 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:44.100011 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 591/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:46:43 2022] GET /identity/v3/projects/67d95564ec224f1bb07e100902d47c0f => generated 361 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:44.107324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539525aa-a105-4874-bb0e-9f81ce836bd0 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:44.224890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539525aa-a105-4874-bb0e-9f81ce836bd0 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:44.267365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee223d-b41c-4a8a-a82e-5f63b3912274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:44.268013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee223d-b41c-4a8a-a82e-5f63b3912274 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:44.268327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee223d-b41c-4a8a-a82e-5f63b3912274 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:44.268601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee223d-b41c-4a8a-a82e-5f63b3912274 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:44.269423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee223d-b41c-4a8a-a82e-5f63b3912274 None admin] RBAC: Adding query filter params (role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.project.id=67d95564ec224f1bb07e100902d47c0f, user.id=b3a634870c604efc8a25cbc824a62b91) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:46:44.269705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee223d-b41c-4a8a-a82e-5f63b3912274 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:44.271211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee223d-b41c-4a8a-a82e-5f63b3912274 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:44.277089 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 594/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:46:44 2022] GET /identity/v3/role_assignments?user.id=b3a634870c604efc8a25cbc824a62b91&scope.project.id=67d95564ec224f1bb07e100902d47c0f&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:46.581901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ec1f-3797-419b-b96c-ffdfef76809b None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:46.582493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ec1f-3797-419b-b96c-ffdfef76809b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:46.582493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ec1f-3797-419b-b96c-ffdfef76809b None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:46.583908 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 592/1186] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:46:46.590936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537e4f3-2516-4d13-b719-7994a1a5e572 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:46.591661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537e4f3-2516-4d13-b719-7994a1a5e572 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:46.591808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537e4f3-2516-4d13-b719-7994a1a5e572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:46.613631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4537e4f3-2516-4d13-b719-7994a1a5e572 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:46.614857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4537e4f3-2516-4d13-b719-7994a1a5e572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:46.645069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:46.689315 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 595/1187] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:46:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:46:46.713889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871ec1f-3797-419b-b96c-ffdfef76809b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:46.834212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871ec1f-3797-419b-b96c-ffdfef76809b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:46.873817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab0403-f6b3-4225-a0db-11b29a5b7100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:46.874644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab0403-f6b3-4225-a0db-11b29a5b7100 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:46.874922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab0403-f6b3-4225-a0db-11b29a5b7100 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:46.875190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab0403-f6b3-4225-a0db-11b29a5b7100 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:46.878158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:46.886811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab0403-f6b3-4225-a0db-11b29a5b7100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:46:46.894560 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-f3ab0403-f6b3-4225-a0db-11b29a5b7100 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:46:46.894560 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:46:46.894560 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:46:46.894560 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:46:46.894560 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:46:46.894560 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:46:46.894560 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:46:46.894560 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:46:46.894560 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:46:46.894560 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:46:46.894560 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:46:46.894560 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:46:46.894560 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:46:46.894560 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:46:46.894560 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:46:46.894560 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:46:46.895614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:46:46.895614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:46:46.895614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:46:46.895614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:46:46.895614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:46:46.895614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:46:46.895614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:46:46.895614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:46:46.895614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:46:46.895614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:46:46.895614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:46:46.895614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:46:46.895614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:46:46.895614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:46:46.895614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:46:46.895614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:46:46.896588 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:46:46.896588 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:46:46.896588 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:46:46.896588 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:46:46.896588 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:46:46.896588 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:46:46.896588 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:46:46.896588 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:46:46.896588 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:46:46.896588 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:46:46.896588 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:46:46.896588 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:46:46.896588 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 593/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:46:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:46:46.902575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537e4f3-2516-4d13-b719-7994a1a5e572 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:47.009261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537e4f3-2516-4d13-b719-7994a1a5e572 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:47.045111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cad00-f031-42f0-9410-88df6daaed6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:47.045769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cad00-f031-42f0-9410-88df6daaed6f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:47.046053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cad00-f031-42f0-9410-88df6daaed6f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:47.046328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cad00-f031-42f0-9410-88df6daaed6f None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:47.047065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cad00-f031-42f0-9410-88df6daaed6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:46:47.047356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cad00-f031-42f0-9410-88df6daaed6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:47.048779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cad00-f031-42f0-9410-88df6daaed6f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:47.057252 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 596/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:46:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:47.064105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab0403-f6b3-4225-a0db-11b29a5b7100 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:47.174971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab0403-f6b3-4225-a0db-11b29a5b7100 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:47.209672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c10a6e-0a9d-40ca-81e2-b0ce96909e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:47.210566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c10a6e-0a9d-40ca-81e2-b0ce96909e66 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:47.210839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c10a6e-0a9d-40ca-81e2-b0ce96909e66 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:47.211113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c10a6e-0a9d-40ca-81e2-b0ce96909e66 None admin] PATH_INFO: `/v3/users/b3a634870c604efc8a25cbc824a62b91` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:47.212421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c10a6e-0a9d-40ca-81e2-b0ce96909e66 None admin] RBAC: Authorizing `identity:get_user(user_id=b3a634870c604efc8a25cbc824a62b91)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:47.213873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c10a6e-0a9d-40ca-81e2-b0ce96909e66 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:47.215506 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 594/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:46:47 2022] GET /identity/v3/users/b3a634870c604efc8a25cbc824a62b91 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:47.222232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cad00-f031-42f0-9410-88df6daaed6f None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:47.261359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:47.353718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cad00-f031-42f0-9410-88df6daaed6f None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:47.391130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482b833-84ab-40df-800f-31b0c41792eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:47.391985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482b833-84ab-40df-800f-31b0c41792eb None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:47.392299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482b833-84ab-40df-800f-31b0c41792eb None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:47.392574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482b833-84ab-40df-800f-31b0c41792eb None admin] PATH_INFO: `/v3/projects/67d95564ec224f1bb07e100902d47c0f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:47.393873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482b833-84ab-40df-800f-31b0c41792eb None admin] RBAC: Authorizing `identity:get_project(project_id=67d95564ec224f1bb07e100902d47c0f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:47.395325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482b833-84ab-40df-800f-31b0c41792eb None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:47.397061 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 597/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:46:47 2022] GET /identity/v3/projects/67d95564ec224f1bb07e100902d47c0f => generated 361 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:47.403248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c10a6e-0a9d-40ca-81e2-b0ce96909e66 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:47.470872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:47.512059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c10a6e-0a9d-40ca-81e2-b0ce96909e66 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:47.557164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4d274-683a-42ee-a487-4f5f3eba5d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:47.558062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4d274-683a-42ee-a487-4f5f3eba5d53 None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:47.558344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4d274-683a-42ee-a487-4f5f3eba5d53 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:47.558621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4d274-683a-42ee-a487-4f5f3eba5d53 None admin] PATH_INFO: `/v3/projects/67d95564ec224f1bb07e100902d47c0f/users/b3a634870c604efc8a25cbc824a62b91/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:47.560865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4d274-683a-42ee-a487-4f5f3eba5d53 None admin] RBAC: Authorizing `identity:create_grant(project_id=67d95564ec224f1bb07e100902d47c0f, user_id=b3a634870c604efc8a25cbc824a62b91, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:47.562333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4d274-683a-42ee-a487-4f5f3eba5d53 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:47.581221 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 595/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:46:47 2022] PUT /identity/v3/projects/67d95564ec224f1bb07e100902d47c0f/users/b3a634870c604efc8a25cbc824a62b91/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:46:49.902964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5516cf8-f47b-4f48-9b9c-88c9f01a2ca1 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:49.903863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5516cf8-f47b-4f48-9b9c-88c9f01a2ca1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:49.903863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5516cf8-f47b-4f48-9b9c-88c9f01a2ca1 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:49.906103 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 598/1193] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:46:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:46:49.911600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92a71d-64cb-449e-a6d9-2ace3fac3849 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:49.912031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92a71d-64cb-449e-a6d9-2ace3fac3849 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:49.912151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92a71d-64cb-449e-a6d9-2ace3fac3849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:49.931252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ef92a71d-64cb-449e-a6d9-2ace3fac3849 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:49.932507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ef92a71d-64cb-449e-a6d9-2ace3fac3849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:50.002496 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 596/1194] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:46:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:46:50.029029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5516cf8-f47b-4f48-9b9c-88c9f01a2ca1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:50.139120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:50.151053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5516cf8-f47b-4f48-9b9c-88c9f01a2ca1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:50.186379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eccd1-4138-422d-8af1-8ad1b318a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:50.187119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eccd1-4138-422d-8af1-8ad1b318a2f0 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:50.187397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eccd1-4138-422d-8af1-8ad1b318a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:50.187667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eccd1-4138-422d-8af1-8ad1b318a2f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:50.200594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54eccd1-4138-422d-8af1-8ad1b318a2f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:46:50.208172 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-a54eccd1-4138-422d-8af1-8ad1b318a2f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:46:50.208172 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:46:50.208172 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:46:50.208172 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:46:50.208172 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:46:50.208172 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:46:50.208172 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:46:50.208172 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:46:50.208172 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:46:50.208172 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:46:50.208172 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:46:50.208172 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:46:50.208172 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:46:50.208172 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:46:50.208172 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:46:50.208172 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:46:50.209271 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:46:50.209271 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:46:50.209271 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:46:50.209271 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:46:50.209271 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:46:50.209271 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:46:50.209271 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:46:50.209271 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:46:50.209271 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:46:50.209271 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:46:50.209271 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:46:50.209271 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:46:50.209271 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:46:50.209271 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:46:50.209271 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:46:50.209271 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:46:50.210168 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:46:50.210168 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:46:50.210168 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:46:50.210168 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:46:50.210168 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:46:50.210168 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:46:50.210168 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:46:50.210168 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:46:50.210168 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:46:50.210168 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:46:50.210168 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:46:50.210168 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:46:50.210168 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 599/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:46:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:46:50.216322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92a71d-64cb-449e-a6d9-2ace3fac3849 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:50.280600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:50.327439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92a71d-64cb-449e-a6d9-2ace3fac3849 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:50.363246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895a5c5-f341-4050-a425-df49bcef4b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:50.363910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895a5c5-f341-4050-a425-df49bcef4b89 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:50.364225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895a5c5-f341-4050-a425-df49bcef4b89 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:50.364496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895a5c5-f341-4050-a425-df49bcef4b89 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:50.365234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895a5c5-f341-4050-a425-df49bcef4b89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:46:50.365543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895a5c5-f341-4050-a425-df49bcef4b89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:50.366927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895a5c5-f341-4050-a425-df49bcef4b89 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:50.375064 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 597/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:46:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:50.381823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eccd1-4138-422d-8af1-8ad1b318a2f0 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:50.506858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eccd1-4138-422d-8af1-8ad1b318a2f0 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:50.543768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66c4d4-6a6b-4f4d-8b76-c3b05db1bc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:50.544661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66c4d4-6a6b-4f4d-8b76-c3b05db1bc59 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:50.544932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66c4d4-6a6b-4f4d-8b76-c3b05db1bc59 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:50.545198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66c4d4-6a6b-4f4d-8b76-c3b05db1bc59 None admin] PATH_INFO: `/v3/users/b3a634870c604efc8a25cbc824a62b91` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:50.546388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66c4d4-6a6b-4f4d-8b76-c3b05db1bc59 None admin] RBAC: Authorizing `identity:get_user(user_id=b3a634870c604efc8a25cbc824a62b91)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:50.547830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66c4d4-6a6b-4f4d-8b76-c3b05db1bc59 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:50.549476 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 600/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Jul 2 20:46:50 2022] GET /identity/v3/users/b3a634870c604efc8a25cbc824a62b91 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:50.558687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895a5c5-f341-4050-a425-df49bcef4b89 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:50.671288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895a5c5-f341-4050-a425-df49bcef4b89 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:50.687554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:50.707859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5a790-c692-4122-92c8-24424f6d6437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:50.708564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5a790-c692-4122-92c8-24424f6d6437 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:50.708855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5a790-c692-4122-92c8-24424f6d6437 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:50.709221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5a790-c692-4122-92c8-24424f6d6437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:50.777785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5a790-c692-4122-92c8-24424f6d6437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:50.779194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5a790-c692-4122-92c8-24424f6d6437 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:50.888171 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 598/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:46:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:46:50.896826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66c4d4-6a6b-4f4d-8b76-c3b05db1bc59 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:50.921040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:51.007814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66c4d4-6a6b-4f4d-8b76-c3b05db1bc59 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:51.043406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a17c5-cfaa-4112-85d6-90f7b2c67586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:51.044232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a17c5-cfaa-4112-85d6-90f7b2c67586 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:51.044513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a17c5-cfaa-4112-85d6-90f7b2c67586 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:51.044783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a17c5-cfaa-4112-85d6-90f7b2c67586 None admin] PATH_INFO: `/v3/projects/67d95564ec224f1bb07e100902d47c0f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:51.046084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a17c5-cfaa-4112-85d6-90f7b2c67586 None admin] RBAC: Authorizing `identity:get_project(project_id=67d95564ec224f1bb07e100902d47c0f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:51.047513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a17c5-cfaa-4112-85d6-90f7b2c67586 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:51.049242 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 601/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Jul 2 20:46:50 2022] GET /identity/v3/projects/67d95564ec224f1bb07e100902d47c0f => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:51.058595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5a790-c692-4122-92c8-24424f6d6437 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:51.081852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:51.164875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5a790-c692-4122-92c8-24424f6d6437 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:51.211402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d970ad0-a9b2-4e17-8851-babe7efc4499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:51.212090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d970ad0-a9b2-4e17-8851-babe7efc4499 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:51.212367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d970ad0-a9b2-4e17-8851-babe7efc4499 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:51.212637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d970ad0-a9b2-4e17-8851-babe7efc4499 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:51.213457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d970ad0-a9b2-4e17-8851-babe7efc4499 None admin] RBAC: Adding query filter params (role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.project.id=67d95564ec224f1bb07e100902d47c0f, user.id=b3a634870c604efc8a25cbc824a62b91) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:46:51.213768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d970ad0-a9b2-4e17-8851-babe7efc4499 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:51.215219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d970ad0-a9b2-4e17-8851-babe7efc4499 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:51.221473 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 599/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:46:51 2022] GET /identity/v3/role_assignments?user.id=b3a634870c604efc8a25cbc824a62b91&scope.project.id=67d95564ec224f1bb07e100902d47c0f&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:47:01.038415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=56 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:47:01.218484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=60 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:47:53.539348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29616dd6-a44f-4052-a554-1636c15f01c1 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:53.539964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29616dd6-a44f-4052-a554-1636c15f01c1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:53.539964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29616dd6-a44f-4052-a554-1636c15f01c1 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:53.541346 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 602/1201] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:47:53.547557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bf383-0133-401e-905d-caae15cbfeff None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:53.548110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bf383-0133-401e-905d-caae15cbfeff None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:53.548110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bf383-0133-401e-905d-caae15cbfeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:53.571210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-951bf383-0133-401e-905d-caae15cbfeff None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:47:53.572740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-951bf383-0133-401e-905d-caae15cbfeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:47:53.670323 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 600/1202] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:47:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:47:53.703516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29616dd6-a44f-4052-a554-1636c15f01c1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:53.854298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29616dd6-a44f-4052-a554-1636c15f01c1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:53.901506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f7ffd-ff79-45a9-ad56-46743ca5d769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:53.902374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f7ffd-ff79-45a9-ad56-46743ca5d769 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:53.902687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f7ffd-ff79-45a9-ad56-46743ca5d769 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:53.902955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f7ffd-ff79-45a9-ad56-46743ca5d769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:53.918896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f7ffd-ff79-45a9-ad56-46743ca5d769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:53.920698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f7ffd-ff79-45a9-ad56-46743ca5d769 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:53.944331 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-350f7ffd-ff79-45a9-ad56-46743ca5d769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:47:53.944331 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:47:53.944331 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:47:53.944331 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:47:53.944331 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:47:53.944331 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:47:53.944331 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:47:53.944331 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:47:53.944331 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:47:53.944331 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:47:53.944331 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:47:53.944331 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:47:53.944331 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:47:53.944331 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:47:53.944331 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:47:53.945455 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:47:53.945455 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:47:53.945455 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:47:53.945455 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:47:53.945455 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:47:53.945455 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:47:53.945455 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:47:53.945455 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:47:53.945455 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:47:53.945455 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:47:53.945455 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:47:53.945455 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:47:53.945455 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:47:53.945455 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:47:53.945455 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:47:53.945455 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:47:53.945455 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:47:53.947101 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:47:53.947101 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:47:53.947101 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:47:53.947101 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:47:53.947101 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 603/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:47:53.952088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bf383-0133-401e-905d-caae15cbfeff None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:54.083504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bf383-0133-401e-905d-caae15cbfeff None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:54.117504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:47:54.125387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d46d5-ffa3-46db-a5b2-a882e1619998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:54.126211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d46d5-ffa3-46db-a5b2-a882e1619998 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:54.126693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d46d5-ffa3-46db-a5b2-a882e1619998 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:54.126968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d46d5-ffa3-46db-a5b2-a882e1619998 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:54.127592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d46d5-ffa3-46db-a5b2-a882e1619998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:47:54.127925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d46d5-ffa3-46db-a5b2-a882e1619998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:54.129695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d46d5-ffa3-46db-a5b2-a882e1619998 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:54.152443 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 601/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:47:54.154000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f7ffd-ff79-45a9-ad56-46743ca5d769 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:54.229996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:47:54.289290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f7ffd-ff79-45a9-ad56-46743ca5d769 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:54.335528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c9235-adac-4013-8ab5-3ddbc5e84bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:54.336297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c9235-adac-4013-8ab5-3ddbc5e84bcd None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:54.336605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c9235-adac-4013-8ab5-3ddbc5e84bcd None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:54.336938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c9235-adac-4013-8ab5-3ddbc5e84bcd None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:54.337763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c9235-adac-4013-8ab5-3ddbc5e84bcd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:54.339649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c9235-adac-4013-8ab5-3ddbc5e84bcd None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:54.364445 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 604/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Jul 2 20:47:54 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:47:56.896592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527ae6e-8514-46cb-a19a-b0f3c48ee081 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:56.897189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527ae6e-8514-46cb-a19a-b0f3c48ee081 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:56.897189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527ae6e-8514-46cb-a19a-b0f3c48ee081 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:56.898641 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 602/1206] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:47:56.903748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae1df1-afbd-4d1e-a54d-8ed3be99e903 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:56.904235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae1df1-afbd-4d1e-a54d-8ed3be99e903 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:56.904322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae1df1-afbd-4d1e-a54d-8ed3be99e903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:56.922872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3dae1df1-afbd-4d1e-a54d-8ed3be99e903 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:47:56.924091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3dae1df1-afbd-4d1e-a54d-8ed3be99e903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:47:57.008351 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 605/1207] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:47:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:47:57.027630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527ae6e-8514-46cb-a19a-b0f3c48ee081 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:57.153229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527ae6e-8514-46cb-a19a-b0f3c48ee081 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:57.190891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66050c47-d98c-4fb7-9d0c-fd14f66cefc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:57.191769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66050c47-d98c-4fb7-9d0c-fd14f66cefc2 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:57.192068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66050c47-d98c-4fb7-9d0c-fd14f66cefc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:57.192350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66050c47-d98c-4fb7-9d0c-fd14f66cefc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:57.204885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66050c47-d98c-4fb7-9d0c-fd14f66cefc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:47:57.212986 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-66050c47-d98c-4fb7-9d0c-fd14f66cefc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:47:57.212986 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:47:57.212986 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:47:57.212986 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:47:57.212986 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:47:57.212986 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:47:57.212986 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:47:57.212986 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:47:57.212986 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:47:57.212986 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:47:57.212986 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:47:57.212986 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:47:57.212986 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:47:57.212986 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:47:57.212986 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:47:57.212986 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:47:57.219945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:47:57.219945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:47:57.219945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:47:57.219945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:47:57.219945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:47:57.219945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:47:57.219945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:47:57.219945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:47:57.219945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:47:57.219945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:47:57.219945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:47:57.219945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:47:57.219945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:47:57.219945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:47:57.219945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:47:57.219945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:47:57.220961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:47:57.220961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:47:57.220961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:47:57.220961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:47:57.220961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:47:57.220961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:47:57.220961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:47:57.220961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:47:57.220961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:47:57.220961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:47:57.220961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:47:57.220961 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:47:57.220961 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 603/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:47:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:47:57.221741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae1df1-afbd-4d1e-a54d-8ed3be99e903 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:57.269709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:47:57.334510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae1df1-afbd-4d1e-a54d-8ed3be99e903 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:57.374786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36799383-2a02-4ef2-87a8-8b21b66a045b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:57.375511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36799383-2a02-4ef2-87a8-8b21b66a045b None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:57.375880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36799383-2a02-4ef2-87a8-8b21b66a045b None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:57.376192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36799383-2a02-4ef2-87a8-8b21b66a045b None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:57.376970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36799383-2a02-4ef2-87a8-8b21b66a045b None admin] RBAC: Adding query filter params (name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:47:57.377274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36799383-2a02-4ef2-87a8-8b21b66a045b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:57.378655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36799383-2a02-4ef2-87a8-8b21b66a045b None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:57.394475 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 606/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:47:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:47:57.395633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66050c47-d98c-4fb7-9d0c-fd14f66cefc2 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:57.449285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:47:57.506411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66050c47-d98c-4fb7-9d0c-fd14f66cefc2 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:57.550403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b83fd0-2917-43ef-978a-5a0ab594964d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:57.551199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b83fd0-2917-43ef-978a-5a0ab594964d None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:57.551524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b83fd0-2917-43ef-978a-5a0ab594964d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:57.551809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b83fd0-2917-43ef-978a-5a0ab594964d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:57.564307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b83fd0-2917-43ef-978a-5a0ab594964d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:57.565781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b83fd0-2917-43ef-978a-5a0ab594964d None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:57.588099 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-74b83fd0-2917-43ef-978a-5a0ab594964d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:47:57.588099 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:47:57.588099 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:47:57.588099 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:47:57.588099 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:47:57.588099 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:47:57.588099 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:47:57.588099 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:47:57.588099 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:47:57.588099 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:47:57.588099 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:47:57.588099 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:47:57.588099 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:47:57.588099 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:47:57.588099 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:47:57.589174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:47:57.589174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:47:57.589174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:47:57.589174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:47:57.589174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:47:57.589174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:47:57.589174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:47:57.589174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:47:57.589174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:47:57.589174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:47:57.589174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:47:57.589174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:47:57.589174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:47:57.589174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:47:57.589174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:47:57.589174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:47:57.589174 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:47:57.590114 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:47:57.590114 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:47:57.590114 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:47:57.590114 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:47:57.590114 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 604/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:47:57.595903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36799383-2a02-4ef2-87a8-8b21b66a045b None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:57.706578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:47:57.709692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36799383-2a02-4ef2-87a8-8b21b66a045b None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:57.749113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ae7ba-48f5-4fe4-ac9a-dc62de478832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:57.749886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ae7ba-48f5-4fe4-ac9a-dc62de478832 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:57.750170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ae7ba-48f5-4fe4-ac9a-dc62de478832 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:57.750440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ae7ba-48f5-4fe4-ac9a-dc62de478832 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:57.751198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ae7ba-48f5-4fe4-ac9a-dc62de478832 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:47:57.751502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ae7ba-48f5-4fe4-ac9a-dc62de478832 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:57.752943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ae7ba-48f5-4fe4-ac9a-dc62de478832 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:57.766439 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 607/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:47:57.772343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b83fd0-2917-43ef-978a-5a0ab594964d None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:57.881185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b83fd0-2917-43ef-978a-5a0ab594964d None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:57.882804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:47:57.917963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f9f8b-9ad1-4575-9b15-f3f53710d36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:57.918803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f9f8b-9ad1-4575-9b15-f3f53710d36d None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:57.919209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f9f8b-9ad1-4575-9b15-f3f53710d36d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:57.919396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f9f8b-9ad1-4575-9b15-f3f53710d36d None admin] PATH_INFO: `/v3/users/placement` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:57.927540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f9f8b-9ad1-4575-9b15-f3f53710d36d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:57.929023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f9f8b-9ad1-4575-9b15-f3f53710d36d None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:57.945741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-fb1f9f8b-9ad1-4575-9b15-f3f53710d36d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:47:57.945741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:47:57.945741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:47:57.945741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:47:57.945741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:47:57.945741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:47:57.945741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:47:57.945741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:47:57.945741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:47:57.945741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:47:57.945741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:47:57.945741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:47:57.945741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:47:57.945741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:47:57.945741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:47:57.945741 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:47:57.947454 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:47:57.947454 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:47:57.947454 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:47:57.947454 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:47:57.947454 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:47:57.947454 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:47:57.947454 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:47:57.947454 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:47:57.947454 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:47:57.947454 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:47:57.947454 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:47:57.947454 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:47:57.947454 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:47:57.947454 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:47:57.947454 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:47:57.947454 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:47:57.947454 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:47:57.947454 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:47:57.950040 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:47:57.950040 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:47:57.950040 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:47:57.950040 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:47:57.950040 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:47:57.950040 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:47:57.950040 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:47:57.950040 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:47:57.950040 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:47:57.950040 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:47:57.950040 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 605/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:47:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:47:57.954196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ae7ba-48f5-4fe4-ac9a-dc62de478832 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:58.062405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ae7ba-48f5-4fe4-ac9a-dc62de478832 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:58.101285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7195ee5-448e-4cb3-be44-11f94865b0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:58.102293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7195ee5-448e-4cb3-be44-11f94865b0a3 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:58.102746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7195ee5-448e-4cb3-be44-11f94865b0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:58.103113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7195ee5-448e-4cb3-be44-11f94865b0a3 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:58.104218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7195ee5-448e-4cb3-be44-11f94865b0a3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:47:58.104624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7195ee5-448e-4cb3-be44-11f94865b0a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:58.106541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7195ee5-448e-4cb3-be44-11f94865b0a3 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:58.133220 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 608/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Sat Jul 2 20:47:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:47:58.134730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f9f8b-9ad1-4575-9b15-f3f53710d36d None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:58.255588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f9f8b-9ad1-4575-9b15-f3f53710d36d None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:58.296688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80faf26-b3b6-4024-9f48-f67c50000c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:58.297343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80faf26-b3b6-4024-9f48-f67c50000c81 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:58.297622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80faf26-b3b6-4024-9f48-f67c50000c81 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:58.297892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80faf26-b3b6-4024-9f48-f67c50000c81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:58.334539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:47:58.377970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80faf26-b3b6-4024-9f48-f67c50000c81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:58.379594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80faf26-b3b6-4024-9f48-f67c50000c81 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:58.485030 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 606/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:47:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:47:58.490777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7195ee5-448e-4cb3-be44-11f94865b0a3 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:58.510777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:47:58.616435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7195ee5-448e-4cb3-be44-11f94865b0a3 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:58.662104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559b0bb-7638-412e-811a-d3b6cb60fe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:58.663106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559b0bb-7638-412e-811a-d3b6cb60fe04 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:58.663455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559b0bb-7638-412e-811a-d3b6cb60fe04 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:58.663730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559b0bb-7638-412e-811a-d3b6cb60fe04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:58.676870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559b0bb-7638-412e-811a-d3b6cb60fe04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:58.678328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559b0bb-7638-412e-811a-d3b6cb60fe04 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:58.698579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-d559b0bb-7638-412e-811a-d3b6cb60fe04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:47:58.698579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:47:58.698579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:47:58.698579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:47:58.698579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:47:58.698579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:47:58.698579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:47:58.698579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:47:58.698579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:47:58.698579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:47:58.698579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:47:58.698579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:47:58.698579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:47:58.698579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:47:58.698579 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:47:58.699700 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:47:58.699700 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:47:58.699700 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:47:58.699700 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:47:58.699700 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:47:58.699700 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:47:58.699700 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:47:58.699700 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:47:58.699700 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:47:58.699700 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:47:58.699700 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:47:58.699700 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:47:58.699700 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:47:58.699700 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:47:58.699700 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:47:58.699700 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:47:58.699700 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:47:58.700816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:47:58.700816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:47:58.700816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:47:58.700816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:47:58.705407 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 609/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:47:58.706915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80faf26-b3b6-4024-9f48-f67c50000c81 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:58.786474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:47:58.835033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80faf26-b3b6-4024-9f48-f67c50000c81 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:58.876652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adafca0-8c2e-4182-b08e-68442aa98a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:58.877342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adafca0-8c2e-4182-b08e-68442aa98a81 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:58.877754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adafca0-8c2e-4182-b08e-68442aa98a81 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:58.878106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adafca0-8c2e-4182-b08e-68442aa98a81 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:58.879061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adafca0-8c2e-4182-b08e-68442aa98a81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:47:58.879465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adafca0-8c2e-4182-b08e-68442aa98a81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:58.881104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adafca0-8c2e-4182-b08e-68442aa98a81 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:58.893891 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 607/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:47:58.899452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559b0bb-7638-412e-811a-d3b6cb60fe04 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:58.981909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:47:59.019797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559b0bb-7638-412e-811a-d3b6cb60fe04 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:59.061932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd34d7f-fa99-4baf-a2fe-145e5beedd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:59.062737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd34d7f-fa99-4baf-a2fe-145e5beedd8d None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:59.063014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd34d7f-fa99-4baf-a2fe-145e5beedd8d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:59.063286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd34d7f-fa99-4baf-a2fe-145e5beedd8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:59.070342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd34d7f-fa99-4baf-a2fe-145e5beedd8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:59.071804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd34d7f-fa99-4baf-a2fe-145e5beedd8d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:59.086277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-2fd34d7f-fa99-4baf-a2fe-145e5beedd8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:47:59.086277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:47:59.086277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:47:59.086277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:47:59.086277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:47:59.086277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:47:59.086277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:47:59.086277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:47:59.086277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:47:59.086277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:47:59.086277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:47:59.086277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:47:59.086277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:47:59.086277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:47:59.086277 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:47:59.087325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:47:59.087325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:47:59.087325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:47:59.087325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:47:59.087325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:47:59.087325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:47:59.087325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:47:59.087325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:47:59.087325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:47:59.087325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:47:59.087325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:47:59.087325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:47:59.087325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:47:59.087325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:47:59.087325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:47:59.087325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:47:59.087325 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:47:59.095811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:47:59.095811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:47:59.095811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:47:59.095811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:47:59.095811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:47:59.095811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:47:59.095811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:47:59.095811 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:47:59.095811 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 610/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:47:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:47:59.098652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adafca0-8c2e-4182-b08e-68442aa98a81 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:59.207281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adafca0-8c2e-4182-b08e-68442aa98a81 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:59.231001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:47:59.247002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09befd25-e548-4718-aa08-77072b7cf1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:59.247933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09befd25-e548-4718-aa08-77072b7cf1a1 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:59.248244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09befd25-e548-4718-aa08-77072b7cf1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:59.248559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09befd25-e548-4718-aa08-77072b7cf1a1 None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:59.249461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09befd25-e548-4718-aa08-77072b7cf1a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:47:59.250995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09befd25-e548-4718-aa08-77072b7cf1a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:59.251727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09befd25-e548-4718-aa08-77072b7cf1a1 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:59.266323 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 608/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:47:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:47:59.273204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd34d7f-fa99-4baf-a2fe-145e5beedd8d None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:59.398055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd34d7f-fa99-4baf-a2fe-145e5beedd8d None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:59.432985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:47:59.440003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30252eb-71a5-439c-a0f5-6d2c656eb269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:59.440858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30252eb-71a5-439c-a0f5-6d2c656eb269 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:59.441139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30252eb-71a5-439c-a0f5-6d2c656eb269 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:59.441437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30252eb-71a5-439c-a0f5-6d2c656eb269 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:59.442259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30252eb-71a5-439c-a0f5-6d2c656eb269 None admin] RBAC: Adding query filter params (role.id=843bfd29577143dcb23593a75d4ee5a0, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=8d8de7334e054d53ab0c0e7dd7cb7c8c) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:47:59.442566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30252eb-71a5-439c-a0f5-6d2c656eb269 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:59.444029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30252eb-71a5-439c-a0f5-6d2c656eb269 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:59.451023 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 611/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:47:59 2022] GET /identity/v3/role_assignments?user.id=8d8de7334e054d53ab0c0e7dd7cb7c8c&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=843bfd29577143dcb23593a75d4ee5a0 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:01.852726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21980d62-b6d2-488d-afc3-6815775b4798 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:01.853295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21980d62-b6d2-488d-afc3-6815775b4798 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:01.853295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21980d62-b6d2-488d-afc3-6815775b4798 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:01.854763 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 609/1220] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:48:01.859787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2120cd2-85b8-498a-9c29-34696f9393f3 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:01.860262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2120cd2-85b8-498a-9c29-34696f9393f3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:01.860353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2120cd2-85b8-498a-9c29-34696f9393f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:01.879969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a2120cd2-85b8-498a-9c29-34696f9393f3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:48:01.881329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a2120cd2-85b8-498a-9c29-34696f9393f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:48:01.956175 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 612/1221] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:48:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:48:01.982873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21980d62-b6d2-488d-afc3-6815775b4798 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:02.107438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21980d62-b6d2-488d-afc3-6815775b4798 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:02.150085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d0127-84b7-457f-8d4c-7f000b31e9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:02.150896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d0127-84b7-457f-8d4c-7f000b31e9c2 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:02.151179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d0127-84b7-457f-8d4c-7f000b31e9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:02.151458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d0127-84b7-457f-8d4c-7f000b31e9c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:02.162873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d0127-84b7-457f-8d4c-7f000b31e9c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:48:02.171661 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-327d0127-84b7-457f-8d4c-7f000b31e9c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:48:02.171661 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:02.171661 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:02.171661 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:02.171661 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:02.171661 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:02.171661 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:02.171661 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:02.171661 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:02.171661 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:02.171661 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:02.171661 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:02.171661 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:48:02.171661 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:48:02.171661 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:48:02.171661 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:48:02.172887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:48:02.172887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:48:02.172887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:48:02.172887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:48:02.172887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:02.172887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:02.172887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:02.172887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:02.172887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:02.172887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:02.172887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:02.172887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:02.172887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:02.172887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:02.172887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:02.172887 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:02.173890 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:02.173890 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:02.173890 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:02.173890 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:02.173890 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:48:02.173890 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:48:02.173890 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:48:02.173890 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:48:02.173890 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:48:02.173890 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:48:02.173890 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:48:02.173890 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:02.173890 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 610/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:48:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:02.179247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2120cd2-85b8-498a-9c29-34696f9393f3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:02.297228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2120cd2-85b8-498a-9c29-34696f9393f3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:02.327295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:02.341243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a21c1-c4b0-4774-bfcb-69d1d0d8caee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:02.341922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a21c1-c4b0-4774-bfcb-69d1d0d8caee None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:02.342203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a21c1-c4b0-4774-bfcb-69d1d0d8caee None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:02.342482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a21c1-c4b0-4774-bfcb-69d1d0d8caee None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:02.343227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a21c1-c4b0-4774-bfcb-69d1d0d8caee None admin] RBAC: Adding query filter params (name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:02.343535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a21c1-c4b0-4774-bfcb-69d1d0d8caee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:02.344949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a21c1-c4b0-4774-bfcb-69d1d0d8caee None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:02.353560 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 613/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:48:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:48:02.359795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d0127-84b7-457f-8d4c-7f000b31e9c2 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:02.415577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:02.484590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d0127-84b7-457f-8d4c-7f000b31e9c2 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:02.522853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337bb75-dd1c-4730-83c5-846abd13c362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:02.523758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337bb75-dd1c-4730-83c5-846abd13c362 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:02.524068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337bb75-dd1c-4730-83c5-846abd13c362 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:02.524355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337bb75-dd1c-4730-83c5-846abd13c362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:02.540937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337bb75-dd1c-4730-83c5-846abd13c362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:02.542773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337bb75-dd1c-4730-83c5-846abd13c362 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:02.562812 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-e337bb75-dd1c-4730-83c5-846abd13c362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:02.562812 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:02.562812 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:02.562812 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:02.562812 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:02.562812 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:02.562812 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:02.562812 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:02.562812 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:02.562812 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:02.562812 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:02.562812 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:02.562812 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:48:02.562812 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:48:02.562812 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:48:02.563987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:48:02.563987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:02.563987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:02.563987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:02.563987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:02.563987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:02.563987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:02.563987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:02.563987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:02.563987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:02.563987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:02.563987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:02.563987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:02.563987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:02.563987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:02.563987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:02.563987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:02.565583 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:48:02.565583 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:48:02.565583 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:02.565583 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:02.565583 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 611/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:02.571104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a21c1-c4b0-4774-bfcb-69d1d0d8caee None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:02.693777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a21c1-c4b0-4774-bfcb-69d1d0d8caee None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:02.730444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1241079-8893-4924-be6b-d3982b70cfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:02.731203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1241079-8893-4924-be6b-d3982b70cfe8 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:02.731480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1241079-8893-4924-be6b-d3982b70cfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:02.731757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1241079-8893-4924-be6b-d3982b70cfe8 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:02.734517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1241079-8893-4924-be6b-d3982b70cfe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:02.734517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1241079-8893-4924-be6b-d3982b70cfe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:02.734517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1241079-8893-4924-be6b-d3982b70cfe8 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:02.747550 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 614/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:02.754433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337bb75-dd1c-4730-83c5-846abd13c362 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:02.873208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:02.881471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337bb75-dd1c-4730-83c5-846abd13c362 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:02.928191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9d04f-ecb6-4bad-b985-d2dc5a49e2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:02.929685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9d04f-ecb6-4bad-b985-d2dc5a49e2df None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:02.929685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9d04f-ecb6-4bad-b985-d2dc5a49e2df None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:02.929685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9d04f-ecb6-4bad-b985-d2dc5a49e2df None admin] PATH_INFO: `/v3/users/placement` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:02.940294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9d04f-ecb6-4bad-b985-d2dc5a49e2df None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:02.941828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9d04f-ecb6-4bad-b985-d2dc5a49e2df None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:02.957795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-6ee9d04f-ecb6-4bad-b985-d2dc5a49e2df None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:48:02.957795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:02.957795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:02.957795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:02.957795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:02.957795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:02.957795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:02.957795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:02.957795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:02.957795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:02.957795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:02.957795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:02.957795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:48:02.957795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:48:02.957795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:48:02.957795 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:48:02.959010 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:02.959010 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:02.959010 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:48:02.959010 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:48:02.959010 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:48:02.959010 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:48:02.959010 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:02.959010 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:02.959010 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:02.959010 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:02.959010 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:02.959010 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:02.959010 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:02.959010 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:02.959010 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:02.959010 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:02.959010 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:02.959010 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:02.960098 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:02.960098 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:02.960098 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:48:02.960098 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:48:02.960098 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:48:02.960098 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:48:02.960098 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:48:02.960098 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:48:02.960098 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:48:02.960098 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:02.960098 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 612/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:48:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:02.966284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1241079-8893-4924-be6b-d3982b70cfe8 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:03.021178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:03.085366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1241079-8893-4924-be6b-d3982b70cfe8 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:03.125505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e65b73-6c82-4b17-8da4-85373c6654ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:03.126440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e65b73-6c82-4b17-8da4-85373c6654ce None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:03.126851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e65b73-6c82-4b17-8da4-85373c6654ce None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:03.127134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e65b73-6c82-4b17-8da4-85373c6654ce None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:03.128320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e65b73-6c82-4b17-8da4-85373c6654ce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:03.128757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e65b73-6c82-4b17-8da4-85373c6654ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:03.130822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e65b73-6c82-4b17-8da4-85373c6654ce None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:03.150247 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 615/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Sat Jul 2 20:48:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:03.156051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9d04f-ecb6-4bad-b985-d2dc5a49e2df None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:03.261606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9d04f-ecb6-4bad-b985-d2dc5a49e2df None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:03.296546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa724a01-f300-4288-9880-98510b47e95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:03.297413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa724a01-f300-4288-9880-98510b47e95e None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:03.297769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa724a01-f300-4288-9880-98510b47e95e None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:03.298071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa724a01-f300-4288-9880-98510b47e95e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:03.310739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa724a01-f300-4288-9880-98510b47e95e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:03.313185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa724a01-f300-4288-9880-98510b47e95e None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:03.332009 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-aa724a01-f300-4288-9880-98510b47e95e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:03.332009 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:03.332009 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:03.332009 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:03.332009 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:03.332009 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:03.332009 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:03.332009 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:03.332009 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:03.332009 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:03.332009 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:03.332009 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:03.332009 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:48:03.332009 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:48:03.332009 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:48:03.333118 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:48:03.333118 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:03.333118 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:03.333118 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:03.333118 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:03.333118 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:03.333118 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:03.333118 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:03.333118 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:03.333118 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:03.333118 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:03.333118 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:03.333118 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:03.333118 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:03.333118 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:03.333118 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:03.333118 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:03.334924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:48:03.334924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:48:03.334924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:03.334924 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:03.334924 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 613/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:03.342841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e65b73-6c82-4b17-8da4-85373c6654ce None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:03.461380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e65b73-6c82-4b17-8da4-85373c6654ce None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:03.463819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:03.500467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a808a09-bce3-43a5-a26a-277c6b563cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:03.501185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a808a09-bce3-43a5-a26a-277c6b563cb8 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:03.501511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a808a09-bce3-43a5-a26a-277c6b563cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:03.501822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a808a09-bce3-43a5-a26a-277c6b563cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:03.502626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a808a09-bce3-43a5-a26a-277c6b563cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:03.502942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a808a09-bce3-43a5-a26a-277c6b563cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:03.504412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a808a09-bce3-43a5-a26a-277c6b563cb8 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:03.516698 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 616/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:03.523230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa724a01-f300-4288-9880-98510b47e95e None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:03.532974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:03.634808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa724a01-f300-4288-9880-98510b47e95e None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:03.675823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b56612-7f00-4743-abb3-bda3edf35926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:03.676916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b56612-7f00-4743-abb3-bda3edf35926 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:03.677278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b56612-7f00-4743-abb3-bda3edf35926 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:03.677652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b56612-7f00-4743-abb3-bda3edf35926 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:03.685743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b56612-7f00-4743-abb3-bda3edf35926 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:03.687235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b56612-7f00-4743-abb3-bda3edf35926 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:03.704505 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-a8b56612-7f00-4743-abb3-bda3edf35926 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:48:03.704505 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:03.704505 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:03.704505 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:03.704505 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:03.704505 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:03.704505 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:03.704505 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:03.704505 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:03.704505 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:03.704505 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:03.704505 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:03.704505 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:48:03.704505 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:48:03.704505 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:48:03.705614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:48:03.705614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:03.705614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:03.705614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:03.705614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:03.705614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:03.705614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:03.705614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:03.705614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:03.705614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:03.705614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:03.705614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:03.705614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:03.705614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:03.705614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:03.705614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:03.705614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:03.706989 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:48:03.706989 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:48:03.706989 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:48:03.706989 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:48:03.706989 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:48:03.706989 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:48:03.706989 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:48:03.706989 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:03.706989 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 614/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:48:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:03.712202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a808a09-bce3-43a5-a26a-277c6b563cb8 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:03.832578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a808a09-bce3-43a5-a26a-277c6b563cb8 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:03.867933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375cc3d-f5ba-41bc-b0cc-bcc15d7be180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:03.868627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375cc3d-f5ba-41bc-b0cc-bcc15d7be180 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:03.868911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375cc3d-f5ba-41bc-b0cc-bcc15d7be180 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:03.869188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375cc3d-f5ba-41bc-b0cc-bcc15d7be180 None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:03.869969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375cc3d-f5ba-41bc-b0cc-bcc15d7be180 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:03.870278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375cc3d-f5ba-41bc-b0cc-bcc15d7be180 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:03.871714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375cc3d-f5ba-41bc-b0cc-bcc15d7be180 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:03.883862 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 617/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:48:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:03.890386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b56612-7f00-4743-abb3-bda3edf35926 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:03.963648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:04.006468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b56612-7f00-4743-abb3-bda3edf35926 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:04.044797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590f210-1249-4fb0-9e85-c0810a6d425d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:04.045814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590f210-1249-4fb0-9e85-c0810a6d425d None admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:04.046190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590f210-1249-4fb0-9e85-c0810a6d425d None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:04.046561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590f210-1249-4fb0-9e85-c0810a6d425d None admin] PATH_INFO: `/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/8d8de7334e054d53ab0c0e7dd7cb7c8c/roles/843bfd29577143dcb23593a75d4ee5a0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:04.064734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590f210-1249-4fb0-9e85-c0810a6d425d None admin] RBAC: Authorizing `identity:create_grant(project_id=001bf63308784f4eb62e64d6f82c8354, user_id=8d8de7334e054d53ab0c0e7dd7cb7c8c, role_id=843bfd29577143dcb23593a75d4ee5a0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:04.066362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590f210-1249-4fb0-9e85-c0810a6d425d None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:04.080376 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 615/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:48:03 2022] PUT /identity/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/8d8de7334e054d53ab0c0e7dd7cb7c8c/roles/843bfd29577143dcb23593a75d4ee5a0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:48:06.534925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b77ff2-ddad-4b02-b8da-e2b4b2c6daa2 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:06.535553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b77ff2-ddad-4b02-b8da-e2b4b2c6daa2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:06.535553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b77ff2-ddad-4b02-b8da-e2b4b2c6daa2 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:06.537110 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 618/1233] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:48:06.543146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ce6e5-aa19-4ee5-bb7e-32e1b498086f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:06.543648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ce6e5-aa19-4ee5-bb7e-32e1b498086f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:06.543854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ce6e5-aa19-4ee5-bb7e-32e1b498086f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:06.561160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-523ce6e5-aa19-4ee5-bb7e-32e1b498086f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:48:06.562366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-523ce6e5-aa19-4ee5-bb7e-32e1b498086f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:48:06.633096 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 616/1234] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:48:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:48:06.659680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b77ff2-ddad-4b02-b8da-e2b4b2c6daa2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:06.691174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:06.779832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b77ff2-ddad-4b02-b8da-e2b4b2c6daa2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:06.823652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6783d-1d69-45ba-a957-d519d71c6daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:06.824532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6783d-1d69-45ba-a957-d519d71c6daa None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:06.824814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6783d-1d69-45ba-a957-d519d71c6daa None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:06.825091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6783d-1d69-45ba-a957-d519d71c6daa None admin] PATH_INFO: `/v3/roles/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:06.838734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6783d-1d69-45ba-a957-d519d71c6daa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:48:06.846738 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-b9d6783d-1d69-45ba-a957-d519d71c6daa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:48:06.846738 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:06.846738 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:06.846738 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:06.846738 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:06.846738 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:06.846738 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:06.846738 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:06.846738 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:06.846738 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:06.846738 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:06.846738 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:06.846738 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:48:06.846738 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:48:06.846738 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:48:06.846738 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:48:06.852239 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:48:06.852239 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:48:06.852239 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:48:06.852239 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:48:06.852239 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:06.852239 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:06.852239 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:06.852239 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:06.852239 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:06.852239 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:06.852239 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:06.852239 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:06.852239 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:06.852239 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:06.852239 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:06.852239 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:06.853445 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:06.853445 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:06.853445 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:06.853445 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:06.853445 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:48:06.853445 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:48:06.853445 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:48:06.853445 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:48:06.853445 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:48:06.853445 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:48:06.853445 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:48:06.853445 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:48:06.853445 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 619/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Jul 2 20:48:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:06.854572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ce6e5-aa19-4ee5-bb7e-32e1b498086f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:06.906880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:06.966782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ce6e5-aa19-4ee5-bb7e-32e1b498086f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:07.003796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7799c86-6238-4477-a87a-142bff3154dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:07.004525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7799c86-6238-4477-a87a-142bff3154dc None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:07.004830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7799c86-6238-4477-a87a-142bff3154dc None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:07.005105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7799c86-6238-4477-a87a-142bff3154dc None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:07.005875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7799c86-6238-4477-a87a-142bff3154dc None admin] RBAC: Adding query filter params (name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:07.006183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7799c86-6238-4477-a87a-142bff3154dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:07.007569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7799c86-6238-4477-a87a-142bff3154dc None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:07.017938 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 617/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Jul 2 20:48:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:48:07.024975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6783d-1d69-45ba-a957-d519d71c6daa None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:07.126195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:07.143366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6783d-1d69-45ba-a957-d519d71c6daa None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:07.177145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a37003-f471-4caa-9080-b2676219736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:07.178065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a37003-f471-4caa-9080-b2676219736a None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:07.178372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a37003-f471-4caa-9080-b2676219736a None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:07.178643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a37003-f471-4caa-9080-b2676219736a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:07.191754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a37003-f471-4caa-9080-b2676219736a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:07.193617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a37003-f471-4caa-9080-b2676219736a None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:07.213222 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-71a37003-f471-4caa-9080-b2676219736a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:07.213222 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:07.213222 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:07.213222 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:07.213222 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:07.213222 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:07.213222 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:07.213222 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:07.213222 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:07.213222 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:07.213222 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:07.213222 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:07.213222 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:48:07.213222 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:48:07.213222 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:48:07.214504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:48:07.214504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:07.214504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:07.214504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:07.214504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:07.214504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:07.214504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:07.214504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:07.214504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:07.214504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:07.214504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:07.214504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:07.214504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:07.214504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:07.214504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:07.214504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:07.214504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:07.215568 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:48:07.215568 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:48:07.215568 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:07.215568 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:48:07.215568 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 620/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:48:07.221073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7799c86-6238-4477-a87a-142bff3154dc None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:07.330218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7799c86-6238-4477-a87a-142bff3154dc None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:07.340916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:07.368648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fa97f-a573-4052-804d-1fad95ef2e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:07.369330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fa97f-a573-4052-804d-1fad95ef2e6c None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:07.369609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fa97f-a573-4052-804d-1fad95ef2e6c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:07.369910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fa97f-a573-4052-804d-1fad95ef2e6c None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:07.370723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fa97f-a573-4052-804d-1fad95ef2e6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:07.371075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fa97f-a573-4052-804d-1fad95ef2e6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:07.372585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fa97f-a573-4052-804d-1fad95ef2e6c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:07.390252 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 618/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:07.391680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a37003-f471-4caa-9080-b2676219736a None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:07.506895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a37003-f471-4caa-9080-b2676219736a None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:07.543233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43db69-0b4f-484d-b140-2c04d6f45b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:07.544310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43db69-0b4f-484d-b140-2c04d6f45b0c None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:07.544622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43db69-0b4f-484d-b140-2c04d6f45b0c None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:07.544966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43db69-0b4f-484d-b140-2c04d6f45b0c None admin] PATH_INFO: `/v3/users/placement` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:07.548124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:07.554327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43db69-0b4f-484d-b140-2c04d6f45b0c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:07.556119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43db69-0b4f-484d-b140-2c04d6f45b0c None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:07.572240 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-bc43db69-0b4f-484d-b140-2c04d6f45b0c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:48:07.572240 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:07.572240 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:07.572240 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:07.572240 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:07.572240 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:07.572240 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:07.572240 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:07.572240 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:07.572240 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:07.572240 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:07.572240 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:07.572240 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:48:07.572240 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:48:07.572240 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:48:07.572240 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:48:07.573292 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:07.573292 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:07.573292 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:48:07.573292 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:48:07.573292 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:48:07.573292 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:48:07.573292 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:07.573292 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:07.573292 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:07.573292 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:07.573292 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:07.573292 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:07.573292 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:07.573292 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:07.573292 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:07.573292 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:07.573292 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:07.573292 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:07.574267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:07.574267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:07.574267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:48:07.574267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:48:07.574267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:48:07.574267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:48:07.574267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:48:07.574267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:48:07.574267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:48:07.574267 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:48:07.579008 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 621/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:48:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:07.580169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fa97f-a573-4052-804d-1fad95ef2e6c None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:07.696386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fa97f-a573-4052-804d-1fad95ef2e6c None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:07.731126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be6c7c-104c-43ec-8567-4a989d581de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:07.731802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be6c7c-104c-43ec-8567-4a989d581de0 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:07.732114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be6c7c-104c-43ec-8567-4a989d581de0 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:07.732393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be6c7c-104c-43ec-8567-4a989d581de0 None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:07.733230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be6c7c-104c-43ec-8567-4a989d581de0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:07.733536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be6c7c-104c-43ec-8567-4a989d581de0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:07.734989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be6c7c-104c-43ec-8567-4a989d581de0 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:07.754214 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 619/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Sat Jul 2 20:48:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:07.760923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43db69-0b4f-484d-b140-2c04d6f45b0c None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:07.885315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43db69-0b4f-484d-b140-2c04d6f45b0c None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:07.923306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c5ddd-5502-4747-9a6e-83eeb7db5fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:07.924079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c5ddd-5502-4747-9a6e-83eeb7db5fce None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:07.924387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c5ddd-5502-4747-9a6e-83eeb7db5fce None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:07.924737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c5ddd-5502-4747-9a6e-83eeb7db5fce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:07.987957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:07.996494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c5ddd-5502-4747-9a6e-83eeb7db5fce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:07.998215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c5ddd-5502-4747-9a6e-83eeb7db5fce None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:08.107830 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 622/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:48:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 02 20:48:08.113703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be6c7c-104c-43ec-8567-4a989d581de0 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:08.143372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:08.221566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be6c7c-104c-43ec-8567-4a989d581de0 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:08.256763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7376da-0e33-4e47-9e91-92134f2dbe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:08.257488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7376da-0e33-4e47-9e91-92134f2dbe98 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:08.257763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7376da-0e33-4e47-9e91-92134f2dbe98 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:08.258029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7376da-0e33-4e47-9e91-92134f2dbe98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:08.271805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7376da-0e33-4e47-9e91-92134f2dbe98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:08.273679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7376da-0e33-4e47-9e91-92134f2dbe98 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:08.293426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-ae7376da-0e33-4e47-9e91-92134f2dbe98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:08.293426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:08.293426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:08.293426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:08.293426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:08.293426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:08.293426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:08.293426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:08.293426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:08.293426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:08.293426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:08.293426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:08.293426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:48:08.293426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:48:08.293426 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:48:08.294521 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:48:08.294521 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:08.294521 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:08.294521 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:08.294521 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:08.294521 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:08.294521 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:08.294521 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:08.294521 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:08.294521 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:08.294521 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:08.294521 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:08.294521 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:08.294521 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:08.294521 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:08.294521 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:08.294521 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:08.295527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:48:08.295527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:48:08.295527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:08.295527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:08.295527 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 620/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:08.300948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c5ddd-5502-4747-9a6e-83eeb7db5fce None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:08.421511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:08.428031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c5ddd-5502-4747-9a6e-83eeb7db5fce None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:08.466165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6baaf6-dc80-4e77-9860-0ea4a67df5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:08.466929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6baaf6-dc80-4e77-9860-0ea4a67df5f8 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:08.467244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6baaf6-dc80-4e77-9860-0ea4a67df5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:08.467554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6baaf6-dc80-4e77-9860-0ea4a67df5f8 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:08.468415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6baaf6-dc80-4e77-9860-0ea4a67df5f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:08.468724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6baaf6-dc80-4e77-9860-0ea4a67df5f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:08.470145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6baaf6-dc80-4e77-9860-0ea4a67df5f8 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:08.487017 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 623/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:08.493075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7376da-0e33-4e47-9e91-92134f2dbe98 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:08.576179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:08.599858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7376da-0e33-4e47-9e91-92134f2dbe98 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:08.638742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a55b0-f99c-4279-87a0-c30ef92bb185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:08.639745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a55b0-f99c-4279-87a0-c30ef92bb185 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:08.640030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a55b0-f99c-4279-87a0-c30ef92bb185 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:08.640338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a55b0-f99c-4279-87a0-c30ef92bb185 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:08.648445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a55b0-f99c-4279-87a0-c30ef92bb185 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:08.650154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a55b0-f99c-4279-87a0-c30ef92bb185 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:08.665638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-7f4a55b0-f99c-4279-87a0-c30ef92bb185 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:48:08.665638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:08.665638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:08.665638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:08.665638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:08.665638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:08.665638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:08.665638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:08.665638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:08.665638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:08.665638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:08.665638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:08.665638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:48:08.665638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:48:08.665638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:48:08.666727 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:48:08.666727 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:08.666727 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:08.666727 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:08.666727 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:08.666727 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:08.666727 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:08.666727 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:08.666727 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:08.666727 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:08.666727 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:08.666727 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:08.666727 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:08.666727 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:08.666727 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:08.666727 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:08.666727 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:08.667645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:48:08.667645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:48:08.667645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:48:08.667645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:48:08.667645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:48:08.667645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:48:08.667645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:48:08.667645 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:08.667645 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 621/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:48:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:48:08.673236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6baaf6-dc80-4e77-9860-0ea4a67df5f8 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:08.787571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6baaf6-dc80-4e77-9860-0ea4a67df5f8 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:08.827457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c03421-ec2d-4a15-ab75-395a5fb93f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:08.828303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c03421-ec2d-4a15-ab75-395a5fb93f6f None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:08.828642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c03421-ec2d-4a15-ab75-395a5fb93f6f None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:08.828976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c03421-ec2d-4a15-ab75-395a5fb93f6f None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:08.830021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c03421-ec2d-4a15-ab75-395a5fb93f6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:08.830331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c03421-ec2d-4a15-ab75-395a5fb93f6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:08.832016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c03421-ec2d-4a15-ab75-395a5fb93f6f None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:08.852585 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 624/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:48:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:08.853994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a55b0-f99c-4279-87a0-c30ef92bb185 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:08.964313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a55b0-f99c-4279-87a0-c30ef92bb185 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:09.002547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb2bd8-d55d-497a-aef4-ea6e2bb0a6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:09.003275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb2bd8-d55d-497a-aef4-ea6e2bb0a6cf None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:09.003612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb2bd8-d55d-497a-aef4-ea6e2bb0a6cf None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:09.003922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb2bd8-d55d-497a-aef4-ea6e2bb0a6cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:09.005048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb2bd8-d55d-497a-aef4-ea6e2bb0a6cf None admin] RBAC: Adding query filter params (role.id=843bfd29577143dcb23593a75d4ee5a0, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=8d8de7334e054d53ab0c0e7dd7cb7c8c) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:09.005422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb2bd8-d55d-497a-aef4-ea6e2bb0a6cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:09.007011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb2bd8-d55d-497a-aef4-ea6e2bb0a6cf None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:09.013359 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 622/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:48:08 2022] GET /identity/v3/role_assignments?user.id=8d8de7334e054d53ab0c0e7dd7cb7c8c&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=843bfd29577143dcb23593a75d4ee5a0 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:48:11.586339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050e7c9-d523-491d-aa4e-be3cee6af279 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:11.586936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050e7c9-d523-491d-aa4e-be3cee6af279 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:11.586936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050e7c9-d523-491d-aa4e-be3cee6af279 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:11.588678 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 625/1247] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:48:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:48:11.594407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49cc60-b3a7-4ea8-bb36-e7d6a6491fe8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:11.594910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49cc60-b3a7-4ea8-bb36-e7d6a6491fe8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:11.595002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49cc60-b3a7-4ea8-bb36-e7d6a6491fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:11.600187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:11.614397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1a49cc60-b3a7-4ea8-bb36-e7d6a6491fe8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:48:11.615733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1a49cc60-b3a7-4ea8-bb36-e7d6a6491fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:48:11.692477 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 623/1248] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:48:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:48:11.723413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050e7c9-d523-491d-aa4e-be3cee6af279 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:11.742756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:11.858465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050e7c9-d523-491d-aa4e-be3cee6af279 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:11.899544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ddbe9-9379-4f1e-b09a-1344682a79ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:11.900376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ddbe9-9379-4f1e-b09a-1344682a79ca None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:11.900654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ddbe9-9379-4f1e-b09a-1344682a79ca None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:11.900923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ddbe9-9379-4f1e-b09a-1344682a79ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:11.910892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ddbe9-9379-4f1e-b09a-1344682a79ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:48:11.918879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-eb8ddbe9-9379-4f1e-b09a-1344682a79ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:48:11.918879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:11.918879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:11.918879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:11.918879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:11.918879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:11.918879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:11.918879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:11.918879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:11.918879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:11.918879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:11.918879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:11.918879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:48:11.918879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:48:11.918879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:48:11.918879 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:48:11.919938 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:48:11.919938 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:48:11.919938 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:48:11.919938 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:48:11.919938 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:11.919938 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:11.919938 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:11.919938 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:11.919938 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:11.919938 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:11.919938 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:11.919938 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:11.919938 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:11.919938 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:11.919938 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:11.919938 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:11.920887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:11.920887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:11.920887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:11.920887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:11.920887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:48:11.920887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:48:11.920887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:48:11.920887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:48:11.920887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:48:11.920887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:48:11.920887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:48:11.920887 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:48:11.920887 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 626/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:48:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:11.926334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49cc60-b3a7-4ea8-bb36-e7d6a6491fe8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:12.038279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49cc60-b3a7-4ea8-bb36-e7d6a6491fe8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:12.070792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:12.076776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542dbfe-3b6e-43c0-9e53-066708e966b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:12.077540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542dbfe-3b6e-43c0-9e53-066708e966b9 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:12.077841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542dbfe-3b6e-43c0-9e53-066708e966b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:12.078098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542dbfe-3b6e-43c0-9e53-066708e966b9 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:12.079043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542dbfe-3b6e-43c0-9e53-066708e966b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:12.079410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542dbfe-3b6e-43c0-9e53-066708e966b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:12.081123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542dbfe-3b6e-43c0-9e53-066708e966b9 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:12.091822 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 624/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:48:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:12.098154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ddbe9-9379-4f1e-b09a-1344682a79ca None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:12.184680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:12.215898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ddbe9-9379-4f1e-b09a-1344682a79ca None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:12.261902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8fcaa-ed9c-4281-8ba5-67ab6bf21e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:12.262714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8fcaa-ed9c-4281-8ba5-67ab6bf21e26 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:12.263038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8fcaa-ed9c-4281-8ba5-67ab6bf21e26 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:12.263470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8fcaa-ed9c-4281-8ba5-67ab6bf21e26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:12.276278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8fcaa-ed9c-4281-8ba5-67ab6bf21e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:12.277928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8fcaa-ed9c-4281-8ba5-67ab6bf21e26 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:12.305373 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-1af8fcaa-ed9c-4281-8ba5-67ab6bf21e26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:12.305373 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:12.305373 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:12.305373 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:12.305373 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:12.305373 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:12.305373 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:12.305373 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:12.305373 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:12.305373 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:12.305373 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:12.305373 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:12.305373 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:48:12.305373 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:48:12.305373 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:48:12.306632 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:48:12.306632 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:12.306632 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:12.306632 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:12.306632 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:12.306632 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:12.306632 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:12.306632 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:12.306632 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:12.306632 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:12.306632 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:12.306632 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:12.306632 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:12.306632 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:12.306632 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:12.306632 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:12.306632 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:12.307943 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:48:12.307943 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:48:12.307943 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:12.307943 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:48:12.307943 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 627/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:12.314259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542dbfe-3b6e-43c0-9e53-066708e966b9 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:12.422142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542dbfe-3b6e-43c0-9e53-066708e966b9 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:12.462670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e64e4-e07e-43c6-a8b4-c55cfba3bbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:12.463487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e64e4-e07e-43c6-a8b4-c55cfba3bbcd None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:12.463814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e64e4-e07e-43c6-a8b4-c55cfba3bbcd None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:12.464128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e64e4-e07e-43c6-a8b4-c55cfba3bbcd None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:12.465136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e64e4-e07e-43c6-a8b4-c55cfba3bbcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:12.465451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e64e4-e07e-43c6-a8b4-c55cfba3bbcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:12.467041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e64e4-e07e-43c6-a8b4-c55cfba3bbcd None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:12.481541 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 625/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:12.487372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8fcaa-ed9c-4281-8ba5-67ab6bf21e26 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:12.602816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8fcaa-ed9c-4281-8ba5-67ab6bf21e26 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:12.632138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:12.641923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8786c-01d3-41c4-ab1c-087a49b329b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:12.642764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8786c-01d3-41c4-ab1c-087a49b329b0 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:12.643046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8786c-01d3-41c4-ab1c-087a49b329b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:12.643326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8786c-01d3-41c4-ab1c-087a49b329b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:12.651273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8786c-01d3-41c4-ab1c-087a49b329b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:12.652765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8786c-01d3-41c4-ab1c-087a49b329b0 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:12.668625 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-6ab8786c-01d3-41c4-ab1c-087a49b329b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:48:12.668625 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:12.668625 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:12.668625 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:12.668625 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:12.668625 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:12.668625 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:12.668625 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:12.668625 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:12.668625 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:12.668625 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:12.668625 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:12.668625 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:48:12.668625 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:48:12.668625 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:48:12.668625 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:48:12.669791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:12.669791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:12.669791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:48:12.669791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:48:12.669791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:48:12.669791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:48:12.669791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:12.669791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:12.669791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:12.669791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:12.669791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:12.669791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:12.669791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:12.669791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:12.669791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:12.669791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:12.669791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:12.669791 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:12.671220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:12.671220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:12.671220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:48:12.671220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:48:12.671220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:48:12.671220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:48:12.671220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:48:12.671220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:48:12.671220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:48:12.671220 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:48:12.671220 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 628/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:48:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:12.676067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e64e4-e07e-43c6-a8b4-c55cfba3bbcd None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:12.738271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:12.787911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e64e4-e07e-43c6-a8b4-c55cfba3bbcd None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:12.970585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79d6f3-9453-49ec-8424-d77db4a01019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:12.971290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79d6f3-9453-49ec-8424-d77db4a01019 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:12.971599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79d6f3-9453-49ec-8424-d77db4a01019 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:12.971972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79d6f3-9453-49ec-8424-d77db4a01019 None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:12.972905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79d6f3-9453-49ec-8424-d77db4a01019 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:12.973460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79d6f3-9453-49ec-8424-d77db4a01019 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:12.975234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79d6f3-9453-49ec-8424-d77db4a01019 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:12.997729 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 626/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Sat Jul 2 20:48:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:13.003999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8786c-01d3-41c4-ab1c-087a49b329b0 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:13.123410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8786c-01d3-41c4-ab1c-087a49b329b0 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:13.161133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db7e0d-66eb-4c21-85ba-a892aedff452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:13.162253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db7e0d-66eb-4c21-85ba-a892aedff452 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:13.162744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db7e0d-66eb-4c21-85ba-a892aedff452 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:13.163079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db7e0d-66eb-4c21-85ba-a892aedff452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:13.229929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:13.243643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db7e0d-66eb-4c21-85ba-a892aedff452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:13.245208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db7e0d-66eb-4c21-85ba-a892aedff452 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:13.351350 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 629/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:48:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:48:13.357332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79d6f3-9453-49ec-8424-d77db4a01019 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:13.467172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79d6f3-9453-49ec-8424-d77db4a01019 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:13.481755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:13.505331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799009f-18c5-4153-82cf-2b19a01ab57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:13.506151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799009f-18c5-4153-82cf-2b19a01ab57c None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:13.506429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799009f-18c5-4153-82cf-2b19a01ab57c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:13.506817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799009f-18c5-4153-82cf-2b19a01ab57c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:13.518321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799009f-18c5-4153-82cf-2b19a01ab57c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:13.519834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799009f-18c5-4153-82cf-2b19a01ab57c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:13.539168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-f799009f-18c5-4153-82cf-2b19a01ab57c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:13.539168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:13.539168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:13.539168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:13.539168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:13.539168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:13.539168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:13.539168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:13.539168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:13.539168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:13.539168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:13.539168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:13.539168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:48:13.539168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:48:13.539168 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:48:13.540746 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:48:13.540746 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:13.540746 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:13.540746 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:13.540746 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:13.540746 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:13.540746 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:13.540746 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:13.540746 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:13.540746 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:13.540746 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:13.540746 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:13.540746 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:13.540746 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:13.540746 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:13.540746 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:13.540746 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:13.546632 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:48:13.546632 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:48:13.546632 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:13.546632 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:13.546632 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 627/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:48:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:13.547003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db7e0d-66eb-4c21-85ba-a892aedff452 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:13.642222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:13.655453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db7e0d-66eb-4c21-85ba-a892aedff452 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:13.692093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913464c-9bc0-4de5-9362-fe8cd98242b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:13.692824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913464c-9bc0-4de5-9362-fe8cd98242b9 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:13.693113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913464c-9bc0-4de5-9362-fe8cd98242b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:13.693389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913464c-9bc0-4de5-9362-fe8cd98242b9 None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:13.694116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913464c-9bc0-4de5-9362-fe8cd98242b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:13.694422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913464c-9bc0-4de5-9362-fe8cd98242b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:13.695835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913464c-9bc0-4de5-9362-fe8cd98242b9 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:13.708116 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 630/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:13.713964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799009f-18c5-4153-82cf-2b19a01ab57c None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:13.831730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799009f-18c5-4153-82cf-2b19a01ab57c None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:13.871298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d0ae7-c743-4fec-9389-d9cefe1f240c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:13.872133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d0ae7-c743-4fec-9389-d9cefe1f240c None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:13.872416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d0ae7-c743-4fec-9389-d9cefe1f240c None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:13.872689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d0ae7-c743-4fec-9389-d9cefe1f240c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:13.879591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d0ae7-c743-4fec-9389-d9cefe1f240c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:13.881186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d0ae7-c743-4fec-9389-d9cefe1f240c None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:13.895303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-b74d0ae7-c743-4fec-9389-d9cefe1f240c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:48:13.895303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:13.895303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:13.895303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:13.895303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:13.895303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:13.895303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:13.895303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:13.895303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:13.895303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:13.895303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:13.895303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:13.895303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:48:13.895303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:48:13.895303 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:48:13.896464 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:48:13.896464 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:13.896464 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:13.896464 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:13.896464 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:13.896464 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:13.896464 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:13.896464 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:13.896464 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:13.896464 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:13.896464 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:13.896464 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:13.896464 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:13.896464 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:13.896464 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:13.896464 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:13.896464 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:13.897607 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:48:13.897607 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:48:13.897607 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:48:13.897607 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:48:13.897607 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:48:13.897607 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:48:13.897607 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:48:13.897607 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:13.901390 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 628/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:48:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:13.902794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913464c-9bc0-4de5-9362-fe8cd98242b9 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:14.005649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913464c-9bc0-4de5-9362-fe8cd98242b9 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:14.041343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada2451-979c-4444-8b2c-2b300a1d680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:14.042005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada2451-979c-4444-8b2c-2b300a1d680a None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:14.042286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada2451-979c-4444-8b2c-2b300a1d680a None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:14.042561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada2451-979c-4444-8b2c-2b300a1d680a None admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:14.043342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada2451-979c-4444-8b2c-2b300a1d680a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:14.043655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada2451-979c-4444-8b2c-2b300a1d680a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:14.045151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada2451-979c-4444-8b2c-2b300a1d680a None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:14.057338 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 631/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:48:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:14.063929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d0ae7-c743-4fec-9389-d9cefe1f240c None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:14.091682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:14.165948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d0ae7-c743-4fec-9389-d9cefe1f240c None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:14.201175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d665d7b-60f6-4416-afb2-95e256461675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:14.201821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d665d7b-60f6-4416-afb2-95e256461675 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:14.202096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d665d7b-60f6-4416-afb2-95e256461675 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:14.202367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d665d7b-60f6-4416-afb2-95e256461675 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:14.203176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d665d7b-60f6-4416-afb2-95e256461675 None admin] RBAC: Adding query filter params (role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=8d8de7334e054d53ab0c0e7dd7cb7c8c) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:14.203490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d665d7b-60f6-4416-afb2-95e256461675 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:14.204997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d665d7b-60f6-4416-afb2-95e256461675 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:14.210612 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 629/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:48:14 2022] GET /identity/v3/role_assignments?user.id=8d8de7334e054d53ab0c0e7dd7cb7c8c&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:16.468856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a13477-7b7f-4fbe-af66-2cbc66f027ef None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:16.469419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a13477-7b7f-4fbe-af66-2cbc66f027ef None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:16.469419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a13477-7b7f-4fbe-af66-2cbc66f027ef None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:16.470805 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 632/1261] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:48:16.477685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf55ef-4ca6-4748-b065-f5fc34d0edea None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:16.478490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf55ef-4ca6-4748-b065-f5fc34d0edea None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:16.478638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf55ef-4ca6-4748-b065-f5fc34d0edea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:16.501582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-41cf55ef-4ca6-4748-b065-f5fc34d0edea None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:48:16.502795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-41cf55ef-4ca6-4748-b065-f5fc34d0edea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:48:16.574263 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 630/1262] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:48:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:48:16.602119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a13477-7b7f-4fbe-af66-2cbc66f027ef None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:16.613502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:16.706136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a13477-7b7f-4fbe-af66-2cbc66f027ef None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:16.741465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20442820-d3b2-47de-b9f5-4bc59df0fe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:16.742178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20442820-d3b2-47de-b9f5-4bc59df0fe80 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:16.742452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20442820-d3b2-47de-b9f5-4bc59df0fe80 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:16.742716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20442820-d3b2-47de-b9f5-4bc59df0fe80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:16.753559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20442820-d3b2-47de-b9f5-4bc59df0fe80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:48:16.761204 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-20442820-d3b2-47de-b9f5-4bc59df0fe80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:48:16.761204 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:16.761204 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:16.761204 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:16.761204 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:16.761204 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:16.761204 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:16.761204 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:16.761204 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:16.761204 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:16.761204 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:16.761204 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:16.761204 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:48:16.761204 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:48:16.761204 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:48:16.761204 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:48:16.762306 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:48:16.762306 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:48:16.762306 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:48:16.762306 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:48:16.762306 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:16.762306 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:16.762306 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:16.762306 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:16.762306 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:16.762306 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:16.762306 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:16.762306 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:16.762306 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:16.762306 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:16.762306 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:16.762306 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:16.763351 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:16.763351 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:16.763351 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:16.763351 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:16.763351 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:48:16.763351 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:48:16.763351 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:48:16.763351 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:48:16.763351 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:48:16.763351 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:48:16.763351 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:48:16.763351 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:48:16.763351 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 633/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:48:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:16.768593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf55ef-4ca6-4748-b065-f5fc34d0edea None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:16.790222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:16.886214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf55ef-4ca6-4748-b065-f5fc34d0edea None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:16.920256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211113e0-f988-491f-a7aa-2fc5ffd03223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:16.920940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211113e0-f988-491f-a7aa-2fc5ffd03223 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:16.921216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211113e0-f988-491f-a7aa-2fc5ffd03223 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:16.921487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211113e0-f988-491f-a7aa-2fc5ffd03223 None admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:16.922225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211113e0-f988-491f-a7aa-2fc5ffd03223 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:16.922531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211113e0-f988-491f-a7aa-2fc5ffd03223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:16.923929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211113e0-f988-491f-a7aa-2fc5ffd03223 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:16.932309 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 631/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:48:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:48:16.938244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20442820-d3b2-47de-b9f5-4bc59df0fe80 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:17.012789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:17.048328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20442820-d3b2-47de-b9f5-4bc59df0fe80 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:17.083554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd8ddd-8b00-4f65-b6fc-e85ecbf6e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:17.084842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd8ddd-8b00-4f65-b6fc-e85ecbf6e149 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:17.085307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd8ddd-8b00-4f65-b6fc-e85ecbf6e149 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:17.085783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd8ddd-8b00-4f65-b6fc-e85ecbf6e149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:17.100630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd8ddd-8b00-4f65-b6fc-e85ecbf6e149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:17.102092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd8ddd-8b00-4f65-b6fc-e85ecbf6e149 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:17.123869 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-5cfd8ddd-8b00-4f65-b6fc-e85ecbf6e149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:17.123869 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:17.123869 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:17.123869 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:17.123869 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:17.123869 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:17.123869 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:17.123869 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:17.123869 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:17.123869 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:17.123869 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:17.123869 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:17.123869 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:48:17.123869 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:48:17.123869 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:48:17.125003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:48:17.125003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:17.125003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:17.125003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:17.125003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:17.125003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:17.125003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:17.125003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:17.125003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:17.125003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:17.125003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:17.125003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:17.125003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:17.125003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:17.125003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:17.125003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:17.125003 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:17.126020 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:48:17.126020 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:48:17.126020 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:17.126020 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:48:17.126020 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 634/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:17.131494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211113e0-f988-491f-a7aa-2fc5ffd03223 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:17.217734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:17.238299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211113e0-f988-491f-a7aa-2fc5ffd03223 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:17.272798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9ff22-d762-441d-a5b0-4645447aa608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:17.273377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9ff22-d762-441d-a5b0-4645447aa608 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:17.273654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9ff22-d762-441d-a5b0-4645447aa608 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:17.273930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9ff22-d762-441d-a5b0-4645447aa608 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:17.274644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9ff22-d762-441d-a5b0-4645447aa608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:17.274955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9ff22-d762-441d-a5b0-4645447aa608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:17.276365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9ff22-d762-441d-a5b0-4645447aa608 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:17.288363 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 632/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:17.295269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd8ddd-8b00-4f65-b6fc-e85ecbf6e149 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:17.401037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd8ddd-8b00-4f65-b6fc-e85ecbf6e149 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:17.426274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:17.443608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a94ab8-79b8-43ec-b2d9-33465699296a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:17.444482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a94ab8-79b8-43ec-b2d9-33465699296a None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:17.444761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a94ab8-79b8-43ec-b2d9-33465699296a None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:17.445033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a94ab8-79b8-43ec-b2d9-33465699296a None admin] PATH_INFO: `/v3/users/placement` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:17.452962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a94ab8-79b8-43ec-b2d9-33465699296a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:17.454404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a94ab8-79b8-43ec-b2d9-33465699296a None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:17.469051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-c4a94ab8-79b8-43ec-b2d9-33465699296a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:48:17.469051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:17.469051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:17.469051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:17.469051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:17.469051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:17.469051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:17.469051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:17.469051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:17.469051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:17.469051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:17.469051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:17.469051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:48:17.469051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:48:17.469051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:48:17.469051 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:48:17.470539 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:17.470539 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:17.470539 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:48:17.470539 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:48:17.470539 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:48:17.470539 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:48:17.470539 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:17.470539 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:17.470539 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:17.470539 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:17.470539 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:17.470539 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:17.470539 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:17.470539 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:17.470539 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:17.470539 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:17.470539 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:17.470539 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:17.471706 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:17.471706 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:17.471706 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:48:17.471706 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:48:17.471706 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:48:17.471706 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:48:17.471706 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:48:17.471706 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:48:17.471706 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:48:17.471706 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:48:17.471706 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 635/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:48:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:17.476620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9ff22-d762-441d-a5b0-4645447aa608 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:17.593319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9ff22-d762-441d-a5b0-4645447aa608 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:17.629081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e67521-fc48-465f-ba6f-a798747281ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:17.629774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e67521-fc48-465f-ba6f-a798747281ca None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:17.630052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e67521-fc48-465f-ba6f-a798747281ca None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:17.630361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e67521-fc48-465f-ba6f-a798747281ca None admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:17.631183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e67521-fc48-465f-ba6f-a798747281ca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:17.631492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e67521-fc48-465f-ba6f-a798747281ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:17.632981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e67521-fc48-465f-ba6f-a798747281ca None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:17.641752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:17.650755 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 633/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Sat Jul 2 20:48:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:17.656941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a94ab8-79b8-43ec-b2d9-33465699296a None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:17.761689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a94ab8-79b8-43ec-b2d9-33465699296a None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:17.801534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffec90-658a-4772-ac40-ef313ad1a5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:17.802701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffec90-658a-4772-ac40-ef313ad1a5a8 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:17.803128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffec90-658a-4772-ac40-ef313ad1a5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:17.803438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffec90-658a-4772-ac40-ef313ad1a5a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:17.817703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffec90-658a-4772-ac40-ef313ad1a5a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:17.819263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffec90-658a-4772-ac40-ef313ad1a5a8 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:17.836608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-acffec90-658a-4772-ac40-ef313ad1a5a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:17.836608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:17.836608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:17.836608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:17.836608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:17.836608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:17.836608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:17.836608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:17.836608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:17.836608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:17.836608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:17.836608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:17.836608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:48:17.836608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:48:17.836608 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:48:17.837638 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:48:17.837638 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:17.837638 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:17.837638 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:17.837638 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:17.837638 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:17.837638 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:17.837638 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:17.837638 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:17.837638 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:17.837638 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:17.837638 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:17.837638 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:17.837638 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:17.837638 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:17.837638 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:17.837638 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:17.838678 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:48:17.838678 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:48:17.838678 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:17.838678 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:48:17.838678 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 636/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:17.843745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e67521-fc48-465f-ba6f-a798747281ca None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:17.944683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e67521-fc48-465f-ba6f-a798747281ca None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:17.979609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84450957-39cf-45c7-b878-6371275b8b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:17.980274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84450957-39cf-45c7-b878-6371275b8b85 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:17.980551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84450957-39cf-45c7-b878-6371275b8b85 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:17.980815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84450957-39cf-45c7-b878-6371275b8b85 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:17.981518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84450957-39cf-45c7-b878-6371275b8b85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:17.981811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84450957-39cf-45c7-b878-6371275b8b85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:17.983182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84450957-39cf-45c7-b878-6371275b8b85 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:17.994506 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 634/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:18.003019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffec90-658a-4772-ac40-ef313ad1a5a8 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:18.037459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:18.124764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffec90-658a-4772-ac40-ef313ad1a5a8 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:18.169532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9857a-5b87-4184-9cc2-ef43ff48808b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:18.170348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9857a-5b87-4184-9cc2-ef43ff48808b None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:18.170640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9857a-5b87-4184-9cc2-ef43ff48808b None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:18.170915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9857a-5b87-4184-9cc2-ef43ff48808b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:18.178350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9857a-5b87-4184-9cc2-ef43ff48808b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:18.179834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9857a-5b87-4184-9cc2-ef43ff48808b None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:18.194381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-5fb9857a-5b87-4184-9cc2-ef43ff48808b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:48:18.194381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:18.194381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:18.194381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:18.194381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:18.194381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:18.194381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:18.194381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:18.194381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:18.194381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:18.194381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:18.194381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:18.194381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:48:18.194381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:48:18.194381 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:48:18.195400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:48:18.195400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:18.195400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:18.195400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:18.195400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:18.195400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:18.195400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:18.195400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:18.195400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:18.195400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:18.195400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:18.195400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:18.195400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:18.195400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:18.195400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:18.195400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:18.195400 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:18.196648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:48:18.196648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:48:18.196648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:48:18.196648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:48:18.196648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:48:18.196648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:48:18.196648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:48:18.196648 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:48:18.196648 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 637/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:48:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:18.201678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84450957-39cf-45c7-b878-6371275b8b85 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:18.261983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:18.311795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84450957-39cf-45c7-b878-6371275b8b85 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:18.346645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff999f0-7cfa-41ce-822e-b8dd673a7748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:18.347294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff999f0-7cfa-41ce-822e-b8dd673a7748 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:18.347554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff999f0-7cfa-41ce-822e-b8dd673a7748 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:18.347825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff999f0-7cfa-41ce-822e-b8dd673a7748 None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:18.348623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff999f0-7cfa-41ce-822e-b8dd673a7748 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:18.348957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff999f0-7cfa-41ce-822e-b8dd673a7748 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:18.350401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff999f0-7cfa-41ce-822e-b8dd673a7748 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:18.362853 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 635/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:48:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:18.369835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9857a-5b87-4184-9cc2-ef43ff48808b None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:18.473031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:18.483151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9857a-5b87-4184-9cc2-ef43ff48808b None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:18.519088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a4252-8090-48a1-bf8e-e49bc211008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:18.519955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a4252-8090-48a1-bf8e-e49bc211008d None admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:18.520290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a4252-8090-48a1-bf8e-e49bc211008d None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:18.520558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a4252-8090-48a1-bf8e-e49bc211008d None admin] PATH_INFO: `/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/8d8de7334e054d53ab0c0e7dd7cb7c8c/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:18.523130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a4252-8090-48a1-bf8e-e49bc211008d None admin] RBAC: Authorizing `identity:create_grant(project_id=001bf63308784f4eb62e64d6f82c8354, user_id=8d8de7334e054d53ab0c0e7dd7cb7c8c, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:18.524627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a4252-8090-48a1-bf8e-e49bc211008d None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:18.540165 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 638/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Jul 2 20:48:18 2022] PUT /identity/v3/projects/001bf63308784f4eb62e64d6f82c8354/users/8d8de7334e054d53ab0c0e7dd7cb7c8c/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:48:20.838968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c858716-363b-45b9-95f3-3c4fd165c8a8 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:20.839535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c858716-363b-45b9-95f3-3c4fd165c8a8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:20.839632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c858716-363b-45b9-95f3-3c4fd165c8a8 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:20.841391 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 636/1274] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:48:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:48:20.848651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65450e53-1c1b-4c76-a414-d03f1f503bc1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:20.849257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65450e53-1c1b-4c76-a414-d03f1f503bc1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:20.849456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65450e53-1c1b-4c76-a414-d03f1f503bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:20.873957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-65450e53-1c1b-4c76-a414-d03f1f503bc1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:48:20.875630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-65450e53-1c1b-4c76-a414-d03f1f503bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:48:21.086940 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 639/1275] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:48:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:48:21.112093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c858716-363b-45b9-95f3-3c4fd165c8a8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:21.227108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c858716-363b-45b9-95f3-3c4fd165c8a8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:21.245023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:21.263766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb43a7-dceb-42ae-a523-d580b84c0314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:21.264608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb43a7-dceb-42ae-a523-d580b84c0314 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:21.264892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb43a7-dceb-42ae-a523-d580b84c0314 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:21.265172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb43a7-dceb-42ae-a523-d580b84c0314 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:21.275892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb43a7-dceb-42ae-a523-d580b84c0314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:48:21.284029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-5ffb43a7-dceb-42ae-a523-d580b84c0314 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:48:21.284029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:21.284029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:21.284029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:21.284029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:21.284029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:21.284029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:21.284029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:21.284029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:21.284029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:21.284029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:21.284029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:21.284029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:48:21.284029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:48:21.284029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:48:21.284029 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:48:21.285610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:48:21.285610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:48:21.285610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:48:21.285610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:48:21.285610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:21.285610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:21.285610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:21.285610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:21.285610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:21.285610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:21.285610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:21.285610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:21.285610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:21.285610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:21.285610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:21.285610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:21.287090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:21.287090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:21.287090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:21.287090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:21.287090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:48:21.287090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:48:21.287090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:48:21.287090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:48:21.287090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:48:21.287090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:48:21.287090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:48:21.287090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:21.287090 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 637/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Jul 2 20:48:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:21.292519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65450e53-1c1b-4c76-a414-d03f1f503bc1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:21.376859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:21.397344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65450e53-1c1b-4c76-a414-d03f1f503bc1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:21.432418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3ecac-4443-440f-8ff3-804cdcb76991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:21.433065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3ecac-4443-440f-8ff3-804cdcb76991 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:21.433346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3ecac-4443-440f-8ff3-804cdcb76991 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:21.433615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3ecac-4443-440f-8ff3-804cdcb76991 None admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:21.434361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3ecac-4443-440f-8ff3-804cdcb76991 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:21.434662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3ecac-4443-440f-8ff3-804cdcb76991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:21.436088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3ecac-4443-440f-8ff3-804cdcb76991 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:21.444605 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 640/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Jul 2 20:48:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:21.450842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb43a7-dceb-42ae-a523-d580b84c0314 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:21.558047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb43a7-dceb-42ae-a523-d580b84c0314 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:21.593714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc4ee2-de26-4c07-8b1a-be782ce0e78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:21.594511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc4ee2-de26-4c07-8b1a-be782ce0e78b None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:21.594791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc4ee2-de26-4c07-8b1a-be782ce0e78b None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:21.595068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc4ee2-de26-4c07-8b1a-be782ce0e78b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:21.608854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc4ee2-de26-4c07-8b1a-be782ce0e78b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:21.611126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc4ee2-de26-4c07-8b1a-be782ce0e78b None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:21.628538 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-7ebc4ee2-de26-4c07-8b1a-be782ce0e78b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:21.628538 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:21.628538 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:21.628538 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:21.628538 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:21.628538 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:21.628538 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:21.628538 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:21.628538 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:21.628538 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:21.628538 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:21.628538 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:21.628538 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:48:21.628538 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:48:21.628538 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:48:21.629614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:48:21.629614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:21.629614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:21.629614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:21.629614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:21.629614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:21.629614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:21.629614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:21.629614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:21.629614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:21.629614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:21.629614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:21.629614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:21.629614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:21.629614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:21.629614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:21.629614 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:21.631293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:48:21.631293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:48:21.631293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:21.631293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:21.631293 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 638/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:21.639178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3ecac-4443-440f-8ff3-804cdcb76991 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:21.749896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3ecac-4443-440f-8ff3-804cdcb76991 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:21.789318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0232a-362a-4900-b6a5-6c15f09801fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:21.790051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0232a-362a-4900-b6a5-6c15f09801fa None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:21.790305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0232a-362a-4900-b6a5-6c15f09801fa None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:21.790626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0232a-362a-4900-b6a5-6c15f09801fa None admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:21.791795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0232a-362a-4900-b6a5-6c15f09801fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:21.792188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0232a-362a-4900-b6a5-6c15f09801fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:21.793738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0232a-362a-4900-b6a5-6c15f09801fa None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:21.808763 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 641/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:21.815473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc4ee2-de26-4c07-8b1a-be782ce0e78b None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:21.855024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:21.937585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc4ee2-de26-4c07-8b1a-be782ce0e78b None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:21.976379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33cc49-1dbe-4fda-b43e-22be3b3a1ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:21.977567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33cc49-1dbe-4fda-b43e-22be3b3a1ecd None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:21.977930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33cc49-1dbe-4fda-b43e-22be3b3a1ecd None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:21.978299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33cc49-1dbe-4fda-b43e-22be3b3a1ecd None admin] PATH_INFO: `/v3/users/placement` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:21.991324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33cc49-1dbe-4fda-b43e-22be3b3a1ecd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:21.992835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33cc49-1dbe-4fda-b43e-22be3b3a1ecd None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:22.011974 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-4b33cc49-1dbe-4fda-b43e-22be3b3a1ecd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:48:22.011974 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:22.011974 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:22.011974 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:22.011974 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:22.011974 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:22.011974 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:22.011974 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:22.011974 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:22.011974 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:22.011974 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:22.011974 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:22.011974 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:48:22.011974 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:48:22.011974 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:48:22.011974 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:48:22.013173 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:22.013173 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:22.013173 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:48:22.013173 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:48:22.013173 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:48:22.013173 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:48:22.013173 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:22.013173 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:22.013173 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:22.013173 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:22.013173 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:22.013173 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:22.013173 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:22.013173 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:22.013173 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:22.013173 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:22.013173 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:22.013173 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:22.014519 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:22.014519 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:22.014519 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:48:22.014519 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:48:22.014519 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:48:22.014519 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:48:22.014519 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:48:22.014519 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:48:22.014519 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:48:22.014519 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:22.014519 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 639/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:48:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:48:22.019188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0232a-362a-4900-b6a5-6c15f09801fa None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:22.023286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:22.124831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0232a-362a-4900-b6a5-6c15f09801fa None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:22.163579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988885c-b16c-4a45-8f26-b0ef9e6b7441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:22.164273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988885c-b16c-4a45-8f26-b0ef9e6b7441 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:22.164554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988885c-b16c-4a45-8f26-b0ef9e6b7441 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:22.164828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988885c-b16c-4a45-8f26-b0ef9e6b7441 None admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:22.165656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988885c-b16c-4a45-8f26-b0ef9e6b7441 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:22.165963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988885c-b16c-4a45-8f26-b0ef9e6b7441 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:22.167792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988885c-b16c-4a45-8f26-b0ef9e6b7441 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:22.184958 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 642/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Sat Jul 2 20:48:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:22.191185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33cc49-1dbe-4fda-b43e-22be3b3a1ecd None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:22.302275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:22.318904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33cc49-1dbe-4fda-b43e-22be3b3a1ecd None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:22.354388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c3eef-ca1b-4be3-a4ed-18430d874e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:22.355026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c3eef-ca1b-4be3-a4ed-18430d874e29 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:22.355307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c3eef-ca1b-4be3-a4ed-18430d874e29 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:22.355582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c3eef-ca1b-4be3-a4ed-18430d874e29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:22.423956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c3eef-ca1b-4be3-a4ed-18430d874e29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:22.425449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c3eef-ca1b-4be3-a4ed-18430d874e29 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:22.515606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:22.526732 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 640/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Jul 2 20:48:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:48:22.533082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988885c-b16c-4a45-8f26-b0ef9e6b7441 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:22.613635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:22.653610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988885c-b16c-4a45-8f26-b0ef9e6b7441 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:22.689601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe27cf-a687-4d65-939a-9c42d23b6db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:22.690388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe27cf-a687-4d65-939a-9c42d23b6db4 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:22.690673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe27cf-a687-4d65-939a-9c42d23b6db4 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:22.690941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe27cf-a687-4d65-939a-9c42d23b6db4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:22.702022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe27cf-a687-4d65-939a-9c42d23b6db4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:22.703965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe27cf-a687-4d65-939a-9c42d23b6db4 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:22.723013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-7cfe27cf-a687-4d65-939a-9c42d23b6db4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:22.723013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:22.723013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:22.723013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:22.723013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:22.723013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:22.723013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:22.723013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:22.723013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:22.723013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:22.723013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:22.723013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:22.723013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:48:22.723013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:48:22.723013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:48:22.724067 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:48:22.724067 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:22.724067 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:22.724067 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:22.724067 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:22.724067 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:22.724067 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:22.724067 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:22.724067 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:22.724067 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:22.724067 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:22.724067 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:22.724067 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:22.724067 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:22.724067 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:22.724067 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:22.724067 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:22.725654 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:48:22.725654 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:48:22.725654 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:48:22.725654 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:48:22.725654 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 643/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:22.733541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c3eef-ca1b-4be3-a4ed-18430d874e29 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:22.842845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c3eef-ca1b-4be3-a4ed-18430d874e29 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:22.878744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53a92b-438f-47e8-a6ad-3fa8427925d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:22.879467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53a92b-438f-47e8-a6ad-3fa8427925d7 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:22.879853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53a92b-438f-47e8-a6ad-3fa8427925d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:22.880165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53a92b-438f-47e8-a6ad-3fa8427925d7 None admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:22.880971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53a92b-438f-47e8-a6ad-3fa8427925d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:22.881293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53a92b-438f-47e8-a6ad-3fa8427925d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:22.882686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53a92b-438f-47e8-a6ad-3fa8427925d7 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:22.894510 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 641/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Jul 2 20:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:22.900629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe27cf-a687-4d65-939a-9c42d23b6db4 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:23.006145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe27cf-a687-4d65-939a-9c42d23b6db4 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:23.019548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:23.039883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd26ebb-09d7-4692-9d37-c370a0865244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:23.040714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd26ebb-09d7-4692-9d37-c370a0865244 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:23.040992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd26ebb-09d7-4692-9d37-c370a0865244 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:23.041621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd26ebb-09d7-4692-9d37-c370a0865244 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:23.048334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd26ebb-09d7-4692-9d37-c370a0865244 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:23.049773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd26ebb-09d7-4692-9d37-c370a0865244 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:23.063775 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-4cd26ebb-09d7-4692-9d37-c370a0865244 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:48:23.063775 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:23.063775 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:23.063775 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:23.063775 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:23.063775 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:23.063775 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:23.063775 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:23.063775 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:23.063775 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:23.063775 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:23.063775 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:23.063775 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:48:23.063775 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:48:23.063775 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:48:23.064780 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:48:23.064780 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:23.064780 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:23.064780 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:23.064780 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:23.064780 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:23.064780 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:23.064780 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:23.064780 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:23.064780 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:23.064780 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:23.064780 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:23.064780 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:23.064780 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:23.064780 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:23.064780 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:23.064780 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:23.065713 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:48:23.065713 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:48:23.065713 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:48:23.065713 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:48:23.065713 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:48:23.065713 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:48:23.065713 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:48:23.065713 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 20:48:23.065713 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 644/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Jul 2 20:48:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:23.071027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53a92b-438f-47e8-a6ad-3fa8427925d7 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:23.120819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:23.171410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53a92b-438f-47e8-a6ad-3fa8427925d7 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:23.209908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd685b7-868c-4f77-a4f1-d2492c1a4cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:23.210568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd685b7-868c-4f77-a4f1-d2492c1a4cf1 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:23.210841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd685b7-868c-4f77-a4f1-d2492c1a4cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:23.211109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd685b7-868c-4f77-a4f1-d2492c1a4cf1 None admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:23.211876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd685b7-868c-4f77-a4f1-d2492c1a4cf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:23.212217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd685b7-868c-4f77-a4f1-d2492c1a4cf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:23.213656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd685b7-868c-4f77-a4f1-d2492c1a4cf1 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:23.225587 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 642/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Jul 2 20:48:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:48:23.235449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd26ebb-09d7-4692-9d37-c370a0865244 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:23.342091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd26ebb-09d7-4692-9d37-c370a0865244 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:23.377325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b451ba4-e06e-402e-8fdd-bbfbd36c60b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:23.377885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b451ba4-e06e-402e-8fdd-bbfbd36c60b4 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:23.378164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b451ba4-e06e-402e-8fdd-bbfbd36c60b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:23.378438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b451ba4-e06e-402e-8fdd-bbfbd36c60b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:23.379260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b451ba4-e06e-402e-8fdd-bbfbd36c60b4 None admin] RBAC: Adding query filter params (role.id=fbc5ccb2ed1447f0a3df77c23347d54c, scope.project.id=001bf63308784f4eb62e64d6f82c8354, user.id=8d8de7334e054d53ab0c0e7dd7cb7c8c) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:23.379571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b451ba4-e06e-402e-8fdd-bbfbd36c60b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:23.381236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b451ba4-e06e-402e-8fdd-bbfbd36c60b4 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:23.387220 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 645/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Jul 2 20:48:23 2022] GET /identity/v3/role_assignments?user.id=8d8de7334e054d53ab0c0e7dd7cb7c8c&scope.project.id=001bf63308784f4eb62e64d6f82c8354&role.id=fbc5ccb2ed1447f0a3df77c23347d54c => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:25.706336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621901f8-b241-418a-8768-057dc5c1bbd1 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:25.707260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621901f8-b241-418a-8768-057dc5c1bbd1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:25.707260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621901f8-b241-418a-8768-057dc5c1bbd1 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:25.709320 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 643/1288] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:48:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:48:25.714921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a5e0e-5ab2-4e92-aedf-d50fecf8c595 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:25.715350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a5e0e-5ab2-4e92-aedf-d50fecf8c595 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:25.715439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a5e0e-5ab2-4e92-aedf-d50fecf8c595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:25.734772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f08a5e0e-5ab2-4e92-aedf-d50fecf8c595 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:48:25.735950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f08a5e0e-5ab2-4e92-aedf-d50fecf8c595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:48:25.768215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:25.811037 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 646/1289] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:48:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:48:25.840541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621901f8-b241-418a-8768-057dc5c1bbd1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:25.960407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621901f8-b241-418a-8768-057dc5c1bbd1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:25.971265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:25.996421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192511bb-1290-4f0e-a7ea-577a25f980bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:25.997214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192511bb-1290-4f0e-a7ea-577a25f980bc None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:25.997496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192511bb-1290-4f0e-a7ea-577a25f980bc None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:25.997774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192511bb-1290-4f0e-a7ea-577a25f980bc None admin] PATH_INFO: `/v3/services/placement` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:25.998436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192511bb-1290-4f0e-a7ea-577a25f980bc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:25.999838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192511bb-1290-4f0e-a7ea-577a25f980bc None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:26.012570 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-192511bb-1290-4f0e-a7ea-577a25f980bc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 20:48:26.012570 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:26.012570 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:48:26.012570 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:48:26.012570 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:48:26.012570 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:48:26.012570 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:48:26.012570 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:48:26.012570 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 20:48:26.012570 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:26.012570 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:48:26.012570 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:26.012570 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:26.012570 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:26.012570 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:26.012570 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:26.012570 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:26.013731 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:26.013731 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:26.013731 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:26.013731 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:26.013731 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:26.013731 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:26.013731 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:48:26.013731 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:48:26.013731 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:48:26.013731 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:48:26.013731 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:26.013731 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:26.013731 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:26.013731 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:26.013731 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:26.013731 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:26.014673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:26.014673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:26.014673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:26.014673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:26.014673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:26.014673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:26.014673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:26.014673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:26.014673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:26.014673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:26.014673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:48:26.014673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:48:26.014673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 20:48:26.014673 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:26.014673 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 644/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Sat Jul 2 20:48:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:26.020201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a5e0e-5ab2-4e92-aedf-d50fecf8c595 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:26.127216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a5e0e-5ab2-4e92-aedf-d50fecf8c595 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:26.161720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063fd62-052d-4132-9a53-958431d827df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:26.162370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063fd62-052d-4132-9a53-958431d827df None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:26.162645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063fd62-052d-4132-9a53-958431d827df None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:26.162914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063fd62-052d-4132-9a53-958431d827df None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:26.163609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063fd62-052d-4132-9a53-958431d827df None admin] RBAC: Adding query filter params (name=placement) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:26.163965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063fd62-052d-4132-9a53-958431d827df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:26.165894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063fd62-052d-4132-9a53-958431d827df None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:26.173203 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 647/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Sat Jul 2 20:48:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:26.179399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192511bb-1290-4f0e-a7ea-577a25f980bc None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:26.302767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192511bb-1290-4f0e-a7ea-577a25f980bc None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:26.337729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c29a3-8e18-4fae-82a9-8977834d39cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:26.338383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c29a3-8e18-4fae-82a9-8977834d39cd None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:26.338659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c29a3-8e18-4fae-82a9-8977834d39cd None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:26.338932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c29a3-8e18-4fae-82a9-8977834d39cd None admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:26.339639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c29a3-8e18-4fae-82a9-8977834d39cd None admin] RBAC: Adding query filter params (type=placement) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:26.339941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c29a3-8e18-4fae-82a9-8977834d39cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:26.341359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c29a3-8e18-4fae-82a9-8977834d39cd None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:26.345935 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 645/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Sat Jul 2 20:48:26 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:28.626342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08a6f5-7a1b-45c1-9f5e-40877d80a5c6 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:28.627311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08a6f5-7a1b-45c1-9f5e-40877d80a5c6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:28.627311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08a6f5-7a1b-45c1-9f5e-40877d80a5c6 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:28.629415 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 648/1293] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:48:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:48:28.638104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b1b02-e104-4d1c-b235-d2d473504d4a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:28.638558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b1b02-e104-4d1c-b235-d2d473504d4a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:28.638712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b1b02-e104-4d1c-b235-d2d473504d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:28.660901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1e6b1b02-e104-4d1c-b235-d2d473504d4a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:48:28.662137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1e6b1b02-e104-4d1c-b235-d2d473504d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:48:28.695748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:28.741433 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 646/1294] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:48:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:48:28.771796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08a6f5-7a1b-45c1-9f5e-40877d80a5c6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:28.810590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:28.885373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08a6f5-7a1b-45c1-9f5e-40877d80a5c6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:28.919698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66013e64-a071-4eb4-a5a7-d12eff3dfe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:28.920376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66013e64-a071-4eb4-a5a7-d12eff3dfe7e None admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:28.920654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66013e64-a071-4eb4-a5a7-d12eff3dfe7e None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:28.920921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66013e64-a071-4eb4-a5a7-d12eff3dfe7e None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:28.921627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66013e64-a071-4eb4-a5a7-d12eff3dfe7e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:28.922996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66013e64-a071-4eb4-a5a7-d12eff3dfe7e None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:28.939364 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 649/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Jul 2 20:48:28 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:48:31.220094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3afaff-483c-49b3-8ad0-5490f83285c5 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:31.220919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3afaff-483c-49b3-8ad0-5490f83285c5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:31.220919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3afaff-483c-49b3-8ad0-5490f83285c5 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:31.223064 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 647/1296] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:48:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:48:31.230086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9a012-733d-4f37-88a1-c8d1e415ba32 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:31.230535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9a012-733d-4f37-88a1-c8d1e415ba32 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:31.230640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9a012-733d-4f37-88a1-c8d1e415ba32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:31.257218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c3a9a012-733d-4f37-88a1-c8d1e415ba32 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:48:31.258426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c3a9a012-733d-4f37-88a1-c8d1e415ba32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:48:31.345028 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 650/1297] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:48:31 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:48:31.369359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3afaff-483c-49b3-8ad0-5490f83285c5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:31.475563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3afaff-483c-49b3-8ad0-5490f83285c5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:31.509936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f1a97-8346-45bc-a9c4-a5ccac002fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:31.510709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f1a97-8346-45bc-a9c4-a5ccac002fa5 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:31.510983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f1a97-8346-45bc-a9c4-a5ccac002fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:31.511249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f1a97-8346-45bc-a9c4-a5ccac002fa5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:31.511898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f1a97-8346-45bc-a9c4-a5ccac002fa5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:31.513290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f1a97-8346-45bc-a9c4-a5ccac002fa5 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:31.525198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-693f1a97-8346-45bc-a9c4-a5ccac002fa5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 20:48:31.525198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:31.525198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:48:31.525198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:48:31.525198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:48:31.525198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:48:31.525198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:48:31.525198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:48:31.525198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 20:48:31.525198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:31.525198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:48:31.525198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:31.525198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:31.525198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:31.525198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:31.525198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:31.525198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:31.526356 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:31.526356 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:31.526356 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:31.526356 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:31.526356 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:31.526356 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:31.526356 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:48:31.526356 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:48:31.526356 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:48:31.526356 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:48:31.526356 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:31.526356 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:31.526356 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:31.526356 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:31.526356 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:31.526356 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:31.527393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:31.527393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:31.527393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:31.527393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:31.527393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:31.527393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:31.527393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:31.527393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:31.527393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:31.527393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:31.527393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:48:31.527393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:48:31.527393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 20:48:31.527393 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:31.527393 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 648/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Sat Jul 2 20:48:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:31.532952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9a012-733d-4f37-88a1-c8d1e415ba32 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:31.558985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:31.647229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9a012-733d-4f37-88a1-c8d1e415ba32 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:31.682890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345af36-fc38-40cc-8b04-2c6b17db6574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:31.683534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345af36-fc38-40cc-8b04-2c6b17db6574 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:31.683804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345af36-fc38-40cc-8b04-2c6b17db6574 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:31.684083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345af36-fc38-40cc-8b04-2c6b17db6574 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:31.684804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345af36-fc38-40cc-8b04-2c6b17db6574 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:31.685106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345af36-fc38-40cc-8b04-2c6b17db6574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:31.686498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345af36-fc38-40cc-8b04-2c6b17db6574 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:31.691773 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 651/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Sat Jul 2 20:48:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:31.701533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f1a97-8346-45bc-a9c4-a5ccac002fa5 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:31.737965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:31.820914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f1a97-8346-45bc-a9c4-a5ccac002fa5 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:31.857971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418479a5-3c42-4136-8008-68c4f03da8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:31.858902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418479a5-3c42-4136-8008-68c4f03da8f9 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:31.859269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418479a5-3c42-4136-8008-68c4f03da8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:31.859621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418479a5-3c42-4136-8008-68c4f03da8f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:31.860887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418479a5-3c42-4136-8008-68c4f03da8f9 None admin] RBAC: Adding query filter params (interface=public, service_id=108ee4e4db99463fb73d03811ec55335, region_id=RegionOne) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:31.861297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418479a5-3c42-4136-8008-68c4f03da8f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:31.863455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418479a5-3c42-4136-8008-68c4f03da8f9 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:31.872225 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 649/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Sat Jul 2 20:48:31 2022] GET /identity/v3/endpoints?service_id=108ee4e4db99463fb73d03811ec55335&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:48:31.878403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345af36-fc38-40cc-8b04-2c6b17db6574 None admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:31.966780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:31.987365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345af36-fc38-40cc-8b04-2c6b17db6574 None admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:32.024800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296782e-a51a-4e9b-a0cf-4881feda6cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:32.025436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296782e-a51a-4e9b-a0cf-4881feda6cf6 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:32.025710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296782e-a51a-4e9b-a0cf-4881feda6cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:32.025988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296782e-a51a-4e9b-a0cf-4881feda6cf6 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:32.026657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296782e-a51a-4e9b-a0cf-4881feda6cf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:32.028018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296782e-a51a-4e9b-a0cf-4881feda6cf6 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:32.034878 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 652/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Sat Jul 2 20:48:31 2022] GET /identity/v3/services => generated 2191 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:48:34.312917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9c08-0b72-4984-a69f-f2866263f99b None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:34.313498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9c08-0b72-4984-a69f-f2866263f99b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:34.313498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9c08-0b72-4984-a69f-f2866263f99b None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:34.315577 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 650/1302] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:48:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:48:34.324633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a42273-c046-492c-a30a-7519445e7842 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:34.325059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a42273-c046-492c-a30a-7519445e7842 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:34.325244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a42273-c046-492c-a30a-7519445e7842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:34.353608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-93a42273-c046-492c-a30a-7519445e7842 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:48:34.354734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-93a42273-c046-492c-a30a-7519445e7842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:48:34.427587 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 653/1303] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:48:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:48:34.465235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba9c08-0b72-4984-a69f-f2866263f99b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:34.567801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:34.575889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba9c08-0b72-4984-a69f-f2866263f99b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:34.611014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9f909-8611-494e-bd26-65fa1f4baef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:34.611742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9f909-8611-494e-bd26-65fa1f4baef6 None admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:34.612022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9f909-8611-494e-bd26-65fa1f4baef6 None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:34.612340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9f909-8611-494e-bd26-65fa1f4baef6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:34.612989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9f909-8611-494e-bd26-65fa1f4baef6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:34.614380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9f909-8611-494e-bd26-65fa1f4baef6 None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:34.626638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-48d9f909-8611-494e-bd26-65fa1f4baef6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 20:48:34.626638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:34.626638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:48:34.626638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:48:34.626638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:48:34.626638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:48:34.626638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:48:34.626638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:48:34.626638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 20:48:34.626638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:34.626638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:48:34.626638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:34.626638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:48:34.626638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:48:34.626638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:48:34.626638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:48:34.626638 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:48:34.627775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:48:34.627775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:48:34.627775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:48:34.627775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:48:34.627775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:48:34.627775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:48:34.627775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:48:34.627775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:48:34.627775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:48:34.627775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:48:34.627775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:48:34.627775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:48:34.627775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:48:34.627775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:48:34.627775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:48:34.627775 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:48:34.628934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:48:34.628934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 20:48:34.628934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:48:34.628934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:48:34.628934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:48:34.628934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:48:34.628934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:48:34.628934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:48:34.628934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:48:34.628934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:48:34.628934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:48:34.628934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:48:34.628934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 20:48:34.628934 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 20:48:34.632224 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 651/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Sat Jul 2 20:48:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:48:34.634357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a42273-c046-492c-a30a-7519445e7842 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:34.733787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:34.767557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a42273-c046-492c-a30a-7519445e7842 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:34.812663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2858e-fe72-4e73-ae74-bfe27d951986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:34.813318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2858e-fe72-4e73-ae74-bfe27d951986 None admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:34.813609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2858e-fe72-4e73-ae74-bfe27d951986 None admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:34.813882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2858e-fe72-4e73-ae74-bfe27d951986 None admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:34.814611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2858e-fe72-4e73-ae74-bfe27d951986 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:48:34.814917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2858e-fe72-4e73-ae74-bfe27d951986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:34.816355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2858e-fe72-4e73-ae74-bfe27d951986 None admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:34.821982 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 654/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Sat Jul 2 20:48:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:48:34.828169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9f909-8611-494e-bd26-65fa1f4baef6 None admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:34.937094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9f909-8611-494e-bd26-65fa1f4baef6 None admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:34.971581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543144db-d93e-4914-8048-f2e00aa7516f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:34.972251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543144db-d93e-4914-8048-f2e00aa7516f None admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:34.972531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543144db-d93e-4914-8048-f2e00aa7516f None admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:34.972806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543144db-d93e-4914-8048-f2e00aa7516f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:34.973544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543144db-d93e-4914-8048-f2e00aa7516f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:34.974974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543144db-d93e-4914-8048-f2e00aa7516f None admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:34.995041 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 652/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Jul 2 20:48:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:48:44.819065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=30 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:44.991180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:46.549931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96f807-2f7b-420b-a2e5-99d02204468f None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:46.550481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96f807-2f7b-420b-a2e5-99d02204468f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:46.550481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96f807-2f7b-420b-a2e5-99d02204468f None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:46.552023 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 655/1307] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:49:46.557311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a0a89-dc35-4f26-ab82-807156a74a74 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:46.557761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a0a89-dc35-4f26-ab82-807156a74a74 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:46.558055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a0a89-dc35-4f26-ab82-807156a74a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:46.641234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d14a0a89-dc35-4f26-ab82-807156a74a74 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:46.642805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d14a0a89-dc35-4f26-ab82-807156a74a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:46.775713 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 653/1308] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:49:46.828912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fb286-b786-48b9-9ce1-76cf5f6f1620 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:46.829197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fb286-b786-48b9-9ce1-76cf5f6f1620 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:46.829451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fb286-b786-48b9-9ce1-76cf5f6f1620 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:46.831195 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 656/1309] 10.222.0.43 () {54 vars in 964 bytes} [Sat Jul 2 20:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:49:46.837298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df5abe-ba47-4ce0-8add-7a4f95ead2d0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:46.837595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df5abe-ba47-4ce0-8add-7a4f95ead2d0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:46.837944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df5abe-ba47-4ce0-8add-7a4f95ead2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:46.913850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-42df5abe-ba47-4ce0-8add-7a4f95ead2d0 None None] MFA Rules not processed for user `684732cf5a004fb084ce0e523398c970`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:46.915751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-42df5abe-ba47-4ce0-8add-7a4f95ead2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:46.942809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:47.007856 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 654/1310] 10.222.0.43 () {58 vars in 1061 bytes} [Sat Jul 2 20:49:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:49:47.016785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fb286-b786-48b9-9ce1-76cf5f6f1620 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:47.018494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bf9fb286-b786-48b9-9ce1-76cf5f6f1620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:47.156682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fb286-b786-48b9-9ce1-76cf5f6f1620 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:47.237120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8a8c7-d4d6-4f24-ab27-e1c307480f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:47.237776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8a8c7-d4d6-4f24-ab27-e1c307480f04 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:47.238028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8a8c7-d4d6-4f24-ab27-e1c307480f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:47.238326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8a8c7-d4d6-4f24-ab27-e1c307480f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:47.239996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b4f8a8c7-d4d6-4f24-ab27-e1c307480f04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:47.298935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:47.358598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8a8c7-d4d6-4f24-ab27-e1c307480f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:47.359998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8a8c7-d4d6-4f24-ab27-e1c307480f04 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:47.379511 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 657/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:49:49.928272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fc77e-a8f7-49eb-a15e-a21e3f653106 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:49.928804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fc77e-a8f7-49eb-a15e-a21e3f653106 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:49.928804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fc77e-a8f7-49eb-a15e-a21e3f653106 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:49.930416 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 655/1312] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:49:49.935399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd226e00-2caf-4d76-9e03-989f5ac21772 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:49.935827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd226e00-2caf-4d76-9e03-989f5ac21772 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:49.936106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd226e00-2caf-4d76-9e03-989f5ac21772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:50.022503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fd226e00-2caf-4d76-9e03-989f5ac21772 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:50.023906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fd226e00-2caf-4d76-9e03-989f5ac21772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:50.135323 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 658/1313] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 20:49:50.188623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150892c-4469-43d3-ae3f-4c93da9b0307 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:50.188846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150892c-4469-43d3-ae3f-4c93da9b0307 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:50.189093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150892c-4469-43d3-ae3f-4c93da9b0307 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:50.190482 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 656/1314] 10.222.0.43 () {54 vars in 964 bytes} [Sat Jul 2 20:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:49:50.197016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf061e39-e618-44c4-88c6-23e0ed71ef0b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:50.197381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf061e39-e618-44c4-88c6-23e0ed71ef0b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:50.197698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf061e39-e618-44c4-88c6-23e0ed71ef0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:50.209931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:50.277626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bf061e39-e618-44c4-88c6-23e0ed71ef0b None None] MFA Rules not processed for user `684732cf5a004fb084ce0e523398c970`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:50.278834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bf061e39-e618-44c4-88c6-23e0ed71ef0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:50.361736 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 659/1315] 10.222.0.43 () {58 vars in 1061 bytes} [Sat Jul 2 20:49:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:49:50.371230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150892c-4469-43d3-ae3f-4c93da9b0307 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:50.372789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0150892c-4469-43d3-ae3f-4c93da9b0307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:50.493635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150892c-4469-43d3-ae3f-4c93da9b0307 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:50.571455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:50.574087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bb6b1-2364-4394-8269-7e5f8f792aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:50.574855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bb6b1-2364-4394-8269-7e5f8f792aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:50.575224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bb6b1-2364-4394-8269-7e5f8f792aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:50.575573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bb6b1-2364-4394-8269-7e5f8f792aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:50.577702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fd8bb6b1-2364-4394-8269-7e5f8f792aa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:50.696317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bb6b1-2364-4394-8269-7e5f8f792aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:50.697768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bb6b1-2364-4394-8269-7e5f8f792aa7 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:50.717307 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 657/1316] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:49:53.546242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7af95-5b80-407f-b5ab-6ba7aafee0de None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:53.547069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7af95-5b80-407f-b5ab-6ba7aafee0de None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:53.547069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7af95-5b80-407f-b5ab-6ba7aafee0de None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:53.548600 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 660/1317] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:49:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:49:53.554010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73ee58-821e-431d-acd7-ec680a905a9b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:53.554455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73ee58-821e-431d-acd7-ec680a905a9b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:53.554559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73ee58-821e-431d-acd7-ec680a905a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:53.618110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7f73ee58-821e-431d-acd7-ec680a905a9b None None] MFA Rules not processed for user `01308079b08d469b8f639c49f9b8e1a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:53.619294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7f73ee58-821e-431d-acd7-ec680a905a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:53.696830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:53.748958 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 658/1318] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:49:53 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:49:53.798950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7af95-5b80-407f-b5ab-6ba7aafee0de None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:53.800483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3cb7af95-5b80-407f-b5ab-6ba7aafee0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:53.918159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7af95-5b80-407f-b5ab-6ba7aafee0de None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:53.921006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:54.003962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f89669-ca6c-4c71-b135-5e568b8732c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:54.004667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f89669-ca6c-4c71-b135-5e568b8732c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:54.004943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f89669-ca6c-4c71-b135-5e568b8732c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:54.005212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f89669-ca6c-4c71-b135-5e568b8732c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:54.006855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-40f89669-ca6c-4c71-b135-5e568b8732c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:54.129379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f89669-ca6c-4c71-b135-5e568b8732c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:54.130824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f89669-ca6c-4c71-b135-5e568b8732c1 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:54.150238 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 661/1319] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:49:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 20:49:57.031361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e243e2-60d9-4244-9f5f-04905e3cd92e None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:57.031930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e243e2-60d9-4244-9f5f-04905e3cd92e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:57.031930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e243e2-60d9-4244-9f5f-04905e3cd92e None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:57.033444 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 659/1320] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:49:57.040329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b521d-5404-41b4-ad14-a79c7a80f881 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:57.041022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b521d-5404-41b4-ad14-a79c7a80f881 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:57.041289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b521d-5404-41b4-ad14-a79c7a80f881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:57.088237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:57.116063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8c5b521d-5404-41b4-ad14-a79c7a80f881 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:57.117295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8c5b521d-5404-41b4-ad14-a79c7a80f881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:57.229786 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 662/1321] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:49:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:49:57.273738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e243e2-60d9-4244-9f5f-04905e3cd92e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:57.276148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-14e243e2-60d9-4244-9f5f-04905e3cd92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:57.392496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e243e2-60d9-4244-9f5f-04905e3cd92e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:57.467661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189d573-4db7-442e-8caf-ccb14a5c9959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:57.468320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189d573-4db7-442e-8caf-ccb14a5c9959 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:57.468593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189d573-4db7-442e-8caf-ccb14a5c9959 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:57.468861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189d573-4db7-442e-8caf-ccb14a5c9959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:57.470470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6189d573-4db7-442e-8caf-ccb14a5c9959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:57.477795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:57.600892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189d573-4db7-442e-8caf-ccb14a5c9959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:57.602392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189d573-4db7-442e-8caf-ccb14a5c9959 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:57.621409 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 660/1322] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:49:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:00.610525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1fdd5-626b-409e-ac8f-094ea8b99f86 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:00.611060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1fdd5-626b-409e-ac8f-094ea8b99f86 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:00.611060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1fdd5-626b-409e-ac8f-094ea8b99f86 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:00.612547 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 663/1323] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:00.618053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7b67a-bdc4-42a8-8192-623e1127bc13 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:00.618466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7b67a-bdc4-42a8-8192-623e1127bc13 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:00.618642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7b67a-bdc4-42a8-8192-623e1127bc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:00.686127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-cad7b67a-bdc4-42a8-8192-623e1127bc13 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:00.687342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cad7b67a-bdc4-42a8-8192-623e1127bc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:00.746026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:00.785680 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 661/1324] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:00.824759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1fdd5-626b-409e-ac8f-094ea8b99f86 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:00.826286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-92a1fdd5-626b-409e-ac8f-094ea8b99f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:00.935893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1fdd5-626b-409e-ac8f-094ea8b99f86 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:00.949675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:01.015519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b58b0-3499-4d24-8495-1857b373a634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:01.016189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b58b0-3499-4d24-8495-1857b373a634 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:01.016468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b58b0-3499-4d24-8495-1857b373a634 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:01.016745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b58b0-3499-4d24-8495-1857b373a634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:01.018376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cc4b58b0-3499-4d24-8495-1857b373a634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:01.139374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b58b0-3499-4d24-8495-1857b373a634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:01.140877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b58b0-3499-4d24-8495-1857b373a634 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:01.159258 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 664/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:03.488489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b7f77-6659-48cb-9328-5fb637c3e08f None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:03.489037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b7f77-6659-48cb-9328-5fb637c3e08f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:03.489037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b7f77-6659-48cb-9328-5fb637c3e08f None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:03.490427 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 662/1326] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:03.496209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502802fb-6f08-4dce-aa6c-1bed6b2570a2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:03.496646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502802fb-6f08-4dce-aa6c-1bed6b2570a2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:03.496777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502802fb-6f08-4dce-aa6c-1bed6b2570a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:03.544870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:03.564231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-502802fb-6f08-4dce-aa6c-1bed6b2570a2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:03.565481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-502802fb-6f08-4dce-aa6c-1bed6b2570a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:03.665374 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 665/1327] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:03.702538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b7f77-6659-48cb-9328-5fb637c3e08f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:03.704111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f99b7f77-6659-48cb-9328-5fb637c3e08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:03.810227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b7f77-6659-48cb-9328-5fb637c3e08f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:03.884603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc3877-cacb-4dfb-b3bf-4b27fafd405e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:03.885245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc3877-cacb-4dfb-b3bf-4b27fafd405e service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:03.885520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc3877-cacb-4dfb-b3bf-4b27fafd405e service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:03.885886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc3877-cacb-4dfb-b3bf-4b27fafd405e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:03.887497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-78cc3877-cacb-4dfb-b3bf-4b27fafd405e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:03.904105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:03.998887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc3877-cacb-4dfb-b3bf-4b27fafd405e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:04.000421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc3877-cacb-4dfb-b3bf-4b27fafd405e service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:04.018559 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 663/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:06.342485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97d074-99cd-45d4-a504-482a416feaf9 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:06.343032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97d074-99cd-45d4-a504-482a416feaf9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:06.343032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97d074-99cd-45d4-a504-482a416feaf9 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:06.344564 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 666/1329] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:06.349562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e16129-1a67-4b1d-974a-ca21494a6d80 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:06.349981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e16129-1a67-4b1d-974a-ca21494a6d80 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:06.350130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e16129-1a67-4b1d-974a-ca21494a6d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:06.416008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-72e16129-1a67-4b1d-974a-ca21494a6d80 None None] MFA Rules not processed for user `01308079b08d469b8f639c49f9b8e1a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:06.417231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-72e16129-1a67-4b1d-974a-ca21494a6d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:06.483811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:06.517501 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 664/1330] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:50:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:06.556272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97d074-99cd-45d4-a504-482a416feaf9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:06.557885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ef97d074-99cd-45d4-a504-482a416feaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:06.670343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97d074-99cd-45d4-a504-482a416feaf9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:06.693370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:06.752736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c740f-3e3b-41a6-a950-9cda65914a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:06.753377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c740f-3e3b-41a6-a950-9cda65914a04 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:06.753620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c740f-3e3b-41a6-a950-9cda65914a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:06.753891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c740f-3e3b-41a6-a950-9cda65914a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:06.755539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-942c740f-3e3b-41a6-a950-9cda65914a04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:06.873819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c740f-3e3b-41a6-a950-9cda65914a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:06.875174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c740f-3e3b-41a6-a950-9cda65914a04 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:06.893450 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 667/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:09.582234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2992aa-df71-45d7-bbbc-47f5084eb487 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:09.582854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2992aa-df71-45d7-bbbc-47f5084eb487 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:09.582854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2992aa-df71-45d7-bbbc-47f5084eb487 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:09.584195 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 665/1332] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:09.590283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741ccf8-597d-4ed1-ae08-312d5767e712 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:09.590875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741ccf8-597d-4ed1-ae08-312d5767e712 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:09.590875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741ccf8-597d-4ed1-ae08-312d5767e712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:09.665920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:09.669611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5741ccf8-597d-4ed1-ae08-312d5767e712 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:09.671586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5741ccf8-597d-4ed1-ae08-312d5767e712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:09.791018 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 668/1333] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:09.828635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2992aa-df71-45d7-bbbc-47f5084eb487 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:09.830168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3d2992aa-df71-45d7-bbbc-47f5084eb487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:09.933981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2992aa-df71-45d7-bbbc-47f5084eb487 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:10.022566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6fee4-2720-486a-a04d-680a94536a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:10.023132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6fee4-2720-486a-a04d-680a94536a62 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:10.023411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6fee4-2720-486a-a04d-680a94536a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:10.023682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6fee4-2720-486a-a04d-680a94536a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:10.025366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a6b6fee4-2720-486a-a04d-680a94536a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:10.055660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:10.143303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6fee4-2720-486a-a04d-680a94536a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:10.144799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6fee4-2720-486a-a04d-680a94536a62 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:10.163248 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 666/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:12.496318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f72e2d-3466-4d36-8504-3dd6b588bc9b None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:12.497139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f72e2d-3466-4d36-8504-3dd6b588bc9b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:12.497139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f72e2d-3466-4d36-8504-3dd6b588bc9b None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:12.499446 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 669/1335] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:50:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:12.505716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f78937-783a-4f47-9a9f-20097458b19a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:12.506164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f78937-783a-4f47-9a9f-20097458b19a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:12.506279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f78937-783a-4f47-9a9f-20097458b19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:12.572556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-83f78937-783a-4f47-9a9f-20097458b19a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:12.573757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-83f78937-783a-4f47-9a9f-20097458b19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:12.656516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:12.681573 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 667/1336] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:12.721970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f72e2d-3466-4d36-8504-3dd6b588bc9b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:12.723495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-87f72e2d-3466-4d36-8504-3dd6b588bc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:12.831348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f72e2d-3466-4d36-8504-3dd6b588bc9b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:12.861460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:12.910394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927299a1-bf9c-4738-a13b-9b3f3afa0b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:12.911039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927299a1-bf9c-4738-a13b-9b3f3afa0b3c service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:12.911320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927299a1-bf9c-4738-a13b-9b3f3afa0b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:12.911592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927299a1-bf9c-4738-a13b-9b3f3afa0b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:12.913269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-927299a1-bf9c-4738-a13b-9b3f3afa0b3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:13.028028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927299a1-bf9c-4738-a13b-9b3f3afa0b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:13.029828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927299a1-bf9c-4738-a13b-9b3f3afa0b3c service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:13.051391 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 670/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:15.702672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d80293-b68d-4701-8248-57a237c6e292 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:15.703230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d80293-b68d-4701-8248-57a237c6e292 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:15.703230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d80293-b68d-4701-8248-57a237c6e292 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:15.705568 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 668/1338] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:50:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:15.713739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393b6f8-a0d6-459f-84b0-f2e1317f83f7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:15.714145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393b6f8-a0d6-459f-84b0-f2e1317f83f7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:15.714290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393b6f8-a0d6-459f-84b0-f2e1317f83f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:15.781075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9393b6f8-a0d6-459f-84b0-f2e1317f83f7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:15.782363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9393b6f8-a0d6-459f-84b0-f2e1317f83f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:15.791390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:15.892713 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 671/1339] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:50:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:15.931209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d80293-b68d-4701-8248-57a237c6e292 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:15.933623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a5d80293-b68d-4701-8248-57a237c6e292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:16.051274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d80293-b68d-4701-8248-57a237c6e292 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:16.131596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ababef-b28e-4cb2-8771-4d9156397333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:16.132293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ababef-b28e-4cb2-8771-4d9156397333 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:16.132566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ababef-b28e-4cb2-8771-4d9156397333 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:16.132839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ababef-b28e-4cb2-8771-4d9156397333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:16.134508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c9ababef-b28e-4cb2-8771-4d9156397333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:16.171914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:16.258017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ababef-b28e-4cb2-8771-4d9156397333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:16.259554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ababef-b28e-4cb2-8771-4d9156397333 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:16.278982 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 669/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:20.691159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccb315-990d-4a89-b2f6-8f8f27edc3c5 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:20.691723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccb315-990d-4a89-b2f6-8f8f27edc3c5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:20.691837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccb315-990d-4a89-b2f6-8f8f27edc3c5 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:20.693203 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 672/1341] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:20.698746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84be28c-edbc-48d0-95c5-38eef6f54e5b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:20.699236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84be28c-edbc-48d0-95c5-38eef6f54e5b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:20.699332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84be28c-edbc-48d0-95c5-38eef6f54e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:20.776692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b84be28c-edbc-48d0-95c5-38eef6f54e5b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:20.778072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b84be28c-edbc-48d0-95c5-38eef6f54e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:20.876053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:20.889487 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 670/1342] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:20.930362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccb315-990d-4a89-b2f6-8f8f27edc3c5 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:20.932833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a9ccb315-990d-4a89-b2f6-8f8f27edc3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:21.035105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccb315-990d-4a89-b2f6-8f8f27edc3c5 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:21.039060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20be476-3a7e-419e-a5b6-e5a94819e4e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:21.039702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20be476-3a7e-419e-a5b6-e5a94819e4e1 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:21.039986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20be476-3a7e-419e-a5b6-e5a94819e4e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:21.040282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20be476-3a7e-419e-a5b6-e5a94819e4e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:21.050494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20be476-3a7e-419e-a5b6-e5a94819e4e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:21.051958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20be476-3a7e-419e-a5b6-e5a94819e4e1 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:21.061770 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 673/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:23.983859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c2ab3-42f0-42eb-b5f7-e965b8010dc9 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:23.984469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c2ab3-42f0-42eb-b5f7-e965b8010dc9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:23.984469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c2ab3-42f0-42eb-b5f7-e965b8010dc9 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:23.985759 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 671/1344] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:23.991345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc89a4-daec-433c-9677-64862ecb5eb5 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:23.991782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc89a4-daec-433c-9677-64862ecb5eb5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:23.991873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc89a4-daec-433c-9677-64862ecb5eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:24.022623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4ddc89a4-daec-433c-9677-64862ecb5eb5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:24.023852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4ddc89a4-daec-433c-9677-64862ecb5eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:24.052973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:24.109583 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 674/1345] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:50:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:24.147821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c2ab3-42f0-42eb-b5f7-e965b8010dc9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:24.159874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c2ab3-42f0-42eb-b5f7-e965b8010dc9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:24.163619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81849f75-2b0c-4b95-8f55-6ed98d864f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:24.164286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81849f75-2b0c-4b95-8f55-6ed98d864f81 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:24.164567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81849f75-2b0c-4b95-8f55-6ed98d864f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:24.164839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81849f75-2b0c-4b95-8f55-6ed98d864f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:24.174169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81849f75-2b0c-4b95-8f55-6ed98d864f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:24.175602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81849f75-2b0c-4b95-8f55-6ed98d864f81 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:24.184925 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 672/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:28.425955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3046c37-f86f-40e2-a536-acef3834784c None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:28.426432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3046c37-f86f-40e2-a536-acef3834784c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:28.428631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3046c37-f86f-40e2-a536-acef3834784c None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:28.428631 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 675/1347] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:28.433671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb065b-ccb8-4244-850b-80a74464aa9b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:28.434132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb065b-ccb8-4244-850b-80a74464aa9b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:28.434215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb065b-ccb8-4244-850b-80a74464aa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:28.453019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-cabb065b-ccb8-4244-850b-80a74464aa9b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:28.454220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cabb065b-ccb8-4244-850b-80a74464aa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:28.462905 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 673/1348] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:28.501940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3046c37-f86f-40e2-a536-acef3834784c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:28.513607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3046c37-f86f-40e2-a536-acef3834784c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:28.517553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e3c30-7bd1-46fe-9785-b875107525f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:28.518185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e3c30-7bd1-46fe-9785-b875107525f9 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:28.518466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e3c30-7bd1-46fe-9785-b875107525f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:28.518741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e3c30-7bd1-46fe-9785-b875107525f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:28.528577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e3c30-7bd1-46fe-9785-b875107525f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:28.530013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e3c30-7bd1-46fe-9785-b875107525f9 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:28.539790 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 676/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:34.025998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420377f6-21c0-4868-9bad-f74bea55a49a None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:34.026592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420377f6-21c0-4868-9bad-f74bea55a49a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:34.026592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420377f6-21c0-4868-9bad-f74bea55a49a None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:34.028022 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 674/1350] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 20:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:34.039219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c9705-888a-4554-9605-714c9cece541 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:34.040216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c9705-888a-4554-9605-714c9cece541 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:34.040757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c9705-888a-4554-9605-714c9cece541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:34.119191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-664c9705-888a-4554-9605-714c9cece541 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:34.120956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-664c9705-888a-4554-9605-714c9cece541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:34.203509 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 677/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 20:50:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:38.447525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=13 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:38.711874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc1c61-0721-455e-8ed6-4d1beaea252d None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:38.712756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc1c61-0721-455e-8ed6-4d1beaea252d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:38.713349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc1c61-0721-455e-8ed6-4d1beaea252d None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:38.716677 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 675/1352] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 20:50:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:38.721964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e3273-b2b5-42e1-a6f0-32297c6922db None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:38.722542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e3273-b2b5-42e1-a6f0-32297c6922db None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:38.722664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e3273-b2b5-42e1-a6f0-32297c6922db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:38.742714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e81e3273-b2b5-42e1-a6f0-32297c6922db None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:38.744022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e81e3273-b2b5-42e1-a6f0-32297c6922db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:38.752871 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 678/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 20:50:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:40.426593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3db965-af59-47a0-a4ee-1206f8cb6b82 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:40.427241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3db965-af59-47a0-a4ee-1206f8cb6b82 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:40.427241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3db965-af59-47a0-a4ee-1206f8cb6b82 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:40.428724 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 676/1354] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 20:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:40.433509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d53a9-a9b5-4715-a512-718e2c323ecd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:40.433922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d53a9-a9b5-4715-a512-718e2c323ecd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:40.434025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d53a9-a9b5-4715-a512-718e2c323ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:40.452190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-806d53a9-a9b5-4715-a512-718e2c323ecd None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:40.453412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-806d53a9-a9b5-4715-a512-718e2c323ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:40.463509 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 679/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 20:50:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:44.464871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a48c17-8308-45b9-b4c2-5346f1471a1f None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:44.465471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a48c17-8308-45b9-b4c2-5346f1471a1f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:44.465471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a48c17-8308-45b9-b4c2-5346f1471a1f None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:44.466746 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 677/1356] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:44.472219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1d1a6-6e4c-491c-a656-39e09e36a592 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:44.472940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1d1a6-6e4c-491c-a656-39e09e36a592 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:44.473419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1d1a6-6e4c-491c-a656-39e09e36a592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:44.491338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9de1d1a6-6e4c-491c-a656-39e09e36a592 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:44.492550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9de1d1a6-6e4c-491c-a656-39e09e36a592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:44.500965 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 680/1357] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:44.559850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fd1e0-0aeb-4481-8f3d-595a6987868a None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:44.560424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fd1e0-0aeb-4481-8f3d-595a6987868a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:44.561030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fd1e0-0aeb-4481-8f3d-595a6987868a None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:44.563964 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 678/1358] 10.222.0.43 () {54 vars in 961 bytes} [Sat Jul 2 20:50:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:44.572672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b941f-8ee9-41bd-8b24-1dea362bbaac None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:44.573176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b941f-8ee9-41bd-8b24-1dea362bbaac None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:44.573873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b941f-8ee9-41bd-8b24-1dea362bbaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:44.619312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:44.629346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c81b941f-8ee9-41bd-8b24-1dea362bbaac None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:44.630909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c81b941f-8ee9-41bd-8b24-1dea362bbaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:44.715351 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 681/1359] 10.222.0.43 () {58 vars in 1058 bytes} [Sat Jul 2 20:50:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:44.723213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fd1e0-0aeb-4481-8f3d-595a6987868a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:44.739257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fd1e0-0aeb-4481-8f3d-595a6987868a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:44.745468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd46d3-96c6-4bbf-a303-ce2346701177 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:44.746232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd46d3-96c6-4bbf-a303-ce2346701177 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:44.746666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd46d3-96c6-4bbf-a303-ce2346701177 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:44.747028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd46d3-96c6-4bbf-a303-ce2346701177 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:44.756262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd46d3-96c6-4bbf-a303-ce2346701177 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:44.758213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd46d3-96c6-4bbf-a303-ce2346701177 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:44.768793 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 679/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:47.299069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296269cb-c0a3-4b0f-97f9-f6112ab3008b None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:47.299897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296269cb-c0a3-4b0f-97f9-f6112ab3008b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:47.300340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296269cb-c0a3-4b0f-97f9-f6112ab3008b None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:47.302921 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 682/1361] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:50:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:50:47.308638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d887e0b-ae76-4e65-a5d1-40620fe91835 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:47.309159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d887e0b-ae76-4e65-a5d1-40620fe91835 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:47.309159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d887e0b-ae76-4e65-a5d1-40620fe91835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:47.326825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5d887e0b-ae76-4e65-a5d1-40620fe91835 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:47.327996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5d887e0b-ae76-4e65-a5d1-40620fe91835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:47.336297 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 680/1362] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:47.383609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296269cb-c0a3-4b0f-97f9-f6112ab3008b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:47.400624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296269cb-c0a3-4b0f-97f9-f6112ab3008b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:47.406555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf282e0-bf04-4574-83e7-b35dca2f7983 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:47.407396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf282e0-bf04-4574-83e7-b35dca2f7983 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:47.407830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf282e0-bf04-4574-83e7-b35dca2f7983 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:47.408284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf282e0-bf04-4574-83e7-b35dca2f7983 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:47.418298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf282e0-bf04-4574-83e7-b35dca2f7983 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:47.420608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf282e0-bf04-4574-83e7-b35dca2f7983 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:47.433003 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 683/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:50.065443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6dd0f-d0fc-4a3d-8171-0f2f56fb2415 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:50.065936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6dd0f-d0fc-4a3d-8171-0f2f56fb2415 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:50.065936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6dd0f-d0fc-4a3d-8171-0f2f56fb2415 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:50.068241 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 681/1364] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:50.074203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed150d-1a2b-40bd-ae47-189518cd90ce None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:50.075063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed150d-1a2b-40bd-ae47-189518cd90ce None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:50.075963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed150d-1a2b-40bd-ae47-189518cd90ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:50.095671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-80ed150d-1a2b-40bd-ae47-189518cd90ce None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:50.096927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-80ed150d-1a2b-40bd-ae47-189518cd90ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:50.105243 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 684/1365] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:50.150921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36c827-50c1-4a22-886a-64d55637db8c None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:50.151260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36c827-50c1-4a22-886a-64d55637db8c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:50.151542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36c827-50c1-4a22-886a-64d55637db8c None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:50.152945 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 682/1366] 10.222.0.43 () {54 vars in 961 bytes} [Sat Jul 2 20:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:50.158414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc44e29-263f-4422-9c86-1f50d20d4e36 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:50.158869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc44e29-263f-4422-9c86-1f50d20d4e36 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:50.159141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc44e29-263f-4422-9c86-1f50d20d4e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:50.179921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4dc44e29-263f-4422-9c86-1f50d20d4e36 None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:50.181277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4dc44e29-263f-4422-9c86-1f50d20d4e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:50.191426 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 685/1367] 10.222.0.43 () {58 vars in 1058 bytes} [Sat Jul 2 20:50:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:50.199567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36c827-50c1-4a22-886a-64d55637db8c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:50.215610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36c827-50c1-4a22-886a-64d55637db8c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:50.221489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa877f-e111-48e9-a9e6-f7f2bb081ff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:50.222129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa877f-e111-48e9-a9e6-f7f2bb081ff9 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:50.222403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa877f-e111-48e9-a9e6-f7f2bb081ff9 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:50.222671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa877f-e111-48e9-a9e6-f7f2bb081ff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:50.230990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa877f-e111-48e9-a9e6-f7f2bb081ff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:50.232659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa877f-e111-48e9-a9e6-f7f2bb081ff9 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:50.243047 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 683/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:52.641795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f367ed-4569-42d6-9c64-6f713eafe48f None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:52.644990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f367ed-4569-42d6-9c64-6f713eafe48f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:52.645374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f367ed-4569-42d6-9c64-6f713eafe48f None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:52.647151 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 686/1369] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:50:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:52.653112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18016ea3-ea89-4be9-bf38-8d23c9d1e1c2 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:52.653997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18016ea3-ea89-4be9-bf38-8d23c9d1e1c2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:52.654502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18016ea3-ea89-4be9-bf38-8d23c9d1e1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:52.678191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-18016ea3-ea89-4be9-bf38-8d23c9d1e1c2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:52.679680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-18016ea3-ea89-4be9-bf38-8d23c9d1e1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:52.695651 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 684/1370] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:52.739605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f367ed-4569-42d6-9c64-6f713eafe48f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:52.756873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f367ed-4569-42d6-9c64-6f713eafe48f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:52.762967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245712b-c5d9-47c5-af44-77c0e06df261 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:52.764407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245712b-c5d9-47c5-af44-77c0e06df261 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:52.765433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245712b-c5d9-47c5-af44-77c0e06df261 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:52.765865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245712b-c5d9-47c5-af44-77c0e06df261 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:52.776448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245712b-c5d9-47c5-af44-77c0e06df261 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:52.782212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245712b-c5d9-47c5-af44-77c0e06df261 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:52.800810 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 687/1371] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:55.554755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b611cbf-fc04-44cf-a389-2bcf2d8aac7f None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:55.555874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b611cbf-fc04-44cf-a389-2bcf2d8aac7f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:55.556400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b611cbf-fc04-44cf-a389-2bcf2d8aac7f None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:55.561820 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 685/1372] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:50:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:55.563185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472e988-ff1a-422f-b64c-12f424daae18 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:55.563638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472e988-ff1a-422f-b64c-12f424daae18 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:55.563727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472e988-ff1a-422f-b64c-12f424daae18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:55.583463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a472e988-ff1a-422f-b64c-12f424daae18 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:55.584971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a472e988-ff1a-422f-b64c-12f424daae18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:55.593917 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 688/1373] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 20:50:55.642650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b611cbf-fc04-44cf-a389-2bcf2d8aac7f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:55.659446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b611cbf-fc04-44cf-a389-2bcf2d8aac7f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:55.665670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75512ed9-5a57-4022-a753-2ef7f197067a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:55.666821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75512ed9-5a57-4022-a753-2ef7f197067a service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:55.667314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75512ed9-5a57-4022-a753-2ef7f197067a service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:55.667783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75512ed9-5a57-4022-a753-2ef7f197067a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:55.677869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75512ed9-5a57-4022-a753-2ef7f197067a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:55.679715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75512ed9-5a57-4022-a753-2ef7f197067a service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:55.691489 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 686/1374] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:56.594414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738487f8-1035-4e2b-a42f-706d29b96473 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:56.594948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738487f8-1035-4e2b-a42f-706d29b96473 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:56.595387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738487f8-1035-4e2b-a42f-706d29b96473 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:56.597086 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 689/1375] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:56.602888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d983de8-a57e-46fa-9708-e97b31334894 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:56.603361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d983de8-a57e-46fa-9708-e97b31334894 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:56.603463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d983de8-a57e-46fa-9708-e97b31334894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:56.632637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6d983de8-a57e-46fa-9708-e97b31334894 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:56.633904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6d983de8-a57e-46fa-9708-e97b31334894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:56.644002 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 687/1376] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:56.928355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c950a0-1486-41e4-b5c0-bda4d3f34e09 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:56.928608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c950a0-1486-41e4-b5c0-bda4d3f34e09 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:56.929092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c950a0-1486-41e4-b5c0-bda4d3f34e09 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:56.930432 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 690/1377] 10.222.0.43 () {54 vars in 963 bytes} [Sat Jul 2 20:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:56.936073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a70635-9893-459e-9aa4-9d9c18661e1d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:56.939475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a70635-9893-459e-9aa4-9d9c18661e1d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:56.939815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a70635-9893-459e-9aa4-9d9c18661e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:56.994138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-46a70635-9893-459e-9aa4-9d9c18661e1d None None] MFA Rules not processed for user `f9ea416fd4d4420b9112507ef1a68bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:56.995311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-46a70635-9893-459e-9aa4-9d9c18661e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:57.065383 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 688/1378] 10.222.0.43 () {58 vars in 1060 bytes} [Sat Jul 2 20:50:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:57.094150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c950a0-1486-41e4-b5c0-bda4d3f34e09 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:57.094150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c950a0-1486-41e4-b5c0-bda4d3f34e09 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:57.094150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9b9d5-7a9b-4685-9316-02f0e7027715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:57.094150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9b9d5-7a9b-4685-9316-02f0e7027715 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:57.096425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9b9d5-7a9b-4685-9316-02f0e7027715 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:57.096425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9b9d5-7a9b-4685-9316-02f0e7027715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:57.103972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9b9d5-7a9b-4685-9316-02f0e7027715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:57.105674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9b9d5-7a9b-4685-9316-02f0e7027715 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:57.115980 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 691/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 20:50:58.195036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817fa90-02ec-4f17-879a-93d76ceff03f None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:58.195737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817fa90-02ec-4f17-879a-93d76ceff03f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:58.195737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817fa90-02ec-4f17-879a-93d76ceff03f None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:58.197275 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 689/1380] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:58.202756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c51f7-c2dd-4b3b-a6bf-ecda128b47e2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:58.203218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c51f7-c2dd-4b3b-a6bf-ecda128b47e2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:58.203322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c51f7-c2dd-4b3b-a6bf-ecda128b47e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:58.222130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b29c51f7-c2dd-4b3b-a6bf-ecda128b47e2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:58.223357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b29c51f7-c2dd-4b3b-a6bf-ecda128b47e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:58.232740 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 692/1381] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:58.279804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817fa90-02ec-4f17-879a-93d76ceff03f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:58.294869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817fa90-02ec-4f17-879a-93d76ceff03f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:58.301341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba17b03-3812-4fad-91b8-b4dae8ad272b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:58.302018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba17b03-3812-4fad-91b8-b4dae8ad272b service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:58.302301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba17b03-3812-4fad-91b8-b4dae8ad272b service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:58.302580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba17b03-3812-4fad-91b8-b4dae8ad272b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:58.312168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba17b03-3812-4fad-91b8-b4dae8ad272b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:58.313875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba17b03-3812-4fad-91b8-b4dae8ad272b service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:58.325025 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 690/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:00.849818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4581a43-b502-4729-9abb-008b3f17d565 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:00.850397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4581a43-b502-4729-9abb-008b3f17d565 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:00.850397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4581a43-b502-4729-9abb-008b3f17d565 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:00.851661 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 693/1383] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:00.857048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c25d11-4bc7-41d5-ad0e-48e6ff184f07 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:00.857514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c25d11-4bc7-41d5-ad0e-48e6ff184f07 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:00.857622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c25d11-4bc7-41d5-ad0e-48e6ff184f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:00.876543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-91c25d11-4bc7-41d5-ad0e-48e6ff184f07 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:00.877792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-91c25d11-4bc7-41d5-ad0e-48e6ff184f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:00.886542 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 691/1384] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:00.929929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4581a43-b502-4729-9abb-008b3f17d565 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:00.944955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4581a43-b502-4729-9abb-008b3f17d565 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:00.951184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6071c28-cecb-427d-a943-1ec7a04f36d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:00.951819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6071c28-cecb-427d-a943-1ec7a04f36d4 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:00.952129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6071c28-cecb-427d-a943-1ec7a04f36d4 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:00.952400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6071c28-cecb-427d-a943-1ec7a04f36d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:00.961158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6071c28-cecb-427d-a943-1ec7a04f36d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:00.962986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6071c28-cecb-427d-a943-1ec7a04f36d4 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:00.972515 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 694/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:03.429474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbf50c-51b5-45b0-9a10-af25835af0de None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:03.430134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbf50c-51b5-45b0-9a10-af25835af0de None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:03.430134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbf50c-51b5-45b0-9a10-af25835af0de None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:03.431709 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 692/1386] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:03.437020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00afeb-b18b-416d-ae6e-e83fcbe43d9b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:03.437871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00afeb-b18b-416d-ae6e-e83fcbe43d9b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:03.438130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00afeb-b18b-416d-ae6e-e83fcbe43d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:03.468344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4c00afeb-b18b-416d-ae6e-e83fcbe43d9b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:03.469998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4c00afeb-b18b-416d-ae6e-e83fcbe43d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:03.480357 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 695/1387] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:03.529952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbf50c-51b5-45b0-9a10-af25835af0de None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:03.546286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbf50c-51b5-45b0-9a10-af25835af0de None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:03.552246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddec605-79df-4499-8749-ad96ef666499 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:03.552897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddec605-79df-4499-8749-ad96ef666499 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:03.553180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddec605-79df-4499-8749-ad96ef666499 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:03.553474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddec605-79df-4499-8749-ad96ef666499 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:03.562359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddec605-79df-4499-8749-ad96ef666499 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:03.563994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddec605-79df-4499-8749-ad96ef666499 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:03.573898 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 693/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:06.167354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf949e-b62f-4a0d-ad9c-c046ae349d80 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:06.168019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf949e-b62f-4a0d-ad9c-c046ae349d80 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:06.168019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf949e-b62f-4a0d-ad9c-c046ae349d80 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:06.169424 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 696/1389] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:06.175087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89f0e7-9c45-4887-a273-7b9ae93e87f0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:06.175626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89f0e7-9c45-4887-a273-7b9ae93e87f0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:06.175626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89f0e7-9c45-4887-a273-7b9ae93e87f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:06.195349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ff89f0e7-9c45-4887-a273-7b9ae93e87f0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:06.196612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ff89f0e7-9c45-4887-a273-7b9ae93e87f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:06.205433 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 694/1390] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:06.251873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf949e-b62f-4a0d-ad9c-c046ae349d80 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:06.268694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf949e-b62f-4a0d-ad9c-c046ae349d80 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:06.274922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ae07a-415c-4cbc-b216-2084b9aecd34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:06.275560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ae07a-415c-4cbc-b216-2084b9aecd34 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:06.275836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ae07a-415c-4cbc-b216-2084b9aecd34 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:06.276141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ae07a-415c-4cbc-b216-2084b9aecd34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:06.285043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ae07a-415c-4cbc-b216-2084b9aecd34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:06.286674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ae07a-415c-4cbc-b216-2084b9aecd34 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:06.297074 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 697/1391] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:08.743602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475ab02-36b6-4033-a9ad-9d7de491c024 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:08.744488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475ab02-36b6-4033-a9ad-9d7de491c024 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:08.744488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475ab02-36b6-4033-a9ad-9d7de491c024 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:08.745529 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 695/1392] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:08.751073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c63e90-98d0-46c2-838d-7a9071d82245 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:08.751553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c63e90-98d0-46c2-838d-7a9071d82245 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:08.751788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c63e90-98d0-46c2-838d-7a9071d82245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:08.775711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d9c63e90-98d0-46c2-838d-7a9071d82245 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:08.777328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d9c63e90-98d0-46c2-838d-7a9071d82245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:08.790548 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 698/1393] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:08.837086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475ab02-36b6-4033-a9ad-9d7de491c024 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:08.845606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=84 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:51:08.853044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475ab02-36b6-4033-a9ad-9d7de491c024 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:08.860171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4725d5f-f137-4a07-b064-99ac0f41a79f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:08.861062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4725d5f-f137-4a07-b064-99ac0f41a79f service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:08.861419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4725d5f-f137-4a07-b064-99ac0f41a79f service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:08.861779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4725d5f-f137-4a07-b064-99ac0f41a79f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:08.871317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4725d5f-f137-4a07-b064-99ac0f41a79f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:08.873077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4725d5f-f137-4a07-b064-99ac0f41a79f service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:08.883153 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 696/1394] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:11.327127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429756cd-0a74-4ef0-942b-11558e4c57e6 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:11.327751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429756cd-0a74-4ef0-942b-11558e4c57e6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:11.327858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429756cd-0a74-4ef0-942b-11558e4c57e6 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:11.329827 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 699/1395] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:51:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:11.336995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a88478-45a1-47d5-8025-642113dbb6c6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:11.337620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a88478-45a1-47d5-8025-642113dbb6c6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:11.337620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a88478-45a1-47d5-8025-642113dbb6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:11.356646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b1a88478-45a1-47d5-8025-642113dbb6c6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:11.357816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b1a88478-45a1-47d5-8025-642113dbb6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:11.367031 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 697/1396] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:11.412541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429756cd-0a74-4ef0-942b-11558e4c57e6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:11.428071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429756cd-0a74-4ef0-942b-11558e4c57e6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:11.436544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f82125-202b-4496-8504-60c3b24e2ed2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:11.437240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f82125-202b-4496-8504-60c3b24e2ed2 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:11.437521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f82125-202b-4496-8504-60c3b24e2ed2 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:11.437799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f82125-202b-4496-8504-60c3b24e2ed2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:11.447045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f82125-202b-4496-8504-60c3b24e2ed2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:11.448886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f82125-202b-4496-8504-60c3b24e2ed2 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:11.458953 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 700/1397] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:13.656262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847e802-59e1-4bf3-b8d4-aae75db470c0 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:13.656954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847e802-59e1-4bf3-b8d4-aae75db470c0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:13.656954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847e802-59e1-4bf3-b8d4-aae75db470c0 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:13.658162 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 698/1398] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:13.663662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf563d-5241-44f6-83ed-67c817028d3c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:13.664197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf563d-5241-44f6-83ed-67c817028d3c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:13.664197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf563d-5241-44f6-83ed-67c817028d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:13.682747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4fdf563d-5241-44f6-83ed-67c817028d3c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:13.683929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4fdf563d-5241-44f6-83ed-67c817028d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:13.693374 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 701/1399] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:13.750819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d962f-9a1d-4ec1-aed1-e46ab31ccf81 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:13.751082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d962f-9a1d-4ec1-aed1-e46ab31ccf81 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:13.751383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d962f-9a1d-4ec1-aed1-e46ab31ccf81 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:13.752855 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 699/1400] 10.222.0.43 () {54 vars in 962 bytes} [Sat Jul 2 20:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:13.758012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c54f3-da69-463a-ba7c-b7eb7d9af29b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:13.758303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c54f3-da69-463a-ba7c-b7eb7d9af29b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:13.758580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c54f3-da69-463a-ba7c-b7eb7d9af29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:13.786678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:51:13.813619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9e0c54f3-da69-463a-ba7c-b7eb7d9af29b None None] MFA Rules not processed for user `3de168a603b0478fa8de67f6d206e1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:13.814927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9e0c54f3-da69-463a-ba7c-b7eb7d9af29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:13.828661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7076e-5db6-45a5-9667-79009572a878 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:13.828945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7076e-5db6-45a5-9667-79009572a878 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:13.829239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7076e-5db6-45a5-9667-79009572a878 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:13.830641 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 700/1401] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:13.835590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14824b78-a229-4710-877f-1d49dcaef3be None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:13.835988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14824b78-a229-4710-877f-1d49dcaef3be None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:13.836311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14824b78-a229-4710-877f-1d49dcaef3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:13.854649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-14824b78-a229-4710-877f-1d49dcaef3be None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:13.855843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-14824b78-a229-4710-877f-1d49dcaef3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:13.863941 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 701/1402] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 20:51:13.878362 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 702/1403] 10.222.0.43 () {58 vars in 1059 bytes} [Sat Jul 2 20:51:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:13.886122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14824b78-a229-4710-877f-1d49dcaef3be None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:13.895870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14824b78-a229-4710-877f-1d49dcaef3be None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:13.900443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cdbfb-7b91-4363-8062-8d9f7f247db5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:13.901102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cdbfb-7b91-4363-8062-8d9f7f247db5 service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:13.901396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cdbfb-7b91-4363-8062-8d9f7f247db5 service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:13.901666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cdbfb-7b91-4363-8062-8d9f7f247db5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:13.909646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c54f3-da69-463a-ba7c-b7eb7d9af29b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:13.911790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cdbfb-7b91-4363-8062-8d9f7f247db5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:13.913282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cdbfb-7b91-4363-8062-8d9f7f247db5 service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:13.922446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c54f3-da69-463a-ba7c-b7eb7d9af29b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:13.923943 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 702/1404] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:13.928305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fba57a-a8d3-461c-b5b7-1f5a065e2764 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:13.928957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fba57a-a8d3-461c-b5b7-1f5a065e2764 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:13.929241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fba57a-a8d3-461c-b5b7-1f5a065e2764 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:13.929518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fba57a-a8d3-461c-b5b7-1f5a065e2764 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:13.937863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fba57a-a8d3-461c-b5b7-1f5a065e2764 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:13.939451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fba57a-a8d3-461c-b5b7-1f5a065e2764 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:13.949202 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 703/1405] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 20:51:14.496289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2a26d-25b1-46ff-b525-fd66d46af21b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:14.496584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2a26d-25b1-46ff-b525-fd66d46af21b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:14.496867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2a26d-25b1-46ff-b525-fd66d46af21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:14.552484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c5a2a26d-25b1-46ff-b525-fd66d46af21b None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:14.553724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c5a2a26d-25b1-46ff-b525-fd66d46af21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:14.621434 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 703/1406] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 20:51:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:14.662194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44b5dc-8c5b-46d1-8cb4-f60f59a49b93 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:14.662478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44b5dc-8c5b-46d1-8cb4-f60f59a49b93 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:14.662749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44b5dc-8c5b-46d1-8cb4-f60f59a49b93 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:14.664216 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 704/1407] 10.222.0.43 () {54 vars in 942 bytes} [Sat Jul 2 20:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:14.672932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fefd7-4974-4097-ae43-4255c74d3b15 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:14.673743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fefd7-4974-4097-ae43-4255c74d3b15 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:14.673850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fefd7-4974-4097-ae43-4255c74d3b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:14.738125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-532fefd7-4974-4097-ae43-4255c74d3b15 None None] MFA Rules not processed for user `55367f643da048c5ab61ab6325552256`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:14.739272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-532fefd7-4974-4097-ae43-4255c74d3b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:14.809530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:51:14.815310 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 704/1408] 10.222.0.43 () {58 vars in 1039 bytes} [Sat Jul 2 20:51:14 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:14.825193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44b5dc-8c5b-46d1-8cb4-f60f59a49b93 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:14.840355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44b5dc-8c5b-46d1-8cb4-f60f59a49b93 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:14.846163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ae9bc-354a-4319-aa2e-b4848a509e15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:14.846815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ae9bc-354a-4319-aa2e-b4848a509e15 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:14.847095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ae9bc-354a-4319-aa2e-b4848a509e15 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:14.847369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ae9bc-354a-4319-aa2e-b4848a509e15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:14.856230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ae9bc-354a-4319-aa2e-b4848a509e15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:14.857857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ae9bc-354a-4319-aa2e-b4848a509e15 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:14.866208 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 705/1409] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 20:51:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 20:51:24.813361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:51:24.862862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=43 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:51:38.194974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797f73e-1f46-4c69-9f54-90004b4b52ab None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:38.195639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797f73e-1f46-4c69-9f54-90004b4b52ab None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:38.195639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797f73e-1f46-4c69-9f54-90004b4b52ab None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:38.196956 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 705/1410] 10.222.0.43 () {54 vars in 918 bytes} [Sat Jul 2 20:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:38.202316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53148e-c8c1-481f-be76-916aa4468648 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:38.202817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53148e-c8c1-481f-be76-916aa4468648 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:38.202927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53148e-c8c1-481f-be76-916aa4468648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:38.222469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ea53148e-c8c1-481f-be76-916aa4468648 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:38.223707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ea53148e-c8c1-481f-be76-916aa4468648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:38.234357 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 706/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Sat Jul 2 20:51:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:38.249378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e2410-6728-4d2a-9a0c-78d9e34bc2e9 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:38.249691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e2410-6728-4d2a-9a0c-78d9e34bc2e9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:38.249948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e2410-6728-4d2a-9a0c-78d9e34bc2e9 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:38.251301 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 706/1412] 10.222.0.43 () {54 vars in 918 bytes} [Sat Jul 2 20:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:38.256384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35847985-8910-4256-9d2a-95b00c3c0605 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:38.256661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35847985-8910-4256-9d2a-95b00c3c0605 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:38.256914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35847985-8910-4256-9d2a-95b00c3c0605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:38.275178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-35847985-8910-4256-9d2a-95b00c3c0605 None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:38.276432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-35847985-8910-4256-9d2a-95b00c3c0605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:38.286272 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 707/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Sat Jul 2 20:51:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:41.156505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f810868-55e9-4a20-a147-177163baa6f5 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:41.157140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f810868-55e9-4a20-a147-177163baa6f5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:41.157140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f810868-55e9-4a20-a147-177163baa6f5 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:41.158478 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:41.165036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bd015-cc48-4606-aaf7-f595df99e6f8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:41.165813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bd015-cc48-4606-aaf7-f595df99e6f8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:41.165980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bd015-cc48-4606-aaf7-f595df99e6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:41.192407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-942bd015-cc48-4606-aaf7-f595df99e6f8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:41.193623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-942bd015-cc48-4606-aaf7-f595df99e6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:41.202721 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:41.251656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f810868-55e9-4a20-a147-177163baa6f5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:41.266939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f810868-55e9-4a20-a147-177163baa6f5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:41.272896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6fbbb-dce6-4c98-8b18-5969bf78c946 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:41.273562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6fbbb-dce6-4c98-8b18-5969bf78c946 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:41.273840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6fbbb-dce6-4c98-8b18-5969bf78c946 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:41.274118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6fbbb-dce6-4c98-8b18-5969bf78c946 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:41.282588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6fbbb-dce6-4c98-8b18-5969bf78c946 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:41.284238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6fbbb-dce6-4c98-8b18-5969bf78c946 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:41.293867 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 708/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 20:51:42.278519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95224c9e-6508-4374-a6fb-7c0356b324c0 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:42.279309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95224c9e-6508-4374-a6fb-7c0356b324c0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:42.279309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95224c9e-6508-4374-a6fb-7c0356b324c0 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:42.280551 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:51:42.285930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f6eb1-3ab2-4c6c-8e8c-3e598d19a96a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:42.286444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f6eb1-3ab2-4c6c-8e8c-3e598d19a96a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:42.286444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f6eb1-3ab2-4c6c-8e8c-3e598d19a96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:42.307422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-901f6eb1-3ab2-4c6c-8e8c-3e598d19a96a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:42.308734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-901f6eb1-3ab2-4c6c-8e8c-3e598d19a96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:42.319819 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:42.559941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95224c9e-6508-4374-a6fb-7c0356b324c0 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:42.577913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95224c9e-6508-4374-a6fb-7c0356b324c0 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:42.585074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b06fa-e697-4986-8347-31875ede0c58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:42.585711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b06fa-e697-4986-8347-31875ede0c58 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:42.585999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b06fa-e697-4986-8347-31875ede0c58 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:42.586275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b06fa-e697-4986-8347-31875ede0c58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:42.595104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b06fa-e697-4986-8347-31875ede0c58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:42.596755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b06fa-e697-4986-8347-31875ede0c58 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:42.606487 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 710/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:43.553852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb95d5-7cc1-47fd-8bbb-8622e16e12b9 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:43.554475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb95d5-7cc1-47fd-8bbb-8622e16e12b9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:43.554475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb95d5-7cc1-47fd-8bbb-8622e16e12b9 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:43.555895 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:51:43.561377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28af551-3b42-47eb-8914-d64b0097cf1e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:43.561864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28af551-3b42-47eb-8914-d64b0097cf1e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:43.562004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28af551-3b42-47eb-8914-d64b0097cf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:43.582204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d28af551-3b42-47eb-8914-d64b0097cf1e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:43.583437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d28af551-3b42-47eb-8914-d64b0097cf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:43.592669 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:43.753001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb95d5-7cc1-47fd-8bbb-8622e16e12b9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:43.777064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb95d5-7cc1-47fd-8bbb-8622e16e12b9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:43.790431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d63bd-8b55-4c49-a266-5d09ecd37940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:43.791351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d63bd-8b55-4c49-a266-5d09ecd37940 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:43.791736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d63bd-8b55-4c49-a266-5d09ecd37940 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:43.793321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d63bd-8b55-4c49-a266-5d09ecd37940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:43.805208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d63bd-8b55-4c49-a266-5d09ecd37940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:43.807068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d63bd-8b55-4c49-a266-5d09ecd37940 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:43.818514 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 711/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:44.735616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6059984-1453-45ea-b9a4-9293c0345b53 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:44.736487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6059984-1453-45ea-b9a4-9293c0345b53 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:44.736487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6059984-1453-45ea-b9a4-9293c0345b53 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:44.738627 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:51:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:44.744627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c067125-1fbf-4fd0-8a37-0c65e99cfafb None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:44.745116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c067125-1fbf-4fd0-8a37-0c65e99cfafb None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:44.745244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c067125-1fbf-4fd0-8a37-0c65e99cfafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:44.770298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9c067125-1fbf-4fd0-8a37-0c65e99cfafb None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:44.771508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9c067125-1fbf-4fd0-8a37-0c65e99cfafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:44.780526 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:44.940131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6059984-1453-45ea-b9a4-9293c0345b53 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:44.957234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6059984-1453-45ea-b9a4-9293c0345b53 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:44.964127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def9abe-738f-455a-b743-dfa133bc1c5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:44.964804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def9abe-738f-455a-b743-dfa133bc1c5c service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:44.965081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def9abe-738f-455a-b743-dfa133bc1c5c service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:44.965350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def9abe-738f-455a-b743-dfa133bc1c5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:44.974135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def9abe-738f-455a-b743-dfa133bc1c5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:44.975797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def9abe-738f-455a-b743-dfa133bc1c5c service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:44.985975 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 713/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:45.863994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1343daf-f616-497f-810a-ea79b996e089 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:45.864632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1343daf-f616-497f-810a-ea79b996e089 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:45.864632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1343daf-f616-497f-810a-ea79b996e089 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:45.865982 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:51:45.871626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313c823-91e7-445e-8255-9f15abae6657 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:45.872149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313c823-91e7-445e-8255-9f15abae6657 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:45.872267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313c823-91e7-445e-8255-9f15abae6657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:45.891220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5313c823-91e7-445e-8255-9f15abae6657 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:45.892484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5313c823-91e7-445e-8255-9f15abae6657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:45.901820 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:46.065974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1343daf-f616-497f-810a-ea79b996e089 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:46.082121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1343daf-f616-497f-810a-ea79b996e089 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:46.089416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df261c-f9ce-4992-a1b7-e88e673fce99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:46.090106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df261c-f9ce-4992-a1b7-e88e673fce99 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:46.090394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df261c-f9ce-4992-a1b7-e88e673fce99 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:46.090666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df261c-f9ce-4992-a1b7-e88e673fce99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:46.100483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df261c-f9ce-4992-a1b7-e88e673fce99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:46.102195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df261c-f9ce-4992-a1b7-e88e673fce99 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:46.112367 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 714/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:46.931357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc4b22-ebb8-4e23-a9d8-3c322508fc71 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:46.931974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc4b22-ebb8-4e23-a9d8-3c322508fc71 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:46.931974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc4b22-ebb8-4e23-a9d8-3c322508fc71 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:46.933339 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:46.940023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50405c65-4a3d-47a2-a86c-14dd904cf759 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:46.940830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50405c65-4a3d-47a2-a86c-14dd904cf759 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:46.941068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50405c65-4a3d-47a2-a86c-14dd904cf759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:46.962922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-50405c65-4a3d-47a2-a86c-14dd904cf759 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:46.964201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-50405c65-4a3d-47a2-a86c-14dd904cf759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:46.972498 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:47.138072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc4b22-ebb8-4e23-a9d8-3c322508fc71 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:47.157656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc4b22-ebb8-4e23-a9d8-3c322508fc71 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:47.163539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238d728-9553-4add-9ee4-c38bdb683a0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:47.164388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238d728-9553-4add-9ee4-c38bdb683a0f service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:47.164516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238d728-9553-4add-9ee4-c38bdb683a0f service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:47.164784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238d728-9553-4add-9ee4-c38bdb683a0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:47.173862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238d728-9553-4add-9ee4-c38bdb683a0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:47.175509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238d728-9553-4add-9ee4-c38bdb683a0f service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:47.185418 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 716/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:48.013499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d5d0c-025c-4b39-aced-34ad7e556f36 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:48.014368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d5d0c-025c-4b39-aced-34ad7e556f36 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:48.014463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d5d0c-025c-4b39-aced-34ad7e556f36 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:48.017401 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:51:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:48.023819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a10d24-9f2a-4335-92ce-ab87867446d5 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:48.024662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a10d24-9f2a-4335-92ce-ab87867446d5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:48.024810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a10d24-9f2a-4335-92ce-ab87867446d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:48.045647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-80a10d24-9f2a-4335-92ce-ab87867446d5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:48.046897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-80a10d24-9f2a-4335-92ce-ab87867446d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:48.056075 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:48.219374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d5d0c-025c-4b39-aced-34ad7e556f36 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:48.236189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d5d0c-025c-4b39-aced-34ad7e556f36 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:48.242277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676f0f9-1a0c-42d1-be9a-b13155e4b17d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:48.242910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676f0f9-1a0c-42d1-be9a-b13155e4b17d service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:48.243188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676f0f9-1a0c-42d1-be9a-b13155e4b17d service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:48.243458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676f0f9-1a0c-42d1-be9a-b13155e4b17d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:48.252029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676f0f9-1a0c-42d1-be9a-b13155e4b17d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:48.253659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676f0f9-1a0c-42d1-be9a-b13155e4b17d service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:48.263156 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 717/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:49.082955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c47f0-d657-4b85-83be-e8a2270ede3f None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:49.083490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c47f0-d657-4b85-83be-e8a2270ede3f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:49.083490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c47f0-d657-4b85-83be-e8a2270ede3f None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:49.084836 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:49.090832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30696a0e-5509-462d-a07e-fe8b22a52487 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:49.091317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30696a0e-5509-462d-a07e-fe8b22a52487 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:49.091415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30696a0e-5509-462d-a07e-fe8b22a52487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:49.115977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-30696a0e-5509-462d-a07e-fe8b22a52487 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:49.117223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-30696a0e-5509-462d-a07e-fe8b22a52487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:49.127389 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:49.289122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c47f0-d657-4b85-83be-e8a2270ede3f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:49.308338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c47f0-d657-4b85-83be-e8a2270ede3f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:49.314508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342397a5-6d87-48c8-8e92-764e7668a192 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:49.315171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342397a5-6d87-48c8-8e92-764e7668a192 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:49.315452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342397a5-6d87-48c8-8e92-764e7668a192 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:49.315709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342397a5-6d87-48c8-8e92-764e7668a192 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:49.324697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342397a5-6d87-48c8-8e92-764e7668a192 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:49.326325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342397a5-6d87-48c8-8e92-764e7668a192 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:49.336129 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 719/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:50.154470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80526d95-e2d0-44d1-aecf-d28c158fdf8f None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:50.155299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80526d95-e2d0-44d1-aecf-d28c158fdf8f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:50.155466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80526d95-e2d0-44d1-aecf-d28c158fdf8f None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:50.157727 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:51:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:50.163966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549e878-8ef0-46d8-8992-4158ab8ddd53 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:50.164455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549e878-8ef0-46d8-8992-4158ab8ddd53 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:50.164584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549e878-8ef0-46d8-8992-4158ab8ddd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:50.190744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e549e878-8ef0-46d8-8992-4158ab8ddd53 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:50.191946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e549e878-8ef0-46d8-8992-4158ab8ddd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:50.201161 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:50.371468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80526d95-e2d0-44d1-aecf-d28c158fdf8f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:50.388884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80526d95-e2d0-44d1-aecf-d28c158fdf8f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:50.396019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7cdf4-1c73-4f3a-b16b-0c85933de76a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:50.396784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7cdf4-1c73-4f3a-b16b-0c85933de76a service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:50.397093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7cdf4-1c73-4f3a-b16b-0c85933de76a service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:50.397367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7cdf4-1c73-4f3a-b16b-0c85933de76a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:50.406353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7cdf4-1c73-4f3a-b16b-0c85933de76a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:50.408239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7cdf4-1c73-4f3a-b16b-0c85933de76a service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:50.418574 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 720/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:52.577220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12778302-ee54-4e6d-ba31-1fd67e6e2793 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:52.577856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12778302-ee54-4e6d-ba31-1fd67e6e2793 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:52.577856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12778302-ee54-4e6d-ba31-1fd67e6e2793 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:52.579222 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:52.586008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8e1cd-2ee4-472b-a95f-28bedbf11040 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:52.586870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8e1cd-2ee4-472b-a95f-28bedbf11040 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:52.586870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8e1cd-2ee4-472b-a95f-28bedbf11040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:52.608825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ebf8e1cd-2ee4-472b-a95f-28bedbf11040 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:52.610055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ebf8e1cd-2ee4-472b-a95f-28bedbf11040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:52.619109 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:52.663845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12778302-ee54-4e6d-ba31-1fd67e6e2793 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:52.678272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12778302-ee54-4e6d-ba31-1fd67e6e2793 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:52.682157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e870588-39aa-4efe-89a6-993d37730259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:52.682791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e870588-39aa-4efe-89a6-993d37730259 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:52.683073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e870588-39aa-4efe-89a6-993d37730259 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:52.683374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e870588-39aa-4efe-89a6-993d37730259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:52.692630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e870588-39aa-4efe-89a6-993d37730259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:52.694064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e870588-39aa-4efe-89a6-993d37730259 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:52.705226 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 722/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:55.200934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f6501-58c7-481b-ac0a-f68c510719cd None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:55.201559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f6501-58c7-481b-ac0a-f68c510719cd None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:55.201559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f6501-58c7-481b-ac0a-f68c510719cd None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:55.202889 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:51:55.212299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40028c48-8d4a-4a80-8b83-956ed81a82c0 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:55.213059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40028c48-8d4a-4a80-8b83-956ed81a82c0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:55.213276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40028c48-8d4a-4a80-8b83-956ed81a82c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:55.238291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-40028c48-8d4a-4a80-8b83-956ed81a82c0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:55.239540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-40028c48-8d4a-4a80-8b83-956ed81a82c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:55.248692 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:55.288975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f6501-58c7-481b-ac0a-f68c510719cd None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:55.301515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f6501-58c7-481b-ac0a-f68c510719cd None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:55.305675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16259d4b-f929-42d3-8774-97aac960a86d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:55.306415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16259d4b-f929-42d3-8774-97aac960a86d service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:55.306695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16259d4b-f929-42d3-8774-97aac960a86d service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:55.306980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16259d4b-f929-42d3-8774-97aac960a86d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:55.316744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16259d4b-f929-42d3-8774-97aac960a86d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:55.318181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16259d4b-f929-42d3-8774-97aac960a86d service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:55.327862 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 723/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:58.095166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebe91e-fdba-4169-a541-09e02cf1325d None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:58.095166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebe91e-fdba-4169-a541-09e02cf1325d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:58.095695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebe91e-fdba-4169-a541-09e02cf1325d None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:58.097005 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:51:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:51:58.102597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14dee7-044f-49ea-b1ee-1075e6d0f4ad None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:58.103136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14dee7-044f-49ea-b1ee-1075e6d0f4ad None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:58.103136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14dee7-044f-49ea-b1ee-1075e6d0f4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:58.123612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-de14dee7-044f-49ea-b1ee-1075e6d0f4ad None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:58.124871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-de14dee7-044f-49ea-b1ee-1075e6d0f4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:58.134226 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:58.177390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebe91e-fdba-4169-a541-09e02cf1325d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:58.190057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebe91e-fdba-4169-a541-09e02cf1325d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:58.194059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818feee7-2158-46b0-af4d-35421d8b0aa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:58.194705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818feee7-2158-46b0-af4d-35421d8b0aa8 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:58.194990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818feee7-2158-46b0-af4d-35421d8b0aa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:58.195266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818feee7-2158-46b0-af4d-35421d8b0aa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:58.205582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818feee7-2158-46b0-af4d-35421d8b0aa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:58.207041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818feee7-2158-46b0-af4d-35421d8b0aa8 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:58.217430 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 725/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:52:00.682826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104127b-919b-4dd7-9950-30bae65de65f None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:00.683787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104127b-919b-4dd7-9950-30bae65de65f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:00.683787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104127b-919b-4dd7-9950-30bae65de65f None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:00.685248 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:52:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:52:00.690755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5d464-3a39-4a55-87ba-bcdde835b66d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:00.691295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5d464-3a39-4a55-87ba-bcdde835b66d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:00.691295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5d464-3a39-4a55-87ba-bcdde835b66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:00.716697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1dd5d464-3a39-4a55-87ba-bcdde835b66d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:52:00.717928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1dd5d464-3a39-4a55-87ba-bcdde835b66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:52:00.727295 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:52:00.768388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104127b-919b-4dd7-9950-30bae65de65f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:52:00.770486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7104127b-919b-4dd7-9950-30bae65de65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:52:00.785230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104127b-919b-4dd7-9950-30bae65de65f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:52:00.789312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a30c18-cc5e-41fc-9d69-cd4e17c89d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:52:00.789976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a30c18-cc5e-41fc-9d69-cd4e17c89d6d service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:00.790261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a30c18-cc5e-41fc-9d69-cd4e17c89d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:00.790539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a30c18-cc5e-41fc-9d69-cd4e17c89d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:00.800802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a30c18-cc5e-41fc-9d69-cd4e17c89d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:52:00.802325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a30c18-cc5e-41fc-9d69-cd4e17c89d6d service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:52:00.812998 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 726/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:52:03.245619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d913ad-8738-4edb-bafc-f77f4ae525d3 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:03.246226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d913ad-8738-4edb-bafc-f77f4ae525d3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:03.246226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d913ad-8738-4edb-bafc-f77f4ae525d3 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:03.247732 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:52:03.254377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3f6a8-632d-4cc0-bcd3-c4e3bca9ac6b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:03.254844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3f6a8-632d-4cc0-bcd3-c4e3bca9ac6b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:03.254949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3f6a8-632d-4cc0-bcd3-c4e3bca9ac6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:03.280762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-53d3f6a8-632d-4cc0-bcd3-c4e3bca9ac6b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:52:03.281974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-53d3f6a8-632d-4cc0-bcd3-c4e3bca9ac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:52:03.291245 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:52:03.334232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d913ad-8738-4edb-bafc-f77f4ae525d3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:52:03.347179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d913ad-8738-4edb-bafc-f77f4ae525d3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:52:03.351026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55909bac-ccee-4465-9a7f-ab38655596e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:52:03.351657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55909bac-ccee-4465-9a7f-ab38655596e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:03.351935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55909bac-ccee-4465-9a7f-ab38655596e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:03.352250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55909bac-ccee-4465-9a7f-ab38655596e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:03.361598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55909bac-ccee-4465-9a7f-ab38655596e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:52:03.363025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55909bac-ccee-4465-9a7f-ab38655596e9 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:52:03.372617 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 728/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:52:05.792688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800fb53-d213-4c13-8cca-bd27036c615b None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:05.793358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800fb53-d213-4c13-8cca-bd27036c615b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:05.793358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800fb53-d213-4c13-8cca-bd27036c615b None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:05.794885 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:52:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:52:05.801900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1771-6449-42f3-973c-b7bbece3efaf None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:05.802365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1771-6449-42f3-973c-b7bbece3efaf None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:05.802469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1771-6449-42f3-973c-b7bbece3efaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:05.811769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=70 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:52:05.824938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8c1d1771-6449-42f3-973c-b7bbece3efaf None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:52:05.826159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8c1d1771-6449-42f3-973c-b7bbece3efaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:52:05.835443 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:52:05.876331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800fb53-d213-4c13-8cca-bd27036c615b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:52:05.882242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=64 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:52:05.888996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800fb53-d213-4c13-8cca-bd27036c615b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:52:05.892876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce3b18-46ed-40d9-a528-8ff5ece27205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:52:05.893528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce3b18-46ed-40d9-a528-8ff5ece27205 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:05.893802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce3b18-46ed-40d9-a528-8ff5ece27205 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:05.894078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce3b18-46ed-40d9-a528-8ff5ece27205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:05.903425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce3b18-46ed-40d9-a528-8ff5ece27205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:52:05.905269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce3b18-46ed-40d9-a528-8ff5ece27205 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:52:05.915439 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 729/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:52:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:52:08.279577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741105a-c3ec-47c7-b336-5d280c346b9e None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:08.280606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741105a-c3ec-47c7-b336-5d280c346b9e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:08.280606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741105a-c3ec-47c7-b336-5d280c346b9e None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:08.282800 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:52:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:52:08.289389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc075a2-5553-4a79-a726-d2fd5d5a7254 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:08.290164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc075a2-5553-4a79-a726-d2fd5d5a7254 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:08.290361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc075a2-5553-4a79-a726-d2fd5d5a7254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:08.310769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-cfc075a2-5553-4a79-a726-d2fd5d5a7254 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:52:08.312007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cfc075a2-5553-4a79-a726-d2fd5d5a7254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:52:08.321548 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:52:08.373126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741105a-c3ec-47c7-b336-5d280c346b9e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:52:08.385925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741105a-c3ec-47c7-b336-5d280c346b9e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:52:08.389689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca1acb-73d7-4405-8cff-8bcca279426e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:52:08.390324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca1acb-73d7-4405-8cff-8bcca279426e service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:08.390605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca1acb-73d7-4405-8cff-8bcca279426e service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:08.390879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca1acb-73d7-4405-8cff-8bcca279426e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:08.400001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca1acb-73d7-4405-8cff-8bcca279426e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:52:08.401513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca1acb-73d7-4405-8cff-8bcca279426e service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:52:08.411196 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 731/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:52:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:52:10.783352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a37e2-ff73-4950-bbf3-761e08cd7e25 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:10.784329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a37e2-ff73-4950-bbf3-761e08cd7e25 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:10.784329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a37e2-ff73-4950-bbf3-761e08cd7e25 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:10.786511 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:52:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:52:10.795802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e46a4d-f7f8-4c68-9e8b-897a6fa3ea14 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:10.796259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e46a4d-f7f8-4c68-9e8b-897a6fa3ea14 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:10.796469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e46a4d-f7f8-4c68-9e8b-897a6fa3ea14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:10.822151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-84e46a4d-f7f8-4c68-9e8b-897a6fa3ea14 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:52:10.823404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-84e46a4d-f7f8-4c68-9e8b-897a6fa3ea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:52:10.832296 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:52:10.874787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a37e2-ff73-4950-bbf3-761e08cd7e25 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:52:10.887321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a37e2-ff73-4950-bbf3-761e08cd7e25 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:52:10.891719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb4c58-6c42-4163-b100-3da92f9a922c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:52:10.892395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb4c58-6c42-4163-b100-3da92f9a922c service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:10.892684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb4c58-6c42-4163-b100-3da92f9a922c service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:10.892964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb4c58-6c42-4163-b100-3da92f9a922c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:10.903261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb4c58-6c42-4163-b100-3da92f9a922c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:52:10.904747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb4c58-6c42-4163-b100-3da92f9a922c service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:52:10.914638 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 732/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:52:13.237266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc8279-d212-4821-9d57-32321457b394 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:13.237868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc8279-d212-4821-9d57-32321457b394 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:13.237868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc8279-d212-4821-9d57-32321457b394 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:13.239192 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:52:13.245658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d34e0-64e7-4b96-bc68-b903627de869 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:13.246087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d34e0-64e7-4b96-bc68-b903627de869 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:13.246236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d34e0-64e7-4b96-bc68-b903627de869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:13.270808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6d7d34e0-64e7-4b96-bc68-b903627de869 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:52:13.272022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6d7d34e0-64e7-4b96-bc68-b903627de869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:52:13.281607 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:52:13.319315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc8279-d212-4821-9d57-32321457b394 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:52:13.331897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc8279-d212-4821-9d57-32321457b394 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:52:13.335730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf24bda-a43e-4027-a5f7-e93c4f1f2417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:52:13.336415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf24bda-a43e-4027-a5f7-e93c4f1f2417 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:13.336699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf24bda-a43e-4027-a5f7-e93c4f1f2417 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:13.336977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf24bda-a43e-4027-a5f7-e93c4f1f2417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:13.347508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf24bda-a43e-4027-a5f7-e93c4f1f2417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:52:13.348966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf24bda-a43e-4027-a5f7-e93c4f1f2417 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:52:13.359053 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 734/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:52:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:52:15.722121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831ed42-8882-4889-bd37-75bb1fe4276d None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:15.722993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831ed42-8882-4889-bd37-75bb1fe4276d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:15.722993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831ed42-8882-4889-bd37-75bb1fe4276d None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:15.725174 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:52:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:52:15.733226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a8e67-24b6-4545-bc7e-c7f01b03dcb2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:15.733682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a8e67-24b6-4545-bc7e-c7f01b03dcb2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:15.733791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a8e67-24b6-4545-bc7e-c7f01b03dcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:15.752954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d52a8e67-24b6-4545-bc7e-c7f01b03dcb2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:52:15.754195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d52a8e67-24b6-4545-bc7e-c7f01b03dcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:52:15.763915 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 20:52:15.803766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831ed42-8882-4889-bd37-75bb1fe4276d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:52:15.816087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831ed42-8882-4889-bd37-75bb1fe4276d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:52:15.819904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb02e05-8810-4a65-afa3-9615aeba13a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:52:15.820564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb02e05-8810-4a65-afa3-9615aeba13a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:15.820841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb02e05-8810-4a65-afa3-9615aeba13a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:15.821116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb02e05-8810-4a65-afa3-9615aeba13a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:15.830193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb02e05-8810-4a65-afa3-9615aeba13a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:52:15.831635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb02e05-8810-4a65-afa3-9615aeba13a5 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:52:15.841245 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 735/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:52:25.746771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=20 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:52:25.836949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=23 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:52:52.691970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9398d-174c-4c86-a003-80d4751ba94f None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:52.692671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9398d-174c-4c86-a003-80d4751ba94f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:52.692671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9398d-174c-4c86-a003-80d4751ba94f None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:52.694592 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 736/1471] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:52:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:52:52.701860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c3f40-fc40-4a17-b3a8-86be18750980 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:52.702320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c3f40-fc40-4a17-b3a8-86be18750980 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:52.702450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c3f40-fc40-4a17-b3a8-86be18750980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:52.721064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fb2c3f40-fc40-4a17-b3a8-86be18750980 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:52:52.722274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fb2c3f40-fc40-4a17-b3a8-86be18750980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:52:52.731036 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 736/1472] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:52:52.782881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb36f5c-27d7-4e51-906c-c4601cfd2940 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:52.783183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb36f5c-27d7-4e51-906c-c4601cfd2940 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:52.783444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb36f5c-27d7-4e51-906c-c4601cfd2940 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:52.784942 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 737/1473] 10.222.0.43 () {54 vars in 962 bytes} [Sat Jul 2 20:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:52:52.790131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a882c51-0815-443b-9194-ecf056dd10a4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:52.790422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a882c51-0815-443b-9194-ecf056dd10a4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:52.790700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a882c51-0815-443b-9194-ecf056dd10a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:52.812715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2a882c51-0815-443b-9194-ecf056dd10a4 None None] MFA Rules not processed for user `3de168a603b0478fa8de67f6d206e1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:52:52.814062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2a882c51-0815-443b-9194-ecf056dd10a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:52:52.821872 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 737/1474] 10.222.0.43 () {58 vars in 1059 bytes} [Sat Jul 2 20:52:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:52:52.829791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb36f5c-27d7-4e51-906c-c4601cfd2940 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:52:52.841038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb36f5c-27d7-4e51-906c-c4601cfd2940 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:52:52.845287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6259c-6f79-4ffe-8bf6-4a6cc8bbf56a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:52:52.845973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6259c-6f79-4ffe-8bf6-4a6cc8bbf56a service glance] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:52.846259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6259c-6f79-4ffe-8bf6-4a6cc8bbf56a service glance] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:52.846536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6259c-6f79-4ffe-8bf6-4a6cc8bbf56a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:52.856379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6259c-6f79-4ffe-8bf6-4a6cc8bbf56a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:52:52.857864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6259c-6f79-4ffe-8bf6-4a6cc8bbf56a service glance] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:52:52.867555 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 738/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 20:52:55.278687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ceee5-488a-471d-83a4-674986bcfe8e None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:55.279556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ceee5-488a-471d-83a4-674986bcfe8e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:55.279556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ceee5-488a-471d-83a4-674986bcfe8e None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:55.281840 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 738/1476] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:52:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:52:55.287291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8a520-e743-4539-a7f3-b387b317b8df None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:55.287748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8a520-e743-4539-a7f3-b387b317b8df None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:55.287854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8a520-e743-4539-a7f3-b387b317b8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:55.307087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-63a8a520-e743-4539-a7f3-b387b317b8df None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:52:55.308388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-63a8a520-e743-4539-a7f3-b387b317b8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:52:55.316812 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 739/1477] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:52:55.343219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ceee5-488a-471d-83a4-674986bcfe8e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:52:55.362035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ceee5-488a-471d-83a4-674986bcfe8e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:52:55.367772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3818f-8bb9-4127-b2c3-eb511ddde8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:52:55.368479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3818f-8bb9-4127-b2c3-eb511ddde8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:55.368760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3818f-8bb9-4127-b2c3-eb511ddde8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:55.369034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3818f-8bb9-4127-b2c3-eb511ddde8f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:55.369778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3818f-8bb9-4127-b2c3-eb511ddde8f8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:52:55.371623 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-28d3818f-8bb9-4127-b2c3-eb511ddde8f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:52:55.371623 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 20:52:55.371623 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 20:52:55.372838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3818f-8bb9-4127-b2c3-eb511ddde8f8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:52:55.393510 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 739/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Jul 2 20:52:55 2022] GET /identity/v3/projects => generated 2553 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:52:57.818678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3996a1-5c04-443d-acee-9d6e5bdeff39 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:57.819621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3996a1-5c04-443d-acee-9d6e5bdeff39 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:57.819621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3996a1-5c04-443d-acee-9d6e5bdeff39 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:57.821767 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 740/1479] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:52:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:52:57.830030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2786a-ba3c-4df0-8a4a-bc82ebbe9eb3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:57.830488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2786a-ba3c-4df0-8a4a-bc82ebbe9eb3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:57.830593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2786a-ba3c-4df0-8a4a-bc82ebbe9eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:57.850049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f1d2786a-ba3c-4df0-8a4a-bc82ebbe9eb3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:52:57.851264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f1d2786a-ba3c-4df0-8a4a-bc82ebbe9eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:52:57.860106 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 740/1480] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 20:52:57.905840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3996a1-5c04-443d-acee-9d6e5bdeff39 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:52:57.921895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3996a1-5c04-443d-acee-9d6e5bdeff39 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:52:57.928076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f2c30-7d9a-4bae-a22e-da15ec2d2a35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:52:57.928729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f2c30-7d9a-4bae-a22e-da15ec2d2a35 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:57.929013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f2c30-7d9a-4bae-a22e-da15ec2d2a35 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:57.929279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f2c30-7d9a-4bae-a22e-da15ec2d2a35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:57.937633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f2c30-7d9a-4bae-a22e-da15ec2d2a35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:52:57.939222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f2c30-7d9a-4bae-a22e-da15ec2d2a35 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:52:57.948571 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 741/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:53:00.496740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936992b-7132-4766-bad3-df9ef32a0cda None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:53:00.497800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936992b-7132-4766-bad3-df9ef32a0cda None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:53:00.497800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936992b-7132-4766-bad3-df9ef32a0cda None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:53:00.500116 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 741/1482] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:53:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:53:00.509545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7716622-018e-4b3a-8860-8e02e6c86d83 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:53:00.510023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7716622-018e-4b3a-8860-8e02e6c86d83 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:53:00.510258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7716622-018e-4b3a-8860-8e02e6c86d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:53:00.531916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d7716622-018e-4b3a-8860-8e02e6c86d83 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:53:00.533347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d7716622-018e-4b3a-8860-8e02e6c86d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:53:00.543817 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 742/1483] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 20:53:00.587085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936992b-7132-4766-bad3-df9ef32a0cda None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:53:00.602454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936992b-7132-4766-bad3-df9ef32a0cda None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:53:00.607209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935421b-eb74-40f4-a676-a835aad9aae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:53:00.607945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935421b-eb74-40f4-a676-a835aad9aae0 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:53:00.608270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935421b-eb74-40f4-a676-a835aad9aae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:53:00.608595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935421b-eb74-40f4-a676-a835aad9aae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:53:00.618658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935421b-eb74-40f4-a676-a835aad9aae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:53:00.620294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935421b-eb74-40f4-a676-a835aad9aae0 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:53:00.631925 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 742/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:53:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:53:03.006302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c0113-d724-4af0-a109-3badbd403966 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:53:03.006856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c0113-d724-4af0-a109-3badbd403966 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:53:03.006856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c0113-d724-4af0-a109-3badbd403966 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:53:03.008940 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 743/1485] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:53:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:53:03.018543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdb4e7-f71f-40d8-8b62-f389a1214b3f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:53:03.018974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdb4e7-f71f-40d8-8b62-f389a1214b3f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:53:03.019116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdb4e7-f71f-40d8-8b62-f389a1214b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:53:03.041262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-40fdb4e7-f71f-40d8-8b62-f389a1214b3f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:53:03.042481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-40fdb4e7-f71f-40d8-8b62-f389a1214b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:53:03.051831 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 743/1486] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:53:03.094165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c0113-d724-4af0-a109-3badbd403966 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:53:03.107570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c0113-d724-4af0-a109-3badbd403966 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:53:03.111637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5864d10-8de9-4d78-9137-41557845657a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:53:03.112327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5864d10-8de9-4d78-9137-41557845657a service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:53:03.112595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5864d10-8de9-4d78-9137-41557845657a service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:53:03.112880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5864d10-8de9-4d78-9137-41557845657a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:53:03.122960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5864d10-8de9-4d78-9137-41557845657a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:53:03.125270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5864d10-8de9-4d78-9137-41557845657a service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:53:03.139836 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 744/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:53:05.562096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea8154-19d9-4d66-b1ac-5a5ea2f81609 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:53:05.563105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea8154-19d9-4d66-b1ac-5a5ea2f81609 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:53:05.563105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea8154-19d9-4d66-b1ac-5a5ea2f81609 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:53:05.565453 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 744/1488] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:53:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:53:05.571877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e2285-2b67-4e54-b2d3-d10fdec19915 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:53:05.572391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e2285-2b67-4e54-b2d3-d10fdec19915 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:53:05.572512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e2285-2b67-4e54-b2d3-d10fdec19915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:53:05.592229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9d8e2285-2b67-4e54-b2d3-d10fdec19915 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:53:05.593506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9d8e2285-2b67-4e54-b2d3-d10fdec19915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:53:05.602172 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 745/1489] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:53:05.653182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea8154-19d9-4d66-b1ac-5a5ea2f81609 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:53:05.665745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea8154-19d9-4d66-b1ac-5a5ea2f81609 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:53:05.669750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb394d2-e6d6-4969-bf32-286886afcbbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:53:05.670387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb394d2-e6d6-4969-bf32-286886afcbbd service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:53:05.670668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb394d2-e6d6-4969-bf32-286886afcbbd service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:53:05.670949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb394d2-e6d6-4969-bf32-286886afcbbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:53:05.682090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb394d2-e6d6-4969-bf32-286886afcbbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:53:05.683659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb394d2-e6d6-4969-bf32-286886afcbbd service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:53:05.694242 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 745/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:53:08.260214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b753204-aab4-492e-8f6f-6b626ef014c5 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:53:08.261300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b753204-aab4-492e-8f6f-6b626ef014c5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:53:08.261300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b753204-aab4-492e-8f6f-6b626ef014c5 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:53:08.263252 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 746/1491] 10.222.0.43 () {54 vars in 926 bytes} [Sat Jul 2 20:53:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:53:08.271166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d24006-706a-4cc3-b679-5268a1bad40d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:53:08.271646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d24006-706a-4cc3-b679-5268a1bad40d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:53:08.271751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d24006-706a-4cc3-b679-5268a1bad40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:53:08.291745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-71d24006-706a-4cc3-b679-5268a1bad40d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:53:08.293014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-71d24006-706a-4cc3-b679-5268a1bad40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:53:08.302806 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 746/1492] 10.222.0.43 () {58 vars in 1023 bytes} [Sat Jul 2 20:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:53:08.345121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b753204-aab4-492e-8f6f-6b626ef014c5 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:53:08.358632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b753204-aab4-492e-8f6f-6b626ef014c5 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:53:08.363614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b05f4-4c0c-4fb1-8ff7-0b700c5fc65b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:53:08.364313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b05f4-4c0c-4fb1-8ff7-0b700c5fc65b service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:53:08.364598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b05f4-4c0c-4fb1-8ff7-0b700c5fc65b service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:53:08.364876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b05f4-4c0c-4fb1-8ff7-0b700c5fc65b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:53:08.375048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b05f4-4c0c-4fb1-8ff7-0b700c5fc65b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:53:08.376747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b05f4-4c0c-4fb1-8ff7-0b700c5fc65b service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:53:08.386719 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 747/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:53:18.286411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=33 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:53:18.382438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=33 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:55:06.354187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fc380-fcef-4cd0-9356-efebad60701b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:06.355073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fc380-fcef-4cd0-9356-efebad60701b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:06.355073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fc380-fcef-4cd0-9356-efebad60701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:06.377409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-887fc380-fcef-4cd0-9356-efebad60701b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:55:06.378634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-887fc380-fcef-4cd0-9356-efebad60701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:55:06.388388 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 747/1494] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 20:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:55:06.397239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24924d6d-5a0b-48d8-85e6-9f4a7b87a757 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:06.398056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24924d6d-5a0b-48d8-85e6-9f4a7b87a757 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:06.398322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24924d6d-5a0b-48d8-85e6-9f4a7b87a757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:06.422709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-24924d6d-5a0b-48d8-85e6-9f4a7b87a757 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:55:06.424064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-24924d6d-5a0b-48d8-85e6-9f4a7b87a757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:55:06.434252 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 748/1495] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 20:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:55:06.441372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fc380-fcef-4cd0-9356-efebad60701b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:55:06.456976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fc380-fcef-4cd0-9356-efebad60701b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:55:06.464173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25abd0-4565-40dc-8c73-d858a6f08ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:55:06.464938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25abd0-4565-40dc-8c73-d858a6f08ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:06.465256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25abd0-4565-40dc-8c73-d858a6f08ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:06.465565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25abd0-4565-40dc-8c73-d858a6f08ff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:06.466315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25abd0-4565-40dc-8c73-d858a6f08ff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:55:06.466620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25abd0-4565-40dc-8c73-d858a6f08ff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:55:06.467684 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-3f25abd0-4565-40dc-8c73-d858a6f08ff1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:55:06.467684 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 20:55:06.467684 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 20:55:06.468589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25abd0-4565-40dc-8c73-d858a6f08ff1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:55:06.480905 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 748/1496] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 20:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:55:06.489218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24924d6d-5a0b-48d8-85e6-9f4a7b87a757 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:55:06.498700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24924d6d-5a0b-48d8-85e6-9f4a7b87a757 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:55:06.503961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1073f5-3065-4c1b-9b8f-821554900df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:55:06.504638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1073f5-3065-4c1b-9b8f-821554900df6 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:06.504915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1073f5-3065-4c1b-9b8f-821554900df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:06.505200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1073f5-3065-4c1b-9b8f-821554900df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:06.505887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1073f5-3065-4c1b-9b8f-821554900df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:55:06.507609 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-fd1073f5-3065-4c1b-9b8f-821554900df6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:55:06.507609 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 20:55:06.507609 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 20:55:06.508826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1073f5-3065-4c1b-9b8f-821554900df6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:55:06.550497 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 749/1497] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 20:55:06 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:55:06.554863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25abd0-4565-40dc-8c73-d858a6f08ff1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:55:06.565417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25abd0-4565-40dc-8c73-d858a6f08ff1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:55:06.624896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3f5fd-55c7-464f-bf82-7333d72c85db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:55:06.625496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3f5fd-55c7-464f-bf82-7333d72c85db admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:06.625777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3f5fd-55c7-464f-bf82-7333d72c85db admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:06.626112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3f5fd-55c7-464f-bf82-7333d72c85db admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:06.626807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3f5fd-55c7-464f-bf82-7333d72c85db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:55:06.627838 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-0cb3f5fd-55c7-464f-bf82-7333d72c85db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:55:06.627838 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 20:55:06.627838 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 20:55:06.629080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3f5fd-55c7-464f-bf82-7333d72c85db admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:55:06.650802 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 749/1498] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 20:55:06 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:55:06.655142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1073f5-3065-4c1b-9b8f-821554900df6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:55:06.665980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1073f5-3065-4c1b-9b8f-821554900df6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:55:06.672072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48295182-c70c-41cf-b294-2ebce0447390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:55:06.672737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48295182-c70c-41cf-b294-2ebce0447390 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:06.673038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48295182-c70c-41cf-b294-2ebce0447390 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:06.673310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48295182-c70c-41cf-b294-2ebce0447390 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:06.674061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48295182-c70c-41cf-b294-2ebce0447390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:55:06.675082 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-48295182-c70c-41cf-b294-2ebce0447390 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:55:06.675082 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 20:55:06.675082 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 20:55:06.675967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48295182-c70c-41cf-b294-2ebce0447390 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:55:06.689604 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 750/1499] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 20:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:55:06.693862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3f5fd-55c7-464f-bf82-7333d72c85db admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:55:06.704358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3f5fd-55c7-464f-bf82-7333d72c85db admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:55:06.709735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751ac2a-2e96-49f8-843c-d3fd9a64ec79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:55:06.710384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751ac2a-2e96-49f8-843c-d3fd9a64ec79 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:06.710674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751ac2a-2e96-49f8-843c-d3fd9a64ec79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:06.710942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751ac2a-2e96-49f8-843c-d3fd9a64ec79 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:06.711657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751ac2a-2e96-49f8-843c-d3fd9a64ec79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:55:06.712708 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-9751ac2a-2e96-49f8-843c-d3fd9a64ec79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:55:06.712708 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 20:55:06.712708 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 20:55:06.713596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751ac2a-2e96-49f8-843c-d3fd9a64ec79 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:55:06.727286 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 750/1500] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 20:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:55:06.731750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48295182-c70c-41cf-b294-2ebce0447390 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:55:06.742163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48295182-c70c-41cf-b294-2ebce0447390 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:55:06.747273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de70a77-1155-459c-867e-7e52d9c35661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:55:06.748224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de70a77-1155-459c-867e-7e52d9c35661 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:06.748532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de70a77-1155-459c-867e-7e52d9c35661 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:06.748810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de70a77-1155-459c-867e-7e52d9c35661 admin admin] PATH_INFO: `/v3/projects/0cce4907063b4041846353a1de6a1055/users/687d303f01bd446aa7b65698e138dc62/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:06.765052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de70a77-1155-459c-867e-7e52d9c35661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cce4907063b4041846353a1de6a1055, user_id=687d303f01bd446aa7b65698e138dc62, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:55:06.766704 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-7de70a77-1155-459c-867e-7e52d9c35661 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:55:06.766704 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 20:55:06.766704 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 20:55:06.768881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de70a77-1155-459c-867e-7e52d9c35661 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:55:06.786560 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 751/1501] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 20:55:06 2022] PUT /identity/v3/projects/0cce4907063b4041846353a1de6a1055/users/687d303f01bd446aa7b65698e138dc62/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:55:06.799235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742a405-2c32-4cd4-b8bf-50cf1519569f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:06.799521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742a405-2c32-4cd4-b8bf-50cf1519569f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:06.799793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742a405-2c32-4cd4-b8bf-50cf1519569f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:06.829241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6742a405-2c32-4cd4-b8bf-50cf1519569f None None] MFA Rules not processed for user `687d303f01bd446aa7b65698e138dc62`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:55:06.830528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6742a405-2c32-4cd4-b8bf-50cf1519569f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:55:06.894690 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 751/1502] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 20:55:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:55:06.914587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c7fd9-1507-4cc9-880c-0c50b64e359c None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:06.914967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c7fd9-1507-4cc9-880c-0c50b64e359c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:06.915310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c7fd9-1507-4cc9-880c-0c50b64e359c None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:06.917259 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 752/1503] 10.222.0.43 () {54 vars in 963 bytes} [Sat Jul 2 20:55:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:55:06.924363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce75253-1561-48fb-a4b0-864de68e9c88 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:06.924825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce75253-1561-48fb-a4b0-864de68e9c88 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:06.925101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce75253-1561-48fb-a4b0-864de68e9c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:06.942852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fce75253-1561-48fb-a4b0-864de68e9c88 None None] MFA Rules not processed for user `f9ea416fd4d4420b9112507ef1a68bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:55:06.944133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fce75253-1561-48fb-a4b0-864de68e9c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:55:06.987656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:55:06.997233 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 752/1504] 10.222.0.43 () {58 vars in 1060 bytes} [Sat Jul 2 20:55:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 20:55:07.007049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c7fd9-1507-4cc9-880c-0c50b64e359c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:55:07.018676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c7fd9-1507-4cc9-880c-0c50b64e359c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:55:07.022314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56299b0c-b4c9-4d47-9009-5ca0d674ea04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:55:07.022972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56299b0c-b4c9-4d47-9009-5ca0d674ea04 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:07.023255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56299b0c-b4c9-4d47-9009-5ca0d674ea04 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:07.023529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56299b0c-b4c9-4d47-9009-5ca0d674ea04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:07.031828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56299b0c-b4c9-4d47-9009-5ca0d674ea04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:55:07.033298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56299b0c-b4c9-4d47-9009-5ca0d674ea04 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:55:07.042141 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 753/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:55:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:55:07.088053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6ec51-0cd5-4308-aa79-cb4b61553569 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:07.088358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6ec51-0cd5-4308-aa79-cb4b61553569 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:07.088638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6ec51-0cd5-4308-aa79-cb4b61553569 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:07.089959 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 753/1506] 10.222.0.43 () {52 vars in 829 bytes} [Sat Jul 2 20:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:55:07.093849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56299b0c-b4c9-4d47-9009-5ca0d674ea04 service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:55:07.162141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56299b0c-b4c9-4d47-9009-5ca0d674ea04 service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:55:07.168299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cedac0-7ea3-474f-a386-acafbc0c5c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:55:07.169565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cedac0-7ea3-474f-a386-acafbc0c5c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:07.169828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cedac0-7ea3-474f-a386-acafbc0c5c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:07.170095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cedac0-7ea3-474f-a386-acafbc0c5c5b admin admin] PATH_INFO: `/v3/users/687d303f01bd446aa7b65698e138dc62` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:07.171362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cedac0-7ea3-474f-a386-acafbc0c5c5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=687d303f01bd446aa7b65698e138dc62)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:55:07.172426 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-95cedac0-7ea3-474f-a386-acafbc0c5c5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:55:07.172426 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 20:55:07.172426 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 20:55:07.173689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cedac0-7ea3-474f-a386-acafbc0c5c5b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:55:07.240569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-95cedac0-7ea3-474f-a386-acafbc0c5c5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687d303f01bd446aa7b65698e138dc62'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:55:07.250604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-95cedac0-7ea3-474f-a386-acafbc0c5c5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687d303f01bd446aa7b65698e138dc62'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:55:07.262798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-95cedac0-7ea3-474f-a386-acafbc0c5c5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687d303f01bd446aa7b65698e138dc62'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:55:07.263522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-95cedac0-7ea3-474f-a386-acafbc0c5c5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687d303f01bd446aa7b65698e138dc62'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:55:07.264232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-95cedac0-7ea3-474f-a386-acafbc0c5c5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687d303f01bd446aa7b65698e138dc62'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:55:07.280152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:55:07.289582 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 754/1507] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 20:55:07 2022] DELETE /identity/v3/users/687d303f01bd446aa7b65698e138dc62 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:55:07.295283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6214bbc-d176-46c0-9038-2e93df667954 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:07.295659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6214bbc-d176-46c0-9038-2e93df667954 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:07.296106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6214bbc-d176-46c0-9038-2e93df667954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:07.321203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a6214bbc-d176-46c0-9038-2e93df667954 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:55:07.322415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a6214bbc-d176-46c0-9038-2e93df667954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:55:07.382996 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 754/1508] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 20:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:55:07.392778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cedac0-7ea3-474f-a386-acafbc0c5c5b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:55:07.394464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-95cedac0-7ea3-474f-a386-acafbc0c5c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:55:07.453938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cedac0-7ea3-474f-a386-acafbc0c5c5b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:55:07.458069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a10414-f505-46bb-b27a-7b0a43cf5038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:55:07.458729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a10414-f505-46bb-b27a-7b0a43cf5038 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:07.459010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a10414-f505-46bb-b27a-7b0a43cf5038 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:07.459293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a10414-f505-46bb-b27a-7b0a43cf5038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:07.469016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a10414-f505-46bb-b27a-7b0a43cf5038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:55:07.470593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a10414-f505-46bb-b27a-7b0a43cf5038 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:55:07.480187 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 755/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:55:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:55:07.877191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6214bbc-d176-46c0-9038-2e93df667954 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:55:07.878668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a6214bbc-d176-46c0-9038-2e93df667954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:55:07.890797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6214bbc-d176-46c0-9038-2e93df667954 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:55:07.896410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3c812-35b2-43de-8b30-8b3e43586c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:55:07.897246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3c812-35b2-43de-8b30-8b3e43586c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:07.897552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3c812-35b2-43de-8b30-8b3e43586c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:07.897827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3c812-35b2-43de-8b30-8b3e43586c3d admin admin] PATH_INFO: `/v3/projects/0cce4907063b4041846353a1de6a1055` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:07.898965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3c812-35b2-43de-8b30-8b3e43586c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cce4907063b4041846353a1de6a1055)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:55:07.900935 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-fdb3c812-35b2-43de-8b30-8b3e43586c3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:55:07.900935 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 20:55:07.900935 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 20:55:07.902546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3c812-35b2-43de-8b30-8b3e43586c3d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:55:07.967481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fdb3c812-35b2-43de-8b30-8b3e43586c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cce4907063b4041846353a1de6a1055', 'request_id': 'req-fdb3c812-35b2-43de-8b30-8b3e43586c3d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:55:07.978363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fdb3c812-35b2-43de-8b30-8b3e43586c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cce4907063b4041846353a1de6a1055', 'request_id': 'req-fdb3c812-35b2-43de-8b30-8b3e43586c3d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:55:07.991683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fdb3c812-35b2-43de-8b30-8b3e43586c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cce4907063b4041846353a1de6a1055', 'request_id': 'req-fdb3c812-35b2-43de-8b30-8b3e43586c3d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:55:08.002797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fdb3c812-35b2-43de-8b30-8b3e43586c3d admin admin] The token cache is being invalidate because project 0cce4907063b4041846353a1de6a1055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 20:55:08.003078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fdb3c812-35b2-43de-8b30-8b3e43586c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:55:08.003867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fdb3c812-35b2-43de-8b30-8b3e43586c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:55:08.005581 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 755/1510] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 20:55:07 2022] DELETE /identity/v3/projects/0cce4907063b4041846353a1de6a1055 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:55:17.475932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:55:17.999593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:58:31.815208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3737b8-85df-41ee-aa62-80ee0cceee63 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:31.816274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3737b8-85df-41ee-aa62-80ee0cceee63 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:31.816274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3737b8-85df-41ee-aa62-80ee0cceee63 None None] PATH_INFO: `/v3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:31.817832 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 756/1511] 10.222.0.58 () {54 vars in 925 bytes} [Sat Jul 2 20:58:31 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:58:31.830617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1f20c-ce4f-4cf4-b248-becb55b7ba63 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:31.831269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1f20c-ce4f-4cf4-b248-becb55b7ba63 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:31.831422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1f20c-ce4f-4cf4-b248-becb55b7ba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:31.853411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-10a1f20c-ce4f-4cf4-b248-becb55b7ba63 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:58:31.854649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-10a1f20c-ce4f-4cf4-b248-becb55b7ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:58:31.923309 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 756/1512] 10.222.0.58 () {58 vars in 1015 bytes} [Sat Jul 2 20:58:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:58:36.480270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e8729-35db-411d-a155-0c80688c480b None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:36.480873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e8729-35db-411d-a155-0c80688c480b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:36.480873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e8729-35db-411d-a155-0c80688c480b None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:36.482186 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 757/1513] 10.222.0.43 () {54 vars in 960 bytes} [Sat Jul 2 20:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:58:36.488700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a20667-b5d5-4927-9bb2-7acb078d9e24 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:36.489160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a20667-b5d5-4927-9bb2-7acb078d9e24 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:36.489348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a20667-b5d5-4927-9bb2-7acb078d9e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:36.518826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-24a20667-b5d5-4927-9bb2-7acb078d9e24 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:58:36.520275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-24a20667-b5d5-4927-9bb2-7acb078d9e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:58:36.531520 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 757/1514] 10.222.0.43 () {58 vars in 1057 bytes} [Sat Jul 2 20:58:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:58:36.539842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e8729-35db-411d-a155-0c80688c480b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:58:36.559341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e8729-35db-411d-a155-0c80688c480b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:58:36.566641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134e248-6d71-4da9-908c-3a5d49760abb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:58:36.567283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134e248-6d71-4da9-908c-3a5d49760abb service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:36.567558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134e248-6d71-4da9-908c-3a5d49760abb service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:36.567830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134e248-6d71-4da9-908c-3a5d49760abb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:36.579156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134e248-6d71-4da9-908c-3a5d49760abb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:58:36.580810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134e248-6d71-4da9-908c-3a5d49760abb service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:58:36.593207 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 758/1515] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:58:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:58:46.512862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=32 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:58:46.588278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:58:46.928488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205df6b5-8b86-48ae-b0e4-f531268078bd None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:46.928969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205df6b5-8b86-48ae-b0e4-f531268078bd None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:46.929416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205df6b5-8b86-48ae-b0e4-f531268078bd None None] PATH_INFO: `/v3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:46.931552 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 758/1516] 10.222.0.59 () {54 vars in 925 bytes} [Sat Jul 2 20:58:46 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:58:46.940842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c40e1-0211-4c8a-b29b-b0ab3a332b81 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:46.941322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c40e1-0211-4c8a-b29b-b0ab3a332b81 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:46.941786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c40e1-0211-4c8a-b29b-b0ab3a332b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:46.965914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-218c40e1-0211-4c8a-b29b-b0ab3a332b81 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:58:46.967142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-218c40e1-0211-4c8a-b29b-b0ab3a332b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:58:46.977290 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 759/1517] 10.222.0.59 () {58 vars in 1015 bytes} [Sat Jul 2 20:58:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:58:55.721868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205df6b5-8b86-48ae-b0e4-f531268078bd None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:58:55.739711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205df6b5-8b86-48ae-b0e4-f531268078bd None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:58:55.748127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81586cbf-eefe-406f-b3ea-36f92147dfeb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:58:55.748772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586cbf-eefe-406f-b3ea-36f92147dfeb service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:55.749069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586cbf-eefe-406f-b3ea-36f92147dfeb service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:55.749343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586cbf-eefe-406f-b3ea-36f92147dfeb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:55.758542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81586cbf-eefe-406f-b3ea-36f92147dfeb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:58:55.760746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81586cbf-eefe-406f-b3ea-36f92147dfeb service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:58:55.770696 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 759/1518] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:58:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:58:56.960573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:59:05.766527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:59:06.502337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b62568-fddf-4834-a165-0f5775427347 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:59:06.502964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b62568-fddf-4834-a165-0f5775427347 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:59:06.502964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b62568-fddf-4834-a165-0f5775427347 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:59:06.504349 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 760/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:59:06.512280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b0133-fb42-4272-9c24-6179d71be91f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:59:06.512709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b0133-fb42-4272-9c24-6179d71be91f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:59:06.513196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b0133-fb42-4272-9c24-6179d71be91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:59:06.539897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-664b0133-fb42-4272-9c24-6179d71be91f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:59:06.541148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-664b0133-fb42-4272-9c24-6179d71be91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:59:06.609770 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 760/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:59:06.774384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b62568-fddf-4834-a165-0f5775427347 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:59:06.776277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d6b62568-fddf-4834-a165-0f5775427347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:59:06.856560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b62568-fddf-4834-a165-0f5775427347 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:59:06.863076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eff6ea-69eb-4b60-a9d0-816048f23782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:59:06.863734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eff6ea-69eb-4b60-a9d0-816048f23782 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:59:06.864157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eff6ea-69eb-4b60-a9d0-816048f23782 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:59:06.864442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eff6ea-69eb-4b60-a9d0-816048f23782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:59:06.872969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eff6ea-69eb-4b60-a9d0-816048f23782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:59:06.874592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eff6ea-69eb-4b60-a9d0-816048f23782 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:59:06.884031 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 761/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:59:07.730751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919e6b1-a97a-4f1f-a4bc-12d93f458ac3 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:59:07.731760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919e6b1-a97a-4f1f-a4bc-12d93f458ac3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:59:07.731760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919e6b1-a97a-4f1f-a4bc-12d93f458ac3 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:59:07.733898 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:59:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:59:07.740100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ff8a8-ea5f-4471-85d4-c8546705e235 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:59:07.740909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ff8a8-ea5f-4471-85d4-c8546705e235 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:59:07.741073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ff8a8-ea5f-4471-85d4-c8546705e235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:59:07.765895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ac6ff8a8-ea5f-4471-85d4-c8546705e235 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:59:07.767153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ac6ff8a8-ea5f-4471-85d4-c8546705e235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:59:07.776819 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:59:07.943512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919e6b1-a97a-4f1f-a4bc-12d93f458ac3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:59:07.962156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919e6b1-a97a-4f1f-a4bc-12d93f458ac3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:59:07.969829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcf308-4336-454f-9073-45b9e31b2efc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:59:07.970782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcf308-4336-454f-9073-45b9e31b2efc service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:59:07.971111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcf308-4336-454f-9073-45b9e31b2efc service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:59:07.971543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcf308-4336-454f-9073-45b9e31b2efc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:59:07.981191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcf308-4336-454f-9073-45b9e31b2efc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:59:07.982739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcf308-4336-454f-9073-45b9e31b2efc service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:59:07.992518 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 762/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:59:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:59:12.022246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae83084-d841-4e3c-a287-b4b15dbb60d4 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:59:12.023275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae83084-d841-4e3c-a287-b4b15dbb60d4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:59:12.023275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae83084-d841-4e3c-a287-b4b15dbb60d4 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:59:12.025275 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:59:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:59:12.031562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b253e-2ec2-417a-9be9-bcdf2a03ad3f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:59:12.032384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b253e-2ec2-417a-9be9-bcdf2a03ad3f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:59:12.032559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b253e-2ec2-417a-9be9-bcdf2a03ad3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:59:12.059551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-073b253e-2ec2-417a-9be9-bcdf2a03ad3f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:59:12.060801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-073b253e-2ec2-417a-9be9-bcdf2a03ad3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:59:12.069573 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:59:12.148342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae83084-d841-4e3c-a287-b4b15dbb60d4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:59:12.150719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9ae83084-d841-4e3c-a287-b4b15dbb60d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:59:12.214452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae83084-d841-4e3c-a287-b4b15dbb60d4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:59:12.218250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e659d3c-c3d8-4b4e-af1e-b527707bdca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:59:12.218899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e659d3c-c3d8-4b4e-af1e-b527707bdca3 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:59:12.219194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e659d3c-c3d8-4b4e-af1e-b527707bdca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:59:12.219456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e659d3c-c3d8-4b4e-af1e-b527707bdca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:59:12.229839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e659d3c-c3d8-4b4e-af1e-b527707bdca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:59:12.231295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e659d3c-c3d8-4b4e-af1e-b527707bdca3 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:59:12.241571 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 764/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:59:14.539729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73e0fd-348c-4fa5-b183-d489c55c47a3 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:59:14.540718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73e0fd-348c-4fa5-b183-d489c55c47a3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:59:14.540718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73e0fd-348c-4fa5-b183-d489c55c47a3 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:59:14.542884 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:59:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:59:14.551865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a9502-1989-4448-8579-3530777906fd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:59:14.552339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a9502-1989-4448-8579-3530777906fd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:59:14.552476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a9502-1989-4448-8579-3530777906fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:59:14.577163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-690a9502-1989-4448-8579-3530777906fd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:59:14.578414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-690a9502-1989-4448-8579-3530777906fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:59:14.587253 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:59:14.624894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73e0fd-348c-4fa5-b183-d489c55c47a3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:59:14.640696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73e0fd-348c-4fa5-b183-d489c55c47a3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:59:14.646454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e3ba7-b2f8-4425-b871-e73ede6830f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:59:14.647346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e3ba7-b2f8-4425-b871-e73ede6830f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:59:14.647720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e3ba7-b2f8-4425-b871-e73ede6830f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:59:14.648003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e3ba7-b2f8-4425-b871-e73ede6830f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:59:14.663274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e3ba7-b2f8-4425-b871-e73ede6830f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:59:14.664800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e3ba7-b2f8-4425-b871-e73ede6830f3 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:59:14.674824 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 765/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 20:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 20:59:24.571666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=66 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:59:24.670339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=42 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:05.098259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78486a98-f6cf-4749-bca6-bd7f00aee2bc None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:05.098724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78486a98-f6cf-4749-bca6-bd7f00aee2bc None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:05.098808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78486a98-f6cf-4749-bca6-bd7f00aee2bc None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:05.100317 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 766/1531] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:00:05.105532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73f8f7-76bf-497b-9fcf-4d9680ad2643 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:05.105951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73f8f7-76bf-497b-9fcf-4d9680ad2643 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:05.106079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73f8f7-76bf-497b-9fcf-4d9680ad2643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:05.129669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-db73f8f7-76bf-497b-9fcf-4d9680ad2643 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:05.130969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-db73f8f7-76bf-497b-9fcf-4d9680ad2643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:05.141482 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 766/1532] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:00:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:00:15.121856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:44.147235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6af9f-bbbb-4b3c-bda2-7bd7d989e040 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:44.148299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6af9f-bbbb-4b3c-bda2-7bd7d989e040 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:44.148783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6af9f-bbbb-4b3c-bda2-7bd7d989e040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:44.156064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e54774-ebd6-4407-9828-16e3676c5330 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:44.156064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e54774-ebd6-4407-9828-16e3676c5330 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:44.156064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e54774-ebd6-4407-9828-16e3676c5330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:44.308264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-83d6af9f-bbbb-4b3c-bda2-7bd7d989e040 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:44.310208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-83d6af9f-bbbb-4b3c-bda2-7bd7d989e040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:44.324102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-48e54774-ebd6-4407-9828-16e3676c5330 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:44.325469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-48e54774-ebd6-4407-9828-16e3676c5330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:44.426634 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 767/1533] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:44.433870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa061f4-4e9e-432f-aa12-a2c9db51dad0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:44.434127 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 767/1534] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:44.434409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa061f4-4e9e-432f-aa12-a2c9db51dad0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:44.434652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa061f4-4e9e-432f-aa12-a2c9db51dad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:44.461557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ffa061f4-4e9e-432f-aa12-a2c9db51dad0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:44.462234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252e44e-3806-4d78-ab1d-6a514e3edfd0 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:44.462730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252e44e-3806-4d78-ab1d-6a514e3edfd0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:44.462838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ffa061f4-4e9e-432f-aa12-a2c9db51dad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:44.463318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252e44e-3806-4d78-ab1d-6a514e3edfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:44.477336 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 768/1535] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:00:44.479058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9368e96-54e7-4e26-a063-17eb4e4ef335 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:44.479493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9368e96-54e7-4e26-a063-17eb4e4ef335 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:44.479914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9368e96-54e7-4e26-a063-17eb4e4ef335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:44.505135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d9368e96-54e7-4e26-a063-17eb4e4ef335 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:44.505997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f252e44e-3806-4d78-ab1d-6a514e3edfd0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:44.506802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d9368e96-54e7-4e26-a063-17eb4e4ef335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:44.507382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f252e44e-3806-4d78-ab1d-6a514e3edfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:44.520593 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 769/1536] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:44.522169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9368e96-54e7-4e26-a063-17eb4e4ef335 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:44.534415 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 768/1537] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 02 21:00:44.536737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8546f56-f2b3-4dd1-a171-d422495c1a84 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:44.537315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8546f56-f2b3-4dd1-a171-d422495c1a84 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:44.537827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8546f56-f2b3-4dd1-a171-d422495c1a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:44.544115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9368e96-54e7-4e26-a063-17eb4e4ef335 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:44.549878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a375bce-311d-4edd-a884-77d4fb200573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:44.555727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a375bce-311d-4edd-a884-77d4fb200573 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:44.555727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a375bce-311d-4edd-a884-77d4fb200573 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:44.555727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a375bce-311d-4edd-a884-77d4fb200573 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:44.555727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a375bce-311d-4edd-a884-77d4fb200573 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:00:44.555727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a375bce-311d-4edd-a884-77d4fb200573 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:44.555727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a375bce-311d-4edd-a884-77d4fb200573 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:44.575554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a8546f56-f2b3-4dd1-a171-d422495c1a84 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:44.577559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a8546f56-f2b3-4dd1-a171-d422495c1a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:44.584370 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 770/1538] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:00:44.584370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a375bce-311d-4edd-a884-77d4fb200573 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:44.600164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a375bce-311d-4edd-a884-77d4fb200573 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:44.605197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81235c-fcd7-466b-85df-db4539b9e9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:44.606340 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 769/1539] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:44.606466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81235c-fcd7-466b-85df-db4539b9e9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:44.606669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81235c-fcd7-466b-85df-db4539b9e9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:44.606945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81235c-fcd7-466b-85df-db4539b9e9e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:44.607675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81235c-fcd7-466b-85df-db4539b9e9e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:00:44.607981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81235c-fcd7-466b-85df-db4539b9e9e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:44.608782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8546f56-f2b3-4dd1-a171-d422495c1a84 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:44.617978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81235c-fcd7-466b-85df-db4539b9e9e3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:44.624959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8546f56-f2b3-4dd1-a171-d422495c1a84 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:44.637470 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 771/1540] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:00:44.638515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81235c-fcd7-466b-85df-db4539b9e9e3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:44.641838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae7afc-059d-46b9-be79-402f3bf485d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:44.642780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7afc-059d-46b9-be79-402f3bf485d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:44.643266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7afc-059d-46b9-be79-402f3bf485d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:44.643867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7afc-059d-46b9-be79-402f3bf485d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:44.644801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae7afc-059d-46b9-be79-402f3bf485d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:44.646998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae7afc-059d-46b9-be79-402f3bf485d5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:44.656777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81235c-fcd7-466b-85df-db4539b9e9e3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:44.661519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf24ca2-aa64-47a9-890c-399f20ce76eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:44.662190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf24ca2-aa64-47a9-890c-399f20ce76eb admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:44.662849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf24ca2-aa64-47a9-890c-399f20ce76eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:44.663132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf24ca2-aa64-47a9-890c-399f20ce76eb admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:44.663857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf24ca2-aa64-47a9-890c-399f20ce76eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:00:44.672365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf24ca2-aa64-47a9-890c-399f20ce76eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:44.674892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf24ca2-aa64-47a9-890c-399f20ce76eb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:44.691697 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 772/1541] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:00:44.692409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf24ca2-aa64-47a9-890c-399f20ce76eb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:44.708519 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 770/1542] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:44 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:44.709735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae7afc-059d-46b9-be79-402f3bf485d5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:44.709863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf24ca2-aa64-47a9-890c-399f20ce76eb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:44.779938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698ec93-e542-4cff-981a-854023656402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:44.780665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698ec93-e542-4cff-981a-854023656402 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:44.780952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698ec93-e542-4cff-981a-854023656402 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:44.781224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698ec93-e542-4cff-981a-854023656402 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:44.781932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698ec93-e542-4cff-981a-854023656402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:44.782976 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-2698ec93-e542-4cff-981a-854023656402 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:44.782976 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:00:44.782976 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:00:44.784206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698ec93-e542-4cff-981a-854023656402 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:44.821551 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 773/1543] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:44 2022] POST /identity/v3/projects => generated 411 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:44.823479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698ec93-e542-4cff-981a-854023656402 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:44.845452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:44.853707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae7afc-059d-46b9-be79-402f3bf485d5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:44.920668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:44.931633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698ec93-e542-4cff-981a-854023656402 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:44.938762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cbd45-0a29-4186-87b6-12f94905215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:44.939651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cbd45-0a29-4186-87b6-12f94905215f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:44.939931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cbd45-0a29-4186-87b6-12f94905215f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:44.940229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cbd45-0a29-4186-87b6-12f94905215f admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:44.941678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cbd45-0a29-4186-87b6-12f94905215f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:44.943796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cbd45-0a29-4186-87b6-12f94905215f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:44.970636 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 774/1544] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:44 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:44.972465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246af61-fc54-4fca-8a15-bdd5155507da None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:44.972828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246af61-fc54-4fca-8a15-bdd5155507da None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:44.973107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246af61-fc54-4fca-8a15-bdd5155507da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:44.974763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a720d-74c8-4c9a-b12f-9c138f870945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:44.975686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a720d-74c8-4c9a-b12f-9c138f870945 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:44.976203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a720d-74c8-4c9a-b12f-9c138f870945 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:44.976691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a720d-74c8-4c9a-b12f-9c138f870945 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:44.977609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a720d-74c8-4c9a-b12f-9c138f870945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:44.979765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a720d-74c8-4c9a-b12f-9c138f870945 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:44.995633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2246af61-fc54-4fca-8a15-bdd5155507da None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:44.997231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2246af61-fc54-4fca-8a15-bdd5155507da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:45.009958 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 775/1545] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:45.011055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246af61-fc54-4fca-8a15-bdd5155507da None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.025882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246af61-fc54-4fca-8a15-bdd5155507da None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.033811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332597bb-2465-4d4e-b627-bf440ba3ed78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.034553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332597bb-2465-4d4e-b627-bf440ba3ed78 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.034841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332597bb-2465-4d4e-b627-bf440ba3ed78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.035122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332597bb-2465-4d4e-b627-bf440ba3ed78 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.035872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332597bb-2465-4d4e-b627-bf440ba3ed78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.038279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332597bb-2465-4d4e-b627-bf440ba3ed78 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.048825 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 771/1546] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:44 2022] POST /identity/v3/projects => generated 373 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:45.053601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a720d-74c8-4c9a-b12f-9c138f870945 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.067249 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 776/1547] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/users => generated 306 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:45.069248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61050c00-7813-49d5-95c7-188c6d96df8b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.071232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61050c00-7813-49d5-95c7-188c6d96df8b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.071232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61050c00-7813-49d5-95c7-188c6d96df8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.099504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-61050c00-7813-49d5-95c7-188c6d96df8b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:45.100760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-61050c00-7813-49d5-95c7-188c6d96df8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:45.127359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a720d-74c8-4c9a-b12f-9c138f870945 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.131978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690da0f-6db7-4146-aea9-10835b4431df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.132707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690da0f-6db7-4146-aea9-10835b4431df admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.133100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690da0f-6db7-4146-aea9-10835b4431df admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.133365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690da0f-6db7-4146-aea9-10835b4431df admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.134086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690da0f-6db7-4146-aea9-10835b4431df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.135675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690da0f-6db7-4146-aea9-10835b4431df admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.145669 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 772/1548] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:45.146887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb11661-540b-477c-8f03-edfb86184b6b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.147173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb11661-540b-477c-8f03-edfb86184b6b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.147450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb11661-540b-477c-8f03-edfb86184b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.174018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-7eb11661-540b-477c-8f03-edfb86184b6b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:45.175490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7eb11661-540b-477c-8f03-edfb86184b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:45.176430 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 777/1549] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:45.177746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41609abb-bee0-4cdf-ae5b-1420fe68a0bd None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.178032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41609abb-bee0-4cdf-ae5b-1420fe68a0bd None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.178302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41609abb-bee0-4cdf-ae5b-1420fe68a0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.189909 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 773/1550] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:45.190053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb11661-540b-477c-8f03-edfb86184b6b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.198871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-41609abb-bee0-4cdf-ae5b-1420fe68a0bd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:45.199442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb11661-540b-477c-8f03-edfb86184b6b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.200199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-41609abb-bee0-4cdf-ae5b-1420fe68a0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:45.204068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1af6f-fe1f-4ecb-b8aa-4379054b6917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.204717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1af6f-fe1f-4ecb-b8aa-4379054b6917 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.204995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1af6f-fe1f-4ecb-b8aa-4379054b6917 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.205270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1af6f-fe1f-4ecb-b8aa-4379054b6917 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.205950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1af6f-fe1f-4ecb-b8aa-4379054b6917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.207075 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-58a1af6f-fe1f-4ecb-b8aa-4379054b6917 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:45.207075 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:00:45.207075 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:00:45.208149 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 778/1551] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:45.208394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1af6f-fe1f-4ecb-b8aa-4379054b6917 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.209415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d02f7-66c5-4a2e-a772-61fd97ef158e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.209627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d02f7-66c5-4a2e-a772-61fd97ef158e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.209898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d02f7-66c5-4a2e-a772-61fd97ef158e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.228302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-674d02f7-66c5-4a2e-a772-61fd97ef158e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:45.229629 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 774/1552] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/users => generated 287 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:45.229744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-674d02f7-66c5-4a2e-a772-61fd97ef158e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:45.230330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1af6f-fe1f-4ecb-b8aa-4379054b6917 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.237833 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 779/1553] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:45.239058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67309003-5033-45bc-8b36-5e59dd085d81 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.239338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67309003-5033-45bc-8b36-5e59dd085d81 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.239606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67309003-5033-45bc-8b36-5e59dd085d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.246407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1af6f-fe1f-4ecb-b8aa-4379054b6917 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.251174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ea668-cfab-4b85-b34e-c85e6ebb00bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.251842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ea668-cfab-4b85-b34e-c85e6ebb00bd admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.252190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ea668-cfab-4b85-b34e-c85e6ebb00bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.252478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ea668-cfab-4b85-b34e-c85e6ebb00bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.253269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ea668-cfab-4b85-b34e-c85e6ebb00bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.254888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ea668-cfab-4b85-b34e-c85e6ebb00bd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.256950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-67309003-5033-45bc-8b36-5e59dd085d81 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:45.258263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-67309003-5033-45bc-8b36-5e59dd085d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:45.265585 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 775/1554] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:45.266299 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 780/1555] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:45.267339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe226f3-277d-4f7f-a547-53dd84f3c0a5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.267619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe226f3-277d-4f7f-a547-53dd84f3c0a5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.267892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe226f3-277d-4f7f-a547-53dd84f3c0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.272548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ea668-cfab-4b85-b34e-c85e6ebb00bd admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.282949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ea668-cfab-4b85-b34e-c85e6ebb00bd admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.285883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bbe226f3-277d-4f7f-a547-53dd84f3c0a5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:45.287068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bbe226f3-277d-4f7f-a547-53dd84f3c0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:45.287570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bd3cd-027c-412b-b667-c0e9c5c7506d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.288277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bd3cd-027c-412b-b667-c0e9c5c7506d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.288563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bd3cd-027c-412b-b667-c0e9c5c7506d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.288868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bd3cd-027c-412b-b667-c0e9c5c7506d admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.289601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bd3cd-027c-412b-b667-c0e9c5c7506d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.291227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bd3cd-027c-412b-b667-c0e9c5c7506d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.294899 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 781/1556] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:45.295659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe226f3-277d-4f7f-a547-53dd84f3c0a5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.302070 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 776/1557] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:45.303361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd852e-206b-4ea5-b428-8b3d8815d171 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.303929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd852e-206b-4ea5-b428-8b3d8815d171 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.303929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd852e-206b-4ea5-b428-8b3d8815d171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.305531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe226f3-277d-4f7f-a547-53dd84f3c0a5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.310397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0866c8e-4cc1-4a95-b870-b180fe1c05ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.311191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0866c8e-4cc1-4a95-b870-b180fe1c05ad admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.311374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0866c8e-4cc1-4a95-b870-b180fe1c05ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.311651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0866c8e-4cc1-4a95-b870-b180fe1c05ad admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.312403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0866c8e-4cc1-4a95-b870-b180fe1c05ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:00:45.313182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0866c8e-4cc1-4a95-b870-b180fe1c05ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.314833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0866c8e-4cc1-4a95-b870-b180fe1c05ad admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.323243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-63fd852e-206b-4ea5-b428-8b3d8815d171 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:45.324614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-63fd852e-206b-4ea5-b428-8b3d8815d171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:45.326838 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 782/1558] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:00:45.327687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0866c8e-4cc1-4a95-b870-b180fe1c05ad admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.338189 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 777/1559] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:45.339542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c8fb1-32e5-4bbd-9114-07a71db66585 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.340103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c8fb1-32e5-4bbd-9114-07a71db66585 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.340212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c8fb1-32e5-4bbd-9114-07a71db66585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.341302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0866c8e-4cc1-4a95-b870-b180fe1c05ad admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.345860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947098a-3e74-4ef2-8ee7-c3b4d4bc692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.346640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947098a-3e74-4ef2-8ee7-c3b4d4bc692e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.346923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947098a-3e74-4ef2-8ee7-c3b4d4bc692e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.347273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947098a-3e74-4ef2-8ee7-c3b4d4bc692e admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.348004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947098a-3e74-4ef2-8ee7-c3b4d4bc692e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.349811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947098a-3e74-4ef2-8ee7-c3b4d4bc692e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.359648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-927c8fb1-32e5-4bbd-9114-07a71db66585 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:45.360678 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 783/1560] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:45.360946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-927c8fb1-32e5-4bbd-9114-07a71db66585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:45.361479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947098a-3e74-4ef2-8ee7-c3b4d4bc692e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.369891 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 778/1561] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:45.371029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6c09d-7b73-45be-a585-dc6ff39345a9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.371165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947098a-3e74-4ef2-8ee7-c3b4d4bc692e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.371319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6c09d-7b73-45be-a585-dc6ff39345a9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.371594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6c09d-7b73-45be-a585-dc6ff39345a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.375649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc8221-81d4-48ef-bcfa-bad3e8050885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.376320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc8221-81d4-48ef-bcfa-bad3e8050885 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.376595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc8221-81d4-48ef-bcfa-bad3e8050885 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.376947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc8221-81d4-48ef-bcfa-bad3e8050885 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.377793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc8221-81d4-48ef-bcfa-bad3e8050885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.379265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc8221-81d4-48ef-bcfa-bad3e8050885 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.389574 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 784/1562] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:45.390351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc8221-81d4-48ef-bcfa-bad3e8050885 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.390464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-aec6c09d-7b73-45be-a585-dc6ff39345a9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:45.391795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-aec6c09d-7b73-45be-a585-dc6ff39345a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:45.400258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc8221-81d4-48ef-bcfa-bad3e8050885 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.400679 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 779/1563] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:45.401470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6c09d-7b73-45be-a585-dc6ff39345a9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.406291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85015be-f617-451a-b8c4-7fe647753dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.406964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85015be-f617-451a-b8c4-7fe647753dac admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.407252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85015be-f617-451a-b8c4-7fe647753dac admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.407529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85015be-f617-451a-b8c4-7fe647753dac admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.408292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85015be-f617-451a-b8c4-7fe647753dac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:00:45.408599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85015be-f617-451a-b8c4-7fe647753dac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.410208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85015be-f617-451a-b8c4-7fe647753dac admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.410952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6c09d-7b73-45be-a585-dc6ff39345a9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.415996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28620c-7ef6-404a-8b8f-a7c05f2dc4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.416842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28620c-7ef6-404a-8b8f-a7c05f2dc4f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.417216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:45.417952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28620c-7ef6-404a-8b8f-a7c05f2dc4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.417952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28620c-7ef6-404a-8b8f-a7c05f2dc4f2 admin admin] PATH_INFO: `/v3/projects/6bdc6de09f4c4eee86457474d257f369/users/bb4fd1236bf6401db0c45c78c56dbbc4/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.424492 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 785/1564] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:00:45.425624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85015be-f617-451a-b8c4-7fe647753dac admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.436697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85015be-f617-451a-b8c4-7fe647753dac admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.437773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28620c-7ef6-404a-8b8f-a7c05f2dc4f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bdc6de09f4c4eee86457474d257f369, user_id=bb4fd1236bf6401db0c45c78c56dbbc4, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.440531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28620c-7ef6-404a-8b8f-a7c05f2dc4f2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.441466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cf7f5-071d-46d3-840a-6f431ddc6cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.442110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cf7f5-071d-46d3-840a-6f431ddc6cff admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.442389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cf7f5-071d-46d3-840a-6f431ddc6cff admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.442661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cf7f5-071d-46d3-840a-6f431ddc6cff admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.443342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cf7f5-071d-46d3-840a-6f431ddc6cff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.445556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cf7f5-071d-46d3-840a-6f431ddc6cff admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.454627 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 780/1565] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:45 2022] PUT /identity/v3/projects/6bdc6de09f4c4eee86457474d257f369/users/bb4fd1236bf6401db0c45c78c56dbbc4/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:45.455457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28620c-7ef6-404a-8b8f-a7c05f2dc4f2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.473424 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 786/1566] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/projects => generated 395 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:45.474260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cf7f5-071d-46d3-840a-6f431ddc6cff admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.498021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:45.530502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28620c-7ef6-404a-8b8f-a7c05f2dc4f2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.535095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2194f93-ac5d-4b73-a95f-f38521cbddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.535756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2194f93-ac5d-4b73-a95f-f38521cbddbe admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.536067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2194f93-ac5d-4b73-a95f-f38521cbddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.536341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2194f93-ac5d-4b73-a95f-f38521cbddbe admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.537062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2194f93-ac5d-4b73-a95f-f38521cbddbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:00:45.537367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2194f93-ac5d-4b73-a95f-f38521cbddbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.537650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cf7f5-071d-46d3-840a-6f431ddc6cff admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.538399 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-d2194f93-ac5d-4b73-a95f-f38521cbddbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:45.538399 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:00:45.538399 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:00:45.539277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2194f93-ac5d-4b73-a95f-f38521cbddbe admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.542341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94462fe9-da4f-4d4b-9759-6e387e171ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.543078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94462fe9-da4f-4d4b-9759-6e387e171ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.543366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94462fe9-da4f-4d4b-9759-6e387e171ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.543644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94462fe9-da4f-4d4b-9759-6e387e171ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.544396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94462fe9-da4f-4d4b-9759-6e387e171ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.546412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94462fe9-da4f-4d4b-9759-6e387e171ff7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.551360 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 781/1567] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:00:45.559160 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 787/1568] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:45.559329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2194f93-ac5d-4b73-a95f-f38521cbddbe admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.559433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94462fe9-da4f-4d4b-9759-6e387e171ff7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.566758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2194f93-ac5d-4b73-a95f-f38521cbddbe admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.567843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94462fe9-da4f-4d4b-9759-6e387e171ff7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.571321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f6417-ee61-493c-9284-217ea3ddd8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.571969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f6417-ee61-493c-9284-217ea3ddd8ec admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.572284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f6417-ee61-493c-9284-217ea3ddd8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.572485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825686a-9fc8-402d-ac2a-cd8414af5b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.572585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f6417-ee61-493c-9284-217ea3ddd8ec admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.573260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f6417-ee61-493c-9284-217ea3ddd8ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:00:45.573348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825686a-9fc8-402d-ac2a-cd8414af5b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.573592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f6417-ee61-493c-9284-217ea3ddd8ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.573696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825686a-9fc8-402d-ac2a-cd8414af5b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.573878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825686a-9fc8-402d-ac2a-cd8414af5b48 admin admin] PATH_INFO: `/v3/projects/c44f2953a422441c8c6b6cb9ef62f295/users/3e60c8745b5b4bcdaf75e83b4264dd3b/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.575349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f6417-ee61-493c-9284-217ea3ddd8ec admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.587642 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 782/1569] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:00:45.588469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f6417-ee61-493c-9284-217ea3ddd8ec admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.588729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825686a-9fc8-402d-ac2a-cd8414af5b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44f2953a422441c8c6b6cb9ef62f295, user_id=3e60c8745b5b4bcdaf75e83b4264dd3b, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.589878 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-6825686a-9fc8-402d-ac2a-cd8414af5b48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:45.589878 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:00:45.589878 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:00:45.591812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825686a-9fc8-402d-ac2a-cd8414af5b48 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.600622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f6417-ee61-493c-9284-217ea3ddd8ec admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.606739 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 788/1570] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:45 2022] PUT /identity/v3/projects/c44f2953a422441c8c6b6cb9ef62f295/users/3e60c8745b5b4bcdaf75e83b4264dd3b/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:45.607394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825686a-9fc8-402d-ac2a-cd8414af5b48 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.666405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825686a-9fc8-402d-ac2a-cd8414af5b48 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.671068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf4001-a7a3-4e4b-9d6c-c678f51148c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.671485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fee94-a84f-44e3-a89e-b91c53e2e540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.671722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf4001-a7a3-4e4b-9d6c-c678f51148c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.672000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf4001-a7a3-4e4b-9d6c-c678f51148c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.672180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fee94-a84f-44e3-a89e-b91c53e2e540 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.672280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf4001-a7a3-4e4b-9d6c-c678f51148c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.672461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fee94-a84f-44e3-a89e-b91c53e2e540 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.672731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fee94-a84f-44e3-a89e-b91c53e2e540 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.672972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf4001-a7a3-4e4b-9d6c-c678f51148c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.673446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fee94-a84f-44e3-a89e-b91c53e2e540 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:00:45.673748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fee94-a84f-44e3-a89e-b91c53e2e540 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.674980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf4001-a7a3-4e4b-9d6c-c678f51148c9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.675489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fee94-a84f-44e3-a89e-b91c53e2e540 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.687148 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 783/1571] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:00:45.688403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d71a1-3771-4d82-acda-dc135ec3a6e4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.688692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d71a1-3771-4d82-acda-dc135ec3a6e4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.688992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d71a1-3771-4d82-acda-dc135ec3a6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.706695 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 789/1572] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:45.707509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf4001-a7a3-4e4b-9d6c-c678f51148c9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.720303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-106d71a1-3771-4d82-acda-dc135ec3a6e4 None None] MFA Rules not processed for user `bb4fd1236bf6401db0c45c78c56dbbc4`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:45.721541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-106d71a1-3771-4d82-acda-dc135ec3a6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:45.743945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:45.773857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf4001-a7a3-4e4b-9d6c-c678f51148c9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.779522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9388fe1-3cd3-4dbd-8f62-1244855e5c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.780234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9388fe1-3cd3-4dbd-8f62-1244855e5c0e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.780516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9388fe1-3cd3-4dbd-8f62-1244855e5c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.780792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9388fe1-3cd3-4dbd-8f62-1244855e5c0e admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.781488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9388fe1-3cd3-4dbd-8f62-1244855e5c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.783467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9388fe1-3cd3-4dbd-8f62-1244855e5c0e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.786723 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 784/1573] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:45.789612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d71a1-3771-4d82-acda-dc135ec3a6e4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.803547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d71a1-3771-4d82-acda-dc135ec3a6e4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.804534 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 790/1574] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:45.805348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9388fe1-3cd3-4dbd-8f62-1244855e5c0e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.811860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2c8c8-c4b0-4049-af8c-85b6177ad8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.812623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2c8c8-c4b0-4049-af8c-85b6177ad8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.812968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2c8c8-c4b0-4049-af8c-85b6177ad8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.813243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2c8c8-c4b0-4049-af8c-85b6177ad8d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.813975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2c8c8-c4b0-4049-af8c-85b6177ad8d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.815076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9388fe1-3cd3-4dbd-8f62-1244855e5c0e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.815838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2c8c8-c4b0-4049-af8c-85b6177ad8d7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.819693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bc657-fe9f-496d-8980-7697c4eba587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.820612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bc657-fe9f-496d-8980-7697c4eba587 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.820890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bc657-fe9f-496d-8980-7697c4eba587 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.821165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bc657-fe9f-496d-8980-7697c4eba587 admin admin] PATH_INFO: `/v3/projects/ff81db2a0deb4600a70a7a4f8bf8285f/users/765027ff05394688851476e92d182d9a/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.837350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1bc657-fe9f-496d-8980-7697c4eba587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff81db2a0deb4600a70a7a4f8bf8285f, user_id=765027ff05394688851476e92d182d9a, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.840192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1bc657-fe9f-496d-8980-7697c4eba587 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:45.843534 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 785/1575] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:45.844583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2c8c8-c4b0-4049-af8c-85b6177ad8d7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.857378 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 791/1576] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:45 2022] PUT /identity/v3/projects/ff81db2a0deb4600a70a7a4f8bf8285f/users/765027ff05394688851476e92d182d9a/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:45.857744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:45.859539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e3596-7ed4-4169-9bbe-e00d5086dac6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.859827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e3596-7ed4-4169-9bbe-e00d5086dac6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.860157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e3596-7ed4-4169-9bbe-e00d5086dac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.886356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bf6e3596-7ed4-4169-9bbe-e00d5086dac6 None None] MFA Rules not processed for user `3e60c8745b5b4bcdaf75e83b4264dd3b`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:45.887624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bf6e3596-7ed4-4169-9bbe-e00d5086dac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:45.927662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2c8c8-c4b0-4049-af8c-85b6177ad8d7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:45.952380 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 792/1577] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:45.953228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e3596-7ed4-4169-9bbe-e00d5086dac6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:45.986340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f3406-3e46-40c7-82b5-48126269c171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:45.987010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f3406-3e46-40c7-82b5-48126269c171 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:45.987314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f3406-3e46-40c7-82b5-48126269c171 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:45.987596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f3406-3e46-40c7-82b5-48126269c171 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:45.988340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f3406-3e46-40c7-82b5-48126269c171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:45.990294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f3406-3e46-40c7-82b5-48126269c171 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.016806 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 786/1578] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:46.017012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e3596-7ed4-4169-9bbe-e00d5086dac6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.017926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f3406-3e46-40c7-82b5-48126269c171 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.054750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:46.079094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a951f-53cc-4806-af14-6f4ff78da815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.079769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a951f-53cc-4806-af14-6f4ff78da815 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.080064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a951f-53cc-4806-af14-6f4ff78da815 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.080344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a951f-53cc-4806-af14-6f4ff78da815 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.081028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a951f-53cc-4806-af14-6f4ff78da815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.082976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a951f-53cc-4806-af14-6f4ff78da815 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.083497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f3406-3e46-40c7-82b5-48126269c171 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.088168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b7907-97b7-4051-8e01-f0b4e43e4b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.088845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b7907-97b7-4051-8e01-f0b4e43e4b04 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.089131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b7907-97b7-4051-8e01-f0b4e43e4b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.089406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b7907-97b7-4051-8e01-f0b4e43e4b04 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.090093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b7907-97b7-4051-8e01-f0b4e43e4b04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.092010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b7907-97b7-4051-8e01-f0b4e43e4b04 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.115182 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 787/1579] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:46 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:46.115383 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 793/1580] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:45 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:46.115383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a951f-53cc-4806-af14-6f4ff78da815 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.116205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b7907-97b7-4051-8e01-f0b4e43e4b04 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.125904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b7907-97b7-4051-8e01-f0b4e43e4b04 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.156237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:46.179134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a951f-53cc-4806-af14-6f4ff78da815 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.183947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768ee34-1b96-450f-bdbf-5ec4bdf0594e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.184149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24128186-fa6c-45a2-9dd8-63b606202a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.184662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768ee34-1b96-450f-bdbf-5ec4bdf0594e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.184816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24128186-fa6c-45a2-9dd8-63b606202a62 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.184943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768ee34-1b96-450f-bdbf-5ec4bdf0594e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.185064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24128186-fa6c-45a2-9dd8-63b606202a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.185210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24128186-fa6c-45a2-9dd8-63b606202a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.185299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768ee34-1b96-450f-bdbf-5ec4bdf0594e admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.185890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24128186-fa6c-45a2-9dd8-63b606202a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.185983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768ee34-1b96-450f-bdbf-5ec4bdf0594e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.187564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768ee34-1b96-450f-bdbf-5ec4bdf0594e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.187785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24128186-fa6c-45a2-9dd8-63b606202a62 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.197949 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 794/1581] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:46.198564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768ee34-1b96-450f-bdbf-5ec4bdf0594e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.208640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768ee34-1b96-450f-bdbf-5ec4bdf0594e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.213197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331a6c0-0022-4b60-8aa1-f4bd78cabc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.213845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331a6c0-0022-4b60-8aa1-f4bd78cabc31 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.214128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331a6c0-0022-4b60-8aa1-f4bd78cabc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.214405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331a6c0-0022-4b60-8aa1-f4bd78cabc31 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.215134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331a6c0-0022-4b60-8aa1-f4bd78cabc31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.218625 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 788/1582] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:46 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:46.218764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331a6c0-0022-4b60-8aa1-f4bd78cabc31 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.218859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78ea5a-cff0-4c46-8bde-d6fa8137a6e2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.218859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78ea5a-cff0-4c46-8bde-d6fa8137a6e2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.218859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78ea5a-cff0-4c46-8bde-d6fa8137a6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.237632 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 795/1583] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:46 2022] POST /identity/v3/users => generated 291 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:46.238451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331a6c0-0022-4b60-8aa1-f4bd78cabc31 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.245548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bf78ea5a-cff0-4c46-8bde-d6fa8137a6e2 None None] MFA Rules not processed for user `765027ff05394688851476e92d182d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:46.246772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bf78ea5a-cff0-4c46-8bde-d6fa8137a6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:46.249635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331a6c0-0022-4b60-8aa1-f4bd78cabc31 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.307968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c86830-1ded-406f-9dc8-04f09b9d43f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.308703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c86830-1ded-406f-9dc8-04f09b9d43f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.309011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c86830-1ded-406f-9dc8-04f09b9d43f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.309225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c86830-1ded-406f-9dc8-04f09b9d43f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.309952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c86830-1ded-406f-9dc8-04f09b9d43f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.311862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c86830-1ded-406f-9dc8-04f09b9d43f0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.320089 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 789/1584] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:46.320089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78ea5a-cff0-4c46-8bde-d6fa8137a6e2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.330767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78ea5a-cff0-4c46-8bde-d6fa8137a6e2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.335885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19ac16-9afb-4750-8e7a-090db772cfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.336594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19ac16-9afb-4750-8e7a-090db772cfc3 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.336923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19ac16-9afb-4750-8e7a-090db772cfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.337132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19ac16-9afb-4750-8e7a-090db772cfc3 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.337812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19ac16-9afb-4750-8e7a-090db772cfc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.339274 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 796/1585] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:46 2022] POST /identity/v3/projects => generated 411 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:46.339739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19ac16-9afb-4750-8e7a-090db772cfc3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.340134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c86830-1ded-406f-9dc8-04f09b9d43f0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.360459 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 790/1586] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:46 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:46.361696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19ac16-9afb-4750-8e7a-090db772cfc3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.371640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19ac16-9afb-4750-8e7a-090db772cfc3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.372021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:46.411239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c86830-1ded-406f-9dc8-04f09b9d43f0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.415798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccef1e1-ee38-4afe-80f1-a2a8f4793144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.416500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccef1e1-ee38-4afe-80f1-a2a8f4793144 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.416777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccef1e1-ee38-4afe-80f1-a2a8f4793144 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.417049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccef1e1-ee38-4afe-80f1-a2a8f4793144 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.417785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccef1e1-ee38-4afe-80f1-a2a8f4793144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.419385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccef1e1-ee38-4afe-80f1-a2a8f4793144 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.428276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafdeeb9-7ae0-46bd-a065-27e7a2df2094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.428947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdeeb9-7ae0-46bd-a065-27e7a2df2094 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.429265 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 797/1587] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:46.429370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdeeb9-7ae0-46bd-a065-27e7a2df2094 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.429495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdeeb9-7ae0-46bd-a065-27e7a2df2094 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.430008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccef1e1-ee38-4afe-80f1-a2a8f4793144 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.430168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafdeeb9-7ae0-46bd-a065-27e7a2df2094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.432131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafdeeb9-7ae0-46bd-a065-27e7a2df2094 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.439587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccef1e1-ee38-4afe-80f1-a2a8f4793144 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.444848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995b2b7-a8f8-41d8-83f5-bf48abe3adaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.445595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995b2b7-a8f8-41d8-83f5-bf48abe3adaf admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.445955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995b2b7-a8f8-41d8-83f5-bf48abe3adaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.446216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995b2b7-a8f8-41d8-83f5-bf48abe3adaf admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.447078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995b2b7-a8f8-41d8-83f5-bf48abe3adaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.448783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995b2b7-a8f8-41d8-83f5-bf48abe3adaf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.455749 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 791/1588] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:46 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:46.455749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafdeeb9-7ae0-46bd-a065-27e7a2df2094 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.464321 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 798/1589] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:46.464321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995b2b7-a8f8-41d8-83f5-bf48abe3adaf admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.464559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafdeeb9-7ae0-46bd-a065-27e7a2df2094 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.467661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389813a-56a4-46ef-a568-61a9e1ceabfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.468352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389813a-56a4-46ef-a568-61a9e1ceabfb admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.468590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389813a-56a4-46ef-a568-61a9e1ceabfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.468893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389813a-56a4-46ef-a568-61a9e1ceabfb admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.469569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389813a-56a4-46ef-a568-61a9e1ceabfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.471522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389813a-56a4-46ef-a568-61a9e1ceabfb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.472738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995b2b7-a8f8-41d8-83f5-bf48abe3adaf admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.477863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2740e-ff8a-4a89-932f-dc0c177af987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.478541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2740e-ff8a-4a89-932f-dc0c177af987 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.478819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2740e-ff8a-4a89-932f-dc0c177af987 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.479062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2740e-ff8a-4a89-932f-dc0c177af987 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.479766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2740e-ff8a-4a89-932f-dc0c177af987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.481438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2740e-ff8a-4a89-932f-dc0c177af987 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.494989 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 799/1590] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:46.495165 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 792/1591] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:46 2022] POST /identity/v3/users => generated 292 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:46.495264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2740e-ff8a-4a89-932f-dc0c177af987 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.495347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389813a-56a4-46ef-a568-61a9e1ceabfb admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.499232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:46.504917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2740e-ff8a-4a89-932f-dc0c177af987 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.505654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389813a-56a4-46ef-a568-61a9e1ceabfb admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.509476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91535a-4977-46f9-af7c-a156540dde0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.510114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91535a-4977-46f9-af7c-a156540dde0d admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.510390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91535a-4977-46f9-af7c-a156540dde0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.510659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91535a-4977-46f9-af7c-a156540dde0d admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.511029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bd5d7-2c3a-4e44-b3df-8be133a64475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.511330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91535a-4977-46f9-af7c-a156540dde0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.511838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bd5d7-2c3a-4e44-b3df-8be133a64475 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.512249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bd5d7-2c3a-4e44-b3df-8be133a64475 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.512591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bd5d7-2c3a-4e44-b3df-8be133a64475 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.513285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91535a-4977-46f9-af7c-a156540dde0d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.513391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205bd5d7-2c3a-4e44-b3df-8be133a64475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.515343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205bd5d7-2c3a-4e44-b3df-8be133a64475 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.537847 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 793/1592] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:46 2022] POST /identity/v3/users => generated 312 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:46.538930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bd5d7-2c3a-4e44-b3df-8be133a64475 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.542924 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 800/1593] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:46 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:46.543830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91535a-4977-46f9-af7c-a156540dde0d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.549275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bd5d7-2c3a-4e44-b3df-8be133a64475 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.606419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91535a-4977-46f9-af7c-a156540dde0d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.606719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdf561-70f3-4f64-bff1-8177b3799e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.607415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdf561-70f3-4f64-bff1-8177b3799e23 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.607697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdf561-70f3-4f64-bff1-8177b3799e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.607978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdf561-70f3-4f64-bff1-8177b3799e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.608869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdf561-70f3-4f64-bff1-8177b3799e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.610577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdf561-70f3-4f64-bff1-8177b3799e23 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.611315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f57e2-6b1e-45d3-bb5f-cae6884b19a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.611993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f57e2-6b1e-45d3-bb5f-cae6884b19a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.612314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f57e2-6b1e-45d3-bb5f-cae6884b19a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.612597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f57e2-6b1e-45d3-bb5f-cae6884b19a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.613343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f57e2-6b1e-45d3-bb5f-cae6884b19a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.614962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f57e2-6b1e-45d3-bb5f-cae6884b19a3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.620525 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 794/1594] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:46.621653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdf561-70f3-4f64-bff1-8177b3799e23 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.629182 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 801/1595] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:46.630206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f57e2-6b1e-45d3-bb5f-cae6884b19a3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.631636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdf561-70f3-4f64-bff1-8177b3799e23 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.636417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68a522-5b53-40f1-9ac5-f04da546c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.637153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68a522-5b53-40f1-9ac5-f04da546c838 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.637435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68a522-5b53-40f1-9ac5-f04da546c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.637705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68a522-5b53-40f1-9ac5-f04da546c838 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.638433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68a522-5b53-40f1-9ac5-f04da546c838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.640076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68a522-5b53-40f1-9ac5-f04da546c838 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.642160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f57e2-6b1e-45d3-bb5f-cae6884b19a3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.647213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea2ace-2985-4cac-8b75-8177a8c64930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.648195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea2ace-2985-4cac-8b75-8177a8c64930 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.648473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea2ace-2985-4cac-8b75-8177a8c64930 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.648887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea2ace-2985-4cac-8b75-8177a8c64930 admin admin] PATH_INFO: `/v3/projects/60101912b2e94f7485de6b7adc5642c9/users/8f03e55928514c9c99289d5002af5349/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.650646 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 795/1596] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:46.651423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68a522-5b53-40f1-9ac5-f04da546c838 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.661062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68a522-5b53-40f1-9ac5-f04da546c838 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.665579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e889e92-e5ae-4379-9570-0bd5aaf12779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.666220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e889e92-e5ae-4379-9570-0bd5aaf12779 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.666496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e889e92-e5ae-4379-9570-0bd5aaf12779 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.666767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e889e92-e5ae-4379-9570-0bd5aaf12779 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.667471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e889e92-e5ae-4379-9570-0bd5aaf12779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.669119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e889e92-e5ae-4379-9570-0bd5aaf12779 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.669299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea2ace-2985-4cac-8b75-8177a8c64930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60101912b2e94f7485de6b7adc5642c9, user_id=8f03e55928514c9c99289d5002af5349, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.671986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea2ace-2985-4cac-8b75-8177a8c64930 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.680209 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 796/1597] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:46.680980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e889e92-e5ae-4379-9570-0bd5aaf12779 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.690445 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 802/1598] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:46 2022] PUT /identity/v3/projects/60101912b2e94f7485de6b7adc5642c9/users/8f03e55928514c9c99289d5002af5349/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:46.691257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea2ace-2985-4cac-8b75-8177a8c64930 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.691396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e889e92-e5ae-4379-9570-0bd5aaf12779 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.750689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:46.760366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8483e-d484-479f-ab03-f607d7fbbf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.761167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8483e-d484-479f-ab03-f607d7fbbf12 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.761557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8483e-d484-479f-ab03-f607d7fbbf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.761840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8483e-d484-479f-ab03-f607d7fbbf12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.762595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8483e-d484-479f-ab03-f607d7fbbf12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.764265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8483e-d484-479f-ab03-f607d7fbbf12 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.764746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea2ace-2985-4cac-8b75-8177a8c64930 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.769934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07831bbe-bb8a-4ea5-9680-e15ca19ff0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.770603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07831bbe-bb8a-4ea5-9680-e15ca19ff0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.770889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07831bbe-bb8a-4ea5-9680-e15ca19ff0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.771169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07831bbe-bb8a-4ea5-9680-e15ca19ff0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.771889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07831bbe-bb8a-4ea5-9680-e15ca19ff0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.773549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07831bbe-bb8a-4ea5-9680-e15ca19ff0b5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.774839 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 797/1599] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:46.775623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8483e-d484-479f-ab03-f607d7fbbf12 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.788083 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 803/1600] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:46.788268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8483e-d484-479f-ab03-f607d7fbbf12 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.788360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07831bbe-bb8a-4ea5-9680-e15ca19ff0b5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.792907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8681b6-8e43-49d9-ac73-eeeef3ab455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.793646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8681b6-8e43-49d9-ac73-eeeef3ab455a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.793926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8681b6-8e43-49d9-ac73-eeeef3ab455a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.794208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8681b6-8e43-49d9-ac73-eeeef3ab455a admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.794891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8681b6-8e43-49d9-ac73-eeeef3ab455a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.795864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07831bbe-bb8a-4ea5-9680-e15ca19ff0b5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.797002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8681b6-8e43-49d9-ac73-eeeef3ab455a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.800798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418d09b-9cc2-4f13-a09f-f9e13a6605ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.801445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418d09b-9cc2-4f13-a09f-f9e13a6605ea admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.801721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418d09b-9cc2-4f13-a09f-f9e13a6605ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.801995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418d09b-9cc2-4f13-a09f-f9e13a6605ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.802691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418d09b-9cc2-4f13-a09f-f9e13a6605ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.804412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418d09b-9cc2-4f13-a09f-f9e13a6605ea admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.814798 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 804/1601] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:46.815582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418d09b-9cc2-4f13-a09f-f9e13a6605ea admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.825102 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 798/1602] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:46 2022] POST /identity/v3/users => generated 293 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:46.828741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8681b6-8e43-49d9-ac73-eeeef3ab455a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.831542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418d09b-9cc2-4f13-a09f-f9e13a6605ea admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.836059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b28c3-5d5d-4b48-b474-c80fa8bb8482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.836965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b28c3-5d5d-4b48-b474-c80fa8bb8482 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.837248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b28c3-5d5d-4b48-b474-c80fa8bb8482 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.837524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b28c3-5d5d-4b48-b474-c80fa8bb8482 admin admin] PATH_INFO: `/v3/projects/347aae622773490aa3e8f0716b37d77e/users/b62db007a28947abbb19e137f52472a0/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.839001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8681b6-8e43-49d9-ac73-eeeef3ab455a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.845135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c652fd-13ac-4c21-9572-a263f12e1c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.845788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c652fd-13ac-4c21-9572-a263f12e1c6e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.846083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c652fd-13ac-4c21-9572-a263f12e1c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.846350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c652fd-13ac-4c21-9572-a263f12e1c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.847067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c652fd-13ac-4c21-9572-a263f12e1c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.848895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c652fd-13ac-4c21-9572-a263f12e1c6e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.852214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b28c3-5d5d-4b48-b474-c80fa8bb8482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=347aae622773490aa3e8f0716b37d77e, user_id=b62db007a28947abbb19e137f52472a0, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.854878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b28c3-5d5d-4b48-b474-c80fa8bb8482 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.862024 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 799/1603] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:46.862833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c652fd-13ac-4c21-9572-a263f12e1c6e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.868707 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 805/1604] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:46 2022] PUT /identity/v3/projects/347aae622773490aa3e8f0716b37d77e/users/b62db007a28947abbb19e137f52472a0/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:46.869744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4ea55-c861-4235-9bd4-fef63eb71409 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.870060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4ea55-c861-4235-9bd4-fef63eb71409 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.870335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4ea55-c861-4235-9bd4-fef63eb71409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.885632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c652fd-13ac-4c21-9572-a263f12e1c6e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.896020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bee4ea55-c861-4235-9bd4-fef63eb71409 None None] MFA Rules not processed for user `8f03e55928514c9c99289d5002af5349`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:46.897258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bee4ea55-c861-4235-9bd4-fef63eb71409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:46.910629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:46.944085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e604a-1e93-4647-aaec-c48b70bdb83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:46.944999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e604a-1e93-4647-aaec-c48b70bdb83b admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:46.945354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e604a-1e93-4647-aaec-c48b70bdb83b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:46.945695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e604a-1e93-4647-aaec-c48b70bdb83b admin admin] PATH_INFO: `/v3/projects/5be6d9bc1b374279aa2861c0d18a1b46/users/1815c9e136bb454ebe477a8452e42ca9/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:46.959337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e604a-1e93-4647-aaec-c48b70bdb83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be6d9bc1b374279aa2861c0d18a1b46, user_id=1815c9e136bb454ebe477a8452e42ca9, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:46.962035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e604a-1e93-4647-aaec-c48b70bdb83b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:46.969413 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 806/1605] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:46.969413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4ea55-c861-4235-9bd4-fef63eb71409 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:46.977619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4ea55-c861-4235-9bd4-fef63eb71409 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:46.982043 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 800/1606] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:46 2022] PUT /identity/v3/projects/5be6d9bc1b374279aa2861c0d18a1b46/users/1815c9e136bb454ebe477a8452e42ca9/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:46.983056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e604a-1e93-4647-aaec-c48b70bdb83b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:47.047495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e604a-1e93-4647-aaec-c48b70bdb83b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:47.048838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbd1cd-6709-4899-b88e-9b17b418ce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:47.049739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbd1cd-6709-4899-b88e-9b17b418ce99 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.050025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbd1cd-6709-4899-b88e-9b17b418ce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.050287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbd1cd-6709-4899-b88e-9b17b418ce99 admin admin] PATH_INFO: `/v3/projects/4fbf50031e9747178c370f741e59c074/users/c5a45a1afe564b64927c29d0d439847d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.052335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5cf48-86a4-4176-acdd-e912adcb93ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:47.053349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5cf48-86a4-4176-acdd-e912adcb93ea admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.053659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5cf48-86a4-4176-acdd-e912adcb93ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.053934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5cf48-86a4-4176-acdd-e912adcb93ea admin admin] PATH_INFO: `/v3/projects/ff96e14a835e4928a68e5df0452ad248/users/d707707ad60a4feb9e766a0e8ed8c2dd/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.069514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbd1cd-6709-4899-b88e-9b17b418ce99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fbf50031e9747178c370f741e59c074, user_id=c5a45a1afe564b64927c29d0d439847d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:47.070206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5cf48-86a4-4176-acdd-e912adcb93ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff96e14a835e4928a68e5df0452ad248, user_id=d707707ad60a4feb9e766a0e8ed8c2dd, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:47.072233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbd1cd-6709-4899-b88e-9b17b418ce99 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:47.072995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5cf48-86a4-4176-acdd-e912adcb93ea admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:47.090341 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 801/1607] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:46 2022] PUT /identity/v3/projects/ff96e14a835e4928a68e5df0452ad248/users/d707707ad60a4feb9e766a0e8ed8c2dd/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:47.090939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5cf48-86a4-4176-acdd-e912adcb93ea admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:47.094707 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 807/1608] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:46 2022] PUT /identity/v3/projects/4fbf50031e9747178c370f741e59c074/users/c5a45a1afe564b64927c29d0d439847d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:47.097271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbd1cd-6709-4899-b88e-9b17b418ce99 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:47.123179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:47.157792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5cf48-86a4-4176-acdd-e912adcb93ea admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:47.160878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbd1cd-6709-4899-b88e-9b17b418ce99 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:47.162435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81efcb-062c-4f8d-bf68-f96cccab8572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:47.163345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81efcb-062c-4f8d-bf68-f96cccab8572 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.163628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81efcb-062c-4f8d-bf68-f96cccab8572 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.163906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81efcb-062c-4f8d-bf68-f96cccab8572 admin admin] PATH_INFO: `/v3/projects/939eb4bb7d8744f7a76ed90eaf2366a7/users/181505c4f41b4a53bed9d4f362f6b8fa/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.165777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06c120-d758-4863-8d5b-8d26daf128c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:47.166435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06c120-d758-4863-8d5b-8d26daf128c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.166713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06c120-d758-4863-8d5b-8d26daf128c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.166987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06c120-d758-4863-8d5b-8d26daf128c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.167756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06c120-d758-4863-8d5b-8d26daf128c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:47.169420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06c120-d758-4863-8d5b-8d26daf128c8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:47.178733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81efcb-062c-4f8d-bf68-f96cccab8572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=939eb4bb7d8744f7a76ed90eaf2366a7, user_id=181505c4f41b4a53bed9d4f362f6b8fa, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:47.179179 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 808/1609] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:47.179952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06c120-d758-4863-8d5b-8d26daf128c8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:47.181457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81efcb-062c-4f8d-bf68-f96cccab8572 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:47.190315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06c120-d758-4863-8d5b-8d26daf128c8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:47.195147 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 802/1610] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:47 2022] PUT /identity/v3/projects/939eb4bb7d8744f7a76ed90eaf2366a7/users/181505c4f41b4a53bed9d4f362f6b8fa/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:47.196460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd707e-9d39-45ea-9fc9-669c024a9a6a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.196777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd707e-9d39-45ea-9fc9-669c024a9a6a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.197051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd707e-9d39-45ea-9fc9-669c024a9a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.230979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d2bd707e-9d39-45ea-9fc9-669c024a9a6a None None] MFA Rules not processed for user `b62db007a28947abbb19e137f52472a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:47.232348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d2bd707e-9d39-45ea-9fc9-669c024a9a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:47.236391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:47.249650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a9c2a-9041-43b3-a04a-7fcdf4b2be0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:47.250728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a9c2a-9041-43b3-a04a-7fcdf4b2be0b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.251086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a9c2a-9041-43b3-a04a-7fcdf4b2be0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.251367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a9c2a-9041-43b3-a04a-7fcdf4b2be0b admin admin] PATH_INFO: `/v3/projects/f2be8b6009c94753aae37882ed620670/users/031d2a0dc253402e82289c197d9cfd5d/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.266968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a9c2a-9041-43b3-a04a-7fcdf4b2be0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2be8b6009c94753aae37882ed620670, user_id=031d2a0dc253402e82289c197d9cfd5d, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:47.269723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a9c2a-9041-43b3-a04a-7fcdf4b2be0b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:47.283905 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 809/1611] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:47 2022] PUT /identity/v3/projects/f2be8b6009c94753aae37882ed620670/users/031d2a0dc253402e82289c197d9cfd5d/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:47.288637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a9c2a-9041-43b3-a04a-7fcdf4b2be0b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:47.303438 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 803/1612] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:47.304784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bc537-f0f4-43ac-b4ff-8c4aafa55af0 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.305130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bc537-f0f4-43ac-b4ff-8c4aafa55af0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.305418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bc537-f0f4-43ac-b4ff-8c4aafa55af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.331066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-956bc537-f0f4-43ac-b4ff-8c4aafa55af0 None None] MFA Rules not processed for user `1815c9e136bb454ebe477a8452e42ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:47.332328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-956bc537-f0f4-43ac-b4ff-8c4aafa55af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:47.353170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a9c2a-9041-43b3-a04a-7fcdf4b2be0b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:47.358645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692fce4-bacd-463d-a200-8de7539506e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:47.359386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692fce4-bacd-463d-a200-8de7539506e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.359679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692fce4-bacd-463d-a200-8de7539506e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.359954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692fce4-bacd-463d-a200-8de7539506e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.360678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692fce4-bacd-463d-a200-8de7539506e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:47.362621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692fce4-bacd-463d-a200-8de7539506e8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:47.395347 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 810/1613] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:47 2022] POST /identity/v3/projects => generated 399 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:47.395347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692fce4-bacd-463d-a200-8de7539506e8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:47.401487 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 804/1614] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:47.405764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bc537-f0f4-43ac-b4ff-8c4aafa55af0 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:47.413277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bc537-f0f4-43ac-b4ff-8c4aafa55af0 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:47.428552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:47.461844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692fce4-bacd-463d-a200-8de7539506e8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:47.466959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2c285-8ec0-43ad-aeec-0de5c8030319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:47.467649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2c285-8ec0-43ad-aeec-0de5c8030319 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.467929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2c285-8ec0-43ad-aeec-0de5c8030319 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.468228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2c285-8ec0-43ad-aeec-0de5c8030319 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.468943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2c285-8ec0-43ad-aeec-0de5c8030319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:47.470748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2c285-8ec0-43ad-aeec-0de5c8030319 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:47.474526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3838fa4-037f-423c-a62e-d03e25a75636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:47.475214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3838fa4-037f-423c-a62e-d03e25a75636 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.475496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3838fa4-037f-423c-a62e-d03e25a75636 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.475772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3838fa4-037f-423c-a62e-d03e25a75636 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.476665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3838fa4-037f-423c-a62e-d03e25a75636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:47.478250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3838fa4-037f-423c-a62e-d03e25a75636 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:47.481174 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 811/1615] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:47.482009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2c285-8ec0-43ad-aeec-0de5c8030319 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:47.489647 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 805/1616] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:47.490948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4952c-ca81-44b4-9c84-a54e4b52aaf7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.491245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4952c-ca81-44b4-9c84-a54e4b52aaf7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.491526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4952c-ca81-44b4-9c84-a54e4b52aaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.492300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2c285-8ec0-43ad-aeec-0de5c8030319 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:47.497918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a1b89-32f7-4221-b9d7-2cfc421b4fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:47.499372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a1b89-32f7-4221-b9d7-2cfc421b4fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.499678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a1b89-32f7-4221-b9d7-2cfc421b4fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.499959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a1b89-32f7-4221-b9d7-2cfc421b4fe9 admin admin] PATH_INFO: `/v3/projects/d42ffae4422e4dbcacf4cf486a83bf81/users/dd85d42d45a043a4b1636effb5d5c424/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.517264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a1b89-32f7-4221-b9d7-2cfc421b4fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d42ffae4422e4dbcacf4cf486a83bf81, user_id=dd85d42d45a043a4b1636effb5d5c424, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:47.517563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-36e4952c-ca81-44b4-9c84-a54e4b52aaf7 None None] MFA Rules not processed for user `181505c4f41b4a53bed9d4f362f6b8fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:47.518972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-36e4952c-ca81-44b4-9c84-a54e4b52aaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:47.520067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a1b89-32f7-4221-b9d7-2cfc421b4fe9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:47.538834 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 812/1617] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:47 2022] PUT /identity/v3/projects/d42ffae4422e4dbcacf4cf486a83bf81/users/dd85d42d45a043a4b1636effb5d5c424/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:47.538834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051c622-df8f-41a0-a6fa-8136b00e5789 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.538834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051c622-df8f-41a0-a6fa-8136b00e5789 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.538834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051c622-df8f-41a0-a6fa-8136b00e5789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.540724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:47.567831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1051c622-df8f-41a0-a6fa-8136b00e5789 None None] MFA Rules not processed for user `031d2a0dc253402e82289c197d9cfd5d`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:47.569251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1051c622-df8f-41a0-a6fa-8136b00e5789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:47.589744 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 806/1618] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:47.590756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4952c-ca81-44b4-9c84-a54e4b52aaf7 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:47.601032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4952c-ca81-44b4-9c84-a54e4b52aaf7 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:47.638860 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 813/1619] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:47.639900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051c622-df8f-41a0-a6fa-8136b00e5789 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:47.659592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3ecef-d5f6-4379-bbfa-001203912dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:47.660322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3ecef-d5f6-4379-bbfa-001203912dae admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.660611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3ecef-d5f6-4379-bbfa-001203912dae admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.660891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3ecef-d5f6-4379-bbfa-001203912dae admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.661627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3ecef-d5f6-4379-bbfa-001203912dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:47.663574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3ecef-d5f6-4379-bbfa-001203912dae admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:47.695580 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 807/1620] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:47 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:47.695580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3ecef-d5f6-4379-bbfa-001203912dae admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:47.710779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051c622-df8f-41a0-a6fa-8136b00e5789 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:47.742920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:47.756314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3ecef-d5f6-4379-bbfa-001203912dae admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:47.761788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42d8f6-d2ee-4ad7-9010-e06c14efdcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:47.762440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42d8f6-d2ee-4ad7-9010-e06c14efdcad admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.762721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42d8f6-d2ee-4ad7-9010-e06c14efdcad admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.763107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42d8f6-d2ee-4ad7-9010-e06c14efdcad admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.763796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42d8f6-d2ee-4ad7-9010-e06c14efdcad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:47.765750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42d8f6-d2ee-4ad7-9010-e06c14efdcad admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:47.769471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5cd36-a04a-43c9-92e6-85451f5158cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:47.770540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5cd36-a04a-43c9-92e6-85451f5158cf admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.770833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5cd36-a04a-43c9-92e6-85451f5158cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.771111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5cd36-a04a-43c9-92e6-85451f5158cf admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.772471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5cd36-a04a-43c9-92e6-85451f5158cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:47.774213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5cd36-a04a-43c9-92e6-85451f5158cf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:47.798531 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 814/1621] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:47 2022] POST /identity/v3/users => generated 306 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:47.799369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5cd36-a04a-43c9-92e6-85451f5158cf admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:47.800023 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 808/1622] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:47 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:47.801200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42d8f6-d2ee-4ad7-9010-e06c14efdcad admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:47.811446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5cd36-a04a-43c9-92e6-85451f5158cf admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:47.842552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:47.875299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b2ddb-44a4-4009-94cc-5dd51acb3da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:47.876258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b2ddb-44a4-4009-94cc-5dd51acb3da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.876490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42d8f6-d2ee-4ad7-9010-e06c14efdcad admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:47.876614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b2ddb-44a4-4009-94cc-5dd51acb3da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.876809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b2ddb-44a4-4009-94cc-5dd51acb3da9 admin admin] PATH_INFO: `/v3/projects/ff96e14a835e4928a68e5df0452ad248/users/d707707ad60a4feb9e766a0e8ed8c2dd/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.878894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b2ddb-44a4-4009-94cc-5dd51acb3da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff96e14a835e4928a68e5df0452ad248, user_id=d707707ad60a4feb9e766a0e8ed8c2dd, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:47.881702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b2ddb-44a4-4009-94cc-5dd51acb3da9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:47.883287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee4d27-a4da-42e0-8c44-9e350984bfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:47.884400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee4d27-a4da-42e0-8c44-9e350984bfb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.885316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee4d27-a4da-42e0-8c44-9e350984bfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.885316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee4d27-a4da-42e0-8c44-9e350984bfb7 admin admin] PATH_INFO: `/v3/projects/4fbf50031e9747178c370f741e59c074/users/c5a45a1afe564b64927c29d0d439847d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.888887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee4d27-a4da-42e0-8c44-9e350984bfb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fbf50031e9747178c370f741e59c074, user_id=c5a45a1afe564b64927c29d0d439847d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:47.893020 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 815/1623] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:47 2022] PUT /identity/v3/projects/ff96e14a835e4928a68e5df0452ad248/users/d707707ad60a4feb9e766a0e8ed8c2dd/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:47.893692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee4d27-a4da-42e0-8c44-9e350984bfb7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:47.893851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b2ddb-44a4-4009-94cc-5dd51acb3da9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:47.908166 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 809/1624] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:47 2022] PUT /identity/v3/projects/4fbf50031e9747178c370f741e59c074/users/c5a45a1afe564b64927c29d0d439847d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:47.909015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee4d27-a4da-42e0-8c44-9e350984bfb7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:47.967302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b2ddb-44a4-4009-94cc-5dd51acb3da9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:47.972180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb6766-6cdf-4a8b-b5e8-2e5bd06c60d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:47.972860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb6766-6cdf-4a8b-b5e8-2e5bd06c60d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.973170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb6766-6cdf-4a8b-b5e8-2e5bd06c60d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.973450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb6766-6cdf-4a8b-b5e8-2e5bd06c60d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.974170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb6766-6cdf-4a8b-b5e8-2e5bd06c60d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:47.975650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee4d27-a4da-42e0-8c44-9e350984bfb7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:47.975848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb6766-6cdf-4a8b-b5e8-2e5bd06c60d6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:47.980469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a54d20-3be8-4fe5-8cb6-d06481e0e321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:47.981118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a54d20-3be8-4fe5-8cb6-d06481e0e321 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:47.981396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a54d20-3be8-4fe5-8cb6-d06481e0e321 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:47.981693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a54d20-3be8-4fe5-8cb6-d06481e0e321 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:47.982378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a54d20-3be8-4fe5-8cb6-d06481e0e321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:47.984304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a54d20-3be8-4fe5-8cb6-d06481e0e321 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:47.986304 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 816/1625] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:47.987084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb6766-6cdf-4a8b-b5e8-2e5bd06c60d6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:48.001011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb6766-6cdf-4a8b-b5e8-2e5bd06c60d6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:48.006833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f75b2-7dc8-43f7-8907-ea2d6b01e6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:48.007519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f75b2-7dc8-43f7-8907-ea2d6b01e6da admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.007816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f75b2-7dc8-43f7-8907-ea2d6b01e6da admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.008129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f75b2-7dc8-43f7-8907-ea2d6b01e6da admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.008814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f75b2-7dc8-43f7-8907-ea2d6b01e6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:48.013744 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 810/1626] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:47 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:48.013886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f75b2-7dc8-43f7-8907-ea2d6b01e6da admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:48.013963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a54d20-3be8-4fe5-8cb6-d06481e0e321 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:48.043509 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 817/1627] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:47 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:48.044532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f75b2-7dc8-43f7-8907-ea2d6b01e6da admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:48.074514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a54d20-3be8-4fe5-8cb6-d06481e0e321 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:48.079539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:48.109186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f75b2-7dc8-43f7-8907-ea2d6b01e6da admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:48.114078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0109d-c226-428d-b83c-1e32d720df55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:48.114852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0109d-c226-428d-b83c-1e32d720df55 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.115131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0109d-c226-428d-b83c-1e32d720df55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.115409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0109d-c226-428d-b83c-1e32d720df55 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.116177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0109d-c226-428d-b83c-1e32d720df55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:48.118045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0109d-c226-428d-b83c-1e32d720df55 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:48.127101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:48.132249 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 818/1628] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:48.132249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0109d-c226-428d-b83c-1e32d720df55 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:48.134042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011e79e-417e-4246-9eba-c2eadcd59e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:48.134897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011e79e-417e-4246-9eba-c2eadcd59e0e admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.135239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011e79e-417e-4246-9eba-c2eadcd59e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.135725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011e79e-417e-4246-9eba-c2eadcd59e0e admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.136547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011e79e-417e-4246-9eba-c2eadcd59e0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:48.138684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011e79e-417e-4246-9eba-c2eadcd59e0e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:48.140389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0109d-c226-428d-b83c-1e32d720df55 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:48.144988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa9663-1d83-4cc6-b58c-c8d9fbaf427e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:48.145639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa9663-1d83-4cc6-b58c-c8d9fbaf427e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.145917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa9663-1d83-4cc6-b58c-c8d9fbaf427e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.146193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa9663-1d83-4cc6-b58c-c8d9fbaf427e admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.146867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa9663-1d83-4cc6-b58c-c8d9fbaf427e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:48.148806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa9663-1d83-4cc6-b58c-c8d9fbaf427e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:48.160060 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 811/1629] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:48 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:48.161349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206157fa-7044-41db-a5c3-4548ee5ae850 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.161632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206157fa-7044-41db-a5c3-4548ee5ae850 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.161905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206157fa-7044-41db-a5c3-4548ee5ae850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.174540 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 819/1630] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:48 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:48.176018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a397738-700b-4b7b-baa7-5b673a4656db None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.176500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a397738-700b-4b7b-baa7-5b673a4656db None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.176916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a397738-700b-4b7b-baa7-5b673a4656db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.188466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-206157fa-7044-41db-a5c3-4548ee5ae850 None None] MFA Rules not processed for user `d707707ad60a4feb9e766a0e8ed8c2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:48.189705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-206157fa-7044-41db-a5c3-4548ee5ae850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:48.204119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6a397738-700b-4b7b-baa7-5b673a4656db None None] MFA Rules not processed for user `c5a45a1afe564b64927c29d0d439847d`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:48.205366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6a397738-700b-4b7b-baa7-5b673a4656db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:48.284806 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 820/1631] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:48 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:48.285495 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 812/1632] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:48 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:48.285928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a397738-700b-4b7b-baa7-5b673a4656db None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:48.286327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206157fa-7044-41db-a5c3-4548ee5ae850 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:48.300822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206157fa-7044-41db-a5c3-4548ee5ae850 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:48.306312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10997fb2-f58b-4b81-9e6c-fd961c1bd2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:48.307046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10997fb2-f58b-4b81-9e6c-fd961c1bd2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.307405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10997fb2-f58b-4b81-9e6c-fd961c1bd2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.307772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10997fb2-f58b-4b81-9e6c-fd961c1bd2f3 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.308632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10997fb2-f58b-4b81-9e6c-fd961c1bd2f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:48.310745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10997fb2-f58b-4b81-9e6c-fd961c1bd2f3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:48.319061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a397738-700b-4b7b-baa7-5b673a4656db None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:48.325678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fc248-04b8-4553-b6a1-e6bb25cb0396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:48.326739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fc248-04b8-4553-b6a1-e6bb25cb0396 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.327118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fc248-04b8-4553-b6a1-e6bb25cb0396 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.327327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fc248-04b8-4553-b6a1-e6bb25cb0396 admin admin] PATH_INFO: `/v3/projects/d42ffae4422e4dbcacf4cf486a83bf81/users/dd85d42d45a043a4b1636effb5d5c424/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.329723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55fc248-04b8-4553-b6a1-e6bb25cb0396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d42ffae4422e4dbcacf4cf486a83bf81, user_id=dd85d42d45a043a4b1636effb5d5c424, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:48.332796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55fc248-04b8-4553-b6a1-e6bb25cb0396 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:48.337737 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 813/1633] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:48 2022] POST /identity/v3/users => generated 295 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:48.338776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10997fb2-f58b-4b81-9e6c-fd961c1bd2f3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:48.354210 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 821/1634] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:48 2022] PUT /identity/v3/projects/d42ffae4422e4dbcacf4cf486a83bf81/users/dd85d42d45a043a4b1636effb5d5c424/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:48.354210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fc248-04b8-4553-b6a1-e6bb25cb0396 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:48.361164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10997fb2-f58b-4b81-9e6c-fd961c1bd2f3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:48.412550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fc248-04b8-4553-b6a1-e6bb25cb0396 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:48.417196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418de28-2984-4942-9876-da46314f0f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:48.418478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418de28-2984-4942-9876-da46314f0f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.418588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8982a7e-2b50-428d-acf4-e4299bd954af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:48.418764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418de28-2984-4942-9876-da46314f0f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.419037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418de28-2984-4942-9876-da46314f0f63 admin admin] PATH_INFO: `/v3/projects/6d7d23bdd8554a3da2d3aebc900f105a/users/439030a81af2433b99277ebe210a0a9f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.419230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8982a7e-2b50-428d-acf4-e4299bd954af admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.419510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8982a7e-2b50-428d-acf4-e4299bd954af admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.419783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8982a7e-2b50-428d-acf4-e4299bd954af admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.420500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8982a7e-2b50-428d-acf4-e4299bd954af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:48.422427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8982a7e-2b50-428d-acf4-e4299bd954af admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:48.433489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418de28-2984-4942-9876-da46314f0f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d7d23bdd8554a3da2d3aebc900f105a, user_id=439030a81af2433b99277ebe210a0a9f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:48.436556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418de28-2984-4942-9876-da46314f0f63 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:48.442980 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 814/1635] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:48 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:48.443682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8982a7e-2b50-428d-acf4-e4299bd954af admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:48.453327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8982a7e-2b50-428d-acf4-e4299bd954af admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:48.453824 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 822/1636] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:48 2022] PUT /identity/v3/projects/6d7d23bdd8554a3da2d3aebc900f105a/users/439030a81af2433b99277ebe210a0a9f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:48.454739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418de28-2984-4942-9876-da46314f0f63 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:48.463455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:48.499380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:48.516171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a61571-7284-4069-a291-6abee000abe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:48.516779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a61571-7284-4069-a291-6abee000abe8 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.517057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a61571-7284-4069-a291-6abee000abe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.517330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a61571-7284-4069-a291-6abee000abe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.518043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a61571-7284-4069-a291-6abee000abe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:48.519659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a61571-7284-4069-a291-6abee000abe8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:48.520515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418de28-2984-4942-9876-da46314f0f63 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:48.525323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654a6c9-a69e-4a39-9814-1caaeeea760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:48.525989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654a6c9-a69e-4a39-9814-1caaeeea760d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.526268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654a6c9-a69e-4a39-9814-1caaeeea760d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.526543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654a6c9-a69e-4a39-9814-1caaeeea760d admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.527293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654a6c9-a69e-4a39-9814-1caaeeea760d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:48.529340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654a6c9-a69e-4a39-9814-1caaeeea760d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:48.530043 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 815/1637] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:48.531305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f10dbc-852e-482c-a955-4660052d3de3 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.531624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f10dbc-852e-482c-a955-4660052d3de3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.531872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f10dbc-852e-482c-a955-4660052d3de3 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.533110 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 816/1638] 10.222.0.43 () {54 vars in 961 bytes} [Sat Jul 2 21:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:00:48.533807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f10dbc-852e-482c-a955-4660052d3de3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:48.540824 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 823/1639] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:48.542297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c21a85-726b-4396-bc7a-7c47740d6b29 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.542631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c21a85-726b-4396-bc7a-7c47740d6b29 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.542932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c21a85-726b-4396-bc7a-7c47740d6b29 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.544402 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 824/1640] 10.222.0.43 () {54 vars in 961 bytes} [Sat Jul 2 21:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:00:48.545490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864b2c4-332b-4e35-a6b0-b9068019d58b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.545881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864b2c4-332b-4e35-a6b0-b9068019d58b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.546127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864b2c4-332b-4e35-a6b0-b9068019d58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.549260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f10dbc-852e-482c-a955-4660052d3de3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:48.553795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb9976-27a9-41e7-9ae2-cf4ae6707545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:48.554442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb9976-27a9-41e7-9ae2-cf4ae6707545 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.554718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb9976-27a9-41e7-9ae2-cf4ae6707545 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.554991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb9976-27a9-41e7-9ae2-cf4ae6707545 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.555688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb9976-27a9-41e7-9ae2-cf4ae6707545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:48.557306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb9976-27a9-41e7-9ae2-cf4ae6707545 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:48.567416 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 817/1641] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:48.568292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb9976-27a9-41e7-9ae2-cf4ae6707545 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:48.572252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b864b2c4-332b-4e35-a6b0-b9068019d58b None None] MFA Rules not processed for user `dd85d42d45a043a4b1636effb5d5c424`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:48.573459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b864b2c4-332b-4e35-a6b0-b9068019d58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:48.577923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb9976-27a9-41e7-9ae2-cf4ae6707545 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:48.583133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65e65f-9325-4785-8844-0cf5d7f95949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:48.583789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65e65f-9325-4785-8844-0cf5d7f95949 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.584092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65e65f-9325-4785-8844-0cf5d7f95949 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.584371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65e65f-9325-4785-8844-0cf5d7f95949 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.585076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65e65f-9325-4785-8844-0cf5d7f95949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:48.586762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65e65f-9325-4785-8844-0cf5d7f95949 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:48.597706 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 818/1642] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:48.598616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65e65f-9325-4785-8844-0cf5d7f95949 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:48.608881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65e65f-9325-4785-8844-0cf5d7f95949 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:48.615371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abbad0-76ad-4cff-9eb5-f662b45e2b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:48.616085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abbad0-76ad-4cff-9eb5-f662b45e2b69 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.616705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abbad0-76ad-4cff-9eb5-f662b45e2b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.616989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abbad0-76ad-4cff-9eb5-f662b45e2b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.618102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abbad0-76ad-4cff-9eb5-f662b45e2b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:48.619702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abbad0-76ad-4cff-9eb5-f662b45e2b69 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:48.630008 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 819/1643] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:48.630713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abbad0-76ad-4cff-9eb5-f662b45e2b69 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:48.639938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abbad0-76ad-4cff-9eb5-f662b45e2b69 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:48.643349 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 825/1644] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:48.644765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc135a8-f6d9-458d-8e4f-112cba76a0c1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.645053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc135a8-f6d9-458d-8e4f-112cba76a0c1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.645330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc135a8-f6d9-458d-8e4f-112cba76a0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.648440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116af245-05bf-4a65-909a-b65588a9b194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:48.649361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116af245-05bf-4a65-909a-b65588a9b194 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.649674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116af245-05bf-4a65-909a-b65588a9b194 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.649937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116af245-05bf-4a65-909a-b65588a9b194 admin admin] PATH_INFO: `/v3/projects/a51f57a3bff440d3995b73b10d26ba63/users/387ec92e4d4f4d909cd222a3d7070d0a/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.665078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116af245-05bf-4a65-909a-b65588a9b194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a51f57a3bff440d3995b73b10d26ba63, user_id=387ec92e4d4f4d909cd222a3d7070d0a, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:48.667724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116af245-05bf-4a65-909a-b65588a9b194 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:48.680924 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 820/1645] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:48 2022] PUT /identity/v3/projects/a51f57a3bff440d3995b73b10d26ba63/users/387ec92e4d4f4d909cd222a3d7070d0a/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:48.681710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116af245-05bf-4a65-909a-b65588a9b194 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:48.706551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8bc135a8-f6d9-458d-8e4f-112cba76a0c1 None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:48.707764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8bc135a8-f6d9-458d-8e4f-112cba76a0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:48.743660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116af245-05bf-4a65-909a-b65588a9b194 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:48.748345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1706a18-e09e-4fb8-94db-411dedfd47a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:48.749231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1706a18-e09e-4fb8-94db-411dedfd47a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.749505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1706a18-e09e-4fb8-94db-411dedfd47a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.749772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1706a18-e09e-4fb8-94db-411dedfd47a8 admin admin] PATH_INFO: `/v3/projects/a2ad02f18d5543ffa99bee36ec3c5feb/users/b9624a988b0342a082163fcfc034703c/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.759797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:48.764830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1706a18-e09e-4fb8-94db-411dedfd47a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ad02f18d5543ffa99bee36ec3c5feb, user_id=b9624a988b0342a082163fcfc034703c, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:48.767560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1706a18-e09e-4fb8-94db-411dedfd47a8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:48.781102 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 821/1646] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:48 2022] PUT /identity/v3/projects/a2ad02f18d5543ffa99bee36ec3c5feb/users/b9624a988b0342a082163fcfc034703c/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:48.782640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711c1fb-aa4a-41d0-abbb-3e06ac41a98f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.782921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711c1fb-aa4a-41d0-abbb-3e06ac41a98f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.783191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711c1fb-aa4a-41d0-abbb-3e06ac41a98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.800267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5711c1fb-aa4a-41d0-abbb-3e06ac41a98f None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:48.801472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5711c1fb-aa4a-41d0-abbb-3e06ac41a98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:48.813370 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 826/1647] 10.222.0.43 () {58 vars in 1058 bytes} [Sat Jul 2 21:00:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:48.814453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc135a8-f6d9-458d-8e4f-112cba76a0c1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:48.824951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc135a8-f6d9-458d-8e4f-112cba76a0c1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:48.858370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:48.870995 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 822/1648] 10.222.0.43 () {58 vars in 1058 bytes} [Sat Jul 2 21:00:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:48.871815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711c1fb-aa4a-41d0-abbb-3e06ac41a98f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:48.886344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a701472-bfe8-4f28-85d5-289fc2f6413f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:48.887368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a701472-bfe8-4f28-85d5-289fc2f6413f admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.887652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a701472-bfe8-4f28-85d5-289fc2f6413f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.887928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a701472-bfe8-4f28-85d5-289fc2f6413f admin admin] PATH_INFO: `/v3/projects/1bdc44d92d9d426c87e325b65ae5ec9d/users/2e4064706a08429592fefdc974b47554/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.903489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a701472-bfe8-4f28-85d5-289fc2f6413f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bdc44d92d9d426c87e325b65ae5ec9d, user_id=2e4064706a08429592fefdc974b47554, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:48.906216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a701472-bfe8-4f28-85d5-289fc2f6413f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:48.920412 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 827/1649] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:48 2022] PUT /identity/v3/projects/1bdc44d92d9d426c87e325b65ae5ec9d/users/2e4064706a08429592fefdc974b47554/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:48.923787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a701472-bfe8-4f28-85d5-289fc2f6413f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:48.935269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711c1fb-aa4a-41d0-abbb-3e06ac41a98f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:48.985662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a701472-bfe8-4f28-85d5-289fc2f6413f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:48.990367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279c194-2358-4a47-85cf-a4fc71690604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:48.990718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43042f3-f07a-42d3-a562-6b0ced433f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:48.991268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279c194-2358-4a47-85cf-a4fc71690604 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.991542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279c194-2358-4a47-85cf-a4fc71690604 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.991633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43042f3-f07a-42d3-a562-6b0ced433f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:48.991815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279c194-2358-4a47-85cf-a4fc71690604 admin admin] PATH_INFO: `/v3/projects/6d7d23bdd8554a3da2d3aebc900f105a/users/439030a81af2433b99277ebe210a0a9f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.991914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43042f3-f07a-42d3-a562-6b0ced433f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:48.992293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43042f3-f07a-42d3-a562-6b0ced433f56 admin admin] PATH_INFO: `/v3/projects/03129da6be614af18c09e2eb1d12b67c/users/d45c44ea336c431da7cc749c8d1c069c/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:48.993832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b279c194-2358-4a47-85cf-a4fc71690604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d7d23bdd8554a3da2d3aebc900f105a, user_id=439030a81af2433b99277ebe210a0a9f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:48.996552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b279c194-2358-4a47-85cf-a4fc71690604 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:49.006403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43042f3-f07a-42d3-a562-6b0ced433f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03129da6be614af18c09e2eb1d12b67c, user_id=d45c44ea336c431da7cc749c8d1c069c, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:49.006750 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 828/1650] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:48 2022] PUT /identity/v3/projects/6d7d23bdd8554a3da2d3aebc900f105a/users/439030a81af2433b99277ebe210a0a9f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:49.007611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279c194-2358-4a47-85cf-a4fc71690604 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:49.009317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43042f3-f07a-42d3-a562-6b0ced433f56 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:49.028639 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 823/1651] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:48 2022] PUT /identity/v3/projects/03129da6be614af18c09e2eb1d12b67c/users/d45c44ea336c431da7cc749c8d1c069c/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:49.029559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43042f3-f07a-42d3-a562-6b0ced433f56 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:49.049671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:49.078721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279c194-2358-4a47-85cf-a4fc71690604 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:49.095790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43042f3-f07a-42d3-a562-6b0ced433f56 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:49.101280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d77094-10b8-4b22-9626-b2750030ccaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:49.101946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d77094-10b8-4b22-9626-b2750030ccaa admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:49.102224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d77094-10b8-4b22-9626-b2750030ccaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:49.102516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d77094-10b8-4b22-9626-b2750030ccaa admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:49.103213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d77094-10b8-4b22-9626-b2750030ccaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:49.105690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d77094-10b8-4b22-9626-b2750030ccaa admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:49.117887 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 824/1652] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:49.118784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d77094-10b8-4b22-9626-b2750030ccaa admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:49.137485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff03076-c522-48a0-bef9-c790f9e9feb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:49.138444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff03076-c522-48a0-bef9-c790f9e9feb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:49.138729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff03076-c522-48a0-bef9-c790f9e9feb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:49.139008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff03076-c522-48a0-bef9-c790f9e9feb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:49.139763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff03076-c522-48a0-bef9-c790f9e9feb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:49.141445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff03076-c522-48a0-bef9-c790f9e9feb5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:49.146972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:49.153440 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 829/1653] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:49.157174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff03076-c522-48a0-bef9-c790f9e9feb5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:49.195125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d77094-10b8-4b22-9626-b2750030ccaa admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:49.200812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff2620-6638-41c0-9af0-8cd688a409cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:49.201461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff2620-6638-41c0-9af0-8cd688a409cc service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:49.201748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff2620-6638-41c0-9af0-8cd688a409cc service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:49.202021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff2620-6638-41c0-9af0-8cd688a409cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:49.229486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff03076-c522-48a0-bef9-c790f9e9feb5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:49.235209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d81531-e659-494e-8fa8-396eb23eb01d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:49.235884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d81531-e659-494e-8fa8-396eb23eb01d service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:49.236205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d81531-e659-494e-8fa8-396eb23eb01d service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:49.236522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d81531-e659-494e-8fa8-396eb23eb01d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:49.266222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff2620-6638-41c0-9af0-8cd688a409cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:49.267831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff2620-6638-41c0-9af0-8cd688a409cc service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:49.278390 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 825/1654] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:49 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:49.279256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff2620-6638-41c0-9af0-8cd688a409cc service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:49.293895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff2620-6638-41c0-9af0-8cd688a409cc service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:49.295695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d81531-e659-494e-8fa8-396eb23eb01d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:49.297349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d81531-e659-494e-8fa8-396eb23eb01d service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:49.301315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45767c6a-f0c5-4044-85ee-d18565427cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:49.302039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45767c6a-f0c5-4044-85ee-d18565427cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:49.302382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45767c6a-f0c5-4044-85ee-d18565427cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:49.303199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45767c6a-f0c5-4044-85ee-d18565427cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:49.303493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45767c6a-f0c5-4044-85ee-d18565427cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:49.305626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45767c6a-f0c5-4044-85ee-d18565427cb1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:49.308333 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 830/1655] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:49 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:49.317717 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 826/1656] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:49.318538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45767c6a-f0c5-4044-85ee-d18565427cb1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:49.318762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9b74d-c361-4a32-9675-8074666a1fbc None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:49.319343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9b74d-c361-4a32-9675-8074666a1fbc None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:49.319768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9b74d-c361-4a32-9675-8074666a1fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:49.328933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45767c6a-f0c5-4044-85ee-d18565427cb1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:49.334398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29f7b7-09a0-4c6a-af93-2db40d222e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:49.335173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f7b7-09a0-4c6a-af93-2db40d222e1e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:49.335455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f7b7-09a0-4c6a-af93-2db40d222e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:49.335844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f7b7-09a0-4c6a-af93-2db40d222e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:49.336590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29f7b7-09a0-4c6a-af93-2db40d222e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:49.338176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29f7b7-09a0-4c6a-af93-2db40d222e1e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:49.345330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:49.349923 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 827/1657] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:49.350843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29f7b7-09a0-4c6a-af93-2db40d222e1e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:49.360458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e3d9b74d-c361-4a32-9675-8074666a1fbc None None] MFA Rules not processed for user `439030a81af2433b99277ebe210a0a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:49.361669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29f7b7-09a0-4c6a-af93-2db40d222e1e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:49.362378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e3d9b74d-c361-4a32-9675-8074666a1fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:49.366589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d1bb1-6bc5-4c6b-af66-ba0f6f299e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:49.367484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d1bb1-6bc5-4c6b-af66-ba0f6f299e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:49.367806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d1bb1-6bc5-4c6b-af66-ba0f6f299e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:49.368323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d1bb1-6bc5-4c6b-af66-ba0f6f299e36 admin admin] PATH_INFO: `/v3/projects/a2ad02f18d5543ffa99bee36ec3c5feb/users/b9624a988b0342a082163fcfc034703c/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:49.370561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d1bb1-6bc5-4c6b-af66-ba0f6f299e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ad02f18d5543ffa99bee36ec3c5feb, user_id=b9624a988b0342a082163fcfc034703c, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:49.373379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d1bb1-6bc5-4c6b-af66-ba0f6f299e36 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:49.396812 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 828/1658] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:49 2022] PUT /identity/v3/projects/a2ad02f18d5543ffa99bee36ec3c5feb/users/b9624a988b0342a082163fcfc034703c/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:49.396812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d1bb1-6bc5-4c6b-af66-ba0f6f299e36 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:49.454294 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 831/1659] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:49 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:49.455310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9b74d-c361-4a32-9675-8074666a1fbc None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:49.467142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9b74d-c361-4a32-9675-8074666a1fbc None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:49.480254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d1bb1-6bc5-4c6b-af66-ba0f6f299e36 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:49.485949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d6d74-ba5a-4f41-a64f-0d67a3afb593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:49.487457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d6d74-ba5a-4f41-a64f-0d67a3afb593 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:49.487893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d6d74-ba5a-4f41-a64f-0d67a3afb593 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:49.488901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d6d74-ba5a-4f41-a64f-0d67a3afb593 admin admin] PATH_INFO: `/v3/projects/a51f57a3bff440d3995b73b10d26ba63/users/387ec92e4d4f4d909cd222a3d7070d0a/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:49.492434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d6d74-ba5a-4f41-a64f-0d67a3afb593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a51f57a3bff440d3995b73b10d26ba63, user_id=387ec92e4d4f4d909cd222a3d7070d0a, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:49.496580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d6d74-ba5a-4f41-a64f-0d67a3afb593 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:49.521024 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 829/1660] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:49 2022] PUT /identity/v3/projects/a51f57a3bff440d3995b73b10d26ba63/users/387ec92e4d4f4d909cd222a3d7070d0a/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:49.521024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d6d74-ba5a-4f41-a64f-0d67a3afb593 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:49.539444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871aed0-cde6-4547-806a-38e7e00e1879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:49.539641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:49.540814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871aed0-cde6-4547-806a-38e7e00e1879 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:49.541276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871aed0-cde6-4547-806a-38e7e00e1879 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:49.541701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871aed0-cde6-4547-806a-38e7e00e1879 admin admin] PATH_INFO: `/v3/projects/1bdc44d92d9d426c87e325b65ae5ec9d/users/2e4064706a08429592fefdc974b47554/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:49.544142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871aed0-cde6-4547-806a-38e7e00e1879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bdc44d92d9d426c87e325b65ae5ec9d, user_id=2e4064706a08429592fefdc974b47554, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:49.547088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871aed0-cde6-4547-806a-38e7e00e1879 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:49.560010 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 832/1661] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:49 2022] PUT /identity/v3/projects/1bdc44d92d9d426c87e325b65ae5ec9d/users/2e4064706a08429592fefdc974b47554/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:49.570865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9da7a-97d1-42ae-a6de-01928663041c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:49.571161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9da7a-97d1-42ae-a6de-01928663041c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:49.571437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9da7a-97d1-42ae-a6de-01928663041c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:49.598285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ffe9da7a-97d1-42ae-a6de-01928663041c None None] MFA Rules not processed for user `b9624a988b0342a082163fcfc034703c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:49.599506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ffe9da7a-97d1-42ae-a6de-01928663041c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:49.602416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d6d74-ba5a-4f41-a64f-0d67a3afb593 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:49.661913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e761c-c3f4-4ef4-ba60-aeebbcfe32e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:49.662814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e761c-c3f4-4ef4-ba60-aeebbcfe32e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:49.663098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e761c-c3f4-4ef4-ba60-aeebbcfe32e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:49.663378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e761c-c3f4-4ef4-ba60-aeebbcfe32e8 admin admin] PATH_INFO: `/v3/projects/03129da6be614af18c09e2eb1d12b67c/users/d45c44ea336c431da7cc749c8d1c069c/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:49.665437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e761c-c3f4-4ef4-ba60-aeebbcfe32e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03129da6be614af18c09e2eb1d12b67c, user_id=d45c44ea336c431da7cc749c8d1c069c, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:49.666409 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 833/1662] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:49.667798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58049d6c-e7e4-4cc9-b46a-38a68b92d3f7 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:49.668118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58049d6c-e7e4-4cc9-b46a-38a68b92d3f7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:49.668224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e761c-c3f4-4ef4-ba60-aeebbcfe32e8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:49.668398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58049d6c-e7e4-4cc9-b46a-38a68b92d3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:49.679121 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 830/1663] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:49 2022] PUT /identity/v3/projects/03129da6be614af18c09e2eb1d12b67c/users/d45c44ea336c431da7cc749c8d1c069c/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:49.679970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e761c-c3f4-4ef4-ba60-aeebbcfe32e8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:49.697923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:49.701404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-58049d6c-e7e4-4cc9-b46a-38a68b92d3f7 None None] MFA Rules not processed for user `387ec92e4d4f4d909cd222a3d7070d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:49.704272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-58049d6c-e7e4-4cc9-b46a-38a68b92d3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:49.762243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e761c-c3f4-4ef4-ba60-aeebbcfe32e8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:49.768472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fe903-9a6b-49b6-8a05-042029dbac5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:49.769107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fe903-9a6b-49b6-8a05-042029dbac5e service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:49.769394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fe903-9a6b-49b6-8a05-042029dbac5e service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:49.769680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fe903-9a6b-49b6-8a05-042029dbac5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:49.774621 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 834/1664] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:49.775993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856af16-afd5-4838-b2be-74e1d9a51dac None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:49.776317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856af16-afd5-4838-b2be-74e1d9a51dac None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:49.776589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856af16-afd5-4838-b2be-74e1d9a51dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:49.804839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f856af16-afd5-4838-b2be-74e1d9a51dac None None] MFA Rules not processed for user `2e4064706a08429592fefdc974b47554`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:49.806028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f856af16-afd5-4838-b2be-74e1d9a51dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:49.836860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:49.848943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fe903-9a6b-49b6-8a05-042029dbac5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:49.850537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fe903-9a6b-49b6-8a05-042029dbac5e service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:49.860368 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 831/1665] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:49.861250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fe903-9a6b-49b6-8a05-042029dbac5e service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:49.872421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fe903-9a6b-49b6-8a05-042029dbac5e service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:49.878098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09397a9e-46c5-4b15-b102-6d91b77297b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:49.878739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09397a9e-46c5-4b15-b102-6d91b77297b1 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:49.879016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09397a9e-46c5-4b15-b102-6d91b77297b1 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:49.879288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09397a9e-46c5-4b15-b102-6d91b77297b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:49.886740 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 835/1666] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:49.888246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd1ceb-e80a-496b-8905-c7b204e1fcb6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:49.888541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd1ceb-e80a-496b-8905-c7b204e1fcb6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:49.888820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd1ceb-e80a-496b-8905-c7b204e1fcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:49.922239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f2bd1ceb-e80a-496b-8905-c7b204e1fcb6 None None] MFA Rules not processed for user `d45c44ea336c431da7cc749c8d1c069c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:49.923472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f2bd1ceb-e80a-496b-8905-c7b204e1fcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:49.957980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09397a9e-46c5-4b15-b102-6d91b77297b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:49.959690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09397a9e-46c5-4b15-b102-6d91b77297b1 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:49.969789 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 832/1667] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:49 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:49.970670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09397a9e-46c5-4b15-b102-6d91b77297b1 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:49.981672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09397a9e-46c5-4b15-b102-6d91b77297b1 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:49.987696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc6a1b-97c7-498e-9836-0e80d1220cef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:49.988380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc6a1b-97c7-498e-9836-0e80d1220cef service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:49.988666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc6a1b-97c7-498e-9836-0e80d1220cef service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:49.989174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc6a1b-97c7-498e-9836-0e80d1220cef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:50.008438 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 836/1668] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:50.054770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd1ceb-e80a-496b-8905-c7b204e1fcb6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:50.060003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc6a1b-97c7-498e-9836-0e80d1220cef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:50.061647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc6a1b-97c7-498e-9836-0e80d1220cef service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:50.065365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:50.071396 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 833/1669] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:49 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:50.072245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc6a1b-97c7-498e-9836-0e80d1220cef service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:50.083057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc6a1b-97c7-498e-9836-0e80d1220cef service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:50.089451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24107ceb-c874-42dc-b798-4c27841d5c3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:50.091942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24107ceb-c874-42dc-b798-4c27841d5c3d service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:50.091942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24107ceb-c874-42dc-b798-4c27841d5c3d service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:50.093301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24107ceb-c874-42dc-b798-4c27841d5c3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:50.131069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd1ceb-e80a-496b-8905-c7b204e1fcb6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:50.136357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468273f-7a77-4ede-a676-64ac703786ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:50.137313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468273f-7a77-4ede-a676-64ac703786ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:50.137596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468273f-7a77-4ede-a676-64ac703786ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:50.137873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468273f-7a77-4ede-a676-64ac703786ce admin admin] PATH_INFO: `/v3/users/bb4fd1236bf6401db0c45c78c56dbbc4` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:50.139087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468273f-7a77-4ede-a676-64ac703786ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb4fd1236bf6401db0c45c78c56dbbc4)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:50.140170 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-9468273f-7a77-4ede-a676-64ac703786ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:50.140170 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:00:50.140170 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:00:50.141385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468273f-7a77-4ede-a676-64ac703786ce admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:50.159423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24107ceb-c874-42dc-b798-4c27841d5c3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:50.161085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24107ceb-c874-42dc-b798-4c27841d5c3d service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:50.172933 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 834/1670] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:50.173759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24107ceb-c874-42dc-b798-4c27841d5c3d service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:50.184855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24107ceb-c874-42dc-b798-4c27841d5c3d service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:50.192990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50ad57-b1bf-45fb-b6ed-e16dd83021da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:50.193830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50ad57-b1bf-45fb-b6ed-e16dd83021da service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:50.194203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50ad57-b1bf-45fb-b6ed-e16dd83021da service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:50.194583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50ad57-b1bf-45fb-b6ed-e16dd83021da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:50.204073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50ad57-b1bf-45fb-b6ed-e16dd83021da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:50.205687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50ad57-b1bf-45fb-b6ed-e16dd83021da service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:50.210981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9468273f-7a77-4ede-a676-64ac703786ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb4fd1236bf6401db0c45c78c56dbbc4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:50.216416 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 835/1671] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:50.220613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9468273f-7a77-4ede-a676-64ac703786ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb4fd1236bf6401db0c45c78c56dbbc4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:50.221704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9468273f-7a77-4ede-a676-64ac703786ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb4fd1236bf6401db0c45c78c56dbbc4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:50.222525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9468273f-7a77-4ede-a676-64ac703786ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb4fd1236bf6401db0c45c78c56dbbc4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:50.236149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9468273f-7a77-4ede-a676-64ac703786ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb4fd1236bf6401db0c45c78c56dbbc4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:50.249887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50ad57-b1bf-45fb-b6ed-e16dd83021da service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:50.255880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:50.262177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50ad57-b1bf-45fb-b6ed-e16dd83021da service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:50.268792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15999c-a921-406c-823e-856474e7f1b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:50.269514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15999c-a921-406c-823e-856474e7f1b9 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:50.269864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15999c-a921-406c-823e-856474e7f1b9 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:50.270206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15999c-a921-406c-823e-856474e7f1b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:50.272573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ab15999c-a921-406c-823e-856474e7f1b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:50.275229 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 837/1672] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:00:50 2022] DELETE /identity/v3/users/bb4fd1236bf6401db0c45c78c56dbbc4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:50.280656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5eee9-de20-45f9-b5e9-015f4120b418 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:50.281082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5eee9-de20-45f9-b5e9-015f4120b418 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:50.281377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5eee9-de20-45f9-b5e9-015f4120b418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:50.286155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15999c-a921-406c-823e-856474e7f1b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:50.287816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15999c-a921-406c-823e-856474e7f1b9 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:50.302736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b5f5eee9-de20-45f9-b5e9-015f4120b418 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:50.302936 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 836/1673] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:00:50.303758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15999c-a921-406c-823e-856474e7f1b9 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:50.305160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ab15999c-a921-406c-823e-856474e7f1b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:50.305637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b5f5eee9-de20-45f9-b5e9-015f4120b418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:50.319055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15999c-a921-406c-823e-856474e7f1b9 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:50.379573 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 838/1674] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:00:50.380397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5eee9-de20-45f9-b5e9-015f4120b418 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:50.381706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b5f5eee9-de20-45f9-b5e9-015f4120b418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:50.401886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef70c2-017d-49a4-9a45-48e6709da59e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:50.402906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef70c2-017d-49a4-9a45-48e6709da59e service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:50.403184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef70c2-017d-49a4-9a45-48e6709da59e service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:50.403455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef70c2-017d-49a4-9a45-48e6709da59e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:50.405302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7fef70c2-017d-49a4-9a45-48e6709da59e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:50.413682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:50.458000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5eee9-de20-45f9-b5e9-015f4120b418 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:50.464196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2644c9d-74c9-472f-ad7f-ce29e2d0cc63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:50.464377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef70c2-017d-49a4-9a45-48e6709da59e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:50.464904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2644c9d-74c9-472f-ad7f-ce29e2d0cc63 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:50.465181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2644c9d-74c9-472f-ad7f-ce29e2d0cc63 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:50.465450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2644c9d-74c9-472f-ad7f-ce29e2d0cc63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:50.465865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef70c2-017d-49a4-9a45-48e6709da59e service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:50.467265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c2644c9d-74c9-472f-ad7f-ce29e2d0cc63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:50.474892 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 837/1675] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:50.475728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef70c2-017d-49a4-9a45-48e6709da59e service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:50.476998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7fef70c2-017d-49a4-9a45-48e6709da59e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:50.546014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2644c9d-74c9-472f-ad7f-ce29e2d0cc63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:50.548011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2644c9d-74c9-472f-ad7f-ce29e2d0cc63 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:50.559883 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 839/1676] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:50.566854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef70c2-017d-49a4-9a45-48e6709da59e service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:50.570697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6af46-2b4e-477a-b47f-791a0f1399d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:50.571283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6af46-2b4e-477a-b47f-791a0f1399d1 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:50.573217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6af46-2b4e-477a-b47f-791a0f1399d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:50.573217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6af46-2b4e-477a-b47f-791a0f1399d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:50.585577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2644c9d-74c9-472f-ad7f-ce29e2d0cc63 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:50.587453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c2644c9d-74c9-472f-ad7f-ce29e2d0cc63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:50.596104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6af46-2b4e-477a-b47f-791a0f1399d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:50.597794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6af46-2b4e-477a-b47f-791a0f1399d1 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:50.611777 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 838/1677] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:50.612698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6af46-2b4e-477a-b47f-791a0f1399d1 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:50.614149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-72d6af46-2b4e-477a-b47f-791a0f1399d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:50.615922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2644c9d-74c9-472f-ad7f-ce29e2d0cc63 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:50.621096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba4612-3002-48eb-90b2-b97dfa43a64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:50.622296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba4612-3002-48eb-90b2-b97dfa43a64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:50.622732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba4612-3002-48eb-90b2-b97dfa43a64f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:50.623058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba4612-3002-48eb-90b2-b97dfa43a64f admin admin] PATH_INFO: `/v3/users/031d2a0dc253402e82289c197d9cfd5d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:50.624711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba4612-3002-48eb-90b2-b97dfa43a64f admin admin] RBAC: Authorizing `identity:delete_user(user_id=031d2a0dc253402e82289c197d9cfd5d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:50.627191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba4612-3002-48eb-90b2-b97dfa43a64f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:50.635726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6af46-2b4e-477a-b47f-791a0f1399d1 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:50.647745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac0368-2a2c-4b28-a1e5-ea8e936c7b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:50.648723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac0368-2a2c-4b28-a1e5-ea8e936c7b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:50.648979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac0368-2a2c-4b28-a1e5-ea8e936c7b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:50.649253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac0368-2a2c-4b28-a1e5-ea8e936c7b76 admin admin] PATH_INFO: `/v3/users/3e60c8745b5b4bcdaf75e83b4264dd3b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:50.651968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac0368-2a2c-4b28-a1e5-ea8e936c7b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e60c8745b5b4bcdaf75e83b4264dd3b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:50.654383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac0368-2a2c-4b28-a1e5-ea8e936c7b76 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:50.662713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:50.740017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e3ba4612-3002-48eb-90b2-b97dfa43a64f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '031d2a0dc253402e82289c197d9cfd5d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:50.758560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e3ba4612-3002-48eb-90b2-b97dfa43a64f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '031d2a0dc253402e82289c197d9cfd5d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:50.760759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e3ba4612-3002-48eb-90b2-b97dfa43a64f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '031d2a0dc253402e82289c197d9cfd5d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:50.762200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e3ba4612-3002-48eb-90b2-b97dfa43a64f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '031d2a0dc253402e82289c197d9cfd5d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:50.767009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d2ac0368-2a2c-4b28-a1e5-ea8e936c7b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e60c8745b5b4bcdaf75e83b4264dd3b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:50.781140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d2ac0368-2a2c-4b28-a1e5-ea8e936c7b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e60c8745b5b4bcdaf75e83b4264dd3b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:50.789567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e3ba4612-3002-48eb-90b2-b97dfa43a64f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '031d2a0dc253402e82289c197d9cfd5d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:50.801877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d2ac0368-2a2c-4b28-a1e5-ea8e936c7b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e60c8745b5b4bcdaf75e83b4264dd3b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:50.814487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d2ac0368-2a2c-4b28-a1e5-ea8e936c7b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e60c8745b5b4bcdaf75e83b4264dd3b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:50.816424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d2ac0368-2a2c-4b28-a1e5-ea8e936c7b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e60c8745b5b4bcdaf75e83b4264dd3b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:50.847872 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 840/1678] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:00:50 2022] DELETE /identity/v3/users/031d2a0dc253402e82289c197d9cfd5d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:00:50.851021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e189ea-2df2-4443-b8bb-c32ba7a05881 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:50.851311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e189ea-2df2-4443-b8bb-c32ba7a05881 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:50.851865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e189ea-2df2-4443-b8bb-c32ba7a05881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:50.864077 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 839/1679] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:00:50 2022] DELETE /identity/v3/users/3e60c8745b5b4bcdaf75e83b4264dd3b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:50.865575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df02be4-6d11-4a2c-b2e9-260b74b4c45d None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:50.865828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df02be4-6d11-4a2c-b2e9-260b74b4c45d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:50.866066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df02be4-6d11-4a2c-b2e9-260b74b4c45d None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:50.867835 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 840/1680] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:00:50.869192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c58de9-fcf9-4af3-9305-15553fc554a2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:50.869303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c58de9-fcf9-4af3-9305-15553fc554a2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:50.869580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c58de9-fcf9-4af3-9305-15553fc554a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:50.887770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-48e189ea-2df2-4443-b8bb-c32ba7a05881 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:50.889464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-11c58de9-fcf9-4af3-9305-15553fc554a2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:50.889599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-48e189ea-2df2-4443-b8bb-c32ba7a05881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:50.890655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-11c58de9-fcf9-4af3-9305-15553fc554a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:50.939866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:50.977733 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 841/1681] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:50.979903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84de0a-33b2-41b4-a03f-c65c83533cac None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:50.979903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84de0a-33b2-41b4-a03f-c65c83533cac None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:50.979903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84de0a-33b2-41b4-a03f-c65c83533cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:50.987823 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 841/1682] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:50.989693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e189ea-2df2-4443-b8bb-c32ba7a05881 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:50.991632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-48e189ea-2df2-4443-b8bb-c32ba7a05881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:51.068408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9a84de0a-33b2-41b4-a03f-c65c83533cac None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:51.070770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9a84de0a-33b2-41b4-a03f-c65c83533cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:51.098916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e189ea-2df2-4443-b8bb-c32ba7a05881 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:51.106117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4d209-50bf-419d-a3e4-1396af5a4443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:51.106983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4d209-50bf-419d-a3e4-1396af5a4443 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:51.107330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4d209-50bf-419d-a3e4-1396af5a4443 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:51.107721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4d209-50bf-419d-a3e4-1396af5a4443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:51.121429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4d209-50bf-419d-a3e4-1396af5a4443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:51.124286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4d209-50bf-419d-a3e4-1396af5a4443 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:51.136642 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 842/1683] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:00:51.137362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4d209-50bf-419d-a3e4-1396af5a4443 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:51.138760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bcf4d209-50bf-419d-a3e4-1396af5a4443 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:51.143855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:51.159709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4d209-50bf-419d-a3e4-1396af5a4443 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:51.164787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e1d0f-1b0b-4000-a056-f2afcd973038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:51.165740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e1d0f-1b0b-4000-a056-f2afcd973038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:51.166472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e1d0f-1b0b-4000-a056-f2afcd973038 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:51.166472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e1d0f-1b0b-4000-a056-f2afcd973038 admin admin] PATH_INFO: `/v3/users/765027ff05394688851476e92d182d9a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:51.168169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e1d0f-1b0b-4000-a056-f2afcd973038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=765027ff05394688851476e92d182d9a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:51.170620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e1d0f-1b0b-4000-a056-f2afcd973038 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:51.196007 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 842/1684] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:51.197316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84de0a-33b2-41b4-a03f-c65c83533cac None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:51.199120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9a84de0a-33b2-41b4-a03f-c65c83533cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:51.217444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84de0a-33b2-41b4-a03f-c65c83533cac None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:51.223200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476a257-b0a0-4965-ba04-dcf8b11d96e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:51.223870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476a257-b0a0-4965-ba04-dcf8b11d96e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:51.224232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476a257-b0a0-4965-ba04-dcf8b11d96e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:51.224541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476a257-b0a0-4965-ba04-dcf8b11d96e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:51.241284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-275e1d0f-1b0b-4000-a056-f2afcd973038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765027ff05394688851476e92d182d9a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.243964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476a257-b0a0-4965-ba04-dcf8b11d96e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:51.245854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476a257-b0a0-4965-ba04-dcf8b11d96e9 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:51.253099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-275e1d0f-1b0b-4000-a056-f2afcd973038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765027ff05394688851476e92d182d9a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.254110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-275e1d0f-1b0b-4000-a056-f2afcd973038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765027ff05394688851476e92d182d9a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.255019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-275e1d0f-1b0b-4000-a056-f2afcd973038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765027ff05394688851476e92d182d9a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.265941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-275e1d0f-1b0b-4000-a056-f2afcd973038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765027ff05394688851476e92d182d9a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.269169 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 843/1685] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:51.270100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476a257-b0a0-4965-ba04-dcf8b11d96e9 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:51.271491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0476a257-b0a0-4965-ba04-dcf8b11d96e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:51.290623 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 843/1686] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:00:51 2022] DELETE /identity/v3/users/765027ff05394688851476e92d182d9a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:51.292498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc75eb5-d82a-4621-9094-08bf03ee51ca None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:51.292771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc75eb5-d82a-4621-9094-08bf03ee51ca None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:51.293229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc75eb5-d82a-4621-9094-08bf03ee51ca None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:51.296971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476a257-b0a0-4965-ba04-dcf8b11d96e9 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:51.299984 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 844/1687] 10.222.0.43 () {54 vars in 960 bytes} [Sat Jul 2 21:00:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:00:51.301492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ed570-9447-425e-8ece-9de1519b8f3e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:51.301776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ed570-9447-425e-8ece-9de1519b8f3e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:51.302240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ed570-9447-425e-8ece-9de1519b8f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:51.334809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f72ed570-9447-425e-8ece-9de1519b8f3e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:51.336682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f72ed570-9447-425e-8ece-9de1519b8f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:51.398856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:51.407658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54268b-87bd-4799-b577-021b26cc2cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:51.409858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54268b-87bd-4799-b577-021b26cc2cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:51.410195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54268b-87bd-4799-b577-021b26cc2cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:51.410672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54268b-87bd-4799-b577-021b26cc2cb1 admin admin] PATH_INFO: `/v3/projects/6bdc6de09f4c4eee86457474d257f369` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:51.417373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54268b-87bd-4799-b577-021b26cc2cb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bdc6de09f4c4eee86457474d257f369)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:51.418782 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-2e54268b-87bd-4799-b577-021b26cc2cb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:51.418782 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:00:51.418782 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:00:51.420454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54268b-87bd-4799-b577-021b26cc2cb1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:51.435979 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 845/1688] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:51.437678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab236fd7-1d37-4726-9191-f73903dc07f7 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:51.438133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab236fd7-1d37-4726-9191-f73903dc07f7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:51.438568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab236fd7-1d37-4726-9191-f73903dc07f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:51.460484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ab236fd7-1d37-4726-9191-f73903dc07f7 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:51.462255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ab236fd7-1d37-4726-9191-f73903dc07f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:51.537589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2e54268b-87bd-4799-b577-021b26cc2cb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bdc6de09f4c4eee86457474d257f369', 'request_id': 'req-2e54268b-87bd-4799-b577-021b26cc2cb1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.554186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2e54268b-87bd-4799-b577-021b26cc2cb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bdc6de09f4c4eee86457474d257f369', 'request_id': 'req-2e54268b-87bd-4799-b577-021b26cc2cb1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.563162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2e54268b-87bd-4799-b577-021b26cc2cb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bdc6de09f4c4eee86457474d257f369', 'request_id': 'req-2e54268b-87bd-4799-b577-021b26cc2cb1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.583229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2e54268b-87bd-4799-b577-021b26cc2cb1 admin admin] The token cache is being invalidate because project 6bdc6de09f4c4eee86457474d257f369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:00:51.583463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2e54268b-87bd-4799-b577-021b26cc2cb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.584228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2e54268b-87bd-4799-b577-021b26cc2cb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.585847 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 844/1689] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:00:51 2022] DELETE /identity/v3/projects/6bdc6de09f4c4eee86457474d257f369 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:51.586801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54268b-87bd-4799-b577-021b26cc2cb1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:51.588012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2e54268b-87bd-4799-b577-021b26cc2cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:51.610039 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 846/1690] 10.222.0.43 () {58 vars in 1057 bytes} [Sat Jul 2 21:00:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:51.611748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab236fd7-1d37-4726-9191-f73903dc07f7 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:51.613896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ab236fd7-1d37-4726-9191-f73903dc07f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:51.628467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab236fd7-1d37-4726-9191-f73903dc07f7 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:51.657013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54268b-87bd-4799-b577-021b26cc2cb1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:51.667869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02467d89-5b3d-4c63-89af-2f54264b6d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:51.668579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02467d89-5b3d-4c63-89af-2f54264b6d3f service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:51.668856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02467d89-5b3d-4c63-89af-2f54264b6d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:51.669148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02467d89-5b3d-4c63-89af-2f54264b6d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:51.671091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-02467d89-5b3d-4c63-89af-2f54264b6d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:51.685709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:51.702468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40236a-2fad-4e77-b359-78f28df05571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:51.703348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40236a-2fad-4e77-b359-78f28df05571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:51.703623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40236a-2fad-4e77-b359-78f28df05571 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:51.703901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40236a-2fad-4e77-b359-78f28df05571 admin admin] PATH_INFO: `/v3/projects/c44f2953a422441c8c6b6cb9ef62f295` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:51.705151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40236a-2fad-4e77-b359-78f28df05571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c44f2953a422441c8c6b6cb9ef62f295)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:51.707120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40236a-2fad-4e77-b359-78f28df05571 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:51.738249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02467d89-5b3d-4c63-89af-2f54264b6d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:51.739711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02467d89-5b3d-4c63-89af-2f54264b6d3f service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:51.749405 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 845/1691] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:51.753889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ed40236a-2fad-4e77-b359-78f28df05571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44f2953a422441c8c6b6cb9ef62f295', 'request_id': 'req-ed40236a-2fad-4e77-b359-78f28df05571'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.756192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02467d89-5b3d-4c63-89af-2f54264b6d3f service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:51.757650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-02467d89-5b3d-4c63-89af-2f54264b6d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:51.763447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ed40236a-2fad-4e77-b359-78f28df05571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44f2953a422441c8c6b6cb9ef62f295', 'request_id': 'req-ed40236a-2fad-4e77-b359-78f28df05571'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.772193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ed40236a-2fad-4e77-b359-78f28df05571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44f2953a422441c8c6b6cb9ef62f295', 'request_id': 'req-ed40236a-2fad-4e77-b359-78f28df05571'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.784281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ed40236a-2fad-4e77-b359-78f28df05571 admin admin] The token cache is being invalidate because project c44f2953a422441c8c6b6cb9ef62f295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:00:51.785022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ed40236a-2fad-4e77-b359-78f28df05571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.785279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ed40236a-2fad-4e77-b359-78f28df05571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.786950 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 847/1692] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:00:51 2022] DELETE /identity/v3/projects/c44f2953a422441c8c6b6cb9ef62f295 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:51.787761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40236a-2fad-4e77-b359-78f28df05571 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:51.789363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ed40236a-2fad-4e77-b359-78f28df05571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:51.818080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:51.855174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02467d89-5b3d-4c63-89af-2f54264b6d3f service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:51.863337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40236a-2fad-4e77-b359-78f28df05571 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:51.869515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39caa6ae-409a-4bc3-a31d-bf9f511e49a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:51.870575 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39caa6ae-409a-4bc3-a31d-bf9f511e49a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:51.870862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39caa6ae-409a-4bc3-a31d-bf9f511e49a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:51.871270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39caa6ae-409a-4bc3-a31d-bf9f511e49a0 admin admin] PATH_INFO: `/v3/users/c5a45a1afe564b64927c29d0d439847d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:51.872541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39caa6ae-409a-4bc3-a31d-bf9f511e49a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a45a1afe564b64927c29d0d439847d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:51.874789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39caa6ae-409a-4bc3-a31d-bf9f511e49a0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:51.934613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a312f-a2fa-4c10-9dfe-e2051028f1c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:51.935646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a312f-a2fa-4c10-9dfe-e2051028f1c5 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:51.936087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a312f-a2fa-4c10-9dfe-e2051028f1c5 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:51.936606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a312f-a2fa-4c10-9dfe-e2051028f1c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:51.938692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fc4a312f-a2fa-4c10-9dfe-e2051028f1c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:51.939486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-39caa6ae-409a-4bc3-a31d-bf9f511e49a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a45a1afe564b64927c29d0d439847d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.948963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-39caa6ae-409a-4bc3-a31d-bf9f511e49a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a45a1afe564b64927c29d0d439847d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.949757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-39caa6ae-409a-4bc3-a31d-bf9f511e49a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a45a1afe564b64927c29d0d439847d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.950379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-39caa6ae-409a-4bc3-a31d-bf9f511e49a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a45a1afe564b64927c29d0d439847d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.958868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-39caa6ae-409a-4bc3-a31d-bf9f511e49a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a45a1afe564b64927c29d0d439847d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:51.978960 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 848/1693] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:00:51 2022] DELETE /identity/v3/users/c5a45a1afe564b64927c29d0d439847d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:51.980349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39caa6ae-409a-4bc3-a31d-bf9f511e49a0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:51.982117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-39caa6ae-409a-4bc3-a31d-bf9f511e49a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:51.996873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:52.013046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a312f-a2fa-4c10-9dfe-e2051028f1c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:52.014904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a312f-a2fa-4c10-9dfe-e2051028f1c5 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:52.026546 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 846/1694] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:52.027991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a312f-a2fa-4c10-9dfe-e2051028f1c5 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:52.029587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fc4a312f-a2fa-4c10-9dfe-e2051028f1c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:52.047674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a312f-a2fa-4c10-9dfe-e2051028f1c5 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:52.133916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39caa6ae-409a-4bc3-a31d-bf9f511e49a0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:52.142092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91fc8d-b8bd-48fc-b428-27905c53b828 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:52.145160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91fc8d-b8bd-48fc-b428-27905c53b828 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:52.145513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91fc8d-b8bd-48fc-b428-27905c53b828 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:52.146122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91fc8d-b8bd-48fc-b428-27905c53b828 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:52.148372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7b91fc8d-b8bd-48fc-b428-27905c53b828 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:52.162510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24952d4-3a46-4b08-a77f-648d40964007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:52.163873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24952d4-3a46-4b08-a77f-648d40964007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:52.164384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24952d4-3a46-4b08-a77f-648d40964007 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:52.164918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24952d4-3a46-4b08-a77f-648d40964007 admin admin] PATH_INFO: `/v3/projects/f2be8b6009c94753aae37882ed620670` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:52.166489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24952d4-3a46-4b08-a77f-648d40964007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2be8b6009c94753aae37882ed620670)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:52.167173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91fc8d-b8bd-48fc-b428-27905c53b828 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:52.169459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91fc8d-b8bd-48fc-b428-27905c53b828 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:52.169931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24952d4-3a46-4b08-a77f-648d40964007 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:52.183311 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 849/1695] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:52.185232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91fc8d-b8bd-48fc-b428-27905c53b828 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:52.186808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7b91fc8d-b8bd-48fc-b428-27905c53b828 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:52.207904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91fc8d-b8bd-48fc-b428-27905c53b828 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:52.213355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb490c12-a37b-4461-b085-d8706234677d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:52.214303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb490c12-a37b-4461-b085-d8706234677d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:52.214590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb490c12-a37b-4461-b085-d8706234677d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:52.214871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb490c12-a37b-4461-b085-d8706234677d admin admin] PATH_INFO: `/v3/users/d707707ad60a4feb9e766a0e8ed8c2dd` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:52.216232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb490c12-a37b-4461-b085-d8706234677d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d707707ad60a4feb9e766a0e8ed8c2dd)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:52.218164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb490c12-a37b-4461-b085-d8706234677d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:52.228288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b24952d4-3a46-4b08-a77f-648d40964007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2be8b6009c94753aae37882ed620670', 'request_id': 'req-b24952d4-3a46-4b08-a77f-648d40964007'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.241315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b24952d4-3a46-4b08-a77f-648d40964007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2be8b6009c94753aae37882ed620670', 'request_id': 'req-b24952d4-3a46-4b08-a77f-648d40964007'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.243436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:52.252874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b24952d4-3a46-4b08-a77f-648d40964007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2be8b6009c94753aae37882ed620670', 'request_id': 'req-b24952d4-3a46-4b08-a77f-648d40964007'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.285246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b24952d4-3a46-4b08-a77f-648d40964007 admin admin] The token cache is being invalidate because project f2be8b6009c94753aae37882ed620670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:00:52.287603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b24952d4-3a46-4b08-a77f-648d40964007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.289349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b24952d4-3a46-4b08-a77f-648d40964007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.294089 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 847/1696] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:00:52 2022] DELETE /identity/v3/projects/f2be8b6009c94753aae37882ed620670 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:52.295408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24952d4-3a46-4b08-a77f-648d40964007 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:52.299775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b24952d4-3a46-4b08-a77f-648d40964007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:52.304030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fb490c12-a37b-4461-b085-d8706234677d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd707707ad60a4feb9e766a0e8ed8c2dd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.321955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fb490c12-a37b-4461-b085-d8706234677d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd707707ad60a4feb9e766a0e8ed8c2dd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.323759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fb490c12-a37b-4461-b085-d8706234677d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd707707ad60a4feb9e766a0e8ed8c2dd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.325195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fb490c12-a37b-4461-b085-d8706234677d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd707707ad60a4feb9e766a0e8ed8c2dd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.351469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fb490c12-a37b-4461-b085-d8706234677d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd707707ad60a4feb9e766a0e8ed8c2dd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.387557 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 850/1697] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:00:52 2022] DELETE /identity/v3/users/d707707ad60a4feb9e766a0e8ed8c2dd => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:52.394186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb490c12-a37b-4461-b085-d8706234677d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:52.395442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fb490c12-a37b-4461-b085-d8706234677d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:52.428118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24952d4-3a46-4b08-a77f-648d40964007 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:52.485549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:52.515546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb490c12-a37b-4461-b085-d8706234677d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:52.522384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9c14d-9693-48b2-a285-ab7933f10936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:52.523734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9c14d-9693-48b2-a285-ab7933f10936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:52.524230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9c14d-9693-48b2-a285-ab7933f10936 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:52.525122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9c14d-9693-48b2-a285-ab7933f10936 admin admin] PATH_INFO: `/v3/users/d45c44ea336c431da7cc749c8d1c069c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:52.526559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9c14d-9693-48b2-a285-ab7933f10936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d45c44ea336c431da7cc749c8d1c069c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:52.530033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9c14d-9693-48b2-a285-ab7933f10936 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:52.538868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52ca45-22f9-4cfc-983c-a0eb379b4a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:52.539975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52ca45-22f9-4cfc-983c-a0eb379b4a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:52.540386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52ca45-22f9-4cfc-983c-a0eb379b4a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:52.540727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52ca45-22f9-4cfc-983c-a0eb379b4a92 admin admin] PATH_INFO: `/v3/projects/ff81db2a0deb4600a70a7a4f8bf8285f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:52.546771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52ca45-22f9-4cfc-983c-a0eb379b4a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff81db2a0deb4600a70a7a4f8bf8285f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:52.546771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52ca45-22f9-4cfc-983c-a0eb379b4a92 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:52.612456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88c9c14d-9693-48b2-a285-ab7933f10936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd45c44ea336c431da7cc749c8d1c069c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.625778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ae52ca45-22f9-4cfc-983c-a0eb379b4a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff81db2a0deb4600a70a7a4f8bf8285f', 'request_id': 'req-ae52ca45-22f9-4cfc-983c-a0eb379b4a92'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.634039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88c9c14d-9693-48b2-a285-ab7933f10936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd45c44ea336c431da7cc749c8d1c069c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.634910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88c9c14d-9693-48b2-a285-ab7933f10936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd45c44ea336c431da7cc749c8d1c069c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.636453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88c9c14d-9693-48b2-a285-ab7933f10936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd45c44ea336c431da7cc749c8d1c069c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.639379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ae52ca45-22f9-4cfc-983c-a0eb379b4a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff81db2a0deb4600a70a7a4f8bf8285f', 'request_id': 'req-ae52ca45-22f9-4cfc-983c-a0eb379b4a92'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.649307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ae52ca45-22f9-4cfc-983c-a0eb379b4a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff81db2a0deb4600a70a7a4f8bf8285f', 'request_id': 'req-ae52ca45-22f9-4cfc-983c-a0eb379b4a92'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.666408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88c9c14d-9693-48b2-a285-ab7933f10936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd45c44ea336c431da7cc749c8d1c069c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.672253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ae52ca45-22f9-4cfc-983c-a0eb379b4a92 admin admin] The token cache is being invalidate because project ff81db2a0deb4600a70a7a4f8bf8285f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:00:52.672451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ae52ca45-22f9-4cfc-983c-a0eb379b4a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.673493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ae52ca45-22f9-4cfc-983c-a0eb379b4a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:52.684918 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 848/1698] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:00:52 2022] DELETE /identity/v3/projects/ff81db2a0deb4600a70a7a4f8bf8285f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:52.684918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52ca45-22f9-4cfc-983c-a0eb379b4a92 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:52.685137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ae52ca45-22f9-4cfc-983c-a0eb379b4a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:52.739527 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 851/1699] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:00:52 2022] DELETE /identity/v3/users/d45c44ea336c431da7cc749c8d1c069c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:52.744436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9c14d-9693-48b2-a285-ab7933f10936 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:52.748287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-88c9c14d-9693-48b2-a285-ab7933f10936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:52.844910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:52.869336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52ca45-22f9-4cfc-983c-a0eb379b4a92 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:52.961466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9c14d-9693-48b2-a285-ab7933f10936 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:52.972225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb1c4c-78de-4996-99a7-fd6291b05c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:52.976632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb1c4c-78de-4996-99a7-fd6291b05c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:52.977119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb1c4c-78de-4996-99a7-fd6291b05c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:52.977932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb1c4c-78de-4996-99a7-fd6291b05c13 admin admin] PATH_INFO: `/v3/users/dd85d42d45a043a4b1636effb5d5c424` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:52.980167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb1c4c-78de-4996-99a7-fd6291b05c13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd85d42d45a043a4b1636effb5d5c424)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:52.983584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08685ae0-a049-46e9-8146-097fe78824cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:52.984620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08685ae0-a049-46e9-8146-097fe78824cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:52.985268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08685ae0-a049-46e9-8146-097fe78824cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:52.985617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08685ae0-a049-46e9-8146-097fe78824cc admin admin] PATH_INFO: `/v3/projects/4fbf50031e9747178c370f741e59c074` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:52.987064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08685ae0-a049-46e9-8146-097fe78824cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fbf50031e9747178c370f741e59c074)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:52.987399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb1c4c-78de-4996-99a7-fd6291b05c13 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:52.989834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08685ae0-a049-46e9-8146-097fe78824cc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:52.992929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:53.054670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-08685ae0-a049-46e9-8146-097fe78824cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fbf50031e9747178c370f741e59c074', 'request_id': 'req-08685ae0-a049-46e9-8146-097fe78824cc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.062782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-08685ae0-a049-46e9-8146-097fe78824cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fbf50031e9747178c370f741e59c074', 'request_id': 'req-08685ae0-a049-46e9-8146-097fe78824cc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.069271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-08685ae0-a049-46e9-8146-097fe78824cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fbf50031e9747178c370f741e59c074', 'request_id': 'req-08685ae0-a049-46e9-8146-097fe78824cc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.069922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2edb1c4c-78de-4996-99a7-fd6291b05c13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd85d42d45a043a4b1636effb5d5c424'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.091157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-08685ae0-a049-46e9-8146-097fe78824cc admin admin] The token cache is being invalidate because project 4fbf50031e9747178c370f741e59c074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:00:53.091417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-08685ae0-a049-46e9-8146-097fe78824cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.092118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-08685ae0-a049-46e9-8146-097fe78824cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.093681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2edb1c4c-78de-4996-99a7-fd6291b05c13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd85d42d45a043a4b1636effb5d5c424'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.094513 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 849/1700] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:00:52 2022] DELETE /identity/v3/projects/4fbf50031e9747178c370f741e59c074 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:53.094793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2edb1c4c-78de-4996-99a7-fd6291b05c13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd85d42d45a043a4b1636effb5d5c424'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.095488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08685ae0-a049-46e9-8146-097fe78824cc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:53.096935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-08685ae0-a049-46e9-8146-097fe78824cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:53.100876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2edb1c4c-78de-4996-99a7-fd6291b05c13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd85d42d45a043a4b1636effb5d5c424'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.110171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2edb1c4c-78de-4996-99a7-fd6291b05c13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd85d42d45a043a4b1636effb5d5c424'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.138629 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 852/1701] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:00:52 2022] DELETE /identity/v3/users/dd85d42d45a043a4b1636effb5d5c424 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:53.141669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb1c4c-78de-4996-99a7-fd6291b05c13 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:53.141669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2edb1c4c-78de-4996-99a7-fd6291b05c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:53.237922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08685ae0-a049-46e9-8146-097fe78824cc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:53.255396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb1c4c-78de-4996-99a7-fd6291b05c13 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:53.260361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37265177-8791-491f-ac15-5c093c1fa00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:53.261838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37265177-8791-491f-ac15-5c093c1fa00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:53.262244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37265177-8791-491f-ac15-5c093c1fa00d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:53.262488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37265177-8791-491f-ac15-5c093c1fa00d admin admin] PATH_INFO: `/v3/projects/ff96e14a835e4928a68e5df0452ad248` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:53.263853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37265177-8791-491f-ac15-5c093c1fa00d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff96e14a835e4928a68e5df0452ad248)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:53.266661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37265177-8791-491f-ac15-5c093c1fa00d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:53.326017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:53.339083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-37265177-8791-491f-ac15-5c093c1fa00d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff96e14a835e4928a68e5df0452ad248', 'request_id': 'req-37265177-8791-491f-ac15-5c093c1fa00d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.352999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262bb64-63e2-4ed5-b6ba-d6fd85d915f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:53.353660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262bb64-63e2-4ed5-b6ba-d6fd85d915f0 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:53.353933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262bb64-63e2-4ed5-b6ba-d6fd85d915f0 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:53.354199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262bb64-63e2-4ed5-b6ba-d6fd85d915f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:53.356342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6262bb64-63e2-4ed5-b6ba-d6fd85d915f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:53.360577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-37265177-8791-491f-ac15-5c093c1fa00d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff96e14a835e4928a68e5df0452ad248', 'request_id': 'req-37265177-8791-491f-ac15-5c093c1fa00d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.374102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-37265177-8791-491f-ac15-5c093c1fa00d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff96e14a835e4928a68e5df0452ad248', 'request_id': 'req-37265177-8791-491f-ac15-5c093c1fa00d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.392417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-37265177-8791-491f-ac15-5c093c1fa00d admin admin] The token cache is being invalidate because project ff96e14a835e4928a68e5df0452ad248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:00:53.392969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-37265177-8791-491f-ac15-5c093c1fa00d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.393810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-37265177-8791-491f-ac15-5c093c1fa00d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.396333 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 853/1702] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:00:53 2022] DELETE /identity/v3/projects/ff96e14a835e4928a68e5df0452ad248 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:53.399116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8156429-ad1e-43ef-aaff-706c8c198e95 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:53.399619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8156429-ad1e-43ef-aaff-706c8c198e95 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:53.400118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8156429-ad1e-43ef-aaff-706c8c198e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:53.401718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:53.433757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d8156429-ad1e-43ef-aaff-706c8c198e95 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:53.435306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d8156429-ad1e-43ef-aaff-706c8c198e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:53.454896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262bb64-63e2-4ed5-b6ba-d6fd85d915f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:53.456908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262bb64-63e2-4ed5-b6ba-d6fd85d915f0 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:53.472353 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 850/1703] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:53.486521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262bb64-63e2-4ed5-b6ba-d6fd85d915f0 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:53.492949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6262bb64-63e2-4ed5-b6ba-d6fd85d915f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:53.513826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262bb64-63e2-4ed5-b6ba-d6fd85d915f0 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:53.536257 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 854/1704] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:53.537903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e6df0-b39e-4ce7-9663-bf731a4d0de4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:53.538587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e6df0-b39e-4ce7-9663-bf731a4d0de4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:53.538922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e6df0-b39e-4ce7-9663-bf731a4d0de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:53.570460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2d5e6df0-b39e-4ce7-9663-bf731a4d0de4 None None] MFA Rules not processed for user `b62db007a28947abbb19e137f52472a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:53.571674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2d5e6df0-b39e-4ce7-9663-bf731a4d0de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:53.596789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fdfe3-f870-4c6e-ba02-2bdc6e1780d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:53.598889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fdfe3-f870-4c6e-ba02-2bdc6e1780d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:53.598889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fdfe3-f870-4c6e-ba02-2bdc6e1780d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:53.598889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fdfe3-f870-4c6e-ba02-2bdc6e1780d7 admin admin] PATH_INFO: `/v3/projects/03129da6be614af18c09e2eb1d12b67c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:53.600052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fdfe3-f870-4c6e-ba02-2bdc6e1780d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03129da6be614af18c09e2eb1d12b67c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:53.602232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fdfe3-f870-4c6e-ba02-2bdc6e1780d7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:53.650594 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 855/1705] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:53.652705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60832b15-21aa-4a91-8af2-b936d819cc4d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:53.653010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60832b15-21aa-4a91-8af2-b936d819cc4d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:53.653403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60832b15-21aa-4a91-8af2-b936d819cc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:53.661096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-038fdfe3-f870-4c6e-ba02-2bdc6e1780d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03129da6be614af18c09e2eb1d12b67c', 'request_id': 'req-038fdfe3-f870-4c6e-ba02-2bdc6e1780d7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.670413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-038fdfe3-f870-4c6e-ba02-2bdc6e1780d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03129da6be614af18c09e2eb1d12b67c', 'request_id': 'req-038fdfe3-f870-4c6e-ba02-2bdc6e1780d7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.673967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-038fdfe3-f870-4c6e-ba02-2bdc6e1780d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03129da6be614af18c09e2eb1d12b67c', 'request_id': 'req-038fdfe3-f870-4c6e-ba02-2bdc6e1780d7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.676335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-60832b15-21aa-4a91-8af2-b936d819cc4d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:53.677576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-60832b15-21aa-4a91-8af2-b936d819cc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:53.690185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-038fdfe3-f870-4c6e-ba02-2bdc6e1780d7 admin admin] The token cache is being invalidate because project 03129da6be614af18c09e2eb1d12b67c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:00:53.690596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-038fdfe3-f870-4c6e-ba02-2bdc6e1780d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.691116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-038fdfe3-f870-4c6e-ba02-2bdc6e1780d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.693130 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 851/1706] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:00:53 2022] DELETE /identity/v3/projects/03129da6be614af18c09e2eb1d12b67c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:53.697278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fdfe3-f870-4c6e-ba02-2bdc6e1780d7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:53.698917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-038fdfe3-f870-4c6e-ba02-2bdc6e1780d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:53.739960 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 856/1707] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:53.741980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723d9c7-00a0-490b-b4de-084b52c1c857 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:53.742276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723d9c7-00a0-490b-b4de-084b52c1c857 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:53.742539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723d9c7-00a0-490b-b4de-084b52c1c857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:53.771418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:53.773440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e723d9c7-00a0-490b-b4de-084b52c1c857 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:53.774747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e723d9c7-00a0-490b-b4de-084b52c1c857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:53.776292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fdfe3-f870-4c6e-ba02-2bdc6e1780d7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:53.784840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a3e24-26e7-4e11-8b87-5f3470287ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:53.784840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a3e24-26e7-4e11-8b87-5f3470287ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:53.787103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a3e24-26e7-4e11-8b87-5f3470287ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:53.787103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a3e24-26e7-4e11-8b87-5f3470287ac1 admin admin] PATH_INFO: `/v3/projects/d42ffae4422e4dbcacf4cf486a83bf81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:53.787103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a3e24-26e7-4e11-8b87-5f3470287ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d42ffae4422e4dbcacf4cf486a83bf81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:53.788885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a3e24-26e7-4e11-8b87-5f3470287ac1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:53.792371 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 857/1708] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:53.792371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723d9c7-00a0-490b-b4de-084b52c1c857 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:53.792581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e723d9c7-00a0-490b-b4de-084b52c1c857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:53.805823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723d9c7-00a0-490b-b4de-084b52c1c857 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:53.811771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa2144-248f-445c-ad89-70b03f2c5c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:53.812823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa2144-248f-445c-ad89-70b03f2c5c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:53.813265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa2144-248f-445c-ad89-70b03f2c5c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:53.813654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa2144-248f-445c-ad89-70b03f2c5c42 admin admin] PATH_INFO: `/v3/users/181505c4f41b4a53bed9d4f362f6b8fa` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:53.815677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa2144-248f-445c-ad89-70b03f2c5c42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=181505c4f41b4a53bed9d4f362f6b8fa)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:53.821129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa2144-248f-445c-ad89-70b03f2c5c42 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:53.824294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:53.849506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fd3a3e24-26e7-4e11-8b87-5f3470287ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd42ffae4422e4dbcacf4cf486a83bf81', 'request_id': 'req-fd3a3e24-26e7-4e11-8b87-5f3470287ac1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.855206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fd3a3e24-26e7-4e11-8b87-5f3470287ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd42ffae4422e4dbcacf4cf486a83bf81', 'request_id': 'req-fd3a3e24-26e7-4e11-8b87-5f3470287ac1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.861339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fd3a3e24-26e7-4e11-8b87-5f3470287ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd42ffae4422e4dbcacf4cf486a83bf81', 'request_id': 'req-fd3a3e24-26e7-4e11-8b87-5f3470287ac1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.879863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fd3a3e24-26e7-4e11-8b87-5f3470287ac1 admin admin] The token cache is being invalidate because project d42ffae4422e4dbcacf4cf486a83bf81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:00:53.880083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fd3a3e24-26e7-4e11-8b87-5f3470287ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.880893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fd3a3e24-26e7-4e11-8b87-5f3470287ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.886255 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 852/1709] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:00:53 2022] DELETE /identity/v3/projects/d42ffae4422e4dbcacf4cf486a83bf81 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:53.886255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a3e24-26e7-4e11-8b87-5f3470287ac1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:53.888603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fd3a3e24-26e7-4e11-8b87-5f3470287ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:53.899928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c5aa2144-248f-445c-ad89-70b03f2c5c42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181505c4f41b4a53bed9d4f362f6b8fa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.908921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c5aa2144-248f-445c-ad89-70b03f2c5c42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181505c4f41b4a53bed9d4f362f6b8fa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.909664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c5aa2144-248f-445c-ad89-70b03f2c5c42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181505c4f41b4a53bed9d4f362f6b8fa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.910414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c5aa2144-248f-445c-ad89-70b03f2c5c42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181505c4f41b4a53bed9d4f362f6b8fa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.922617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c5aa2144-248f-445c-ad89-70b03f2c5c42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181505c4f41b4a53bed9d4f362f6b8fa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:53.942704 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 858/1710] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:00:53 2022] DELETE /identity/v3/users/181505c4f41b4a53bed9d4f362f6b8fa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:53.945713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb4ceb-6982-40e3-8437-e095af91ea52 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:53.945713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb4ceb-6982-40e3-8437-e095af91ea52 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:53.945713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb4ceb-6982-40e3-8437-e095af91ea52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:53.964024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fbbb4ceb-6982-40e3-8437-e095af91ea52 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:53.965371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fbbb4ceb-6982-40e3-8437-e095af91ea52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:53.998951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a3e24-26e7-4e11-8b87-5f3470287ac1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.056208 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 859/1711] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:54.056208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6fd0a-e48d-406f-a1f2-5be1a01eab80 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.056208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6fd0a-e48d-406f-a1f2-5be1a01eab80 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.056208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6fd0a-e48d-406f-a1f2-5be1a01eab80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.074866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664cb22-6410-4ffc-b08b-4d0d91571f7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.080442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664cb22-6410-4ffc-b08b-4d0d91571f7c service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.080774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664cb22-6410-4ffc-b08b-4d0d91571f7c service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.080909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-17a6fd0a-e48d-406f-a1f2-5be1a01eab80 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:54.081094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664cb22-6410-4ffc-b08b-4d0d91571f7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.082316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-17a6fd0a-e48d-406f-a1f2-5be1a01eab80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:54.083012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a664cb22-6410-4ffc-b08b-4d0d91571f7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:54.091366 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 860/1712] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:54.092419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6fd0a-e48d-406f-a1f2-5be1a01eab80 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.096032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-17a6fd0a-e48d-406f-a1f2-5be1a01eab80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:54.112010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6fd0a-e48d-406f-a1f2-5be1a01eab80 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.118634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:54.121626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bff27-f301-4169-b53f-a0c756855e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.122630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bff27-f301-4169-b53f-a0c756855e94 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.123166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bff27-f301-4169-b53f-a0c756855e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.123758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bff27-f301-4169-b53f-a0c756855e94 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.124990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bff27-f301-4169-b53f-a0c756855e94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:00:54.125548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bff27-f301-4169-b53f-a0c756855e94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.127478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bff27-f301-4169-b53f-a0c756855e94 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.139583 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 861/1713] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:00:54.140956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac13cb9-5522-4bc6-bacb-c4459e4bd7a1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.141240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac13cb9-5522-4bc6-bacb-c4459e4bd7a1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.141510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac13cb9-5522-4bc6-bacb-c4459e4bd7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.160275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5ac13cb9-5522-4bc6-bacb-c4459e4bd7a1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:54.161552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5ac13cb9-5522-4bc6-bacb-c4459e4bd7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:54.163627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664cb22-6410-4ffc-b08b-4d0d91571f7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.165379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664cb22-6410-4ffc-b08b-4d0d91571f7c service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.169994 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 862/1714] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:54.171210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4e788-4952-4d46-851b-38677468aa14 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.171490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4e788-4952-4d46-851b-38677468aa14 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.171761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4e788-4952-4d46-851b-38677468aa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.176989 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 853/1715] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:54.178552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f489b-dc0b-4e40-a460-32dbb657933a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.179003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f489b-dc0b-4e40-a460-32dbb657933a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.179285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f489b-dc0b-4e40-a460-32dbb657933a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.192563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7ee4e788-4952-4d46-851b-38677468aa14 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:54.193776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7ee4e788-4952-4d46-851b-38677468aa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:54.196626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-754f489b-dc0b-4e40-a460-32dbb657933a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:54.197812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-754f489b-dc0b-4e40-a460-32dbb657933a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:54.207930 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 863/1716] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:54.207930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4e788-4952-4d46-851b-38677468aa14 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.214189 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 854/1717] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:54.215534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f489b-dc0b-4e40-a460-32dbb657933a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.225999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f489b-dc0b-4e40-a460-32dbb657933a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.226891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4e788-4952-4d46-851b-38677468aa14 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.231408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc80d88-cbba-4583-8aea-95b491b4e800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.232114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc80d88-cbba-4583-8aea-95b491b4e800 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.232398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc80d88-cbba-4583-8aea-95b491b4e800 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.232672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc80d88-cbba-4583-8aea-95b491b4e800 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.233367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc80d88-cbba-4583-8aea-95b491b4e800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.233526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538996c-647d-4b59-ba4d-47dae4675122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.234169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538996c-647d-4b59-ba4d-47dae4675122 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.234458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538996c-647d-4b59-ba4d-47dae4675122 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.234715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538996c-647d-4b59-ba4d-47dae4675122 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.235284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc80d88-cbba-4583-8aea-95b491b4e800 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.235452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538996c-647d-4b59-ba4d-47dae4675122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:00:54.235755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538996c-647d-4b59-ba4d-47dae4675122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.237381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538996c-647d-4b59-ba4d-47dae4675122 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.251709 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 864/1718] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:00:54.253153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c858b35-9270-4369-b6ac-b48cead4221e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.253439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c858b35-9270-4369-b6ac-b48cead4221e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.253712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c858b35-9270-4369-b6ac-b48cead4221e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.263748 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 855/1719] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:54 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:54.265381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc80d88-cbba-4583-8aea-95b491b4e800 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.267363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-efc80d88-cbba-4583-8aea-95b491b4e800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:54.272627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8c858b35-9270-4369-b6ac-b48cead4221e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:54.274300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8c858b35-9270-4369-b6ac-b48cead4221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:54.307927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:54.325456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc80d88-cbba-4583-8aea-95b491b4e800 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.329494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c731c4e-b320-46a2-8bbc-51422ac88855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.330302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c731c4e-b320-46a2-8bbc-51422ac88855 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.330762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c731c4e-b320-46a2-8bbc-51422ac88855 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.331041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c731c4e-b320-46a2-8bbc-51422ac88855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.338724 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 865/1720] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:54.339560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c858b35-9270-4369-b6ac-b48cead4221e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.349154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c858b35-9270-4369-b6ac-b48cead4221e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.354264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25590956-9e05-41c9-9a9a-42e4e637a65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.354966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25590956-9e05-41c9-9a9a-42e4e637a65c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.355241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25590956-9e05-41c9-9a9a-42e4e637a65c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.355530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25590956-9e05-41c9-9a9a-42e4e637a65c admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.356248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25590956-9e05-41c9-9a9a-42e4e637a65c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:00:54.356551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25590956-9e05-41c9-9a9a-42e4e637a65c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.358144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25590956-9e05-41c9-9a9a-42e4e637a65c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.370657 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 866/1721] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:00:54.371843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a1e0d-0212-4106-a55b-b5b01e6278a3 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.372168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a1e0d-0212-4106-a55b-b5b01e6278a3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.372446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a1e0d-0212-4106-a55b-b5b01e6278a3 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.373675 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 867/1722] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:00:54.378723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a1e0d-0212-4106-a55b-b5b01e6278a3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.391457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a1e0d-0212-4106-a55b-b5b01e6278a3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.396465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a9edf-374e-41e5-ab27-44458ef0e295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.397154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a9edf-374e-41e5-ab27-44458ef0e295 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.397493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a9edf-374e-41e5-ab27-44458ef0e295 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.397780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a9edf-374e-41e5-ab27-44458ef0e295 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.398461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a9edf-374e-41e5-ab27-44458ef0e295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.400472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a9edf-374e-41e5-ab27-44458ef0e295 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.405232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c731c4e-b320-46a2-8bbc-51422ac88855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.406673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c731c4e-b320-46a2-8bbc-51422ac88855 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.416451 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 856/1723] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:54.417351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c731c4e-b320-46a2-8bbc-51422ac88855 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.426962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c731c4e-b320-46a2-8bbc-51422ac88855 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.429943 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 868/1724] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:54 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:54.430842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a9edf-374e-41e5-ab27-44458ef0e295 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.435785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f70d9-7c7a-4115-83c7-1041f5efc10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.436798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f70d9-7c7a-4115-83c7-1041f5efc10b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.437204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f70d9-7c7a-4115-83c7-1041f5efc10b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.437573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f70d9-7c7a-4115-83c7-1041f5efc10b admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.438388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f70d9-7c7a-4115-83c7-1041f5efc10b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.440518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f70d9-7c7a-4115-83c7-1041f5efc10b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.464755 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 857/1725] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:54 2022] POST /identity/v3/users => generated 288 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:54.466144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f70d9-7c7a-4115-83c7-1041f5efc10b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.479439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f70d9-7c7a-4115-83c7-1041f5efc10b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.508850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:54.509236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a9edf-374e-41e5-ab27-44458ef0e295 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.515316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7766ad9-027d-48d4-ab31-62e689e3092d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.516165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7766ad9-027d-48d4-ab31-62e689e3092d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.516438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7766ad9-027d-48d4-ab31-62e689e3092d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.516863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7766ad9-027d-48d4-ab31-62e689e3092d admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.517810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7766ad9-027d-48d4-ab31-62e689e3092d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:00:54.518082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7766ad9-027d-48d4-ab31-62e689e3092d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.520522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7766ad9-027d-48d4-ab31-62e689e3092d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.537037 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 869/1726] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:00:54.537037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b82a9e-e238-43dd-a081-cd22533ff8ad None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.537037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b82a9e-e238-43dd-a081-cd22533ff8ad None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.537037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b82a9e-e238-43dd-a081-cd22533ff8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.549540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e755f17-ccad-4e6d-bdad-e7cbec3b2891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.550327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e755f17-ccad-4e6d-bdad-e7cbec3b2891 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.551059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e755f17-ccad-4e6d-bdad-e7cbec3b2891 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.551491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e755f17-ccad-4e6d-bdad-e7cbec3b2891 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.552242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e755f17-ccad-4e6d-bdad-e7cbec3b2891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.554377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e755f17-ccad-4e6d-bdad-e7cbec3b2891 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.555545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-52b82a9e-e238-43dd-a081-cd22533ff8ad None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:54.557019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-52b82a9e-e238-43dd-a081-cd22533ff8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:54.596479 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 858/1727] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:54 2022] POST /identity/v3/projects => generated 403 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:54.597382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e755f17-ccad-4e6d-bdad-e7cbec3b2891 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.646550 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 870/1728] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:00:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:54.647440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b82a9e-e238-43dd-a081-cd22533ff8ad None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.660281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b82a9e-e238-43dd-a081-cd22533ff8ad None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.666168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83519a4-a61e-4fc9-b2ee-f7e876f257fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.667638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83519a4-a61e-4fc9-b2ee-f7e876f257fa admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.668022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83519a4-a61e-4fc9-b2ee-f7e876f257fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.668586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83519a4-a61e-4fc9-b2ee-f7e876f257fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.669866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83519a4-a61e-4fc9-b2ee-f7e876f257fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.670958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e755f17-ccad-4e6d-bdad-e7cbec3b2891 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.671545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83519a4-a61e-4fc9-b2ee-f7e876f257fa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.675922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04e72e-7928-429b-ae07-58c3d54107dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.676648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04e72e-7928-429b-ae07-58c3d54107dc admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.676930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04e72e-7928-429b-ae07-58c3d54107dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.677207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04e72e-7928-429b-ae07-58c3d54107dc admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.677913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04e72e-7928-429b-ae07-58c3d54107dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.679898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04e72e-7928-429b-ae07-58c3d54107dc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.684258 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 871/1729] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:54.685097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83519a4-a61e-4fc9-b2ee-f7e876f257fa admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.702760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83519a4-a61e-4fc9-b2ee-f7e876f257fa admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.706674 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 859/1730] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:54 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:54.706674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04e72e-7928-429b-ae07-58c3d54107dc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.711795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739f447-f039-4a7c-886c-97ed676d00da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.712801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739f447-f039-4a7c-886c-97ed676d00da admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.712992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739f447-f039-4a7c-886c-97ed676d00da admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.713342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739f447-f039-4a7c-886c-97ed676d00da admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.713916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739f447-f039-4a7c-886c-97ed676d00da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.715686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04e72e-7928-429b-ae07-58c3d54107dc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.715929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739f447-f039-4a7c-886c-97ed676d00da admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.721486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66675b73-69f5-47ca-b67c-05aeb1a7ef5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.722222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66675b73-69f5-47ca-b67c-05aeb1a7ef5e admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.722599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66675b73-69f5-47ca-b67c-05aeb1a7ef5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.722932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66675b73-69f5-47ca-b67c-05aeb1a7ef5e admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.723737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66675b73-69f5-47ca-b67c-05aeb1a7ef5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.726238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66675b73-69f5-47ca-b67c-05aeb1a7ef5e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.733878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:54.751221 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 872/1731] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:54 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:54.755579 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 860/1732] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:54 2022] POST /identity/v3/users => generated 302 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:54.755869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739f447-f039-4a7c-886c-97ed676d00da admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.756614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66675b73-69f5-47ca-b67c-05aeb1a7ef5e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.757505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7739f447-f039-4a7c-886c-97ed676d00da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:54.766765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66675b73-69f5-47ca-b67c-05aeb1a7ef5e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.817489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739f447-f039-4a7c-886c-97ed676d00da admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.821502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27dffa-f4a2-46ba-a605-fe0b15a2d813 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.822230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27dffa-f4a2-46ba-a605-fe0b15a2d813 service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.822510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27dffa-f4a2-46ba-a605-fe0b15a2d813 service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.822812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27dffa-f4a2-46ba-a605-fe0b15a2d813 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.824956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d311a-0a4b-4bde-8352-5bf27c1bfde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.825618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d311a-0a4b-4bde-8352-5bf27c1bfde1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.825896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d311a-0a4b-4bde-8352-5bf27c1bfde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.826167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d311a-0a4b-4bde-8352-5bf27c1bfde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.826879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d311a-0a4b-4bde-8352-5bf27c1bfde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.828528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d311a-0a4b-4bde-8352-5bf27c1bfde1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.838550 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 861/1733] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:54.839511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d311a-0a4b-4bde-8352-5bf27c1bfde1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.848856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d311a-0a4b-4bde-8352-5bf27c1bfde1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.853396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc60b6-1cdb-4de7-b6bc-35b0a503f449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.854025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc60b6-1cdb-4de7-b6bc-35b0a503f449 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.854300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc60b6-1cdb-4de7-b6bc-35b0a503f449 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.854610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc60b6-1cdb-4de7-b6bc-35b0a503f449 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.855652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc60b6-1cdb-4de7-b6bc-35b0a503f449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.856896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc60b6-1cdb-4de7-b6bc-35b0a503f449 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.867242 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 862/1734] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:54.868073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc60b6-1cdb-4de7-b6bc-35b0a503f449 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.869688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-35dc60b6-1cdb-4de7-b6bc-35b0a503f449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:54.882764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc60b6-1cdb-4de7-b6bc-35b0a503f449 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.887605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4cc2a-c40a-4bd6-8df1-e5fc3d8f5bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.888499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4cc2a-c40a-4bd6-8df1-e5fc3d8f5bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.888776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4cc2a-c40a-4bd6-8df1-e5fc3d8f5bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.889046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4cc2a-c40a-4bd6-8df1-e5fc3d8f5bf6 admin admin] PATH_INFO: `/v3/projects/939eb4bb7d8744f7a76ed90eaf2366a7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.890211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4cc2a-c40a-4bd6-8df1-e5fc3d8f5bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=939eb4bb7d8744f7a76ed90eaf2366a7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.892161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4cc2a-c40a-4bd6-8df1-e5fc3d8f5bf6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.894848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:54.895402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27dffa-f4a2-46ba-a605-fe0b15a2d813 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.897165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27dffa-f4a2-46ba-a605-fe0b15a2d813 service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.908938 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 873/1735] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:54.909732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27dffa-f4a2-46ba-a605-fe0b15a2d813 service glance] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.919310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27dffa-f4a2-46ba-a605-fe0b15a2d813 service glance] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.925017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565b6b9-9bd1-4ada-bf21-e64779d9b99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:54.925694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565b6b9-9bd1-4ada-bf21-e64779d9b99c admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:54.925977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565b6b9-9bd1-4ada-bf21-e64779d9b99c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:54.926305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565b6b9-9bd1-4ada-bf21-e64779d9b99c admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:54.926946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565b6b9-9bd1-4ada-bf21-e64779d9b99c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:54.929018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565b6b9-9bd1-4ada-bf21-e64779d9b99c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:54.946598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9ed4cc2a-c40a-4bd6-8df1-e5fc3d8f5bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '939eb4bb7d8744f7a76ed90eaf2366a7', 'request_id': 'req-9ed4cc2a-c40a-4bd6-8df1-e5fc3d8f5bf6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:54.951774 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 874/1736] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:54 2022] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:54.952607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565b6b9-9bd1-4ada-bf21-e64779d9b99c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.958477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9ed4cc2a-c40a-4bd6-8df1-e5fc3d8f5bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '939eb4bb7d8744f7a76ed90eaf2366a7', 'request_id': 'req-9ed4cc2a-c40a-4bd6-8df1-e5fc3d8f5bf6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:54.962585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565b6b9-9bd1-4ada-bf21-e64779d9b99c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:54.965189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9ed4cc2a-c40a-4bd6-8df1-e5fc3d8f5bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '939eb4bb7d8744f7a76ed90eaf2366a7', 'request_id': 'req-9ed4cc2a-c40a-4bd6-8df1-e5fc3d8f5bf6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:54.979201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9ed4cc2a-c40a-4bd6-8df1-e5fc3d8f5bf6 admin admin] The token cache is being invalidate because project 939eb4bb7d8744f7a76ed90eaf2366a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:00:54.979517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9ed4cc2a-c40a-4bd6-8df1-e5fc3d8f5bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:54.980244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9ed4cc2a-c40a-4bd6-8df1-e5fc3d8f5bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:54.981915 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 863/1737] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:00:54 2022] DELETE /identity/v3/projects/939eb4bb7d8744f7a76ed90eaf2366a7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:54.982727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4cc2a-c40a-4bd6-8df1-e5fc3d8f5bf6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:54.984116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9ed4cc2a-c40a-4bd6-8df1-e5fc3d8f5bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:55.031429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17213898-6c19-47eb-8d2c-19bfeb87807c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:55.032273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17213898-6c19-47eb-8d2c-19bfeb87807c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:55.032554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17213898-6c19-47eb-8d2c-19bfeb87807c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:55.032826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17213898-6c19-47eb-8d2c-19bfeb87807c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:55.033546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17213898-6c19-47eb-8d2c-19bfeb87807c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:55.035278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17213898-6c19-47eb-8d2c-19bfeb87807c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:55.045674 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 875/1738] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:55.046739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17213898-6c19-47eb-8d2c-19bfeb87807c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:55.048535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-17213898-6c19-47eb-8d2c-19bfeb87807c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:55.060087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4cc2a-c40a-4bd6-8df1-e5fc3d8f5bf6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:55.060514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17213898-6c19-47eb-8d2c-19bfeb87807c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:55.064936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2346b-8bfd-4474-bff3-427fe276b7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:55.065081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9a2cf-5eca-4161-8e90-2827d5b3454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:55.065705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9a2cf-5eca-4161-8e90-2827d5b3454d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:55.065887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2346b-8bfd-4474-bff3-427fe276b7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:55.065983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9a2cf-5eca-4161-8e90-2827d5b3454d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:55.066173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2346b-8bfd-4474-bff3-427fe276b7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:55.066341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9a2cf-5eca-4161-8e90-2827d5b3454d admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:55.066460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2346b-8bfd-4474-bff3-427fe276b7cc admin admin] PATH_INFO: `/v3/projects/a2fc9601cb2e4e36ae887b890192d35d/users/4fc70b6bd8624f53965366f5c521d3c5/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:55.067011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9a2cf-5eca-4161-8e90-2827d5b3454d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:55.068648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9a2cf-5eca-4161-8e90-2827d5b3454d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:55.078956 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 876/1739] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:55.079795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9a2cf-5eca-4161-8e90-2827d5b3454d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:55.081512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f1e9a2cf-5eca-4161-8e90-2827d5b3454d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:55.092985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2346b-8bfd-4474-bff3-427fe276b7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fc9601cb2e4e36ae887b890192d35d, user_id=4fc70b6bd8624f53965366f5c521d3c5, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:55.093668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2346b-8bfd-4474-bff3-427fe276b7cc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:55.094655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9a2cf-5eca-4161-8e90-2827d5b3454d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:55.095988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:55.104943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d48cb-a52b-45be-af84-67e472ceefd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:55.105935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d48cb-a52b-45be-af84-67e472ceefd7 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:55.106235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d48cb-a52b-45be-af84-67e472ceefd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:55.106584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d48cb-a52b-45be-af84-67e472ceefd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:55.107385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d48cb-a52b-45be-af84-67e472ceefd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:55.109122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d48cb-a52b-45be-af84-67e472ceefd7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:55.123111 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 864/1740] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:54 2022] PUT /identity/v3/projects/a2fc9601cb2e4e36ae887b890192d35d/users/4fc70b6bd8624f53965366f5c521d3c5/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:55.123111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2346b-8bfd-4474-bff3-427fe276b7cc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:55.123417 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 877/1741] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:55.123417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d48cb-a52b-45be-af84-67e472ceefd7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:55.124856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6e3d48cb-a52b-45be-af84-67e472ceefd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:55.125522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a4b2346b-8bfd-4474-bff3-427fe276b7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:55.138556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d48cb-a52b-45be-af84-67e472ceefd7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:55.197985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2346b-8bfd-4474-bff3-427fe276b7cc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:55.203248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e641b-6b59-41ca-a8a3-71b02c26ee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:55.204314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e641b-6b59-41ca-a8a3-71b02c26ee91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:55.204683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e641b-6b59-41ca-a8a3-71b02c26ee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:55.205064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e641b-6b59-41ca-a8a3-71b02c26ee91 admin admin] PATH_INFO: `/v3/users/2e4064706a08429592fefdc974b47554` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:55.206555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e641b-6b59-41ca-a8a3-71b02c26ee91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e4064706a08429592fefdc974b47554)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:55.206850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fad7f-fa4a-4f36-a7a2-452ea4e26183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:55.207569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fad7f-fa4a-4f36-a7a2-452ea4e26183 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:55.207855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fad7f-fa4a-4f36-a7a2-452ea4e26183 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:55.208164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fad7f-fa4a-4f36-a7a2-452ea4e26183 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:55.208887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fad7f-fa4a-4f36-a7a2-452ea4e26183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:55.209050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e641b-6b59-41ca-a8a3-71b02c26ee91 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:55.210507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fad7f-fa4a-4f36-a7a2-452ea4e26183 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:55.221191 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 878/1742] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:55.222018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fad7f-fa4a-4f36-a7a2-452ea4e26183 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:55.231669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:55.233495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fad7f-fa4a-4f36-a7a2-452ea4e26183 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:55.239733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341aed42-6695-465f-b059-af5bbb919998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:55.240894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aed42-6695-465f-b059-af5bbb919998 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:55.241304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aed42-6695-465f-b059-af5bbb919998 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:55.241598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aed42-6695-465f-b059-af5bbb919998 admin admin] PATH_INFO: `/v3/projects/552b40f3c5904cbfba0c0c3d53f1c2fd/users/87a3518e60d74bb1921aad6e34203c86/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:55.259696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341aed42-6695-465f-b059-af5bbb919998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=552b40f3c5904cbfba0c0c3d53f1c2fd, user_id=87a3518e60d74bb1921aad6e34203c86, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:55.262536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341aed42-6695-465f-b059-af5bbb919998 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:55.267767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1e7e641b-6b59-41ca-a8a3-71b02c26ee91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e4064706a08429592fefdc974b47554'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:55.277828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1e7e641b-6b59-41ca-a8a3-71b02c26ee91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e4064706a08429592fefdc974b47554'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:55.279209 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 879/1743] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:55 2022] PUT /identity/v3/projects/552b40f3c5904cbfba0c0c3d53f1c2fd/users/87a3518e60d74bb1921aad6e34203c86/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:55.286642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1e7e641b-6b59-41ca-a8a3-71b02c26ee91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e4064706a08429592fefdc974b47554'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:55.287486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1e7e641b-6b59-41ca-a8a3-71b02c26ee91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e4064706a08429592fefdc974b47554'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:55.288248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1e7e641b-6b59-41ca-a8a3-71b02c26ee91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e4064706a08429592fefdc974b47554'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:55.289249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341aed42-6695-465f-b059-af5bbb919998 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:55.292137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-341aed42-6695-465f-b059-af5bbb919998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:55.318075 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 865/1744] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:00:55 2022] DELETE /identity/v3/users/2e4064706a08429592fefdc974b47554 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:55.321268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85266a23-aa30-4335-a27b-6d39344305d3 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:55.321268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85266a23-aa30-4335-a27b-6d39344305d3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:55.321268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85266a23-aa30-4335-a27b-6d39344305d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:55.347866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-85266a23-aa30-4335-a27b-6d39344305d3 None None] MFA Rules not processed for user `4fc70b6bd8624f53965366f5c521d3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:55.349123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-85266a23-aa30-4335-a27b-6d39344305d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:55.379868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341aed42-6695-465f-b059-af5bbb919998 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:55.423618 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 866/1745] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:55.429149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85266a23-aa30-4335-a27b-6d39344305d3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:55.430609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-85266a23-aa30-4335-a27b-6d39344305d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:55.456143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95350bd8-3290-4f0d-8a51-627b536516fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:55.456825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95350bd8-3290-4f0d-8a51-627b536516fe admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:55.457111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95350bd8-3290-4f0d-8a51-627b536516fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:55.457395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95350bd8-3290-4f0d-8a51-627b536516fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:55.458178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95350bd8-3290-4f0d-8a51-627b536516fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:55.460151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95350bd8-3290-4f0d-8a51-627b536516fe admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:55.473183 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 880/1746] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:55.478643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8187f2-0749-497b-b648-228c55d04a0f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:55.478942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8187f2-0749-497b-b648-228c55d04a0f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:55.479224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8187f2-0749-497b-b648-228c55d04a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:55.498057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:55.517986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4d8187f2-0749-497b-b648-228c55d04a0f None None] MFA Rules not processed for user `87a3518e60d74bb1921aad6e34203c86`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:55.520029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4d8187f2-0749-497b-b648-228c55d04a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:55.525021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85266a23-aa30-4335-a27b-6d39344305d3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:55.539050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a67020-f4b9-469e-b56f-b5292baf95c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:55.540307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a67020-f4b9-469e-b56f-b5292baf95c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:55.540592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a67020-f4b9-469e-b56f-b5292baf95c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:55.540869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a67020-f4b9-469e-b56f-b5292baf95c6 admin admin] PATH_INFO: `/v3/projects/a0b01ef5940f47eab5705b2393dcad53/users/d81aa185b2134cf090495a03bf3cdf02/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:55.559374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a67020-f4b9-469e-b56f-b5292baf95c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b01ef5940f47eab5705b2393dcad53, user_id=d81aa185b2134cf090495a03bf3cdf02, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:55.564241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a67020-f4b9-469e-b56f-b5292baf95c6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:55.586704 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 867/1747] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:55 2022] PUT /identity/v3/projects/a0b01ef5940f47eab5705b2393dcad53/users/d81aa185b2134cf090495a03bf3cdf02/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:55.588028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a67020-f4b9-469e-b56f-b5292baf95c6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:55.598712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-96a67020-f4b9-469e-b56f-b5292baf95c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:55.612784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:55.621257 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 881/1748] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:55.622409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8187f2-0749-497b-b648-228c55d04a0f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:55.639010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8187f2-0749-497b-b648-228c55d04a0f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:55.706460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a67020-f4b9-469e-b56f-b5292baf95c6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:55.712644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133fcee-6b75-45ef-8d41-c1402510f090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:55.715349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133fcee-6b75-45ef-8d41-c1402510f090 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:55.715640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133fcee-6b75-45ef-8d41-c1402510f090 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:55.715917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133fcee-6b75-45ef-8d41-c1402510f090 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:55.716648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133fcee-6b75-45ef-8d41-c1402510f090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:55.718556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133fcee-6b75-45ef-8d41-c1402510f090 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:55.740845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03e540-291d-45c7-a196-e1a354ec6b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:55.741832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03e540-291d-45c7-a196-e1a354ec6b1b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:55.742147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03e540-291d-45c7-a196-e1a354ec6b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:55.742410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03e540-291d-45c7-a196-e1a354ec6b1b admin admin] PATH_INFO: `/v3/projects/4e2b38c57ff74555a00cd95b06028b3f/users/e702dd5bbb544dc986c503b54436811c/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:55.750825 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 868/1749] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:55 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:55.750825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df51657-ac56-4ad1-b046-0cd7b191590b None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:55.750825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df51657-ac56-4ad1-b046-0cd7b191590b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:55.750825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df51657-ac56-4ad1-b046-0cd7b191590b None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:55.752239 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 869/1750] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:00:55.752732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1db0b5-9110-4a83-bf22-6b896eb58f6f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:55.753012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1db0b5-9110-4a83-bf22-6b896eb58f6f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:55.753393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1db0b5-9110-4a83-bf22-6b896eb58f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:55.759320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03e540-291d-45c7-a196-e1a354ec6b1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2b38c57ff74555a00cd95b06028b3f, user_id=e702dd5bbb544dc986c503b54436811c, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:55.762158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03e540-291d-45c7-a196-e1a354ec6b1b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:55.783117 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 882/1751] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:55 2022] PUT /identity/v3/projects/4e2b38c57ff74555a00cd95b06028b3f/users/e702dd5bbb544dc986c503b54436811c/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:55.783937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03e540-291d-45c7-a196-e1a354ec6b1b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:55.785687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4e1db0b5-9110-4a83-bf22-6b896eb58f6f None None] MFA Rules not processed for user `d81aa185b2134cf090495a03bf3cdf02`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:55.786084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fa03e540-291d-45c7-a196-e1a354ec6b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:55.787076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4e1db0b5-9110-4a83-bf22-6b896eb58f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:55.863014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03e540-291d-45c7-a196-e1a354ec6b1b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:55.866686 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 870/1752] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:55.867743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1db0b5-9110-4a83-bf22-6b896eb58f6f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:55.869250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4e1db0b5-9110-4a83-bf22-6b896eb58f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:55.869360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424ddfd-0afa-4e29-ad2f-693adfb09d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:55.870144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424ddfd-0afa-4e29-ad2f-693adfb09d87 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:55.870735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424ddfd-0afa-4e29-ad2f-693adfb09d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:55.871184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424ddfd-0afa-4e29-ad2f-693adfb09d87 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:55.872121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424ddfd-0afa-4e29-ad2f-693adfb09d87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:55.874727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424ddfd-0afa-4e29-ad2f-693adfb09d87 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:55.905524 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 883/1753] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:55 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:55.905524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424ddfd-0afa-4e29-ad2f-693adfb09d87 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:55.908384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:55.945667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1db0b5-9110-4a83-bf22-6b896eb58f6f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:55.965319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:55.965509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424ddfd-0afa-4e29-ad2f-693adfb09d87 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:55.970287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba9630-11bb-49bd-85de-c4a29b505e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:55.970955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba9630-11bb-49bd-85de-c4a29b505e6d admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:55.971240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba9630-11bb-49bd-85de-c4a29b505e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:55.971511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba9630-11bb-49bd-85de-c4a29b505e6d admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:55.972858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba9630-11bb-49bd-85de-c4a29b505e6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:55.974799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba9630-11bb-49bd-85de-c4a29b505e6d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:55.994996 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 884/1754] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:55 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:55.996429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02165a1-39e4-4483-a789-c906b66a3153 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:55.996635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02165a1-39e4-4483-a789-c906b66a3153 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:55.997028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02165a1-39e4-4483-a789-c906b66a3153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.006713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a82233-7d68-4167-8642-90f52e971c0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:56.007386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a82233-7d68-4167-8642-90f52e971c0b service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.007670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a82233-7d68-4167-8642-90f52e971c0b service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.007940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a82233-7d68-4167-8642-90f52e971c0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.010056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-75a82233-7d68-4167-8642-90f52e971c0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:56.014881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f02165a1-39e4-4483-a789-c906b66a3153 None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:56.016084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f02165a1-39e4-4483-a789-c906b66a3153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:56.022220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a82233-7d68-4167-8642-90f52e971c0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:56.023976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a82233-7d68-4167-8642-90f52e971c0b service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:56.034388 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 871/1755] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:56.035625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a14c-078a-43df-aee9-316225c41c2c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.035941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a14c-078a-43df-aee9-316225c41c2c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.036238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a14c-078a-43df-aee9-316225c41c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.069633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3619a14c-078a-43df-aee9-316225c41c2c None None] MFA Rules not processed for user `e702dd5bbb544dc986c503b54436811c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:56.070865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3619a14c-078a-43df-aee9-316225c41c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:56.094409 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 885/1756] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:00:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:56.095299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02165a1-39e4-4483-a789-c906b66a3153 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:56.100872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f02165a1-39e4-4483-a789-c906b66a3153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:56.116678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02165a1-39e4-4483-a789-c906b66a3153 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:56.121294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b4a97-9f9e-45bc-8b74-9a40452f0e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:56.122165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b4a97-9f9e-45bc-8b74-9a40452f0e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.122443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b4a97-9f9e-45bc-8b74-9a40452f0e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.122721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b4a97-9f9e-45bc-8b74-9a40452f0e2a admin admin] PATH_INFO: `/v3/projects/1bdc44d92d9d426c87e325b65ae5ec9d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.123993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b4a97-9f9e-45bc-8b74-9a40452f0e2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bdc44d92d9d426c87e325b65ae5ec9d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:56.126343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b4a97-9f9e-45bc-8b74-9a40452f0e2a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:56.152755 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 872/1757] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:56.153691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619a14c-078a-43df-aee9-316225c41c2c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:56.167437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619a14c-078a-43df-aee9-316225c41c2c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:56.180801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dd9b4a97-9f9e-45bc-8b74-9a40452f0e2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bdc44d92d9d426c87e325b65ae5ec9d', 'request_id': 'req-dd9b4a97-9f9e-45bc-8b74-9a40452f0e2a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:56.189992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dd9b4a97-9f9e-45bc-8b74-9a40452f0e2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bdc44d92d9d426c87e325b65ae5ec9d', 'request_id': 'req-dd9b4a97-9f9e-45bc-8b74-9a40452f0e2a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:56.198760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dd9b4a97-9f9e-45bc-8b74-9a40452f0e2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bdc44d92d9d426c87e325b65ae5ec9d', 'request_id': 'req-dd9b4a97-9f9e-45bc-8b74-9a40452f0e2a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:56.210238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dd9b4a97-9f9e-45bc-8b74-9a40452f0e2a admin admin] The token cache is being invalidate because project 1bdc44d92d9d426c87e325b65ae5ec9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:00:56.210671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dd9b4a97-9f9e-45bc-8b74-9a40452f0e2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:56.211563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dd9b4a97-9f9e-45bc-8b74-9a40452f0e2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:56.216179 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 886/1758] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:00:56 2022] DELETE /identity/v3/projects/1bdc44d92d9d426c87e325b65ae5ec9d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:56.217264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b4a97-9f9e-45bc-8b74-9a40452f0e2a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:56.219961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dd9b4a97-9f9e-45bc-8b74-9a40452f0e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:56.227762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a40f80-5a06-408c-8f3f-81230f9abb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:56.228472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a40f80-5a06-408c-8f3f-81230f9abb41 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.228806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a40f80-5a06-408c-8f3f-81230f9abb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.229084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a40f80-5a06-408c-8f3f-81230f9abb41 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.229831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a40f80-5a06-408c-8f3f-81230f9abb41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:56.232005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a40f80-5a06-408c-8f3f-81230f9abb41 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:56.232607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:56.262841 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 873/1759] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:56 2022] POST /identity/v3/projects => generated 401 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:56.263998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a40f80-5a06-408c-8f3f-81230f9abb41 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:56.265860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-93a40f80-5a06-408c-8f3f-81230f9abb41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:56.294777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b4a97-9f9e-45bc-8b74-9a40452f0e2a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:56.299484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:56.339631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a40f80-5a06-408c-8f3f-81230f9abb41 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:56.345448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5aa691-6a26-4b88-8689-92c6724895b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:56.346449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5aa691-6a26-4b88-8689-92c6724895b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.346761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5aa691-6a26-4b88-8689-92c6724895b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.347104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5aa691-6a26-4b88-8689-92c6724895b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.347874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5aa691-6a26-4b88-8689-92c6724895b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:56.349798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5aa691-6a26-4b88-8689-92c6724895b2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:56.359932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad0c7c-c315-4de3-8a0e-a42ae9b93b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:56.360657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad0c7c-c315-4de3-8a0e-a42ae9b93b9d admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.360940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad0c7c-c315-4de3-8a0e-a42ae9b93b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.361213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad0c7c-c315-4de3-8a0e-a42ae9b93b9d admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.362082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad0c7c-c315-4de3-8a0e-a42ae9b93b9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:56.366458 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 874/1760] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:56.366458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5aa691-6a26-4b88-8689-92c6724895b2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:56.366681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad0c7c-c315-4de3-8a0e-a42ae9b93b9d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:56.366756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3e5aa691-6a26-4b88-8689-92c6724895b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:56.397945 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 887/1761] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:56 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:56.397945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad0c7c-c315-4de3-8a0e-a42ae9b93b9d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:56.400785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-48ad0c7c-c315-4de3-8a0e-a42ae9b93b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:56.416705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad0c7c-c315-4de3-8a0e-a42ae9b93b9d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:56.422912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9321e00-88b9-4ccf-bfd8-b24ca5781238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:56.423773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9321e00-88b9-4ccf-bfd8-b24ca5781238 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.424083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9321e00-88b9-4ccf-bfd8-b24ca5781238 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.424369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9321e00-88b9-4ccf-bfd8-b24ca5781238 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.425711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9321e00-88b9-4ccf-bfd8-b24ca5781238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:56.428161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9321e00-88b9-4ccf-bfd8-b24ca5781238 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:56.428372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5aa691-6a26-4b88-8689-92c6724895b2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:56.433523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75238e5d-db9f-4bf4-ae24-3cc449ccfb6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:56.434188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75238e5d-db9f-4bf4-ae24-3cc449ccfb6d service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.434475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75238e5d-db9f-4bf4-ae24-3cc449ccfb6d service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.434745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75238e5d-db9f-4bf4-ae24-3cc449ccfb6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.436677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-75238e5d-db9f-4bf4-ae24-3cc449ccfb6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:56.461072 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 888/1762] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:56 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:56.462780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390eb58-e8e1-4e71-99b0-9903430f5ee5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.463162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390eb58-e8e1-4e71-99b0-9903430f5ee5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.463532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390eb58-e8e1-4e71-99b0-9903430f5ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.483308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2390eb58-e8e1-4e71-99b0-9903430f5ee5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:56.485134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2390eb58-e8e1-4e71-99b0-9903430f5ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:56.521640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75238e5d-db9f-4bf4-ae24-3cc449ccfb6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:56.523264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75238e5d-db9f-4bf4-ae24-3cc449ccfb6d service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:56.535653 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 875/1763] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:56.536518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75238e5d-db9f-4bf4-ae24-3cc449ccfb6d service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:56.537897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-75238e5d-db9f-4bf4-ae24-3cc449ccfb6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:56.551699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75238e5d-db9f-4bf4-ae24-3cc449ccfb6d service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:56.582308 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 889/1764] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:56.583302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390eb58-e8e1-4e71-99b0-9903430f5ee5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:56.596768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390eb58-e8e1-4e71-99b0-9903430f5ee5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:56.603599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae28b99-76b8-45ac-93c7-0ea9e0cb1588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:56.604921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28b99-76b8-45ac-93c7-0ea9e0cb1588 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.605354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28b99-76b8-45ac-93c7-0ea9e0cb1588 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.605762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae28b99-76b8-45ac-93c7-0ea9e0cb1588 admin admin] PATH_INFO: `/v3/projects/838d3e40e494430ba0e52cfc3d57a0f9/users/3989676a87274c6f99da6b00243ff2fc/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.626092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae28b99-76b8-45ac-93c7-0ea9e0cb1588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=838d3e40e494430ba0e52cfc3d57a0f9, user_id=3989676a87274c6f99da6b00243ff2fc, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:56.626386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c9fe3-28e0-4f89-89b0-1b123e7d77e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:56.627769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c9fe3-28e0-4f89-89b0-1b123e7d77e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.628142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c9fe3-28e0-4f89-89b0-1b123e7d77e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.628485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c9fe3-28e0-4f89-89b0-1b123e7d77e4 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.629453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c9fe3-28e0-4f89-89b0-1b123e7d77e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:56.631345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae28b99-76b8-45ac-93c7-0ea9e0cb1588 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:56.636219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c9fe3-28e0-4f89-89b0-1b123e7d77e4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:56.643981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:56.647746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:56.650926 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 890/1765] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:56 2022] PUT /identity/v3/projects/838d3e40e494430ba0e52cfc3d57a0f9/users/3989676a87274c6f99da6b00243ff2fc/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:56.651839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae28b99-76b8-45ac-93c7-0ea9e0cb1588 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:56.665903 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 876/1766] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:56 2022] POST /identity/v3/users => generated 307 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:56.665903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c9fe3-28e0-4f89-89b0-1b123e7d77e4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:56.674845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c9fe3-28e0-4f89-89b0-1b123e7d77e4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:56.732731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae28b99-76b8-45ac-93c7-0ea9e0cb1588 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:56.738158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee196260-4e3b-4c31-9e7f-039af32f2224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:56.739037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee196260-4e3b-4c31-9e7f-039af32f2224 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.739549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee196260-4e3b-4c31-9e7f-039af32f2224 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.739913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee196260-4e3b-4c31-9e7f-039af32f2224 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.740207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecc344-873f-44ae-9014-80e24949030e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:56.740849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee196260-4e3b-4c31-9e7f-039af32f2224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:56.740955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecc344-873f-44ae-9014-80e24949030e admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.741145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecc344-873f-44ae-9014-80e24949030e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.741419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecc344-873f-44ae-9014-80e24949030e admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.742157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecc344-873f-44ae-9014-80e24949030e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:56.742582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee196260-4e3b-4c31-9e7f-039af32f2224 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:56.744168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecc344-873f-44ae-9014-80e24949030e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:56.762732 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 891/1767] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:56.764113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5d571-7023-41ae-8ab8-0fdda62096c6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.764405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5d571-7023-41ae-8ab8-0fdda62096c6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.764684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5d571-7023-41ae-8ab8-0fdda62096c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.765864 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 877/1768] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:56 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:56.766601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecc344-873f-44ae-9014-80e24949030e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:56.776024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecc344-873f-44ae-9014-80e24949030e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:56.781146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88117b5-833b-4a6f-8b34-de6e5877d0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:56.781797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88117b5-833b-4a6f-8b34-de6e5877d0ca admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.782079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88117b5-833b-4a6f-8b34-de6e5877d0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.782385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88117b5-833b-4a6f-8b34-de6e5877d0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.783066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88117b5-833b-4a6f-8b34-de6e5877d0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:56.783616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7df5d571-7023-41ae-8ab8-0fdda62096c6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:56.784695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88117b5-833b-4a6f-8b34-de6e5877d0ca admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:56.784900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7df5d571-7023-41ae-8ab8-0fdda62096c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:56.793898 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 892/1769] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:56.796483 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 878/1770] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:56.797271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88117b5-833b-4a6f-8b34-de6e5877d0ca admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:56.800888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5d571-7023-41ae-8ab8-0fdda62096c6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:56.809733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88117b5-833b-4a6f-8b34-de6e5877d0ca admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:56.812799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5d571-7023-41ae-8ab8-0fdda62096c6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:56.815576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1f6a6-c0b1-4eac-b4b3-d6325bcd6535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:56.816615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1f6a6-c0b1-4eac-b4b3-d6325bcd6535 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.816890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1f6a6-c0b1-4eac-b4b3-d6325bcd6535 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.817166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1f6a6-c0b1-4eac-b4b3-d6325bcd6535 admin admin] PATH_INFO: `/v3/projects/b07fd8ace17143ab9e4c27f31ca6e197/users/57b529454d4945f9998eaa3bb2630bce/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.817835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa068ae8-382b-42cb-ab89-b3b33a574943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:56.818530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa068ae8-382b-42cb-ab89-b3b33a574943 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.818805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa068ae8-382b-42cb-ab89-b3b33a574943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.819073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa068ae8-382b-42cb-ab89-b3b33a574943 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.819797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa068ae8-382b-42cb-ab89-b3b33a574943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:56.821439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa068ae8-382b-42cb-ab89-b3b33a574943 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:56.832146 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 893/1771] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:56.833062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa068ae8-382b-42cb-ab89-b3b33a574943 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:56.834817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1f6a6-c0b1-4eac-b4b3-d6325bcd6535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07fd8ace17143ab9e4c27f31ca6e197, user_id=57b529454d4945f9998eaa3bb2630bce, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:56.837644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1f6a6-c0b1-4eac-b4b3-d6325bcd6535 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:56.844536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa068ae8-382b-42cb-ab89-b3b33a574943 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:56.849748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622a80d-5080-4a0c-906b-3858b8815935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:56.850411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622a80d-5080-4a0c-906b-3858b8815935 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.850691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622a80d-5080-4a0c-906b-3858b8815935 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.850959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622a80d-5080-4a0c-906b-3858b8815935 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.851665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622a80d-5080-4a0c-906b-3858b8815935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:56.853292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622a80d-5080-4a0c-906b-3858b8815935 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:56.854769 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 879/1772] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:56 2022] PUT /identity/v3/projects/b07fd8ace17143ab9e4c27f31ca6e197/users/57b529454d4945f9998eaa3bb2630bce/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:56.855732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1f6a6-c0b1-4eac-b4b3-d6325bcd6535 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:56.868372 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 894/1773] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:56.869288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622a80d-5080-4a0c-906b-3858b8815935 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:56.880566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622a80d-5080-4a0c-906b-3858b8815935 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:56.937656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1f6a6-c0b1-4eac-b4b3-d6325bcd6535 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:56.943180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993c188-0d5f-486d-822a-63a9038f239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:56.944230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993c188-0d5f-486d-822a-63a9038f239e admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.944508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993c188-0d5f-486d-822a-63a9038f239e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.944781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993c188-0d5f-486d-822a-63a9038f239e admin admin] PATH_INFO: `/v3/projects/838d3e40e494430ba0e52cfc3d57a0f9/users/3989676a87274c6f99da6b00243ff2fc/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.946893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993c188-0d5f-486d-822a-63a9038f239e admin admin] RBAC: Authorizing `identity:create_grant(project_id=838d3e40e494430ba0e52cfc3d57a0f9, user_id=3989676a87274c6f99da6b00243ff2fc, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:56.947810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9c439-c30d-4764-844b-734ea41a7963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:56.948555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9c439-c30d-4764-844b-734ea41a7963 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:56.948830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9c439-c30d-4764-844b-734ea41a7963 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:56.949124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9c439-c30d-4764-844b-734ea41a7963 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:56.949623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993c188-0d5f-486d-822a-63a9038f239e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:56.949849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9c439-c30d-4764-844b-734ea41a7963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:00:56.950167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9c439-c30d-4764-844b-734ea41a7963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:56.951947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9c439-c30d-4764-844b-734ea41a7963 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:56.970394 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 880/1774] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:56 2022] PUT /identity/v3/projects/838d3e40e494430ba0e52cfc3d57a0f9/users/3989676a87274c6f99da6b00243ff2fc/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:56.970394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993c188-0d5f-486d-822a-63a9038f239e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:56.970705 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 895/1775] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:00:56.970705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9c439-c30d-4764-844b-734ea41a7963 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:56.981726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9c439-c30d-4764-844b-734ea41a7963 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:57.019361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:57.040119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef84ab-5347-44b3-8b34-61b1bc182cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:57.040800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef84ab-5347-44b3-8b34-61b1bc182cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:57.041083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef84ab-5347-44b3-8b34-61b1bc182cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:57.041346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef84ab-5347-44b3-8b34-61b1bc182cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:57.041741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993c188-0d5f-486d-822a-63a9038f239e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:57.042177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef84ab-5347-44b3-8b34-61b1bc182cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:57.043842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef84ab-5347-44b3-8b34-61b1bc182cb2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:57.048071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:57.049446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e1295-a20c-4c3c-8f0d-9e6933abc8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:57.049446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e1295-a20c-4c3c-8f0d-9e6933abc8a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:57.049446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e1295-a20c-4c3c-8f0d-9e6933abc8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:57.049446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e1295-a20c-4c3c-8f0d-9e6933abc8a3 admin admin] PATH_INFO: `/v3/projects/0e5534e7aab045a9ba93b7fd2d2d888e/users/a114d547a12a49af863a437afe3a4dbd/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:57.057139 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 896/1776] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:57.058424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef84ab-5347-44b3-8b34-61b1bc182cb2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:57.067824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e1295-a20c-4c3c-8f0d-9e6933abc8a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5534e7aab045a9ba93b7fd2d2d888e, user_id=a114d547a12a49af863a437afe3a4dbd, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:57.070537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e1295-a20c-4c3c-8f0d-9e6933abc8a3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:57.072995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef84ab-5347-44b3-8b34-61b1bc182cb2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:57.086625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcae552-d1b0-4ed1-85ea-c56439103de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:57.087794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcae552-d1b0-4ed1-85ea-c56439103de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:57.096658 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 881/1777] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:56 2022] PUT /identity/v3/projects/0e5534e7aab045a9ba93b7fd2d2d888e/users/a114d547a12a49af863a437afe3a4dbd/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:57.096658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e1295-a20c-4c3c-8f0d-9e6933abc8a3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:57.097461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcae552-d1b0-4ed1-85ea-c56439103de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:57.097461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcae552-d1b0-4ed1-85ea-c56439103de4 admin admin] PATH_INFO: `/v3/projects/7ba02ab1c7994db9aa0d4ce4b3c84f97/users/7e53321c71aa4b3fa7202e0137817cfb/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:57.116646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcae552-d1b0-4ed1-85ea-c56439103de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba02ab1c7994db9aa0d4ce4b3c84f97, user_id=7e53321c71aa4b3fa7202e0137817cfb, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:57.119655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcae552-d1b0-4ed1-85ea-c56439103de4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:57.135158 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 897/1778] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:57 2022] PUT /identity/v3/projects/7ba02ab1c7994db9aa0d4ce4b3c84f97/users/7e53321c71aa4b3fa7202e0137817cfb/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:57.139456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaf6b2-800d-424d-adf9-0ecc407e1e79 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:57.139747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaf6b2-800d-424d-adf9-0ecc407e1e79 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:57.140199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaf6b2-800d-424d-adf9-0ecc407e1e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:57.163621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e1295-a20c-4c3c-8f0d-9e6933abc8a3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:57.169444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a1eaf6b2-800d-424d-adf9-0ecc407e1e79 None None] MFA Rules not processed for user `3989676a87274c6f99da6b00243ff2fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:57.170887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a1eaf6b2-800d-424d-adf9-0ecc407e1e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:57.223620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cc230-3469-4a46-ab13-a215866b98f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:57.224325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cc230-3469-4a46-ab13-a215866b98f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:57.224609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cc230-3469-4a46-ab13-a215866b98f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:57.224879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cc230-3469-4a46-ab13-a215866b98f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:57.225585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cc230-3469-4a46-ab13-a215866b98f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:57.227565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cc230-3469-4a46-ab13-a215866b98f1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:57.241739 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 898/1779] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:57.242394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eaf6b2-800d-424d-adf9-0ecc407e1e79 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:57.252853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eaf6b2-800d-424d-adf9-0ecc407e1e79 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:57.257624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d369d-3fb6-4262-802c-468beb64f55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:57.258554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d369d-3fb6-4262-802c-468beb64f55b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:57.258911 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 882/1780] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:57 2022] POST /identity/v3/projects => generated 393 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:57.259020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d369d-3fb6-4262-802c-468beb64f55b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:57.259158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d369d-3fb6-4262-802c-468beb64f55b admin admin] PATH_INFO: `/v3/projects/b07fd8ace17143ab9e4c27f31ca6e197/users/57b529454d4945f9998eaa3bb2630bce/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:57.259758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cc230-3469-4a46-ab13-a215866b98f1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:57.261549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d369d-3fb6-4262-802c-468beb64f55b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07fd8ace17143ab9e4c27f31ca6e197, user_id=57b529454d4945f9998eaa3bb2630bce, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:57.264281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d369d-3fb6-4262-802c-468beb64f55b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:57.274985 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 899/1781] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:57 2022] PUT /identity/v3/projects/b07fd8ace17143ab9e4c27f31ca6e197/users/57b529454d4945f9998eaa3bb2630bce/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:57.275716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d369d-3fb6-4262-802c-468beb64f55b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:57.320608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cc230-3469-4a46-ab13-a215866b98f1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:57.324331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:57.343264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d369d-3fb6-4262-802c-468beb64f55b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:57.347947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f7d0b-d2ae-4054-94d0-b17d360045dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:57.348645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f7d0b-d2ae-4054-94d0-b17d360045dd admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:57.348934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f7d0b-d2ae-4054-94d0-b17d360045dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:57.349207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f7d0b-d2ae-4054-94d0-b17d360045dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:57.349926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f7d0b-d2ae-4054-94d0-b17d360045dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:57.351574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f7d0b-d2ae-4054-94d0-b17d360045dd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:57.361397 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 900/1782] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:57.362199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f7d0b-d2ae-4054-94d0-b17d360045dd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:57.363951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d25f7d0b-d2ae-4054-94d0-b17d360045dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:57.378557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb111235-d34f-43b0-ab8a-995a8345b918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:57.379235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb111235-d34f-43b0-ab8a-995a8345b918 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:57.379515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb111235-d34f-43b0-ab8a-995a8345b918 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:57.379789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb111235-d34f-43b0-ab8a-995a8345b918 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:57.380546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb111235-d34f-43b0-ab8a-995a8345b918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:57.382344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb111235-d34f-43b0-ab8a-995a8345b918 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:57.392553 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 883/1783] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:57.393347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb111235-d34f-43b0-ab8a-995a8345b918 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:57.405237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb111235-d34f-43b0-ab8a-995a8345b918 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:57.410778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ced8ce-cc94-4496-94a6-62232cda2a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:57.411411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:57.411544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ced8ce-cc94-4496-94a6-62232cda2a1b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:57.411702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ced8ce-cc94-4496-94a6-62232cda2a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:57.412004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ced8ce-cc94-4496-94a6-62232cda2a1b admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:57.412824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ced8ce-cc94-4496-94a6-62232cda2a1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:57.415212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ced8ce-cc94-4496-94a6-62232cda2a1b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:57.441787 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 884/1784] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:57 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:57.441787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b8775-d776-4585-b65c-d801b752baf8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:57.441787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b8775-d776-4585-b65c-d801b752baf8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:57.441787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b8775-d776-4585-b65c-d801b752baf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:57.443573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f7d0b-d2ae-4054-94d0-b17d360045dd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:57.450980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a374fd6-a048-4ec6-a267-0d313fec2daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:57.451670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a374fd6-a048-4ec6-a267-0d313fec2daa service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:57.451953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a374fd6-a048-4ec6-a267-0d313fec2daa service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:57.452265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a374fd6-a048-4ec6-a267-0d313fec2daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:57.468908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d37b8775-d776-4585-b65c-d801b752baf8 None None] MFA Rules not processed for user `57b529454d4945f9998eaa3bb2630bce`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:57.470509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d37b8775-d776-4585-b65c-d801b752baf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:57.517917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a374fd6-a048-4ec6-a267-0d313fec2daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:57.520349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a374fd6-a048-4ec6-a267-0d313fec2daa service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:57.533166 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 901/1785] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:57.533990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a374fd6-a048-4ec6-a267-0d313fec2daa service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:57.547111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a374fd6-a048-4ec6-a267-0d313fec2daa service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:57.553146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308d005-8de1-46fd-91b0-d24e104ca5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:57.554097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308d005-8de1-46fd-91b0-d24e104ca5a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:57.559565 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 885/1786] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:57.559902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308d005-8de1-46fd-91b0-d24e104ca5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:57.560291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308d005-8de1-46fd-91b0-d24e104ca5a4 admin admin] PATH_INFO: `/v3/projects/7ba02ab1c7994db9aa0d4ce4b3c84f97/users/7e53321c71aa4b3fa7202e0137817cfb/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:57.561538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b8775-d776-4585-b65c-d801b752baf8 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:57.570400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308d005-8de1-46fd-91b0-d24e104ca5a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba02ab1c7994db9aa0d4ce4b3c84f97, user_id=7e53321c71aa4b3fa7202e0137817cfb, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:57.573674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308d005-8de1-46fd-91b0-d24e104ca5a4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:57.589864 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 902/1787] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:57 2022] PUT /identity/v3/projects/7ba02ab1c7994db9aa0d4ce4b3c84f97/users/7e53321c71aa4b3fa7202e0137817cfb/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:57.590015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b8775-d776-4585-b65c-d801b752baf8 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:57.590712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308d005-8de1-46fd-91b0-d24e104ca5a4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:57.689706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc88e7-b914-407b-9a95-52032d13b12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:57.691828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc88e7-b914-407b-9a95-52032d13b12e admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:57.692339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc88e7-b914-407b-9a95-52032d13b12e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:57.693120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc88e7-b914-407b-9a95-52032d13b12e admin admin] PATH_INFO: `/v3/projects/0e5534e7aab045a9ba93b7fd2d2d888e/users/a114d547a12a49af863a437afe3a4dbd/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:57.695401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc88e7-b914-407b-9a95-52032d13b12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5534e7aab045a9ba93b7fd2d2d888e, user_id=a114d547a12a49af863a437afe3a4dbd, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:57.696458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308d005-8de1-46fd-91b0-d24e104ca5a4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:57.698676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc88e7-b914-407b-9a95-52032d13b12e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:57.701248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c5ea4-d9e8-4add-a6f8-9ddf37b58bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:57.701922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c5ea4-d9e8-4add-a6f8-9ddf37b58bcd admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:57.702209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c5ea4-d9e8-4add-a6f8-9ddf37b58bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:57.702488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c5ea4-d9e8-4add-a6f8-9ddf37b58bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:57.703232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c5ea4-d9e8-4add-a6f8-9ddf37b58bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:57.704926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c5ea4-d9e8-4add-a6f8-9ddf37b58bcd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:57.711756 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 886/1788] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:57 2022] PUT /identity/v3/projects/0e5534e7aab045a9ba93b7fd2d2d888e/users/a114d547a12a49af863a437afe3a4dbd/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:57.713925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc88e7-b914-407b-9a95-52032d13b12e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:57.716557 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 903/1789] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:57.717428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c5ea4-d9e8-4add-a6f8-9ddf37b58bcd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:57.724785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2cfc88e7-b914-407b-9a95-52032d13b12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:57.732612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:57.800471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:57.817446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc88e7-b914-407b-9a95-52032d13b12e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:57.820818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c5ea4-d9e8-4add-a6f8-9ddf37b58bcd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:57.825194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e14f9-69d3-45e1-a6ac-1885473909ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:57.825851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e14f9-69d3-45e1-a6ac-1885473909ec service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:57.826159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e14f9-69d3-45e1-a6ac-1885473909ec service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:57.826433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e14f9-69d3-45e1-a6ac-1885473909ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:57.826610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4580c-fa83-4775-a720-88ad3bf979b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:57.827264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4580c-fa83-4775-a720-88ad3bf979b4 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:57.827539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4580c-fa83-4775-a720-88ad3bf979b4 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:57.827817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4580c-fa83-4775-a720-88ad3bf979b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:57.829651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fde4580c-fa83-4775-a720-88ad3bf979b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:57.888545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e14f9-69d3-45e1-a6ac-1885473909ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:57.890395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e14f9-69d3-45e1-a6ac-1885473909ec service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:57.891527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4580c-fa83-4775-a720-88ad3bf979b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:57.893187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4580c-fa83-4775-a720-88ad3bf979b4 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:57.900581 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 887/1790] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:57.902313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3645583-363b-41f2-bea5-4e08367c23e2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:57.902673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3645583-363b-41f2-bea5-4e08367c23e2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:57.902952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3645583-363b-41f2-bea5-4e08367c23e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:57.904982 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 904/1791] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:57.906009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4580c-fa83-4775-a720-88ad3bf979b4 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:57.963047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f3645583-363b-41f2-bea5-4e08367c23e2 None None] MFA Rules not processed for user `7e53321c71aa4b3fa7202e0137817cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:57.967935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f3645583-363b-41f2-bea5-4e08367c23e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:58.048159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4580c-fa83-4775-a720-88ad3bf979b4 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:58.060828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36886e-2213-4c91-8129-58768d9e96ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:58.064630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36886e-2213-4c91-8129-58768d9e96ab admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:58.065077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36886e-2213-4c91-8129-58768d9e96ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:58.065358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36886e-2213-4c91-8129-58768d9e96ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:58.066104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36886e-2213-4c91-8129-58768d9e96ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:58.067792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36886e-2213-4c91-8129-58768d9e96ab admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:58.082853 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 905/1792] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:58.084560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22171f1-7a23-4577-ba64-e5900aa14484 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:58.085042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22171f1-7a23-4577-ba64-e5900aa14484 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:58.085506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22171f1-7a23-4577-ba64-e5900aa14484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:58.114821 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 888/1793] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:58.116175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a58e51-3458-48cf-87e5-b79bd50d3517 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:58.116490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a58e51-3458-48cf-87e5-b79bd50d3517 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:58.116739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a58e51-3458-48cf-87e5-b79bd50d3517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:58.135836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d9a58e51-3458-48cf-87e5-b79bd50d3517 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:58.137099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d9a58e51-3458-48cf-87e5-b79bd50d3517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:58.138372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e22171f1-7a23-4577-ba64-e5900aa14484 None None] MFA Rules not processed for user `a114d547a12a49af863a437afe3a4dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:58.140184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e22171f1-7a23-4577-ba64-e5900aa14484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:58.155982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:58.210164 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 889/1794] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:00:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:58.218522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a58e51-3458-48cf-87e5-b79bd50d3517 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:58.246874 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 906/1795] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:58 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:58.246874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22171f1-7a23-4577-ba64-e5900aa14484 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:58.247169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a58e51-3458-48cf-87e5-b79bd50d3517 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:58.251838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d198fc-a919-49b6-a956-ba9cc3615993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:58.253262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d198fc-a919-49b6-a956-ba9cc3615993 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:58.253262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d198fc-a919-49b6-a956-ba9cc3615993 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:58.253475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d198fc-a919-49b6-a956-ba9cc3615993 admin admin] PATH_INFO: `/v3/projects/4b24a22b9a2043ce990653db8ea28a5a/users/69ce5d41ca8a41a0a9a6e42f1f08ba04/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:58.261753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22171f1-7a23-4577-ba64-e5900aa14484 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:58.269534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0944dda-f3db-48b4-b8dd-6e0b4fa9ea4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:58.270362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0944dda-f3db-48b4-b8dd-6e0b4fa9ea4f service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:58.270712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0944dda-f3db-48b4-b8dd-6e0b4fa9ea4f service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:58.271058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0944dda-f3db-48b4-b8dd-6e0b4fa9ea4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:58.287041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0944dda-f3db-48b4-b8dd-6e0b4fa9ea4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:58.288464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0944dda-f3db-48b4-b8dd-6e0b4fa9ea4f service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:58.290666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d198fc-a919-49b6-a956-ba9cc3615993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b24a22b9a2043ce990653db8ea28a5a, user_id=69ce5d41ca8a41a0a9a6e42f1f08ba04, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:58.297586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d198fc-a919-49b6-a956-ba9cc3615993 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:58.299302 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 907/1796] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:58.332476 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 890/1797] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:00:58 2022] PUT /identity/v3/projects/4b24a22b9a2043ce990653db8ea28a5a/users/69ce5d41ca8a41a0a9a6e42f1f08ba04/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:58.333072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84527872-250d-46d5-b1fc-c55b08b9e274 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:58.333072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84527872-250d-46d5-b1fc-c55b08b9e274 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:58.333256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84527872-250d-46d5-b1fc-c55b08b9e274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:58.340979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:58.375403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-84527872-250d-46d5-b1fc-c55b08b9e274 None None] MFA Rules not processed for user `69ce5d41ca8a41a0a9a6e42f1f08ba04`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:58.376793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-84527872-250d-46d5-b1fc-c55b08b9e274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:58.397622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d198fc-a919-49b6-a956-ba9cc3615993 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:58.461655 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 908/1798] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:00:58.462754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84527872-250d-46d5-b1fc-c55b08b9e274 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:58.464303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-84527872-250d-46d5-b1fc-c55b08b9e274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:58.509013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d198fc-a919-49b6-a956-ba9cc3615993 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:58.515158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755516f3-6108-4ea0-85c5-36c844b52075 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:58.515958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755516f3-6108-4ea0-85c5-36c844b52075 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:58.516336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755516f3-6108-4ea0-85c5-36c844b52075 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:58.516821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755516f3-6108-4ea0-85c5-36c844b52075 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:58.560191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84527872-250d-46d5-b1fc-c55b08b9e274 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:58.566321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31c7c6-dbe6-48e2-8be6-bfc1fefd1604 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:58.567312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31c7c6-dbe6-48e2-8be6-bfc1fefd1604 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:58.567665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31c7c6-dbe6-48e2-8be6-bfc1fefd1604 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:58.568123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31c7c6-dbe6-48e2-8be6-bfc1fefd1604 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:58.613930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755516f3-6108-4ea0-85c5-36c844b52075 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:58.615586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755516f3-6108-4ea0-85c5-36c844b52075 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:58.630661 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 891/1799] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:58 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:58.644485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755516f3-6108-4ea0-85c5-36c844b52075 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:58.645498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31c7c6-dbe6-48e2-8be6-bfc1fefd1604 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:58.647959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31c7c6-dbe6-48e2-8be6-bfc1fefd1604 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:58.672492 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 909/1800] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:00:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:00:58.755605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:58.841345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755516f3-6108-4ea0-85c5-36c844b52075 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:58.856322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31f15f-d1d8-4bff-bdb4-be7786a1c9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:58.858828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31f15f-d1d8-4bff-bdb4-be7786a1c9ea admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:58.860977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31f15f-d1d8-4bff-bdb4-be7786a1c9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:58.861480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31f15f-d1d8-4bff-bdb4-be7786a1c9ea admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:58.863421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31f15f-d1d8-4bff-bdb4-be7786a1c9ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:58.867234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31f15f-d1d8-4bff-bdb4-be7786a1c9ea admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:58.910671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31c7c6-dbe6-48e2-8be6-bfc1fefd1604 service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:58.931265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31c7c6-dbe6-48e2-8be6-bfc1fefd1604 service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:58.948961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1c668-fa88-4bea-ad4a-1d9a982b5e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:58.949704 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 892/1801] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:00:58 2022] POST /identity/v3/projects => generated 393 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:58.949999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1c668-fa88-4bea-ad4a-1d9a982b5e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:58.950281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1c668-fa88-4bea-ad4a-1d9a982b5e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:58.950553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1c668-fa88-4bea-ad4a-1d9a982b5e64 admin admin] PATH_INFO: `/v3/users/87a3518e60d74bb1921aad6e34203c86` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:58.951374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31f15f-d1d8-4bff-bdb4-be7786a1c9ea admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:58.952070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1c668-fa88-4bea-ad4a-1d9a982b5e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a3518e60d74bb1921aad6e34203c86)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:58.959176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1c668-fa88-4bea-ad4a-1d9a982b5e64 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:59.036468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:59.080500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d2c1c668-fa88-4bea-ad4a-1d9a982b5e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a3518e60d74bb1921aad6e34203c86'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:59.161502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d2c1c668-fa88-4bea-ad4a-1d9a982b5e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a3518e60d74bb1921aad6e34203c86'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:59.163515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d2c1c668-fa88-4bea-ad4a-1d9a982b5e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a3518e60d74bb1921aad6e34203c86'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:59.164795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d2c1c668-fa88-4bea-ad4a-1d9a982b5e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a3518e60d74bb1921aad6e34203c86'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:59.181529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d2c1c668-fa88-4bea-ad4a-1d9a982b5e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a3518e60d74bb1921aad6e34203c86'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:59.238161 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 910/1802] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:00:58 2022] DELETE /identity/v3/users/87a3518e60d74bb1921aad6e34203c86 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:00:59.239244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1c668-fa88-4bea-ad4a-1d9a982b5e64 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:59.243948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d2c1c668-fa88-4bea-ad4a-1d9a982b5e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:59.248538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31f15f-d1d8-4bff-bdb4-be7786a1c9ea admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:59.347817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1c668-fa88-4bea-ad4a-1d9a982b5e64 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:59.354275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e7cb2-03b4-4385-9a47-62e10b8aa4cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:59.355508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec69658-7e26-4ff2-a0c9-a71f31a72059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:59.356346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e7cb2-03b4-4385-9a47-62e10b8aa4cf service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:59.356586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec69658-7e26-4ff2-a0c9-a71f31a72059 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:59.357010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec69658-7e26-4ff2-a0c9-a71f31a72059 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:59.357262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e7cb2-03b4-4385-9a47-62e10b8aa4cf service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:59.357369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec69658-7e26-4ff2-a0c9-a71f31a72059 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:59.357804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e7cb2-03b4-4385-9a47-62e10b8aa4cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:59.358332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec69658-7e26-4ff2-a0c9-a71f31a72059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:59.360592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bd0e7cb2-03b4-4385-9a47-62e10b8aa4cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:59.361131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec69658-7e26-4ff2-a0c9-a71f31a72059 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:59.388839 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 911/1803] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:00:59 2022] POST /identity/v3/users => generated 303 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:00:59.389864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec69658-7e26-4ff2-a0c9-a71f31a72059 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:59.391748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dec69658-7e26-4ff2-a0c9-a71f31a72059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:59.407444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec69658-7e26-4ff2-a0c9-a71f31a72059 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:59.428487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fdfcc-d1ab-457e-9379-04ccaded04ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:59.437283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fdfcc-d1ab-457e-9379-04ccaded04ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:59.437283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fdfcc-d1ab-457e-9379-04ccaded04ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:59.437283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fdfcc-d1ab-457e-9379-04ccaded04ba admin admin] PATH_INFO: `/v3/users/4fc70b6bd8624f53965366f5c521d3c5` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:59.437283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fdfcc-d1ab-457e-9379-04ccaded04ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc70b6bd8624f53965366f5c521d3c5)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:59.438715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fdfcc-d1ab-457e-9379-04ccaded04ba admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:59.473643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:59.477204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e7cb2-03b4-4385-9a47-62e10b8aa4cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:59.497495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e7cb2-03b4-4385-9a47-62e10b8aa4cf service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:59.533921 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 893/1804] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:59.535146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c941cb-518d-401a-b9d6-a57db18034da None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:59.541056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c941cb-518d-401a-b9d6-a57db18034da None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:59.541400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c941cb-518d-401a-b9d6-a57db18034da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:59.563620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-da5fdfcc-d1ab-457e-9379-04ccaded04ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc70b6bd8624f53965366f5c521d3c5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:59.590674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-da5fdfcc-d1ab-457e-9379-04ccaded04ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc70b6bd8624f53965366f5c521d3c5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:59.590674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-da5fdfcc-d1ab-457e-9379-04ccaded04ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc70b6bd8624f53965366f5c521d3c5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:59.593683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-da5fdfcc-d1ab-457e-9379-04ccaded04ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc70b6bd8624f53965366f5c521d3c5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:59.622491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-da5fdfcc-d1ab-457e-9379-04ccaded04ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc70b6bd8624f53965366f5c521d3c5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:00:59.650657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-30c941cb-518d-401a-b9d6-a57db18034da None None] MFA Rules not processed for user `684732cf5a004fb084ce0e523398c970`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:59.652347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-30c941cb-518d-401a-b9d6-a57db18034da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:59.658938 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 912/1805] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:00:59 2022] DELETE /identity/v3/users/4fc70b6bd8624f53965366f5c521d3c5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:00:59.665681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb28acf-bd4c-4fbf-837f-d51ac2aa9742 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:59.666189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb28acf-bd4c-4fbf-837f-d51ac2aa9742 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:59.666852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb28acf-bd4c-4fbf-837f-d51ac2aa9742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:59.688912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=80,keystone:DELETE=15,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:59.705424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5eb28acf-bd4c-4fbf-837f-d51ac2aa9742 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:59.707071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5eb28acf-bd4c-4fbf-837f-d51ac2aa9742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:59.805751 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 894/1806] 10.222.0.58 () {58 vars in 1015 bytes} [Sat Jul 2 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:59.805751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c941cb-518d-401a-b9d6-a57db18034da None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:59.805751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-30c941cb-518d-401a-b9d6-a57db18034da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:59.884112 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 913/1807] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:59.884112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7e4be-3415-43e7-95b4-c1dd7d3ecd33 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:59.884112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7e4be-3415-43e7-95b4-c1dd7d3ecd33 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:59.884112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7e4be-3415-43e7-95b4-c1dd7d3ecd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:59.935623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c941cb-518d-401a-b9d6-a57db18034da None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:59.941334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f0330-e60a-4f22-ae8f-9fe2dd60bf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:59.942063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f0330-e60a-4f22-ae8f-9fe2dd60bf9c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:59.942423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f0330-e60a-4f22-ae8f-9fe2dd60bf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:59.942703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f0330-e60a-4f22-ae8f-9fe2dd60bf9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:59.943485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f0330-e60a-4f22-ae8f-9fe2dd60bf9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:00:59.945340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f0330-e60a-4f22-ae8f-9fe2dd60bf9c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:00:59.946061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0fc7e4be-3415-43e7-95b4-c1dd7d3ecd33 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:00:59.947597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0fc7e4be-3415-43e7-95b4-c1dd7d3ecd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:59.966645 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 914/1808] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:00:59.966645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7e4be-3415-43e7-95b4-c1dd7d3ecd33 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:59.966645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0fc7e4be-3415-43e7-95b4-c1dd7d3ecd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:00:59.973762 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 895/1809] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:00:59.975277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f0330-e60a-4f22-ae8f-9fe2dd60bf9c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:00:59.988483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f0330-e60a-4f22-ae8f-9fe2dd60bf9c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:00:59.992638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634ebdd-4698-4363-934c-70ed5d2efe9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:00:59.993404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634ebdd-4698-4363-934c-70ed5d2efe9e service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:00:59.993783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634ebdd-4698-4363-934c-70ed5d2efe9e service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:00:59.994149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634ebdd-4698-4363-934c-70ed5d2efe9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:00:59.998521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7e4be-3415-43e7-95b4-c1dd7d3ecd33 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:00.002604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce4366-f66a-4c5a-a813-3420ea8a917b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:00.003574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce4366-f66a-4c5a-a813-3420ea8a917b service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:00.004003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce4366-f66a-4c5a-a813-3420ea8a917b service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:00.004482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce4366-f66a-4c5a-a813-3420ea8a917b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:00.018686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce4366-f66a-4c5a-a813-3420ea8a917b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:00.020701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce4366-f66a-4c5a-a813-3420ea8a917b service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:00.032200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634ebdd-4698-4363-934c-70ed5d2efe9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:00.034478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634ebdd-4698-4363-934c-70ed5d2efe9e service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:00.037150 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 915/1810] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:00.039642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce4366-f66a-4c5a-a813-3420ea8a917b service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:00.041892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a6ce4366-f66a-4c5a-a813-3420ea8a917b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:00.063437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce4366-f66a-4c5a-a813-3420ea8a917b service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:00.072848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b1e89-f396-4774-9c70-b6e2fd0b0da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:00.077739 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 896/1811] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:00.077739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634ebdd-4698-4363-934c-70ed5d2efe9e service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:00.082483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b1e89-f396-4774-9c70-b6e2fd0b0da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:00.083043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b1e89-f396-4774-9c70-b6e2fd0b0da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:00.086882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b1e89-f396-4774-9c70-b6e2fd0b0da9 admin admin] PATH_INFO: `/v3/users/d81aa185b2134cf090495a03bf3cdf02` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:00.100284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b1e89-f396-4774-9c70-b6e2fd0b0da9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d81aa185b2134cf090495a03bf3cdf02)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:00.100790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634ebdd-4698-4363-934c-70ed5d2efe9e service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:00.103114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b1e89-f396-4774-9c70-b6e2fd0b0da9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:00.108089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b6e95-5314-4d09-a18f-a696203d67c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:00.109206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b6e95-5314-4d09-a18f-a696203d67c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:00.109713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b6e95-5314-4d09-a18f-a696203d67c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:00.110086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b6e95-5314-4d09-a18f-a696203d67c1 admin admin] PATH_INFO: `/v3/projects/907d1642a1eb4a68b58522e541f43393/users/327fa782b7e343269362a697106fa772/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:00.150497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b6e95-5314-4d09-a18f-a696203d67c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=907d1642a1eb4a68b58522e541f43393, user_id=327fa782b7e343269362a697106fa772, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:00.155273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b6e95-5314-4d09-a18f-a696203d67c1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:00.192061 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 897/1812] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:00 2022] PUT /identity/v3/projects/907d1642a1eb4a68b58522e541f43393/users/327fa782b7e343269362a697106fa772/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:00.192061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b6e95-5314-4d09-a18f-a696203d67c1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:00.201885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ff5b1e89-f396-4774-9c70-b6e2fd0b0da9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd81aa185b2134cf090495a03bf3cdf02'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:00.214292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ff5b1e89-f396-4774-9c70-b6e2fd0b0da9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd81aa185b2134cf090495a03bf3cdf02'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:00.215335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ff5b1e89-f396-4774-9c70-b6e2fd0b0da9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd81aa185b2134cf090495a03bf3cdf02'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:00.216381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ff5b1e89-f396-4774-9c70-b6e2fd0b0da9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd81aa185b2134cf090495a03bf3cdf02'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:00.243123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ff5b1e89-f396-4774-9c70-b6e2fd0b0da9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd81aa185b2134cf090495a03bf3cdf02'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:00.293376 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 916/1813] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:00 2022] DELETE /identity/v3/users/d81aa185b2134cf090495a03bf3cdf02 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:00.293376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b1e89-f396-4774-9c70-b6e2fd0b0da9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:00.297127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ff5b1e89-f396-4774-9c70-b6e2fd0b0da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:00.304866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b6e95-5314-4d09-a18f-a696203d67c1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:00.309090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:00.377374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a0743-52fd-4120-a435-f3e6b39393eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:00.379490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a0743-52fd-4120-a435-f3e6b39393eb service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:00.379913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a0743-52fd-4120-a435-f3e6b39393eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:00.380345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a0743-52fd-4120-a435-f3e6b39393eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:00.383324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b68a0743-52fd-4120-a435-f3e6b39393eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:00.446144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b1e89-f396-4774-9c70-b6e2fd0b0da9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:00.454379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261e435-dfc7-4b32-bc7d-df44f2c5e085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:00.455481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261e435-dfc7-4b32-bc7d-df44f2c5e085 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:00.455895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261e435-dfc7-4b32-bc7d-df44f2c5e085 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:00.456304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261e435-dfc7-4b32-bc7d-df44f2c5e085 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:00.457658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261e435-dfc7-4b32-bc7d-df44f2c5e085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:00.460127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261e435-dfc7-4b32-bc7d-df44f2c5e085 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:00.462415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:00.479661 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 917/1814] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:00.481861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a0743-52fd-4120-a435-f3e6b39393eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:00.482489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1854dc-b766-4e44-8c30-f80d30e5f010 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:00.483301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1854dc-b766-4e44-8c30-f80d30e5f010 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:00.483417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a0743-52fd-4120-a435-f3e6b39393eb service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:00.485047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1854dc-b766-4e44-8c30-f80d30e5f010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:00.501730 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 898/1815] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:00.502646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a0743-52fd-4120-a435-f3e6b39393eb service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:00.517185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1b1854dc-b766-4e44-8c30-f80d30e5f010 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:00.519672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1b1854dc-b766-4e44-8c30-f80d30e5f010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:00.523186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a0743-52fd-4120-a435-f3e6b39393eb service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:00.528971 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 918/1816] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:00.534450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ff71e-79b0-48a0-b3bb-d37cfbd9f7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:00.535408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ff71e-79b0-48a0-b3bb-d37cfbd9f7f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:00.535688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ff71e-79b0-48a0-b3bb-d37cfbd9f7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:00.536397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ff71e-79b0-48a0-b3bb-d37cfbd9f7f9 admin admin] PATH_INFO: `/v3/projects/907d1642a1eb4a68b58522e541f43393/users/327fa782b7e343269362a697106fa772/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:00.539296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ff71e-79b0-48a0-b3bb-d37cfbd9f7f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=907d1642a1eb4a68b58522e541f43393, user_id=327fa782b7e343269362a697106fa772, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:00.543523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1854dc-b766-4e44-8c30-f80d30e5f010 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:00.543697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ff71e-79b0-48a0-b3bb-d37cfbd9f7f9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:00.544690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1b1854dc-b766-4e44-8c30-f80d30e5f010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:00.559466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1854dc-b766-4e44-8c30-f80d30e5f010 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:00.566450 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 899/1817] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:00 2022] PUT /identity/v3/projects/907d1642a1eb4a68b58522e541f43393/users/327fa782b7e343269362a697106fa772/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:00.568208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f44623-75a3-4717-8926-3e514a34780d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:00.568534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f44623-75a3-4717-8926-3e514a34780d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:00.568778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f44623-75a3-4717-8926-3e514a34780d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:00.648652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f5f44623-75a3-4717-8926-3e514a34780d None None] MFA Rules not processed for user `327fa782b7e343269362a697106fa772`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:00.650156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f5f44623-75a3-4717-8926-3e514a34780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:00.691656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f28998-6414-4fd5-a804-990faf3e2fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:00.692636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f28998-6414-4fd5-a804-990faf3e2fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:00.692995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f28998-6414-4fd5-a804-990faf3e2fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:00.693340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f28998-6414-4fd5-a804-990faf3e2fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:00.846251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f28998-6414-4fd5-a804-990faf3e2fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:00.847839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f28998-6414-4fd5-a804-990faf3e2fd0 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:00.849562 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 900/1818] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:00.853842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f44623-75a3-4717-8926-3e514a34780d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:00.866174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f44623-75a3-4717-8926-3e514a34780d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:00.877563 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 919/1819] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:01:00.881864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1735b0-7b09-44ed-b3b3-d1091f6b2930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:00.882894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1735b0-7b09-44ed-b3b3-d1091f6b2930 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:00.883392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1735b0-7b09-44ed-b3b3-d1091f6b2930 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:00.884571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1735b0-7b09-44ed-b3b3-d1091f6b2930 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:00.885613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1735b0-7b09-44ed-b3b3-d1091f6b2930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:00.890612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1735b0-7b09-44ed-b3b3-d1091f6b2930 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:00.949369 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 901/1820] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:00 2022] POST /identity/v3/projects => generated 393 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:00.951204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f28998-6414-4fd5-a804-990faf3e2fd0 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:00.971770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f28998-6414-4fd5-a804-990faf3e2fd0 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:01.101614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf45da-47c6-4622-bcd0-4bd777b9c2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:01.102798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf45da-47c6-4622-bcd0-4bd777b9c2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:01.103195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf45da-47c6-4622-bcd0-4bd777b9c2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:01.103573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf45da-47c6-4622-bcd0-4bd777b9c2f4 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:01.104608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf45da-47c6-4622-bcd0-4bd777b9c2f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:01.107198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf45da-47c6-4622-bcd0-4bd777b9c2f4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:01.139534 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 920/1821] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:00 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:01.141075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1735b0-7b09-44ed-b3b3-d1091f6b2930 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:01.158522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1735b0-7b09-44ed-b3b3-d1091f6b2930 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:01.172019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58378cd9-229e-45f4-95c7-1fcc61606338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:01.172963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58378cd9-229e-45f4-95c7-1fcc61606338 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:01.173348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58378cd9-229e-45f4-95c7-1fcc61606338 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:01.174037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58378cd9-229e-45f4-95c7-1fcc61606338 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:01.174965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58378cd9-229e-45f4-95c7-1fcc61606338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:01.176976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58378cd9-229e-45f4-95c7-1fcc61606338 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:01.181514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:01.216774 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 902/1822] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:01.218592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf45da-47c6-4622-bcd0-4bd777b9c2f4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:01.235668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf45da-47c6-4622-bcd0-4bd777b9c2f4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:01.242137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a28f7-1058-42ec-8ec0-2b5149e6dd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:01.242931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a28f7-1058-42ec-8ec0-2b5149e6dd13 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:01.243200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a28f7-1058-42ec-8ec0-2b5149e6dd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:01.243527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a28f7-1058-42ec-8ec0-2b5149e6dd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:01.244388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a28f7-1058-42ec-8ec0-2b5149e6dd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:01.246637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a28f7-1058-42ec-8ec0-2b5149e6dd13 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:01.268186 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 921/1823] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:01.280076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58378cd9-229e-45f4-95c7-1fcc61606338 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:01.288912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58378cd9-229e-45f4-95c7-1fcc61606338 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:01.301779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095d40a-1cb0-4411-829b-9c4d9255629a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:01.303329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095d40a-1cb0-4411-829b-9c4d9255629a admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:01.303894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095d40a-1cb0-4411-829b-9c4d9255629a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:01.304365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095d40a-1cb0-4411-829b-9c4d9255629a admin admin] PATH_INFO: `/v3/projects/798845d7ca1f4577ac6ae317a7eece2b/users/e9d0f3b1bea04e4a953595f44b1f93fe/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:01.364240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095d40a-1cb0-4411-829b-9c4d9255629a admin admin] RBAC: Authorizing `identity:create_grant(project_id=798845d7ca1f4577ac6ae317a7eece2b, user_id=e9d0f3b1bea04e4a953595f44b1f93fe, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:01.368341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095d40a-1cb0-4411-829b-9c4d9255629a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:01.393197 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 903/1824] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:01 2022] PUT /identity/v3/projects/798845d7ca1f4577ac6ae317a7eece2b/users/e9d0f3b1bea04e4a953595f44b1f93fe/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:01.407445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7d4e1-db42-42ac-959f-1ebbc3a153e3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:01.407739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7d4e1-db42-42ac-959f-1ebbc3a153e3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:01.408021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7d4e1-db42-42ac-959f-1ebbc3a153e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:01.485118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bef7d4e1-db42-42ac-959f-1ebbc3a153e3 None None] MFA Rules not processed for user `e9d0f3b1bea04e4a953595f44b1f93fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:01.487504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bef7d4e1-db42-42ac-959f-1ebbc3a153e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:01.505297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:01.540188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095d40a-1cb0-4411-829b-9c4d9255629a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:01.541789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1095d40a-1cb0-4411-829b-9c4d9255629a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:01.684203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095d40a-1cb0-4411-829b-9c4d9255629a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:01.690181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba427f-c895-4ea3-bbe9-c471d5e58e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:01.691396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba427f-c895-4ea3-bbe9-c471d5e58e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:01.691923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba427f-c895-4ea3-bbe9-c471d5e58e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:01.692617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba427f-c895-4ea3-bbe9-c471d5e58e12 admin admin] PATH_INFO: `/v3/projects/a0b01ef5940f47eab5705b2393dcad53` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:01.694876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba427f-c895-4ea3-bbe9-c471d5e58e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b01ef5940f47eab5705b2393dcad53)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:01.697395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba427f-c895-4ea3-bbe9-c471d5e58e12 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:01.708854 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 922/1825] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:01.725057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7d4e1-db42-42ac-959f-1ebbc3a153e3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:01.727916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bef7d4e1-db42-42ac-959f-1ebbc3a153e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:01.804089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-efba427f-c895-4ea3-bbe9-c471d5e58e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b01ef5940f47eab5705b2393dcad53', 'request_id': 'req-efba427f-c895-4ea3-bbe9-c471d5e58e12'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:01.814376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-efba427f-c895-4ea3-bbe9-c471d5e58e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b01ef5940f47eab5705b2393dcad53', 'request_id': 'req-efba427f-c895-4ea3-bbe9-c471d5e58e12'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:01.835027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-efba427f-c895-4ea3-bbe9-c471d5e58e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b01ef5940f47eab5705b2393dcad53', 'request_id': 'req-efba427f-c895-4ea3-bbe9-c471d5e58e12'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:01.854204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-efba427f-c895-4ea3-bbe9-c471d5e58e12 admin admin] The token cache is being invalidate because project a0b01ef5940f47eab5705b2393dcad53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:01.854668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-efba427f-c895-4ea3-bbe9-c471d5e58e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:01.858103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7d4e1-db42-42ac-959f-1ebbc3a153e3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:01.867107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-efba427f-c895-4ea3-bbe9-c471d5e58e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:01.873479 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 904/1826] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:01 2022] DELETE /identity/v3/projects/a0b01ef5940f47eab5705b2393dcad53 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:01:01.877989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba427f-c895-4ea3-bbe9-c471d5e58e12 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:01.881556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-efba427f-c895-4ea3-bbe9-c471d5e58e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:01.941692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f00ff-9c25-48bd-b252-efc2465ea2a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:01.942576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f00ff-9c25-48bd-b252-efc2465ea2a2 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:01.942883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f00ff-9c25-48bd-b252-efc2465ea2a2 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:01.943277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f00ff-9c25-48bd-b252-efc2465ea2a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:01.945833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b34f00ff-9c25-48bd-b252-efc2465ea2a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:02.010624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:02.085878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f00ff-9c25-48bd-b252-efc2465ea2a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:02.087904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f00ff-9c25-48bd-b252-efc2465ea2a2 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:02.104398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba427f-c895-4ea3-bbe9-c471d5e58e12 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:02.117032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d7c07-36e6-49a5-8011-41c03cda5797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:02.118049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d7c07-36e6-49a5-8011-41c03cda5797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:02.118525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d7c07-36e6-49a5-8011-41c03cda5797 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:02.119134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d7c07-36e6-49a5-8011-41c03cda5797 admin admin] PATH_INFO: `/v3/users/a114d547a12a49af863a437afe3a4dbd` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:02.119304 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 923/1827] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:02.120177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d7c07-36e6-49a5-8011-41c03cda5797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a114d547a12a49af863a437afe3a4dbd)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:02.122307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d7c07-36e6-49a5-8011-41c03cda5797 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:02.136095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:02.180875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb38571-3eb7-48d2-bd84-e74233f59534 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:02.181953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb38571-3eb7-48d2-bd84-e74233f59534 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:02.181953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb38571-3eb7-48d2-bd84-e74233f59534 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:02.183891 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 924/1828] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:02.197932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb38571-3eb7-48d2-bd84-e74233f59534 None None] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:02.202302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5cb38571-3eb7-48d2-bd84-e74233f59534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:02.236085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-249d7c07-36e6-49a5-8011-41c03cda5797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a114d547a12a49af863a437afe3a4dbd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:02.256890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-249d7c07-36e6-49a5-8011-41c03cda5797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a114d547a12a49af863a437afe3a4dbd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:02.275766 ncdv-master-1 devstack@keystone.service[91078]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-5cb38571-3eb7-48d2-bd84-e74233f59534 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 02 21:01:02.276482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb38571-3eb7-48d2-bd84-e74233f59534 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:02.277592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-249d7c07-36e6-49a5-8011-41c03cda5797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a114d547a12a49af863a437afe3a4dbd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:02.279699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-249d7c07-36e6-49a5-8011-41c03cda5797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a114d547a12a49af863a437afe3a4dbd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:02.280662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-249d7c07-36e6-49a5-8011-41c03cda5797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a114d547a12a49af863a437afe3a4dbd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:02.321544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb38571-3eb7-48d2-bd84-e74233f59534 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:02.339732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ce510-1016-4784-9f5e-9c82b3fee159 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '327fa782b7e343269362a697106fa772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907d1642a1eb4a68b58522e541f43393', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:02.341531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ce510-1016-4784-9f5e-9c82b3fee159 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:02.343230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ce510-1016-4784-9f5e-9c82b3fee159 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:02.343516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ce510-1016-4784-9f5e-9c82b3fee159 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] PATH_INFO: `/v3/projects/4b24a22b9a2043ce990653db8ea28a5a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:02.349267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ce510-1016-4784-9f5e-9c82b3fee159 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] RBAC: Authorizing `identity:get_project(project_id=4b24a22b9a2043ce990653db8ea28a5a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:02.355974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ce510-1016-4784-9f5e-9c82b3fee159 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:02.366071 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 905/1830] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:01 2022] DELETE /identity/v3/users/a114d547a12a49af863a437afe3a4dbd => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:01:02.369510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2d8cb-b18f-48f2-99c6-e2e52f4c03ec None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:02.370176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2d8cb-b18f-48f2-99c6-e2e52f4c03ec None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:02.370756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2d8cb-b18f-48f2-99c6-e2e52f4c03ec None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:02.373008 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 925/1830] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:02 2022] GET /identity/v3/projects/4b24a22b9a2043ce990653db8ea28a5a => generated 393 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:01:02.374301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ce510-1016-4784-9f5e-9c82b3fee159 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:02.384576 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 906/1831] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:01:02 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:02.392436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9a6ce510-1016-4784-9f5e-9c82b3fee159 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:02.459411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ce510-1016-4784-9f5e-9c82b3fee159 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:02.459596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75b447-3b07-43fa-b913-68cd1a87ade8 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:02.460098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75b447-3b07-43fa-b913-68cd1a87ade8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:02.460098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75b447-3b07-43fa-b913-68cd1a87ade8 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:02.461800 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 907/1832] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:02.476531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75b447-3b07-43fa-b913-68cd1a87ade8 None None] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:02.478708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2a75b447-3b07-43fa-b913-68cd1a87ade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:02.660869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720b96b-41a0-4d5e-bb8d-025071451be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:02.662033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720b96b-41a0-4d5e-bb8d-025071451be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:02.662327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720b96b-41a0-4d5e-bb8d-025071451be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:02.662612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720b96b-41a0-4d5e-bb8d-025071451be9 admin admin] PATH_INFO: `/v3/projects/a2fc9601cb2e4e36ae887b890192d35d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:02.668798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720b96b-41a0-4d5e-bb8d-025071451be9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2fc9601cb2e4e36ae887b890192d35d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:02.670836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720b96b-41a0-4d5e-bb8d-025071451be9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:02.721368 ncdv-master-1 devstack@keystone.service[91077]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-2a75b447-3b07-43fa-b913-68cd1a87ade8 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 02 21:01:02.721981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75b447-3b07-43fa-b913-68cd1a87ade8 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:02.731849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2a75b447-3b07-43fa-b913-68cd1a87ade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:02.788520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4720b96b-41a0-4d5e-bb8d-025071451be9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2fc9601cb2e4e36ae887b890192d35d', 'request_id': 'req-4720b96b-41a0-4d5e-bb8d-025071451be9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:02.802250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4720b96b-41a0-4d5e-bb8d-025071451be9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2fc9601cb2e4e36ae887b890192d35d', 'request_id': 'req-4720b96b-41a0-4d5e-bb8d-025071451be9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:02.822211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4720b96b-41a0-4d5e-bb8d-025071451be9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2fc9601cb2e4e36ae887b890192d35d', 'request_id': 'req-4720b96b-41a0-4d5e-bb8d-025071451be9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:02.838883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4720b96b-41a0-4d5e-bb8d-025071451be9 admin admin] The token cache is being invalidate because project a2fc9601cb2e4e36ae887b890192d35d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:02.839169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4720b96b-41a0-4d5e-bb8d-025071451be9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:02.844595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4720b96b-41a0-4d5e-bb8d-025071451be9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:02.849327 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 926/1833] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:02 2022] DELETE /identity/v3/projects/a2fc9601cb2e4e36ae887b890192d35d => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:02.849327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dae2e2-bdd6-40a1-ac6f-185f2f3c0aa6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:02.849327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dae2e2-bdd6-40a1-ac6f-185f2f3c0aa6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:02.849327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dae2e2-bdd6-40a1-ac6f-185f2f3c0aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:02.888489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d3dae2e2-bdd6-40a1-ac6f-185f2f3c0aa6 None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:02.889736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d3dae2e2-bdd6-40a1-ac6f-185f2f3c0aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:02.940103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75b447-3b07-43fa-b913-68cd1a87ade8 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:02.977080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:02.978264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:03.023704 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 927/1834] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:01:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:03.024817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dae2e2-bdd6-40a1-ac6f-185f2f3c0aa6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:03.026911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d3dae2e2-bdd6-40a1-ac6f-185f2f3c0aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:03.069575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82dd76-2e9e-4b85-87a8-9f4930af78ef tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '327fa782b7e343269362a697106fa772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907d1642a1eb4a68b58522e541f43393', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:03.070576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82dd76-2e9e-4b85-87a8-9f4930af78ef tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:03.070875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82dd76-2e9e-4b85-87a8-9f4930af78ef tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:03.071153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82dd76-2e9e-4b85-87a8-9f4930af78ef tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] PATH_INFO: `/v3/projects/4b24a22b9a2043ce990653db8ea28a5a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:03.072975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82dd76-2e9e-4b85-87a8-9f4930af78ef tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] RBAC: Authorizing `identity:get_project(project_id=4b24a22b9a2043ce990653db8ea28a5a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:03.084667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82dd76-2e9e-4b85-87a8-9f4930af78ef tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:03.087715 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 908/1835] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:02 2022] GET /identity/v3/projects/4b24a22b9a2043ce990653db8ea28a5a => generated 393 bytes in 612 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:03.097732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82dd76-2e9e-4b85-87a8-9f4930af78ef tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:03.099962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-da82dd76-2e9e-4b85-87a8-9f4930af78ef tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:03.175072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dae2e2-bdd6-40a1-ac6f-185f2f3c0aa6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:03.184920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae784b2-8690-4b9a-bd60-c3beb43ae3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:03.185682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae784b2-8690-4b9a-bd60-c3beb43ae3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:03.189127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae784b2-8690-4b9a-bd60-c3beb43ae3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:03.189127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae784b2-8690-4b9a-bd60-c3beb43ae3aa admin admin] PATH_INFO: `/v3/projects/552b40f3c5904cbfba0c0c3d53f1c2fd` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:03.189876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae784b2-8690-4b9a-bd60-c3beb43ae3aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=552b40f3c5904cbfba0c0c3d53f1c2fd)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:03.192709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae784b2-8690-4b9a-bd60-c3beb43ae3aa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:03.213733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82dd76-2e9e-4b85-87a8-9f4930af78ef tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:03.225694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dd72d-1e91-43ff-bfb2-41c60bec3faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:03.226629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dd72d-1e91-43ff-bfb2-41c60bec3faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:03.226879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dd72d-1e91-43ff-bfb2-41c60bec3faa admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:03.227150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dd72d-1e91-43ff-bfb2-41c60bec3faa admin admin] PATH_INFO: `/v3/users/3989676a87274c6f99da6b00243ff2fc` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:03.229298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4dd72d-1e91-43ff-bfb2-41c60bec3faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3989676a87274c6f99da6b00243ff2fc)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:03.231285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4dd72d-1e91-43ff-bfb2-41c60bec3faa admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:03.295533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dae784b2-8690-4b9a-bd60-c3beb43ae3aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '552b40f3c5904cbfba0c0c3d53f1c2fd', 'request_id': 'req-dae784b2-8690-4b9a-bd60-c3beb43ae3aa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.306494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cd4dd72d-1e91-43ff-bfb2-41c60bec3faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3989676a87274c6f99da6b00243ff2fc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.307842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dae784b2-8690-4b9a-bd60-c3beb43ae3aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '552b40f3c5904cbfba0c0c3d53f1c2fd', 'request_id': 'req-dae784b2-8690-4b9a-bd60-c3beb43ae3aa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.320483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dae784b2-8690-4b9a-bd60-c3beb43ae3aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '552b40f3c5904cbfba0c0c3d53f1c2fd', 'request_id': 'req-dae784b2-8690-4b9a-bd60-c3beb43ae3aa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.324709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cd4dd72d-1e91-43ff-bfb2-41c60bec3faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3989676a87274c6f99da6b00243ff2fc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.332552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cd4dd72d-1e91-43ff-bfb2-41c60bec3faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3989676a87274c6f99da6b00243ff2fc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.333313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cd4dd72d-1e91-43ff-bfb2-41c60bec3faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3989676a87274c6f99da6b00243ff2fc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.334000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cd4dd72d-1e91-43ff-bfb2-41c60bec3faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3989676a87274c6f99da6b00243ff2fc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.334812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dae784b2-8690-4b9a-bd60-c3beb43ae3aa admin admin] The token cache is being invalidate because project 552b40f3c5904cbfba0c0c3d53f1c2fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:03.335515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dae784b2-8690-4b9a-bd60-c3beb43ae3aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.336353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dae784b2-8690-4b9a-bd60-c3beb43ae3aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.340151 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 928/1836] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:03 2022] DELETE /identity/v3/projects/552b40f3c5904cbfba0c0c3d53f1c2fd => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:03.341220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae784b2-8690-4b9a-bd60-c3beb43ae3aa admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:03.342831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dae784b2-8690-4b9a-bd60-c3beb43ae3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:03.360564 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 909/1837] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:03 2022] DELETE /identity/v3/users/3989676a87274c6f99da6b00243ff2fc => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:03.361485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dd72d-1e91-43ff-bfb2-41c60bec3faa admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:03.369158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cd4dd72d-1e91-43ff-bfb2-41c60bec3faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:03.453165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:03.466401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae784b2-8690-4b9a-bd60-c3beb43ae3aa admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:03.492439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4dd72d-1e91-43ff-bfb2-41c60bec3faa admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:03.501105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee107d-bb77-4877-b183-dcd9f4e7b10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:03.501524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee107d-bb77-4877-b183-dcd9f4e7b10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:03.501800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee107d-bb77-4877-b183-dcd9f4e7b10b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:03.502742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee107d-bb77-4877-b183-dcd9f4e7b10b admin admin] PATH_INFO: `/v3/projects/0e5534e7aab045a9ba93b7fd2d2d888e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:03.506896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee107d-bb77-4877-b183-dcd9f4e7b10b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5534e7aab045a9ba93b7fd2d2d888e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:03.511031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:03.511770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee107d-bb77-4877-b183-dcd9f4e7b10b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:03.599248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8fee107d-bb77-4877-b183-dcd9f4e7b10b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5534e7aab045a9ba93b7fd2d2d888e', 'request_id': 'req-8fee107d-bb77-4877-b183-dcd9f4e7b10b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.604511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8fee107d-bb77-4877-b183-dcd9f4e7b10b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5534e7aab045a9ba93b7fd2d2d888e', 'request_id': 'req-8fee107d-bb77-4877-b183-dcd9f4e7b10b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.604926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43f154-8190-476e-b3d4-122e0d681446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:03.605948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43f154-8190-476e-b3d4-122e0d681446 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:03.606364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43f154-8190-476e-b3d4-122e0d681446 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:03.606775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43f154-8190-476e-b3d4-122e0d681446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:03.609715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ea43f154-8190-476e-b3d4-122e0d681446 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:03.617392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8fee107d-bb77-4877-b183-dcd9f4e7b10b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5534e7aab045a9ba93b7fd2d2d888e', 'request_id': 'req-8fee107d-bb77-4877-b183-dcd9f4e7b10b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.633320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43f154-8190-476e-b3d4-122e0d681446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:03.635931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43f154-8190-476e-b3d4-122e0d681446 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:03.637977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8fee107d-bb77-4877-b183-dcd9f4e7b10b admin admin] The token cache is being invalidate because project 0e5534e7aab045a9ba93b7fd2d2d888e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:03.638280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8fee107d-bb77-4877-b183-dcd9f4e7b10b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.638985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8fee107d-bb77-4877-b183-dcd9f4e7b10b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.645048 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 910/1838] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:03 2022] DELETE /identity/v3/projects/0e5534e7aab045a9ba93b7fd2d2d888e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:03.646647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c039770-fb85-4c51-b946-fb61d620874f None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:03.646934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c039770-fb85-4c51-b946-fb61d620874f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:03.647212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c039770-fb85-4c51-b946-fb61d620874f None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:03.649142 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 911/1839] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:03.649868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c039770-fb85-4c51-b946-fb61d620874f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:03.653107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9c039770-fb85-4c51-b946-fb61d620874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:03.659005 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 929/1840] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:03.672671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871900d-61e8-40cc-a144-0151ebb294d5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:03.673350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871900d-61e8-40cc-a144-0151ebb294d5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:03.673623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871900d-61e8-40cc-a144-0151ebb294d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:03.697752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9871900d-61e8-40cc-a144-0151ebb294d5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:03.699289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9871900d-61e8-40cc-a144-0151ebb294d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:03.735812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c039770-fb85-4c51-b946-fb61d620874f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:03.742214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3563e23-b4b3-42f0-803c-5ac0b76680fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:03.746806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3563e23-b4b3-42f0-803c-5ac0b76680fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:03.746806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3563e23-b4b3-42f0-803c-5ac0b76680fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:03.746806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3563e23-b4b3-42f0-803c-5ac0b76680fd admin admin] PATH_INFO: `/v3/users/57b529454d4945f9998eaa3bb2630bce` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:03.746806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3563e23-b4b3-42f0-803c-5ac0b76680fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b529454d4945f9998eaa3bb2630bce)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:03.749151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3563e23-b4b3-42f0-803c-5ac0b76680fd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:03.794964 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 930/1841] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:03.797066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871900d-61e8-40cc-a144-0151ebb294d5 None None] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:03.806777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9871900d-61e8-40cc-a144-0151ebb294d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:03.852272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d3563e23-b4b3-42f0-803c-5ac0b76680fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b529454d4945f9998eaa3bb2630bce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.868988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d3563e23-b4b3-42f0-803c-5ac0b76680fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b529454d4945f9998eaa3bb2630bce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.878843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d3563e23-b4b3-42f0-803c-5ac0b76680fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b529454d4945f9998eaa3bb2630bce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.881964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d3563e23-b4b3-42f0-803c-5ac0b76680fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b529454d4945f9998eaa3bb2630bce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.882929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d3563e23-b4b3-42f0-803c-5ac0b76680fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b529454d4945f9998eaa3bb2630bce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:03.913463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:03.935374 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 912/1842] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:03 2022] DELETE /identity/v3/users/57b529454d4945f9998eaa3bb2630bce => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:03.935374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944ad38-47e8-4566-a0b8-5d0e92f36a7c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:03.935374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944ad38-47e8-4566-a0b8-5d0e92f36a7c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:03.935374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944ad38-47e8-4566-a0b8-5d0e92f36a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:03.959546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f944ad38-47e8-4566-a0b8-5d0e92f36a7c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:03.960941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f944ad38-47e8-4566-a0b8-5d0e92f36a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:03.977868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871900d-61e8-40cc-a144-0151ebb294d5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:03.980118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9871900d-61e8-40cc-a144-0151ebb294d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:04.058925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:04.101972 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 913/1843] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:04.103107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944ad38-47e8-4566-a0b8-5d0e92f36a7c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:04.105561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f944ad38-47e8-4566-a0b8-5d0e92f36a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:04.110648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871900d-61e8-40cc-a144-0151ebb294d5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:04.120384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944ad38-47e8-4566-a0b8-5d0e92f36a7c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:04.126642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85a300-c265-437f-8464-852fc87f5136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:04.127545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85a300-c265-437f-8464-852fc87f5136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:04.127828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85a300-c265-437f-8464-852fc87f5136 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:04.128223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85a300-c265-437f-8464-852fc87f5136 admin admin] PATH_INFO: `/v3/projects/838d3e40e494430ba0e52cfc3d57a0f9` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:04.129406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85a300-c265-437f-8464-852fc87f5136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=838d3e40e494430ba0e52cfc3d57a0f9)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:04.131780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85a300-c265-437f-8464-852fc87f5136 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:04.218971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5f85a300-c265-437f-8464-852fc87f5136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '838d3e40e494430ba0e52cfc3d57a0f9', 'request_id': 'req-5f85a300-c265-437f-8464-852fc87f5136'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:04.229303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5f85a300-c265-437f-8464-852fc87f5136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '838d3e40e494430ba0e52cfc3d57a0f9', 'request_id': 'req-5f85a300-c265-437f-8464-852fc87f5136'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:04.251067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5f85a300-c265-437f-8464-852fc87f5136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '838d3e40e494430ba0e52cfc3d57a0f9', 'request_id': 'req-5f85a300-c265-437f-8464-852fc87f5136'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:04.252451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd656b-563e-45e8-be56-8839e104a801 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '327fa782b7e343269362a697106fa772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907d1642a1eb4a68b58522e541f43393', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:04.253743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd656b-563e-45e8-be56-8839e104a801 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:04.254562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd656b-563e-45e8-be56-8839e104a801 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:04.254948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd656b-563e-45e8-be56-8839e104a801 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] PATH_INFO: `/v3/projects/4b24a22b9a2043ce990653db8ea28a5a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:04.257149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd656b-563e-45e8-be56-8839e104a801 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] RBAC: Authorizing `identity:get_project(project_id=4b24a22b9a2043ce990653db8ea28a5a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:04.265418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd656b-563e-45e8-be56-8839e104a801 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:04.268468 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 931/1844] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:03 2022] GET /identity/v3/projects/4b24a22b9a2043ce990653db8ea28a5a => generated 393 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:04.269379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd656b-563e-45e8-be56-8839e104a801 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:04.271661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5f85a300-c265-437f-8464-852fc87f5136 admin admin] The token cache is being invalidate because project 838d3e40e494430ba0e52cfc3d57a0f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:04.272324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5f85a300-c265-437f-8464-852fc87f5136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:04.273863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5f85a300-c265-437f-8464-852fc87f5136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:04.276936 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 914/1845] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:04 2022] DELETE /identity/v3/projects/838d3e40e494430ba0e52cfc3d57a0f9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:04.284085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd656b-563e-45e8-be56-8839e104a801 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:04.295519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4208b7-cfa8-4528-9f62-19add8bcfbd7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:04.296238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4208b7-cfa8-4528-9f62-19add8bcfbd7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:04.296778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4208b7-cfa8-4528-9f62-19add8bcfbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:04.319932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ae4208b7-cfa8-4528-9f62-19add8bcfbd7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:04.321601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ae4208b7-cfa8-4528-9f62-19add8bcfbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:04.399394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83295bb-60ec-46a6-bc7e-3d5a2a14c41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:04.401022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83295bb-60ec-46a6-bc7e-3d5a2a14c41b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:04.401888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83295bb-60ec-46a6-bc7e-3d5a2a14c41b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:04.402589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83295bb-60ec-46a6-bc7e-3d5a2a14c41b admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:04.403721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83295bb-60ec-46a6-bc7e-3d5a2a14c41b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:04.404365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83295bb-60ec-46a6-bc7e-3d5a2a14c41b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:04.408689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83295bb-60ec-46a6-bc7e-3d5a2a14c41b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:04.429369 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 932/1846] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:04.435217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83295bb-60ec-46a6-bc7e-3d5a2a14c41b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:04.437624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b83295bb-60ec-46a6-bc7e-3d5a2a14c41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:04.480677 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 915/1847] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:04.480887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83295bb-60ec-46a6-bc7e-3d5a2a14c41b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:04.482812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bea94b-b85e-43d5-876b-bb9f9e134d75 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:04.483192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bea94b-b85e-43d5-876b-bb9f9e134d75 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:04.483561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bea94b-b85e-43d5-876b-bb9f9e134d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:04.499651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c951e-a3a5-4b67-bf22-025c25a88575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:04.500704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c951e-a3a5-4b67-bf22-025c25a88575 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:04.502398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c951e-a3a5-4b67-bf22-025c25a88575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:04.502955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c951e-a3a5-4b67-bf22-025c25a88575 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:04.503859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c951e-a3a5-4b67-bf22-025c25a88575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:04.513167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c951e-a3a5-4b67-bf22-025c25a88575 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:04.533763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-00bea94b-b85e-43d5-876b-bb9f9e134d75 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:04.533763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-00bea94b-b85e-43d5-876b-bb9f9e134d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:04.559017 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 916/1848] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:01:04.559899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bea94b-b85e-43d5-876b-bb9f9e134d75 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:04.561211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-00bea94b-b85e-43d5-876b-bb9f9e134d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:04.578026 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 933/1849] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:04 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:01:04.579121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c951e-a3a5-4b67-bf22-025c25a88575 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:04.600310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bea94b-b85e-43d5-876b-bb9f9e134d75 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:04.614345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:04.702484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c951e-a3a5-4b67-bf22-025c25a88575 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:04.707870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ea0e2-76f5-408e-9eb4-226c6dd39231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:04.708702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ea0e2-76f5-408e-9eb4-226c6dd39231 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:04.709101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ea0e2-76f5-408e-9eb4-226c6dd39231 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:04.709392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ea0e2-76f5-408e-9eb4-226c6dd39231 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:04.710214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ea0e2-76f5-408e-9eb4-226c6dd39231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:04.710615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ea0e2-76f5-408e-9eb4-226c6dd39231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:04.712625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ea0e2-76f5-408e-9eb4-226c6dd39231 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:04.714243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19026a31-6ac9-4849-a2f5-f4a903713df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:04.716127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19026a31-6ac9-4849-a2f5-f4a903713df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:04.716510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:04.717036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19026a31-6ac9-4849-a2f5-f4a903713df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:04.717481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19026a31-6ac9-4849-a2f5-f4a903713df3 admin admin] PATH_INFO: `/v3/projects/b07fd8ace17143ab9e4c27f31ca6e197` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:04.719080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19026a31-6ac9-4849-a2f5-f4a903713df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07fd8ace17143ab9e4c27f31ca6e197)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:04.721548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19026a31-6ac9-4849-a2f5-f4a903713df3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:04.745367 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 934/1850] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:04.746721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ea0e2-76f5-408e-9eb4-226c6dd39231 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:04.766625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ea0e2-76f5-408e-9eb4-226c6dd39231 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:04.778617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9bb0c-47ad-4921-ba16-8a37f0dd8a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:04.779354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9bb0c-47ad-4921-ba16-8a37f0dd8a49 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:04.779669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9bb0c-47ad-4921-ba16-8a37f0dd8a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:04.785207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9bb0c-47ad-4921-ba16-8a37f0dd8a49 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:04.786320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9bb0c-47ad-4921-ba16-8a37f0dd8a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:04.790282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9bb0c-47ad-4921-ba16-8a37f0dd8a49 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:04.904779 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 935/1851] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:04 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:04.906180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9bb0c-47ad-4921-ba16-8a37f0dd8a49 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:04.935361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-19026a31-6ac9-4849-a2f5-f4a903713df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07fd8ace17143ab9e4c27f31ca6e197', 'request_id': 'req-19026a31-6ac9-4849-a2f5-f4a903713df3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:04.944315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-19026a31-6ac9-4849-a2f5-f4a903713df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07fd8ace17143ab9e4c27f31ca6e197', 'request_id': 'req-19026a31-6ac9-4849-a2f5-f4a903713df3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:04.952550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-19026a31-6ac9-4849-a2f5-f4a903713df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07fd8ace17143ab9e4c27f31ca6e197', 'request_id': 'req-19026a31-6ac9-4849-a2f5-f4a903713df3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:04.954968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9bb0c-47ad-4921-ba16-8a37f0dd8a49 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:04.978098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-19026a31-6ac9-4849-a2f5-f4a903713df3 admin admin] The token cache is being invalidate because project b07fd8ace17143ab9e4c27f31ca6e197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:04.979020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-19026a31-6ac9-4849-a2f5-f4a903713df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:04.980002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-19026a31-6ac9-4849-a2f5-f4a903713df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:04.984148 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 917/1852] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:04 2022] DELETE /identity/v3/projects/b07fd8ace17143ab9e4c27f31ca6e197 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:04.985146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19026a31-6ac9-4849-a2f5-f4a903713df3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:04.988642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-19026a31-6ac9-4849-a2f5-f4a903713df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:05.040191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8e4f9-413e-469e-bdc9-368694f0fcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:05.048003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8e4f9-413e-469e-bdc9-368694f0fcac admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:05.048429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8e4f9-413e-469e-bdc9-368694f0fcac admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:05.048877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8e4f9-413e-469e-bdc9-368694f0fcac admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:05.049529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8e4f9-413e-469e-bdc9-368694f0fcac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:05.061966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8e4f9-413e-469e-bdc9-368694f0fcac admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:05.117072 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 936/1853] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:04 2022] POST /identity/v3/projects => generated 377 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:05.118132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8e4f9-413e-469e-bdc9-368694f0fcac admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:05.120070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c7e8e4f9-413e-469e-bdc9-368694f0fcac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:05.127342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19026a31-6ac9-4849-a2f5-f4a903713df3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:05.210109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:05.216324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8e4f9-413e-469e-bdc9-368694f0fcac admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:05.229837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93da0e4-d6bc-4595-a617-22a1b83452de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:05.230983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93da0e4-d6bc-4595-a617-22a1b83452de admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:05.231493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93da0e4-d6bc-4595-a617-22a1b83452de admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:05.231834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93da0e4-d6bc-4595-a617-22a1b83452de admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:05.232783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93da0e4-d6bc-4595-a617-22a1b83452de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:05.235091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93da0e4-d6bc-4595-a617-22a1b83452de admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:05.251477 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 937/1854] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:05.253088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63631c5-b24b-4fdb-a82b-11f42963884c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:05.253391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63631c5-b24b-4fdb-a82b-11f42963884c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:05.253843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63631c5-b24b-4fdb-a82b-11f42963884c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:05.271446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9a110-99dd-441c-9975-239ac5b7c2f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:05.272447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9a110-99dd-441c-9975-239ac5b7c2f4 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:05.272882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9a110-99dd-441c-9975-239ac5b7c2f4 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:05.273306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9a110-99dd-441c-9975-239ac5b7c2f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:05.275027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a63631c5-b24b-4fdb-a82b-11f42963884c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:05.275531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b8b9a110-99dd-441c-9975-239ac5b7c2f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:05.276887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a63631c5-b24b-4fdb-a82b-11f42963884c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:05.285890 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 938/1855] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:05.286606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63631c5-b24b-4fdb-a82b-11f42963884c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:05.288460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a63631c5-b24b-4fdb-a82b-11f42963884c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:05.300279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63631c5-b24b-4fdb-a82b-11f42963884c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:05.305399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c173c94-8903-4fe7-b25f-c974374485ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:05.306230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c173c94-8903-4fe7-b25f-c974374485ca admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:05.306511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c173c94-8903-4fe7-b25f-c974374485ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:05.306907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c173c94-8903-4fe7-b25f-c974374485ca admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:05.307828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c173c94-8903-4fe7-b25f-c974374485ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:05.309863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c173c94-8903-4fe7-b25f-c974374485ca admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:05.341115 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 939/1856] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:05 2022] POST /identity/v3/users => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:05.343183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c173c94-8903-4fe7-b25f-c974374485ca admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:05.363036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9a110-99dd-441c-9975-239ac5b7c2f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:05.363331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c173c94-8903-4fe7-b25f-c974374485ca admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:05.365545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9a110-99dd-441c-9975-239ac5b7c2f4 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:05.368938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5863d4-a0af-49fe-b7d7-a80b2535cdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:05.369903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5863d4-a0af-49fe-b7d7-a80b2535cdb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:05.369903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5863d4-a0af-49fe-b7d7-a80b2535cdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:05.370216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5863d4-a0af-49fe-b7d7-a80b2535cdb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:05.371394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5863d4-a0af-49fe-b7d7-a80b2535cdb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:05.373656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5863d4-a0af-49fe-b7d7-a80b2535cdb0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:05.382329 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 918/1857] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:05.383871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583ddaf-b9ca-4464-97b7-7f54b34244d3 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:05.384205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583ddaf-b9ca-4464-97b7-7f54b34244d3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:05.384497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583ddaf-b9ca-4464-97b7-7f54b34244d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:05.388651 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 940/1858] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:05.389816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5863d4-a0af-49fe-b7d7-a80b2535cdb0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:05.412232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5863d4-a0af-49fe-b7d7-a80b2535cdb0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:05.413252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2583ddaf-b9ca-4464-97b7-7f54b34244d3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:05.415406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2583ddaf-b9ca-4464-97b7-7f54b34244d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:05.418618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f571ef2-6f64-4743-8c69-1bc7750e0007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:05.419387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f571ef2-6f64-4743-8c69-1bc7750e0007 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:05.419674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f571ef2-6f64-4743-8c69-1bc7750e0007 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:05.419953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f571ef2-6f64-4743-8c69-1bc7750e0007 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:05.420730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f571ef2-6f64-4743-8c69-1bc7750e0007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:05.422606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f571ef2-6f64-4743-8c69-1bc7750e0007 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:05.440030 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 941/1859] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:05.444211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f571ef2-6f64-4743-8c69-1bc7750e0007 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:05.447143 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 919/1860] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:05.448454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583ddaf-b9ca-4464-97b7-7f54b34244d3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:05.458347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f571ef2-6f64-4743-8c69-1bc7750e0007 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:05.466691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab344a-2abd-4215-9083-2550f16b4ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:05.467389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583ddaf-b9ca-4464-97b7-7f54b34244d3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:05.467565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab344a-2abd-4215-9083-2550f16b4ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:05.467853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab344a-2abd-4215-9083-2550f16b4ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:05.468175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab344a-2abd-4215-9083-2550f16b4ab7 admin admin] PATH_INFO: `/v3/projects/472fb37426124cf29d3d25e3ee20e85a/users/02f90a5c6ca3424abaf510cbe3e9f929/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:05.472741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227b02d-472a-4964-832c-665848694f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:05.473449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227b02d-472a-4964-832c-665848694f62 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:05.473712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227b02d-472a-4964-832c-665848694f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:05.474171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227b02d-472a-4964-832c-665848694f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:05.474934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227b02d-472a-4964-832c-665848694f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:05.476608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227b02d-472a-4964-832c-665848694f62 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:05.492123 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 920/1861] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:05.492123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227b02d-472a-4964-832c-665848694f62 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:05.500868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:05.506355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab344a-2abd-4215-9083-2550f16b4ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=472fb37426124cf29d3d25e3ee20e85a, user_id=02f90a5c6ca3424abaf510cbe3e9f929, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:05.509437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab344a-2abd-4215-9083-2550f16b4ab7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:05.514778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227b02d-472a-4964-832c-665848694f62 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:05.533034 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 942/1862] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:05 2022] PUT /identity/v3/projects/472fb37426124cf29d3d25e3ee20e85a/users/02f90a5c6ca3424abaf510cbe3e9f929/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:05.533976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab344a-2abd-4215-9083-2550f16b4ab7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:05.536372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9d146-7d25-4319-8971-a42611c40164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:05.537229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9d146-7d25-4319-8971-a42611c40164 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:05.537614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9d146-7d25-4319-8971-a42611c40164 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:05.537986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9d146-7d25-4319-8971-a42611c40164 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:05.538982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9d146-7d25-4319-8971-a42611c40164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:05.539275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9d146-7d25-4319-8971-a42611c40164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:05.541025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9d146-7d25-4319-8971-a42611c40164 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:05.561660 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 921/1863] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:05.563056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687710a2-c9df-481c-8131-73977a3c0994 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:05.563342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687710a2-c9df-481c-8131-73977a3c0994 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:05.563634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687710a2-c9df-481c-8131-73977a3c0994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:05.600072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-687710a2-c9df-481c-8131-73977a3c0994 None None] MFA Rules not processed for user `02f90a5c6ca3424abaf510cbe3e9f929`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:05.601503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-687710a2-c9df-481c-8131-73977a3c0994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:05.620807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab344a-2abd-4215-9083-2550f16b4ab7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:05.625879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabc9ea-013f-4692-a043-f7bf6797efd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:05.626940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabc9ea-013f-4692-a043-f7bf6797efd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:05.627326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabc9ea-013f-4692-a043-f7bf6797efd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:05.627696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabc9ea-013f-4692-a043-f7bf6797efd1 admin admin] PATH_INFO: `/v3/projects/657057f81e8943daa81146c218046699/users/5a0772a498774299b2e5b33d42abba78/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:05.643750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabc9ea-013f-4692-a043-f7bf6797efd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=657057f81e8943daa81146c218046699, user_id=5a0772a498774299b2e5b33d42abba78, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:05.646632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabc9ea-013f-4692-a043-f7bf6797efd1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:05.667626 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 943/1864] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:05 2022] PUT /identity/v3/projects/657057f81e8943daa81146c218046699/users/5a0772a498774299b2e5b33d42abba78/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:05.669200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4008ad0-2843-405e-8398-51bfbd84cee9 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:05.669556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4008ad0-2843-405e-8398-51bfbd84cee9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:05.669919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4008ad0-2843-405e-8398-51bfbd84cee9 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:05.671308 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 944/1865] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:05.677628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4008ad0-2843-405e-8398-51bfbd84cee9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:05.720415 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 922/1866] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:05.721340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687710a2-c9df-481c-8131-73977a3c0994 None None] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:05.772075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:05.786877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4008ad0-2843-405e-8398-51bfbd84cee9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:05.792711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f2620-0e51-4a36-98d6-0cad3d94a02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:05.793453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f2620-0e51-4a36-98d6-0cad3d94a02a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:05.793781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f2620-0e51-4a36-98d6-0cad3d94a02a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:05.794061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f2620-0e51-4a36-98d6-0cad3d94a02a admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:05.794880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f2620-0e51-4a36-98d6-0cad3d94a02a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:05.796885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f2620-0e51-4a36-98d6-0cad3d94a02a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:05.808723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687710a2-c9df-481c-8131-73977a3c0994 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:05.810450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-687710a2-c9df-481c-8131-73977a3c0994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:05.831530 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 945/1867] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:05 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:05.833134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbffea-d32d-441b-950c-492f2883ad89 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:05.833418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbffea-d32d-441b-950c-492f2883ad89 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:05.833754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbffea-d32d-441b-950c-492f2883ad89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:05.870804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-01fbffea-d32d-441b-950c-492f2883ad89 None None] MFA Rules not processed for user `5a0772a498774299b2e5b33d42abba78`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:05.872528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-01fbffea-d32d-441b-950c-492f2883ad89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:05.889877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687710a2-c9df-481c-8131-73977a3c0994 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:05.922205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:05.947648 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 946/1868] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:05.947648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbffea-d32d-441b-950c-492f2883ad89 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:05.970117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3face123-7fc7-4ce7-aa49-11606afcdaac tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '327fa782b7e343269362a697106fa772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907d1642a1eb4a68b58522e541f43393', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:05.971076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3face123-7fc7-4ce7-aa49-11606afcdaac tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:05.971338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3face123-7fc7-4ce7-aa49-11606afcdaac tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:05.971590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3face123-7fc7-4ce7-aa49-11606afcdaac tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] PATH_INFO: `/v3/projects/4b24a22b9a2043ce990653db8ea28a5a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:05.972980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3face123-7fc7-4ce7-aa49-11606afcdaac tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] RBAC: Authorizing `identity:get_project(project_id=4b24a22b9a2043ce990653db8ea28a5a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:05.975057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3face123-7fc7-4ce7-aa49-11606afcdaac tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:05.977205 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 923/1869] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:05 2022] GET /identity/v3/projects/4b24a22b9a2043ce990653db8ea28a5a => generated 393 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:05.977998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3face123-7fc7-4ce7-aa49-11606afcdaac tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:06.071777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3face123-7fc7-4ce7-aa49-11606afcdaac tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:06.074491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbffea-d32d-441b-950c-492f2883ad89 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:06.082597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850a26c-f528-486b-b882-a9e042405843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:06.083413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850a26c-f528-486b-b882-a9e042405843 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.084492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850a26c-f528-486b-b882-a9e042405843 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.087879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145ea55-d7d9-47ea-81c8-6d76ceb6803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:06.087879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145ea55-d7d9-47ea-81c8-6d76ceb6803e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.087879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145ea55-d7d9-47ea-81c8-6d76ceb6803e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.087879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145ea55-d7d9-47ea-81c8-6d76ceb6803e admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.088864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145ea55-d7d9-47ea-81c8-6d76ceb6803e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:06.090846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145ea55-d7d9-47ea-81c8-6d76ceb6803e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:06.096318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850a26c-f528-486b-b882-a9e042405843 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.097201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850a26c-f528-486b-b882-a9e042405843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:06.099241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850a26c-f528-486b-b882-a9e042405843 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:06.121763 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 924/1870] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:05 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:06.122866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850a26c-f528-486b-b882-a9e042405843 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:06.133131 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 947/1871] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:05 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:06.133131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b6e32-e56c-434b-b55f-0466e3c30cbf None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.133131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b6e32-e56c-434b-b55f-0466e3c30cbf None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.133131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b6e32-e56c-434b-b55f-0466e3c30cbf None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.135277 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 948/1872] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:06.136297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b6e32-e56c-434b-b55f-0466e3c30cbf None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:06.142513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850a26c-f528-486b-b882-a9e042405843 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:06.148999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:06.207867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05818771-1508-4e20-9c13-470fd2d26059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:06.208925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05818771-1508-4e20-9c13-470fd2d26059 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.210777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05818771-1508-4e20-9c13-470fd2d26059 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.210964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05818771-1508-4e20-9c13-470fd2d26059 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.211863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05818771-1508-4e20-9c13-470fd2d26059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:06.215023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05818771-1508-4e20-9c13-470fd2d26059 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:06.218073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b6e32-e56c-434b-b55f-0466e3c30cbf None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:06.223672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1616dcc-70f1-48b6-b687-c499e1d1f112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:06.225732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1616dcc-70f1-48b6-b687-c499e1d1f112 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.226193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1616dcc-70f1-48b6-b687-c499e1d1f112 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.226684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1616dcc-70f1-48b6-b687-c499e1d1f112 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.227817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1616dcc-70f1-48b6-b687-c499e1d1f112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:06.230029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1616dcc-70f1-48b6-b687-c499e1d1f112 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:06.243214 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 949/1873] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:06.244473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1616dcc-70f1-48b6-b687-c499e1d1f112 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:06.256883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1616dcc-70f1-48b6-b687-c499e1d1f112 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:06.262629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03806be4-7753-409f-8466-d63e3cb3c27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:06.263544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03806be4-7753-409f-8466-d63e3cb3c27a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.264091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03806be4-7753-409f-8466-d63e3cb3c27a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.264683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03806be4-7753-409f-8466-d63e3cb3c27a admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.265852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03806be4-7753-409f-8466-d63e3cb3c27a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:06.266453 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 925/1874] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:06 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:06.267305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05818771-1508-4e20-9c13-470fd2d26059 admin admin] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:06.269070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03806be4-7753-409f-8466-d63e3cb3c27a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:06.294832 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 950/1875] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:06 2022] POST /identity/v3/users => generated 297 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:06.294832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03806be4-7753-409f-8466-d63e3cb3c27a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:06.305972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03806be4-7753-409f-8466-d63e3cb3c27a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:06.386063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05818771-1508-4e20-9c13-470fd2d26059 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:06.411172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:06.430359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65ffa5-696f-42f4-834b-a40f280a4621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:06.432198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65ffa5-696f-42f4-834b-a40f280a4621 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.432556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65ffa5-696f-42f4-834b-a40f280a4621 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.432897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65ffa5-696f-42f4-834b-a40f280a4621 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.433728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65ffa5-696f-42f4-834b-a40f280a4621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:06.436978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65ffa5-696f-42f4-834b-a40f280a4621 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:06.455981 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 951/1876] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:06.457106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65ffa5-696f-42f4-834b-a40f280a4621 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:06.468226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65ffa5-696f-42f4-834b-a40f280a4621 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:06.468567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05818771-1508-4e20-9c13-470fd2d26059 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:06.473299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfe7ad-34e8-4b65-804d-d5cfa23c87fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:06.473865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89facc7-e177-455c-b988-621447d82e18 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '327fa782b7e343269362a697106fa772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907d1642a1eb4a68b58522e541f43393', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:06.474133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfe7ad-34e8-4b65-804d-d5cfa23c87fa admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.474977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfe7ad-34e8-4b65-804d-d5cfa23c87fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.474977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfe7ad-34e8-4b65-804d-d5cfa23c87fa admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.475184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89facc7-e177-455c-b988-621447d82e18 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.475532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89facc7-e177-455c-b988-621447d82e18 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.475876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89facc7-e177-455c-b988-621447d82e18 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] PATH_INFO: `/v3/projects/4b24a22b9a2043ce990653db8ea28a5a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.476284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfe7ad-34e8-4b65-804d-d5cfa23c87fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:06.477525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89facc7-e177-455c-b988-621447d82e18 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] RBAC: Authorizing `identity:get_project(project_id=4b24a22b9a2043ce990653db8ea28a5a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:06.478387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfe7ad-34e8-4b65-804d-d5cfa23c87fa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:06.480712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89facc7-e177-455c-b988-621447d82e18 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:06.493292 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 926/1877] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:06 2022] GET /identity/v3/projects/4b24a22b9a2043ce990653db8ea28a5a => generated 393 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:06.495356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89facc7-e177-455c-b988-621447d82e18 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:06.518078 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 952/1878] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:06 2022] POST /identity/v3/users => generated 294 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:06.518682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfe7ad-34e8-4b65-804d-d5cfa23c87fa admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:06.520882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89facc7-e177-455c-b988-621447d82e18 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:06.525831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4718e4-a8aa-491f-b7d4-01163b49745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:06.526930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4718e4-a8aa-491f-b7d4-01163b49745a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.527338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4718e4-a8aa-491f-b7d4-01163b49745a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.527709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4718e4-a8aa-491f-b7d4-01163b49745a admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.528576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4718e4-a8aa-491f-b7d4-01163b49745a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:06.531218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4718e4-a8aa-491f-b7d4-01163b49745a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:06.531812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfe7ad-34e8-4b65-804d-d5cfa23c87fa admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:06.542704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc7ea2-d24b-4d25-a124-68859b4ac2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:06.543625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc7ea2-d24b-4d25-a124-68859b4ac2ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.543907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc7ea2-d24b-4d25-a124-68859b4ac2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.544219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc7ea2-d24b-4d25-a124-68859b4ac2ec admin admin] PATH_INFO: `/v3/projects/06035f9f58154f3cafeb6b51a598c2a7/users/ae79f3d496c7426f99ecc72cdd3e3f46/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.545331 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 927/1879] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:06.546309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4718e4-a8aa-491f-b7d4-01163b49745a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:06.557156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4718e4-a8aa-491f-b7d4-01163b49745a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:06.562638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba1e72-d67a-49e1-b4ed-669eab65d740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:06.563442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba1e72-d67a-49e1-b4ed-669eab65d740 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.563822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba1e72-d67a-49e1-b4ed-669eab65d740 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.564188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc7ea2-d24b-4d25-a124-68859b4ac2ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=06035f9f58154f3cafeb6b51a598c2a7, user_id=ae79f3d496c7426f99ecc72cdd3e3f46, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:06.564313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba1e72-d67a-49e1-b4ed-669eab65d740 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.565162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba1e72-d67a-49e1-b4ed-669eab65d740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:06.566856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba1e72-d67a-49e1-b4ed-669eab65d740 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:06.567587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc7ea2-d24b-4d25-a124-68859b4ac2ec admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:06.589673 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 928/1881] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:06.590589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba1e72-d67a-49e1-b4ed-669eab65d740 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:06.596288 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 953/1881] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:06 2022] PUT /identity/v3/projects/06035f9f58154f3cafeb6b51a598c2a7/users/ae79f3d496c7426f99ecc72cdd3e3f46/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:06.597312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc7ea2-d24b-4d25-a124-68859b4ac2ec admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:06.627930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba1e72-d67a-49e1-b4ed-669eab65d740 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:06.637356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:06.689291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc7ea2-d24b-4d25-a124-68859b4ac2ec admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:06.697962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb778f-5a1e-470a-ab0b-7fbf532fc0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:06.699669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb778f-5a1e-470a-ab0b-7fbf532fc0b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.699955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb778f-5a1e-470a-ab0b-7fbf532fc0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.700263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb778f-5a1e-470a-ab0b-7fbf532fc0b3 admin admin] PATH_INFO: `/v3/projects/1da6c0d2bdfd4ddb906ba11f5661118f/users/701fc0602de041baa8e03d2f2d2da765/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.725384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb778f-5a1e-470a-ab0b-7fbf532fc0b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da6c0d2bdfd4ddb906ba11f5661118f, user_id=701fc0602de041baa8e03d2f2d2da765, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:06.728006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb778f-5a1e-470a-ab0b-7fbf532fc0b3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:06.745205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31e539-90e4-4000-ad12-f670b39196ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:06.746345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31e539-90e4-4000-ad12-f670b39196ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.746632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31e539-90e4-4000-ad12-f670b39196ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.746911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31e539-90e4-4000-ad12-f670b39196ff admin admin] PATH_INFO: `/v3/projects/f3566744b2614c9db205c66899f36435/users/fc8bea52d3db4a62b9ea4d11e67d70e4/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.753117 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 954/1882] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:06 2022] PUT /identity/v3/projects/1da6c0d2bdfd4ddb906ba11f5661118f/users/701fc0602de041baa8e03d2f2d2da765/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:06.753117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd23865-2557-41b1-8523-47b17b5e430d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.753117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd23865-2557-41b1-8523-47b17b5e430d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.753117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd23865-2557-41b1-8523-47b17b5e430d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.765229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31e539-90e4-4000-ad12-f670b39196ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3566744b2614c9db205c66899f36435, user_id=fc8bea52d3db4a62b9ea4d11e67d70e4, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:06.768217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31e539-90e4-4000-ad12-f670b39196ff admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:06.782629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9dd23865-2557-41b1-8523-47b17b5e430d None None] MFA Rules not processed for user `ae79f3d496c7426f99ecc72cdd3e3f46`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:06.784192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9dd23865-2557-41b1-8523-47b17b5e430d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:06.789771 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 929/1883] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:06 2022] PUT /identity/v3/projects/f3566744b2614c9db205c66899f36435/users/fc8bea52d3db4a62b9ea4d11e67d70e4/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:06.791526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599e873-ea41-4d68-b8f1-34b5e3004669 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.791818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599e873-ea41-4d68-b8f1-34b5e3004669 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.792131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599e873-ea41-4d68-b8f1-34b5e3004669 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.793486 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 930/1884] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:06.794191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599e873-ea41-4d68-b8f1-34b5e3004669 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:06.874651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599e873-ea41-4d68-b8f1-34b5e3004669 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:06.874857 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 955/1885] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:06.875943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd23865-2557-41b1-8523-47b17b5e430d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:06.879910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ec349-e31b-4d6e-880e-2b5bc4e83b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:06.880783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ec349-e31b-4d6e-880e-2b5bc4e83b9a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.881144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ec349-e31b-4d6e-880e-2b5bc4e83b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.881509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ec349-e31b-4d6e-880e-2b5bc4e83b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.882311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ec349-e31b-4d6e-880e-2b5bc4e83b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:06.884013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ec349-e31b-4d6e-880e-2b5bc4e83b9a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:06.891543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd23865-2557-41b1-8523-47b17b5e430d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:06.899210 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 931/1886] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:06.899344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19fa18-bd84-4220-8850-44c79454991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:06.899451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ec349-e31b-4d6e-880e-2b5bc4e83b9a admin admin] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:06.899537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19fa18-bd84-4220-8850-44c79454991c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.899537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19fa18-bd84-4220-8850-44c79454991c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.899537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19fa18-bd84-4220-8850-44c79454991c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.899537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19fa18-bd84-4220-8850-44c79454991c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:06.899876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19fa18-bd84-4220-8850-44c79454991c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:06.901054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f10ec349-e31b-4d6e-880e-2b5bc4e83b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:06.911259 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 956/1887] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:06.912168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19fa18-bd84-4220-8850-44c79454991c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:06.923412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19fa18-bd84-4220-8850-44c79454991c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:06.933411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e687b3-4995-4bdc-9d33-659ae29a615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:06.933411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e687b3-4995-4bdc-9d33-659ae29a615a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:06.933411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e687b3-4995-4bdc-9d33-659ae29a615a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:06.933411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e687b3-4995-4bdc-9d33-659ae29a615a admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:06.933939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e687b3-4995-4bdc-9d33-659ae29a615a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:06.933939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e687b3-4995-4bdc-9d33-659ae29a615a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:06.937129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:06.964747 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 957/1888] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:06 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:06.964747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e687b3-4995-4bdc-9d33-659ae29a615a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:06.993830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ec349-e31b-4d6e-880e-2b5bc4e83b9a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:07.018226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:07.029284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e687b3-4995-4bdc-9d33-659ae29a615a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:07.034777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0460ec-905e-4f1c-a27b-42d51f4ba833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:07.035719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0460ec-905e-4f1c-a27b-42d51f4ba833 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:07.035998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0460ec-905e-4f1c-a27b-42d51f4ba833 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:07.036309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0460ec-905e-4f1c-a27b-42d51f4ba833 admin admin] PATH_INFO: `/v3/projects/1da6c0d2bdfd4ddb906ba11f5661118f/users/701fc0602de041baa8e03d2f2d2da765/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:07.038319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0460ec-905e-4f1c-a27b-42d51f4ba833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da6c0d2bdfd4ddb906ba11f5661118f, user_id=701fc0602de041baa8e03d2f2d2da765, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:07.041116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0460ec-905e-4f1c-a27b-42d51f4ba833 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:07.052535 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 958/1889] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:06 2022] PUT /identity/v3/projects/1da6c0d2bdfd4ddb906ba11f5661118f/users/701fc0602de041baa8e03d2f2d2da765/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:07.053563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0460ec-905e-4f1c-a27b-42d51f4ba833 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:07.058297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ec349-e31b-4d6e-880e-2b5bc4e83b9a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:07.121616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69efce-525d-477d-8bc8-88a1b12789f9 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '327fa782b7e343269362a697106fa772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907d1642a1eb4a68b58522e541f43393', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:07.123370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69efce-525d-477d-8bc8-88a1b12789f9 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:07.123823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69efce-525d-477d-8bc8-88a1b12789f9 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:07.124244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69efce-525d-477d-8bc8-88a1b12789f9 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] PATH_INFO: `/v3/projects/798845d7ca1f4577ac6ae317a7eece2b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:07.125597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0460ec-905e-4f1c-a27b-42d51f4ba833 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:07.125732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69efce-525d-477d-8bc8-88a1b12789f9 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] RBAC: Authorizing `identity:get_project(project_id=798845d7ca1f4577ac6ae317a7eece2b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:07.127737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69efce-525d-477d-8bc8-88a1b12789f9 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:07.129614 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 932/1890] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:06 2022] GET /identity/v3/projects/798845d7ca1f4577ac6ae317a7eece2b => generated 393 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:07.130368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69efce-525d-477d-8bc8-88a1b12789f9 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:07.130503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e9762-a11a-4036-863d-1bd7a128f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:07.131399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e9762-a11a-4036-863d-1bd7a128f2bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:07.131687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e9762-a11a-4036-863d-1bd7a128f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:07.131963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e9762-a11a-4036-863d-1bd7a128f2bb admin admin] PATH_INFO: `/v3/projects/f3566744b2614c9db205c66899f36435/users/fc8bea52d3db4a62b9ea4d11e67d70e4/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:07.134018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e9762-a11a-4036-863d-1bd7a128f2bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3566744b2614c9db205c66899f36435, user_id=fc8bea52d3db4a62b9ea4d11e67d70e4, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:07.136805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e9762-a11a-4036-863d-1bd7a128f2bb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:07.141253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69efce-525d-477d-8bc8-88a1b12789f9 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:07.152442 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 959/1891] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:07 2022] PUT /identity/v3/projects/f3566744b2614c9db205c66899f36435/users/fc8bea52d3db4a62b9ea4d11e67d70e4/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:07.153993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbd456-a375-46e7-9375-ed0afb9557ef None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:07.154504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbd456-a375-46e7-9375-ed0afb9557ef None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:07.154857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbd456-a375-46e7-9375-ed0afb9557ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:07.192937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-48fbd456-a375-46e7-9375-ed0afb9557ef None None] MFA Rules not processed for user `701fc0602de041baa8e03d2f2d2da765`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:07.194437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-48fbd456-a375-46e7-9375-ed0afb9557ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:07.207791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279645fc-4546-426d-b207-68722fe0a51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:07.208582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279645fc-4546-426d-b207-68722fe0a51f admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:07.208935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279645fc-4546-426d-b207-68722fe0a51f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:07.209321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279645fc-4546-426d-b207-68722fe0a51f admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:07.210184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279645fc-4546-426d-b207-68722fe0a51f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:07.212250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279645fc-4546-426d-b207-68722fe0a51f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:07.239440 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 933/1892] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:07 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:07.240212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49944855-b5bc-4357-8dcd-202d570395f8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:07.240498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49944855-b5bc-4357-8dcd-202d570395f8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:07.240773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49944855-b5bc-4357-8dcd-202d570395f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:07.265937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-49944855-b5bc-4357-8dcd-202d570395f8 None None] MFA Rules not processed for user `fc8bea52d3db4a62b9ea4d11e67d70e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:07.267070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-49944855-b5bc-4357-8dcd-202d570395f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:07.269683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:07.276718 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 960/1893] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:07.284291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbd456-a375-46e7-9375-ed0afb9557ef None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:07.286777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-48fbd456-a375-46e7-9375-ed0afb9557ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:07.303264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbd456-a375-46e7-9375-ed0afb9557ef None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:07.308478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4041fc-8ab8-4228-b9e4-04a39ff34648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:07.309344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4041fc-8ab8-4228-b9e4-04a39ff34648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:07.309632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4041fc-8ab8-4228-b9e4-04a39ff34648 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:07.309908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4041fc-8ab8-4228-b9e4-04a39ff34648 admin admin] PATH_INFO: `/v3/users/69ce5d41ca8a41a0a9a6e42f1f08ba04` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:07.311115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4041fc-8ab8-4228-b9e4-04a39ff34648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ce5d41ca8a41a0a9a6e42f1f08ba04)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:07.313102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4041fc-8ab8-4228-b9e4-04a39ff34648 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:07.324682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:07.349031 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 934/1894] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:07.349883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49944855-b5bc-4357-8dcd-202d570395f8 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:07.361227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49944855-b5bc-4357-8dcd-202d570395f8 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:07.365936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411ac28-4345-48e5-8693-0e0cfa575688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:07.366600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411ac28-4345-48e5-8693-0e0cfa575688 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:07.366817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8d4041fc-8ab8-4228-b9e4-04a39ff34648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ce5d41ca8a41a0a9a6e42f1f08ba04'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:07.366929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411ac28-4345-48e5-8693-0e0cfa575688 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:07.367152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411ac28-4345-48e5-8693-0e0cfa575688 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:07.367875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3411ac28-4345-48e5-8693-0e0cfa575688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:07.369582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3411ac28-4345-48e5-8693-0e0cfa575688 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:07.377380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8d4041fc-8ab8-4228-b9e4-04a39ff34648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ce5d41ca8a41a0a9a6e42f1f08ba04'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:07.378180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8d4041fc-8ab8-4228-b9e4-04a39ff34648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ce5d41ca8a41a0a9a6e42f1f08ba04'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:07.378829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8d4041fc-8ab8-4228-b9e4-04a39ff34648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ce5d41ca8a41a0a9a6e42f1f08ba04'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:07.380961 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 935/1895] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:07.381767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411ac28-4345-48e5-8693-0e0cfa575688 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:07.383380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3411ac28-4345-48e5-8693-0e0cfa575688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:07.390015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8d4041fc-8ab8-4228-b9e4-04a39ff34648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ce5d41ca8a41a0a9a6e42f1f08ba04'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:07.408850 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 961/1896] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:07 2022] DELETE /identity/v3/users/69ce5d41ca8a41a0a9a6e42f1f08ba04 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:07.409667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4041fc-8ab8-4228-b9e4-04a39ff34648 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:07.411016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8d4041fc-8ab8-4228-b9e4-04a39ff34648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:07.458793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411ac28-4345-48e5-8693-0e0cfa575688 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:07.495239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4041fc-8ab8-4228-b9e4-04a39ff34648 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:07.502116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810715b-2c0c-4631-92f1-3d3d1deeb44b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:07.502779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810715b-2c0c-4631-92f1-3d3d1deeb44b service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:07.503062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810715b-2c0c-4631-92f1-3d3d1deeb44b service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:07.503336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810715b-2c0c-4631-92f1-3d3d1deeb44b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:07.505208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3810715b-2c0c-4631-92f1-3d3d1deeb44b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:07.525372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab334dc1-8295-4da3-a754-37a15918d235 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:07.526689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab334dc1-8295-4da3-a754-37a15918d235 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:07.527223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab334dc1-8295-4da3-a754-37a15918d235 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:07.527506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab334dc1-8295-4da3-a754-37a15918d235 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:07.529477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ab334dc1-8295-4da3-a754-37a15918d235 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:07.569378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810715b-2c0c-4631-92f1-3d3d1deeb44b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:07.571132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810715b-2c0c-4631-92f1-3d3d1deeb44b service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:07.581954 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 962/1897] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:07.582877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810715b-2c0c-4631-92f1-3d3d1deeb44b service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:07.584244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3810715b-2c0c-4631-92f1-3d3d1deeb44b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:07.589712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:07.613203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab334dc1-8295-4da3-a754-37a15918d235 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:07.614970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab334dc1-8295-4da3-a754-37a15918d235 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:07.641490 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 936/1898] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:07.644941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c977ba-450b-47b0-80c3-ea9cdc54736e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:07.645233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c977ba-450b-47b0-80c3-ea9cdc54736e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:07.645512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c977ba-450b-47b0-80c3-ea9cdc54736e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:07.672467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:07.684239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810715b-2c0c-4631-92f1-3d3d1deeb44b service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:07.689097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a3c977ba-450b-47b0-80c3-ea9cdc54736e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:07.692908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572374b-4622-4ca2-ae89-8595d7d9398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:07.693957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572374b-4622-4ca2-ae89-8595d7d9398b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:07.694341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572374b-4622-4ca2-ae89-8595d7d9398b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:07.694716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572374b-4622-4ca2-ae89-8595d7d9398b admin admin] PATH_INFO: `/v3/projects/8e2c755f798b4c5da16d019753deb482/users/c23e56fcf6b04feda78e462149dd7708/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:07.695515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a3c977ba-450b-47b0-80c3-ea9cdc54736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:07.713783 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 937/1899] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:07.723958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572374b-4622-4ca2-ae89-8595d7d9398b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2c755f798b4c5da16d019753deb482, user_id=c23e56fcf6b04feda78e462149dd7708, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:07.726896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572374b-4622-4ca2-ae89-8595d7d9398b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:07.738279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c977ba-450b-47b0-80c3-ea9cdc54736e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:07.740462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a3c977ba-450b-47b0-80c3-ea9cdc54736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:07.749714 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 963/1900] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:07 2022] PUT /identity/v3/projects/8e2c755f798b4c5da16d019753deb482/users/c23e56fcf6b04feda78e462149dd7708/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:07.753550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572374b-4622-4ca2-ae89-8595d7d9398b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:07.864021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572374b-4622-4ca2-ae89-8595d7d9398b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:07.866220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c977ba-450b-47b0-80c3-ea9cdc54736e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:07.879504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201ae26-286c-4877-ba17-16986ba5ddbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:07.884491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201ae26-286c-4877-ba17-16986ba5ddbd admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:07.884948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201ae26-286c-4877-ba17-16986ba5ddbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:07.885179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201ae26-286c-4877-ba17-16986ba5ddbd admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:07.886431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201ae26-286c-4877-ba17-16986ba5ddbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:07.889573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201ae26-286c-4877-ba17-16986ba5ddbd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:07.908252 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 964/1901] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:01:07.912787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201ae26-286c-4877-ba17-16986ba5ddbd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:07.915356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9201ae26-286c-4877-ba17-16986ba5ddbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:07.930018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201ae26-286c-4877-ba17-16986ba5ddbd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:07.940707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fabe9a-96d6-4727-b40a-a37a3680e0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:07.942163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fabe9a-96d6-4727-b40a-a37a3680e0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:07.942664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fabe9a-96d6-4727-b40a-a37a3680e0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:07.943148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fabe9a-96d6-4727-b40a-a37a3680e0c8 admin admin] PATH_INFO: `/v3/users/02f90a5c6ca3424abaf510cbe3e9f929` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:07.943354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab162a-03b6-4925-a0b9-116ea6e31538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:07.944023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab162a-03b6-4925-a0b9-116ea6e31538 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:07.944331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab162a-03b6-4925-a0b9-116ea6e31538 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:07.944588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab162a-03b6-4925-a0b9-116ea6e31538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:07.946027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fabe9a-96d6-4727-b40a-a37a3680e0c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f90a5c6ca3424abaf510cbe3e9f929)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:07.948571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fabe9a-96d6-4727-b40a-a37a3680e0c8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:07.954675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab162a-03b6-4925-a0b9-116ea6e31538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:07.956154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab162a-03b6-4925-a0b9-116ea6e31538 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:07.972169 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 938/1902] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:07.973170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab162a-03b6-4925-a0b9-116ea6e31538 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:07.984323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab162a-03b6-4925-a0b9-116ea6e31538 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:07.990402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf4011-7922-4d82-a097-b7ef8d47fba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:07.991446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf4011-7922-4d82-a097-b7ef8d47fba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:07.991849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf4011-7922-4d82-a097-b7ef8d47fba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:07.992162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf4011-7922-4d82-a097-b7ef8d47fba1 admin admin] PATH_INFO: `/v3/projects/8e2c755f798b4c5da16d019753deb482/users/c23e56fcf6b04feda78e462149dd7708/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:07.994494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf4011-7922-4d82-a097-b7ef8d47fba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2c755f798b4c5da16d019753deb482, user_id=c23e56fcf6b04feda78e462149dd7708, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:07.997322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf4011-7922-4d82-a097-b7ef8d47fba1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:08.017395 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 939/1903] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:07 2022] PUT /identity/v3/projects/8e2c755f798b4c5da16d019753deb482/users/c23e56fcf6b04feda78e462149dd7708/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:08.018783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-13fabe9a-96d6-4727-b40a-a37a3680e0c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f90a5c6ca3424abaf510cbe3e9f929'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.028825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccd501-b532-45af-a0d9-993c4ebeffec None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:08.029114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccd501-b532-45af-a0d9-993c4ebeffec None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:08.029421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccd501-b532-45af-a0d9-993c4ebeffec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:08.031256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-13fabe9a-96d6-4727-b40a-a37a3680e0c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f90a5c6ca3424abaf510cbe3e9f929'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.032871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-13fabe9a-96d6-4727-b40a-a37a3680e0c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f90a5c6ca3424abaf510cbe3e9f929'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.033694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-13fabe9a-96d6-4727-b40a-a37a3680e0c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f90a5c6ca3424abaf510cbe3e9f929'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.047464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-13fabe9a-96d6-4727-b40a-a37a3680e0c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f90a5c6ca3424abaf510cbe3e9f929'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.063988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:08.076347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-73ccd501-b532-45af-a0d9-993c4ebeffec None None] MFA Rules not processed for user `c23e56fcf6b04feda78e462149dd7708`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:08.077662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-73ccd501-b532-45af-a0d9-993c4ebeffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:08.084510 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 965/1904] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:07 2022] DELETE /identity/v3/users/02f90a5c6ca3424abaf510cbe3e9f929 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:08.087553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fabe9a-96d6-4727-b40a-a37a3680e0c8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:08.088582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-13fabe9a-96d6-4727-b40a-a37a3680e0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:08.172403 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 940/1905] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:01:08.173912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc90cf-479d-40ac-9f4c-c88aa7259110 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:08.174292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc90cf-479d-40ac-9f4c-c88aa7259110 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:08.174651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc90cf-479d-40ac-9f4c-c88aa7259110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:08.181116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fabe9a-96d6-4727-b40a-a37a3680e0c8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:08.186600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a369e-87e6-4a93-a0ef-c431bb48dadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:08.187730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a369e-87e6-4a93-a0ef-c431bb48dadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:08.188028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a369e-87e6-4a93-a0ef-c431bb48dadf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:08.188779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a369e-87e6-4a93-a0ef-c431bb48dadf admin admin] PATH_INFO: `/v3/users/5a0772a498774299b2e5b33d42abba78` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:08.189781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a369e-87e6-4a93-a0ef-c431bb48dadf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a0772a498774299b2e5b33d42abba78)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:08.191823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a369e-87e6-4a93-a0ef-c431bb48dadf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:08.193383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-54dc90cf-479d-40ac-9f4c-c88aa7259110 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:08.195039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-54dc90cf-479d-40ac-9f4c-c88aa7259110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:08.205143 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 941/1906] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:08.209149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc90cf-479d-40ac-9f4c-c88aa7259110 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:08.240017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:08.252532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-777a369e-87e6-4a93-a0ef-c431bb48dadf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a0772a498774299b2e5b33d42abba78'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.262084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-777a369e-87e6-4a93-a0ef-c431bb48dadf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a0772a498774299b2e5b33d42abba78'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.263997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-777a369e-87e6-4a93-a0ef-c431bb48dadf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a0772a498774299b2e5b33d42abba78'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.265382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-777a369e-87e6-4a93-a0ef-c431bb48dadf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a0772a498774299b2e5b33d42abba78'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.275296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-777a369e-87e6-4a93-a0ef-c431bb48dadf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a0772a498774299b2e5b33d42abba78'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.289301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc90cf-479d-40ac-9f4c-c88aa7259110 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:08.294640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa613d8-3118-4002-bfc6-86c8c3c365ad tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23e56fcf6b04feda78e462149dd7708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2c755f798b4c5da16d019753deb482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:08.295335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa613d8-3118-4002-bfc6-86c8c3c365ad tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:08.295624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa613d8-3118-4002-bfc6-86c8c3c365ad tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:08.295905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa613d8-3118-4002-bfc6-86c8c3c365ad tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:08.296941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa613d8-3118-4002-bfc6-86c8c3c365ad tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:08.296941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa613d8-3118-4002-bfc6-86c8c3c365ad tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:08.298586 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 966/1907] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:08 2022] DELETE /identity/v3/users/5a0772a498774299b2e5b33d42abba78 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:08.299404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a369e-87e6-4a93-a0ef-c431bb48dadf admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:08.301952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa613d8-3118-4002-bfc6-86c8c3c365ad tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:08.303662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-777a369e-87e6-4a93-a0ef-c431bb48dadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:08.318140 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 942/1908] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:08.318140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dead2-05de-4be5-9995-fb9d0bd3b2c4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:08.318140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dead2-05de-4be5-9995-fb9d0bd3b2c4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:08.318140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dead2-05de-4be5-9995-fb9d0bd3b2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:08.341127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1b8dead2-05de-4be5-9995-fb9d0bd3b2c4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:08.342499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1b8dead2-05de-4be5-9995-fb9d0bd3b2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:08.369287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a369e-87e6-4a93-a0ef-c431bb48dadf admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:08.373201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9f1a9-a028-4256-9c4a-959f596ddfa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:08.373857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9f1a9-a028-4256-9c4a-959f596ddfa9 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:08.374141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9f1a9-a028-4256-9c4a-959f596ddfa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:08.374430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9f1a9-a028-4256-9c4a-959f596ddfa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:08.376284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-81e9f1a9-a028-4256-9c4a-959f596ddfa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:08.403619 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 943/1909] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:08.404203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:08.405473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dead2-05de-4be5-9995-fb9d0bd3b2c4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:08.407526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1b8dead2-05de-4be5-9995-fb9d0bd3b2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:08.420241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dead2-05de-4be5-9995-fb9d0bd3b2c4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:08.425207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ec81b-bb37-4dbd-96d0-4311b3f10b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:08.426073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ec81b-bb37-4dbd-96d0-4311b3f10b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:08.426357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ec81b-bb37-4dbd-96d0-4311b3f10b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:08.426600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ec81b-bb37-4dbd-96d0-4311b3f10b8c admin admin] PATH_INFO: `/v3/projects/4b24a22b9a2043ce990653db8ea28a5a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:08.427814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ec81b-bb37-4dbd-96d0-4311b3f10b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b24a22b9a2043ce990653db8ea28a5a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:08.429759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ec81b-bb37-4dbd-96d0-4311b3f10b8c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:08.445813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9f1a9-a028-4256-9c4a-959f596ddfa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:08.447609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9f1a9-a028-4256-9c4a-959f596ddfa9 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:08.458368 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 967/1910] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:08.459196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9f1a9-a028-4256-9c4a-959f596ddfa9 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:08.460611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-81e9f1a9-a028-4256-9c4a-959f596ddfa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:08.479422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-541ec81b-bb37-4dbd-96d0-4311b3f10b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b24a22b9a2043ce990653db8ea28a5a', 'request_id': 'req-541ec81b-bb37-4dbd-96d0-4311b3f10b8c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.487424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-541ec81b-bb37-4dbd-96d0-4311b3f10b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b24a22b9a2043ce990653db8ea28a5a', 'request_id': 'req-541ec81b-bb37-4dbd-96d0-4311b3f10b8c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.494166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-541ec81b-bb37-4dbd-96d0-4311b3f10b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b24a22b9a2043ce990653db8ea28a5a', 'request_id': 'req-541ec81b-bb37-4dbd-96d0-4311b3f10b8c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.512076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-541ec81b-bb37-4dbd-96d0-4311b3f10b8c admin admin] The token cache is being invalidate because project 4b24a22b9a2043ce990653db8ea28a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:08.512399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-541ec81b-bb37-4dbd-96d0-4311b3f10b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.513197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-541ec81b-bb37-4dbd-96d0-4311b3f10b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.518577 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 944/1911] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:08 2022] DELETE /identity/v3/projects/4b24a22b9a2043ce990653db8ea28a5a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:08.518577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ec81b-bb37-4dbd-96d0-4311b3f10b8c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:08.518577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-541ec81b-bb37-4dbd-96d0-4311b3f10b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:08.530170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9f1a9-a028-4256-9c4a-959f596ddfa9 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:08.569399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:08.583368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ec81b-bb37-4dbd-96d0-4311b3f10b8c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:08.589825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0d705-aee6-48d0-b296-680d1375bfb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:08.590569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0d705-aee6-48d0-b296-680d1375bfb4 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:08.590966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0d705-aee6-48d0-b296-680d1375bfb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:08.591321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0d705-aee6-48d0-b296-680d1375bfb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:08.593259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e6a0d705-aee6-48d0-b296-680d1375bfb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:08.594594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2d5cf-1f64-425e-805f-25b6b9869b73 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23e56fcf6b04feda78e462149dd7708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2c755f798b4c5da16d019753deb482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:08.595270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2d5cf-1f64-425e-805f-25b6b9869b73 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:08.595559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2d5cf-1f64-425e-805f-25b6b9869b73 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:08.595844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2d5cf-1f64-425e-805f-25b6b9869b73 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:08.596879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2d5cf-1f64-425e-805f-25b6b9869b73 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:08.598507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2d5cf-1f64-425e-805f-25b6b9869b73 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:08.632643 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 968/1912] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:08 2022] POST /identity/v3/projects => generated 369 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:08.633870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2d5cf-1f64-425e-805f-25b6b9869b73 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:08.635911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fbe2d5cf-1f64-425e-805f-25b6b9869b73 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:08.672174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0d705-aee6-48d0-b296-680d1375bfb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:08.673626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0d705-aee6-48d0-b296-680d1375bfb4 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:08.688284 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 945/1913] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:08.689126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0d705-aee6-48d0-b296-680d1375bfb4 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:08.693112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e6a0d705-aee6-48d0-b296-680d1375bfb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:08.710999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:08.714136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0d705-aee6-48d0-b296-680d1375bfb4 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:08.719750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2d5cf-1f64-425e-805f-25b6b9869b73 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:08.727030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ac3a0-7948-4ce4-bc64-1a73fee2dd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:08.728331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ac3a0-7948-4ce4-bc64-1a73fee2dd31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:08.728900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ac3a0-7948-4ce4-bc64-1a73fee2dd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:08.729404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ac3a0-7948-4ce4-bc64-1a73fee2dd31 admin admin] PATH_INFO: `/v3/users/327fa782b7e343269362a697106fa772` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:08.730936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ac3a0-7948-4ce4-bc64-1a73fee2dd31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=327fa782b7e343269362a697106fa772)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:08.733216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ac3a0-7948-4ce4-bc64-1a73fee2dd31 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:08.792506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85442e44-5110-400a-b4a4-7f2609ef4e09 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23e56fcf6b04feda78e462149dd7708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2c755f798b4c5da16d019753deb482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:08.793487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85442e44-5110-400a-b4a4-7f2609ef4e09 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:08.793877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85442e44-5110-400a-b4a4-7f2609ef4e09 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:08.794533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85442e44-5110-400a-b4a4-7f2609ef4e09 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:08.795249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85442e44-5110-400a-b4a4-7f2609ef4e09 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:08.795660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85442e44-5110-400a-b4a4-7f2609ef4e09 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:08.797661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85442e44-5110-400a-b4a4-7f2609ef4e09 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:08.804318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-086ac3a0-7948-4ce4-bc64-1a73fee2dd31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327fa782b7e343269362a697106fa772'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.811475 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 946/1914] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:08.812423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85442e44-5110-400a-b4a4-7f2609ef4e09 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:08.814387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-85442e44-5110-400a-b4a4-7f2609ef4e09 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:08.819309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-086ac3a0-7948-4ce4-bc64-1a73fee2dd31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327fa782b7e343269362a697106fa772'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.820372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-086ac3a0-7948-4ce4-bc64-1a73fee2dd31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327fa782b7e343269362a697106fa772'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.821244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-086ac3a0-7948-4ce4-bc64-1a73fee2dd31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327fa782b7e343269362a697106fa772'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.830522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85442e44-5110-400a-b4a4-7f2609ef4e09 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:08.831900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-086ac3a0-7948-4ce4-bc64-1a73fee2dd31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327fa782b7e343269362a697106fa772'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.836190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644810f-25ea-4f02-87ab-4800fbadb9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:08.837078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644810f-25ea-4f02-87ab-4800fbadb9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:08.837503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644810f-25ea-4f02-87ab-4800fbadb9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:08.837832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644810f-25ea-4f02-87ab-4800fbadb9ed admin admin] PATH_INFO: `/v3/projects/472fb37426124cf29d3d25e3ee20e85a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:08.839344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644810f-25ea-4f02-87ab-4800fbadb9ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=472fb37426124cf29d3d25e3ee20e85a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:08.841596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644810f-25ea-4f02-87ab-4800fbadb9ed admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:08.858403 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 969/1915] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:08 2022] DELETE /identity/v3/users/327fa782b7e343269362a697106fa772 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:08.859451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ac3a0-7948-4ce4-bc64-1a73fee2dd31 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:08.861144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-086ac3a0-7948-4ce4-bc64-1a73fee2dd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:08.910198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3644810f-25ea-4f02-87ab-4800fbadb9ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '472fb37426124cf29d3d25e3ee20e85a', 'request_id': 'req-3644810f-25ea-4f02-87ab-4800fbadb9ed'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.935337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3644810f-25ea-4f02-87ab-4800fbadb9ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '472fb37426124cf29d3d25e3ee20e85a', 'request_id': 'req-3644810f-25ea-4f02-87ab-4800fbadb9ed'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.951827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3644810f-25ea-4f02-87ab-4800fbadb9ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '472fb37426124cf29d3d25e3ee20e85a', 'request_id': 'req-3644810f-25ea-4f02-87ab-4800fbadb9ed'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.971626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3644810f-25ea-4f02-87ab-4800fbadb9ed admin admin] The token cache is being invalidate because project 472fb37426124cf29d3d25e3ee20e85a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:08.972710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3644810f-25ea-4f02-87ab-4800fbadb9ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.974281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3644810f-25ea-4f02-87ab-4800fbadb9ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:08.977006 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 947/1916] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:08 2022] DELETE /identity/v3/projects/472fb37426124cf29d3d25e3ee20e85a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:08.981783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644810f-25ea-4f02-87ab-4800fbadb9ed admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:08.985451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3644810f-25ea-4f02-87ab-4800fbadb9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:09.008850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:09.025695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ac3a0-7948-4ce4-bc64-1a73fee2dd31 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:09.123658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644810f-25ea-4f02-87ab-4800fbadb9ed admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:09.131403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93d51a-c771-4d09-8880-3ed1f48fd490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:09.132091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93d51a-c771-4d09-8880-3ed1f48fd490 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:09.132377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93d51a-c771-4d09-8880-3ed1f48fd490 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:09.132650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93d51a-c771-4d09-8880-3ed1f48fd490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:09.134773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2f93d51a-c771-4d09-8880-3ed1f48fd490 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:09.136957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf3079-a68c-44ae-9ffb-b3edcce9ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:09.138697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf3079-a68c-44ae-9ffb-b3edcce9ce1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:09.139165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf3079-a68c-44ae-9ffb-b3edcce9ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:09.139584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf3079-a68c-44ae-9ffb-b3edcce9ce1c admin admin] PATH_INFO: `/v3/users/fc8bea52d3db4a62b9ea4d11e67d70e4` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:09.141015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf3079-a68c-44ae-9ffb-b3edcce9ce1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8bea52d3db4a62b9ea4d11e67d70e4)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:09.143534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf3079-a68c-44ae-9ffb-b3edcce9ce1c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:09.148146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:09.209637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-82bf3079-a68c-44ae-9ffb-b3edcce9ce1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8bea52d3db4a62b9ea4d11e67d70e4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.218187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-82bf3079-a68c-44ae-9ffb-b3edcce9ce1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8bea52d3db4a62b9ea4d11e67d70e4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.226844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-82bf3079-a68c-44ae-9ffb-b3edcce9ce1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8bea52d3db4a62b9ea4d11e67d70e4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.228234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-82bf3079-a68c-44ae-9ffb-b3edcce9ce1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8bea52d3db4a62b9ea4d11e67d70e4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.228506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-82bf3079-a68c-44ae-9ffb-b3edcce9ce1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8bea52d3db4a62b9ea4d11e67d70e4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.242897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93d51a-c771-4d09-8880-3ed1f48fd490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:09.246007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93d51a-c771-4d09-8880-3ed1f48fd490 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:09.252291 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 948/1917] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:08 2022] DELETE /identity/v3/users/fc8bea52d3db4a62b9ea4d11e67d70e4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:09.253466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf3079-a68c-44ae-9ffb-b3edcce9ce1c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:09.255318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-82bf3079-a68c-44ae-9ffb-b3edcce9ce1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:09.264218 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 970/1918] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:09.285837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c70282-4ed7-44e9-86ef-3070f4571e8d None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:09.286939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c70282-4ed7-44e9-86ef-3070f4571e8d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:09.287929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c70282-4ed7-44e9-86ef-3070f4571e8d None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:09.290864 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 971/1919] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 21:01:09.298420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c70282-4ed7-44e9-86ef-3070f4571e8d None None] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:09.300612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f1c70282-4ed7-44e9-86ef-3070f4571e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:09.337552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf3079-a68c-44ae-9ffb-b3edcce9ce1c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:09.343937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05ddaf-257d-4b26-a1a3-2d44593b4b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:09.345615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05ddaf-257d-4b26-a1a3-2d44593b4b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:09.346040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05ddaf-257d-4b26-a1a3-2d44593b4b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:09.346477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05ddaf-257d-4b26-a1a3-2d44593b4b3e admin admin] PATH_INFO: `/v3/projects/657057f81e8943daa81146c218046699` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:09.347932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05ddaf-257d-4b26-a1a3-2d44593b4b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=657057f81e8943daa81146c218046699)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:09.351040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05ddaf-257d-4b26-a1a3-2d44593b4b3e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:09.395404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:09.423499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8b05ddaf-257d-4b26-a1a3-2d44593b4b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '657057f81e8943daa81146c218046699', 'request_id': 'req-8b05ddaf-257d-4b26-a1a3-2d44593b4b3e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.426193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c70282-4ed7-44e9-86ef-3070f4571e8d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:09.428360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f1c70282-4ed7-44e9-86ef-3070f4571e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:09.439506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8b05ddaf-257d-4b26-a1a3-2d44593b4b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '657057f81e8943daa81146c218046699', 'request_id': 'req-8b05ddaf-257d-4b26-a1a3-2d44593b4b3e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.446045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8b05ddaf-257d-4b26-a1a3-2d44593b4b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '657057f81e8943daa81146c218046699', 'request_id': 'req-8b05ddaf-257d-4b26-a1a3-2d44593b4b3e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.466374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8b05ddaf-257d-4b26-a1a3-2d44593b4b3e admin admin] The token cache is being invalidate because project 657057f81e8943daa81146c218046699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:09.466861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8b05ddaf-257d-4b26-a1a3-2d44593b4b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.467870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8b05ddaf-257d-4b26-a1a3-2d44593b4b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.469895 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 949/1920] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:09 2022] DELETE /identity/v3/projects/657057f81e8943daa81146c218046699 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:09.470821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05ddaf-257d-4b26-a1a3-2d44593b4b3e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:09.474079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8b05ddaf-257d-4b26-a1a3-2d44593b4b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:09.509810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c70282-4ed7-44e9-86ef-3070f4571e8d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:09.553982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05ddaf-257d-4b26-a1a3-2d44593b4b3e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:09.556291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:09.559149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e0f9a-ffe6-433b-a0c0-4341adfe2e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:09.560086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e0f9a-ffe6-433b-a0c0-4341adfe2e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:09.560370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e0f9a-ffe6-433b-a0c0-4341adfe2e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:09.560648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e0f9a-ffe6-433b-a0c0-4341adfe2e65 admin admin] PATH_INFO: `/v3/projects/907d1642a1eb4a68b58522e541f43393` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:09.561861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e0f9a-ffe6-433b-a0c0-4341adfe2e65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=907d1642a1eb4a68b58522e541f43393)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:09.563774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e0f9a-ffe6-433b-a0c0-4341adfe2e65 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:09.574663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37779627-84d0-4102-b4fc-1303cff5297c tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23e56fcf6b04feda78e462149dd7708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2c755f798b4c5da16d019753deb482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:09.575596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37779627-84d0-4102-b4fc-1303cff5297c tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:09.575878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37779627-84d0-4102-b4fc-1303cff5297c tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:09.576205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37779627-84d0-4102-b4fc-1303cff5297c tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] PATH_INFO: `/v3/projects/ef7ac194856345328a65d0f209d5bfd3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:09.577437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37779627-84d0-4102-b4fc-1303cff5297c tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorizing `identity:get_project(project_id=ef7ac194856345328a65d0f209d5bfd3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:09.579698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37779627-84d0-4102-b4fc-1303cff5297c tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:09.582348 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 972/1921] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:09 2022] GET /identity/v3/projects/ef7ac194856345328a65d0f209d5bfd3 => generated 369 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:01:09.583287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37779627-84d0-4102-b4fc-1303cff5297c tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:09.584648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-37779627-84d0-4102-b4fc-1303cff5297c tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:09.601593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37779627-84d0-4102-b4fc-1303cff5297c tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:09.607646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87706403-7abb-4daa-b4f9-edd6c3c7a6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:09.608848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87706403-7abb-4daa-b4f9-edd6c3c7a6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:09.609188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87706403-7abb-4daa-b4f9-edd6c3c7a6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:09.609528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87706403-7abb-4daa-b4f9-edd6c3c7a6fa admin admin] PATH_INFO: `/v3/users/701fc0602de041baa8e03d2f2d2da765` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:09.610863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87706403-7abb-4daa-b4f9-edd6c3c7a6fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=701fc0602de041baa8e03d2f2d2da765)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:09.613113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87706403-7abb-4daa-b4f9-edd6c3c7a6fa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:09.628358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6d7e0f9a-ffe6-433b-a0c0-4341adfe2e65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907d1642a1eb4a68b58522e541f43393', 'request_id': 'req-6d7e0f9a-ffe6-433b-a0c0-4341adfe2e65'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.638951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6d7e0f9a-ffe6-433b-a0c0-4341adfe2e65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907d1642a1eb4a68b58522e541f43393', 'request_id': 'req-6d7e0f9a-ffe6-433b-a0c0-4341adfe2e65'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.648256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6d7e0f9a-ffe6-433b-a0c0-4341adfe2e65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907d1642a1eb4a68b58522e541f43393', 'request_id': 'req-6d7e0f9a-ffe6-433b-a0c0-4341adfe2e65'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.666781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6d7e0f9a-ffe6-433b-a0c0-4341adfe2e65 admin admin] The token cache is being invalidate because project 907d1642a1eb4a68b58522e541f43393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:09.667316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6d7e0f9a-ffe6-433b-a0c0-4341adfe2e65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.668747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6d7e0f9a-ffe6-433b-a0c0-4341adfe2e65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.671713 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 950/1922] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:09 2022] DELETE /identity/v3/projects/907d1642a1eb4a68b58522e541f43393 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:09.676732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e0f9a-ffe6-433b-a0c0-4341adfe2e65 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:09.681611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6d7e0f9a-ffe6-433b-a0c0-4341adfe2e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:09.685917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-87706403-7abb-4daa-b4f9-edd6c3c7a6fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '701fc0602de041baa8e03d2f2d2da765'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.708940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-87706403-7abb-4daa-b4f9-edd6c3c7a6fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '701fc0602de041baa8e03d2f2d2da765'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.710031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-87706403-7abb-4daa-b4f9-edd6c3c7a6fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '701fc0602de041baa8e03d2f2d2da765'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.711110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-87706403-7abb-4daa-b4f9-edd6c3c7a6fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '701fc0602de041baa8e03d2f2d2da765'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.719402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-87706403-7abb-4daa-b4f9-edd6c3c7a6fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '701fc0602de041baa8e03d2f2d2da765'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.748214 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 973/1923] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:09 2022] DELETE /identity/v3/users/701fc0602de041baa8e03d2f2d2da765 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:09.749887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28fdaf-bdb8-4445-9201-42732e6dcfe3 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:09.750181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28fdaf-bdb8-4445-9201-42732e6dcfe3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:09.750460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28fdaf-bdb8-4445-9201-42732e6dcfe3 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:09.752100 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 974/1924] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:09.758461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:09.762332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28fdaf-bdb8-4445-9201-42732e6dcfe3 None None] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:09.764544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0a28fdaf-bdb8-4445-9201-42732e6dcfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:09.778070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e0f9a-ffe6-433b-a0c0-4341adfe2e65 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:09.858857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28fdaf-bdb8-4445-9201-42732e6dcfe3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:09.861039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0a28fdaf-bdb8-4445-9201-42732e6dcfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:09.862554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b97829-72f3-4a03-804e-929d1c6121c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:09.863673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b97829-72f3-4a03-804e-929d1c6121c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:09.864005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b97829-72f3-4a03-804e-929d1c6121c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:09.864369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b97829-72f3-4a03-804e-929d1c6121c5 admin admin] PATH_INFO: `/v3/users/e9d0f3b1bea04e4a953595f44b1f93fe` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:09.865709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b97829-72f3-4a03-804e-929d1c6121c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9d0f3b1bea04e4a953595f44b1f93fe)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:09.868134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b97829-72f3-4a03-804e-929d1c6121c5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:09.932105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:09.947280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28fdaf-bdb8-4445-9201-42732e6dcfe3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:09.959559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91e084-5c1d-4d37-b0b6-3ed5ddaf0118 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23e56fcf6b04feda78e462149dd7708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2c755f798b4c5da16d019753deb482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:09.961293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91e084-5c1d-4d37-b0b6-3ed5ddaf0118 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:09.961655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91e084-5c1d-4d37-b0b6-3ed5ddaf0118 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:09.961959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91e084-5c1d-4d37-b0b6-3ed5ddaf0118 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] PATH_INFO: `/v3/projects/ef7ac194856345328a65d0f209d5bfd3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:09.963482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91e084-5c1d-4d37-b0b6-3ed5ddaf0118 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorizing `identity:get_project(project_id=ef7ac194856345328a65d0f209d5bfd3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:09.965792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91e084-5c1d-4d37-b0b6-3ed5ddaf0118 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:09.973539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-32b97829-72f3-4a03-804e-929d1c6121c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9d0f3b1bea04e4a953595f44b1f93fe'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:09.981236 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 975/1925] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:09 2022] GET /identity/v3/projects/ef7ac194856345328a65d0f209d5bfd3 => generated 369 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:01:09.984361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91e084-5c1d-4d37-b0b6-3ed5ddaf0118 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:09.986605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-df91e084-5c1d-4d37-b0b6-3ed5ddaf0118 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:09.990392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-32b97829-72f3-4a03-804e-929d1c6121c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9d0f3b1bea04e4a953595f44b1f93fe'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.007411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-32b97829-72f3-4a03-804e-929d1c6121c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9d0f3b1bea04e4a953595f44b1f93fe'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.012533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-32b97829-72f3-4a03-804e-929d1c6121c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9d0f3b1bea04e4a953595f44b1f93fe'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.013887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-32b97829-72f3-4a03-804e-929d1c6121c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9d0f3b1bea04e4a953595f44b1f93fe'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.017559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91e084-5c1d-4d37-b0b6-3ed5ddaf0118 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:10.027546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6aceaf-ff2e-4003-9fc9-c1d18564248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:10.028479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6aceaf-ff2e-4003-9fc9-c1d18564248e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.028751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6aceaf-ff2e-4003-9fc9-c1d18564248e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.029026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6aceaf-ff2e-4003-9fc9-c1d18564248e admin admin] PATH_INFO: `/v3/projects/f3566744b2614c9db205c66899f36435` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.031050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6aceaf-ff2e-4003-9fc9-c1d18564248e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3566744b2614c9db205c66899f36435)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:10.033378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6aceaf-ff2e-4003-9fc9-c1d18564248e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:10.050005 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 951/1926] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:09 2022] DELETE /identity/v3/users/e9d0f3b1bea04e4a953595f44b1f93fe => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:01:10.051736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b97829-72f3-4a03-804e-929d1c6121c5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:10.053402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-32b97829-72f3-4a03-804e-929d1c6121c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:10.101273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0b6aceaf-ff2e-4003-9fc9-c1d18564248e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3566744b2614c9db205c66899f36435', 'request_id': 'req-0b6aceaf-ff2e-4003-9fc9-c1d18564248e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.118803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0b6aceaf-ff2e-4003-9fc9-c1d18564248e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3566744b2614c9db205c66899f36435', 'request_id': 'req-0b6aceaf-ff2e-4003-9fc9-c1d18564248e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.134001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0b6aceaf-ff2e-4003-9fc9-c1d18564248e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3566744b2614c9db205c66899f36435', 'request_id': 'req-0b6aceaf-ff2e-4003-9fc9-c1d18564248e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.159614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0b6aceaf-ff2e-4003-9fc9-c1d18564248e admin admin] The token cache is being invalidate because project f3566744b2614c9db205c66899f36435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:10.160199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0b6aceaf-ff2e-4003-9fc9-c1d18564248e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.161194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0b6aceaf-ff2e-4003-9fc9-c1d18564248e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.168298 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 976/1927] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:09 2022] DELETE /identity/v3/projects/f3566744b2614c9db205c66899f36435 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:10.168298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6aceaf-ff2e-4003-9fc9-c1d18564248e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:10.175277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b97829-72f3-4a03-804e-929d1c6121c5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:10.177337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0b6aceaf-ff2e-4003-9fc9-c1d18564248e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:10.226152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:10.286583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8009d-2614-4c5a-9182-ec3d2eb5156e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23e56fcf6b04feda78e462149dd7708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2c755f798b4c5da16d019753deb482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:10.287855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6aceaf-ff2e-4003-9fc9-c1d18564248e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:10.288454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8009d-2614-4c5a-9182-ec3d2eb5156e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.288957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8009d-2614-4c5a-9182-ec3d2eb5156e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.289435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8009d-2614-4c5a-9182-ec3d2eb5156e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.290613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8009d-2614-4c5a-9182-ec3d2eb5156e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:10.291491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8009d-2614-4c5a-9182-ec3d2eb5156e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:10.293208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d6c0f-634c-414e-b5c2-bd1db40a8e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:10.294096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d6c0f-634c-414e-b5c2-bd1db40a8e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.294518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d6c0f-634c-414e-b5c2-bd1db40a8e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.294732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8009d-2614-4c5a-9182-ec3d2eb5156e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:10.294938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d6c0f-634c-414e-b5c2-bd1db40a8e1f admin admin] PATH_INFO: `/v3/projects/1da6c0d2bdfd4ddb906ba11f5661118f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.296314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d6c0f-634c-414e-b5c2-bd1db40a8e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da6c0d2bdfd4ddb906ba11f5661118f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:10.298541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d6c0f-634c-414e-b5c2-bd1db40a8e1f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:10.335126 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 952/1928] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:10.337654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58a4ab-1f59-47dc-8b90-933f7aec16d8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.338562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58a4ab-1f59-47dc-8b90-933f7aec16d8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.339322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58a4ab-1f59-47dc-8b90-933f7aec16d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.375263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-dd58a4ab-1f59-47dc-8b90-933f7aec16d8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:10.378867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dd58a4ab-1f59-47dc-8b90-933f7aec16d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:10.380596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-970d6c0f-634c-414e-b5c2-bd1db40a8e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da6c0d2bdfd4ddb906ba11f5661118f', 'request_id': 'req-970d6c0f-634c-414e-b5c2-bd1db40a8e1f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.396614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-970d6c0f-634c-414e-b5c2-bd1db40a8e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da6c0d2bdfd4ddb906ba11f5661118f', 'request_id': 'req-970d6c0f-634c-414e-b5c2-bd1db40a8e1f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.405176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-970d6c0f-634c-414e-b5c2-bd1db40a8e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da6c0d2bdfd4ddb906ba11f5661118f', 'request_id': 'req-970d6c0f-634c-414e-b5c2-bd1db40a8e1f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.419497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-970d6c0f-634c-414e-b5c2-bd1db40a8e1f admin admin] The token cache is being invalidate because project 1da6c0d2bdfd4ddb906ba11f5661118f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:10.419823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-970d6c0f-634c-414e-b5c2-bd1db40a8e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.420991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-970d6c0f-634c-414e-b5c2-bd1db40a8e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.424130 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 977/1929] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:10 2022] DELETE /identity/v3/projects/1da6c0d2bdfd4ddb906ba11f5661118f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:10.424130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d6c0f-634c-414e-b5c2-bd1db40a8e1f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:10.426010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-970d6c0f-634c-414e-b5c2-bd1db40a8e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:10.456837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:10.490518 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 953/1930] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:10.491450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef99de4-2208-4c8b-af3f-955e01787ee8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.491738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef99de4-2208-4c8b-af3f-955e01787ee8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.492013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef99de4-2208-4c8b-af3f-955e01787ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.523159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8ef99de4-2208-4c8b-af3f-955e01787ee8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:10.524799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8ef99de4-2208-4c8b-af3f-955e01787ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:10.531817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d6c0f-634c-414e-b5c2-bd1db40a8e1f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:10.534365 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 954/1931] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:10.535002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef99de4-2208-4c8b-af3f-955e01787ee8 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:10.536313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8ef99de4-2208-4c8b-af3f-955e01787ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:10.543116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f78b33-8240-4f2f-b589-e144fa1d510e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23e56fcf6b04feda78e462149dd7708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2c755f798b4c5da16d019753deb482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:10.544409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f78b33-8240-4f2f-b589-e144fa1d510e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.545043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f78b33-8240-4f2f-b589-e144fa1d510e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.545385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f78b33-8240-4f2f-b589-e144fa1d510e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.546327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f78b33-8240-4f2f-b589-e144fa1d510e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:10.549080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f78b33-8240-4f2f-b589-e144fa1d510e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:10.549572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef99de4-2208-4c8b-af3f-955e01787ee8 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:10.554253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb89bf-2486-4bb9-bfb5-f244795869f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:10.555140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb89bf-2486-4bb9-bfb5-f244795869f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.555426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb89bf-2486-4bb9-bfb5-f244795869f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.555703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb89bf-2486-4bb9-bfb5-f244795869f9 admin admin] PATH_INFO: `/v3/projects/798845d7ca1f4577ac6ae317a7eece2b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.556982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb89bf-2486-4bb9-bfb5-f244795869f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=798845d7ca1f4577ac6ae317a7eece2b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:10.559213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb89bf-2486-4bb9-bfb5-f244795869f9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:10.573958 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 978/1932] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:10 2022] POST /identity/v3/users => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:10.575674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0ec78-12b8-4db5-8e93-8d89daecc467 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.575962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0ec78-12b8-4db5-8e93-8d89daecc467 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.576271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0ec78-12b8-4db5-8e93-8d89daecc467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.604558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-cdc0ec78-12b8-4db5-8e93-8d89daecc467 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:10.605741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cdc0ec78-12b8-4db5-8e93-8d89daecc467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:10.619465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-49eb89bf-2486-4bb9-bfb5-f244795869f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '798845d7ca1f4577ac6ae317a7eece2b', 'request_id': 'req-49eb89bf-2486-4bb9-bfb5-f244795869f9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.626054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-49eb89bf-2486-4bb9-bfb5-f244795869f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '798845d7ca1f4577ac6ae317a7eece2b', 'request_id': 'req-49eb89bf-2486-4bb9-bfb5-f244795869f9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.632761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-49eb89bf-2486-4bb9-bfb5-f244795869f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '798845d7ca1f4577ac6ae317a7eece2b', 'request_id': 'req-49eb89bf-2486-4bb9-bfb5-f244795869f9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.647824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-49eb89bf-2486-4bb9-bfb5-f244795869f9 admin admin] The token cache is being invalidate because project 798845d7ca1f4577ac6ae317a7eece2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:10.648304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-49eb89bf-2486-4bb9-bfb5-f244795869f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.648953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-49eb89bf-2486-4bb9-bfb5-f244795869f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:10.650892 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 955/1933] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:10 2022] DELETE /identity/v3/projects/798845d7ca1f4577ac6ae317a7eece2b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:10.652368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b492b-1701-4f03-bcfe-105384509e3a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.652652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b492b-1701-4f03-bcfe-105384509e3a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.652928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b492b-1701-4f03-bcfe-105384509e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.671523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d66b492b-1701-4f03-bcfe-105384509e3a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:10.672771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d66b492b-1701-4f03-bcfe-105384509e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:10.674799 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 979/1934] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:10.675784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0ec78-12b8-4db5-8e93-8d89daecc467 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:10.677068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cdc0ec78-12b8-4db5-8e93-8d89daecc467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:10.684073 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 956/1935] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:10.685334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95041b7-53d2-4de9-bda3-4593d602fdb2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.685622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95041b7-53d2-4de9-bda3-4593d602fdb2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.685901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95041b7-53d2-4de9-bda3-4593d602fdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.703778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c95041b7-53d2-4de9-bda3-4593d602fdb2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:10.705022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c95041b7-53d2-4de9-bda3-4593d602fdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:10.713301 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 957/1936] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:10.714383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95041b7-53d2-4de9-bda3-4593d602fdb2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:10.723762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95041b7-53d2-4de9-bda3-4593d602fdb2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:10.729191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c42ee-37ae-4b3e-98a5-67eb50cd8487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:10.729828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c42ee-37ae-4b3e-98a5-67eb50cd8487 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.730135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c42ee-37ae-4b3e-98a5-67eb50cd8487 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.730406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c42ee-37ae-4b3e-98a5-67eb50cd8487 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.731122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c42ee-37ae-4b3e-98a5-67eb50cd8487 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:10.731428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c42ee-37ae-4b3e-98a5-67eb50cd8487 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:10.733049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c42ee-37ae-4b3e-98a5-67eb50cd8487 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:10.744522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0ec78-12b8-4db5-8e93-8d89daecc467 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:10.744838 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 958/1937] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:10.748321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c42ee-37ae-4b3e-98a5-67eb50cd8487 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:10.752751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed778efe-dd64-4bc0-8627-dfcd7fcdf451 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23e56fcf6b04feda78e462149dd7708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2c755f798b4c5da16d019753deb482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:10.753418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed778efe-dd64-4bc0-8627-dfcd7fcdf451 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.753700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed778efe-dd64-4bc0-8627-dfcd7fcdf451 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.753977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed778efe-dd64-4bc0-8627-dfcd7fcdf451 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.754704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed778efe-dd64-4bc0-8627-dfcd7fcdf451 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:10.755014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed778efe-dd64-4bc0-8627-dfcd7fcdf451 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:10.755285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c42ee-37ae-4b3e-98a5-67eb50cd8487 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:10.756653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed778efe-dd64-4bc0-8627-dfcd7fcdf451 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:10.759922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbc2b5-6ab7-4999-8034-ddd7496f8c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:10.760617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbc2b5-6ab7-4999-8034-ddd7496f8c84 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.760902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbc2b5-6ab7-4999-8034-ddd7496f8c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.761177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbc2b5-6ab7-4999-8034-ddd7496f8c84 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.761893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbc2b5-6ab7-4999-8034-ddd7496f8c84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:10.762185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbc2b5-6ab7-4999-8034-ddd7496f8c84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:10.763735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbc2b5-6ab7-4999-8034-ddd7496f8c84 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:10.765238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:10.771283 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 980/1938] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:10.771283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef91bb-05bc-41af-8a22-68bd4092ac63 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.771283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef91bb-05bc-41af-8a22-68bd4092ac63 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.771283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef91bb-05bc-41af-8a22-68bd4092ac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.778627 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 959/1939] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:10.779601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbc2b5-6ab7-4999-8034-ddd7496f8c84 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:10.792770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbc2b5-6ab7-4999-8034-ddd7496f8c84 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:10.794973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-dfef91bb-05bc-41af-8a22-68bd4092ac63 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:10.796359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dfef91bb-05bc-41af-8a22-68bd4092ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:10.798375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcd25a-7e72-4b8f-8ed0-b0cc266647ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:10.799046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcd25a-7e72-4b8f-8ed0-b0cc266647ca admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.799331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcd25a-7e72-4b8f-8ed0-b0cc266647ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.799609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcd25a-7e72-4b8f-8ed0-b0cc266647ca admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.800352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcd25a-7e72-4b8f-8ed0-b0cc266647ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:10.802248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcd25a-7e72-4b8f-8ed0-b0cc266647ca admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:10.805077 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 981/1940] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:10.807013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef91bb-05bc-41af-8a22-68bd4092ac63 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:10.817413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef91bb-05bc-41af-8a22-68bd4092ac63 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:10.822703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0fd74-5884-4d9d-adfa-3829c3ee61c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:10.823372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0fd74-5884-4d9d-adfa-3829c3ee61c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.823655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0fd74-5884-4d9d-adfa-3829c3ee61c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.824079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0fd74-5884-4d9d-adfa-3829c3ee61c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.824695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0fd74-5884-4d9d-adfa-3829c3ee61c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:10.826612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0fd74-5884-4d9d-adfa-3829c3ee61c1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:10.832663 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 960/1941] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:10 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:10.832663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94282447-d89b-4822-b110-ed2441fcd649 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.832663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94282447-d89b-4822-b110-ed2441fcd649 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.832663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94282447-d89b-4822-b110-ed2441fcd649 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.832663 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 961/1942] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:10.833393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94282447-d89b-4822-b110-ed2441fcd649 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:10.860897 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 982/1943] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:10 2022] POST /identity/v3/projects => generated 397 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:10.860897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0fd74-5884-4d9d-adfa-3829c3ee61c1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:10.869133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:10.900782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94282447-d89b-4822-b110-ed2441fcd649 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:10.923576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0fd74-5884-4d9d-adfa-3829c3ee61c1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:10.928498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c5e04-53f9-4892-881b-8887eb28da9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:10.929139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c5e04-53f9-4892-881b-8887eb28da9b admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.929424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c5e04-53f9-4892-881b-8887eb28da9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.929689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c5e04-53f9-4892-881b-8887eb28da9b admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.930372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c5e04-53f9-4892-881b-8887eb28da9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:10.932377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c5e04-53f9-4892-881b-8887eb28da9b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:10.956220 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 983/1944] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:10 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:10.957153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c5e04-53f9-4892-881b-8887eb28da9b admin admin] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:10.958765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ac5c5e04-53f9-4892-881b-8887eb28da9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:10.959774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da023fd5-c985-4173-af25-06f21e837721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:10.960480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da023fd5-c985-4173-af25-06f21e837721 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.960762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da023fd5-c985-4173-af25-06f21e837721 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.961041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da023fd5-c985-4173-af25-06f21e837721 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.961888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da023fd5-c985-4173-af25-06f21e837721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:10.962208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da023fd5-c985-4173-af25-06f21e837721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:10.963844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da023fd5-c985-4173-af25-06f21e837721 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:10.975803 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 962/1945] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:10.976990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da023fd5-c985-4173-af25-06f21e837721 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:10.986704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da023fd5-c985-4173-af25-06f21e837721 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:10.991731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb308fa-a4cb-4a78-9869-d9c08dbe1e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:10.992494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb308fa-a4cb-4a78-9869-d9c08dbe1e9c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:10.992843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb308fa-a4cb-4a78-9869-d9c08dbe1e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:10.993186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb308fa-a4cb-4a78-9869-d9c08dbe1e9c admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:10.994186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb308fa-a4cb-4a78-9869-d9c08dbe1e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:10.996004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb308fa-a4cb-4a78-9869-d9c08dbe1e9c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.017265 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 963/1946] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:10 2022] POST /identity/v3/users => generated 299 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:11.018115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb308fa-a4cb-4a78-9869-d9c08dbe1e9c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.027689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb308fa-a4cb-4a78-9869-d9c08dbe1e9c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:11.032786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882d77a-d71d-4971-a02a-f97af062279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:11.033418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882d77a-d71d-4971-a02a-f97af062279b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.033699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882d77a-d71d-4971-a02a-f97af062279b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.033798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c5e04-53f9-4892-881b-8887eb28da9b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.034244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882d77a-d71d-4971-a02a-f97af062279b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.034744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882d77a-d71d-4971-a02a-f97af062279b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:11.036340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882d77a-d71d-4971-a02a-f97af062279b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.049742 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 964/1947] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:11.049742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882d77a-d71d-4971-a02a-f97af062279b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.060223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882d77a-d71d-4971-a02a-f97af062279b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:11.064983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20f0a0-7dc4-48af-9b1a-12efb42325b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:11.065619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20f0a0-7dc4-48af-9b1a-12efb42325b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.065903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20f0a0-7dc4-48af-9b1a-12efb42325b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.066180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20f0a0-7dc4-48af-9b1a-12efb42325b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.066865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20f0a0-7dc4-48af-9b1a-12efb42325b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:11.068818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20f0a0-7dc4-48af-9b1a-12efb42325b4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.110237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c5e04-53f9-4892-881b-8887eb28da9b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:11.112354 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 965/1948] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:11 2022] POST /identity/v3/projects => generated 361 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:11.113151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20f0a0-7dc4-48af-9b1a-12efb42325b4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.144689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:11.162149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:11.188988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81207bdb-5237-4181-bfff-6a5c3ef5b5e9 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23e56fcf6b04feda78e462149dd7708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2c755f798b4c5da16d019753deb482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:11.189896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81207bdb-5237-4181-bfff-6a5c3ef5b5e9 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.190337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81207bdb-5237-4181-bfff-6a5c3ef5b5e9 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.190629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81207bdb-5237-4181-bfff-6a5c3ef5b5e9 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] PATH_INFO: `/v3/projects/ef7ac194856345328a65d0f209d5bfd3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.200511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81207bdb-5237-4181-bfff-6a5c3ef5b5e9 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorizing `identity:get_project(project_id=ef7ac194856345328a65d0f209d5bfd3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:11.200511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81207bdb-5237-4181-bfff-6a5c3ef5b5e9 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.200511 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 984/1949] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:10 2022] GET /identity/v3/projects/ef7ac194856345328a65d0f209d5bfd3 => generated 369 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:11.200511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81207bdb-5237-4181-bfff-6a5c3ef5b5e9 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.210587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20f0a0-7dc4-48af-9b1a-12efb42325b4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:11.214619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81207bdb-5237-4181-bfff-6a5c3ef5b5e9 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:11.216641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a3dff-c48c-48b8-bfac-0124088b688c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:11.217429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a3dff-c48c-48b8-bfac-0124088b688c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.217806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a3dff-c48c-48b8-bfac-0124088b688c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.218179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a3dff-c48c-48b8-bfac-0124088b688c admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.219142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a3dff-c48c-48b8-bfac-0124088b688c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:11.220238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fecd1-f19a-4a86-accd-8efbde07c924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:11.220981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a3dff-c48c-48b8-bfac-0124088b688c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.221257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fecd1-f19a-4a86-accd-8efbde07c924 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.221828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fecd1-f19a-4a86-accd-8efbde07c924 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.222261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fecd1-f19a-4a86-accd-8efbde07c924 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.223141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fecd1-f19a-4a86-accd-8efbde07c924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:11.224966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fecd1-f19a-4a86-accd-8efbde07c924 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.232813 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 966/1950] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:11.234610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a3dff-c48c-48b8-bfac-0124088b688c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.242703 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 985/1951] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:11.242703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fecd1-f19a-4a86-accd-8efbde07c924 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.246679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a3dff-c48c-48b8-bfac-0124088b688c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:11.254581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab1f06-8ee7-428b-b49b-02fc920207de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:11.256659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1f06-8ee7-428b-b49b-02fc920207de admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.260814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1f06-8ee7-428b-b49b-02fc920207de admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.261123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1f06-8ee7-428b-b49b-02fc920207de admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.263609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab1f06-8ee7-428b-b49b-02fc920207de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:11.265706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab1f06-8ee7-428b-b49b-02fc920207de admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.265853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fecd1-f19a-4a86-accd-8efbde07c924 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:11.287371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465892ce-4ad2-4d30-8b8f-3a48d6033108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:11.288372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465892ce-4ad2-4d30-8b8f-3a48d6033108 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.288727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465892ce-4ad2-4d30-8b8f-3a48d6033108 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.289020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465892ce-4ad2-4d30-8b8f-3a48d6033108 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.289967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465892ce-4ad2-4d30-8b8f-3a48d6033108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:11.291618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465892ce-4ad2-4d30-8b8f-3a48d6033108 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.299656 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 967/1952] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:11 2022] POST /identity/v3/users => generated 281 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:11.300837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab1f06-8ee7-428b-b49b-02fc920207de admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.302709 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 986/1953] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:11.303702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465892ce-4ad2-4d30-8b8f-3a48d6033108 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.313206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab1f06-8ee7-428b-b49b-02fc920207de admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:11.315496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465892ce-4ad2-4d30-8b8f-3a48d6033108 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:11.319112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229605c0-4f83-41fe-b2df-65c79f91e6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:11.320125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229605c0-4f83-41fe-b2df-65c79f91e6db admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.320717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229605c0-4f83-41fe-b2df-65c79f91e6db admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.320826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e388047-a42c-4124-afaa-7f5a5f5c41a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:11.320928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229605c0-4f83-41fe-b2df-65c79f91e6db admin admin] PATH_INFO: `/v3/projects/d89b6b5b3969440597c12fb2f216f2d2/users/e45bf8801c9b469e857ea01159e5dabc/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.321553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e388047-a42c-4124-afaa-7f5a5f5c41a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.321898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e388047-a42c-4124-afaa-7f5a5f5c41a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.322089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e388047-a42c-4124-afaa-7f5a5f5c41a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.322828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e388047-a42c-4124-afaa-7f5a5f5c41a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:11.325229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e388047-a42c-4124-afaa-7f5a5f5c41a9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.339959 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 987/1954] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:11.339959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e388047-a42c-4124-afaa-7f5a5f5c41a9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.356110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e388047-a42c-4124-afaa-7f5a5f5c41a9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:11.358254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c470d-f050-45c3-8bf1-be6dec1e79c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:11.359413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c470d-f050-45c3-8bf1-be6dec1e79c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.359805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c470d-f050-45c3-8bf1-be6dec1e79c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.360067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c470d-f050-45c3-8bf1-be6dec1e79c3 admin admin] PATH_INFO: `/v3/projects/d59cb1f0d7bb4708ac0994f7c9b846b3/users/f3287fb85c2343d686718d3c4aaa5c00/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.361488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229605c0-4f83-41fe-b2df-65c79f91e6db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d89b6b5b3969440597c12fb2f216f2d2, user_id=e45bf8801c9b469e857ea01159e5dabc, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:11.367179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229605c0-4f83-41fe-b2df-65c79f91e6db admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.378306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c470d-f050-45c3-8bf1-be6dec1e79c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59cb1f0d7bb4708ac0994f7c9b846b3, user_id=f3287fb85c2343d686718d3c4aaa5c00, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:11.381024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c470d-f050-45c3-8bf1-be6dec1e79c3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.382953 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 968/1955] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:11 2022] PUT /identity/v3/projects/d89b6b5b3969440597c12fb2f216f2d2/users/e45bf8801c9b469e857ea01159e5dabc/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:11.384191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229605c0-4f83-41fe-b2df-65c79f91e6db admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.397243 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 988/1956] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:11 2022] PUT /identity/v3/projects/d59cb1f0d7bb4708ac0994f7c9b846b3/users/f3287fb85c2343d686718d3c4aaa5c00/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:11.398770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fd144-e259-42f8-b056-19729f8ca889 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.399061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fd144-e259-42f8-b056-19729f8ca889 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.399338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fd144-e259-42f8-b056-19729f8ca889 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.404178 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 989/1957] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:11.405577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366deb45-aa06-4ed4-898f-910f0f6ffd3a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.405871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366deb45-aa06-4ed4-898f-910f0f6ffd3a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.406149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366deb45-aa06-4ed4-898f-910f0f6ffd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.432682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-366deb45-aa06-4ed4-898f-910f0f6ffd3a None None] MFA Rules not processed for user `e45bf8801c9b469e857ea01159e5dabc`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:11.433825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-366deb45-aa06-4ed4-898f-910f0f6ffd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:11.447364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229605c0-4f83-41fe-b2df-65c79f91e6db admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:11.499087 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 990/1958] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:11.500425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d085a-7ab1-4928-b0ba-7c89dd437580 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.500718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d085a-7ab1-4928-b0ba-7c89dd437580 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.500994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d085a-7ab1-4928-b0ba-7c89dd437580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.506627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8251ad-9d76-445f-aaa3-d03463b50d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:11.507294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8251ad-9d76-445f-aaa3-d03463b50d49 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.507571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8251ad-9d76-445f-aaa3-d03463b50d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.507840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8251ad-9d76-445f-aaa3-d03463b50d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.508597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8251ad-9d76-445f-aaa3-d03463b50d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:11.510249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8251ad-9d76-445f-aaa3-d03463b50d49 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.518979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f62d085a-7ab1-4928-b0ba-7c89dd437580 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:11.520215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f62d085a-7ab1-4928-b0ba-7c89dd437580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:11.520729 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 969/1959] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:11.521642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8251ad-9d76-445f-aaa3-d03463b50d49 admin admin] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:11.523152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9f8251ad-9d76-445f-aaa3-d03463b50d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:11.528446 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 991/1960] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:11.529190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d085a-7ab1-4928-b0ba-7c89dd437580 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.538470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d085a-7ab1-4928-b0ba-7c89dd437580 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:11.543146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb815a07-22ca-4d03-9acb-4021c3d9eab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:11.543767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb815a07-22ca-4d03-9acb-4021c3d9eab8 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.544068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb815a07-22ca-4d03-9acb-4021c3d9eab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.544351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb815a07-22ca-4d03-9acb-4021c3d9eab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.545038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb815a07-22ca-4d03-9acb-4021c3d9eab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:11.546135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:11.546965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb815a07-22ca-4d03-9acb-4021c3d9eab8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.573262 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 992/1961] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:11 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:11.574407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb815a07-22ca-4d03-9acb-4021c3d9eab8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.602093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8251ad-9d76-445f-aaa3-d03463b50d49 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.623513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:11.643555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb815a07-22ca-4d03-9acb-4021c3d9eab8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:11.648484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7738455-a80c-4455-b8a0-e1bb228b0752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:11.649390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7738455-a80c-4455-b8a0-e1bb228b0752 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.649671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7738455-a80c-4455-b8a0-e1bb228b0752 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.649947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7738455-a80c-4455-b8a0-e1bb228b0752 admin admin] PATH_INFO: `/v3/projects/35d44a2b124348dcb3dd5411e6acf5a0/users/51ad1ac8ea7a4482a7dd7cf531ce5a1d/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.668714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7738455-a80c-4455-b8a0-e1bb228b0752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d44a2b124348dcb3dd5411e6acf5a0, user_id=51ad1ac8ea7a4482a7dd7cf531ce5a1d, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:11.671413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7738455-a80c-4455-b8a0-e1bb228b0752 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.675076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8251ad-9d76-445f-aaa3-d03463b50d49 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:11.690842 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 993/1962] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:11 2022] PUT /identity/v3/projects/35d44a2b124348dcb3dd5411e6acf5a0/users/51ad1ac8ea7a4482a7dd7cf531ce5a1d/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:11.692129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7738455-a80c-4455-b8a0-e1bb228b0752 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.703457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c7738455-a80c-4455-b8a0-e1bb228b0752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:11.738241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2920c68-197c-42fe-94ae-9d0b174c3870 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23e56fcf6b04feda78e462149dd7708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2c755f798b4c5da16d019753deb482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:11.739130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2920c68-197c-42fe-94ae-9d0b174c3870 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.739574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2920c68-197c-42fe-94ae-9d0b174c3870 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.739845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2920c68-197c-42fe-94ae-9d0b174c3870 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] PATH_INFO: `/v3/projects/ef7ac194856345328a65d0f209d5bfd3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.741113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2920c68-197c-42fe-94ae-9d0b174c3870 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorizing `identity:get_project(project_id=ef7ac194856345328a65d0f209d5bfd3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:11.743269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2920c68-197c-42fe-94ae-9d0b174c3870 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.745559 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 970/1963] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:11 2022] GET /identity/v3/projects/ef7ac194856345328a65d0f209d5bfd3 => generated 369 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:11.746351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2920c68-197c-42fe-94ae-9d0b174c3870 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.757474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2920c68-197c-42fe-94ae-9d0b174c3870 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:11.783530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7738455-a80c-4455-b8a0-e1bb228b0752 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:11.788942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724011d0-2cf8-4aea-be58-50de86f985fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:11.789671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724011d0-2cf8-4aea-be58-50de86f985fb service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.790453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724011d0-2cf8-4aea-be58-50de86f985fb service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.790962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724011d0-2cf8-4aea-be58-50de86f985fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.819999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70be65c-624a-431a-b3fa-38972f93175a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:11.820791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70be65c-624a-431a-b3fa-38972f93175a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.821079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70be65c-624a-431a-b3fa-38972f93175a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.821358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70be65c-624a-431a-b3fa-38972f93175a admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.822522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70be65c-624a-431a-b3fa-38972f93175a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:11.824501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70be65c-624a-431a-b3fa-38972f93175a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.833172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:11.849023 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 971/1964] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:11 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:11.849023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51952fa-9511-42e5-bd40-ef8f89f753b6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.849023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51952fa-9511-42e5-bd40-ef8f89f753b6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.849023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51952fa-9511-42e5-bd40-ef8f89f753b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.858897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724011d0-2cf8-4aea-be58-50de86f985fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:11.860418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724011d0-2cf8-4aea-be58-50de86f985fb service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.870458 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 994/1965] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:11.871366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724011d0-2cf8-4aea-be58-50de86f985fb service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.875029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e51952fa-9511-42e5-bd40-ef8f89f753b6 None None] MFA Rules not processed for user `51ad1ac8ea7a4482a7dd7cf531ce5a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:11.876387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e51952fa-9511-42e5-bd40-ef8f89f753b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:11.943163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724011d0-2cf8-4aea-be58-50de86f985fb service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:11.948658 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 972/1966] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:11.948658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51952fa-9511-42e5-bd40-ef8f89f753b6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.950665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e130af-cfdc-4419-9737-654c1f2a2d15 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23e56fcf6b04feda78e462149dd7708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2c755f798b4c5da16d019753deb482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:11.951718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e130af-cfdc-4419-9737-654c1f2a2d15 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.952100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e130af-cfdc-4419-9737-654c1f2a2d15 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.952446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e130af-cfdc-4419-9737-654c1f2a2d15 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] PATH_INFO: `/v3/users/e6941849e83842fd8c46cd7788813dad` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.962983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51952fa-9511-42e5-bd40-ef8f89f753b6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:11.969979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d945e7d-f1e9-4c11-9405-41b56e78a7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:11.970723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d945e7d-f1e9-4c11-9405-41b56e78a7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:11.970981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d945e7d-f1e9-4c11-9405-41b56e78a7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:11.971275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d945e7d-f1e9-4c11-9405-41b56e78a7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:11.972245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d945e7d-f1e9-4c11-9405-41b56e78a7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:11.972380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e130af-cfdc-4419-9737-654c1f2a2d15 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e6941849e83842fd8c46cd7788813dad)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:11.974187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d945e7d-f1e9-4c11-9405-41b56e78a7b0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.974431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e130af-cfdc-4419-9737-654c1f2a2d15 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:11.980644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:11.990672 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 973/1967] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:11.990672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d945e7d-f1e9-4c11-9405-41b56e78a7b0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:11.999538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d945e7d-f1e9-4c11-9405-41b56e78a7b0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:12.005186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15dd8c1-ba13-4b92-b749-85bb3e086358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:12.005948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15dd8c1-ba13-4b92-b749-85bb3e086358 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:12.006297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15dd8c1-ba13-4b92-b749-85bb3e086358 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:12.006638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15dd8c1-ba13-4b92-b749-85bb3e086358 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:12.007456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15dd8c1-ba13-4b92-b749-85bb3e086358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:12.009618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15dd8c1-ba13-4b92-b749-85bb3e086358 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:12.033949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-53e130af-cfdc-4419-9737-654c1f2a2d15 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6941849e83842fd8c46cd7788813dad'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:12.043378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-53e130af-cfdc-4419-9737-654c1f2a2d15 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6941849e83842fd8c46cd7788813dad'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:12.044418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-53e130af-cfdc-4419-9737-654c1f2a2d15 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6941849e83842fd8c46cd7788813dad'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:12.045474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-53e130af-cfdc-4419-9737-654c1f2a2d15 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6941849e83842fd8c46cd7788813dad'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:12.050387 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 974/1968] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:11 2022] POST /identity/v3/projects => generated 359 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:12.051304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15dd8c1-ba13-4b92-b749-85bb3e086358 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:12.053394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a15dd8c1-ba13-4b92-b749-85bb3e086358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:12.056032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-53e130af-cfdc-4419-9737-654c1f2a2d15 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6941849e83842fd8c46cd7788813dad'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:12.099763 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 995/1969] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:11 2022] DELETE /identity/v3/users/e6941849e83842fd8c46cd7788813dad => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:12.100745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e130af-cfdc-4419-9737-654c1f2a2d15 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:12.104633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-53e130af-cfdc-4419-9737-654c1f2a2d15 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:12.136316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15dd8c1-ba13-4b92-b749-85bb3e086358 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:12.205779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e130af-cfdc-4419-9737-654c1f2a2d15 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:12.210045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:12.211375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995365f-e716-4d5b-9424-34e442a2c34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:12.212297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995365f-e716-4d5b-9424-34e442a2c34c admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:12.213394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995365f-e716-4d5b-9424-34e442a2c34c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:12.213394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995365f-e716-4d5b-9424-34e442a2c34c admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:12.213719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995365f-e716-4d5b-9424-34e442a2c34c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:12.216949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995365f-e716-4d5b-9424-34e442a2c34c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:12.219445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf50d3-008d-4d80-a3b5-b09538c84a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:12.234681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf50d3-008d-4d80-a3b5-b09538c84a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:12.234970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf50d3-008d-4d80-a3b5-b09538c84a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:12.235255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf50d3-008d-4d80-a3b5-b09538c84a14 admin admin] PATH_INFO: `/v3/projects/5fd09a8aa76f4ce2bc232b7403aaa02d/users/c48bca53bf234aa887b344c67c1b285e/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:12.254761 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 996/1970] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:12 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:12.255746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995365f-e716-4d5b-9424-34e442a2c34c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:12.260411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a995365f-e716-4d5b-9424-34e442a2c34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:12.275816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf50d3-008d-4d80-a3b5-b09538c84a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fd09a8aa76f4ce2bc232b7403aaa02d, user_id=c48bca53bf234aa887b344c67c1b285e, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:12.282244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf50d3-008d-4d80-a3b5-b09538c84a14 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:12.308316 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 975/1971] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:12 2022] PUT /identity/v3/projects/5fd09a8aa76f4ce2bc232b7403aaa02d/users/c48bca53bf234aa887b344c67c1b285e/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:12.309565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf50d3-008d-4d80-a3b5-b09538c84a14 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:12.370129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995365f-e716-4d5b-9424-34e442a2c34c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:12.400258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:12.406600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf50d3-008d-4d80-a3b5-b09538c84a14 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:12.414794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede4447-4f53-47dc-9d40-a4be1ea6a09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:12.415850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede4447-4f53-47dc-9d40-a4be1ea6a09d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:12.416995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede4447-4f53-47dc-9d40-a4be1ea6a09d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:12.417475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede4447-4f53-47dc-9d40-a4be1ea6a09d admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:12.418847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede4447-4f53-47dc-9d40-a4be1ea6a09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:12.420941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede4447-4f53-47dc-9d40-a4be1ea6a09d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:12.440075 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 976/1972] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:12.441375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede4447-4f53-47dc-9d40-a4be1ea6a09d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:12.456866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4f957-6e56-4f5c-bd54-a1a71a1c601e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23e56fcf6b04feda78e462149dd7708', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2c755f798b4c5da16d019753deb482', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:12.458179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4f957-6e56-4f5c-bd54-a1a71a1c601e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:12.458700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4f957-6e56-4f5c-bd54-a1a71a1c601e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:12.459191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4f957-6e56-4f5c-bd54-a1a71a1c601e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] PATH_INFO: `/v3/projects/ef7ac194856345328a65d0f209d5bfd3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:12.459732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede4447-4f53-47dc-9d40-a4be1ea6a09d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:12.460635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4f957-6e56-4f5c-bd54-a1a71a1c601e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ef7ac194856345328a65d0f209d5bfd3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:12.463258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4f957-6e56-4f5c-bd54-a1a71a1c601e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:12.466303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97715cde-610e-4117-b7b3-d4b7851e53d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:12.466985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97715cde-610e-4117-b7b3-d4b7851e53d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:12.467273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97715cde-610e-4117-b7b3-d4b7851e53d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:12.467989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97715cde-610e-4117-b7b3-d4b7851e53d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:12.468723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97715cde-610e-4117-b7b3-d4b7851e53d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:12.470710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97715cde-610e-4117-b7b3-d4b7851e53d9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:12.483030 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 977/1973] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:12.484183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97715cde-610e-4117-b7b3-d4b7851e53d9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:12.500387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97715cde-610e-4117-b7b3-d4b7851e53d9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:12.507317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800bfea-5e39-41c9-b09e-beccb46e1a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:12.508648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800bfea-5e39-41c9-b09e-beccb46e1a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:12.509162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800bfea-5e39-41c9-b09e-beccb46e1a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:12.509501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800bfea-5e39-41c9-b09e-beccb46e1a15 admin admin] PATH_INFO: `/v3/projects/446ece37fefc42b691a6363aad384dad/users/3b7b2263389245b8b9f172c24f40f84c/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:12.525304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-97a4f957-6e56-4f5c-bd54-a1a71a1c601e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef7ac194856345328a65d0f209d5bfd3', 'request_id': 'req-97a4f957-6e56-4f5c-bd54-a1a71a1c601e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:12.526908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800bfea-5e39-41c9-b09e-beccb46e1a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=446ece37fefc42b691a6363aad384dad, user_id=3b7b2263389245b8b9f172c24f40f84c, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:12.529603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800bfea-5e39-41c9-b09e-beccb46e1a15 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:12.535321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-97a4f957-6e56-4f5c-bd54-a1a71a1c601e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef7ac194856345328a65d0f209d5bfd3', 'request_id': 'req-97a4f957-6e56-4f5c-bd54-a1a71a1c601e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:12.545019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-97a4f957-6e56-4f5c-bd54-a1a71a1c601e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef7ac194856345328a65d0f209d5bfd3', 'request_id': 'req-97a4f957-6e56-4f5c-bd54-a1a71a1c601e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:12.546953 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 978/1974] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:12 2022] PUT /identity/v3/projects/446ece37fefc42b691a6363aad384dad/users/3b7b2263389245b8b9f172c24f40f84c/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:12.547918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800bfea-5e39-41c9-b09e-beccb46e1a15 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:12.560602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-97a4f957-6e56-4f5c-bd54-a1a71a1c601e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] The token cache is being invalidate because project ef7ac194856345328a65d0f209d5bfd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:12.560886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-97a4f957-6e56-4f5c-bd54-a1a71a1c601e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:12.561604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-97a4f957-6e56-4f5c-bd54-a1a71a1c601e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:12.563246 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 997/1975] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:12 2022] DELETE /identity/v3/projects/ef7ac194856345328a65d0f209d5bfd3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:12.564032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4f957-6e56-4f5c-bd54-a1a71a1c601e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:12.565433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-97a4f957-6e56-4f5c-bd54-a1a71a1c601e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:12.650570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4f957-6e56-4f5c-bd54-a1a71a1c601e tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:12.670143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800bfea-5e39-41c9-b09e-beccb46e1a15 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:12.676548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c213647-1061-473d-871c-2fb2d3aaecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:12.677662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c213647-1061-473d-871c-2fb2d3aaecee admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:12.678060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c213647-1061-473d-871c-2fb2d3aaecee admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:12.678427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c213647-1061-473d-871c-2fb2d3aaecee admin admin] PATH_INFO: `/v3/projects/5fd09a8aa76f4ce2bc232b7403aaa02d/users/c48bca53bf234aa887b344c67c1b285e/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:12.681490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c213647-1061-473d-871c-2fb2d3aaecee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fd09a8aa76f4ce2bc232b7403aaa02d, user_id=c48bca53bf234aa887b344c67c1b285e, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:12.684901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c213647-1061-473d-871c-2fb2d3aaecee admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:12.701037 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 979/1976] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:12 2022] PUT /identity/v3/projects/5fd09a8aa76f4ce2bc232b7403aaa02d/users/c48bca53bf234aa887b344c67c1b285e/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:12.702313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c213647-1061-473d-871c-2fb2d3aaecee admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:12.704983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3c213647-1061-473d-871c-2fb2d3aaecee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:12.732275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc84b8-3c2c-4aab-b192-fde944a0d13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:12.732969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc84b8-3c2c-4aab-b192-fde944a0d13c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:12.733247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc84b8-3c2c-4aab-b192-fde944a0d13c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:12.733517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc84b8-3c2c-4aab-b192-fde944a0d13c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:12.734243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc84b8-3c2c-4aab-b192-fde944a0d13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:12.735920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc84b8-3c2c-4aab-b192-fde944a0d13c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:12.737475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:12.751665 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 998/1977] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:12.753198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f69ad1-d50b-4f44-ab42-5ae8a961f864 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:12.753587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f69ad1-d50b-4f44-ab42-5ae8a961f864 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:12.753844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f69ad1-d50b-4f44-ab42-5ae8a961f864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:12.779889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:12.786234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e6f69ad1-d50b-4f44-ab42-5ae8a961f864 None None] MFA Rules not processed for user `c48bca53bf234aa887b344c67c1b285e`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:12.787817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e6f69ad1-d50b-4f44-ab42-5ae8a961f864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:12.817394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c213647-1061-473d-871c-2fb2d3aaecee admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:12.824081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f3771-0f34-4fad-bea7-fe02e33ac1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:12.825303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f3771-0f34-4fad-bea7-fe02e33ac1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:12.825880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f3771-0f34-4fad-bea7-fe02e33ac1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:12.826299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f3771-0f34-4fad-bea7-fe02e33ac1b3 admin admin] PATH_INFO: `/v3/users/ae79f3d496c7426f99ecc72cdd3e3f46` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:12.827827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f3771-0f34-4fad-bea7-fe02e33ac1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae79f3d496c7426f99ecc72cdd3e3f46)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:12.830736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f3771-0f34-4fad-bea7-fe02e33ac1b3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:12.914101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e49f3771-0f34-4fad-bea7-fe02e33ac1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae79f3d496c7426f99ecc72cdd3e3f46'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:12.923932 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 999/1978] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:12.925220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f69ad1-d50b-4f44-ab42-5ae8a961f864 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:12.936008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e49f3771-0f34-4fad-bea7-fe02e33ac1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae79f3d496c7426f99ecc72cdd3e3f46'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:12.945999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e49f3771-0f34-4fad-bea7-fe02e33ac1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae79f3d496c7426f99ecc72cdd3e3f46'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:12.947194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e49f3771-0f34-4fad-bea7-fe02e33ac1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae79f3d496c7426f99ecc72cdd3e3f46'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:12.947865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f69ad1-d50b-4f44-ab42-5ae8a961f864 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:12.948512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e49f3771-0f34-4fad-bea7-fe02e33ac1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae79f3d496c7426f99ecc72cdd3e3f46'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:12.959978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaf040-49e1-4936-b563-a1b486e57372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:12.961302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaf040-49e1-4936-b563-a1b486e57372 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:12.962776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaf040-49e1-4936-b563-a1b486e57372 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:12.963227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaf040-49e1-4936-b563-a1b486e57372 admin admin] PATH_INFO: `/v3/projects/446ece37fefc42b691a6363aad384dad/users/3b7b2263389245b8b9f172c24f40f84c/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:12.966149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeaf040-49e1-4936-b563-a1b486e57372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=446ece37fefc42b691a6363aad384dad, user_id=3b7b2263389245b8b9f172c24f40f84c, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:12.969626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeaf040-49e1-4936-b563-a1b486e57372 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:12.981070 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 980/1979] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:12 2022] DELETE /identity/v3/users/ae79f3d496c7426f99ecc72cdd3e3f46 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:12.981070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f3771-0f34-4fad-bea7-fe02e33ac1b3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:12.982417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e49f3771-0f34-4fad-bea7-fe02e33ac1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:12.988173 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1000/1980] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:12 2022] PUT /identity/v3/projects/446ece37fefc42b691a6363aad384dad/users/3b7b2263389245b8b9f172c24f40f84c/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:12.989846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437e0d1-4619-4fdf-a409-7e31cf65e92d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:12.990289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437e0d1-4619-4fdf-a409-7e31cf65e92d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:12.990771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437e0d1-4619-4fdf-a409-7e31cf65e92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:13.016391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e437e0d1-4619-4fdf-a409-7e31cf65e92d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:13.018343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e437e0d1-4619-4fdf-a409-7e31cf65e92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:13.086737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f3771-0f34-4fad-bea7-fe02e33ac1b3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:13.095429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec7576-8256-4a02-bfa5-2bcac2ffdc18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:13.096475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec7576-8256-4a02-bfa5-2bcac2ffdc18 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:13.096852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec7576-8256-4a02-bfa5-2bcac2ffdc18 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:13.097222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec7576-8256-4a02-bfa5-2bcac2ffdc18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:13.099672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-50ec7576-8256-4a02-bfa5-2bcac2ffdc18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:13.140957 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1001/1981] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:13.143243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5bbf5-a3ad-45be-b05b-e9392e988a67 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:13.144016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5bbf5-a3ad-45be-b05b-e9392e988a67 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:13.144016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5bbf5-a3ad-45be-b05b-e9392e988a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:13.182203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-58f5bbf5-a3ad-45be-b05b-e9392e988a67 None None] MFA Rules not processed for user `3b7b2263389245b8b9f172c24f40f84c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:13.183497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-58f5bbf5-a3ad-45be-b05b-e9392e988a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:13.197060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:13.221907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec7576-8256-4a02-bfa5-2bcac2ffdc18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:13.223856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec7576-8256-4a02-bfa5-2bcac2ffdc18 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:13.252579 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 981/1982] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:13.256255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec7576-8256-4a02-bfa5-2bcac2ffdc18 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:13.258303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-50ec7576-8256-4a02-bfa5-2bcac2ffdc18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:13.301433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:13.328850 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1002/1983] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:13 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:13.342805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5bbf5-a3ad-45be-b05b-e9392e988a67 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:13.344866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-58f5bbf5-a3ad-45be-b05b-e9392e988a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:13.364837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5bbf5-a3ad-45be-b05b-e9392e988a67 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:13.373252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e0b3c-b7e2-4e95-81fa-1a1efe782e33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:13.374270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e0b3c-b7e2-4e95-81fa-1a1efe782e33 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:13.374920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e0b3c-b7e2-4e95-81fa-1a1efe782e33 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:13.375396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e0b3c-b7e2-4e95-81fa-1a1efe782e33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:13.388598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e0b3c-b7e2-4e95-81fa-1a1efe782e33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:13.390169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec7576-8256-4a02-bfa5-2bcac2ffdc18 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:13.390641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e0b3c-b7e2-4e95-81fa-1a1efe782e33 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:13.395806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d0d96-4864-4267-88cc-9e44aec2c0d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:13.398935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d0d96-4864-4267-88cc-9e44aec2c0d8 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:13.399388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d0d96-4864-4267-88cc-9e44aec2c0d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:13.399809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d0d96-4864-4267-88cc-9e44aec2c0d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:13.412698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d0d96-4864-4267-88cc-9e44aec2c0d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:13.414327 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1003/1984] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:13 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:01:13.415926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d0d96-4864-4267-88cc-9e44aec2c0d8 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:13.439692 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 982/1985] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:13.675639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e0b3c-b7e2-4e95-81fa-1a1efe782e33 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:13.677283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f75e0b3c-b7e2-4e95-81fa-1a1efe782e33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:13.692528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e0b3c-b7e2-4e95-81fa-1a1efe782e33 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:13.697199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fad85-7323-41ee-b841-d88b36e7216c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:13.698105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fad85-7323-41ee-b841-d88b36e7216c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:13.698376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fad85-7323-41ee-b841-d88b36e7216c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:13.698643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fad85-7323-41ee-b841-d88b36e7216c admin admin] PATH_INFO: `/v3/users/e45bf8801c9b469e857ea01159e5dabc` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:13.699849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fad85-7323-41ee-b841-d88b36e7216c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e45bf8801c9b469e857ea01159e5dabc)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:13.701881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fad85-7323-41ee-b841-d88b36e7216c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:13.766220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-495fad85-7323-41ee-b841-d88b36e7216c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e45bf8801c9b469e857ea01159e5dabc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:13.775172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-495fad85-7323-41ee-b841-d88b36e7216c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e45bf8801c9b469e857ea01159e5dabc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:13.775888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-495fad85-7323-41ee-b841-d88b36e7216c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e45bf8801c9b469e857ea01159e5dabc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:13.777090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-495fad85-7323-41ee-b841-d88b36e7216c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e45bf8801c9b469e857ea01159e5dabc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:13.786686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-495fad85-7323-41ee-b841-d88b36e7216c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e45bf8801c9b469e857ea01159e5dabc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:13.812941 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1004/1986] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:13 2022] DELETE /identity/v3/users/e45bf8801c9b469e857ea01159e5dabc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:13.817326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905cd18-4b39-4583-acf0-883d28f50df9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:13.817819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905cd18-4b39-4583-acf0-883d28f50df9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:13.817912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905cd18-4b39-4583-acf0-883d28f50df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:13.835695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e905cd18-4b39-4583-acf0-883d28f50df9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:13.836831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e905cd18-4b39-4583-acf0-883d28f50df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:13.944619 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 983/1987] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:13.954263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fad85-7323-41ee-b841-d88b36e7216c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:13.955961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-495fad85-7323-41ee-b841-d88b36e7216c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:14.037915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fad85-7323-41ee-b841-d88b36e7216c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:14.041702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1bbd4-ed67-4451-8685-045baf23a278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:14.042421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1bbd4-ed67-4451-8685-045baf23a278 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:14.042769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1bbd4-ed67-4451-8685-045baf23a278 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:14.043114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1bbd4-ed67-4451-8685-045baf23a278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:14.053668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1bbd4-ed67-4451-8685-045baf23a278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:14.055238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1bbd4-ed67-4451-8685-045baf23a278 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:14.065241 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1005/1988] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:14.199535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905cd18-4b39-4583-acf0-883d28f50df9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:14.201482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e905cd18-4b39-4583-acf0-883d28f50df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:14.215982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905cd18-4b39-4583-acf0-883d28f50df9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:14.227926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b104e-2dc0-45f4-97dc-af96541c2b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:14.229134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b104e-2dc0-45f4-97dc-af96541c2b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:14.229424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b104e-2dc0-45f4-97dc-af96541c2b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:14.229712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b104e-2dc0-45f4-97dc-af96541c2b6b admin admin] PATH_INFO: `/v3/projects/06035f9f58154f3cafeb6b51a598c2a7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:14.233891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b104e-2dc0-45f4-97dc-af96541c2b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=06035f9f58154f3cafeb6b51a598c2a7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:14.237249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b104e-2dc0-45f4-97dc-af96541c2b6b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:14.278547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1bbd4-ed67-4451-8685-045baf23a278 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:14.280682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d7c1bbd4-ed67-4451-8685-045baf23a278 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:14.299906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1bbd4-ed67-4451-8685-045baf23a278 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:14.306157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaf8ff-5fa5-411d-a36a-0465ece60c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:14.307543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaf8ff-5fa5-411d-a36a-0465ece60c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:14.308208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaf8ff-5fa5-411d-a36a-0465ece60c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:14.308583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaf8ff-5fa5-411d-a36a-0465ece60c57 admin admin] PATH_INFO: `/v3/users/51ad1ac8ea7a4482a7dd7cf531ce5a1d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:14.309973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadaf8ff-5fa5-411d-a36a-0465ece60c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ad1ac8ea7a4482a7dd7cf531ce5a1d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:14.312319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadaf8ff-5fa5-411d-a36a-0465ece60c57 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:14.382851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8b0b104e-2dc0-45f4-97dc-af96541c2b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06035f9f58154f3cafeb6b51a598c2a7', 'request_id': 'req-8b0b104e-2dc0-45f4-97dc-af96541c2b6b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.399346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fadaf8ff-5fa5-411d-a36a-0465ece60c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ad1ac8ea7a4482a7dd7cf531ce5a1d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.402871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8b0b104e-2dc0-45f4-97dc-af96541c2b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06035f9f58154f3cafeb6b51a598c2a7', 'request_id': 'req-8b0b104e-2dc0-45f4-97dc-af96541c2b6b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.404469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:14.419676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8b0b104e-2dc0-45f4-97dc-af96541c2b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06035f9f58154f3cafeb6b51a598c2a7', 'request_id': 'req-8b0b104e-2dc0-45f4-97dc-af96541c2b6b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.431648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fadaf8ff-5fa5-411d-a36a-0465ece60c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ad1ac8ea7a4482a7dd7cf531ce5a1d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.432485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fadaf8ff-5fa5-411d-a36a-0465ece60c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ad1ac8ea7a4482a7dd7cf531ce5a1d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.434058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fadaf8ff-5fa5-411d-a36a-0465ece60c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ad1ac8ea7a4482a7dd7cf531ce5a1d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.441431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8b0b104e-2dc0-45f4-97dc-af96541c2b6b admin admin] The token cache is being invalidate because project 06035f9f58154f3cafeb6b51a598c2a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:14.442125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8b0b104e-2dc0-45f4-97dc-af96541c2b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.443040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8b0b104e-2dc0-45f4-97dc-af96541c2b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.446599 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 984/1989] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:14 2022] DELETE /identity/v3/projects/06035f9f58154f3cafeb6b51a598c2a7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:14.449514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fadaf8ff-5fa5-411d-a36a-0465ece60c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ad1ac8ea7a4482a7dd7cf531ce5a1d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.451937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b104e-2dc0-45f4-97dc-af96541c2b6b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:14.454469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8b0b104e-2dc0-45f4-97dc-af96541c2b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:14.482275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:14.498252 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1006/1990] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:14 2022] DELETE /identity/v3/users/51ad1ac8ea7a4482a7dd7cf531ce5a1d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:01:14.510313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a1ffd-4f87-4a4d-8a6f-80ca52257e43 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:14.515245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a1ffd-4f87-4a4d-8a6f-80ca52257e43 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:14.515572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a1ffd-4f87-4a4d-8a6f-80ca52257e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:14.553311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-cd7a1ffd-4f87-4a4d-8a6f-80ca52257e43 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:14.554920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cd7a1ffd-4f87-4a4d-8a6f-80ca52257e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:14.636490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b104e-2dc0-45f4-97dc-af96541c2b6b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:14.683813 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1007/1991] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:14.684546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a1ffd-4f87-4a4d-8a6f-80ca52257e43 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:14.685874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cd7a1ffd-4f87-4a4d-8a6f-80ca52257e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:14.700821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a1ffd-4f87-4a4d-8a6f-80ca52257e43 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:14.705682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ba06f-500d-4a75-95c1-db4a58177f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:14.706646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ba06f-500d-4a75-95c1-db4a58177f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:14.707154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ba06f-500d-4a75-95c1-db4a58177f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:14.707489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ba06f-500d-4a75-95c1-db4a58177f1e admin admin] PATH_INFO: `/v3/projects/d89b6b5b3969440597c12fb2f216f2d2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:14.708772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ba06f-500d-4a75-95c1-db4a58177f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d89b6b5b3969440597c12fb2f216f2d2)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:14.710940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ba06f-500d-4a75-95c1-db4a58177f1e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:14.721066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579497c-9448-444e-a2e6-6af66e53be3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:14.721981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579497c-9448-444e-a2e6-6af66e53be3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:14.722252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579497c-9448-444e-a2e6-6af66e53be3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:14.722544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579497c-9448-444e-a2e6-6af66e53be3e admin admin] PATH_INFO: `/v3/users/c23e56fcf6b04feda78e462149dd7708` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:14.723737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579497c-9448-444e-a2e6-6af66e53be3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c23e56fcf6b04feda78e462149dd7708)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:14.726005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579497c-9448-444e-a2e6-6af66e53be3e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:14.769365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6a5ba06f-500d-4a75-95c1-db4a58177f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd89b6b5b3969440597c12fb2f216f2d2', 'request_id': 'req-6a5ba06f-500d-4a75-95c1-db4a58177f1e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.787251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6a5ba06f-500d-4a75-95c1-db4a58177f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd89b6b5b3969440597c12fb2f216f2d2', 'request_id': 'req-6a5ba06f-500d-4a75-95c1-db4a58177f1e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.795567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0579497c-9448-444e-a2e6-6af66e53be3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c23e56fcf6b04feda78e462149dd7708'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.796094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6a5ba06f-500d-4a75-95c1-db4a58177f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd89b6b5b3969440597c12fb2f216f2d2', 'request_id': 'req-6a5ba06f-500d-4a75-95c1-db4a58177f1e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.808169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0579497c-9448-444e-a2e6-6af66e53be3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c23e56fcf6b04feda78e462149dd7708'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.810183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6a5ba06f-500d-4a75-95c1-db4a58177f1e admin admin] The token cache is being invalidate because project d89b6b5b3969440597c12fb2f216f2d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:14.811448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6a5ba06f-500d-4a75-95c1-db4a58177f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.812206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6a5ba06f-500d-4a75-95c1-db4a58177f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.814495 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1008/1992] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:14 2022] DELETE /identity/v3/projects/d89b6b5b3969440597c12fb2f216f2d2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:14.815978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a17f4-0315-4a6a-9a84-946bf57d4738 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:14.816414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a17f4-0315-4a6a-9a84-946bf57d4738 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:14.816693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a17f4-0315-4a6a-9a84-946bf57d4738 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:14.819241 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1009/1993] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:14.820270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a17f4-0315-4a6a-9a84-946bf57d4738 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:14.820469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0579497c-9448-444e-a2e6-6af66e53be3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c23e56fcf6b04feda78e462149dd7708'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.821509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0579497c-9448-444e-a2e6-6af66e53be3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c23e56fcf6b04feda78e462149dd7708'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.822274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-be7a17f4-0315-4a6a-9a84-946bf57d4738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:14.822437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0579497c-9448-444e-a2e6-6af66e53be3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c23e56fcf6b04feda78e462149dd7708'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:14.849309 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 985/1994] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:14 2022] DELETE /identity/v3/users/c23e56fcf6b04feda78e462149dd7708 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:14.850792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579497c-9448-444e-a2e6-6af66e53be3e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:14.863211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0579497c-9448-444e-a2e6-6af66e53be3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:14.931890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:14.936593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a17f4-0315-4a6a-9a84-946bf57d4738 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:14.943371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:14.971870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579497c-9448-444e-a2e6-6af66e53be3e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:14.992614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0c709-506c-4b65-b38e-acb1fb9a9b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:14.993926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0c709-506c-4b65-b38e-acb1fb9a9b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:14.994384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0c709-506c-4b65-b38e-acb1fb9a9b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:14.994851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0c709-506c-4b65-b38e-acb1fb9a9b5f admin admin] PATH_INFO: `/v3/users/c48bca53bf234aa887b344c67c1b285e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:14.996473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0c709-506c-4b65-b38e-acb1fb9a9b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c48bca53bf234aa887b344c67c1b285e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:14.998603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0c709-506c-4b65-b38e-acb1fb9a9b5f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:15.032942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4bc43-9aaf-4423-ba2b-a8c390675622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:15.033684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4bc43-9aaf-4423-ba2b-a8c390675622 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:15.033971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4bc43-9aaf-4423-ba2b-a8c390675622 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:15.034267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4bc43-9aaf-4423-ba2b-a8c390675622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:15.037136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8db4bc43-9aaf-4423-ba2b-a8c390675622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:15.063106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4bc43-9aaf-4423-ba2b-a8c390675622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:15.064890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4bc43-9aaf-4423-ba2b-a8c390675622 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:15.086272 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1010/1995] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:15.091937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd94e9-34d7-4e5c-82bd-f73c0d098ffc None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:15.091937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd94e9-34d7-4e5c-82bd-f73c0d098ffc None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:15.091937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd94e9-34d7-4e5c-82bd-f73c0d098ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:15.099382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbc0c709-506c-4b65-b38e-acb1fb9a9b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c48bca53bf234aa887b344c67c1b285e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:15.116737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbc0c709-506c-4b65-b38e-acb1fb9a9b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c48bca53bf234aa887b344c67c1b285e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:15.122875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d9fd94e9-34d7-4e5c-82bd-f73c0d098ffc None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:15.124435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d9fd94e9-34d7-4e5c-82bd-f73c0d098ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:15.136553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbc0c709-506c-4b65-b38e-acb1fb9a9b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c48bca53bf234aa887b344c67c1b285e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:15.138038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbc0c709-506c-4b65-b38e-acb1fb9a9b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c48bca53bf234aa887b344c67c1b285e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:15.139084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbc0c709-506c-4b65-b38e-acb1fb9a9b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c48bca53bf234aa887b344c67c1b285e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:15.184374 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 986/1996] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:14 2022] DELETE /identity/v3/users/c48bca53bf234aa887b344c67c1b285e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:15.233872 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1011/1997] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:01:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:15.289082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0c709-506c-4b65-b38e-acb1fb9a9b5f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:15.291214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fbc0c709-506c-4b65-b38e-acb1fb9a9b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:15.397354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0c709-506c-4b65-b38e-acb1fb9a9b5f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:15.409086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f120421-a296-4eef-9783-a694ef3f1e5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:15.409466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f120421-a296-4eef-9783-a694ef3f1e5c service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:15.409863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f120421-a296-4eef-9783-a694ef3f1e5c service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:15.410435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f120421-a296-4eef-9783-a694ef3f1e5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:15.423175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f120421-a296-4eef-9783-a694ef3f1e5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:15.426219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f120421-a296-4eef-9783-a694ef3f1e5c service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:15.442707 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 987/1998] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:15.633444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd94e9-34d7-4e5c-82bd-f73c0d098ffc None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:15.637408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d9fd94e9-34d7-4e5c-82bd-f73c0d098ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:15.658247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd94e9-34d7-4e5c-82bd-f73c0d098ffc None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:15.803631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4df1b6-98be-4031-af21-993a851a8472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:15.804580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4df1b6-98be-4031-af21-993a851a8472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:15.804899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4df1b6-98be-4031-af21-993a851a8472 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:15.805177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4df1b6-98be-4031-af21-993a851a8472 admin admin] PATH_INFO: `/v3/projects/8e2c755f798b4c5da16d019753deb482` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:15.807569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4df1b6-98be-4031-af21-993a851a8472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e2c755f798b4c5da16d019753deb482)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:15.810181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4df1b6-98be-4031-af21-993a851a8472 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:15.886058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:15.893847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6c4df1b6-98be-4031-af21-993a851a8472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e2c755f798b4c5da16d019753deb482', 'request_id': 'req-6c4df1b6-98be-4031-af21-993a851a8472'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:15.908157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6c4df1b6-98be-4031-af21-993a851a8472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e2c755f798b4c5da16d019753deb482', 'request_id': 'req-6c4df1b6-98be-4031-af21-993a851a8472'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:15.923122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6c4df1b6-98be-4031-af21-993a851a8472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e2c755f798b4c5da16d019753deb482', 'request_id': 'req-6c4df1b6-98be-4031-af21-993a851a8472'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:15.949589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6c4df1b6-98be-4031-af21-993a851a8472 admin admin] The token cache is being invalidate because project 8e2c755f798b4c5da16d019753deb482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:15.950261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6c4df1b6-98be-4031-af21-993a851a8472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:15.951193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6c4df1b6-98be-4031-af21-993a851a8472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:15.957979 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1012/1999] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:15 2022] DELETE /identity/v3/projects/8e2c755f798b4c5da16d019753deb482 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:15.960607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe44b0d-19d3-4a2f-b8d0-5efd75c863b8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:15.961092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe44b0d-19d3-4a2f-b8d0-5efd75c863b8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:15.961217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe44b0d-19d3-4a2f-b8d0-5efd75c863b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:15.999531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4df1b6-98be-4031-af21-993a851a8472 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:16.000068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3fe44b0d-19d3-4a2f-b8d0-5efd75c863b8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:16.001284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6c4df1b6-98be-4031-af21-993a851a8472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:16.001403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3fe44b0d-19d3-4a2f-b8d0-5efd75c863b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:16.062154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:16.110834 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 988/2000] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:16.112169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe44b0d-19d3-4a2f-b8d0-5efd75c863b8 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:16.114157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3fe44b0d-19d3-4a2f-b8d0-5efd75c863b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:16.138140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe44b0d-19d3-4a2f-b8d0-5efd75c863b8 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:16.147483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf7531-7876-43d8-b64b-17b812958a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:16.148718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf7531-7876-43d8-b64b-17b812958a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:16.149882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf7531-7876-43d8-b64b-17b812958a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:16.150371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf7531-7876-43d8-b64b-17b812958a8b admin admin] PATH_INFO: `/v3/projects/5fd09a8aa76f4ce2bc232b7403aaa02d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:16.152401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf7531-7876-43d8-b64b-17b812958a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fd09a8aa76f4ce2bc232b7403aaa02d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:16.161007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4df1b6-98be-4031-af21-993a851a8472 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:16.168335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f325a-d8ec-462f-8d21-5103d0a7f7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:16.169785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f325a-d8ec-462f-8d21-5103d0a7f7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:16.170064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f325a-d8ec-462f-8d21-5103d0a7f7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:16.170502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f325a-d8ec-462f-8d21-5103d0a7f7d0 admin admin] PATH_INFO: `/v3/projects/35d44a2b124348dcb3dd5411e6acf5a0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:16.172662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f325a-d8ec-462f-8d21-5103d0a7f7d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d44a2b124348dcb3dd5411e6acf5a0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:16.174670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf7531-7876-43d8-b64b-17b812958a8b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:16.179323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f325a-d8ec-462f-8d21-5103d0a7f7d0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:16.254455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bfcf7531-7876-43d8-b64b-17b812958a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fd09a8aa76f4ce2bc232b7403aaa02d', 'request_id': 'req-bfcf7531-7876-43d8-b64b-17b812958a8b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:16.258974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e35f325a-d8ec-462f-8d21-5103d0a7f7d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d44a2b124348dcb3dd5411e6acf5a0', 'request_id': 'req-e35f325a-d8ec-462f-8d21-5103d0a7f7d0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:16.266639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bfcf7531-7876-43d8-b64b-17b812958a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fd09a8aa76f4ce2bc232b7403aaa02d', 'request_id': 'req-bfcf7531-7876-43d8-b64b-17b812958a8b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:16.273712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e35f325a-d8ec-462f-8d21-5103d0a7f7d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d44a2b124348dcb3dd5411e6acf5a0', 'request_id': 'req-e35f325a-d8ec-462f-8d21-5103d0a7f7d0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:16.274880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bfcf7531-7876-43d8-b64b-17b812958a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fd09a8aa76f4ce2bc232b7403aaa02d', 'request_id': 'req-bfcf7531-7876-43d8-b64b-17b812958a8b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:16.288366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e35f325a-d8ec-462f-8d21-5103d0a7f7d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d44a2b124348dcb3dd5411e6acf5a0', 'request_id': 'req-e35f325a-d8ec-462f-8d21-5103d0a7f7d0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:16.302364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bfcf7531-7876-43d8-b64b-17b812958a8b admin admin] The token cache is being invalidate because project 5fd09a8aa76f4ce2bc232b7403aaa02d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:16.302683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bfcf7531-7876-43d8-b64b-17b812958a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:16.303713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bfcf7531-7876-43d8-b64b-17b812958a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:16.306568 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 989/2001] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:16 2022] DELETE /identity/v3/projects/5fd09a8aa76f4ce2bc232b7403aaa02d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:16.310325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e35f325a-d8ec-462f-8d21-5103d0a7f7d0 admin admin] The token cache is being invalidate because project 35d44a2b124348dcb3dd5411e6acf5a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:16.310325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e35f325a-d8ec-462f-8d21-5103d0a7f7d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:16.310603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6133497-f43c-4e63-91b4-ff23b4eaf30f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:16.310603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6133497-f43c-4e63-91b4-ff23b4eaf30f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:16.310603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6133497-f43c-4e63-91b4-ff23b4eaf30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:16.311386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e35f325a-d8ec-462f-8d21-5103d0a7f7d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:16.316893 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1013/2002] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:15 2022] DELETE /identity/v3/projects/35d44a2b124348dcb3dd5411e6acf5a0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:16.316893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a017e7-d1a1-4fc2-87eb-85e07958aa02 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:16.317130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a017e7-d1a1-4fc2-87eb-85e07958aa02 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:16.317350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a017e7-d1a1-4fc2-87eb-85e07958aa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:16.342441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d6133497-f43c-4e63-91b4-ff23b4eaf30f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:16.344251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d6133497-f43c-4e63-91b4-ff23b4eaf30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:16.346957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-33a017e7-d1a1-4fc2-87eb-85e07958aa02 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:16.348270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-33a017e7-d1a1-4fc2-87eb-85e07958aa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:16.424640 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 990/2003] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:16.424640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6133497-f43c-4e63-91b4-ff23b4eaf30f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:16.424640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d6133497-f43c-4e63-91b4-ff23b4eaf30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:16.437749 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1014/2004] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:16.445271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6133497-f43c-4e63-91b4-ff23b4eaf30f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:16.445377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a017e7-d1a1-4fc2-87eb-85e07958aa02 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:16.448852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc282d46-15c8-4a5d-972f-578e20302b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:16.449813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc282d46-15c8-4a5d-972f-578e20302b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:16.450098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc282d46-15c8-4a5d-972f-578e20302b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:16.450375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc282d46-15c8-4a5d-972f-578e20302b58 admin admin] PATH_INFO: `/v3/users/3b7b2263389245b8b9f172c24f40f84c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:16.450799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:16.451634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc282d46-15c8-4a5d-972f-578e20302b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7b2263389245b8b9f172c24f40f84c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:16.454681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc282d46-15c8-4a5d-972f-578e20302b58 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:16.457787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a017e7-d1a1-4fc2-87eb-85e07958aa02 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:16.467618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57c8f5-51b2-4890-a98f-2356951b7e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:16.468414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57c8f5-51b2-4890-a98f-2356951b7e27 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:16.468710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57c8f5-51b2-4890-a98f-2356951b7e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:16.469168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57c8f5-51b2-4890-a98f-2356951b7e27 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:16.470570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57c8f5-51b2-4890-a98f-2356951b7e27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:16.471084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57c8f5-51b2-4890-a98f-2356951b7e27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:16.473803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57c8f5-51b2-4890-a98f-2356951b7e27 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:16.492875 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1015/2005] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:16.492875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38474eff-aa4e-4ae4-a26c-4482df357824 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:16.492875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38474eff-aa4e-4ae4-a26c-4482df357824 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:16.492875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38474eff-aa4e-4ae4-a26c-4482df357824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:16.512547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-38474eff-aa4e-4ae4-a26c-4482df357824 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:16.513773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-38474eff-aa4e-4ae4-a26c-4482df357824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:16.522659 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1016/2006] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:16.523482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38474eff-aa4e-4ae4-a26c-4482df357824 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:16.528241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dc282d46-15c8-4a5d-972f-578e20302b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7b2263389245b8b9f172c24f40f84c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:16.537747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38474eff-aa4e-4ae4-a26c-4482df357824 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:16.543093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dc282d46-15c8-4a5d-972f-578e20302b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7b2263389245b8b9f172c24f40f84c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:16.545120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99fdcf-5a30-4efb-b5b3-ec1cac5c4a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:16.546458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99fdcf-5a30-4efb-b5b3-ec1cac5c4a2e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:16.546818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99fdcf-5a30-4efb-b5b3-ec1cac5c4a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:16.547189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99fdcf-5a30-4efb-b5b3-ec1cac5c4a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:16.549679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99fdcf-5a30-4efb-b5b3-ec1cac5c4a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:16.551994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99fdcf-5a30-4efb-b5b3-ec1cac5c4a2e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:16.554886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dc282d46-15c8-4a5d-972f-578e20302b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7b2263389245b8b9f172c24f40f84c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:16.555761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dc282d46-15c8-4a5d-972f-578e20302b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7b2263389245b8b9f172c24f40f84c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:16.556637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dc282d46-15c8-4a5d-972f-578e20302b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7b2263389245b8b9f172c24f40f84c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:16.558452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:16.580947 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 991/2007] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:16 2022] DELETE /identity/v3/users/3b7b2263389245b8b9f172c24f40f84c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:16.582115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc282d46-15c8-4a5d-972f-578e20302b58 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:16.583640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dc282d46-15c8-4a5d-972f-578e20302b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:16.593918 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1017/2008] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:16 2022] POST /identity/v3/projects => generated 393 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:16.598459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99fdcf-5a30-4efb-b5b3-ec1cac5c4a2e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:16.600734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8b99fdcf-5a30-4efb-b5b3-ec1cac5c4a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:16.677837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc282d46-15c8-4a5d-972f-578e20302b58 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:16.683478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99fdcf-5a30-4efb-b5b3-ec1cac5c4a2e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:16.693995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a79e8-2ef3-4cd3-97a8-2d172ad60b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:16.694776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da229c-3e0b-4d8f-822c-528d67263550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:16.695290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a79e8-2ef3-4cd3-97a8-2d172ad60b9b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:16.695698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da229c-3e0b-4d8f-822c-528d67263550 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:16.695866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a79e8-2ef3-4cd3-97a8-2d172ad60b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:16.696295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da229c-3e0b-4d8f-822c-528d67263550 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:16.696456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a79e8-2ef3-4cd3-97a8-2d172ad60b9b admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:16.696869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da229c-3e0b-4d8f-822c-528d67263550 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:16.697550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a79e8-2ef3-4cd3-97a8-2d172ad60b9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:16.697906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da229c-3e0b-4d8f-822c-528d67263550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:16.698208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a79e8-2ef3-4cd3-97a8-2d172ad60b9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:16.700794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da229c-3e0b-4d8f-822c-528d67263550 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:16.701724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a79e8-2ef3-4cd3-97a8-2d172ad60b9b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:16.729207 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 992/2009] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:16.732235 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1018/2010] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:16 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:01:16.733409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a79e8-2ef3-4cd3-97a8-2d172ad60b9b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:16.736881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da229c-3e0b-4d8f-822c-528d67263550 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:16.756997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da229c-3e0b-4d8f-822c-528d67263550 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:16.758186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a79e8-2ef3-4cd3-97a8-2d172ad60b9b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:16.764872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29faf7-b43d-406b-84f7-762fa213ba2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:16.765819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29faf7-b43d-406b-84f7-762fa213ba2c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:16.766263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29faf7-b43d-406b-84f7-762fa213ba2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:16.766755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29faf7-b43d-406b-84f7-762fa213ba2c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:16.767631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29faf7-b43d-406b-84f7-762fa213ba2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:16.768531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fee18-669e-4bbc-bc45-e336c3b29a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:16.770195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29faf7-b43d-406b-84f7-762fa213ba2c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:16.773140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fee18-669e-4bbc-bc45-e336c3b29a87 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:16.773725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fee18-669e-4bbc-bc45-e336c3b29a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:16.778361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fee18-669e-4bbc-bc45-e336c3b29a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:16.779274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52fee18-669e-4bbc-bc45-e336c3b29a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:16.782304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52fee18-669e-4bbc-bc45-e336c3b29a87 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:16.794074 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1019/2011] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:01:16.797976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29faf7-b43d-406b-84f7-762fa213ba2c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:16.819444 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 993/2012] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:16 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:16.820702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29faf7-b43d-406b-84f7-762fa213ba2c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:16.823859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fee18-669e-4bbc-bc45-e336c3b29a87 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:16.916085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cd7df-d21e-417e-a4b1-bcbf36cadb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:16.917199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cd7df-d21e-417e-a4b1-bcbf36cadb79 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:16.917507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cd7df-d21e-417e-a4b1-bcbf36cadb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:16.918007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324cd7df-d21e-417e-a4b1-bcbf36cadb79 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:16.918746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cd7df-d21e-417e-a4b1-bcbf36cadb79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:16.920427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324cd7df-d21e-417e-a4b1-bcbf36cadb79 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:16.938983 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1020/2013] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:16.941422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cd7df-d21e-417e-a4b1-bcbf36cadb79 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:16.947122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fee18-669e-4bbc-bc45-e336c3b29a87 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:16.953338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20cfb6-e546-462d-b8b5-42e74891e232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:16.954314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20cfb6-e546-462d-b8b5-42e74891e232 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:16.954614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20cfb6-e546-462d-b8b5-42e74891e232 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:16.954927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20cfb6-e546-462d-b8b5-42e74891e232 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:16.955666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20cfb6-e546-462d-b8b5-42e74891e232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:16.958516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20cfb6-e546-462d-b8b5-42e74891e232 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:16.970482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324cd7df-d21e-417e-a4b1-bcbf36cadb79 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:16.977051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8434e-d739-4336-a1c9-1155c3082548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:16.978688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8434e-d739-4336-a1c9-1155c3082548 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:16.979063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8434e-d739-4336-a1c9-1155c3082548 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:16.980149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8434e-d739-4336-a1c9-1155c3082548 admin admin] PATH_INFO: `/v3/projects/618d91601a8c4d7194194033be0be5c6/users/123d7b542a8443a192f2f89d05cebbb6/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:17.003199 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 994/2014] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:16 2022] POST /identity/v3/users => generated 291 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:01:17.004092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20cfb6-e546-462d-b8b5-42e74891e232 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:17.006300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dd20cfb6-e546-462d-b8b5-42e74891e232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:17.015322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8434e-d739-4336-a1c9-1155c3082548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=618d91601a8c4d7194194033be0be5c6, user_id=123d7b542a8443a192f2f89d05cebbb6, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:17.018560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8434e-d739-4336-a1c9-1155c3082548 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:17.023520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20cfb6-e546-462d-b8b5-42e74891e232 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:17.029451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5c6ea-437d-43d3-bb2e-cd31e0dd431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:17.030341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5c6ea-437d-43d3-bb2e-cd31e0dd431a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:17.031309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5c6ea-437d-43d3-bb2e-cd31e0dd431a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:17.031309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5c6ea-437d-43d3-bb2e-cd31e0dd431a admin admin] PATH_INFO: `/v3/projects/446ece37fefc42b691a6363aad384dad` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:17.032255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5c6ea-437d-43d3-bb2e-cd31e0dd431a admin admin] RBAC: Authorizing `identity:delete_project(project_id=446ece37fefc42b691a6363aad384dad)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:17.034252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5c6ea-437d-43d3-bb2e-cd31e0dd431a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:17.038762 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1021/2015] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:16 2022] PUT /identity/v3/projects/618d91601a8c4d7194194033be0be5c6/users/123d7b542a8443a192f2f89d05cebbb6/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:17.039675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8434e-d739-4336-a1c9-1155c3082548 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:17.072100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:17.115492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:17.140434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4fc5c6ea-437d-43d3-bb2e-cd31e0dd431a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '446ece37fefc42b691a6363aad384dad', 'request_id': 'req-4fc5c6ea-437d-43d3-bb2e-cd31e0dd431a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:17.150447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4fc5c6ea-437d-43d3-bb2e-cd31e0dd431a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '446ece37fefc42b691a6363aad384dad', 'request_id': 'req-4fc5c6ea-437d-43d3-bb2e-cd31e0dd431a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:17.158260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4fc5c6ea-437d-43d3-bb2e-cd31e0dd431a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '446ece37fefc42b691a6363aad384dad', 'request_id': 'req-4fc5c6ea-437d-43d3-bb2e-cd31e0dd431a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:17.160283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8434e-d739-4336-a1c9-1155c3082548 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:17.182437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4fc5c6ea-437d-43d3-bb2e-cd31e0dd431a admin admin] The token cache is being invalidate because project 446ece37fefc42b691a6363aad384dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:17.183560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4fc5c6ea-437d-43d3-bb2e-cd31e0dd431a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:17.185011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4fc5c6ea-437d-43d3-bb2e-cd31e0dd431a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:17.187802 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 995/2016] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:17 2022] DELETE /identity/v3/projects/446ece37fefc42b691a6363aad384dad => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:17.189613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefd899-4bea-4746-af62-963aed2c43dd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:17.190117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefd899-4bea-4746-af62-963aed2c43dd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:17.190622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefd899-4bea-4746-af62-963aed2c43dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:17.236227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e74c8-0821-4645-8a0e-05fab299a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:17.237288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e74c8-0821-4645-8a0e-05fab299a0dc admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:17.237747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e74c8-0821-4645-8a0e-05fab299a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:17.238028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e74c8-0821-4645-8a0e-05fab299a0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:17.238863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e74c8-0821-4645-8a0e-05fab299a0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:17.242382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e74c8-0821-4645-8a0e-05fab299a0dc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:17.257317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1cefd899-4bea-4746-af62-963aed2c43dd None None] MFA Rules not processed for user `123d7b542a8443a192f2f89d05cebbb6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:17.260308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1cefd899-4bea-4746-af62-963aed2c43dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:17.260565 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1022/2017] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:17.262513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b61788-135a-41d6-b98f-d8f68190e4fe None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:17.263028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b61788-135a-41d6-b98f-d8f68190e4fe None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:17.263472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b61788-135a-41d6-b98f-d8f68190e4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:17.289305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e4b61788-135a-41d6-b98f-d8f68190e4fe None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:17.290807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e4b61788-135a-41d6-b98f-d8f68190e4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:17.306913 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1023/2018] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:17.306913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b61788-135a-41d6-b98f-d8f68190e4fe None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:17.306913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e4b61788-135a-41d6-b98f-d8f68190e4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:17.323134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b61788-135a-41d6-b98f-d8f68190e4fe None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:17.329526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a298b-fdc9-427b-aed7-9c798e11bc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:17.330235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a298b-fdc9-427b-aed7-9c798e11bc77 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:17.330517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a298b-fdc9-427b-aed7-9c798e11bc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:17.330842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a298b-fdc9-427b-aed7-9c798e11bc77 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:17.331523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a298b-fdc9-427b-aed7-9c798e11bc77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:17.333619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a298b-fdc9-427b-aed7-9c798e11bc77 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:17.361177 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1024/2019] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:17.363216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc7a3e-ac25-409b-90c6-511771821c83 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:17.363510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc7a3e-ac25-409b-90c6-511771821c83 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:17.363790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc7a3e-ac25-409b-90c6-511771821c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:17.389034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-77bc7a3e-ac25-409b-90c6-511771821c83 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:17.390757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-77bc7a3e-ac25-409b-90c6-511771821c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:17.399865 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 996/2020] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:17.404412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefd899-4bea-4746-af62-963aed2c43dd None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:17.406297 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1025/2021] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:17.407387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc7a3e-ac25-409b-90c6-511771821c83 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:17.409300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-77bc7a3e-ac25-409b-90c6-511771821c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:17.423726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc7a3e-ac25-409b-90c6-511771821c83 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:17.430067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a24743-99d4-4524-8416-36af4ae34fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:17.431566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a24743-99d4-4524-8416-36af4ae34fce admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:17.432076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a24743-99d4-4524-8416-36af4ae34fce admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:17.432895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a24743-99d4-4524-8416-36af4ae34fce admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:17.433803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a24743-99d4-4524-8416-36af4ae34fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:17.436140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a24743-99d4-4524-8416-36af4ae34fce admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:17.436442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefd899-4bea-4746-af62-963aed2c43dd None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:17.454779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b171f41-8fba-4778-99a4-dce12b711206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:17.456260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b171f41-8fba-4778-99a4-dce12b711206 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:17.456545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b171f41-8fba-4778-99a4-dce12b711206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:17.456826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b171f41-8fba-4778-99a4-dce12b711206 admin admin] PATH_INFO: `/v3/projects/2f742f03e6c14260b98b00f5c13438f0/users/4ce2e8e17cd74914b0c5391443f6d3ec/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:17.481479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b171f41-8fba-4778-99a4-dce12b711206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f742f03e6c14260b98b00f5c13438f0, user_id=4ce2e8e17cd74914b0c5391443f6d3ec, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:17.484343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b171f41-8fba-4778-99a4-dce12b711206 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:17.489862 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1026/2022] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:17 2022] POST /identity/v3/projects => generated 393 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:17.491430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a24743-99d4-4524-8416-36af4ae34fce admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:17.505097 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 997/2023] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:17 2022] PUT /identity/v3/projects/2f742f03e6c14260b98b00f5c13438f0/users/4ce2e8e17cd74914b0c5391443f6d3ec/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:17.505748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b171f41-8fba-4778-99a4-dce12b711206 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:17.583933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a24743-99d4-4524-8416-36af4ae34fce admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:17.602414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:17.615738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b171f41-8fba-4778-99a4-dce12b711206 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:17.626697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9ada5-4c28-49bc-b711-f8642ae121fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:17.628880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9ada5-4c28-49bc-b711-f8642ae121fe admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:17.629362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9ada5-4c28-49bc-b711-f8642ae121fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:17.630069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9ada5-4c28-49bc-b711-f8642ae121fe admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:17.632349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9ada5-4c28-49bc-b711-f8642ae121fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:17.634926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9ada5-4c28-49bc-b711-f8642ae121fe admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:17.663318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89a4b6-0e4d-4953-98a3-616742df182c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:17.664357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89a4b6-0e4d-4953-98a3-616742df182c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:17.664771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89a4b6-0e4d-4953-98a3-616742df182c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:17.665134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89a4b6-0e4d-4953-98a3-616742df182c admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:17.666535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89a4b6-0e4d-4953-98a3-616742df182c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:17.666935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89a4b6-0e4d-4953-98a3-616742df182c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:17.669300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89a4b6-0e4d-4953-98a3-616742df182c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:17.679983 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 998/2024] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:17 2022] POST /identity/v3/users => generated 303 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:17.682335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7478edd-329e-4c6a-a523-42420a6a3a42 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:17.685760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7478edd-329e-4c6a-a523-42420a6a3a42 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:17.686787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7478edd-329e-4c6a-a523-42420a6a3a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:17.690621 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1027/2025] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:17.690621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89a4b6-0e4d-4953-98a3-616742df182c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:17.708860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89a4b6-0e4d-4953-98a3-616742df182c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:17.714291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3aa43-a4ae-4dce-85a0-eede67caa7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:17.715271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3aa43-a4ae-4dce-85a0-eede67caa7ca admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:17.715694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3aa43-a4ae-4dce-85a0-eede67caa7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:17.716104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3aa43-a4ae-4dce-85a0-eede67caa7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:17.717245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3aa43-a4ae-4dce-85a0-eede67caa7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:17.719010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3aa43-a4ae-4dce-85a0-eede67caa7ca admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:17.732217 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1028/2026] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:17.732217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3aa43-a4ae-4dce-85a0-eede67caa7ca admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:17.747785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3aa43-a4ae-4dce-85a0-eede67caa7ca admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:17.759207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffce23-0232-4bca-b484-b32fbf71afb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:17.760193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffce23-0232-4bca-b484-b32fbf71afb9 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:17.760631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffce23-0232-4bca-b484-b32fbf71afb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:17.761052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffce23-0232-4bca-b484-b32fbf71afb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:17.761680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b7478edd-329e-4c6a-a523-42420a6a3a42 None None] MFA Rules not processed for user `4ce2e8e17cd74914b0c5391443f6d3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:17.762080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffce23-0232-4bca-b484-b32fbf71afb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:17.763266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b7478edd-329e-4c6a-a523-42420a6a3a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:17.766212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccffce23-0232-4bca-b484-b32fbf71afb9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:17.779530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:17.811534 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1029/2027] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:17 2022] POST /identity/v3/projects => generated 407 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:17.812960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffce23-0232-4bca-b484-b32fbf71afb9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:17.899879 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 999/2028] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:17.905129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7478edd-329e-4c6a-a523-42420a6a3a42 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:17.921952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7478edd-329e-4c6a-a523-42420a6a3a42 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:17.929496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37396c4-25d4-4be1-a8bf-5c4b4b975ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:17.930283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37396c4-25d4-4be1-a8bf-5c4b4b975ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:17.930632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37396c4-25d4-4be1-a8bf-5c4b4b975ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:17.931039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37396c4-25d4-4be1-a8bf-5c4b4b975ba1 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:17.931153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffce23-0232-4bca-b484-b32fbf71afb9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:17.931877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37396c4-25d4-4be1-a8bf-5c4b4b975ba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:17.934783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37396c4-25d4-4be1-a8bf-5c4b4b975ba1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:17.938015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ea42e-adda-42bc-a60b-6b034479fac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:17.939127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ea42e-adda-42bc-a60b-6b034479fac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:17.939412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ea42e-adda-42bc-a60b-6b034479fac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:17.939808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ea42e-adda-42bc-a60b-6b034479fac0 admin admin] PATH_INFO: `/v3/projects/d5b549171ddb47118c3c564da1fe6467/users/50d1ebfc28054ff3a3e437666a17be0e/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:17.977928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ea42e-adda-42bc-a60b-6b034479fac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b549171ddb47118c3c564da1fe6467, user_id=50d1ebfc28054ff3a3e437666a17be0e, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:17.982995 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1000/2029] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:17 2022] POST /identity/v3/users => generated 304 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:17.982995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37396c4-25d4-4be1-a8bf-5c4b4b975ba1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:17.983190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ea42e-adda-42bc-a60b-6b034479fac0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:18.007216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37396c4-25d4-4be1-a8bf-5c4b4b975ba1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:18.012365 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1030/2030] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:17 2022] PUT /identity/v3/projects/d5b549171ddb47118c3c564da1fe6467/users/50d1ebfc28054ff3a3e437666a17be0e/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:18.013241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ea42e-adda-42bc-a60b-6b034479fac0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:18.095905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a707f9-ed64-47ca-9669-f4effdf00f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:18.096939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a707f9-ed64-47ca-9669-f4effdf00f03 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:18.097084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a707f9-ed64-47ca-9669-f4effdf00f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:18.097441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a707f9-ed64-47ca-9669-f4effdf00f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:18.098227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a707f9-ed64-47ca-9669-f4effdf00f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:18.100402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a707f9-ed64-47ca-9669-f4effdf00f03 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:18.110289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ea42e-adda-42bc-a60b-6b034479fac0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:18.121304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7757aa9-a14f-4737-a09d-e78d126b0626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:18.121994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7757aa9-a14f-4737-a09d-e78d126b0626 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:18.122281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7757aa9-a14f-4737-a09d-e78d126b0626 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:18.122710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7757aa9-a14f-4737-a09d-e78d126b0626 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:18.123936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7757aa9-a14f-4737-a09d-e78d126b0626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:18.125109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7757aa9-a14f-4737-a09d-e78d126b0626 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:18.128463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:18.140396 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1001/2031] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:17 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:18.141218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a707f9-ed64-47ca-9669-f4effdf00f03 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:18.152247 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1031/2032] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:18.153189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7757aa9-a14f-4737-a09d-e78d126b0626 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:18.169695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7757aa9-a14f-4737-a09d-e78d126b0626 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:18.287474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a707f9-ed64-47ca-9669-f4effdf00f03 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:18.300273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61a5cf-e9c0-401c-8b5f-0ee55635be8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:18.301151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61a5cf-e9c0-401c-8b5f-0ee55635be8b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:18.301527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61a5cf-e9c0-401c-8b5f-0ee55635be8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:18.301936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61a5cf-e9c0-401c-8b5f-0ee55635be8b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:18.302810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61a5cf-e9c0-401c-8b5f-0ee55635be8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:18.305946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61a5cf-e9c0-401c-8b5f-0ee55635be8b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:18.314820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471abd90-002a-408c-9bac-22c53f388e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:18.316522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471abd90-002a-408c-9bac-22c53f388e42 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:18.316974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471abd90-002a-408c-9bac-22c53f388e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:18.317136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471abd90-002a-408c-9bac-22c53f388e42 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:18.317971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471abd90-002a-408c-9bac-22c53f388e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:18.320136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471abd90-002a-408c-9bac-22c53f388e42 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:18.320352 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1002/2033] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:18.323563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61a5cf-e9c0-401c-8b5f-0ee55635be8b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:18.347071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61a5cf-e9c0-401c-8b5f-0ee55635be8b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:18.354835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb59714-4c8b-45c9-add3-232bd038dcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:18.355871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb59714-4c8b-45c9-add3-232bd038dcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:18.356596 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1032/2034] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:18 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:18.357037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb59714-4c8b-45c9-add3-232bd038dcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:18.357460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471abd90-002a-408c-9bac-22c53f388e42 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:18.357740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb59714-4c8b-45c9-add3-232bd038dcb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:18.358673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb59714-4c8b-45c9-add3-232bd038dcb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:18.361122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb59714-4c8b-45c9-add3-232bd038dcb1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:18.372129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471abd90-002a-408c-9bac-22c53f388e42 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:18.378369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adfd86-340c-464b-a6d7-5a2e093db142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:18.379682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adfd86-340c-464b-a6d7-5a2e093db142 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:18.380250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adfd86-340c-464b-a6d7-5a2e093db142 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:18.380725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adfd86-340c-464b-a6d7-5a2e093db142 admin admin] PATH_INFO: `/v3/projects/d5b549171ddb47118c3c564da1fe6467/users/50d1ebfc28054ff3a3e437666a17be0e/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:18.381787 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1003/2035] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:18.382721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb59714-4c8b-45c9-add3-232bd038dcb1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:18.385390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adfd86-340c-464b-a6d7-5a2e093db142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b549171ddb47118c3c564da1fe6467, user_id=50d1ebfc28054ff3a3e437666a17be0e, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:18.387891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:18.389832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adfd86-340c-464b-a6d7-5a2e093db142 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:18.393851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb59714-4c8b-45c9-add3-232bd038dcb1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:18.404184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87572f64-635a-43d8-8722-ffc41aef52b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:18.404888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87572f64-635a-43d8-8722-ffc41aef52b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:18.405286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87572f64-635a-43d8-8722-ffc41aef52b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:18.405667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87572f64-635a-43d8-8722-ffc41aef52b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:18.406578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87572f64-635a-43d8-8722-ffc41aef52b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:18.408430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87572f64-635a-43d8-8722-ffc41aef52b1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:18.426823 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1004/2037] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:18.426823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87572f64-635a-43d8-8722-ffc41aef52b1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:18.427885 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1033/2037] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:18 2022] PUT /identity/v3/projects/d5b549171ddb47118c3c564da1fe6467/users/50d1ebfc28054ff3a3e437666a17be0e/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:18.429839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adfd86-340c-464b-a6d7-5a2e093db142 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:18.441912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87572f64-635a-43d8-8722-ffc41aef52b1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:18.530778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a6b3a-e6ff-43ad-a50b-fa283366b0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:18.532901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a6b3a-e6ff-43ad-a50b-fa283366b0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:18.534522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a6b3a-e6ff-43ad-a50b-fa283366b0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:18.535013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a6b3a-e6ff-43ad-a50b-fa283366b0c3 admin admin] PATH_INFO: `/v3/projects/f0efa15c4f2142fc8b52e69b09614d9c/users/50529fed2cef428bbbf096c0de327e8f/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:18.563346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a6b3a-e6ff-43ad-a50b-fa283366b0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0efa15c4f2142fc8b52e69b09614d9c, user_id=50529fed2cef428bbbf096c0de327e8f, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:18.564142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adfd86-340c-464b-a6d7-5a2e093db142 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:18.566724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a6b3a-e6ff-43ad-a50b-fa283366b0c3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:18.577551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad142b-e886-421b-993d-a1bc498968a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:18.579594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad142b-e886-421b-993d-a1bc498968a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:18.579877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad142b-e886-421b-993d-a1bc498968a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:18.581576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad142b-e886-421b-993d-a1bc498968a5 admin admin] PATH_INFO: `/v3/projects/a1e2efb2af3f48f19c4753e0334144d2/users/53d9c508420a4fb3ae0d932eb8f87173/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:18.589084 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1005/2038] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:18 2022] PUT /identity/v3/projects/f0efa15c4f2142fc8b52e69b09614d9c/users/50529fed2cef428bbbf096c0de327e8f/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:18.590755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c00ca-0184-4ffc-8310-6ef41ef7c502 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:18.591185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c00ca-0184-4ffc-8310-6ef41ef7c502 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:18.591602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c00ca-0184-4ffc-8310-6ef41ef7c502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:18.607733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad142b-e886-421b-993d-a1bc498968a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e2efb2af3f48f19c4753e0334144d2, user_id=53d9c508420a4fb3ae0d932eb8f87173, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:18.610482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad142b-e886-421b-993d-a1bc498968a5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:18.635826 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1034/2039] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:18 2022] PUT /identity/v3/projects/a1e2efb2af3f48f19c4753e0334144d2/users/53d9c508420a4fb3ae0d932eb8f87173/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:18.637153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfc127-1da9-4490-abad-d0717c457760 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:18.637435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfc127-1da9-4490-abad-d0717c457760 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:18.637705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfc127-1da9-4490-abad-d0717c457760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:18.640086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-cc2c00ca-0184-4ffc-8310-6ef41ef7c502 None None] MFA Rules not processed for user `50d1ebfc28054ff3a3e437666a17be0e`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:18.646132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cc2c00ca-0184-4ffc-8310-6ef41ef7c502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:18.674959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d3dfc127-1da9-4490-abad-d0717c457760 None None] MFA Rules not processed for user `50529fed2cef428bbbf096c0de327e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:18.677470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d3dfc127-1da9-4490-abad-d0717c457760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:18.754794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:18.791182 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1006/2040] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:18.792265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c00ca-0184-4ffc-8310-6ef41ef7c502 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:18.819818 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1035/2041] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:18 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:18.821829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfc127-1da9-4490-abad-d0717c457760 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:18.823022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d3dfc127-1da9-4490-abad-d0717c457760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:18.931782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c00ca-0184-4ffc-8310-6ef41ef7c502 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:18.938259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff36a73-d202-452d-bd0d-8b95038f1c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:18.939786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff36a73-d202-452d-bd0d-8b95038f1c2e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:18.940125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff36a73-d202-452d-bd0d-8b95038f1c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:18.940652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff36a73-d202-452d-bd0d-8b95038f1c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:18.941324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff36a73-d202-452d-bd0d-8b95038f1c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:18.944142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff36a73-d202-452d-bd0d-8b95038f1c2e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:18.946020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:18.962386 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1007/2042] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:18.963104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff36a73-d202-452d-bd0d-8b95038f1c2e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:18.966021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfc127-1da9-4490-abad-d0717c457760 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:18.973276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09e20d-f8a4-4c4c-b673-d5759d981b8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:18.973956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09e20d-f8a4-4c4c-b673-d5759d981b8b service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:18.974242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09e20d-f8a4-4c4c-b673-d5759d981b8b service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:18.974871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09e20d-f8a4-4c4c-b673-d5759d981b8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:18.981038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff36a73-d202-452d-bd0d-8b95038f1c2e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:18.984751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09e20d-f8a4-4c4c-b673-d5759d981b8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:18.987495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09e20d-f8a4-4c4c-b673-d5759d981b8b service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:18.988344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a3f07-4c60-47c5-9e69-1fa59d226d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:18.989190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a3f07-4c60-47c5-9e69-1fa59d226d50 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:18.989772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a3f07-4c60-47c5-9e69-1fa59d226d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:18.990516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a3f07-4c60-47c5-9e69-1fa59d226d50 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:18.991631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a3f07-4c60-47c5-9e69-1fa59d226d50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:18.994195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a3f07-4c60-47c5-9e69-1fa59d226d50 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:18.999414 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1036/2043] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:19.000883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbccbab-52ca-4a15-addf-7dcc98d8aee9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:19.001200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbccbab-52ca-4a15-addf-7dcc98d8aee9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:19.001479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbccbab-52ca-4a15-addf-7dcc98d8aee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:19.031979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7cbccbab-52ca-4a15-addf-7dcc98d8aee9 None None] MFA Rules not processed for user `f3287fb85c2343d686718d3c4aaa5c00`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:19.033275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7cbccbab-52ca-4a15-addf-7dcc98d8aee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:19.034525 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1008/2044] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:18 2022] POST /identity/v3/projects => generated 409 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:19.035628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a3f07-4c60-47c5-9e69-1fa59d226d50 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:19.128231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a3f07-4c60-47c5-9e69-1fa59d226d50 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:19.137859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24d2c5-b7e9-4a3c-af8b-1af2561eaded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:19.139103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24d2c5-b7e9-4a3c-af8b-1af2561eaded admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:19.139584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24d2c5-b7e9-4a3c-af8b-1af2561eaded admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:19.140307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24d2c5-b7e9-4a3c-af8b-1af2561eaded admin admin] PATH_INFO: `/v3/projects/a1e2efb2af3f48f19c4753e0334144d2/users/53d9c508420a4fb3ae0d932eb8f87173/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:19.145119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24d2c5-b7e9-4a3c-af8b-1af2561eaded admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e2efb2af3f48f19c4753e0334144d2, user_id=53d9c508420a4fb3ae0d932eb8f87173, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:19.147095 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1037/2045] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:19.147830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbccbab-52ca-4a15-addf-7dcc98d8aee9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:19.149188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24d2c5-b7e9-4a3c-af8b-1af2561eaded admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:19.165373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbccbab-52ca-4a15-addf-7dcc98d8aee9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:19.174622 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1009/2046] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:19 2022] PUT /identity/v3/projects/a1e2efb2af3f48f19c4753e0334144d2/users/53d9c508420a4fb3ae0d932eb8f87173/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:19.176934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24d2c5-b7e9-4a3c-af8b-1af2561eaded admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:19.269911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed12653-cd09-4355-8d7c-a9508578a837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:19.270640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed12653-cd09-4355-8d7c-a9508578a837 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:19.270928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed12653-cd09-4355-8d7c-a9508578a837 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:19.271217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed12653-cd09-4355-8d7c-a9508578a837 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:19.271931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed12653-cd09-4355-8d7c-a9508578a837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:19.273464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24d2c5-b7e9-4a3c-af8b-1af2561eaded admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:19.275606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed12653-cd09-4355-8d7c-a9508578a837 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:19.280448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760954d-4a31-4617-bf74-044df1ff7958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:19.281623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760954d-4a31-4617-bf74-044df1ff7958 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:19.282046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760954d-4a31-4617-bf74-044df1ff7958 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:19.282416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760954d-4a31-4617-bf74-044df1ff7958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:19.287905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:19.321566 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1038/2047] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:19 2022] POST /identity/v3/users => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:19.321566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed12653-cd09-4355-8d7c-a9508578a837 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:19.323958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-aed12653-cd09-4355-8d7c-a9508578a837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:19.349489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed12653-cd09-4355-8d7c-a9508578a837 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:19.356905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc40167-afbe-4687-bcbd-09890954ad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:19.359295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc40167-afbe-4687-bcbd-09890954ad2c admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:19.360157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc40167-afbe-4687-bcbd-09890954ad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:19.360521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc40167-afbe-4687-bcbd-09890954ad2c admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:19.361726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc40167-afbe-4687-bcbd-09890954ad2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:19.364138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc40167-afbe-4687-bcbd-09890954ad2c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:19.371879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760954d-4a31-4617-bf74-044df1ff7958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:19.374797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760954d-4a31-4617-bf74-044df1ff7958 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:19.391479 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1010/2048] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:19.394249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8c2b7-7f2f-4bd2-aef1-677c81087a69 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:19.394751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8c2b7-7f2f-4bd2-aef1-677c81087a69 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:19.394848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8c2b7-7f2f-4bd2-aef1-677c81087a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:19.403363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:19.418522 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1039/2049] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:19 2022] POST /identity/v3/projects => generated 397 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:19.418522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc40167-afbe-4687-bcbd-09890954ad2c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:19.431430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4de8c2b7-7f2f-4bd2-aef1-677c81087a69 None None] MFA Rules not processed for user `53d9c508420a4fb3ae0d932eb8f87173`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:19.433204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4de8c2b7-7f2f-4bd2-aef1-677c81087a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:19.513641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc40167-afbe-4687-bcbd-09890954ad2c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:19.519608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13223eb9-cb61-40c6-bcbb-6f16b47b494f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:19.520432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13223eb9-cb61-40c6-bcbb-6f16b47b494f admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:19.520719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13223eb9-cb61-40c6-bcbb-6f16b47b494f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:19.521015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13223eb9-cb61-40c6-bcbb-6f16b47b494f admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:19.521733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13223eb9-cb61-40c6-bcbb-6f16b47b494f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:19.523675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13223eb9-cb61-40c6-bcbb-6f16b47b494f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:19.534671 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1011/2050] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:19.534671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8c2b7-7f2f-4bd2-aef1-677c81087a69 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:19.543140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8c2b7-7f2f-4bd2-aef1-677c81087a69 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:19.548446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76628f3a-8635-4306-b90c-1f1fdc80bddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:19.549115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76628f3a-8635-4306-b90c-1f1fdc80bddf admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:19.549395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76628f3a-8635-4306-b90c-1f1fdc80bddf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:19.549672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76628f3a-8635-4306-b90c-1f1fdc80bddf admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:19.551004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76628f3a-8635-4306-b90c-1f1fdc80bddf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:19.555040 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1040/2051] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:19.555040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13223eb9-cb61-40c6-bcbb-6f16b47b494f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:19.555222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76628f3a-8635-4306-b90c-1f1fdc80bddf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:19.574061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13223eb9-cb61-40c6-bcbb-6f16b47b494f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:19.579334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270a553-55d9-4ab3-9719-4e75ad0b4603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:19.580238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270a553-55d9-4ab3-9719-4e75ad0b4603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:19.580521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270a553-55d9-4ab3-9719-4e75ad0b4603 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:19.580793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270a553-55d9-4ab3-9719-4e75ad0b4603 admin admin] PATH_INFO: `/v3/users/123d7b542a8443a192f2f89d05cebbb6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:19.582008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270a553-55d9-4ab3-9719-4e75ad0b4603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=123d7b542a8443a192f2f89d05cebbb6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:19.583959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270a553-55d9-4ab3-9719-4e75ad0b4603 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:19.585230 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1012/2052] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:19 2022] POST /identity/v3/users => generated 305 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:19.586145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76628f3a-8635-4306-b90c-1f1fdc80bddf admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:19.647618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2270a553-55d9-4ab3-9719-4e75ad0b4603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '123d7b542a8443a192f2f89d05cebbb6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:19.656946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2270a553-55d9-4ab3-9719-4e75ad0b4603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '123d7b542a8443a192f2f89d05cebbb6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:19.657626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2270a553-55d9-4ab3-9719-4e75ad0b4603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '123d7b542a8443a192f2f89d05cebbb6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:19.658250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2270a553-55d9-4ab3-9719-4e75ad0b4603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '123d7b542a8443a192f2f89d05cebbb6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:19.668341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76628f3a-8635-4306-b90c-1f1fdc80bddf admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:19.670655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2270a553-55d9-4ab3-9719-4e75ad0b4603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '123d7b542a8443a192f2f89d05cebbb6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:19.674972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1d409-ddf0-44d6-97ec-6754953de361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:19.675683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1d409-ddf0-44d6-97ec-6754953de361 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:19.675963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1d409-ddf0-44d6-97ec-6754953de361 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:19.676277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1d409-ddf0-44d6-97ec-6754953de361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:19.678377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a7e1d409-ddf0-44d6-97ec-6754953de361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:19.692199 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1041/2053] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:19 2022] DELETE /identity/v3/users/123d7b542a8443a192f2f89d05cebbb6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:19.692437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1d409-ddf0-44d6-97ec-6754953de361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:19.693315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270a553-55d9-4ab3-9719-4e75ad0b4603 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:19.693968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1d409-ddf0-44d6-97ec-6754953de361 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:19.695794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2270a553-55d9-4ab3-9719-4e75ad0b4603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:19.705723 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1013/2054] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:19.707295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1d409-ddf0-44d6-97ec-6754953de361 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:19.709778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a7e1d409-ddf0-44d6-97ec-6754953de361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:19.724320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1d409-ddf0-44d6-97ec-6754953de361 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:19.766447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:19.798984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:19.803490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270a553-55d9-4ab3-9719-4e75ad0b4603 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:19.806339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9060e3c-e25c-453c-9b75-8f91a00c4703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:19.807304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9060e3c-e25c-453c-9b75-8f91a00c4703 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:19.808089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9060e3c-e25c-453c-9b75-8f91a00c4703 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:19.809037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9060e3c-e25c-453c-9b75-8f91a00c4703 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:19.809630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9060e3c-e25c-453c-9b75-8f91a00c4703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:19.811450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee42e85-ae47-4c8b-8d5f-f9d4e61918f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:19.812516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee42e85-ae47-4c8b-8d5f-f9d4e61918f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:19.812693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9060e3c-e25c-453c-9b75-8f91a00c4703 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:19.812917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee42e85-ae47-4c8b-8d5f-f9d4e61918f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:19.813249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee42e85-ae47-4c8b-8d5f-f9d4e61918f1 admin admin] PATH_INFO: `/v3/projects/00fdba5a56d040eda25ea8dc34ac3936/users/9d2b203e4fa546059ec3efeeae76ffad/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:19.831867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee42e85-ae47-4c8b-8d5f-f9d4e61918f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00fdba5a56d040eda25ea8dc34ac3936, user_id=9d2b203e4fa546059ec3efeeae76ffad, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:19.834752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee42e85-ae47-4c8b-8d5f-f9d4e61918f1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:19.842672 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1014/2055] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:19.844384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b3f20-c632-4e40-9d5b-798318dbb6a7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:19.846588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b3f20-c632-4e40-9d5b-798318dbb6a7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:19.846871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b3f20-c632-4e40-9d5b-798318dbb6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:19.853535 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1042/2056] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:19 2022] PUT /identity/v3/projects/00fdba5a56d040eda25ea8dc34ac3936/users/9d2b203e4fa546059ec3efeeae76ffad/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:19.855067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521be4ec-3b73-4a47-962a-ea0dff4208e7 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:19.855419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521be4ec-3b73-4a47-962a-ea0dff4208e7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:19.855758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521be4ec-3b73-4a47-962a-ea0dff4208e7 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:19.857263 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1043/2057] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:19.858056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521be4ec-3b73-4a47-962a-ea0dff4208e7 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:19.872635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c19b3f20-c632-4e40-9d5b-798318dbb6a7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:19.874477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c19b3f20-c632-4e40-9d5b-798318dbb6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:19.928354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521be4ec-3b73-4a47-962a-ea0dff4208e7 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:19.932917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35acbc7-847f-4548-a2e2-cab3065c3342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:19.933801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35acbc7-847f-4548-a2e2-cab3065c3342 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:19.934130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35acbc7-847f-4548-a2e2-cab3065c3342 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:19.934415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35acbc7-847f-4548-a2e2-cab3065c3342 admin admin] PATH_INFO: `/v3/projects/a2435181dd914e78be658755f294300d/users/eb68afc30fd8403a82efa015738a776f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:19.952772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35acbc7-847f-4548-a2e2-cab3065c3342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2435181dd914e78be658755f294300d, user_id=eb68afc30fd8403a82efa015738a776f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:19.956571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35acbc7-847f-4548-a2e2-cab3065c3342 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:19.961452 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1015/2058] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:19.962837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b3f20-c632-4e40-9d5b-798318dbb6a7 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:19.974819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b3f20-c632-4e40-9d5b-798318dbb6a7 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:19.982080 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1044/2059] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:19 2022] PUT /identity/v3/projects/a2435181dd914e78be658755f294300d/users/eb68afc30fd8403a82efa015738a776f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:19.983250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35acbc7-847f-4548-a2e2-cab3065c3342 admin admin] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:19.985009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c35acbc7-847f-4548-a2e2-cab3065c3342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:20.040776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bad2f-d54c-4b5f-adfb-34ed0fcb1683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:20.041450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bad2f-d54c-4b5f-adfb-34ed0fcb1683 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:20.041724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bad2f-d54c-4b5f-adfb-34ed0fcb1683 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:20.041986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bad2f-d54c-4b5f-adfb-34ed0fcb1683 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:20.042705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bad2f-d54c-4b5f-adfb-34ed0fcb1683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:20.044334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bad2f-d54c-4b5f-adfb-34ed0fcb1683 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:20.054729 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1016/2060] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:20.055519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bad2f-d54c-4b5f-adfb-34ed0fcb1683 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:20.058257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0a9bad2f-d54c-4b5f-adfb-34ed0fcb1683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:20.062445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35acbc7-847f-4548-a2e2-cab3065c3342 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:20.107495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:20.122411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bad2f-d54c-4b5f-adfb-34ed0fcb1683 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:20.126113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205487f9-5f46-4819-a32a-8155e51f03ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:20.126771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205487f9-5f46-4819-a32a-8155e51f03ab service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:20.127450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205487f9-5f46-4819-a32a-8155e51f03ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:20.127450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205487f9-5f46-4819-a32a-8155e51f03ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:20.131039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35acbc7-847f-4548-a2e2-cab3065c3342 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:20.136114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155d2a0-197e-4ab8-aeb9-3936ff9a53d2 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d9c508420a4fb3ae0d932eb8f87173', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e2efb2af3f48f19c4753e0334144d2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:20.136602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205487f9-5f46-4819-a32a-8155e51f03ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:20.136980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155d2a0-197e-4ab8-aeb9-3936ff9a53d2 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:20.137261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155d2a0-197e-4ab8-aeb9-3936ff9a53d2 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:20.137533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155d2a0-197e-4ab8-aeb9-3936ff9a53d2 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] PATH_INFO: `/v3/projects/2f742f03e6c14260b98b00f5c13438f0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:20.138078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205487f9-5f46-4819-a32a-8155e51f03ab service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:20.138697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155d2a0-197e-4ab8-aeb9-3936ff9a53d2 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: Authorizing `identity:get_project(project_id=2f742f03e6c14260b98b00f5c13438f0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:20.140779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155d2a0-197e-4ab8-aeb9-3936ff9a53d2 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:20.142489 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1045/2061] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:19 2022] GET /identity/v3/projects/2f742f03e6c14260b98b00f5c13438f0 => generated 381 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:20.143326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155d2a0-197e-4ab8-aeb9-3936ff9a53d2 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:20.148599 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1017/2062] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:20.149698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205487f9-5f46-4819-a32a-8155e51f03ab service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:20.156486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155d2a0-197e-4ab8-aeb9-3936ff9a53d2 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:20.167847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d44cd-d7ea-4ffa-88ed-44be1f16ff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:20.168990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d44cd-d7ea-4ffa-88ed-44be1f16ff4b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:20.169279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d44cd-d7ea-4ffa-88ed-44be1f16ff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:20.169556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d44cd-d7ea-4ffa-88ed-44be1f16ff4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:20.170283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d44cd-d7ea-4ffa-88ed-44be1f16ff4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:20.171042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205487f9-5f46-4819-a32a-8155e51f03ab service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:20.172155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d44cd-d7ea-4ffa-88ed-44be1f16ff4b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:20.179899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712378a-de79-4fb7-983f-24a71b0852d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:20.180909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712378a-de79-4fb7-983f-24a71b0852d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:20.181188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712378a-de79-4fb7-983f-24a71b0852d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:20.181890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712378a-de79-4fb7-983f-24a71b0852d6 admin admin] PATH_INFO: `/v3/projects/00fdba5a56d040eda25ea8dc34ac3936/users/9d2b203e4fa546059ec3efeeae76ffad/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:20.183576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712378a-de79-4fb7-983f-24a71b0852d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00fdba5a56d040eda25ea8dc34ac3936, user_id=9d2b203e4fa546059ec3efeeae76ffad, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:20.186597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712378a-de79-4fb7-983f-24a71b0852d6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:20.200681 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1046/2063] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:20.201898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d44cd-d7ea-4ffa-88ed-44be1f16ff4b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:20.212354 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1018/2064] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:20 2022] PUT /identity/v3/projects/00fdba5a56d040eda25ea8dc34ac3936/users/9d2b203e4fa546059ec3efeeae76ffad/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:20.214834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907959a1-a2b7-4b7a-ac23-1526a25b66fb None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:20.215119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907959a1-a2b7-4b7a-ac23-1526a25b66fb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:20.215392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907959a1-a2b7-4b7a-ac23-1526a25b66fb None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:20.218688 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1019/2065] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 21:01:20.218811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d44cd-d7ea-4ffa-88ed-44be1f16ff4b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:20.222036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907959a1-a2b7-4b7a-ac23-1526a25b66fb None None] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:20.223933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-907959a1-a2b7-4b7a-ac23-1526a25b66fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:20.258895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:20.296103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6efc1-d735-4b44-9477-497f250e18d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:20.297276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6efc1-d735-4b44-9477-497f250e18d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:20.297566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6efc1-d735-4b44-9477-497f250e18d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:20.297842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6efc1-d735-4b44-9477-497f250e18d6 admin admin] PATH_INFO: `/v3/projects/a2435181dd914e78be658755f294300d/users/eb68afc30fd8403a82efa015738a776f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:20.300734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6efc1-d735-4b44-9477-497f250e18d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2435181dd914e78be658755f294300d, user_id=eb68afc30fd8403a82efa015738a776f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:20.304991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6efc1-d735-4b44-9477-497f250e18d6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:20.323860 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1047/2066] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:20 2022] PUT /identity/v3/projects/a2435181dd914e78be658755f294300d/users/eb68afc30fd8403a82efa015738a776f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:20.325660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad6e9b-b499-4364-b30f-9ffbbc84b64a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:20.326028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad6e9b-b499-4364-b30f-9ffbbc84b64a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:20.326429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad6e9b-b499-4364-b30f-9ffbbc84b64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:20.345374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907959a1-a2b7-4b7a-ac23-1526a25b66fb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:20.368460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7dad6e9b-b499-4364-b30f-9ffbbc84b64a None None] MFA Rules not processed for user `9d2b203e4fa546059ec3efeeae76ffad`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:20.369589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7dad6e9b-b499-4364-b30f-9ffbbc84b64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:20.437711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907959a1-a2b7-4b7a-ac23-1526a25b66fb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:20.454720 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1048/2067] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:20 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:20.462971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad6e9b-b499-4364-b30f-9ffbbc84b64a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:20.524966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:20.526679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1a069-3bbe-4b16-bb04-78091b350f37 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d9c508420a4fb3ae0d932eb8f87173', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e2efb2af3f48f19c4753e0334144d2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:20.528642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1a069-3bbe-4b16-bb04-78091b350f37 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:20.529166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1a069-3bbe-4b16-bb04-78091b350f37 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:20.530025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1a069-3bbe-4b16-bb04-78091b350f37 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] PATH_INFO: `/v3/projects/2f742f03e6c14260b98b00f5c13438f0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:20.533056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1a069-3bbe-4b16-bb04-78091b350f37 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: Authorizing `identity:get_project(project_id=2f742f03e6c14260b98b00f5c13438f0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:20.536115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1a069-3bbe-4b16-bb04-78091b350f37 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:20.539485 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1020/2068] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:20 2022] GET /identity/v3/projects/2f742f03e6c14260b98b00f5c13438f0 => generated 381 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:20.560145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad6e9b-b499-4364-b30f-9ffbbc84b64a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:20.574923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99c4b1-ac7e-423b-ac27-f255ff862d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:20.576614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99c4b1-ac7e-423b-ac27-f255ff862d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:20.581088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99c4b1-ac7e-423b-ac27-f255ff862d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:20.581937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99c4b1-ac7e-423b-ac27-f255ff862d26 admin admin] PATH_INFO: `/v3/users/50529fed2cef428bbbf096c0de327e8f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:20.590172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99c4b1-ac7e-423b-ac27-f255ff862d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50529fed2cef428bbbf096c0de327e8f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:20.595112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99c4b1-ac7e-423b-ac27-f255ff862d26 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:20.603258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1a069-3bbe-4b16-bb04-78091b350f37 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:20.606248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b0a1a069-3bbe-4b16-bb04-78091b350f37 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:20.633298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1a069-3bbe-4b16-bb04-78091b350f37 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:20.640236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc335f96-cba5-4de7-a2ba-1564f2541ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:20.641182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc335f96-cba5-4de7-a2ba-1564f2541ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:20.641510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc335f96-cba5-4de7-a2ba-1564f2541ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:20.641843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc335f96-cba5-4de7-a2ba-1564f2541ff4 admin admin] PATH_INFO: `/v3/projects/618d91601a8c4d7194194033be0be5c6` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:20.643093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc335f96-cba5-4de7-a2ba-1564f2541ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=618d91601a8c4d7194194033be0be5c6)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:20.645149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc335f96-cba5-4de7-a2ba-1564f2541ff4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:20.723612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6b99c4b1-ac7e-423b-ac27-f255ff862d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50529fed2cef428bbbf096c0de327e8f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:20.732749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6b99c4b1-ac7e-423b-ac27-f255ff862d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50529fed2cef428bbbf096c0de327e8f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:20.733432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6b99c4b1-ac7e-423b-ac27-f255ff862d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50529fed2cef428bbbf096c0de327e8f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:20.734038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6b99c4b1-ac7e-423b-ac27-f255ff862d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50529fed2cef428bbbf096c0de327e8f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:20.742113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6b99c4b1-ac7e-423b-ac27-f255ff862d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50529fed2cef428bbbf096c0de327e8f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:20.754323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dc335f96-cba5-4de7-a2ba-1564f2541ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '618d91601a8c4d7194194033be0be5c6', 'request_id': 'req-dc335f96-cba5-4de7-a2ba-1564f2541ff4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:20.763820 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1049/2069] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:20 2022] DELETE /identity/v3/users/50529fed2cef428bbbf096c0de327e8f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:20.763820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad8163-5b2b-4fa8-b767-7627b3ac1451 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:20.763820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad8163-5b2b-4fa8-b767-7627b3ac1451 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:20.763820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad8163-5b2b-4fa8-b767-7627b3ac1451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:20.767379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dc335f96-cba5-4de7-a2ba-1564f2541ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '618d91601a8c4d7194194033be0be5c6', 'request_id': 'req-dc335f96-cba5-4de7-a2ba-1564f2541ff4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:20.774125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:20.781665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dc335f96-cba5-4de7-a2ba-1564f2541ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '618d91601a8c4d7194194033be0be5c6', 'request_id': 'req-dc335f96-cba5-4de7-a2ba-1564f2541ff4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:20.784777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-59ad8163-5b2b-4fa8-b767-7627b3ac1451 None None] MFA Rules not processed for user `4ce2e8e17cd74914b0c5391443f6d3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:20.786290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-59ad8163-5b2b-4fa8-b767-7627b3ac1451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:20.803072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dc335f96-cba5-4de7-a2ba-1564f2541ff4 admin admin] The token cache is being invalidate because project 618d91601a8c4d7194194033be0be5c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:20.803632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dc335f96-cba5-4de7-a2ba-1564f2541ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:20.805607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dc335f96-cba5-4de7-a2ba-1564f2541ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:20.808274 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1021/2070] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:20 2022] DELETE /identity/v3/projects/618d91601a8c4d7194194033be0be5c6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:20.809568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0c783-78ae-4eba-954f-beefb4047c46 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:20.809853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0c783-78ae-4eba-954f-beefb4047c46 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:20.810126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0c783-78ae-4eba-954f-beefb4047c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:20.829523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2cc0c783-78ae-4eba-954f-beefb4047c46 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:20.830726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2cc0c783-78ae-4eba-954f-beefb4047c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:20.852870 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1050/2071] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:20.854246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad8163-5b2b-4fa8-b767-7627b3ac1451 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:20.858675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-59ad8163-5b2b-4fa8-b767-7627b3ac1451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:20.912663 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1022/2072] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:20.916827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0c783-78ae-4eba-954f-beefb4047c46 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:20.918290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2cc0c783-78ae-4eba-954f-beefb4047c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:21.011053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad8163-5b2b-4fa8-b767-7627b3ac1451 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:21.016160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0c783-78ae-4eba-954f-beefb4047c46 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:21.023582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b474855-d485-41c7-8d49-edbf117bf31d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:21.023868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8de892-9ca3-435c-9a68-a6c085b144e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:21.024601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b474855-d485-41c7-8d49-edbf117bf31d service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:21.024946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b474855-d485-41c7-8d49-edbf117bf31d service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:21.025059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8de892-9ca3-435c-9a68-a6c085b144e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:21.025305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8de892-9ca3-435c-9a68-a6c085b144e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:21.025884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8de892-9ca3-435c-9a68-a6c085b144e5 admin admin] PATH_INFO: `/v3/users/50d1ebfc28054ff3a3e437666a17be0e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:21.025997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b474855-d485-41c7-8d49-edbf117bf31d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:21.027480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8de892-9ca3-435c-9a68-a6c085b144e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50d1ebfc28054ff3a3e437666a17be0e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:21.028809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2b474855-d485-41c7-8d49-edbf117bf31d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:21.037418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8de892-9ca3-435c-9a68-a6c085b144e5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:21.042771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b474855-d485-41c7-8d49-edbf117bf31d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:21.045025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b474855-d485-41c7-8d49-edbf117bf31d service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:21.058167 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1023/2073] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:21.059400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b474855-d485-41c7-8d49-edbf117bf31d service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:21.061029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2b474855-d485-41c7-8d49-edbf117bf31d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:21.065097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:21.164523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bb8de892-9ca3-435c-9a68-a6c085b144e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50d1ebfc28054ff3a3e437666a17be0e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:21.181317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bb8de892-9ca3-435c-9a68-a6c085b144e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50d1ebfc28054ff3a3e437666a17be0e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:21.182462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bb8de892-9ca3-435c-9a68-a6c085b144e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50d1ebfc28054ff3a3e437666a17be0e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:21.184406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bb8de892-9ca3-435c-9a68-a6c085b144e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50d1ebfc28054ff3a3e437666a17be0e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:21.211546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bb8de892-9ca3-435c-9a68-a6c085b144e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50d1ebfc28054ff3a3e437666a17be0e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:21.228538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b474855-d485-41c7-8d49-edbf117bf31d service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:21.234802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcc293-fac7-484c-a063-259df9bb1f3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:21.235537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcc293-fac7-484c-a063-259df9bb1f3c service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:21.235821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcc293-fac7-484c-a063-259df9bb1f3c service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:21.236181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcc293-fac7-484c-a063-259df9bb1f3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:21.238546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f8dcc293-fac7-484c-a063-259df9bb1f3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:21.272665 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1051/2074] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:20 2022] DELETE /identity/v3/users/50d1ebfc28054ff3a3e437666a17be0e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:21.279512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcc293-fac7-484c-a063-259df9bb1f3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:21.281654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcc293-fac7-484c-a063-259df9bb1f3c service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:21.298819 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1024/2075] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:21.886105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f6d5c-b562-459c-aa4f-93d288103bd7 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:21.886771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f6d5c-b562-459c-aa4f-93d288103bd7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:21.886771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f6d5c-b562-459c-aa4f-93d288103bd7 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:21.888677 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1052/2076] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:21.894810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcc293-fac7-484c-a063-259df9bb1f3c service neutron] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:21.896128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f8dcc293-fac7-484c-a063-259df9bb1f3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:21.918905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcc293-fac7-484c-a063-259df9bb1f3c service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:21.920026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f8dcc293-fac7-484c-a063-259df9bb1f3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:21.935560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:22.028857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f6d5c-b562-459c-aa4f-93d288103bd7 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:22.031339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d43f6d5c-b562-459c-aa4f-93d288103bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:22.042013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcc293-fac7-484c-a063-259df9bb1f3c service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:22.154074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f6d5c-b562-459c-aa4f-93d288103bd7 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:22.159538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86f513-2b13-4b4c-98f0-ed2e6dd39c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:22.160702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86f513-2b13-4b4c-98f0-ed2e6dd39c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:22.161262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86f513-2b13-4b4c-98f0-ed2e6dd39c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:22.161732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86f513-2b13-4b4c-98f0-ed2e6dd39c04 admin admin] PATH_INFO: `/v3/projects/f0efa15c4f2142fc8b52e69b09614d9c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:22.164171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86f513-2b13-4b4c-98f0-ed2e6dd39c04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0efa15c4f2142fc8b52e69b09614d9c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:22.167943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86f513-2b13-4b4c-98f0-ed2e6dd39c04 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:22.210986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0430a5a-5a8b-4621-896a-1f97f2477aab tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d9c508420a4fb3ae0d932eb8f87173', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e2efb2af3f48f19c4753e0334144d2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:22.214191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0430a5a-5a8b-4621-896a-1f97f2477aab tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:22.215941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0430a5a-5a8b-4621-896a-1f97f2477aab tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:22.216440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0430a5a-5a8b-4621-896a-1f97f2477aab tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] PATH_INFO: `/v3/projects/2f742f03e6c14260b98b00f5c13438f0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:22.221745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0430a5a-5a8b-4621-896a-1f97f2477aab tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: Authorizing `identity:get_project(project_id=2f742f03e6c14260b98b00f5c13438f0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:22.226500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0430a5a-5a8b-4621-896a-1f97f2477aab tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:22.254249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bd86f513-2b13-4b4c-98f0-ed2e6dd39c04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0efa15c4f2142fc8b52e69b09614d9c', 'request_id': 'req-bd86f513-2b13-4b4c-98f0-ed2e6dd39c04'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:22.255172 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1025/2077] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:21 2022] GET /identity/v3/projects/2f742f03e6c14260b98b00f5c13438f0 => generated 381 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:22.277338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bd86f513-2b13-4b4c-98f0-ed2e6dd39c04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0efa15c4f2142fc8b52e69b09614d9c', 'request_id': 'req-bd86f513-2b13-4b4c-98f0-ed2e6dd39c04'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:22.287352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bd86f513-2b13-4b4c-98f0-ed2e6dd39c04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0efa15c4f2142fc8b52e69b09614d9c', 'request_id': 'req-bd86f513-2b13-4b4c-98f0-ed2e6dd39c04'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:22.324488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bd86f513-2b13-4b4c-98f0-ed2e6dd39c04 admin admin] The token cache is being invalidate because project f0efa15c4f2142fc8b52e69b09614d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:22.326695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bd86f513-2b13-4b4c-98f0-ed2e6dd39c04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:22.327591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bd86f513-2b13-4b4c-98f0-ed2e6dd39c04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:22.332366 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1053/2078] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:22 2022] DELETE /identity/v3/projects/f0efa15c4f2142fc8b52e69b09614d9c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:22.333685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0430a5a-5a8b-4621-896a-1f97f2477aab tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:22.335560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c0430a5a-5a8b-4621-896a-1f97f2477aab tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:22.366593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0430a5a-5a8b-4621-896a-1f97f2477aab tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:22.381309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86f513-2b13-4b4c-98f0-ed2e6dd39c04 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:22.382826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bd86f513-2b13-4b4c-98f0-ed2e6dd39c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:22.429701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:22.527684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86f513-2b13-4b4c-98f0-ed2e6dd39c04 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:22.541032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d0566-187c-430b-bd12-21380dc64160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:22.543043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b9501-c339-49e6-9e27-cad58b2f76db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:22.543592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b9501-c339-49e6-9e27-cad58b2f76db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:22.543878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b9501-c339-49e6-9e27-cad58b2f76db admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:22.545642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d0566-187c-430b-bd12-21380dc64160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:22.546051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d0566-187c-430b-bd12-21380dc64160 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:22.546314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b9501-c339-49e6-9e27-cad58b2f76db admin admin] PATH_INFO: `/v3/projects/d5b549171ddb47118c3c564da1fe6467` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:22.546553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d0566-187c-430b-bd12-21380dc64160 admin admin] PATH_INFO: `/v3/users/9d2b203e4fa546059ec3efeeae76ffad` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:22.549215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d0566-187c-430b-bd12-21380dc64160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2b203e4fa546059ec3efeeae76ffad)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:22.549876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b9501-c339-49e6-9e27-cad58b2f76db admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b549171ddb47118c3c564da1fe6467)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:22.551740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d0566-187c-430b-bd12-21380dc64160 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:22.552076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b9501-c339-49e6-9e27-cad58b2f76db admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:22.657283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-234d0566-187c-430b-bd12-21380dc64160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2b203e4fa546059ec3efeeae76ffad'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:22.688662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-234d0566-187c-430b-bd12-21380dc64160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2b203e4fa546059ec3efeeae76ffad'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:22.689547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-816b9501-c339-49e6-9e27-cad58b2f76db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b549171ddb47118c3c564da1fe6467', 'request_id': 'req-816b9501-c339-49e6-9e27-cad58b2f76db'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:22.701762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-816b9501-c339-49e6-9e27-cad58b2f76db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b549171ddb47118c3c564da1fe6467', 'request_id': 'req-816b9501-c339-49e6-9e27-cad58b2f76db'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:22.704573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-234d0566-187c-430b-bd12-21380dc64160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2b203e4fa546059ec3efeeae76ffad'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:22.705611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-234d0566-187c-430b-bd12-21380dc64160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2b203e4fa546059ec3efeeae76ffad'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:22.706348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-234d0566-187c-430b-bd12-21380dc64160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2b203e4fa546059ec3efeeae76ffad'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:22.707758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:22.708763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-816b9501-c339-49e6-9e27-cad58b2f76db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b549171ddb47118c3c564da1fe6467', 'request_id': 'req-816b9501-c339-49e6-9e27-cad58b2f76db'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:22.736266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-816b9501-c339-49e6-9e27-cad58b2f76db admin admin] The token cache is being invalidate because project d5b549171ddb47118c3c564da1fe6467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:22.737988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-816b9501-c339-49e6-9e27-cad58b2f76db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:22.738736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-816b9501-c339-49e6-9e27-cad58b2f76db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:22.742419 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1026/2079] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:22 2022] DELETE /identity/v3/users/9d2b203e4fa546059ec3efeeae76ffad => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:22.742575 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1054/2080] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:22 2022] DELETE /identity/v3/projects/d5b549171ddb47118c3c564da1fe6467 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:22.742668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06105b1a-7e67-4497-b174-155e6a640d59 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:22.742668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06105b1a-7e67-4497-b174-155e6a640d59 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:22.742668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06105b1a-7e67-4497-b174-155e6a640d59 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:22.745634 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1027/2081] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:22.748349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa564a-bc16-4777-a61a-afccf072a80c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:22.748723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa564a-bc16-4777-a61a-afccf072a80c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:22.749107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa564a-bc16-4777-a61a-afccf072a80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:22.758246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06105b1a-7e67-4497-b174-155e6a640d59 None None] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:22.761432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-06105b1a-7e67-4497-b174-155e6a640d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:22.803662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-85aa564a-bc16-4777-a61a-afccf072a80c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:22.807783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-85aa564a-bc16-4777-a61a-afccf072a80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:22.887899 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1055/2082] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:01:22.897493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd2fe5-ad8e-4310-9369-8c515ca87b85 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:22.897984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd2fe5-ad8e-4310-9369-8c515ca87b85 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:22.898404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd2fe5-ad8e-4310-9369-8c515ca87b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:22.906639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06105b1a-7e67-4497-b174-155e6a640d59 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:22.911005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-06105b1a-7e67-4497-b174-155e6a640d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:22.924080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c9bd2fe5-ad8e-4310-9369-8c515ca87b85 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:22.925856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c9bd2fe5-ad8e-4310-9369-8c515ca87b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:22.946120 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1056/2083] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:01:22.969427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd2fe5-ad8e-4310-9369-8c515ca87b85 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:22.990588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd2fe5-ad8e-4310-9369-8c515ca87b85 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:23.000211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d6abf-5672-491a-8be2-7c110190b052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:23.000896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d6abf-5672-491a-8be2-7c110190b052 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:23.001176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d6abf-5672-491a-8be2-7c110190b052 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:23.005572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d6abf-5672-491a-8be2-7c110190b052 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:23.007351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d6abf-5672-491a-8be2-7c110190b052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:23.010577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d6abf-5672-491a-8be2-7c110190b052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:23.015230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d6abf-5672-491a-8be2-7c110190b052 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:23.055943 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1057/2084] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:23.058480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06105b1a-7e67-4497-b174-155e6a640d59 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:23.059111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d6abf-5672-491a-8be2-7c110190b052 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:23.071433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ecce8-e8d7-419e-9ca3-801f57e42348 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d9c508420a4fb3ae0d932eb8f87173', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e2efb2af3f48f19c4753e0334144d2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:23.072409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ecce8-e8d7-419e-9ca3-801f57e42348 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:23.072694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ecce8-e8d7-419e-9ca3-801f57e42348 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:23.072972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ecce8-e8d7-419e-9ca3-801f57e42348 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] PATH_INFO: `/v3/projects/2f742f03e6c14260b98b00f5c13438f0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:23.076027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ecce8-e8d7-419e-9ca3-801f57e42348 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: Authorizing `identity:get_project(project_id=2f742f03e6c14260b98b00f5c13438f0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:23.080899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ecce8-e8d7-419e-9ca3-801f57e42348 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:23.082614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d6abf-5672-491a-8be2-7c110190b052 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:23.088089 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1028/2085] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:22 2022] GET /identity/v3/projects/2f742f03e6c14260b98b00f5c13438f0 => generated 381 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:01:23.090660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71c374-0799-485f-b765-d9d9287e865f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:23.091334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71c374-0799-485f-b765-d9d9287e865f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:23.091614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71c374-0799-485f-b765-d9d9287e865f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:23.091890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71c374-0799-485f-b765-d9d9287e865f admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:23.092627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71c374-0799-485f-b765-d9d9287e865f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:23.094555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71c374-0799-485f-b765-d9d9287e865f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:23.144627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2077f-b338-4747-911c-383d9f44bda7 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:23.145156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2077f-b338-4747-911c-383d9f44bda7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:23.145581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2077f-b338-4747-911c-383d9f44bda7 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:23.147646 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1029/2086] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:23.156666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2077f-b338-4747-911c-383d9f44bda7 None None] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:23.160182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-85b2077f-b338-4747-911c-383d9f44bda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:23.180065 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1058/2087] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:23 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:23.181551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71c374-0799-485f-b765-d9d9287e865f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:23.210115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2077f-b338-4747-911c-383d9f44bda7 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:23.211524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:23.237284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2077f-b338-4747-911c-383d9f44bda7 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:23.321366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71c374-0799-485f-b765-d9d9287e865f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:23.327722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8cda1-4810-460e-9223-c7c7cfa781dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:23.328319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8cda1-4810-460e-9223-c7c7cfa781dc admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:23.328999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8cda1-4810-460e-9223-c7c7cfa781dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:23.328999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8cda1-4810-460e-9223-c7c7cfa781dc admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:23.329818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8cda1-4810-460e-9223-c7c7cfa781dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:23.332676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e8cda1-4810-460e-9223-c7c7cfa781dc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:23.360681 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1059/2088] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:23 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:23.361943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8cda1-4810-460e-9223-c7c7cfa781dc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:23.364535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d9026-b23a-4f91-93ea-c8df7da94f99 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d9c508420a4fb3ae0d932eb8f87173', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e2efb2af3f48f19c4753e0334144d2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:23.364918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b7e8cda1-4810-460e-9223-c7c7cfa781dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:23.367206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d9026-b23a-4f91-93ea-c8df7da94f99 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:23.367652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d9026-b23a-4f91-93ea-c8df7da94f99 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:23.368695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d9026-b23a-4f91-93ea-c8df7da94f99 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] PATH_INFO: `/v3/projects/2f742f03e6c14260b98b00f5c13438f0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:23.378949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d9026-b23a-4f91-93ea-c8df7da94f99 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: Authorizing `identity:get_project(project_id=2f742f03e6c14260b98b00f5c13438f0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:23.379808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8cda1-4810-460e-9223-c7c7cfa781dc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:23.381045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d9026-b23a-4f91-93ea-c8df7da94f99 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:23.383225 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1030/2089] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:23 2022] GET /identity/v3/projects/2f742f03e6c14260b98b00f5c13438f0 => generated 381 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:01:23.384233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d9026-b23a-4f91-93ea-c8df7da94f99 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:23.397640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d9026-b23a-4f91-93ea-c8df7da94f99 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:23.401456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81005c24-e65b-452b-948a-6dd4b2e84385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:23.402497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81005c24-e65b-452b-948a-6dd4b2e84385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:23.402628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b375424-9432-4197-8bd5-a7b859a44f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:23.403341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b375424-9432-4197-8bd5-a7b859a44f95 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:23.403558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b375424-9432-4197-8bd5-a7b859a44f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:23.403839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b375424-9432-4197-8bd5-a7b859a44f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:23.404288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81005c24-e65b-452b-948a-6dd4b2e84385 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:23.404605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b375424-9432-4197-8bd5-a7b859a44f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:23.405982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81005c24-e65b-452b-948a-6dd4b2e84385 admin admin] PATH_INFO: `/v3/projects/00fdba5a56d040eda25ea8dc34ac3936` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:23.406221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b375424-9432-4197-8bd5-a7b859a44f95 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:23.409787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81005c24-e65b-452b-948a-6dd4b2e84385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00fdba5a56d040eda25ea8dc34ac3936)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:23.414220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81005c24-e65b-452b-948a-6dd4b2e84385 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:23.421322 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1031/2090] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:23.425260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b375424-9432-4197-8bd5-a7b859a44f95 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:23.435500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:23.448793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b375424-9432-4197-8bd5-a7b859a44f95 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:23.457042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf42db-51ab-4f73-807c-d48334fd5fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:23.458326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf42db-51ab-4f73-807c-d48334fd5fff admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:23.459727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf42db-51ab-4f73-807c-d48334fd5fff admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:23.460875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf42db-51ab-4f73-807c-d48334fd5fff admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:23.462374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf42db-51ab-4f73-807c-d48334fd5fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:23.465050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf42db-51ab-4f73-807c-d48334fd5fff admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:23.486950 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1032/2091] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:23.491291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf42db-51ab-4f73-807c-d48334fd5fff admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:23.511045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf42db-51ab-4f73-807c-d48334fd5fff admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:23.518707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce69273-b179-404d-8406-11bf43c81c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:23.519914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce69273-b179-404d-8406-11bf43c81c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:23.520317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce69273-b179-404d-8406-11bf43c81c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:23.520688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce69273-b179-404d-8406-11bf43c81c85 admin admin] PATH_INFO: `/v3/projects/5ca9141ebaeb4f53af10810f11950dbe/users/e895eba472f9403caf1c5036663af2ea/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:23.544504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce69273-b179-404d-8406-11bf43c81c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca9141ebaeb4f53af10810f11950dbe, user_id=e895eba472f9403caf1c5036663af2ea, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:23.548577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce69273-b179-404d-8406-11bf43c81c85 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:23.554065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-81005c24-e65b-452b-948a-6dd4b2e84385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00fdba5a56d040eda25ea8dc34ac3936', 'request_id': 'req-81005c24-e65b-452b-948a-6dd4b2e84385'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:23.576707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-81005c24-e65b-452b-948a-6dd4b2e84385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00fdba5a56d040eda25ea8dc34ac3936', 'request_id': 'req-81005c24-e65b-452b-948a-6dd4b2e84385'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:23.598287 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1033/2092] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:23 2022] PUT /identity/v3/projects/5ca9141ebaeb4f53af10810f11950dbe/users/e895eba472f9403caf1c5036663af2ea/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:23.598287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8049cfb-2685-465c-8594-2240e8d9c28b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:23.598287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8049cfb-2685-465c-8594-2240e8d9c28b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:23.598287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8049cfb-2685-465c-8594-2240e8d9c28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:23.598743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-81005c24-e65b-452b-948a-6dd4b2e84385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00fdba5a56d040eda25ea8dc34ac3936', 'request_id': 'req-81005c24-e65b-452b-948a-6dd4b2e84385'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:23.610120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-81005c24-e65b-452b-948a-6dd4b2e84385 admin admin] The token cache is being invalidate because project 00fdba5a56d040eda25ea8dc34ac3936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:23.610718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-81005c24-e65b-452b-948a-6dd4b2e84385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:23.612829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-81005c24-e65b-452b-948a-6dd4b2e84385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:23.615129 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1060/2093] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:23 2022] DELETE /identity/v3/projects/00fdba5a56d040eda25ea8dc34ac3936 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:23.617530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d3919-e3a6-4a2d-8b1e-64c92462c677 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:23.619718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d3919-e3a6-4a2d-8b1e-64c92462c677 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:23.619718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d3919-e3a6-4a2d-8b1e-64c92462c677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:23.631850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a8049cfb-2685-465c-8594-2240e8d9c28b None None] MFA Rules not processed for user `4ce2e8e17cd74914b0c5391443f6d3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:23.645691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a8049cfb-2685-465c-8594-2240e8d9c28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:23.686459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ca4d3919-e3a6-4a2d-8b1e-64c92462c677 None None] MFA Rules not processed for user `e895eba472f9403caf1c5036663af2ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:23.688974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ca4d3919-e3a6-4a2d-8b1e-64c92462c677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:23.763422 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1034/2094] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:23.765169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50296e09-9216-4985-8d03-b7da96e6b062 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:23.765408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50296e09-9216-4985-8d03-b7da96e6b062 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:23.765716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50296e09-9216-4985-8d03-b7da96e6b062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:23.845644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-50296e09-9216-4985-8d03-b7da96e6b062 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:23.846885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-50296e09-9216-4985-8d03-b7da96e6b062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:23.853279 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1061/2095] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:23.933871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d3919-e3a6-4a2d-8b1e-64c92462c677 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:23.935911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ca4d3919-e3a6-4a2d-8b1e-64c92462c677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:23.971149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:24.007968 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1035/2096] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:24.021087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a86b58-b127-4397-99b5-dbf6c03d603e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:24.021867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a86b58-b127-4397-99b5-dbf6c03d603e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:24.022454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a86b58-b127-4397-99b5-dbf6c03d603e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:24.049867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-56a86b58-b127-4397-99b5-dbf6c03d603e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:24.051024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-56a86b58-b127-4397-99b5-dbf6c03d603e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:24.072627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d3919-e3a6-4a2d-8b1e-64c92462c677 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:24.081422 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1036/2097] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:24.083984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a86b58-b127-4397-99b5-dbf6c03d603e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:24.084822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20da67-f8b9-4bae-bcb7-e165692f5fc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:24.085657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20da67-f8b9-4bae-bcb7-e165692f5fc8 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:24.085944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20da67-f8b9-4bae-bcb7-e165692f5fc8 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:24.086250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20da67-f8b9-4bae-bcb7-e165692f5fc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:24.100181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20da67-f8b9-4bae-bcb7-e165692f5fc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:24.102781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a86b58-b127-4397-99b5-dbf6c03d603e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:24.104469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20da67-f8b9-4bae-bcb7-e165692f5fc8 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:24.112126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6805db2-0575-4e1c-87da-b099e5e5c656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:24.114218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6805db2-0575-4e1c-87da-b099e5e5c656 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:24.114704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6805db2-0575-4e1c-87da-b099e5e5c656 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:24.115851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6805db2-0575-4e1c-87da-b099e5e5c656 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:24.117559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6805db2-0575-4e1c-87da-b099e5e5c656 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:24.118243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6805db2-0575-4e1c-87da-b099e5e5c656 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:24.120075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6805db2-0575-4e1c-87da-b099e5e5c656 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:24.120748 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1062/2098] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:24.150964 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1037/2099] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:24.154769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20da67-f8b9-4bae-bcb7-e165692f5fc8 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:24.172592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20da67-f8b9-4bae-bcb7-e165692f5fc8 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:24.187765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b1d35-19f6-43fb-8bb1-35b2eb3a6487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:24.188485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b1d35-19f6-43fb-8bb1-35b2eb3a6487 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:24.188773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b1d35-19f6-43fb-8bb1-35b2eb3a6487 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:24.189050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b1d35-19f6-43fb-8bb1-35b2eb3a6487 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:24.189751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b1d35-19f6-43fb-8bb1-35b2eb3a6487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:24.191687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b1d35-19f6-43fb-8bb1-35b2eb3a6487 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:24.230894 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1063/2100] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:24 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:24.235023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6805db2-0575-4e1c-87da-b099e5e5c656 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:24.245754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6805db2-0575-4e1c-87da-b099e5e5c656 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:24.252558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8298d-fe88-4073-b4f0-a3089a8fa210 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:24.252840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8298d-fe88-4073-b4f0-a3089a8fa210 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:24.253127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8298d-fe88-4073-b4f0-a3089a8fa210 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:24.255443 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1064/2101] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:24.263298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f76003-73fd-4cb7-8b61-52d96f5169b5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:24.264232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f76003-73fd-4cb7-8b61-52d96f5169b5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:24.264232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f76003-73fd-4cb7-8b61-52d96f5169b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:24.288844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b3f76003-73fd-4cb7-8b61-52d96f5169b5 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:24.290230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b3f76003-73fd-4cb7-8b61-52d96f5169b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:24.335051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:24.355664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc47888-7b01-4c2c-9983-d8501f052ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:24.356204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc47888-7b01-4c2c-9983-d8501f052ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:24.356849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc47888-7b01-4c2c-9983-d8501f052ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:24.357250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc47888-7b01-4c2c-9983-d8501f052ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:24.358055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc47888-7b01-4c2c-9983-d8501f052ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:24.360304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc47888-7b01-4c2c-9983-d8501f052ad9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:24.408871 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1038/2102] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:24 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:24.415145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc47888-7b01-4c2c-9983-d8501f052ad9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:24.417854 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1065/2103] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:01:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:24.428403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc47888-7b01-4c2c-9983-d8501f052ad9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:24.433703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37310fea-0cb5-4df7-b506-072705fe51eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:24.434380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37310fea-0cb5-4df7-b506-072705fe51eb admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:24.434663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37310fea-0cb5-4df7-b506-072705fe51eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:24.435073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37310fea-0cb5-4df7-b506-072705fe51eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:24.435809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37310fea-0cb5-4df7-b506-072705fe51eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:24.437553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37310fea-0cb5-4df7-b506-072705fe51eb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:24.446406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f76003-73fd-4cb7-8b61-52d96f5169b5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:24.448515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b3f76003-73fd-4cb7-8b61-52d96f5169b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:24.470254 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1039/2104] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:24.471567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f76003-73fd-4cb7-8b61-52d96f5169b5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:24.472642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37310fea-0cb5-4df7-b506-072705fe51eb admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:24.487218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c033d9c-7a55-4498-acf1-889d6e3e8056 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:24.488080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c033d9c-7a55-4498-acf1-889d6e3e8056 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:24.488379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c033d9c-7a55-4498-acf1-889d6e3e8056 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:24.488657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c033d9c-7a55-4498-acf1-889d6e3e8056 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:24.502171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37310fea-0cb5-4df7-b506-072705fe51eb admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:24.511475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c033d9c-7a55-4498-acf1-889d6e3e8056 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:24.513250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c033d9c-7a55-4498-acf1-889d6e3e8056 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:24.515568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e74301-cb69-4942-b5cc-227b4e94b953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:24.516977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e74301-cb69-4942-b5cc-227b4e94b953 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:24.516977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e74301-cb69-4942-b5cc-227b4e94b953 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:24.517175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e74301-cb69-4942-b5cc-227b4e94b953 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:24.517904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e74301-cb69-4942-b5cc-227b4e94b953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:24.519512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e74301-cb69-4942-b5cc-227b4e94b953 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:24.545796 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1040/2105] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:24.545999 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1066/2106] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:01:24.547487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e74301-cb69-4942-b5cc-227b4e94b953 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:24.588261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e74301-cb69-4942-b5cc-227b4e94b953 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:24.620512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd576a-1caa-43ce-91c5-4580a93b29f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:24.620512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd576a-1caa-43ce-91c5-4580a93b29f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:24.620512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd576a-1caa-43ce-91c5-4580a93b29f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:24.620512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd576a-1caa-43ce-91c5-4580a93b29f1 admin admin] PATH_INFO: `/v3/projects/5bd447457aca466982c2f65274e1eea1/users/6369d76ef37b4bbeb203539d8017a222/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:24.642666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd576a-1caa-43ce-91c5-4580a93b29f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd447457aca466982c2f65274e1eea1, user_id=6369d76ef37b4bbeb203539d8017a222, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:24.647540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd576a-1caa-43ce-91c5-4580a93b29f1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:24.648797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f563be-0efe-4655-94b5-6bdff9ee46fc None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:24.649152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f563be-0efe-4655-94b5-6bdff9ee46fc None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:24.649440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f563be-0efe-4655-94b5-6bdff9ee46fc None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:24.651779 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1067/2107] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:24.656924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f563be-0efe-4655-94b5-6bdff9ee46fc None None] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:24.660245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a0f563be-0efe-4655-94b5-6bdff9ee46fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:24.687095 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1041/2108] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:24 2022] PUT /identity/v3/projects/5bd447457aca466982c2f65274e1eea1/users/6369d76ef37b4bbeb203539d8017a222/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:24.699964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ee7ea-ea38-46c3-ae9a-3c50ba4033a7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:24.701908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ee7ea-ea38-46c3-ae9a-3c50ba4033a7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:24.702188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ee7ea-ea38-46c3-ae9a-3c50ba4033a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:24.778456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-815ee7ea-ea38-46c3-ae9a-3c50ba4033a7 None None] MFA Rules not processed for user `6369d76ef37b4bbeb203539d8017a222`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:24.779739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-815ee7ea-ea38-46c3-ae9a-3c50ba4033a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:24.780894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:24.830767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f563be-0efe-4655-94b5-6bdff9ee46fc None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:24.832358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a0f563be-0efe-4655-94b5-6bdff9ee46fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:24.953671 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1042/2109] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:24.958543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ee7ea-ea38-46c3-ae9a-3c50ba4033a7 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:24.996613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f563be-0efe-4655-94b5-6bdff9ee46fc None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:25.005145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc3c69-da81-412a-b241-adf4258aca08 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d9c508420a4fb3ae0d932eb8f87173', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e2efb2af3f48f19c4753e0334144d2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:25.006102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc3c69-da81-412a-b241-adf4258aca08 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:25.006387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc3c69-da81-412a-b241-adf4258aca08 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:25.006668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc3c69-da81-412a-b241-adf4258aca08 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] PATH_INFO: `/v3/projects/2f742f03e6c14260b98b00f5c13438f0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:25.011540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc3c69-da81-412a-b241-adf4258aca08 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: Authorizing `identity:get_project(project_id=2f742f03e6c14260b98b00f5c13438f0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:25.013770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc3c69-da81-412a-b241-adf4258aca08 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:25.015808 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1068/2110] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:24 2022] GET /identity/v3/projects/2f742f03e6c14260b98b00f5c13438f0 => generated 381 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:01:25.165976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ee7ea-ea38-46c3-ae9a-3c50ba4033a7 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:25.174610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfb243-b7ee-49ba-bbb7-a0f6c7e68ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:25.175366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfb243-b7ee-49ba-bbb7-a0f6c7e68ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:25.175594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfb243-b7ee-49ba-bbb7-a0f6c7e68ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:25.175954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfb243-b7ee-49ba-bbb7-a0f6c7e68ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:25.176822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfb243-b7ee-49ba-bbb7-a0f6c7e68ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:25.178794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfb243-b7ee-49ba-bbb7-a0f6c7e68ea4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:25.258232 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1043/2111] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:24 2022] POST /identity/v3/projects => generated 379 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:01:25.261891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc3c69-da81-412a-b241-adf4258aca08 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:25.282298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc3c69-da81-412a-b241-adf4258aca08 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:25.327837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d15ac6-5a6f-47f3-abf3-dd2f91b75043 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:25.328381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d15ac6-5a6f-47f3-abf3-dd2f91b75043 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:25.328662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d15ac6-5a6f-47f3-abf3-dd2f91b75043 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:25.330424 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1044/2112] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:25.337255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d15ac6-5a6f-47f3-abf3-dd2f91b75043 None None] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:25.363725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:25.497217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411963c-db9d-4fb7-8809-bfe3063e45f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:25.498100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411963c-db9d-4fb7-8809-bfe3063e45f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:25.500479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411963c-db9d-4fb7-8809-bfe3063e45f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:25.500876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411963c-db9d-4fb7-8809-bfe3063e45f8 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:25.502161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411963c-db9d-4fb7-8809-bfe3063e45f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:25.506698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411963c-db9d-4fb7-8809-bfe3063e45f8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:25.518626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d15ac6-5a6f-47f3-abf3-dd2f91b75043 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:25.553142 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1069/2113] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:25 2022] POST /identity/v3/users => generated 296 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:25.568496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411963c-db9d-4fb7-8809-bfe3063e45f8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:25.613474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411963c-db9d-4fb7-8809-bfe3063e45f8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:25.635064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c73a39-5924-4eb1-8649-05925a301dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:25.639686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c73a39-5924-4eb1-8649-05925a301dcc admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:25.639966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c73a39-5924-4eb1-8649-05925a301dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:25.640723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c73a39-5924-4eb1-8649-05925a301dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:25.642208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c73a39-5924-4eb1-8649-05925a301dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:25.644685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c73a39-5924-4eb1-8649-05925a301dcc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:25.670640 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1070/2114] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:25.677146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c73a39-5924-4eb1-8649-05925a301dcc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:25.703892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c73a39-5924-4eb1-8649-05925a301dcc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:25.713460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d15ac6-5a6f-47f3-abf3-dd2f91b75043 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:25.717551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be58bcf-78be-4d87-8032-7218dd90042e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:25.718635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be58bcf-78be-4d87-8032-7218dd90042e admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:25.719111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be58bcf-78be-4d87-8032-7218dd90042e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:25.719554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be58bcf-78be-4d87-8032-7218dd90042e admin admin] PATH_INFO: `/v3/projects/ca07070903f8432d8cc630a386b129be/users/2a1c803f868344d19bfe75427060053d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:25.735088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c69b1-3b68-489f-a9bc-414a2dc77696 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d9c508420a4fb3ae0d932eb8f87173', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e2efb2af3f48f19c4753e0334144d2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:25.736081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c69b1-3b68-489f-a9bc-414a2dc77696 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:25.736373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c69b1-3b68-489f-a9bc-414a2dc77696 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:25.738959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c69b1-3b68-489f-a9bc-414a2dc77696 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] PATH_INFO: `/v3/projects/2f742f03e6c14260b98b00f5c13438f0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:25.741797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c69b1-3b68-489f-a9bc-414a2dc77696 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: Authorizing `identity:get_project(project_id=2f742f03e6c14260b98b00f5c13438f0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:25.744315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c69b1-3b68-489f-a9bc-414a2dc77696 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:25.753821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be58bcf-78be-4d87-8032-7218dd90042e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca07070903f8432d8cc630a386b129be, user_id=2a1c803f868344d19bfe75427060053d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:25.760667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be58bcf-78be-4d87-8032-7218dd90042e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:25.787188 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1045/2115] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:25 2022] GET /identity/v3/projects/2f742f03e6c14260b98b00f5c13438f0 => generated 381 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:25.789740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c69b1-3b68-489f-a9bc-414a2dc77696 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:25.793040 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1071/2116] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:25 2022] PUT /identity/v3/projects/ca07070903f8432d8cc630a386b129be/users/2a1c803f868344d19bfe75427060053d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:25.816633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c69b1-3b68-489f-a9bc-414a2dc77696 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:25.867353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43218f44-41b8-4402-9a35-b67c34adbf99 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:25.867644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43218f44-41b8-4402-9a35-b67c34adbf99 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:25.868222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43218f44-41b8-4402-9a35-b67c34adbf99 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:25.874875 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1072/2117] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 21:01:25.912863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43218f44-41b8-4402-9a35-b67c34adbf99 None None] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:26.018243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b285a45-551b-428f-a6f7-be24225096f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:26.019108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b285a45-551b-428f-a6f7-be24225096f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:26.019477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b285a45-551b-428f-a6f7-be24225096f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:26.020444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b285a45-551b-428f-a6f7-be24225096f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:26.022137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b285a45-551b-428f-a6f7-be24225096f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:26.026283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b285a45-551b-428f-a6f7-be24225096f3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:26.046819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:26.067427 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1046/2118] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:01:26.069533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b285a45-551b-428f-a6f7-be24225096f3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:26.093868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b285a45-551b-428f-a6f7-be24225096f3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:26.109513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cbc36-75ab-4963-8c49-2f86fee8fb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:26.113938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cbc36-75ab-4963-8c49-2f86fee8fb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:26.114995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cbc36-75ab-4963-8c49-2f86fee8fb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:26.115392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cbc36-75ab-4963-8c49-2f86fee8fb41 admin admin] PATH_INFO: `/v3/projects/ca07070903f8432d8cc630a386b129be/users/2a1c803f868344d19bfe75427060053d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:26.120004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cbc36-75ab-4963-8c49-2f86fee8fb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca07070903f8432d8cc630a386b129be, user_id=2a1c803f868344d19bfe75427060053d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:26.123959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43218f44-41b8-4402-9a35-b67c34adbf99 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:26.126419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cbc36-75ab-4963-8c49-2f86fee8fb41 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:26.159963 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1047/2119] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:26 2022] PUT /identity/v3/projects/ca07070903f8432d8cc630a386b129be/users/2a1c803f868344d19bfe75427060053d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:26.172596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3857c-ad9a-4d78-bab2-18e9ac77943d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:26.173541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3857c-ad9a-4d78-bab2-18e9ac77943d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:26.173541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3857c-ad9a-4d78-bab2-18e9ac77943d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:26.295989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43218f44-41b8-4402-9a35-b67c34adbf99 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:26.313221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c7c3857c-ad9a-4d78-bab2-18e9ac77943d None None] MFA Rules not processed for user `2a1c803f868344d19bfe75427060053d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:26.314967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c7c3857c-ad9a-4d78-bab2-18e9ac77943d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:26.404453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:26.430894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33265ed-c397-48bc-bf1b-d15119ecc028 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d9c508420a4fb3ae0d932eb8f87173', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e2efb2af3f48f19c4753e0334144d2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:26.431907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33265ed-c397-48bc-bf1b-d15119ecc028 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:26.432219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33265ed-c397-48bc-bf1b-d15119ecc028 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:26.432500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33265ed-c397-48bc-bf1b-d15119ecc028 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] PATH_INFO: `/v3/projects/2f742f03e6c14260b98b00f5c13438f0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:26.437585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33265ed-c397-48bc-bf1b-d15119ecc028 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: Authorizing `identity:get_project(project_id=2f742f03e6c14260b98b00f5c13438f0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:26.440184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33265ed-c397-48bc-bf1b-d15119ecc028 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:26.442139 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1073/2120] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:25 2022] GET /identity/v3/projects/2f742f03e6c14260b98b00f5c13438f0 => generated 381 bytes in 530 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:26.674687 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1048/2121] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:26.731944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b79b35-0dc8-4a87-bc4e-db90da198de6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:26.732291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b79b35-0dc8-4a87-bc4e-db90da198de6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:26.732576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b79b35-0dc8-4a87-bc4e-db90da198de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:26.767158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3857c-ad9a-4d78-bab2-18e9ac77943d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:26.768527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-55b79b35-0dc8-4a87-bc4e-db90da198de6 None None] MFA Rules not processed for user `4ce2e8e17cd74914b0c5391443f6d3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:26.769766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-55b79b35-0dc8-4a87-bc4e-db90da198de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:26.890442 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1074/2122] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:26.931187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3857c-ad9a-4d78-bab2-18e9ac77943d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:26.946567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70913c18-a88d-4ca8-a04d-9c471f75b651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:26.947624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70913c18-a88d-4ca8-a04d-9c471f75b651 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:26.949975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70913c18-a88d-4ca8-a04d-9c471f75b651 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:26.950420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70913c18-a88d-4ca8-a04d-9c471f75b651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:26.968700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70913c18-a88d-4ca8-a04d-9c471f75b651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:26.971837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70913c18-a88d-4ca8-a04d-9c471f75b651 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:26.990053 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1049/2123] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:01:27.516676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220332d8-c328-4543-9ced-0fa48c23e037 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:27.517158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220332d8-c328-4543-9ced-0fa48c23e037 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:27.517249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220332d8-c328-4543-9ced-0fa48c23e037 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:27.518870 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1075/2124] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:27.528403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70913c18-a88d-4ca8-a04d-9c471f75b651 service nova] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:01:27.548210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70913c18-a88d-4ca8-a04d-9c471f75b651 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:27.584302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70913c18-a88d-4ca8-a04d-9c471f75b651 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:27.596073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53f90f-3ab9-4182-b9f5-3043c92d9f4a tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53d9c508420a4fb3ae0d932eb8f87173', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1e2efb2af3f48f19c4753e0334144d2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:27.609609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53f90f-3ab9-4182-b9f5-3043c92d9f4a tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:27.610171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53f90f-3ab9-4182-b9f5-3043c92d9f4a tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:27.610658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53f90f-3ab9-4182-b9f5-3043c92d9f4a tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] PATH_INFO: `/v3/projects/2f742f03e6c14260b98b00f5c13438f0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:27.612298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53f90f-3ab9-4182-b9f5-3043c92d9f4a tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: Authorizing `identity:get_project(project_id=2f742f03e6c14260b98b00f5c13438f0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:27.615457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53f90f-3ab9-4182-b9f5-3043c92d9f4a tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:27.618387 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1050/2125] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:01:27 2022] GET /identity/v3/projects/2f742f03e6c14260b98b00f5c13438f0 => generated 381 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:27.841843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220332d8-c328-4543-9ced-0fa48c23e037 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:27.858996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53f90f-3ab9-4182-b9f5-3043c92d9f4a tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:27.861944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9a53f90f-3ab9-4182-b9f5-3043c92d9f4a tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:27.959335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:28.008611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220332d8-c328-4543-9ced-0fa48c23e037 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:28.020157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c15ef-db66-42cb-86d8-b3c9ebc41619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:28.021327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c15ef-db66-42cb-86d8-b3c9ebc41619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:28.021613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c15ef-db66-42cb-86d8-b3c9ebc41619 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:28.021887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c15ef-db66-42cb-86d8-b3c9ebc41619 admin admin] PATH_INFO: `/v3/users/6369d76ef37b4bbeb203539d8017a222` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:28.023194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c15ef-db66-42cb-86d8-b3c9ebc41619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6369d76ef37b4bbeb203539d8017a222)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:28.025609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c15ef-db66-42cb-86d8-b3c9ebc41619 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:28.042796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53f90f-3ab9-4182-b9f5-3043c92d9f4a tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:28.060822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df250f-f4f0-4783-904f-764b45c10816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:28.062259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df250f-f4f0-4783-904f-764b45c10816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:28.062618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df250f-f4f0-4783-904f-764b45c10816 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:28.062963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df250f-f4f0-4783-904f-764b45c10816 admin admin] PATH_INFO: `/v3/users/4ce2e8e17cd74914b0c5391443f6d3ec` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:28.064851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df250f-f4f0-4783-904f-764b45c10816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ce2e8e17cd74914b0c5391443f6d3ec)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:28.067228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df250f-f4f0-4783-904f-764b45c10816 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:28.137353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c40c15ef-db66-42cb-86d8-b3c9ebc41619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6369d76ef37b4bbeb203539d8017a222'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.144187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:28.165577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c40c15ef-db66-42cb-86d8-b3c9ebc41619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6369d76ef37b4bbeb203539d8017a222'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.166148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-73df250f-f4f0-4783-904f-764b45c10816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ce2e8e17cd74914b0c5391443f6d3ec'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.166301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c40c15ef-db66-42cb-86d8-b3c9ebc41619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6369d76ef37b4bbeb203539d8017a222'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.167751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c40c15ef-db66-42cb-86d8-b3c9ebc41619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6369d76ef37b4bbeb203539d8017a222'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.185685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-73df250f-f4f0-4783-904f-764b45c10816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ce2e8e17cd74914b0c5391443f6d3ec'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.194788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c40c15ef-db66-42cb-86d8-b3c9ebc41619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6369d76ef37b4bbeb203539d8017a222'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.196735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-73df250f-f4f0-4783-904f-764b45c10816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ce2e8e17cd74914b0c5391443f6d3ec'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.198116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-73df250f-f4f0-4783-904f-764b45c10816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ce2e8e17cd74914b0c5391443f6d3ec'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.199516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-73df250f-f4f0-4783-904f-764b45c10816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ce2e8e17cd74914b0c5391443f6d3ec'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.240109 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1051/2126] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:27 2022] DELETE /identity/v3/users/4ce2e8e17cd74914b0c5391443f6d3ec => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:28.241811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df250f-f4f0-4783-904f-764b45c10816 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:28.244031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-73df250f-f4f0-4783-904f-764b45c10816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:28.252521 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1076/2127] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:27 2022] DELETE /identity/v3/users/6369d76ef37b4bbeb203539d8017a222 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:28.254447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822832c4-ef62-4e04-b714-11ba7cf2eb53 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:28.255798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822832c4-ef62-4e04-b714-11ba7cf2eb53 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:28.256205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822832c4-ef62-4e04-b714-11ba7cf2eb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:28.286607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-822832c4-ef62-4e04-b714-11ba7cf2eb53 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:28.287839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-822832c4-ef62-4e04-b714-11ba7cf2eb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:28.465558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df250f-f4f0-4783-904f-764b45c10816 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:28.471536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbe575-6cb6-40ec-b4af-ba68f55b385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:28.472022 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1077/2128] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:28.473352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbe575-6cb6-40ec-b4af-ba68f55b385c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:28.473770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbe575-6cb6-40ec-b4af-ba68f55b385c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:28.474201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbe575-6cb6-40ec-b4af-ba68f55b385c admin admin] PATH_INFO: `/v3/users/e895eba472f9403caf1c5036663af2ea` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:28.479725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e908e6-ec50-4791-8dc0-5fab75943603 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:28.479954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e908e6-ec50-4791-8dc0-5fab75943603 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:28.480351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e908e6-ec50-4791-8dc0-5fab75943603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:28.483032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbe575-6cb6-40ec-b4af-ba68f55b385c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e895eba472f9403caf1c5036663af2ea)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:28.486715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbe575-6cb6-40ec-b4af-ba68f55b385c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:28.513549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-85e908e6-ec50-4791-8dc0-5fab75943603 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:28.516551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-85e908e6-ec50-4791-8dc0-5fab75943603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:28.535335 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1078/2129] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:28.536920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e908e6-ec50-4791-8dc0-5fab75943603 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:28.542560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-85e908e6-ec50-4791-8dc0-5fab75943603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:28.572135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e908e6-ec50-4791-8dc0-5fab75943603 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:28.585263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f83cc-6fac-472b-990c-8f2cf887021c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:28.586518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f83cc-6fac-472b-990c-8f2cf887021c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:28.586965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f83cc-6fac-472b-990c-8f2cf887021c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:28.587377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f83cc-6fac-472b-990c-8f2cf887021c admin admin] PATH_INFO: `/v3/users/e702dd5bbb544dc986c503b54436811c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:28.588766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f83cc-6fac-472b-990c-8f2cf887021c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e702dd5bbb544dc986c503b54436811c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:28.597450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f83cc-6fac-472b-990c-8f2cf887021c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:28.621393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24bbe575-6cb6-40ec-b4af-ba68f55b385c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e895eba472f9403caf1c5036663af2ea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.641252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24bbe575-6cb6-40ec-b4af-ba68f55b385c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e895eba472f9403caf1c5036663af2ea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.669077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24bbe575-6cb6-40ec-b4af-ba68f55b385c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e895eba472f9403caf1c5036663af2ea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.670082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24bbe575-6cb6-40ec-b4af-ba68f55b385c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e895eba472f9403caf1c5036663af2ea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.671385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24bbe575-6cb6-40ec-b4af-ba68f55b385c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e895eba472f9403caf1c5036663af2ea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.710763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:28.718572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7e4f83cc-6fac-472b-990c-8f2cf887021c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e702dd5bbb544dc986c503b54436811c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.722752 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1052/2130] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:28 2022] DELETE /identity/v3/users/e895eba472f9403caf1c5036663af2ea => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:28.723624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbe575-6cb6-40ec-b4af-ba68f55b385c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:28.727107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-24bbe575-6cb6-40ec-b4af-ba68f55b385c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:28.739635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7e4f83cc-6fac-472b-990c-8f2cf887021c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e702dd5bbb544dc986c503b54436811c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.740580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7e4f83cc-6fac-472b-990c-8f2cf887021c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e702dd5bbb544dc986c503b54436811c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.741357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7e4f83cc-6fac-472b-990c-8f2cf887021c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e702dd5bbb544dc986c503b54436811c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.754765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7e4f83cc-6fac-472b-990c-8f2cf887021c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e702dd5bbb544dc986c503b54436811c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:28.792814 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1079/2131] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:28 2022] DELETE /identity/v3/users/e702dd5bbb544dc986c503b54436811c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:28.795443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f83cc-6fac-472b-990c-8f2cf887021c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:28.797103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7e4f83cc-6fac-472b-990c-8f2cf887021c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:28.882082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:28.901718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f83cc-6fac-472b-990c-8f2cf887021c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:28.912049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868bf6d-2cb1-490d-8b56-f3d09c0ed95b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:28.912890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868bf6d-2cb1-490d-8b56-f3d09c0ed95b service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:28.913250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868bf6d-2cb1-490d-8b56-f3d09c0ed95b service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:28.913621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868bf6d-2cb1-490d-8b56-f3d09c0ed95b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:28.926136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b868bf6d-2cb1-490d-8b56-f3d09c0ed95b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:28.953497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbe575-6cb6-40ec-b4af-ba68f55b385c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:28.960944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb9a77-a3d4-44f0-bfc8-1f6fb11ed4fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:28.961867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb9a77-a3d4-44f0-bfc8-1f6fb11ed4fe service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:28.962200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb9a77-a3d4-44f0-bfc8-1f6fb11ed4fe service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:28.962518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb9a77-a3d4-44f0-bfc8-1f6fb11ed4fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:28.974062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-87bb9a77-a3d4-44f0-bfc8-1f6fb11ed4fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:29.069497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868bf6d-2cb1-490d-8b56-f3d09c0ed95b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:29.071480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868bf6d-2cb1-490d-8b56-f3d09c0ed95b service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:29.103268 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1080/2132] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:29.110305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226844a-3cbb-4038-bf40-2663be92dc70 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:29.110914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226844a-3cbb-4038-bf40-2663be92dc70 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:29.111128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226844a-3cbb-4038-bf40-2663be92dc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:29.148391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb9a77-a3d4-44f0-bfc8-1f6fb11ed4fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:29.151024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb9a77-a3d4-44f0-bfc8-1f6fb11ed4fe service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:29.158956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2226844a-3cbb-4038-bf40-2663be92dc70 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:29.161618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2226844a-3cbb-4038-bf40-2663be92dc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:29.188375 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1053/2133] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:29.191338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9fb8b-62c5-4161-bf4a-a602b397f2ef None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:29.191960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9fb8b-62c5-4161-bf4a-a602b397f2ef None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:29.192328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9fb8b-62c5-4161-bf4a-a602b397f2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:29.215323 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1081/2134] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:29.216925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa63d0-a9bc-4b89-9a37-bc9d07e23282 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:29.217214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa63d0-a9bc-4b89-9a37-bc9d07e23282 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:29.217502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa63d0-a9bc-4b89-9a37-bc9d07e23282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:29.222370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-68b9fb8b-62c5-4161-bf4a-a602b397f2ef None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:29.226416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-68b9fb8b-62c5-4161-bf4a-a602b397f2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:29.238134 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1054/2135] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:29.241235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9fb8b-62c5-4161-bf4a-a602b397f2ef None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:29.243060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-68b9fb8b-62c5-4161-bf4a-a602b397f2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:29.277324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9fb8b-62c5-4161-bf4a-a602b397f2ef None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:29.287087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b2fa63d0-a9bc-4b89-9a37-bc9d07e23282 None None] MFA Rules not processed for user `eb68afc30fd8403a82efa015738a776f`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:29.289171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b2fa63d0-a9bc-4b89-9a37-bc9d07e23282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:29.298516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe0dfc-95c2-4984-a2aa-7e6a33e4d90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:29.306338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe0dfc-95c2-4984-a2aa-7e6a33e4d90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:29.308622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe0dfc-95c2-4984-a2aa-7e6a33e4d90b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:29.309016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe0dfc-95c2-4984-a2aa-7e6a33e4d90b admin admin] PATH_INFO: `/v3/users/1815c9e136bb454ebe477a8452e42ca9` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:29.311184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe0dfc-95c2-4984-a2aa-7e6a33e4d90b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1815c9e136bb454ebe477a8452e42ca9)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:29.315057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe0dfc-95c2-4984-a2aa-7e6a33e4d90b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:29.436247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e0fe0dfc-95c2-4984-a2aa-7e6a33e4d90b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1815c9e136bb454ebe477a8452e42ca9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:29.439269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:29.455735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e0fe0dfc-95c2-4984-a2aa-7e6a33e4d90b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1815c9e136bb454ebe477a8452e42ca9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:29.474814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e0fe0dfc-95c2-4984-a2aa-7e6a33e4d90b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1815c9e136bb454ebe477a8452e42ca9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:29.475878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e0fe0dfc-95c2-4984-a2aa-7e6a33e4d90b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1815c9e136bb454ebe477a8452e42ca9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:29.476700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e0fe0dfc-95c2-4984-a2aa-7e6a33e4d90b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1815c9e136bb454ebe477a8452e42ca9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:29.498016 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1082/2136] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:29.498016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa63d0-a9bc-4b89-9a37-bc9d07e23282 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:29.498016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b2fa63d0-a9bc-4b89-9a37-bc9d07e23282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:29.505317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa63d0-a9bc-4b89-9a37-bc9d07e23282 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:29.517001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b7a2-f8b2-4e11-b64b-db4eec3d2942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:29.517959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b7a2-f8b2-4e11-b64b-db4eec3d2942 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:29.521236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b7a2-f8b2-4e11-b64b-db4eec3d2942 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:29.521753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b7a2-f8b2-4e11-b64b-db4eec3d2942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:29.527935 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1055/2137] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:29 2022] DELETE /identity/v3/users/1815c9e136bb454ebe477a8452e42ca9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:29.529115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe0dfc-95c2-4984-a2aa-7e6a33e4d90b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:29.531747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2020b7a2-f8b2-4e11-b64b-db4eec3d2942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:29.533872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e0fe0dfc-95c2-4984-a2aa-7e6a33e4d90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:29.573006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020b7a2-f8b2-4e11-b64b-db4eec3d2942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:29.574509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020b7a2-f8b2-4e11-b64b-db4eec3d2942 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:29.616337 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1083/2138] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:29.617853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6964dc-7aa6-4fa5-a592-b459bcbecf49 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:29.618156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6964dc-7aa6-4fa5-a592-b459bcbecf49 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:29.618438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6964dc-7aa6-4fa5-a592-b459bcbecf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:29.663493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2c6964dc-7aa6-4fa5-a592-b459bcbecf49 None None] MFA Rules not processed for user `f3287fb85c2343d686718d3c4aaa5c00`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:29.665908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2c6964dc-7aa6-4fa5-a592-b459bcbecf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:29.689567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:29.694922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe0dfc-95c2-4984-a2aa-7e6a33e4d90b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:29.700692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c2243-9749-4b95-8e78-ed14531ae55d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:29.701595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c2243-9749-4b95-8e78-ed14531ae55d service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:29.701990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c2243-9749-4b95-8e78-ed14531ae55d service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:29.702328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c2243-9749-4b95-8e78-ed14531ae55d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:29.705978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ef6c2243-9749-4b95-8e78-ed14531ae55d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:29.756207 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1084/2139] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:29.757246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6964dc-7aa6-4fa5-a592-b459bcbecf49 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:29.759540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2c6964dc-7aa6-4fa5-a592-b459bcbecf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:29.924896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6964dc-7aa6-4fa5-a592-b459bcbecf49 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:29.933227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848318e-f186-4763-bf54-5b710ce08a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:29.934648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848318e-f186-4763-bf54-5b710ce08a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:29.934944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848318e-f186-4763-bf54-5b710ce08a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:29.935277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848318e-f186-4763-bf54-5b710ce08a19 admin admin] PATH_INFO: `/v3/users/b62db007a28947abbb19e137f52472a0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:29.936817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848318e-f186-4763-bf54-5b710ce08a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b62db007a28947abbb19e137f52472a0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:29.939775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848318e-f186-4763-bf54-5b710ce08a19 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:29.943731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c2243-9749-4b95-8e78-ed14531ae55d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:29.948471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c2243-9749-4b95-8e78-ed14531ae55d service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:29.975646 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1056/2140] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:29.978787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6dfa5-4636-467c-9141-27ea3c657287 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:29.979197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6dfa5-4636-467c-9141-27ea3c657287 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:29.979559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6dfa5-4636-467c-9141-27ea3c657287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:30.002226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-18a6dfa5-4636-467c-9141-27ea3c657287 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:30.003541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-18a6dfa5-4636-467c-9141-27ea3c657287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:30.020373 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1057/2141] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:30.020373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6dfa5-4636-467c-9141-27ea3c657287 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:30.025964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-18a6dfa5-4636-467c-9141-27ea3c657287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:30.068319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f848318e-f186-4763-bf54-5b710ce08a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b62db007a28947abbb19e137f52472a0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.084531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f848318e-f186-4763-bf54-5b710ce08a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b62db007a28947abbb19e137f52472a0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.085312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f848318e-f186-4763-bf54-5b710ce08a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b62db007a28947abbb19e137f52472a0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.086232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f848318e-f186-4763-bf54-5b710ce08a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b62db007a28947abbb19e137f52472a0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.126972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f848318e-f186-4763-bf54-5b710ce08a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b62db007a28947abbb19e137f52472a0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.164772 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1085/2142] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:29 2022] DELETE /identity/v3/users/b62db007a28947abbb19e137f52472a0 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:30.168450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848318e-f186-4763-bf54-5b710ce08a19 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:30.184078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f848318e-f186-4763-bf54-5b710ce08a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:30.200502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:30.239990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6dfa5-4636-467c-9141-27ea3c657287 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:30.342142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848318e-f186-4763-bf54-5b710ce08a19 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:30.346710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130bdf6-cb0b-477a-86a3-df42d1d4457d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:30.347615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130bdf6-cb0b-477a-86a3-df42d1d4457d service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:30.348020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130bdf6-cb0b-477a-86a3-df42d1d4457d service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:30.348451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130bdf6-cb0b-477a-86a3-df42d1d4457d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:30.350937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7130bdf6-cb0b-477a-86a3-df42d1d4457d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:30.357720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447b54a-f198-408a-bba9-2e183a4d864c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:30.358608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447b54a-f198-408a-bba9-2e183a4d864c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:30.358893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447b54a-f198-408a-bba9-2e183a4d864c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:30.359169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447b54a-f198-408a-bba9-2e183a4d864c admin admin] PATH_INFO: `/v3/projects/2f742f03e6c14260b98b00f5c13438f0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:30.360744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447b54a-f198-408a-bba9-2e183a4d864c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f742f03e6c14260b98b00f5c13438f0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:30.364255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447b54a-f198-408a-bba9-2e183a4d864c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:30.390900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:30.425935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130bdf6-cb0b-477a-86a3-df42d1d4457d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:30.427678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130bdf6-cb0b-477a-86a3-df42d1d4457d service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:30.437010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b447b54a-f198-408a-bba9-2e183a4d864c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f742f03e6c14260b98b00f5c13438f0', 'request_id': 'req-b447b54a-f198-408a-bba9-2e183a4d864c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.442655 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1058/2143] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:30.443870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130bdf6-cb0b-477a-86a3-df42d1d4457d service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:30.449083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b447b54a-f198-408a-bba9-2e183a4d864c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f742f03e6c14260b98b00f5c13438f0', 'request_id': 'req-b447b54a-f198-408a-bba9-2e183a4d864c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.449389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7130bdf6-cb0b-477a-86a3-df42d1d4457d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:30.459401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b447b54a-f198-408a-bba9-2e183a4d864c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f742f03e6c14260b98b00f5c13438f0', 'request_id': 'req-b447b54a-f198-408a-bba9-2e183a4d864c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.477325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b447b54a-f198-408a-bba9-2e183a4d864c admin admin] The token cache is being invalidate because project 2f742f03e6c14260b98b00f5c13438f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:30.478043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b447b54a-f198-408a-bba9-2e183a4d864c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.478855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b447b54a-f198-408a-bba9-2e183a4d864c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.480777 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1086/2144] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:30 2022] DELETE /identity/v3/projects/2f742f03e6c14260b98b00f5c13438f0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:30.481877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447b54a-f198-408a-bba9-2e183a4d864c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:30.483245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b447b54a-f198-408a-bba9-2e183a4d864c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:30.483406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130bdf6-cb0b-477a-86a3-df42d1d4457d service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:30.557290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641731dd-6ada-40be-b45f-d145b73de5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:30.558303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641731dd-6ada-40be-b45f-d145b73de5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:30.558577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641731dd-6ada-40be-b45f-d145b73de5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:30.558852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641731dd-6ada-40be-b45f-d145b73de5ba admin admin] PATH_INFO: `/v3/projects/5bd447457aca466982c2f65274e1eea1` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:30.560059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641731dd-6ada-40be-b45f-d145b73de5ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd447457aca466982c2f65274e1eea1)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:30.561582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447b54a-f198-408a-bba9-2e183a4d864c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:30.561985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641731dd-6ada-40be-b45f-d145b73de5ba admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:30.566235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982afea-7771-44d1-9e42-0f601dbb9bce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:30.566884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982afea-7771-44d1-9e42-0f601dbb9bce service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:30.567197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982afea-7771-44d1-9e42-0f601dbb9bce service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:30.567474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982afea-7771-44d1-9e42-0f601dbb9bce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:30.569541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0982afea-7771-44d1-9e42-0f601dbb9bce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:30.585675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982afea-7771-44d1-9e42-0f601dbb9bce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:30.587214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982afea-7771-44d1-9e42-0f601dbb9bce service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:30.601450 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1087/2145] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:30.603056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbe0a9-c82f-4ca3-8d10-c2d2fb414b53 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:30.603339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbe0a9-c82f-4ca3-8d10-c2d2fb414b53 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:30.603630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbe0a9-c82f-4ca3-8d10-c2d2fb414b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:30.623645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d1fbe0a9-c82f-4ca3-8d10-c2d2fb414b53 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:30.625296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d1fbe0a9-c82f-4ca3-8d10-c2d2fb414b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:30.626412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-641731dd-6ada-40be-b45f-d145b73de5ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd447457aca466982c2f65274e1eea1', 'request_id': 'req-641731dd-6ada-40be-b45f-d145b73de5ba'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.633953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-641731dd-6ada-40be-b45f-d145b73de5ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd447457aca466982c2f65274e1eea1', 'request_id': 'req-641731dd-6ada-40be-b45f-d145b73de5ba'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.642075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-641731dd-6ada-40be-b45f-d145b73de5ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd447457aca466982c2f65274e1eea1', 'request_id': 'req-641731dd-6ada-40be-b45f-d145b73de5ba'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.659689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-641731dd-6ada-40be-b45f-d145b73de5ba admin admin] The token cache is being invalidate because project 5bd447457aca466982c2f65274e1eea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:30.660243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-641731dd-6ada-40be-b45f-d145b73de5ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.660964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-641731dd-6ada-40be-b45f-d145b73de5ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.665561 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1059/2146] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:30 2022] DELETE /identity/v3/projects/5bd447457aca466982c2f65274e1eea1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:30.665561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641731dd-6ada-40be-b45f-d145b73de5ba admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:30.665807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:30.666128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-641731dd-6ada-40be-b45f-d145b73de5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:30.711111 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1088/2147] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:30.715494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbe0a9-c82f-4ca3-8d10-c2d2fb414b53 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:30.724456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d1fbe0a9-c82f-4ca3-8d10-c2d2fb414b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:30.738202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbe0a9-c82f-4ca3-8d10-c2d2fb414b53 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:30.745793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df7de7-3a83-45e1-89dd-8b2b9b9965f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:30.748201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df7de7-3a83-45e1-89dd-8b2b9b9965f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:30.748496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df7de7-3a83-45e1-89dd-8b2b9b9965f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:30.748859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df7de7-3a83-45e1-89dd-8b2b9b9965f2 admin admin] PATH_INFO: `/v3/projects/5ca9141ebaeb4f53af10810f11950dbe` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:30.751252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df7de7-3a83-45e1-89dd-8b2b9b9965f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca9141ebaeb4f53af10810f11950dbe)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:30.753005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:30.754542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df7de7-3a83-45e1-89dd-8b2b9b9965f2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:30.757053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641731dd-6ada-40be-b45f-d145b73de5ba admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:30.763253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b87b2-0cba-4ba0-831c-f11ade14dcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:30.764409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b87b2-0cba-4ba0-831c-f11ade14dcdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:30.764943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b87b2-0cba-4ba0-831c-f11ade14dcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:30.765311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b87b2-0cba-4ba0-831c-f11ade14dcdb admin admin] PATH_INFO: `/v3/users/8f03e55928514c9c99289d5002af5349` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:30.767366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b87b2-0cba-4ba0-831c-f11ade14dcdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f03e55928514c9c99289d5002af5349)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:30.770375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b87b2-0cba-4ba0-831c-f11ade14dcdb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:30.829375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cf8b87b2-0cba-4ba0-831c-f11ade14dcdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f03e55928514c9c99289d5002af5349'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.835256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-12df7de7-3a83-45e1-89dd-8b2b9b9965f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca9141ebaeb4f53af10810f11950dbe', 'request_id': 'req-12df7de7-3a83-45e1-89dd-8b2b9b9965f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.842575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cf8b87b2-0cba-4ba0-831c-f11ade14dcdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f03e55928514c9c99289d5002af5349'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.849119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-12df7de7-3a83-45e1-89dd-8b2b9b9965f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca9141ebaeb4f53af10810f11950dbe', 'request_id': 'req-12df7de7-3a83-45e1-89dd-8b2b9b9965f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.856705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cf8b87b2-0cba-4ba0-831c-f11ade14dcdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f03e55928514c9c99289d5002af5349'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.857649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cf8b87b2-0cba-4ba0-831c-f11ade14dcdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f03e55928514c9c99289d5002af5349'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.858424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cf8b87b2-0cba-4ba0-831c-f11ade14dcdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f03e55928514c9c99289d5002af5349'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.860417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-12df7de7-3a83-45e1-89dd-8b2b9b9965f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca9141ebaeb4f53af10810f11950dbe', 'request_id': 'req-12df7de7-3a83-45e1-89dd-8b2b9b9965f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.874866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-12df7de7-3a83-45e1-89dd-8b2b9b9965f2 admin admin] The token cache is being invalidate because project 5ca9141ebaeb4f53af10810f11950dbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:30.875082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-12df7de7-3a83-45e1-89dd-8b2b9b9965f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.876179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-12df7de7-3a83-45e1-89dd-8b2b9b9965f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:30.883607 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1089/2148] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:30 2022] DELETE /identity/v3/projects/5ca9141ebaeb4f53af10810f11950dbe => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:30.884668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df7de7-3a83-45e1-89dd-8b2b9b9965f2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:30.886523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-12df7de7-3a83-45e1-89dd-8b2b9b9965f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:30.888660 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1060/2149] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:30 2022] DELETE /identity/v3/users/8f03e55928514c9c99289d5002af5349 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:30.890392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b87b2-0cba-4ba0-831c-f11ade14dcdb admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:30.892353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cf8b87b2-0cba-4ba0-831c-f11ade14dcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:30.978398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df7de7-3a83-45e1-89dd-8b2b9b9965f2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:30.984275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed601cd-9b14-4b51-a6ce-a1fcfc09008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:30.985606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed601cd-9b14-4b51-a6ce-a1fcfc09008d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:30.986036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed601cd-9b14-4b51-a6ce-a1fcfc09008d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:30.986321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed601cd-9b14-4b51-a6ce-a1fcfc09008d admin admin] PATH_INFO: `/v3/projects/4e2b38c57ff74555a00cd95b06028b3f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:30.987504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b87b2-0cba-4ba0-831c-f11ade14dcdb admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:30.987644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed601cd-9b14-4b51-a6ce-a1fcfc09008d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e2b38c57ff74555a00cd95b06028b3f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:30.989535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed601cd-9b14-4b51-a6ce-a1fcfc09008d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:30.993286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74c8bf-e2c4-47d4-8781-2109f1d962c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:30.994816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74c8bf-e2c4-47d4-8781-2109f1d962c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:30.995203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74c8bf-e2c4-47d4-8781-2109f1d962c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:30.995587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74c8bf-e2c4-47d4-8781-2109f1d962c3 admin admin] PATH_INFO: `/v3/users/53d9c508420a4fb3ae0d932eb8f87173` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:30.997469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74c8bf-e2c4-47d4-8781-2109f1d962c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d9c508420a4fb3ae0d932eb8f87173)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:31.000153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74c8bf-e2c4-47d4-8781-2109f1d962c3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:31.058099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eed601cd-9b14-4b51-a6ce-a1fcfc09008d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e2b38c57ff74555a00cd95b06028b3f', 'request_id': 'req-eed601cd-9b14-4b51-a6ce-a1fcfc09008d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.069023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8c74c8bf-e2c4-47d4-8781-2109f1d962c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d9c508420a4fb3ae0d932eb8f87173'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.069339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eed601cd-9b14-4b51-a6ce-a1fcfc09008d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e2b38c57ff74555a00cd95b06028b3f', 'request_id': 'req-eed601cd-9b14-4b51-a6ce-a1fcfc09008d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.079467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eed601cd-9b14-4b51-a6ce-a1fcfc09008d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e2b38c57ff74555a00cd95b06028b3f', 'request_id': 'req-eed601cd-9b14-4b51-a6ce-a1fcfc09008d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.081158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:31.094965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8c74c8bf-e2c4-47d4-8781-2109f1d962c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d9c508420a4fb3ae0d932eb8f87173'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.105918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eed601cd-9b14-4b51-a6ce-a1fcfc09008d admin admin] The token cache is being invalidate because project 4e2b38c57ff74555a00cd95b06028b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:31.107951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eed601cd-9b14-4b51-a6ce-a1fcfc09008d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.109835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eed601cd-9b14-4b51-a6ce-a1fcfc09008d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.113884 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1090/2150] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:30 2022] DELETE /identity/v3/projects/4e2b38c57ff74555a00cd95b06028b3f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:31.115492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8c74c8bf-e2c4-47d4-8781-2109f1d962c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d9c508420a4fb3ae0d932eb8f87173'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.116101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed601cd-9b14-4b51-a6ce-a1fcfc09008d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:31.117664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8c74c8bf-e2c4-47d4-8781-2109f1d962c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d9c508420a4fb3ae0d932eb8f87173'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.118709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-eed601cd-9b14-4b51-a6ce-a1fcfc09008d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:31.120229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8c74c8bf-e2c4-47d4-8781-2109f1d962c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d9c508420a4fb3ae0d932eb8f87173'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.162229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:31.186197 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1061/2151] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:30 2022] DELETE /identity/v3/users/53d9c508420a4fb3ae0d932eb8f87173 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:31.187468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74c8bf-e2c4-47d4-8781-2109f1d962c3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:31.196818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8c74c8bf-e2c4-47d4-8781-2109f1d962c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:31.261567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed601cd-9b14-4b51-a6ce-a1fcfc09008d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:31.293806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74c8bf-e2c4-47d4-8781-2109f1d962c3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:31.298639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbbbd3-6755-4177-934a-b8095b20e8e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:31.299309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbbbd3-6755-4177-934a-b8095b20e8e1 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:31.299592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbbbd3-6755-4177-934a-b8095b20e8e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:31.299868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbbbd3-6755-4177-934a-b8095b20e8e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:31.303577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5dbbbbd3-6755-4177-934a-b8095b20e8e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:31.333550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf51155-ebd3-4b2a-8f91-8fbd5988fdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:31.335120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf51155-ebd3-4b2a-8f91-8fbd5988fdf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:31.335501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf51155-ebd3-4b2a-8f91-8fbd5988fdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:31.335872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf51155-ebd3-4b2a-8f91-8fbd5988fdf0 admin admin] PATH_INFO: `/v3/users/2a1c803f868344d19bfe75427060053d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:31.337538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf51155-ebd3-4b2a-8f91-8fbd5988fdf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1c803f868344d19bfe75427060053d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:31.339883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf51155-ebd3-4b2a-8f91-8fbd5988fdf0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:31.402419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbbbd3-6755-4177-934a-b8095b20e8e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:31.404800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbbbd3-6755-4177-934a-b8095b20e8e1 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:31.417280 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1062/2152] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:31.418715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfe4cf-c3ba-4c63-93ca-32a630382dfd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:31.418956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfe4cf-c3ba-4c63-93ca-32a630382dfd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:31.419222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfe4cf-c3ba-4c63-93ca-32a630382dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:31.420181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dbf51155-ebd3-4b2a-8f91-8fbd5988fdf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1c803f868344d19bfe75427060053d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.431695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dbf51155-ebd3-4b2a-8f91-8fbd5988fdf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1c803f868344d19bfe75427060053d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.432807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dbf51155-ebd3-4b2a-8f91-8fbd5988fdf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1c803f868344d19bfe75427060053d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.433997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dbf51155-ebd3-4b2a-8f91-8fbd5988fdf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1c803f868344d19bfe75427060053d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.442602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-86dfe4cf-c3ba-4c63-93ca-32a630382dfd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:31.444243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-86dfe4cf-c3ba-4c63-93ca-32a630382dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:31.446753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dbf51155-ebd3-4b2a-8f91-8fbd5988fdf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1c803f868344d19bfe75427060053d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.456771 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1063/2153] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:31.458150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433b70b-8f5f-4533-a859-04bdd91edc84 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:31.458442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433b70b-8f5f-4533-a859-04bdd91edc84 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:31.459178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433b70b-8f5f-4533-a859-04bdd91edc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:31.472146 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1091/2154] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:31 2022] DELETE /identity/v3/users/2a1c803f868344d19bfe75427060053d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:31.474036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f81093-d33c-45f6-a66d-49fcc4cf555f None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:31.474623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f81093-d33c-45f6-a66d-49fcc4cf555f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:31.475054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f81093-d33c-45f6-a66d-49fcc4cf555f None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:31.482049 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1092/2155] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:01:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:31.483735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f81093-d33c-45f6-a66d-49fcc4cf555f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:31.484285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a433b70b-8f5f-4533-a859-04bdd91edc84 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:31.486616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-98f81093-d33c-45f6-a66d-49fcc4cf555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:31.486932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a433b70b-8f5f-4533-a859-04bdd91edc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:31.512080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:31.558669 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1064/2156] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:31.559343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433b70b-8f5f-4533-a859-04bdd91edc84 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:31.561285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a433b70b-8f5f-4533-a859-04bdd91edc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:31.576894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433b70b-8f5f-4533-a859-04bdd91edc84 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:31.584566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80575b3a-0b56-4e71-8a4a-19516eeadc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:31.585511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80575b3a-0b56-4e71-8a4a-19516eeadc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:31.585793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80575b3a-0b56-4e71-8a4a-19516eeadc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:31.586133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80575b3a-0b56-4e71-8a4a-19516eeadc06 admin admin] PATH_INFO: `/v3/projects/5be6d9bc1b374279aa2861c0d18a1b46` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:31.587522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80575b3a-0b56-4e71-8a4a-19516eeadc06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5be6d9bc1b374279aa2861c0d18a1b46)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:31.590150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80575b3a-0b56-4e71-8a4a-19516eeadc06 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:31.593624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f81093-d33c-45f6-a66d-49fcc4cf555f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:31.602114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b28c1c-aad0-4f17-a278-f23019bc65c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:31.604642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b28c1c-aad0-4f17-a278-f23019bc65c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:31.604930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b28c1c-aad0-4f17-a278-f23019bc65c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:31.605440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b28c1c-aad0-4f17-a278-f23019bc65c6 admin admin] PATH_INFO: `/v3/users/7e53321c71aa4b3fa7202e0137817cfb` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:31.608306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b28c1c-aad0-4f17-a278-f23019bc65c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e53321c71aa4b3fa7202e0137817cfb)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:31.611451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b28c1c-aad0-4f17-a278-f23019bc65c6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:31.649109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:31.690476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-80575b3a-0b56-4e71-8a4a-19516eeadc06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5be6d9bc1b374279aa2861c0d18a1b46', 'request_id': 'req-80575b3a-0b56-4e71-8a4a-19516eeadc06'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.729400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-80575b3a-0b56-4e71-8a4a-19516eeadc06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5be6d9bc1b374279aa2861c0d18a1b46', 'request_id': 'req-80575b3a-0b56-4e71-8a4a-19516eeadc06'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.752635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-80575b3a-0b56-4e71-8a4a-19516eeadc06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5be6d9bc1b374279aa2861c0d18a1b46', 'request_id': 'req-80575b3a-0b56-4e71-8a4a-19516eeadc06'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.758819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-03b28c1c-aad0-4f17-a278-f23019bc65c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e53321c71aa4b3fa7202e0137817cfb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.771484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-03b28c1c-aad0-4f17-a278-f23019bc65c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e53321c71aa4b3fa7202e0137817cfb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.772666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-03b28c1c-aad0-4f17-a278-f23019bc65c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e53321c71aa4b3fa7202e0137817cfb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.773476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-03b28c1c-aad0-4f17-a278-f23019bc65c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e53321c71aa4b3fa7202e0137817cfb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.787630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-80575b3a-0b56-4e71-8a4a-19516eeadc06 admin admin] The token cache is being invalidate because project 5be6d9bc1b374279aa2861c0d18a1b46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:31.788158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-80575b3a-0b56-4e71-8a4a-19516eeadc06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.790313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-80575b3a-0b56-4e71-8a4a-19516eeadc06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.797563 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1065/2157] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:31 2022] DELETE /identity/v3/projects/5be6d9bc1b374279aa2861c0d18a1b46 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:31.797563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd994c8-1201-454d-90a6-3db3cf012ab3 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:31.797563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd994c8-1201-454d-90a6-3db3cf012ab3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:31.797563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd994c8-1201-454d-90a6-3db3cf012ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:31.814986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-03b28c1c-aad0-4f17-a278-f23019bc65c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e53321c71aa4b3fa7202e0137817cfb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:31.825700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6fd994c8-1201-454d-90a6-3db3cf012ab3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:31.841635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6fd994c8-1201-454d-90a6-3db3cf012ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:31.852080 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1093/2158] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:31 2022] DELETE /identity/v3/users/7e53321c71aa4b3fa7202e0137817cfb => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:31.855499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b53bb0-e262-4ce3-86dd-9af33ec2a4d0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:31.856025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b53bb0-e262-4ce3-86dd-9af33ec2a4d0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:31.856510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b53bb0-e262-4ce3-86dd-9af33ec2a4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:31.895544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-89b53bb0-e262-4ce3-86dd-9af33ec2a4d0 None None] MFA Rules not processed for user `684732cf5a004fb084ce0e523398c970`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:31.898608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-89b53bb0-e262-4ce3-86dd-9af33ec2a4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:31.975936 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1094/2159] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:01:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:31.985431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b53bb0-e262-4ce3-86dd-9af33ec2a4d0 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:31.987475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-89b53bb0-e262-4ce3-86dd-9af33ec2a4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:32.006322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b53bb0-e262-4ce3-86dd-9af33ec2a4d0 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:32.014349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cad1d5-be1b-412c-93fb-9e4ba8654b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:32.016094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cad1d5-be1b-412c-93fb-9e4ba8654b06 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:32.016677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cad1d5-be1b-412c-93fb-9e4ba8654b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:32.017081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cad1d5-be1b-412c-93fb-9e4ba8654b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:32.021027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-36cad1d5-be1b-412c-93fb-9e4ba8654b06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:32.039219 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1066/2160] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:32.041134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd994c8-1201-454d-90a6-3db3cf012ab3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:32.048466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6fd994c8-1201-454d-90a6-3db3cf012ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:32.077837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd994c8-1201-454d-90a6-3db3cf012ab3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:32.109816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:32.163237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cad1d5-be1b-412c-93fb-9e4ba8654b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:32.175520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8858ca0-6ed0-4a8c-aaed-9eb6c1347614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:32.176973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8858ca0-6ed0-4a8c-aaed-9eb6c1347614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:32.177320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8858ca0-6ed0-4a8c-aaed-9eb6c1347614 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:32.177677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8858ca0-6ed0-4a8c-aaed-9eb6c1347614 admin admin] PATH_INFO: `/v3/projects/a1e2efb2af3f48f19c4753e0334144d2` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:32.179268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8858ca0-6ed0-4a8c-aaed-9eb6c1347614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1e2efb2af3f48f19c4753e0334144d2)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:32.179371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cad1d5-be1b-412c-93fb-9e4ba8654b06 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:32.181987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8858ca0-6ed0-4a8c-aaed-9eb6c1347614 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:32.209578 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1095/2161] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:32.210474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cad1d5-be1b-412c-93fb-9e4ba8654b06 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:32.214922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-36cad1d5-be1b-412c-93fb-9e4ba8654b06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:32.243390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cad1d5-be1b-412c-93fb-9e4ba8654b06 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:32.257092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379ba43-980a-4128-ba02-98368975293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:32.260321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379ba43-980a-4128-ba02-98368975293e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:32.261201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379ba43-980a-4128-ba02-98368975293e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:32.262638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379ba43-980a-4128-ba02-98368975293e admin admin] PATH_INFO: `/v3/projects/347aae622773490aa3e8f0716b37d77e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:32.264510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379ba43-980a-4128-ba02-98368975293e admin admin] RBAC: Authorizing `identity:delete_project(project_id=347aae622773490aa3e8f0716b37d77e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:32.269757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379ba43-980a-4128-ba02-98368975293e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:32.294180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f8858ca0-6ed0-4a8c-aaed-9eb6c1347614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e2efb2af3f48f19c4753e0334144d2', 'request_id': 'req-f8858ca0-6ed0-4a8c-aaed-9eb6c1347614'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.309180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f8858ca0-6ed0-4a8c-aaed-9eb6c1347614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e2efb2af3f48f19c4753e0334144d2', 'request_id': 'req-f8858ca0-6ed0-4a8c-aaed-9eb6c1347614'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.324871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f8858ca0-6ed0-4a8c-aaed-9eb6c1347614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e2efb2af3f48f19c4753e0334144d2', 'request_id': 'req-f8858ca0-6ed0-4a8c-aaed-9eb6c1347614'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.329977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:32.359085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f8858ca0-6ed0-4a8c-aaed-9eb6c1347614 admin admin] The token cache is being invalidate because project a1e2efb2af3f48f19c4753e0334144d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:32.359471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f8858ca0-6ed0-4a8c-aaed-9eb6c1347614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.361455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f8858ca0-6ed0-4a8c-aaed-9eb6c1347614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.363635 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1067/2162] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:32 2022] DELETE /identity/v3/projects/a1e2efb2af3f48f19c4753e0334144d2 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:32.365632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8858ca0-6ed0-4a8c-aaed-9eb6c1347614 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:32.373004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f8858ca0-6ed0-4a8c-aaed-9eb6c1347614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:32.386918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f379ba43-980a-4128-ba02-98368975293e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '347aae622773490aa3e8f0716b37d77e', 'request_id': 'req-f379ba43-980a-4128-ba02-98368975293e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.398715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f379ba43-980a-4128-ba02-98368975293e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '347aae622773490aa3e8f0716b37d77e', 'request_id': 'req-f379ba43-980a-4128-ba02-98368975293e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.413125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f379ba43-980a-4128-ba02-98368975293e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '347aae622773490aa3e8f0716b37d77e', 'request_id': 'req-f379ba43-980a-4128-ba02-98368975293e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.438181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f379ba43-980a-4128-ba02-98368975293e admin admin] The token cache is being invalidate because project 347aae622773490aa3e8f0716b37d77e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:32.438889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f379ba43-980a-4128-ba02-98368975293e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.440202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f379ba43-980a-4128-ba02-98368975293e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.442304 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1096/2163] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:32 2022] DELETE /identity/v3/projects/347aae622773490aa3e8f0716b37d77e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:32.444767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379ba43-980a-4128-ba02-98368975293e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:32.449973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f379ba43-980a-4128-ba02-98368975293e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:32.496832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8858ca0-6ed0-4a8c-aaed-9eb6c1347614 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:32.532019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379ba43-980a-4128-ba02-98368975293e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:32.545117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5c180-7306-4aa5-806e-9f034e5eddb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:32.546137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5c180-7306-4aa5-806e-9f034e5eddb7 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:32.546767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5c180-7306-4aa5-806e-9f034e5eddb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:32.547218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5c180-7306-4aa5-806e-9f034e5eddb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:32.549648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-18b5c180-7306-4aa5-806e-9f034e5eddb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:32.563221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5c180-7306-4aa5-806e-9f034e5eddb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:32.564968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5c180-7306-4aa5-806e-9f034e5eddb7 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:32.570540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee265b3-a6c6-44e1-9824-b78dc2023b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:32.571854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee265b3-a6c6-44e1-9824-b78dc2023b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:32.571854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee265b3-a6c6-44e1-9824-b78dc2023b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:32.572098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee265b3-a6c6-44e1-9824-b78dc2023b13 admin admin] PATH_INFO: `/v3/users/b9624a988b0342a082163fcfc034703c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:32.573408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee265b3-a6c6-44e1-9824-b78dc2023b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9624a988b0342a082163fcfc034703c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:32.575451 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1097/2164] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:32.576632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5c180-7306-4aa5-806e-9f034e5eddb7 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:32.576746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee265b3-a6c6-44e1-9824-b78dc2023b13 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:32.578637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-18b5c180-7306-4aa5-806e-9f034e5eddb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:32.596188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5c180-7306-4aa5-806e-9f034e5eddb7 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:32.602905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7953ab-128a-471b-8031-04fcef7451d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:32.604174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7953ab-128a-471b-8031-04fcef7451d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:32.604664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7953ab-128a-471b-8031-04fcef7451d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:32.605144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7953ab-128a-471b-8031-04fcef7451d4 admin admin] PATH_INFO: `/v3/projects/ca07070903f8432d8cc630a386b129be` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:32.606999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7953ab-128a-471b-8031-04fcef7451d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca07070903f8432d8cc630a386b129be)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:32.610310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7953ab-128a-471b-8031-04fcef7451d4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:32.641179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dee265b3-a6c6-44e1-9824-b78dc2023b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9624a988b0342a082163fcfc034703c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.652678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dee265b3-a6c6-44e1-9824-b78dc2023b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9624a988b0342a082163fcfc034703c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.669532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dee265b3-a6c6-44e1-9824-b78dc2023b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9624a988b0342a082163fcfc034703c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.670510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dee265b3-a6c6-44e1-9824-b78dc2023b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9624a988b0342a082163fcfc034703c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.670910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dee265b3-a6c6-44e1-9824-b78dc2023b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9624a988b0342a082163fcfc034703c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.699580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba7953ab-128a-471b-8031-04fcef7451d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca07070903f8432d8cc630a386b129be', 'request_id': 'req-ba7953ab-128a-471b-8031-04fcef7451d4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.718341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba7953ab-128a-471b-8031-04fcef7451d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca07070903f8432d8cc630a386b129be', 'request_id': 'req-ba7953ab-128a-471b-8031-04fcef7451d4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.718853 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1068/2165] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:32 2022] DELETE /identity/v3/users/b9624a988b0342a082163fcfc034703c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:32.722762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:32.723806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee265b3-a6c6-44e1-9824-b78dc2023b13 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:32.726000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dee265b3-a6c6-44e1-9824-b78dc2023b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:32.745312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba7953ab-128a-471b-8031-04fcef7451d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca07070903f8432d8cc630a386b129be', 'request_id': 'req-ba7953ab-128a-471b-8031-04fcef7451d4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.764021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:32.778956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba7953ab-128a-471b-8031-04fcef7451d4 admin admin] The token cache is being invalidate because project ca07070903f8432d8cc630a386b129be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:32.780594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba7953ab-128a-471b-8031-04fcef7451d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.784607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba7953ab-128a-471b-8031-04fcef7451d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:32.788930 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1098/2166] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:32 2022] DELETE /identity/v3/projects/ca07070903f8432d8cc630a386b129be => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:32.793527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1fea2-40a2-45ac-a240-ba8dfe55dedc None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:32.794639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1fea2-40a2-45ac-a240-ba8dfe55dedc None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:32.795787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1fea2-40a2-45ac-a240-ba8dfe55dedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:32.838626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-25b1fea2-40a2-45ac-a240-ba8dfe55dedc None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:32.844401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-25b1fea2-40a2-45ac-a240-ba8dfe55dedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:32.854109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee265b3-a6c6-44e1-9824-b78dc2023b13 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:32.860942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d8d0c-58f5-4f01-9309-01b4e68e7b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:32.861657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d8d0c-58f5-4f01-9309-01b4e68e7b8b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:32.861921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d8d0c-58f5-4f01-9309-01b4e68e7b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:32.862637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d8d0c-58f5-4f01-9309-01b4e68e7b8b admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:32.863558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d8d0c-58f5-4f01-9309-01b4e68e7b8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:32.864068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d8d0c-58f5-4f01-9309-01b4e68e7b8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:32.866089 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1099/2167] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:32.867379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1fea2-40a2-45ac-a240-ba8dfe55dedc None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:32.874818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-25b1fea2-40a2-45ac-a240-ba8dfe55dedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:32.875545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d8d0c-58f5-4f01-9309-01b4e68e7b8b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:32.903512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1fea2-40a2-45ac-a240-ba8dfe55dedc None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:32.918029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d1731-6b5f-4a4e-8b90-60f2495bd1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:32.919169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d1731-6b5f-4a4e-8b90-60f2495bd1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:32.919361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d1731-6b5f-4a4e-8b90-60f2495bd1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:32.920109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d1731-6b5f-4a4e-8b90-60f2495bd1ec admin admin] PATH_INFO: `/v3/projects/7ba02ab1c7994db9aa0d4ce4b3c84f97` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:32.922915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d1731-6b5f-4a4e-8b90-60f2495bd1ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba02ab1c7994db9aa0d4ce4b3c84f97)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:32.930170 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1069/2168] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:32.930799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d1731-6b5f-4a4e-8b90-60f2495bd1ec admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:32.932119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d8d0c-58f5-4f01-9309-01b4e68e7b8b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:32.936025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9d8d8d0c-58f5-4f01-9309-01b4e68e7b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:32.956403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d8d0c-58f5-4f01-9309-01b4e68e7b8b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:32.964630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff2863-c160-4e5a-af63-a52c6333d522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:32.965803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff2863-c160-4e5a-af63-a52c6333d522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:32.966097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff2863-c160-4e5a-af63-a52c6333d522 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:32.966375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff2863-c160-4e5a-af63-a52c6333d522 admin admin] PATH_INFO: `/v3/users/387ec92e4d4f4d909cd222a3d7070d0a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:32.967620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff2863-c160-4e5a-af63-a52c6333d522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=387ec92e4d4f4d909cd222a3d7070d0a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:32.983151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff2863-c160-4e5a-af63-a52c6333d522 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:33.085306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d09d1731-6b5f-4a4e-8b90-60f2495bd1ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba02ab1c7994db9aa0d4ce4b3c84f97', 'request_id': 'req-d09d1731-6b5f-4a4e-8b90-60f2495bd1ec'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:33.112658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d09d1731-6b5f-4a4e-8b90-60f2495bd1ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba02ab1c7994db9aa0d4ce4b3c84f97', 'request_id': 'req-d09d1731-6b5f-4a4e-8b90-60f2495bd1ec'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:33.137322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21ff2863-c160-4e5a-af63-a52c6333d522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '387ec92e4d4f4d909cd222a3d7070d0a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:33.151616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d09d1731-6b5f-4a4e-8b90-60f2495bd1ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba02ab1c7994db9aa0d4ce4b3c84f97', 'request_id': 'req-d09d1731-6b5f-4a4e-8b90-60f2495bd1ec'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:33.153286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21ff2863-c160-4e5a-af63-a52c6333d522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '387ec92e4d4f4d909cd222a3d7070d0a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:33.171753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21ff2863-c160-4e5a-af63-a52c6333d522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '387ec92e4d4f4d909cd222a3d7070d0a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:33.172596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21ff2863-c160-4e5a-af63-a52c6333d522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '387ec92e4d4f4d909cd222a3d7070d0a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:33.173223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21ff2863-c160-4e5a-af63-a52c6333d522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '387ec92e4d4f4d909cd222a3d7070d0a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:33.178585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d09d1731-6b5f-4a4e-8b90-60f2495bd1ec admin admin] The token cache is being invalidate because project 7ba02ab1c7994db9aa0d4ce4b3c84f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:33.179158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d09d1731-6b5f-4a4e-8b90-60f2495bd1ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:33.183791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d09d1731-6b5f-4a4e-8b90-60f2495bd1ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:33.186008 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1100/2169] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:32 2022] DELETE /identity/v3/projects/7ba02ab1c7994db9aa0d4ce4b3c84f97 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:33.187727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b2804-57c2-41d8-b5ec-1f0c1d57cc73 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:33.188251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b2804-57c2-41d8-b5ec-1f0c1d57cc73 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:33.188824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b2804-57c2-41d8-b5ec-1f0c1d57cc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:33.222787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-089b2804-57c2-41d8-b5ec-1f0c1d57cc73 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:33.227487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-089b2804-57c2-41d8-b5ec-1f0c1d57cc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:33.265500 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1070/2170] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:32 2022] DELETE /identity/v3/users/387ec92e4d4f4d909cd222a3d7070d0a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:33.271656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1be72-756b-498f-879c-4ab0de9db915 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:33.272183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1be72-756b-498f-879c-4ab0de9db915 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:33.272712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1be72-756b-498f-879c-4ab0de9db915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:33.307455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a0f1be72-756b-498f-879c-4ab0de9db915 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:33.308728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a0f1be72-756b-498f-879c-4ab0de9db915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:33.352384 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1101/2171] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:33.353608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b2804-57c2-41d8-b5ec-1f0c1d57cc73 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:33.355047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-089b2804-57c2-41d8-b5ec-1f0c1d57cc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:33.369846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b2804-57c2-41d8-b5ec-1f0c1d57cc73 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:33.438790 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1071/2172] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:33.440819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1be72-756b-498f-879c-4ab0de9db915 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:33.442290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a0f1be72-756b-498f-879c-4ab0de9db915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:33.457629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1be72-756b-498f-879c-4ab0de9db915 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:33.466305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346b168-8949-4516-873e-588f824aacee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:33.466305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346b168-8949-4516-873e-588f824aacee admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:33.466667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346b168-8949-4516-873e-588f824aacee admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:33.466753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346b168-8949-4516-873e-588f824aacee admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:33.467448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346b168-8949-4516-873e-588f824aacee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:33.473210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346b168-8949-4516-873e-588f824aacee admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:33.540575 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1072/2173] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:33 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:33.546207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75a4ff-6c58-4971-ba01-941fb122d899 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:33.546563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75a4ff-6c58-4971-ba01-941fb122d899 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:33.546853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75a4ff-6c58-4971-ba01-941fb122d899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:33.558507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80805553-ba59-44dd-9dd6-de66917b46fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:33.559850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80805553-ba59-44dd-9dd6-de66917b46fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:33.560499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80805553-ba59-44dd-9dd6-de66917b46fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:33.561326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80805553-ba59-44dd-9dd6-de66917b46fe admin admin] PATH_INFO: `/v3/projects/60101912b2e94f7485de6b7adc5642c9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:33.567119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80805553-ba59-44dd-9dd6-de66917b46fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=60101912b2e94f7485de6b7adc5642c9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:33.575035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:33.582721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80805553-ba59-44dd-9dd6-de66917b46fe admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:33.597010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:33.614630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9f75a4ff-6c58-4971-ba01-941fb122d899 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:33.617490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9f75a4ff-6c58-4971-ba01-941fb122d899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:33.692427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-80805553-ba59-44dd-9dd6-de66917b46fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60101912b2e94f7485de6b7adc5642c9', 'request_id': 'req-80805553-ba59-44dd-9dd6-de66917b46fe'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:33.706311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-80805553-ba59-44dd-9dd6-de66917b46fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60101912b2e94f7485de6b7adc5642c9', 'request_id': 'req-80805553-ba59-44dd-9dd6-de66917b46fe'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:33.717449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-80805553-ba59-44dd-9dd6-de66917b46fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60101912b2e94f7485de6b7adc5642c9', 'request_id': 'req-80805553-ba59-44dd-9dd6-de66917b46fe'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:33.736529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-80805553-ba59-44dd-9dd6-de66917b46fe admin admin] The token cache is being invalidate because project 60101912b2e94f7485de6b7adc5642c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:33.736987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-80805553-ba59-44dd-9dd6-de66917b46fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:33.737548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-80805553-ba59-44dd-9dd6-de66917b46fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:33.739300 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1102/2174] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:33 2022] DELETE /identity/v3/projects/60101912b2e94f7485de6b7adc5642c9 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:33.748874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bff6d0-906e-4e49-ae5b-651452f0a88e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:33.748874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bff6d0-906e-4e49-ae5b-651452f0a88e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:33.748874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bff6d0-906e-4e49-ae5b-651452f0a88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:33.749300 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1073/2175] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:33.750708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75a4ff-6c58-4971-ba01-941fb122d899 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:33.772792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75a4ff-6c58-4971-ba01-941fb122d899 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:33.778969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b6bff6d0-906e-4e49-ae5b-651452f0a88e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:33.780249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b6bff6d0-906e-4e49-ae5b-651452f0a88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:33.858061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2042dd1-6e1f-460f-b76f-81034e1fae5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:33.858740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2042dd1-6e1f-460f-b76f-81034e1fae5f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:33.859025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2042dd1-6e1f-460f-b76f-81034e1fae5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:33.859297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2042dd1-6e1f-460f-b76f-81034e1fae5f admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:33.860025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2042dd1-6e1f-460f-b76f-81034e1fae5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:33.860363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2042dd1-6e1f-460f-b76f-81034e1fae5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:33.863188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2042dd1-6e1f-460f-b76f-81034e1fae5f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:33.877576 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1074/2176] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:33.878566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2042dd1-6e1f-460f-b76f-81034e1fae5f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:33.883186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d2042dd1-6e1f-460f-b76f-81034e1fae5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:33.901717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2042dd1-6e1f-460f-b76f-81034e1fae5f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:33.902298 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1103/2177] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:33.904435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bff6d0-906e-4e49-ae5b-651452f0a88e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:33.906923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b6bff6d0-906e-4e49-ae5b-651452f0a88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:33.908809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b415c5-c514-42b4-8cfd-4b5988512183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:33.909961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b415c5-c514-42b4-8cfd-4b5988512183 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:33.910645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b415c5-c514-42b4-8cfd-4b5988512183 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:33.911118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b415c5-c514-42b4-8cfd-4b5988512183 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:33.912205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b415c5-c514-42b4-8cfd-4b5988512183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:33.915490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b415c5-c514-42b4-8cfd-4b5988512183 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:33.922822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bff6d0-906e-4e49-ae5b-651452f0a88e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:33.929009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc7810-82af-429e-8c3c-a9f54edaabce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:33.930198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc7810-82af-429e-8c3c-a9f54edaabce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:33.930423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc7810-82af-429e-8c3c-a9f54edaabce admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:33.930687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc7810-82af-429e-8c3c-a9f54edaabce admin admin] PATH_INFO: `/v3/projects/a2ad02f18d5543ffa99bee36ec3c5feb` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:33.933567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc7810-82af-429e-8c3c-a9f54edaabce admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ad02f18d5543ffa99bee36ec3c5feb)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:33.936355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc7810-82af-429e-8c3c-a9f54edaabce admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:33.955302 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1075/2178] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:33 2022] POST /identity/v3/users => generated 290 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:33.955302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b415c5-c514-42b4-8cfd-4b5988512183 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:33.955779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e5b415c5-c514-42b4-8cfd-4b5988512183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:33.976072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b415c5-c514-42b4-8cfd-4b5988512183 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:33.981250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b51c7-a586-4431-9e20-4ff73706f9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:33.982259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b51c7-a586-4431-9e20-4ff73706f9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:33.982688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b51c7-a586-4431-9e20-4ff73706f9df admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:33.983057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b51c7-a586-4431-9e20-4ff73706f9df admin admin] PATH_INFO: `/v3/users/439030a81af2433b99277ebe210a0a9f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:33.985040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b51c7-a586-4431-9e20-4ff73706f9df admin admin] RBAC: Authorizing `identity:delete_user(user_id=439030a81af2433b99277ebe210a0a9f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:33.987417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b51c7-a586-4431-9e20-4ff73706f9df admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:34.011588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cecc7810-82af-429e-8c3c-a9f54edaabce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ad02f18d5543ffa99bee36ec3c5feb', 'request_id': 'req-cecc7810-82af-429e-8c3c-a9f54edaabce'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.023487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cecc7810-82af-429e-8c3c-a9f54edaabce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ad02f18d5543ffa99bee36ec3c5feb', 'request_id': 'req-cecc7810-82af-429e-8c3c-a9f54edaabce'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.033234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cecc7810-82af-429e-8c3c-a9f54edaabce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ad02f18d5543ffa99bee36ec3c5feb', 'request_id': 'req-cecc7810-82af-429e-8c3c-a9f54edaabce'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.048390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cecc7810-82af-429e-8c3c-a9f54edaabce admin admin] The token cache is being invalidate because project a2ad02f18d5543ffa99bee36ec3c5feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:34.048689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cecc7810-82af-429e-8c3c-a9f54edaabce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.049489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cecc7810-82af-429e-8c3c-a9f54edaabce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.049643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa4b51c7-a586-4431-9e20-4ff73706f9df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '439030a81af2433b99277ebe210a0a9f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.051584 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1104/2179] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:33 2022] DELETE /identity/v3/projects/a2ad02f18d5543ffa99bee36ec3c5feb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:34.052891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35973d6d-dd54-4ec7-b02d-17d7fe8768a3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:34.053180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35973d6d-dd54-4ec7-b02d-17d7fe8768a3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:34.053478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35973d6d-dd54-4ec7-b02d-17d7fe8768a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:34.068810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa4b51c7-a586-4431-9e20-4ff73706f9df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '439030a81af2433b99277ebe210a0a9f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.080164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-35973d6d-dd54-4ec7-b02d-17d7fe8768a3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:34.080379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa4b51c7-a586-4431-9e20-4ff73706f9df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '439030a81af2433b99277ebe210a0a9f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.080481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-35973d6d-dd54-4ec7-b02d-17d7fe8768a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:34.080573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa4b51c7-a586-4431-9e20-4ff73706f9df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '439030a81af2433b99277ebe210a0a9f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.080573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa4b51c7-a586-4431-9e20-4ff73706f9df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '439030a81af2433b99277ebe210a0a9f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.092643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:34.101514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:34.107124 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1076/2180] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:33 2022] DELETE /identity/v3/users/439030a81af2433b99277ebe210a0a9f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:34.108475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b51c7-a586-4431-9e20-4ff73706f9df admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:34.113134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fa4b51c7-a586-4431-9e20-4ff73706f9df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:34.174288 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1105/2181] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:34.175411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35973d6d-dd54-4ec7-b02d-17d7fe8768a3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:34.176819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-35973d6d-dd54-4ec7-b02d-17d7fe8768a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:34.194741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35973d6d-dd54-4ec7-b02d-17d7fe8768a3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:34.292670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b51c7-a586-4431-9e20-4ff73706f9df admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:34.297732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a993f53-0f2f-4add-ad28-c4329b1529f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:34.299354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a993f53-0f2f-4add-ad28-c4329b1529f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:34.299857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a993f53-0f2f-4add-ad28-c4329b1529f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:34.300422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a993f53-0f2f-4add-ad28-c4329b1529f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:34.301355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a993f53-0f2f-4add-ad28-c4329b1529f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:34.303634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a993f53-0f2f-4add-ad28-c4329b1529f9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:34.305973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb4862-c3ac-476e-b5db-ac4a23676b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:34.306880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb4862-c3ac-476e-b5db-ac4a23676b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:34.307167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb4862-c3ac-476e-b5db-ac4a23676b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:34.307501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb4862-c3ac-476e-b5db-ac4a23676b3f admin admin] PATH_INFO: `/v3/projects/a51f57a3bff440d3995b73b10d26ba63` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:34.310337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb4862-c3ac-476e-b5db-ac4a23676b3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a51f57a3bff440d3995b73b10d26ba63)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:34.314263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb4862-c3ac-476e-b5db-ac4a23676b3f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:34.351584 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1106/2182] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:34 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:34.352721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a993f53-0f2f-4add-ad28-c4329b1529f9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:34.356029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7a993f53-0f2f-4add-ad28-c4329b1529f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:34.397882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cfbb4862-c3ac-476e-b5db-ac4a23676b3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a51f57a3bff440d3995b73b10d26ba63', 'request_id': 'req-cfbb4862-c3ac-476e-b5db-ac4a23676b3f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.411738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cfbb4862-c3ac-476e-b5db-ac4a23676b3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a51f57a3bff440d3995b73b10d26ba63', 'request_id': 'req-cfbb4862-c3ac-476e-b5db-ac4a23676b3f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.421732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cfbb4862-c3ac-476e-b5db-ac4a23676b3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a51f57a3bff440d3995b73b10d26ba63', 'request_id': 'req-cfbb4862-c3ac-476e-b5db-ac4a23676b3f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.452719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cfbb4862-c3ac-476e-b5db-ac4a23676b3f admin admin] The token cache is being invalidate because project a51f57a3bff440d3995b73b10d26ba63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:34.453265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cfbb4862-c3ac-476e-b5db-ac4a23676b3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.455229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cfbb4862-c3ac-476e-b5db-ac4a23676b3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.459285 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1077/2183] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:34 2022] DELETE /identity/v3/projects/a51f57a3bff440d3995b73b10d26ba63 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:34.461202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb4862-c3ac-476e-b5db-ac4a23676b3f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:34.464623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cfbb4862-c3ac-476e-b5db-ac4a23676b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:34.515506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a993f53-0f2f-4add-ad28-c4329b1529f9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:34.590464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:34.606260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92d7a6-590d-4c95-9eda-3d40fb2c7589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:34.607084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92d7a6-590d-4c95-9eda-3d40fb2c7589 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:34.607387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92d7a6-590d-4c95-9eda-3d40fb2c7589 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:34.607733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92d7a6-590d-4c95-9eda-3d40fb2c7589 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:34.608680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92d7a6-590d-4c95-9eda-3d40fb2c7589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:34.609064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92d7a6-590d-4c95-9eda-3d40fb2c7589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:34.610852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92d7a6-590d-4c95-9eda-3d40fb2c7589 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:34.632524 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1107/2184] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:34.632524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21279ed-20d5-40f3-a59c-b436d4045ae3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:34.632524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21279ed-20d5-40f3-a59c-b436d4045ae3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:34.632524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21279ed-20d5-40f3-a59c-b436d4045ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:34.635176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb4862-c3ac-476e-b5db-ac4a23676b3f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:34.645379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39202a57-2958-43b9-83db-c72ece62df36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:34.646262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39202a57-2958-43b9-83db-c72ece62df36 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:34.646548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39202a57-2958-43b9-83db-c72ece62df36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:34.646824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39202a57-2958-43b9-83db-c72ece62df36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:34.647674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39202a57-2958-43b9-83db-c72ece62df36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:34.649499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39202a57-2958-43b9-83db-c72ece62df36 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:34.652543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b21279ed-20d5-40f3-a59c-b436d4045ae3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:34.654035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b21279ed-20d5-40f3-a59c-b436d4045ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:34.663073 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1108/2185] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:34.663766 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1078/2186] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:34.664220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21279ed-20d5-40f3-a59c-b436d4045ae3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:34.664605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39202a57-2958-43b9-83db-c72ece62df36 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:34.667057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-39202a57-2958-43b9-83db-c72ece62df36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:34.669484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b21279ed-20d5-40f3-a59c-b436d4045ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:34.682718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21279ed-20d5-40f3-a59c-b436d4045ae3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:34.687451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39202a57-2958-43b9-83db-c72ece62df36 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:34.689026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21c281-957f-4467-a8ce-641d691985f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:34.689802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21c281-957f-4467-a8ce-641d691985f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:34.690197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21c281-957f-4467-a8ce-641d691985f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:34.690477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21c281-957f-4467-a8ce-641d691985f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:34.691278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21c281-957f-4467-a8ce-641d691985f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:34.691581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21c281-957f-4467-a8ce-641d691985f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:34.692242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291ba5b-4a89-4c9f-a3e1-841050582758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:34.692924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291ba5b-4a89-4c9f-a3e1-841050582758 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:34.693333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291ba5b-4a89-4c9f-a3e1-841050582758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:34.693507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291ba5b-4a89-4c9f-a3e1-841050582758 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:34.693857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21c281-957f-4467-a8ce-641d691985f7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:34.696899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291ba5b-4a89-4c9f-a3e1-841050582758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:34.698788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291ba5b-4a89-4c9f-a3e1-841050582758 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:34.717536 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1109/2187] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:34.718952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997aca3-2a12-4f97-8589-32ac935df7d6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:34.719242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997aca3-2a12-4f97-8589-32ac935df7d6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:34.719519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997aca3-2a12-4f97-8589-32ac935df7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:34.728840 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1079/2188] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:34 2022] POST /identity/v3/users => generated 291 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:34.732803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291ba5b-4a89-4c9f-a3e1-841050582758 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:34.735266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6291ba5b-4a89-4c9f-a3e1-841050582758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:34.740893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4997aca3-2a12-4f97-8589-32ac935df7d6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:34.742500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4997aca3-2a12-4f97-8589-32ac935df7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:34.744431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:34.750782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291ba5b-4a89-4c9f-a3e1-841050582758 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:34.753121 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1110/2189] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:34.760813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997aca3-2a12-4f97-8589-32ac935df7d6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:34.762963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4997aca3-2a12-4f97-8589-32ac935df7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:34.768212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cf720-8275-4e38-b985-a9add08d53f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:34.769716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cf720-8275-4e38-b985-a9add08d53f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:34.770258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cf720-8275-4e38-b985-a9add08d53f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:34.770694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cf720-8275-4e38-b985-a9add08d53f9 admin admin] PATH_INFO: `/v3/projects/6d7d23bdd8554a3da2d3aebc900f105a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:34.772131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cf720-8275-4e38-b985-a9add08d53f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d7d23bdd8554a3da2d3aebc900f105a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:34.774088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cf720-8275-4e38-b985-a9add08d53f9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:34.777035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997aca3-2a12-4f97-8589-32ac935df7d6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:34.781723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09f442-4aba-41a3-97bf-caa4e575f4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:34.782415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09f442-4aba-41a3-97bf-caa4e575f4ee admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:34.782694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09f442-4aba-41a3-97bf-caa4e575f4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:34.782960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09f442-4aba-41a3-97bf-caa4e575f4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:34.783649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09f442-4aba-41a3-97bf-caa4e575f4ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:34.785606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09f442-4aba-41a3-97bf-caa4e575f4ee admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:34.813808 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1111/2190] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:34 2022] POST /identity/v3/projects => generated 389 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:34.814562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09f442-4aba-41a3-97bf-caa4e575f4ee admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:34.826135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c21cf720-8275-4e38-b985-a9add08d53f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d7d23bdd8554a3da2d3aebc900f105a', 'request_id': 'req-c21cf720-8275-4e38-b985-a9add08d53f9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.833210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c21cf720-8275-4e38-b985-a9add08d53f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d7d23bdd8554a3da2d3aebc900f105a', 'request_id': 'req-c21cf720-8275-4e38-b985-a9add08d53f9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.838960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c21cf720-8275-4e38-b985-a9add08d53f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d7d23bdd8554a3da2d3aebc900f105a', 'request_id': 'req-c21cf720-8275-4e38-b985-a9add08d53f9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.852032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c21cf720-8275-4e38-b985-a9add08d53f9 admin admin] The token cache is being invalidate because project 6d7d23bdd8554a3da2d3aebc900f105a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:34.852341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c21cf720-8275-4e38-b985-a9add08d53f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.852982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c21cf720-8275-4e38-b985-a9add08d53f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:34.854706 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1080/2191] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:34 2022] DELETE /identity/v3/projects/6d7d23bdd8554a3da2d3aebc900f105a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:34.856010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a8a88-2775-4d95-9c96-65cea98a6972 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:34.856329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a8a88-2775-4d95-9c96-65cea98a6972 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:34.856629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a8a88-2775-4d95-9c96-65cea98a6972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:34.875059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-666a8a88-2775-4d95-9c96-65cea98a6972 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:34.876312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-666a8a88-2775-4d95-9c96-65cea98a6972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:34.883153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09f442-4aba-41a3-97bf-caa4e575f4ee admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:34.884978 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1081/2192] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:34.888681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a8a88-2775-4d95-9c96-65cea98a6972 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:34.888681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-666a8a88-2775-4d95-9c96-65cea98a6972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:34.891669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4565a-0c5a-4b47-bf92-7a9931f43c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:34.892454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4565a-0c5a-4b47-bf92-7a9931f43c6b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:34.892725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4565a-0c5a-4b47-bf92-7a9931f43c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:34.893001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4565a-0c5a-4b47-bf92-7a9931f43c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:34.893727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4565a-0c5a-4b47-bf92-7a9931f43c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:34.895376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4565a-0c5a-4b47-bf92-7a9931f43c6b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:34.899143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a8a88-2775-4d95-9c96-65cea98a6972 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:34.904623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf1cb3-b757-4d9c-82a4-380e589877de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:34.905271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf1cb3-b757-4d9c-82a4-380e589877de admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:34.905552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf1cb3-b757-4d9c-82a4-380e589877de admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:34.905826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf1cb3-b757-4d9c-82a4-380e589877de admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:34.906056 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1112/2193] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:34.909417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf1cb3-b757-4d9c-82a4-380e589877de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:34.909512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4565a-0c5a-4b47-bf92-7a9931f43c6b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:34.909589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf1cb3-b757-4d9c-82a4-380e589877de admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:34.910568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9dc4565a-0c5a-4b47-bf92-7a9931f43c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:34.923343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4565a-0c5a-4b47-bf92-7a9931f43c6b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:34.928323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a20b6e-37ea-4492-9a0c-1471fd1342f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:34.929014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a20b6e-37ea-4492-9a0c-1471fd1342f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:34.929295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a20b6e-37ea-4492-9a0c-1471fd1342f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:34.929599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a20b6e-37ea-4492-9a0c-1471fd1342f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:34.930317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a20b6e-37ea-4492-9a0c-1471fd1342f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:34.933334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a20b6e-37ea-4492-9a0c-1471fd1342f0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:34.936821 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1082/2194] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:34 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:34.938095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02079a68-1ecb-457e-b5c5-f80974be233a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:34.938377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02079a68-1ecb-457e-b5c5-f80974be233a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:34.939098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02079a68-1ecb-457e-b5c5-f80974be233a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:34.944120 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1113/2195] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:34.944796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a20b6e-37ea-4492-9a0c-1471fd1342f0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:34.946667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-07a20b6e-37ea-4492-9a0c-1471fd1342f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:34.956742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-02079a68-1ecb-457e-b5c5-f80974be233a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:34.958273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-02079a68-1ecb-457e-b5c5-f80974be233a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:34.958898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a20b6e-37ea-4492-9a0c-1471fd1342f0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:35.021320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1cad6-7c15-4559-9762-6ddefc25fb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:35.022210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1cad6-7c15-4559-9762-6ddefc25fb3c admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.022498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1cad6-7c15-4559-9762-6ddefc25fb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.022788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1cad6-7c15-4559-9762-6ddefc25fb3c admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.023507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1cad6-7c15-4559-9762-6ddefc25fb3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:35.029062 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1083/2196] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:35.029194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1cad6-7c15-4559-9762-6ddefc25fb3c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:35.029276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a58fa-f47e-4c13-810f-26fdb134f44f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.029276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a58fa-f47e-4c13-810f-26fdb134f44f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.029276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a58fa-f47e-4c13-810f-26fdb134f44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.046510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bd9a58fa-f47e-4c13-810f-26fdb134f44f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:35.047971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bd9a58fa-f47e-4c13-810f-26fdb134f44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:35.055649 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1114/2197] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:34 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:35.055649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1cad6-7c15-4559-9762-6ddefc25fb3c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:35.060902 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1084/2198] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:35.063423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1cad6-7c15-4559-9762-6ddefc25fb3c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:35.068282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e94762-253c-41b9-b308-1591a584796b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:35.068888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e94762-253c-41b9-b308-1591a584796b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.069179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e94762-253c-41b9-b308-1591a584796b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.069456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e94762-253c-41b9-b308-1591a584796b admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.069778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a58fa-f47e-4c13-810f-26fdb134f44f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:35.070239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e94762-253c-41b9-b308-1591a584796b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:35.070547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e94762-253c-41b9-b308-1591a584796b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:35.071688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bd9a58fa-f47e-4c13-810f-26fdb134f44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:35.072242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e94762-253c-41b9-b308-1591a584796b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:35.081641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:35.091127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a58fa-f47e-4c13-810f-26fdb134f44f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:35.098042 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1115/2199] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:35.099497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e94762-253c-41b9-b308-1591a584796b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:35.105528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bd03c-920f-4473-b397-f95d663b3fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:35.106441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bd03c-920f-4473-b397-f95d663b3fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.107368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bd03c-920f-4473-b397-f95d663b3fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.107646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bd03c-920f-4473-b397-f95d663b3fa6 admin admin] PATH_INFO: `/v3/projects/753c958df79645c09e5b6e12fdc8b454/users/a8ae594a351c42d7a790c76efd50e305/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.110399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e94762-253c-41b9-b308-1591a584796b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:35.115057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4582-cdc6-4b54-9fab-a198fef42101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:35.115747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4582-cdc6-4b54-9fab-a198fef42101 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.116032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4582-cdc6-4b54-9fab-a198fef42101 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.116332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4582-cdc6-4b54-9fab-a198fef42101 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.117081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4582-cdc6-4b54-9fab-a198fef42101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:35.119017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4582-cdc6-4b54-9fab-a198fef42101 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:35.123216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bd03c-920f-4473-b397-f95d663b3fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=753c958df79645c09e5b6e12fdc8b454, user_id=a8ae594a351c42d7a790c76efd50e305, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:35.125900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bd03c-920f-4473-b397-f95d663b3fa6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:35.145799 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1085/2200] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:35 2022] PUT /identity/v3/projects/753c958df79645c09e5b6e12fdc8b454/users/a8ae594a351c42d7a790c76efd50e305/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:35.147709 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1116/2201] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:35 2022] POST /identity/v3/users => generated 300 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:35.148936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4582-cdc6-4b54-9fab-a198fef42101 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:35.155763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bd03c-920f-4473-b397-f95d663b3fa6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:35.168368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4582-cdc6-4b54-9fab-a198fef42101 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:35.188749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:35.247726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba347ca3-4fd1-46b3-bb08-df820af29393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:35.248549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba347ca3-4fd1-46b3-bb08-df820af29393 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.248906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba347ca3-4fd1-46b3-bb08-df820af29393 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.249256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba347ca3-4fd1-46b3-bb08-df820af29393 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.249396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bd03c-920f-4473-b397-f95d663b3fa6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:35.250268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba347ca3-4fd1-46b3-bb08-df820af29393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:35.250649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba347ca3-4fd1-46b3-bb08-df820af29393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:35.252479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba347ca3-4fd1-46b3-bb08-df820af29393 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:35.255952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ceb13e-7ed6-4ca3-9cd6-820033de52b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:35.256943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceb13e-7ed6-4ca3-9cd6-820033de52b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.257297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceb13e-7ed6-4ca3-9cd6-820033de52b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.257609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceb13e-7ed6-4ca3-9cd6-820033de52b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.258443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ceb13e-7ed6-4ca3-9cd6-820033de52b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:35.261974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ceb13e-7ed6-4ca3-9cd6-820033de52b9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:35.274664 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1117/2202] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:35.279054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba347ca3-4fd1-46b3-bb08-df820af29393 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:35.288246 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1086/2203] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:35.288709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05cbf3-5723-4c79-9717-d0071773ea02 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.289169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05cbf3-5723-4c79-9717-d0071773ea02 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.289455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05cbf3-5723-4c79-9717-d0071773ea02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.292278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba347ca3-4fd1-46b3-bb08-df820af29393 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:35.297183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dd2f6-4e62-4dd2-9a3e-a5ff20a7cb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:35.297900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dd2f6-4e62-4dd2-9a3e-a5ff20a7cb92 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.298189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dd2f6-4e62-4dd2-9a3e-a5ff20a7cb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.298464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dd2f6-4e62-4dd2-9a3e-a5ff20a7cb92 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.299184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dd2f6-4e62-4dd2-9a3e-a5ff20a7cb92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:35.300904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dd2f6-4e62-4dd2-9a3e-a5ff20a7cb92 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:35.308735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-be05cbf3-5723-4c79-9717-d0071773ea02 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:35.310194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-be05cbf3-5723-4c79-9717-d0071773ea02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:35.314611 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1118/2204] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:35.314611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dd2f6-4e62-4dd2-9a3e-a5ff20a7cb92 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:35.322168 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1087/2205] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:35.322168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05cbf3-5723-4c79-9717-d0071773ea02 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:35.327454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dd2f6-4e62-4dd2-9a3e-a5ff20a7cb92 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:35.329504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05cbf3-5723-4c79-9717-d0071773ea02 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:35.332208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f2f76-8310-4fd7-a148-de9e55119ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:35.332848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f2f76-8310-4fd7-a148-de9e55119ebc admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.333131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f2f76-8310-4fd7-a148-de9e55119ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.333405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f2f76-8310-4fd7-a148-de9e55119ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.334087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f2f76-8310-4fd7-a148-de9e55119ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:35.334221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f263c2-3945-4ec3-896c-b3a325fbf4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:35.334772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f263c2-3945-4ec3-896c-b3a325fbf4ac admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.335078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f263c2-3945-4ec3-896c-b3a325fbf4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.335344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f263c2-3945-4ec3-896c-b3a325fbf4ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.336128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f2f76-8310-4fd7-a148-de9e55119ebc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:35.336385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f263c2-3945-4ec3-896c-b3a325fbf4ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:35.337819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f263c2-3945-4ec3-896c-b3a325fbf4ac admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:35.347966 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1088/2206] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:35.349280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81947429-be42-4e53-ace2-29f9ec471269 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.349567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81947429-be42-4e53-ace2-29f9ec471269 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.349846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81947429-be42-4e53-ace2-29f9ec471269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.368225 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1119/2207] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:35 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:35.368225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f2f76-8310-4fd7-a148-de9e55119ebc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:35.380389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-81947429-be42-4e53-ace2-29f9ec471269 None None] MFA Rules not processed for user `a8ae594a351c42d7a790c76efd50e305`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:35.381619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-81947429-be42-4e53-ace2-29f9ec471269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:35.432817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f2f76-8310-4fd7-a148-de9e55119ebc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:35.437885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8ff24-fdc3-4f52-a680-c47099bb1309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:35.438537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8ff24-fdc3-4f52-a680-c47099bb1309 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.438836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8ff24-fdc3-4f52-a680-c47099bb1309 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.439230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8ff24-fdc3-4f52-a680-c47099bb1309 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.440069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8ff24-fdc3-4f52-a680-c47099bb1309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:35.441906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8ff24-fdc3-4f52-a680-c47099bb1309 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:35.456186 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1089/2208] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:35.457246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81947429-be42-4e53-ace2-29f9ec471269 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:35.471340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81947429-be42-4e53-ace2-29f9ec471269 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:35.476381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471efa4-087e-45d3-a418-db2d4534af0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:35.477532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471efa4-087e-45d3-a418-db2d4534af0d admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.477833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471efa4-087e-45d3-a418-db2d4534af0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.478172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471efa4-087e-45d3-a418-db2d4534af0d admin admin] PATH_INFO: `/v3/projects/065f852898294f2c8a154eb8d5f498f0/users/9ee93cc6740d4e92b231f60d8b9d4450/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.481305 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1120/2209] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:35 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:35.485359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8ff24-fdc3-4f52-a680-c47099bb1309 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:35.498263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471efa4-087e-45d3-a418-db2d4534af0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=065f852898294f2c8a154eb8d5f498f0, user_id=9ee93cc6740d4e92b231f60d8b9d4450, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:35.502399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471efa4-087e-45d3-a418-db2d4534af0d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:35.525150 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1090/2210] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:35 2022] PUT /identity/v3/projects/065f852898294f2c8a154eb8d5f498f0/users/9ee93cc6740d4e92b231f60d8b9d4450/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:35.525735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471efa4-087e-45d3-a418-db2d4534af0d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:35.538782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:35.633501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8ff24-fdc3-4f52-a680-c47099bb1309 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:35.640477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7b22d-ff42-42f0-aff2-33807fadeac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:35.641184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7b22d-ff42-42f0-aff2-33807fadeac1 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.641467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7b22d-ff42-42f0-aff2-33807fadeac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.641791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7b22d-ff42-42f0-aff2-33807fadeac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.642542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7b22d-ff42-42f0-aff2-33807fadeac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:35.643054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471efa4-087e-45d3-a418-db2d4534af0d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:35.644961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7b22d-ff42-42f0-aff2-33807fadeac1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:35.655147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca2614-183f-4e6e-839f-3363109bfbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:35.656158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca2614-183f-4e6e-839f-3363109bfbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.656597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca2614-183f-4e6e-839f-3363109bfbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.657113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca2614-183f-4e6e-839f-3363109bfbb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.658903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca2614-183f-4e6e-839f-3363109bfbb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:35.658903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca2614-183f-4e6e-839f-3363109bfbb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:35.676096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca2614-183f-4e6e-839f-3363109bfbb1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:35.685468 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1121/2211] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:35.686845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7b22d-ff42-42f0-aff2-33807fadeac1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:35.709206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7b22d-ff42-42f0-aff2-33807fadeac1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:35.721572 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1091/2212] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:35.729748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca2614-183f-4e6e-839f-3363109bfbb1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:35.730668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a72401-1dd4-4742-88cc-0ff438246788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:35.731831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72401-1dd4-4742-88cc-0ff438246788 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.732131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72401-1dd4-4742-88cc-0ff438246788 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.732426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72401-1dd4-4742-88cc-0ff438246788 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.733464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a72401-1dd4-4742-88cc-0ff438246788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:35.734964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a72401-1dd4-4742-88cc-0ff438246788 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:35.743954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:35.753911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca2614-183f-4e6e-839f-3363109bfbb1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:35.754611 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1122/2213] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:35.755984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a72401-1dd4-4742-88cc-0ff438246788 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:35.758319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-16a72401-1dd4-4742-88cc-0ff438246788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:35.767695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c8c87-5f18-45be-bb6b-9ffaa72565dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:35.767695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c8c87-5f18-45be-bb6b-9ffaa72565dc admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.767695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c8c87-5f18-45be-bb6b-9ffaa72565dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.767695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c8c87-5f18-45be-bb6b-9ffaa72565dc admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.768324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c8c87-5f18-45be-bb6b-9ffaa72565dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:35.769473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c8c87-5f18-45be-bb6b-9ffaa72565dc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:35.800507 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1092/2214] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:35 2022] POST /identity/v3/users => generated 292 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:35.800507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c8c87-5f18-45be-bb6b-9ffaa72565dc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:35.811484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c8c87-5f18-45be-bb6b-9ffaa72565dc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:35.835813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08190fdd-e184-47fa-b1ae-911b1a7ecb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:35.840927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08190fdd-e184-47fa-b1ae-911b1a7ecb80 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.841180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08190fdd-e184-47fa-b1ae-911b1a7ecb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.841483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08190fdd-e184-47fa-b1ae-911b1a7ecb80 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.842274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08190fdd-e184-47fa-b1ae-911b1a7ecb80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:35.844315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08190fdd-e184-47fa-b1ae-911b1a7ecb80 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:35.896340 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1093/2215] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:35 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:35.897010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a72401-1dd4-4742-88cc-0ff438246788 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:35.897128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4319b4-9591-4754-aa62-597825928f2a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.897128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4319b4-9591-4754-aa62-597825928f2a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.897128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4319b4-9591-4754-aa62-597825928f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.905345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acb68d-ea19-4d2d-b6ca-44b702ccd6cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:35.906355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acb68d-ea19-4d2d-b6ca-44b702ccd6cc service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:35.906623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acb68d-ea19-4d2d-b6ca-44b702ccd6cc service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:35.906906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acb68d-ea19-4d2d-b6ca-44b702ccd6cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:35.930815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ad4319b4-9591-4754-aa62-597825928f2a None None] MFA Rules not processed for user `9ee93cc6740d4e92b231f60d8b9d4450`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:35.932579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ad4319b4-9591-4754-aa62-597825928f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:35.998917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acb68d-ea19-4d2d-b6ca-44b702ccd6cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:36.000838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acb68d-ea19-4d2d-b6ca-44b702ccd6cc service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:36.014628 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1123/2216] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:36.018379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acb68d-ea19-4d2d-b6ca-44b702ccd6cc service glance] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:36.021458 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1094/2217] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:36.022448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4319b4-9591-4754-aa62-597825928f2a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:36.038660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4319b4-9591-4754-aa62-597825928f2a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:36.040973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acb68d-ea19-4d2d-b6ca-44b702ccd6cc service glance] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:36.043805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bb2f5-0a4c-4775-94c5-01099216a296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:36.044642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bb2f5-0a4c-4775-94c5-01099216a296 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:36.045019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bb2f5-0a4c-4775-94c5-01099216a296 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:36.045368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bb2f5-0a4c-4775-94c5-01099216a296 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:36.046150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bb2f5-0a4c-4775-94c5-01099216a296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:36.048358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bb2f5-0a4c-4775-94c5-01099216a296 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:36.051007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a43554-da0f-42fb-8c89-84eca334b843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:36.053347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a43554-da0f-42fb-8c89-84eca334b843 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:36.054854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a43554-da0f-42fb-8c89-84eca334b843 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:36.054854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a43554-da0f-42fb-8c89-84eca334b843 admin admin] PATH_INFO: `/v3/projects/eba90f0c20674772824b3286c46941d2/users/10cba2186f6343d98d0d69822ab8640b/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:36.101751 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1095/2218] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:36 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:36.103055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bb2f5-0a4c-4775-94c5-01099216a296 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:36.106337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a43554-da0f-42fb-8c89-84eca334b843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba90f0c20674772824b3286c46941d2, user_id=10cba2186f6343d98d0d69822ab8640b, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:36.110620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a43554-da0f-42fb-8c89-84eca334b843 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:36.133095 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1124/2219] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:36 2022] PUT /identity/v3/projects/eba90f0c20674772824b3286c46941d2/users/10cba2186f6343d98d0d69822ab8640b/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:36.135049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a43554-da0f-42fb-8c89-84eca334b843 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:36.197751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:36.211167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bb2f5-0a4c-4775-94c5-01099216a296 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:36.266452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a43554-da0f-42fb-8c89-84eca334b843 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:36.272078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4e750-ed3d-4aca-a180-3bb67962826b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:36.272767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4e750-ed3d-4aca-a180-3bb67962826b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:36.273029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4e750-ed3d-4aca-a180-3bb67962826b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:36.273321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4e750-ed3d-4aca-a180-3bb67962826b admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:36.274105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4e750-ed3d-4aca-a180-3bb67962826b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:36.276173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4e750-ed3d-4aca-a180-3bb67962826b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:36.284141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:36.296255 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1125/2220] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:36.296255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4e750-ed3d-4aca-a180-3bb67962826b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:36.306904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce29ca-11b5-4f2d-95b6-d9f983805220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:36.307850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce29ca-11b5-4f2d-95b6-d9f983805220 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:36.308194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce29ca-11b5-4f2d-95b6-d9f983805220 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:36.308449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce29ca-11b5-4f2d-95b6-d9f983805220 admin admin] PATH_INFO: `/v3/projects/a0c4b2443f764da8beae86f4c9f393b5/users/ee6053c662e94292a110de1b2b1b943d/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:36.310087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4e750-ed3d-4aca-a180-3bb67962826b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:36.317422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217c199-fae8-4922-bcd5-8578f4014ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:36.318188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217c199-fae8-4922-bcd5-8578f4014ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:36.319077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217c199-fae8-4922-bcd5-8578f4014ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:36.319438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217c199-fae8-4922-bcd5-8578f4014ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:36.321034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217c199-fae8-4922-bcd5-8578f4014ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:36.322115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217c199-fae8-4922-bcd5-8578f4014ba5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:36.327427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce29ca-11b5-4f2d-95b6-d9f983805220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c4b2443f764da8beae86f4c9f393b5, user_id=ee6053c662e94292a110de1b2b1b943d, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:36.331090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce29ca-11b5-4f2d-95b6-d9f983805220 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:36.334321 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1126/2221] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:36.335329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217c199-fae8-4922-bcd5-8578f4014ba5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:36.348401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217c199-fae8-4922-bcd5-8578f4014ba5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:36.349736 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1096/2222] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:36 2022] PUT /identity/v3/projects/a0c4b2443f764da8beae86f4c9f393b5/users/ee6053c662e94292a110de1b2b1b943d/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:36.357709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce29ca-11b5-4f2d-95b6-d9f983805220 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:36.429995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dca54-6a11-4f1f-9e7e-716fab7f69ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:36.431072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dca54-6a11-4f1f-9e7e-716fab7f69ea admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:36.431463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dca54-6a11-4f1f-9e7e-716fab7f69ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:36.431849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dca54-6a11-4f1f-9e7e-716fab7f69ea admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:36.432874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380dca54-6a11-4f1f-9e7e-716fab7f69ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:36.435110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380dca54-6a11-4f1f-9e7e-716fab7f69ea admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:36.445593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce29ca-11b5-4f2d-95b6-d9f983805220 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:36.451798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a5fb1-3b08-42c3-be08-b8f5ffe190d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:36.452581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a5fb1-3b08-42c3-be08-b8f5ffe190d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:36.452858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a5fb1-3b08-42c3-be08-b8f5ffe190d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:36.453127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a5fb1-3b08-42c3-be08-b8f5ffe190d3 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:36.453821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a5fb1-3b08-42c3-be08-b8f5ffe190d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:36.456004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a5fb1-3b08-42c3-be08-b8f5ffe190d3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:36.472739 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1127/2223] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:36 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:36.474662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad8b1a-8c60-48fe-b3dd-04cb502f4a11 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:36.475197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad8b1a-8c60-48fe-b3dd-04cb502f4a11 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:36.475679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad8b1a-8c60-48fe-b3dd-04cb502f4a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:36.484149 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1097/2224] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:36 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:36.489248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcd6ed-cf90-430b-ae8a-8bb06ec14e0c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:36.489792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcd6ed-cf90-430b-ae8a-8bb06ec14e0c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:36.490239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcd6ed-cf90-430b-ae8a-8bb06ec14e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:36.497244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d2ad8b1a-8c60-48fe-b3dd-04cb502f4a11 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:36.498675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d2ad8b1a-8c60-48fe-b3dd-04cb502f4a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:36.562541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-11fcd6ed-cf90-430b-ae8a-8bb06ec14e0c None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:36.564311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-11fcd6ed-cf90-430b-ae8a-8bb06ec14e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:36.594770 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1128/2225] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:36.595693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad8b1a-8c60-48fe-b3dd-04cb502f4a11 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:36.612294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad8b1a-8c60-48fe-b3dd-04cb502f4a11 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:36.628942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9b79e-6a75-48c6-972e-7dd0fc089b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:36.630606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9b79e-6a75-48c6-972e-7dd0fc089b4d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:36.630986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9b79e-6a75-48c6-972e-7dd0fc089b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:36.631265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9b79e-6a75-48c6-972e-7dd0fc089b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:36.632709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9b79e-6a75-48c6-972e-7dd0fc089b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:36.634440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9b79e-6a75-48c6-972e-7dd0fc089b4d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:36.649343 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1129/2226] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:36.650546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9b79e-6a75-48c6-972e-7dd0fc089b4d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:36.660837 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1098/2227] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:01:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:36.662326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64b0b7-f9e9-4e5e-9b9f-f3b22cae476d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:36.662610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64b0b7-f9e9-4e5e-9b9f-f3b22cae476d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:36.663326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64b0b7-f9e9-4e5e-9b9f-f3b22cae476d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:36.666899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9b79e-6a75-48c6-972e-7dd0fc089b4d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:36.672677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f85ef9-1cc7-4ccf-bf98-270293381758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:36.672989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f85ef9-1cc7-4ccf-bf98-270293381758 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:36.673578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f85ef9-1cc7-4ccf-bf98-270293381758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:36.673578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f85ef9-1cc7-4ccf-bf98-270293381758 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:36.674259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f85ef9-1cc7-4ccf-bf98-270293381758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:36.676008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f85ef9-1cc7-4ccf-bf98-270293381758 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:36.694384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9b64b0b7-f9e9-4e5e-9b9f-f3b22cae476d None None] MFA Rules not processed for user `ee6053c662e94292a110de1b2b1b943d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:36.695931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9b64b0b7-f9e9-4e5e-9b9f-f3b22cae476d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:36.698127 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1130/2228] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:36.699459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f85ef9-1cc7-4ccf-bf98-270293381758 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:36.711924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f85ef9-1cc7-4ccf-bf98-270293381758 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:36.719765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:36.721753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89131958-c20f-4cb5-9029-952260e82a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:36.722951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89131958-c20f-4cb5-9029-952260e82a97 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:36.723387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89131958-c20f-4cb5-9029-952260e82a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:36.723786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89131958-c20f-4cb5-9029-952260e82a97 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:36.724591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89131958-c20f-4cb5-9029-952260e82a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:36.727152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89131958-c20f-4cb5-9029-952260e82a97 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:36.740352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:36.764396 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1131/2229] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:36 2022] POST /identity/v3/users => generated 298 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:36.765424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89131958-c20f-4cb5-9029-952260e82a97 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:36.781583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89131958-c20f-4cb5-9029-952260e82a97 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:36.783989 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1099/2230] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:36.784996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64b0b7-f9e9-4e5e-9b9f-f3b22cae476d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:36.787743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a235a-2d6f-4599-b3a1-f1885c94ff11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:36.788515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a235a-2d6f-4599-b3a1-f1885c94ff11 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:36.788848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a235a-2d6f-4599-b3a1-f1885c94ff11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:36.789140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a235a-2d6f-4599-b3a1-f1885c94ff11 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:36.789888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a235a-2d6f-4599-b3a1-f1885c94ff11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:36.791613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a235a-2d6f-4599-b3a1-f1885c94ff11 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:36.791986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9b64b0b7-f9e9-4e5e-9b9f-f3b22cae476d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:36.808102 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1132/2231] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:36.808102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a235a-2d6f-4599-b3a1-f1885c94ff11 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:36.820007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a235a-2d6f-4599-b3a1-f1885c94ff11 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:36.824886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a9595-fd28-4011-a2d6-703f493c6110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:36.825844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a9595-fd28-4011-a2d6-703f493c6110 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:36.826121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a9595-fd28-4011-a2d6-703f493c6110 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:36.826394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a9595-fd28-4011-a2d6-703f493c6110 admin admin] PATH_INFO: `/v3/projects/fe14810bac064dc8934463f59b2f29f3/users/f3e7b801f0944b0ead312439806e2df1/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:36.846106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a9595-fd28-4011-a2d6-703f493c6110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe14810bac064dc8934463f59b2f29f3, user_id=f3e7b801f0944b0ead312439806e2df1, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:36.848889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a9595-fd28-4011-a2d6-703f493c6110 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:36.863223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64b0b7-f9e9-4e5e-9b9f-f3b22cae476d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:36.866557 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1133/2232] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:36 2022] PUT /identity/v3/projects/fe14810bac064dc8934463f59b2f29f3/users/f3e7b801f0944b0ead312439806e2df1/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:36.867782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a9595-fd28-4011-a2d6-703f493c6110 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:36.877338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0d8a9595-fd28-4011-a2d6-703f493c6110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:36.946139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6390b-c85e-4574-a715-e736d115f43d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:36.946873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6390b-c85e-4574-a715-e736d115f43d service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:36.949020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6390b-c85e-4574-a715-e736d115f43d service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:36.949478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6390b-c85e-4574-a715-e736d115f43d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:37.004893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a9595-fd28-4011-a2d6-703f493c6110 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:37.015059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1418df1-f345-4942-9ddc-4206ceeb3144 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:37.015752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1418df1-f345-4942-9ddc-4206ceeb3144 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:37.016458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1418df1-f345-4942-9ddc-4206ceeb3144 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:37.017150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1418df1-f345-4942-9ddc-4206ceeb3144 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:37.045502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6390b-c85e-4574-a715-e736d115f43d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:37.047067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6390b-c85e-4574-a715-e736d115f43d service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:37.065161 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1100/2233] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:37.066096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6390b-c85e-4574-a715-e736d115f43d service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:37.078139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6390b-c85e-4574-a715-e736d115f43d service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:37.084913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f746b8-1cef-4313-8b2e-1532f7358f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:37.086066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f746b8-1cef-4313-8b2e-1532f7358f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:37.086710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f746b8-1cef-4313-8b2e-1532f7358f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:37.086992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f746b8-1cef-4313-8b2e-1532f7358f7f admin admin] PATH_INFO: `/v3/projects/8ae5fa728db84608bfaa558277a90b34/users/fe262620110042f6baacf06dd51e0ddc/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:37.106114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1418df1-f345-4942-9ddc-4206ceeb3144 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:37.108033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1418df1-f345-4942-9ddc-4206ceeb3144 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:37.117994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f746b8-1cef-4313-8b2e-1532f7358f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae5fa728db84608bfaa558277a90b34, user_id=fe262620110042f6baacf06dd51e0ddc, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:37.118188 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1134/2234] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:01:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:37.118829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1418df1-f345-4942-9ddc-4206ceeb3144 service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:37.121701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f746b8-1cef-4313-8b2e-1532f7358f7f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:37.135227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:37.135677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1418df1-f345-4942-9ddc-4206ceeb3144 service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:37.142765 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1101/2235] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:37 2022] PUT /identity/v3/projects/8ae5fa728db84608bfaa558277a90b34/users/fe262620110042f6baacf06dd51e0ddc/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:37.146512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f746b8-1cef-4313-8b2e-1532f7358f7f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:37.234136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:37.270052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a766f32-0889-4e22-85e4-b19f6600ac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:37.270897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a766f32-0889-4e22-85e4-b19f6600ac26 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:37.271350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a766f32-0889-4e22-85e4-b19f6600ac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:37.271629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a766f32-0889-4e22-85e4-b19f6600ac26 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:37.272057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f746b8-1cef-4313-8b2e-1532f7358f7f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:37.272538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a766f32-0889-4e22-85e4-b19f6600ac26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:37.275416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a766f32-0889-4e22-85e4-b19f6600ac26 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:37.280410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1da26e-8219-451b-a474-9b6787b32f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:37.281346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1da26e-8219-451b-a474-9b6787b32f44 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:37.281591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1da26e-8219-451b-a474-9b6787b32f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:37.281869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1da26e-8219-451b-a474-9b6787b32f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:37.283210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1da26e-8219-451b-a474-9b6787b32f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:37.285238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1da26e-8219-451b-a474-9b6787b32f44 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:37.289406 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1135/2236] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:37.290770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a766f32-0889-4e22-85e4-b19f6600ac26 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:37.308939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a766f32-0889-4e22-85e4-b19f6600ac26 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:37.318030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92f9d0-e83d-4da1-8421-b249a3b3c049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:37.318731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92f9d0-e83d-4da1-8421-b249a3b3c049 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:37.319025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92f9d0-e83d-4da1-8421-b249a3b3c049 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:37.319303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92f9d0-e83d-4da1-8421-b249a3b3c049 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:37.321906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92f9d0-e83d-4da1-8421-b249a3b3c049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:37.324218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92f9d0-e83d-4da1-8421-b249a3b3c049 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:37.332291 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1102/2237] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:37 2022] POST /identity/v3/projects => generated 399 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:37.335500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43dcf4-c495-48be-9b55-e2c1cc4b18a9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:37.337743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43dcf4-c495-48be-9b55-e2c1cc4b18a9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:37.338036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43dcf4-c495-48be-9b55-e2c1cc4b18a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:37.344247 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1136/2238] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:37.348114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa2f4d-76a8-4530-a77a-80af258c5a7e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:37.348517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa2f4d-76a8-4530-a77a-80af258c5a7e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:37.348812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa2f4d-76a8-4530-a77a-80af258c5a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:37.406057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fdfa2f4d-76a8-4530-a77a-80af258c5a7e None None] MFA Rules not processed for user `fe262620110042f6baacf06dd51e0ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:37.407557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fdfa2f4d-76a8-4530-a77a-80af258c5a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:37.412466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1e43dcf4-c495-48be-9b55-e2c1cc4b18a9 None None] MFA Rules not processed for user `f3e7b801f0944b0ead312439806e2df1`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:37.413901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1e43dcf4-c495-48be-9b55-e2c1cc4b18a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:37.523294 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1137/2239] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:37.525019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa2f4d-76a8-4530-a77a-80af258c5a7e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:37.560343 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1103/2240] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:37.561596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43dcf4-c495-48be-9b55-e2c1cc4b18a9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:37.654252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa2f4d-76a8-4530-a77a-80af258c5a7e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:37.659895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82252a-72f4-4ff7-b4cb-32bbd88c415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:37.660905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82252a-72f4-4ff7-b4cb-32bbd88c415a admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:37.661371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82252a-72f4-4ff7-b4cb-32bbd88c415a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:37.661775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82252a-72f4-4ff7-b4cb-32bbd88c415a admin admin] PATH_INFO: `/v3/projects/aaed67e75e9d41f9b52b2eecece4d00a/users/f01d709cb67c4742be0b40aceb2bd6db/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:37.696415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82252a-72f4-4ff7-b4cb-32bbd88c415a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaed67e75e9d41f9b52b2eecece4d00a, user_id=f01d709cb67c4742be0b40aceb2bd6db, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:37.702030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82252a-72f4-4ff7-b4cb-32bbd88c415a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:37.709823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43dcf4-c495-48be-9b55-e2c1cc4b18a9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:37.715979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b40ab6-02ec-4825-8def-9f38d85f1494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:37.716773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b40ab6-02ec-4825-8def-9f38d85f1494 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:37.717198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b40ab6-02ec-4825-8def-9f38d85f1494 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:37.717710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b40ab6-02ec-4825-8def-9f38d85f1494 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:37.719626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b40ab6-02ec-4825-8def-9f38d85f1494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:37.723102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b40ab6-02ec-4825-8def-9f38d85f1494 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:37.742801 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1138/2241] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:37 2022] PUT /identity/v3/projects/aaed67e75e9d41f9b52b2eecece4d00a/users/f01d709cb67c4742be0b40aceb2bd6db/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:37.743835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82252a-72f4-4ff7-b4cb-32bbd88c415a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:37.772230 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1104/2242] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:37 2022] POST /identity/v3/users => generated 306 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:37.773672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b40ab6-02ec-4825-8def-9f38d85f1494 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:37.785675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:37.803707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b40ab6-02ec-4825-8def-9f38d85f1494 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:37.846572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:37.878375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82252a-72f4-4ff7-b4cb-32bbd88c415a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:37.886185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32b591-50a9-4c53-8ddb-543da0db6234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:37.887108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32b591-50a9-4c53-8ddb-543da0db6234 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:37.887396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32b591-50a9-4c53-8ddb-543da0db6234 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:37.887669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32b591-50a9-4c53-8ddb-543da0db6234 admin admin] PATH_INFO: `/v3/projects/86d180accd794d748ed7093a2497dcd8/users/dc7f11b88fbc4744a2608685ef53e982/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:37.906493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583589c0-dd7a-4304-8af9-c1945dc496ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:37.906493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583589c0-dd7a-4304-8af9-c1945dc496ea admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:37.906493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583589c0-dd7a-4304-8af9-c1945dc496ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:37.906493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583589c0-dd7a-4304-8af9-c1945dc496ea admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:37.907005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583589c0-dd7a-4304-8af9-c1945dc496ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:37.908726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583589c0-dd7a-4304-8af9-c1945dc496ea admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:37.911538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32b591-50a9-4c53-8ddb-543da0db6234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d180accd794d748ed7093a2497dcd8, user_id=dc7f11b88fbc4744a2608685ef53e982, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:37.914671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32b591-50a9-4c53-8ddb-543da0db6234 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:37.941399 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1139/2243] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:37 2022] PUT /identity/v3/projects/86d180accd794d748ed7093a2497dcd8/users/dc7f11b88fbc4744a2608685ef53e982/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:37.942552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32b591-50a9-4c53-8ddb-543da0db6234 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:37.944826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6b32b591-50a9-4c53-8ddb-543da0db6234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:37.958167 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1105/2244] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:37 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:37.959097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583589c0-dd7a-4304-8af9-c1945dc496ea admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:38.080117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32b591-50a9-4c53-8ddb-543da0db6234 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:38.127231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583589c0-dd7a-4304-8af9-c1945dc496ea admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:38.135037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6d7ed-4a42-4094-9f46-5a69330353c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:38.136784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6d7ed-4a42-4094-9f46-5a69330353c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:38.137224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6d7ed-4a42-4094-9f46-5a69330353c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:38.138253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6d7ed-4a42-4094-9f46-5a69330353c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:38.139262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6d7ed-4a42-4094-9f46-5a69330353c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:38.149887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6d7ed-4a42-4094-9f46-5a69330353c0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:38.177563 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1106/2245] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:38.178409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6d7ed-4a42-4094-9f46-5a69330353c0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:38.196818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6d7ed-4a42-4094-9f46-5a69330353c0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:38.202399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5039e82-766b-4b49-9ec5-329953270558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:38.203098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5039e82-766b-4b49-9ec5-329953270558 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:38.206637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5039e82-766b-4b49-9ec5-329953270558 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:38.207014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5039e82-766b-4b49-9ec5-329953270558 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:38.208103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5039e82-766b-4b49-9ec5-329953270558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:38.209346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92795bc-5285-4588-a0ad-732ae592c7c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:38.209980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5039e82-766b-4b49-9ec5-329953270558 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:38.210237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92795bc-5285-4588-a0ad-732ae592c7c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:38.210665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92795bc-5285-4588-a0ad-732ae592c7c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:38.211049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92795bc-5285-4588-a0ad-732ae592c7c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:38.240648 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1107/2246] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:38.240648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00515e-cba0-4ce9-a511-6a5e2413fab2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:38.240648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00515e-cba0-4ce9-a511-6a5e2413fab2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:38.240648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00515e-cba0-4ce9-a511-6a5e2413fab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:38.278680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ec00515e-cba0-4ce9-a511-6a5e2413fab2 None None] MFA Rules not processed for user `dc7f11b88fbc4744a2608685ef53e982`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:38.279958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ec00515e-cba0-4ce9-a511-6a5e2413fab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:38.336331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92795bc-5285-4588-a0ad-732ae592c7c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:38.340641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92795bc-5285-4588-a0ad-732ae592c7c9 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:38.368190 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1140/2247] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:38.369352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92795bc-5285-4588-a0ad-732ae592c7c9 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:38.385012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92795bc-5285-4588-a0ad-732ae592c7c9 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:38.395159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ba6cf-9c6e-4a15-acc8-fcca1b3d5201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:38.396191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ba6cf-9c6e-4a15-acc8-fcca1b3d5201 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:38.396635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ba6cf-9c6e-4a15-acc8-fcca1b3d5201 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:38.398253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ba6cf-9c6e-4a15-acc8-fcca1b3d5201 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:38.400496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ba6cf-9c6e-4a15-acc8-fcca1b3d5201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:38.403387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ba6cf-9c6e-4a15-acc8-fcca1b3d5201 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:38.440215 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1141/2248] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:38 2022] POST /identity/v3/users => generated 300 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:38.441452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ba6cf-9c6e-4a15-acc8-fcca1b3d5201 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:38.459109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ba6cf-9c6e-4a15-acc8-fcca1b3d5201 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:38.463473 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1108/2249] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:38.464234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00515e-cba0-4ce9-a511-6a5e2413fab2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:38.467718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f3a2e-04ff-4b7c-bcb8-198564797f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:38.469261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f3a2e-04ff-4b7c-bcb8-198564797f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:38.470613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f3a2e-04ff-4b7c-bcb8-198564797f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:38.471069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f3a2e-04ff-4b7c-bcb8-198564797f2a admin admin] PATH_INFO: `/v3/projects/aaed67e75e9d41f9b52b2eecece4d00a/users/f01d709cb67c4742be0b40aceb2bd6db/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:38.478027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f3a2e-04ff-4b7c-bcb8-198564797f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaed67e75e9d41f9b52b2eecece4d00a, user_id=f01d709cb67c4742be0b40aceb2bd6db, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:38.481645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f3a2e-04ff-4b7c-bcb8-198564797f2a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:38.483723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:38.494902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:38.495333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00515e-cba0-4ce9-a511-6a5e2413fab2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:38.505106 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1142/2250] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:38 2022] PUT /identity/v3/projects/aaed67e75e9d41f9b52b2eecece4d00a/users/f01d709cb67c4742be0b40aceb2bd6db/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:38.506827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f3a2e-04ff-4b7c-bcb8-198564797f2a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:38.639528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b329a-117c-4240-b32f-dd3ecb9f61fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:38.640060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b329a-117c-4240-b32f-dd3ecb9f61fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:38.640356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b329a-117c-4240-b32f-dd3ecb9f61fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:38.640623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b329a-117c-4240-b32f-dd3ecb9f61fb admin admin] PATH_INFO: `/v3/projects/f024a13edfe44741b289a28f8c20ef33/users/bcab9436967748519726af2bb6321864/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:38.671774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f3a2e-04ff-4b7c-bcb8-198564797f2a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:38.683400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefda503-b743-46e4-bbef-6e1e3ebaa35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:38.684164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefda503-b743-46e4-bbef-6e1e3ebaa35e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:38.684448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefda503-b743-46e4-bbef-6e1e3ebaa35e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:38.684724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefda503-b743-46e4-bbef-6e1e3ebaa35e admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:38.686906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefda503-b743-46e4-bbef-6e1e3ebaa35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:38.690373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b329a-117c-4240-b32f-dd3ecb9f61fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f024a13edfe44741b289a28f8c20ef33, user_id=bcab9436967748519726af2bb6321864, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:38.693397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b329a-117c-4240-b32f-dd3ecb9f61fb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:38.706733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefda503-b743-46e4-bbef-6e1e3ebaa35e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:38.737649 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1143/2251] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:38.738888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefda503-b743-46e4-bbef-6e1e3ebaa35e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:38.739676 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1109/2252] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:38 2022] PUT /identity/v3/projects/f024a13edfe44741b289a28f8c20ef33/users/bcab9436967748519726af2bb6321864/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:38.741954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f60c3-5b29-4cbd-94b1-d5abeaa0aadb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:38.742251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f60c3-5b29-4cbd-94b1-d5abeaa0aadb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:38.744183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f60c3-5b29-4cbd-94b1-d5abeaa0aadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:38.772546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefda503-b743-46e4-bbef-6e1e3ebaa35e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:38.818498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b46f60c3-5b29-4cbd-94b1-d5abeaa0aadb None None] MFA Rules not processed for user `f01d709cb67c4742be0b40aceb2bd6db`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:38.823914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b46f60c3-5b29-4cbd-94b1-d5abeaa0aadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:38.934042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b26d9-3fb8-4c37-8b27-2061acc4f7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:38.935456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b26d9-3fb8-4c37-8b27-2061acc4f7fc admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:38.935771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b26d9-3fb8-4c37-8b27-2061acc4f7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:38.936263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b26d9-3fb8-4c37-8b27-2061acc4f7fc admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:38.941210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b26d9-3fb8-4c37-8b27-2061acc4f7fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:38.943787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b26d9-3fb8-4c37-8b27-2061acc4f7fc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:38.983835 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1110/2253] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:38.989126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f60c3-5b29-4cbd-94b1-d5abeaa0aadb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:39.015835 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1144/2254] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:38 2022] POST /identity/v3/projects => generated 385 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:39.017294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f60c3-5b29-4cbd-94b1-d5abeaa0aadb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:39.017392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b26d9-3fb8-4c37-8b27-2061acc4f7fc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:39.166024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b140802-90b4-4d06-9909-3ff00e7aebf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:39.167342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b140802-90b4-4d06-9909-3ff00e7aebf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:39.167906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b140802-90b4-4d06-9909-3ff00e7aebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:39.168865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b140802-90b4-4d06-9909-3ff00e7aebf0 admin admin] PATH_INFO: `/v3/projects/c4c1a7b3a27642768fdc343c03e931a6/users/a6f93f8145f7475d975b44f63f1850bb/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:39.183886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b26d9-3fb8-4c37-8b27-2061acc4f7fc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:39.195279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee3dd8-adc8-4e40-b02e-72214bb9a653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:39.196320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee3dd8-adc8-4e40-b02e-72214bb9a653 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:39.200445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee3dd8-adc8-4e40-b02e-72214bb9a653 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:39.200445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee3dd8-adc8-4e40-b02e-72214bb9a653 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:39.200445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee3dd8-adc8-4e40-b02e-72214bb9a653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:39.201700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee3dd8-adc8-4e40-b02e-72214bb9a653 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:39.216808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b140802-90b4-4d06-9909-3ff00e7aebf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c1a7b3a27642768fdc343c03e931a6, user_id=a6f93f8145f7475d975b44f63f1850bb, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:39.221365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b140802-90b4-4d06-9909-3ff00e7aebf0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:39.226867 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1145/2255] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:39.228096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee3dd8-adc8-4e40-b02e-72214bb9a653 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:39.230109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:39.253231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee3dd8-adc8-4e40-b02e-72214bb9a653 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:39.281028 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1111/2256] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:38 2022] PUT /identity/v3/projects/c4c1a7b3a27642768fdc343c03e931a6/users/a6f93f8145f7475d975b44f63f1850bb/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:39.283145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb442b-7c4c-4aa8-aecd-8b07e6e16608 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:39.283438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb442b-7c4c-4aa8-aecd-8b07e6e16608 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:39.284703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb442b-7c4c-4aa8-aecd-8b07e6e16608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:39.287109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:39.334652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-71bb442b-7c4c-4aa8-aecd-8b07e6e16608 None None] MFA Rules not processed for user `9ee93cc6740d4e92b231f60d8b9d4450`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:39.340268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-71bb442b-7c4c-4aa8-aecd-8b07e6e16608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:39.411722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85c485-3268-4a88-b7c2-c59261fd30c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:39.412773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85c485-3268-4a88-b7c2-c59261fd30c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:39.415228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85c485-3268-4a88-b7c2-c59261fd30c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:39.415385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85c485-3268-4a88-b7c2-c59261fd30c5 admin admin] PATH_INFO: `/v3/users/f3e7b801f0944b0ead312439806e2df1` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:39.418826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85c485-3268-4a88-b7c2-c59261fd30c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e7b801f0944b0ead312439806e2df1)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:39.421971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85c485-3268-4a88-b7c2-c59261fd30c5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:39.466539 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1112/2257] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:39.467898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb442b-7c4c-4aa8-aecd-8b07e6e16608 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:39.483779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb442b-7c4c-4aa8-aecd-8b07e6e16608 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:39.489489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0f267-5ca4-4980-a8f2-52b9a04d86c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:39.490730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0f267-5ca4-4980-a8f2-52b9a04d86c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:39.498023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0f267-5ca4-4980-a8f2-52b9a04d86c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:39.498862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0f267-5ca4-4980-a8f2-52b9a04d86c4 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:39.500120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0f267-5ca4-4980-a8f2-52b9a04d86c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:39.503384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0f267-5ca4-4980-a8f2-52b9a04d86c4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:39.575072 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1113/2258] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:39 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:39.578072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0f267-5ca4-4980-a8f2-52b9a04d86c4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:39.598927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fa85c485-3268-4a88-b7c2-c59261fd30c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e7b801f0944b0ead312439806e2df1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:39.600727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0f267-5ca4-4980-a8f2-52b9a04d86c4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:39.617745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d7f52-d378-4adb-968b-30cf3ffc8b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:39.621008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d7f52-d378-4adb-968b-30cf3ffc8b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:39.623022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fa85c485-3268-4a88-b7c2-c59261fd30c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e7b801f0944b0ead312439806e2df1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:39.623655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fa85c485-3268-4a88-b7c2-c59261fd30c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e7b801f0944b0ead312439806e2df1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:39.624367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fa85c485-3268-4a88-b7c2-c59261fd30c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e7b801f0944b0ead312439806e2df1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:39.632839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d7f52-d378-4adb-968b-30cf3ffc8b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:39.633858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d7f52-d378-4adb-968b-30cf3ffc8b41 admin admin] PATH_INFO: `/v3/projects/f024a13edfe44741b289a28f8c20ef33/users/bcab9436967748519726af2bb6321864/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:39.639242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fa85c485-3268-4a88-b7c2-c59261fd30c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e7b801f0944b0ead312439806e2df1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:39.640649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d7f52-d378-4adb-968b-30cf3ffc8b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f024a13edfe44741b289a28f8c20ef33, user_id=bcab9436967748519726af2bb6321864, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:39.646110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d7f52-d378-4adb-968b-30cf3ffc8b41 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:39.672174 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1146/2259] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:39 2022] DELETE /identity/v3/users/f3e7b801f0944b0ead312439806e2df1 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:39.673419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85c485-3268-4a88-b7c2-c59261fd30c5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:39.676660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fa85c485-3268-4a88-b7c2-c59261fd30c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:39.684833 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1114/2260] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:39 2022] PUT /identity/v3/projects/f024a13edfe44741b289a28f8c20ef33/users/bcab9436967748519726af2bb6321864/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:39.687145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d7f52-d378-4adb-968b-30cf3ffc8b41 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:39.699312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c75d7f52-d378-4adb-968b-30cf3ffc8b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:39.864365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85c485-3268-4a88-b7c2-c59261fd30c5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:39.869637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031e975-0cf6-429e-943f-fe535303aa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:39.870617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031e975-0cf6-429e-943f-fe535303aa07 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:39.870893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031e975-0cf6-429e-943f-fe535303aa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:39.871579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031e975-0cf6-429e-943f-fe535303aa07 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:39.872427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031e975-0cf6-429e-943f-fe535303aa07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:39.874623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031e975-0cf6-429e-943f-fe535303aa07 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:39.894534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d7f52-d378-4adb-968b-30cf3ffc8b41 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:39.896111 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1147/2261] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:39.902906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031e975-0cf6-429e-943f-fe535303aa07 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:39.907639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a031e975-0cf6-429e-943f-fe535303aa07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:39.941652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031e975-0cf6-429e-943f-fe535303aa07 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:39.955398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0eda2-c4ba-44ad-adb8-0887423bd4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:39.956881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0eda2-c4ba-44ad-adb8-0887423bd4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:39.957481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0eda2-c4ba-44ad-adb8-0887423bd4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:39.959047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0eda2-c4ba-44ad-adb8-0887423bd4e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:39.960478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0eda2-c4ba-44ad-adb8-0887423bd4e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:39.969141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0eda2-c4ba-44ad-adb8-0887423bd4e1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:39.998980 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1148/2262] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:40.013119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ca5be-9b05-4b52-abd0-0df28ad40588 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:40.013409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ca5be-9b05-4b52-abd0-0df28ad40588 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:40.013680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ca5be-9b05-4b52-abd0-0df28ad40588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:40.033539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6f045-2a14-42aa-806c-bd2dd87c4a7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:40.034209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6f045-2a14-42aa-806c-bd2dd87c4a7a service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:40.034675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6f045-2a14-42aa-806c-bd2dd87c4a7a service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:40.034998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6f045-2a14-42aa-806c-bd2dd87c4a7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:40.035778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-420ca5be-9b05-4b52-abd0-0df28ad40588 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:40.038804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-420ca5be-9b05-4b52-abd0-0df28ad40588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:40.038928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9ff6f045-2a14-42aa-806c-bd2dd87c4a7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:40.054311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:40.055893 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1149/2263] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:40.056942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8d4dd-79d8-42c1-835e-6ec790ebb220 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:40.057230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8d4dd-79d8-42c1-835e-6ec790ebb220 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:40.057501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8d4dd-79d8-42c1-835e-6ec790ebb220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:40.096469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e2e8d4dd-79d8-42c1-835e-6ec790ebb220 None None] MFA Rules not processed for user `bcab9436967748519726af2bb6321864`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:40.098128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e2e8d4dd-79d8-42c1-835e-6ec790ebb220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:40.104158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:40.148961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6f045-2a14-42aa-806c-bd2dd87c4a7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:40.151603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6f045-2a14-42aa-806c-bd2dd87c4a7a service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:40.164073 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1115/2264] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:40.165116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6f045-2a14-42aa-806c-bd2dd87c4a7a service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:40.180151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6f045-2a14-42aa-806c-bd2dd87c4a7a service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:40.190425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91336e-96d0-4ee8-8801-1a83fbb36ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:40.191446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91336e-96d0-4ee8-8801-1a83fbb36ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:40.191823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91336e-96d0-4ee8-8801-1a83fbb36ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:40.192242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91336e-96d0-4ee8-8801-1a83fbb36ee7 admin admin] PATH_INFO: `/v3/projects/c4c1a7b3a27642768fdc343c03e931a6/users/a6f93f8145f7475d975b44f63f1850bb/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:40.194520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91336e-96d0-4ee8-8801-1a83fbb36ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c1a7b3a27642768fdc343c03e931a6, user_id=a6f93f8145f7475d975b44f63f1850bb, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:40.197990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91336e-96d0-4ee8-8801-1a83fbb36ee7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:40.230046 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1150/2265] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:40 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:40.230046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8d4dd-79d8-42c1-835e-6ec790ebb220 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:40.234211 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1116/2266] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:40 2022] PUT /identity/v3/projects/c4c1a7b3a27642768fdc343c03e931a6/users/a6f93f8145f7475d975b44f63f1850bb/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:40.236934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91336e-96d0-4ee8-8801-1a83fbb36ee7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:40.255736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bb91336e-96d0-4ee8-8801-1a83fbb36ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:40.255986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8d4dd-79d8-42c1-835e-6ec790ebb220 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:40.323375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91336e-96d0-4ee8-8801-1a83fbb36ee7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:40.327573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dea900-5fcc-4b50-976b-fe21bf62b14c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:40.327907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236aaf9-56aa-42e3-bfc1-ef1155b4e320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:40.328877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236aaf9-56aa-42e3-bfc1-ef1155b4e320 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:40.329000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dea900-5fcc-4b50-976b-fe21bf62b14c service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:40.329185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236aaf9-56aa-42e3-bfc1-ef1155b4e320 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:40.329435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236aaf9-56aa-42e3-bfc1-ef1155b4e320 admin admin] PATH_INFO: `/v3/projects/08ea7e8980754be9be832d38d4e86d63/users/af7e157c93a24909baed949020a31e6d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:40.329543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dea900-5fcc-4b50-976b-fe21bf62b14c service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:40.329924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dea900-5fcc-4b50-976b-fe21bf62b14c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:40.340836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dea900-5fcc-4b50-976b-fe21bf62b14c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:40.342418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dea900-5fcc-4b50-976b-fe21bf62b14c service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:40.345359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236aaf9-56aa-42e3-bfc1-ef1155b4e320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ea7e8980754be9be832d38d4e86d63, user_id=af7e157c93a24909baed949020a31e6d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:40.348595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236aaf9-56aa-42e3-bfc1-ef1155b4e320 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:40.356162 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1117/2267] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:40.357666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8178f3-432f-449d-b442-5614c294486e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:40.357998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8178f3-432f-449d-b442-5614c294486e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:40.358262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8178f3-432f-449d-b442-5614c294486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:40.370896 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1151/2268] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:40 2022] PUT /identity/v3/projects/08ea7e8980754be9be832d38d4e86d63/users/af7e157c93a24909baed949020a31e6d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:40.375261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236aaf9-56aa-42e3-bfc1-ef1155b4e320 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:40.394837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ef8178f3-432f-449d-b442-5614c294486e None None] MFA Rules not processed for user `a6f93f8145f7475d975b44f63f1850bb`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:40.400308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ef8178f3-432f-449d-b442-5614c294486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:40.483733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236aaf9-56aa-42e3-bfc1-ef1155b4e320 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:40.490160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03840f20-0b87-492e-9402-84ce7df15272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:40.491740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03840f20-0b87-492e-9402-84ce7df15272 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:40.492023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03840f20-0b87-492e-9402-84ce7df15272 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:40.492398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03840f20-0b87-492e-9402-84ce7df15272 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:40.494479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03840f20-0b87-492e-9402-84ce7df15272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:40.498711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03840f20-0b87-492e-9402-84ce7df15272 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:40.522753 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1152/2269] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:01:40.527121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03840f20-0b87-492e-9402-84ce7df15272 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:40.539733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03840f20-0b87-492e-9402-84ce7df15272 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:40.545891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61661e81-f62e-41e9-8b53-7a40f1855d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:40.547164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61661e81-f62e-41e9-8b53-7a40f1855d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:40.547673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61661e81-f62e-41e9-8b53-7a40f1855d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:40.548061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61661e81-f62e-41e9-8b53-7a40f1855d42 admin admin] PATH_INFO: `/v3/projects/08ea7e8980754be9be832d38d4e86d63/users/af7e157c93a24909baed949020a31e6d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:40.550739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61661e81-f62e-41e9-8b53-7a40f1855d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ea7e8980754be9be832d38d4e86d63, user_id=af7e157c93a24909baed949020a31e6d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:40.554311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61661e81-f62e-41e9-8b53-7a40f1855d42 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:40.576196 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1153/2270] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:40 2022] PUT /identity/v3/projects/08ea7e8980754be9be832d38d4e86d63/users/af7e157c93a24909baed949020a31e6d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:01:40.576196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61661e81-f62e-41e9-8b53-7a40f1855d42 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:40.576457 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1118/2271] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:40.578224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-61661e81-f62e-41e9-8b53-7a40f1855d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:40.579070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39050f-ef31-4bdb-ae51-f2c3b4148d3d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:40.579358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39050f-ef31-4bdb-ae51-f2c3b4148d3d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:40.579633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39050f-ef31-4bdb-ae51-f2c3b4148d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:40.596563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:40.624075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-cc39050f-ef31-4bdb-ae51-f2c3b4148d3d None None] MFA Rules not processed for user `fe262620110042f6baacf06dd51e0ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:40.625572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cc39050f-ef31-4bdb-ae51-f2c3b4148d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:40.654043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:40.708140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61661e81-f62e-41e9-8b53-7a40f1855d42 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:40.722832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b10468-cb0f-4f90-84d5-6fb560f7daca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:40.723953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b10468-cb0f-4f90-84d5-6fb560f7daca service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:40.724101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b10468-cb0f-4f90-84d5-6fb560f7daca service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:40.724434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b10468-cb0f-4f90-84d5-6fb560f7daca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:40.727692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e2b10468-cb0f-4f90-84d5-6fb560f7daca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:40.735536 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1119/2272] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:40.736979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c34d19-53df-417e-953b-1bd435bb28a5 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:40.737314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c34d19-53df-417e-953b-1bd435bb28a5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:40.737589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c34d19-53df-417e-953b-1bd435bb28a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:40.799090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f4c34d19-53df-417e-953b-1bd435bb28a5 None None] MFA Rules not processed for user `af7e157c93a24909baed949020a31e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:40.815600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f4c34d19-53df-417e-953b-1bd435bb28a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:40.818555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b10468-cb0f-4f90-84d5-6fb560f7daca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:40.820894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b10468-cb0f-4f90-84d5-6fb560f7daca service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:40.865111 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1154/2273] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:40.866896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b10468-cb0f-4f90-84d5-6fb560f7daca service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:40.877855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e2b10468-cb0f-4f90-84d5-6fb560f7daca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:40.961372 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1120/2274] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:40.991927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c34d19-53df-417e-953b-1bd435bb28a5 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:41.017574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c34d19-53df-417e-953b-1bd435bb28a5 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:41.036061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06307746-c7b0-4e01-b727-2b9d8933adae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:41.036986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06307746-c7b0-4e01-b727-2b9d8933adae service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:41.037332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06307746-c7b0-4e01-b727-2b9d8933adae service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:41.037665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06307746-c7b0-4e01-b727-2b9d8933adae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:41.041784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-06307746-c7b0-4e01-b727-2b9d8933adae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:41.068558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06307746-c7b0-4e01-b727-2b9d8933adae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:41.070360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06307746-c7b0-4e01-b727-2b9d8933adae service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:41.091842 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1121/2275] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:41.110187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b10468-cb0f-4f90-84d5-6fb560f7daca service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:41.122601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc6065-4244-4e4e-ba05-7836b3644249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:41.124259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc6065-4244-4e4e-ba05-7836b3644249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:41.127718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc6065-4244-4e4e-ba05-7836b3644249 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:41.128131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc6065-4244-4e4e-ba05-7836b3644249 admin admin] PATH_INFO: `/v3/projects/fe14810bac064dc8934463f59b2f29f3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:41.130474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc6065-4244-4e4e-ba05-7836b3644249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe14810bac064dc8934463f59b2f29f3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:41.135795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc6065-4244-4e4e-ba05-7836b3644249 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:41.240234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:41.245424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fecc6065-4244-4e4e-ba05-7836b3644249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe14810bac064dc8934463f59b2f29f3', 'request_id': 'req-fecc6065-4244-4e4e-ba05-7836b3644249'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:41.263521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fecc6065-4244-4e4e-ba05-7836b3644249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe14810bac064dc8934463f59b2f29f3', 'request_id': 'req-fecc6065-4244-4e4e-ba05-7836b3644249'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:41.271878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fecc6065-4244-4e4e-ba05-7836b3644249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe14810bac064dc8934463f59b2f29f3', 'request_id': 'req-fecc6065-4244-4e4e-ba05-7836b3644249'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:41.297693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fecc6065-4244-4e4e-ba05-7836b3644249 admin admin] The token cache is being invalidate because project fe14810bac064dc8934463f59b2f29f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:41.304418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fecc6065-4244-4e4e-ba05-7836b3644249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:41.305283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fecc6065-4244-4e4e-ba05-7836b3644249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:41.309774 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1155/2276] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:40 2022] DELETE /identity/v3/projects/fe14810bac064dc8934463f59b2f29f3 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:41.318918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bd540-c888-4673-b820-45d247cbf7bb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:41.319206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bd540-c888-4673-b820-45d247cbf7bb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:41.319448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bd540-c888-4673-b820-45d247cbf7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:41.343394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-556bd540-c888-4673-b820-45d247cbf7bb None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:41.344771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-556bd540-c888-4673-b820-45d247cbf7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:41.494233 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1122/2277] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:41.497208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d7c93-39a1-4183-a9bb-d717f235af6e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:41.497792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d7c93-39a1-4183-a9bb-d717f235af6e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:41.498103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d7c93-39a1-4183-a9bb-d717f235af6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:41.554728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4f4d7c93-39a1-4183-a9bb-d717f235af6e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:41.560081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4f4d7c93-39a1-4183-a9bb-d717f235af6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:41.586163 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1156/2278] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:41.587556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bd540-c888-4673-b820-45d247cbf7bb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:41.610660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bd540-c888-4673-b820-45d247cbf7bb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:41.622212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ea5e1-1166-4f25-98f2-ee97c636c704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:41.622981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ea5e1-1166-4f25-98f2-ee97c636c704 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:41.623179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ea5e1-1166-4f25-98f2-ee97c636c704 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:41.623457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ea5e1-1166-4f25-98f2-ee97c636c704 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:41.626696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ea5e1-1166-4f25-98f2-ee97c636c704 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:41.628117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ea5e1-1166-4f25-98f2-ee97c636c704 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:41.631926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ea5e1-1166-4f25-98f2-ee97c636c704 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:41.669864 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1123/2279] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:41.671501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d7c93-39a1-4183-a9bb-d717f235af6e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:41.690102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d7c93-39a1-4183-a9bb-d717f235af6e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:41.703601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314ae54-7afa-40fa-9de2-0781d864d7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:41.704290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314ae54-7afa-40fa-9de2-0781d864d7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:41.705409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314ae54-7afa-40fa-9de2-0781d864d7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:41.707374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314ae54-7afa-40fa-9de2-0781d864d7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:41.708245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314ae54-7afa-40fa-9de2-0781d864d7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:41.711450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314ae54-7afa-40fa-9de2-0781d864d7d3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:41.754623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ea5e1-1166-4f25-98f2-ee97c636c704 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:41.757403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-674ea5e1-1166-4f25-98f2-ee97c636c704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:41.794910 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1157/2280] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:41 2022] POST /identity/v3/projects => generated 403 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:41.795985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314ae54-7afa-40fa-9de2-0781d864d7d3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:41.839581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:41.971054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314ae54-7afa-40fa-9de2-0781d864d7d3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:41.985557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ea5e1-1166-4f25-98f2-ee97c636c704 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:41.986537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336f7d0-aa8f-43e8-9719-a80a7fa2e486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:41.987255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336f7d0-aa8f-43e8-9719-a80a7fa2e486 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:41.987566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336f7d0-aa8f-43e8-9719-a80a7fa2e486 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:41.987844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336f7d0-aa8f-43e8-9719-a80a7fa2e486 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:41.988821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336f7d0-aa8f-43e8-9719-a80a7fa2e486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:41.994381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336f7d0-aa8f-43e8-9719-a80a7fa2e486 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:42.050181 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1158/2281] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:41 2022] POST /identity/v3/users => generated 302 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:42.056640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336f7d0-aa8f-43e8-9719-a80a7fa2e486 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:42.089783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336f7d0-aa8f-43e8-9719-a80a7fa2e486 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:42.111149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934dbf7-242a-4407-90dd-1e91ea307549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:42.111818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934dbf7-242a-4407-90dd-1e91ea307549 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:42.112182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934dbf7-242a-4407-90dd-1e91ea307549 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:42.112463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934dbf7-242a-4407-90dd-1e91ea307549 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:42.114399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934dbf7-242a-4407-90dd-1e91ea307549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:42.118294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934dbf7-242a-4407-90dd-1e91ea307549 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:42.168631 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1159/2282] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:01:42.173596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934dbf7-242a-4407-90dd-1e91ea307549 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:42.199360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7049a8a-6710-4e70-aff5-d692e4a1571f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:42.200061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7049a8a-6710-4e70-aff5-d692e4a1571f service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:42.200337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7049a8a-6710-4e70-aff5-d692e4a1571f service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:42.200613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7049a8a-6710-4e70-aff5-d692e4a1571f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:42.206796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c7049a8a-6710-4e70-aff5-d692e4a1571f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:42.214165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934dbf7-242a-4407-90dd-1e91ea307549 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:42.233891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d6fb0-e9ce-41fc-a036-31045f2c4d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:42.236526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d6fb0-e9ce-41fc-a036-31045f2c4d24 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:42.236844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d6fb0-e9ce-41fc-a036-31045f2c4d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:42.237889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d6fb0-e9ce-41fc-a036-31045f2c4d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:42.239723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d6fb0-e9ce-41fc-a036-31045f2c4d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:42.247897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d6fb0-e9ce-41fc-a036-31045f2c4d24 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:42.274260 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1160/2283] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:42.280478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d6fb0-e9ce-41fc-a036-31045f2c4d24 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:42.321550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d6fb0-e9ce-41fc-a036-31045f2c4d24 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:42.339298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e778b2-f7f5-4dfa-b7ba-873f0e9e1c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:42.341242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e778b2-f7f5-4dfa-b7ba-873f0e9e1c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:42.344239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e778b2-f7f5-4dfa-b7ba-873f0e9e1c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:42.344552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e778b2-f7f5-4dfa-b7ba-873f0e9e1c43 admin admin] PATH_INFO: `/v3/projects/f8920bed46d34026a06fedf429e5cca4/users/a60bf5141fea499abb9b22658e56c944/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:42.395907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e778b2-f7f5-4dfa-b7ba-873f0e9e1c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8920bed46d34026a06fedf429e5cca4, user_id=a60bf5141fea499abb9b22658e56c944, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:42.403322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e778b2-f7f5-4dfa-b7ba-873f0e9e1c43 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:42.408491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7049a8a-6710-4e70-aff5-d692e4a1571f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:42.410750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7049a8a-6710-4e70-aff5-d692e4a1571f service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:42.455575 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1161/2284] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:42 2022] PUT /identity/v3/projects/f8920bed46d34026a06fedf429e5cca4/users/a60bf5141fea499abb9b22658e56c944/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:42.457289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc23ca8-73b7-41ba-aa25-f8c5ccd46cbc None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:42.457583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc23ca8-73b7-41ba-aa25-f8c5ccd46cbc None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:42.457908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc23ca8-73b7-41ba-aa25-f8c5ccd46cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:42.476131 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1124/2285] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:42.526018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8cc23ca8-73b7-41ba-aa25-f8c5ccd46cbc None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:42.574922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8cc23ca8-73b7-41ba-aa25-f8c5ccd46cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:42.705146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=4,keystone:SELECT=90,keystone:INSERT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:42.741426 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1162/2286] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:42.765659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7049a8a-6710-4e70-aff5-d692e4a1571f service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:42.769355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c7049a8a-6710-4e70-aff5-d692e4a1571f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:42.809426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898d879-1ed7-4152-b65c-ce790d3fc3a9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:42.809934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898d879-1ed7-4152-b65c-ce790d3fc3a9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:42.810407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898d879-1ed7-4152-b65c-ce790d3fc3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:42.859383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3898d879-1ed7-4152-b65c-ce790d3fc3a9 None None] MFA Rules not processed for user `684732cf5a004fb084ce0e523398c970`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:42.862930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3898d879-1ed7-4152-b65c-ce790d3fc3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:42.948884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7049a8a-6710-4e70-aff5-d692e4a1571f service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:42.972575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:43.055822 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1163/2287] 10.222.0.59 () {58 vars in 1015 bytes} [Sat Jul 2 21:01:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:01:43.072242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898d879-1ed7-4152-b65c-ce790d3fc3a9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:43.086860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898d879-1ed7-4152-b65c-ce790d3fc3a9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:43.090838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577aec7c-6714-4ffb-817a-cd1e265d8f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:43.091900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577aec7c-6714-4ffb-817a-cd1e265d8f40 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:43.094676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577aec7c-6714-4ffb-817a-cd1e265d8f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:43.095873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577aec7c-6714-4ffb-817a-cd1e265d8f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:43.097030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9e786-9f31-450a-bb04-bb77a3379e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:43.098830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9e786-9f31-450a-bb04-bb77a3379e9e service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:43.099593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9e786-9f31-450a-bb04-bb77a3379e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:43.100633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9e786-9f31-450a-bb04-bb77a3379e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:43.120187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9e786-9f31-450a-bb04-bb77a3379e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:43.123736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9e786-9f31-450a-bb04-bb77a3379e9e service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:43.135073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577aec7c-6714-4ffb-817a-cd1e265d8f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:43.137901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577aec7c-6714-4ffb-817a-cd1e265d8f40 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:43.146816 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1164/2288] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:01:43.150131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9e786-9f31-450a-bb04-bb77a3379e9e service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:43.154555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e6c9e786-9f31-450a-bb04-bb77a3379e9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:43.170834 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1125/2289] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:43.442670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9e786-9f31-450a-bb04-bb77a3379e9e service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:43.449566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fa534-6b0b-4e2e-b420-595f28fdd1d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:43.450461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fa534-6b0b-4e2e-b420-595f28fdd1d6 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:43.451041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fa534-6b0b-4e2e-b420-595f28fdd1d6 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:43.451676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fa534-6b0b-4e2e-b420-595f28fdd1d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:43.454783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-476fa534-6b0b-4e2e-b420-595f28fdd1d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:43.618872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fa534-6b0b-4e2e-b420-595f28fdd1d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:43.620563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fa534-6b0b-4e2e-b420-595f28fdd1d6 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:43.650544 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1165/2290] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:43 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:44.748287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577aec7c-6714-4ffb-817a-cd1e265d8f40 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:44.750408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-577aec7c-6714-4ffb-817a-cd1e265d8f40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:44.806414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577aec7c-6714-4ffb-817a-cd1e265d8f40 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:44.821687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03946a20-bcc4-406b-9268-1735a876cbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:44.828416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03946a20-bcc4-406b-9268-1735a876cbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:44.830224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03946a20-bcc4-406b-9268-1735a876cbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:44.831078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03946a20-bcc4-406b-9268-1735a876cbb5 admin admin] PATH_INFO: `/v3/users/dc7f11b88fbc4744a2608685ef53e982` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:44.838828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03946a20-bcc4-406b-9268-1735a876cbb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc7f11b88fbc4744a2608685ef53e982)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:44.841486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03946a20-bcc4-406b-9268-1735a876cbb5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:44.951235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03946a20-bcc4-406b-9268-1735a876cbb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc7f11b88fbc4744a2608685ef53e982'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:44.966035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03946a20-bcc4-406b-9268-1735a876cbb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc7f11b88fbc4744a2608685ef53e982'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:44.981848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03946a20-bcc4-406b-9268-1735a876cbb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc7f11b88fbc4744a2608685ef53e982'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:44.983091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03946a20-bcc4-406b-9268-1735a876cbb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc7f11b88fbc4744a2608685ef53e982'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:44.983982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03946a20-bcc4-406b-9268-1735a876cbb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc7f11b88fbc4744a2608685ef53e982'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:45.041277 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1126/2291] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:44 2022] DELETE /identity/v3/users/dc7f11b88fbc4744a2608685ef53e982 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:45.045707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd3a4f-6cb8-4160-b1c8-cc652db184ce None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:45.046221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd3a4f-6cb8-4160-b1c8-cc652db184ce None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:45.046221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd3a4f-6cb8-4160-b1c8-cc652db184ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:45.093893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-81bd3a4f-6cb8-4160-b1c8-cc652db184ce None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:45.098724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-81bd3a4f-6cb8-4160-b1c8-cc652db184ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:45.155041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:45.344545 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1166/2292] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:45.377728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03946a20-bcc4-406b-9268-1735a876cbb5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:45.379384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-03946a20-bcc4-406b-9268-1735a876cbb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:45.402099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03946a20-bcc4-406b-9268-1735a876cbb5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:45.407859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c01ca-96b2-4829-8ff4-b1bcda2731ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:45.408758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c01ca-96b2-4829-8ff4-b1bcda2731ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:45.409221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c01ca-96b2-4829-8ff4-b1bcda2731ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:45.409505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c01ca-96b2-4829-8ff4-b1bcda2731ce admin admin] PATH_INFO: `/v3/users/ee6053c662e94292a110de1b2b1b943d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:45.411074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c01ca-96b2-4829-8ff4-b1bcda2731ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee6053c662e94292a110de1b2b1b943d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:45.426119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c01ca-96b2-4829-8ff4-b1bcda2731ce admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:45.436168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd3a4f-6cb8-4160-b1c8-cc652db184ce None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:45.437642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-81bd3a4f-6cb8-4160-b1c8-cc652db184ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:45.589096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-805c01ca-96b2-4829-8ff4-b1bcda2731ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee6053c662e94292a110de1b2b1b943d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:45.600355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd3a4f-6cb8-4160-b1c8-cc652db184ce None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:45.607992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-805c01ca-96b2-4829-8ff4-b1bcda2731ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee6053c662e94292a110de1b2b1b943d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:45.614636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf80a3-3917-466c-85ec-4d272935fcd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:45.615318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf80a3-3917-466c-85ec-4d272935fcd6 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:45.615603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf80a3-3917-466c-85ec-4d272935fcd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:45.615881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf80a3-3917-466c-85ec-4d272935fcd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:45.623924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-805c01ca-96b2-4829-8ff4-b1bcda2731ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee6053c662e94292a110de1b2b1b943d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:45.625738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-805c01ca-96b2-4829-8ff4-b1bcda2731ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee6053c662e94292a110de1b2b1b943d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:45.626849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-805c01ca-96b2-4829-8ff4-b1bcda2731ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee6053c662e94292a110de1b2b1b943d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:45.636101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf80a3-3917-466c-85ec-4d272935fcd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:45.637592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf80a3-3917-466c-85ec-4d272935fcd6 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:45.664471 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1167/2293] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:45.666994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:45.681217 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1127/2294] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:45 2022] DELETE /identity/v3/users/ee6053c662e94292a110de1b2b1b943d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:45.686411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13c0d5-dd8e-41e2-a1bd-74026de1d29e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:45.686963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13c0d5-dd8e-41e2-a1bd-74026de1d29e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:45.687451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13c0d5-dd8e-41e2-a1bd-74026de1d29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:45.737124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d7fb9-5f68-4e95-8dd6-d504fb53ad9a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:45.737357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d7fb9-5f68-4e95-8dd6-d504fb53ad9a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:45.737627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d7fb9-5f68-4e95-8dd6-d504fb53ad9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:45.738095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6a13c0d5-dd8e-41e2-a1bd-74026de1d29e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:45.742150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6a13c0d5-dd8e-41e2-a1bd-74026de1d29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:45.809670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ac7d7fb9-5f68-4e95-8dd6-d504fb53ad9a None None] MFA Rules not processed for user `10cba2186f6343d98d0d69822ab8640b`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:45.811558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ac7d7fb9-5f68-4e95-8dd6-d504fb53ad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:45.956424 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1168/2295] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:45.983560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13c0d5-dd8e-41e2-a1bd-74026de1d29e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:45.985474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6a13c0d5-dd8e-41e2-a1bd-74026de1d29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:46.046287 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1128/2296] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:46.141170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13c0d5-dd8e-41e2-a1bd-74026de1d29e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:46.145699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5adcb-d62e-417c-890b-be4030a83495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:46.146258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5adcb-d62e-417c-890b-be4030a83495 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:46.146558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5adcb-d62e-417c-890b-be4030a83495 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:46.147213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5adcb-d62e-417c-890b-be4030a83495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:46.175454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5adcb-d62e-417c-890b-be4030a83495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:46.177314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d7fb9-5f68-4e95-8dd6-d504fb53ad9a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:46.177522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5adcb-d62e-417c-890b-be4030a83495 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:46.179313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ac7d7fb9-5f68-4e95-8dd6-d504fb53ad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:46.196992 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1169/2297] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:01:46.309455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d7fb9-5f68-4e95-8dd6-d504fb53ad9a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:46.316708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48edd0-7658-4eb2-a0a5-b45da059e416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:46.317528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48edd0-7658-4eb2-a0a5-b45da059e416 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:46.317907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48edd0-7658-4eb2-a0a5-b45da059e416 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:46.318274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48edd0-7658-4eb2-a0a5-b45da059e416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:46.328835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48edd0-7658-4eb2-a0a5-b45da059e416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:46.331527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48edd0-7658-4eb2-a0a5-b45da059e416 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:46.344383 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1129/2298] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:46.923634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffacfcc-387b-450c-b932-609ab44b6771 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:46.923931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffacfcc-387b-450c-b932-609ab44b6771 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:46.924235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffacfcc-387b-450c-b932-609ab44b6771 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:46.925626 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1170/2299] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:01:46.992214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919c7ab-40c3-4641-afea-76e310b5ca52 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:46.992800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919c7ab-40c3-4641-afea-76e310b5ca52 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:46.992898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919c7ab-40c3-4641-afea-76e310b5ca52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:47.030691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d919c7ab-40c3-4641-afea-76e310b5ca52 None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:47.036621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d919c7ab-40c3-4641-afea-76e310b5ca52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:47.061655 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1130/2300] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:47.215826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffacfcc-387b-450c-b932-609ab44b6771 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:47.217661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bffacfcc-387b-450c-b932-609ab44b6771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:47.229322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:47.236770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffacfcc-387b-450c-b932-609ab44b6771 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:47.243792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52883637-2018-4c8c-8fa8-97ba12e85127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:47.244801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52883637-2018-4c8c-8fa8-97ba12e85127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:47.245137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52883637-2018-4c8c-8fa8-97ba12e85127 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:47.245662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52883637-2018-4c8c-8fa8-97ba12e85127 admin admin] PATH_INFO: `/v3/projects/a0c4b2443f764da8beae86f4c9f393b5` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:47.248191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52883637-2018-4c8c-8fa8-97ba12e85127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0c4b2443f764da8beae86f4c9f393b5)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:47.250339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52883637-2018-4c8c-8fa8-97ba12e85127 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:47.347550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-52883637-2018-4c8c-8fa8-97ba12e85127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0c4b2443f764da8beae86f4c9f393b5', 'request_id': 'req-52883637-2018-4c8c-8fa8-97ba12e85127'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:47.365431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-52883637-2018-4c8c-8fa8-97ba12e85127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0c4b2443f764da8beae86f4c9f393b5', 'request_id': 'req-52883637-2018-4c8c-8fa8-97ba12e85127'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:47.375294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-52883637-2018-4c8c-8fa8-97ba12e85127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0c4b2443f764da8beae86f4c9f393b5', 'request_id': 'req-52883637-2018-4c8c-8fa8-97ba12e85127'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:47.388709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919c7ab-40c3-4641-afea-76e310b5ca52 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:47.405803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919c7ab-40c3-4641-afea-76e310b5ca52 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:47.408560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-52883637-2018-4c8c-8fa8-97ba12e85127 admin admin] The token cache is being invalidate because project a0c4b2443f764da8beae86f4c9f393b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:47.409251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-52883637-2018-4c8c-8fa8-97ba12e85127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:47.410542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-52883637-2018-4c8c-8fa8-97ba12e85127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:47.416393 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1171/2301] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:47 2022] DELETE /identity/v3/projects/a0c4b2443f764da8beae86f4c9f393b5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:47.420249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52883637-2018-4c8c-8fa8-97ba12e85127 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:47.430386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-52883637-2018-4c8c-8fa8-97ba12e85127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:47.614746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:47.636801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a5191-d671-40bf-81d6-fe4dadc9c546 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:47.637536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a5191-d671-40bf-81d6-fe4dadc9c546 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:47.637836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a5191-d671-40bf-81d6-fe4dadc9c546 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:47.638095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a5191-d671-40bf-81d6-fe4dadc9c546 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:47.640180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0a5a5191-d671-40bf-81d6-fe4dadc9c546 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:47.665878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52883637-2018-4c8c-8fa8-97ba12e85127 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:47.666990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a5191-d671-40bf-81d6-fe4dadc9c546 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:47.668872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a5191-d671-40bf-81d6-fe4dadc9c546 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:47.677598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95563fb7-4dfa-46c1-93b7-6c0205e894c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:47.678821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95563fb7-4dfa-46c1-93b7-6c0205e894c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:47.679125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95563fb7-4dfa-46c1-93b7-6c0205e894c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:47.679841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95563fb7-4dfa-46c1-93b7-6c0205e894c7 admin admin] PATH_INFO: `/v3/users/bcab9436967748519726af2bb6321864` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:47.683928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95563fb7-4dfa-46c1-93b7-6c0205e894c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcab9436967748519726af2bb6321864)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:47.688235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95563fb7-4dfa-46c1-93b7-6c0205e894c7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:47.706563 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1131/2302] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:01:47.823283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-95563fb7-4dfa-46c1-93b7-6c0205e894c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcab9436967748519726af2bb6321864'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:47.840587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-95563fb7-4dfa-46c1-93b7-6c0205e894c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcab9436967748519726af2bb6321864'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:47.841713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-95563fb7-4dfa-46c1-93b7-6c0205e894c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcab9436967748519726af2bb6321864'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:47.842950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-95563fb7-4dfa-46c1-93b7-6c0205e894c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcab9436967748519726af2bb6321864'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:47.855085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-95563fb7-4dfa-46c1-93b7-6c0205e894c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcab9436967748519726af2bb6321864'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:47.896012 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1172/2303] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:47 2022] DELETE /identity/v3/users/bcab9436967748519726af2bb6321864 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:48.231908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a5191-d671-40bf-81d6-fe4dadc9c546 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:48.233997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0a5a5191-d671-40bf-81d6-fe4dadc9c546 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:48.258268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a5191-d671-40bf-81d6-fe4dadc9c546 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:48.366635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fe2c8-9455-465d-8a0e-dcf30d9963cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:48.367715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fe2c8-9455-465d-8a0e-dcf30d9963cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:48.368211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fe2c8-9455-465d-8a0e-dcf30d9963cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:48.368661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fe2c8-9455-465d-8a0e-dcf30d9963cc admin admin] PATH_INFO: `/v3/projects/86d180accd794d748ed7093a2497dcd8` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:48.370106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fe2c8-9455-465d-8a0e-dcf30d9963cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d180accd794d748ed7093a2497dcd8)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:48.372249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fe2c8-9455-465d-8a0e-dcf30d9963cc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:48.445830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5f2fe2c8-9455-465d-8a0e-dcf30d9963cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d180accd794d748ed7093a2497dcd8', 'request_id': 'req-5f2fe2c8-9455-465d-8a0e-dcf30d9963cc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:48.474735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5f2fe2c8-9455-465d-8a0e-dcf30d9963cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d180accd794d748ed7093a2497dcd8', 'request_id': 'req-5f2fe2c8-9455-465d-8a0e-dcf30d9963cc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:48.490793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5f2fe2c8-9455-465d-8a0e-dcf30d9963cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d180accd794d748ed7093a2497dcd8', 'request_id': 'req-5f2fe2c8-9455-465d-8a0e-dcf30d9963cc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:48.542419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5f2fe2c8-9455-465d-8a0e-dcf30d9963cc admin admin] The token cache is being invalidate because project 86d180accd794d748ed7093a2497dcd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:48.542736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5f2fe2c8-9455-465d-8a0e-dcf30d9963cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:48.545296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5f2fe2c8-9455-465d-8a0e-dcf30d9963cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:48.550213 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1132/2304] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:48 2022] DELETE /identity/v3/projects/86d180accd794d748ed7093a2497dcd8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:48.554936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95563fb7-4dfa-46c1-93b7-6c0205e894c7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:48.557384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-95563fb7-4dfa-46c1-93b7-6c0205e894c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:48.586943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95563fb7-4dfa-46c1-93b7-6c0205e894c7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:48.600581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:48.710464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314b4ee-72a1-45df-8017-5df5ab27abb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:48.713070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314b4ee-72a1-45df-8017-5df5ab27abb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:48.713830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314b4ee-72a1-45df-8017-5df5ab27abb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:48.714368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314b4ee-72a1-45df-8017-5df5ab27abb2 admin admin] PATH_INFO: `/v3/users/af7e157c93a24909baed949020a31e6d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:48.718283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314b4ee-72a1-45df-8017-5df5ab27abb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af7e157c93a24909baed949020a31e6d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:48.721658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314b4ee-72a1-45df-8017-5df5ab27abb2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:48.852937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a314b4ee-72a1-45df-8017-5df5ab27abb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af7e157c93a24909baed949020a31e6d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:48.874282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a314b4ee-72a1-45df-8017-5df5ab27abb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af7e157c93a24909baed949020a31e6d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:48.875096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a314b4ee-72a1-45df-8017-5df5ab27abb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af7e157c93a24909baed949020a31e6d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:48.875839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a314b4ee-72a1-45df-8017-5df5ab27abb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af7e157c93a24909baed949020a31e6d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:48.888893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a314b4ee-72a1-45df-8017-5df5ab27abb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af7e157c93a24909baed949020a31e6d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:48.928431 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1173/2305] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:48 2022] DELETE /identity/v3/users/af7e157c93a24909baed949020a31e6d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:49.511295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfca9fb-b3bb-4c1b-aa8c-d1413a949a95 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:49.511934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfca9fb-b3bb-4c1b-aa8c-d1413a949a95 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:49.511934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfca9fb-b3bb-4c1b-aa8c-d1413a949a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:49.527023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314b4ee-72a1-45df-8017-5df5ab27abb2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:49.529938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a314b4ee-72a1-45df-8017-5df5ab27abb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:49.569888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1dfca9fb-b3bb-4c1b-aa8c-d1413a949a95 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:49.574439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1dfca9fb-b3bb-4c1b-aa8c-d1413a949a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:49.675550 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1133/2306] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:01:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:49.684201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314b4ee-72a1-45df-8017-5df5ab27abb2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:49.695396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfca9fb-b3bb-4c1b-aa8c-d1413a949a95 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:49.695592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b33ea-a401-4f4a-a8b5-370fca57d213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:49.696363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b33ea-a401-4f4a-a8b5-370fca57d213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:49.696709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b33ea-a401-4f4a-a8b5-370fca57d213 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:49.696888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1dfca9fb-b3bb-4c1b-aa8c-d1413a949a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:49.697043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b33ea-a401-4f4a-a8b5-370fca57d213 admin admin] PATH_INFO: `/v3/projects/f024a13edfe44741b289a28f8c20ef33` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:49.709055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b33ea-a401-4f4a-a8b5-370fca57d213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f024a13edfe44741b289a28f8c20ef33)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:49.711168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b33ea-a401-4f4a-a8b5-370fca57d213 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:49.746026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:49.776522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:49.805020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bc9b33ea-a401-4f4a-a8b5-370fca57d213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f024a13edfe44741b289a28f8c20ef33', 'request_id': 'req-bc9b33ea-a401-4f4a-a8b5-370fca57d213'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:49.827468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bc9b33ea-a401-4f4a-a8b5-370fca57d213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f024a13edfe44741b289a28f8c20ef33', 'request_id': 'req-bc9b33ea-a401-4f4a-a8b5-370fca57d213'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:49.836986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bc9b33ea-a401-4f4a-a8b5-370fca57d213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f024a13edfe44741b289a28f8c20ef33', 'request_id': 'req-bc9b33ea-a401-4f4a-a8b5-370fca57d213'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:49.848508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfca9fb-b3bb-4c1b-aa8c-d1413a949a95 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:49.861282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bc9b33ea-a401-4f4a-a8b5-370fca57d213 admin admin] The token cache is being invalidate because project f024a13edfe44741b289a28f8c20ef33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:49.861495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bc9b33ea-a401-4f4a-a8b5-370fca57d213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:49.862296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bc9b33ea-a401-4f4a-a8b5-370fca57d213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:49.864292 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1174/2307] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:49 2022] DELETE /identity/v3/projects/f024a13edfe44741b289a28f8c20ef33 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:49.868953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaae05c-8305-48b8-a7a2-fe7effaf80c5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:49.869241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaae05c-8305-48b8-a7a2-fe7effaf80c5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:49.869523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaae05c-8305-48b8-a7a2-fe7effaf80c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:49.909677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3aaae05c-8305-48b8-a7a2-fe7effaf80c5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:49.911300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3aaae05c-8305-48b8-a7a2-fe7effaf80c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:49.953467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22396d4-1458-49d2-bc46-615917e007ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:49.954826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22396d4-1458-49d2-bc46-615917e007ac service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:49.955012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22396d4-1458-49d2-bc46-615917e007ac service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:49.955404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22396d4-1458-49d2-bc46-615917e007ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:49.958705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a22396d4-1458-49d2-bc46-615917e007ac service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:50.066408 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1175/2308] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:01:50.067322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaae05c-8305-48b8-a7a2-fe7effaf80c5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:50.070886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3aaae05c-8305-48b8-a7a2-fe7effaf80c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:50.107712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaae05c-8305-48b8-a7a2-fe7effaf80c5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:50.130247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5d4e4-4f10-4a07-93b0-36aeeaf6e500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:50.131763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5d4e4-4f10-4a07-93b0-36aeeaf6e500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:50.132545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5d4e4-4f10-4a07-93b0-36aeeaf6e500 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:50.134175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22396d4-1458-49d2-bc46-615917e007ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:50.134283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5d4e4-4f10-4a07-93b0-36aeeaf6e500 admin admin] PATH_INFO: `/v3/projects/08ea7e8980754be9be832d38d4e86d63` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:50.135010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22396d4-1458-49d2-bc46-615917e007ac service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:50.135542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5d4e4-4f10-4a07-93b0-36aeeaf6e500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08ea7e8980754be9be832d38d4e86d63)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:50.138614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5d4e4-4f10-4a07-93b0-36aeeaf6e500 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:50.157567 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1134/2309] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:01:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:50.159977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77ad42-91d9-4a43-95fc-b9bd8514683c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:50.160291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77ad42-91d9-4a43-95fc-b9bd8514683c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:50.160635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77ad42-91d9-4a43-95fc-b9bd8514683c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:50.210090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2a77ad42-91d9-4a43-95fc-b9bd8514683c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:50.213540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2a77ad42-91d9-4a43-95fc-b9bd8514683c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:50.231397 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1135/2310] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:50.232799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77ad42-91d9-4a43-95fc-b9bd8514683c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:50.253023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77ad42-91d9-4a43-95fc-b9bd8514683c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:50.297567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ddd5d4e4-4f10-4a07-93b0-36aeeaf6e500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08ea7e8980754be9be832d38d4e86d63', 'request_id': 'req-ddd5d4e4-4f10-4a07-93b0-36aeeaf6e500'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:50.332513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ddd5d4e4-4f10-4a07-93b0-36aeeaf6e500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08ea7e8980754be9be832d38d4e86d63', 'request_id': 'req-ddd5d4e4-4f10-4a07-93b0-36aeeaf6e500'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:50.360371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ddd5d4e4-4f10-4a07-93b0-36aeeaf6e500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08ea7e8980754be9be832d38d4e86d63', 'request_id': 'req-ddd5d4e4-4f10-4a07-93b0-36aeeaf6e500'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:50.405146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ddd5d4e4-4f10-4a07-93b0-36aeeaf6e500 admin admin] The token cache is being invalidate because project 08ea7e8980754be9be832d38d4e86d63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:50.405626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ddd5d4e4-4f10-4a07-93b0-36aeeaf6e500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:50.406942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ddd5d4e4-4f10-4a07-93b0-36aeeaf6e500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:50.413875 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1176/2311] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:50 2022] DELETE /identity/v3/projects/08ea7e8980754be9be832d38d4e86d63 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:50.414647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e65ad-4b33-4a68-9e65-caa2df14a9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:50.415354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e65ad-4b33-4a68-9e65-caa2df14a9fc admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:50.415635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e65ad-4b33-4a68-9e65-caa2df14a9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:50.417340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e65ad-4b33-4a68-9e65-caa2df14a9fc admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:50.418122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e65ad-4b33-4a68-9e65-caa2df14a9fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:50.418442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e65ad-4b33-4a68-9e65-caa2df14a9fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:50.421180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867d094-90a9-45e8-b1cb-fa8fb78a862f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:50.421673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e65ad-4b33-4a68-9e65-caa2df14a9fc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:50.422768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867d094-90a9-45e8-b1cb-fa8fb78a862f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:50.423254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867d094-90a9-45e8-b1cb-fa8fb78a862f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:50.439361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:50.453856 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1136/2312] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:50.454971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e65ad-4b33-4a68-9e65-caa2df14a9fc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:50.457736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ca0e65ad-4b33-4a68-9e65-caa2df14a9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:50.474721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e65ad-4b33-4a68-9e65-caa2df14a9fc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:50.480654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496599a9-ad61-49b7-8c40-6d50953a0a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:50.481786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496599a9-ad61-49b7-8c40-6d50953a0a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:50.482177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496599a9-ad61-49b7-8c40-6d50953a0a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:50.482601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496599a9-ad61-49b7-8c40-6d50953a0a94 admin admin] PATH_INFO: `/v3/users/a8ae594a351c42d7a790c76efd50e305` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:50.483941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496599a9-ad61-49b7-8c40-6d50953a0a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ae594a351c42d7a790c76efd50e305)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:50.491431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496599a9-ad61-49b7-8c40-6d50953a0a94 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:50.493769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1867d094-90a9-45e8-b1cb-fa8fb78a862f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:50.495198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1867d094-90a9-45e8-b1cb-fa8fb78a862f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:50.505237 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1177/2313] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:50.506986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867d094-90a9-45e8-b1cb-fa8fb78a862f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:50.508558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1867d094-90a9-45e8-b1cb-fa8fb78a862f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:50.521649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867d094-90a9-45e8-b1cb-fa8fb78a862f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:50.528287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd0def-9786-4b26-8b6b-9868b8161050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:50.529233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd0def-9786-4b26-8b6b-9868b8161050 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:50.529697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd0def-9786-4b26-8b6b-9868b8161050 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:50.530166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd0def-9786-4b26-8b6b-9868b8161050 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:50.531046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd0def-9786-4b26-8b6b-9868b8161050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:50.538580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd0def-9786-4b26-8b6b-9868b8161050 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:50.592924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-496599a9-ad61-49b7-8c40-6d50953a0a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ae594a351c42d7a790c76efd50e305'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:50.601453 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1178/2314] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:50 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:50.602952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2c320-2c5b-4e9d-a13c-14df652f7eee None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:50.606416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2c320-2c5b-4e9d-a13c-14df652f7eee None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:50.607291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2c320-2c5b-4e9d-a13c-14df652f7eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:50.645025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-496599a9-ad61-49b7-8c40-6d50953a0a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ae594a351c42d7a790c76efd50e305'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:50.656296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-496599a9-ad61-49b7-8c40-6d50953a0a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ae594a351c42d7a790c76efd50e305'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:50.657638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-496599a9-ad61-49b7-8c40-6d50953a0a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ae594a351c42d7a790c76efd50e305'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:50.658840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-496599a9-ad61-49b7-8c40-6d50953a0a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ae594a351c42d7a790c76efd50e305'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:50.681950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f8c2c320-2c5b-4e9d-a13c-14df652f7eee None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:50.687022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f8c2c320-2c5b-4e9d-a13c-14df652f7eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:50.690816 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1137/2315] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:50 2022] DELETE /identity/v3/users/a8ae594a351c42d7a790c76efd50e305 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:50.694803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496599a9-ad61-49b7-8c40-6d50953a0a94 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:50.696652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-496599a9-ad61-49b7-8c40-6d50953a0a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:50.704424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:50.789063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496599a9-ad61-49b7-8c40-6d50953a0a94 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:50.795770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034a93a-cb20-4487-9627-24a3cfbaa47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:50.796701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034a93a-cb20-4487-9627-24a3cfbaa47c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:50.797085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034a93a-cb20-4487-9627-24a3cfbaa47c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:50.797754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034a93a-cb20-4487-9627-24a3cfbaa47c admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:50.798585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034a93a-cb20-4487-9627-24a3cfbaa47c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:50.800907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034a93a-cb20-4487-9627-24a3cfbaa47c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:50.831424 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1138/2316] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:50 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:50.833355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774c0b4-3ddb-4e79-812b-8bd5b46b870b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:50.833691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774c0b4-3ddb-4e79-812b-8bd5b46b870b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:50.833971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774c0b4-3ddb-4e79-812b-8bd5b46b870b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:50.854341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3774c0b4-3ddb-4e79-812b-8bd5b46b870b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:50.855606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3774c0b4-3ddb-4e79-812b-8bd5b46b870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:50.868556 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1139/2317] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:50.868556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774c0b4-3ddb-4e79-812b-8bd5b46b870b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:50.882407 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1179/2318] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:50.886699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774c0b4-3ddb-4e79-812b-8bd5b46b870b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:50.886824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2c320-2c5b-4e9d-a13c-14df652f7eee None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:50.894968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef39fb8-782a-4d9b-ad7b-b817cc274cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:50.895906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef39fb8-782a-4d9b-ad7b-b817cc274cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:50.896302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef39fb8-782a-4d9b-ad7b-b817cc274cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:50.896638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef39fb8-782a-4d9b-ad7b-b817cc274cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:50.899672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef39fb8-782a-4d9b-ad7b-b817cc274cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:50.901418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef39fb8-782a-4d9b-ad7b-b817cc274cc8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:50.915815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2c320-2c5b-4e9d-a13c-14df652f7eee None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:50.918717 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1140/2319] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:50.924841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef39fb8-782a-4d9b-ad7b-b817cc274cc8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:50.928810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65614e-68bd-4424-a984-85d3c62b1ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:50.929508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65614e-68bd-4424-a984-85d3c62b1ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:50.929788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65614e-68bd-4424-a984-85d3c62b1ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:50.930063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65614e-68bd-4424-a984-85d3c62b1ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:50.930810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65614e-68bd-4424-a984-85d3c62b1ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:50.931119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65614e-68bd-4424-a984-85d3c62b1ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:50.932791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65614e-68bd-4424-a984-85d3c62b1ec7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:50.943677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef39fb8-782a-4d9b-ad7b-b817cc274cc8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:50.949303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade8387-e5e7-46d9-87ee-30a8375aeb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:50.950199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade8387-e5e7-46d9-87ee-30a8375aeb62 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:50.950564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade8387-e5e7-46d9-87ee-30a8375aeb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:50.950904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade8387-e5e7-46d9-87ee-30a8375aeb62 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:50.951707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade8387-e5e7-46d9-87ee-30a8375aeb62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:50.953518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade8387-e5e7-46d9-87ee-30a8375aeb62 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:50.961986 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1180/2320] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:50.966039 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1141/2321] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:50.969408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65614e-68bd-4424-a984-85d3c62b1ec7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:50.969893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade8387-e5e7-46d9-87ee-30a8375aeb62 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:50.971854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-aade8387-e5e7-46d9-87ee-30a8375aeb62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:50.988589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65614e-68bd-4424-a984-85d3c62b1ec7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:51.000084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbd865-98eb-4a02-ad35-8ea1d7e188ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:51.000813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbd865-98eb-4a02-ad35-8ea1d7e188ff admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:51.001062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbd865-98eb-4a02-ad35-8ea1d7e188ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:51.001331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbd865-98eb-4a02-ad35-8ea1d7e188ff admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:51.002038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbd865-98eb-4a02-ad35-8ea1d7e188ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:51.004004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbd865-98eb-4a02-ad35-8ea1d7e188ff admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:51.038113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:51.072900 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1181/2322] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:50 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:01:51.072900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbd865-98eb-4a02-ad35-8ea1d7e188ff admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:51.110164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade8387-e5e7-46d9-87ee-30a8375aeb62 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:51.202746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70308f48-d691-4161-ae2c-0f6b3a2068ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:51.203571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70308f48-d691-4161-ae2c-0f6b3a2068ff service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:51.204731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70308f48-d691-4161-ae2c-0f6b3a2068ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:51.210657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70308f48-d691-4161-ae2c-0f6b3a2068ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:51.216168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbd865-98eb-4a02-ad35-8ea1d7e188ff admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:51.234750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a396f8-228a-4a55-a749-46b07366e2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:51.235683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a396f8-228a-4a55-a749-46b07366e2cf admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:51.235967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a396f8-228a-4a55-a749-46b07366e2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:51.236929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a396f8-228a-4a55-a749-46b07366e2cf admin admin] PATH_INFO: `/v3/projects/63f39c85f12c4ad58be6d786de9a584b/users/592e8c2ad31f459fa0b37f219cc4f84c/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:51.242279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70308f48-d691-4161-ae2c-0f6b3a2068ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:51.244331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70308f48-d691-4161-ae2c-0f6b3a2068ff service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:51.259919 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1142/2323] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:51.261118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70308f48-d691-4161-ae2c-0f6b3a2068ff service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:51.272135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a396f8-228a-4a55-a749-46b07366e2cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f39c85f12c4ad58be6d786de9a584b, user_id=592e8c2ad31f459fa0b37f219cc4f84c, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:51.273429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70308f48-d691-4161-ae2c-0f6b3a2068ff service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:51.275396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a396f8-228a-4a55-a749-46b07366e2cf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:51.279834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf52bb-0f0d-4769-88d1-8dffd795a123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:51.280626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf52bb-0f0d-4769-88d1-8dffd795a123 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:51.280918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf52bb-0f0d-4769-88d1-8dffd795a123 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:51.281238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf52bb-0f0d-4769-88d1-8dffd795a123 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:51.281957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf52bb-0f0d-4769-88d1-8dffd795a123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:51.283968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf52bb-0f0d-4769-88d1-8dffd795a123 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:51.312900 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1182/2324] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:51 2022] PUT /identity/v3/projects/63f39c85f12c4ad58be6d786de9a584b/users/592e8c2ad31f459fa0b37f219cc4f84c/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:51.323567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0d94f-21c2-4b7a-a6b2-c8086bf9368e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:51.323857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0d94f-21c2-4b7a-a6b2-c8086bf9368e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:51.324173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0d94f-21c2-4b7a-a6b2-c8086bf9368e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:51.347451 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1143/2325] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:51 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:51.355846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf52bb-0f0d-4769-88d1-8dffd795a123 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:51.377934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c8a0d94f-21c2-4b7a-a6b2-c8086bf9368e None None] MFA Rules not processed for user `592e8c2ad31f459fa0b37f219cc4f84c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:51.379188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c8a0d94f-21c2-4b7a-a6b2-c8086bf9368e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:51.395723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf52bb-0f0d-4769-88d1-8dffd795a123 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:51.507625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:51.540995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d759b-f172-471e-8ef3-80ee1e115c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:51.541973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d759b-f172-471e-8ef3-80ee1e115c20 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:51.542639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d759b-f172-471e-8ef3-80ee1e115c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:51.543088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d759b-f172-471e-8ef3-80ee1e115c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:51.545318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d759b-f172-471e-8ef3-80ee1e115c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:51.547790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d759b-f172-471e-8ef3-80ee1e115c20 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:51.559154 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1183/2326] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:51.563770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0d94f-21c2-4b7a-a6b2-c8086bf9368e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:51.576870 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1144/2327] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:51.580620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d759b-f172-471e-8ef3-80ee1e115c20 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:51.589446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0d94f-21c2-4b7a-a6b2-c8086bf9368e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:51.597214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6684e6-4857-43ff-8a14-c026f7c19226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:51.597943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6684e6-4857-43ff-8a14-c026f7c19226 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:51.598229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6684e6-4857-43ff-8a14-c026f7c19226 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:51.598513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6684e6-4857-43ff-8a14-c026f7c19226 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:51.599206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6684e6-4857-43ff-8a14-c026f7c19226 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:51.604968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6684e6-4857-43ff-8a14-c026f7c19226 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:51.609694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d759b-f172-471e-8ef3-80ee1e115c20 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:51.627087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d308d87-e496-48b1-8aeb-0e3b4b856bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:51.628331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d308d87-e496-48b1-8aeb-0e3b4b856bca admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:51.628331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d308d87-e496-48b1-8aeb-0e3b4b856bca admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:51.628331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d308d87-e496-48b1-8aeb-0e3b4b856bca admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:51.633310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d308d87-e496-48b1-8aeb-0e3b4b856bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:51.634823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d308d87-e496-48b1-8aeb-0e3b4b856bca admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:51.651997 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1145/2328] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:01:51.656327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d308d87-e496-48b1-8aeb-0e3b4b856bca admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:51.664441 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1184/2329] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:51 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:51.668968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6684e6-4857-43ff-8a14-c026f7c19226 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:51.671513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d308d87-e496-48b1-8aeb-0e3b4b856bca admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:51.811603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:51.823520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6684e6-4857-43ff-8a14-c026f7c19226 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:51.830605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd3f3a-ce1e-4dd2-b77f-71584a845858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:51.831436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271a222-b5c4-42cd-9622-6503c0014fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:51.831564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd3f3a-ce1e-4dd2-b77f-71584a845858 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:51.831812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd3f3a-ce1e-4dd2-b77f-71584a845858 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:51.832643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd3f3a-ce1e-4dd2-b77f-71584a845858 admin admin] PATH_INFO: `/v3/projects/7446ab773d3343c5938091756e592f97/users/a3880346be3e4ddfbbc0a822c179bc64/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:51.833402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271a222-b5c4-42cd-9622-6503c0014fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:51.834145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271a222-b5c4-42cd-9622-6503c0014fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:51.834866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271a222-b5c4-42cd-9622-6503c0014fb1 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:51.836964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271a222-b5c4-42cd-9622-6503c0014fb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:51.839752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271a222-b5c4-42cd-9622-6503c0014fb1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:51.858227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd3f3a-ce1e-4dd2-b77f-71584a845858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7446ab773d3343c5938091756e592f97, user_id=a3880346be3e4ddfbbc0a822c179bc64, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:51.861145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd3f3a-ce1e-4dd2-b77f-71584a845858 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:51.873891 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1185/2330] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:51 2022] POST /identity/v3/users => generated 294 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:01:51.876224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271a222-b5c4-42cd-9622-6503c0014fb1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:51.887791 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1146/2331] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:51 2022] PUT /identity/v3/projects/7446ab773d3343c5938091756e592f97/users/a3880346be3e4ddfbbc0a822c179bc64/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:51.898445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f39fa9-02af-44b5-879e-ab741fcbe8af None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:51.899046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f39fa9-02af-44b5-879e-ab741fcbe8af None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:51.899320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f39fa9-02af-44b5-879e-ab741fcbe8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:51.908497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271a222-b5c4-42cd-9622-6503c0014fb1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:51.957820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-45f39fa9-02af-44b5-879e-ab741fcbe8af None None] MFA Rules not processed for user `a3880346be3e4ddfbbc0a822c179bc64`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:51.961271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-45f39fa9-02af-44b5-879e-ab741fcbe8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:52.055054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417702f-18bb-4e31-8afe-e40dfbaef7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:52.056158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417702f-18bb-4e31-8afe-e40dfbaef7cd admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:52.058695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417702f-18bb-4e31-8afe-e40dfbaef7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:52.059000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417702f-18bb-4e31-8afe-e40dfbaef7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:52.060327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417702f-18bb-4e31-8afe-e40dfbaef7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:52.066553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417702f-18bb-4e31-8afe-e40dfbaef7cd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:52.093216 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1186/2332] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:01:52.101235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417702f-18bb-4e31-8afe-e40dfbaef7cd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:52.113576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417702f-18bb-4e31-8afe-e40dfbaef7cd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:52.122258 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1147/2333] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:52.122462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be1d3c-f21b-491a-838d-9fdb048b6680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:52.123521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be1d3c-f21b-491a-838d-9fdb048b6680 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:52.123899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be1d3c-f21b-491a-838d-9fdb048b6680 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:52.124340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be1d3c-f21b-491a-838d-9fdb048b6680 admin admin] PATH_INFO: `/v3/projects/9aacdf1893ae44e383bfc224b1e78784/users/1068ef10c5ca46619e6280360e5a0930/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:52.125465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f39fa9-02af-44b5-879e-ab741fcbe8af None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:52.144507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be1d3c-f21b-491a-838d-9fdb048b6680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aacdf1893ae44e383bfc224b1e78784, user_id=1068ef10c5ca46619e6280360e5a0930, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:52.147819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be1d3c-f21b-491a-838d-9fdb048b6680 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:52.159685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f39fa9-02af-44b5-879e-ab741fcbe8af None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:52.178285 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1187/2334] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:52 2022] PUT /identity/v3/projects/9aacdf1893ae44e383bfc224b1e78784/users/1068ef10c5ca46619e6280360e5a0930/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:52.179664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be1d3c-f21b-491a-838d-9fdb048b6680 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:52.288185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:52.335318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3823fdc-c8bd-4893-a27c-860b27223f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:52.336077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3823fdc-c8bd-4893-a27c-860b27223f53 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:52.336685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3823fdc-c8bd-4893-a27c-860b27223f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:52.336805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3823fdc-c8bd-4893-a27c-860b27223f53 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:52.337431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3823fdc-c8bd-4893-a27c-860b27223f53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:52.339498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3823fdc-c8bd-4893-a27c-860b27223f53 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:52.376708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be1d3c-f21b-491a-838d-9fdb048b6680 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:52.388584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f6530-52dc-4a1e-beb9-c35595b742da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:52.389337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f6530-52dc-4a1e-beb9-c35595b742da admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:52.389622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f6530-52dc-4a1e-beb9-c35595b742da admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:52.389901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f6530-52dc-4a1e-beb9-c35595b742da admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:52.390638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f6530-52dc-4a1e-beb9-c35595b742da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:52.397326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f6530-52dc-4a1e-beb9-c35595b742da admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:52.398238 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1148/2335] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:52 2022] POST /identity/v3/projects => generated 387 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:52.399554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3823fdc-c8bd-4893-a27c-860b27223f53 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:52.425911 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1188/2336] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:52.430189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f6530-52dc-4a1e-beb9-c35595b742da admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:52.452515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f6530-52dc-4a1e-beb9-c35595b742da admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:52.562448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:52.579173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3823fdc-c8bd-4893-a27c-860b27223f53 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:52.592958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110afff-512d-46e6-b8df-d9effb3f375a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:52.593965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110afff-512d-46e6-b8df-d9effb3f375a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:52.594428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110afff-512d-46e6-b8df-d9effb3f375a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:52.594916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110afff-512d-46e6-b8df-d9effb3f375a admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:52.596454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110afff-512d-46e6-b8df-d9effb3f375a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:52.602788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110afff-512d-46e6-b8df-d9effb3f375a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:52.627940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2590f56-953d-4ad9-99bc-649ccf742710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:52.630061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2590f56-953d-4ad9-99bc-649ccf742710 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:52.630468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2590f56-953d-4ad9-99bc-649ccf742710 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:52.630990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2590f56-953d-4ad9-99bc-649ccf742710 admin admin] PATH_INFO: `/v3/projects/9aacdf1893ae44e383bfc224b1e78784/users/1068ef10c5ca46619e6280360e5a0930/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:52.634043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2590f56-953d-4ad9-99bc-649ccf742710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aacdf1893ae44e383bfc224b1e78784, user_id=1068ef10c5ca46619e6280360e5a0930, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:52.648132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2590f56-953d-4ad9-99bc-649ccf742710 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:52.656837 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1149/2337] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:52 2022] POST /identity/v3/users => generated 300 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:52.658489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110afff-512d-46e6-b8df-d9effb3f375a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:52.681851 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1189/2338] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:52 2022] PUT /identity/v3/projects/9aacdf1893ae44e383bfc224b1e78784/users/1068ef10c5ca46619e6280360e5a0930/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:52.698583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff347845-9bc6-44a2-a3eb-af8ce15cbfbc None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:52.698934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff347845-9bc6-44a2-a3eb-af8ce15cbfbc None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:52.699435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff347845-9bc6-44a2-a3eb-af8ce15cbfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:52.700026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110afff-512d-46e6-b8df-d9effb3f375a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:52.770396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ff347845-9bc6-44a2-a3eb-af8ce15cbfbc None None] MFA Rules not processed for user `1068ef10c5ca46619e6280360e5a0930`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:52.771862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ff347845-9bc6-44a2-a3eb-af8ce15cbfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:52.853712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51852b-74fb-4ae4-884e-069f0fc6bca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:52.854564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51852b-74fb-4ae4-884e-069f0fc6bca4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:52.854848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51852b-74fb-4ae4-884e-069f0fc6bca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:52.855121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51852b-74fb-4ae4-884e-069f0fc6bca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:52.856088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51852b-74fb-4ae4-884e-069f0fc6bca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:52.857697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51852b-74fb-4ae4-884e-069f0fc6bca4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:52.881440 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1150/2339] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:52.885508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51852b-74fb-4ae4-884e-069f0fc6bca4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:52.914727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51852b-74fb-4ae4-884e-069f0fc6bca4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:52.936565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe38a1a-8db2-4f50-b1df-d8706b65a606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:52.938003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe38a1a-8db2-4f50-b1df-d8706b65a606 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:52.938430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe38a1a-8db2-4f50-b1df-d8706b65a606 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:52.938833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe38a1a-8db2-4f50-b1df-d8706b65a606 admin admin] PATH_INFO: `/v3/projects/e4a47b7c8d8447f88c04b24a475514d8/users/40bf017752034f5fa719b92b7ab06dee/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:52.988441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe38a1a-8db2-4f50-b1df-d8706b65a606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a47b7c8d8447f88c04b24a475514d8, user_id=40bf017752034f5fa719b92b7ab06dee, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:52.991200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe38a1a-8db2-4f50-b1df-d8706b65a606 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:53.013943 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1151/2340] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:52 2022] PUT /identity/v3/projects/e4a47b7c8d8447f88c04b24a475514d8/users/40bf017752034f5fa719b92b7ab06dee/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:01:53.018003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe38a1a-8db2-4f50-b1df-d8706b65a606 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:53.032427 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1190/2341] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:53.033495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff347845-9bc6-44a2-a3eb-af8ce15cbfbc None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:53.036071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ff347845-9bc6-44a2-a3eb-af8ce15cbfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:53.077764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff347845-9bc6-44a2-a3eb-af8ce15cbfbc None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:53.163082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe38a1a-8db2-4f50-b1df-d8706b65a606 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:53.164558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:53.173318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca74940-8b56-4b35-8a9e-355d03ac9b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:53.174543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca74940-8b56-4b35-8a9e-355d03ac9b5a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:53.174979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca74940-8b56-4b35-8a9e-355d03ac9b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:53.175606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca74940-8b56-4b35-8a9e-355d03ac9b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:53.176900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca74940-8b56-4b35-8a9e-355d03ac9b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:53.180349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca74940-8b56-4b35-8a9e-355d03ac9b5a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:53.185724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f55bbb-bf4d-4b42-bda3-1aaaeb6b415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:53.186624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f55bbb-bf4d-4b42-bda3-1aaaeb6b415a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:53.186905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f55bbb-bf4d-4b42-bda3-1aaaeb6b415a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:53.187182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f55bbb-bf4d-4b42-bda3-1aaaeb6b415a admin admin] PATH_INFO: `/v3/projects/753c958df79645c09e5b6e12fdc8b454` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:53.188493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f55bbb-bf4d-4b42-bda3-1aaaeb6b415a admin admin] RBAC: Authorizing `identity:delete_project(project_id=753c958df79645c09e5b6e12fdc8b454)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:53.191375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f55bbb-bf4d-4b42-bda3-1aaaeb6b415a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:53.198106 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1152/2342] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:01:53.200460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b88b4-d82f-47f0-b9ea-1e8b7de739f4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:53.201229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b88b4-d82f-47f0-b9ea-1e8b7de739f4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:53.201529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b88b4-d82f-47f0-b9ea-1e8b7de739f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:53.225773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-585b88b4-d82f-47f0-b9ea-1e8b7de739f4 None None] MFA Rules not processed for user `592e8c2ad31f459fa0b37f219cc4f84c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:53.227366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-585b88b4-d82f-47f0-b9ea-1e8b7de739f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:53.272278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-64f55bbb-bf4d-4b42-bda3-1aaaeb6b415a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '753c958df79645c09e5b6e12fdc8b454', 'request_id': 'req-64f55bbb-bf4d-4b42-bda3-1aaaeb6b415a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:53.284114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-64f55bbb-bf4d-4b42-bda3-1aaaeb6b415a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '753c958df79645c09e5b6e12fdc8b454', 'request_id': 'req-64f55bbb-bf4d-4b42-bda3-1aaaeb6b415a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:53.297728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-64f55bbb-bf4d-4b42-bda3-1aaaeb6b415a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '753c958df79645c09e5b6e12fdc8b454', 'request_id': 'req-64f55bbb-bf4d-4b42-bda3-1aaaeb6b415a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:53.327956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-64f55bbb-bf4d-4b42-bda3-1aaaeb6b415a admin admin] The token cache is being invalidate because project 753c958df79645c09e5b6e12fdc8b454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:53.328342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-64f55bbb-bf4d-4b42-bda3-1aaaeb6b415a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:53.329186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-64f55bbb-bf4d-4b42-bda3-1aaaeb6b415a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:53.336731 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1191/2343] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:53 2022] DELETE /identity/v3/projects/753c958df79645c09e5b6e12fdc8b454 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:53.337835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f55bbb-bf4d-4b42-bda3-1aaaeb6b415a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:53.339989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-64f55bbb-bf4d-4b42-bda3-1aaaeb6b415a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:53.364258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:53.390818 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1153/2344] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:53.394499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3dd61-40c1-4c71-b41a-e0fcc44c4b11 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:53.395781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3dd61-40c1-4c71-b41a-e0fcc44c4b11 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:53.396993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3dd61-40c1-4c71-b41a-e0fcc44c4b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:53.440653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9dc3dd61-40c1-4c71-b41a-e0fcc44c4b11 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:53.444492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9dc3dd61-40c1-4c71-b41a-e0fcc44c4b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:53.509350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f55bbb-bf4d-4b42-bda3-1aaaeb6b415a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:53.521027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40655638-5163-41dc-8e14-aef0c9ad99be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:53.522061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40655638-5163-41dc-8e14-aef0c9ad99be admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:53.522443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40655638-5163-41dc-8e14-aef0c9ad99be admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:53.522834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40655638-5163-41dc-8e14-aef0c9ad99be admin admin] PATH_INFO: `/v3/projects/e4a47b7c8d8447f88c04b24a475514d8/users/40bf017752034f5fa719b92b7ab06dee/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:53.534739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40655638-5163-41dc-8e14-aef0c9ad99be admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a47b7c8d8447f88c04b24a475514d8, user_id=40bf017752034f5fa719b92b7ab06dee, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:53.537714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40655638-5163-41dc-8e14-aef0c9ad99be admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:53.562610 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1192/2345] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:53 2022] PUT /identity/v3/projects/e4a47b7c8d8447f88c04b24a475514d8/users/40bf017752034f5fa719b92b7ab06dee/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:53.563703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40655638-5163-41dc-8e14-aef0c9ad99be admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:53.573397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-40655638-5163-41dc-8e14-aef0c9ad99be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:53.600187 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1154/2346] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:53.601853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8448d-65fd-4cb2-adb7-89c7497f5feb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:53.602148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8448d-65fd-4cb2-adb7-89c7497f5feb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:53.607538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8448d-65fd-4cb2-adb7-89c7497f5feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:53.667587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4ba8448d-65fd-4cb2-adb7-89c7497f5feb None None] MFA Rules not processed for user `40bf017752034f5fa719b92b7ab06dee`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:53.670182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4ba8448d-65fd-4cb2-adb7-89c7497f5feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:53.738775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40655638-5163-41dc-8e14-aef0c9ad99be admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:53.752842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b465f-c5fa-40f7-ab1d-7aa353c0c695 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:53.753716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b465f-c5fa-40f7-ab1d-7aa353c0c695 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:53.754101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b465f-c5fa-40f7-ab1d-7aa353c0c695 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:53.754477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b465f-c5fa-40f7-ab1d-7aa353c0c695 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:53.757163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bc7b465f-c5fa-40f7-ab1d-7aa353c0c695 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:53.762807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:53.771010 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1155/2347] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:53.773007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaf8df-bbc8-48c7-9cb8-f035fcd9892e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:53.774548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaf8df-bbc8-48c7-9cb8-f035fcd9892e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:53.774974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaf8df-bbc8-48c7-9cb8-f035fcd9892e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:53.800786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-17eaf8df-bbc8-48c7-9cb8-f035fcd9892e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:53.802770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-17eaf8df-bbc8-48c7-9cb8-f035fcd9892e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:53.828729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b465f-c5fa-40f7-ab1d-7aa353c0c695 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:53.831309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b465f-c5fa-40f7-ab1d-7aa353c0c695 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:53.842110 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1193/2348] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:53.892249 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1156/2349] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:53.896102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b465f-c5fa-40f7-ab1d-7aa353c0c695 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:53.910359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b465f-c5fa-40f7-ab1d-7aa353c0c695 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:53.917613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eaf8df-bbc8-48c7-9cb8-f035fcd9892e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:53.918704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54100018-7ec6-42dd-a5f7-258db6317d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:53.919503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54100018-7ec6-42dd-a5f7-258db6317d46 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:53.919935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54100018-7ec6-42dd-a5f7-258db6317d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:53.920448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54100018-7ec6-42dd-a5f7-258db6317d46 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:53.921776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-17eaf8df-bbc8-48c7-9cb8-f035fcd9892e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:53.929732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54100018-7ec6-42dd-a5f7-258db6317d46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:01:53.930511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54100018-7ec6-42dd-a5f7-258db6317d46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:53.934392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54100018-7ec6-42dd-a5f7-258db6317d46 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:53.944814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eaf8df-bbc8-48c7-9cb8-f035fcd9892e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:53.952920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c270b-08e0-4e0e-8e1c-65f64d42f174 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:53.955303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c270b-08e0-4e0e-8e1c-65f64d42f174 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:53.955597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c270b-08e0-4e0e-8e1c-65f64d42f174 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:53.955879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c270b-08e0-4e0e-8e1c-65f64d42f174 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:53.973496 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1194/2350] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:01:53.975450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54100018-7ec6-42dd-a5f7-258db6317d46 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:53.985111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c270b-08e0-4e0e-8e1c-65f64d42f174 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:53.991340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c270b-08e0-4e0e-8e1c-65f64d42f174 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:54.000171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54100018-7ec6-42dd-a5f7-258db6317d46 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:54.011376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89615cf-5264-4014-ad54-488b9e578185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:54.013623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89615cf-5264-4014-ad54-488b9e578185 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:54.014929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89615cf-5264-4014-ad54-488b9e578185 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:54.015215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89615cf-5264-4014-ad54-488b9e578185 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:54.015930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89615cf-5264-4014-ad54-488b9e578185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:54.016417 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1157/2351] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:01:54.034923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89615cf-5264-4014-ad54-488b9e578185 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:54.097146 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1195/2352] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:53 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:54.103200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c270b-08e0-4e0e-8e1c-65f64d42f174 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:54.120915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c270b-08e0-4e0e-8e1c-65f64d42f174 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:54.130643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:54.194516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681c611-c2f1-40b8-9ea8-3ee38478ecff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:54.195257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681c611-c2f1-40b8-9ea8-3ee38478ecff admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:54.195557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681c611-c2f1-40b8-9ea8-3ee38478ecff admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:54.195816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681c611-c2f1-40b8-9ea8-3ee38478ecff admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:54.197083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681c611-c2f1-40b8-9ea8-3ee38478ecff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:54.199111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681c611-c2f1-40b8-9ea8-3ee38478ecff admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:54.231252 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1158/2353] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:54 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:54.231766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89615cf-5264-4014-ad54-488b9e578185 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:54.248422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89615cf-5264-4014-ad54-488b9e578185 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:54.257983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407fa86-84e6-44b5-b31c-6c5ffdd8e06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:54.258679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407fa86-84e6-44b5-b31c-6c5ffdd8e06a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:54.259274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407fa86-84e6-44b5-b31c-6c5ffdd8e06a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:54.259385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407fa86-84e6-44b5-b31c-6c5ffdd8e06a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:54.260251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407fa86-84e6-44b5-b31c-6c5ffdd8e06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:54.262063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407fa86-84e6-44b5-b31c-6c5ffdd8e06a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:54.285242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681c611-c2f1-40b8-9ea8-3ee38478ecff admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:54.288478 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1196/2354] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:01:54.306702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681c611-c2f1-40b8-9ea8-3ee38478ecff admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:54.323331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af0892-34e8-4afc-94e2-05d3bd299180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:54.324419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af0892-34e8-4afc-94e2-05d3bd299180 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:54.325180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af0892-34e8-4afc-94e2-05d3bd299180 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:54.325689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af0892-34e8-4afc-94e2-05d3bd299180 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:54.326813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af0892-34e8-4afc-94e2-05d3bd299180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:54.331290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af0892-34e8-4afc-94e2-05d3bd299180 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:54.402005 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1159/2355] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:54.407495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407fa86-84e6-44b5-b31c-6c5ffdd8e06a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:54.427401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407fa86-84e6-44b5-b31c-6c5ffdd8e06a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:54.442579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0751f2-36da-4511-bf72-0367a1b1e20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:54.443710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0751f2-36da-4511-bf72-0367a1b1e20d admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:54.444033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0751f2-36da-4511-bf72-0367a1b1e20d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:54.444902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0751f2-36da-4511-bf72-0367a1b1e20d admin admin] PATH_INFO: `/v3/projects/cf58f8d6d237407ca69b667e089ef5e5/users/aeca74e8f34544b49f4276aff011a596/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:54.481997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0751f2-36da-4511-bf72-0367a1b1e20d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf58f8d6d237407ca69b667e089ef5e5, user_id=aeca74e8f34544b49f4276aff011a596, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:54.485293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0751f2-36da-4511-bf72-0367a1b1e20d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:54.514501 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1197/2356] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:54 2022] PUT /identity/v3/projects/cf58f8d6d237407ca69b667e089ef5e5/users/aeca74e8f34544b49f4276aff011a596/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:54.529407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4caa23b-b852-41c6-81cf-0f3e0e7d5c63 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:54.529702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4caa23b-b852-41c6-81cf-0f3e0e7d5c63 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:54.529987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4caa23b-b852-41c6-81cf-0f3e0e7d5c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:54.602769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c4caa23b-b852-41c6-81cf-0f3e0e7d5c63 None None] MFA Rules not processed for user `aeca74e8f34544b49f4276aff011a596`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:54.604108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c4caa23b-b852-41c6-81cf-0f3e0e7d5c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:54.782008 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1160/2357] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:01:55.530000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0751f2-36da-4511-bf72-0367a1b1e20d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:55.697607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0751f2-36da-4511-bf72-0367a1b1e20d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:55.706084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475f000-d10c-4063-bdc2-b78da6527c60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:55.706876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475f000-d10c-4063-bdc2-b78da6527c60 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:55.707346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475f000-d10c-4063-bdc2-b78da6527c60 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:55.707722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475f000-d10c-4063-bdc2-b78da6527c60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:55.717444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475f000-d10c-4063-bdc2-b78da6527c60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:55.719272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475f000-d10c-4063-bdc2-b78da6527c60 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:55.730738 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1198/2358] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:55.902067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4caa23b-b852-41c6-81cf-0f3e0e7d5c63 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:55.920204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4caa23b-b852-41c6-81cf-0f3e0e7d5c63 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:55.926028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fabb00-08d7-41f9-a24c-ce4a9433cc84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:55.926690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fabb00-08d7-41f9-a24c-ce4a9433cc84 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:55.927386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fabb00-08d7-41f9-a24c-ce4a9433cc84 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:55.927761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fabb00-08d7-41f9-a24c-ce4a9433cc84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:55.930021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-01fabb00-08d7-41f9-a24c-ce4a9433cc84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:56.057736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fabb00-08d7-41f9-a24c-ce4a9433cc84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:56.060079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fabb00-08d7-41f9-a24c-ce4a9433cc84 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:56.089524 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1161/2359] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:56.531807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c23514-07f6-44ff-b871-a475a3a6f1ce None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:56.532724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c23514-07f6-44ff-b871-a475a3a6f1ce None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:56.533147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c23514-07f6-44ff-b871-a475a3a6f1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:56.583464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e8c23514-07f6-44ff-b871-a475a3a6f1ce None None] MFA Rules not processed for user `a60bf5141fea499abb9b22658e56c944`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:56.584983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e8c23514-07f6-44ff-b871-a475a3a6f1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:56.608549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:56.775423 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1199/2360] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:56.779947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fabb00-08d7-41f9-a24c-ce4a9433cc84 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:56.781436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-01fabb00-08d7-41f9-a24c-ce4a9433cc84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:56.845155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:56.916501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fabb00-08d7-41f9-a24c-ce4a9433cc84 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:56.922596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464772b-04e0-4aeb-ae95-c4929822b8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:56.923318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464772b-04e0-4aeb-ae95-c4929822b8ae admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:56.923600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464772b-04e0-4aeb-ae95-c4929822b8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:56.923875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464772b-04e0-4aeb-ae95-c4929822b8ae admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:56.924615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464772b-04e0-4aeb-ae95-c4929822b8ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:56.926737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464772b-04e0-4aeb-ae95-c4929822b8ae admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:56.953249 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1162/2361] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:01:56 2022] POST /identity/v3/projects => generated 401 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:56.957354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c23514-07f6-44ff-b871-a475a3a6f1ce None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:56.969027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c23514-07f6-44ff-b871-a475a3a6f1ce None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:57.032259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d77f67-3174-495b-ab00-9c081fdaeae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:57.032956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d77f67-3174-495b-ab00-9c081fdaeae3 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:57.033237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d77f67-3174-495b-ab00-9c081fdaeae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:57.033509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d77f67-3174-495b-ab00-9c081fdaeae3 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:57.034359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d77f67-3174-495b-ab00-9c081fdaeae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:57.036609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d77f67-3174-495b-ab00-9c081fdaeae3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:57.060170 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1200/2362] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:01:56 2022] POST /identity/v3/users => generated 307 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:01:57.061418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464772b-04e0-4aeb-ae95-c4929822b8ae admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:57.074629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464772b-04e0-4aeb-ae95-c4929822b8ae admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:57.092317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f489f-3952-44c0-8dd7-6ecdd005a1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:57.095086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f489f-3952-44c0-8dd7-6ecdd005a1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:57.095608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f489f-3952-44c0-8dd7-6ecdd005a1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:57.096104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f489f-3952-44c0-8dd7-6ecdd005a1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:57.103548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f489f-3952-44c0-8dd7-6ecdd005a1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:57.106233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f489f-3952-44c0-8dd7-6ecdd005a1f2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:57.122846 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1163/2363] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:57.126954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d77f67-3174-495b-ab00-9c081fdaeae3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:57.138444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d77f67-3174-495b-ab00-9c081fdaeae3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:57.147038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57e833-3e31-4a9b-ad5c-eb1750ea177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:57.149132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57e833-3e31-4a9b-ad5c-eb1750ea177e admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:57.149421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57e833-3e31-4a9b-ad5c-eb1750ea177e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:57.149700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57e833-3e31-4a9b-ad5c-eb1750ea177e admin admin] PATH_INFO: `/v3/projects/9d755969a6714b5c8b63f7bb043418ba/users/5048815dbc9346f4b80e0fcf89236176/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:57.179330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57e833-3e31-4a9b-ad5c-eb1750ea177e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d755969a6714b5c8b63f7bb043418ba, user_id=5048815dbc9346f4b80e0fcf89236176, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:57.182155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57e833-3e31-4a9b-ad5c-eb1750ea177e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:57.206249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f489f-3952-44c0-8dd7-6ecdd005a1f2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:57.207020 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1201/2364] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:57 2022] PUT /identity/v3/projects/9d755969a6714b5c8b63f7bb043418ba/users/5048815dbc9346f4b80e0fcf89236176/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:57.225652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f489f-3952-44c0-8dd7-6ecdd005a1f2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:57.369886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9a52f-dd7e-45d8-bb79-fc56ed871c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:57.370710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9a52f-dd7e-45d8-bb79-fc56ed871c00 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:57.371061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9a52f-dd7e-45d8-bb79-fc56ed871c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:57.371663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9a52f-dd7e-45d8-bb79-fc56ed871c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:57.384137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9a52f-dd7e-45d8-bb79-fc56ed871c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:57.388311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9a52f-dd7e-45d8-bb79-fc56ed871c00 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:57.417606 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1164/2365] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:01:57.425065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57e833-3e31-4a9b-ad5c-eb1750ea177e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:57.448562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57e833-3e31-4a9b-ad5c-eb1750ea177e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:57.479692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342823b-33c2-455f-8700-256ce07d658e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:57.483865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342823b-33c2-455f-8700-256ce07d658e admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:57.484338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342823b-33c2-455f-8700-256ce07d658e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:57.485135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342823b-33c2-455f-8700-256ce07d658e admin admin] PATH_INFO: `/v3/projects/9d755969a6714b5c8b63f7bb043418ba/users/5048815dbc9346f4b80e0fcf89236176/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:57.495108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342823b-33c2-455f-8700-256ce07d658e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d755969a6714b5c8b63f7bb043418ba, user_id=5048815dbc9346f4b80e0fcf89236176, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:57.502010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342823b-33c2-455f-8700-256ce07d658e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:57.527323 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1202/2366] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:01:57 2022] PUT /identity/v3/projects/9d755969a6714b5c8b63f7bb043418ba/users/5048815dbc9346f4b80e0fcf89236176/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:57.889682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9a52f-dd7e-45d8-bb79-fc56ed871c00 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:57.903953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9a52f-dd7e-45d8-bb79-fc56ed871c00 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:58.026646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8cc85-1729-45fb-b3a9-ced38ab29a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:58.027706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8cc85-1729-45fb-b3a9-ced38ab29a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:58.027991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8cc85-1729-45fb-b3a9-ced38ab29a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:58.028301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8cc85-1729-45fb-b3a9-ced38ab29a71 admin admin] PATH_INFO: `/v3/users/a3880346be3e4ddfbbc0a822c179bc64` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:58.029908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8cc85-1729-45fb-b3a9-ced38ab29a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3880346be3e4ddfbbc0a822c179bc64)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:58.031875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8cc85-1729-45fb-b3a9-ced38ab29a71 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:58.034837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342823b-33c2-455f-8700-256ce07d658e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:58.051475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342823b-33c2-455f-8700-256ce07d658e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:58.057437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319aa2ff-0816-4125-911e-3ea36d5db486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:58.058369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319aa2ff-0816-4125-911e-3ea36d5db486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:58.058935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319aa2ff-0816-4125-911e-3ea36d5db486 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:58.059360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319aa2ff-0816-4125-911e-3ea36d5db486 admin admin] PATH_INFO: `/v3/users/aeca74e8f34544b49f4276aff011a596` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:58.062144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319aa2ff-0816-4125-911e-3ea36d5db486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeca74e8f34544b49f4276aff011a596)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:58.067515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319aa2ff-0816-4125-911e-3ea36d5db486 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:58.170199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:58.221053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-319aa2ff-0816-4125-911e-3ea36d5db486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeca74e8f34544b49f4276aff011a596'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:58.221866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbf8cc85-1729-45fb-b3a9-ced38ab29a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3880346be3e4ddfbbc0a822c179bc64'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:58.242968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-319aa2ff-0816-4125-911e-3ea36d5db486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeca74e8f34544b49f4276aff011a596'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:58.244166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-319aa2ff-0816-4125-911e-3ea36d5db486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeca74e8f34544b49f4276aff011a596'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:58.245063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-319aa2ff-0816-4125-911e-3ea36d5db486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeca74e8f34544b49f4276aff011a596'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:58.251394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbf8cc85-1729-45fb-b3a9-ced38ab29a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3880346be3e4ddfbbc0a822c179bc64'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:58.255814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:58.272026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-319aa2ff-0816-4125-911e-3ea36d5db486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeca74e8f34544b49f4276aff011a596'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:58.288845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbf8cc85-1729-45fb-b3a9-ced38ab29a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3880346be3e4ddfbbc0a822c179bc64'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:58.292429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbf8cc85-1729-45fb-b3a9-ced38ab29a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3880346be3e4ddfbbc0a822c179bc64'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:58.293517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbf8cc85-1729-45fb-b3a9-ced38ab29a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3880346be3e4ddfbbc0a822c179bc64'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:58.312642 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1203/2367] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:58 2022] DELETE /identity/v3/users/aeca74e8f34544b49f4276aff011a596 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:58.317290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beffc2-deab-47e0-bc3e-764e154a4536 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:58.317515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beffc2-deab-47e0-bc3e-764e154a4536 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:58.317800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beffc2-deab-47e0-bc3e-764e154a4536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:58.351605 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1165/2368] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:57 2022] DELETE /identity/v3/users/a3880346be3e4ddfbbc0a822c179bc64 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:58.354890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c9beffc2-deab-47e0-bc3e-764e154a4536 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:58.355027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcf7a5-730b-47fe-bd8a-7594e138812c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:58.355027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcf7a5-730b-47fe-bd8a-7594e138812c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:58.355422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c9beffc2-deab-47e0-bc3e-764e154a4536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:58.357587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcf7a5-730b-47fe-bd8a-7594e138812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:58.406519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3fdcf7a5-730b-47fe-bd8a-7594e138812c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:58.411327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3fdcf7a5-730b-47fe-bd8a-7594e138812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:58.489872 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1204/2369] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:01:58.543339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9beffc2-deab-47e0-bc3e-764e154a4536 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:58.544604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c9beffc2-deab-47e0-bc3e-764e154a4536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:58.560260 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1166/2370] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:01:58.571437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcf7a5-730b-47fe-bd8a-7594e138812c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:58.573277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3fdcf7a5-730b-47fe-bd8a-7594e138812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:58.652797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcf7a5-730b-47fe-bd8a-7594e138812c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:58.660105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb57a52-c1a6-4404-9f03-696e5aa476cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:58.660886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9beffc2-deab-47e0-bc3e-764e154a4536 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:58.664437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb57a52-c1a6-4404-9f03-696e5aa476cf service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:58.664727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d71c9e-ef4c-401c-89cf-a64441063354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:58.664858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb57a52-c1a6-4404-9f03-696e5aa476cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:58.665016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb57a52-c1a6-4404-9f03-696e5aa476cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:58.665384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d71c9e-ef4c-401c-89cf-a64441063354 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:58.665674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d71c9e-ef4c-401c-89cf-a64441063354 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:58.665953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d71c9e-ef4c-401c-89cf-a64441063354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:58.677152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d71c9e-ef4c-401c-89cf-a64441063354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:58.679362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d71c9e-ef4c-401c-89cf-a64441063354 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:58.689818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb57a52-c1a6-4404-9f03-696e5aa476cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:58.691331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb57a52-c1a6-4404-9f03-696e5aa476cf service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:58.700080 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1205/2371] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:01:58.707942 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1167/2372] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:01:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:01:59.526734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d71c9e-ef4c-401c-89cf-a64441063354 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:59.529038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-09d71c9e-ef4c-401c-89cf-a64441063354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:59.540753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb57a52-c1a6-4404-9f03-696e5aa476cf service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:59.542890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dcb57a52-c1a6-4404-9f03-696e5aa476cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:59.567889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d71c9e-ef4c-401c-89cf-a64441063354 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:59.571253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb57a52-c1a6-4404-9f03-696e5aa476cf service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:01:59.593711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271860d-dff0-4100-9283-f3ea53463a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:59.594734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271860d-dff0-4100-9283-f3ea53463a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:59.595533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900082d-b029-4cfb-afd9-cc725837cdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:01:59.596548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900082d-b029-4cfb-afd9-cc725837cdb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:59.596938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271860d-dff0-4100-9283-f3ea53463a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:59.597379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271860d-dff0-4100-9283-f3ea53463a4a admin admin] PATH_INFO: `/v3/projects/cf58f8d6d237407ca69b667e089ef5e5` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:59.597749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900082d-b029-4cfb-afd9-cc725837cdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:59.598356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900082d-b029-4cfb-afd9-cc725837cdb1 admin admin] PATH_INFO: `/v3/projects/7446ab773d3343c5938091756e592f97` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:59.600158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271860d-dff0-4100-9283-f3ea53463a4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf58f8d6d237407ca69b667e089ef5e5)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:59.602343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271860d-dff0-4100-9283-f3ea53463a4a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:59.603267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900082d-b029-4cfb-afd9-cc725837cdb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7446ab773d3343c5938091756e592f97)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:01:59.605352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900082d-b029-4cfb-afd9-cc725837cdb1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:01:59.763853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:59.780938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2900082d-b029-4cfb-afd9-cc725837cdb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7446ab773d3343c5938091756e592f97', 'request_id': 'req-2900082d-b029-4cfb-afd9-cc725837cdb1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:59.784778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8271860d-dff0-4100-9283-f3ea53463a4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf58f8d6d237407ca69b667e089ef5e5', 'request_id': 'req-8271860d-dff0-4100-9283-f3ea53463a4a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:59.798359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2900082d-b029-4cfb-afd9-cc725837cdb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7446ab773d3343c5938091756e592f97', 'request_id': 'req-2900082d-b029-4cfb-afd9-cc725837cdb1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:59.808586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8271860d-dff0-4100-9283-f3ea53463a4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf58f8d6d237407ca69b667e089ef5e5', 'request_id': 'req-8271860d-dff0-4100-9283-f3ea53463a4a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:59.823122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2900082d-b029-4cfb-afd9-cc725837cdb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7446ab773d3343c5938091756e592f97', 'request_id': 'req-2900082d-b029-4cfb-afd9-cc725837cdb1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:59.827968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8271860d-dff0-4100-9283-f3ea53463a4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf58f8d6d237407ca69b667e089ef5e5', 'request_id': 'req-8271860d-dff0-4100-9283-f3ea53463a4a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:59.852896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:59.856751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2900082d-b029-4cfb-afd9-cc725837cdb1 admin admin] The token cache is being invalidate because project 7446ab773d3343c5938091756e592f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:59.858318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2900082d-b029-4cfb-afd9-cc725837cdb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:59.861386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2900082d-b029-4cfb-afd9-cc725837cdb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:59.862892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8271860d-dff0-4100-9283-f3ea53463a4a admin admin] The token cache is being invalidate because project cf58f8d6d237407ca69b667e089ef5e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:01:59.867685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8271860d-dff0-4100-9283-f3ea53463a4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:59.868934 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1168/2373] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:59 2022] DELETE /identity/v3/projects/7446ab773d3343c5938091756e592f97 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:01:59.869291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8271860d-dff0-4100-9283-f3ea53463a4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:01:59.876963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900082d-b029-4cfb-afd9-cc725837cdb1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:01:59.879901 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1206/2374] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:59 2022] DELETE /identity/v3/projects/cf58f8d6d237407ca69b667e089ef5e5 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:01:59.881203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2900082d-b029-4cfb-afd9-cc725837cdb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:01:59.885059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b84e8-3176-46b9-8cb9-6fd635c5edc4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:01:59.886644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b84e8-3176-46b9-8cb9-6fd635c5edc4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:01:59.886939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b84e8-3176-46b9-8cb9-6fd635c5edc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:01:59.979186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ab4b84e8-3176-46b9-8cb9-6fd635c5edc4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:01:59.980983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ab4b84e8-3176-46b9-8cb9-6fd635c5edc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:00.094656 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1207/2375] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:00.105265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d44c33-7f08-4ec1-95b1-e5a76ca4775e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:00.105569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d44c33-7f08-4ec1-95b1-e5a76ca4775e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:00.105833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d44c33-7f08-4ec1-95b1-e5a76ca4775e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:00.132064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900082d-b029-4cfb-afd9-cc725837cdb1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:00.143264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303d418-b77d-45f4-80dd-a37f00ff0a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:00.144200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303d418-b77d-45f4-80dd-a37f00ff0a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:00.144487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303d418-b77d-45f4-80dd-a37f00ff0a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:00.144766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303d418-b77d-45f4-80dd-a37f00ff0a28 admin admin] PATH_INFO: `/v3/users/40bf017752034f5fa719b92b7ab06dee` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:00.147629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303d418-b77d-45f4-80dd-a37f00ff0a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40bf017752034f5fa719b92b7ab06dee)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:00.150149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303d418-b77d-45f4-80dd-a37f00ff0a28 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:00.151481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c2d44c33-7f08-4ec1-95b1-e5a76ca4775e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:00.152981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c2d44c33-7f08-4ec1-95b1-e5a76ca4775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:00.177597 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1208/2376] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:00.178661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d44c33-7f08-4ec1-95b1-e5a76ca4775e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:00.209165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d44c33-7f08-4ec1-95b1-e5a76ca4775e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:00.218137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab676f-fd99-4fc7-aa81-136c40eb8d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:00.218808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab676f-fd99-4fc7-aa81-136c40eb8d34 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:00.219094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab676f-fd99-4fc7-aa81-136c40eb8d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:00.228884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab676f-fd99-4fc7-aa81-136c40eb8d34 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:00.228884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab676f-fd99-4fc7-aa81-136c40eb8d34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:02:00.228884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab676f-fd99-4fc7-aa81-136c40eb8d34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:00.228884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab676f-fd99-4fc7-aa81-136c40eb8d34 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:00.255920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d303d418-b77d-45f4-80dd-a37f00ff0a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40bf017752034f5fa719b92b7ab06dee'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:00.267065 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1209/2377] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:02:00.267472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab676f-fd99-4fc7-aa81-136c40eb8d34 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:00.274058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d303d418-b77d-45f4-80dd-a37f00ff0a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40bf017752034f5fa719b92b7ab06dee'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:00.296634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab676f-fd99-4fc7-aa81-136c40eb8d34 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:00.305174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d303d418-b77d-45f4-80dd-a37f00ff0a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40bf017752034f5fa719b92b7ab06dee'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:00.305773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d303d418-b77d-45f4-80dd-a37f00ff0a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40bf017752034f5fa719b92b7ab06dee'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:00.306395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d303d418-b77d-45f4-80dd-a37f00ff0a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40bf017752034f5fa719b92b7ab06dee'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:00.310076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f5874-b384-4dbd-8717-3766b4088c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:00.311552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5874-b384-4dbd-8717-3766b4088c10 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:00.312294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5874-b384-4dbd-8717-3766b4088c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:00.312802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5874-b384-4dbd-8717-3766b4088c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:00.313729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f5874-b384-4dbd-8717-3766b4088c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:00.316194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f5874-b384-4dbd-8717-3766b4088c10 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:00.341958 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1169/2378] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:01:59 2022] DELETE /identity/v3/users/40bf017752034f5fa719b92b7ab06dee => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:00.359321 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1210/2379] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:02:00 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:02:00.363335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303d418-b77d-45f4-80dd-a37f00ff0a28 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:00.365877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d303d418-b77d-45f4-80dd-a37f00ff0a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:00.457392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:00.478548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303d418-b77d-45f4-80dd-a37f00ff0a28 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:00.556217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc74fde-a5b5-4768-97f5-c0e3fb84fac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:00.557110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc74fde-a5b5-4768-97f5-c0e3fb84fac5 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:00.557507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc74fde-a5b5-4768-97f5-c0e3fb84fac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:00.557981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc74fde-a5b5-4768-97f5-c0e3fb84fac5 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:00.558773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc74fde-a5b5-4768-97f5-c0e3fb84fac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:00.563330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc74fde-a5b5-4768-97f5-c0e3fb84fac5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:00.601397 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1170/2380] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:02:00 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:02:00.602443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f5874-b384-4dbd-8717-3766b4088c10 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:00.629153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f5874-b384-4dbd-8717-3766b4088c10 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:00.655015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602c16b-f0a6-4c17-9596-e56864253747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:00.656804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602c16b-f0a6-4c17-9596-e56864253747 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:00.658034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602c16b-f0a6-4c17-9596-e56864253747 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:00.659960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602c16b-f0a6-4c17-9596-e56864253747 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:00.662424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602c16b-f0a6-4c17-9596-e56864253747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:00.668836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602c16b-f0a6-4c17-9596-e56864253747 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:00.701164 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1211/2381] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:02:00.705505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc74fde-a5b5-4768-97f5-c0e3fb84fac5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:00.724085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc74fde-a5b5-4768-97f5-c0e3fb84fac5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:00.749626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedc23d-df24-4e5f-8bf1-c304f5e0e7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:00.750439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedc23d-df24-4e5f-8bf1-c304f5e0e7fe admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:00.750828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedc23d-df24-4e5f-8bf1-c304f5e0e7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:00.751210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedc23d-df24-4e5f-8bf1-c304f5e0e7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:00.752105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedc23d-df24-4e5f-8bf1-c304f5e0e7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:00.753885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedc23d-df24-4e5f-8bf1-c304f5e0e7fe admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:00.785531 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1171/2382] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:02:00.787662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602c16b-f0a6-4c17-9596-e56864253747 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:00.829186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602c16b-f0a6-4c17-9596-e56864253747 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:00.836843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2954d9-0d16-4eeb-aedb-34045f2fe085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:00.839551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2954d9-0d16-4eeb-aedb-34045f2fe085 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:00.839719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2954d9-0d16-4eeb-aedb-34045f2fe085 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:00.839957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2954d9-0d16-4eeb-aedb-34045f2fe085 admin admin] PATH_INFO: `/v3/projects/072e342f5fb4457f9051c6e61aff4725/users/f946f72c764940c5818854d5a6323f3f/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:00.865423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2954d9-0d16-4eeb-aedb-34045f2fe085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=072e342f5fb4457f9051c6e61aff4725, user_id=f946f72c764940c5818854d5a6323f3f, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:00.868563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2954d9-0d16-4eeb-aedb-34045f2fe085 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:00.903759 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1212/2383] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:02:00 2022] PUT /identity/v3/projects/072e342f5fb4457f9051c6e61aff4725/users/f946f72c764940c5818854d5a6323f3f/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:00.913413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58145ca6-7cf3-497d-acd9-f72f2902a6f4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:00.914043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58145ca6-7cf3-497d-acd9-f72f2902a6f4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:00.914467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58145ca6-7cf3-497d-acd9-f72f2902a6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:00.970998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-58145ca6-7cf3-497d-acd9-f72f2902a6f4 None None] MFA Rules not processed for user `f946f72c764940c5818854d5a6323f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:00.972151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-58145ca6-7cf3-497d-acd9-f72f2902a6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:01.116450 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1172/2384] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:01.268943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2954d9-0d16-4eeb-aedb-34045f2fe085 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:01.270689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2b2954d9-0d16-4eeb-aedb-34045f2fe085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:01.387483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58145ca6-7cf3-497d-acd9-f72f2902a6f4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:01.389094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-58145ca6-7cf3-497d-acd9-f72f2902a6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:01.409201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2954d9-0d16-4eeb-aedb-34045f2fe085 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:01.426118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1c8b0-2a5e-46e0-b3d3-45ae1a4035d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:01.428482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1c8b0-2a5e-46e0-b3d3-45ae1a4035d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:01.428855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1c8b0-2a5e-46e0-b3d3-45ae1a4035d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:01.429526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1c8b0-2a5e-46e0-b3d3-45ae1a4035d5 admin admin] PATH_INFO: `/v3/projects/e4a47b7c8d8447f88c04b24a475514d8` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:01.430742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1c8b0-2a5e-46e0-b3d3-45ae1a4035d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a47b7c8d8447f88c04b24a475514d8)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:01.432925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1c8b0-2a5e-46e0-b3d3-45ae1a4035d5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:01.518171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:01.547977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7cf1c8b0-2a5e-46e0-b3d3-45ae1a4035d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a47b7c8d8447f88c04b24a475514d8', 'request_id': 'req-7cf1c8b0-2a5e-46e0-b3d3-45ae1a4035d5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:01.570192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7cf1c8b0-2a5e-46e0-b3d3-45ae1a4035d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a47b7c8d8447f88c04b24a475514d8', 'request_id': 'req-7cf1c8b0-2a5e-46e0-b3d3-45ae1a4035d5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:01.579636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7cf1c8b0-2a5e-46e0-b3d3-45ae1a4035d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a47b7c8d8447f88c04b24a475514d8', 'request_id': 'req-7cf1c8b0-2a5e-46e0-b3d3-45ae1a4035d5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:01.593713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58145ca6-7cf3-497d-acd9-f72f2902a6f4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:01.601711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7cf1c8b0-2a5e-46e0-b3d3-45ae1a4035d5 admin admin] The token cache is being invalidate because project e4a47b7c8d8447f88c04b24a475514d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:02:01.602020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7cf1c8b0-2a5e-46e0-b3d3-45ae1a4035d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:01.604025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:01.604245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7cf1c8b0-2a5e-46e0-b3d3-45ae1a4035d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:01.609501 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1213/2385] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:02:01 2022] DELETE /identity/v3/projects/e4a47b7c8d8447f88c04b24a475514d8 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:01.614621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308417b2-5ffe-431b-8a8f-7acadbcb8d2d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:01.615039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308417b2-5ffe-431b-8a8f-7acadbcb8d2d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:01.619010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308417b2-5ffe-431b-8a8f-7acadbcb8d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:01.687040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-308417b2-5ffe-431b-8a8f-7acadbcb8d2d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:01.691548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-308417b2-5ffe-431b-8a8f-7acadbcb8d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:01.845512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ec12f-2da2-48a0-a5f2-cf4956798401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:01.846297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ec12f-2da2-48a0-a5f2-cf4956798401 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:01.848718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ec12f-2da2-48a0-a5f2-cf4956798401 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:01.849068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ec12f-2da2-48a0-a5f2-cf4956798401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:01.855766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-526ec12f-2da2-48a0-a5f2-cf4956798401 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:01.910558 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1214/2386] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:01.915978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06951065-52fe-44b9-876a-87bd2da37fe9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:01.916315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06951065-52fe-44b9-876a-87bd2da37fe9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:01.916581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06951065-52fe-44b9-876a-87bd2da37fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:01.941330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ec12f-2da2-48a0-a5f2-cf4956798401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:01.943563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ec12f-2da2-48a0-a5f2-cf4956798401 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:01.955404 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1173/2387] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:02:01.974396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-06951065-52fe-44b9-876a-87bd2da37fe9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:01.975363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-06951065-52fe-44b9-876a-87bd2da37fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:02.020847 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1215/2388] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:02.024703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ec12f-2da2-48a0-a5f2-cf4956798401 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:02.041292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ec12f-2da2-48a0-a5f2-cf4956798401 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:02.057382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e24105-f7b6-4a3b-bc92-2296eb8cc1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:02.058298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e24105-f7b6-4a3b-bc92-2296eb8cc1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:02.058593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e24105-f7b6-4a3b-bc92-2296eb8cc1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:02.058859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e24105-f7b6-4a3b-bc92-2296eb8cc1d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:02.059676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e24105-f7b6-4a3b-bc92-2296eb8cc1d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:02:02.059888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e24105-f7b6-4a3b-bc92-2296eb8cc1d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:02.061709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e24105-f7b6-4a3b-bc92-2296eb8cc1d5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:02.075502 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1174/2389] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:02:02.080267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06951065-52fe-44b9-876a-87bd2da37fe9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:02.092011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e24105-f7b6-4a3b-bc92-2296eb8cc1d5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:02.095354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06951065-52fe-44b9-876a-87bd2da37fe9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:02.097674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b4e24105-f7b6-4a3b-bc92-2296eb8cc1d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:02.118281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e5f0e-636f-479d-936d-ef1e91d0ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:02.124137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e5f0e-636f-479d-936d-ef1e91d0ef56 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:02.124616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e5f0e-636f-479d-936d-ef1e91d0ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:02.124990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e5f0e-636f-479d-936d-ef1e91d0ef56 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:02.125834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e5f0e-636f-479d-936d-ef1e91d0ef56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:02.134266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e5f0e-636f-479d-936d-ef1e91d0ef56 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:02.158785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e24105-f7b6-4a3b-bc92-2296eb8cc1d5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:02.174024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3366e8-7c90-4320-ae28-1e866ee23d0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:02.174862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3366e8-7c90-4320-ae28-1e866ee23d0c service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:02.175596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3366e8-7c90-4320-ae28-1e866ee23d0c service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:02.175934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3366e8-7c90-4320-ae28-1e866ee23d0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:02.178394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6e3366e8-7c90-4320-ae28-1e866ee23d0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:02.209228 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1216/2390] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:02:02 2022] POST /identity/v3/projects => generated 391 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:02:02.213258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e5f0e-636f-479d-936d-ef1e91d0ef56 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:02.270518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3366e8-7c90-4320-ae28-1e866ee23d0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:02.272354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3366e8-7c90-4320-ae28-1e866ee23d0c service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:02.292155 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1175/2391] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:02.319466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e5f0e-636f-479d-936d-ef1e91d0ef56 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:02.340171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe49490-1965-426a-b4de-ec006852db7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:02.340888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe49490-1965-426a-b4de-ec006852db7a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:02.341168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe49490-1965-426a-b4de-ec006852db7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:02.341443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe49490-1965-426a-b4de-ec006852db7a admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:02.342151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe49490-1965-426a-b4de-ec006852db7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:02.344159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe49490-1965-426a-b4de-ec006852db7a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:02.391311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3366e8-7c90-4320-ae28-1e866ee23d0c service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:02.394836 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1217/2392] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:02:02 2022] POST /identity/v3/users => generated 296 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:02:02.409483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3366e8-7c90-4320-ae28-1e866ee23d0c service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:02.423500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc27cd-e238-477d-aa96-ce385a2070ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:02.424338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc27cd-e238-477d-aa96-ce385a2070ad admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:02.424690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc27cd-e238-477d-aa96-ce385a2070ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:02.425033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc27cd-e238-477d-aa96-ce385a2070ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:02.425836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc27cd-e238-477d-aa96-ce385a2070ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:02.427767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc27cd-e238-477d-aa96-ce385a2070ad admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:02.451204 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1176/2393] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:02:02.455283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe49490-1965-426a-b4de-ec006852db7a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:02.472513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe49490-1965-426a-b4de-ec006852db7a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:02.495017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c227b-30bc-48e3-973a-eddb4a4270c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:02.497070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c227b-30bc-48e3-973a-eddb4a4270c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:02.497565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c227b-30bc-48e3-973a-eddb4a4270c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:02.498023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c227b-30bc-48e3-973a-eddb4a4270c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:02.499923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c227b-30bc-48e3-973a-eddb4a4270c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:02.502115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c227b-30bc-48e3-973a-eddb4a4270c2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:02.518592 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1218/2394] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:02:02.524826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc27cd-e238-477d-aa96-ce385a2070ad admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:02.542599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc27cd-e238-477d-aa96-ce385a2070ad admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:02.558041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524a387-94df-4cba-855d-5c9a62b4f49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:02.559484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524a387-94df-4cba-855d-5c9a62b4f49e admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:02.559943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524a387-94df-4cba-855d-5c9a62b4f49e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:02.560532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524a387-94df-4cba-855d-5c9a62b4f49e admin admin] PATH_INFO: `/v3/projects/ac182c55820f4116aa230af37a5146bd/users/643fc360ab0e4d40b4822ca236972719/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:02.581607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:02.591923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524a387-94df-4cba-855d-5c9a62b4f49e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac182c55820f4116aa230af37a5146bd, user_id=643fc360ab0e4d40b4822ca236972719, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:02.596578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524a387-94df-4cba-855d-5c9a62b4f49e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:02.634210 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1177/2395] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:02:02 2022] PUT /identity/v3/projects/ac182c55820f4116aa230af37a5146bd/users/643fc360ab0e4d40b4822ca236972719/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:02:02.636021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659bb3f-c95f-457b-87a9-908f82486765 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:02.636503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659bb3f-c95f-457b-87a9-908f82486765 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:02.636695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659bb3f-c95f-457b-87a9-908f82486765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:02.647241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:02.691144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5659bb3f-c95f-457b-87a9-908f82486765 None None] MFA Rules not processed for user `643fc360ab0e4d40b4822ca236972719`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:02.692471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5659bb3f-c95f-457b-87a9-908f82486765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:02.774212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bc0b6-fe46-4ff0-89eb-963c8a623893 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:02.774807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bc0b6-fe46-4ff0-89eb-963c8a623893 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:02.776090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bc0b6-fe46-4ff0-89eb-963c8a623893 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:02.778134 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1178/2396] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:02:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:02:02.836849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f3852-eb3c-4b60-9cec-1aa605bd6b6e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:02.837160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f3852-eb3c-4b60-9cec-1aa605bd6b6e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:02.837854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f3852-eb3c-4b60-9cec-1aa605bd6b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:02.864565 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1219/2397] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:02.868847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659bb3f-c95f-457b-87a9-908f82486765 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:02.871148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-555f3852-eb3c-4b60-9cec-1aa605bd6b6e None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:02.874726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-555f3852-eb3c-4b60-9cec-1aa605bd6b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:03.016240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659bb3f-c95f-457b-87a9-908f82486765 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:03.030382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8b7d2-25f1-40db-87f7-8795b2dd0488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:03.030976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8b7d2-25f1-40db-87f7-8795b2dd0488 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:03.031259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8b7d2-25f1-40db-87f7-8795b2dd0488 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:03.031535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8b7d2-25f1-40db-87f7-8795b2dd0488 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:03.032288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8b7d2-25f1-40db-87f7-8795b2dd0488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:03.034631 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1179/2398] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:02:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:03.034825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8b7d2-25f1-40db-87f7-8795b2dd0488 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:03.075464 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1220/2399] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:02:02 2022] POST /identity/v3/projects => generated 391 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:02:03.079426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f3852-eb3c-4b60-9cec-1aa605bd6b6e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:03.093162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f3852-eb3c-4b60-9cec-1aa605bd6b6e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:03.135592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8b7d2-25f1-40db-87f7-8795b2dd0488 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:03.138323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-90f8b7d2-25f1-40db-87f7-8795b2dd0488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:03.247716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bda7f-0ad0-494c-8ed4-94da9e9dc963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:03.253274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bda7f-0ad0-494c-8ed4-94da9e9dc963 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:03.253655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bda7f-0ad0-494c-8ed4-94da9e9dc963 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:03.253926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bda7f-0ad0-494c-8ed4-94da9e9dc963 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:03.256841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bda7f-0ad0-494c-8ed4-94da9e9dc963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:03.263687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bda7f-0ad0-494c-8ed4-94da9e9dc963 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:03.338342 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1180/2400] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:02:03 2022] POST /identity/v3/users => generated 302 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:02:03.338342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bda7f-0ad0-494c-8ed4-94da9e9dc963 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:03.342683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8d5bda7f-0ad0-494c-8ed4-94da9e9dc963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:03.383783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bda7f-0ad0-494c-8ed4-94da9e9dc963 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:03.387199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8b7d2-25f1-40db-87f7-8795b2dd0488 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:03.395092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa57b0-c271-46b2-b585-a1354d6ebe90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:03.396522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa57b0-c271-46b2-b585-a1354d6ebe90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:03.396901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa57b0-c271-46b2-b585-a1354d6ebe90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:03.397329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa57b0-c271-46b2-b585-a1354d6ebe90 admin admin] PATH_INFO: `/v3/users/10cba2186f6343d98d0d69822ab8640b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:03.400435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa57b0-c271-46b2-b585-a1354d6ebe90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10cba2186f6343d98d0d69822ab8640b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:03.400609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b156b-ee7f-405c-96da-e868d799d96f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:03.401131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b156b-ee7f-405c-96da-e868d799d96f service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:03.401415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b156b-ee7f-405c-96da-e868d799d96f service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:03.401691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b156b-ee7f-405c-96da-e868d799d96f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:03.403270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa57b0-c271-46b2-b585-a1354d6ebe90 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:03.432112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b156b-ee7f-405c-96da-e868d799d96f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:03.433232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b156b-ee7f-405c-96da-e868d799d96f service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:03.480278 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1221/2401] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:03.481750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b156b-ee7f-405c-96da-e868d799d96f service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:03.499791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b156b-ee7f-405c-96da-e868d799d96f service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:03.509802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8017f7-0407-43a3-aaa1-50575d451653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:03.510459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e5fa57b0-c271-46b2-b585-a1354d6ebe90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10cba2186f6343d98d0d69822ab8640b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:03.511258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8017f7-0407-43a3-aaa1-50575d451653 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:03.511548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8017f7-0407-43a3-aaa1-50575d451653 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:03.511826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8017f7-0407-43a3-aaa1-50575d451653 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:03.512674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8017f7-0407-43a3-aaa1-50575d451653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:03.514371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8017f7-0407-43a3-aaa1-50575d451653 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:03.520669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:03.528154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e5fa57b0-c271-46b2-b585-a1354d6ebe90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10cba2186f6343d98d0d69822ab8640b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:03.542597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e5fa57b0-c271-46b2-b585-a1354d6ebe90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10cba2186f6343d98d0d69822ab8640b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:03.547294 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1222/2402] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:02:03.552000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8017f7-0407-43a3-aaa1-50575d451653 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:03.553226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e5fa57b0-c271-46b2-b585-a1354d6ebe90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10cba2186f6343d98d0d69822ab8640b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:03.554075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e5fa57b0-c271-46b2-b585-a1354d6ebe90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10cba2186f6343d98d0d69822ab8640b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:03.566879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:03.574481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8017f7-0407-43a3-aaa1-50575d451653 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:03.583103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43562063-2164-4ab7-ab2d-b3d6d294e52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:03.583848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43562063-2164-4ab7-ab2d-b3d6d294e52c admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:03.584158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43562063-2164-4ab7-ab2d-b3d6d294e52c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:03.584530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43562063-2164-4ab7-ab2d-b3d6d294e52c admin admin] PATH_INFO: `/v3/projects/be841d52aa80426b870e5ecb04c749f7/users/161b80f04eef480c9f12f1fdc0bcd984/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:03.597697 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1181/2403] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:02:03 2022] DELETE /identity/v3/users/10cba2186f6343d98d0d69822ab8640b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:03.605582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43562063-2164-4ab7-ab2d-b3d6d294e52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=be841d52aa80426b870e5ecb04c749f7, user_id=161b80f04eef480c9f12f1fdc0bcd984, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:03.609833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43562063-2164-4ab7-ab2d-b3d6d294e52c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:03.674614 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1223/2404] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:02:03 2022] PUT /identity/v3/projects/be841d52aa80426b870e5ecb04c749f7/users/161b80f04eef480c9f12f1fdc0bcd984/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:03.678524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa57b0-c271-46b2-b585-a1354d6ebe90 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:03.679979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e5fa57b0-c271-46b2-b585-a1354d6ebe90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:03.780381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa57b0-c271-46b2-b585-a1354d6ebe90 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:03.849422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43562063-2164-4ab7-ab2d-b3d6d294e52c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:03.852180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-43562063-2164-4ab7-ab2d-b3d6d294e52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:03.870175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e901d-2ffb-4891-b968-9172923e780d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:03.870776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e901d-2ffb-4891-b968-9172923e780d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:03.871127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e901d-2ffb-4891-b968-9172923e780d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:03.871516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e901d-2ffb-4891-b968-9172923e780d admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:03.872435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e901d-2ffb-4891-b968-9172923e780d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:03.876073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e901d-2ffb-4891-b968-9172923e780d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:03.890884 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1182/2405] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:02:03.897168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e901d-2ffb-4891-b968-9172923e780d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:03.943783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e901d-2ffb-4891-b968-9172923e780d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:03.951848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b163bc-c1c1-4056-8fe9-79bdf78c4cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:03.953491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b163bc-c1c1-4056-8fe9-79bdf78c4cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:03.953970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b163bc-c1c1-4056-8fe9-79bdf78c4cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:03.954354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b163bc-c1c1-4056-8fe9-79bdf78c4cc2 admin admin] PATH_INFO: `/v3/projects/be841d52aa80426b870e5ecb04c749f7/users/161b80f04eef480c9f12f1fdc0bcd984/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:03.958794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b163bc-c1c1-4056-8fe9-79bdf78c4cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be841d52aa80426b870e5ecb04c749f7, user_id=161b80f04eef480c9f12f1fdc0bcd984, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:03.962991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b163bc-c1c1-4056-8fe9-79bdf78c4cc2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:04.013536 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1183/2406] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:02:03 2022] PUT /identity/v3/projects/be841d52aa80426b870e5ecb04c749f7/users/161b80f04eef480c9f12f1fdc0bcd984/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:04.015262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44478b6c-f744-4762-a456-5b226d25b618 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:04.019657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44478b6c-f744-4762-a456-5b226d25b618 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:04.020100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44478b6c-f744-4762-a456-5b226d25b618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:04.092233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-44478b6c-f744-4762-a456-5b226d25b618 None None] MFA Rules not processed for user `161b80f04eef480c9f12f1fdc0bcd984`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:04.095245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-44478b6c-f744-4762-a456-5b226d25b618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:04.110540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43562063-2164-4ab7-ab2d-b3d6d294e52c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:04.329555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b278316-84f6-4132-a2a9-e84bcf28ef4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:04.330192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b278316-84f6-4132-a2a9-e84bcf28ef4c service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:04.330477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b278316-84f6-4132-a2a9-e84bcf28ef4c service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:04.332656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b278316-84f6-4132-a2a9-e84bcf28ef4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:04.336815 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1184/2407] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:04.337864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44478b6c-f744-4762-a456-5b226d25b618 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:04.339124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9b278316-84f6-4132-a2a9-e84bcf28ef4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:04.341472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-44478b6c-f744-4762-a456-5b226d25b618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:04.351375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:04.532262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b278316-84f6-4132-a2a9-e84bcf28ef4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:04.533922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b278316-84f6-4132-a2a9-e84bcf28ef4c service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:04.537907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44478b6c-f744-4762-a456-5b226d25b618 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:04.552837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774febe6-a879-45ab-a2c0-f9f5eefd7ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:04.554836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774febe6-a879-45ab-a2c0-f9f5eefd7ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:04.555422 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1224/2408] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:04.569643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774febe6-a879-45ab-a2c0-f9f5eefd7ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:04.570198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774febe6-a879-45ab-a2c0-f9f5eefd7ea3 admin admin] PATH_INFO: `/v3/projects/eba90f0c20674772824b3286c46941d2` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:04.579967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774febe6-a879-45ab-a2c0-f9f5eefd7ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba90f0c20674772824b3286c46941d2)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:04.582419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774febe6-a879-45ab-a2c0-f9f5eefd7ea3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:04.702395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-774febe6-a879-45ab-a2c0-f9f5eefd7ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba90f0c20674772824b3286c46941d2', 'request_id': 'req-774febe6-a879-45ab-a2c0-f9f5eefd7ea3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:04.714449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-774febe6-a879-45ab-a2c0-f9f5eefd7ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba90f0c20674772824b3286c46941d2', 'request_id': 'req-774febe6-a879-45ab-a2c0-f9f5eefd7ea3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:04.730735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-774febe6-a879-45ab-a2c0-f9f5eefd7ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba90f0c20674772824b3286c46941d2', 'request_id': 'req-774febe6-a879-45ab-a2c0-f9f5eefd7ea3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:04.754654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-774febe6-a879-45ab-a2c0-f9f5eefd7ea3 admin admin] The token cache is being invalidate because project eba90f0c20674772824b3286c46941d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:02:04.755390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-774febe6-a879-45ab-a2c0-f9f5eefd7ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:04.756541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-774febe6-a879-45ab-a2c0-f9f5eefd7ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:04.758478 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1185/2409] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:02:04 2022] DELETE /identity/v3/projects/eba90f0c20674772824b3286c46941d2 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:04.763787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e7cef-45af-4224-a11d-14bd2ee62fc9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:04.764319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e7cef-45af-4224-a11d-14bd2ee62fc9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:04.764424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e7cef-45af-4224-a11d-14bd2ee62fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:04.777130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:04.796484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-075e7cef-45af-4224-a11d-14bd2ee62fc9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:04.797893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-075e7cef-45af-4224-a11d-14bd2ee62fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:04.954892 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1225/2410] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:04.956672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd7637-0769-411b-ac22-15717a15660b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:04.956972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd7637-0769-411b-ac22-15717a15660b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:04.957269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd7637-0769-411b-ac22-15717a15660b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:04.984625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-94fd7637-0769-411b-ac22-15717a15660b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:04.986311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-94fd7637-0769-411b-ac22-15717a15660b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:05.010837 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1186/2411] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:05.011260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e7cef-45af-4224-a11d-14bd2ee62fc9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:05.025374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e7cef-45af-4224-a11d-14bd2ee62fc9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:05.059906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7c3b3-5eca-415d-9aa3-1ee8debc5a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:05.062607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7c3b3-5eca-415d-9aa3-1ee8debc5a25 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:05.063788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7c3b3-5eca-415d-9aa3-1ee8debc5a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:05.065395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7c3b3-5eca-415d-9aa3-1ee8debc5a25 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:05.069228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7c3b3-5eca-415d-9aa3-1ee8debc5a25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:02:05.069742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7c3b3-5eca-415d-9aa3-1ee8debc5a25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:05.073865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7c3b3-5eca-415d-9aa3-1ee8debc5a25 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:05.103358 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1226/2412] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:02:05.107644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd7637-0769-411b-ac22-15717a15660b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:05.127814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd7637-0769-411b-ac22-15717a15660b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:05.154317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9a36d-4f8f-4eb0-a0e0-ada2b31a2172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:05.155013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9a36d-4f8f-4eb0-a0e0-ada2b31a2172 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:05.155290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9a36d-4f8f-4eb0-a0e0-ada2b31a2172 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:05.155569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9a36d-4f8f-4eb0-a0e0-ada2b31a2172 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:05.156374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9a36d-4f8f-4eb0-a0e0-ada2b31a2172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:05.159052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9a36d-4f8f-4eb0-a0e0-ada2b31a2172 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:05.202305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7c3b3-5eca-415d-9aa3-1ee8debc5a25 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:05.204331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-02c7c3b3-5eca-415d-9aa3-1ee8debc5a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:05.239039 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1187/2413] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:02:05 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:02:05.243389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9a36d-4f8f-4eb0-a0e0-ada2b31a2172 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:05.244476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7c3b3-5eca-415d-9aa3-1ee8debc5a25 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:05.337685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d16925-29eb-4ebd-a981-38191dd62b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:05.339210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d16925-29eb-4ebd-a981-38191dd62b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:05.339611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d16925-29eb-4ebd-a981-38191dd62b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:05.339890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d16925-29eb-4ebd-a981-38191dd62b7c admin admin] PATH_INFO: `/v3/users/643fc360ab0e4d40b4822ca236972719` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:05.341577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d16925-29eb-4ebd-a981-38191dd62b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=643fc360ab0e4d40b4822ca236972719)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:05.343181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d16925-29eb-4ebd-a981-38191dd62b7c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:05.381299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9a36d-4f8f-4eb0-a0e0-ada2b31a2172 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:05.388492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129392e7-251a-4620-86e6-94c8ee587e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:05.389224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129392e7-251a-4620-86e6-94c8ee587e24 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:05.389553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129392e7-251a-4620-86e6-94c8ee587e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:05.389829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129392e7-251a-4620-86e6-94c8ee587e24 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:05.397396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129392e7-251a-4620-86e6-94c8ee587e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:05.407173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129392e7-251a-4620-86e6-94c8ee587e24 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:05.419818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f8d16925-29eb-4ebd-a981-38191dd62b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '643fc360ab0e4d40b4822ca236972719'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:05.428885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:05.435050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f8d16925-29eb-4ebd-a981-38191dd62b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '643fc360ab0e4d40b4822ca236972719'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:05.435844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f8d16925-29eb-4ebd-a981-38191dd62b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '643fc360ab0e4d40b4822ca236972719'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:05.436906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f8d16925-29eb-4ebd-a981-38191dd62b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '643fc360ab0e4d40b4822ca236972719'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:05.455212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f8d16925-29eb-4ebd-a981-38191dd62b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '643fc360ab0e4d40b4822ca236972719'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:05.457863 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1188/2414] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:02:05 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:02:05.461184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129392e7-251a-4620-86e6-94c8ee587e24 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:05.463244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-129392e7-251a-4620-86e6-94c8ee587e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:05.496503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129392e7-251a-4620-86e6-94c8ee587e24 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:05.505176 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1227/2415] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:02:05 2022] DELETE /identity/v3/users/643fc360ab0e4d40b4822ca236972719 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:02:05.508208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb9b9a-4224-4881-b31e-0768b467e8ac None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:05.508499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb9b9a-4224-4881-b31e-0768b467e8ac None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:05.508779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb9b9a-4224-4881-b31e-0768b467e8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:05.512073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e7b52-662f-4785-95db-0e55fe39a7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:05.512968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e7b52-662f-4785-95db-0e55fe39a7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:05.513084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e7b52-662f-4785-95db-0e55fe39a7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:05.513319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e7b52-662f-4785-95db-0e55fe39a7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:05.514837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e7b52-662f-4785-95db-0e55fe39a7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:05.517134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e7b52-662f-4785-95db-0e55fe39a7f6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:05.545928 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1189/2416] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:02:05.546606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2dfb9b9a-4224-4881-b31e-0768b467e8ac None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:05.547995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2dfb9b9a-4224-4881-b31e-0768b467e8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:05.549380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e7b52-662f-4785-95db-0e55fe39a7f6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:05.563766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:05.572725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e7b52-662f-4785-95db-0e55fe39a7f6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:05.703912 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1228/2417] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:05.711682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb02ec-638f-4103-b09e-10a2b85f98ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:05.712901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb02ec-638f-4103-b09e-10a2b85f98ad admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:05.713186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb02ec-638f-4103-b09e-10a2b85f98ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:05.713465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb02ec-638f-4103-b09e-10a2b85f98ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:05.714253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb02ec-638f-4103-b09e-10a2b85f98ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:05.715944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb02ec-638f-4103-b09e-10a2b85f98ad admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:05.731837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb9b9a-4224-4881-b31e-0768b467e8ac None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:05.733923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2dfb9b9a-4224-4881-b31e-0768b467e8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:05.739646 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1190/2418] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:02:05.744395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb02ec-638f-4103-b09e-10a2b85f98ad admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:05.771042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb02ec-638f-4103-b09e-10a2b85f98ad admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:05.787088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9120e-7485-4b27-a3f2-8724ade23d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:05.791163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9120e-7485-4b27-a3f2-8724ade23d0c admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:05.791454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9120e-7485-4b27-a3f2-8724ade23d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:05.792331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9120e-7485-4b27-a3f2-8724ade23d0c admin admin] PATH_INFO: `/v3/projects/4c4a0acce7ef425b93c417e1a8fccf78/users/b16a9c9e35954d579536375f7eab1c9b/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:05.835465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9120e-7485-4b27-a3f2-8724ade23d0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4a0acce7ef425b93c417e1a8fccf78, user_id=b16a9c9e35954d579536375f7eab1c9b, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:05.838568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9120e-7485-4b27-a3f2-8724ade23d0c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:05.851803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb9b9a-4224-4881-b31e-0768b467e8ac None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:05.870956 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1191/2419] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:02:05 2022] PUT /identity/v3/projects/4c4a0acce7ef425b93c417e1a8fccf78/users/b16a9c9e35954d579536375f7eab1c9b/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:05.871157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3d19a-43f7-49be-b091-09420a8a2043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:05.873260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3d19a-43f7-49be-b091-09420a8a2043 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:05.875776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3d19a-43f7-49be-b091-09420a8a2043 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:05.876823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3d19a-43f7-49be-b091-09420a8a2043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:05.877049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbc7c9-5d87-42af-8175-2b5a188e5794 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:05.877525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbc7c9-5d87-42af-8175-2b5a188e5794 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:05.877860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbc7c9-5d87-42af-8175-2b5a188e5794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:05.923009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3d19a-43f7-49be-b091-09420a8a2043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:05.925197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3d19a-43f7-49be-b091-09420a8a2043 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:05.930299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-99dbc7c9-5d87-42af-8175-2b5a188e5794 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:05.931126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-99dbc7c9-5d87-42af-8175-2b5a188e5794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:05.974029 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1229/2420] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:06.112451 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1192/2421] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:06.129725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9b8e1-2433-45a1-ae8b-4c1ffe3b32d1 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:06.130119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9b8e1-2433-45a1-ae8b-4c1ffe3b32d1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:06.130333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9b8e1-2433-45a1-ae8b-4c1ffe3b32d1 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:06.131768 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1230/2422] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:02:06.136258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbc7c9-5d87-42af-8175-2b5a188e5794 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:06.138793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-99dbc7c9-5d87-42af-8175-2b5a188e5794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:06.141840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c46c77-c243-457e-96d2-0af6f4c369b8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:06.142057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c46c77-c243-457e-96d2-0af6f4c369b8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:06.142339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c46c77-c243-457e-96d2-0af6f4c369b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:06.190785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-68c46c77-c243-457e-96d2-0af6f4c369b8 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:06.196305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-68c46c77-c243-457e-96d2-0af6f4c369b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:06.327863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbc7c9-5d87-42af-8175-2b5a188e5794 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:06.342378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4594e6-dfa6-42d7-adda-1d5726e890a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:06.348140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4594e6-dfa6-42d7-adda-1d5726e890a1 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:06.348482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4594e6-dfa6-42d7-adda-1d5726e890a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:06.348816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4594e6-dfa6-42d7-adda-1d5726e890a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:06.413961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4594e6-dfa6-42d7-adda-1d5726e890a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:06.422814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4594e6-dfa6-42d7-adda-1d5726e890a1 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:06.430828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:06.442151 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1231/2423] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:02:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:02:06.474432 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1193/2424] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:06.484992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c46c77-c243-457e-96d2-0af6f4c369b8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:06.487092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-68c46c77-c243-457e-96d2-0af6f4c369b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:06.535817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c46c77-c243-457e-96d2-0af6f4c369b8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:06.550206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbab188-30cf-4679-abc6-2ff51c15b3e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:06.550947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbab188-30cf-4679-abc6-2ff51c15b3e3 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:06.551235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbab188-30cf-4679-abc6-2ff51c15b3e3 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:06.551517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbab188-30cf-4679-abc6-2ff51c15b3e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:06.573304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbab188-30cf-4679-abc6-2ff51c15b3e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:06.574946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbab188-30cf-4679-abc6-2ff51c15b3e3 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:06.603130 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1232/2425] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:02:06.620196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d66db5-3cff-4e60-9dfb-7cec5ca1ba56 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:06.620196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d66db5-3cff-4e60-9dfb-7cec5ca1ba56 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:06.620196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d66db5-3cff-4e60-9dfb-7cec5ca1ba56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:06.709654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f3d66db5-3cff-4e60-9dfb-7cec5ca1ba56 None None] MFA Rules not processed for user `9ee93cc6740d4e92b231f60d8b9d4450`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:06.718675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f3d66db5-3cff-4e60-9dfb-7cec5ca1ba56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:06.925371 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1194/2426] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:07.019493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbab188-30cf-4679-abc6-2ff51c15b3e3 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:07.032842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbab188-30cf-4679-abc6-2ff51c15b3e3 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:07.042186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7eb59-f5cb-4fc2-81f0-c631fec72b39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:07.043159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7eb59-f5cb-4fc2-81f0-c631fec72b39 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:07.044480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7eb59-f5cb-4fc2-81f0-c631fec72b39 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:07.044765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7eb59-f5cb-4fc2-81f0-c631fec72b39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:07.046811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-eca7eb59-f5cb-4fc2-81f0-c631fec72b39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:07.061805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7eb59-f5cb-4fc2-81f0-c631fec72b39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:07.064433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7eb59-f5cb-4fc2-81f0-c631fec72b39 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:07.111578 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1233/2427] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:07.188712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ba4c0-136d-49ab-a946-32118ad5cccd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:07.188926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ba4c0-136d-49ab-a946-32118ad5cccd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:07.189103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ba4c0-136d-49ab-a946-32118ad5cccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:07.257154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-af2ba4c0-136d-49ab-a946-32118ad5cccd None None] MFA Rules not processed for user `5048815dbc9346f4b80e0fcf89236176`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:07.259712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-af2ba4c0-136d-49ab-a946-32118ad5cccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:07.317207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7eb59-f5cb-4fc2-81f0-c631fec72b39 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:07.319377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-eca7eb59-f5cb-4fc2-81f0-c631fec72b39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:07.378442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7eb59-f5cb-4fc2-81f0-c631fec72b39 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:07.394060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27cf8b-28b1-4285-becd-ac543deaf7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:07.395500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27cf8b-28b1-4285-becd-ac543deaf7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:07.395798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27cf8b-28b1-4285-becd-ac543deaf7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:07.396108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27cf8b-28b1-4285-becd-ac543deaf7d3 admin admin] PATH_INFO: `/v3/projects/ac182c55820f4116aa230af37a5146bd` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:07.398715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27cf8b-28b1-4285-becd-ac543deaf7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac182c55820f4116aa230af37a5146bd)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:07.403101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27cf8b-28b1-4285-becd-ac543deaf7d3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:07.474725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:07.491198 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1195/2428] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:07 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:07.553456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2a27cf8b-28b1-4285-becd-ac543deaf7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac182c55820f4116aa230af37a5146bd', 'request_id': 'req-2a27cf8b-28b1-4285-becd-ac543deaf7d3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:07.587151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2a27cf8b-28b1-4285-becd-ac543deaf7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac182c55820f4116aa230af37a5146bd', 'request_id': 'req-2a27cf8b-28b1-4285-becd-ac543deaf7d3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:07.599371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2a27cf8b-28b1-4285-becd-ac543deaf7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac182c55820f4116aa230af37a5146bd', 'request_id': 'req-2a27cf8b-28b1-4285-becd-ac543deaf7d3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:07.626559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2a27cf8b-28b1-4285-becd-ac543deaf7d3 admin admin] The token cache is being invalidate because project ac182c55820f4116aa230af37a5146bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:02:07.626859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2a27cf8b-28b1-4285-becd-ac543deaf7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:07.628909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2a27cf8b-28b1-4285-becd-ac543deaf7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:07.633517 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1234/2429] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:02:07 2022] DELETE /identity/v3/projects/ac182c55820f4116aa230af37a5146bd => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:07.638565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ba4c0-136d-49ab-a946-32118ad5cccd None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:07.660724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ba4c0-136d-49ab-a946-32118ad5cccd None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:07.748568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c73a7-ca09-42f3-a2b7-a0ca8002a04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:07.749767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c73a7-ca09-42f3-a2b7-a0ca8002a04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:07.750137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c73a7-ca09-42f3-a2b7-a0ca8002a04f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:07.750530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c73a7-ca09-42f3-a2b7-a0ca8002a04f admin admin] PATH_INFO: `/v3/users/161b80f04eef480c9f12f1fdc0bcd984` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:07.751950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c73a7-ca09-42f3-a2b7-a0ca8002a04f admin admin] RBAC: Authorizing `identity:delete_user(user_id=161b80f04eef480c9f12f1fdc0bcd984)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:07.755302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c73a7-ca09-42f3-a2b7-a0ca8002a04f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:07.814079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:07.833712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5c2c73a7-ca09-42f3-a2b7-a0ca8002a04f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '161b80f04eef480c9f12f1fdc0bcd984'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:07.843934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5c2c73a7-ca09-42f3-a2b7-a0ca8002a04f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '161b80f04eef480c9f12f1fdc0bcd984'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:07.855430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5c2c73a7-ca09-42f3-a2b7-a0ca8002a04f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '161b80f04eef480c9f12f1fdc0bcd984'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:07.857608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5c2c73a7-ca09-42f3-a2b7-a0ca8002a04f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '161b80f04eef480c9f12f1fdc0bcd984'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:07.858518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5c2c73a7-ca09-42f3-a2b7-a0ca8002a04f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '161b80f04eef480c9f12f1fdc0bcd984'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:07.884195 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1196/2430] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:02:07 2022] DELETE /identity/v3/users/161b80f04eef480c9f12f1fdc0bcd984 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:02:08.303346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27cf8b-28b1-4285-becd-ac543deaf7d3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:08.304806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2a27cf8b-28b1-4285-becd-ac543deaf7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:08.340943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27cf8b-28b1-4285-becd-ac543deaf7d3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:08.428088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10362908-d074-46e5-8e42-314e7ed35111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:08.430027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10362908-d074-46e5-8e42-314e7ed35111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:08.431256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10362908-d074-46e5-8e42-314e7ed35111 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:08.432584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10362908-d074-46e5-8e42-314e7ed35111 admin admin] PATH_INFO: `/v3/projects/be841d52aa80426b870e5ecb04c749f7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:08.434880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10362908-d074-46e5-8e42-314e7ed35111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be841d52aa80426b870e5ecb04c749f7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:08.438422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10362908-d074-46e5-8e42-314e7ed35111 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:08.513290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-10362908-d074-46e5-8e42-314e7ed35111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be841d52aa80426b870e5ecb04c749f7', 'request_id': 'req-10362908-d074-46e5-8e42-314e7ed35111'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:08.527359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-10362908-d074-46e5-8e42-314e7ed35111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be841d52aa80426b870e5ecb04c749f7', 'request_id': 'req-10362908-d074-46e5-8e42-314e7ed35111'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:08.542285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-10362908-d074-46e5-8e42-314e7ed35111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be841d52aa80426b870e5ecb04c749f7', 'request_id': 'req-10362908-d074-46e5-8e42-314e7ed35111'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:08.559351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-10362908-d074-46e5-8e42-314e7ed35111 admin admin] The token cache is being invalidate because project be841d52aa80426b870e5ecb04c749f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:02:08.559744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-10362908-d074-46e5-8e42-314e7ed35111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:08.560851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-10362908-d074-46e5-8e42-314e7ed35111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:08.567513 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1235/2431] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:02:08 2022] DELETE /identity/v3/projects/be841d52aa80426b870e5ecb04c749f7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:08.568741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe2673-d1b3-4107-bc8c-493fd5f3cbe7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:08.569012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe2673-d1b3-4107-bc8c-493fd5f3cbe7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:08.569369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe2673-d1b3-4107-bc8c-493fd5f3cbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:08.602345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-90fe2673-d1b3-4107-bc8c-493fd5f3cbe7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:08.603985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-90fe2673-d1b3-4107-bc8c-493fd5f3cbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:08.724201 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1197/2432] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:08.733215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c1b99-4630-408b-bb71-88b98a79b7f1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:08.733517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c1b99-4630-408b-bb71-88b98a79b7f1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:08.733774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c1b99-4630-408b-bb71-88b98a79b7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:08.765080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-590c1b99-4630-408b-bb71-88b98a79b7f1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:08.766480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-590c1b99-4630-408b-bb71-88b98a79b7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:08.781905 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1236/2433] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:08.782814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe2673-d1b3-4107-bc8c-493fd5f3cbe7 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:08.799956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe2673-d1b3-4107-bc8c-493fd5f3cbe7 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:08.819204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a7688-c274-4592-840c-8ba73ccf5b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:08.821417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a7688-c274-4592-840c-8ba73ccf5b12 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:08.821871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a7688-c274-4592-840c-8ba73ccf5b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:08.822294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a7688-c274-4592-840c-8ba73ccf5b12 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:08.823557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a7688-c274-4592-840c-8ba73ccf5b12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:02:08.824082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a7688-c274-4592-840c-8ba73ccf5b12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:08.831209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a7688-c274-4592-840c-8ba73ccf5b12 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:08.863143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c1b99-4630-408b-bb71-88b98a79b7f1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:08.864892 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1198/2434] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:02:08.883971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c1b99-4630-408b-bb71-88b98a79b7f1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:08.886431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a7688-c274-4592-840c-8ba73ccf5b12 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:08.888666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f02a7688-c274-4592-840c-8ba73ccf5b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:08.898316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e10b8-4271-4597-80d2-2f20052550aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:08.901550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e10b8-4271-4597-80d2-2f20052550aa admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:08.902000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e10b8-4271-4597-80d2-2f20052550aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:08.903381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e10b8-4271-4597-80d2-2f20052550aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:08.905619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e10b8-4271-4597-80d2-2f20052550aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:08.910967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e10b8-4271-4597-80d2-2f20052550aa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:08.959152 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1237/2435] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:02:08 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:02:08.964403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e10b8-4271-4597-80d2-2f20052550aa admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:08.985303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:09.059259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a7688-c274-4592-840c-8ba73ccf5b12 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:09.082853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e10b8-4271-4597-80d2-2f20052550aa admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:09.102792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ae33a-e5ca-4e2c-9425-6ff2b84fb51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:09.103545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ae33a-e5ca-4e2c-9425-6ff2b84fb51c admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:09.103819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ae33a-e5ca-4e2c-9425-6ff2b84fb51c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:09.121616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ae33a-e5ca-4e2c-9425-6ff2b84fb51c admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:09.140603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ae33a-e5ca-4e2c-9425-6ff2b84fb51c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:09.142756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ae33a-e5ca-4e2c-9425-6ff2b84fb51c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:09.166996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:09.198282 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1238/2436] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:02:08 2022] POST /identity/v3/users => generated 303 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:02:09.199477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ae33a-e5ca-4e2c-9425-6ff2b84fb51c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:09.214707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ae33a-e5ca-4e2c-9425-6ff2b84fb51c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:09.225757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e002b6-e96a-48d2-9f57-dfd4a2ff63e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:09.228352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e002b6-e96a-48d2-9f57-dfd4a2ff63e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:09.229838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e002b6-e96a-48d2-9f57-dfd4a2ff63e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:09.231802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e002b6-e96a-48d2-9f57-dfd4a2ff63e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:09.232923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e002b6-e96a-48d2-9f57-dfd4a2ff63e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:09.238717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e002b6-e96a-48d2-9f57-dfd4a2ff63e3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:09.254447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd427eba-ca37-4e8b-a3d9-341b24bc2483 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:09.255775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd427eba-ca37-4e8b-a3d9-341b24bc2483 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:09.256973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd427eba-ca37-4e8b-a3d9-341b24bc2483 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:09.257778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd427eba-ca37-4e8b-a3d9-341b24bc2483 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:09.261022 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1239/2437] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:02:09.262283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e002b6-e96a-48d2-9f57-dfd4a2ff63e3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:09.265059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cd427eba-ca37-4e8b-a3d9-341b24bc2483 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:09.274513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e002b6-e96a-48d2-9f57-dfd4a2ff63e3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:09.280173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f47d19-e18b-4a72-b0ed-082a0680034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:09.281263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f47d19-e18b-4a72-b0ed-082a0680034a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:09.283320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f47d19-e18b-4a72-b0ed-082a0680034a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:09.283848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f47d19-e18b-4a72-b0ed-082a0680034a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:09.285025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f47d19-e18b-4a72-b0ed-082a0680034a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:09.286662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f47d19-e18b-4a72-b0ed-082a0680034a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:09.305692 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1240/2438] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:02:09.307862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f47d19-e18b-4a72-b0ed-082a0680034a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:09.322693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f47d19-e18b-4a72-b0ed-082a0680034a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:09.355700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a67174-0b90-4362-be16-6728f7e42a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:09.357091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a67174-0b90-4362-be16-6728f7e42a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:09.357469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a67174-0b90-4362-be16-6728f7e42a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:09.357862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a67174-0b90-4362-be16-6728f7e42a72 admin admin] PATH_INFO: `/v3/projects/179257c7585f48aaa243914298831528/users/6bba4a354d6c42048145b2163549dc65/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:09.399060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a67174-0b90-4362-be16-6728f7e42a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=179257c7585f48aaa243914298831528, user_id=6bba4a354d6c42048145b2163549dc65, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:09.401828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a67174-0b90-4362-be16-6728f7e42a72 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:09.437946 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1241/2439] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:02:09 2022] PUT /identity/v3/projects/179257c7585f48aaa243914298831528/users/6bba4a354d6c42048145b2163549dc65/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:09.442745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd427eba-ca37-4e8b-a3d9-341b24bc2483 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:09.446556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ede4b-7778-469d-91a1-92503a769b3b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:09.446927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ede4b-7778-469d-91a1-92503a769b3b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:09.447197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ede4b-7778-469d-91a1-92503a769b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:09.448445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd427eba-ca37-4e8b-a3d9-341b24bc2483 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:09.487135 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1199/2440] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:08 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:09.494547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a49ede4b-7778-469d-91a1-92503a769b3b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:09.497527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a49ede4b-7778-469d-91a1-92503a769b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:09.673589 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1242/2441] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:09.683221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd427eba-ca37-4e8b-a3d9-341b24bc2483 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:09.685026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cd427eba-ca37-4e8b-a3d9-341b24bc2483 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:09.862922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd427eba-ca37-4e8b-a3d9-341b24bc2483 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:09.982094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625ac16-8e5f-433b-af41-0f22a5f4db50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:09.984925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625ac16-8e5f-433b-af41-0f22a5f4db50 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:09.985273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625ac16-8e5f-433b-af41-0f22a5f4db50 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:09.985766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625ac16-8e5f-433b-af41-0f22a5f4db50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:09.998043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437113c-d345-4e06-92bd-99ab5d024a7e None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:09.998768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437113c-d345-4e06-92bd-99ab5d024a7e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:09.999292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437113c-d345-4e06-92bd-99ab5d024a7e None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:10.001917 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1243/2442] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:02:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:02:10.019120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625ac16-8e5f-433b-af41-0f22a5f4db50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:10.032934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625ac16-8e5f-433b-af41-0f22a5f4db50 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:10.047536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81457e42-0eb9-45a1-be66-8c77a9d2f5eb None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:10.047857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81457e42-0eb9-45a1-be66-8c77a9d2f5eb None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:10.048130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81457e42-0eb9-45a1-be66-8c77a9d2f5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:10.076362 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1200/2443] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:10.097132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-81457e42-0eb9-45a1-be66-8c77a9d2f5eb None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:10.098593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-81457e42-0eb9-45a1-be66-8c77a9d2f5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:10.270775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:10.314923 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1244/2444] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:02:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:10.346402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625ac16-8e5f-433b-af41-0f22a5f4db50 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:10.356665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625ac16-8e5f-433b-af41-0f22a5f4db50 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:10.360609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5da651-17a8-47c0-a868-2bfa91c3a8e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:10.361444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5da651-17a8-47c0-a868-2bfa91c3a8e1 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:10.361728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5da651-17a8-47c0-a868-2bfa91c3a8e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:10.361994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5da651-17a8-47c0-a868-2bfa91c3a8e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:10.395532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5da651-17a8-47c0-a868-2bfa91c3a8e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:10.401944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5da651-17a8-47c0-a868-2bfa91c3a8e1 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:10.420302 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1201/2445] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:10.449306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcf627-23b8-4551-9e04-2b130713a8ba None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:10.449917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcf627-23b8-4551-9e04-2b130713a8ba None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:10.450815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcf627-23b8-4551-9e04-2b130713a8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:10.500605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-20dcf627-23b8-4551-9e04-2b130713a8ba None None] MFA Rules not processed for user `684732cf5a004fb084ce0e523398c970`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:10.502710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-20dcf627-23b8-4551-9e04-2b130713a8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:10.515280 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1245/2446] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:02:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:02:10.528019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5da651-17a8-47c0-a868-2bfa91c3a8e1 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:10.541271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5da651-17a8-47c0-a868-2bfa91c3a8e1 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:10.549474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce476a6-5b57-4068-b4a2-eadf49a9ba6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:10.550883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce476a6-5b57-4068-b4a2-eadf49a9ba6f service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:10.551370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce476a6-5b57-4068-b4a2-eadf49a9ba6f service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:10.552276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce476a6-5b57-4068-b4a2-eadf49a9ba6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:10.567138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce476a6-5b57-4068-b4a2-eadf49a9ba6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:10.568971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce476a6-5b57-4068-b4a2-eadf49a9ba6f service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:10.586354 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1202/2447] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:02:11.120824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcf627-23b8-4551-9e04-2b130713a8ba None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:11.145376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcf627-23b8-4551-9e04-2b130713a8ba None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:11.155875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32f450-1361-4033-82fa-d645bf4239ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:11.156603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32f450-1361-4033-82fa-d645bf4239ab service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:11.156979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32f450-1361-4033-82fa-d645bf4239ab service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:11.157349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32f450-1361-4033-82fa-d645bf4239ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:11.159590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9a32f450-1361-4033-82fa-d645bf4239ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:11.254750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32f450-1361-4033-82fa-d645bf4239ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:11.256617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32f450-1361-4033-82fa-d645bf4239ab service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:11.296419 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1246/2448] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:11 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:11.989731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce476a6-5b57-4068-b4a2-eadf49a9ba6f service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:11.991348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3ce476a6-5b57-4068-b4a2-eadf49a9ba6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:12.036475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:12.057584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce476a6-5b57-4068-b4a2-eadf49a9ba6f service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:12.084589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01bbea-1890-43c0-8cf0-b3ef8290346f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:12.086375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01bbea-1890-43c0-8cf0-b3ef8290346f service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:12.091752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01bbea-1890-43c0-8cf0-b3ef8290346f service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:12.092649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01bbea-1890-43c0-8cf0-b3ef8290346f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:12.096197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1f01bbea-1890-43c0-8cf0-b3ef8290346f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:12.247625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01bbea-1890-43c0-8cf0-b3ef8290346f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:12.256826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01bbea-1890-43c0-8cf0-b3ef8290346f service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:12.290188 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1203/2449] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:12.462781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32f450-1361-4033-82fa-d645bf4239ab service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:12.464322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9a32f450-1361-4033-82fa-d645bf4239ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:12.497000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32f450-1361-4033-82fa-d645bf4239ab service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:12.504898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af1de0-be31-4396-9b27-8351f3665b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:12.505713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af1de0-be31-4396-9b27-8351f3665b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:12.506172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af1de0-be31-4396-9b27-8351f3665b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:12.506438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af1de0-be31-4396-9b27-8351f3665b63 admin admin] PATH_INFO: `/v3/users/f946f72c764940c5818854d5a6323f3f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:12.517238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af1de0-be31-4396-9b27-8351f3665b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f946f72c764940c5818854d5a6323f3f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:12.519093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af1de0-be31-4396-9b27-8351f3665b63 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:12.613193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b6af1de0-be31-4396-9b27-8351f3665b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f946f72c764940c5818854d5a6323f3f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:12.626844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b6af1de0-be31-4396-9b27-8351f3665b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f946f72c764940c5818854d5a6323f3f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:12.627462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b6af1de0-be31-4396-9b27-8351f3665b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f946f72c764940c5818854d5a6323f3f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:12.628303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b6af1de0-be31-4396-9b27-8351f3665b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f946f72c764940c5818854d5a6323f3f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:12.640639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b6af1de0-be31-4396-9b27-8351f3665b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f946f72c764940c5818854d5a6323f3f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:12.672366 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1247/2450] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:02:12 2022] DELETE /identity/v3/users/f946f72c764940c5818854d5a6323f3f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:12.677146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51326ae-b4a5-4c40-bdee-8e809fe51cf4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:12.677621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51326ae-b4a5-4c40-bdee-8e809fe51cf4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:12.678047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51326ae-b4a5-4c40-bdee-8e809fe51cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:12.701066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e51326ae-b4a5-4c40-bdee-8e809fe51cf4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:12.704486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e51326ae-b4a5-4c40-bdee-8e809fe51cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:12.812122 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1204/2451] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:02:13.242484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af1de0-be31-4396-9b27-8351f3665b63 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:13.245561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b6af1de0-be31-4396-9b27-8351f3665b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:13.425012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:13.465454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af1de0-be31-4396-9b27-8351f3665b63 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:13.475512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a65757-2974-4e33-aab4-5f32af68846b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:13.476646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a65757-2974-4e33-aab4-5f32af68846b service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:13.477675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a65757-2974-4e33-aab4-5f32af68846b service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:13.478120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a65757-2974-4e33-aab4-5f32af68846b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:13.493089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a65757-2974-4e33-aab4-5f32af68846b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:13.496558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a65757-2974-4e33-aab4-5f32af68846b service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:13.530460 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1248/2452] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:16.114522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51326ae-b4a5-4c40-bdee-8e809fe51cf4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:16.119640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e51326ae-b4a5-4c40-bdee-8e809fe51cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:16.137570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51326ae-b4a5-4c40-bdee-8e809fe51cf4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:16.145665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd9d62-564f-4290-9b68-d23358f9119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:16.147179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd9d62-564f-4290-9b68-d23358f9119c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:16.147957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd9d62-564f-4290-9b68-d23358f9119c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:16.148446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd9d62-564f-4290-9b68-d23358f9119c admin admin] PATH_INFO: `/v3/projects/072e342f5fb4457f9051c6e61aff4725` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:16.150024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd9d62-564f-4290-9b68-d23358f9119c admin admin] RBAC: Authorizing `identity:delete_project(project_id=072e342f5fb4457f9051c6e61aff4725)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:16.153586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd9d62-564f-4290-9b68-d23358f9119c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:16.258556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a2bd9d62-564f-4290-9b68-d23358f9119c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '072e342f5fb4457f9051c6e61aff4725', 'request_id': 'req-a2bd9d62-564f-4290-9b68-d23358f9119c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:16.273669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a2bd9d62-564f-4290-9b68-d23358f9119c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '072e342f5fb4457f9051c6e61aff4725', 'request_id': 'req-a2bd9d62-564f-4290-9b68-d23358f9119c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:16.294845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a2bd9d62-564f-4290-9b68-d23358f9119c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '072e342f5fb4457f9051c6e61aff4725', 'request_id': 'req-a2bd9d62-564f-4290-9b68-d23358f9119c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:16.349734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a2bd9d62-564f-4290-9b68-d23358f9119c admin admin] The token cache is being invalidate because project 072e342f5fb4457f9051c6e61aff4725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:02:16.350502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a2bd9d62-564f-4290-9b68-d23358f9119c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:16.358538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a2bd9d62-564f-4290-9b68-d23358f9119c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:16.362078 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1205/2453] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:02:16 2022] DELETE /identity/v3/projects/072e342f5fb4457f9051c6e61aff4725 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:16.370033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460f347-8083-40ae-ac23-bd01023981bb None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:16.371156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460f347-8083-40ae-ac23-bd01023981bb None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:16.371371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460f347-8083-40ae-ac23-bd01023981bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:16.432556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1460f347-8083-40ae-ac23-bd01023981bb None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:16.433806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1460f347-8083-40ae-ac23-bd01023981bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:16.585358 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1249/2454] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:16.593667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e84702-b239-45ce-b059-a80bb2ae9e36 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:16.595107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e84702-b239-45ce-b059-a80bb2ae9e36 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:16.595652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e84702-b239-45ce-b059-a80bb2ae9e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:16.619905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b3e84702-b239-45ce-b059-a80bb2ae9e36 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:16.621392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b3e84702-b239-45ce-b059-a80bb2ae9e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:16.634695 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1206/2455] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:16.636197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460f347-8083-40ae-ac23-bd01023981bb None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:16.655104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460f347-8083-40ae-ac23-bd01023981bb None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:16.674272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6154a66-5deb-47ad-8db1-08df216795cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:16.675346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6154a66-5deb-47ad-8db1-08df216795cf admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:16.675817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6154a66-5deb-47ad-8db1-08df216795cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:16.676361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6154a66-5deb-47ad-8db1-08df216795cf admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:16.677469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6154a66-5deb-47ad-8db1-08df216795cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:02:16.677963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6154a66-5deb-47ad-8db1-08df216795cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:16.679831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6154a66-5deb-47ad-8db1-08df216795cf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:16.708173 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1250/2456] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:02:16.712383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e84702-b239-45ce-b059-a80bb2ae9e36 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:16.726584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e84702-b239-45ce-b059-a80bb2ae9e36 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:16.740615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0202ce2-2c1c-4641-9258-5de7654dd5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:16.741707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0202ce2-2c1c-4641-9258-5de7654dd5fd admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:16.742195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0202ce2-2c1c-4641-9258-5de7654dd5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:16.743285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0202ce2-2c1c-4641-9258-5de7654dd5fd admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:16.744266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0202ce2-2c1c-4641-9258-5de7654dd5fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:16.746461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0202ce2-2c1c-4641-9258-5de7654dd5fd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:16.791413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:16.835054 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1207/2457] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:02:16 2022] POST /identity/v3/projects => generated 395 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:02:16.839834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6154a66-5deb-47ad-8db1-08df216795cf admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:16.857742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6154a66-5deb-47ad-8db1-08df216795cf admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:17.024924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32d204-b4c0-42f7-a94c-3ce77b4c8401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:17.025948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32d204-b4c0-42f7-a94c-3ce77b4c8401 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:17.026426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32d204-b4c0-42f7-a94c-3ce77b4c8401 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:17.026919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32d204-b4c0-42f7-a94c-3ce77b4c8401 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:17.027851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32d204-b4c0-42f7-a94c-3ce77b4c8401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:17.030332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32d204-b4c0-42f7-a94c-3ce77b4c8401 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:17.056617 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1251/2458] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:02:16 2022] POST /identity/v3/users => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:02:17.063720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0202ce2-2c1c-4641-9258-5de7654dd5fd admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:17.098193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0202ce2-2c1c-4641-9258-5de7654dd5fd admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:17.114981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad34b00-0fd1-4392-b882-3c805784ccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:17.115917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad34b00-0fd1-4392-b882-3c805784ccf9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:17.116163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad34b00-0fd1-4392-b882-3c805784ccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:17.116366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad34b00-0fd1-4392-b882-3c805784ccf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:17.117792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad34b00-0fd1-4392-b882-3c805784ccf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:17.121925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad34b00-0fd1-4392-b882-3c805784ccf9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:17.149022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32d204-b4c0-42f7-a94c-3ce77b4c8401 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:17.149313 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1208/2459] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:02:17.163696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32d204-b4c0-42f7-a94c-3ce77b4c8401 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:17.176995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd4a32-a980-4e1e-a364-0db8c326c1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:17.177831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd4a32-a980-4e1e-a364-0db8c326c1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:17.178041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd4a32-a980-4e1e-a364-0db8c326c1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:17.178210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd4a32-a980-4e1e-a364-0db8c326c1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:17.178920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd4a32-a980-4e1e-a364-0db8c326c1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:17.182249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd4a32-a980-4e1e-a364-0db8c326c1e9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:17.196171 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1252/2460] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:02:17.197510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad34b00-0fd1-4392-b882-3c805784ccf9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:17.215111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad34b00-0fd1-4392-b882-3c805784ccf9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:17.224951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfe3d6-debb-463f-87d0-8b8894267b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:17.226481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfe3d6-debb-463f-87d0-8b8894267b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:17.227591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfe3d6-debb-463f-87d0-8b8894267b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:17.228183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfe3d6-debb-463f-87d0-8b8894267b3d admin admin] PATH_INFO: `/v3/projects/83e6c81cb2214f458e3a20263c279b0e/users/e0cd53711ee245648bd3a2dc2c623cec/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:17.256430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfe3d6-debb-463f-87d0-8b8894267b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=83e6c81cb2214f458e3a20263c279b0e, user_id=e0cd53711ee245648bd3a2dc2c623cec, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:17.266077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfe3d6-debb-463f-87d0-8b8894267b3d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:17.306972 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1209/2461] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:02:17 2022] PUT /identity/v3/projects/83e6c81cb2214f458e3a20263c279b0e/users/e0cd53711ee245648bd3a2dc2c623cec/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:02:17.313600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a638e70-2570-475a-970f-f159f910deb6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:17.314137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a638e70-2570-475a-970f-f159f910deb6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:17.314649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a638e70-2570-475a-970f-f159f910deb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:17.359732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9a638e70-2570-475a-970f-f159f910deb6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:17.362408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9a638e70-2570-475a-970f-f159f910deb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:17.516718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:17.551922 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1253/2462] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:17.649479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfe3d6-debb-463f-87d0-8b8894267b3d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:17.652927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c0cfe3d6-debb-463f-87d0-8b8894267b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:17.845384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfe3d6-debb-463f-87d0-8b8894267b3d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:17.857586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5756f0-a5ae-4a62-bd7d-b7805ed43a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:17.858617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5756f0-a5ae-4a62-bd7d-b7805ed43a2a service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:17.862374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5756f0-a5ae-4a62-bd7d-b7805ed43a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:17.863087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5756f0-a5ae-4a62-bd7d-b7805ed43a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:17.880984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5756f0-a5ae-4a62-bd7d-b7805ed43a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:17.896305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5756f0-a5ae-4a62-bd7d-b7805ed43a2a service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:17.913832 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1210/2463] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:19.280945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948b08a-5c2f-42ed-a35a-bda978309d28 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:19.281732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948b08a-5c2f-42ed-a35a-bda978309d28 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:19.281732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948b08a-5c2f-42ed-a35a-bda978309d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:19.284791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5756f0-a5ae-4a62-bd7d-b7805ed43a2a service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:19.286582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-da5756f0-a5ae-4a62-bd7d-b7805ed43a2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:19.356918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f948b08a-5c2f-42ed-a35a-bda978309d28 None None] MFA Rules not processed for user `fe262620110042f6baacf06dd51e0ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:19.358174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f948b08a-5c2f-42ed-a35a-bda978309d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:19.515522 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1254/2464] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:19.552058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5756f0-a5ae-4a62-bd7d-b7805ed43a2a service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:19.570619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a049c10-e039-47ac-a3df-db8f4726d5d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:19.571322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a049c10-e039-47ac-a3df-db8f4726d5d5 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:19.571602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a049c10-e039-47ac-a3df-db8f4726d5d5 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:19.571874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a049c10-e039-47ac-a3df-db8f4726d5d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:19.577756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1a049c10-e039-47ac-a3df-db8f4726d5d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:19.755218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:19.797740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a049c10-e039-47ac-a3df-db8f4726d5d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:19.809506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a049c10-e039-47ac-a3df-db8f4726d5d5 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:19.856540 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1211/2465] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:22.565773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752ed53-ceb8-4b50-9530-275fa69c4452 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:22.566389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752ed53-ceb8-4b50-9530-275fa69c4452 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:22.566520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752ed53-ceb8-4b50-9530-275fa69c4452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:22.592446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3752ed53-ceb8-4b50-9530-275fa69c4452 None None] MFA Rules not processed for user `684732cf5a004fb084ce0e523398c970`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:22.594415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3752ed53-ceb8-4b50-9530-275fa69c4452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:22.604747 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1255/2466] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:02:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:22.930671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a049c10-e039-47ac-a3df-db8f4726d5d5 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:22.932912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1a049c10-e039-47ac-a3df-db8f4726d5d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:22.954631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a049c10-e039-47ac-a3df-db8f4726d5d5 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:22.957935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ca4e4-944f-4550-b13e-8dcfa801bc28 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:22.958222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ca4e4-944f-4550-b13e-8dcfa801bc28 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:22.958497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ca4e4-944f-4550-b13e-8dcfa801bc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:22.963943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ee3e7-0cf6-4e29-9d7e-78d459dc3559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:22.964632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ee3e7-0cf6-4e29-9d7e-78d459dc3559 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:22.974471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ee3e7-0cf6-4e29-9d7e-78d459dc3559 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:22.975075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ee3e7-0cf6-4e29-9d7e-78d459dc3559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:23.001320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ee3e7-0cf6-4e29-9d7e-78d459dc3559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:23.003034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ee3e7-0cf6-4e29-9d7e-78d459dc3559 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:23.033402 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1212/2467] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:23.038065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b37ca4e4-944f-4550-b13e-8dcfa801bc28 None None] MFA Rules not processed for user `b16a9c9e35954d579536375f7eab1c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:23.039868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b37ca4e4-944f-4550-b13e-8dcfa801bc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:23.134642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5815919-aebf-4cd7-802a-0d4c93c48664 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:23.135162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5815919-aebf-4cd7-802a-0d4c93c48664 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:23.135614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5815919-aebf-4cd7-802a-0d4c93c48664 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:23.137248 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1213/2468] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 21:02:23.140272 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1256/2469] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 02 21:02:23.150972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8b159-c6f7-499e-9c2e-6f86da859c39 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:23.151531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8b159-c6f7-499e-9c2e-6f86da859c39 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:23.152122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8b159-c6f7-499e-9c2e-6f86da859c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:23.166906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8757a-ab65-4f5f-960c-ea9b66798200 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:23.167460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8757a-ab65-4f5f-960c-ea9b66798200 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:23.167893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8757a-ab65-4f5f-960c-ea9b66798200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:23.210202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fdd8b159-c6f7-499e-9c2e-6f86da859c39 None None] MFA Rules not processed for user `b16a9c9e35954d579536375f7eab1c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:23.211818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fdd8b159-c6f7-499e-9c2e-6f86da859c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:23.215743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-46b8757a-ab65-4f5f-960c-ea9b66798200 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:23.217036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-46b8757a-ab65-4f5f-960c-ea9b66798200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:23.235241 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1214/2470] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:23.334449 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1257/2471] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:02:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:23.359406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8b159-c6f7-499e-9c2e-6f86da859c39 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:23.363641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fdd8b159-c6f7-499e-9c2e-6f86da859c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:23.422821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8b159-c6f7-499e-9c2e-6f86da859c39 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:23.434365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdefd9-8403-4ab4-8eb2-6c9eb3e8905a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:23.435054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdefd9-8403-4ab4-8eb2-6c9eb3e8905a service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:23.435340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdefd9-8403-4ab4-8eb2-6c9eb3e8905a service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:23.435617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdefd9-8403-4ab4-8eb2-6c9eb3e8905a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:23.469798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdefd9-8403-4ab4-8eb2-6c9eb3e8905a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:23.474979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdefd9-8403-4ab4-8eb2-6c9eb3e8905a service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:23.499704 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1215/2472] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:23.517172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8757a-ab65-4f5f-960c-ea9b66798200 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:23.519853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-46b8757a-ab65-4f5f-960c-ea9b66798200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:23.551698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8757a-ab65-4f5f-960c-ea9b66798200 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:23.558257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962a8fe-a9ca-4d30-bcab-c6a4e0626acb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:23.558949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962a8fe-a9ca-4d30-bcab-c6a4e0626acb service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:23.559237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962a8fe-a9ca-4d30-bcab-c6a4e0626acb service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:23.559515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962a8fe-a9ca-4d30-bcab-c6a4e0626acb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:23.574202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962a8fe-a9ca-4d30-bcab-c6a4e0626acb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:23.578443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962a8fe-a9ca-4d30-bcab-c6a4e0626acb service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:23.594857 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1258/2473] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:23.663526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96380949-ad22-4504-98d2-aa81a5e4d263 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:23.663826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96380949-ad22-4504-98d2-aa81a5e4d263 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:23.664132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96380949-ad22-4504-98d2-aa81a5e4d263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:23.723660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-96380949-ad22-4504-98d2-aa81a5e4d263 None None] MFA Rules not processed for user `6bba4a354d6c42048145b2163549dc65`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:23.724956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-96380949-ad22-4504-98d2-aa81a5e4d263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:23.884189 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1216/2474] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:23 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:23.888702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962a8fe-a9ca-4d30-bcab-c6a4e0626acb service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:23.891063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e962a8fe-a9ca-4d30-bcab-c6a4e0626acb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:23.910626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:23.920533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962a8fe-a9ca-4d30-bcab-c6a4e0626acb service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:23.931291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85b5e5-ea2d-482e-819b-bdcc7ef658ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:23.932582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85b5e5-ea2d-482e-819b-bdcc7ef658ef admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:23.933598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85b5e5-ea2d-482e-819b-bdcc7ef658ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:23.934505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85b5e5-ea2d-482e-819b-bdcc7ef658ef admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:23.935653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85b5e5-ea2d-482e-819b-bdcc7ef658ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:23.938411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85b5e5-ea2d-482e-819b-bdcc7ef658ef admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:23.966058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab0013-464d-4f3b-81e6-66a48e5fce96 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:23.966662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab0013-464d-4f3b-81e6-66a48e5fce96 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:23.967049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab0013-464d-4f3b-81e6-66a48e5fce96 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:23.971125 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1217/2475] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:02:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:02:23.978149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58040235-fe2e-498e-9608-bc6f0902dfda None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:23.979231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58040235-fe2e-498e-9608-bc6f0902dfda None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:23.979786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58040235-fe2e-498e-9608-bc6f0902dfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:23.986228 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1259/2476] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:02:23 2022] POST /identity/v3/projects => generated 403 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:02:23.996370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85b5e5-ea2d-482e-819b-bdcc7ef658ef admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:24.056761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-58040235-fe2e-498e-9608-bc6f0902dfda None None] MFA Rules not processed for user `684732cf5a004fb084ce0e523398c970`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:24.061651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-58040235-fe2e-498e-9608-bc6f0902dfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:24.134969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85b5e5-ea2d-482e-819b-bdcc7ef658ef admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:24.142343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845dea2-2c3e-44ed-ba92-9adb874f6124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:24.143306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845dea2-2c3e-44ed-ba92-9adb874f6124 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:24.145347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845dea2-2c3e-44ed-ba92-9adb874f6124 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:24.145813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845dea2-2c3e-44ed-ba92-9adb874f6124 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:24.147913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845dea2-2c3e-44ed-ba92-9adb874f6124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:24.150110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845dea2-2c3e-44ed-ba92-9adb874f6124 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:24.189577 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1260/2477] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:02:23 2022] POST /identity/v3/users => generated 308 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:02:24.196380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845dea2-2c3e-44ed-ba92-9adb874f6124 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:24.217513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845dea2-2c3e-44ed-ba92-9adb874f6124 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:24.232054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed8a72-62c3-40e9-9054-850b592c1496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:24.232950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed8a72-62c3-40e9-9054-850b592c1496 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:24.235772 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1218/2478] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:02:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:24.235902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed8a72-62c3-40e9-9054-850b592c1496 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:24.236827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed8a72-62c3-40e9-9054-850b592c1496 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:24.237971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed8a72-62c3-40e9-9054-850b592c1496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:24.239912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed8a72-62c3-40e9-9054-850b592c1496 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:24.250652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58040235-fe2e-498e-9608-bc6f0902dfda None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:24.266086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58040235-fe2e-498e-9608-bc6f0902dfda None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:24.274939 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1261/2479] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:02:24.275620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79d6d2-8b5d-49ed-bcc3-f598e34b00da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:24.276350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79d6d2-8b5d-49ed-bcc3-f598e34b00da service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:24.276630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79d6d2-8b5d-49ed-bcc3-f598e34b00da service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:24.276904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79d6d2-8b5d-49ed-bcc3-f598e34b00da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:24.278289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed8a72-62c3-40e9-9054-850b592c1496 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:24.296636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79d6d2-8b5d-49ed-bcc3-f598e34b00da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:24.298267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79d6d2-8b5d-49ed-bcc3-f598e34b00da service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:24.300794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed8a72-62c3-40e9-9054-850b592c1496 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:24.315517 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1219/2480] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:24.315767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf33196-40c7-46ca-bcec-04824a57e917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:24.317133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf33196-40c7-46ca-bcec-04824a57e917 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:24.317672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf33196-40c7-46ca-bcec-04824a57e917 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:24.318114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf33196-40c7-46ca-bcec-04824a57e917 admin admin] PATH_INFO: `/v3/projects/84f0001033e04119bedc25d150414edb/users/2c5de5511c034d2981c607e123d91f8a/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:24.335066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf33196-40c7-46ca-bcec-04824a57e917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f0001033e04119bedc25d150414edb, user_id=2c5de5511c034d2981c607e123d91f8a, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:24.338041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf33196-40c7-46ca-bcec-04824a57e917 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:24.355469 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1262/2481] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:02:24 2022] PUT /identity/v3/projects/84f0001033e04119bedc25d150414edb/users/2c5de5511c034d2981c607e123d91f8a/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:24.359671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79d6d2-8b5d-49ed-bcc3-f598e34b00da service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:24.377681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79d6d2-8b5d-49ed-bcc3-f598e34b00da service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:24.469140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03ecb1-b03a-4166-a930-9076e5ed1658 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:24.469432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03ecb1-b03a-4166-a930-9076e5ed1658 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:24.469714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03ecb1-b03a-4166-a930-9076e5ed1658 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:24.471312 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1263/2482] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:02:24.478862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:24.480390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256ca08-458f-4a3f-94a9-06346f501589 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:24.480597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256ca08-458f-4a3f-94a9-06346f501589 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:24.480847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256ca08-458f-4a3f-94a9-06346f501589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:24.502216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe8bab-f62e-41c6-886e-9f2f61e83ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:24.502913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe8bab-f62e-41c6-886e-9f2f61e83ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:24.503236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe8bab-f62e-41c6-886e-9f2f61e83ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:24.503654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe8bab-f62e-41c6-886e-9f2f61e83ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:24.504454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe8bab-f62e-41c6-886e-9f2f61e83ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:24.507478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe8bab-f62e-41c6-886e-9f2f61e83ba2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:24.514859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2256ca08-458f-4a3f-94a9-06346f501589 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:24.516412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2256ca08-458f-4a3f-94a9-06346f501589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:24.527930 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1220/2483] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:02:24.529619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe8bab-f62e-41c6-886e-9f2f61e83ba2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:24.545774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe8bab-f62e-41c6-886e-9f2f61e83ba2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:24.553866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f88112-9064-4b8f-b759-746580924f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:24.554787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f88112-9064-4b8f-b759-746580924f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:24.555065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f88112-9064-4b8f-b759-746580924f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:24.555338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f88112-9064-4b8f-b759-746580924f19 admin admin] PATH_INFO: `/v3/projects/84f0001033e04119bedc25d150414edb/users/2c5de5511c034d2981c607e123d91f8a/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:24.559383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f88112-9064-4b8f-b759-746580924f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f0001033e04119bedc25d150414edb, user_id=2c5de5511c034d2981c607e123d91f8a, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:24.566616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f88112-9064-4b8f-b759-746580924f19 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:24.591478 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1221/2484] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:02:24 2022] PUT /identity/v3/projects/84f0001033e04119bedc25d150414edb/users/2c5de5511c034d2981c607e123d91f8a/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:24.680025 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1264/2485] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:02:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:24.707242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f88112-9064-4b8f-b759-746580924f19 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:24.949802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f88112-9064-4b8f-b759-746580924f19 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:24.966115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50c65d-49e0-44e8-a60c-4a0d7ccf66cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:24.968234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50c65d-49e0-44e8-a60c-4a0d7ccf66cc service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:24.968676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50c65d-49e0-44e8-a60c-4a0d7ccf66cc service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:24.969607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50c65d-49e0-44e8-a60c-4a0d7ccf66cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:25.002839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50c65d-49e0-44e8-a60c-4a0d7ccf66cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:25.009555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50c65d-49e0-44e8-a60c-4a0d7ccf66cc service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:25.040125 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1222/2486] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:25.385818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b1e84-07f5-44e7-ba4c-b70e3bf7842d None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:25.386108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b1e84-07f5-44e7-ba4c-b70e3bf7842d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:25.386392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b1e84-07f5-44e7-ba4c-b70e3bf7842d None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:25.388773 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1265/2487] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:02:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:02:25.401668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ee796-53a1-4b87-bf8a-538659053963 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:25.401951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ee796-53a1-4b87-bf8a-538659053963 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:25.402222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ee796-53a1-4b87-bf8a-538659053963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:25.423949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f57ee796-53a1-4b87-bf8a-538659053963 None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:25.425655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f57ee796-53a1-4b87-bf8a-538659053963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:25.588835 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1223/2488] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:02:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:25.630374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b1e84-07f5-44e7-ba4c-b70e3bf7842d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:25.705212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:25.764322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b1e84-07f5-44e7-ba4c-b70e3bf7842d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:25.774743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b49de-5755-49fe-97af-96ddb41b1b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:25.775656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b49de-5755-49fe-97af-96ddb41b1b7b service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:25.776055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b49de-5755-49fe-97af-96ddb41b1b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:25.776531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b49de-5755-49fe-97af-96ddb41b1b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:25.810509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b49de-5755-49fe-97af-96ddb41b1b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:25.812097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b49de-5755-49fe-97af-96ddb41b1b7b service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:25.841689 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1266/2489] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:26.348987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458716d-3d9c-468f-9539-eaffe16bf800 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:26.349605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458716d-3d9c-468f-9539-eaffe16bf800 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:26.349605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458716d-3d9c-468f-9539-eaffe16bf800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:26.404202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a458716d-3d9c-468f-9539-eaffe16bf800 None None] MFA Rules not processed for user `a60bf5141fea499abb9b22658e56c944`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:26.405494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a458716d-3d9c-468f-9539-eaffe16bf800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:26.595619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:26.655852 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1224/2490] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:35.827716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=11 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:36.621968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:39.088105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc63cc-7575-4955-b6a0-0afd62dcb88b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:39.088711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc63cc-7575-4955-b6a0-0afd62dcb88b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:39.088711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc63cc-7575-4955-b6a0-0afd62dcb88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:39.230593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-85cc63cc-7575-4955-b6a0-0afd62dcb88b None None] MFA Rules not processed for user `e0cd53711ee245648bd3a2dc2c623cec`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:39.236476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-85cc63cc-7575-4955-b6a0-0afd62dcb88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:39.409058 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1267/2491] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:39.664463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458716d-3d9c-468f-9539-eaffe16bf800 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:39.685494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458716d-3d9c-468f-9539-eaffe16bf800 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:39.694256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf79b3-ac6b-4771-bad8-745699184cc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:39.694873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf79b3-ac6b-4771-bad8-745699184cc8 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:39.695340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf79b3-ac6b-4771-bad8-745699184cc8 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:39.695774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf79b3-ac6b-4771-bad8-745699184cc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:39.706096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf79b3-ac6b-4771-bad8-745699184cc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:39.707980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf79b3-ac6b-4771-bad8-745699184cc8 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:39.727792 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1225/2492] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:40.375744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb62ce-b717-4cd7-9754-9acda74d10b7 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:40.376660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb62ce-b717-4cd7-9754-9acda74d10b7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:40.377351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb62ce-b717-4cd7-9754-9acda74d10b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:40.396914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a7016-9adc-4762-957c-10c75430194c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:40.397199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a7016-9adc-4762-957c-10c75430194c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:40.397480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a7016-9adc-4762-957c-10c75430194c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:40.432518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-80cb62ce-b717-4cd7-9754-9acda74d10b7 None None] MFA Rules not processed for user `f3287fb85c2343d686718d3c4aaa5c00`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:40.434289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-80cb62ce-b717-4cd7-9754-9acda74d10b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:40.455045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a54a7016-9adc-4762-957c-10c75430194c None None] MFA Rules not processed for user `2c5de5511c034d2981c607e123d91f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:40.456503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a54a7016-9adc-4762-957c-10c75430194c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:40.602734 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1268/2493] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:40.605515 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1226/2494] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:45.057607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27929a-2961-40ad-a047-0f79d40209da None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:45.058183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27929a-2961-40ad-a047-0f79d40209da None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:45.058183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27929a-2961-40ad-a047-0f79d40209da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:45.083767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9e27929a-2961-40ad-a047-0f79d40209da None None] MFA Rules not processed for user `9ee93cc6740d4e92b231f60d8b9d4450`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:45.085238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9e27929a-2961-40ad-a047-0f79d40209da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:45.158317 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1269/2495] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:50.587681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=40 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:54.349632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a7016-9adc-4762-957c-10c75430194c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:54.351137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a54a7016-9adc-4762-957c-10c75430194c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:54.545100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a7016-9adc-4762-957c-10c75430194c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:54.552802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607b98c-0661-4f5c-8a3b-296702205918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:54.554158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607b98c-0661-4f5c-8a3b-296702205918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:54.554626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607b98c-0661-4f5c-8a3b-296702205918 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:54.555164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607b98c-0661-4f5c-8a3b-296702205918 admin admin] PATH_INFO: `/v3/users/fe262620110042f6baacf06dd51e0ddc` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:54.556974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607b98c-0661-4f5c-8a3b-296702205918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe262620110042f6baacf06dd51e0ddc)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:54.559349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607b98c-0661-4f5c-8a3b-296702205918 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:54.728472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2607b98c-0661-4f5c-8a3b-296702205918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe262620110042f6baacf06dd51e0ddc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:54.743999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2607b98c-0661-4f5c-8a3b-296702205918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe262620110042f6baacf06dd51e0ddc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:54.778428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2607b98c-0661-4f5c-8a3b-296702205918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe262620110042f6baacf06dd51e0ddc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:54.779366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2607b98c-0661-4f5c-8a3b-296702205918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe262620110042f6baacf06dd51e0ddc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:54.780193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2607b98c-0661-4f5c-8a3b-296702205918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe262620110042f6baacf06dd51e0ddc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:54.800452 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1227/2496] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:02:54 2022] DELETE /identity/v3/users/fe262620110042f6baacf06dd51e0ddc => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:54.805378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7c5a3-93bb-4f36-8826-f544b746ab12 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:54.805906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7c5a3-93bb-4f36-8826-f544b746ab12 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:54.806001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7c5a3-93bb-4f36-8826-f544b746ab12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:54.828704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a3c7c5a3-93bb-4f36-8826-f544b746ab12 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:54.830268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a3c7c5a3-93bb-4f36-8826-f544b746ab12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:54.873506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:54.904130 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1270/2497] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:54.914312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607b98c-0661-4f5c-8a3b-296702205918 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:54.915969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2607b98c-0661-4f5c-8a3b-296702205918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:54.979030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607b98c-0661-4f5c-8a3b-296702205918 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:54.985679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39380a93-4f77-4c0e-8775-67af098b9eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:54.987034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39380a93-4f77-4c0e-8775-67af098b9eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:54.987034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39380a93-4f77-4c0e-8775-67af098b9eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:54.987194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39380a93-4f77-4c0e-8775-67af098b9eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:54.997655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39380a93-4f77-4c0e-8775-67af098b9eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:55.000092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39380a93-4f77-4c0e-8775-67af098b9eb7 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:55.012432 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1228/2498] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:55.772688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7c5a3-93bb-4f36-8826-f544b746ab12 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:55.774412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a3c7c5a3-93bb-4f36-8826-f544b746ab12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:55.806409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7c5a3-93bb-4f36-8826-f544b746ab12 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:55.821183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e472a65-9acd-4504-9b2c-b022fd4a821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:55.822078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e472a65-9acd-4504-9b2c-b022fd4a821c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:55.822533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e472a65-9acd-4504-9b2c-b022fd4a821c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:55.822949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e472a65-9acd-4504-9b2c-b022fd4a821c admin admin] PATH_INFO: `/v3/projects/8ae5fa728db84608bfaa558277a90b34` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:55.824404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e472a65-9acd-4504-9b2c-b022fd4a821c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae5fa728db84608bfaa558277a90b34)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:55.826525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e472a65-9acd-4504-9b2c-b022fd4a821c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:55.927873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e472a65-9acd-4504-9b2c-b022fd4a821c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae5fa728db84608bfaa558277a90b34', 'request_id': 'req-9e472a65-9acd-4504-9b2c-b022fd4a821c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:55.937010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e472a65-9acd-4504-9b2c-b022fd4a821c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae5fa728db84608bfaa558277a90b34', 'request_id': 'req-9e472a65-9acd-4504-9b2c-b022fd4a821c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:55.945212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e472a65-9acd-4504-9b2c-b022fd4a821c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae5fa728db84608bfaa558277a90b34', 'request_id': 'req-9e472a65-9acd-4504-9b2c-b022fd4a821c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:55.964765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e472a65-9acd-4504-9b2c-b022fd4a821c admin admin] The token cache is being invalidate because project 8ae5fa728db84608bfaa558277a90b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:02:55.964765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e472a65-9acd-4504-9b2c-b022fd4a821c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:55.964765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e472a65-9acd-4504-9b2c-b022fd4a821c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:55.967527 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1271/2499] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:02:55 2022] DELETE /identity/v3/projects/8ae5fa728db84608bfaa558277a90b34 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:55.968779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39380a93-4f77-4c0e-8775-67af098b9eb7 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:55.979198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39380a93-4f77-4c0e-8775-67af098b9eb7 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:56.007414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:56.058752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff214d61-616b-4676-9f02-dae9bc744485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:56.060542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff214d61-616b-4676-9f02-dae9bc744485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:56.060824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff214d61-616b-4676-9f02-dae9bc744485 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:56.061098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff214d61-616b-4676-9f02-dae9bc744485 admin admin] PATH_INFO: `/v3/users/a6f93f8145f7475d975b44f63f1850bb` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:56.064464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff214d61-616b-4676-9f02-dae9bc744485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6f93f8145f7475d975b44f63f1850bb)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:56.066234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff214d61-616b-4676-9f02-dae9bc744485 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:56.151894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ff214d61-616b-4676-9f02-dae9bc744485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6f93f8145f7475d975b44f63f1850bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:56.171992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ff214d61-616b-4676-9f02-dae9bc744485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6f93f8145f7475d975b44f63f1850bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:56.184862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ff214d61-616b-4676-9f02-dae9bc744485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6f93f8145f7475d975b44f63f1850bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:56.186136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ff214d61-616b-4676-9f02-dae9bc744485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6f93f8145f7475d975b44f63f1850bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:56.187920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ff214d61-616b-4676-9f02-dae9bc744485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6f93f8145f7475d975b44f63f1850bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:56.219795 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1229/2500] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:02:55 2022] DELETE /identity/v3/users/a6f93f8145f7475d975b44f63f1850bb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:56.617788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e472a65-9acd-4504-9b2c-b022fd4a821c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:56.619423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9e472a65-9acd-4504-9b2c-b022fd4a821c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:56.644293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e472a65-9acd-4504-9b2c-b022fd4a821c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:56.723136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c25ce8-3153-400d-96dc-dd29519fc7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:56.724495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c25ce8-3153-400d-96dc-dd29519fc7eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:56.724784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c25ce8-3153-400d-96dc-dd29519fc7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:56.725059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c25ce8-3153-400d-96dc-dd29519fc7eb admin admin] PATH_INFO: `/v3/projects/c4c1a7b3a27642768fdc343c03e931a6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:56.727203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c25ce8-3153-400d-96dc-dd29519fc7eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c1a7b3a27642768fdc343c03e931a6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:56.729216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c25ce8-3153-400d-96dc-dd29519fc7eb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:56.816837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-07c25ce8-3153-400d-96dc-dd29519fc7eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c1a7b3a27642768fdc343c03e931a6', 'request_id': 'req-07c25ce8-3153-400d-96dc-dd29519fc7eb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:56.839036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-07c25ce8-3153-400d-96dc-dd29519fc7eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c1a7b3a27642768fdc343c03e931a6', 'request_id': 'req-07c25ce8-3153-400d-96dc-dd29519fc7eb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:56.848978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-07c25ce8-3153-400d-96dc-dd29519fc7eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c1a7b3a27642768fdc343c03e931a6', 'request_id': 'req-07c25ce8-3153-400d-96dc-dd29519fc7eb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:56.856401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:56.871741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-07c25ce8-3153-400d-96dc-dd29519fc7eb admin admin] The token cache is being invalidate because project c4c1a7b3a27642768fdc343c03e931a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:02:56.872343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-07c25ce8-3153-400d-96dc-dd29519fc7eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:56.874007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-07c25ce8-3153-400d-96dc-dd29519fc7eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:56.876242 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1272/2501] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:02:56 2022] DELETE /identity/v3/projects/c4c1a7b3a27642768fdc343c03e931a6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:56.881304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e7b59-1c5a-4f79-b21f-3662e7e6c61d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:56.881593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e7b59-1c5a-4f79-b21f-3662e7e6c61d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:56.881869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e7b59-1c5a-4f79-b21f-3662e7e6c61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:56.903690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-754e7b59-1c5a-4f79-b21f-3662e7e6c61d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:56.905360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-754e7b59-1c5a-4f79-b21f-3662e7e6c61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:56.984376 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1230/2502] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:56.991964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1939a25-d9d8-4902-80ad-42ac3d6ad485 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:56.992321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1939a25-d9d8-4902-80ad-42ac3d6ad485 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:56.993051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1939a25-d9d8-4902-80ad-42ac3d6ad485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:57.085428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a1939a25-d9d8-4902-80ad-42ac3d6ad485 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:57.086750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a1939a25-d9d8-4902-80ad-42ac3d6ad485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:57.104162 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1273/2503] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:57.108712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e7b59-1c5a-4f79-b21f-3662e7e6c61d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:57.120467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e7b59-1c5a-4f79-b21f-3662e7e6c61d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:57.126465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96640383-c78c-4d8b-a8fb-54f36278f3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:57.127393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96640383-c78c-4d8b-a8fb-54f36278f3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:57.127740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96640383-c78c-4d8b-a8fb-54f36278f3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:57.128125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96640383-c78c-4d8b-a8fb-54f36278f3a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:57.128920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96640383-c78c-4d8b-a8fb-54f36278f3a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:02:57.129287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96640383-c78c-4d8b-a8fb-54f36278f3a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:57.130985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96640383-c78c-4d8b-a8fb-54f36278f3a3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:57.162005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1939a25-d9d8-4902-80ad-42ac3d6ad485 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:57.166948 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1231/2504] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:02:57.180984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1939a25-d9d8-4902-80ad-42ac3d6ad485 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:57.193433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828c272-4053-41a5-9652-77830d622085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:57.194198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828c272-4053-41a5-9652-77830d622085 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:57.194547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828c272-4053-41a5-9652-77830d622085 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:57.194888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828c272-4053-41a5-9652-77830d622085 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:57.195688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828c272-4053-41a5-9652-77830d622085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:57.197718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828c272-4053-41a5-9652-77830d622085 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:57.270422 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1274/2505] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:02:57 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:02:57.274728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96640383-c78c-4d8b-a8fb-54f36278f3a3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:57.288898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96640383-c78c-4d8b-a8fb-54f36278f3a3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:57.353182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:57.402453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52f51a-3dca-4a5c-bf34-85f14a28aeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:57.403141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52f51a-3dca-4a5c-bf34-85f14a28aeae admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:57.403582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52f51a-3dca-4a5c-bf34-85f14a28aeae admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:57.403704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52f51a-3dca-4a5c-bf34-85f14a28aeae admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:57.404478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52f51a-3dca-4a5c-bf34-85f14a28aeae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:57.406318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52f51a-3dca-4a5c-bf34-85f14a28aeae admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:57.432549 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1232/2506] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:02:57 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:02:57.437573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828c272-4053-41a5-9652-77830d622085 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:57.454976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828c272-4053-41a5-9652-77830d622085 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:57.464585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d098bde-4bef-4405-8f08-05787fbbcc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:57.465631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d098bde-4bef-4405-8f08-05787fbbcc6d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:57.466141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d098bde-4bef-4405-8f08-05787fbbcc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:57.466612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d098bde-4bef-4405-8f08-05787fbbcc6d admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:57.467554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d098bde-4bef-4405-8f08-05787fbbcc6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:57.470067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d098bde-4bef-4405-8f08-05787fbbcc6d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:57.492023 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1275/2507] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:02:57.493313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52f51a-3dca-4a5c-bf34-85f14a28aeae admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:57.506886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52f51a-3dca-4a5c-bf34-85f14a28aeae admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:57.512979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce79d4-b4bb-41a0-9c5b-ff52b990670f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:57.513661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce79d4-b4bb-41a0-9c5b-ff52b990670f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:57.513937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce79d4-b4bb-41a0-9c5b-ff52b990670f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:57.514206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce79d4-b4bb-41a0-9c5b-ff52b990670f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:57.515073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce79d4-b4bb-41a0-9c5b-ff52b990670f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:57.517316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce79d4-b4bb-41a0-9c5b-ff52b990670f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:57.532118 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1233/2508] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:02:57.533753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d098bde-4bef-4405-8f08-05787fbbcc6d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:57.544647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d098bde-4bef-4405-8f08-05787fbbcc6d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:57.553904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895e3ef-07c9-441a-a2e8-73fbb9302d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:57.555377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895e3ef-07c9-441a-a2e8-73fbb9302d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:57.555750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895e3ef-07c9-441a-a2e8-73fbb9302d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:57.555890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895e3ef-07c9-441a-a2e8-73fbb9302d71 admin admin] PATH_INFO: `/v3/projects/e9a4ea7457ed4f6f95cfce76fb27e6b9/users/155b8d908c584eb5bb885426a5fab177/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:57.573177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895e3ef-07c9-441a-a2e8-73fbb9302d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a4ea7457ed4f6f95cfce76fb27e6b9, user_id=155b8d908c584eb5bb885426a5fab177, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:57.575868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895e3ef-07c9-441a-a2e8-73fbb9302d71 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:57.592276 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1276/2509] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:02:57 2022] PUT /identity/v3/projects/e9a4ea7457ed4f6f95cfce76fb27e6b9/users/155b8d908c584eb5bb885426a5fab177/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:57.603189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf475f0-60c6-45fd-b83b-d25037ab6ce5 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:57.603524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf475f0-60c6-45fd-b83b-d25037ab6ce5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:57.603798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf475f0-60c6-45fd-b83b-d25037ab6ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:57.663226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-acf475f0-60c6-45fd-b83b-d25037ab6ce5 None None] MFA Rules not processed for user `155b8d908c584eb5bb885426a5fab177`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:57.664787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-acf475f0-60c6-45fd-b83b-d25037ab6ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:57.766603 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1234/2510] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:57.769129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895e3ef-07c9-441a-a2e8-73fbb9302d71 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:57.844814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895e3ef-07c9-441a-a2e8-73fbb9302d71 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:57.851267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b45fa7-dd77-499b-b100-0f5c4d20c416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:57.852721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b45fa7-dd77-499b-b100-0f5c4d20c416 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:57.853009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b45fa7-dd77-499b-b100-0f5c4d20c416 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:57.853304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b45fa7-dd77-499b-b100-0f5c4d20c416 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:57.854214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b45fa7-dd77-499b-b100-0f5c4d20c416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:57.856309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b45fa7-dd77-499b-b100-0f5c4d20c416 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:57.890110 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1277/2511] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:02:57 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:02:57.894272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf475f0-60c6-45fd-b83b-d25037ab6ce5 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:57.906352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf475f0-60c6-45fd-b83b-d25037ab6ce5 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:57.970496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10824752-45b1-4cd9-8b7a-443186ede7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:57.971249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10824752-45b1-4cd9-8b7a-443186ede7dc admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:57.971534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10824752-45b1-4cd9-8b7a-443186ede7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:57.971840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10824752-45b1-4cd9-8b7a-443186ede7dc admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:57.972636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10824752-45b1-4cd9-8b7a-443186ede7dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:57.974599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10824752-45b1-4cd9-8b7a-443186ede7dc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:57.999444 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1235/2512] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:02:57 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:02:58.000863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b45fa7-dd77-499b-b100-0f5c4d20c416 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:58.011889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b45fa7-dd77-499b-b100-0f5c4d20c416 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:58.017137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca407e5-0b0f-4700-bd13-58a36a170e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:58.017811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca407e5-0b0f-4700-bd13-58a36a170e5e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:58.018105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca407e5-0b0f-4700-bd13-58a36a170e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:58.018377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca407e5-0b0f-4700-bd13-58a36a170e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:58.019118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca407e5-0b0f-4700-bd13-58a36a170e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:58.021162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca407e5-0b0f-4700-bd13-58a36a170e5e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:58.035674 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1278/2513] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:02:58.036852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10824752-45b1-4cd9-8b7a-443186ede7dc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:58.048557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10824752-45b1-4cd9-8b7a-443186ede7dc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:58.054128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44260a4-61f2-426d-a167-7220094b8ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:58.056097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44260a4-61f2-426d-a167-7220094b8ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:58.056097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44260a4-61f2-426d-a167-7220094b8ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:58.056097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44260a4-61f2-426d-a167-7220094b8ce1 admin admin] PATH_INFO: `/v3/projects/aec11889f9f34f36b630d97595e50d77/users/5bf4c9c479ab41e2848e1d20dc55a1d3/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:58.072739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44260a4-61f2-426d-a167-7220094b8ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec11889f9f34f36b630d97595e50d77, user_id=5bf4c9c479ab41e2848e1d20dc55a1d3, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:58.075563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44260a4-61f2-426d-a167-7220094b8ce1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:58.105474 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1236/2514] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:02:58 2022] PUT /identity/v3/projects/aec11889f9f34f36b630d97595e50d77/users/5bf4c9c479ab41e2848e1d20dc55a1d3/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:58.109463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca407e5-0b0f-4700-bd13-58a36a170e5e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:58.120305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca407e5-0b0f-4700-bd13-58a36a170e5e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:58.204398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a49d03-f527-4f0b-8651-d5ac3b5ae360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:58.205749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a49d03-f527-4f0b-8651-d5ac3b5ae360 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:58.205749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a49d03-f527-4f0b-8651-d5ac3b5ae360 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:58.205749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a49d03-f527-4f0b-8651-d5ac3b5ae360 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:58.206336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a49d03-f527-4f0b-8651-d5ac3b5ae360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:58.208353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a49d03-f527-4f0b-8651-d5ac3b5ae360 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:58.214862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:58.224720 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1279/2515] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:02:58.225979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44260a4-61f2-426d-a167-7220094b8ce1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:58.234831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:58.240246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44260a4-61f2-426d-a167-7220094b8ce1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:58.247382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03ae3b-9f0a-48af-932e-a0aed2dc3f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:58.248945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03ae3b-9f0a-48af-932e-a0aed2dc3f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:58.248945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03ae3b-9f0a-48af-932e-a0aed2dc3f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:58.249492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03ae3b-9f0a-48af-932e-a0aed2dc3f72 admin admin] PATH_INFO: `/v3/projects/aec11889f9f34f36b630d97595e50d77/users/5bf4c9c479ab41e2848e1d20dc55a1d3/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:58.251914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03ae3b-9f0a-48af-932e-a0aed2dc3f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec11889f9f34f36b630d97595e50d77, user_id=5bf4c9c479ab41e2848e1d20dc55a1d3, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:58.254698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03ae3b-9f0a-48af-932e-a0aed2dc3f72 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:58.268524 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1237/2516] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:02:58 2022] PUT /identity/v3/projects/aec11889f9f34f36b630d97595e50d77/users/5bf4c9c479ab41e2848e1d20dc55a1d3/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:58.286413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ea99c-d16b-4981-b285-970bbf2964b6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:58.286683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ea99c-d16b-4981-b285-970bbf2964b6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:58.287033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ea99c-d16b-4981-b285-970bbf2964b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:58.318202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-670ea99c-d16b-4981-b285-970bbf2964b6 None None] MFA Rules not processed for user `5bf4c9c479ab41e2848e1d20dc55a1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:58.327295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-670ea99c-d16b-4981-b285-970bbf2964b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:58.409005 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1280/2517] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:58.433023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03ae3b-9f0a-48af-932e-a0aed2dc3f72 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:58.437601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-db03ae3b-9f0a-48af-932e-a0aed2dc3f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:58.553804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03ae3b-9f0a-48af-932e-a0aed2dc3f72 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:58.561467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b5875-8526-4d66-b529-55f7dea0748f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:58.562275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b5875-8526-4d66-b529-55f7dea0748f service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:58.562754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b5875-8526-4d66-b529-55f7dea0748f service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:58.563130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b5875-8526-4d66-b529-55f7dea0748f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:58.576078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b5875-8526-4d66-b529-55f7dea0748f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:58.577907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b5875-8526-4d66-b529-55f7dea0748f service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:58.595828 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1238/2518] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:58.654628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2360-b1d8-4d2d-93c0-029a8e6298f4 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:58.655658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2360-b1d8-4d2d-93c0-029a8e6298f4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:58.656452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2360-b1d8-4d2d-93c0-029a8e6298f4 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:58.659245 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1281/2519] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:02:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 21:02:58.664184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b5875-8526-4d66-b529-55f7dea0748f service nova] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:02:58.678133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b5875-8526-4d66-b529-55f7dea0748f service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:58.688704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b5875-8526-4d66-b529-55f7dea0748f service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:58.695202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda872cb-e364-406a-a530-b56532819c5a tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bf4c9c479ab41e2848e1d20dc55a1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aec11889f9f34f36b630d97595e50d77', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:58.696638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda872cb-e364-406a-a530-b56532819c5a tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:58.697586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda872cb-e364-406a-a530-b56532819c5a tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:58.697586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda872cb-e364-406a-a530-b56532819c5a tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] PATH_INFO: `/v3/projects/e9a4ea7457ed4f6f95cfce76fb27e6b9` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:58.699018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda872cb-e364-406a-a530-b56532819c5a tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] RBAC: Authorizing `identity:get_project(project_id=e9a4ea7457ed4f6f95cfce76fb27e6b9)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:58.701499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda872cb-e364-406a-a530-b56532819c5a tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:58.716568 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1239/2520] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:02:58 2022] GET /identity/v3/projects/e9a4ea7457ed4f6f95cfce76fb27e6b9 => generated 377 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:02:58.750457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd2360-b1d8-4d2d-93c0-029a8e6298f4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:58.767811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd2360-b1d8-4d2d-93c0-029a8e6298f4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:58.774547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c0de3-81c4-47ad-ad23-053d8ddddbb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:58.775363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c0de3-81c4-47ad-ad23-053d8ddddbb4 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:58.775840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c0de3-81c4-47ad-ad23-053d8ddddbb4 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:58.776243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c0de3-81c4-47ad-ad23-053d8ddddbb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:58.848384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c0de3-81c4-47ad-ad23-053d8ddddbb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:58.851335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c0de3-81c4-47ad-ad23-053d8ddddbb4 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:58.862042 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1282/2521] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:58.919736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c89573-fb07-48b5-850b-8210fb0bfe34 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:58.920020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c89573-fb07-48b5-850b-8210fb0bfe34 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:58.920337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c89573-fb07-48b5-850b-8210fb0bfe34 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:58.921890 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1240/2522] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:02:58.927291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c0de3-81c4-47ad-ad23-053d8ddddbb4 service nova] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:02:58.928906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4b3c0de3-81c4-47ad-ad23-053d8ddddbb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:58.944188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c0de3-81c4-47ad-ad23-053d8ddddbb4 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:58.955145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c0de3-81c4-47ad-ad23-053d8ddddbb4 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:58.960501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0ea1b-3b5d-4212-9fb8-f7307f7dc3d1 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bf4c9c479ab41e2848e1d20dc55a1d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aec11889f9f34f36b630d97595e50d77', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:58.961710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0ea1b-3b5d-4212-9fb8-f7307f7dc3d1 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:58.962000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0ea1b-3b5d-4212-9fb8-f7307f7dc3d1 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:58.962277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0ea1b-3b5d-4212-9fb8-f7307f7dc3d1 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] PATH_INFO: `/v3/projects/e9a4ea7457ed4f6f95cfce76fb27e6b9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:58.964127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0ea1b-3b5d-4212-9fb8-f7307f7dc3d1 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] RBAC: Authorizing `identity:get_project(project_id=e9a4ea7457ed4f6f95cfce76fb27e6b9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:58.966592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0ea1b-3b5d-4212-9fb8-f7307f7dc3d1 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:58.973968 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1283/2523] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:02:58 2022] GET /identity/v3/projects/e9a4ea7457ed4f6f95cfce76fb27e6b9 => generated 377 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:02:59.035942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5ed10-25b5-4f89-9fda-618a967a8a97 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:59.036464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5ed10-25b5-4f89-9fda-618a967a8a97 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:59.036574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5ed10-25b5-4f89-9fda-618a967a8a97 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:59.039060 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1241/2524] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:02:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:02:59.106914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555fc49-54ee-45c1-804e-2ccaa3edb1b2 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:59.107205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555fc49-54ee-45c1-804e-2ccaa3edb1b2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:59.107483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555fc49-54ee-45c1-804e-2ccaa3edb1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:59.133602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7555fc49-54ee-45c1-804e-2ccaa3edb1b2 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:59.135797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7555fc49-54ee-45c1-804e-2ccaa3edb1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:59.248074 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1284/2525] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:02:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:59.263216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5ed10-25b5-4f89-9fda-618a967a8a97 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:59.265094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-98c5ed10-25b5-4f89-9fda-618a967a8a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:59.281342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555fc49-54ee-45c1-804e-2ccaa3edb1b2 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:59.302452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:59.348183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5ed10-25b5-4f89-9fda-618a967a8a97 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:59.353369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601527c9-ad4d-402d-b986-ba3573fafa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:59.354523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601527c9-ad4d-402d-b986-ba3573fafa88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:59.354842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601527c9-ad4d-402d-b986-ba3573fafa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:59.355808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601527c9-ad4d-402d-b986-ba3573fafa88 admin admin] PATH_INFO: `/v3/users/e0cd53711ee245648bd3a2dc2c623cec` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:59.357760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601527c9-ad4d-402d-b986-ba3573fafa88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0cd53711ee245648bd3a2dc2c623cec)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:59.360401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601527c9-ad4d-402d-b986-ba3573fafa88 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:59.369330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555fc49-54ee-45c1-804e-2ccaa3edb1b2 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:59.374062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba574ff1-9754-4aaa-b7d1-ce7ee58d9703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:59.375074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba574ff1-9754-4aaa-b7d1-ce7ee58d9703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:59.375355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba574ff1-9754-4aaa-b7d1-ce7ee58d9703 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:59.375681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba574ff1-9754-4aaa-b7d1-ce7ee58d9703 admin admin] PATH_INFO: `/v3/users/155b8d908c584eb5bb885426a5fab177` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:59.376961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba574ff1-9754-4aaa-b7d1-ce7ee58d9703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=155b8d908c584eb5bb885426a5fab177)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:59.378921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba574ff1-9754-4aaa-b7d1-ce7ee58d9703 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:59.437747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-601527c9-ad4d-402d-b986-ba3573fafa88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0cd53711ee245648bd3a2dc2c623cec'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:59.449352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-601527c9-ad4d-402d-b986-ba3573fafa88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0cd53711ee245648bd3a2dc2c623cec'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:59.460267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-601527c9-ad4d-402d-b986-ba3573fafa88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0cd53711ee245648bd3a2dc2c623cec'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:59.461084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-601527c9-ad4d-402d-b986-ba3573fafa88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0cd53711ee245648bd3a2dc2c623cec'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:59.461720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-601527c9-ad4d-402d-b986-ba3573fafa88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0cd53711ee245648bd3a2dc2c623cec'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:59.465900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba574ff1-9754-4aaa-b7d1-ce7ee58d9703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '155b8d908c584eb5bb885426a5fab177'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:59.469823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:59.479891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba574ff1-9754-4aaa-b7d1-ce7ee58d9703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '155b8d908c584eb5bb885426a5fab177'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:59.482900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba574ff1-9754-4aaa-b7d1-ce7ee58d9703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '155b8d908c584eb5bb885426a5fab177'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:59.484882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba574ff1-9754-4aaa-b7d1-ce7ee58d9703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '155b8d908c584eb5bb885426a5fab177'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:59.497742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba574ff1-9754-4aaa-b7d1-ce7ee58d9703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '155b8d908c584eb5bb885426a5fab177'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:02:59.499159 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1242/2526] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:02:59 2022] DELETE /identity/v3/users/e0cd53711ee245648bd3a2dc2c623cec => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:02:59.500258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601527c9-ad4d-402d-b986-ba3573fafa88 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:59.502262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-601527c9-ad4d-402d-b986-ba3573fafa88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:59.528796 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1285/2527] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:02:59 2022] DELETE /identity/v3/users/155b8d908c584eb5bb885426a5fab177 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:02:59.535232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fd149-9183-45e6-8f23-49918e21261f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:59.535525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fd149-9183-45e6-8f23-49918e21261f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:59.536099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fd149-9183-45e6-8f23-49918e21261f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:59.566077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d01fd149-9183-45e6-8f23-49918e21261f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:02:59.567670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d01fd149-9183-45e6-8f23-49918e21261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:59.600838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601527c9-ad4d-402d-b986-ba3573fafa88 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:59.667908 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1286/2528] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:02:59.703708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e23fd-c749-46d4-ad05-aeb438236030 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:59.705046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e23fd-c749-46d4-ad05-aeb438236030 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:59.705412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e23fd-c749-46d4-ad05-aeb438236030 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:59.705906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e23fd-c749-46d4-ad05-aeb438236030 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:59.709454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0a4e23fd-c749-46d4-ad05-aeb438236030 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:59.711119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fd149-9183-45e6-8f23-49918e21261f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:02:59.713077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d01fd149-9183-45e6-8f23-49918e21261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:02:59.736277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e23fd-c749-46d4-ad05-aeb438236030 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:59.739139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e23fd-c749-46d4-ad05-aeb438236030 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:59.762076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:59.765802 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1243/2529] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:59.809922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fd149-9183-45e6-8f23-49918e21261f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:02:59.814745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548ec2c-c319-4293-ad6c-475bf35fe826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:02:59.815925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548ec2c-c319-4293-ad6c-475bf35fe826 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:02:59.816258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548ec2c-c319-4293-ad6c-475bf35fe826 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:02:59.816539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548ec2c-c319-4293-ad6c-475bf35fe826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:02:59.837867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548ec2c-c319-4293-ad6c-475bf35fe826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:02:59.850443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548ec2c-c319-4293-ad6c-475bf35fe826 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:02:59.867748 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1287/2530] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:03:00.215767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e23fd-c749-46d4-ad05-aeb438236030 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:00.217284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0a4e23fd-c749-46d4-ad05-aeb438236030 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:00.230943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e23fd-c749-46d4-ad05-aeb438236030 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:00.240763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552a809-b57a-43f3-bfde-43a0162ac95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:00.241781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552a809-b57a-43f3-bfde-43a0162ac95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:00.242212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552a809-b57a-43f3-bfde-43a0162ac95b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:00.243507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552a809-b57a-43f3-bfde-43a0162ac95b admin admin] PATH_INFO: `/v3/projects/83e6c81cb2214f458e3a20263c279b0e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:00.244902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552a809-b57a-43f3-bfde-43a0162ac95b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83e6c81cb2214f458e3a20263c279b0e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:00.247441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552a809-b57a-43f3-bfde-43a0162ac95b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:00.323210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e552a809-b57a-43f3-bfde-43a0162ac95b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83e6c81cb2214f458e3a20263c279b0e', 'request_id': 'req-e552a809-b57a-43f3-bfde-43a0162ac95b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:00.348577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e552a809-b57a-43f3-bfde-43a0162ac95b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83e6c81cb2214f458e3a20263c279b0e', 'request_id': 'req-e552a809-b57a-43f3-bfde-43a0162ac95b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:00.360229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e552a809-b57a-43f3-bfde-43a0162ac95b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83e6c81cb2214f458e3a20263c279b0e', 'request_id': 'req-e552a809-b57a-43f3-bfde-43a0162ac95b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:00.379143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:00.386151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e552a809-b57a-43f3-bfde-43a0162ac95b admin admin] The token cache is being invalidate because project 83e6c81cb2214f458e3a20263c279b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:03:00.386534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e552a809-b57a-43f3-bfde-43a0162ac95b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:00.387347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e552a809-b57a-43f3-bfde-43a0162ac95b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:00.390957 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1244/2531] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:03:00 2022] DELETE /identity/v3/projects/83e6c81cb2214f458e3a20263c279b0e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:00.401601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46afe16-2bfa-4f09-91f5-912ad66b470c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:00.401959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46afe16-2bfa-4f09-91f5-912ad66b470c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:00.402302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46afe16-2bfa-4f09-91f5-912ad66b470c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:00.449679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b46afe16-2bfa-4f09-91f5-912ad66b470c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:00.461045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b46afe16-2bfa-4f09-91f5-912ad66b470c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:00.572735 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1288/2532] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:00.582936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f5332-360b-436c-af1b-776ba68d9bb9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:00.585584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f5332-360b-436c-af1b-776ba68d9bb9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:00.586429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f5332-360b-436c-af1b-776ba68d9bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:00.646674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-324f5332-360b-436c-af1b-776ba68d9bb9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:00.649973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-324f5332-360b-436c-af1b-776ba68d9bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:00.665341 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1245/2533] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:00.668436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46afe16-2bfa-4f09-91f5-912ad66b470c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:00.686109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46afe16-2bfa-4f09-91f5-912ad66b470c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:00.694711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8fcaa-063b-4572-a9b3-9efc1cb71862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:00.695798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8fcaa-063b-4572-a9b3-9efc1cb71862 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:00.696963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8fcaa-063b-4572-a9b3-9efc1cb71862 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:00.697399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8fcaa-063b-4572-a9b3-9efc1cb71862 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:00.699753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8fcaa-063b-4572-a9b3-9efc1cb71862 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:03:00.701522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8fcaa-063b-4572-a9b3-9efc1cb71862 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:00.705132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8fcaa-063b-4572-a9b3-9efc1cb71862 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:00.725340 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1289/2534] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:03:00.730253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f5332-360b-436c-af1b-776ba68d9bb9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:00.756522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f5332-360b-436c-af1b-776ba68d9bb9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:00.775808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b71f5-9bc3-49fd-ae9e-6360fc70d5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:00.777411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b71f5-9bc3-49fd-ae9e-6360fc70d5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:00.777954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b71f5-9bc3-49fd-ae9e-6360fc70d5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:00.778548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b71f5-9bc3-49fd-ae9e-6360fc70d5b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:00.780467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b71f5-9bc3-49fd-ae9e-6360fc70d5b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:00.784000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b71f5-9bc3-49fd-ae9e-6360fc70d5b6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:00.841897 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1246/2535] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:03:00 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:00.842659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8fcaa-063b-4572-a9b3-9efc1cb71862 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:00.843223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b71f5-9bc3-49fd-ae9e-6360fc70d5b6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:00.844909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d1c8fcaa-063b-4572-a9b3-9efc1cb71862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:00.885503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8fcaa-063b-4572-a9b3-9efc1cb71862 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:00.960494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b71f5-9bc3-49fd-ae9e-6360fc70d5b6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:00.975878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814f0e3-c108-4fd0-b7f8-5b50cf5cd949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:00.976962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814f0e3-c108-4fd0-b7f8-5b50cf5cd949 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:00.978238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814f0e3-c108-4fd0-b7f8-5b50cf5cd949 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:00.979334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814f0e3-c108-4fd0-b7f8-5b50cf5cd949 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:00.983760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814f0e3-c108-4fd0-b7f8-5b50cf5cd949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:00.986120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814f0e3-c108-4fd0-b7f8-5b50cf5cd949 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:01.029790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8b9e8-31cd-4c97-93f3-7fdf4d83bdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:01.031123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8b9e8-31cd-4c97-93f3-7fdf4d83bdda admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:01.031421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8b9e8-31cd-4c97-93f3-7fdf4d83bdda admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:01.031827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8b9e8-31cd-4c97-93f3-7fdf4d83bdda admin admin] PATH_INFO: `/v3/projects/e9a4ea7457ed4f6f95cfce76fb27e6b9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:01.034138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8b9e8-31cd-4c97-93f3-7fdf4d83bdda admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a4ea7457ed4f6f95cfce76fb27e6b9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:01.038381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8b9e8-31cd-4c97-93f3-7fdf4d83bdda admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:01.038553 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1247/2536] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:03:00 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:01.041127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814f0e3-c108-4fd0-b7f8-5b50cf5cd949 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:01.084753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814f0e3-c108-4fd0-b7f8-5b50cf5cd949 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:01.096321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fef9d5-5989-4783-8660-532e90c66245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:01.100026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fef9d5-5989-4783-8660-532e90c66245 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:01.100592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fef9d5-5989-4783-8660-532e90c66245 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:01.100998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fef9d5-5989-4783-8660-532e90c66245 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:01.102911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fef9d5-5989-4783-8660-532e90c66245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:01.109099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fef9d5-5989-4783-8660-532e90c66245 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:01.129122 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1248/2537] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:03:01.130315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fef9d5-5989-4783-8660-532e90c66245 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:01.154755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fef9d5-5989-4783-8660-532e90c66245 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:01.165240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0af8b9e8-31cd-4c97-93f3-7fdf4d83bdda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a4ea7457ed4f6f95cfce76fb27e6b9', 'request_id': 'req-0af8b9e8-31cd-4c97-93f3-7fdf4d83bdda'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:01.179841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0af8b9e8-31cd-4c97-93f3-7fdf4d83bdda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a4ea7457ed4f6f95cfce76fb27e6b9', 'request_id': 'req-0af8b9e8-31cd-4c97-93f3-7fdf4d83bdda'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:01.196562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0af8b9e8-31cd-4c97-93f3-7fdf4d83bdda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a4ea7457ed4f6f95cfce76fb27e6b9', 'request_id': 'req-0af8b9e8-31cd-4c97-93f3-7fdf4d83bdda'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:01.202001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:01.228559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0af8b9e8-31cd-4c97-93f3-7fdf4d83bdda admin admin] The token cache is being invalidate because project e9a4ea7457ed4f6f95cfce76fb27e6b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:03:01.228986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0af8b9e8-31cd-4c97-93f3-7fdf4d83bdda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:01.229963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0af8b9e8-31cd-4c97-93f3-7fdf4d83bdda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:01.232007 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1290/2538] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:03:00 2022] DELETE /identity/v3/projects/e9a4ea7457ed4f6f95cfce76fb27e6b9 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:01.237065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8b9e8-31cd-4c97-93f3-7fdf4d83bdda admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:01.242937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0af8b9e8-31cd-4c97-93f3-7fdf4d83bdda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:01.259292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42accb3b-b873-4330-bd59-222288632cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:01.262135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42accb3b-b873-4330-bd59-222288632cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:01.265070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42accb3b-b873-4330-bd59-222288632cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:01.265493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42accb3b-b873-4330-bd59-222288632cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:01.266428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42accb3b-b873-4330-bd59-222288632cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:01.268239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42accb3b-b873-4330-bd59-222288632cf4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:01.303379 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1249/2539] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:03:01.305143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42accb3b-b873-4330-bd59-222288632cf4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:01.308345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-42accb3b-b873-4330-bd59-222288632cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:01.326542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42accb3b-b873-4330-bd59-222288632cf4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:01.339223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61d040-0bd4-4146-be74-1c64fd2f4a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:01.341103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61d040-0bd4-4146-be74-1c64fd2f4a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:01.341103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61d040-0bd4-4146-be74-1c64fd2f4a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:01.341575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61d040-0bd4-4146-be74-1c64fd2f4a37 admin admin] PATH_INFO: `/v3/projects/63b8773841e44baab20aa0677e027de7/users/45991293f65c4c22a91afa74cf8179ce/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:01.378176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61d040-0bd4-4146-be74-1c64fd2f4a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b8773841e44baab20aa0677e027de7, user_id=45991293f65c4c22a91afa74cf8179ce, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:01.388729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61d040-0bd4-4146-be74-1c64fd2f4a37 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:01.419603 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1250/2540] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:03:01 2022] PUT /identity/v3/projects/63b8773841e44baab20aa0677e027de7/users/45991293f65c4c22a91afa74cf8179ce/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:01.425461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53533dec-fa19-4a9c-a897-8a88249433fb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:01.425979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53533dec-fa19-4a9c-a897-8a88249433fb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:01.426267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53533dec-fa19-4a9c-a897-8a88249433fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:01.443245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8b9e8-31cd-4c97-93f3-7fdf4d83bdda admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:01.468145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-53533dec-fa19-4a9c-a897-8a88249433fb None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:01.482052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-53533dec-fa19-4a9c-a897-8a88249433fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:01.529057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:01.603447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcde369-9140-4763-b2fd-e40373b3237f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:01.606338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcde369-9140-4763-b2fd-e40373b3237f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:01.608729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcde369-9140-4763-b2fd-e40373b3237f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:01.608729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcde369-9140-4763-b2fd-e40373b3237f admin admin] PATH_INFO: `/v3/users/5bf4c9c479ab41e2848e1d20dc55a1d3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:01.610567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcde369-9140-4763-b2fd-e40373b3237f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf4c9c479ab41e2848e1d20dc55a1d3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:01.613524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcde369-9140-4763-b2fd-e40373b3237f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:01.646626 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1251/2541] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:01.663333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53533dec-fa19-4a9c-a897-8a88249433fb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:01.665319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-53533dec-fa19-4a9c-a897-8a88249433fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:01.725936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8fcde369-9140-4763-b2fd-e40373b3237f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf4c9c479ab41e2848e1d20dc55a1d3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:01.740962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8fcde369-9140-4763-b2fd-e40373b3237f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf4c9c479ab41e2848e1d20dc55a1d3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:01.742239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8fcde369-9140-4763-b2fd-e40373b3237f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf4c9c479ab41e2848e1d20dc55a1d3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:01.744557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8fcde369-9140-4763-b2fd-e40373b3237f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf4c9c479ab41e2848e1d20dc55a1d3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:01.771857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8fcde369-9140-4763-b2fd-e40373b3237f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf4c9c479ab41e2848e1d20dc55a1d3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:01.799237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53533dec-fa19-4a9c-a897-8a88249433fb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:01.800219 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1291/2542] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:03:01 2022] DELETE /identity/v3/users/5bf4c9c479ab41e2848e1d20dc55a1d3 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:01.878882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756659cd-57cc-4df6-b4b5-cfbf08c31cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:01.879714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756659cd-57cc-4df6-b4b5-cfbf08c31cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:01.880140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756659cd-57cc-4df6-b4b5-cfbf08c31cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:01.880521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756659cd-57cc-4df6-b4b5-cfbf08c31cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:01.883138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-756659cd-57cc-4df6-b4b5-cfbf08c31cd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:01.987355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756659cd-57cc-4df6-b4b5-cfbf08c31cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:01.989011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756659cd-57cc-4df6-b4b5-cfbf08c31cd2 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:02.009766 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1252/2543] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:03:03.021354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcde369-9140-4763-b2fd-e40373b3237f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:03.022838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8fcde369-9140-4763-b2fd-e40373b3237f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:03.051349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcde369-9140-4763-b2fd-e40373b3237f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:03.062429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a8790-8ff0-4470-9477-9ff7fd0848ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:03.063407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a8790-8ff0-4470-9477-9ff7fd0848ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:03.064243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a8790-8ff0-4470-9477-9ff7fd0848ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:03.064526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a8790-8ff0-4470-9477-9ff7fd0848ba admin admin] PATH_INFO: `/v3/projects/aec11889f9f34f36b630d97595e50d77` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:03.069551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a8790-8ff0-4470-9477-9ff7fd0848ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=aec11889f9f34f36b630d97595e50d77)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:03.071563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a8790-8ff0-4470-9477-9ff7fd0848ba admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:03.101789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:03.166339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-172a8790-8ff0-4470-9477-9ff7fd0848ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec11889f9f34f36b630d97595e50d77', 'request_id': 'req-172a8790-8ff0-4470-9477-9ff7fd0848ba'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:03.180093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-172a8790-8ff0-4470-9477-9ff7fd0848ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec11889f9f34f36b630d97595e50d77', 'request_id': 'req-172a8790-8ff0-4470-9477-9ff7fd0848ba'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:03.188851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-172a8790-8ff0-4470-9477-9ff7fd0848ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec11889f9f34f36b630d97595e50d77', 'request_id': 'req-172a8790-8ff0-4470-9477-9ff7fd0848ba'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:03.203980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-172a8790-8ff0-4470-9477-9ff7fd0848ba admin admin] The token cache is being invalidate because project aec11889f9f34f36b630d97595e50d77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:03:03.204380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-172a8790-8ff0-4470-9477-9ff7fd0848ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:03.205169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-172a8790-8ff0-4470-9477-9ff7fd0848ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:03.207735 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1292/2544] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:03:03 2022] DELETE /identity/v3/projects/aec11889f9f34f36b630d97595e50d77 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:03.213637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e2741-c50e-44a0-af86-e7c0d3081d5e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:03.214392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e2741-c50e-44a0-af86-e7c0d3081d5e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:03.214839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e2741-c50e-44a0-af86-e7c0d3081d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:03.235332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f62e2741-c50e-44a0-af86-e7c0d3081d5e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:03.237298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f62e2741-c50e-44a0-af86-e7c0d3081d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:03.275480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:03.333586 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1253/2545] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:03:03.342481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3b240-506c-44ec-9440-245ee08731fb None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:03.342854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3b240-506c-44ec-9440-245ee08731fb None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:03.343225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3b240-506c-44ec-9440-245ee08731fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:03.379684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b7e3b240-506c-44ec-9440-245ee08731fb None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:03.385623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b7e3b240-506c-44ec-9440-245ee08731fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:03.411328 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1293/2546] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:03.415826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e2741-c50e-44a0-af86-e7c0d3081d5e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:03.429443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e2741-c50e-44a0-af86-e7c0d3081d5e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:03.434262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2311f-be25-40b4-a416-134a1c5f677c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:03.435423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2311f-be25-40b4-a416-134a1c5f677c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:03.435696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2311f-be25-40b4-a416-134a1c5f677c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:03.436059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2311f-be25-40b4-a416-134a1c5f677c admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:03.437472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2311f-be25-40b4-a416-134a1c5f677c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:03:03.437870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2311f-be25-40b4-a416-134a1c5f677c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:03.439530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2311f-be25-40b4-a416-134a1c5f677c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:03.461138 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1254/2547] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:03:03.462679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3b240-506c-44ec-9440-245ee08731fb None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:03.475074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3b240-506c-44ec-9440-245ee08731fb None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:03.481806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81deacfb-6c24-4531-8489-67d1b0052a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:03.482802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81deacfb-6c24-4531-8489-67d1b0052a29 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:03.483327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81deacfb-6c24-4531-8489-67d1b0052a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:03.483814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81deacfb-6c24-4531-8489-67d1b0052a29 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:03.485101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81deacfb-6c24-4531-8489-67d1b0052a29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:03.487817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81deacfb-6c24-4531-8489-67d1b0052a29 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:03.535900 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1294/2548] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:03:03 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:03.537085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2311f-be25-40b4-a416-134a1c5f677c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:03.554229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2311f-be25-40b4-a416-134a1c5f677c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:03.668357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f265d3-a591-4bdb-89b1-f32531206df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:03.669522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f265d3-a591-4bdb-89b1-f32531206df9 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:03.670009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f265d3-a591-4bdb-89b1-f32531206df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:03.670384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f265d3-a591-4bdb-89b1-f32531206df9 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:03.671194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f265d3-a591-4bdb-89b1-f32531206df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:03.673757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f265d3-a591-4bdb-89b1-f32531206df9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:03.728244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81deacfb-6c24-4531-8489-67d1b0052a29 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:03.741054 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1255/2549] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:03:03 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:03.744873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81deacfb-6c24-4531-8489-67d1b0052a29 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:03.753301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78c249-fa44-43fd-b035-3756a78381e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:03.754101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78c249-fa44-43fd-b035-3756a78381e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:03.754390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78c249-fa44-43fd-b035-3756a78381e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:03.754770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78c249-fa44-43fd-b035-3756a78381e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:03.755504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78c249-fa44-43fd-b035-3756a78381e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:03.758345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78c249-fa44-43fd-b035-3756a78381e8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:03.788426 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1295/2550] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:03:03.791560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f265d3-a591-4bdb-89b1-f32531206df9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:03.813706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f265d3-a591-4bdb-89b1-f32531206df9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:03.824961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204252aa-e72a-499f-b077-3cdc522a643b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:03.825809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204252aa-e72a-499f-b077-3cdc522a643b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:03.826737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204252aa-e72a-499f-b077-3cdc522a643b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:03.827029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204252aa-e72a-499f-b077-3cdc522a643b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:03.829655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204252aa-e72a-499f-b077-3cdc522a643b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:03.833036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204252aa-e72a-499f-b077-3cdc522a643b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:03.857301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78c249-fa44-43fd-b035-3756a78381e8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:03.870536 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1256/2551] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:03:03.871643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78c249-fa44-43fd-b035-3756a78381e8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:03.877188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6ea9c-56ab-4725-b23a-8ce3d74e04b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:03.877973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6ea9c-56ab-4725-b23a-8ce3d74e04b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:03.879256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6ea9c-56ab-4725-b23a-8ce3d74e04b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:03.879256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6ea9c-56ab-4725-b23a-8ce3d74e04b6 admin admin] PATH_INFO: `/v3/projects/f5b51168214242c293747b7bf732272d/users/1a33cd6c279a484cb0e1fbb6f5275470/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:03.903206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6ea9c-56ab-4725-b23a-8ce3d74e04b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b51168214242c293747b7bf732272d, user_id=1a33cd6c279a484cb0e1fbb6f5275470, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:03.908169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6ea9c-56ab-4725-b23a-8ce3d74e04b6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:03.936441 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1296/2552] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:03:03 2022] PUT /identity/v3/projects/f5b51168214242c293747b7bf732272d/users/1a33cd6c279a484cb0e1fbb6f5275470/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:03.939846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d01bd-2f45-4fcb-9d4d-5b84fa0cc5d6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:03.940157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d01bd-2f45-4fcb-9d4d-5b84fa0cc5d6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:03.940521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d01bd-2f45-4fcb-9d4d-5b84fa0cc5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:03.983935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-950d01bd-2f45-4fcb-9d4d-5b84fa0cc5d6 None None] MFA Rules not processed for user `1a33cd6c279a484cb0e1fbb6f5275470`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:03.985056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-950d01bd-2f45-4fcb-9d4d-5b84fa0cc5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:04.130308 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1257/2553] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:04.132790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6ea9c-56ab-4725-b23a-8ce3d74e04b6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:04.270150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6ea9c-56ab-4725-b23a-8ce3d74e04b6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:04.287132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7567a2-c08a-4f06-951a-359210f98e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:04.287865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7567a2-c08a-4f06-951a-359210f98e01 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:04.288184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7567a2-c08a-4f06-951a-359210f98e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:04.288677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7567a2-c08a-4f06-951a-359210f98e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:04.289462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7567a2-c08a-4f06-951a-359210f98e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:04.292673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7567a2-c08a-4f06-951a-359210f98e01 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:04.335250 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1297/2554] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:03:04 2022] POST /identity/v3/projects => generated 389 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:04.339728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d01bd-2f45-4fcb-9d4d-5b84fa0cc5d6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:04.354672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d01bd-2f45-4fcb-9d4d-5b84fa0cc5d6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:04.402791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:04.462784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b57b57-13b6-46f6-a40f-352ad757c011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:04.464712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b57b57-13b6-46f6-a40f-352ad757c011 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:04.464894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b57b57-13b6-46f6-a40f-352ad757c011 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:04.465173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b57b57-13b6-46f6-a40f-352ad757c011 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:04.465876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b57b57-13b6-46f6-a40f-352ad757c011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:04.467813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b57b57-13b6-46f6-a40f-352ad757c011 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:04.509034 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1258/2555] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:03:04 2022] POST /identity/v3/users => generated 301 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:04.515264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7567a2-c08a-4f06-951a-359210f98e01 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:04.533615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7567a2-c08a-4f06-951a-359210f98e01 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:04.543802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f712cc-26d6-4bcf-94ae-03a1888836bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:04.544779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f712cc-26d6-4bcf-94ae-03a1888836bf admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:04.545692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f712cc-26d6-4bcf-94ae-03a1888836bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:04.546180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f712cc-26d6-4bcf-94ae-03a1888836bf admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:04.571085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f712cc-26d6-4bcf-94ae-03a1888836bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:04.575304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f712cc-26d6-4bcf-94ae-03a1888836bf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:04.610751 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1298/2556] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:03:04.615452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b57b57-13b6-46f6-a40f-352ad757c011 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:04.631064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b57b57-13b6-46f6-a40f-352ad757c011 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:04.648993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0e42a-3656-48cf-a91a-23de1d2aeb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:04.652383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0e42a-3656-48cf-a91a-23de1d2aeb30 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:04.653060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0e42a-3656-48cf-a91a-23de1d2aeb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:04.653796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0e42a-3656-48cf-a91a-23de1d2aeb30 admin admin] PATH_INFO: `/v3/projects/dfe9fb969f744191b6062e5403c99233/users/30201a4ea6a94c3bb49adccc556159fc/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:04.719781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0e42a-3656-48cf-a91a-23de1d2aeb30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe9fb969f744191b6062e5403c99233, user_id=30201a4ea6a94c3bb49adccc556159fc, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:04.723248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0e42a-3656-48cf-a91a-23de1d2aeb30 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:04.762408 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1259/2557] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:03:04 2022] PUT /identity/v3/projects/dfe9fb969f744191b6062e5403c99233/users/30201a4ea6a94c3bb49adccc556159fc/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:04.762934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f712cc-26d6-4bcf-94ae-03a1888836bf admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:04.787659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f712cc-26d6-4bcf-94ae-03a1888836bf admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:04.802271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:04.904251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1736fd-c31b-4f7d-b0a3-0936b43c03e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:04.935044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1736fd-c31b-4f7d-b0a3-0936b43c03e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:04.936931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1736fd-c31b-4f7d-b0a3-0936b43c03e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:04.940176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1736fd-c31b-4f7d-b0a3-0936b43c03e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:04.943843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1736fd-c31b-4f7d-b0a3-0936b43c03e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:04.948176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1736fd-c31b-4f7d-b0a3-0936b43c03e0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:04.969854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0e42a-3656-48cf-a91a-23de1d2aeb30 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:04.975932 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1299/2558] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:03:04.989602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0e42a-3656-48cf-a91a-23de1d2aeb30 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:04.996322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53993fbe-4015-47f5-9c40-e612f688e2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:04.998696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53993fbe-4015-47f5-9c40-e612f688e2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:04.999084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53993fbe-4015-47f5-9c40-e612f688e2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:05.001779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53993fbe-4015-47f5-9c40-e612f688e2a0 admin admin] PATH_INFO: `/v3/projects/dfe9fb969f744191b6062e5403c99233/users/30201a4ea6a94c3bb49adccc556159fc/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:05.005534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53993fbe-4015-47f5-9c40-e612f688e2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe9fb969f744191b6062e5403c99233, user_id=30201a4ea6a94c3bb49adccc556159fc, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:05.008514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53993fbe-4015-47f5-9c40-e612f688e2a0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:05.047425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16bd0e-6ad6-4bf2-89da-e82a068ed9e1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:05.048007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16bd0e-6ad6-4bf2-89da-e82a068ed9e1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:05.048441 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1260/2559] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:03:04 2022] PUT /identity/v3/projects/dfe9fb969f744191b6062e5403c99233/users/30201a4ea6a94c3bb49adccc556159fc/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:05.048762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16bd0e-6ad6-4bf2-89da-e82a068ed9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:05.093863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ae16bd0e-6ad6-4bf2-89da-e82a068ed9e1 None None] MFA Rules not processed for user `30201a4ea6a94c3bb49adccc556159fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:05.093863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ae16bd0e-6ad6-4bf2-89da-e82a068ed9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:05.267426 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1300/2560] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:03:05.345164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53993fbe-4015-47f5-9c40-e612f688e2a0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:05.348667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-53993fbe-4015-47f5-9c40-e612f688e2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:05.538631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53993fbe-4015-47f5-9c40-e612f688e2a0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:05.545166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf59cd-76e1-4f80-a9a0-a8b6f5754de7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:05.545966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf59cd-76e1-4f80-a9a0-a8b6f5754de7 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:05.546247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf59cd-76e1-4f80-a9a0-a8b6f5754de7 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:05.546522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf59cd-76e1-4f80-a9a0-a8b6f5754de7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:05.560929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf59cd-76e1-4f80-a9a0-a8b6f5754de7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:05.579438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf59cd-76e1-4f80-a9a0-a8b6f5754de7 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:05.596675 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1261/2561] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:03:05.670821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16bd0e-6ad6-4bf2-89da-e82a068ed9e1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:05.672624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ae16bd0e-6ad6-4bf2-89da-e82a068ed9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:05.719982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16bd0e-6ad6-4bf2-89da-e82a068ed9e1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:05.734105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73d370-b0fa-4428-a13c-fa654e32f221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:05.736597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73d370-b0fa-4428-a13c-fa654e32f221 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:05.738356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73d370-b0fa-4428-a13c-fa654e32f221 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:05.739388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73d370-b0fa-4428-a13c-fa654e32f221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:06.117114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73d370-b0fa-4428-a13c-fa654e32f221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:06.119106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73d370-b0fa-4428-a13c-fa654e32f221 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:06.130600 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1301/2562] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:03:07.378626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e77c37-cf77-4f5f-8e53-4477e6a0d341 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:07.379254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e77c37-cf77-4f5f-8e53-4477e6a0d341 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:07.379254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e77c37-cf77-4f5f-8e53-4477e6a0d341 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:07.381040 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1262/2563] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:03:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:03:07.387642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46758983-09e0-4cfb-9d13-e9bb20f7fb5a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:07.389244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46758983-09e0-4cfb-9d13-e9bb20f7fb5a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:07.389781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46758983-09e0-4cfb-9d13-e9bb20f7fb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:07.431570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-46758983-09e0-4cfb-9d13-e9bb20f7fb5a None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:07.432980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-46758983-09e0-4cfb-9d13-e9bb20f7fb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:07.511593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:07.606351 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1302/2564] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:03:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:07.614124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e77c37-cf77-4f5f-8e53-4477e6a0d341 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:07.616214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d7e77c37-cf77-4f5f-8e53-4477e6a0d341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:07.645693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e77c37-cf77-4f5f-8e53-4477e6a0d341 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:07.672432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01b9e6-67a2-4a36-b812-c3b4e81d8d75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:07.673310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01b9e6-67a2-4a36-b812-c3b4e81d8d75 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:07.674805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01b9e6-67a2-4a36-b812-c3b4e81d8d75 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:07.675425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01b9e6-67a2-4a36-b812-c3b4e81d8d75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:07.707210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01b9e6-67a2-4a36-b812-c3b4e81d8d75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:07.707210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01b9e6-67a2-4a36-b812-c3b4e81d8d75 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:07.770794 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1263/2565] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:03:08.318598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46758983-09e0-4cfb-9d13-e9bb20f7fb5a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:08.325459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-46758983-09e0-4cfb-9d13-e9bb20f7fb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:08.471506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46758983-09e0-4cfb-9d13-e9bb20f7fb5a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:08.481014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70173e0-bdd5-43f3-8112-a82f83f6d360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:08.481950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70173e0-bdd5-43f3-8112-a82f83f6d360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:08.482299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70173e0-bdd5-43f3-8112-a82f83f6d360 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:08.482638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70173e0-bdd5-43f3-8112-a82f83f6d360 admin admin] PATH_INFO: `/v3/users/6bba4a354d6c42048145b2163549dc65` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:08.483987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70173e0-bdd5-43f3-8112-a82f83f6d360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bba4a354d6c42048145b2163549dc65)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:08.486111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70173e0-bdd5-43f3-8112-a82f83f6d360 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:08.544272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e70173e0-bdd5-43f3-8112-a82f83f6d360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bba4a354d6c42048145b2163549dc65'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:08.560807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e70173e0-bdd5-43f3-8112-a82f83f6d360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bba4a354d6c42048145b2163549dc65'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:08.561709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e70173e0-bdd5-43f3-8112-a82f83f6d360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bba4a354d6c42048145b2163549dc65'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:08.562682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e70173e0-bdd5-43f3-8112-a82f83f6d360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bba4a354d6c42048145b2163549dc65'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:08.570252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e70173e0-bdd5-43f3-8112-a82f83f6d360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bba4a354d6c42048145b2163549dc65'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:08.589033 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1303/2566] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:03:08 2022] DELETE /identity/v3/users/6bba4a354d6c42048145b2163549dc65 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:08.862775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01b9e6-67a2-4a36-b812-c3b4e81d8d75 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:08.879320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563f378-67fa-4c8f-8251-a33f8085c026 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:08.880176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563f378-67fa-4c8f-8251-a33f8085c026 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:08.880633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563f378-67fa-4c8f-8251-a33f8085c026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:08.884350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01b9e6-67a2-4a36-b812-c3b4e81d8d75 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:08.948955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4563f378-67fa-4c8f-8251-a33f8085c026 None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:08.952206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4563f378-67fa-4c8f-8251-a33f8085c026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:08.985163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:09.026832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a7b85-2846-4853-9ca3-68a985f2984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:09.027730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a7b85-2846-4853-9ca3-68a985f2984a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:09.028006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a7b85-2846-4853-9ca3-68a985f2984a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:09.028633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a7b85-2846-4853-9ca3-68a985f2984a admin admin] PATH_INFO: `/v3/projects/179257c7585f48aaa243914298831528` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:09.031662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a7b85-2846-4853-9ca3-68a985f2984a admin admin] RBAC: Authorizing `identity:delete_project(project_id=179257c7585f48aaa243914298831528)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:09.034929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a7b85-2846-4853-9ca3-68a985f2984a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:09.055452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:09.103368 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1304/2567] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:03:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:03:09.115150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563f378-67fa-4c8f-8251-a33f8085c026 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:09.116981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4563f378-67fa-4c8f-8251-a33f8085c026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:09.162655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bf2a7b85-2846-4853-9ca3-68a985f2984a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '179257c7585f48aaa243914298831528', 'request_id': 'req-bf2a7b85-2846-4853-9ca3-68a985f2984a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:09.187942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bf2a7b85-2846-4853-9ca3-68a985f2984a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '179257c7585f48aaa243914298831528', 'request_id': 'req-bf2a7b85-2846-4853-9ca3-68a985f2984a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:09.196983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bf2a7b85-2846-4853-9ca3-68a985f2984a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '179257c7585f48aaa243914298831528', 'request_id': 'req-bf2a7b85-2846-4853-9ca3-68a985f2984a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:09.217290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563f378-67fa-4c8f-8251-a33f8085c026 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:09.223184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bf2a7b85-2846-4853-9ca3-68a985f2984a admin admin] The token cache is being invalidate because project 179257c7585f48aaa243914298831528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:03:09.223619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bf2a7b85-2846-4853-9ca3-68a985f2984a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:09.226650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bf2a7b85-2846-4853-9ca3-68a985f2984a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:09.230887 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1264/2568] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:03:08 2022] DELETE /identity/v3/projects/179257c7585f48aaa243914298831528 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:09.235443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a7b85-2846-4853-9ca3-68a985f2984a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:09.236903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bf2a7b85-2846-4853-9ca3-68a985f2984a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:09.318223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffdd8f-c04b-4986-a564-f0855a644a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:09.319889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffdd8f-c04b-4986-a564-f0855a644a9a service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:09.320393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffdd8f-c04b-4986-a564-f0855a644a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:09.321330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffdd8f-c04b-4986-a564-f0855a644a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:09.325595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a7b85-2846-4853-9ca3-68a985f2984a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:09.326570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-deffdd8f-c04b-4986-a564-f0855a644a9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:09.331312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4841cd-0157-4a88-9936-72d444f4ab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:09.332463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4841cd-0157-4a88-9936-72d444f4ab16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:09.332805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4841cd-0157-4a88-9936-72d444f4ab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:09.333156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4841cd-0157-4a88-9936-72d444f4ab16 admin admin] PATH_INFO: `/v3/users/2c5de5511c034d2981c607e123d91f8a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:09.334990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4841cd-0157-4a88-9936-72d444f4ab16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c5de5511c034d2981c607e123d91f8a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:09.348064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4841cd-0157-4a88-9936-72d444f4ab16 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:09.401625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0a4841cd-0157-4a88-9936-72d444f4ab16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c5de5511c034d2981c607e123d91f8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:09.415057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0a4841cd-0157-4a88-9936-72d444f4ab16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c5de5511c034d2981c607e123d91f8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:09.432139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0a4841cd-0157-4a88-9936-72d444f4ab16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c5de5511c034d2981c607e123d91f8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:09.432908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0a4841cd-0157-4a88-9936-72d444f4ab16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c5de5511c034d2981c607e123d91f8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:09.433554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0a4841cd-0157-4a88-9936-72d444f4ab16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c5de5511c034d2981c607e123d91f8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:09.449196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:09.456583 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1265/2569] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:03:09 2022] DELETE /identity/v3/users/2c5de5511c034d2981c607e123d91f8a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:09.457564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4841cd-0157-4a88-9936-72d444f4ab16 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:09.459370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0a4841cd-0157-4a88-9936-72d444f4ab16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:09.500939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffdd8f-c04b-4986-a564-f0855a644a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:09.502634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffdd8f-c04b-4986-a564-f0855a644a9a service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:09.537226 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1305/2570] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:03:09.538631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50354d3a-8142-43f0-87cd-40732fec51e2 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:09.538913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50354d3a-8142-43f0-87cd-40732fec51e2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:09.539185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50354d3a-8142-43f0-87cd-40732fec51e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:09.587351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4841cd-0157-4a88-9936-72d444f4ab16 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:09.592910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-50354d3a-8142-43f0-87cd-40732fec51e2 None None] MFA Rules not processed for user `592e8c2ad31f459fa0b37f219cc4f84c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:09.594301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-50354d3a-8142-43f0-87cd-40732fec51e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:09.600004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf42581-2d14-4f4d-8165-0a8be506aacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:09.601017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf42581-2d14-4f4d-8165-0a8be506aacc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:09.601303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf42581-2d14-4f4d-8165-0a8be506aacc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:09.601579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf42581-2d14-4f4d-8165-0a8be506aacc admin admin] PATH_INFO: `/v3/users/1a33cd6c279a484cb0e1fbb6f5275470` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:09.603325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf42581-2d14-4f4d-8165-0a8be506aacc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a33cd6c279a484cb0e1fbb6f5275470)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:09.606418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf42581-2d14-4f4d-8165-0a8be506aacc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:09.669800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:09.710407 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1306/2571] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:09.731578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-caf42581-2d14-4f4d-8165-0a8be506aacc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a33cd6c279a484cb0e1fbb6f5275470'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:09.752102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-caf42581-2d14-4f4d-8165-0a8be506aacc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a33cd6c279a484cb0e1fbb6f5275470'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:09.763074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-caf42581-2d14-4f4d-8165-0a8be506aacc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a33cd6c279a484cb0e1fbb6f5275470'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:09.765809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-caf42581-2d14-4f4d-8165-0a8be506aacc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a33cd6c279a484cb0e1fbb6f5275470'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:09.767400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-caf42581-2d14-4f4d-8165-0a8be506aacc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a33cd6c279a484cb0e1fbb6f5275470'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:09.804503 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1266/2572] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:03:09 2022] DELETE /identity/v3/users/1a33cd6c279a484cb0e1fbb6f5275470 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:09.810047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32857abc-04b2-49f9-83f6-b120e7f99a1b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:09.811094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32857abc-04b2-49f9-83f6-b120e7f99a1b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:09.811692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32857abc-04b2-49f9-83f6-b120e7f99a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:09.843848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-32857abc-04b2-49f9-83f6-b120e7f99a1b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:09.845299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-32857abc-04b2-49f9-83f6-b120e7f99a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:09.959304 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1307/2573] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:09.988746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf42581-2d14-4f4d-8165-0a8be506aacc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:09.990248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-caf42581-2d14-4f4d-8165-0a8be506aacc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:10.053703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32857abc-04b2-49f9-83f6-b120e7f99a1b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:10.055593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-32857abc-04b2-49f9-83f6-b120e7f99a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:10.119067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32857abc-04b2-49f9-83f6-b120e7f99a1b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:10.120546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf42581-2d14-4f4d-8165-0a8be506aacc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:10.129035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54581f5-4b9c-44b8-abfd-696e9d8fc590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:10.129738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54581f5-4b9c-44b8-abfd-696e9d8fc590 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:10.130025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54581f5-4b9c-44b8-abfd-696e9d8fc590 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:10.130304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54581f5-4b9c-44b8-abfd-696e9d8fc590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:10.132275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c545cb3-ca61-44dd-8e80-e2c42272d5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:10.134345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c545cb3-ca61-44dd-8e80-e2c42272d5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:10.134626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c545cb3-ca61-44dd-8e80-e2c42272d5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:10.134946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c545cb3-ca61-44dd-8e80-e2c42272d5f2 admin admin] PATH_INFO: `/v3/projects/84f0001033e04119bedc25d150414edb` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:10.136266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c545cb3-ca61-44dd-8e80-e2c42272d5f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84f0001033e04119bedc25d150414edb)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:10.138837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c545cb3-ca61-44dd-8e80-e2c42272d5f2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:10.143569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54581f5-4b9c-44b8-abfd-696e9d8fc590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:10.146248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54581f5-4b9c-44b8-abfd-696e9d8fc590 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:10.158072 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1267/2574] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:03:10.206501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2c545cb3-ca61-44dd-8e80-e2c42272d5f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84f0001033e04119bedc25d150414edb', 'request_id': 'req-2c545cb3-ca61-44dd-8e80-e2c42272d5f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:10.219386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2c545cb3-ca61-44dd-8e80-e2c42272d5f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84f0001033e04119bedc25d150414edb', 'request_id': 'req-2c545cb3-ca61-44dd-8e80-e2c42272d5f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:10.288132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2c545cb3-ca61-44dd-8e80-e2c42272d5f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84f0001033e04119bedc25d150414edb', 'request_id': 'req-2c545cb3-ca61-44dd-8e80-e2c42272d5f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:10.340347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2c545cb3-ca61-44dd-8e80-e2c42272d5f2 admin admin] The token cache is being invalidate because project 84f0001033e04119bedc25d150414edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:03:10.340638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2c545cb3-ca61-44dd-8e80-e2c42272d5f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:10.341316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2c545cb3-ca61-44dd-8e80-e2c42272d5f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:10.348676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5f872-7a10-426f-bae9-54f518ba182e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:10.349351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5f872-7a10-426f-bae9-54f518ba182e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:10.350134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5f872-7a10-426f-bae9-54f518ba182e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:10.363087 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1308/2575] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:03:10 2022] DELETE /identity/v3/projects/84f0001033e04119bedc25d150414edb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:10.384449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-34d5f872-7a10-426f-bae9-54f518ba182e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:10.385856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-34d5f872-7a10-426f-bae9-54f518ba182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:10.406610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:10.510550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6658dd-a2d9-415e-bd42-204499e8405d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:10.511097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6658dd-a2d9-415e-bd42-204499e8405d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:10.511097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6658dd-a2d9-415e-bd42-204499e8405d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:10.517182 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1268/2576] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:10.536518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4d6658dd-a2d9-415e-bd42-204499e8405d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:10.538273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4d6658dd-a2d9-415e-bd42-204499e8405d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:10.558974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5f872-7a10-426f-bae9-54f518ba182e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:10.559223 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1309/2577] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:10.571292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5f872-7a10-426f-bae9-54f518ba182e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:10.577893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00e6e3-f9fe-4361-80b5-38aaf0fe2df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:10.578602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00e6e3-f9fe-4361-80b5-38aaf0fe2df9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:10.578886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00e6e3-f9fe-4361-80b5-38aaf0fe2df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:10.579222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00e6e3-f9fe-4361-80b5-38aaf0fe2df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:10.580019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00e6e3-f9fe-4361-80b5-38aaf0fe2df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:03:10.580480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00e6e3-f9fe-4361-80b5-38aaf0fe2df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:10.583240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00e6e3-f9fe-4361-80b5-38aaf0fe2df9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:10.601261 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1269/2578] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:03:10.606035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6658dd-a2d9-415e-bd42-204499e8405d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:10.618720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6658dd-a2d9-415e-bd42-204499e8405d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:10.639470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a627eea-6339-4fc2-9533-9cd7b3375b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:10.640228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a627eea-6339-4fc2-9533-9cd7b3375b05 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:10.640728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a627eea-6339-4fc2-9533-9cd7b3375b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:10.641151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a627eea-6339-4fc2-9533-9cd7b3375b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:10.641859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a627eea-6339-4fc2-9533-9cd7b3375b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:10.644862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a627eea-6339-4fc2-9533-9cd7b3375b05 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:10.686905 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1310/2579] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:03:10 2022] POST /identity/v3/projects => generated 391 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:10.691997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00e6e3-f9fe-4361-80b5-38aaf0fe2df9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:10.703571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00e6e3-f9fe-4361-80b5-38aaf0fe2df9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:10.782679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8757f-5851-461e-a430-c02dd572c3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:10.783311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8757f-5851-461e-a430-c02dd572c3ff admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:10.783798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8757f-5851-461e-a430-c02dd572c3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:10.784802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8757f-5851-461e-a430-c02dd572c3ff admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:10.785822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8757f-5851-461e-a430-c02dd572c3ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:10.788928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8757f-5851-461e-a430-c02dd572c3ff admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:10.827937 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1270/2580] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:03:10 2022] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:10.829205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a627eea-6339-4fc2-9533-9cd7b3375b05 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:10.842183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a627eea-6339-4fc2-9533-9cd7b3375b05 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:10.848119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f061a-03a3-42a7-afb7-c64a9539c15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:10.848904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f061a-03a3-42a7-afb7-c64a9539c15c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:10.849188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f061a-03a3-42a7-afb7-c64a9539c15c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:10.849888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f061a-03a3-42a7-afb7-c64a9539c15c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:10.850181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f061a-03a3-42a7-afb7-c64a9539c15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:10.851963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f061a-03a3-42a7-afb7-c64a9539c15c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:10.879718 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1311/2581] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:03:10.881480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8757f-5851-461e-a430-c02dd572c3ff admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:10.905734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8757f-5851-461e-a430-c02dd572c3ff admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:10.913700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c8517-3200-4504-b2ef-987b3069c091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:10.914720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c8517-3200-4504-b2ef-987b3069c091 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:10.916050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c8517-3200-4504-b2ef-987b3069c091 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:10.916658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c8517-3200-4504-b2ef-987b3069c091 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:10.918611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c8517-3200-4504-b2ef-987b3069c091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:10.920846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c8517-3200-4504-b2ef-987b3069c091 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:10.943342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f061a-03a3-42a7-afb7-c64a9539c15c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:10.943759 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1271/2582] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:03:10.963921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f061a-03a3-42a7-afb7-c64a9539c15c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:10.970057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf4e86-f3e3-4272-88a4-2fc7bfbe579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:10.970980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf4e86-f3e3-4272-88a4-2fc7bfbe579c admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:10.971259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf4e86-f3e3-4272-88a4-2fc7bfbe579c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:10.971526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf4e86-f3e3-4272-88a4-2fc7bfbe579c admin admin] PATH_INFO: `/v3/projects/1d9b6d27cc864181b2c9b80cfe70565c/users/c790cfcf5ebd49358bd53a6baf622b89/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:10.995948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf4e86-f3e3-4272-88a4-2fc7bfbe579c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9b6d27cc864181b2c9b80cfe70565c, user_id=c790cfcf5ebd49358bd53a6baf622b89, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:11.000838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf4e86-f3e3-4272-88a4-2fc7bfbe579c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:11.019650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:11.032085 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1312/2583] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:03:10 2022] PUT /identity/v3/projects/1d9b6d27cc864181b2c9b80cfe70565c/users/c790cfcf5ebd49358bd53a6baf622b89/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:03:11.040658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f43ff3-de34-4d68-a69e-3089468700e2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:11.041697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f43ff3-de34-4d68-a69e-3089468700e2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:11.042266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f43ff3-de34-4d68-a69e-3089468700e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:11.082553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-70f43ff3-de34-4d68-a69e-3089468700e2 None None] MFA Rules not processed for user `c790cfcf5ebd49358bd53a6baf622b89`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:11.083811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-70f43ff3-de34-4d68-a69e-3089468700e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:11.189041 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1272/2584] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:03:11.441213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf4e86-f3e3-4272-88a4-2fc7bfbe579c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:11.443006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-79bf4e86-f3e3-4272-88a4-2fc7bfbe579c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:11.619992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf4e86-f3e3-4272-88a4-2fc7bfbe579c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:11.627422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61629e8e-ba0e-4ce2-b719-7dd746dbae43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:11.628352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61629e8e-ba0e-4ce2-b719-7dd746dbae43 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:11.628780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61629e8e-ba0e-4ce2-b719-7dd746dbae43 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:11.629528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61629e8e-ba0e-4ce2-b719-7dd746dbae43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:11.639797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61629e8e-ba0e-4ce2-b719-7dd746dbae43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:11.642005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61629e8e-ba0e-4ce2-b719-7dd746dbae43 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:11.655071 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1313/2585] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:03:11.666106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f43ff3-de34-4d68-a69e-3089468700e2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:11.667608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-70f43ff3-de34-4d68-a69e-3089468700e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:11.711841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:11.855395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f43ff3-de34-4d68-a69e-3089468700e2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:11.874844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14254272-7685-473e-8ec4-49eb04f2083d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:11.874844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14254272-7685-473e-8ec4-49eb04f2083d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:11.874844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14254272-7685-473e-8ec4-49eb04f2083d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:11.876971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14254272-7685-473e-8ec4-49eb04f2083d admin admin] PATH_INFO: `/v3/projects/f5b51168214242c293747b7bf732272d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:11.887649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14254272-7685-473e-8ec4-49eb04f2083d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b51168214242c293747b7bf732272d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:11.890320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14254272-7685-473e-8ec4-49eb04f2083d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:12.000228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-14254272-7685-473e-8ec4-49eb04f2083d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b51168214242c293747b7bf732272d', 'request_id': 'req-14254272-7685-473e-8ec4-49eb04f2083d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:12.018021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-14254272-7685-473e-8ec4-49eb04f2083d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b51168214242c293747b7bf732272d', 'request_id': 'req-14254272-7685-473e-8ec4-49eb04f2083d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:12.027616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-14254272-7685-473e-8ec4-49eb04f2083d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b51168214242c293747b7bf732272d', 'request_id': 'req-14254272-7685-473e-8ec4-49eb04f2083d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:12.074274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-14254272-7685-473e-8ec4-49eb04f2083d admin admin] The token cache is being invalidate because project f5b51168214242c293747b7bf732272d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:03:12.077935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-14254272-7685-473e-8ec4-49eb04f2083d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:12.079277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-14254272-7685-473e-8ec4-49eb04f2083d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:12.092739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61629e8e-ba0e-4ce2-b719-7dd746dbae43 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:12.093001 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1273/2586] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:03:11 2022] DELETE /identity/v3/projects/f5b51168214242c293747b7bf732272d => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:12.110051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61629e8e-ba0e-4ce2-b719-7dd746dbae43 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:12.277253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa5948-9cbe-464e-80f8-10670b47336d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:12.277871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa5948-9cbe-464e-80f8-10670b47336d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:12.278404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa5948-9cbe-464e-80f8-10670b47336d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:12.327009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-51fa5948-9cbe-464e-80f8-10670b47336d None None] MFA Rules not processed for user `45991293f65c4c22a91afa74cf8179ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:12.328744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-51fa5948-9cbe-464e-80f8-10670b47336d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:12.358810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2853a5-1f44-4e8a-86c7-3159433a426a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:12.364587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2853a5-1f44-4e8a-86c7-3159433a426a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:12.365050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2853a5-1f44-4e8a-86c7-3159433a426a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:12.365494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2853a5-1f44-4e8a-86c7-3159433a426a admin admin] PATH_INFO: `/v3/users/30201a4ea6a94c3bb49adccc556159fc` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:12.368578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2853a5-1f44-4e8a-86c7-3159433a426a admin admin] RBAC: Authorizing `identity:delete_user(user_id=30201a4ea6a94c3bb49adccc556159fc)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:12.372425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2853a5-1f44-4e8a-86c7-3159433a426a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:12.466775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-db2853a5-1f44-4e8a-86c7-3159433a426a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30201a4ea6a94c3bb49adccc556159fc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:12.466938 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1274/2587] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:12.467801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa5948-9cbe-464e-80f8-10670b47336d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:12.469485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-51fa5948-9cbe-464e-80f8-10670b47336d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:12.483797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-db2853a5-1f44-4e8a-86c7-3159433a426a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30201a4ea6a94c3bb49adccc556159fc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:12.485273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-db2853a5-1f44-4e8a-86c7-3159433a426a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30201a4ea6a94c3bb49adccc556159fc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:12.485991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-db2853a5-1f44-4e8a-86c7-3159433a426a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30201a4ea6a94c3bb49adccc556159fc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:12.494768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa5948-9cbe-464e-80f8-10670b47336d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:12.503708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-db2853a5-1f44-4e8a-86c7-3159433a426a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30201a4ea6a94c3bb49adccc556159fc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:12.506680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2dc56-a57c-424d-a4cd-c1dd34bff0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:12.510138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2dc56-a57c-424d-a4cd-c1dd34bff0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:12.510362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2dc56-a57c-424d-a4cd-c1dd34bff0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:12.510539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2dc56-a57c-424d-a4cd-c1dd34bff0e9 admin admin] PATH_INFO: `/v3/users/c790cfcf5ebd49358bd53a6baf622b89` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:12.514729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2dc56-a57c-424d-a4cd-c1dd34bff0e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c790cfcf5ebd49358bd53a6baf622b89)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:12.516784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2dc56-a57c-424d-a4cd-c1dd34bff0e9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:12.542122 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1314/2588] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:03:12 2022] DELETE /identity/v3/users/30201a4ea6a94c3bb49adccc556159fc => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:12.542971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2853a5-1f44-4e8a-86c7-3159433a426a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:12.545288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-db2853a5-1f44-4e8a-86c7-3159433a426a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:12.562802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:12.591043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:12.616680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23b2dc56-a57c-424d-a4cd-c1dd34bff0e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c790cfcf5ebd49358bd53a6baf622b89'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:12.633331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23b2dc56-a57c-424d-a4cd-c1dd34bff0e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c790cfcf5ebd49358bd53a6baf622b89'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:12.644885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23b2dc56-a57c-424d-a4cd-c1dd34bff0e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c790cfcf5ebd49358bd53a6baf622b89'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:12.646714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23b2dc56-a57c-424d-a4cd-c1dd34bff0e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c790cfcf5ebd49358bd53a6baf622b89'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:12.649161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23b2dc56-a57c-424d-a4cd-c1dd34bff0e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c790cfcf5ebd49358bd53a6baf622b89'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:12.733140 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1275/2589] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:03:12 2022] DELETE /identity/v3/users/c790cfcf5ebd49358bd53a6baf622b89 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:12.738249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedf5a0-0724-4334-8a7e-c3eabb9a5007 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:12.739540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedf5a0-0724-4334-8a7e-c3eabb9a5007 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:12.739921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedf5a0-0724-4334-8a7e-c3eabb9a5007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:12.744839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2853a5-1f44-4e8a-86c7-3159433a426a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:12.782948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8aedf5a0-0724-4334-8a7e-c3eabb9a5007 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:12.784361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8aedf5a0-0724-4334-8a7e-c3eabb9a5007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:12.863310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb8623-ce6d-47e9-bcff-f9576c2835df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:12.864016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb8623-ce6d-47e9-bcff-f9576c2835df admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:12.864686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb8623-ce6d-47e9-bcff-f9576c2835df admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:12.866640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb8623-ce6d-47e9-bcff-f9576c2835df admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:12.868227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb8623-ce6d-47e9-bcff-f9576c2835df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:12.879920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb8623-ce6d-47e9-bcff-f9576c2835df admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:12.949419 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1315/2590] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:03:12 2022] POST /identity/v3/projects => generated 389 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:12.950368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb8623-ce6d-47e9-bcff-f9576c2835df admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:12.953399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d8bb8623-ce6d-47e9-bcff-f9576c2835df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:12.958306 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1276/2591] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:12.970095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedf5a0-0724-4334-8a7e-c3eabb9a5007 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:12.971814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8aedf5a0-0724-4334-8a7e-c3eabb9a5007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:13.143733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb8623-ce6d-47e9-bcff-f9576c2835df admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:13.156544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fe0b6-d50d-4567-9ff2-c0d95548a09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:13.156812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedf5a0-0724-4334-8a7e-c3eabb9a5007 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:13.157263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fe0b6-d50d-4567-9ff2-c0d95548a09f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:13.157580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fe0b6-d50d-4567-9ff2-c0d95548a09f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:13.157781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fe0b6-d50d-4567-9ff2-c0d95548a09f admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:13.160622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fe0b6-d50d-4567-9ff2-c0d95548a09f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:13.169074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fe0b6-d50d-4567-9ff2-c0d95548a09f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:13.217871 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1316/2592] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:03:12 2022] POST /identity/v3/users => generated 301 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:13.223372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fe0b6-d50d-4567-9ff2-c0d95548a09f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:13.247183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fe0b6-d50d-4567-9ff2-c0d95548a09f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:13.249617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581f39d-d6c2-4c33-a25c-cefea157d6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:13.250621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581f39d-d6c2-4c33-a25c-cefea157d6dc service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:13.250903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581f39d-d6c2-4c33-a25c-cefea157d6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:13.251179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581f39d-d6c2-4c33-a25c-cefea157d6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:13.262380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7d4d6-86c6-42b3-bf0e-5c9189247e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:13.263363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7d4d6-86c6-42b3-bf0e-5c9189247e66 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:13.263717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7d4d6-86c6-42b3-bf0e-5c9189247e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:13.264074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7d4d6-86c6-42b3-bf0e-5c9189247e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:13.264877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7d4d6-86c6-42b3-bf0e-5c9189247e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:13.266637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7d4d6-86c6-42b3-bf0e-5c9189247e66 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:13.269799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581f39d-d6c2-4c33-a25c-cefea157d6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:13.271837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581f39d-d6c2-4c33-a25c-cefea157d6dc service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:13.285910 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1277/2593] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:03:13.291940 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1317/2594] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:03:13.296450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581f39d-d6c2-4c33-a25c-cefea157d6dc service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:13.313216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581f39d-d6c2-4c33-a25c-cefea157d6dc service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:13.321226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25b852-8930-4131-8576-5635f126865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:13.322379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25b852-8930-4131-8576-5635f126865c admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:13.322660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25b852-8930-4131-8576-5635f126865c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:13.322931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25b852-8930-4131-8576-5635f126865c admin admin] PATH_INFO: `/v3/projects/d23ade532437415e802030f18fe78d01/users/bd452195a8d8423a9957773af081b75f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:13.327012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:13.349928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25b852-8930-4131-8576-5635f126865c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23ade532437415e802030f18fe78d01, user_id=bd452195a8d8423a9957773af081b75f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:13.353023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25b852-8930-4131-8576-5635f126865c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:13.369889 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1278/2595] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:03:13 2022] PUT /identity/v3/projects/d23ade532437415e802030f18fe78d01/users/bd452195a8d8423a9957773af081b75f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:13.374645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7d4d6-86c6-42b3-bf0e-5c9189247e66 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:13.393399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25b852-8930-4131-8576-5635f126865c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:13.398595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7d4d6-86c6-42b3-bf0e-5c9189247e66 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:13.401343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-af25b852-8930-4131-8576-5635f126865c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:13.427824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:13.566905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d0044-0e85-4ad3-9903-2ac6f3733cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:13.567606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d0044-0e85-4ad3-9903-2ac6f3733cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:13.567886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d0044-0e85-4ad3-9903-2ac6f3733cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:13.568196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d0044-0e85-4ad3-9903-2ac6f3733cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:13.568926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d0044-0e85-4ad3-9903-2ac6f3733cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:13.570604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d0044-0e85-4ad3-9903-2ac6f3733cf3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:13.594783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25b852-8930-4131-8576-5635f126865c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:13.617375 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1318/2596] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:03:13.621265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b8ceb-edf5-46aa-ae1c-b205f1eab8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:13.622169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b8ceb-edf5-46aa-ae1c-b205f1eab8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:13.622448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b8ceb-edf5-46aa-ae1c-b205f1eab8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:13.622722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b8ceb-edf5-46aa-ae1c-b205f1eab8a4 admin admin] PATH_INFO: `/v3/projects/dfe9fb969f744191b6062e5403c99233` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:13.624208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d0044-0e85-4ad3-9903-2ac6f3733cf3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:13.625324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b8ceb-edf5-46aa-ae1c-b205f1eab8a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe9fb969f744191b6062e5403c99233)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:13.627274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b8ceb-edf5-46aa-ae1c-b205f1eab8a4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:13.646747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d0044-0e85-4ad3-9903-2ac6f3733cf3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:13.657868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7b596-2c21-49fa-a96d-a6f0d0e89f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:13.662250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7b596-2c21-49fa-a96d-a6f0d0e89f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:13.662643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7b596-2c21-49fa-a96d-a6f0d0e89f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:13.662959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7b596-2c21-49fa-a96d-a6f0d0e89f79 admin admin] PATH_INFO: `/v3/projects/d23ade532437415e802030f18fe78d01/users/bd452195a8d8423a9957773af081b75f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:13.666413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7b596-2c21-49fa-a96d-a6f0d0e89f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23ade532437415e802030f18fe78d01, user_id=bd452195a8d8423a9957773af081b75f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:13.670431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7b596-2c21-49fa-a96d-a6f0d0e89f79 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:13.704794 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1319/2597] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:03:13 2022] PUT /identity/v3/projects/d23ade532437415e802030f18fe78d01/users/bd452195a8d8423a9957773af081b75f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:13.743654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8a5b8ceb-edf5-46aa-ae1c-b205f1eab8a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe9fb969f744191b6062e5403c99233', 'request_id': 'req-8a5b8ceb-edf5-46aa-ae1c-b205f1eab8a4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:13.755661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8a5b8ceb-edf5-46aa-ae1c-b205f1eab8a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe9fb969f744191b6062e5403c99233', 'request_id': 'req-8a5b8ceb-edf5-46aa-ae1c-b205f1eab8a4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:13.764740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8a5b8ceb-edf5-46aa-ae1c-b205f1eab8a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe9fb969f744191b6062e5403c99233', 'request_id': 'req-8a5b8ceb-edf5-46aa-ae1c-b205f1eab8a4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:13.788384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8a5b8ceb-edf5-46aa-ae1c-b205f1eab8a4 admin admin] The token cache is being invalidate because project dfe9fb969f744191b6062e5403c99233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:03:13.789009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8a5b8ceb-edf5-46aa-ae1c-b205f1eab8a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:13.790358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8a5b8ceb-edf5-46aa-ae1c-b205f1eab8a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:13.794509 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1279/2598] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:03:13 2022] DELETE /identity/v3/projects/dfe9fb969f744191b6062e5403c99233 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:13.799366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450ea9c-4936-4291-aeca-80ba759bab84 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:13.799938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450ea9c-4936-4291-aeca-80ba759bab84 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:13.801143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450ea9c-4936-4291-aeca-80ba759bab84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:13.840937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4450ea9c-4936-4291-aeca-80ba759bab84 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:13.844463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4450ea9c-4936-4291-aeca-80ba759bab84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:13.938548 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1320/2599] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:13.945869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48a76f-cf68-4a11-af71-22f22fb20860 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:13.946163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48a76f-cf68-4a11-af71-22f22fb20860 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:13.946443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48a76f-cf68-4a11-af71-22f22fb20860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:13.970867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4e48a76f-cf68-4a11-af71-22f22fb20860 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:13.972287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4e48a76f-cf68-4a11-af71-22f22fb20860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:13.985737 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1280/2600] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:13.989843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450ea9c-4936-4291-aeca-80ba759bab84 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:14.004803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450ea9c-4936-4291-aeca-80ba759bab84 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:14.017723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a1cc7-7bdd-43cf-85e4-c0536f6ccd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:14.019419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a1cc7-7bdd-43cf-85e4-c0536f6ccd31 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:14.020725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a1cc7-7bdd-43cf-85e4-c0536f6ccd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:14.021569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a1cc7-7bdd-43cf-85e4-c0536f6ccd31 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:14.022622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a1cc7-7bdd-43cf-85e4-c0536f6ccd31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:03:14.023402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a1cc7-7bdd-43cf-85e4-c0536f6ccd31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:14.025956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a1cc7-7bdd-43cf-85e4-c0536f6ccd31 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:14.043831 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1321/2601] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:03:14.048114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48a76f-cf68-4a11-af71-22f22fb20860 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:14.060230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48a76f-cf68-4a11-af71-22f22fb20860 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:14.066623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec7bb2-a7ea-4e09-b2a6-44467c6a421c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:14.068589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec7bb2-a7ea-4e09-b2a6-44467c6a421c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:14.069094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec7bb2-a7ea-4e09-b2a6-44467c6a421c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:14.069577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec7bb2-a7ea-4e09-b2a6-44467c6a421c admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:14.070670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec7bb2-a7ea-4e09-b2a6-44467c6a421c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:14.074277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec7bb2-a7ea-4e09-b2a6-44467c6a421c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:14.120949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a1cc7-7bdd-43cf-85e4-c0536f6ccd31 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:14.121391 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1281/2602] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:03:14 2022] POST /identity/v3/projects => generated 391 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:03:14.138397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a1cc7-7bdd-43cf-85e4-c0536f6ccd31 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:14.257969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a113b-61a8-4a5e-96bc-7308cc25fadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:14.259652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a113b-61a8-4a5e-96bc-7308cc25fadc admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:14.263510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a113b-61a8-4a5e-96bc-7308cc25fadc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:14.263821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a113b-61a8-4a5e-96bc-7308cc25fadc admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:14.265580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a113b-61a8-4a5e-96bc-7308cc25fadc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:14.270098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a113b-61a8-4a5e-96bc-7308cc25fadc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:14.295736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47153fa-aed6-489a-8c38-46776b8af5bb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:14.297322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47153fa-aed6-489a-8c38-46776b8af5bb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:14.297634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47153fa-aed6-489a-8c38-46776b8af5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:14.359408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d47153fa-aed6-489a-8c38-46776b8af5bb None None] MFA Rules not processed for user `9ee93cc6740d4e92b231f60d8b9d4450`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:14.361177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d47153fa-aed6-489a-8c38-46776b8af5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:14.362754 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1322/2603] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:03:14 2022] POST /identity/v3/users => generated 296 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:03:14.363750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a113b-61a8-4a5e-96bc-7308cc25fadc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:14.367307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6a8a113b-61a8-4a5e-96bc-7308cc25fadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:14.414502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a113b-61a8-4a5e-96bc-7308cc25fadc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:14.416228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:14.437005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab314d1e-e4bf-4d13-ade2-f2ee9f154f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:14.438009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab314d1e-e4bf-4d13-ade2-f2ee9f154f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:14.448735 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1282/2604] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:03:14.448735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47153fa-aed6-489a-8c38-46776b8af5bb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:14.455227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab314d1e-e4bf-4d13-ade2-f2ee9f154f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:14.455630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab314d1e-e4bf-4d13-ade2-f2ee9f154f5e admin admin] PATH_INFO: `/v3/projects/1d9b6d27cc864181b2c9b80cfe70565c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:14.460238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab314d1e-e4bf-4d13-ade2-f2ee9f154f5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d9b6d27cc864181b2c9b80cfe70565c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:14.465813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab314d1e-e4bf-4d13-ade2-f2ee9f154f5e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:14.468827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47153fa-aed6-489a-8c38-46776b8af5bb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:14.485711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc99c7-7101-4e82-b0d5-78dad3972e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:14.486246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc99c7-7101-4e82-b0d5-78dad3972e53 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:14.486518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc99c7-7101-4e82-b0d5-78dad3972e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:14.486797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc99c7-7101-4e82-b0d5-78dad3972e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:14.487534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc99c7-7101-4e82-b0d5-78dad3972e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:14.489471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc99c7-7101-4e82-b0d5-78dad3972e53 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:14.498477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:14.527909 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1283/2605] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:03:14.531174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc99c7-7101-4e82-b0d5-78dad3972e53 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:14.553233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc99c7-7101-4e82-b0d5-78dad3972e53 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:14.570635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5add1-0cdc-479f-9819-9b48b5bf436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:14.571517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5add1-0cdc-479f-9819-9b48b5bf436c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:14.571790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5add1-0cdc-479f-9819-9b48b5bf436c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:14.572104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5add1-0cdc-479f-9819-9b48b5bf436c admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:14.572842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5add1-0cdc-479f-9819-9b48b5bf436c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:14.576447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5add1-0cdc-479f-9819-9b48b5bf436c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:14.581170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ab314d1e-e4bf-4d13-ade2-f2ee9f154f5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d9b6d27cc864181b2c9b80cfe70565c', 'request_id': 'req-ab314d1e-e4bf-4d13-ade2-f2ee9f154f5e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:14.600450 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1284/2606] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:03:14.605457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5add1-0cdc-479f-9819-9b48b5bf436c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:14.610076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ab314d1e-e4bf-4d13-ade2-f2ee9f154f5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d9b6d27cc864181b2c9b80cfe70565c', 'request_id': 'req-ab314d1e-e4bf-4d13-ade2-f2ee9f154f5e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:14.623745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5add1-0cdc-479f-9819-9b48b5bf436c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:14.627330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ab314d1e-e4bf-4d13-ade2-f2ee9f154f5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d9b6d27cc864181b2c9b80cfe70565c', 'request_id': 'req-ab314d1e-e4bf-4d13-ade2-f2ee9f154f5e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:14.642912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ab314d1e-e4bf-4d13-ade2-f2ee9f154f5e admin admin] The token cache is being invalidate because project 1d9b6d27cc864181b2c9b80cfe70565c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:03:14.643572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ab314d1e-e4bf-4d13-ade2-f2ee9f154f5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:14.644413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ab314d1e-e4bf-4d13-ade2-f2ee9f154f5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:14.647235 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1323/2607] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:03:14 2022] DELETE /identity/v3/projects/1d9b6d27cc864181b2c9b80cfe70565c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:14.652320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f641456-09c2-4549-a738-5e2e5700a8f6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:14.653416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f641456-09c2-4549-a738-5e2e5700a8f6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:14.653765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f641456-09c2-4549-a738-5e2e5700a8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:14.673751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6f641456-09c2-4549-a738-5e2e5700a8f6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:14.674973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6f641456-09c2-4549-a738-5e2e5700a8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:14.730840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a33db-72de-45ec-be56-66a30907f663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:14.732289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a33db-72de-45ec-be56-66a30907f663 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:14.732738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a33db-72de-45ec-be56-66a30907f663 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:14.733190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a33db-72de-45ec-be56-66a30907f663 admin admin] PATH_INFO: `/v3/projects/1cc99843bb204044a5dad9cac16b48e2/users/33e85698bc864c248a83a3322ba72437/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:14.750579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a33db-72de-45ec-be56-66a30907f663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc99843bb204044a5dad9cac16b48e2, user_id=33e85698bc864c248a83a3322ba72437, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:14.754038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a33db-72de-45ec-be56-66a30907f663 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:14.760222 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1324/2608] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:14.767324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5562d-6232-449d-ba1c-a11183e0845b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:14.767955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5562d-6232-449d-ba1c-a11183e0845b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:14.768274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5562d-6232-449d-ba1c-a11183e0845b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:14.788740 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1285/2609] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:03:14 2022] PUT /identity/v3/projects/1cc99843bb204044a5dad9cac16b48e2/users/33e85698bc864c248a83a3322ba72437/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:03:14.801233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437370e0-809a-48dc-9b22-274d289a1f4c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:14.802675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437370e0-809a-48dc-9b22-274d289a1f4c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:14.803491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437370e0-809a-48dc-9b22-274d289a1f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:14.817666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c5d5562d-6232-449d-ba1c-a11183e0845b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:14.819566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c5d5562d-6232-449d-ba1c-a11183e0845b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:14.868278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-437370e0-809a-48dc-9b22-274d289a1f4c None None] MFA Rules not processed for user `33e85698bc864c248a83a3322ba72437`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:14.871008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-437370e0-809a-48dc-9b22-274d289a1f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:14.949003 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1325/2610] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:14.956440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5562d-6232-449d-ba1c-a11183e0845b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:14.975484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5562d-6232-449d-ba1c-a11183e0845b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:14.987655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b889d-c2a7-4731-bd37-54230700b5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:14.988375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b889d-c2a7-4731-bd37-54230700b5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:14.988658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b889d-c2a7-4731-bd37-54230700b5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:14.988933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b889d-c2a7-4731-bd37-54230700b5e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:14.989673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b889d-c2a7-4731-bd37-54230700b5e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:03:14.989983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b889d-c2a7-4731-bd37-54230700b5e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:14.991647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b889d-c2a7-4731-bd37-54230700b5e3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:15.014196 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1326/2611] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:03:15.015243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b889d-c2a7-4731-bd37-54230700b5e3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:15.041461 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1286/2612] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:03:15.041698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b889d-c2a7-4731-bd37-54230700b5e3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:15.042856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437370e0-809a-48dc-9b22-274d289a1f4c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:15.044365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-437370e0-809a-48dc-9b22-274d289a1f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:15.046055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b847f-0577-49fd-887b-32f63f3fd95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:15.046827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b847f-0577-49fd-887b-32f63f3fd95e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:15.047100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b847f-0577-49fd-887b-32f63f3fd95e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:15.047371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b847f-0577-49fd-887b-32f63f3fd95e admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:15.048221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b847f-0577-49fd-887b-32f63f3fd95e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:15.050192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b847f-0577-49fd-887b-32f63f3fd95e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:15.061488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437370e0-809a-48dc-9b22-274d289a1f4c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:15.066976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b041a5-cb75-44c8-a9c1-4ee60211bb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:15.067886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b041a5-cb75-44c8-a9c1-4ee60211bb25 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:15.068272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b041a5-cb75-44c8-a9c1-4ee60211bb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:15.068635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b041a5-cb75-44c8-a9c1-4ee60211bb25 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:15.071059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b041a5-cb75-44c8-a9c1-4ee60211bb25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:15.073656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b041a5-cb75-44c8-a9c1-4ee60211bb25 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:15.116361 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1327/2613] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:03:15 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:15.117283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b847f-0577-49fd-887b-32f63f3fd95e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:15.130956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:15.145308 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1287/2614] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:03:15 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:03:15.148277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b041a5-cb75-44c8-a9c1-4ee60211bb25 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:15.204534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:15.266891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b847f-0577-49fd-887b-32f63f3fd95e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:15.293904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b041a5-cb75-44c8-a9c1-4ee60211bb25 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:15.300289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f60e3-f5cc-4f3f-95d0-7bffbbc0f443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:15.301003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f60e3-f5cc-4f3f-95d0-7bffbbc0f443 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:15.301364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f60e3-f5cc-4f3f-95d0-7bffbbc0f443 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:15.301703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f60e3-f5cc-4f3f-95d0-7bffbbc0f443 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:15.302531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f60e3-f5cc-4f3f-95d0-7bffbbc0f443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:15.304685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f60e3-f5cc-4f3f-95d0-7bffbbc0f443 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:15.353406 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1288/2615] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:03:15 2022] POST /identity/v3/users => generated 302 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:15.357415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f60e3-f5cc-4f3f-95d0-7bffbbc0f443 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:15.404501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f60e3-f5cc-4f3f-95d0-7bffbbc0f443 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:15.446996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c9d7b-19b8-4db6-b14d-7d542b5b5b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:15.450276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c9d7b-19b8-4db6-b14d-7d542b5b5b6d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:15.450474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c9d7b-19b8-4db6-b14d-7d542b5b5b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:15.450716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c9d7b-19b8-4db6-b14d-7d542b5b5b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:15.451879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c9d7b-19b8-4db6-b14d-7d542b5b5b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:15.453758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c9d7b-19b8-4db6-b14d-7d542b5b5b6d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:15.480020 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1289/2616] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:03:15.482408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c9d7b-19b8-4db6-b14d-7d542b5b5b6d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:15.495921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947e7da-947a-408f-8132-d5fe98fa36b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:15.496905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947e7da-947a-408f-8132-d5fe98fa36b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:15.497402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947e7da-947a-408f-8132-d5fe98fa36b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:15.497921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947e7da-947a-408f-8132-d5fe98fa36b4 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:15.499920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947e7da-947a-408f-8132-d5fe98fa36b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:15.504194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947e7da-947a-408f-8132-d5fe98fa36b4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:15.512382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c9d7b-19b8-4db6-b14d-7d542b5b5b6d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:15.520025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e693e22-d2df-48af-8824-ac913271600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:15.521334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e693e22-d2df-48af-8824-ac913271600c admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:15.521799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e693e22-d2df-48af-8824-ac913271600c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:15.522252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e693e22-d2df-48af-8824-ac913271600c admin admin] PATH_INFO: `/v3/projects/76c63dc7677845fcacf1f456ab365ccd/users/2f57b8c3441a4829abb628a4a29c7013/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:15.553865 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1328/2617] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:03:15 2022] POST /identity/v3/users => generated 291 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:15.558450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947e7da-947a-408f-8132-d5fe98fa36b4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:15.577975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e693e22-d2df-48af-8824-ac913271600c admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c63dc7677845fcacf1f456ab365ccd, user_id=2f57b8c3441a4829abb628a4a29c7013, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:15.580611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e693e22-d2df-48af-8824-ac913271600c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:15.586453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947e7da-947a-408f-8132-d5fe98fa36b4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:15.601759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee77b82-d784-4560-813c-c5fca516c38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:15.602760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee77b82-d784-4560-813c-c5fca516c38c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:15.603044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee77b82-d784-4560-813c-c5fca516c38c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:15.603325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee77b82-d784-4560-813c-c5fca516c38c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:15.604415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee77b82-d784-4560-813c-c5fca516c38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:15.605830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee77b82-d784-4560-813c-c5fca516c38c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:15.609135 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1290/2618] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:03:15 2022] PUT /identity/v3/projects/76c63dc7677845fcacf1f456ab365ccd/users/2f57b8c3441a4829abb628a4a29c7013/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:15.613187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e693e22-d2df-48af-8824-ac913271600c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:15.633106 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1329/2619] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:03:15.636911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee77b82-d784-4560-813c-c5fca516c38c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:15.655779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee77b82-d784-4560-813c-c5fca516c38c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:15.791983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e693e22-d2df-48af-8824-ac913271600c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:15.811653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820428e-de8e-422a-8c7a-4b312415cd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:15.812556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820428e-de8e-422a-8c7a-4b312415cd67 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:15.813046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820428e-de8e-422a-8c7a-4b312415cd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:15.813198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820428e-de8e-422a-8c7a-4b312415cd67 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:15.813952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820428e-de8e-422a-8c7a-4b312415cd67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:15.815583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820428e-de8e-422a-8c7a-4b312415cd67 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:15.832877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5564de-fb05-4048-a771-c3734d041a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:15.833381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5564de-fb05-4048-a771-c3734d041a2b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:15.833896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5564de-fb05-4048-a771-c3734d041a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:15.834315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5564de-fb05-4048-a771-c3734d041a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:15.835576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5564de-fb05-4048-a771-c3734d041a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:15.839143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5564de-fb05-4048-a771-c3734d041a2b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:15.872607 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1330/2620] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:03:15.872962 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1291/2621] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:03:15.881345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5564de-fb05-4048-a771-c3734d041a2b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:15.882461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820428e-de8e-422a-8c7a-4b312415cd67 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:15.915065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5564de-fb05-4048-a771-c3734d041a2b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:15.915510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820428e-de8e-422a-8c7a-4b312415cd67 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:15.927141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7b7ce-2fbc-4920-baf4-ede564a66166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:15.928078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7b7ce-2fbc-4920-baf4-ede564a66166 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:15.928366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7b7ce-2fbc-4920-baf4-ede564a66166 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:15.928652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7b7ce-2fbc-4920-baf4-ede564a66166 admin admin] PATH_INFO: `/v3/projects/76c63dc7677845fcacf1f456ab365ccd/users/2f57b8c3441a4829abb628a4a29c7013/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:15.934420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7b7ce-2fbc-4920-baf4-ede564a66166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c63dc7677845fcacf1f456ab365ccd, user_id=2f57b8c3441a4829abb628a4a29c7013, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:15.937938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7b7ce-2fbc-4920-baf4-ede564a66166 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:15.940888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a85e3d-7b50-4b7c-b2a9-5412e0d91b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:15.941813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a85e3d-7b50-4b7c-b2a9-5412e0d91b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:15.942092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a85e3d-7b50-4b7c-b2a9-5412e0d91b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:15.942366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a85e3d-7b50-4b7c-b2a9-5412e0d91b46 admin admin] PATH_INFO: `/v3/projects/ad0b5a189e934370af07b11ee0a9e737/users/223fd6f7a4c84114af7a22eb19cc7034/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:15.971991 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1331/2622] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:03:15 2022] PUT /identity/v3/projects/76c63dc7677845fcacf1f456ab365ccd/users/2f57b8c3441a4829abb628a4a29c7013/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:15.985594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc3d20-fab4-490e-b3ff-29fe9cd48833 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:15.985913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc3d20-fab4-490e-b3ff-29fe9cd48833 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:15.986211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc3d20-fab4-490e-b3ff-29fe9cd48833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:16.020885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:16.027032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-50fc3d20-fab4-490e-b3ff-29fe9cd48833 None None] MFA Rules not processed for user `2f57b8c3441a4829abb628a4a29c7013`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:16.030683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-50fc3d20-fab4-490e-b3ff-29fe9cd48833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:16.185788 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1332/2623] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:16.245411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a85e3d-7b50-4b7c-b2a9-5412e0d91b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad0b5a189e934370af07b11ee0a9e737, user_id=223fd6f7a4c84114af7a22eb19cc7034, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:16.251946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a85e3d-7b50-4b7c-b2a9-5412e0d91b46 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:16.274692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc3d20-fab4-490e-b3ff-29fe9cd48833 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:16.276755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-50fc3d20-fab4-490e-b3ff-29fe9cd48833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:16.303472 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1292/2624] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:03:15 2022] PUT /identity/v3/projects/ad0b5a189e934370af07b11ee0a9e737/users/223fd6f7a4c84114af7a22eb19cc7034/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:16.318311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d63e1-fce8-4def-ad2b-d0bb19bb9979 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:16.318628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d63e1-fce8-4def-ad2b-d0bb19bb9979 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:16.318954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d63e1-fce8-4def-ad2b-d0bb19bb9979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:16.388845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-444d63e1-fce8-4def-ad2b-d0bb19bb9979 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:16.390292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-444d63e1-fce8-4def-ad2b-d0bb19bb9979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:16.514302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:16.558542 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1293/2625] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:16.560306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc3d20-fab4-490e-b3ff-29fe9cd48833 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:16.572868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d63e1-fce8-4def-ad2b-d0bb19bb9979 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:16.574452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-444d63e1-fce8-4def-ad2b-d0bb19bb9979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:16.697973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d63e1-fce8-4def-ad2b-d0bb19bb9979 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:16.708511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee292a-8279-4861-acf0-8f4ba29232c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:16.709563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee292a-8279-4861-acf0-8f4ba29232c8 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:16.710040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee292a-8279-4861-acf0-8f4ba29232c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:16.710503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee292a-8279-4861-acf0-8f4ba29232c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:16.749257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee292a-8279-4861-acf0-8f4ba29232c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:16.754331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee292a-8279-4861-acf0-8f4ba29232c8 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:16.782328 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1294/2626] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:03:16.785095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530a23f-9de0-4782-bc89-e405a525dc53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:16.786101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530a23f-9de0-4782-bc89-e405a525dc53 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:16.786589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530a23f-9de0-4782-bc89-e405a525dc53 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:16.787660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530a23f-9de0-4782-bc89-e405a525dc53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:16.854611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:16.897255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530a23f-9de0-4782-bc89-e405a525dc53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:16.899507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530a23f-9de0-4782-bc89-e405a525dc53 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:16.952354 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1333/2627] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:03:18.352231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee292a-8279-4861-acf0-8f4ba29232c8 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:18.368841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee292a-8279-4861-acf0-8f4ba29232c8 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:18.382183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db42d6-a2e3-4d45-9d7c-7fc4785ed776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:18.383113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db42d6-a2e3-4d45-9d7c-7fc4785ed776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:18.383413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db42d6-a2e3-4d45-9d7c-7fc4785ed776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:18.383689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db42d6-a2e3-4d45-9d7c-7fc4785ed776 admin admin] PATH_INFO: `/v3/users/33e85698bc864c248a83a3322ba72437` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:18.385444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db42d6-a2e3-4d45-9d7c-7fc4785ed776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e85698bc864c248a83a3322ba72437)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:18.387602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db42d6-a2e3-4d45-9d7c-7fc4785ed776 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:18.495990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-22db42d6-a2e3-4d45-9d7c-7fc4785ed776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e85698bc864c248a83a3322ba72437'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:18.516186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-22db42d6-a2e3-4d45-9d7c-7fc4785ed776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e85698bc864c248a83a3322ba72437'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:18.549294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-22db42d6-a2e3-4d45-9d7c-7fc4785ed776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e85698bc864c248a83a3322ba72437'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:18.551247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-22db42d6-a2e3-4d45-9d7c-7fc4785ed776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e85698bc864c248a83a3322ba72437'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:18.552100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-22db42d6-a2e3-4d45-9d7c-7fc4785ed776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e85698bc864c248a83a3322ba72437'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:18.597833 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1295/2628] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:03:18 2022] DELETE /identity/v3/users/33e85698bc864c248a83a3322ba72437 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:18.602828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32404cf0-135d-4d63-99c7-335d76bff185 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:18.604700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32404cf0-135d-4d63-99c7-335d76bff185 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:18.605056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32404cf0-135d-4d63-99c7-335d76bff185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:18.644596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-32404cf0-135d-4d63-99c7-335d76bff185 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:18.646078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-32404cf0-135d-4d63-99c7-335d76bff185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:18.793642 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1334/2629] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:18.841751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db42d6-a2e3-4d45-9d7c-7fc4785ed776 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:18.843577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-22db42d6-a2e3-4d45-9d7c-7fc4785ed776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:19.036510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db42d6-a2e3-4d45-9d7c-7fc4785ed776 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:19.040954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8c891-434c-4bc0-a5ba-aee77cc4f271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:19.047368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8c891-434c-4bc0-a5ba-aee77cc4f271 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:19.047926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8c891-434c-4bc0-a5ba-aee77cc4f271 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:19.048486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8c891-434c-4bc0-a5ba-aee77cc4f271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:19.078013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8c891-434c-4bc0-a5ba-aee77cc4f271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:19.079590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8c891-434c-4bc0-a5ba-aee77cc4f271 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:19.099840 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1296/2630] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:03:21.078039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32404cf0-135d-4d63-99c7-335d76bff185 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:21.082951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-32404cf0-135d-4d63-99c7-335d76bff185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:21.134290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32404cf0-135d-4d63-99c7-335d76bff185 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:21.155925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270846dc-0bd8-4bf6-867a-36ca763de0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:21.157055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270846dc-0bd8-4bf6-867a-36ca763de0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:21.157512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270846dc-0bd8-4bf6-867a-36ca763de0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:21.158468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270846dc-0bd8-4bf6-867a-36ca763de0c5 admin admin] PATH_INFO: `/v3/projects/1cc99843bb204044a5dad9cac16b48e2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:21.160659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270846dc-0bd8-4bf6-867a-36ca763de0c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc99843bb204044a5dad9cac16b48e2)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:21.162964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270846dc-0bd8-4bf6-867a-36ca763de0c5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:21.297628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-270846dc-0bd8-4bf6-867a-36ca763de0c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc99843bb204044a5dad9cac16b48e2', 'request_id': 'req-270846dc-0bd8-4bf6-867a-36ca763de0c5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:21.330914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-270846dc-0bd8-4bf6-867a-36ca763de0c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc99843bb204044a5dad9cac16b48e2', 'request_id': 'req-270846dc-0bd8-4bf6-867a-36ca763de0c5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:21.350532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-270846dc-0bd8-4bf6-867a-36ca763de0c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc99843bb204044a5dad9cac16b48e2', 'request_id': 'req-270846dc-0bd8-4bf6-867a-36ca763de0c5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:21.378630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-270846dc-0bd8-4bf6-867a-36ca763de0c5 admin admin] The token cache is being invalidate because project 1cc99843bb204044a5dad9cac16b48e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:03:21.380890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-270846dc-0bd8-4bf6-867a-36ca763de0c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:21.381793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-270846dc-0bd8-4bf6-867a-36ca763de0c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:21.386199 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1335/2631] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:03:21 2022] DELETE /identity/v3/projects/1cc99843bb204044a5dad9cac16b48e2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:21.390465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8c891-434c-4bc0-a5ba-aee77cc4f271 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:21.396133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:21.404339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8c891-434c-4bc0-a5ba-aee77cc4f271 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:21.530587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cee57e-ca01-4acc-b739-dcb325afd096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:21.531521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cee57e-ca01-4acc-b739-dcb325afd096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:21.531748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cee57e-ca01-4acc-b739-dcb325afd096 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:21.532025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cee57e-ca01-4acc-b739-dcb325afd096 admin admin] PATH_INFO: `/v3/users/2f57b8c3441a4829abb628a4a29c7013` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:21.537343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cee57e-ca01-4acc-b739-dcb325afd096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f57b8c3441a4829abb628a4a29c7013)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:21.539475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cee57e-ca01-4acc-b739-dcb325afd096 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:21.635921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-30cee57e-ca01-4acc-b739-dcb325afd096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f57b8c3441a4829abb628a4a29c7013'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:21.649651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-30cee57e-ca01-4acc-b739-dcb325afd096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f57b8c3441a4829abb628a4a29c7013'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:21.660200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-30cee57e-ca01-4acc-b739-dcb325afd096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f57b8c3441a4829abb628a4a29c7013'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:21.661229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-30cee57e-ca01-4acc-b739-dcb325afd096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f57b8c3441a4829abb628a4a29c7013'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:21.662081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-30cee57e-ca01-4acc-b739-dcb325afd096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f57b8c3441a4829abb628a4a29c7013'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:21.685832 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1297/2632] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:03:21 2022] DELETE /identity/v3/users/2f57b8c3441a4829abb628a4a29c7013 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:22.123637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270846dc-0bd8-4bf6-867a-36ca763de0c5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:22.127741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-270846dc-0bd8-4bf6-867a-36ca763de0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:22.146573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270846dc-0bd8-4bf6-867a-36ca763de0c5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:22.229883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:22.243666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd4d39-689f-4783-920d-14d8a1815319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:22.244733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd4d39-689f-4783-920d-14d8a1815319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:22.245071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd4d39-689f-4783-920d-14d8a1815319 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:22.245380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd4d39-689f-4783-920d-14d8a1815319 admin admin] PATH_INFO: `/v3/projects/76c63dc7677845fcacf1f456ab365ccd` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:22.246729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd4d39-689f-4783-920d-14d8a1815319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76c63dc7677845fcacf1f456ab365ccd)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:22.250667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd4d39-689f-4783-920d-14d8a1815319 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:22.340367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bccd4d39-689f-4783-920d-14d8a1815319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76c63dc7677845fcacf1f456ab365ccd', 'request_id': 'req-bccd4d39-689f-4783-920d-14d8a1815319'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:22.351738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bccd4d39-689f-4783-920d-14d8a1815319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76c63dc7677845fcacf1f456ab365ccd', 'request_id': 'req-bccd4d39-689f-4783-920d-14d8a1815319'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:22.366809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bccd4d39-689f-4783-920d-14d8a1815319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76c63dc7677845fcacf1f456ab365ccd', 'request_id': 'req-bccd4d39-689f-4783-920d-14d8a1815319'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:22.382834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bccd4d39-689f-4783-920d-14d8a1815319 admin admin] The token cache is being invalidate because project 76c63dc7677845fcacf1f456ab365ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:03:22.383285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bccd4d39-689f-4783-920d-14d8a1815319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:22.384003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bccd4d39-689f-4783-920d-14d8a1815319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:22.386728 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1336/2633] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:03:22 2022] DELETE /identity/v3/projects/76c63dc7677845fcacf1f456ab365ccd => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:22.391826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04b59a-0204-4d3b-b8a2-d093b819c09e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:22.392325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04b59a-0204-4d3b-b8a2-d093b819c09e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:22.392409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04b59a-0204-4d3b-b8a2-d093b819c09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:22.416074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5a04b59a-0204-4d3b-b8a2-d093b819c09e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:22.417401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5a04b59a-0204-4d3b-b8a2-d093b819c09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:22.496209 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1298/2634] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:22.504591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a78533-632f-4ce7-ab0e-d4c8854ba4cb None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:22.504897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a78533-632f-4ce7-ab0e-d4c8854ba4cb None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:22.505180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a78533-632f-4ce7-ab0e-d4c8854ba4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:22.530208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-20a78533-632f-4ce7-ab0e-d4c8854ba4cb None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:22.531487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-20a78533-632f-4ce7-ab0e-d4c8854ba4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:22.544210 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1337/2635] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:22.548779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04b59a-0204-4d3b-b8a2-d093b819c09e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:22.567918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04b59a-0204-4d3b-b8a2-d093b819c09e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:22.581096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f24f6-9663-4336-88de-8260572aeb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:22.582028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f24f6-9663-4336-88de-8260572aeb40 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:22.582320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f24f6-9663-4336-88de-8260572aeb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:22.582578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f24f6-9663-4336-88de-8260572aeb40 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:22.583463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f24f6-9663-4336-88de-8260572aeb40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:03:22.583773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f24f6-9663-4336-88de-8260572aeb40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:22.585675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f24f6-9663-4336-88de-8260572aeb40 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:22.601409 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1299/2636] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:03:22.605591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a78533-632f-4ce7-ab0e-d4c8854ba4cb None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:22.616771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a78533-632f-4ce7-ab0e-d4c8854ba4cb None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:22.622501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37539124-e627-4c15-b8cd-904f9b04e57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:22.623424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37539124-e627-4c15-b8cd-904f9b04e57e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:22.623959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37539124-e627-4c15-b8cd-904f9b04e57e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:22.624511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37539124-e627-4c15-b8cd-904f9b04e57e admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:22.625415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37539124-e627-4c15-b8cd-904f9b04e57e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:22.628753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37539124-e627-4c15-b8cd-904f9b04e57e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:22.666679 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1338/2637] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:03:22 2022] POST /identity/v3/projects => generated 395 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:22.668702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f24f6-9663-4336-88de-8260572aeb40 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:22.680494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f24f6-9663-4336-88de-8260572aeb40 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:22.685918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:22.758872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e536e-2f51-4ec7-9c2b-27c2d195150b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:22.759556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e536e-2f51-4ec7-9c2b-27c2d195150b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:22.759840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e536e-2f51-4ec7-9c2b-27c2d195150b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:22.760168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e536e-2f51-4ec7-9c2b-27c2d195150b admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:22.760906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e536e-2f51-4ec7-9c2b-27c2d195150b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:22.763536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e536e-2f51-4ec7-9c2b-27c2d195150b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:22.792286 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1300/2638] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:03:22 2022] POST /identity/v3/users => generated 298 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:22.793923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37539124-e627-4c15-b8cd-904f9b04e57e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:22.810196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37539124-e627-4c15-b8cd-904f9b04e57e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:22.817004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d6a3d-9977-47eb-add5-b5b52889254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:22.818472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d6a3d-9977-47eb-add5-b5b52889254a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:22.818616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d6a3d-9977-47eb-add5-b5b52889254a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:22.818810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d6a3d-9977-47eb-add5-b5b52889254a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:22.819995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d6a3d-9977-47eb-add5-b5b52889254a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:22.821296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d6a3d-9977-47eb-add5-b5b52889254a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:22.835765 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1339/2639] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:03:22.839781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e536e-2f51-4ec7-9c2b-27c2d195150b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:22.852188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e536e-2f51-4ec7-9c2b-27c2d195150b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:22.858427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c647bc1-818c-48d8-8bd9-aaab31073dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:22.859113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c647bc1-818c-48d8-8bd9-aaab31073dfb admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:22.859398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c647bc1-818c-48d8-8bd9-aaab31073dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:22.859678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c647bc1-818c-48d8-8bd9-aaab31073dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:22.860456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c647bc1-818c-48d8-8bd9-aaab31073dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:22.862069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c647bc1-818c-48d8-8bd9-aaab31073dfb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:22.874138 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1301/2640] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:03:22.878191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d6a3d-9977-47eb-add5-b5b52889254a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:22.903699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d6a3d-9977-47eb-add5-b5b52889254a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:22.910513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dad1d5-e3b0-4e9d-b04d-ad66a8dc1b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:22.911375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dad1d5-e3b0-4e9d-b04d-ad66a8dc1b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:22.911656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dad1d5-e3b0-4e9d-b04d-ad66a8dc1b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:22.911929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dad1d5-e3b0-4e9d-b04d-ad66a8dc1b92 admin admin] PATH_INFO: `/v3/projects/a338b957d2b54fe58eeb6e7ab0834d26/users/074598e5e56e45818de003076d942361/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:22.930885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dad1d5-e3b0-4e9d-b04d-ad66a8dc1b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a338b957d2b54fe58eeb6e7ab0834d26, user_id=074598e5e56e45818de003076d942361, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:22.934281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dad1d5-e3b0-4e9d-b04d-ad66a8dc1b92 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:22.952541 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1340/2641] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:03:22 2022] PUT /identity/v3/projects/a338b957d2b54fe58eeb6e7ab0834d26/users/074598e5e56e45818de003076d942361/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:22.963982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a6b16-39d5-482b-b82e-2a0706f3c859 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:22.964315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a6b16-39d5-482b-b82e-2a0706f3c859 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:22.964593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a6b16-39d5-482b-b82e-2a0706f3c859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:22.992935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-746a6b16-39d5-482b-b82e-2a0706f3c859 None None] MFA Rules not processed for user `074598e5e56e45818de003076d942361`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:22.994053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-746a6b16-39d5-482b-b82e-2a0706f3c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:23.078299 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1302/2642] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:23.080027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dad1d5-e3b0-4e9d-b04d-ad66a8dc1b92 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:23.165166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dad1d5-e3b0-4e9d-b04d-ad66a8dc1b92 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:23.170594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69f1ee-4ca8-427e-ae0a-0711bc51372b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:23.171430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69f1ee-4ca8-427e-ae0a-0711bc51372b admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:23.171812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69f1ee-4ca8-427e-ae0a-0711bc51372b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:23.172237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69f1ee-4ca8-427e-ae0a-0711bc51372b admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:23.173050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69f1ee-4ca8-427e-ae0a-0711bc51372b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:23.175146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69f1ee-4ca8-427e-ae0a-0711bc51372b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:23.209004 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1341/2643] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:03:23 2022] POST /identity/v3/projects => generated 393 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:23.213281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a6b16-39d5-482b-b82e-2a0706f3c859 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:23.224893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a6b16-39d5-482b-b82e-2a0706f3c859 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:23.301326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a8d59-e33c-4c2a-9802-6182f8a31c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:23.302253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a8d59-e33c-4c2a-9802-6182f8a31c87 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:23.303124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a8d59-e33c-4c2a-9802-6182f8a31c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:23.303456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a8d59-e33c-4c2a-9802-6182f8a31c87 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:23.304315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a8d59-e33c-4c2a-9802-6182f8a31c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:23.306326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a8d59-e33c-4c2a-9802-6182f8a31c87 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:23.334196 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1303/2644] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:03:23 2022] POST /identity/v3/users => generated 303 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:23.338047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69f1ee-4ca8-427e-ae0a-0711bc51372b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:23.346970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:23.355090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69f1ee-4ca8-427e-ae0a-0711bc51372b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:23.366846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2d05a-87d7-4e44-b5f2-8f0ecec306c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:23.367696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2d05a-87d7-4e44-b5f2-8f0ecec306c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:23.370598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2d05a-87d7-4e44-b5f2-8f0ecec306c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:23.371637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2d05a-87d7-4e44-b5f2-8f0ecec306c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:23.371637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2d05a-87d7-4e44-b5f2-8f0ecec306c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:23.373446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2d05a-87d7-4e44-b5f2-8f0ecec306c9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:23.389607 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1342/2645] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:03:23.394094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a8d59-e33c-4c2a-9802-6182f8a31c87 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:23.405049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a8d59-e33c-4c2a-9802-6182f8a31c87 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:23.409891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75102002-3801-4db5-b6e5-14fa1e8afd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:23.410786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75102002-3801-4db5-b6e5-14fa1e8afd26 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:23.411062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75102002-3801-4db5-b6e5-14fa1e8afd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:23.413803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75102002-3801-4db5-b6e5-14fa1e8afd26 admin admin] PATH_INFO: `/v3/projects/0271a096c78149f59741b485f9db3f84/users/4b86a2ead5e24287a97ddcfa4ac89718/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:23.414440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:23.432695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75102002-3801-4db5-b6e5-14fa1e8afd26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0271a096c78149f59741b485f9db3f84, user_id=4b86a2ead5e24287a97ddcfa4ac89718, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:23.439858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75102002-3801-4db5-b6e5-14fa1e8afd26 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:23.460626 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1304/2646] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:03:23 2022] PUT /identity/v3/projects/0271a096c78149f59741b485f9db3f84/users/4b86a2ead5e24287a97ddcfa4ac89718/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:23.464537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2d05a-87d7-4e44-b5f2-8f0ecec306c9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:23.479168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2d05a-87d7-4e44-b5f2-8f0ecec306c9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:23.562104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50ef96-6752-48d7-a208-e94ac901aeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:23.563841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50ef96-6752-48d7-a208-e94ac901aeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:23.564361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50ef96-6752-48d7-a208-e94ac901aeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:23.564785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50ef96-6752-48d7-a208-e94ac901aeb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:23.566456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50ef96-6752-48d7-a208-e94ac901aeb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:23.568984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50ef96-6752-48d7-a208-e94ac901aeb7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:23.585875 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1343/2647] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:03:23.590549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75102002-3801-4db5-b6e5-14fa1e8afd26 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:23.605144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75102002-3801-4db5-b6e5-14fa1e8afd26 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:23.611105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79c1f9-65b0-4577-b9a1-64ec3d988031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:23.612104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79c1f9-65b0-4577-b9a1-64ec3d988031 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:23.612763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79c1f9-65b0-4577-b9a1-64ec3d988031 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:23.613291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79c1f9-65b0-4577-b9a1-64ec3d988031 admin admin] PATH_INFO: `/v3/projects/0271a096c78149f59741b485f9db3f84/users/4b86a2ead5e24287a97ddcfa4ac89718/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:23.615688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79c1f9-65b0-4577-b9a1-64ec3d988031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0271a096c78149f59741b485f9db3f84, user_id=4b86a2ead5e24287a97ddcfa4ac89718, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:23.619146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79c1f9-65b0-4577-b9a1-64ec3d988031 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:23.632618 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1305/2648] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:03:23 2022] PUT /identity/v3/projects/0271a096c78149f59741b485f9db3f84/users/4b86a2ead5e24287a97ddcfa4ac89718/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:23.646545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ca0fc-2f7e-46dc-8953-a9121348a1de None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:23.646545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ca0fc-2f7e-46dc-8953-a9121348a1de None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:23.646545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ca0fc-2f7e-46dc-8953-a9121348a1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:23.679204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a62ca0fc-2f7e-46dc-8953-a9121348a1de None None] MFA Rules not processed for user `4b86a2ead5e24287a97ddcfa4ac89718`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:23.680756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a62ca0fc-2f7e-46dc-8953-a9121348a1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:23.776167 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1344/2649] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:23.962400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79c1f9-65b0-4577-b9a1-64ec3d988031 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:23.966468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1a79c1f9-65b0-4577-b9a1-64ec3d988031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:24.076073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79c1f9-65b0-4577-b9a1-64ec3d988031 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:24.088176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c416fc8-2e33-47e8-82e3-eb3b6a70531d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:24.094983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c416fc8-2e33-47e8-82e3-eb3b6a70531d service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:24.095538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c416fc8-2e33-47e8-82e3-eb3b6a70531d service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:24.096181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c416fc8-2e33-47e8-82e3-eb3b6a70531d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:24.109395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c416fc8-2e33-47e8-82e3-eb3b6a70531d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:24.111815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c416fc8-2e33-47e8-82e3-eb3b6a70531d service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:24.125834 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1306/2650] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:03:24.595353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ca0fc-2f7e-46dc-8953-a9121348a1de None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:24.737434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ca0fc-2f7e-46dc-8953-a9121348a1de None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:24.742594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0346c5-40de-4b9a-9de2-941ccf278e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:24.743750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0346c5-40de-4b9a-9de2-941ccf278e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:24.744244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0346c5-40de-4b9a-9de2-941ccf278e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:24.744695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0346c5-40de-4b9a-9de2-941ccf278e81 admin admin] PATH_INFO: `/v3/users/074598e5e56e45818de003076d942361` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:24.746071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0346c5-40de-4b9a-9de2-941ccf278e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=074598e5e56e45818de003076d942361)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:24.748486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0346c5-40de-4b9a-9de2-941ccf278e81 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:24.773489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:24.819835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-df0346c5-40de-4b9a-9de2-941ccf278e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074598e5e56e45818de003076d942361'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:24.831774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-df0346c5-40de-4b9a-9de2-941ccf278e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074598e5e56e45818de003076d942361'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:24.832540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-df0346c5-40de-4b9a-9de2-941ccf278e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074598e5e56e45818de003076d942361'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:24.833262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-df0346c5-40de-4b9a-9de2-941ccf278e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074598e5e56e45818de003076d942361'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:24.842885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-df0346c5-40de-4b9a-9de2-941ccf278e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074598e5e56e45818de003076d942361'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:24.870170 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1345/2651] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:03:24 2022] DELETE /identity/v3/users/074598e5e56e45818de003076d942361 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:24.875173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768fd1c-ea8c-48bd-9d93-5f83735110e1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:24.875688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768fd1c-ea8c-48bd-9d93-5f83735110e1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:24.875688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768fd1c-ea8c-48bd-9d93-5f83735110e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:24.896184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5768fd1c-ea8c-48bd-9d93-5f83735110e1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:24.897349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5768fd1c-ea8c-48bd-9d93-5f83735110e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:24.978933 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1307/2652] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:24.988774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0346c5-40de-4b9a-9de2-941ccf278e81 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:24.990346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-df0346c5-40de-4b9a-9de2-941ccf278e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:25.085113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0346c5-40de-4b9a-9de2-941ccf278e81 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:25.100726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee1c51-c4ac-4979-91c7-f39f39b1386f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:25.101416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee1c51-c4ac-4979-91c7-f39f39b1386f service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:25.102051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee1c51-c4ac-4979-91c7-f39f39b1386f service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:25.102354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee1c51-c4ac-4979-91c7-f39f39b1386f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:25.114490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee1c51-c4ac-4979-91c7-f39f39b1386f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:25.115811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee1c51-c4ac-4979-91c7-f39f39b1386f service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:25.128996 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1346/2653] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:03:25.478976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768fd1c-ea8c-48bd-9d93-5f83735110e1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:25.481158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5768fd1c-ea8c-48bd-9d93-5f83735110e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:25.507174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768fd1c-ea8c-48bd-9d93-5f83735110e1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:25.512635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b72d8e-c69c-4a8c-8e85-19fa52790296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:25.513326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b72d8e-c69c-4a8c-8e85-19fa52790296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:25.513603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b72d8e-c69c-4a8c-8e85-19fa52790296 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:25.513922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b72d8e-c69c-4a8c-8e85-19fa52790296 admin admin] PATH_INFO: `/v3/projects/a338b957d2b54fe58eeb6e7ab0834d26` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:25.515497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b72d8e-c69c-4a8c-8e85-19fa52790296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a338b957d2b54fe58eeb6e7ab0834d26)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:25.535159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b72d8e-c69c-4a8c-8e85-19fa52790296 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:25.646433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-84b72d8e-c69c-4a8c-8e85-19fa52790296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a338b957d2b54fe58eeb6e7ab0834d26', 'request_id': 'req-84b72d8e-c69c-4a8c-8e85-19fa52790296'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:25.648150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:25.664504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-84b72d8e-c69c-4a8c-8e85-19fa52790296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a338b957d2b54fe58eeb6e7ab0834d26', 'request_id': 'req-84b72d8e-c69c-4a8c-8e85-19fa52790296'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:25.674572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-84b72d8e-c69c-4a8c-8e85-19fa52790296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a338b957d2b54fe58eeb6e7ab0834d26', 'request_id': 'req-84b72d8e-c69c-4a8c-8e85-19fa52790296'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:25.696842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-84b72d8e-c69c-4a8c-8e85-19fa52790296 admin admin] The token cache is being invalidate because project a338b957d2b54fe58eeb6e7ab0834d26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:03:25.697190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-84b72d8e-c69c-4a8c-8e85-19fa52790296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:25.701835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-84b72d8e-c69c-4a8c-8e85-19fa52790296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:25.706495 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1308/2654] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:03:25 2022] DELETE /identity/v3/projects/a338b957d2b54fe58eeb6e7ab0834d26 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:25.707930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee1c51-c4ac-4979-91c7-f39f39b1386f service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:25.721586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee1c51-c4ac-4979-91c7-f39f39b1386f service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:25.884427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad8800-ef8d-4969-9ae0-888782dc6099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:25.885271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad8800-ef8d-4969-9ae0-888782dc6099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:25.885606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad8800-ef8d-4969-9ae0-888782dc6099 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:25.886057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad8800-ef8d-4969-9ae0-888782dc6099 admin admin] PATH_INFO: `/v3/users/4b86a2ead5e24287a97ddcfa4ac89718` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:25.887668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad8800-ef8d-4969-9ae0-888782dc6099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b86a2ead5e24287a97ddcfa4ac89718)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:25.890832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad8800-ef8d-4969-9ae0-888782dc6099 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:25.972855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:25.984112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fcad8800-ef8d-4969-9ae0-888782dc6099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b86a2ead5e24287a97ddcfa4ac89718'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:26.014506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fcad8800-ef8d-4969-9ae0-888782dc6099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b86a2ead5e24287a97ddcfa4ac89718'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:26.015331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fcad8800-ef8d-4969-9ae0-888782dc6099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b86a2ead5e24287a97ddcfa4ac89718'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:26.016417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fcad8800-ef8d-4969-9ae0-888782dc6099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b86a2ead5e24287a97ddcfa4ac89718'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:26.028068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fcad8800-ef8d-4969-9ae0-888782dc6099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b86a2ead5e24287a97ddcfa4ac89718'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:26.067673 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1347/2655] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:03:25 2022] DELETE /identity/v3/users/4b86a2ead5e24287a97ddcfa4ac89718 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:27.493390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b72d8e-c69c-4a8c-8e85-19fa52790296 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:27.496636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-84b72d8e-c69c-4a8c-8e85-19fa52790296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:27.535738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b72d8e-c69c-4a8c-8e85-19fa52790296 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:27.775967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e202786-97ce-411a-8796-e4cbecae7fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:27.776981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e202786-97ce-411a-8796-e4cbecae7fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:27.777256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e202786-97ce-411a-8796-e4cbecae7fac admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:27.777630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e202786-97ce-411a-8796-e4cbecae7fac admin admin] PATH_INFO: `/v3/projects/0271a096c78149f59741b485f9db3f84` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:27.779533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e202786-97ce-411a-8796-e4cbecae7fac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0271a096c78149f59741b485f9db3f84)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:27.805797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e202786-97ce-411a-8796-e4cbecae7fac admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:27.915037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3e202786-97ce-411a-8796-e4cbecae7fac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0271a096c78149f59741b485f9db3f84', 'request_id': 'req-3e202786-97ce-411a-8796-e4cbecae7fac'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:27.932821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3e202786-97ce-411a-8796-e4cbecae7fac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0271a096c78149f59741b485f9db3f84', 'request_id': 'req-3e202786-97ce-411a-8796-e4cbecae7fac'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:27.941315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3e202786-97ce-411a-8796-e4cbecae7fac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0271a096c78149f59741b485f9db3f84', 'request_id': 'req-3e202786-97ce-411a-8796-e4cbecae7fac'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:27.966822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3e202786-97ce-411a-8796-e4cbecae7fac admin admin] The token cache is being invalidate because project 0271a096c78149f59741b485f9db3f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:03:27.966822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3e202786-97ce-411a-8796-e4cbecae7fac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:27.966822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3e202786-97ce-411a-8796-e4cbecae7fac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:03:27.969234 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1309/2656] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:03:27 2022] DELETE /identity/v3/projects/0271a096c78149f59741b485f9db3f84 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:27.979025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3653d6-5947-4434-92c1-97243856e70a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:27.982348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3653d6-5947-4434-92c1-97243856e70a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:27.983058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3653d6-5947-4434-92c1-97243856e70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:28.026617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-af3653d6-5947-4434-92c1-97243856e70a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:28.030005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-af3653d6-5947-4434-92c1-97243856e70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:28.144501 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1348/2657] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:28.152104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f31f63-bcfa-45a8-ab4b-421eca9a41ed None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:28.152741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f31f63-bcfa-45a8-ab4b-421eca9a41ed None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:28.153223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f31f63-bcfa-45a8-ab4b-421eca9a41ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:28.198515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-73f31f63-bcfa-45a8-ab4b-421eca9a41ed None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:28.199867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-73f31f63-bcfa-45a8-ab4b-421eca9a41ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:28.217119 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1310/2658] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:03:28.221162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3653d6-5947-4434-92c1-97243856e70a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:28.234927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3653d6-5947-4434-92c1-97243856e70a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:28.248855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88f08e-eff0-4129-b3b4-bb919c08cc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:28.249280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88f08e-eff0-4129-b3b4-bb919c08cc3d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:28.249537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88f08e-eff0-4129-b3b4-bb919c08cc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:28.249811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88f08e-eff0-4129-b3b4-bb919c08cc3d admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:28.250891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88f08e-eff0-4129-b3b4-bb919c08cc3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:03:28.250891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88f08e-eff0-4129-b3b4-bb919c08cc3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:28.252567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88f08e-eff0-4129-b3b4-bb919c08cc3d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:28.293132 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1349/2659] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:03:28.297493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f31f63-bcfa-45a8-ab4b-421eca9a41ed None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:28.310011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f31f63-bcfa-45a8-ab4b-421eca9a41ed None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:28.322188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cd7e2-583a-41a3-a1cb-ce7b42610ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:28.322863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cd7e2-583a-41a3-a1cb-ce7b42610ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:28.323136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cd7e2-583a-41a3-a1cb-ce7b42610ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:28.323441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cd7e2-583a-41a3-a1cb-ce7b42610ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:28.324173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cd7e2-583a-41a3-a1cb-ce7b42610ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:28.327830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cd7e2-583a-41a3-a1cb-ce7b42610ae0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:28.387290 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1311/2660] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:03:28 2022] POST /identity/v3/projects => generated 393 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:28.393226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88f08e-eff0-4129-b3b4-bb919c08cc3d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:28.410795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88f08e-eff0-4129-b3b4-bb919c08cc3d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:28.533798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19165ae5-9fdd-44a3-8ee1-ecf8832851fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:28.534734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19165ae5-9fdd-44a3-8ee1-ecf8832851fb admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:28.535179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19165ae5-9fdd-44a3-8ee1-ecf8832851fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:28.535609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19165ae5-9fdd-44a3-8ee1-ecf8832851fb admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:28.536504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19165ae5-9fdd-44a3-8ee1-ecf8832851fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:28.539572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19165ae5-9fdd-44a3-8ee1-ecf8832851fb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:28.575008 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1350/2661] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:03:28 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:28.579383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cd7e2-583a-41a3-a1cb-ce7b42610ae0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:28.602847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cd7e2-583a-41a3-a1cb-ce7b42610ae0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:28.616965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf5849-9d65-405b-be8c-cf5c05c92914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:28.617670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf5849-9d65-405b-be8c-cf5c05c92914 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:28.617950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf5849-9d65-405b-be8c-cf5c05c92914 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:28.618221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf5849-9d65-405b-be8c-cf5c05c92914 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:28.618970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf5849-9d65-405b-be8c-cf5c05c92914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:28.620604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf5849-9d65-405b-be8c-cf5c05c92914 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:28.636315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19165ae5-9fdd-44a3-8ee1-ecf8832851fb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:28.644339 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1312/2662] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:03:28.651882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19165ae5-9fdd-44a3-8ee1-ecf8832851fb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:28.665625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f8695-b8ff-490f-a2f3-31d5e0e5a5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:28.666334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f8695-b8ff-490f-a2f3-31d5e0e5a5aa admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:28.666618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f8695-b8ff-490f-a2f3-31d5e0e5a5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:28.667029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f8695-b8ff-490f-a2f3-31d5e0e5a5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:28.667773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f8695-b8ff-490f-a2f3-31d5e0e5a5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:28.673475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f8695-b8ff-490f-a2f3-31d5e0e5a5aa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:28.703205 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1351/2663] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:03:28.706144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf5849-9d65-405b-be8c-cf5c05c92914 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:28.716797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf5849-9d65-405b-be8c-cf5c05c92914 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:28.750175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dca515-96b5-4945-b163-22ee5a1480e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:28.751096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dca515-96b5-4945-b163-22ee5a1480e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:28.751358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dca515-96b5-4945-b163-22ee5a1480e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:28.751680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dca515-96b5-4945-b163-22ee5a1480e2 admin admin] PATH_INFO: `/v3/projects/48b2d24d625d4151b67de30f8fa7b918/users/6c9e360aff3b43688e88f739a1723921/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:28.789909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dca515-96b5-4945-b163-22ee5a1480e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b2d24d625d4151b67de30f8fa7b918, user_id=6c9e360aff3b43688e88f739a1723921, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:28.792591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dca515-96b5-4945-b163-22ee5a1480e2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:28.809938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27330358-b4cb-4e5c-ac5a-3409da5dfc5b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:28.810294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27330358-b4cb-4e5c-ac5a-3409da5dfc5b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:28.810595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27330358-b4cb-4e5c-ac5a-3409da5dfc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:28.820739 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1313/2664] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:03:28 2022] PUT /identity/v3/projects/48b2d24d625d4151b67de30f8fa7b918/users/6c9e360aff3b43688e88f739a1723921/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:28.873465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-27330358-b4cb-4e5c-ac5a-3409da5dfc5b None None] MFA Rules not processed for user `223fd6f7a4c84114af7a22eb19cc7034`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:28.874565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-27330358-b4cb-4e5c-ac5a-3409da5dfc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:28.894030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:28.914689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aabca1-a813-41e2-9cf7-8e1d04b6d1a3 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:28.914970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aabca1-a813-41e2-9cf7-8e1d04b6d1a3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:28.915475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aabca1-a813-41e2-9cf7-8e1d04b6d1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:28.923257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:28.965305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-50aabca1-a813-41e2-9cf7-8e1d04b6d1a3 None None] MFA Rules not processed for user `6c9e360aff3b43688e88f739a1723921`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:28.966671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-50aabca1-a813-41e2-9cf7-8e1d04b6d1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:29.019117 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1352/2665] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:29.031748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188d107-a30f-47e5-a1b1-5d9cebed2897 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:29.032297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188d107-a30f-47e5-a1b1-5d9cebed2897 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:29.032416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188d107-a30f-47e5-a1b1-5d9cebed2897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:29.087266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f188d107-a30f-47e5-a1b1-5d9cebed2897 None None] MFA Rules not processed for user `223fd6f7a4c84114af7a22eb19cc7034`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:29.088937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f188d107-a30f-47e5-a1b1-5d9cebed2897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:29.118343 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1353/2666] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:29.129803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188d107-a30f-47e5-a1b1-5d9cebed2897 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:29.131257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f188d107-a30f-47e5-a1b1-5d9cebed2897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:29.160864 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1314/2667] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:03:29.173627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aabca1-a813-41e2-9cf7-8e1d04b6d1a3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:29.310626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188d107-a30f-47e5-a1b1-5d9cebed2897 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:29.316393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aabca1-a813-41e2-9cf7-8e1d04b6d1a3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:29.328359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502f189-df87-47d4-bc98-40cae8795d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:29.329048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502f189-df87-47d4-bc98-40cae8795d80 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:29.329332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502f189-df87-47d4-bc98-40cae8795d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:29.329700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502f189-df87-47d4-bc98-40cae8795d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:29.330503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502f189-df87-47d4-bc98-40cae8795d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:29.332467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502f189-df87-47d4-bc98-40cae8795d80 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:29.347358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53083579-bf9a-4fcb-a0f9-a833a7fff4a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:29.357611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53083579-bf9a-4fcb-a0f9-a833a7fff4a3 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:29.357917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53083579-bf9a-4fcb-a0f9-a833a7fff4a3 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:29.358204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53083579-bf9a-4fcb-a0f9-a833a7fff4a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:29.380919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53083579-bf9a-4fcb-a0f9-a833a7fff4a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:29.386207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53083579-bf9a-4fcb-a0f9-a833a7fff4a3 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:29.418622 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1315/2668] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:03:29 2022] POST /identity/v3/projects => generated 391 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:29.422445 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1354/2669] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:03:29.437683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de3d62-4da5-4289-adf5-99313c4e0d84 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:29.438919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53083579-bf9a-4fcb-a0f9-a833a7fff4a3 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:29.440282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de3d62-4da5-4289-adf5-99313c4e0d84 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:29.441098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de3d62-4da5-4289-adf5-99313c4e0d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:29.488329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53083579-bf9a-4fcb-a0f9-a833a7fff4a3 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:29.529180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-47de3d62-4da5-4289-adf5-99313c4e0d84 None None] MFA Rules not processed for user `bd452195a8d8423a9957773af081b75f`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:29.530745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-47de3d62-4da5-4289-adf5-99313c4e0d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:29.640600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f14064-660a-4a15-a6c3-e9711b0950a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:29.642002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f14064-660a-4a15-a6c3-e9711b0950a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:29.642500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f14064-660a-4a15-a6c3-e9711b0950a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:29.643298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f14064-660a-4a15-a6c3-e9711b0950a6 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:29.644612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f14064-660a-4a15-a6c3-e9711b0950a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:29.650116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f14064-660a-4a15-a6c3-e9711b0950a6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:29.654771 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1316/2670] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:29.676879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de3d62-4da5-4289-adf5-99313c4e0d84 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:29.679312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-47de3d62-4da5-4289-adf5-99313c4e0d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:29.685661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:29.695387 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1355/2671] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:03:29 2022] POST /identity/v3/users => generated 302 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:03:29.703157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f14064-660a-4a15-a6c3-e9711b0950a6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:29.728521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f14064-660a-4a15-a6c3-e9711b0950a6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:29.748621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97fabc-5788-4e76-81b3-431c91b05c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:29.750177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97fabc-5788-4e76-81b3-431c91b05c7a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:29.750722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97fabc-5788-4e76-81b3-431c91b05c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:29.751984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97fabc-5788-4e76-81b3-431c91b05c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:29.753870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97fabc-5788-4e76-81b3-431c91b05c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:29.757264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97fabc-5788-4e76-81b3-431c91b05c7a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:29.779800 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1356/2672] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:03:29.785466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97fabc-5788-4e76-81b3-431c91b05c7a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:29.809064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97fabc-5788-4e76-81b3-431c91b05c7a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:29.824325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b8256-1001-478b-a5e0-e5b03bb26fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:29.825578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b8256-1001-478b-a5e0-e5b03bb26fce admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:29.826972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b8256-1001-478b-a5e0-e5b03bb26fce admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:29.827474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b8256-1001-478b-a5e0-e5b03bb26fce admin admin] PATH_INFO: `/v3/projects/9014a6e32f3442ca8336f44a9d311b56/users/43df10ed0fb64a6e909b08989e0b226d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:29.844866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:29.875964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b8256-1001-478b-a5e0-e5b03bb26fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9014a6e32f3442ca8336f44a9d311b56, user_id=43df10ed0fb64a6e909b08989e0b226d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:29.883737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b8256-1001-478b-a5e0-e5b03bb26fce admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:29.899172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de3d62-4da5-4289-adf5-99313c4e0d84 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:29.909244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281abfa6-8e49-41be-8b57-261e099c78f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:29.911250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281abfa6-8e49-41be-8b57-261e099c78f7 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:29.911997 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1357/2673] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:03:29 2022] PUT /identity/v3/projects/9014a6e32f3442ca8336f44a9d311b56/users/43df10ed0fb64a6e909b08989e0b226d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:29.913831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281abfa6-8e49-41be-8b57-261e099c78f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:29.914163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281abfa6-8e49-41be-8b57-261e099c78f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:29.916403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b8256-1001-478b-a5e0-e5b03bb26fce admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:29.921594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-281abfa6-8e49-41be-8b57-261e099c78f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:30.121868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b8256-1001-478b-a5e0-e5b03bb26fce admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:30.128536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cc9e0-8d6f-4c0b-bebd-558196846e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:30.129368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cc9e0-8d6f-4c0b-bebd-558196846e9e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:30.129892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cc9e0-8d6f-4c0b-bebd-558196846e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:30.130269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cc9e0-8d6f-4c0b-bebd-558196846e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:30.131226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691cc9e0-8d6f-4c0b-bebd-558196846e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:30.133171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691cc9e0-8d6f-4c0b-bebd-558196846e9e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:30.148968 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1358/2674] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:03:30.153306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cc9e0-8d6f-4c0b-bebd-558196846e9e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:30.169357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cc9e0-8d6f-4c0b-bebd-558196846e9e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:30.184731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d29c8-7478-40e2-b7c8-eab9516db8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:30.187048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d29c8-7478-40e2-b7c8-eab9516db8c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:30.188632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d29c8-7478-40e2-b7c8-eab9516db8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:30.190156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d29c8-7478-40e2-b7c8-eab9516db8c1 admin admin] PATH_INFO: `/v3/projects/9014a6e32f3442ca8336f44a9d311b56/users/43df10ed0fb64a6e909b08989e0b226d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:30.194769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281abfa6-8e49-41be-8b57-261e099c78f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:30.198653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d29c8-7478-40e2-b7c8-eab9516db8c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9014a6e32f3442ca8336f44a9d311b56, user_id=43df10ed0fb64a6e909b08989e0b226d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:30.199656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281abfa6-8e49-41be-8b57-261e099c78f7 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:30.211088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d29c8-7478-40e2-b7c8-eab9516db8c1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:30.248859 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1317/2675] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:03:30.259107 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1359/2676] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:03:30 2022] PUT /identity/v3/projects/9014a6e32f3442ca8336f44a9d311b56/users/43df10ed0fb64a6e909b08989e0b226d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:03:30.269969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a15387-d3fd-4295-99d8-be14b4099555 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:30.270484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a15387-d3fd-4295-99d8-be14b4099555 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:30.270825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a15387-d3fd-4295-99d8-be14b4099555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:30.321115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b9a15387-d3fd-4295-99d8-be14b4099555 None None] MFA Rules not processed for user `43df10ed0fb64a6e909b08989e0b226d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:30.322549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b9a15387-d3fd-4295-99d8-be14b4099555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:30.486369 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1318/2677] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:30.504425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9a3af-e123-449f-affd-03c06d7b0a0c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:30.504798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9a3af-e123-449f-affd-03c06d7b0a0c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:30.505150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9a3af-e123-449f-affd-03c06d7b0a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:30.552995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0fc9a3af-e123-449f-affd-03c06d7b0a0c None None] MFA Rules not processed for user `6c9e360aff3b43688e88f739a1723921`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:30.555705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0fc9a3af-e123-449f-affd-03c06d7b0a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:30.730705 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1360/2678] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:31.046473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a15387-d3fd-4295-99d8-be14b4099555 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:31.161667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:31.306109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a15387-d3fd-4295-99d8-be14b4099555 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:31.347583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107448f-d795-4ffb-aee7-69fca8467b73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:31.348497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107448f-d795-4ffb-aee7-69fca8467b73 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:31.348780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107448f-d795-4ffb-aee7-69fca8467b73 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:31.349273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107448f-d795-4ffb-aee7-69fca8467b73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:31.389658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107448f-d795-4ffb-aee7-69fca8467b73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:31.391307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107448f-d795-4ffb-aee7-69fca8467b73 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:31.441566 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1319/2679] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:03:34.621727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59246505-013e-43d8-9165-a35b8b9d32bb None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:34.622272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59246505-013e-43d8-9165-a35b8b9d32bb None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:34.623099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59246505-013e-43d8-9165-a35b8b9d32bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:34.671546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-59246505-013e-43d8-9165-a35b8b9d32bb None None] MFA Rules not processed for user `f3287fb85c2343d686718d3c4aaa5c00`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:34.673107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-59246505-013e-43d8-9165-a35b8b9d32bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:34.828773 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1361/2680] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:35.232527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107448f-d795-4ffb-aee7-69fca8467b73 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:35.234653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b107448f-d795-4ffb-aee7-69fca8467b73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:35.475391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107448f-d795-4ffb-aee7-69fca8467b73 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:35.483059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1357bf-0eef-4b1d-97e0-17179e9f5b6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:35.483786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1357bf-0eef-4b1d-97e0-17179e9f5b6f service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:35.483998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1357bf-0eef-4b1d-97e0-17179e9f5b6f service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:35.484321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1357bf-0eef-4b1d-97e0-17179e9f5b6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:35.491843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bc1357bf-0eef-4b1d-97e0-17179e9f5b6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:35.519609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1357bf-0eef-4b1d-97e0-17179e9f5b6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:35.521269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1357bf-0eef-4b1d-97e0-17179e9f5b6f service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:35.541088 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1320/2681] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:03:36.815492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4df14-30c3-493b-99c3-2f2f2917cd45 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:36.816489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4df14-30c3-493b-99c3-2f2f2917cd45 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:36.816930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4df14-30c3-493b-99c3-2f2f2917cd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:36.851517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e0f4df14-30c3-493b-99c3-2f2f2917cd45 None None] MFA Rules not processed for user `a60bf5141fea499abb9b22658e56c944`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:36.854818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e0f4df14-30c3-493b-99c3-2f2f2917cd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:36.889979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:37.022944 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1362/2682] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:38.524212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24394705-445b-4cd0-bb85-8894e5ecb460 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:38.524844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24394705-445b-4cd0-bb85-8894e5ecb460 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:38.524844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24394705-445b-4cd0-bb85-8894e5ecb460 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:38.526465 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1321/2683] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:03:38.553004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da357d-c6e0-4e50-9822-584302f9bc9d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:38.553626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da357d-c6e0-4e50-9822-584302f9bc9d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:38.553626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da357d-c6e0-4e50-9822-584302f9bc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:38.598799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b3da357d-c6e0-4e50-9822-584302f9bc9d None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:38.605109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b3da357d-c6e0-4e50-9822-584302f9bc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:38.634665 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1363/2684] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:03:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:38.667951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24394705-445b-4cd0-bb85-8894e5ecb460 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:38.670319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-24394705-445b-4cd0-bb85-8894e5ecb460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:38.710589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24394705-445b-4cd0-bb85-8894e5ecb460 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:38.742051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1487d4b-1872-45a0-9aa9-b0a95956ad10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:38.742051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1487d4b-1872-45a0-9aa9-b0a95956ad10 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:38.742051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1487d4b-1872-45a0-9aa9-b0a95956ad10 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:38.742051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1487d4b-1872-45a0-9aa9-b0a95956ad10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:38.768288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1487d4b-1872-45a0-9aa9-b0a95956ad10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:38.770309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1487d4b-1872-45a0-9aa9-b0a95956ad10 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:38.788332 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1322/2685] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:03:41.887555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afe51f-6d8a-4592-978e-a64892757c2e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:41.888933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afe51f-6d8a-4592-978e-a64892757c2e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:41.889367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afe51f-6d8a-4592-978e-a64892757c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:41.941105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a5afe51f-6d8a-4592-978e-a64892757c2e None None] MFA Rules not processed for user `b16a9c9e35954d579536375f7eab1c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:41.942603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a5afe51f-6d8a-4592-978e-a64892757c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:42.103717 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1364/2686] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:43.765730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ee4fd-8d7f-4aa2-b319-1f51e8818ec0 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:43.767529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ee4fd-8d7f-4aa2-b319-1f51e8818ec0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:43.767805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ee4fd-8d7f-4aa2-b319-1f51e8818ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:43.798197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-198ee4fd-8d7f-4aa2-b319-1f51e8818ec0 None None] MFA Rules not processed for user `9ee93cc6740d4e92b231f60d8b9d4450`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:43.807023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-198ee4fd-8d7f-4aa2-b319-1f51e8818ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:43.968026 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1323/2687] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:03:52.084359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=45 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:53.940730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=86 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:55.072596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afe51f-6d8a-4592-978e-a64892757c2e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:55.074309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a5afe51f-6d8a-4592-978e-a64892757c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:55.091600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afe51f-6d8a-4592-978e-a64892757c2e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:55.097832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae7019-6b7e-4280-9907-88d82d86a13f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:55.098623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae7019-6b7e-4280-9907-88d82d86a13f service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:55.099118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae7019-6b7e-4280-9907-88d82d86a13f service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:55.100342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae7019-6b7e-4280-9907-88d82d86a13f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:55.109876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae7019-6b7e-4280-9907-88d82d86a13f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:55.111446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae7019-6b7e-4280-9907-88d82d86a13f service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:55.122319 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1365/2688] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:03:55.157724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e715d0-ba9b-4213-8f21-39751c0d0da6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:55.158708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e715d0-ba9b-4213-8f21-39751c0d0da6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:55.158961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e715d0-ba9b-4213-8f21-39751c0d0da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:55.180262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a3e715d0-ba9b-4213-8f21-39751c0d0da6 None None] MFA Rules not processed for user `6c9e360aff3b43688e88f739a1723921`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:03:55.181756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a3e715d0-ba9b-4213-8f21-39751c0d0da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:55.192452 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1324/2689] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:03:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:04.689433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae7019-6b7e-4280-9907-88d82d86a13f service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:04.703103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae7019-6b7e-4280-9907-88d82d86a13f service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:04.708795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d696660-de22-41d9-915a-c58fb4ec4910 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:04.709818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d696660-de22-41d9-915a-c58fb4ec4910 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:04.710255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d696660-de22-41d9-915a-c58fb4ec4910 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:04.711488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d696660-de22-41d9-915a-c58fb4ec4910 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:04.717851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9d696660-de22-41d9-915a-c58fb4ec4910 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:04.736235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d696660-de22-41d9-915a-c58fb4ec4910 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:04.739419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d696660-de22-41d9-915a-c58fb4ec4910 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:04.754431 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1366/2690] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:04:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:04:05.173703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:12.089072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e715d0-ba9b-4213-8f21-39751c0d0da6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:12.090716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a3e715d0-ba9b-4213-8f21-39751c0d0da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:12.187690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e715d0-ba9b-4213-8f21-39751c0d0da6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:12.192509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3c1c2-7159-4f14-9735-f3bf73347310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:12.193482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3c1c2-7159-4f14-9735-f3bf73347310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:12.193759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3c1c2-7159-4f14-9735-f3bf73347310 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:12.194487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3c1c2-7159-4f14-9735-f3bf73347310 admin admin] PATH_INFO: `/v3/users/223fd6f7a4c84114af7a22eb19cc7034` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:12.195676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3c1c2-7159-4f14-9735-f3bf73347310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=223fd6f7a4c84114af7a22eb19cc7034)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:12.197754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3c1c2-7159-4f14-9735-f3bf73347310 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:12.250443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ea3c1c2-7159-4f14-9735-f3bf73347310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '223fd6f7a4c84114af7a22eb19cc7034'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:12.260582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ea3c1c2-7159-4f14-9735-f3bf73347310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '223fd6f7a4c84114af7a22eb19cc7034'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:12.270682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ea3c1c2-7159-4f14-9735-f3bf73347310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '223fd6f7a4c84114af7a22eb19cc7034'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:12.271498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ea3c1c2-7159-4f14-9735-f3bf73347310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '223fd6f7a4c84114af7a22eb19cc7034'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:12.272175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ea3c1c2-7159-4f14-9735-f3bf73347310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '223fd6f7a4c84114af7a22eb19cc7034'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:12.299882 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1325/2691] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:04:12 2022] DELETE /identity/v3/users/223fd6f7a4c84114af7a22eb19cc7034 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:04:12.522044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d696660-de22-41d9-915a-c58fb4ec4910 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:12.533750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d696660-de22-41d9-915a-c58fb4ec4910 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:12.609664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0eb562-b930-4347-8197-bac68e72920f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:12.610863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0eb562-b930-4347-8197-bac68e72920f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:12.611142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0eb562-b930-4347-8197-bac68e72920f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:12.611410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0eb562-b930-4347-8197-bac68e72920f admin admin] PATH_INFO: `/v3/projects/ad0b5a189e934370af07b11ee0a9e737` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:12.612817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0eb562-b930-4347-8197-bac68e72920f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad0b5a189e934370af07b11ee0a9e737)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:12.614754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0eb562-b930-4347-8197-bac68e72920f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:12.679127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cb0eb562-b930-4347-8197-bac68e72920f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad0b5a189e934370af07b11ee0a9e737', 'request_id': 'req-cb0eb562-b930-4347-8197-bac68e72920f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:12.689402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cb0eb562-b930-4347-8197-bac68e72920f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad0b5a189e934370af07b11ee0a9e737', 'request_id': 'req-cb0eb562-b930-4347-8197-bac68e72920f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:12.703403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cb0eb562-b930-4347-8197-bac68e72920f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad0b5a189e934370af07b11ee0a9e737', 'request_id': 'req-cb0eb562-b930-4347-8197-bac68e72920f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:12.716305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cb0eb562-b930-4347-8197-bac68e72920f admin admin] The token cache is being invalidate because project ad0b5a189e934370af07b11ee0a9e737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:04:12.716857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cb0eb562-b930-4347-8197-bac68e72920f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:12.717681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cb0eb562-b930-4347-8197-bac68e72920f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:12.719381 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1367/2692] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:04:12 2022] DELETE /identity/v3/projects/ad0b5a189e934370af07b11ee0a9e737 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:04:12.724599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2ba9b-d479-4729-81c3-872acfee414a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:12.725046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2ba9b-d479-4729-81c3-872acfee414a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:12.725316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2ba9b-d479-4729-81c3-872acfee414a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:12.747827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9dd2ba9b-d479-4729-81c3-872acfee414a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:12.747827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9dd2ba9b-d479-4729-81c3-872acfee414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:12.910467 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1326/2693] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:12.916969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce115c7f-f117-4b9e-9c6f-367b22dacef6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:12.917780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce115c7f-f117-4b9e-9c6f-367b22dacef6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:12.918104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce115c7f-f117-4b9e-9c6f-367b22dacef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:12.962892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ce115c7f-f117-4b9e-9c6f-367b22dacef6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:12.966064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ce115c7f-f117-4b9e-9c6f-367b22dacef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:12.982425 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1368/2694] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:12.985121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2ba9b-d479-4729-81c3-872acfee414a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:13.007871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2ba9b-d479-4729-81c3-872acfee414a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:13.024786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2905d-2803-4664-9162-61f32011dbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:13.025872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2905d-2803-4664-9162-61f32011dbcd admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:13.027375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2905d-2803-4664-9162-61f32011dbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:13.028115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2905d-2803-4664-9162-61f32011dbcd admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:13.029419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2905d-2803-4664-9162-61f32011dbcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:04:13.032621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2905d-2803-4664-9162-61f32011dbcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:13.036577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2905d-2803-4664-9162-61f32011dbcd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:13.079707 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1327/2695] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:04:13.080983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce115c7f-f117-4b9e-9c6f-367b22dacef6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:13.098384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce115c7f-f117-4b9e-9c6f-367b22dacef6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:13.150644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de33957-648f-4e80-8531-62c2089904ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:13.151556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de33957-648f-4e80-8531-62c2089904ee admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:13.153046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de33957-648f-4e80-8531-62c2089904ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:13.155109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de33957-648f-4e80-8531-62c2089904ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:13.156089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de33957-648f-4e80-8531-62c2089904ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:13.160147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de33957-648f-4e80-8531-62c2089904ee admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:13.224963 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1369/2696] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:04:13 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:04:13.229944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2905d-2803-4664-9162-61f32011dbcd admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:13.240562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2905d-2803-4664-9162-61f32011dbcd admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:13.245066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:13.318881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eec45-efe4-4a45-9d37-90655aeedbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:13.319614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eec45-efe4-4a45-9d37-90655aeedbbf admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:13.319878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eec45-efe4-4a45-9d37-90655aeedbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:13.320185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eec45-efe4-4a45-9d37-90655aeedbbf admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:13.321293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8eec45-efe4-4a45-9d37-90655aeedbbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:13.323621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8eec45-efe4-4a45-9d37-90655aeedbbf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:13.372832 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1328/2697] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:04:13 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:04:13.377328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de33957-648f-4e80-8531-62c2089904ee admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:13.391435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de33957-648f-4e80-8531-62c2089904ee admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:13.396600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a7625-0125-4d18-a6a9-35d456bdf06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:13.397277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a7625-0125-4d18-a6a9-35d456bdf06e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:13.397557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a7625-0125-4d18-a6a9-35d456bdf06e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:13.397829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a7625-0125-4d18-a6a9-35d456bdf06e admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:13.398710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a7625-0125-4d18-a6a9-35d456bdf06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:13.400377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a7625-0125-4d18-a6a9-35d456bdf06e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:13.417701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eec45-efe4-4a45-9d37-90655aeedbbf admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:13.423386 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1370/2698] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:04:13.429051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eec45-efe4-4a45-9d37-90655aeedbbf admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:13.434857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1517af1-9509-495d-a363-d0f11f2d1e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:13.435839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1517af1-9509-495d-a363-d0f11f2d1e54 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:13.436320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1517af1-9509-495d-a363-d0f11f2d1e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:13.436587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1517af1-9509-495d-a363-d0f11f2d1e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:13.437511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1517af1-9509-495d-a363-d0f11f2d1e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:13.439320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1517af1-9509-495d-a363-d0f11f2d1e54 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:13.454309 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1329/2699] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:04:13.455323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a7625-0125-4d18-a6a9-35d456bdf06e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:13.494578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a7625-0125-4d18-a6a9-35d456bdf06e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:13.514874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129ba4a-e3ea-43be-bd93-473ee41d12fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:13.519392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129ba4a-e3ea-43be-bd93-473ee41d12fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:13.519690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129ba4a-e3ea-43be-bd93-473ee41d12fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:13.520015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129ba4a-e3ea-43be-bd93-473ee41d12fb admin admin] PATH_INFO: `/v3/projects/8576652bfe8441e0985297d016a1ca9b/users/3fefe83ec0664f6188af74ea4b5c1291/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:13.577105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129ba4a-e3ea-43be-bd93-473ee41d12fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8576652bfe8441e0985297d016a1ca9b, user_id=3fefe83ec0664f6188af74ea4b5c1291, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:13.580627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129ba4a-e3ea-43be-bd93-473ee41d12fb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:13.597218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:13.606251 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1371/2700] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:04:13 2022] PUT /identity/v3/projects/8576652bfe8441e0985297d016a1ca9b/users/3fefe83ec0664f6188af74ea4b5c1291/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:04:13.611587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ec21e-7d5a-4cc6-9038-453d28ee7b25 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:13.612193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ec21e-7d5a-4cc6-9038-453d28ee7b25 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:13.612702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ec21e-7d5a-4cc6-9038-453d28ee7b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:13.649561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-826ec21e-7d5a-4cc6-9038-453d28ee7b25 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:13.651947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-826ec21e-7d5a-4cc6-9038-453d28ee7b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:13.740678 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1330/2701] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:13.777226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129ba4a-e3ea-43be-bd93-473ee41d12fb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:13.788055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f129ba4a-e3ea-43be-bd93-473ee41d12fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:13.876572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129ba4a-e3ea-43be-bd93-473ee41d12fb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:13.882959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d840b9-6017-4347-9b56-57df8f8434f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:13.883813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d840b9-6017-4347-9b56-57df8f8434f1 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:13.884252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d840b9-6017-4347-9b56-57df8f8434f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:13.884527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d840b9-6017-4347-9b56-57df8f8434f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:13.896743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d840b9-6017-4347-9b56-57df8f8434f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:13.898334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d840b9-6017-4347-9b56-57df8f8434f1 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:13.910728 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1372/2702] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:04:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:04:15.247711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8fa94-9662-447f-9fb1-eec78f45c8aa None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:15.248288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8fa94-9662-447f-9fb1-eec78f45c8aa None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:15.248288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8fa94-9662-447f-9fb1-eec78f45c8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:15.267755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-04d8fa94-9662-447f-9fb1-eec78f45c8aa None None] MFA Rules not processed for user `9ee93cc6740d4e92b231f60d8b9d4450`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:15.269418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-04d8fa94-9662-447f-9fb1-eec78f45c8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:15.333728 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1331/2703] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:04:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:04:22.217634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e509c-4eb3-4e19-a1aa-a656bf629ae8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:22.218701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e509c-4eb3-4e19-a1aa-a656bf629ae8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:22.220401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e509c-4eb3-4e19-a1aa-a656bf629ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:22.327692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a51e509c-4eb3-4e19-a1aa-a656bf629ae8 None None] MFA Rules not processed for user `3fefe83ec0664f6188af74ea4b5c1291`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:22.329183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a51e509c-4eb3-4e19-a1aa-a656bf629ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:22.452650 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1373/2704] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:04:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:22.551837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471e79f-689e-4bd0-9f1e-4b0a2ef75e22 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:22.552352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471e79f-689e-4bd0-9f1e-4b0a2ef75e22 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:22.552851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471e79f-689e-4bd0-9f1e-4b0a2ef75e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:22.575717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6471e79f-689e-4bd0-9f1e-4b0a2ef75e22 None None] MFA Rules not processed for user `3fefe83ec0664f6188af74ea4b5c1291`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:22.577312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6471e79f-689e-4bd0-9f1e-4b0a2ef75e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:22.585563 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1332/2705] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:04:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:22.597437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e509c-4eb3-4e19-a1aa-a656bf629ae8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:22.601705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a51e509c-4eb3-4e19-a1aa-a656bf629ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:22.798246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e509c-4eb3-4e19-a1aa-a656bf629ae8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:22.806869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8345d-056c-4055-8787-54137ed98f1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:22.807894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8345d-056c-4055-8787-54137ed98f1e service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:22.808369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8345d-056c-4055-8787-54137ed98f1e service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:22.808818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8345d-056c-4055-8787-54137ed98f1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:22.823346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8345d-056c-4055-8787-54137ed98f1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:22.827391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8345d-056c-4055-8787-54137ed98f1e service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:22.856429 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1374/2706] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:04:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:04:24.643683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471e79f-689e-4bd0-9f1e-4b0a2ef75e22 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:24.645124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6471e79f-689e-4bd0-9f1e-4b0a2ef75e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:24.674782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471e79f-689e-4bd0-9f1e-4b0a2ef75e22 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:24.689164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a68ac6-4a8a-4aec-9203-13a794d09ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:24.690263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a68ac6-4a8a-4aec-9203-13a794d09ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:24.694986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a68ac6-4a8a-4aec-9203-13a794d09ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:24.695501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a68ac6-4a8a-4aec-9203-13a794d09ddd admin admin] PATH_INFO: `/v3/users/6c9e360aff3b43688e88f739a1723921` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:24.699437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a68ac6-4a8a-4aec-9203-13a794d09ddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9e360aff3b43688e88f739a1723921)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:24.701800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a68ac6-4a8a-4aec-9203-13a794d09ddd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:24.752535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:24.805268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-70a68ac6-4a8a-4aec-9203-13a794d09ddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9e360aff3b43688e88f739a1723921'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:24.821344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-70a68ac6-4a8a-4aec-9203-13a794d09ddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9e360aff3b43688e88f739a1723921'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:24.842165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-70a68ac6-4a8a-4aec-9203-13a794d09ddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9e360aff3b43688e88f739a1723921'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:24.843670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-70a68ac6-4a8a-4aec-9203-13a794d09ddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9e360aff3b43688e88f739a1723921'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:24.845737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-70a68ac6-4a8a-4aec-9203-13a794d09ddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9e360aff3b43688e88f739a1723921'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:24.891100 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1333/2707] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:04:24 2022] DELETE /identity/v3/users/6c9e360aff3b43688e88f739a1723921 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:04:24.896560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ff1b7-55ea-4d0d-a7ec-bee3b17bdf97 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:24.897120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ff1b7-55ea-4d0d-a7ec-bee3b17bdf97 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:24.897220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ff1b7-55ea-4d0d-a7ec-bee3b17bdf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:24.950986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bf6ff1b7-55ea-4d0d-a7ec-bee3b17bdf97 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:24.953924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bf6ff1b7-55ea-4d0d-a7ec-bee3b17bdf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:24.995969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:25.136598 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1375/2708] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:25.148906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a68ac6-4a8a-4aec-9203-13a794d09ddd admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:25.150729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-70a68ac6-4a8a-4aec-9203-13a794d09ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:25.325863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a68ac6-4a8a-4aec-9203-13a794d09ddd admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:25.330302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047aab4-e090-4127-a4dd-33d6025edd50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:25.331083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047aab4-e090-4127-a4dd-33d6025edd50 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:25.332663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047aab4-e090-4127-a4dd-33d6025edd50 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:25.333069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047aab4-e090-4127-a4dd-33d6025edd50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:25.347041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047aab4-e090-4127-a4dd-33d6025edd50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:25.348875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047aab4-e090-4127-a4dd-33d6025edd50 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:25.362613 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1334/2709] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:04:25.604400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544ad95-343a-4bb5-99f0-8d5378dd36ac None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:25.604697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544ad95-343a-4bb5-99f0-8d5378dd36ac None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:25.605539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544ad95-343a-4bb5-99f0-8d5378dd36ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:25.661880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047aab4-e090-4127-a4dd-33d6025edd50 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:25.663502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c047aab4-e090-4127-a4dd-33d6025edd50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:25.663720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3544ad95-343a-4bb5-99f0-8d5378dd36ac None None] MFA Rules not processed for user `45991293f65c4c22a91afa74cf8179ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:25.665754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3544ad95-343a-4bb5-99f0-8d5378dd36ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:25.680682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047aab4-e090-4127-a4dd-33d6025edd50 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:25.687286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cac6e-c4a3-4905-93ae-d68891fc740b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:25.688515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cac6e-c4a3-4905-93ae-d68891fc740b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:25.689015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cac6e-c4a3-4905-93ae-d68891fc740b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:25.689392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cac6e-c4a3-4905-93ae-d68891fc740b admin admin] PATH_INFO: `/v3/projects/48b2d24d625d4151b67de30f8fa7b918` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:25.690724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95cac6e-c4a3-4905-93ae-d68891fc740b admin admin] RBAC: Authorizing `identity:delete_project(project_id=48b2d24d625d4151b67de30f8fa7b918)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:25.692783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95cac6e-c4a3-4905-93ae-d68891fc740b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:25.783241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f95cac6e-c4a3-4905-93ae-d68891fc740b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48b2d24d625d4151b67de30f8fa7b918', 'request_id': 'req-f95cac6e-c4a3-4905-93ae-d68891fc740b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:25.786132 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1376/2710] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:04:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:25.791399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f95cac6e-c4a3-4905-93ae-d68891fc740b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48b2d24d625d4151b67de30f8fa7b918', 'request_id': 'req-f95cac6e-c4a3-4905-93ae-d68891fc740b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:25.797822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f128b3-8e91-4a7a-a40b-04258bdac71e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:25.799711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f128b3-8e91-4a7a-a40b-04258bdac71e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:25.800331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f128b3-8e91-4a7a-a40b-04258bdac71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:25.803444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f95cac6e-c4a3-4905-93ae-d68891fc740b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48b2d24d625d4151b67de30f8fa7b918', 'request_id': 'req-f95cac6e-c4a3-4905-93ae-d68891fc740b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:25.830982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e6f128b3-8e91-4a7a-a40b-04258bdac71e None None] MFA Rules not processed for user `45991293f65c4c22a91afa74cf8179ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:25.833064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e6f128b3-8e91-4a7a-a40b-04258bdac71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:25.843523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f95cac6e-c4a3-4905-93ae-d68891fc740b admin admin] The token cache is being invalidate because project 48b2d24d625d4151b67de30f8fa7b918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:04:25.845060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f95cac6e-c4a3-4905-93ae-d68891fc740b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:25.847465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f95cac6e-c4a3-4905-93ae-d68891fc740b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:25.850158 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1335/2711] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:04:25 2022] DELETE /identity/v3/projects/48b2d24d625d4151b67de30f8fa7b918 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:04:25.857850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cac6e-c4a3-4905-93ae-d68891fc740b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:25.859880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f95cac6e-c4a3-4905-93ae-d68891fc740b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:25.905269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:25.941950 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1377/2712] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:04:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:26.002751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cac6e-c4a3-4905-93ae-d68891fc740b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:26.010327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8c8bc-e920-4f30-92f8-816fca293568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:26.019355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8c8bc-e920-4f30-92f8-816fca293568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:26.019646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8c8bc-e920-4f30-92f8-816fca293568 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:26.020688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8c8bc-e920-4f30-92f8-816fca293568 admin admin] PATH_INFO: `/v3/users/43df10ed0fb64a6e909b08989e0b226d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:26.021573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8c8bc-e920-4f30-92f8-816fca293568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43df10ed0fb64a6e909b08989e0b226d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:26.023543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8c8bc-e920-4f30-92f8-816fca293568 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:26.110825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-18e8c8bc-e920-4f30-92f8-816fca293568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43df10ed0fb64a6e909b08989e0b226d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:26.121446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-18e8c8bc-e920-4f30-92f8-816fca293568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43df10ed0fb64a6e909b08989e0b226d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:26.131778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-18e8c8bc-e920-4f30-92f8-816fca293568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43df10ed0fb64a6e909b08989e0b226d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:26.132619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-18e8c8bc-e920-4f30-92f8-816fca293568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43df10ed0fb64a6e909b08989e0b226d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:26.133359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-18e8c8bc-e920-4f30-92f8-816fca293568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43df10ed0fb64a6e909b08989e0b226d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:26.162489 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1336/2713] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:04:25 2022] DELETE /identity/v3/users/43df10ed0fb64a6e909b08989e0b226d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:04:26.905500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f128b3-8e91-4a7a-a40b-04258bdac71e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:26.922460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f128b3-8e91-4a7a-a40b-04258bdac71e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:27.052675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3870be-35bd-44c6-98f1-dd51ab7161f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:27.054746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3870be-35bd-44c6-98f1-dd51ab7161f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:27.055190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3870be-35bd-44c6-98f1-dd51ab7161f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:27.055618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3870be-35bd-44c6-98f1-dd51ab7161f2 admin admin] PATH_INFO: `/v3/projects/9014a6e32f3442ca8336f44a9d311b56` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:27.057314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3870be-35bd-44c6-98f1-dd51ab7161f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9014a6e32f3442ca8336f44a9d311b56)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:27.059420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3870be-35bd-44c6-98f1-dd51ab7161f2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:27.083854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:27.151391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7d3870be-35bd-44c6-98f1-dd51ab7161f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9014a6e32f3442ca8336f44a9d311b56', 'request_id': 'req-7d3870be-35bd-44c6-98f1-dd51ab7161f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:27.165664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7d3870be-35bd-44c6-98f1-dd51ab7161f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9014a6e32f3442ca8336f44a9d311b56', 'request_id': 'req-7d3870be-35bd-44c6-98f1-dd51ab7161f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:27.178737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7d3870be-35bd-44c6-98f1-dd51ab7161f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9014a6e32f3442ca8336f44a9d311b56', 'request_id': 'req-7d3870be-35bd-44c6-98f1-dd51ab7161f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:27.203613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7d3870be-35bd-44c6-98f1-dd51ab7161f2 admin admin] The token cache is being invalidate because project 9014a6e32f3442ca8336f44a9d311b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:04:27.204341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7d3870be-35bd-44c6-98f1-dd51ab7161f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:27.205194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7d3870be-35bd-44c6-98f1-dd51ab7161f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:04:27.208846 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1378/2714] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:04:26 2022] DELETE /identity/v3/projects/9014a6e32f3442ca8336f44a9d311b56 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:04:27.215215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea675518-db1c-41a6-97dc-91a92a4c168e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:27.215735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea675518-db1c-41a6-97dc-91a92a4c168e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:27.216164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea675518-db1c-41a6-97dc-91a92a4c168e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:27.241928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ea675518-db1c-41a6-97dc-91a92a4c168e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:27.244334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ea675518-db1c-41a6-97dc-91a92a4c168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:27.374598 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1337/2715] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:04:27.377792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a3139-0659-4740-bd7e-9a061fd65980 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:27.378376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a3139-0659-4740-bd7e-9a061fd65980 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:27.378865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a3139-0659-4740-bd7e-9a061fd65980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:27.407994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-616a3139-0659-4740-bd7e-9a061fd65980 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:27.409497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-616a3139-0659-4740-bd7e-9a061fd65980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:27.431321 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1379/2716] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:27.437108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea675518-db1c-41a6-97dc-91a92a4c168e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:27.450700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea675518-db1c-41a6-97dc-91a92a4c168e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:27.464932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625d669-bbbf-4cbf-96d6-d7a57d359551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:27.465615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625d669-bbbf-4cbf-96d6-d7a57d359551 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:27.465895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625d669-bbbf-4cbf-96d6-d7a57d359551 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:27.466168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625d669-bbbf-4cbf-96d6-d7a57d359551 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:27.466908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625d669-bbbf-4cbf-96d6-d7a57d359551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:04:27.467217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625d669-bbbf-4cbf-96d6-d7a57d359551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:27.476180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6625d669-bbbf-4cbf-96d6-d7a57d359551 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:27.498067 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1338/2717] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:04:27.502999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a3139-0659-4740-bd7e-9a061fd65980 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:27.520823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a3139-0659-4740-bd7e-9a061fd65980 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:27.529532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94008e9-94b9-4251-b779-3ef67c9c6ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:27.530511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94008e9-94b9-4251-b779-3ef67c9c6ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:27.530886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94008e9-94b9-4251-b779-3ef67c9c6ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:27.531247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94008e9-94b9-4251-b779-3ef67c9c6ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:27.533823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94008e9-94b9-4251-b779-3ef67c9c6ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:27.535890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94008e9-94b9-4251-b779-3ef67c9c6ff0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:27.619811 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1380/2718] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:04:27 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:04:27.625736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625d669-bbbf-4cbf-96d6-d7a57d359551 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:27.640273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6625d669-bbbf-4cbf-96d6-d7a57d359551 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:27.699143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:27.767207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d7bb1-414c-4a67-9241-8d74809992c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:27.767897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d7bb1-414c-4a67-9241-8d74809992c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:27.768214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d7bb1-414c-4a67-9241-8d74809992c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:27.768841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d7bb1-414c-4a67-9241-8d74809992c7 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:27.769549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d7bb1-414c-4a67-9241-8d74809992c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:27.771633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d7bb1-414c-4a67-9241-8d74809992c7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:27.800966 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1339/2719] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:04:27 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:04:27.805299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94008e9-94b9-4251-b779-3ef67c9c6ff0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:27.823027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94008e9-94b9-4251-b779-3ef67c9c6ff0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:27.835543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c35a7e-cfc1-4f1d-9559-eb64b22b4467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:27.837117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c35a7e-cfc1-4f1d-9559-eb64b22b4467 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:27.837498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c35a7e-cfc1-4f1d-9559-eb64b22b4467 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:27.837867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c35a7e-cfc1-4f1d-9559-eb64b22b4467 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:27.841009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c35a7e-cfc1-4f1d-9559-eb64b22b4467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:27.844760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c35a7e-cfc1-4f1d-9559-eb64b22b4467 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:27.877377 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1381/2720] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:04:27.879897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d7bb1-414c-4a67-9241-8d74809992c7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:27.898193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d7bb1-414c-4a67-9241-8d74809992c7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:27.914376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9b48b-5e69-43c3-879e-3f2e352a916f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:27.915313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9b48b-5e69-43c3-879e-3f2e352a916f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:27.915753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9b48b-5e69-43c3-879e-3f2e352a916f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:27.916098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9b48b-5e69-43c3-879e-3f2e352a916f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:27.917044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9b48b-5e69-43c3-879e-3f2e352a916f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:27.921000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9b48b-5e69-43c3-879e-3f2e352a916f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:27.960281 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1340/2721] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:04:27.964328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c35a7e-cfc1-4f1d-9559-eb64b22b4467 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:27.977214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c35a7e-cfc1-4f1d-9559-eb64b22b4467 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:27.991646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bc99b-8b08-4053-8928-6ce665697294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:27.992941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bc99b-8b08-4053-8928-6ce665697294 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:27.993873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bc99b-8b08-4053-8928-6ce665697294 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:27.994251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bc99b-8b08-4053-8928-6ce665697294 admin admin] PATH_INFO: `/v3/projects/4b15f516c6a34343979d19a0938c232b/users/1fade188e2a14766ae95fe44143bca97/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:28.040627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bc99b-8b08-4053-8928-6ce665697294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b15f516c6a34343979d19a0938c232b, user_id=1fade188e2a14766ae95fe44143bca97, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:28.043979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bc99b-8b08-4053-8928-6ce665697294 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:28.080271 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1382/2722] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:04:27 2022] PUT /identity/v3/projects/4b15f516c6a34343979d19a0938c232b/users/1fade188e2a14766ae95fe44143bca97/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:04:28.082170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2519c95-8967-42b9-a571-1522ff14c1a0 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:28.085331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2519c95-8967-42b9-a571-1522ff14c1a0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:28.085900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2519c95-8967-42b9-a571-1522ff14c1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:28.134086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f2519c95-8967-42b9-a571-1522ff14c1a0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:28.136417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f2519c95-8967-42b9-a571-1522ff14c1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:28.295093 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1341/2723] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:28.319035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bc99b-8b08-4053-8928-6ce665697294 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:28.323369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-352bc99b-8b08-4053-8928-6ce665697294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:28.446722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bc99b-8b08-4053-8928-6ce665697294 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:28.452490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ad207-f228-4f10-adfe-0b11a25c129d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:28.453132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ad207-f228-4f10-adfe-0b11a25c129d service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:28.453415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ad207-f228-4f10-adfe-0b11a25c129d service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:28.453691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ad207-f228-4f10-adfe-0b11a25c129d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:28.467479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ad207-f228-4f10-adfe-0b11a25c129d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:28.469000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ad207-f228-4f10-adfe-0b11a25c129d service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:28.480627 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1383/2724] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:04:29.487049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229f48f-4f4a-4e18-9738-70e942db392f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:29.492326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229f48f-4f4a-4e18-9738-70e942db392f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:29.492617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229f48f-4f4a-4e18-9738-70e942db392f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:29.521570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9229f48f-4f4a-4e18-9738-70e942db392f None None] MFA Rules not processed for user `592e8c2ad31f459fa0b37f219cc4f84c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:29.523144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9229f48f-4f4a-4e18-9738-70e942db392f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:29.604985 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1342/2725] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:04:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:36.439526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478d879-4ff7-4265-9360-69ce109b2113 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:36.440521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478d879-4ff7-4265-9360-69ce109b2113 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:36.440959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478d879-4ff7-4265-9360-69ce109b2113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:36.480686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6478d879-4ff7-4265-9360-69ce109b2113 None None] MFA Rules not processed for user `1fade188e2a14766ae95fe44143bca97`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:36.481973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6478d879-4ff7-4265-9360-69ce109b2113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:36.516257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:36.559456 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1384/2726] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:04:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:36.564209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229f48f-4f4a-4e18-9738-70e942db392f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:36.575380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229f48f-4f4a-4e18-9738-70e942db392f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:36.579818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb034b28-03f3-412e-9204-c935bff2cf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:36.580503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb034b28-03f3-412e-9204-c935bff2cf1f admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:36.580780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb034b28-03f3-412e-9204-c935bff2cf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:36.581051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb034b28-03f3-412e-9204-c935bff2cf1f admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:36.581735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb034b28-03f3-412e-9204-c935bff2cf1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:36.583730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb034b28-03f3-412e-9204-c935bff2cf1f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:36.609976 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1343/2727] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:04:36 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:04:36.614466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478d879-4ff7-4265-9360-69ce109b2113 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:36.625703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478d879-4ff7-4265-9360-69ce109b2113 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:36.698294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50daa2c-cac0-4242-bc81-e0a1e0f30f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:36.698903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50daa2c-cac0-4242-bc81-e0a1e0f30f76 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:36.699189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50daa2c-cac0-4242-bc81-e0a1e0f30f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:36.699468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50daa2c-cac0-4242-bc81-e0a1e0f30f76 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:36.700206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50daa2c-cac0-4242-bc81-e0a1e0f30f76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:36.702229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50daa2c-cac0-4242-bc81-e0a1e0f30f76 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:36.748229 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1385/2728] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:04:36 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:04:36.752821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb034b28-03f3-412e-9204-c935bff2cf1f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:36.769069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb034b28-03f3-412e-9204-c935bff2cf1f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:36.775232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5d2f6-6aa3-4639-b4b4-ff6c114438e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:36.776437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5d2f6-6aa3-4639-b4b4-ff6c114438e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:36.777093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5d2f6-6aa3-4639-b4b4-ff6c114438e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:36.777531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5d2f6-6aa3-4639-b4b4-ff6c114438e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:36.778652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5d2f6-6aa3-4639-b4b4-ff6c114438e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:36.780555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5d2f6-6aa3-4639-b4b4-ff6c114438e1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:36.802896 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1344/2729] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:04:36.807303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50daa2c-cac0-4242-bc81-e0a1e0f30f76 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:36.818897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50daa2c-cac0-4242-bc81-e0a1e0f30f76 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:36.824762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbd3d4-c83e-43b4-9fe8-e00e1675bd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:36.826034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbd3d4-c83e-43b4-9fe8-e00e1675bd55 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:36.826543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbd3d4-c83e-43b4-9fe8-e00e1675bd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:36.827047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbd3d4-c83e-43b4-9fe8-e00e1675bd55 admin admin] PATH_INFO: `/v3/projects/05a8c36319054fc8af0b5dd1916d7b5f/users/276b5102c10049faa2de880b2c3a8ee6/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:36.847328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbd3d4-c83e-43b4-9fe8-e00e1675bd55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a8c36319054fc8af0b5dd1916d7b5f, user_id=276b5102c10049faa2de880b2c3a8ee6, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:36.850593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbd3d4-c83e-43b4-9fe8-e00e1675bd55 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:36.884127 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1386/2730] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:04:36 2022] PUT /identity/v3/projects/05a8c36319054fc8af0b5dd1916d7b5f/users/276b5102c10049faa2de880b2c3a8ee6/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:04:36.886604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5d2f6-6aa3-4639-b4b4-ff6c114438e1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:36.899285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5d2f6-6aa3-4639-b4b4-ff6c114438e1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:36.944822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:37.008161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030d6a9-4677-4eeb-9613-56aaca39c949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:37.009486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030d6a9-4677-4eeb-9613-56aaca39c949 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:37.010073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030d6a9-4677-4eeb-9613-56aaca39c949 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:37.010518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030d6a9-4677-4eeb-9613-56aaca39c949 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:37.011418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030d6a9-4677-4eeb-9613-56aaca39c949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:37.014264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030d6a9-4677-4eeb-9613-56aaca39c949 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:37.028259 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1345/2731] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:04:37.032137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbd3d4-c83e-43b4-9fe8-e00e1675bd55 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:37.055582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbd3d4-c83e-43b4-9fe8-e00e1675bd55 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:37.072735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96182c93-294d-4040-b764-1add7dbe4e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:37.073796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96182c93-294d-4040-b764-1add7dbe4e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:37.074880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96182c93-294d-4040-b764-1add7dbe4e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:37.075645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96182c93-294d-4040-b764-1add7dbe4e43 admin admin] PATH_INFO: `/v3/projects/05a8c36319054fc8af0b5dd1916d7b5f/users/276b5102c10049faa2de880b2c3a8ee6/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:37.083264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96182c93-294d-4040-b764-1add7dbe4e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a8c36319054fc8af0b5dd1916d7b5f, user_id=276b5102c10049faa2de880b2c3a8ee6, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:37.089863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96182c93-294d-4040-b764-1add7dbe4e43 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:37.127728 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1387/2732] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:04:37 2022] PUT /identity/v3/projects/05a8c36319054fc8af0b5dd1916d7b5f/users/276b5102c10049faa2de880b2c3a8ee6/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:04:47.022055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=20 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:47.112119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=59,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:49.600497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eebe3-1d7f-48c4-9777-68099071c600 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:49.601038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eebe3-1d7f-48c4-9777-68099071c600 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:49.601285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eebe3-1d7f-48c4-9777-68099071c600 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:49.604667 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1346/2733] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:04:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:04:49.615362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ba6ab-0256-4e92-828a-085b58ffd1a5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:49.615901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ba6ab-0256-4e92-828a-085b58ffd1a5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:49.615901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ba6ab-0256-4e92-828a-085b58ffd1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:49.651815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-837ba6ab-0256-4e92-828a-085b58ffd1a5 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:49.653338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-837ba6ab-0256-4e92-828a-085b58ffd1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:49.766714 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1388/2734] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:04:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:49.793846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1eebe3-1d7f-48c4-9777-68099071c600 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:49.795741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6c1eebe3-1d7f-48c4-9777-68099071c600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:49.831935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1eebe3-1d7f-48c4-9777-68099071c600 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:49.847240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096158d-a069-4b01-be03-3747c520de7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:49.848158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096158d-a069-4b01-be03-3747c520de7b service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:49.848545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096158d-a069-4b01-be03-3747c520de7b service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:49.848894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096158d-a069-4b01-be03-3747c520de7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:49.868850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096158d-a069-4b01-be03-3747c520de7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:49.870554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096158d-a069-4b01-be03-3747c520de7b service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:49.907123 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1347/2735] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:04:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:04:50.798671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0670b-b9da-463a-906d-d0ba9274f790 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:50.799237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0670b-b9da-463a-906d-d0ba9274f790 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:50.799237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0670b-b9da-463a-906d-d0ba9274f790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:50.855022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5aa0670b-b9da-463a-906d-d0ba9274f790 None None] MFA Rules not processed for user `276b5102c10049faa2de880b2c3a8ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:50.858266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5aa0670b-b9da-463a-906d-d0ba9274f790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:50.985699 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1389/2736] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:04:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:51.270247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096158d-a069-4b01-be03-3747c520de7b service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:51.271916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c096158d-a069-4b01-be03-3747c520de7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:51.351888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096158d-a069-4b01-be03-3747c520de7b service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:51.357386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cfafb-1019-4357-9b1c-e030866344ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:51.358041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cfafb-1019-4357-9b1c-e030866344ac service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:51.358330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cfafb-1019-4357-9b1c-e030866344ac service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:51.358603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cfafb-1019-4357-9b1c-e030866344ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:51.419830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cfafb-1019-4357-9b1c-e030866344ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:51.421482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cfafb-1019-4357-9b1c-e030866344ac service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:51.431402 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1348/2737] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:04:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:04:53.121638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4c698-5d7d-40f1-b263-f09d5a7a4782 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:53.123347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4c698-5d7d-40f1-b263-f09d5a7a4782 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:53.123792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4c698-5d7d-40f1-b263-f09d5a7a4782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:53.162550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7ab4c698-5d7d-40f1-b263-f09d5a7a4782 None None] MFA Rules not processed for user `3fefe83ec0664f6188af74ea4b5c1291`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:53.163816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7ab4c698-5d7d-40f1-b263-f09d5a7a4782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:53.338632 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1390/2738] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:04:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:53.666267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5618342-b933-4331-8197-3f997553ca8d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:53.666894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5618342-b933-4331-8197-3f997553ca8d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:53.667159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5618342-b933-4331-8197-3f997553ca8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:53.720560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b5618342-b933-4331-8197-3f997553ca8d None None] MFA Rules not processed for user `b16a9c9e35954d579536375f7eab1c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:53.731986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b5618342-b933-4331-8197-3f997553ca8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:53.906317 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1349/2739] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:04:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:55.549380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99421b5c-ee01-458e-8a63-e8f8a95154b7 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:55.550442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99421b5c-ee01-458e-8a63-e8f8a95154b7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:55.551897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99421b5c-ee01-458e-8a63-e8f8a95154b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:55.586409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-99421b5c-ee01-458e-8a63-e8f8a95154b7 None None] MFA Rules not processed for user `1fade188e2a14766ae95fe44143bca97`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:55.593711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-99421b5c-ee01-458e-8a63-e8f8a95154b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:55.636877 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1391/2740] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:59.332275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ce29b-8ed9-47f3-9f62-2d873cd4d457 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:59.332876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ce29b-8ed9-47f3-9f62-2d873cd4d457 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:59.332992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ce29b-8ed9-47f3-9f62-2d873cd4d457 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:59.334758 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1350/2741] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:04:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:04:59.340120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c3549-d4ae-4486-9a91-684a9ffee114 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:59.340604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c3549-d4ae-4486-9a91-684a9ffee114 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:59.340604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c3549-d4ae-4486-9a91-684a9ffee114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:59.360823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2f0c3549-d4ae-4486-9a91-684a9ffee114 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:04:59.362462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2f0c3549-d4ae-4486-9a91-684a9ffee114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:59.377574 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1392/2742] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:04:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:04:59.395223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ce29b-8ed9-47f3-9f62-2d873cd4d457 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:04:59.397133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-587ce29b-8ed9-47f3-9f62-2d873cd4d457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:04:59.418260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ce29b-8ed9-47f3-9f62-2d873cd4d457 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:04:59.424799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e68e7b-94e4-4bfb-944e-78200bd91aec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:04:59.425643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e68e7b-94e4-4bfb-944e-78200bd91aec service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:04:59.426129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e68e7b-94e4-4bfb-944e-78200bd91aec service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:04:59.426661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e68e7b-94e4-4bfb-944e-78200bd91aec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:04:59.439134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e68e7b-94e4-4bfb-944e-78200bd91aec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:04:59.441193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e68e7b-94e4-4bfb-944e-78200bd91aec service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:04:59.467086 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1351/2743] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:04:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:05:09.354840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:09.449588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:22.842950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c3549-d4ae-4486-9a91-684a9ffee114 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:22.844588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2f0c3549-d4ae-4486-9a91-684a9ffee114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:22.983762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c3549-d4ae-4486-9a91-684a9ffee114 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:22.989386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd10b34-e24f-4287-ac09-eed6135af48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:22.990616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd10b34-e24f-4287-ac09-eed6135af48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:22.991179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd10b34-e24f-4287-ac09-eed6135af48a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:22.991763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd10b34-e24f-4287-ac09-eed6135af48a admin admin] PATH_INFO: `/v3/users/9ee93cc6740d4e92b231f60d8b9d4450` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:22.993120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd10b34-e24f-4287-ac09-eed6135af48a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ee93cc6740d4e92b231f60d8b9d4450)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:22.995056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd10b34-e24f-4287-ac09-eed6135af48a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:23.084517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4bd10b34-e24f-4287-ac09-eed6135af48a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ee93cc6740d4e92b231f60d8b9d4450'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:23.099590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4bd10b34-e24f-4287-ac09-eed6135af48a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ee93cc6740d4e92b231f60d8b9d4450'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:23.100256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4bd10b34-e24f-4287-ac09-eed6135af48a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ee93cc6740d4e92b231f60d8b9d4450'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:23.101049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4bd10b34-e24f-4287-ac09-eed6135af48a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ee93cc6740d4e92b231f60d8b9d4450'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:23.114902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4bd10b34-e24f-4287-ac09-eed6135af48a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ee93cc6740d4e92b231f60d8b9d4450'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:23.178157 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1393/2744] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:05:22 2022] DELETE /identity/v3/users/9ee93cc6740d4e92b231f60d8b9d4450 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:05:23.182721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac46189-4d1c-4a04-b400-dd158e1423ad None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:23.183202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac46189-4d1c-4a04-b400-dd158e1423ad None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:23.183321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac46189-4d1c-4a04-b400-dd158e1423ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:23.205973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-aac46189-4d1c-4a04-b400-dd158e1423ad None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:23.207273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-aac46189-4d1c-4a04-b400-dd158e1423ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:23.279196 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1352/2745] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:05:23.308346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd10b34-e24f-4287-ac09-eed6135af48a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:23.309975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4bd10b34-e24f-4287-ac09-eed6135af48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:23.396554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd10b34-e24f-4287-ac09-eed6135af48a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:23.403380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72d5d5-ba90-4325-9d1c-e4a8fac7c9ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:23.404072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72d5d5-ba90-4325-9d1c-e4a8fac7c9ce service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:23.404342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72d5d5-ba90-4325-9d1c-e4a8fac7c9ce service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:23.404614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72d5d5-ba90-4325-9d1c-e4a8fac7c9ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:23.416197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72d5d5-ba90-4325-9d1c-e4a8fac7c9ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:23.417661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72d5d5-ba90-4325-9d1c-e4a8fac7c9ce service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:23.431664 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1394/2746] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:05:24.355198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac46189-4d1c-4a04-b400-dd158e1423ad None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:24.357780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-aac46189-4d1c-4a04-b400-dd158e1423ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:24.373269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac46189-4d1c-4a04-b400-dd158e1423ad None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:24.380939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca3769-106b-4620-8b14-9c355b29f399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:24.382321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca3769-106b-4620-8b14-9c355b29f399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:24.382770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca3769-106b-4620-8b14-9c355b29f399 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:24.383041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca3769-106b-4620-8b14-9c355b29f399 admin admin] PATH_INFO: `/v3/projects/065f852898294f2c8a154eb8d5f498f0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:24.384320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca3769-106b-4620-8b14-9c355b29f399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=065f852898294f2c8a154eb8d5f498f0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:24.386403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca3769-106b-4620-8b14-9c355b29f399 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:24.417952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b72d8b-b28c-4eef-b9b1-9f7dc0783c44 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:24.418744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b72d8b-b28c-4eef-b9b1-9f7dc0783c44 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:24.418744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b72d8b-b28c-4eef-b9b1-9f7dc0783c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:24.465093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-95b72d8b-b28c-4eef-b9b1-9f7dc0783c44 None None] MFA Rules not processed for user `3fefe83ec0664f6188af74ea4b5c1291`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:24.467207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-95b72d8b-b28c-4eef-b9b1-9f7dc0783c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:24.503567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b8ca3769-106b-4620-8b14-9c355b29f399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '065f852898294f2c8a154eb8d5f498f0', 'request_id': 'req-b8ca3769-106b-4620-8b14-9c355b29f399'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:24.512925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b8ca3769-106b-4620-8b14-9c355b29f399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '065f852898294f2c8a154eb8d5f498f0', 'request_id': 'req-b8ca3769-106b-4620-8b14-9c355b29f399'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:24.520717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b8ca3769-106b-4620-8b14-9c355b29f399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '065f852898294f2c8a154eb8d5f498f0', 'request_id': 'req-b8ca3769-106b-4620-8b14-9c355b29f399'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:24.522116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:24.545543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b8ca3769-106b-4620-8b14-9c355b29f399 admin admin] The token cache is being invalidate because project 065f852898294f2c8a154eb8d5f498f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:05:24.546002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b8ca3769-106b-4620-8b14-9c355b29f399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:24.548607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b8ca3769-106b-4620-8b14-9c355b29f399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:24.555383 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1353/2747] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:05:24 2022] DELETE /identity/v3/projects/065f852898294f2c8a154eb8d5f498f0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:05:24.556864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca3769-106b-4620-8b14-9c355b29f399 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:24.558263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b8ca3769-106b-4620-8b14-9c355b29f399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:24.585438 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1395/2748] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:05:24.653603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca3769-106b-4620-8b14-9c355b29f399 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:24.660311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b2452-b881-408a-ba29-e23493772603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:24.661202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b2452-b881-408a-ba29-e23493772603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:24.661481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b2452-b881-408a-ba29-e23493772603 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:24.661755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b2452-b881-408a-ba29-e23493772603 admin admin] PATH_INFO: `/v3/users/f01d709cb67c4742be0b40aceb2bd6db` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:24.663937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b2452-b881-408a-ba29-e23493772603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01d709cb67c4742be0b40aceb2bd6db)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:24.666272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b2452-b881-408a-ba29-e23493772603 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:24.705145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:24.732782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bb3b2452-b881-408a-ba29-e23493772603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01d709cb67c4742be0b40aceb2bd6db'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:24.744376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bb3b2452-b881-408a-ba29-e23493772603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01d709cb67c4742be0b40aceb2bd6db'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:24.754760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bb3b2452-b881-408a-ba29-e23493772603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01d709cb67c4742be0b40aceb2bd6db'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:24.755635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bb3b2452-b881-408a-ba29-e23493772603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01d709cb67c4742be0b40aceb2bd6db'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:24.756331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bb3b2452-b881-408a-ba29-e23493772603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01d709cb67c4742be0b40aceb2bd6db'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:24.778851 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1354/2749] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:05:24 2022] DELETE /identity/v3/users/f01d709cb67c4742be0b40aceb2bd6db => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:05:24.992628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b72d8b-b28c-4eef-b9b1-9f7dc0783c44 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:25.011941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b72d8b-b28c-4eef-b9b1-9f7dc0783c44 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:25.085849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816809f-9173-4cb2-bfbb-dcd4dc7298e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:25.086883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816809f-9173-4cb2-bfbb-dcd4dc7298e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:25.087254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816809f-9173-4cb2-bfbb-dcd4dc7298e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:25.087574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816809f-9173-4cb2-bfbb-dcd4dc7298e2 admin admin] PATH_INFO: `/v3/projects/aaed67e75e9d41f9b52b2eecece4d00a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:25.089574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816809f-9173-4cb2-bfbb-dcd4dc7298e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaed67e75e9d41f9b52b2eecece4d00a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:25.091578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816809f-9173-4cb2-bfbb-dcd4dc7298e2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:25.148205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1816809f-9173-4cb2-bfbb-dcd4dc7298e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaed67e75e9d41f9b52b2eecece4d00a', 'request_id': 'req-1816809f-9173-4cb2-bfbb-dcd4dc7298e2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:25.157823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1816809f-9173-4cb2-bfbb-dcd4dc7298e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaed67e75e9d41f9b52b2eecece4d00a', 'request_id': 'req-1816809f-9173-4cb2-bfbb-dcd4dc7298e2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:25.165523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1816809f-9173-4cb2-bfbb-dcd4dc7298e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaed67e75e9d41f9b52b2eecece4d00a', 'request_id': 'req-1816809f-9173-4cb2-bfbb-dcd4dc7298e2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:25.177590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1816809f-9173-4cb2-bfbb-dcd4dc7298e2 admin admin] The token cache is being invalidate because project aaed67e75e9d41f9b52b2eecece4d00a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:05:25.177884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1816809f-9173-4cb2-bfbb-dcd4dc7298e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:25.178566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1816809f-9173-4cb2-bfbb-dcd4dc7298e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:25.183996 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1396/2750] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:05:24 2022] DELETE /identity/v3/projects/aaed67e75e9d41f9b52b2eecece4d00a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:05:25.185552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365a740-148f-4d9d-9bbd-abf75d51449c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:25.186018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365a740-148f-4d9d-9bbd-abf75d51449c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:25.186366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365a740-148f-4d9d-9bbd-abf75d51449c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:25.205213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1365a740-148f-4d9d-9bbd-abf75d51449c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:25.206527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1365a740-148f-4d9d-9bbd-abf75d51449c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:25.295294 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1355/2751] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:05:25.303255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f153e-a8b0-4861-b861-adc8ceddbad5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:25.303622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f153e-a8b0-4861-b861-adc8ceddbad5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:25.303910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f153e-a8b0-4861-b861-adc8ceddbad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:25.337712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-559f153e-a8b0-4861-b861-adc8ceddbad5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:25.339570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-559f153e-a8b0-4861-b861-adc8ceddbad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:25.349166 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1397/2752] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:05:25.353589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365a740-148f-4d9d-9bbd-abf75d51449c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:25.363889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365a740-148f-4d9d-9bbd-abf75d51449c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:25.370076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f45c01-8736-42b0-b311-16900cf1401d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:25.370987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f45c01-8736-42b0-b311-16900cf1401d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:25.371271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f45c01-8736-42b0-b311-16900cf1401d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:25.371545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f45c01-8736-42b0-b311-16900cf1401d admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:25.372472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f45c01-8736-42b0-b311-16900cf1401d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:05:25.372948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f45c01-8736-42b0-b311-16900cf1401d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:25.374566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f45c01-8736-42b0-b311-16900cf1401d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:25.388483 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1356/2753] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:05:25.393131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f153e-a8b0-4861-b861-adc8ceddbad5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:25.404170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f153e-a8b0-4861-b861-adc8ceddbad5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:25.410202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b5d87-549d-422f-87e5-80656767d5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:25.411113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b5d87-549d-422f-87e5-80656767d5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:25.411595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b5d87-549d-422f-87e5-80656767d5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:25.412101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b5d87-549d-422f-87e5-80656767d5b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:25.414559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b5d87-549d-422f-87e5-80656767d5b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:25.416452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b5d87-549d-422f-87e5-80656767d5b7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:25.470063 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1398/2754] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:05:25 2022] POST /identity/v3/projects => generated 403 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:05:25.474436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f45c01-8736-42b0-b311-16900cf1401d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:25.485387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f45c01-8736-42b0-b311-16900cf1401d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:25.547219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efeb42-b16c-427d-af18-0cbd09146867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:25.548020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efeb42-b16c-427d-af18-0cbd09146867 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:25.548336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efeb42-b16c-427d-af18-0cbd09146867 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:25.548724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efeb42-b16c-427d-af18-0cbd09146867 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:25.549426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9efeb42-b16c-427d-af18-0cbd09146867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:25.551641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9efeb42-b16c-427d-af18-0cbd09146867 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:25.574497 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1357/2755] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:05:25 2022] POST /identity/v3/users => generated 302 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:05:25.578979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b5d87-549d-422f-87e5-80656767d5b7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:25.589765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b5d87-549d-422f-87e5-80656767d5b7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:25.594759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f1149-e766-4a2f-9e10-e04363abce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:25.595520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f1149-e766-4a2f-9e10-e04363abce1c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:25.595868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f1149-e766-4a2f-9e10-e04363abce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:25.596180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f1149-e766-4a2f-9e10-e04363abce1c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:25.597138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f1149-e766-4a2f-9e10-e04363abce1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:25.598964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f1149-e766-4a2f-9e10-e04363abce1c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:25.609782 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1399/2756] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:05:25.613968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efeb42-b16c-427d-af18-0cbd09146867 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:25.624093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efeb42-b16c-427d-af18-0cbd09146867 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:25.628798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc89d3b-9330-436a-abb2-e549f68c0d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:25.629440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc89d3b-9330-436a-abb2-e549f68c0d55 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:25.629719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc89d3b-9330-436a-abb2-e549f68c0d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:25.629989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc89d3b-9330-436a-abb2-e549f68c0d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:25.630701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc89d3b-9330-436a-abb2-e549f68c0d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:25.632311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc89d3b-9330-436a-abb2-e549f68c0d55 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:25.644463 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1358/2757] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:05:25.649117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f1149-e766-4a2f-9e10-e04363abce1c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:25.659437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f1149-e766-4a2f-9e10-e04363abce1c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:25.664354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f40e5-4614-46dd-be72-523d1c532c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:25.665234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f40e5-4614-46dd-be72-523d1c532c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:25.665516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f40e5-4614-46dd-be72-523d1c532c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:25.665785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f40e5-4614-46dd-be72-523d1c532c51 admin admin] PATH_INFO: `/v3/projects/ecfdf4cd98424466b843358ec3837dac/users/d5164f71494648a881073054de361a50/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:25.669913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:25.686233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f40e5-4614-46dd-be72-523d1c532c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecfdf4cd98424466b843358ec3837dac, user_id=d5164f71494648a881073054de361a50, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:25.692545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f40e5-4614-46dd-be72-523d1c532c51 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:25.710995 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1400/2758] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:05:25 2022] PUT /identity/v3/projects/ecfdf4cd98424466b843358ec3837dac/users/d5164f71494648a881073054de361a50/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:05:25.722202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3a545-4c69-4bdd-9f07-fed6fc3fbd39 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:25.722977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3a545-4c69-4bdd-9f07-fed6fc3fbd39 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:25.723100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3a545-4c69-4bdd-9f07-fed6fc3fbd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:25.743907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:25.757444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0dd3a545-4c69-4bdd-9f07-fed6fc3fbd39 None None] MFA Rules not processed for user `d5164f71494648a881073054de361a50`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:25.773062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0dd3a545-4c69-4bdd-9f07-fed6fc3fbd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:25.857529 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1359/2759] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:05:25.862993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f40e5-4614-46dd-be72-523d1c532c51 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:25.961646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f40e5-4614-46dd-be72-523d1c532c51 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:25.967413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee260bd3-b6ae-4e57-bdfd-76c4450ff9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:25.968157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee260bd3-b6ae-4e57-bdfd-76c4450ff9cc admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:25.968455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee260bd3-b6ae-4e57-bdfd-76c4450ff9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:25.968780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee260bd3-b6ae-4e57-bdfd-76c4450ff9cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:25.969776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee260bd3-b6ae-4e57-bdfd-76c4450ff9cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:25.971843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee260bd3-b6ae-4e57-bdfd-76c4450ff9cc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:26.020805 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1401/2760] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:05:25 2022] POST /identity/v3/projects => generated 401 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:05:26.022796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3a545-4c69-4bdd-9f07-fed6fc3fbd39 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:26.035338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3a545-4c69-4bdd-9f07-fed6fc3fbd39 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:26.156487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88099e-e8ef-4be5-95d1-8f29db4adbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:26.157247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88099e-e8ef-4be5-95d1-8f29db4adbde admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:26.157594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88099e-e8ef-4be5-95d1-8f29db4adbde admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:26.157941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88099e-e8ef-4be5-95d1-8f29db4adbde admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:26.158787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88099e-e8ef-4be5-95d1-8f29db4adbde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:26.160806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88099e-e8ef-4be5-95d1-8f29db4adbde admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:26.194761 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1360/2761] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:05:26 2022] POST /identity/v3/users => generated 307 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:05:26.197565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee260bd3-b6ae-4e57-bdfd-76c4450ff9cc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:26.212873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee260bd3-b6ae-4e57-bdfd-76c4450ff9cc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:26.221482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f14581-2ebd-46bb-8ffb-e57e82abedea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:26.222169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f14581-2ebd-46bb-8ffb-e57e82abedea admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:26.222475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f14581-2ebd-46bb-8ffb-e57e82abedea admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:26.222724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f14581-2ebd-46bb-8ffb-e57e82abedea admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:26.223486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f14581-2ebd-46bb-8ffb-e57e82abedea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:26.225142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f14581-2ebd-46bb-8ffb-e57e82abedea admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:26.239767 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1402/2762] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:05:26.241052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88099e-e8ef-4be5-95d1-8f29db4adbde admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:26.253669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88099e-e8ef-4be5-95d1-8f29db4adbde admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:26.260866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8536fa-581f-4672-8f22-08c1c02e8b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:26.262046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8536fa-581f-4672-8f22-08c1c02e8b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:26.262046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8536fa-581f-4672-8f22-08c1c02e8b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:26.262459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8536fa-581f-4672-8f22-08c1c02e8b55 admin admin] PATH_INFO: `/v3/projects/9321670224b549749cc13233ffbe4c4e/users/3ffef0a840204a60852740f8e80ddda0/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:26.263815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58a595-f4c1-46dc-be92-5335d0d215c2 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:26.264194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58a595-f4c1-46dc-be92-5335d0d215c2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:26.264618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58a595-f4c1-46dc-be92-5335d0d215c2 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:26.267608 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1403/2763] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:05:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:05:26.273367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc121a-8773-4a8d-8364-5825c65cedda None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:26.273653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc121a-8773-4a8d-8364-5825c65cedda None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:26.273936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc121a-8773-4a8d-8364-5825c65cedda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:26.286603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8536fa-581f-4672-8f22-08c1c02e8b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9321670224b549749cc13233ffbe4c4e, user_id=3ffef0a840204a60852740f8e80ddda0, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:26.290589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8536fa-581f-4672-8f22-08c1c02e8b55 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:26.296819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-45bc121a-8773-4a8d-8364-5825c65cedda None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:26.298225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-45bc121a-8773-4a8d-8364-5825c65cedda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:26.316252 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1361/2764] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:05:26 2022] PUT /identity/v3/projects/9321670224b549749cc13233ffbe4c4e/users/3ffef0a840204a60852740f8e80ddda0/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:05:26.335237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8536fa-581f-4672-8f22-08c1c02e8b55 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:26.394330 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1404/2765] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:05:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:05:26.419437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc121a-8773-4a8d-8364-5825c65cedda None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:26.420941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-45bc121a-8773-4a8d-8364-5825c65cedda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:26.434410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc121a-8773-4a8d-8364-5825c65cedda None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:26.438587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8536fa-581f-4672-8f22-08c1c02e8b55 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:26.444915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1dcb1-43c0-480c-aa69-93e045c40ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:26.446015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1dcb1-43c0-480c-aa69-93e045c40ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:26.446820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1dcb1-43c0-480c-aa69-93e045c40ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:26.447151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1dcb1-43c0-480c-aa69-93e045c40ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:26.448150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1dcb1-43c0-480c-aa69-93e045c40ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:26.449783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1dcb1-43c0-480c-aa69-93e045c40ce9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:26.459430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:26.471154 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1362/2766] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:05:26.475206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1dcb1-43c0-480c-aa69-93e045c40ce9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:26.490421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1dcb1-43c0-480c-aa69-93e045c40ce9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:26.503553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05325862-ebc7-4155-96a8-732f7d9d711e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:26.505478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05325862-ebc7-4155-96a8-732f7d9d711e admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:26.505774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05325862-ebc7-4155-96a8-732f7d9d711e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:26.506736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05325862-ebc7-4155-96a8-732f7d9d711e admin admin] PATH_INFO: `/v3/projects/9321670224b549749cc13233ffbe4c4e/users/3ffef0a840204a60852740f8e80ddda0/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:26.512174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:26.512739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05325862-ebc7-4155-96a8-732f7d9d711e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9321670224b549749cc13233ffbe4c4e, user_id=3ffef0a840204a60852740f8e80ddda0, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:26.517284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05325862-ebc7-4155-96a8-732f7d9d711e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:26.534444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d279958-4f83-4569-948d-88a20e775cff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:26.535115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d279958-4f83-4569-948d-88a20e775cff service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:26.535644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d279958-4f83-4569-948d-88a20e775cff service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:26.535644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d279958-4f83-4569-948d-88a20e775cff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:26.540083 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1363/2767] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:05:26 2022] PUT /identity/v3/projects/9321670224b549749cc13233ffbe4c4e/users/3ffef0a840204a60852740f8e80ddda0/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:05:26.550161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cded9-d947-4a87-9c0d-235884c8868a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:26.550534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cded9-d947-4a87-9c0d-235884c8868a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:26.550794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cded9-d947-4a87-9c0d-235884c8868a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:26.558319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d279958-4f83-4569-948d-88a20e775cff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:26.560539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d279958-4f83-4569-948d-88a20e775cff service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:26.580008 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1405/2768] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:05:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:05:26.599770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-520cded9-d947-4a87-9c0d-235884c8868a None None] MFA Rules not processed for user `3ffef0a840204a60852740f8e80ddda0`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:26.601855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-520cded9-d947-4a87-9c0d-235884c8868a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:26.668950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a94425-401a-40cc-a136-84ee16d13c70 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:26.669349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a94425-401a-40cc-a136-84ee16d13c70 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:26.670904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a94425-401a-40cc-a136-84ee16d13c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:26.702187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-60a94425-401a-40cc-a136-84ee16d13c70 None None] MFA Rules not processed for user `3fefe83ec0664f6188af74ea4b5c1291`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:26.703598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-60a94425-401a-40cc-a136-84ee16d13c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:26.717023 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1364/2769] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:26 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:05:26.739019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cded9-d947-4a87-9c0d-235884c8868a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:26.740637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-520cded9-d947-4a87-9c0d-235884c8868a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:26.778299 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1406/2770] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:05:26.858841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cded9-d947-4a87-9c0d-235884c8868a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:26.865457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008acaa3-dd12-4f0b-b822-45e9b894dcf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:26.866256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008acaa3-dd12-4f0b-b822-45e9b894dcf9 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:26.866745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008acaa3-dd12-4f0b-b822-45e9b894dcf9 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:26.867494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008acaa3-dd12-4f0b-b822-45e9b894dcf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:26.877700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008acaa3-dd12-4f0b-b822-45e9b894dcf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:26.879320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008acaa3-dd12-4f0b-b822-45e9b894dcf9 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:26.890939 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1365/2771] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:05:26 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:05:29.981557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a94425-401a-40cc-a136-84ee16d13c70 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:30.011831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a94425-401a-40cc-a136-84ee16d13c70 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:30.033593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f8f11-cf2e-45e6-b129-f3d8cd61b8f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:30.034577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f8f11-cf2e-45e6-b129-f3d8cd61b8f8 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:30.034891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f8f11-cf2e-45e6-b129-f3d8cd61b8f8 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:30.035635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f8f11-cf2e-45e6-b129-f3d8cd61b8f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:30.191872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f8f11-cf2e-45e6-b129-f3d8cd61b8f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:30.193608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f8f11-cf2e-45e6-b129-f3d8cd61b8f8 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:30.226403 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1407/2772] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:05:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:05:30.230307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008acaa3-dd12-4f0b-b822-45e9b894dcf9 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:30.311869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:30.317999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008acaa3-dd12-4f0b-b822-45e9b894dcf9 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:30.331342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45743d-a7f2-41fa-ac54-fc1703790046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:30.332298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45743d-a7f2-41fa-ac54-fc1703790046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:30.332583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45743d-a7f2-41fa-ac54-fc1703790046 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:30.332860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45743d-a7f2-41fa-ac54-fc1703790046 admin admin] PATH_INFO: `/v3/users/d5164f71494648a881073054de361a50` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:30.334152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45743d-a7f2-41fa-ac54-fc1703790046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5164f71494648a881073054de361a50)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:30.337850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45743d-a7f2-41fa-ac54-fc1703790046 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:30.422448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1a45743d-a7f2-41fa-ac54-fc1703790046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5164f71494648a881073054de361a50'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:30.440069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1a45743d-a7f2-41fa-ac54-fc1703790046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5164f71494648a881073054de361a50'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:30.453394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1a45743d-a7f2-41fa-ac54-fc1703790046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5164f71494648a881073054de361a50'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:30.457466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1a45743d-a7f2-41fa-ac54-fc1703790046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5164f71494648a881073054de361a50'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:30.460301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1a45743d-a7f2-41fa-ac54-fc1703790046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5164f71494648a881073054de361a50'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:30.533397 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1366/2773] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:05:30 2022] DELETE /identity/v3/users/d5164f71494648a881073054de361a50 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:05:30.538696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee20f3-dd83-4046-b7c6-e5710502e8d2 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:30.539133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee20f3-dd83-4046-b7c6-e5710502e8d2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:30.539480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee20f3-dd83-4046-b7c6-e5710502e8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:30.575541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-afee20f3-dd83-4046-b7c6-e5710502e8d2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:30.577083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-afee20f3-dd83-4046-b7c6-e5710502e8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:30.717323 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1408/2774] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:05:30.737400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45743d-a7f2-41fa-ac54-fc1703790046 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:30.740462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1a45743d-a7f2-41fa-ac54-fc1703790046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:30.923509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45743d-a7f2-41fa-ac54-fc1703790046 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:30.933925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b630c91-f083-4a42-9897-21175d76ccf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:30.934616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b630c91-f083-4a42-9897-21175d76ccf8 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:30.934898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b630c91-f083-4a42-9897-21175d76ccf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:30.935176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b630c91-f083-4a42-9897-21175d76ccf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:30.965535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b630c91-f083-4a42-9897-21175d76ccf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:30.967182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b630c91-f083-4a42-9897-21175d76ccf8 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:30.992281 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1367/2775] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:05:31.690860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee20f3-dd83-4046-b7c6-e5710502e8d2 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:31.692929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-afee20f3-dd83-4046-b7c6-e5710502e8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:31.707001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee20f3-dd83-4046-b7c6-e5710502e8d2 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:31.719988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cf23a-8a97-48e6-9ece-213c7ba729ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:31.720948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cf23a-8a97-48e6-9ece-213c7ba729ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:31.721227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cf23a-8a97-48e6-9ece-213c7ba729ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:31.721496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cf23a-8a97-48e6-9ece-213c7ba729ff admin admin] PATH_INFO: `/v3/users/b16a9c9e35954d579536375f7eab1c9b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:31.723017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cf23a-8a97-48e6-9ece-213c7ba729ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16a9c9e35954d579536375f7eab1c9b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:31.725067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cf23a-8a97-48e6-9ece-213c7ba729ff admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:31.760768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:31.798481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ca7cf23a-8a97-48e6-9ece-213c7ba729ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16a9c9e35954d579536375f7eab1c9b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:31.813002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ca7cf23a-8a97-48e6-9ece-213c7ba729ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16a9c9e35954d579536375f7eab1c9b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:31.814060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ca7cf23a-8a97-48e6-9ece-213c7ba729ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16a9c9e35954d579536375f7eab1c9b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:31.814834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ca7cf23a-8a97-48e6-9ece-213c7ba729ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16a9c9e35954d579536375f7eab1c9b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:31.825115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ca7cf23a-8a97-48e6-9ece-213c7ba729ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16a9c9e35954d579536375f7eab1c9b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:31.861659 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1409/2776] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:05:31 2022] DELETE /identity/v3/users/b16a9c9e35954d579536375f7eab1c9b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:05:31.896492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b630c91-f083-4a42-9897-21175d76ccf8 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:31.898108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0b630c91-f083-4a42-9897-21175d76ccf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:31.931635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b630c91-f083-4a42-9897-21175d76ccf8 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:32.104601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9b491-38e7-42f4-b97c-b13f5e32bf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:32.105484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9b491-38e7-42f4-b97c-b13f5e32bf30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:32.105768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9b491-38e7-42f4-b97c-b13f5e32bf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:32.106044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9b491-38e7-42f4-b97c-b13f5e32bf30 admin admin] PATH_INFO: `/v3/projects/ecfdf4cd98424466b843358ec3837dac` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:32.120697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9b491-38e7-42f4-b97c-b13f5e32bf30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecfdf4cd98424466b843358ec3837dac)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:32.122757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9b491-38e7-42f4-b97c-b13f5e32bf30 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:32.153115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:32.223769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ee9b491-38e7-42f4-b97c-b13f5e32bf30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecfdf4cd98424466b843358ec3837dac', 'request_id': 'req-7ee9b491-38e7-42f4-b97c-b13f5e32bf30'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:32.235020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ee9b491-38e7-42f4-b97c-b13f5e32bf30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecfdf4cd98424466b843358ec3837dac', 'request_id': 'req-7ee9b491-38e7-42f4-b97c-b13f5e32bf30'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:32.245318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ee9b491-38e7-42f4-b97c-b13f5e32bf30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecfdf4cd98424466b843358ec3837dac', 'request_id': 'req-7ee9b491-38e7-42f4-b97c-b13f5e32bf30'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:32.271303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ee9b491-38e7-42f4-b97c-b13f5e32bf30 admin admin] The token cache is being invalidate because project ecfdf4cd98424466b843358ec3837dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:05:32.271777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ee9b491-38e7-42f4-b97c-b13f5e32bf30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:32.272793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ee9b491-38e7-42f4-b97c-b13f5e32bf30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:32.278334 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1368/2777] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:05:31 2022] DELETE /identity/v3/projects/ecfdf4cd98424466b843358ec3837dac => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:05:32.279702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cf23a-8a97-48e6-9ece-213c7ba729ff admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:32.282224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ca7cf23a-8a97-48e6-9ece-213c7ba729ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:32.311215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cf23a-8a97-48e6-9ece-213c7ba729ff admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:32.390657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9b491-38e7-42f4-b97c-b13f5e32bf30 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:32.392298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7ee9b491-38e7-42f4-b97c-b13f5e32bf30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:32.441090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c67a6-2369-426e-a6cb-2a2752b70c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:32.442029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c67a6-2369-426e-a6cb-2a2752b70c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:32.442311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c67a6-2369-426e-a6cb-2a2752b70c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:32.442587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c67a6-2369-426e-a6cb-2a2752b70c8c admin admin] PATH_INFO: `/v3/users/3ffef0a840204a60852740f8e80ddda0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:32.457302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c67a6-2369-426e-a6cb-2a2752b70c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ffef0a840204a60852740f8e80ddda0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:32.460204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c67a6-2369-426e-a6cb-2a2752b70c8c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:32.541679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-281c67a6-2369-426e-a6cb-2a2752b70c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ffef0a840204a60852740f8e80ddda0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:32.555692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-281c67a6-2369-426e-a6cb-2a2752b70c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ffef0a840204a60852740f8e80ddda0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:32.556358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-281c67a6-2369-426e-a6cb-2a2752b70c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ffef0a840204a60852740f8e80ddda0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:32.556966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-281c67a6-2369-426e-a6cb-2a2752b70c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ffef0a840204a60852740f8e80ddda0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:32.566827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-281c67a6-2369-426e-a6cb-2a2752b70c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ffef0a840204a60852740f8e80ddda0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:32.578012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9b491-38e7-42f4-b97c-b13f5e32bf30 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:32.585150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812e2d3-2a11-424f-bb8a-e973ca4368a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:32.586216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812e2d3-2a11-424f-bb8a-e973ca4368a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:32.586611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812e2d3-2a11-424f-bb8a-e973ca4368a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:32.586978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812e2d3-2a11-424f-bb8a-e973ca4368a7 admin admin] PATH_INFO: `/v3/projects/4c4a0acce7ef425b93c417e1a8fccf78` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:32.588817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812e2d3-2a11-424f-bb8a-e973ca4368a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4a0acce7ef425b93c417e1a8fccf78)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:32.595481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812e2d3-2a11-424f-bb8a-e973ca4368a7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:32.597541 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1410/2778] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:05:32 2022] DELETE /identity/v3/users/3ffef0a840204a60852740f8e80ddda0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:05:32.685430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8812e2d3-2a11-424f-bb8a-e973ca4368a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4a0acce7ef425b93c417e1a8fccf78', 'request_id': 'req-8812e2d3-2a11-424f-bb8a-e973ca4368a7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:32.695574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8812e2d3-2a11-424f-bb8a-e973ca4368a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4a0acce7ef425b93c417e1a8fccf78', 'request_id': 'req-8812e2d3-2a11-424f-bb8a-e973ca4368a7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:32.705535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8812e2d3-2a11-424f-bb8a-e973ca4368a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4a0acce7ef425b93c417e1a8fccf78', 'request_id': 'req-8812e2d3-2a11-424f-bb8a-e973ca4368a7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:32.732713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8812e2d3-2a11-424f-bb8a-e973ca4368a7 admin admin] The token cache is being invalidate because project 4c4a0acce7ef425b93c417e1a8fccf78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:05:32.735137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8812e2d3-2a11-424f-bb8a-e973ca4368a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:32.737683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8812e2d3-2a11-424f-bb8a-e973ca4368a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:32.740407 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1369/2779] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:05:32 2022] DELETE /identity/v3/projects/4c4a0acce7ef425b93c417e1a8fccf78 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:05:32.745473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a9598-20c6-4b46-8283-ae4254210ad8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:32.745995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a9598-20c6-4b46-8283-ae4254210ad8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:32.746369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a9598-20c6-4b46-8283-ae4254210ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:32.781900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5a6a9598-20c6-4b46-8283-ae4254210ad8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:32.785248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5a6a9598-20c6-4b46-8283-ae4254210ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:32.876317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:32.978178 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1411/2780] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:05:32.988333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947bd72-c4b8-47c7-a112-3d8bea774780 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:32.988955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947bd72-c4b8-47c7-a112-3d8bea774780 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:32.988955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947bd72-c4b8-47c7-a112-3d8bea774780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:33.011781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a9598-20c6-4b46-8283-ae4254210ad8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:33.013905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5a6a9598-20c6-4b46-8283-ae4254210ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:33.035543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a9598-20c6-4b46-8283-ae4254210ad8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:33.047533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a947bd72-c4b8-47c7-a112-3d8bea774780 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:33.048913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a947bd72-c4b8-47c7-a112-3d8bea774780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:33.050446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe3bb8-fdbf-44e5-9995-4581286401f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:33.051319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe3bb8-fdbf-44e5-9995-4581286401f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:33.051597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe3bb8-fdbf-44e5-9995-4581286401f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:33.051866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe3bb8-fdbf-44e5-9995-4581286401f3 admin admin] PATH_INFO: `/v3/projects/9321670224b549749cc13233ffbe4c4e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:33.054149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe3bb8-fdbf-44e5-9995-4581286401f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9321670224b549749cc13233ffbe4c4e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:33.056307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe3bb8-fdbf-44e5-9995-4581286401f3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:33.069891 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1370/2781] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:05:33.074791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947bd72-c4b8-47c7-a112-3d8bea774780 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:33.085540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947bd72-c4b8-47c7-a112-3d8bea774780 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:33.090535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e845ce-e482-4f2d-bcc0-167c83de88c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:33.091228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e845ce-e482-4f2d-bcc0-167c83de88c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:33.091554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e845ce-e482-4f2d-bcc0-167c83de88c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:33.091827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e845ce-e482-4f2d-bcc0-167c83de88c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:33.092874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e845ce-e482-4f2d-bcc0-167c83de88c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:05:33.093252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e845ce-e482-4f2d-bcc0-167c83de88c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:33.095638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e845ce-e482-4f2d-bcc0-167c83de88c2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:33.114033 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1371/2782] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:05:33.115054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e845ce-e482-4f2d-bcc0-167c83de88c2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:33.129590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fabe3bb8-fdbf-44e5-9995-4581286401f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9321670224b549749cc13233ffbe4c4e', 'request_id': 'req-fabe3bb8-fdbf-44e5-9995-4581286401f3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:33.141553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fabe3bb8-fdbf-44e5-9995-4581286401f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9321670224b549749cc13233ffbe4c4e', 'request_id': 'req-fabe3bb8-fdbf-44e5-9995-4581286401f3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:33.143175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e845ce-e482-4f2d-bcc0-167c83de88c2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:33.149491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fabe3bb8-fdbf-44e5-9995-4581286401f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9321670224b549749cc13233ffbe4c4e', 'request_id': 'req-fabe3bb8-fdbf-44e5-9995-4581286401f3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:33.167166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:33.176456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fabe3bb8-fdbf-44e5-9995-4581286401f3 admin admin] The token cache is being invalidate because project 9321670224b549749cc13233ffbe4c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:05:33.177196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fabe3bb8-fdbf-44e5-9995-4581286401f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:33.190123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fabe3bb8-fdbf-44e5-9995-4581286401f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:05:33.197906 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1412/2783] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:05:33 2022] DELETE /identity/v3/projects/9321670224b549749cc13233ffbe4c4e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:05:33.199747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343862df-a6c6-4d8d-aecf-cfc8af4c673f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:33.202232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343862df-a6c6-4d8d-aecf-cfc8af4c673f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:33.202686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343862df-a6c6-4d8d-aecf-cfc8af4c673f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:33.238582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-343862df-a6c6-4d8d-aecf-cfc8af4c673f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:33.239482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-343862df-a6c6-4d8d-aecf-cfc8af4c673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:33.241754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3aec7-4a80-44f1-916d-6484fd681282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:33.242431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3aec7-4a80-44f1-916d-6484fd681282 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:33.242709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3aec7-4a80-44f1-916d-6484fd681282 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:33.242982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3aec7-4a80-44f1-916d-6484fd681282 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:33.244569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3aec7-4a80-44f1-916d-6484fd681282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:33.245699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3aec7-4a80-44f1-916d-6484fd681282 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:33.252251 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1413/2784] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:05:33.262553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadc921-798e-444a-a1b6-921ea2d97b9d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:33.263233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadc921-798e-444a-a1b6-921ea2d97b9d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:33.263676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadc921-798e-444a-a1b6-921ea2d97b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:33.284515 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1372/2785] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:05:33 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:05:33.288947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3aec7-4a80-44f1-916d-6484fd681282 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:33.290957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6cf3aec7-4a80-44f1-916d-6484fd681282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:33.301136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4dadc921-798e-444a-a1b6-921ea2d97b9d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:33.302776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4dadc921-798e-444a-a1b6-921ea2d97b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:33.362422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3aec7-4a80-44f1-916d-6484fd681282 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:33.367840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7033927-9d96-4029-9596-a4de2deb8213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:33.368706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7033927-9d96-4029-9596-a4de2deb8213 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:33.369075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7033927-9d96-4029-9596-a4de2deb8213 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:33.369406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7033927-9d96-4029-9596-a4de2deb8213 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:33.370151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7033927-9d96-4029-9596-a4de2deb8213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:33.372256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7033927-9d96-4029-9596-a4de2deb8213 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:33.395928 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1414/2786] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:05:33.404855 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1373/2787] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:05:33 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:05:33.405656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadc921-798e-444a-a1b6-921ea2d97b9d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:33.406100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7033927-9d96-4029-9596-a4de2deb8213 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:33.420019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7033927-9d96-4029-9596-a4de2deb8213 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:33.420270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadc921-798e-444a-a1b6-921ea2d97b9d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:33.429388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09758f7-74c0-494d-823e-57aea7e158e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:33.430340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09758f7-74c0-494d-823e-57aea7e158e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:33.430722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09758f7-74c0-494d-823e-57aea7e158e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:33.430860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e143dcf-82f1-4d4b-b28b-753273bcc2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:33.431036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09758f7-74c0-494d-823e-57aea7e158e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:33.431671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e143dcf-82f1-4d4b-b28b-753273bcc2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:33.431786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09758f7-74c0-494d-823e-57aea7e158e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:05:33.432026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e143dcf-82f1-4d4b-b28b-753273bcc2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:33.432168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09758f7-74c0-494d-823e-57aea7e158e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:33.432847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e143dcf-82f1-4d4b-b28b-753273bcc2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:33.433654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e143dcf-82f1-4d4b-b28b-753273bcc2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:33.433775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09758f7-74c0-494d-823e-57aea7e158e2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:33.437591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e143dcf-82f1-4d4b-b28b-753273bcc2f6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:33.454812 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1415/2788] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:05:33.467007 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1374/2789] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:05:33.467248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09758f7-74c0-494d-823e-57aea7e158e2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:33.473282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e143dcf-82f1-4d4b-b28b-753273bcc2f6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:33.480264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09758f7-74c0-494d-823e-57aea7e158e2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:33.485069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e10a8f-ce63-493b-8e73-5e7fc9d1f579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:33.485777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e10a8f-ce63-493b-8e73-5e7fc9d1f579 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:33.485895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e143dcf-82f1-4d4b-b28b-753273bcc2f6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:33.486306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e10a8f-ce63-493b-8e73-5e7fc9d1f579 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:33.486601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e10a8f-ce63-493b-8e73-5e7fc9d1f579 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:33.487629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e10a8f-ce63-493b-8e73-5e7fc9d1f579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:33.489776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e10a8f-ce63-493b-8e73-5e7fc9d1f579 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:33.493612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b255721-3048-493c-a0e2-fd37a0cea29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:33.494756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b255721-3048-493c-a0e2-fd37a0cea29b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:33.495884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b255721-3048-493c-a0e2-fd37a0cea29b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:33.496367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b255721-3048-493c-a0e2-fd37a0cea29b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:33.497897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b255721-3048-493c-a0e2-fd37a0cea29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:33.500749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b255721-3048-493c-a0e2-fd37a0cea29b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:33.520574 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1375/2790] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:05:33.526541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b255721-3048-493c-a0e2-fd37a0cea29b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:33.531815 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1416/2791] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:05:33 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:05:33.536597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e10a8f-ce63-493b-8e73-5e7fc9d1f579 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:33.538663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b255721-3048-493c-a0e2-fd37a0cea29b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:33.542195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:33.632326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264961d8-2515-4624-8fcd-8d963e563092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:33.632326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264961d8-2515-4624-8fcd-8d963e563092 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:33.632326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264961d8-2515-4624-8fcd-8d963e563092 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:33.632326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264961d8-2515-4624-8fcd-8d963e563092 admin admin] PATH_INFO: `/v3/projects/31671d11617e46fd881d114812d41e35/users/224f488d6b99461bb8bc37921813fb74/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:33.639057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e10a8f-ce63-493b-8e73-5e7fc9d1f579 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:33.645643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ce0ff-e3ba-4e8c-86b1-ebe89be81e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:33.646357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ce0ff-e3ba-4e8c-86b1-ebe89be81e8a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:33.646642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ce0ff-e3ba-4e8c-86b1-ebe89be81e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:33.646921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ce0ff-e3ba-4e8c-86b1-ebe89be81e8a admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:33.647731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ce0ff-e3ba-4e8c-86b1-ebe89be81e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:33.650096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ce0ff-e3ba-4e8c-86b1-ebe89be81e8a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:33.654974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264961d8-2515-4624-8fcd-8d963e563092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31671d11617e46fd881d114812d41e35, user_id=224f488d6b99461bb8bc37921813fb74, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:33.658014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264961d8-2515-4624-8fcd-8d963e563092 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:33.662039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:33.675485 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1417/2793] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:05:33 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:05:33.680517 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1376/2793] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:05:33 2022] PUT /identity/v3/projects/31671d11617e46fd881d114812d41e35/users/224f488d6b99461bb8bc37921813fb74/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:05:33.681066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe359a9-ab77-49e6-a496-8c7a98b0a951 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:33.681361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe359a9-ab77-49e6-a496-8c7a98b0a951 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:33.681643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe359a9-ab77-49e6-a496-8c7a98b0a951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:33.682134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264961d8-2515-4624-8fcd-8d963e563092 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:33.699803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-abe359a9-ab77-49e6-a496-8c7a98b0a951 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:33.701170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-abe359a9-ab77-49e6-a496-8c7a98b0a951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:33.761425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264961d8-2515-4624-8fcd-8d963e563092 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:33.767095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdc049-42b3-46e1-99bd-755d228d6216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:33.768173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdc049-42b3-46e1-99bd-755d228d6216 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:33.768462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdc049-42b3-46e1-99bd-755d228d6216 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:33.768744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdc049-42b3-46e1-99bd-755d228d6216 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:33.769784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdc049-42b3-46e1-99bd-755d228d6216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:33.772081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdc049-42b3-46e1-99bd-755d228d6216 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:33.785719 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1377/2794] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:05:33.789681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdc049-42b3-46e1-99bd-755d228d6216 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:33.792875 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1418/2795] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:05:33.802386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdc049-42b3-46e1-99bd-755d228d6216 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:33.815570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe359a9-ab77-49e6-a496-8c7a98b0a951 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:33.816447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eff650-d10f-4b73-bc13-31eac48a01d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:33.817214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eff650-d10f-4b73-bc13-31eac48a01d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:33.817399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-abe359a9-ab77-49e6-a496-8c7a98b0a951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:33.818012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eff650-d10f-4b73-bc13-31eac48a01d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:33.818370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eff650-d10f-4b73-bc13-31eac48a01d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:33.819595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eff650-d10f-4b73-bc13-31eac48a01d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:33.821670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eff650-d10f-4b73-bc13-31eac48a01d6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:33.841951 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1378/2796] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:05:33.847004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eff650-d10f-4b73-bc13-31eac48a01d6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:33.867715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eff650-d10f-4b73-bc13-31eac48a01d6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:33.873289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810d93c-64a2-46ca-8715-5921a394cf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:33.883042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810d93c-64a2-46ca-8715-5921a394cf91 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:33.883042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810d93c-64a2-46ca-8715-5921a394cf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:33.883042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810d93c-64a2-46ca-8715-5921a394cf91 admin admin] PATH_INFO: `/v3/projects/426d63ca5cfa48e19a7156d1b848447e/users/097020096c1c4ff2b67800be67cd708a/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:33.891176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810d93c-64a2-46ca-8715-5921a394cf91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=426d63ca5cfa48e19a7156d1b848447e, user_id=097020096c1c4ff2b67800be67cd708a, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:33.894230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810d93c-64a2-46ca-8715-5921a394cf91 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:33.914924 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1379/2797] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:05:33 2022] PUT /identity/v3/projects/426d63ca5cfa48e19a7156d1b848447e/users/097020096c1c4ff2b67800be67cd708a/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:05:33.921111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca20b1f-15ca-4dec-8d31-7906118e6e97 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:33.921612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca20b1f-15ca-4dec-8d31-7906118e6e97 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:33.922066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca20b1f-15ca-4dec-8d31-7906118e6e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:33.926430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe359a9-ab77-49e6-a496-8c7a98b0a951 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:33.943095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-cca20b1f-15ca-4dec-8d31-7906118e6e97 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:33.944321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cca20b1f-15ca-4dec-8d31-7906118e6e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:33.973576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:33.979535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87542af5-190a-4efa-9aa8-21eedb95f4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:33.980426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87542af5-190a-4efa-9aa8-21eedb95f4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:33.980760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87542af5-190a-4efa-9aa8-21eedb95f4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:33.981042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87542af5-190a-4efa-9aa8-21eedb95f4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:34.017275 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1380/2798] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:05:34.028125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca20b1f-15ca-4dec-8d31-7906118e6e97 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:34.030144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cca20b1f-15ca-4dec-8d31-7906118e6e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:34.046878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca20b1f-15ca-4dec-8d31-7906118e6e97 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:34.051678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635d7a8-9701-4134-839f-9a0ca5de9042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:34.051678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635d7a8-9701-4134-839f-9a0ca5de9042 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:34.051988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635d7a8-9701-4134-839f-9a0ca5de9042 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:34.052371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635d7a8-9701-4134-839f-9a0ca5de9042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:34.056308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87542af5-190a-4efa-9aa8-21eedb95f4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:34.058247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87542af5-190a-4efa-9aa8-21eedb95f4b8 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:34.062897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635d7a8-9701-4134-839f-9a0ca5de9042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:34.064684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635d7a8-9701-4134-839f-9a0ca5de9042 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:34.073262 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1419/2799] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:05:34.080070 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1381/2800] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:05:35.113628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a1350-818d-4444-a12f-7d0b8e37d7f3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:35.114061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a1350-818d-4444-a12f-7d0b8e37d7f3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:35.114173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a1350-818d-4444-a12f-7d0b8e37d7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:35.133144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-204a1350-818d-4444-a12f-7d0b8e37d7f3 None None] MFA Rules not processed for user `f3287fb85c2343d686718d3c4aaa5c00`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:35.135069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-204a1350-818d-4444-a12f-7d0b8e37d7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:35.233910 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1420/2801] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:05:35.824385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960e7e0-d595-4884-bebd-a1f9f0b5ad76 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:35.824952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960e7e0-d595-4884-bebd-a1f9f0b5ad76 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:35.824952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960e7e0-d595-4884-bebd-a1f9f0b5ad76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:35.895481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6960e7e0-d595-4884-bebd-a1f9f0b5ad76 None None] MFA Rules not processed for user `224f488d6b99461bb8bc37921813fb74`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:35.897451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6960e7e0-d595-4884-bebd-a1f9f0b5ad76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:35.985131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:36.108615 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1382/2802] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:05:36.112829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38d310-71fd-480c-82a7-23fd75363c4e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:36.113608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38d310-71fd-480c-82a7-23fd75363c4e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:36.113877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38d310-71fd-480c-82a7-23fd75363c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:36.182434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ee38d310-71fd-480c-82a7-23fd75363c4e None None] MFA Rules not processed for user `224f488d6b99461bb8bc37921813fb74`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:36.184520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ee38d310-71fd-480c-82a7-23fd75363c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:36.214520 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1421/2803] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:05:36.225261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f03f21-d734-4ef4-a3f3-4f927c966101 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:36.225261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f03f21-d734-4ef4-a3f3-4f927c966101 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:36.225479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f03f21-d734-4ef4-a3f3-4f927c966101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:36.260120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-80f03f21-d734-4ef4-a3f3-4f927c966101 None None] MFA Rules not processed for user `224f488d6b99461bb8bc37921813fb74`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:36.263045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-80f03f21-d734-4ef4-a3f3-4f927c966101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:36.287575 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1383/2804] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:05:36.732293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38d310-71fd-480c-82a7-23fd75363c4e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:36.734039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ee38d310-71fd-480c-82a7-23fd75363c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:36.845348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38d310-71fd-480c-82a7-23fd75363c4e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:36.853310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892a1a0-7f91-4d87-a446-5f40eb2cebd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:36.854218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892a1a0-7f91-4d87-a446-5f40eb2cebd1 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:36.854697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892a1a0-7f91-4d87-a446-5f40eb2cebd1 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:36.855135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892a1a0-7f91-4d87-a446-5f40eb2cebd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:36.866314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892a1a0-7f91-4d87-a446-5f40eb2cebd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:36.868417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892a1a0-7f91-4d87-a446-5f40eb2cebd1 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:36.881751 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1422/2805] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:05:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:05:38.516000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3899f8-9605-4862-bb5a-2e5c522d79f0 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:38.522288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3899f8-9605-4862-bb5a-2e5c522d79f0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:38.522625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3899f8-9605-4862-bb5a-2e5c522d79f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:38.565222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bf3899f8-9605-4862-bb5a-2e5c522d79f0 None None] MFA Rules not processed for user `224f488d6b99461bb8bc37921813fb74`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:38.567083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bf3899f8-9605-4862-bb5a-2e5c522d79f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:38.583237 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1384/2806] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:05:41.045749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11112760-725d-492c-ae58-85e08ff87f3e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:41.047529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11112760-725d-492c-ae58-85e08ff87f3e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:41.048013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11112760-725d-492c-ae58-85e08ff87f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:41.099686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-11112760-725d-492c-ae58-85e08ff87f3e None None] MFA Rules not processed for user `224f488d6b99461bb8bc37921813fb74`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:41.101012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-11112760-725d-492c-ae58-85e08ff87f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:41.159080 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1423/2807] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:05:44.668622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c078d-fe42-453e-a599-1e1e38ecc11b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:44.669081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c078d-fe42-453e-a599-1e1e38ecc11b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:44.669183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c078d-fe42-453e-a599-1e1e38ecc11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:44.725803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a77c078d-fe42-453e-a599-1e1e38ecc11b None None] MFA Rules not processed for user `097020096c1c4ff2b67800be67cd708a`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:44.727098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a77c078d-fe42-453e-a599-1e1e38ecc11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:44.903064 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1385/2808] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:05:44.907266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11112760-725d-492c-ae58-85e08ff87f3e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:44.929042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11112760-725d-492c-ae58-85e08ff87f3e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:44.934048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c5d0b-aedb-432f-b546-72d0b092b533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:44.934849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c5d0b-aedb-432f-b546-72d0b092b533 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:44.935163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c5d0b-aedb-432f-b546-72d0b092b533 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:44.935649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c5d0b-aedb-432f-b546-72d0b092b533 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:44.936269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c5d0b-aedb-432f-b546-72d0b092b533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:44.938270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c5d0b-aedb-432f-b546-72d0b092b533 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:44.977701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:45.003344 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1424/2809] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:05:44 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:05:45.007255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c078d-fe42-453e-a599-1e1e38ecc11b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:45.027469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c078d-fe42-453e-a599-1e1e38ecc11b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:45.246358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f5d30-d619-43fa-b8b6-69dab1cda6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:45.247337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f5d30-d619-43fa-b8b6-69dab1cda6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:45.248006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f5d30-d619-43fa-b8b6-69dab1cda6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:45.248480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f5d30-d619-43fa-b8b6-69dab1cda6a6 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:45.249365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f5d30-d619-43fa-b8b6-69dab1cda6a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:45.251495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f5d30-d619-43fa-b8b6-69dab1cda6a6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:45.301321 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1386/2810] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:05:45 2022] POST /identity/v3/users => generated 298 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:05:45.305196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c5d0b-aedb-432f-b546-72d0b092b533 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:45.322592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c5d0b-aedb-432f-b546-72d0b092b533 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:45.343572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6560f6-03e1-4ca2-824b-9c64329addc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:45.344711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6560f6-03e1-4ca2-824b-9c64329addc2 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:45.345240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6560f6-03e1-4ca2-824b-9c64329addc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:45.345763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6560f6-03e1-4ca2-824b-9c64329addc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:45.346749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6560f6-03e1-4ca2-824b-9c64329addc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:45.348841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6560f6-03e1-4ca2-824b-9c64329addc2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:45.368013 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1425/2811] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:05:45.372804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f5d30-d619-43fa-b8b6-69dab1cda6a6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:45.384447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f5d30-d619-43fa-b8b6-69dab1cda6a6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:45.402268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fdc8c-2229-4e85-9612-1579f28def44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:45.403284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fdc8c-2229-4e85-9612-1579f28def44 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:45.403752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fdc8c-2229-4e85-9612-1579f28def44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:45.403975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fdc8c-2229-4e85-9612-1579f28def44 admin admin] PATH_INFO: `/v3/projects/d942b3d30344459ab6d6b7de865cb085/users/8819f845cd904f8b8cd2a38eb059cb07/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:45.447348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fdc8c-2229-4e85-9612-1579f28def44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d942b3d30344459ab6d6b7de865cb085, user_id=8819f845cd904f8b8cd2a38eb059cb07, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:45.450122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fdc8c-2229-4e85-9612-1579f28def44 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:45.493397 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1387/2812] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:05:45 2022] PUT /identity/v3/projects/d942b3d30344459ab6d6b7de865cb085/users/8819f845cd904f8b8cd2a38eb059cb07/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:05:45.497993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6560f6-03e1-4ca2-824b-9c64329addc2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:45.512409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6560f6-03e1-4ca2-824b-9c64329addc2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:45.685256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbbde2-b343-4d3c-82ee-52e8e8367573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:45.686378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbbde2-b343-4d3c-82ee-52e8e8367573 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:45.686997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbbde2-b343-4d3c-82ee-52e8e8367573 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:45.687841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbbde2-b343-4d3c-82ee-52e8e8367573 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:45.689697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbbde2-b343-4d3c-82ee-52e8e8367573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:45.693366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbbde2-b343-4d3c-82ee-52e8e8367573 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:45.714932 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1426/2813] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:05:45.720012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fdc8c-2229-4e85-9612-1579f28def44 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:45.737754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fdc8c-2229-4e85-9612-1579f28def44 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:45.748824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13951338-aeff-470f-bade-cf0871e5e917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:45.749783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951338-aeff-470f-bade-cf0871e5e917 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:45.750139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951338-aeff-470f-bade-cf0871e5e917 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:45.750358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951338-aeff-470f-bade-cf0871e5e917 admin admin] PATH_INFO: `/v3/projects/d942b3d30344459ab6d6b7de865cb085/users/8819f845cd904f8b8cd2a38eb059cb07/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:45.756206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13951338-aeff-470f-bade-cf0871e5e917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d942b3d30344459ab6d6b7de865cb085, user_id=8819f845cd904f8b8cd2a38eb059cb07, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:45.760116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13951338-aeff-470f-bade-cf0871e5e917 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:45.788999 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1388/2814] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:05:45 2022] PUT /identity/v3/projects/d942b3d30344459ab6d6b7de865cb085/users/8819f845cd904f8b8cd2a38eb059cb07/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:05:51.776374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421d0c5-a969-4747-9f77-216341c6be82 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:51.776896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421d0c5-a969-4747-9f77-216341c6be82 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:51.777358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421d0c5-a969-4747-9f77-216341c6be82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:51.816835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e421d0c5-a969-4747-9f77-216341c6be82 None None] MFA Rules not processed for user `592e8c2ad31f459fa0b37f219cc4f84c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:51.818902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e421d0c5-a969-4747-9f77-216341c6be82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:51.986725 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1427/2815] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:05:54.560089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13951338-aeff-470f-bade-cf0871e5e917 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:54.566348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:54.732790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13951338-aeff-470f-bade-cf0871e5e917 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:54.737570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61613d2e-7ed5-477a-a1f9-ceb108c35276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:54.738569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61613d2e-7ed5-477a-a1f9-ceb108c35276 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:54.739407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61613d2e-7ed5-477a-a1f9-ceb108c35276 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:54.740021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61613d2e-7ed5-477a-a1f9-ceb108c35276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:54.742588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-61613d2e-7ed5-477a-a1f9-ceb108c35276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:54.949112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61613d2e-7ed5-477a-a1f9-ceb108c35276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:54.950609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61613d2e-7ed5-477a-a1f9-ceb108c35276 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:54.979478 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1389/2816] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:05:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:05:56.549865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421d0c5-a969-4747-9f77-216341c6be82 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:56.562001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421d0c5-a969-4747-9f77-216341c6be82 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:56.568351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72631bfc-68ac-480a-87dc-df43ec0cac9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:56.569523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72631bfc-68ac-480a-87dc-df43ec0cac9b service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:56.570123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72631bfc-68ac-480a-87dc-df43ec0cac9b service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:56.571457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72631bfc-68ac-480a-87dc-df43ec0cac9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:56.573715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-72631bfc-68ac-480a-87dc-df43ec0cac9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:56.599972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72631bfc-68ac-480a-87dc-df43ec0cac9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:56.603355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72631bfc-68ac-480a-87dc-df43ec0cac9b service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:56.627354 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1428/2817] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:05:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:05:57.062067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fec3a4-7f14-4b1f-ac55-e4d0cda34147 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:57.062589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fec3a4-7f14-4b1f-ac55-e4d0cda34147 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:57.062808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fec3a4-7f14-4b1f-ac55-e4d0cda34147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:57.111132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-70fec3a4-7f14-4b1f-ac55-e4d0cda34147 None None] MFA Rules not processed for user `3fefe83ec0664f6188af74ea4b5c1291`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:57.113292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-70fec3a4-7f14-4b1f-ac55-e4d0cda34147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:57.230328 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1390/2818] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:05:58.409860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72631bfc-68ac-480a-87dc-df43ec0cac9b service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:58.412207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-72631bfc-68ac-480a-87dc-df43ec0cac9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:58.529315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72631bfc-68ac-480a-87dc-df43ec0cac9b service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:58.535827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77025d-ba25-4e62-af6b-d8487f424cb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:58.536875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77025d-ba25-4e62-af6b-d8487f424cb6 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:58.537379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77025d-ba25-4e62-af6b-d8487f424cb6 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:58.537867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77025d-ba25-4e62-af6b-d8487f424cb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:58.542244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8c77025d-ba25-4e62-af6b-d8487f424cb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:58.559367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77025d-ba25-4e62-af6b-d8487f424cb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:58.561811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77025d-ba25-4e62-af6b-d8487f424cb6 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:58.569196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:58.581067 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1429/2819] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:05:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:05:58.866356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0329f7f-9043-408f-b0d0-1fb0c8134722 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:58.866898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0329f7f-9043-408f-b0d0-1fb0c8134722 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:58.866898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0329f7f-9043-408f-b0d0-1fb0c8134722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:58.903996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e0329f7f-9043-408f-b0d0-1fb0c8134722 None None] MFA Rules not processed for user `8819f845cd904f8b8cd2a38eb059cb07`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:05:58.906184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e0329f7f-9043-408f-b0d0-1fb0c8134722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:58.967256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:59.020780 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1391/2820] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:05:59.038322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77025d-ba25-4e62-af6b-d8487f424cb6 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:59.040221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8c77025d-ba25-4e62-af6b-d8487f424cb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:59.160377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77025d-ba25-4e62-af6b-d8487f424cb6 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:59.165226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee614ec-29ed-4f4d-b3f2-1a48692c0150 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:59.166149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee614ec-29ed-4f4d-b3f2-1a48692c0150 service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:59.166583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee614ec-29ed-4f4d-b3f2-1a48692c0150 service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:59.167015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee614ec-29ed-4f4d-b3f2-1a48692c0150 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:59.181608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee614ec-29ed-4f4d-b3f2-1a48692c0150 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:59.184437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee614ec-29ed-4f4d-b3f2-1a48692c0150 service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:59.197438 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1430/2821] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:05:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:05:59.331655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0329f7f-9043-408f-b0d0-1fb0c8134722 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:05:59.347936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0329f7f-9043-408f-b0d0-1fb0c8134722 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:05:59.405713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308faaa4-88b1-481c-8acc-7cb9e606fa0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:05:59.406478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308faaa4-88b1-481c-8acc-7cb9e606fa0c service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:05:59.406767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308faaa4-88b1-481c-8acc-7cb9e606fa0c service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:05:59.407048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308faaa4-88b1-481c-8acc-7cb9e606fa0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:05:59.428933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-308faaa4-88b1-481c-8acc-7cb9e606fa0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:05:59.468497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308faaa4-88b1-481c-8acc-7cb9e606fa0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:05:59.474548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308faaa4-88b1-481c-8acc-7cb9e606fa0c service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:05:59.541831 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1392/2822] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:05:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:04.480907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee614ec-29ed-4f4d-b3f2-1a48692c0150 service glance] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:04.497712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee614ec-29ed-4f4d-b3f2-1a48692c0150 service glance] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:04.512021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174bba9-32bb-4cb4-9665-846a0215262f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:04.512731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174bba9-32bb-4cb4-9665-846a0215262f service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:04.513065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174bba9-32bb-4cb4-9665-846a0215262f service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:04.513346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174bba9-32bb-4cb4-9665-846a0215262f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:04.521652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9174bba9-32bb-4cb4-9665-846a0215262f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:04.560712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174bba9-32bb-4cb4-9665-846a0215262f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:04.568810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174bba9-32bb-4cb4-9665-846a0215262f service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:04.597630 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1431/2823] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:09.510329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=18 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:10.889104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1b5b9-73db-4bf1-929b-2c50f5875f47 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:10.889104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1b5b9-73db-4bf1-929b-2c50f5875f47 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:10.889104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1b5b9-73db-4bf1-929b-2c50f5875f47 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:10.889104 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1393/2824] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:06:10.896600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18335f5e-393a-4874-bccb-dcd4f7ee2cee None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:10.897257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18335f5e-393a-4874-bccb-dcd4f7ee2cee None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:10.897257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18335f5e-393a-4874-bccb-dcd4f7ee2cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:10.924852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-18335f5e-393a-4874-bccb-dcd4f7ee2cee None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:10.926395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-18335f5e-393a-4874-bccb-dcd4f7ee2cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:10.942166 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1432/2825] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:06:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:10.960682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1b5b9-73db-4bf1-929b-2c50f5875f47 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:10.965618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c8b1b5b9-73db-4bf1-929b-2c50f5875f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:10.997283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1b5b9-73db-4bf1-929b-2c50f5875f47 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:11.002519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537139ab-b24c-4177-baf7-c73b6cfb2d07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:11.003177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537139ab-b24c-4177-baf7-c73b6cfb2d07 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:11.003459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537139ab-b24c-4177-baf7-c73b6cfb2d07 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:11.003743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537139ab-b24c-4177-baf7-c73b6cfb2d07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:11.014599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537139ab-b24c-4177-baf7-c73b6cfb2d07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:11.016755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537139ab-b24c-4177-baf7-c73b6cfb2d07 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:11.042615 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1394/2826] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:12.021626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a584ec8-6c43-4df5-b7df-d8df1c49774c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:12.022165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a584ec8-6c43-4df5-b7df-d8df1c49774c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:12.022299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a584ec8-6c43-4df5-b7df-d8df1c49774c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:12.040980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1a584ec8-6c43-4df5-b7df-d8df1c49774c None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:12.042142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1a584ec8-6c43-4df5-b7df-d8df1c49774c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:12.125429 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1433/2827] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:06:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:12.176766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537139ab-b24c-4177-baf7-c73b6cfb2d07 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:12.178337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-537139ab-b24c-4177-baf7-c73b6cfb2d07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:12.259450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537139ab-b24c-4177-baf7-c73b6cfb2d07 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:12.264901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09833371-263d-4b0f-b64a-30925fe3ad8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:12.265555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09833371-263d-4b0f-b64a-30925fe3ad8e service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:12.265829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09833371-263d-4b0f-b64a-30925fe3ad8e service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:12.266099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09833371-263d-4b0f-b64a-30925fe3ad8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:12.274557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09833371-263d-4b0f-b64a-30925fe3ad8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:12.276172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09833371-263d-4b0f-b64a-30925fe3ad8e service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:12.284590 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1395/2828] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:06:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:06:15.663957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6d636-ab14-4e93-80b7-1ba649293ba5 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:15.664560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6d636-ab14-4e93-80b7-1ba649293ba5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:15.664560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6d636-ab14-4e93-80b7-1ba649293ba5 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:15.665891 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1434/2829] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:06:15.674706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20f8c4-08f3-4693-95a2-dab1241de38d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:15.675306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20f8c4-08f3-4693-95a2-dab1241de38d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:15.675306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20f8c4-08f3-4693-95a2-dab1241de38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:15.718988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0b20f8c4-08f3-4693-95a2-dab1241de38d None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:15.720719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0b20f8c4-08f3-4693-95a2-dab1241de38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:15.746027 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1396/2830] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:06:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:15.792029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6d636-ab14-4e93-80b7-1ba649293ba5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:15.824624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6d636-ab14-4e93-80b7-1ba649293ba5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:15.848870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a9337-8c92-4a29-835e-6302b2dad70a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:15.849746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a9337-8c92-4a29-835e-6302b2dad70a service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:15.850227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a9337-8c92-4a29-835e-6302b2dad70a service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:15.850671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a9337-8c92-4a29-835e-6302b2dad70a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:15.871244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a9337-8c92-4a29-835e-6302b2dad70a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:15.876251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a9337-8c92-4a29-835e-6302b2dad70a service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:15.926232 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1435/2831] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:16.317059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f1ebe-56aa-4bc2-9598-776d282fa293 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:16.318479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f1ebe-56aa-4bc2-9598-776d282fa293 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:16.319216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f1ebe-56aa-4bc2-9598-776d282fa293 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:16.323430 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1397/2832] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:06:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:06:16.330297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26451cc8-5d37-419c-87a9-bfc5e294d6e4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:16.330585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26451cc8-5d37-419c-87a9-bfc5e294d6e4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:16.330860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26451cc8-5d37-419c-87a9-bfc5e294d6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:16.360314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-26451cc8-5d37-419c-87a9-bfc5e294d6e4 None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:16.362417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-26451cc8-5d37-419c-87a9-bfc5e294d6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:16.396693 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1436/2833] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:06:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:16.443257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f1ebe-56aa-4bc2-9598-776d282fa293 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:16.470023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f1ebe-56aa-4bc2-9598-776d282fa293 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:16.479559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118838c5-be34-4ad3-a191-307a2e7a85d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:16.480767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118838c5-be34-4ad3-a191-307a2e7a85d3 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:16.481203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118838c5-be34-4ad3-a191-307a2e7a85d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:16.481665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118838c5-be34-4ad3-a191-307a2e7a85d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:16.508961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118838c5-be34-4ad3-a191-307a2e7a85d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:16.510498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118838c5-be34-4ad3-a191-307a2e7a85d3 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:16.540124 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1398/2834] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:26.029169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26451cc8-5d37-419c-87a9-bfc5e294d6e4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:26.031645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-26451cc8-5d37-419c-87a9-bfc5e294d6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:26.173569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26451cc8-5d37-419c-87a9-bfc5e294d6e4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:26.181092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ce927-290a-4d32-8daf-26e2fadb7b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:26.182422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ce927-290a-4d32-8daf-26e2fadb7b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:26.182722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ce927-290a-4d32-8daf-26e2fadb7b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:26.182981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ce927-290a-4d32-8daf-26e2fadb7b46 admin admin] PATH_INFO: `/v3/users/a60bf5141fea499abb9b22658e56c944` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:26.184346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ce927-290a-4d32-8daf-26e2fadb7b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a60bf5141fea499abb9b22658e56c944)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:26.186878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ce927-290a-4d32-8daf-26e2fadb7b46 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:26.203662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:26.292408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ac5ce927-290a-4d32-8daf-26e2fadb7b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a60bf5141fea499abb9b22658e56c944'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:26.305937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ac5ce927-290a-4d32-8daf-26e2fadb7b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a60bf5141fea499abb9b22658e56c944'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:26.306609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ac5ce927-290a-4d32-8daf-26e2fadb7b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a60bf5141fea499abb9b22658e56c944'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:26.307312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ac5ce927-290a-4d32-8daf-26e2fadb7b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a60bf5141fea499abb9b22658e56c944'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:26.319004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ac5ce927-290a-4d32-8daf-26e2fadb7b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a60bf5141fea499abb9b22658e56c944'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:26.353080 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1437/2835] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:06:26 2022] DELETE /identity/v3/users/a60bf5141fea499abb9b22658e56c944 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:26.528149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=47 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:26.844591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118838c5-be34-4ad3-a191-307a2e7a85d3 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:26.860752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118838c5-be34-4ad3-a191-307a2e7a85d3 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:26.947931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b3dad-98aa-44b4-b6e1-f7bc1d4075c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:26.949111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3dad-98aa-44b4-b6e1-f7bc1d4075c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:26.949668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3dad-98aa-44b4-b6e1-f7bc1d4075c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:26.950268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3dad-98aa-44b4-b6e1-f7bc1d4075c9 admin admin] PATH_INFO: `/v3/projects/f8920bed46d34026a06fedf429e5cca4` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:26.952061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b3dad-98aa-44b4-b6e1-f7bc1d4075c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8920bed46d34026a06fedf429e5cca4)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:26.954336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b3dad-98aa-44b4-b6e1-f7bc1d4075c9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:27.023184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1b2b3dad-98aa-44b4-b6e1-f7bc1d4075c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8920bed46d34026a06fedf429e5cca4', 'request_id': 'req-1b2b3dad-98aa-44b4-b6e1-f7bc1d4075c9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:27.030793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1b2b3dad-98aa-44b4-b6e1-f7bc1d4075c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8920bed46d34026a06fedf429e5cca4', 'request_id': 'req-1b2b3dad-98aa-44b4-b6e1-f7bc1d4075c9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:27.045213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1b2b3dad-98aa-44b4-b6e1-f7bc1d4075c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8920bed46d34026a06fedf429e5cca4', 'request_id': 'req-1b2b3dad-98aa-44b4-b6e1-f7bc1d4075c9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:27.064026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1b2b3dad-98aa-44b4-b6e1-f7bc1d4075c9 admin admin] The token cache is being invalidate because project f8920bed46d34026a06fedf429e5cca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:06:27.064375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1b2b3dad-98aa-44b4-b6e1-f7bc1d4075c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:27.065060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1b2b3dad-98aa-44b4-b6e1-f7bc1d4075c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:27.071227 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1399/2836] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:06:26 2022] DELETE /identity/v3/projects/f8920bed46d34026a06fedf429e5cca4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:27.071410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ce927-290a-4d32-8daf-26e2fadb7b46 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:27.073827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ac5ce927-290a-4d32-8daf-26e2fadb7b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:27.097768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ce927-290a-4d32-8daf-26e2fadb7b46 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:27.209006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d54b6a-4e68-4ab5-b6ef-1753926e8654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:27.210079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d54b6a-4e68-4ab5-b6ef-1753926e8654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:27.210365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d54b6a-4e68-4ab5-b6ef-1753926e8654 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:27.210646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d54b6a-4e68-4ab5-b6ef-1753926e8654 admin admin] PATH_INFO: `/v3/users/5048815dbc9346f4b80e0fcf89236176` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:27.213844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d54b6a-4e68-4ab5-b6ef-1753926e8654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5048815dbc9346f4b80e0fcf89236176)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:27.217167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d54b6a-4e68-4ab5-b6ef-1753926e8654 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:27.316466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-32d54b6a-4e68-4ab5-b6ef-1753926e8654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5048815dbc9346f4b80e0fcf89236176'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:27.328457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-32d54b6a-4e68-4ab5-b6ef-1753926e8654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5048815dbc9346f4b80e0fcf89236176'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:27.329147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-32d54b6a-4e68-4ab5-b6ef-1753926e8654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5048815dbc9346f4b80e0fcf89236176'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:27.329861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-32d54b6a-4e68-4ab5-b6ef-1753926e8654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5048815dbc9346f4b80e0fcf89236176'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:27.342332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-32d54b6a-4e68-4ab5-b6ef-1753926e8654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5048815dbc9346f4b80e0fcf89236176'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:27.374340 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1438/2837] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:06:27 2022] DELETE /identity/v3/users/5048815dbc9346f4b80e0fcf89236176 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:27.662781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b3dad-98aa-44b4-b6e1-f7bc1d4075c9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:27.664593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1b2b3dad-98aa-44b4-b6e1-f7bc1d4075c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:27.688510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b3dad-98aa-44b4-b6e1-f7bc1d4075c9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:27.770588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808033cd-f9f0-4204-9e9f-7e8d9b78182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:27.784946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808033cd-f9f0-4204-9e9f-7e8d9b78182b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:27.785290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808033cd-f9f0-4204-9e9f-7e8d9b78182b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:27.785505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808033cd-f9f0-4204-9e9f-7e8d9b78182b admin admin] PATH_INFO: `/v3/projects/9d755969a6714b5c8b63f7bb043418ba` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:27.786999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808033cd-f9f0-4204-9e9f-7e8d9b78182b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d755969a6714b5c8b63f7bb043418ba)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:27.789329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808033cd-f9f0-4204-9e9f-7e8d9b78182b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:27.836880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:27.854343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-808033cd-f9f0-4204-9e9f-7e8d9b78182b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d755969a6714b5c8b63f7bb043418ba', 'request_id': 'req-808033cd-f9f0-4204-9e9f-7e8d9b78182b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:27.863099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-808033cd-f9f0-4204-9e9f-7e8d9b78182b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d755969a6714b5c8b63f7bb043418ba', 'request_id': 'req-808033cd-f9f0-4204-9e9f-7e8d9b78182b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:27.883490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-808033cd-f9f0-4204-9e9f-7e8d9b78182b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d755969a6714b5c8b63f7bb043418ba', 'request_id': 'req-808033cd-f9f0-4204-9e9f-7e8d9b78182b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:27.900486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-808033cd-f9f0-4204-9e9f-7e8d9b78182b admin admin] The token cache is being invalidate because project 9d755969a6714b5c8b63f7bb043418ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:06:27.901198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-808033cd-f9f0-4204-9e9f-7e8d9b78182b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:27.902096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-808033cd-f9f0-4204-9e9f-7e8d9b78182b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:27.903913 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1400/2838] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:06:27 2022] DELETE /identity/v3/projects/9d755969a6714b5c8b63f7bb043418ba => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:27.910034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4beb30-c4a5-49b0-8d82-321abeecb7db None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:27.911155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4beb30-c4a5-49b0-8d82-321abeecb7db None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:27.911453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4beb30-c4a5-49b0-8d82-321abeecb7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:27.929199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:27.937180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-cc4beb30-c4a5-49b0-8d82-321abeecb7db None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:27.938524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cc4beb30-c4a5-49b0-8d82-321abeecb7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:28.024736 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1439/2839] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:28.033300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e435bf-d6d5-479e-b04e-15e6fcea821a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:28.033584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e435bf-d6d5-479e-b04e-15e6fcea821a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:28.033858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e435bf-d6d5-479e-b04e-15e6fcea821a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:28.055382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-85e435bf-d6d5-479e-b04e-15e6fcea821a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:28.057139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-85e435bf-d6d5-479e-b04e-15e6fcea821a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:28.067132 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1401/2840] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:28.071847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4beb30-c4a5-49b0-8d82-321abeecb7db None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:28.086710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4beb30-c4a5-49b0-8d82-321abeecb7db None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:28.097450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d63c6-b078-4a87-8b2b-f70feae10ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:28.097450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d63c6-b078-4a87-8b2b-f70feae10ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:28.097450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d63c6-b078-4a87-8b2b-f70feae10ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:28.097450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d63c6-b078-4a87-8b2b-f70feae10ac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:28.100585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e435bf-d6d5-479e-b04e-15e6fcea821a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:28.100686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d63c6-b078-4a87-8b2b-f70feae10ac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:06:28.100686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d63c6-b078-4a87-8b2b-f70feae10ac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:28.100968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-85e435bf-d6d5-479e-b04e-15e6fcea821a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:28.103339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d63c6-b078-4a87-8b2b-f70feae10ac4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:28.120329 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1440/2841] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:06:28.124667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d63c6-b078-4a87-8b2b-f70feae10ac4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:28.136966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d63c6-b078-4a87-8b2b-f70feae10ac4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:28.145106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0af21-e200-40d2-8821-9f5a3f6f1e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:28.145808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0af21-e200-40d2-8821-9f5a3f6f1e7a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:28.146702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0af21-e200-40d2-8821-9f5a3f6f1e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:28.146702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0af21-e200-40d2-8821-9f5a3f6f1e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:28.147268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0af21-e200-40d2-8821-9f5a3f6f1e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:28.149395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0af21-e200-40d2-8821-9f5a3f6f1e7a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:28.191383 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1441/2842] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:06:28 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:06:28.192580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0af21-e200-40d2-8821-9f5a3f6f1e7a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:28.207183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e435bf-d6d5-479e-b04e-15e6fcea821a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:28.280052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0af21-e200-40d2-8821-9f5a3f6f1e7a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:28.287080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471dae0-7ba4-4e22-918b-a34dd31f479a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:28.287758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471dae0-7ba4-4e22-918b-a34dd31f479a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:28.288061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471dae0-7ba4-4e22-918b-a34dd31f479a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:28.288350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471dae0-7ba4-4e22-918b-a34dd31f479a admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:28.289047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471dae0-7ba4-4e22-918b-a34dd31f479a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:28.290727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2aa718-e998-4979-9e2d-c68ccf669606 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:28.291134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471dae0-7ba4-4e22-918b-a34dd31f479a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:28.291481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2aa718-e998-4979-9e2d-c68ccf669606 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:28.291765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2aa718-e998-4979-9e2d-c68ccf669606 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:28.292055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2aa718-e998-4979-9e2d-c68ccf669606 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:28.294070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ab2aa718-e998-4979-9e2d-c68ccf669606 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:28.320524 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1442/2843] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:06:28 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:06:28.325082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471dae0-7ba4-4e22-918b-a34dd31f479a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:28.338680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471dae0-7ba4-4e22-918b-a34dd31f479a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:28.345321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b6a42-0543-4897-9d5e-d2e9c06571c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:28.346306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6a42-0543-4897-9d5e-d2e9c06571c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:28.346687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6a42-0543-4897-9d5e-d2e9c06571c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:28.347434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6a42-0543-4897-9d5e-d2e9c06571c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:28.348399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b6a42-0543-4897-9d5e-d2e9c06571c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:28.350440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b6a42-0543-4897-9d5e-d2e9c06571c9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:28.356728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:28.365979 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1443/2844] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:06:28.367120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b6a42-0543-4897-9d5e-d2e9c06571c9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:28.370650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2aa718-e998-4979-9e2d-c68ccf669606 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:28.375112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2aa718-e998-4979-9e2d-c68ccf669606 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:28.379048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b6a42-0543-4897-9d5e-d2e9c06571c9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:28.385064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec230e5-4e16-4720-bcf1-fa359b516898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:28.385899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec230e5-4e16-4720-bcf1-fa359b516898 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:28.386246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec230e5-4e16-4720-bcf1-fa359b516898 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:28.386585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec230e5-4e16-4720-bcf1-fa359b516898 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:28.387925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec230e5-4e16-4720-bcf1-fa359b516898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:28.389857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec230e5-4e16-4720-bcf1-fa359b516898 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:28.392219 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1402/2845] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:28.405233 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1444/2846] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:06:28.406625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2aa718-e998-4979-9e2d-c68ccf669606 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:28.418930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2aa718-e998-4979-9e2d-c68ccf669606 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:28.425871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc6002-db1d-4182-a5fd-cf0b1f92b817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:28.426814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc6002-db1d-4182-a5fd-cf0b1f92b817 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:28.427301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc6002-db1d-4182-a5fd-cf0b1f92b817 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:28.427633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc6002-db1d-4182-a5fd-cf0b1f92b817 admin admin] PATH_INFO: `/v3/projects/9aa2afc8b7e046839c5ce7a82e74744b/users/ba45933f6a5b4ea39a148139ff10f596/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:28.449382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc6002-db1d-4182-a5fd-cf0b1f92b817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa2afc8b7e046839c5ce7a82e74744b, user_id=ba45933f6a5b4ea39a148139ff10f596, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:28.455930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc6002-db1d-4182-a5fd-cf0b1f92b817 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:28.473417 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1403/2847] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:06:28 2022] PUT /identity/v3/projects/9aa2afc8b7e046839c5ce7a82e74744b/users/ba45933f6a5b4ea39a148139ff10f596/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:28.484633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c917b-37b5-48fc-964f-6179e7fd76ab None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:28.484919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c917b-37b5-48fc-964f-6179e7fd76ab None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:28.485204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c917b-37b5-48fc-964f-6179e7fd76ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:28.529065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b81c917b-37b5-48fc-964f-6179e7fd76ab None None] MFA Rules not processed for user `ba45933f6a5b4ea39a148139ff10f596`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:28.530731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b81c917b-37b5-48fc-964f-6179e7fd76ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:28.583327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:28.658268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc6002-db1d-4182-a5fd-cf0b1f92b817 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:28.663743 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1445/2848] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:28.769682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc6002-db1d-4182-a5fd-cf0b1f92b817 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:28.777733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638822d-0d69-4276-8cc0-bf32cd881956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:28.778452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638822d-0d69-4276-8cc0-bf32cd881956 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:28.778880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638822d-0d69-4276-8cc0-bf32cd881956 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:28.779215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638822d-0d69-4276-8cc0-bf32cd881956 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:28.779940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638822d-0d69-4276-8cc0-bf32cd881956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:28.782076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638822d-0d69-4276-8cc0-bf32cd881956 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:28.823165 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1404/2849] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:06:28 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:06:28.826480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c917b-37b5-48fc-964f-6179e7fd76ab None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:28.841448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c917b-37b5-48fc-964f-6179e7fd76ab None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:28.909306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed0574-b8b1-4f19-835f-5e65e27190af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:28.910079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed0574-b8b1-4f19-835f-5e65e27190af admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:28.910369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed0574-b8b1-4f19-835f-5e65e27190af admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:28.910637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed0574-b8b1-4f19-835f-5e65e27190af admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:28.911344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed0574-b8b1-4f19-835f-5e65e27190af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:28.913364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed0574-b8b1-4f19-835f-5e65e27190af admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:28.939006 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1446/2850] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:06:28 2022] POST /identity/v3/users => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:06:28.943250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638822d-0d69-4276-8cc0-bf32cd881956 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:28.958581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638822d-0d69-4276-8cc0-bf32cd881956 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:28.965385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98865a-8b3d-493c-accc-9cb5ab18556f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:28.966581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98865a-8b3d-493c-accc-9cb5ab18556f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:28.966975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98865a-8b3d-493c-accc-9cb5ab18556f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:28.967332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98865a-8b3d-493c-accc-9cb5ab18556f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:28.968461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98865a-8b3d-493c-accc-9cb5ab18556f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:28.970253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98865a-8b3d-493c-accc-9cb5ab18556f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:28.983127 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1405/2851] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:06:28.987461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed0574-b8b1-4f19-835f-5e65e27190af admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:29.002078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed0574-b8b1-4f19-835f-5e65e27190af admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:29.008616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30738d3-cec2-41ea-9833-6d655783c5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:29.009690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30738d3-cec2-41ea-9833-6d655783c5b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:29.009968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30738d3-cec2-41ea-9833-6d655783c5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:29.012156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30738d3-cec2-41ea-9833-6d655783c5b2 admin admin] PATH_INFO: `/v3/projects/470ccd006c414ad3b9378eb3cc46785a/users/de58178026e64a169fbe09b55fd55e64/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:29.042940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30738d3-cec2-41ea-9833-6d655783c5b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=470ccd006c414ad3b9378eb3cc46785a, user_id=de58178026e64a169fbe09b55fd55e64, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:29.048489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30738d3-cec2-41ea-9833-6d655783c5b2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:29.072892 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1447/2852] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:06:28 2022] PUT /identity/v3/projects/470ccd006c414ad3b9378eb3cc46785a/users/de58178026e64a169fbe09b55fd55e64/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:29.075743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98865a-8b3d-493c-accc-9cb5ab18556f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:29.110046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98865a-8b3d-493c-accc-9cb5ab18556f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:29.239394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24912d64-4780-431b-b3e4-048274f6a3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:29.240233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24912d64-4780-431b-b3e4-048274f6a3ad admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:29.240672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24912d64-4780-431b-b3e4-048274f6a3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:29.241110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24912d64-4780-431b-b3e4-048274f6a3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:29.242419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24912d64-4780-431b-b3e4-048274f6a3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:29.254159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24912d64-4780-431b-b3e4-048274f6a3ad admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:29.268718 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1406/2853] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:06:29.273048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30738d3-cec2-41ea-9833-6d655783c5b2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:29.287950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30738d3-cec2-41ea-9833-6d655783c5b2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:29.294970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5a65f-98dd-4e6a-bf49-d00fa115766f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:29.295973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5a65f-98dd-4e6a-bf49-d00fa115766f admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:29.296340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5a65f-98dd-4e6a-bf49-d00fa115766f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:29.296635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5a65f-98dd-4e6a-bf49-d00fa115766f admin admin] PATH_INFO: `/v3/projects/470ccd006c414ad3b9378eb3cc46785a/users/de58178026e64a169fbe09b55fd55e64/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:29.299949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5a65f-98dd-4e6a-bf49-d00fa115766f admin admin] RBAC: Authorizing `identity:create_grant(project_id=470ccd006c414ad3b9378eb3cc46785a, user_id=de58178026e64a169fbe09b55fd55e64, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:29.303048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5a65f-98dd-4e6a-bf49-d00fa115766f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:29.337216 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1448/2854] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:06:29 2022] PUT /identity/v3/projects/470ccd006c414ad3b9378eb3cc46785a/users/de58178026e64a169fbe09b55fd55e64/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:29.348476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19e5e4-e89b-4128-bd4e-1f9eb6ee7588 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:29.348786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19e5e4-e89b-4128-bd4e-1f9eb6ee7588 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:29.349039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19e5e4-e89b-4128-bd4e-1f9eb6ee7588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:29.382286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8c19e5e4-e89b-4128-bd4e-1f9eb6ee7588 None None] MFA Rules not processed for user `de58178026e64a169fbe09b55fd55e64`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:29.383718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8c19e5e4-e89b-4128-bd4e-1f9eb6ee7588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:29.422578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:29.487703 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1407/2855] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:06:29.499324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5a65f-98dd-4e6a-bf49-d00fa115766f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:29.581110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5a65f-98dd-4e6a-bf49-d00fa115766f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:29.588813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f81e2-cd22-4409-b995-bc7935f5b09a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:29.589670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f81e2-cd22-4409-b995-bc7935f5b09a service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:29.589984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f81e2-cd22-4409-b995-bc7935f5b09a service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:29.590326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f81e2-cd22-4409-b995-bc7935f5b09a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:29.601151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f81e2-cd22-4409-b995-bc7935f5b09a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:29.603169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f81e2-cd22-4409-b995-bc7935f5b09a service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:29.615195 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1449/2856] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:30.317994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19e5e4-e89b-4128-bd4e-1f9eb6ee7588 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:30.320133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8c19e5e4-e89b-4128-bd4e-1f9eb6ee7588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:30.399183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f81e2-cd22-4409-b995-bc7935f5b09a service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:30.411645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:30.424414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19e5e4-e89b-4128-bd4e-1f9eb6ee7588 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:30.429639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3dbf5-ade1-4807-90a0-6cac08d5854e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:30.430509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3dbf5-ade1-4807-90a0-6cac08d5854e service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:30.431008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3dbf5-ade1-4807-90a0-6cac08d5854e service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:30.431435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3dbf5-ade1-4807-90a0-6cac08d5854e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:30.433865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bef3dbf5-ade1-4807-90a0-6cac08d5854e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:30.518082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f81e2-cd22-4409-b995-bc7935f5b09a service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:30.552603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15c002-4827-402e-98bc-1d76f0a0f01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:30.554008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15c002-4827-402e-98bc-1d76f0a0f01e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:30.554008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15c002-4827-402e-98bc-1d76f0a0f01e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:30.554236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15c002-4827-402e-98bc-1d76f0a0f01e admin admin] PATH_INFO: `/v3/users/ba45933f6a5b4ea39a148139ff10f596` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:30.555777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15c002-4827-402e-98bc-1d76f0a0f01e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba45933f6a5b4ea39a148139ff10f596)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:30.566086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3dbf5-ade1-4807-90a0-6cac08d5854e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:30.571857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3dbf5-ade1-4807-90a0-6cac08d5854e service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:30.574467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15c002-4827-402e-98bc-1d76f0a0f01e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:30.591176 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1408/2857] 10.222.0.43 () {60 vars in 1396 bytes} [Sat Jul 2 21:06:30 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3264 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:30.592342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c47226-7e02-4947-a44d-26c7e0c87268 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:30.592635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c47226-7e02-4947-a44d-26c7e0c87268 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:30.592921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c47226-7e02-4947-a44d-26c7e0c87268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:30.629158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-07c47226-7e02-4947-a44d-26c7e0c87268 None None] MFA Rules not processed for user `097020096c1c4ff2b67800be67cd708a`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:30.637720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-07c47226-7e02-4947-a44d-26c7e0c87268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:30.702656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bd15c002-4827-402e-98bc-1d76f0a0f01e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba45933f6a5b4ea39a148139ff10f596'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:30.722238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bd15c002-4827-402e-98bc-1d76f0a0f01e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba45933f6a5b4ea39a148139ff10f596'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:30.723108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bd15c002-4827-402e-98bc-1d76f0a0f01e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba45933f6a5b4ea39a148139ff10f596'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:30.724115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bd15c002-4827-402e-98bc-1d76f0a0f01e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba45933f6a5b4ea39a148139ff10f596'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:30.745030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bd15c002-4827-402e-98bc-1d76f0a0f01e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba45933f6a5b4ea39a148139ff10f596'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:30.777371 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1409/2858] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:30.822267 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1450/2859] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:06:30 2022] DELETE /identity/v3/users/ba45933f6a5b4ea39a148139ff10f596 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:30.831937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f164eb2-551f-4e7c-93dc-ba9f50378701 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:30.832863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f164eb2-551f-4e7c-93dc-ba9f50378701 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:30.832863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f164eb2-551f-4e7c-93dc-ba9f50378701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:30.862369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8f164eb2-551f-4e7c-93dc-ba9f50378701 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:30.863718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8f164eb2-551f-4e7c-93dc-ba9f50378701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:30.882385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:30.952107 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1410/2860] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:30.966259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15c002-4827-402e-98bc-1d76f0a0f01e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:30.968672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bd15c002-4827-402e-98bc-1d76f0a0f01e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:31.051579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15c002-4827-402e-98bc-1d76f0a0f01e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:31.057398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af56b00-77d2-43f8-9d68-f15509c24a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:31.058093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af56b00-77d2-43f8-9d68-f15509c24a2b service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:31.058394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af56b00-77d2-43f8-9d68-f15509c24a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:31.058942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af56b00-77d2-43f8-9d68-f15509c24a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:31.086161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af56b00-77d2-43f8-9d68-f15509c24a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:31.088418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af56b00-77d2-43f8-9d68-f15509c24a2b service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:31.112668 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1451/2861] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:31.702579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f164eb2-551f-4e7c-93dc-ba9f50378701 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:31.704173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8f164eb2-551f-4e7c-93dc-ba9f50378701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:31.718099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f164eb2-551f-4e7c-93dc-ba9f50378701 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:31.726072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169fb15-e7a0-406f-aa6a-003ba375ff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:31.727311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169fb15-e7a0-406f-aa6a-003ba375ff9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:31.727743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169fb15-e7a0-406f-aa6a-003ba375ff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:31.728502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169fb15-e7a0-406f-aa6a-003ba375ff9a admin admin] PATH_INFO: `/v3/projects/9aa2afc8b7e046839c5ce7a82e74744b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:31.730147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169fb15-e7a0-406f-aa6a-003ba375ff9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa2afc8b7e046839c5ce7a82e74744b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:31.732346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169fb15-e7a0-406f-aa6a-003ba375ff9a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:31.793025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a169fb15-e7a0-406f-aa6a-003ba375ff9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa2afc8b7e046839c5ce7a82e74744b', 'request_id': 'req-a169fb15-e7a0-406f-aa6a-003ba375ff9a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:31.802302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a169fb15-e7a0-406f-aa6a-003ba375ff9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa2afc8b7e046839c5ce7a82e74744b', 'request_id': 'req-a169fb15-e7a0-406f-aa6a-003ba375ff9a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:31.811765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a169fb15-e7a0-406f-aa6a-003ba375ff9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa2afc8b7e046839c5ce7a82e74744b', 'request_id': 'req-a169fb15-e7a0-406f-aa6a-003ba375ff9a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:31.838196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a169fb15-e7a0-406f-aa6a-003ba375ff9a admin admin] The token cache is being invalidate because project 9aa2afc8b7e046839c5ce7a82e74744b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:06:31.838694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a169fb15-e7a0-406f-aa6a-003ba375ff9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:31.839476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a169fb15-e7a0-406f-aa6a-003ba375ff9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:31.843954 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1411/2862] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:06:31 2022] DELETE /identity/v3/projects/9aa2afc8b7e046839c5ce7a82e74744b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:31.847596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af56b00-77d2-43f8-9d68-f15509c24a2b service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:31.862954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af56b00-77d2-43f8-9d68-f15509c24a2b service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:31.927708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:32.012221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c925632-1fb0-45d9-897f-351ac6d0769c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:32.014422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c925632-1fb0-45d9-897f-351ac6d0769c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:32.014746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c925632-1fb0-45d9-897f-351ac6d0769c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:32.015232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c925632-1fb0-45d9-897f-351ac6d0769c admin admin] PATH_INFO: `/v3/users/de58178026e64a169fbe09b55fd55e64` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:32.016978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c925632-1fb0-45d9-897f-351ac6d0769c admin admin] RBAC: Authorizing `identity:delete_user(user_id=de58178026e64a169fbe09b55fd55e64)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:32.019591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c925632-1fb0-45d9-897f-351ac6d0769c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:32.093967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8c925632-1fb0-45d9-897f-351ac6d0769c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de58178026e64a169fbe09b55fd55e64'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:32.103498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8c925632-1fb0-45d9-897f-351ac6d0769c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de58178026e64a169fbe09b55fd55e64'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:32.104613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8c925632-1fb0-45d9-897f-351ac6d0769c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de58178026e64a169fbe09b55fd55e64'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:32.105321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8c925632-1fb0-45d9-897f-351ac6d0769c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de58178026e64a169fbe09b55fd55e64'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:32.113890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8c925632-1fb0-45d9-897f-351ac6d0769c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de58178026e64a169fbe09b55fd55e64'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:32.135189 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1452/2863] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:06:31 2022] DELETE /identity/v3/users/de58178026e64a169fbe09b55fd55e64 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:32.452331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169fb15-e7a0-406f-aa6a-003ba375ff9a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:32.460928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a169fb15-e7a0-406f-aa6a-003ba375ff9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:32.494885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169fb15-e7a0-406f-aa6a-003ba375ff9a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:32.579222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c039fb-9416-43e0-9923-3e4f286d9f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:32.580806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c039fb-9416-43e0-9923-3e4f286d9f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:32.580806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c039fb-9416-43e0-9923-3e4f286d9f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:32.581249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c039fb-9416-43e0-9923-3e4f286d9f51 admin admin] PATH_INFO: `/v3/projects/470ccd006c414ad3b9378eb3cc46785a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:32.582720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c039fb-9416-43e0-9923-3e4f286d9f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=470ccd006c414ad3b9378eb3cc46785a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:32.585029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c039fb-9416-43e0-9923-3e4f286d9f51 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:32.640433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:32.645239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d0c039fb-9416-43e0-9923-3e4f286d9f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '470ccd006c414ad3b9378eb3cc46785a', 'request_id': 'req-d0c039fb-9416-43e0-9923-3e4f286d9f51'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:32.654919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d0c039fb-9416-43e0-9923-3e4f286d9f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '470ccd006c414ad3b9378eb3cc46785a', 'request_id': 'req-d0c039fb-9416-43e0-9923-3e4f286d9f51'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:32.662638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d0c039fb-9416-43e0-9923-3e4f286d9f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '470ccd006c414ad3b9378eb3cc46785a', 'request_id': 'req-d0c039fb-9416-43e0-9923-3e4f286d9f51'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:32.686742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d0c039fb-9416-43e0-9923-3e4f286d9f51 admin admin] The token cache is being invalidate because project 470ccd006c414ad3b9378eb3cc46785a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:06:32.687047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d0c039fb-9416-43e0-9923-3e4f286d9f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:32.688621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d0c039fb-9416-43e0-9923-3e4f286d9f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:32.691400 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1412/2864] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:06:32 2022] DELETE /identity/v3/projects/470ccd006c414ad3b9378eb3cc46785a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:32.696986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d051b3a-103a-46c9-ba8b-9913ff19769a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:32.697363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d051b3a-103a-46c9-ba8b-9913ff19769a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:32.697718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d051b3a-103a-46c9-ba8b-9913ff19769a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:32.719713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2d051b3a-103a-46c9-ba8b-9913ff19769a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:32.720827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2d051b3a-103a-46c9-ba8b-9913ff19769a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:32.805712 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1453/2865] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:32.817748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d551006-61a6-436f-9fa6-2e9d9662faf8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:32.818270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d551006-61a6-436f-9fa6-2e9d9662faf8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:32.818393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d551006-61a6-436f-9fa6-2e9d9662faf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:32.863849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2d551006-61a6-436f-9fa6-2e9d9662faf8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:32.865077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2d551006-61a6-436f-9fa6-2e9d9662faf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:32.878593 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1413/2866] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:32.882770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d051b3a-103a-46c9-ba8b-9913ff19769a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:32.894746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d051b3a-103a-46c9-ba8b-9913ff19769a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:32.901357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de99ad-c6cc-43bb-b9d0-1871650bb6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:32.902242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de99ad-c6cc-43bb-b9d0-1871650bb6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:32.902562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de99ad-c6cc-43bb-b9d0-1871650bb6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:32.902883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de99ad-c6cc-43bb-b9d0-1871650bb6e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:32.903822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de99ad-c6cc-43bb-b9d0-1871650bb6e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:06:32.904179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de99ad-c6cc-43bb-b9d0-1871650bb6e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:32.906198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de99ad-c6cc-43bb-b9d0-1871650bb6e1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:32.920537 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1454/2867] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:06:32.935366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d551006-61a6-436f-9fa6-2e9d9662faf8 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:32.947772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d551006-61a6-436f-9fa6-2e9d9662faf8 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:32.953103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7f882-b7d5-4b0f-87fd-4ba8659d2f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:32.953979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7f882-b7d5-4b0f-87fd-4ba8659d2f0f admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:32.954298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7f882-b7d5-4b0f-87fd-4ba8659d2f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:32.954565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7f882-b7d5-4b0f-87fd-4ba8659d2f0f admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:32.955231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7f882-b7d5-4b0f-87fd-4ba8659d2f0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:32.957466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7f882-b7d5-4b0f-87fd-4ba8659d2f0f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:32.994682 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1414/2868] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:06:32 2022] POST /identity/v3/projects => generated 393 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:06:33.000843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de99ad-c6cc-43bb-b9d0-1871650bb6e1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:33.021010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de99ad-c6cc-43bb-b9d0-1871650bb6e1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:33.087081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:33.148858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7c282-6cdf-449d-b708-d825ea6ec986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:33.149214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7c282-6cdf-449d-b708-d825ea6ec986 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:33.149469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7c282-6cdf-449d-b708-d825ea6ec986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:33.149752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7c282-6cdf-449d-b708-d825ea6ec986 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:33.150653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7c282-6cdf-449d-b708-d825ea6ec986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:33.154241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7c282-6cdf-449d-b708-d825ea6ec986 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:33.212092 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1455/2869] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:06:32 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:06:33.214054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7f882-b7d5-4b0f-87fd-4ba8659d2f0f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:33.226676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7f882-b7d5-4b0f-87fd-4ba8659d2f0f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:33.237666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e24e3-9935-43bb-bd32-2e0eac14a15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:33.238980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e24e3-9935-43bb-bd32-2e0eac14a15a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:33.239641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e24e3-9935-43bb-bd32-2e0eac14a15a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:33.241306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e24e3-9935-43bb-bd32-2e0eac14a15a admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:33.243072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e24e3-9935-43bb-bd32-2e0eac14a15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:33.245579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e24e3-9935-43bb-bd32-2e0eac14a15a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:33.274849 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1415/2870] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:06:33.276998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7c282-6cdf-449d-b708-d825ea6ec986 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:33.291671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7c282-6cdf-449d-b708-d825ea6ec986 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:33.299351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873eabb-8344-4853-b78f-134fe07b11c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:33.300193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873eabb-8344-4853-b78f-134fe07b11c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:33.300543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873eabb-8344-4853-b78f-134fe07b11c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:33.300883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873eabb-8344-4853-b78f-134fe07b11c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:33.301674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873eabb-8344-4853-b78f-134fe07b11c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:33.303555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873eabb-8344-4853-b78f-134fe07b11c8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:33.322117 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1456/2871] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:06:33.323881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e24e3-9935-43bb-bd32-2e0eac14a15a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:33.337401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e24e3-9935-43bb-bd32-2e0eac14a15a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:33.346155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a448a8b-9f80-444e-b4d8-e8ef22b9b2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:33.347241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a448a8b-9f80-444e-b4d8-e8ef22b9b2eb admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:33.347588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a448a8b-9f80-444e-b4d8-e8ef22b9b2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:33.347999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a448a8b-9f80-444e-b4d8-e8ef22b9b2eb admin admin] PATH_INFO: `/v3/projects/d2b99e87d1d147bf808b264be9f7f639/users/0230af811e5a4ecfa3d04c6624e46807/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:33.374004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a448a8b-9f80-444e-b4d8-e8ef22b9b2eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b99e87d1d147bf808b264be9f7f639, user_id=0230af811e5a4ecfa3d04c6624e46807, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:33.377008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a448a8b-9f80-444e-b4d8-e8ef22b9b2eb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:33.400753 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1416/2872] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:06:33 2022] PUT /identity/v3/projects/d2b99e87d1d147bf808b264be9f7f639/users/0230af811e5a4ecfa3d04c6624e46807/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:33.410757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae5a2c-008c-420d-9607-6b8a0240d8c4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:33.410961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae5a2c-008c-420d-9607-6b8a0240d8c4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:33.411247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae5a2c-008c-420d-9607-6b8a0240d8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:33.449995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-72ae5a2c-008c-420d-9607-6b8a0240d8c4 None None] MFA Rules not processed for user `0230af811e5a4ecfa3d04c6624e46807`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:33.451692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-72ae5a2c-008c-420d-9607-6b8a0240d8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:33.526995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f3616-d65f-49a2-85f3-607e46dfb0b7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:33.527520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f3616-d65f-49a2-85f3-607e46dfb0b7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:33.527966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f3616-d65f-49a2-85f3-607e46dfb0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:33.558824 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1457/2873] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:33.561352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ae6f3616-d65f-49a2-85f3-607e46dfb0b7 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:33.563998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae5a2c-008c-420d-9607-6b8a0240d8c4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:33.566889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ae6f3616-d65f-49a2-85f3-607e46dfb0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:33.646030 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1417/2874] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:06:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:06:33.663116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f3616-d65f-49a2-85f3-607e46dfb0b7 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:33.665317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ae6f3616-d65f-49a2-85f3-607e46dfb0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:33.729412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae5a2c-008c-420d-9607-6b8a0240d8c4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:33.742080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e8517-6147-4862-91a6-f909ac37e9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:33.743032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e8517-6147-4862-91a6-f909ac37e9ca admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:33.743320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e8517-6147-4862-91a6-f909ac37e9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:33.743763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e8517-6147-4862-91a6-f909ac37e9ca admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:33.746665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e8517-6147-4862-91a6-f909ac37e9ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:33.751300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e8517-6147-4862-91a6-f909ac37e9ca admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:33.812181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f3616-d65f-49a2-85f3-607e46dfb0b7 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:33.822119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6103d24-ce71-486a-a415-f5f927319990 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:33.823537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6103d24-ce71-486a-a415-f5f927319990 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:33.824491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6103d24-ce71-486a-a415-f5f927319990 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:33.825012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6103d24-ce71-486a-a415-f5f927319990 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:33.825437 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1458/2875] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:06:33 2022] POST /identity/v3/projects => generated 393 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:06:33.826495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e8517-6147-4862-91a6-f909ac37e9ca admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:33.836110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6103d24-ce71-486a-a415-f5f927319990 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:33.838776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6103d24-ce71-486a-a415-f5f927319990 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:33.851956 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1418/2876] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:06:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:06:33.874999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:33.917660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e8517-6147-4862-91a6-f909ac37e9ca admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:33.925506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6a78c-7a64-4992-ace3-29cd92cf58bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:33.927539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6a78c-7a64-4992-ace3-29cd92cf58bb admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:33.928626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6a78c-7a64-4992-ace3-29cd92cf58bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:33.928626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6a78c-7a64-4992-ace3-29cd92cf58bb admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:33.929380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6a78c-7a64-4992-ace3-29cd92cf58bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:33.932779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6a78c-7a64-4992-ace3-29cd92cf58bb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:33.964190 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1459/2877] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:06:33 2022] POST /identity/v3/users => generated 303 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:06:33.966311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6103d24-ce71-486a-a415-f5f927319990 service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:33.973615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:33.978650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6103d24-ce71-486a-a415-f5f927319990 service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:33.986943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb879cd-ab61-4303-ad2a-3c609ff3329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:33.988028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb879cd-ab61-4303-ad2a-3c609ff3329f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:33.988430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb879cd-ab61-4303-ad2a-3c609ff3329f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:33.988759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb879cd-ab61-4303-ad2a-3c609ff3329f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:33.989639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb879cd-ab61-4303-ad2a-3c609ff3329f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:33.991745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb879cd-ab61-4303-ad2a-3c609ff3329f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:34.006320 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1419/2878] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:06:34.011126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6a78c-7a64-4992-ace3-29cd92cf58bb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:34.022059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6a78c-7a64-4992-ace3-29cd92cf58bb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:34.028612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50929e37-b4f3-4efe-a9bf-ec8634cfd360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:34.029549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50929e37-b4f3-4efe-a9bf-ec8634cfd360 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:34.029833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50929e37-b4f3-4efe-a9bf-ec8634cfd360 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:34.030103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50929e37-b4f3-4efe-a9bf-ec8634cfd360 admin admin] PATH_INFO: `/v3/projects/2059390aee524e5ea3e24bde600bcc66/users/244d0f7054cc4b74a7269c7ad87543bb/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:34.052450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50929e37-b4f3-4efe-a9bf-ec8634cfd360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2059390aee524e5ea3e24bde600bcc66, user_id=244d0f7054cc4b74a7269c7ad87543bb, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:34.056364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50929e37-b4f3-4efe-a9bf-ec8634cfd360 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:34.085159 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1460/2879] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:06:34 2022] PUT /identity/v3/projects/2059390aee524e5ea3e24bde600bcc66/users/244d0f7054cc4b74a7269c7ad87543bb/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:34.086176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb879cd-ab61-4303-ad2a-3c609ff3329f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:34.107795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb879cd-ab61-4303-ad2a-3c609ff3329f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:34.237926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56906ee-a463-4d8d-a3be-765e3c272e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:34.238900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56906ee-a463-4d8d-a3be-765e3c272e10 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:34.239192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56906ee-a463-4d8d-a3be-765e3c272e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:34.239545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56906ee-a463-4d8d-a3be-765e3c272e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:34.242435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56906ee-a463-4d8d-a3be-765e3c272e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:34.252412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56906ee-a463-4d8d-a3be-765e3c272e10 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:34.274444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50929e37-b4f3-4efe-a9bf-ec8634cfd360 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:34.287697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50929e37-b4f3-4efe-a9bf-ec8634cfd360 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:34.288468 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1420/2880] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:06:34.294262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694b3ce-fc1f-476e-b131-cdf85d4df5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:34.295972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694b3ce-fc1f-476e-b131-cdf85d4df5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:34.296383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694b3ce-fc1f-476e-b131-cdf85d4df5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:34.296595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694b3ce-fc1f-476e-b131-cdf85d4df5a9 admin admin] PATH_INFO: `/v3/projects/2059390aee524e5ea3e24bde600bcc66/users/244d0f7054cc4b74a7269c7ad87543bb/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:34.300101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694b3ce-fc1f-476e-b131-cdf85d4df5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2059390aee524e5ea3e24bde600bcc66, user_id=244d0f7054cc4b74a7269c7ad87543bb, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:34.301540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694b3ce-fc1f-476e-b131-cdf85d4df5a9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:34.336056 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1461/2881] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:06:34 2022] PUT /identity/v3/projects/2059390aee524e5ea3e24bde600bcc66/users/244d0f7054cc4b74a7269c7ad87543bb/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:34.338082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5fa95-52ea-4f5b-80d2-d5ceb3ded301 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:34.339159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5fa95-52ea-4f5b-80d2-d5ceb3ded301 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:34.339159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5fa95-52ea-4f5b-80d2-d5ceb3ded301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:34.399596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f8b5fa95-52ea-4f5b-80d2-d5ceb3ded301 None None] MFA Rules not processed for user `244d0f7054cc4b74a7269c7ad87543bb`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:34.404510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f8b5fa95-52ea-4f5b-80d2-d5ceb3ded301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:34.607356 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1421/2882] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:34.620076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694b3ce-fc1f-476e-b131-cdf85d4df5a9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:34.622206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2694b3ce-fc1f-476e-b131-cdf85d4df5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:34.744210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694b3ce-fc1f-476e-b131-cdf85d4df5a9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:34.752081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27dc4c-82b4-4c71-995c-5bfaabb25203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:34.752318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27dc4c-82b4-4c71-995c-5bfaabb25203 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:34.752913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27dc4c-82b4-4c71-995c-5bfaabb25203 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:34.753072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27dc4c-82b4-4c71-995c-5bfaabb25203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:34.762804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27dc4c-82b4-4c71-995c-5bfaabb25203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:34.764584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27dc4c-82b4-4c71-995c-5bfaabb25203 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:34.775189 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1462/2883] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:35.358768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5fa95-52ea-4f5b-80d2-d5ceb3ded301 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:35.558027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5fa95-52ea-4f5b-80d2-d5ceb3ded301 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:35.575837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef6259-808d-4dbe-a803-6091d1ccd333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:35.577171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef6259-808d-4dbe-a803-6091d1ccd333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:35.577308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef6259-808d-4dbe-a803-6091d1ccd333 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:35.577581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef6259-808d-4dbe-a803-6091d1ccd333 admin admin] PATH_INFO: `/v3/users/0230af811e5a4ecfa3d04c6624e46807` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:35.579489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef6259-808d-4dbe-a803-6091d1ccd333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0230af811e5a4ecfa3d04c6624e46807)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:35.582090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef6259-808d-4dbe-a803-6091d1ccd333 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:35.626228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:35.692825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-90ef6259-808d-4dbe-a803-6091d1ccd333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0230af811e5a4ecfa3d04c6624e46807'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:35.711648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-90ef6259-808d-4dbe-a803-6091d1ccd333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0230af811e5a4ecfa3d04c6624e46807'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:35.732022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-90ef6259-808d-4dbe-a803-6091d1ccd333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0230af811e5a4ecfa3d04c6624e46807'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:35.736621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-90ef6259-808d-4dbe-a803-6091d1ccd333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0230af811e5a4ecfa3d04c6624e46807'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:35.737704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-90ef6259-808d-4dbe-a803-6091d1ccd333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0230af811e5a4ecfa3d04c6624e46807'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:35.779569 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1422/2884] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:06:35 2022] DELETE /identity/v3/users/0230af811e5a4ecfa3d04c6624e46807 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:35.781269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b8245-0c1b-4d5e-b809-b0a483329590 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:35.781766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b8245-0c1b-4d5e-b809-b0a483329590 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:35.781766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b8245-0c1b-4d5e-b809-b0a483329590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:35.803782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1a2b8245-0c1b-4d5e-b809-b0a483329590 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:35.805338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1a2b8245-0c1b-4d5e-b809-b0a483329590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:35.896074 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1463/2885] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:35.906594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef6259-808d-4dbe-a803-6091d1ccd333 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:35.908029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-90ef6259-808d-4dbe-a803-6091d1ccd333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:36.009991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef6259-808d-4dbe-a803-6091d1ccd333 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:36.020188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb9cc1-f820-4694-9b47-a84dc28831b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:36.020871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb9cc1-f820-4694-9b47-a84dc28831b8 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:36.021150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb9cc1-f820-4694-9b47-a84dc28831b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:36.021556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb9cc1-f820-4694-9b47-a84dc28831b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:36.034430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb9cc1-f820-4694-9b47-a84dc28831b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:36.036347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb9cc1-f820-4694-9b47-a84dc28831b8 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:36.053862 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1423/2886] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:36.594781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b8245-0c1b-4d5e-b809-b0a483329590 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:36.596650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1a2b8245-0c1b-4d5e-b809-b0a483329590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:36.609627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b8245-0c1b-4d5e-b809-b0a483329590 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:36.630381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdddc9a-7b79-471a-9b2f-f98faed35456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:36.631347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdddc9a-7b79-471a-9b2f-f98faed35456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:36.631673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdddc9a-7b79-471a-9b2f-f98faed35456 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:36.631919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdddc9a-7b79-471a-9b2f-f98faed35456 admin admin] PATH_INFO: `/v3/projects/d2b99e87d1d147bf808b264be9f7f639` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:36.641448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdddc9a-7b79-471a-9b2f-f98faed35456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b99e87d1d147bf808b264be9f7f639)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:36.643442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdddc9a-7b79-471a-9b2f-f98faed35456 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:36.645449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:36.743130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9fdddc9a-7b79-471a-9b2f-f98faed35456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b99e87d1d147bf808b264be9f7f639', 'request_id': 'req-9fdddc9a-7b79-471a-9b2f-f98faed35456'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:36.758210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9fdddc9a-7b79-471a-9b2f-f98faed35456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b99e87d1d147bf808b264be9f7f639', 'request_id': 'req-9fdddc9a-7b79-471a-9b2f-f98faed35456'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:36.780857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9fdddc9a-7b79-471a-9b2f-f98faed35456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b99e87d1d147bf808b264be9f7f639', 'request_id': 'req-9fdddc9a-7b79-471a-9b2f-f98faed35456'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:36.802314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9fdddc9a-7b79-471a-9b2f-f98faed35456 admin admin] The token cache is being invalidate because project d2b99e87d1d147bf808b264be9f7f639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:06:36.802906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9fdddc9a-7b79-471a-9b2f-f98faed35456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:36.803535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9fdddc9a-7b79-471a-9b2f-f98faed35456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:36.806099 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1464/2887] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:06:36 2022] DELETE /identity/v3/projects/d2b99e87d1d147bf808b264be9f7f639 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:36.812715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb9cc1-f820-4694-9b47-a84dc28831b8 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:36.828473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb9cc1-f820-4694-9b47-a84dc28831b8 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:36.906272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c63b7-4ee8-4cab-8106-10bb36fc3c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:36.907174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c63b7-4ee8-4cab-8106-10bb36fc3c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:36.907456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c63b7-4ee8-4cab-8106-10bb36fc3c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:36.907755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c63b7-4ee8-4cab-8106-10bb36fc3c7b admin admin] PATH_INFO: `/v3/users/244d0f7054cc4b74a7269c7ad87543bb` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:36.909387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c63b7-4ee8-4cab-8106-10bb36fc3c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=244d0f7054cc4b74a7269c7ad87543bb)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:36.911447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c63b7-4ee8-4cab-8106-10bb36fc3c7b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:37.001629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:37.016091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c9c63b7-4ee8-4cab-8106-10bb36fc3c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '244d0f7054cc4b74a7269c7ad87543bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:37.036566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c9c63b7-4ee8-4cab-8106-10bb36fc3c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '244d0f7054cc4b74a7269c7ad87543bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:37.061226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c9c63b7-4ee8-4cab-8106-10bb36fc3c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '244d0f7054cc4b74a7269c7ad87543bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:37.062051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c9c63b7-4ee8-4cab-8106-10bb36fc3c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '244d0f7054cc4b74a7269c7ad87543bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:37.062888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c9c63b7-4ee8-4cab-8106-10bb36fc3c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '244d0f7054cc4b74a7269c7ad87543bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:37.112155 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1424/2888] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:06:36 2022] DELETE /identity/v3/users/244d0f7054cc4b74a7269c7ad87543bb => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:37.505631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdddc9a-7b79-471a-9b2f-f98faed35456 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:37.507378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9fdddc9a-7b79-471a-9b2f-f98faed35456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:37.523266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdddc9a-7b79-471a-9b2f-f98faed35456 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:37.622468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780fb14-99fe-43e2-914f-5814d220c679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:37.623527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780fb14-99fe-43e2-914f-5814d220c679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:37.623993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780fb14-99fe-43e2-914f-5814d220c679 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:37.624655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780fb14-99fe-43e2-914f-5814d220c679 admin admin] PATH_INFO: `/v3/projects/2059390aee524e5ea3e24bde600bcc66` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:37.626337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780fb14-99fe-43e2-914f-5814d220c679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2059390aee524e5ea3e24bde600bcc66)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:37.628652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780fb14-99fe-43e2-914f-5814d220c679 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:37.743309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0780fb14-99fe-43e2-914f-5814d220c679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2059390aee524e5ea3e24bde600bcc66', 'request_id': 'req-0780fb14-99fe-43e2-914f-5814d220c679'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:37.765218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0780fb14-99fe-43e2-914f-5814d220c679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2059390aee524e5ea3e24bde600bcc66', 'request_id': 'req-0780fb14-99fe-43e2-914f-5814d220c679'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:37.777773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0780fb14-99fe-43e2-914f-5814d220c679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2059390aee524e5ea3e24bde600bcc66', 'request_id': 'req-0780fb14-99fe-43e2-914f-5814d220c679'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:37.809985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0780fb14-99fe-43e2-914f-5814d220c679 admin admin] The token cache is being invalidate because project 2059390aee524e5ea3e24bde600bcc66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:06:37.810667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0780fb14-99fe-43e2-914f-5814d220c679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:37.811215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0780fb14-99fe-43e2-914f-5814d220c679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:37.814281 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1465/2889] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:06:37 2022] DELETE /identity/v3/projects/2059390aee524e5ea3e24bde600bcc66 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:37.819658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e21eaa-4868-49d2-b6f9-4229e6404f8e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:37.820213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e21eaa-4868-49d2-b6f9-4229e6404f8e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:37.820381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e21eaa-4868-49d2-b6f9-4229e6404f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:37.877548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-43e21eaa-4868-49d2-b6f9-4229e6404f8e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:37.890547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-43e21eaa-4868-49d2-b6f9-4229e6404f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:38.013702 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1425/2890] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:06:38.021637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ef00e-4e37-42d4-acec-651ec854a139 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:38.022081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ef00e-4e37-42d4-acec-651ec854a139 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:38.022781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ef00e-4e37-42d4-acec-651ec854a139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:38.057874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-919ef00e-4e37-42d4-acec-651ec854a139 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:38.059217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-919ef00e-4e37-42d4-acec-651ec854a139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:38.097572 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1466/2891] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:38.098619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e21eaa-4868-49d2-b6f9-4229e6404f8e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:38.114167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e21eaa-4868-49d2-b6f9-4229e6404f8e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:38.120109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7999f7a-fee9-43c5-89e4-a6199a0514d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:38.132258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7999f7a-fee9-43c5-89e4-a6199a0514d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:38.135526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7999f7a-fee9-43c5-89e4-a6199a0514d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:38.135850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7999f7a-fee9-43c5-89e4-a6199a0514d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:38.136738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7999f7a-fee9-43c5-89e4-a6199a0514d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:06:38.137056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7999f7a-fee9-43c5-89e4-a6199a0514d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:38.142454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7999f7a-fee9-43c5-89e4-a6199a0514d7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:38.189179 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1426/2892] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:06:38.193359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ef00e-4e37-42d4-acec-651ec854a139 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:38.207996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ef00e-4e37-42d4-acec-651ec854a139 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:38.221624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970fbd3-218a-4da6-80e9-5618621b6943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:38.222619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970fbd3-218a-4da6-80e9-5618621b6943 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:38.222619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970fbd3-218a-4da6-80e9-5618621b6943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:38.222952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970fbd3-218a-4da6-80e9-5618621b6943 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:38.223566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970fbd3-218a-4da6-80e9-5618621b6943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:38.226214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970fbd3-218a-4da6-80e9-5618621b6943 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:38.252586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:38.283837 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1467/2893] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:06:38 2022] POST /identity/v3/projects => generated 409 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:06:38.288320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7999f7a-fee9-43c5-89e4-a6199a0514d7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:38.305163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7999f7a-fee9-43c5-89e4-a6199a0514d7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:38.439534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7741f8-13d4-4f73-9dbc-58c5ee6efec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:38.441644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7741f8-13d4-4f73-9dbc-58c5ee6efec6 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:38.441644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7741f8-13d4-4f73-9dbc-58c5ee6efec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:38.441644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7741f8-13d4-4f73-9dbc-58c5ee6efec6 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:38.442158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7741f8-13d4-4f73-9dbc-58c5ee6efec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:38.443997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7741f8-13d4-4f73-9dbc-58c5ee6efec6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:38.515064 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1427/2894] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:06:38 2022] POST /identity/v3/users => generated 305 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:06:38.525206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970fbd3-218a-4da6-80e9-5618621b6943 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:38.542544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970fbd3-218a-4da6-80e9-5618621b6943 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:38.569681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4f368-cd2a-402d-993b-672cd426e591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:38.570381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4f368-cd2a-402d-993b-672cd426e591 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:38.570682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4f368-cd2a-402d-993b-672cd426e591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:38.571186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4f368-cd2a-402d-993b-672cd426e591 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:38.571665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4f368-cd2a-402d-993b-672cd426e591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:38.573408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4f368-cd2a-402d-993b-672cd426e591 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:38.587377 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1468/2895] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:06:38.591509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7741f8-13d4-4f73-9dbc-58c5ee6efec6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:38.612019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7741f8-13d4-4f73-9dbc-58c5ee6efec6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:38.634442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97234ed4-abc8-499b-957b-c659f91986f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:38.635569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97234ed4-abc8-499b-957b-c659f91986f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:38.635854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97234ed4-abc8-499b-957b-c659f91986f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:38.636151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97234ed4-abc8-499b-957b-c659f91986f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:38.636881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97234ed4-abc8-499b-957b-c659f91986f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:38.638506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97234ed4-abc8-499b-957b-c659f91986f1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:38.680818 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1428/2896] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:06:38.685337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4f368-cd2a-402d-993b-672cd426e591 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:38.710533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4f368-cd2a-402d-993b-672cd426e591 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:38.716265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045b300-0ce0-47c2-b13c-df5ae8b1d745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:38.717471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045b300-0ce0-47c2-b13c-df5ae8b1d745 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:38.720835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045b300-0ce0-47c2-b13c-df5ae8b1d745 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:38.721647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045b300-0ce0-47c2-b13c-df5ae8b1d745 admin admin] PATH_INFO: `/v3/projects/b22301d58fee4371ad12affa16941f18/users/81d1c4eab12c4c619db4f6714240d552/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:38.765686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045b300-0ce0-47c2-b13c-df5ae8b1d745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b22301d58fee4371ad12affa16941f18, user_id=81d1c4eab12c4c619db4f6714240d552, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:38.768722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045b300-0ce0-47c2-b13c-df5ae8b1d745 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:38.799554 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1469/2897] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:06:38 2022] PUT /identity/v3/projects/b22301d58fee4371ad12affa16941f18/users/81d1c4eab12c4c619db4f6714240d552/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:38.812680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df14645-f37c-41d5-ad92-4230b5764334 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:38.812972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df14645-f37c-41d5-ad92-4230b5764334 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:38.813236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df14645-f37c-41d5-ad92-4230b5764334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:38.865115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5df14645-f37c-41d5-ad92-4230b5764334 None None] MFA Rules not processed for user `81d1c4eab12c4c619db4f6714240d552`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:38.866502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5df14645-f37c-41d5-ad92-4230b5764334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:38.879456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:38.962670 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1429/2898] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:38 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:38.966926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045b300-0ce0-47c2-b13c-df5ae8b1d745 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:39.098821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045b300-0ce0-47c2-b13c-df5ae8b1d745 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:39.115226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c783ab-16fe-4b7c-b7e3-08db37562d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:39.115906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c783ab-16fe-4b7c-b7e3-08db37562d59 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:39.116431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c783ab-16fe-4b7c-b7e3-08db37562d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:39.116929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c783ab-16fe-4b7c-b7e3-08db37562d59 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:39.117582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c783ab-16fe-4b7c-b7e3-08db37562d59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:39.119898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c783ab-16fe-4b7c-b7e3-08db37562d59 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:39.159640 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1470/2899] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:06:38 2022] POST /identity/v3/projects => generated 407 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:06:39.165753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df14645-f37c-41d5-ad92-4230b5764334 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:39.189297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df14645-f37c-41d5-ad92-4230b5764334 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:39.318140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426ff71-b117-4611-9b01-68ca6f73a37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:39.318915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426ff71-b117-4611-9b01-68ca6f73a37c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:39.319192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426ff71-b117-4611-9b01-68ca6f73a37c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:39.319761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426ff71-b117-4611-9b01-68ca6f73a37c admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:39.320359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426ff71-b117-4611-9b01-68ca6f73a37c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:39.337645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426ff71-b117-4611-9b01-68ca6f73a37c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:39.385453 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1430/2900] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:06:39 2022] POST /identity/v3/users => generated 310 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:06:39.389729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c783ab-16fe-4b7c-b7e3-08db37562d59 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:39.401962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c783ab-16fe-4b7c-b7e3-08db37562d59 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:39.409772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d66808-501d-4034-a1c0-9f3f19bb99c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:39.410487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d66808-501d-4034-a1c0-9f3f19bb99c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:39.410757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d66808-501d-4034-a1c0-9f3f19bb99c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:39.411033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d66808-501d-4034-a1c0-9f3f19bb99c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:39.411846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d66808-501d-4034-a1c0-9f3f19bb99c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:39.413530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d66808-501d-4034-a1c0-9f3f19bb99c7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:39.439637 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1471/2901] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:06:39.440895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426ff71-b117-4611-9b01-68ca6f73a37c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:39.452485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426ff71-b117-4611-9b01-68ca6f73a37c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:39.458183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48649566-60bf-4d7c-b1f9-a0c345adbffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:39.459269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48649566-60bf-4d7c-b1f9-a0c345adbffa admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:39.459580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48649566-60bf-4d7c-b1f9-a0c345adbffa admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:39.459885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48649566-60bf-4d7c-b1f9-a0c345adbffa admin admin] PATH_INFO: `/v3/projects/6203aca8bd3e4b0a967f313a1f38bc2f/users/18210d6c256940689c154859e97cee7d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:39.482787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48649566-60bf-4d7c-b1f9-a0c345adbffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6203aca8bd3e4b0a967f313a1f38bc2f, user_id=18210d6c256940689c154859e97cee7d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:39.485800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48649566-60bf-4d7c-b1f9-a0c345adbffa admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:39.501029 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1431/2902] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:06:39 2022] PUT /identity/v3/projects/6203aca8bd3e4b0a967f313a1f38bc2f/users/18210d6c256940689c154859e97cee7d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:06:39.505669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d66808-501d-4034-a1c0-9f3f19bb99c7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:39.517683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d66808-501d-4034-a1c0-9f3f19bb99c7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:39.620184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ca792-c459-427e-85f9-2ac10c297457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:39.620914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ca792-c459-427e-85f9-2ac10c297457 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:39.621197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ca792-c459-427e-85f9-2ac10c297457 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:39.630793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ca792-c459-427e-85f9-2ac10c297457 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:39.638698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ca792-c459-427e-85f9-2ac10c297457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:39.642974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ca792-c459-427e-85f9-2ac10c297457 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:39.672006 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1472/2903] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:06:39.673281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48649566-60bf-4d7c-b1f9-a0c345adbffa admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:39.689734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48649566-60bf-4d7c-b1f9-a0c345adbffa admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:39.697359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a162c6d-4b05-4549-b4e8-696d14fae8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:39.698531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162c6d-4b05-4549-b4e8-696d14fae8a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:39.698661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162c6d-4b05-4549-b4e8-696d14fae8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:39.698866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162c6d-4b05-4549-b4e8-696d14fae8a2 admin admin] PATH_INFO: `/v3/projects/6203aca8bd3e4b0a967f313a1f38bc2f/users/18210d6c256940689c154859e97cee7d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:39.703221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a162c6d-4b05-4549-b4e8-696d14fae8a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6203aca8bd3e4b0a967f313a1f38bc2f, user_id=18210d6c256940689c154859e97cee7d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:39.706680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a162c6d-4b05-4549-b4e8-696d14fae8a2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:39.719386 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1432/2904] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:06:39 2022] PUT /identity/v3/projects/6203aca8bd3e4b0a967f313a1f38bc2f/users/18210d6c256940689c154859e97cee7d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:39.729637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a93d2-327e-4ab2-b27e-dea703ff4b02 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:39.729925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a93d2-327e-4ab2-b27e-dea703ff4b02 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:39.730208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a93d2-327e-4ab2-b27e-dea703ff4b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:39.767503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-931a93d2-327e-4ab2-b27e-dea703ff4b02 None None] MFA Rules not processed for user `18210d6c256940689c154859e97cee7d`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:39.768782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-931a93d2-327e-4ab2-b27e-dea703ff4b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:39.787808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:39.876306 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1473/2905] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:39 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:39.921066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a162c6d-4b05-4549-b4e8-696d14fae8a2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:39.923196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5a162c6d-4b05-4549-b4e8-696d14fae8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:40.027702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:40.037993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a162c6d-4b05-4549-b4e8-696d14fae8a2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:40.047029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b92ef-c18e-4358-b3ee-02faeafc427b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:40.048057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b92ef-c18e-4358-b3ee-02faeafc427b service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:40.048474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b92ef-c18e-4358-b3ee-02faeafc427b service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:40.048836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b92ef-c18e-4358-b3ee-02faeafc427b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:40.059744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b92ef-c18e-4358-b3ee-02faeafc427b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:40.061644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b92ef-c18e-4358-b3ee-02faeafc427b service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:40.084030 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1433/2906] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:39 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:40.178353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a93d2-327e-4ab2-b27e-dea703ff4b02 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:40.180471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-931a93d2-327e-4ab2-b27e-dea703ff4b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:40.198127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a93d2-327e-4ab2-b27e-dea703ff4b02 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:40.206601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80a9f4-a0f6-4c9b-a749-ef0208f558a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:40.207668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80a9f4-a0f6-4c9b-a749-ef0208f558a9 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:40.208089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80a9f4-a0f6-4c9b-a749-ef0208f558a9 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:40.208607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80a9f4-a0f6-4c9b-a749-ef0208f558a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:40.274393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80a9f4-a0f6-4c9b-a749-ef0208f558a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:40.276238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80a9f4-a0f6-4c9b-a749-ef0208f558a9 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:40.287281 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1474/2907] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:40 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:40.431552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b92ef-c18e-4358-b3ee-02faeafc427b service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:40.538751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b92ef-c18e-4358-b3ee-02faeafc427b service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:40.544007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e272789-51d0-40ef-874c-febdfa09a827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:40.545246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e272789-51d0-40ef-874c-febdfa09a827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:40.545698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e272789-51d0-40ef-874c-febdfa09a827 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:40.546151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e272789-51d0-40ef-874c-febdfa09a827 admin admin] PATH_INFO: `/v3/users/81d1c4eab12c4c619db4f6714240d552` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:40.548923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e272789-51d0-40ef-874c-febdfa09a827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d1c4eab12c4c619db4f6714240d552)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:40.550909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e272789-51d0-40ef-874c-febdfa09a827 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:40.641202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1e272789-51d0-40ef-874c-febdfa09a827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d1c4eab12c4c619db4f6714240d552'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:40.652871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1e272789-51d0-40ef-874c-febdfa09a827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d1c4eab12c4c619db4f6714240d552'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:40.676473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1e272789-51d0-40ef-874c-febdfa09a827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d1c4eab12c4c619db4f6714240d552'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:40.677286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1e272789-51d0-40ef-874c-febdfa09a827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d1c4eab12c4c619db4f6714240d552'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:40.677978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1e272789-51d0-40ef-874c-febdfa09a827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d1c4eab12c4c619db4f6714240d552'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:40.716527 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1434/2908] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:06:40 2022] DELETE /identity/v3/users/81d1c4eab12c4c619db4f6714240d552 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:40.720970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ea02e-e1e2-4191-83e9-76d633131e62 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:40.721570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ea02e-e1e2-4191-83e9-76d633131e62 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:40.721570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ea02e-e1e2-4191-83e9-76d633131e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:40.752777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d30ea02e-e1e2-4191-83e9-76d633131e62 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:40.754017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d30ea02e-e1e2-4191-83e9-76d633131e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:40.856480 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1475/2909] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:06:40.866503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e272789-51d0-40ef-874c-febdfa09a827 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:40.868014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1e272789-51d0-40ef-874c-febdfa09a827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:40.976785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e272789-51d0-40ef-874c-febdfa09a827 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:40.985923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9149341-afb5-4b3f-8da0-f7d820b6e00e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:40.986593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9149341-afb5-4b3f-8da0-f7d820b6e00e service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:40.986869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9149341-afb5-4b3f-8da0-f7d820b6e00e service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:40.987137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9149341-afb5-4b3f-8da0-f7d820b6e00e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:41.008677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9149341-afb5-4b3f-8da0-f7d820b6e00e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:41.010506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9149341-afb5-4b3f-8da0-f7d820b6e00e service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:41.024505 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1435/2910] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:41.772593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ea02e-e1e2-4191-83e9-76d633131e62 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:41.774356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d30ea02e-e1e2-4191-83e9-76d633131e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:41.804363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ea02e-e1e2-4191-83e9-76d633131e62 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:41.832956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d5a8d-7a47-4ce6-9a3b-46cee956e378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:41.833868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d5a8d-7a47-4ce6-9a3b-46cee956e378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:41.834176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d5a8d-7a47-4ce6-9a3b-46cee956e378 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:41.834329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d5a8d-7a47-4ce6-9a3b-46cee956e378 admin admin] PATH_INFO: `/v3/projects/b22301d58fee4371ad12affa16941f18` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:41.836388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d5a8d-7a47-4ce6-9a3b-46cee956e378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b22301d58fee4371ad12affa16941f18)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:41.839150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d5a8d-7a47-4ce6-9a3b-46cee956e378 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:41.953556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:41.959652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2e3d5a8d-7a47-4ce6-9a3b-46cee956e378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b22301d58fee4371ad12affa16941f18', 'request_id': 'req-2e3d5a8d-7a47-4ce6-9a3b-46cee956e378'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:41.981678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2e3d5a8d-7a47-4ce6-9a3b-46cee956e378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b22301d58fee4371ad12affa16941f18', 'request_id': 'req-2e3d5a8d-7a47-4ce6-9a3b-46cee956e378'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:41.990542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2e3d5a8d-7a47-4ce6-9a3b-46cee956e378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b22301d58fee4371ad12affa16941f18', 'request_id': 'req-2e3d5a8d-7a47-4ce6-9a3b-46cee956e378'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:42.005214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2e3d5a8d-7a47-4ce6-9a3b-46cee956e378 admin admin] The token cache is being invalidate because project b22301d58fee4371ad12affa16941f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:06:42.005705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2e3d5a8d-7a47-4ce6-9a3b-46cee956e378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:42.007235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2e3d5a8d-7a47-4ce6-9a3b-46cee956e378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:42.009300 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1476/2911] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:06:41 2022] DELETE /identity/v3/projects/b22301d58fee4371ad12affa16941f18 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:42.013585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9149341-afb5-4b3f-8da0-f7d820b6e00e service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:42.026945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9149341-afb5-4b3f-8da0-f7d820b6e00e service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:42.046961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:42.106382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298ee5e-f3fd-4cff-84b9-d3b28e685f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:42.107458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298ee5e-f3fd-4cff-84b9-d3b28e685f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:42.107813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298ee5e-f3fd-4cff-84b9-d3b28e685f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:42.108185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298ee5e-f3fd-4cff-84b9-d3b28e685f0c admin admin] PATH_INFO: `/v3/users/18210d6c256940689c154859e97cee7d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:42.109466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298ee5e-f3fd-4cff-84b9-d3b28e685f0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=18210d6c256940689c154859e97cee7d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:42.111501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298ee5e-f3fd-4cff-84b9-d3b28e685f0c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:42.165400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4298ee5e-f3fd-4cff-84b9-d3b28e685f0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18210d6c256940689c154859e97cee7d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:42.175338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4298ee5e-f3fd-4cff-84b9-d3b28e685f0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18210d6c256940689c154859e97cee7d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:42.183002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4298ee5e-f3fd-4cff-84b9-d3b28e685f0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18210d6c256940689c154859e97cee7d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:42.183666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4298ee5e-f3fd-4cff-84b9-d3b28e685f0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18210d6c256940689c154859e97cee7d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:42.184313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4298ee5e-f3fd-4cff-84b9-d3b28e685f0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18210d6c256940689c154859e97cee7d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:42.202022 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1436/2912] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:06:42 2022] DELETE /identity/v3/users/18210d6c256940689c154859e97cee7d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:42.587408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d5a8d-7a47-4ce6-9a3b-46cee956e378 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:42.589332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2e3d5a8d-7a47-4ce6-9a3b-46cee956e378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:42.622279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d5a8d-7a47-4ce6-9a3b-46cee956e378 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:42.784015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d15f27-3919-4783-8e59-b05f785c7215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:42.785640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d15f27-3919-4783-8e59-b05f785c7215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:42.786022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d15f27-3919-4783-8e59-b05f785c7215 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:42.786408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d15f27-3919-4783-8e59-b05f785c7215 admin admin] PATH_INFO: `/v3/projects/6203aca8bd3e4b0a967f313a1f38bc2f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:42.788391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d15f27-3919-4783-8e59-b05f785c7215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6203aca8bd3e4b0a967f313a1f38bc2f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:42.792591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d15f27-3919-4783-8e59-b05f785c7215 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:42.883243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-85d15f27-3919-4783-8e59-b05f785c7215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6203aca8bd3e4b0a967f313a1f38bc2f', 'request_id': 'req-85d15f27-3919-4783-8e59-b05f785c7215'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:42.909338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-85d15f27-3919-4783-8e59-b05f785c7215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6203aca8bd3e4b0a967f313a1f38bc2f', 'request_id': 'req-85d15f27-3919-4783-8e59-b05f785c7215'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:42.934425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-85d15f27-3919-4783-8e59-b05f785c7215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6203aca8bd3e4b0a967f313a1f38bc2f', 'request_id': 'req-85d15f27-3919-4783-8e59-b05f785c7215'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:42.950855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-85d15f27-3919-4783-8e59-b05f785c7215 admin admin] The token cache is being invalidate because project 6203aca8bd3e4b0a967f313a1f38bc2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:06:42.950855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-85d15f27-3919-4783-8e59-b05f785c7215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:42.950855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-85d15f27-3919-4783-8e59-b05f785c7215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:42.955291 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1477/2913] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:06:42 2022] DELETE /identity/v3/projects/6203aca8bd3e4b0a967f313a1f38bc2f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:42.957064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4582b81-e0e0-4645-b784-d85aa4b76485 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:42.957500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4582b81-e0e0-4645-b784-d85aa4b76485 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:42.957772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4582b81-e0e0-4645-b784-d85aa4b76485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:43.001760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c4582b81-e0e0-4645-b784-d85aa4b76485 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:43.001760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c4582b81-e0e0-4645-b784-d85aa4b76485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:43.084324 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1437/2914] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:06:43.086385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7d3db-2575-4cf9-874d-5cc7f7976830 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:43.086876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7d3db-2575-4cf9-874d-5cc7f7976830 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:43.087773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7d3db-2575-4cf9-874d-5cc7f7976830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:43.122803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-87b7d3db-2575-4cf9-874d-5cc7f7976830 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:43.124312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-87b7d3db-2575-4cf9-874d-5cc7f7976830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:43.135174 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1478/2915] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:43.138195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4582b81-e0e0-4645-b784-d85aa4b76485 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:43.148759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4582b81-e0e0-4645-b784-d85aa4b76485 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:43.153549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145afc5-8565-4001-8469-49140d6a6feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:43.154312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145afc5-8565-4001-8469-49140d6a6feb admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:43.154595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145afc5-8565-4001-8469-49140d6a6feb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:43.155040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145afc5-8565-4001-8469-49140d6a6feb admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:43.155941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145afc5-8565-4001-8469-49140d6a6feb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:06:43.156288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145afc5-8565-4001-8469-49140d6a6feb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:43.158165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145afc5-8565-4001-8469-49140d6a6feb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:43.172233 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1438/2916] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:06:43.176788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7d3db-2575-4cf9-874d-5cc7f7976830 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:43.186781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7d3db-2575-4cf9-874d-5cc7f7976830 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:43.191706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbb7a5-bde0-4c85-8204-ecff787bf836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:43.192441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbb7a5-bde0-4c85-8204-ecff787bf836 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:43.192722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbb7a5-bde0-4c85-8204-ecff787bf836 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:43.192989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbb7a5-bde0-4c85-8204-ecff787bf836 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:43.193686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbb7a5-bde0-4c85-8204-ecff787bf836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:43.195844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbb7a5-bde0-4c85-8204-ecff787bf836 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:43.229867 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1479/2917] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:06:43 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:06:43.231660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145afc5-8565-4001-8469-49140d6a6feb admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:43.243113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145afc5-8565-4001-8469-49140d6a6feb admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:43.256425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:43.310010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1d08d-4d7c-44b0-99a7-ca25a7f278f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:43.310687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1d08d-4d7c-44b0-99a7-ca25a7f278f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:43.310967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1d08d-4d7c-44b0-99a7-ca25a7f278f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:43.311237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1d08d-4d7c-44b0-99a7-ca25a7f278f1 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:43.311915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1d08d-4d7c-44b0-99a7-ca25a7f278f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:43.313858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1d08d-4d7c-44b0-99a7-ca25a7f278f1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:43.338766 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1439/2918] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:06:43 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:06:43.343034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbb7a5-bde0-4c85-8204-ecff787bf836 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:43.355317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbb7a5-bde0-4c85-8204-ecff787bf836 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:43.360766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae3d4a-0956-42b9-8ba7-f7ad6734081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:43.361439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae3d4a-0956-42b9-8ba7-f7ad6734081a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:43.361739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae3d4a-0956-42b9-8ba7-f7ad6734081a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:43.362020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae3d4a-0956-42b9-8ba7-f7ad6734081a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:43.362783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae3d4a-0956-42b9-8ba7-f7ad6734081a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:43.364485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae3d4a-0956-42b9-8ba7-f7ad6734081a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:43.375437 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1480/2919] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:06:43.379503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1d08d-4d7c-44b0-99a7-ca25a7f278f1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:43.390146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1d08d-4d7c-44b0-99a7-ca25a7f278f1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:43.395331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c27860-ec2a-4cc7-957b-cf490ce91158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:43.395998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c27860-ec2a-4cc7-957b-cf490ce91158 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:43.396340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c27860-ec2a-4cc7-957b-cf490ce91158 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:43.396641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c27860-ec2a-4cc7-957b-cf490ce91158 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:43.397369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c27860-ec2a-4cc7-957b-cf490ce91158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:43.398975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c27860-ec2a-4cc7-957b-cf490ce91158 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:43.409288 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1440/2920] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:06:43.413971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae3d4a-0956-42b9-8ba7-f7ad6734081a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:43.424422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae3d4a-0956-42b9-8ba7-f7ad6734081a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:43.429769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cbd48-8746-49fc-a78d-970166c9547b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:43.430662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cbd48-8746-49fc-a78d-970166c9547b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:43.430936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cbd48-8746-49fc-a78d-970166c9547b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:43.431205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262cbd48-8746-49fc-a78d-970166c9547b admin admin] PATH_INFO: `/v3/projects/ff34812ddbf0408fa8a7cd8b6a650656/users/d78b7d8438e045e5b8d59762ac1b729d/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:43.446642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262cbd48-8746-49fc-a78d-970166c9547b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff34812ddbf0408fa8a7cd8b6a650656, user_id=d78b7d8438e045e5b8d59762ac1b729d, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:43.449588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262cbd48-8746-49fc-a78d-970166c9547b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:43.461022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:43.472327 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1481/2921] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:06:43 2022] PUT /identity/v3/projects/ff34812ddbf0408fa8a7cd8b6a650656/users/d78b7d8438e045e5b8d59762ac1b729d/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:43.477370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718db99-e549-42c8-908e-9fc0f8b821e1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:43.477582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718db99-e549-42c8-908e-9fc0f8b821e1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:43.477995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718db99-e549-42c8-908e-9fc0f8b821e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:43.505586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f718db99-e549-42c8-908e-9fc0f8b821e1 None None] MFA Rules not processed for user `d78b7d8438e045e5b8d59762ac1b729d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:43.506818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f718db99-e549-42c8-908e-9fc0f8b821e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:43.575519 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1441/2922] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:43.581219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cbd48-8746-49fc-a78d-970166c9547b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:43.650313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262cbd48-8746-49fc-a78d-970166c9547b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:43.657251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e228135-480e-4160-b547-e3d728ada1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:43.657993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e228135-480e-4160-b547-e3d728ada1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:43.658345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e228135-480e-4160-b547-e3d728ada1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:43.658693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e228135-480e-4160-b547-e3d728ada1e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:43.659472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e228135-480e-4160-b547-e3d728ada1e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:43.662030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e228135-480e-4160-b547-e3d728ada1e8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:43.692154 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1482/2923] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:06:43 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:06:43.693342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718db99-e549-42c8-908e-9fc0f8b821e1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:43.705946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718db99-e549-42c8-908e-9fc0f8b821e1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:43.768981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5182ee-5a29-4158-aa38-14fc90e4c562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:43.770405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5182ee-5a29-4158-aa38-14fc90e4c562 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:43.770684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5182ee-5a29-4158-aa38-14fc90e4c562 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:43.771353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5182ee-5a29-4158-aa38-14fc90e4c562 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:43.772238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5182ee-5a29-4158-aa38-14fc90e4c562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:43.774873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5182ee-5a29-4158-aa38-14fc90e4c562 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:43.806026 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1442/2924] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:06:43 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:06:43.810344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e228135-480e-4160-b547-e3d728ada1e8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:43.827321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e228135-480e-4160-b547-e3d728ada1e8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:43.832537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a28db-30fa-4053-afdb-38d32a08b481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:43.833355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a28db-30fa-4053-afdb-38d32a08b481 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:43.833717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a28db-30fa-4053-afdb-38d32a08b481 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:43.834135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a28db-30fa-4053-afdb-38d32a08b481 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:43.834946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a28db-30fa-4053-afdb-38d32a08b481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:43.836810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a28db-30fa-4053-afdb-38d32a08b481 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:43.851512 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1483/2925] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:06:43.855692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5182ee-5a29-4158-aa38-14fc90e4c562 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:43.874686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5182ee-5a29-4158-aa38-14fc90e4c562 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:43.881202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177455f-c220-4537-80a7-087717b241c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:43.882308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177455f-c220-4537-80a7-087717b241c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:43.882674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177455f-c220-4537-80a7-087717b241c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:43.882948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177455f-c220-4537-80a7-087717b241c3 admin admin] PATH_INFO: `/v3/projects/32a3b86b8a544b6babe90a7f72e7e063/users/4a9b99b7b1b247faaa63d45c0e158b1d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:43.905279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:43.912073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177455f-c220-4537-80a7-087717b241c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a3b86b8a544b6babe90a7f72e7e063, user_id=4a9b99b7b1b247faaa63d45c0e158b1d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:43.915631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177455f-c220-4537-80a7-087717b241c3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:43.939303 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1443/2926] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:06:43 2022] PUT /identity/v3/projects/32a3b86b8a544b6babe90a7f72e7e063/users/4a9b99b7b1b247faaa63d45c0e158b1d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:43.943513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a28db-30fa-4053-afdb-38d32a08b481 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:43.957864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a28db-30fa-4053-afdb-38d32a08b481 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:44.029591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326ec7e-18fc-44e5-84f9-a56e32903341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:44.030431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326ec7e-18fc-44e5-84f9-a56e32903341 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:44.030784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326ec7e-18fc-44e5-84f9-a56e32903341 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:44.031143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326ec7e-18fc-44e5-84f9-a56e32903341 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:44.031926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326ec7e-18fc-44e5-84f9-a56e32903341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:44.033612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326ec7e-18fc-44e5-84f9-a56e32903341 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:44.045029 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1484/2927] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:06:44.049302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177455f-c220-4537-80a7-087717b241c3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:44.060015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177455f-c220-4537-80a7-087717b241c3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:44.064912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7293ce-3965-4010-87c2-525854aafe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:44.065819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7293ce-3965-4010-87c2-525854aafe29 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:44.066097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7293ce-3965-4010-87c2-525854aafe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:44.066370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7293ce-3965-4010-87c2-525854aafe29 admin admin] PATH_INFO: `/v3/projects/32a3b86b8a544b6babe90a7f72e7e063/users/4a9b99b7b1b247faaa63d45c0e158b1d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:44.068426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7293ce-3965-4010-87c2-525854aafe29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a3b86b8a544b6babe90a7f72e7e063, user_id=4a9b99b7b1b247faaa63d45c0e158b1d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:44.071216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7293ce-3965-4010-87c2-525854aafe29 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:44.084342 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1444/2928] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:06:44 2022] PUT /identity/v3/projects/32a3b86b8a544b6babe90a7f72e7e063/users/4a9b99b7b1b247faaa63d45c0e158b1d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:44.094832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f92056-13d3-44a1-a034-1e49d3468d89 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:44.095115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f92056-13d3-44a1-a034-1e49d3468d89 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:44.095397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f92056-13d3-44a1-a034-1e49d3468d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:44.123878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-92f92056-13d3-44a1-a034-1e49d3468d89 None None] MFA Rules not processed for user `4a9b99b7b1b247faaa63d45c0e158b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:44.124838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-92f92056-13d3-44a1-a034-1e49d3468d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:44.200799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:44.216319 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1485/2929] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:44.218244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7293ce-3965-4010-87c2-525854aafe29 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:44.230495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7293ce-3965-4010-87c2-525854aafe29 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:44.237356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3c2e4-1df0-49a6-92ab-934663cd7894 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9b99b7b1b247faaa63d45c0e158b1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a3b86b8a544b6babe90a7f72e7e063', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:44.238347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c2e4-1df0-49a6-92ab-934663cd7894 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:44.238816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c2e4-1df0-49a6-92ab-934663cd7894 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:44.239251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c2e4-1df0-49a6-92ab-934663cd7894 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:44.239978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3c2e4-1df0-49a6-92ab-934663cd7894 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:06:44.240330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3c2e4-1df0-49a6-92ab-934663cd7894 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:44.241955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3c2e4-1df0-49a6-92ab-934663cd7894 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:44.256805 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1445/2930] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:06:44.261183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f92056-13d3-44a1-a034-1e49d3468d89 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:44.270958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f92056-13d3-44a1-a034-1e49d3468d89 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:44.275948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06608d7-0147-4bfd-843f-12610b111612 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9b99b7b1b247faaa63d45c0e158b1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a3b86b8a544b6babe90a7f72e7e063', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:44.276896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06608d7-0147-4bfd-843f-12610b111612 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:44.277176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06608d7-0147-4bfd-843f-12610b111612 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:44.277450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06608d7-0147-4bfd-843f-12610b111612 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:44.278182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06608d7-0147-4bfd-843f-12610b111612 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:44.280123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06608d7-0147-4bfd-843f-12610b111612 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:44.312929 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1486/2931] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:06:44 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:06:44.317145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3c2e4-1df0-49a6-92ab-934663cd7894 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:44.328334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3c2e4-1df0-49a6-92ab-934663cd7894 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:44.401866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a368a-367e-41c2-be44-625994d216fc tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9b99b7b1b247faaa63d45c0e158b1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a3b86b8a544b6babe90a7f72e7e063', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:44.403499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a368a-367e-41c2-be44-625994d216fc tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:44.404151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a368a-367e-41c2-be44-625994d216fc tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:44.404590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a368a-367e-41c2-be44-625994d216fc tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:44.405721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a368a-367e-41c2-be44-625994d216fc tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:06:44.406242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a368a-367e-41c2-be44-625994d216fc tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:44.408304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a368a-367e-41c2-be44-625994d216fc tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:44.424196 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1446/2932] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:06:44.513224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06608d7-0147-4bfd-843f-12610b111612 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:44.515308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b06608d7-0147-4bfd-843f-12610b111612 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:44.591848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06608d7-0147-4bfd-843f-12610b111612 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:44.597381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15571e-ee26-4ef4-93af-1be5a6666333 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:44.598063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15571e-ee26-4ef4-93af-1be5a6666333 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:44.598372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15571e-ee26-4ef4-93af-1be5a6666333 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:44.598650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15571e-ee26-4ef4-93af-1be5a6666333 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:44.607911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15571e-ee26-4ef4-93af-1be5a6666333 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:44.609605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15571e-ee26-4ef4-93af-1be5a6666333 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:44.619814 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1487/2933] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:44.636528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05277eb-c815-426e-822f-882a7b862206 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:44.637019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05277eb-c815-426e-822f-882a7b862206 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:44.637389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05277eb-c815-426e-822f-882a7b862206 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:44.639369 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1447/2934] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:06:44.644295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15571e-ee26-4ef4-93af-1be5a6666333 service nova] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:06:44.656472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15571e-ee26-4ef4-93af-1be5a6666333 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:44.666136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15571e-ee26-4ef4-93af-1be5a6666333 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:44.671021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007db00a-a97c-4619-95c8-f500c69b19a1 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9b99b7b1b247faaa63d45c0e158b1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a3b86b8a544b6babe90a7f72e7e063', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:44.671886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007db00a-a97c-4619-95c8-f500c69b19a1 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:44.672237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007db00a-a97c-4619-95c8-f500c69b19a1 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:44.672518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007db00a-a97c-4619-95c8-f500c69b19a1 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] PATH_INFO: `/v3/projects/2cb2549d293a4159818bb76df4bb1aa9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:44.673731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007db00a-a97c-4619-95c8-f500c69b19a1 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorizing `identity:get_project(project_id=2cb2549d293a4159818bb76df4bb1aa9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:44.675975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007db00a-a97c-4619-95c8-f500c69b19a1 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:44.677682 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1488/2935] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:06:44 2022] GET /identity/v3/projects/2cb2549d293a4159818bb76df4bb1aa9 => generated 371 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:06:44.766047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935aef1-8630-4fb4-ac9f-16dd8cbb03ba None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:44.766340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935aef1-8630-4fb4-ac9f-16dd8cbb03ba None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:44.766620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935aef1-8630-4fb4-ac9f-16dd8cbb03ba None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:44.767997 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1448/2936] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:06:44.774052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007db00a-a97c-4619-95c8-f500c69b19a1 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:06:44.787357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007db00a-a97c-4619-95c8-f500c69b19a1 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:44.795880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007db00a-a97c-4619-95c8-f500c69b19a1 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:44.800455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5519cd9-51bd-41dd-85d8-ae22d5799311 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9b99b7b1b247faaa63d45c0e158b1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a3b86b8a544b6babe90a7f72e7e063', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:44.801316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5519cd9-51bd-41dd-85d8-ae22d5799311 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:44.801595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5519cd9-51bd-41dd-85d8-ae22d5799311 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:44.802547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5519cd9-51bd-41dd-85d8-ae22d5799311 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] PATH_INFO: `/v3/projects/2cb2549d293a4159818bb76df4bb1aa9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:44.803767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5519cd9-51bd-41dd-85d8-ae22d5799311 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorizing `identity:get_project(project_id=2cb2549d293a4159818bb76df4bb1aa9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:44.806092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5519cd9-51bd-41dd-85d8-ae22d5799311 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:44.807869 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1489/2937] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:06:44 2022] GET /identity/v3/projects/2cb2549d293a4159818bb76df4bb1aa9 => generated 371 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:06:44.855006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935aef1-8630-4fb4-ac9f-16dd8cbb03ba None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:44.868334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935aef1-8630-4fb4-ac9f-16dd8cbb03ba None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:44.873264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cab8b8-719e-4696-8c98-2893af2cda72 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9b99b7b1b247faaa63d45c0e158b1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a3b86b8a544b6babe90a7f72e7e063', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:44.874078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cab8b8-719e-4696-8c98-2893af2cda72 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:44.874365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cab8b8-719e-4696-8c98-2893af2cda72 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:44.874640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cab8b8-719e-4696-8c98-2893af2cda72 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:44.875376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cab8b8-719e-4696-8c98-2893af2cda72 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:06:44.875677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cab8b8-719e-4696-8c98-2893af2cda72 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:44.877327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cab8b8-719e-4696-8c98-2893af2cda72 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:44.893043 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1449/2938] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:06:44.897210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5519cd9-51bd-41dd-85d8-ae22d5799311 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:44.908956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5519cd9-51bd-41dd-85d8-ae22d5799311 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:44.915221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4c58e-d98d-42f6-9054-c1e16b6473e8 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9b99b7b1b247faaa63d45c0e158b1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a3b86b8a544b6babe90a7f72e7e063', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:44.916030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4c58e-d98d-42f6-9054-c1e16b6473e8 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:44.916408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4c58e-d98d-42f6-9054-c1e16b6473e8 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:44.916783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4c58e-d98d-42f6-9054-c1e16b6473e8 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:44.917778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4c58e-d98d-42f6-9054-c1e16b6473e8 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:44.919808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4c58e-d98d-42f6-9054-c1e16b6473e8 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:44.954507 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1490/2939] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:06:44 2022] POST /identity/v3/users => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:06:44.958871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cab8b8-719e-4696-8c98-2893af2cda72 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:44.973480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cab8b8-719e-4696-8c98-2893af2cda72 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:44.979711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f1ff2-3995-4dc4-8c39-3ab536ca02bc tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9b99b7b1b247faaa63d45c0e158b1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a3b86b8a544b6babe90a7f72e7e063', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:44.980444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f1ff2-3995-4dc4-8c39-3ab536ca02bc tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:44.980749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f1ff2-3995-4dc4-8c39-3ab536ca02bc tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:44.981144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f1ff2-3995-4dc4-8c39-3ab536ca02bc tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:44.981850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f1ff2-3995-4dc4-8c39-3ab536ca02bc tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:06:44.982212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f1ff2-3995-4dc4-8c39-3ab536ca02bc tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:44.983940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f1ff2-3995-4dc4-8c39-3ab536ca02bc tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:45.000240 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1450/2940] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:06:45.116590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbac19-8705-42d4-b0e3-3f959a9c9387 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:45.116878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbac19-8705-42d4-b0e3-3f959a9c9387 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:45.117177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbac19-8705-42d4-b0e3-3f959a9c9387 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:45.118600 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1491/2941] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:06:45.130824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f1ff2-3995-4dc4-8c39-3ab536ca02bc tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:06:45.144222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f1ff2-3995-4dc4-8c39-3ab536ca02bc tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:45.153379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f1ff2-3995-4dc4-8c39-3ab536ca02bc tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:45.158390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789263ce-3666-4788-98fc-f22a1a68c4bb tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9b99b7b1b247faaa63d45c0e158b1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a3b86b8a544b6babe90a7f72e7e063', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:45.159339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789263ce-3666-4788-98fc-f22a1a68c4bb tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:45.159690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789263ce-3666-4788-98fc-f22a1a68c4bb tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:45.160420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789263ce-3666-4788-98fc-f22a1a68c4bb tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] PATH_INFO: `/v3/projects/2cb2549d293a4159818bb76df4bb1aa9` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:45.161708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789263ce-3666-4788-98fc-f22a1a68c4bb tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorizing `identity:get_project(project_id=2cb2549d293a4159818bb76df4bb1aa9)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:45.163825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789263ce-3666-4788-98fc-f22a1a68c4bb tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:45.166056 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1451/2942] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:06:45 2022] GET /identity/v3/projects/2cb2549d293a4159818bb76df4bb1aa9 => generated 371 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:06:45.297802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50d954-c9cd-40d5-b14c-731346c4dee2 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:45.298065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50d954-c9cd-40d5-b14c-731346c4dee2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:45.298358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50d954-c9cd-40d5-b14c-731346c4dee2 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:45.299723 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1492/2943] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:06:45.304694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789263ce-3666-4788-98fc-f22a1a68c4bb tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:06:45.306728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-789263ce-3666-4788-98fc-f22a1a68c4bb tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:45.325645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789263ce-3666-4788-98fc-f22a1a68c4bb tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:45.335323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789263ce-3666-4788-98fc-f22a1a68c4bb tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:45.340718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19389a-858a-4e7a-9060-49e71295b677 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9b99b7b1b247faaa63d45c0e158b1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a3b86b8a544b6babe90a7f72e7e063', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:45.341113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19389a-858a-4e7a-9060-49e71295b677 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:45.341396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19389a-858a-4e7a-9060-49e71295b677 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:45.341672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19389a-858a-4e7a-9060-49e71295b677 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] PATH_INFO: `/v3/projects/2cb2549d293a4159818bb76df4bb1aa9` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:45.342869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19389a-858a-4e7a-9060-49e71295b677 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorizing `identity:get_project(project_id=2cb2549d293a4159818bb76df4bb1aa9)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:45.344944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19389a-858a-4e7a-9060-49e71295b677 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:45.346675 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1452/2944] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:06:45 2022] GET /identity/v3/projects/2cb2549d293a4159818bb76df4bb1aa9 => generated 371 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:06:45.378832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50d954-c9cd-40d5-b14c-731346c4dee2 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:45.392322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50d954-c9cd-40d5-b14c-731346c4dee2 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:45.397791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3319340-14b6-4231-b2ed-f9f93670c105 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9b99b7b1b247faaa63d45c0e158b1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a3b86b8a544b6babe90a7f72e7e063', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:45.398757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3319340-14b6-4231-b2ed-f9f93670c105 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:45.399104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3319340-14b6-4231-b2ed-f9f93670c105 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:45.399479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3319340-14b6-4231-b2ed-f9f93670c105 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] PATH_INFO: `/v3/users/4931881f62ef436eab9ee8676a7f3ca6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:45.416099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3319340-14b6-4231-b2ed-f9f93670c105 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4931881f62ef436eab9ee8676a7f3ca6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:45.418729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3319340-14b6-4231-b2ed-f9f93670c105 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:45.420511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19389a-858a-4e7a-9060-49e71295b677 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:45.422851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-de19389a-858a-4e7a-9060-49e71295b677 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:45.485576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e3319340-14b6-4231-b2ed-f9f93670c105 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4931881f62ef436eab9ee8676a7f3ca6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:45.499072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e3319340-14b6-4231-b2ed-f9f93670c105 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4931881f62ef436eab9ee8676a7f3ca6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:45.499740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e3319340-14b6-4231-b2ed-f9f93670c105 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4931881f62ef436eab9ee8676a7f3ca6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:45.500552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e3319340-14b6-4231-b2ed-f9f93670c105 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4931881f62ef436eab9ee8676a7f3ca6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:45.501802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19389a-858a-4e7a-9060-49e71295b677 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:45.506245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f123c83-23b5-4a44-82c2-d2cf6c890cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:45.507142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f123c83-23b5-4a44-82c2-d2cf6c890cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:45.507493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f123c83-23b5-4a44-82c2-d2cf6c890cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:45.508067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f123c83-23b5-4a44-82c2-d2cf6c890cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:45.508769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e3319340-14b6-4231-b2ed-f9f93670c105 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4931881f62ef436eab9ee8676a7f3ca6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:45.510306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7f123c83-23b5-4a44-82c2-d2cf6c890cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:45.514062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:45.524393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f123c83-23b5-4a44-82c2-d2cf6c890cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:45.526913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f123c83-23b5-4a44-82c2-d2cf6c890cc2 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:45.540080 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1493/2945] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:06:45 2022] DELETE /identity/v3/users/4931881f62ef436eab9ee8676a7f3ca6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:45.542634 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1453/2946] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:45.544339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3319340-14b6-4231-b2ed-f9f93670c105 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:45.546689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e3319340-14b6-4231-b2ed-f9f93670c105 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:45.678105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3319340-14b6-4231-b2ed-f9f93670c105 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:45.687199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cc0fe-9e30-4599-9318-ef6e0f003421 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9b99b7b1b247faaa63d45c0e158b1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32a3b86b8a544b6babe90a7f72e7e063', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:45.688440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cc0fe-9e30-4599-9318-ef6e0f003421 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:45.688969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cc0fe-9e30-4599-9318-ef6e0f003421 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:45.695947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cc0fe-9e30-4599-9318-ef6e0f003421 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] PATH_INFO: `/v3/projects/2cb2549d293a4159818bb76df4bb1aa9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:45.695947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cc0fe-9e30-4599-9318-ef6e0f003421 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2cb2549d293a4159818bb76df4bb1aa9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:45.695947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cc0fe-9e30-4599-9318-ef6e0f003421 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:45.760407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b52cc0fe-9e30-4599-9318-ef6e0f003421 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb2549d293a4159818bb76df4bb1aa9', 'request_id': 'req-b52cc0fe-9e30-4599-9318-ef6e0f003421'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:45.774492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b52cc0fe-9e30-4599-9318-ef6e0f003421 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb2549d293a4159818bb76df4bb1aa9', 'request_id': 'req-b52cc0fe-9e30-4599-9318-ef6e0f003421'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:45.784633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b52cc0fe-9e30-4599-9318-ef6e0f003421 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb2549d293a4159818bb76df4bb1aa9', 'request_id': 'req-b52cc0fe-9e30-4599-9318-ef6e0f003421'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:45.813470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b52cc0fe-9e30-4599-9318-ef6e0f003421 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] The token cache is being invalidate because project 2cb2549d293a4159818bb76df4bb1aa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:06:45.813470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b52cc0fe-9e30-4599-9318-ef6e0f003421 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:45.814922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b52cc0fe-9e30-4599-9318-ef6e0f003421 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:45.820130 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1494/2947] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:06:45 2022] DELETE /identity/v3/projects/2cb2549d293a4159818bb76df4bb1aa9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:45.825664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f123c83-23b5-4a44-82c2-d2cf6c890cc2 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:45.828029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7f123c83-23b5-4a44-82c2-d2cf6c890cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:45.855713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:45.927876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f123c83-23b5-4a44-82c2-d2cf6c890cc2 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:46.022732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1eb06b-d6fb-41d6-83d8-50e26b99bddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:46.024200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1eb06b-d6fb-41d6-83d8-50e26b99bddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:46.024489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1eb06b-d6fb-41d6-83d8-50e26b99bddb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:46.024764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1eb06b-d6fb-41d6-83d8-50e26b99bddb admin admin] PATH_INFO: `/v3/users/d78b7d8438e045e5b8d59762ac1b729d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:46.026388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1eb06b-d6fb-41d6-83d8-50e26b99bddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d78b7d8438e045e5b8d59762ac1b729d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:46.028628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1eb06b-d6fb-41d6-83d8-50e26b99bddb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:46.115086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1d1eb06b-d6fb-41d6-83d8-50e26b99bddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd78b7d8438e045e5b8d59762ac1b729d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:46.132120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1d1eb06b-d6fb-41d6-83d8-50e26b99bddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd78b7d8438e045e5b8d59762ac1b729d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:46.149861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1d1eb06b-d6fb-41d6-83d8-50e26b99bddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd78b7d8438e045e5b8d59762ac1b729d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:46.150746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1d1eb06b-d6fb-41d6-83d8-50e26b99bddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd78b7d8438e045e5b8d59762ac1b729d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:46.151645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1d1eb06b-d6fb-41d6-83d8-50e26b99bddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd78b7d8438e045e5b8d59762ac1b729d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:46.220110 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1454/2948] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:06:45 2022] DELETE /identity/v3/users/d78b7d8438e045e5b8d59762ac1b729d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:46.225011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d037744-584c-4a9d-b319-aafadc28f71a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:46.225537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d037744-584c-4a9d-b319-aafadc28f71a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:46.225918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d037744-584c-4a9d-b319-aafadc28f71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:46.263008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0d037744-584c-4a9d-b319-aafadc28f71a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:46.264245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0d037744-584c-4a9d-b319-aafadc28f71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:46.423527 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1495/2949] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:46.438812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1eb06b-d6fb-41d6-83d8-50e26b99bddb admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:46.440310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1d1eb06b-d6fb-41d6-83d8-50e26b99bddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:46.534634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:46.551310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1eb06b-d6fb-41d6-83d8-50e26b99bddb admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:46.560650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c59814-5717-46d2-b938-d08e70af221d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:46.561628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c59814-5717-46d2-b938-d08e70af221d service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:46.562084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c59814-5717-46d2-b938-d08e70af221d service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:46.562510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c59814-5717-46d2-b938-d08e70af221d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:46.577005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c59814-5717-46d2-b938-d08e70af221d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:46.578634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c59814-5717-46d2-b938-d08e70af221d service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:46.595243 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1455/2950] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:47.427278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d037744-584c-4a9d-b319-aafadc28f71a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:47.429534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0d037744-584c-4a9d-b319-aafadc28f71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:47.469449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d037744-584c-4a9d-b319-aafadc28f71a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:47.487944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743348a9-67d3-4c7c-822c-78168d84eb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:47.489896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743348a9-67d3-4c7c-822c-78168d84eb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:47.490154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743348a9-67d3-4c7c-822c-78168d84eb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:47.491569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743348a9-67d3-4c7c-822c-78168d84eb75 admin admin] PATH_INFO: `/v3/projects/ff34812ddbf0408fa8a7cd8b6a650656` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:47.495357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743348a9-67d3-4c7c-822c-78168d84eb75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff34812ddbf0408fa8a7cd8b6a650656)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:47.500122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743348a9-67d3-4c7c-822c-78168d84eb75 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:47.512590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:47.560421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-743348a9-67d3-4c7c-822c-78168d84eb75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff34812ddbf0408fa8a7cd8b6a650656', 'request_id': 'req-743348a9-67d3-4c7c-822c-78168d84eb75'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:47.570133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-743348a9-67d3-4c7c-822c-78168d84eb75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff34812ddbf0408fa8a7cd8b6a650656', 'request_id': 'req-743348a9-67d3-4c7c-822c-78168d84eb75'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:47.578669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-743348a9-67d3-4c7c-822c-78168d84eb75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff34812ddbf0408fa8a7cd8b6a650656', 'request_id': 'req-743348a9-67d3-4c7c-822c-78168d84eb75'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:47.603073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-743348a9-67d3-4c7c-822c-78168d84eb75 admin admin] The token cache is being invalidate because project ff34812ddbf0408fa8a7cd8b6a650656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:06:47.603462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-743348a9-67d3-4c7c-822c-78168d84eb75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:47.604359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-743348a9-67d3-4c7c-822c-78168d84eb75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:47.606498 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1496/2951] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:06:47 2022] DELETE /identity/v3/projects/ff34812ddbf0408fa8a7cd8b6a650656 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:47.610907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c59814-5717-46d2-b938-d08e70af221d service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:47.634350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c59814-5717-46d2-b938-d08e70af221d service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:47.716750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fabb52-03f3-46ac-8cff-0d83d8e91c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:47.717658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fabb52-03f3-46ac-8cff-0d83d8e91c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:47.717937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fabb52-03f3-46ac-8cff-0d83d8e91c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:47.719132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fabb52-03f3-46ac-8cff-0d83d8e91c01 admin admin] PATH_INFO: `/v3/users/4a9b99b7b1b247faaa63d45c0e158b1d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:47.720794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fabb52-03f3-46ac-8cff-0d83d8e91c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a9b99b7b1b247faaa63d45c0e158b1d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:47.723492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fabb52-03f3-46ac-8cff-0d83d8e91c01 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:47.784073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a6fabb52-03f3-46ac-8cff-0d83d8e91c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a9b99b7b1b247faaa63d45c0e158b1d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:47.794975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a6fabb52-03f3-46ac-8cff-0d83d8e91c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a9b99b7b1b247faaa63d45c0e158b1d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:47.803769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a6fabb52-03f3-46ac-8cff-0d83d8e91c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a9b99b7b1b247faaa63d45c0e158b1d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:47.804460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a6fabb52-03f3-46ac-8cff-0d83d8e91c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a9b99b7b1b247faaa63d45c0e158b1d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:47.805073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a6fabb52-03f3-46ac-8cff-0d83d8e91c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a9b99b7b1b247faaa63d45c0e158b1d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:47.823070 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1456/2952] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:06:47 2022] DELETE /identity/v3/users/4a9b99b7b1b247faaa63d45c0e158b1d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:48.145828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743348a9-67d3-4c7c-822c-78168d84eb75 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:48.147401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-743348a9-67d3-4c7c-822c-78168d84eb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:48.161885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743348a9-67d3-4c7c-822c-78168d84eb75 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:48.310650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd4cbd-31d9-41eb-90c0-a77c83acc931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:48.312392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd4cbd-31d9-41eb-90c0-a77c83acc931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:48.313069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd4cbd-31d9-41eb-90c0-a77c83acc931 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:48.313557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd4cbd-31d9-41eb-90c0-a77c83acc931 admin admin] PATH_INFO: `/v3/projects/32a3b86b8a544b6babe90a7f72e7e063` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:48.318205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd4cbd-31d9-41eb-90c0-a77c83acc931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a3b86b8a544b6babe90a7f72e7e063)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:48.325192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd4cbd-31d9-41eb-90c0-a77c83acc931 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:48.389661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eccd4cbd-31d9-41eb-90c0-a77c83acc931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a3b86b8a544b6babe90a7f72e7e063', 'request_id': 'req-eccd4cbd-31d9-41eb-90c0-a77c83acc931'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:48.404826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eccd4cbd-31d9-41eb-90c0-a77c83acc931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a3b86b8a544b6babe90a7f72e7e063', 'request_id': 'req-eccd4cbd-31d9-41eb-90c0-a77c83acc931'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:48.415439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eccd4cbd-31d9-41eb-90c0-a77c83acc931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a3b86b8a544b6babe90a7f72e7e063', 'request_id': 'req-eccd4cbd-31d9-41eb-90c0-a77c83acc931'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:48.427724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eccd4cbd-31d9-41eb-90c0-a77c83acc931 admin admin] The token cache is being invalidate because project 32a3b86b8a544b6babe90a7f72e7e063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:06:48.428664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eccd4cbd-31d9-41eb-90c0-a77c83acc931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:48.428934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eccd4cbd-31d9-41eb-90c0-a77c83acc931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:06:48.437638 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1497/2953] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:06:48 2022] DELETE /identity/v3/projects/32a3b86b8a544b6babe90a7f72e7e063 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:48.439404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37acfe-06b7-45eb-94bc-87a5fe8edf06 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:48.439766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37acfe-06b7-45eb-94bc-87a5fe8edf06 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:48.439964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37acfe-06b7-45eb-94bc-87a5fe8edf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:48.478367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5f37acfe-06b7-45eb-94bc-87a5fe8edf06 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:48.479905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5f37acfe-06b7-45eb-94bc-87a5fe8edf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:48.577563 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1457/2954] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:48.643278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3b5b9-1245-4eab-82c3-4b6e38020900 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:48.643568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3b5b9-1245-4eab-82c3-4b6e38020900 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:48.643821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3b5b9-1245-4eab-82c3-4b6e38020900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:48.664203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-35f3b5b9-1245-4eab-82c3-4b6e38020900 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:48.665597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-35f3b5b9-1245-4eab-82c3-4b6e38020900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:48.682585 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1498/2955] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:48.683789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37acfe-06b7-45eb-94bc-87a5fe8edf06 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:48.698069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37acfe-06b7-45eb-94bc-87a5fe8edf06 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:48.707122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5536c8e-11af-4b4b-b3d1-00f05f6f12b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:48.707953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5536c8e-11af-4b4b-b3d1-00f05f6f12b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:48.708255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5536c8e-11af-4b4b-b3d1-00f05f6f12b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:48.708526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5536c8e-11af-4b4b-b3d1-00f05f6f12b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:48.711322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5536c8e-11af-4b4b-b3d1-00f05f6f12b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:06:48.711636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5536c8e-11af-4b4b-b3d1-00f05f6f12b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:48.713618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5536c8e-11af-4b4b-b3d1-00f05f6f12b4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:48.716294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:48.731522 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1458/2956] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:06:48.735883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3b5b9-1245-4eab-82c3-4b6e38020900 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:48.746403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3b5b9-1245-4eab-82c3-4b6e38020900 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:48.752655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f5db7-1b04-46f4-8fce-b421c1906c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:48.753321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5db7-1b04-46f4-8fce-b421c1906c05 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:48.753713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5db7-1b04-46f4-8fce-b421c1906c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:48.753877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5db7-1b04-46f4-8fce-b421c1906c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:48.754764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f5db7-1b04-46f4-8fce-b421c1906c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:48.757006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f5db7-1b04-46f4-8fce-b421c1906c05 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:48.779777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:48.791013 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1499/2957] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:06:48 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:06:48.797764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5536c8e-11af-4b4b-b3d1-00f05f6f12b4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:48.806263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5536c8e-11af-4b4b-b3d1-00f05f6f12b4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:48.881183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5c108-9ac3-4d2b-8d98-12a0a1e469f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:48.881183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5c108-9ac3-4d2b-8d98-12a0a1e469f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:48.881183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5c108-9ac3-4d2b-8d98-12a0a1e469f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:48.881183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5c108-9ac3-4d2b-8d98-12a0a1e469f5 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:48.881778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5c108-9ac3-4d2b-8d98-12a0a1e469f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:48.883723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5c108-9ac3-4d2b-8d98-12a0a1e469f5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:48.918186 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1459/2958] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:06:48 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:06:48.922833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f5db7-1b04-46f4-8fce-b421c1906c05 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:48.939509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f5db7-1b04-46f4-8fce-b421c1906c05 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:48.947734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215e4fd-97e3-45e1-9b4d-cfb94a8c5bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:48.948568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215e4fd-97e3-45e1-9b4d-cfb94a8c5bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:48.948796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215e4fd-97e3-45e1-9b4d-cfb94a8c5bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:48.949492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215e4fd-97e3-45e1-9b4d-cfb94a8c5bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:48.950092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215e4fd-97e3-45e1-9b4d-cfb94a8c5bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:48.952325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1215e4fd-97e3-45e1-9b4d-cfb94a8c5bf8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:48.967685 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1500/2959] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:06:48.969003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5c108-9ac3-4d2b-8d98-12a0a1e469f5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:48.990813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5c108-9ac3-4d2b-8d98-12a0a1e469f5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:48.996023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17a21c-e2d6-4726-8298-9701c696ebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:48.996806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17a21c-e2d6-4726-8298-9701c696ebab admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:48.997201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17a21c-e2d6-4726-8298-9701c696ebab admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:48.997548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17a21c-e2d6-4726-8298-9701c696ebab admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:48.998349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17a21c-e2d6-4726-8298-9701c696ebab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:49.000014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17a21c-e2d6-4726-8298-9701c696ebab admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:49.012262 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1460/2960] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:06:49.027637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215e4fd-97e3-45e1-9b4d-cfb94a8c5bf8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:49.059686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215e4fd-97e3-45e1-9b4d-cfb94a8c5bf8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:49.083836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd029e-824f-40a1-9957-97450ae07c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:49.083836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd029e-824f-40a1-9957-97450ae07c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:49.083836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd029e-824f-40a1-9957-97450ae07c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:49.084287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd029e-824f-40a1-9957-97450ae07c64 admin admin] PATH_INFO: `/v3/projects/381ec26b4d1240b4889b5ecfebf02610/users/5198cb44d38d495794cc8b0fc5d9d4c3/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:49.113453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd029e-824f-40a1-9957-97450ae07c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=381ec26b4d1240b4889b5ecfebf02610, user_id=5198cb44d38d495794cc8b0fc5d9d4c3, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:49.116274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd029e-824f-40a1-9957-97450ae07c64 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:49.144366 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1501/2961] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:06:49 2022] PUT /identity/v3/projects/381ec26b4d1240b4889b5ecfebf02610/users/5198cb44d38d495794cc8b0fc5d9d4c3/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:49.156200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a850d-8efd-44dc-8022-4f9df8020f31 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:49.156972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a850d-8efd-44dc-8022-4f9df8020f31 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:49.157686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a850d-8efd-44dc-8022-4f9df8020f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:49.208549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9f9a850d-8efd-44dc-8022-4f9df8020f31 None None] MFA Rules not processed for user `5198cb44d38d495794cc8b0fc5d9d4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:49.210090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9f9a850d-8efd-44dc-8022-4f9df8020f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:49.295267 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1461/2962] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:49.299503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd029e-824f-40a1-9957-97450ae07c64 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:49.452124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd029e-824f-40a1-9957-97450ae07c64 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:49.458356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ceeef0-8f4f-4823-aa56-8859f92b102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:49.459138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ceeef0-8f4f-4823-aa56-8859f92b102a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:49.459492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ceeef0-8f4f-4823-aa56-8859f92b102a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:49.459997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ceeef0-8f4f-4823-aa56-8859f92b102a admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:49.461113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ceeef0-8f4f-4823-aa56-8859f92b102a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:49.463137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ceeef0-8f4f-4823-aa56-8859f92b102a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:49.512816 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1502/2963] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:06:49 2022] POST /identity/v3/projects => generated 375 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:06:49.517697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a850d-8efd-44dc-8022-4f9df8020f31 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:49.531345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a850d-8efd-44dc-8022-4f9df8020f31 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:49.606953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30f9d1-9fc4-4400-83d2-1cda315f0091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:49.607897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30f9d1-9fc4-4400-83d2-1cda315f0091 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:49.608188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30f9d1-9fc4-4400-83d2-1cda315f0091 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:49.608776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30f9d1-9fc4-4400-83d2-1cda315f0091 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:49.609521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30f9d1-9fc4-4400-83d2-1cda315f0091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:49.612763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30f9d1-9fc4-4400-83d2-1cda315f0091 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:49.622112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:49.642627 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1462/2964] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:06:49 2022] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:06:49.647261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ceeef0-8f4f-4823-aa56-8859f92b102a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:49.666894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ceeef0-8f4f-4823-aa56-8859f92b102a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:49.674464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a2d65-8136-4ba5-ab96-c0d751a79b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:49.675167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a2d65-8136-4ba5-ab96-c0d751a79b4c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:49.675475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a2d65-8136-4ba5-ab96-c0d751a79b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:49.675755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a2d65-8136-4ba5-ab96-c0d751a79b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:49.677865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a2d65-8136-4ba5-ab96-c0d751a79b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:49.679635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a2d65-8136-4ba5-ab96-c0d751a79b4c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:49.700758 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1503/2965] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:06:49.701711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30f9d1-9fc4-4400-83d2-1cda315f0091 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:49.716658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30f9d1-9fc4-4400-83d2-1cda315f0091 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:49.723826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f07779-10e1-47e8-83c2-b2a88444f2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:49.724910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f07779-10e1-47e8-83c2-b2a88444f2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:49.725394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f07779-10e1-47e8-83c2-b2a88444f2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:49.725891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f07779-10e1-47e8-83c2-b2a88444f2bf admin admin] PATH_INFO: `/v3/projects/f98c80749a084cc49245163c6add17cb/users/d948dace8b5e4ad1a11b00b1140f2ddf/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:49.771973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f07779-10e1-47e8-83c2-b2a88444f2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98c80749a084cc49245163c6add17cb, user_id=d948dace8b5e4ad1a11b00b1140f2ddf, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:49.776007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f07779-10e1-47e8-83c2-b2a88444f2bf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:49.795865 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1463/2966] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:06:49 2022] PUT /identity/v3/projects/f98c80749a084cc49245163c6add17cb/users/d948dace8b5e4ad1a11b00b1140f2ddf/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:06:49.800795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a2d65-8136-4ba5-ab96-c0d751a79b4c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:49.816596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a2d65-8136-4ba5-ab96-c0d751a79b4c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:49.891948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e196ae-7d2b-45e3-a7c6-380e72a93e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:49.892758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e196ae-7d2b-45e3-a7c6-380e72a93e65 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:49.893110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e196ae-7d2b-45e3-a7c6-380e72a93e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:49.893458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e196ae-7d2b-45e3-a7c6-380e72a93e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:49.894187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e196ae-7d2b-45e3-a7c6-380e72a93e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:49.895838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e196ae-7d2b-45e3-a7c6-380e72a93e65 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:49.911804 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1504/2967] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:06:49.913557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f07779-10e1-47e8-83c2-b2a88444f2bf admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:49.925391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f07779-10e1-47e8-83c2-b2a88444f2bf admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:49.933546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6182f1c-1f4e-42d6-a758-47b598de9462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:49.934455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6182f1c-1f4e-42d6-a758-47b598de9462 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:49.934735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6182f1c-1f4e-42d6-a758-47b598de9462 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:49.935009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6182f1c-1f4e-42d6-a758-47b598de9462 admin admin] PATH_INFO: `/v3/projects/f98c80749a084cc49245163c6add17cb/users/d948dace8b5e4ad1a11b00b1140f2ddf/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:49.937014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6182f1c-1f4e-42d6-a758-47b598de9462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98c80749a084cc49245163c6add17cb, user_id=d948dace8b5e4ad1a11b00b1140f2ddf, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:49.939638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6182f1c-1f4e-42d6-a758-47b598de9462 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:49.953122 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1464/2968] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:06:49 2022] PUT /identity/v3/projects/f98c80749a084cc49245163c6add17cb/users/d948dace8b5e4ad1a11b00b1140f2ddf/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:06:49.970147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f451bd4-3a38-471d-8867-1ba2b6128802 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:49.970147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f451bd4-3a38-471d-8867-1ba2b6128802 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:49.970147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f451bd4-3a38-471d-8867-1ba2b6128802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:50.008612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9f451bd4-3a38-471d-8867-1ba2b6128802 None None] MFA Rules not processed for user `d948dace8b5e4ad1a11b00b1140f2ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:50.010038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9f451bd4-3a38-471d-8867-1ba2b6128802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:50.041022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:50.111657 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1505/2969] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:50.125661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b4fc4-a2ed-49ea-a35c-a802d2b8fcd7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:50.125935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b4fc4-a2ed-49ea-a35c-a802d2b8fcd7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:50.126337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b4fc4-a2ed-49ea-a35c-a802d2b8fcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:50.153383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f49b4fc4-a2ed-49ea-a35c-a802d2b8fcd7 None None] MFA Rules not processed for user `5198cb44d38d495794cc8b0fc5d9d4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:50.153383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f49b4fc4-a2ed-49ea-a35c-a802d2b8fcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:50.239276 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1465/2970] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:50.250332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f451bd4-3a38-471d-8867-1ba2b6128802 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:50.252808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9f451bd4-3a38-471d-8867-1ba2b6128802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:50.375564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f451bd4-3a38-471d-8867-1ba2b6128802 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:50.392028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fafed0-cb93-46d1-b5fe-07d8b8381c02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:50.392028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fafed0-cb93-46d1-b5fe-07d8b8381c02 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:50.392028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fafed0-cb93-46d1-b5fe-07d8b8381c02 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:50.392028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fafed0-cb93-46d1-b5fe-07d8b8381c02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:50.397291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fafed0-cb93-46d1-b5fe-07d8b8381c02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:50.399519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fafed0-cb93-46d1-b5fe-07d8b8381c02 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:50.411707 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1506/2971] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:50.867777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb6e3b-5ab1-4be1-bac1-0e0c7fc8ab71 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:50.868363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb6e3b-5ab1-4be1-bac1-0e0c7fc8ab71 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:50.868363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb6e3b-5ab1-4be1-bac1-0e0c7fc8ab71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:50.891348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-35fb6e3b-5ab1-4be1-bac1-0e0c7fc8ab71 None None] MFA Rules not processed for user `5198cb44d38d495794cc8b0fc5d9d4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:50.893052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-35fb6e3b-5ab1-4be1-bac1-0e0c7fc8ab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:50.920487 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1466/2972] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:06:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:53.329086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fafed0-cb93-46d1-b5fe-07d8b8381c02 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:53.331438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c5fafed0-cb93-46d1-b5fe-07d8b8381c02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:53.411672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fafed0-cb93-46d1-b5fe-07d8b8381c02 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:53.415925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a349e4f-3dad-4552-8006-791b5c7789ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:53.416452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a349e4f-3dad-4552-8006-791b5c7789ff service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:53.416810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a349e4f-3dad-4552-8006-791b5c7789ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:53.417232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a349e4f-3dad-4552-8006-791b5c7789ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:53.419441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4a349e4f-3dad-4552-8006-791b5c7789ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:53.510860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a349e4f-3dad-4552-8006-791b5c7789ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:53.512832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a349e4f-3dad-4552-8006-791b5c7789ff service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:53.519347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:53.526579 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1507/2973] 10.222.0.43 () {60 vars in 1396 bytes} [Sat Jul 2 21:06:53 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:55.321009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb6e3b-5ab1-4be1-bac1-0e0c7fc8ab71 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:55.351853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb6e3b-5ab1-4be1-bac1-0e0c7fc8ab71 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:55.370702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5c744-6495-4a47-9126-bdb510f5bd07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:55.371889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5c744-6495-4a47-9126-bdb510f5bd07 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:55.372485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5c744-6495-4a47-9126-bdb510f5bd07 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:55.373035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5c744-6495-4a47-9126-bdb510f5bd07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:55.379289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-08a5c744-6495-4a47-9126-bdb510f5bd07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:55.433212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5c744-6495-4a47-9126-bdb510f5bd07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:55.437327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5c744-6495-4a47-9126-bdb510f5bd07 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:55.466700 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1467/2974] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:56.623417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a349e4f-3dad-4552-8006-791b5c7789ff service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:56.649520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a349e4f-3dad-4552-8006-791b5c7789ff service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:56.656540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece1721-14e8-49cb-aa84-ab01b8ee9025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:56.657585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece1721-14e8-49cb-aa84-ab01b8ee9025 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:56.658026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece1721-14e8-49cb-aa84-ab01b8ee9025 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:56.658465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece1721-14e8-49cb-aa84-ab01b8ee9025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:56.660886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1ece1721-14e8-49cb-aa84-ab01b8ee9025 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:56.678609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece1721-14e8-49cb-aa84-ab01b8ee9025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:56.680690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece1721-14e8-49cb-aa84-ab01b8ee9025 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:56.694229 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1508/2975] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:06:58.441532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6c94d-f739-47a2-a6ba-1ae14d32d0c7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:58.442590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6c94d-f739-47a2-a6ba-1ae14d32d0c7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:58.443033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6c94d-f739-47a2-a6ba-1ae14d32d0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:58.468967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0eb6c94d-f739-47a2-a6ba-1ae14d32d0c7 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:06:58.471993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0eb6c94d-f739-47a2-a6ba-1ae14d32d0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:58.598559 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1468/2976] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:06:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:06:58.599391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece1721-14e8-49cb-aa84-ab01b8ee9025 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:58.601747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1ece1721-14e8-49cb-aa84-ab01b8ee9025 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:58.702824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece1721-14e8-49cb-aa84-ab01b8ee9025 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:58.710171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e095a07-2689-4dbc-b281-42c1dd29ea18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:58.711035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e095a07-2689-4dbc-b281-42c1dd29ea18 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:58.711486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e095a07-2689-4dbc-b281-42c1dd29ea18 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:58.711925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e095a07-2689-4dbc-b281-42c1dd29ea18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:58.723673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e095a07-2689-4dbc-b281-42c1dd29ea18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:58.726308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e095a07-2689-4dbc-b281-42c1dd29ea18 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:58.772227 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1509/2977] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:06:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:06:59.439671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6c94d-f739-47a2-a6ba-1ae14d32d0c7 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:06:59.442168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0eb6c94d-f739-47a2-a6ba-1ae14d32d0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:59.473225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6c94d-f739-47a2-a6ba-1ae14d32d0c7 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:06:59.498210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f2cc6-44b4-4481-8946-18cdddbb5679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:06:59.498911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f2cc6-44b4-4481-8946-18cdddbb5679 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:06:59.499273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f2cc6-44b4-4481-8946-18cdddbb5679 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:06:59.501181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f2cc6-44b4-4481-8946-18cdddbb5679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:06:59.504926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6f4f2cc6-44b4-4481-8946-18cdddbb5679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:06:59.582503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:59.632895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f2cc6-44b4-4481-8946-18cdddbb5679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:06:59.634569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f2cc6-44b4-4481-8946-18cdddbb5679 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:06:59.649158 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1469/2978] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:07:01.272139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e095a07-2689-4dbc-b281-42c1dd29ea18 service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:01.297175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e095a07-2689-4dbc-b281-42c1dd29ea18 service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:01.314078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4a239-f20d-4076-905c-4df3aff33b86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:01.314828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4a239-f20d-4076-905c-4df3aff33b86 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:01.315111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4a239-f20d-4076-905c-4df3aff33b86 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:01.315385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4a239-f20d-4076-905c-4df3aff33b86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:01.321703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-53a4a239-f20d-4076-905c-4df3aff33b86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:01.479608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4a239-f20d-4076-905c-4df3aff33b86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:01.487867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4a239-f20d-4076-905c-4df3aff33b86 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:01.503951 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1510/2979] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:07:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:07:02.777469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f2cc6-44b4-4481-8946-18cdddbb5679 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:02.779067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6f4f2cc6-44b4-4481-8946-18cdddbb5679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:02.818127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f2cc6-44b4-4481-8946-18cdddbb5679 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:02.834987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f86756-3102-4745-8893-b5670d6e024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:02.841005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f86756-3102-4745-8893-b5670d6e024a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:02.848071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f86756-3102-4745-8893-b5670d6e024a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:02.848686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f86756-3102-4745-8893-b5670d6e024a admin admin] PATH_INFO: `/v3/users/224f488d6b99461bb8bc37921813fb74` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:02.851844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f86756-3102-4745-8893-b5670d6e024a admin admin] RBAC: Authorizing `identity:delete_user(user_id=224f488d6b99461bb8bc37921813fb74)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:02.860110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f86756-3102-4745-8893-b5670d6e024a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:02.980885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-72f86756-3102-4745-8893-b5670d6e024a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '224f488d6b99461bb8bc37921813fb74'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:03.014350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-72f86756-3102-4745-8893-b5670d6e024a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '224f488d6b99461bb8bc37921813fb74'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:03.057516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-72f86756-3102-4745-8893-b5670d6e024a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '224f488d6b99461bb8bc37921813fb74'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:03.060333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-72f86756-3102-4745-8893-b5670d6e024a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '224f488d6b99461bb8bc37921813fb74'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:03.064434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-72f86756-3102-4745-8893-b5670d6e024a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '224f488d6b99461bb8bc37921813fb74'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:03.117723 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1470/2980] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:07:02 2022] DELETE /identity/v3/users/224f488d6b99461bb8bc37921813fb74 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:07:04.203922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4a239-f20d-4076-905c-4df3aff33b86 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:04.220376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4a239-f20d-4076-905c-4df3aff33b86 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:04.355097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d8274-c0ea-4148-ab5d-b687c2cb3d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:04.356293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d8274-c0ea-4148-ab5d-b687c2cb3d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:04.356799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d8274-c0ea-4148-ab5d-b687c2cb3d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:04.357324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d8274-c0ea-4148-ab5d-b687c2cb3d15 admin admin] PATH_INFO: `/v3/projects/31671d11617e46fd881d114812d41e35` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:04.359268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d8274-c0ea-4148-ab5d-b687c2cb3d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31671d11617e46fd881d114812d41e35)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:04.361811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d8274-c0ea-4148-ab5d-b687c2cb3d15 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:04.378518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:04.451438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-788d8274-c0ea-4148-ab5d-b687c2cb3d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31671d11617e46fd881d114812d41e35', 'request_id': 'req-788d8274-c0ea-4148-ab5d-b687c2cb3d15'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:04.465445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-788d8274-c0ea-4148-ab5d-b687c2cb3d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31671d11617e46fd881d114812d41e35', 'request_id': 'req-788d8274-c0ea-4148-ab5d-b687c2cb3d15'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:04.482918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-788d8274-c0ea-4148-ab5d-b687c2cb3d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31671d11617e46fd881d114812d41e35', 'request_id': 'req-788d8274-c0ea-4148-ab5d-b687c2cb3d15'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:04.499640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-788d8274-c0ea-4148-ab5d-b687c2cb3d15 admin admin] The token cache is being invalidate because project 31671d11617e46fd881d114812d41e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:07:04.500317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-788d8274-c0ea-4148-ab5d-b687c2cb3d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:04.501496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-788d8274-c0ea-4148-ab5d-b687c2cb3d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:04.504650 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1511/2981] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:07:04 2022] DELETE /identity/v3/projects/31671d11617e46fd881d114812d41e35 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:07:04.510220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a7ec4-c1c3-4533-b0b8-d06d0c432311 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:04.510703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a7ec4-c1c3-4533-b0b8-d06d0c432311 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:04.510703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a7ec4-c1c3-4533-b0b8-d06d0c432311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:04.543909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-935a7ec4-c1c3-4533-b0b8-d06d0c432311 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:04.545306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-935a7ec4-c1c3-4533-b0b8-d06d0c432311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:04.731045 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1471/2982] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:07:04.739193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88a67f-ed0a-4764-8ea5-61b1028f2ae6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:04.739728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88a67f-ed0a-4764-8ea5-61b1028f2ae6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:04.740227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88a67f-ed0a-4764-8ea5-61b1028f2ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:04.792259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ea88a67f-ed0a-4764-8ea5-61b1028f2ae6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:04.795652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ea88a67f-ed0a-4764-8ea5-61b1028f2ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:04.816112 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1512/2983] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:07:04.821070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a7ec4-c1c3-4533-b0b8-d06d0c432311 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:04.841383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a7ec4-c1c3-4533-b0b8-d06d0c432311 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:04.865680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a84d4b-d327-4dd8-99ed-af003a236db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:04.866591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a84d4b-d327-4dd8-99ed-af003a236db9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:04.867029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a84d4b-d327-4dd8-99ed-af003a236db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:04.867286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a84d4b-d327-4dd8-99ed-af003a236db9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:04.868187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a84d4b-d327-4dd8-99ed-af003a236db9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:07:04.868830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a84d4b-d327-4dd8-99ed-af003a236db9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:04.870362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a84d4b-d327-4dd8-99ed-af003a236db9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:04.904931 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1472/2984] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:07:04.909227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88a67f-ed0a-4764-8ea5-61b1028f2ae6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:04.925620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88a67f-ed0a-4764-8ea5-61b1028f2ae6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:04.941833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9f7de-634f-40ee-821e-b9477a08934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:04.942586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9f7de-634f-40ee-821e-b9477a08934c admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:04.943129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9f7de-634f-40ee-821e-b9477a08934c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:04.943356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9f7de-634f-40ee-821e-b9477a08934c admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:04.945174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9f7de-634f-40ee-821e-b9477a08934c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:04.946108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9f7de-634f-40ee-821e-b9477a08934c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:05.096562 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1513/2985] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:07:04 2022] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:07:05.097709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a84d4b-d327-4dd8-99ed-af003a236db9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:05.116419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a84d4b-d327-4dd8-99ed-af003a236db9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:05.199335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:05.253604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a2c10-08e2-414c-be27-b43b27acc30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:05.254600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a2c10-08e2-414c-be27-b43b27acc30d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:05.257790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a2c10-08e2-414c-be27-b43b27acc30d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:05.257790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a2c10-08e2-414c-be27-b43b27acc30d admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:05.258596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a2c10-08e2-414c-be27-b43b27acc30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:05.262251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a2c10-08e2-414c-be27-b43b27acc30d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:05.308796 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1473/2986] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:07:05 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:07:05.309933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9f7de-634f-40ee-821e-b9477a08934c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:05.330428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9f7de-634f-40ee-821e-b9477a08934c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:05.356064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f6bf7-975e-4f20-b24f-f3a8e1a534ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:05.358537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f6bf7-975e-4f20-b24f-f3a8e1a534ce admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:05.358690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f6bf7-975e-4f20-b24f-f3a8e1a534ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:05.358979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f6bf7-975e-4f20-b24f-f3a8e1a534ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:05.359766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f6bf7-975e-4f20-b24f-f3a8e1a534ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:05.361543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f6bf7-975e-4f20-b24f-f3a8e1a534ce admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:05.417805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a2c10-08e2-414c-be27-b43b27acc30d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:05.423351 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1514/2987] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:07:05.435699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a2c10-08e2-414c-be27-b43b27acc30d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:05.445871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcef5c-53c1-478a-b241-9ec63ab81ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:05.446713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcef5c-53c1-478a-b241-9ec63ab81ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:05.449347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcef5c-53c1-478a-b241-9ec63ab81ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:05.449906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcef5c-53c1-478a-b241-9ec63ab81ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:05.451125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcef5c-53c1-478a-b241-9ec63ab81ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:05.456108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcef5c-53c1-478a-b241-9ec63ab81ff5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:05.486480 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1474/2988] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:07:05.491331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f6bf7-975e-4f20-b24f-f3a8e1a534ce admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:05.522538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f6bf7-975e-4f20-b24f-f3a8e1a534ce admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:05.532026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37ed39-bd26-484a-98f9-b52f7a7bb1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:05.534114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37ed39-bd26-484a-98f9-b52f7a7bb1de admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:05.534651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37ed39-bd26-484a-98f9-b52f7a7bb1de admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:05.535502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37ed39-bd26-484a-98f9-b52f7a7bb1de admin admin] PATH_INFO: `/v3/projects/73fe5e9f9b7e401488333f601eaa80ac/users/27059ad6d23e4faf8f09c22cf6ee1475/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:05.610332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37ed39-bd26-484a-98f9-b52f7a7bb1de admin admin] RBAC: Authorizing `identity:create_grant(project_id=73fe5e9f9b7e401488333f601eaa80ac, user_id=27059ad6d23e4faf8f09c22cf6ee1475, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:05.621896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37ed39-bd26-484a-98f9-b52f7a7bb1de admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:05.666611 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1515/2989] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:07:05 2022] PUT /identity/v3/projects/73fe5e9f9b7e401488333f601eaa80ac/users/27059ad6d23e4faf8f09c22cf6ee1475/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:07:05.672560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c61602-38da-4da2-9b9b-8a84a22d91a1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:05.673339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c61602-38da-4da2-9b9b-8a84a22d91a1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:05.673677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c61602-38da-4da2-9b9b-8a84a22d91a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:05.714738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-90c61602-38da-4da2-9b9b-8a84a22d91a1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:05.716513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-90c61602-38da-4da2-9b9b-8a84a22d91a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:05.872596 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1475/2990] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:07:05.957202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37ed39-bd26-484a-98f9-b52f7a7bb1de admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:05.959806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6e37ed39-bd26-484a-98f9-b52f7a7bb1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:06.059283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37ed39-bd26-484a-98f9-b52f7a7bb1de admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:06.064943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3e8ff-1aed-4ea3-a26e-0f054837c19c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:06.065937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3e8ff-1aed-4ea3-a26e-0f054837c19c service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:06.067055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3e8ff-1aed-4ea3-a26e-0f054837c19c service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:06.068478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3e8ff-1aed-4ea3-a26e-0f054837c19c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:06.086414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3e8ff-1aed-4ea3-a26e-0f054837c19c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:06.099119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3e8ff-1aed-4ea3-a26e-0f054837c19c service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:06.114174 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1516/2991] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:07:07.660094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3912250-c0d7-46ad-a7cb-e1b3d5a9b974 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:07.660094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3912250-c0d7-46ad-a7cb-e1b3d5a9b974 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:07.661037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3912250-c0d7-46ad-a7cb-e1b3d5a9b974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:07.686973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b3912250-c0d7-46ad-a7cb-e1b3d5a9b974 None None] MFA Rules not processed for user `1fade188e2a14766ae95fe44143bca97`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:07.688921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b3912250-c0d7-46ad-a7cb-e1b3d5a9b974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:07.778452 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1476/2992] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:07:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:07:15.704463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3e8ff-1aed-4ea3-a26e-0f054837c19c service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:15.706581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-01e3e8ff-1aed-4ea3-a26e-0f054837c19c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:15.730330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3e8ff-1aed-4ea3-a26e-0f054837c19c service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:15.740948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ff9b0-ad43-4a63-bb86-3815dabb4dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:15.742592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ff9b0-ad43-4a63-bb86-3815dabb4dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:15.743086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ff9b0-ad43-4a63-bb86-3815dabb4dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:15.743575 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ff9b0-ad43-4a63-bb86-3815dabb4dfd admin admin] PATH_INFO: `/v3/users/f3287fb85c2343d686718d3c4aaa5c00` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:15.745168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ff9b0-ad43-4a63-bb86-3815dabb4dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3287fb85c2343d686718d3c4aaa5c00)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:15.748430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ff9b0-ad43-4a63-bb86-3815dabb4dfd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:15.822426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:15.840105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d61ff9b0-ad43-4a63-bb86-3815dabb4dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3287fb85c2343d686718d3c4aaa5c00'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:15.888579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d61ff9b0-ad43-4a63-bb86-3815dabb4dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3287fb85c2343d686718d3c4aaa5c00'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:15.889268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d61ff9b0-ad43-4a63-bb86-3815dabb4dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3287fb85c2343d686718d3c4aaa5c00'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:15.889917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d61ff9b0-ad43-4a63-bb86-3815dabb4dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3287fb85c2343d686718d3c4aaa5c00'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:15.903399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d61ff9b0-ad43-4a63-bb86-3815dabb4dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3287fb85c2343d686718d3c4aaa5c00'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:15.941911 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1517/2993] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:07:15 2022] DELETE /identity/v3/users/f3287fb85c2343d686718d3c4aaa5c00 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:07:16.322721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3912250-c0d7-46ad-a7cb-e1b3d5a9b974 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:16.351672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3912250-c0d7-46ad-a7cb-e1b3d5a9b974 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:16.495037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2b0ac-ad24-4d8e-8b29-a76bb575fce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:16.495923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2b0ac-ad24-4d8e-8b29-a76bb575fce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:16.496278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2b0ac-ad24-4d8e-8b29-a76bb575fce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:16.498531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2b0ac-ad24-4d8e-8b29-a76bb575fce1 admin admin] PATH_INFO: `/v3/projects/d59cb1f0d7bb4708ac0994f7c9b846b3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:16.502090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2b0ac-ad24-4d8e-8b29-a76bb575fce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d59cb1f0d7bb4708ac0994f7c9b846b3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:16.504474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2b0ac-ad24-4d8e-8b29-a76bb575fce1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:16.508818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:16.619023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-08d2b0ac-ad24-4d8e-8b29-a76bb575fce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'request_id': 'req-08d2b0ac-ad24-4d8e-8b29-a76bb575fce1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:16.629756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-08d2b0ac-ad24-4d8e-8b29-a76bb575fce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'request_id': 'req-08d2b0ac-ad24-4d8e-8b29-a76bb575fce1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:16.639626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-08d2b0ac-ad24-4d8e-8b29-a76bb575fce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'request_id': 'req-08d2b0ac-ad24-4d8e-8b29-a76bb575fce1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:16.664241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-08d2b0ac-ad24-4d8e-8b29-a76bb575fce1 admin admin] The token cache is being invalidate because project d59cb1f0d7bb4708ac0994f7c9b846b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:07:16.664524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-08d2b0ac-ad24-4d8e-8b29-a76bb575fce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:16.665247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-08d2b0ac-ad24-4d8e-8b29-a76bb575fce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:16.668486 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1477/2994] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:07:16 2022] DELETE /identity/v3/projects/d59cb1f0d7bb4708ac0994f7c9b846b3 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:07:16.671300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ff9b0-ad43-4a63-bb86-3815dabb4dfd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:16.673146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d61ff9b0-ad43-4a63-bb86-3815dabb4dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:16.707540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ff9b0-ad43-4a63-bb86-3815dabb4dfd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:16.811959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a7ff9-1d08-4cb5-b63e-0aad530f1fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:16.814358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a7ff9-1d08-4cb5-b63e-0aad530f1fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:16.814643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a7ff9-1d08-4cb5-b63e-0aad530f1fed admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:16.814927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a7ff9-1d08-4cb5-b63e-0aad530f1fed admin admin] PATH_INFO: `/v3/users/eb68afc30fd8403a82efa015738a776f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:16.816349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a7ff9-1d08-4cb5-b63e-0aad530f1fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb68afc30fd8403a82efa015738a776f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:16.818502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a7ff9-1d08-4cb5-b63e-0aad530f1fed admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:16.890419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0c8a7ff9-1d08-4cb5-b63e-0aad530f1fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb68afc30fd8403a82efa015738a776f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:16.909448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0c8a7ff9-1d08-4cb5-b63e-0aad530f1fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb68afc30fd8403a82efa015738a776f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:16.911148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0c8a7ff9-1d08-4cb5-b63e-0aad530f1fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb68afc30fd8403a82efa015738a776f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:16.914245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0c8a7ff9-1d08-4cb5-b63e-0aad530f1fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb68afc30fd8403a82efa015738a776f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:16.927185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0c8a7ff9-1d08-4cb5-b63e-0aad530f1fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb68afc30fd8403a82efa015738a776f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:16.958354 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1518/2995] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:07:16 2022] DELETE /identity/v3/users/eb68afc30fd8403a82efa015738a776f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:07:17.310181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2b0ac-ad24-4d8e-8b29-a76bb575fce1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:17.312929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-08d2b0ac-ad24-4d8e-8b29-a76bb575fce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:17.366703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2b0ac-ad24-4d8e-8b29-a76bb575fce1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:17.533498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185fee6-8634-4106-8312-f89fca9527cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:17.534695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185fee6-8634-4106-8312-f89fca9527cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:17.535201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185fee6-8634-4106-8312-f89fca9527cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:17.535704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185fee6-8634-4106-8312-f89fca9527cf admin admin] PATH_INFO: `/v3/projects/a2435181dd914e78be658755f294300d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:17.537259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185fee6-8634-4106-8312-f89fca9527cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2435181dd914e78be658755f294300d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:17.540007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185fee6-8634-4106-8312-f89fca9527cf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:17.692540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e185fee6-8634-4106-8312-f89fca9527cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2435181dd914e78be658755f294300d', 'request_id': 'req-e185fee6-8634-4106-8312-f89fca9527cf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:17.712827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e185fee6-8634-4106-8312-f89fca9527cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2435181dd914e78be658755f294300d', 'request_id': 'req-e185fee6-8634-4106-8312-f89fca9527cf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:17.730844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e185fee6-8634-4106-8312-f89fca9527cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2435181dd914e78be658755f294300d', 'request_id': 'req-e185fee6-8634-4106-8312-f89fca9527cf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:17.759077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e185fee6-8634-4106-8312-f89fca9527cf admin admin] The token cache is being invalidate because project a2435181dd914e78be658755f294300d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:07:17.759319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e185fee6-8634-4106-8312-f89fca9527cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:17.759978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e185fee6-8634-4106-8312-f89fca9527cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:17.762500 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1478/2996] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:07:17 2022] DELETE /identity/v3/projects/a2435181dd914e78be658755f294300d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:07:17.768325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddaa3e5-fea6-4ab9-b4aa-aef6e573ea6a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:17.768881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddaa3e5-fea6-4ab9-b4aa-aef6e573ea6a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:17.769004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddaa3e5-fea6-4ab9-b4aa-aef6e573ea6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:17.811603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6ddaa3e5-fea6-4ab9-b4aa-aef6e573ea6a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:17.813206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6ddaa3e5-fea6-4ab9-b4aa-aef6e573ea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:17.851335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:17.964644 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1519/2997] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:07:17.966920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e903e-afee-493f-b041-e144d896a2c3 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:17.967614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e903e-afee-493f-b041-e144d896a2c3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:17.968175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e903e-afee-493f-b041-e144d896a2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:18.001214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f18e903e-afee-493f-b041-e144d896a2c3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:18.003173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f18e903e-afee-493f-b041-e144d896a2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:18.022136 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1479/2998] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:07:18.024670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddaa3e5-fea6-4ab9-b4aa-aef6e573ea6a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:18.041790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddaa3e5-fea6-4ab9-b4aa-aef6e573ea6a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:18.050616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a59fc8-da7c-4833-af58-78dbcc6e3575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:18.051995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a59fc8-da7c-4833-af58-78dbcc6e3575 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:18.052549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a59fc8-da7c-4833-af58-78dbcc6e3575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:18.053032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a59fc8-da7c-4833-af58-78dbcc6e3575 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:18.054019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a59fc8-da7c-4833-af58-78dbcc6e3575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:07:18.054724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a59fc8-da7c-4833-af58-78dbcc6e3575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:18.056817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a59fc8-da7c-4833-af58-78dbcc6e3575 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:18.105235 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1520/2999] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:07:18.110484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e903e-afee-493f-b041-e144d896a2c3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:18.125964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e903e-afee-493f-b041-e144d896a2c3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:18.132973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf28b4-3037-44a2-b9b6-4322e9b44a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:18.134393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf28b4-3037-44a2-b9b6-4322e9b44a5f admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:18.135076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf28b4-3037-44a2-b9b6-4322e9b44a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:18.136632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf28b4-3037-44a2-b9b6-4322e9b44a5f admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:18.137615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf28b4-3037-44a2-b9b6-4322e9b44a5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:18.140661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf28b4-3037-44a2-b9b6-4322e9b44a5f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:18.159521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:18.201837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a59fc8-da7c-4833-af58-78dbcc6e3575 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:18.214803 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1480/3000] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:07:18 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:07:18.215414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a59fc8-da7c-4833-af58-78dbcc6e3575 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:18.381643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32980ed-1f2d-428d-ba65-cd008c4ca75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:18.382716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32980ed-1f2d-428d-ba65-cd008c4ca75f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:18.383125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32980ed-1f2d-428d-ba65-cd008c4ca75f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:18.383767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32980ed-1f2d-428d-ba65-cd008c4ca75f admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:18.384951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32980ed-1f2d-428d-ba65-cd008c4ca75f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:18.387603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32980ed-1f2d-428d-ba65-cd008c4ca75f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:18.433142 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1521/3001] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:07:18 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:07:18.434700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf28b4-3037-44a2-b9b6-4322e9b44a5f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:18.456147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf28b4-3037-44a2-b9b6-4322e9b44a5f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:18.463524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d53b2-7b39-4938-8dd0-da34b7bf6757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:18.467685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d53b2-7b39-4938-8dd0-da34b7bf6757 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:18.468251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d53b2-7b39-4938-8dd0-da34b7bf6757 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:18.468689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d53b2-7b39-4938-8dd0-da34b7bf6757 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:18.470751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d53b2-7b39-4938-8dd0-da34b7bf6757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:18.474233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d53b2-7b39-4938-8dd0-da34b7bf6757 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:18.491077 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1481/3002] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:07:18.492643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32980ed-1f2d-428d-ba65-cd008c4ca75f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:18.504335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32980ed-1f2d-428d-ba65-cd008c4ca75f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:18.511040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9f53e-1e41-4a85-b1d1-ffce499b3230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:18.511977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9f53e-1e41-4a85-b1d1-ffce499b3230 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:18.512527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9f53e-1e41-4a85-b1d1-ffce499b3230 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:18.513032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9f53e-1e41-4a85-b1d1-ffce499b3230 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:18.514110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9f53e-1e41-4a85-b1d1-ffce499b3230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:18.516152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9f53e-1e41-4a85-b1d1-ffce499b3230 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:18.546790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d53b2-7b39-4938-8dd0-da34b7bf6757 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:18.556659 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1522/3003] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:07:18.565316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d53b2-7b39-4938-8dd0-da34b7bf6757 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:18.593255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bf1ec-bf41-4d87-85ae-c552d52839c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:18.594266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bf1ec-bf41-4d87-85ae-c552d52839c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:18.597032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bf1ec-bf41-4d87-85ae-c552d52839c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:18.597616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bf1ec-bf41-4d87-85ae-c552d52839c8 admin admin] PATH_INFO: `/v3/projects/8c234eb1b17242368d279c164a6045d4/users/8b345a42784d4df79caab6d667117418/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:18.641340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bf1ec-bf41-4d87-85ae-c552d52839c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c234eb1b17242368d279c164a6045d4, user_id=8b345a42784d4df79caab6d667117418, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:18.645379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bf1ec-bf41-4d87-85ae-c552d52839c8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:18.696199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef1d48-4cff-48cb-865e-44b5d39cac73 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:18.696579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef1d48-4cff-48cb-865e-44b5d39cac73 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:18.697079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef1d48-4cff-48cb-865e-44b5d39cac73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:18.698464 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1482/3004] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:07:18 2022] PUT /identity/v3/projects/8c234eb1b17242368d279c164a6045d4/users/8b345a42784d4df79caab6d667117418/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:07:18.733518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6bef1d48-4cff-48cb-865e-44b5d39cac73 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:18.736148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6bef1d48-4cff-48cb-865e-44b5d39cac73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:18.847772 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1523/3005] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:07:18.875742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bf1ec-bf41-4d87-85ae-c552d52839c8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:18.878052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-766bf1ec-bf41-4d87-85ae-c552d52839c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:19.036641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bf1ec-bf41-4d87-85ae-c552d52839c8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:19.048123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91d6d0-045f-4e0d-9785-184d17ef4669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:19.049398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91d6d0-045f-4e0d-9785-184d17ef4669 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:19.049398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91d6d0-045f-4e0d-9785-184d17ef4669 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:19.049398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91d6d0-045f-4e0d-9785-184d17ef4669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:19.112404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91d6d0-045f-4e0d-9785-184d17ef4669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:19.114905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91d6d0-045f-4e0d-9785-184d17ef4669 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:19.184698 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1483/3006] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:07:21.979870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b62c2-cc77-4049-b8e8-210006743e4d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:21.983885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b62c2-cc77-4049-b8e8-210006743e4d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:21.984425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b62c2-cc77-4049-b8e8-210006743e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:22.007503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-dd4b62c2-cc77-4049-b8e8-210006743e4d None None] MFA Rules not processed for user `5198cb44d38d495794cc8b0fc5d9d4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:22.009110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dd4b62c2-cc77-4049-b8e8-210006743e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:22.056663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:22.106794 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1524/3007] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:07:26.326199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50246dd2-5237-4e9e-9f0e-8228dbe56792 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:26.327051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50246dd2-5237-4e9e-9f0e-8228dbe56792 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:26.328106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50246dd2-5237-4e9e-9f0e-8228dbe56792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:26.372984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-50246dd2-5237-4e9e-9f0e-8228dbe56792 None None] MFA Rules not processed for user `27059ad6d23e4faf8f09c22cf6ee1475`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:26.374721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-50246dd2-5237-4e9e-9f0e-8228dbe56792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:26.487927 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1484/3008] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:07:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:07:26.500657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa423fe-897a-497c-9565-5580fb1370bd None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:26.502526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa423fe-897a-497c-9565-5580fb1370bd None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:26.502792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa423fe-897a-497c-9565-5580fb1370bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:26.528724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6aa423fe-897a-497c-9565-5580fb1370bd None None] MFA Rules not processed for user `27059ad6d23e4faf8f09c22cf6ee1475`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:26.532679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50246dd2-5237-4e9e-9f0e-8228dbe56792 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:26.534225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-50246dd2-5237-4e9e-9f0e-8228dbe56792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:26.535725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6aa423fe-897a-497c-9565-5580fb1370bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:26.554744 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1525/3009] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:07:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:07:26.567547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa423fe-897a-497c-9565-5580fb1370bd None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:26.569169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6aa423fe-897a-497c-9565-5580fb1370bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:26.676665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:26.734532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa423fe-897a-497c-9565-5580fb1370bd None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:26.737721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50246dd2-5237-4e9e-9f0e-8228dbe56792 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:26.743256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076494a-7939-4ddd-8417-a4585fbf154c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:26.744259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076494a-7939-4ddd-8417-a4585fbf154c service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:26.744685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076494a-7939-4ddd-8417-a4585fbf154c service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:26.745875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076494a-7939-4ddd-8417-a4585fbf154c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:26.748812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6f784-6489-4766-976b-5a9c6431ac1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:26.750695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6f784-6489-4766-976b-5a9c6431ac1a service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:26.751175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6f784-6489-4766-976b-5a9c6431ac1a service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:26.751632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6f784-6489-4766-976b-5a9c6431ac1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:26.755541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ffe6f784-6489-4766-976b-5a9c6431ac1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:26.757850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076494a-7939-4ddd-8417-a4585fbf154c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:26.759733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076494a-7939-4ddd-8417-a4585fbf154c service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:26.784747 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1526/3010] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:07:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:07:26.874212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6f784-6489-4766-976b-5a9c6431ac1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:26.877092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6f784-6489-4766-976b-5a9c6431ac1a service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:26.912073 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1485/3011] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:07:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:07:28.012836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076494a-7939-4ddd-8417-a4585fbf154c service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:28.038420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076494a-7939-4ddd-8417-a4585fbf154c service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:28.050851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe32888-083e-4e4d-b681-a4300a581320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:28.053970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe32888-083e-4e4d-b681-a4300a581320 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:28.054648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe32888-083e-4e4d-b681-a4300a581320 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:28.056887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe32888-083e-4e4d-b681-a4300a581320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:28.064257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ffe32888-083e-4e4d-b681-a4300a581320 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:28.095842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe32888-083e-4e4d-b681-a4300a581320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:28.099331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe32888-083e-4e4d-b681-a4300a581320 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:28.117083 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1527/3012] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:07:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:07:28.822043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58201804-a7ba-47dd-8d6c-cb7616df9a4b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:28.822777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58201804-a7ba-47dd-8d6c-cb7616df9a4b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:28.822777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58201804-a7ba-47dd-8d6c-cb7616df9a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:28.857817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-58201804-a7ba-47dd-8d6c-cb7616df9a4b None None] MFA Rules not processed for user `8b345a42784d4df79caab6d667117418`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:28.859421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-58201804-a7ba-47dd-8d6c-cb7616df9a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:28.951493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe32888-083e-4e4d-b681-a4300a581320 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:28.993375 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1486/3013] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:07:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:07:28.999676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe32888-083e-4e4d-b681-a4300a581320 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:29.004996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d46eb-ff11-4d43-80ef-4d8f27f10362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:29.005824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d46eb-ff11-4d43-80ef-4d8f27f10362 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:29.006233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d46eb-ff11-4d43-80ef-4d8f27f10362 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:29.006612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d46eb-ff11-4d43-80ef-4d8f27f10362 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:29.007419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d46eb-ff11-4d43-80ef-4d8f27f10362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:29.009686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d46eb-ff11-4d43-80ef-4d8f27f10362 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:29.068028 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1528/3014] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:07:28 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:07:29.073683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58201804-a7ba-47dd-8d6c-cb7616df9a4b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:29.102997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58201804-a7ba-47dd-8d6c-cb7616df9a4b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:29.228160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfd8d0-75ae-4827-8445-aa2dd2bee227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:29.228948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfd8d0-75ae-4827-8445-aa2dd2bee227 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:29.229601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfd8d0-75ae-4827-8445-aa2dd2bee227 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:29.231873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfd8d0-75ae-4827-8445-aa2dd2bee227 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:29.233022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edfd8d0-75ae-4827-8445-aa2dd2bee227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:29.235174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edfd8d0-75ae-4827-8445-aa2dd2bee227 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:29.301137 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1487/3015] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:07:29 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:07:29.304935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d46eb-ff11-4d43-80ef-4d8f27f10362 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:29.329307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d46eb-ff11-4d43-80ef-4d8f27f10362 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:29.349718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c811d-92c3-4b56-80e5-fa5fe05277c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:29.350782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c811d-92c3-4b56-80e5-fa5fe05277c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:29.351317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c811d-92c3-4b56-80e5-fa5fe05277c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:29.351772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c811d-92c3-4b56-80e5-fa5fe05277c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:29.352790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c811d-92c3-4b56-80e5-fa5fe05277c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:29.355602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c811d-92c3-4b56-80e5-fa5fe05277c2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:29.373261 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1529/3016] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:07:29.378395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfd8d0-75ae-4827-8445-aa2dd2bee227 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:29.384922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:29.408348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfd8d0-75ae-4827-8445-aa2dd2bee227 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:29.420818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2671ed2-1b56-49c1-a6e1-4535324b6a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:29.428358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2671ed2-1b56-49c1-a6e1-4535324b6a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:29.428358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2671ed2-1b56-49c1-a6e1-4535324b6a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:29.428718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2671ed2-1b56-49c1-a6e1-4535324b6a19 admin admin] PATH_INFO: `/v3/projects/e46aa206719140e7a508bab446fe1d59/users/8eef55086fdc488fbe5327d75bc6d949/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:29.490916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2671ed2-1b56-49c1-a6e1-4535324b6a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46aa206719140e7a508bab446fe1d59, user_id=8eef55086fdc488fbe5327d75bc6d949, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:29.494528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2671ed2-1b56-49c1-a6e1-4535324b6a19 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:29.545794 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1488/3017] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:07:29 2022] PUT /identity/v3/projects/e46aa206719140e7a508bab446fe1d59/users/8eef55086fdc488fbe5327d75bc6d949/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:07:29.547424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c811d-92c3-4b56-80e5-fa5fe05277c2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:29.583469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c811d-92c3-4b56-80e5-fa5fe05277c2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:29.724424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e0128-993a-490a-8908-424cc3e6bfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:29.725501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e0128-993a-490a-8908-424cc3e6bfba admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:29.726385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e0128-993a-490a-8908-424cc3e6bfba admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:29.727019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e0128-993a-490a-8908-424cc3e6bfba admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:29.728701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e0128-993a-490a-8908-424cc3e6bfba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:29.730921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e0128-993a-490a-8908-424cc3e6bfba admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:29.790711 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1530/3018] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:07:29.794461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2671ed2-1b56-49c1-a6e1-4535324b6a19 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:29.811260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2671ed2-1b56-49c1-a6e1-4535324b6a19 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:29.823457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0d4f0-9014-4cf1-9f88-f36010c2be7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:29.824777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0d4f0-9014-4cf1-9f88-f36010c2be7e admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:29.825169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0d4f0-9014-4cf1-9f88-f36010c2be7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:29.825560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0d4f0-9014-4cf1-9f88-f36010c2be7e admin admin] PATH_INFO: `/v3/projects/e46aa206719140e7a508bab446fe1d59/users/8eef55086fdc488fbe5327d75bc6d949/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:29.834000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0d4f0-9014-4cf1-9f88-f36010c2be7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46aa206719140e7a508bab446fe1d59, user_id=8eef55086fdc488fbe5327d75bc6d949, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:29.837964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0d4f0-9014-4cf1-9f88-f36010c2be7e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:29.861639 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1489/3019] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:07:29 2022] PUT /identity/v3/projects/e46aa206719140e7a508bab446fe1d59/users/8eef55086fdc488fbe5327d75bc6d949/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:07:30.957908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942e982-d1f6-453d-9632-9068d25c55ce None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:30.959253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942e982-d1f6-453d-9632-9068d25c55ce None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:30.960163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942e982-d1f6-453d-9632-9068d25c55ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:30.996845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f942e982-d1f6-453d-9632-9068d25c55ce None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:31.001158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f942e982-d1f6-453d-9632-9068d25c55ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:31.016450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:31.171569 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1531/3020] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:07:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:07:31.187212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0d4f0-9014-4cf1-9f88-f36010c2be7e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:31.189539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-32d0d4f0-9014-4cf1-9f88-f36010c2be7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:31.327414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0d4f0-9014-4cf1-9f88-f36010c2be7e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:31.334291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2629e43-0766-4f6c-8324-b6766cf5e6e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:31.335275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2629e43-0766-4f6c-8324-b6766cf5e6e0 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:31.335706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2629e43-0766-4f6c-8324-b6766cf5e6e0 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:31.336190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2629e43-0766-4f6c-8324-b6766cf5e6e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:31.374736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2629e43-0766-4f6c-8324-b6766cf5e6e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:31.387301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2629e43-0766-4f6c-8324-b6766cf5e6e0 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:31.412642 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1490/3021] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:07:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:07:34.774293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ff774-604e-458f-aff8-e7007e538603 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:34.774293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ff774-604e-458f-aff8-e7007e538603 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:34.774293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ff774-604e-458f-aff8-e7007e538603 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:34.775465 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1532/3022] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:07:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:07:34.793932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb0f2d-6dbd-4e5d-a8b9-ff8fe7ada97c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:34.794509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb0f2d-6dbd-4e5d-a8b9-ff8fe7ada97c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:34.794620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb0f2d-6dbd-4e5d-a8b9-ff8fe7ada97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:34.834665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a7eb0f2d-6dbd-4e5d-a8b9-ff8fe7ada97c None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:34.837222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a7eb0f2d-6dbd-4e5d-a8b9-ff8fe7ada97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:34.979566 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1491/3023] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:07:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:07:35.015710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ff774-604e-458f-aff8-e7007e538603 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:35.018199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-270ff774-604e-458f-aff8-e7007e538603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:35.049199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ff774-604e-458f-aff8-e7007e538603 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:35.076389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab552ea3-40e8-4cd0-bb5e-27ab0173af0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:35.080661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab552ea3-40e8-4cd0-bb5e-27ab0173af0b service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:35.081440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab552ea3-40e8-4cd0-bb5e-27ab0173af0b service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:35.082138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab552ea3-40e8-4cd0-bb5e-27ab0173af0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:35.120113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab552ea3-40e8-4cd0-bb5e-27ab0173af0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:35.124875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab552ea3-40e8-4cd0-bb5e-27ab0173af0b service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:35.196447 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1533/3024] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:07:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:07:37.230991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aff859-ead5-4636-b46d-cd99b2103c69 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:37.231516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aff859-ead5-4636-b46d-cd99b2103c69 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:37.231640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aff859-ead5-4636-b46d-cd99b2103c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:37.267564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-88aff859-ead5-4636-b46d-cd99b2103c69 None None] MFA Rules not processed for user `3fefe83ec0664f6188af74ea4b5c1291`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:37.275810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-88aff859-ead5-4636-b46d-cd99b2103c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:37.417865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:37.454755 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1492/3025] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:07:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:07:38.304124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab552ea3-40e8-4cd0-bb5e-27ab0173af0b service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:38.419998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab552ea3-40e8-4cd0-bb5e-27ab0173af0b service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:38.445412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23232be3-c8fc-4bd9-9070-3a07f73550e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:38.453194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23232be3-c8fc-4bd9-9070-3a07f73550e1 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:38.460679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23232be3-c8fc-4bd9-9070-3a07f73550e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:38.461950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23232be3-c8fc-4bd9-9070-3a07f73550e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:38.468283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-23232be3-c8fc-4bd9-9070-3a07f73550e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:38.494732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23232be3-c8fc-4bd9-9070-3a07f73550e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:38.499338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23232be3-c8fc-4bd9-9070-3a07f73550e1 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:38.529908 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1534/3026] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:07:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:07:41.599970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76334a-a1d3-415d-acdc-1f496f225430 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:41.600773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76334a-a1d3-415d-acdc-1f496f225430 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:41.600773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76334a-a1d3-415d-acdc-1f496f225430 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:41.602617 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1493/3027] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:07:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:07:41.637529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff9ea2-2c0a-4ac6-a3d4-30505b33fa9c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:41.638480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff9ea2-2c0a-4ac6-a3d4-30505b33fa9c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:41.638922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff9ea2-2c0a-4ac6-a3d4-30505b33fa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:41.661259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3eff9ea2-2c0a-4ac6-a3d4-30505b33fa9c None None] MFA Rules not processed for user `684732cf5a004fb084ce0e523398c970`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:41.662869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3eff9ea2-2c0a-4ac6-a3d4-30505b33fa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:41.680363 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1535/3028] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:07:42.047759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76334a-a1d3-415d-acdc-1f496f225430 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:42.049861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-db76334a-a1d3-415d-acdc-1f496f225430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:42.095566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76334a-a1d3-415d-acdc-1f496f225430 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:42.111835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f637f-04f9-4b28-bafe-cdeac74be30b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:42.113214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f637f-04f9-4b28-bafe-cdeac74be30b service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:42.125009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f637f-04f9-4b28-bafe-cdeac74be30b service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:42.136240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f637f-04f9-4b28-bafe-cdeac74be30b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:42.160990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f637f-04f9-4b28-bafe-cdeac74be30b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:42.166560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f637f-04f9-4b28-bafe-cdeac74be30b service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:42.198353 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1494/3029] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:07:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:07:44.539043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e59699-000b-4684-9e6c-c0bb049a9a24 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:44.539540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e59699-000b-4684-9e6c-c0bb049a9a24 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:44.539640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e59699-000b-4684-9e6c-c0bb049a9a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:44.579107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-71e59699-000b-4684-9e6c-c0bb049a9a24 None None] MFA Rules not processed for user `8eef55086fdc488fbe5327d75bc6d949`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:44.581176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-71e59699-000b-4684-9e6c-c0bb049a9a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:44.668306 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1536/3030] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:07:44.682151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe010d-36b1-4368-8485-66732b9072ad None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:44.684419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe010d-36b1-4368-8485-66732b9072ad None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:44.684938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe010d-36b1-4368-8485-66732b9072ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:44.715502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5dfe010d-36b1-4368-8485-66732b9072ad None None] MFA Rules not processed for user `8b345a42784d4df79caab6d667117418`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:44.718485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5dfe010d-36b1-4368-8485-66732b9072ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:44.833761 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1495/3031] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:07:44.846495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e59699-000b-4684-9e6c-c0bb049a9a24 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:44.904589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:44.993995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e59699-000b-4684-9e6c-c0bb049a9a24 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:45.019938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb977615-feae-4b51-b546-9c102e3511e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:45.020652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb977615-feae-4b51-b546-9c102e3511e7 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:45.020926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb977615-feae-4b51-b546-9c102e3511e7 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:45.022102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb977615-feae-4b51-b546-9c102e3511e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:45.041805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb977615-feae-4b51-b546-9c102e3511e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:45.043753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb977615-feae-4b51-b546-9c102e3511e7 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:45.054428 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1537/3032] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:07:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:07:46.577448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe010d-36b1-4368-8485-66732b9072ad None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:46.597488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe010d-36b1-4368-8485-66732b9072ad None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:46.613960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6057ec-6213-4722-b682-2ca5db57f895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:46.614635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6057ec-6213-4722-b682-2ca5db57f895 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:46.615134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6057ec-6213-4722-b682-2ca5db57f895 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:46.615567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6057ec-6213-4722-b682-2ca5db57f895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:46.620183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4c6057ec-6213-4722-b682-2ca5db57f895 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:46.808203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6057ec-6213-4722-b682-2ca5db57f895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:46.815984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6057ec-6213-4722-b682-2ca5db57f895 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:46.834364 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1496/3033] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:07:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:07:52.741941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73ebd7-b095-4251-8819-0650e219b345 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:52.742782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73ebd7-b095-4251-8819-0650e219b345 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:52.743219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73ebd7-b095-4251-8819-0650e219b345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:52.768602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7a73ebd7-b095-4251-8819-0650e219b345 None None] MFA Rules not processed for user `27059ad6d23e4faf8f09c22cf6ee1475`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:52.769829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7a73ebd7-b095-4251-8819-0650e219b345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:52.834846 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1538/3034] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:07:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:07:56.150405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6057ec-6213-4722-b682-2ca5db57f895 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:56.152522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4c6057ec-6213-4722-b682-2ca5db57f895 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:56.326041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6057ec-6213-4722-b682-2ca5db57f895 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:56.349090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eeeb8-95db-476d-a072-50eb9aad83f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:56.350233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eeeb8-95db-476d-a072-50eb9aad83f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:56.353842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eeeb8-95db-476d-a072-50eb9aad83f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:56.354155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eeeb8-95db-476d-a072-50eb9aad83f0 admin admin] PATH_INFO: `/v3/users/592e8c2ad31f459fa0b37f219cc4f84c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:56.360064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eeeb8-95db-476d-a072-50eb9aad83f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=592e8c2ad31f459fa0b37f219cc4f84c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:56.362103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eeeb8-95db-476d-a072-50eb9aad83f0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:56.396239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:56.459999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-276eeeb8-95db-476d-a072-50eb9aad83f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '592e8c2ad31f459fa0b37f219cc4f84c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:56.474390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-276eeeb8-95db-476d-a072-50eb9aad83f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '592e8c2ad31f459fa0b37f219cc4f84c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:56.486585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-276eeeb8-95db-476d-a072-50eb9aad83f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '592e8c2ad31f459fa0b37f219cc4f84c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:56.487763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-276eeeb8-95db-476d-a072-50eb9aad83f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '592e8c2ad31f459fa0b37f219cc4f84c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:56.488699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-276eeeb8-95db-476d-a072-50eb9aad83f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '592e8c2ad31f459fa0b37f219cc4f84c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:56.545392 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1497/3035] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:07:56 2022] DELETE /identity/v3/users/592e8c2ad31f459fa0b37f219cc4f84c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:07:56.550104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e8a5c-8555-4561-b848-f1d92aea2101 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:56.550594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e8a5c-8555-4561-b848-f1d92aea2101 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:56.550716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e8a5c-8555-4561-b848-f1d92aea2101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:56.575210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-495e8a5c-8555-4561-b848-f1d92aea2101 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:56.576602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-495e8a5c-8555-4561-b848-f1d92aea2101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:56.648554 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1539/3036] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:07:56.658095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eeeb8-95db-476d-a072-50eb9aad83f0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:56.659498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-276eeeb8-95db-476d-a072-50eb9aad83f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:56.763024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eeeb8-95db-476d-a072-50eb9aad83f0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:56.770302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda3088-f0d5-408a-adcc-a615e024f662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:56.776390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda3088-f0d5-408a-adcc-a615e024f662 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:56.777134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda3088-f0d5-408a-adcc-a615e024f662 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:56.777642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda3088-f0d5-408a-adcc-a615e024f662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:56.793584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda3088-f0d5-408a-adcc-a615e024f662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:56.796310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda3088-f0d5-408a-adcc-a615e024f662 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:56.813257 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1498/3037] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:07:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:07:58.376811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e8a5c-8555-4561-b848-f1d92aea2101 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:58.378848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-495e8a5c-8555-4561-b848-f1d92aea2101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:58.398917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e8a5c-8555-4561-b848-f1d92aea2101 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:58.404746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39e6b4-e307-4687-98db-d10f42e35dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:58.406180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39e6b4-e307-4687-98db-d10f42e35dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:58.406723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39e6b4-e307-4687-98db-d10f42e35dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:58.408232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39e6b4-e307-4687-98db-d10f42e35dc8 admin admin] PATH_INFO: `/v3/projects/63f39c85f12c4ad58be6d786de9a584b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:58.431733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39e6b4-e307-4687-98db-d10f42e35dc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f39c85f12c4ad58be6d786de9a584b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:58.450120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39e6b4-e307-4687-98db-d10f42e35dc8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:58.518349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4e39e6b4-e307-4687-98db-d10f42e35dc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f39c85f12c4ad58be6d786de9a584b', 'request_id': 'req-4e39e6b4-e307-4687-98db-d10f42e35dc8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:58.521855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:58.545318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4e39e6b4-e307-4687-98db-d10f42e35dc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f39c85f12c4ad58be6d786de9a584b', 'request_id': 'req-4e39e6b4-e307-4687-98db-d10f42e35dc8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:58.552988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4e39e6b4-e307-4687-98db-d10f42e35dc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f39c85f12c4ad58be6d786de9a584b', 'request_id': 'req-4e39e6b4-e307-4687-98db-d10f42e35dc8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:58.566487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4e39e6b4-e307-4687-98db-d10f42e35dc8 admin admin] The token cache is being invalidate because project 63f39c85f12c4ad58be6d786de9a584b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:07:58.566782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4e39e6b4-e307-4687-98db-d10f42e35dc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:58.567945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4e39e6b4-e307-4687-98db-d10f42e35dc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:58.573534 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1540/3038] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:07:58 2022] DELETE /identity/v3/projects/63f39c85f12c4ad58be6d786de9a584b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:07:58.574507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda3088-f0d5-408a-adcc-a615e024f662 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:58.591758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda3088-f0d5-408a-adcc-a615e024f662 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:58.682868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153df5c4-e21f-432b-a53d-5e476c6ec408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:58.685200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153df5c4-e21f-432b-a53d-5e476c6ec408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:58.686499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153df5c4-e21f-432b-a53d-5e476c6ec408 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:58.687316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153df5c4-e21f-432b-a53d-5e476c6ec408 admin admin] PATH_INFO: `/v3/users/1068ef10c5ca46619e6280360e5a0930` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:58.690447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153df5c4-e21f-432b-a53d-5e476c6ec408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1068ef10c5ca46619e6280360e5a0930)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:58.693609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153df5c4-e21f-432b-a53d-5e476c6ec408 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:58.757034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:58.759303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-153df5c4-e21f-432b-a53d-5e476c6ec408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1068ef10c5ca46619e6280360e5a0930'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:58.769183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-153df5c4-e21f-432b-a53d-5e476c6ec408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1068ef10c5ca46619e6280360e5a0930'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:58.777968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-153df5c4-e21f-432b-a53d-5e476c6ec408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1068ef10c5ca46619e6280360e5a0930'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:58.778651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-153df5c4-e21f-432b-a53d-5e476c6ec408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1068ef10c5ca46619e6280360e5a0930'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:58.779273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-153df5c4-e21f-432b-a53d-5e476c6ec408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1068ef10c5ca46619e6280360e5a0930'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:58.806660 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1499/3039] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:07:58 2022] DELETE /identity/v3/users/1068ef10c5ca46619e6280360e5a0930 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:07:59.496073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39e6b4-e307-4687-98db-d10f42e35dc8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:59.497777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4e39e6b4-e307-4687-98db-d10f42e35dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:59.518777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39e6b4-e307-4687-98db-d10f42e35dc8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:59.653700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c80ea-8cac-4008-bc01-57ead28be141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:59.654941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c80ea-8cac-4008-bc01-57ead28be141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:59.655451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c80ea-8cac-4008-bc01-57ead28be141 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:59.655938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c80ea-8cac-4008-bc01-57ead28be141 admin admin] PATH_INFO: `/v3/projects/9aacdf1893ae44e383bfc224b1e78784` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:59.657981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c80ea-8cac-4008-bc01-57ead28be141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aacdf1893ae44e383bfc224b1e78784)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:59.660067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c80ea-8cac-4008-bc01-57ead28be141 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:07:59.714500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a05c80ea-8cac-4008-bc01-57ead28be141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aacdf1893ae44e383bfc224b1e78784', 'request_id': 'req-a05c80ea-8cac-4008-bc01-57ead28be141'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:59.735444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a05c80ea-8cac-4008-bc01-57ead28be141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aacdf1893ae44e383bfc224b1e78784', 'request_id': 'req-a05c80ea-8cac-4008-bc01-57ead28be141'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:59.735444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a05c80ea-8cac-4008-bc01-57ead28be141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aacdf1893ae44e383bfc224b1e78784', 'request_id': 'req-a05c80ea-8cac-4008-bc01-57ead28be141'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:59.749320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a05c80ea-8cac-4008-bc01-57ead28be141 admin admin] The token cache is being invalidate because project 9aacdf1893ae44e383bfc224b1e78784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:07:59.749609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a05c80ea-8cac-4008-bc01-57ead28be141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:59.750490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a05c80ea-8cac-4008-bc01-57ead28be141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:07:59.752397 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1541/3040] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:07:59 2022] DELETE /identity/v3/projects/9aacdf1893ae44e383bfc224b1e78784 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:07:59.757468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76c099-7cd7-48c7-af7b-9931c86fd4c0 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:59.758514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76c099-7cd7-48c7-af7b-9931c86fd4c0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:59.759085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76c099-7cd7-48c7-af7b-9931c86fd4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:59.782604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8d76c099-7cd7-48c7-af7b-9931c86fd4c0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:59.784944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8d76c099-7cd7-48c7-af7b-9931c86fd4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:59.895645 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1500/3041] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:07:59.903620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0ef77-e9de-4966-a647-6549d1afcca9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:59.904292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0ef77-e9de-4966-a647-6549d1afcca9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:59.904820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0ef77-e9de-4966-a647-6549d1afcca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:59.927699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-43b0ef77-e9de-4966-a647-6549d1afcca9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:07:59.931122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-43b0ef77-e9de-4966-a647-6549d1afcca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:07:59.944754 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1542/3042] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:07:59.946608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76c099-7cd7-48c7-af7b-9931c86fd4c0 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:07:59.957672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76c099-7cd7-48c7-af7b-9931c86fd4c0 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:07:59.966098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b0415-4f93-4d34-bb18-cc9964c96a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:07:59.966792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b0415-4f93-4d34-bb18-cc9964c96a8b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:07:59.967074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b0415-4f93-4d34-bb18-cc9964c96a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:07:59.968101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b0415-4f93-4d34-bb18-cc9964c96a8b admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:07:59.968312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b0415-4f93-4d34-bb18-cc9964c96a8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:07:59.968623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b0415-4f93-4d34-bb18-cc9964c96a8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:07:59.970996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b0415-4f93-4d34-bb18-cc9964c96a8b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:00.024227 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1501/3043] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:08:00.027585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0ef77-e9de-4966-a647-6549d1afcca9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:00.048921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0ef77-e9de-4966-a647-6549d1afcca9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:00.059927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787ff9a-2457-4e7f-8ea1-090cc24dea0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:00.060654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787ff9a-2457-4e7f-8ea1-090cc24dea0e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:00.060945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787ff9a-2457-4e7f-8ea1-090cc24dea0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:00.061215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787ff9a-2457-4e7f-8ea1-090cc24dea0e admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:00.061915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787ff9a-2457-4e7f-8ea1-090cc24dea0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:00.069352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787ff9a-2457-4e7f-8ea1-090cc24dea0e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:00.126167 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1543/3044] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:08:00 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:08:00.126463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b0415-4f93-4d34-bb18-cc9964c96a8b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:00.139635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b0415-4f93-4d34-bb18-cc9964c96a8b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:00.237324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eab502-9911-45de-b4d1-4a43362cad4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:00.237324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eab502-9911-45de-b4d1-4a43362cad4b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:00.237612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eab502-9911-45de-b4d1-4a43362cad4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:00.237707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eab502-9911-45de-b4d1-4a43362cad4b admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:00.238552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eab502-9911-45de-b4d1-4a43362cad4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:00.240568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eab502-9911-45de-b4d1-4a43362cad4b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:00.277661 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1502/3045] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:08:00 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:08:00.281855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787ff9a-2457-4e7f-8ea1-090cc24dea0e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:00.296309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787ff9a-2457-4e7f-8ea1-090cc24dea0e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:00.302325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2e9ab-d7d5-44bb-b48e-a0f3f7d25dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:00.303023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2e9ab-d7d5-44bb-b48e-a0f3f7d25dec admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:00.303317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2e9ab-d7d5-44bb-b48e-a0f3f7d25dec admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:00.303574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2e9ab-d7d5-44bb-b48e-a0f3f7d25dec admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:00.304333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2e9ab-d7d5-44bb-b48e-a0f3f7d25dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:00.305970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2e9ab-d7d5-44bb-b48e-a0f3f7d25dec admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:00.336101 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1544/3046] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:00.340158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eab502-9911-45de-b4d1-4a43362cad4b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:00.351092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eab502-9911-45de-b4d1-4a43362cad4b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:00.366227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481aab52-5040-45b4-9ed6-a2508884cb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:00.367426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481aab52-5040-45b4-9ed6-a2508884cb2b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:00.367918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481aab52-5040-45b4-9ed6-a2508884cb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:00.368183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481aab52-5040-45b4-9ed6-a2508884cb2b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:00.369400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481aab52-5040-45b4-9ed6-a2508884cb2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:00.371469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481aab52-5040-45b4-9ed6-a2508884cb2b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:00.391669 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1503/3047] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:00.393160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2e9ab-d7d5-44bb-b48e-a0f3f7d25dec admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:00.417059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2e9ab-d7d5-44bb-b48e-a0f3f7d25dec admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:00.424636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103d66f-32e2-40cc-8f27-ba1e02d0e615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:00.425916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103d66f-32e2-40cc-8f27-ba1e02d0e615 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:00.426409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103d66f-32e2-40cc-8f27-ba1e02d0e615 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:00.426843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103d66f-32e2-40cc-8f27-ba1e02d0e615 admin admin] PATH_INFO: `/v3/projects/477d4dfce990427eb548507a83c56683/users/536a0ef34839420f9c75af7a39392bb9/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:00.455817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103d66f-32e2-40cc-8f27-ba1e02d0e615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=477d4dfce990427eb548507a83c56683, user_id=536a0ef34839420f9c75af7a39392bb9, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:00.458621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103d66f-32e2-40cc-8f27-ba1e02d0e615 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:00.496466 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1545/3048] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:08:00 2022] PUT /identity/v3/projects/477d4dfce990427eb548507a83c56683/users/536a0ef34839420f9c75af7a39392bb9/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:00.508418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e5481-dc1f-4838-98dd-85f13a13f80e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:00.508714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e5481-dc1f-4838-98dd-85f13a13f80e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:00.509024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e5481-dc1f-4838-98dd-85f13a13f80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:00.549676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-149e5481-dc1f-4838-98dd-85f13a13f80e None None] MFA Rules not processed for user `536a0ef34839420f9c75af7a39392bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:00.551406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-149e5481-dc1f-4838-98dd-85f13a13f80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:00.576186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:00.676087 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1504/3049] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:00.679192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103d66f-32e2-40cc-8f27-ba1e02d0e615 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:00.686408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:00.763998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103d66f-32e2-40cc-8f27-ba1e02d0e615 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:00.769701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f474c62-25e0-453b-b2c2-ff0c567a0268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:00.770384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f474c62-25e0-453b-b2c2-ff0c567a0268 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:00.770769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f474c62-25e0-453b-b2c2-ff0c567a0268 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:00.771056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f474c62-25e0-453b-b2c2-ff0c567a0268 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:00.772199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f474c62-25e0-453b-b2c2-ff0c567a0268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:00.774396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f474c62-25e0-453b-b2c2-ff0c567a0268 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:00.818033 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1546/3050] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:08:00 2022] POST /identity/v3/projects => generated 391 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:08:00.819151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e5481-dc1f-4838-98dd-85f13a13f80e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:00.833331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e5481-dc1f-4838-98dd-85f13a13f80e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:00.961710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4d4ca-38e5-41cb-9bde-8a99d2054f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:00.962429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4d4ca-38e5-41cb-9bde-8a99d2054f47 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:00.962710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4d4ca-38e5-41cb-9bde-8a99d2054f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:00.962981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4d4ca-38e5-41cb-9bde-8a99d2054f47 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:00.964741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4d4ca-38e5-41cb-9bde-8a99d2054f47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:00.967426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4d4ca-38e5-41cb-9bde-8a99d2054f47 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:01.000083 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1505/3051] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:08:00 2022] POST /identity/v3/users => generated 302 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:08:01.003306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f474c62-25e0-453b-b2c2-ff0c567a0268 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:01.021287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f474c62-25e0-453b-b2c2-ff0c567a0268 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:01.033887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136afd37-4a12-49d6-8d58-bfd45403cddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:01.034671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136afd37-4a12-49d6-8d58-bfd45403cddf admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:01.035596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136afd37-4a12-49d6-8d58-bfd45403cddf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:01.035596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136afd37-4a12-49d6-8d58-bfd45403cddf admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:01.036179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136afd37-4a12-49d6-8d58-bfd45403cddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:01.038274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136afd37-4a12-49d6-8d58-bfd45403cddf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:01.066404 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1547/3052] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:01.069478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4d4ca-38e5-41cb-9bde-8a99d2054f47 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:01.086655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4d4ca-38e5-41cb-9bde-8a99d2054f47 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:01.096549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a3603-663f-4ccd-b61a-30a428354a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:01.097663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a3603-663f-4ccd-b61a-30a428354a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:01.098109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a3603-663f-4ccd-b61a-30a428354a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:01.098935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a3603-663f-4ccd-b61a-30a428354a6c admin admin] PATH_INFO: `/v3/projects/2377ea6a920040129181573f1b7abeb8/users/34a8e26bb501492fbef9ebf861740362/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:01.126312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a3603-663f-4ccd-b61a-30a428354a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2377ea6a920040129181573f1b7abeb8, user_id=34a8e26bb501492fbef9ebf861740362, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:01.129575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a3603-663f-4ccd-b61a-30a428354a6c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:01.147284 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1506/3053] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:08:01 2022] PUT /identity/v3/projects/2377ea6a920040129181573f1b7abeb8/users/34a8e26bb501492fbef9ebf861740362/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:01.151384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136afd37-4a12-49d6-8d58-bfd45403cddf admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:01.165426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136afd37-4a12-49d6-8d58-bfd45403cddf admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:01.248563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd55bb-b9f3-46d0-902f-dde4e0ea6185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:01.249559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd55bb-b9f3-46d0-902f-dde4e0ea6185 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:01.250019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd55bb-b9f3-46d0-902f-dde4e0ea6185 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:01.250456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd55bb-b9f3-46d0-902f-dde4e0ea6185 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:01.251417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd55bb-b9f3-46d0-902f-dde4e0ea6185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:01.253480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd55bb-b9f3-46d0-902f-dde4e0ea6185 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:01.268298 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1548/3054] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:01.269027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a3603-663f-4ccd-b61a-30a428354a6c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:01.283565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a3603-663f-4ccd-b61a-30a428354a6c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:01.290628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b80d4c-5822-4313-92a7-08593564ea3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:01.291687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b80d4c-5822-4313-92a7-08593564ea3a admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:01.291687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b80d4c-5822-4313-92a7-08593564ea3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:01.294420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b80d4c-5822-4313-92a7-08593564ea3a admin admin] PATH_INFO: `/v3/projects/2377ea6a920040129181573f1b7abeb8/users/34a8e26bb501492fbef9ebf861740362/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:01.296924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b80d4c-5822-4313-92a7-08593564ea3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2377ea6a920040129181573f1b7abeb8, user_id=34a8e26bb501492fbef9ebf861740362, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:01.300463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b80d4c-5822-4313-92a7-08593564ea3a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:01.315584 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1507/3055] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:08:01 2022] PUT /identity/v3/projects/2377ea6a920040129181573f1b7abeb8/users/34a8e26bb501492fbef9ebf861740362/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:08:01.327098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3426dc3-6264-4e42-8bcb-8af31e63af50 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:01.327295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3426dc3-6264-4e42-8bcb-8af31e63af50 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:01.327884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3426dc3-6264-4e42-8bcb-8af31e63af50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:01.362274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d3426dc3-6264-4e42-8bcb-8af31e63af50 None None] MFA Rules not processed for user `34a8e26bb501492fbef9ebf861740362`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:01.363555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d3426dc3-6264-4e42-8bcb-8af31e63af50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:01.466897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:01.475739 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1549/3056] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:01.484938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b80d4c-5822-4313-92a7-08593564ea3a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:01.488753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-82b80d4c-5822-4313-92a7-08593564ea3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:01.580822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b80d4c-5822-4313-92a7-08593564ea3a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:01.586928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b597e9-0466-473d-b69e-28bcfe36af71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:01.587598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b597e9-0466-473d-b69e-28bcfe36af71 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:01.587885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b597e9-0466-473d-b69e-28bcfe36af71 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:01.588191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b597e9-0466-473d-b69e-28bcfe36af71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:01.595722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:01.658011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b597e9-0466-473d-b69e-28bcfe36af71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:01.659993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b597e9-0466-473d-b69e-28bcfe36af71 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:01.684299 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1508/3057] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:02.432711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3426dc3-6264-4e42-8bcb-8af31e63af50 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:02.446358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3426dc3-6264-4e42-8bcb-8af31e63af50 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:02.451765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1b9f4-d704-4476-a9c1-7fac9ddcff9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:02.452441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1b9f4-d704-4476-a9c1-7fac9ddcff9b service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:02.452716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1b9f4-d704-4476-a9c1-7fac9ddcff9b service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:02.452987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1b9f4-d704-4476-a9c1-7fac9ddcff9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:02.461273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1b9f4-d704-4476-a9c1-7fac9ddcff9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:02.462883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1b9f4-d704-4476-a9c1-7fac9ddcff9b service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:02.472686 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1550/3058] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:05.313712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b597e9-0466-473d-b69e-28bcfe36af71 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:05.315541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-73b597e9-0466-473d-b69e-28bcfe36af71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:05.409673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b597e9-0466-473d-b69e-28bcfe36af71 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:05.424570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb034e3-873e-42ec-9ebc-5e5c5b3584d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:05.425380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb034e3-873e-42ec-9ebc-5e5c5b3584d8 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:05.425770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb034e3-873e-42ec-9ebc-5e5c5b3584d8 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:05.426617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb034e3-873e-42ec-9ebc-5e5c5b3584d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:05.428781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2bb034e3-873e-42ec-9ebc-5e5c5b3584d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:05.447165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb034e3-873e-42ec-9ebc-5e5c5b3584d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:05.449318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb034e3-873e-42ec-9ebc-5e5c5b3584d8 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:05.461517 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1509/3059] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:05.522977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1b9f4-d704-4476-a9c1-7fac9ddcff9b service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:05.524512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9ba1b9f4-d704-4476-a9c1-7fac9ddcff9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:05.540460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1b9f4-d704-4476-a9c1-7fac9ddcff9b service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:05.547596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383cf3a-8123-4269-94e2-f54091d931e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:05.548706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383cf3a-8123-4269-94e2-f54091d931e8 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:05.549185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383cf3a-8123-4269-94e2-f54091d931e8 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:05.549664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383cf3a-8123-4269-94e2-f54091d931e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:05.552583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c383cf3a-8123-4269-94e2-f54091d931e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:05.645347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383cf3a-8123-4269-94e2-f54091d931e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:05.647887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383cf3a-8123-4269-94e2-f54091d931e8 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:05.659965 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1551/3060] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:05 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:06.978887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74cf9a-1ba2-4847-84a0-5e40c859d567 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:06.979431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74cf9a-1ba2-4847-84a0-5e40c859d567 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:06.979431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74cf9a-1ba2-4847-84a0-5e40c859d567 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:06.982853 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1510/3061] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:08:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:08:06.986755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af229cf-29d2-4c06-93ed-8d33083b9bff None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:06.987779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af229cf-29d2-4c06-93ed-8d33083b9bff None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:06.988364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af229cf-29d2-4c06-93ed-8d33083b9bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:07.025082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0af229cf-29d2-4c06-93ed-8d33083b9bff None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:07.027449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0af229cf-29d2-4c06-93ed-8d33083b9bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:07.036967 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1552/3062] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:07.060465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74cf9a-1ba2-4847-84a0-5e40c859d567 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:07.063067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ba74cf9a-1ba2-4847-84a0-5e40c859d567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:07.090030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74cf9a-1ba2-4847-84a0-5e40c859d567 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:07.095818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff3b6c-dd3c-4374-a08f-9588b6a10a09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:07.096536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3b6c-dd3c-4374-a08f-9588b6a10a09 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:07.096818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3b6c-dd3c-4374-a08f-9588b6a10a09 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:07.097120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3b6c-dd3c-4374-a08f-9588b6a10a09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:07.107550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff3b6c-dd3c-4374-a08f-9588b6a10a09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:07.109906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff3b6c-dd3c-4374-a08f-9588b6a10a09 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:07.122720 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1511/3063] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:07.380280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af229cf-29d2-4c06-93ed-8d33083b9bff None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:07.396216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af229cf-29d2-4c06-93ed-8d33083b9bff None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:07.406339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c921b5-dd87-433b-a216-0818e3dcbb4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:07.407586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c921b5-dd87-433b-a216-0818e3dcbb4a service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:07.408169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c921b5-dd87-433b-a216-0818e3dcbb4a service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:07.408626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c921b5-dd87-433b-a216-0818e3dcbb4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:07.412948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-88c921b5-dd87-433b-a216-0818e3dcbb4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:07.428480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c921b5-dd87-433b-a216-0818e3dcbb4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:07.430372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c921b5-dd87-433b-a216-0818e3dcbb4a service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:07.444073 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1553/3064] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:07.833827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff3b6c-dd3c-4374-a08f-9588b6a10a09 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:07.935435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff3b6c-dd3c-4374-a08f-9588b6a10a09 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:07.942181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1362a6-ae1a-46c9-9cea-3df91cfdadd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:07.944139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1362a6-ae1a-46c9-9cea-3df91cfdadd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:07.944509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1362a6-ae1a-46c9-9cea-3df91cfdadd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:07.944786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1362a6-ae1a-46c9-9cea-3df91cfdadd7 admin admin] PATH_INFO: `/v3/users/536a0ef34839420f9c75af7a39392bb9` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:07.946106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1362a6-ae1a-46c9-9cea-3df91cfdadd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=536a0ef34839420f9c75af7a39392bb9)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:07.949403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1362a6-ae1a-46c9-9cea-3df91cfdadd7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:07.993103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:08.025752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ae1362a6-ae1a-46c9-9cea-3df91cfdadd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536a0ef34839420f9c75af7a39392bb9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:08.036707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ae1362a6-ae1a-46c9-9cea-3df91cfdadd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536a0ef34839420f9c75af7a39392bb9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:08.048285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ae1362a6-ae1a-46c9-9cea-3df91cfdadd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536a0ef34839420f9c75af7a39392bb9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:08.050320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ae1362a6-ae1a-46c9-9cea-3df91cfdadd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536a0ef34839420f9c75af7a39392bb9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:08.051233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ae1362a6-ae1a-46c9-9cea-3df91cfdadd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536a0ef34839420f9c75af7a39392bb9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:08.095618 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1512/3065] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:08:07 2022] DELETE /identity/v3/users/536a0ef34839420f9c75af7a39392bb9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:08.102957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aafac-59a1-4243-ba22-041e63b18d71 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:08.103390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aafac-59a1-4243-ba22-041e63b18d71 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:08.103499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aafac-59a1-4243-ba22-041e63b18d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:08.151790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1b1aafac-59a1-4243-ba22-041e63b18d71 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:08.153095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1b1aafac-59a1-4243-ba22-041e63b18d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:08.251332 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1554/3066] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:08.260234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1362a6-ae1a-46c9-9cea-3df91cfdadd7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:08.265706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ae1362a6-ae1a-46c9-9cea-3df91cfdadd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:08.342721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1362a6-ae1a-46c9-9cea-3df91cfdadd7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:08.347064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573b5f5-92f5-4b86-9c21-e9676c492849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:08.347723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573b5f5-92f5-4b86-9c21-e9676c492849 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:08.348004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573b5f5-92f5-4b86-9c21-e9676c492849 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:08.348308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573b5f5-92f5-4b86-9c21-e9676c492849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:08.358381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573b5f5-92f5-4b86-9c21-e9676c492849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:08.359472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573b5f5-92f5-4b86-9c21-e9676c492849 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:08.370765 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1513/3067] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:08.877961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1aafac-59a1-4243-ba22-041e63b18d71 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:08.879407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1b1aafac-59a1-4243-ba22-041e63b18d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:08.891819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1aafac-59a1-4243-ba22-041e63b18d71 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:08.896489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4aed8c-5e8d-4a2f-a406-f82ffe7bc1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:08.897352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4aed8c-5e8d-4a2f-a406-f82ffe7bc1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:08.897631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4aed8c-5e8d-4a2f-a406-f82ffe7bc1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:08.898037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4aed8c-5e8d-4a2f-a406-f82ffe7bc1b9 admin admin] PATH_INFO: `/v3/projects/477d4dfce990427eb548507a83c56683` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:08.899234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4aed8c-5e8d-4a2f-a406-f82ffe7bc1b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=477d4dfce990427eb548507a83c56683)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:08.901197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4aed8c-5e8d-4a2f-a406-f82ffe7bc1b9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:08.958891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bc4aed8c-5e8d-4a2f-a406-f82ffe7bc1b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '477d4dfce990427eb548507a83c56683', 'request_id': 'req-bc4aed8c-5e8d-4a2f-a406-f82ffe7bc1b9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:08.968753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bc4aed8c-5e8d-4a2f-a406-f82ffe7bc1b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '477d4dfce990427eb548507a83c56683', 'request_id': 'req-bc4aed8c-5e8d-4a2f-a406-f82ffe7bc1b9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:08.970283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:08.976320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bc4aed8c-5e8d-4a2f-a406-f82ffe7bc1b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '477d4dfce990427eb548507a83c56683', 'request_id': 'req-bc4aed8c-5e8d-4a2f-a406-f82ffe7bc1b9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:08.989346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bc4aed8c-5e8d-4a2f-a406-f82ffe7bc1b9 admin admin] The token cache is being invalidate because project 477d4dfce990427eb548507a83c56683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:08:08.989634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bc4aed8c-5e8d-4a2f-a406-f82ffe7bc1b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:08.990294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bc4aed8c-5e8d-4a2f-a406-f82ffe7bc1b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:08.991944 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1555/3068] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:08:08 2022] DELETE /identity/v3/projects/477d4dfce990427eb548507a83c56683 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:08.996059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573b5f5-92f5-4b86-9c21-e9676c492849 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:09.006870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573b5f5-92f5-4b86-9c21-e9676c492849 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:09.076209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb20fb3-49e0-496f-aa1d-cf7a1a918f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:09.077917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb20fb3-49e0-496f-aa1d-cf7a1a918f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:09.078429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb20fb3-49e0-496f-aa1d-cf7a1a918f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:09.078767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb20fb3-49e0-496f-aa1d-cf7a1a918f7e admin admin] PATH_INFO: `/v3/users/34a8e26bb501492fbef9ebf861740362` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:09.080105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb20fb3-49e0-496f-aa1d-cf7a1a918f7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a8e26bb501492fbef9ebf861740362)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:09.082959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb20fb3-49e0-496f-aa1d-cf7a1a918f7e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:09.172641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1bb20fb3-49e0-496f-aa1d-cf7a1a918f7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a8e26bb501492fbef9ebf861740362'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:09.175926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:09.188801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1bb20fb3-49e0-496f-aa1d-cf7a1a918f7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a8e26bb501492fbef9ebf861740362'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:09.211400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1bb20fb3-49e0-496f-aa1d-cf7a1a918f7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a8e26bb501492fbef9ebf861740362'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:09.213199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1bb20fb3-49e0-496f-aa1d-cf7a1a918f7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a8e26bb501492fbef9ebf861740362'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:09.214253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1bb20fb3-49e0-496f-aa1d-cf7a1a918f7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a8e26bb501492fbef9ebf861740362'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:09.260932 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1514/3069] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:08:08 2022] DELETE /identity/v3/users/34a8e26bb501492fbef9ebf861740362 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:09.626498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4aed8c-5e8d-4a2f-a406-f82ffe7bc1b9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:09.628521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bc4aed8c-5e8d-4a2f-a406-f82ffe7bc1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:09.644075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4aed8c-5e8d-4a2f-a406-f82ffe7bc1b9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:09.720755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248202f-0f83-4472-80c5-2bd143ade547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:09.722198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248202f-0f83-4472-80c5-2bd143ade547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:09.722636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248202f-0f83-4472-80c5-2bd143ade547 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:09.723071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248202f-0f83-4472-80c5-2bd143ade547 admin admin] PATH_INFO: `/v3/projects/2377ea6a920040129181573f1b7abeb8` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:09.724687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248202f-0f83-4472-80c5-2bd143ade547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2377ea6a920040129181573f1b7abeb8)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:09.726855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248202f-0f83-4472-80c5-2bd143ade547 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:09.797378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6248202f-0f83-4472-80c5-2bd143ade547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2377ea6a920040129181573f1b7abeb8', 'request_id': 'req-6248202f-0f83-4472-80c5-2bd143ade547'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:09.807326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6248202f-0f83-4472-80c5-2bd143ade547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2377ea6a920040129181573f1b7abeb8', 'request_id': 'req-6248202f-0f83-4472-80c5-2bd143ade547'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:09.814700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6248202f-0f83-4472-80c5-2bd143ade547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2377ea6a920040129181573f1b7abeb8', 'request_id': 'req-6248202f-0f83-4472-80c5-2bd143ade547'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:09.826469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6248202f-0f83-4472-80c5-2bd143ade547 admin admin] The token cache is being invalidate because project 2377ea6a920040129181573f1b7abeb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:08:09.827157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6248202f-0f83-4472-80c5-2bd143ade547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:09.828493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6248202f-0f83-4472-80c5-2bd143ade547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:09.830813 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1556/3070] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:08:09 2022] DELETE /identity/v3/projects/2377ea6a920040129181573f1b7abeb8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:09.835613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81604288-9c8d-49d6-9f46-37a7514643b4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:09.835900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81604288-9c8d-49d6-9f46-37a7514643b4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:09.836200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81604288-9c8d-49d6-9f46-37a7514643b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:09.859815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-81604288-9c8d-49d6-9f46-37a7514643b4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:09.861305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-81604288-9c8d-49d6-9f46-37a7514643b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:09.928560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248202f-0f83-4472-80c5-2bd143ade547 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:09.930177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6248202f-0f83-4472-80c5-2bd143ade547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:09.971404 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1515/3071] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:09.973652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105ff2f-b8b1-4b75-8c84-b1713de9247b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:09.973994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105ff2f-b8b1-4b75-8c84-b1713de9247b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:09.974517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105ff2f-b8b1-4b75-8c84-b1713de9247b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:10.023544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a105ff2f-b8b1-4b75-8c84-b1713de9247b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:10.024990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a105ff2f-b8b1-4b75-8c84-b1713de9247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:10.040453 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1516/3072] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:10.041767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105ff2f-b8b1-4b75-8c84-b1713de9247b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:10.068590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105ff2f-b8b1-4b75-8c84-b1713de9247b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:10.077190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b1efe-55b8-4003-87a3-1c16c5b6af84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:10.078542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b1efe-55b8-4003-87a3-1c16c5b6af84 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:10.079014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b1efe-55b8-4003-87a3-1c16c5b6af84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:10.079338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b1efe-55b8-4003-87a3-1c16c5b6af84 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:10.080262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b1efe-55b8-4003-87a3-1c16c5b6af84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:08:10.080565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b1efe-55b8-4003-87a3-1c16c5b6af84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:10.082707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b1efe-55b8-4003-87a3-1c16c5b6af84 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:10.103459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248202f-0f83-4472-80c5-2bd143ade547 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:10.107092 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1517/3073] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:08:10.112253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b1efe-55b8-4003-87a3-1c16c5b6af84 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:10.121309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cff1b5-297d-44f6-8e60-db938f10d26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:10.122861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cff1b5-297d-44f6-8e60-db938f10d26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:10.125973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b1efe-55b8-4003-87a3-1c16c5b6af84 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:10.126447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cff1b5-297d-44f6-8e60-db938f10d26e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:10.126854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cff1b5-297d-44f6-8e60-db938f10d26e admin admin] PATH_INFO: `/v3/users/1fade188e2a14766ae95fe44143bca97` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:10.132187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cff1b5-297d-44f6-8e60-db938f10d26e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fade188e2a14766ae95fe44143bca97)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:10.133726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c07694-58c1-4708-afde-b72a9d2a42dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:10.134691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c07694-58c1-4708-afde-b72a9d2a42dc admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:10.135291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c07694-58c1-4708-afde-b72a9d2a42dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:10.135773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cff1b5-297d-44f6-8e60-db938f10d26e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:10.136214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c07694-58c1-4708-afde-b72a9d2a42dc admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:10.138493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c07694-58c1-4708-afde-b72a9d2a42dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:10.142085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c07694-58c1-4708-afde-b72a9d2a42dc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:10.169162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:10.187436 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1518/3074] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:08:10 2022] POST /identity/v3/projects => generated 393 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:08:10.188789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c07694-58c1-4708-afde-b72a9d2a42dc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:10.191406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-08c07694-58c1-4708-afde-b72a9d2a42dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:10.237630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-72cff1b5-297d-44f6-8e60-db938f10d26e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fade188e2a14766ae95fe44143bca97'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:10.248238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-72cff1b5-297d-44f6-8e60-db938f10d26e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fade188e2a14766ae95fe44143bca97'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:10.249157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-72cff1b5-297d-44f6-8e60-db938f10d26e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fade188e2a14766ae95fe44143bca97'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:10.251254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-72cff1b5-297d-44f6-8e60-db938f10d26e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fade188e2a14766ae95fe44143bca97'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:10.261835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-72cff1b5-297d-44f6-8e60-db938f10d26e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fade188e2a14766ae95fe44143bca97'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:10.287130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c07694-58c1-4708-afde-b72a9d2a42dc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:10.300555 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1557/3075] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:08:09 2022] DELETE /identity/v3/users/1fade188e2a14766ae95fe44143bca97 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:08:10.300763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b4fa8-5f2e-460f-8095-6ac80792a514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:10.300763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b4fa8-5f2e-460f-8095-6ac80792a514 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:10.300763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b4fa8-5f2e-460f-8095-6ac80792a514 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:10.300763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b4fa8-5f2e-460f-8095-6ac80792a514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:10.301145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cff1b5-297d-44f6-8e60-db938f10d26e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:10.301542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a15b4fa8-5f2e-460f-8095-6ac80792a514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:10.304893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-72cff1b5-297d-44f6-8e60-db938f10d26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:10.351445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:10.414794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b4fa8-5f2e-460f-8095-6ac80792a514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:10.417214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b4fa8-5f2e-460f-8095-6ac80792a514 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:10.420824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cff1b5-297d-44f6-8e60-db938f10d26e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:10.426692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6849de9-1af7-43b0-8446-0a90688a9ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:10.428430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6849de9-1af7-43b0-8446-0a90688a9ebe admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:10.428805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6849de9-1af7-43b0-8446-0a90688a9ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:10.429346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6849de9-1af7-43b0-8446-0a90688a9ebe admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:10.430202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6849de9-1af7-43b0-8446-0a90688a9ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:10.432277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6849de9-1af7-43b0-8446-0a90688a9ebe admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:10.445088 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1519/3076] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:10.458476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b4fa8-5f2e-460f-8095-6ac80792a514 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:10.460596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a15b4fa8-5f2e-460f-8095-6ac80792a514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:10.468623 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1558/3077] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:08:10 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:08:10.469954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6849de9-1af7-43b0-8446-0a90688a9ebe admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:10.472812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b4fa8-5f2e-460f-8095-6ac80792a514 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:10.481375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6849de9-1af7-43b0-8446-0a90688a9ebe admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:10.486363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb166b43-5459-43f0-94c5-550be7f24576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:10.487033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb166b43-5459-43f0-94c5-550be7f24576 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:10.487308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb166b43-5459-43f0-94c5-550be7f24576 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:10.487586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb166b43-5459-43f0-94c5-550be7f24576 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:10.488335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb166b43-5459-43f0-94c5-550be7f24576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:10.489939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb166b43-5459-43f0-94c5-550be7f24576 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:10.502802 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1559/3078] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:10.506603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb166b43-5459-43f0-94c5-550be7f24576 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:10.519809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb166b43-5459-43f0-94c5-550be7f24576 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:10.525579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22258a74-617d-45f5-b5c0-31b8535f6dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:10.526769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22258a74-617d-45f5-b5c0-31b8535f6dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:10.527049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22258a74-617d-45f5-b5c0-31b8535f6dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:10.527321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22258a74-617d-45f5-b5c0-31b8535f6dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:10.528061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22258a74-617d-45f5-b5c0-31b8535f6dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:10.530071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22258a74-617d-45f5-b5c0-31b8535f6dc6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:10.545782 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1560/3079] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:10.549216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22258a74-617d-45f5-b5c0-31b8535f6dc6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:10.558608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81cf2b-d5e1-41c8-b3e1-4cd19e830ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:10.559434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81cf2b-d5e1-41c8-b3e1-4cd19e830ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:10.559813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81cf2b-d5e1-41c8-b3e1-4cd19e830ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:10.560344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81cf2b-d5e1-41c8-b3e1-4cd19e830ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:10.562123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22258a74-617d-45f5-b5c0-31b8535f6dc6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:10.562642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6e81cf2b-d5e1-41c8-b3e1-4cd19e830ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:10.567739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e58111-964f-4e40-8ca8-4a172428c39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:10.568839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e58111-964f-4e40-8ca8-4a172428c39d admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:10.569125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e58111-964f-4e40-8ca8-4a172428c39d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:10.569426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e58111-964f-4e40-8ca8-4a172428c39d admin admin] PATH_INFO: `/v3/projects/e11f8356b092424299996ee25929ac33/users/b20959ef471349ba8c0cba87579d2dc3/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:10.580344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81cf2b-d5e1-41c8-b3e1-4cd19e830ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:10.582137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81cf2b-d5e1-41c8-b3e1-4cd19e830ad8 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:10.591576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e58111-964f-4e40-8ca8-4a172428c39d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11f8356b092424299996ee25929ac33, user_id=b20959ef471349ba8c0cba87579d2dc3, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:10.594620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e58111-964f-4e40-8ca8-4a172428c39d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:10.595373 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1520/3080] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:08:10.610710 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1561/3081] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:08:10 2022] PUT /identity/v3/projects/e11f8356b092424299996ee25929ac33/users/b20959ef471349ba8c0cba87579d2dc3/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:10.631788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81cf2b-d5e1-41c8-b3e1-4cd19e830ad8 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:10.633422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6e81cf2b-d5e1-41c8-b3e1-4cd19e830ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:10.687721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb24210-8e00-4431-b284-ab2fb0170721 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:10.688698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81cf2b-d5e1-41c8-b3e1-4cd19e830ad8 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:10.688801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb24210-8e00-4431-b284-ab2fb0170721 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:10.688801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb24210-8e00-4431-b284-ab2fb0170721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:10.739215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7cb24210-8e00-4431-b284-ab2fb0170721 None None] MFA Rules not processed for user `b20959ef471349ba8c0cba87579d2dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:10.740453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7cb24210-8e00-4431-b284-ab2fb0170721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:10.780414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:10.783871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76af4b-add5-489a-88ce-2eb08ee14890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:10.784847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76af4b-add5-489a-88ce-2eb08ee14890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:10.785147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76af4b-add5-489a-88ce-2eb08ee14890 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:10.785438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76af4b-add5-489a-88ce-2eb08ee14890 admin admin] PATH_INFO: `/v3/projects/4b15f516c6a34343979d19a0938c232b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:10.786759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76af4b-add5-489a-88ce-2eb08ee14890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b15f516c6a34343979d19a0938c232b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:10.789038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76af4b-add5-489a-88ce-2eb08ee14890 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:10.832319 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1562/3082] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:10.836939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb24210-8e00-4431-b284-ab2fb0170721 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:10.841076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ad76af4b-add5-489a-88ce-2eb08ee14890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b15f516c6a34343979d19a0938c232b', 'request_id': 'req-ad76af4b-add5-489a-88ce-2eb08ee14890'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:10.848971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb24210-8e00-4431-b284-ab2fb0170721 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:10.850637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ad76af4b-add5-489a-88ce-2eb08ee14890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b15f516c6a34343979d19a0938c232b', 'request_id': 'req-ad76af4b-add5-489a-88ce-2eb08ee14890'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:10.858956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ad76af4b-add5-489a-88ce-2eb08ee14890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b15f516c6a34343979d19a0938c232b', 'request_id': 'req-ad76af4b-add5-489a-88ce-2eb08ee14890'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:10.870833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:10.878164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ad76af4b-add5-489a-88ce-2eb08ee14890 admin admin] The token cache is being invalidate because project 4b15f516c6a34343979d19a0938c232b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:08:10.878865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ad76af4b-add5-489a-88ce-2eb08ee14890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:10.884808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ad76af4b-add5-489a-88ce-2eb08ee14890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:10.887088 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1521/3083] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:08:10 2022] DELETE /identity/v3/projects/4b15f516c6a34343979d19a0938c232b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:10.890942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76af4b-add5-489a-88ce-2eb08ee14890 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:10.893185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ad76af4b-add5-489a-88ce-2eb08ee14890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:10.929978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e511f76-1872-4ec6-9848-688dc6a3a2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:10.931472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e511f76-1872-4ec6-9848-688dc6a3a2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:10.932643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e511f76-1872-4ec6-9848-688dc6a3a2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:10.933512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e511f76-1872-4ec6-9848-688dc6a3a2a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:10.934942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e511f76-1872-4ec6-9848-688dc6a3a2a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:10.938001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e511f76-1872-4ec6-9848-688dc6a3a2a3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:10.973852 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1563/3084] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:08:10 2022] POST /identity/v3/projects => generated 395 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:08:10.978215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e511f76-1872-4ec6-9848-688dc6a3a2a3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:10.980269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1e511f76-1872-4ec6-9848-688dc6a3a2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:10.990283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76af4b-add5-489a-88ce-2eb08ee14890 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:11.058906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93237a16-a02f-4977-b699-1ea8a2810503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:11.060337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93237a16-a02f-4977-b699-1ea8a2810503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:11.060482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e511f76-1872-4ec6-9848-688dc6a3a2a3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:11.060609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93237a16-a02f-4977-b699-1ea8a2810503 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:11.060878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93237a16-a02f-4977-b699-1ea8a2810503 admin admin] PATH_INFO: `/v3/users/276b5102c10049faa2de880b2c3a8ee6` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:11.062177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93237a16-a02f-4977-b699-1ea8a2810503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=276b5102c10049faa2de880b2c3a8ee6)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:11.064234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93237a16-a02f-4977-b699-1ea8a2810503 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:11.067901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79905c-44f0-4ce2-991b-3c0ba9911881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:11.069244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79905c-44f0-4ce2-991b-3c0ba9911881 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:11.069244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79905c-44f0-4ce2-991b-3c0ba9911881 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:11.069640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79905c-44f0-4ce2-991b-3c0ba9911881 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:11.070400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79905c-44f0-4ce2-991b-3c0ba9911881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:11.072588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79905c-44f0-4ce2-991b-3c0ba9911881 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:11.109176 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1564/3085] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:08:10 2022] POST /identity/v3/users => generated 304 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:08:11.110889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79905c-44f0-4ce2-991b-3c0ba9911881 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:11.124083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-93237a16-a02f-4977-b699-1ea8a2810503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276b5102c10049faa2de880b2c3a8ee6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:11.134722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79905c-44f0-4ce2-991b-3c0ba9911881 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:11.135536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-93237a16-a02f-4977-b699-1ea8a2810503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276b5102c10049faa2de880b2c3a8ee6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:11.143705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02c99c-8a1c-4a2d-9cf6-7e44e5aa9b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:11.144789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02c99c-8a1c-4a2d-9cf6-7e44e5aa9b41 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:11.145914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02c99c-8a1c-4a2d-9cf6-7e44e5aa9b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:11.146423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02c99c-8a1c-4a2d-9cf6-7e44e5aa9b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:11.147035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-93237a16-a02f-4977-b699-1ea8a2810503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276b5102c10049faa2de880b2c3a8ee6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:11.147990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-93237a16-a02f-4977-b699-1ea8a2810503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276b5102c10049faa2de880b2c3a8ee6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:11.148267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02c99c-8a1c-4a2d-9cf6-7e44e5aa9b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:11.148914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-93237a16-a02f-4977-b699-1ea8a2810503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276b5102c10049faa2de880b2c3a8ee6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:11.149945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02c99c-8a1c-4a2d-9cf6-7e44e5aa9b41 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:11.161876 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1565/3086] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:11.166125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02c99c-8a1c-4a2d-9cf6-7e44e5aa9b41 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:11.168142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5e02c99c-8a1c-4a2d-9cf6-7e44e5aa9b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:11.177666 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1522/3087] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:08:10 2022] DELETE /identity/v3/users/276b5102c10049faa2de880b2c3a8ee6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:11.185995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02c99c-8a1c-4a2d-9cf6-7e44e5aa9b41 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:11.230348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:11.271935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de6de0-6c15-4861-b0ad-fc439a1b1c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:11.272940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de6de0-6c15-4861-b0ad-fc439a1b1c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:11.273225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de6de0-6c15-4861-b0ad-fc439a1b1c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:11.273502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de6de0-6c15-4861-b0ad-fc439a1b1c4d admin admin] PATH_INFO: `/v3/projects/c188b782e83f45fabc149f9293772616/users/837004ee9a4541e3b2faff3b2672ca4f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:11.295902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de6de0-6c15-4861-b0ad-fc439a1b1c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c188b782e83f45fabc149f9293772616, user_id=837004ee9a4541e3b2faff3b2672ca4f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:11.299403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de6de0-6c15-4861-b0ad-fc439a1b1c4d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:11.330863 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1566/3088] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:08:11 2022] PUT /identity/v3/projects/c188b782e83f45fabc149f9293772616/users/837004ee9a4541e3b2faff3b2672ca4f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:08:11.334883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93237a16-a02f-4977-b699-1ea8a2810503 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:11.345478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93237a16-a02f-4977-b699-1ea8a2810503 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:11.370092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:11.391984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de6de0-6c15-4861-b0ad-fc439a1b1c4d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:11.394175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c0de6de0-6c15-4861-b0ad-fc439a1b1c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:11.455914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed34a59-e4d0-40a7-95f7-4ec0997c4f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:11.456714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed34a59-e4d0-40a7-95f7-4ec0997c4f41 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:11.457607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed34a59-e4d0-40a7-95f7-4ec0997c4f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:11.457607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed34a59-e4d0-40a7-95f7-4ec0997c4f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:11.458277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed34a59-e4d0-40a7-95f7-4ec0997c4f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:11.460027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed34a59-e4d0-40a7-95f7-4ec0997c4f41 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:11.474374 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1523/3089] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:11.478601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed34a59-e4d0-40a7-95f7-4ec0997c4f41 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:11.489334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed34a59-e4d0-40a7-95f7-4ec0997c4f41 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:11.494137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9c3fb-6f44-4bcd-bb29-f3afaf11fd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:11.495106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9c3fb-6f44-4bcd-bb29-f3afaf11fd7c admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:11.495451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9c3fb-6f44-4bcd-bb29-f3afaf11fd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:11.495785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9c3fb-6f44-4bcd-bb29-f3afaf11fd7c admin admin] PATH_INFO: `/v3/projects/c188b782e83f45fabc149f9293772616/users/837004ee9a4541e3b2faff3b2672ca4f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:11.497890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de6de0-6c15-4861-b0ad-fc439a1b1c4d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:11.498057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9c3fb-6f44-4bcd-bb29-f3afaf11fd7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c188b782e83f45fabc149f9293772616, user_id=837004ee9a4541e3b2faff3b2672ca4f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:11.500715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9c3fb-6f44-4bcd-bb29-f3afaf11fd7c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:11.502767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96210977-be59-49e4-9696-26e6be79eb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:11.503628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96210977-be59-49e4-9696-26e6be79eb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:11.503905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96210977-be59-49e4-9696-26e6be79eb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:11.504203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96210977-be59-49e4-9696-26e6be79eb35 admin admin] PATH_INFO: `/v3/projects/05a8c36319054fc8af0b5dd1916d7b5f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:11.505384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96210977-be59-49e4-9696-26e6be79eb35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a8c36319054fc8af0b5dd1916d7b5f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:11.507311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96210977-be59-49e4-9696-26e6be79eb35 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:11.511601 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1524/3090] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:08:11 2022] PUT /identity/v3/projects/c188b782e83f45fabc149f9293772616/users/837004ee9a4541e3b2faff3b2672ca4f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:08:11.522458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5f199-8d5b-450a-87d8-5b797531da97 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:11.522849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5f199-8d5b-450a-87d8-5b797531da97 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:11.523296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5f199-8d5b-450a-87d8-5b797531da97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:11.552247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3cc5f199-8d5b-450a-87d8-5b797531da97 None None] MFA Rules not processed for user `837004ee9a4541e3b2faff3b2672ca4f`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:11.553613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3cc5f199-8d5b-450a-87d8-5b797531da97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:11.560441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-96210977-be59-49e4-9696-26e6be79eb35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a8c36319054fc8af0b5dd1916d7b5f', 'request_id': 'req-96210977-be59-49e4-9696-26e6be79eb35'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:11.570922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-96210977-be59-49e4-9696-26e6be79eb35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a8c36319054fc8af0b5dd1916d7b5f', 'request_id': 'req-96210977-be59-49e4-9696-26e6be79eb35'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:11.580340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-96210977-be59-49e4-9696-26e6be79eb35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a8c36319054fc8af0b5dd1916d7b5f', 'request_id': 'req-96210977-be59-49e4-9696-26e6be79eb35'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:11.594060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-96210977-be59-49e4-9696-26e6be79eb35 admin admin] The token cache is being invalidate because project 05a8c36319054fc8af0b5dd1916d7b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:08:11.594342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-96210977-be59-49e4-9696-26e6be79eb35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:11.594999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-96210977-be59-49e4-9696-26e6be79eb35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:11.596871 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1567/3091] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:08:11 2022] DELETE /identity/v3/projects/05a8c36319054fc8af0b5dd1916d7b5f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:08:11.601450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763447b9-eba5-4f8e-b41d-1dde1fe6dca8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:11.601731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763447b9-eba5-4f8e-b41d-1dde1fe6dca8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:11.602004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763447b9-eba5-4f8e-b41d-1dde1fe6dca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:11.621354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-763447b9-eba5-4f8e-b41d-1dde1fe6dca8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:11.622577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-763447b9-eba5-4f8e-b41d-1dde1fe6dca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:11.636006 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1525/3092] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:11.647032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5f199-8d5b-450a-87d8-5b797531da97 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:11.648545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3cc5f199-8d5b-450a-87d8-5b797531da97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:11.673986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:11.697944 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1568/3093] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:08:11.706070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e551f0-c58d-43dd-b2e5-88ab82f750a4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:11.706364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e551f0-c58d-43dd-b2e5-88ab82f750a4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:11.706642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e551f0-c58d-43dd-b2e5-88ab82f750a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:11.725491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b2e551f0-c58d-43dd-b2e5-88ab82f750a4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:11.726992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b2e551f0-c58d-43dd-b2e5-88ab82f750a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:11.735907 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1569/3094] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:08:11.739938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e551f0-c58d-43dd-b2e5-88ab82f750a4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:11.741192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5f199-8d5b-450a-87d8-5b797531da97 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:11.750744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2936407-71d6-42ed-940a-128e9b0b7fff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:11.751403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2936407-71d6-42ed-940a-128e9b0b7fff service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:11.751581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e551f0-c58d-43dd-b2e5-88ab82f750a4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:11.751830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2936407-71d6-42ed-940a-128e9b0b7fff service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:11.752299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2936407-71d6-42ed-940a-128e9b0b7fff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:11.756432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb22c58-dd64-4d59-aba1-9906ffd5070c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:11.757091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb22c58-dd64-4d59-aba1-9906ffd5070c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:11.757366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb22c58-dd64-4d59-aba1-9906ffd5070c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:11.757638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb22c58-dd64-4d59-aba1-9906ffd5070c admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:11.759728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb22c58-dd64-4d59-aba1-9906ffd5070c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:08:11.759728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb22c58-dd64-4d59-aba1-9906ffd5070c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:11.760294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb22c58-dd64-4d59-aba1-9906ffd5070c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:11.766236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2936407-71d6-42ed-940a-128e9b0b7fff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:11.768068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2936407-71d6-42ed-940a-128e9b0b7fff service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:11.776539 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1570/3095] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:08:11.777716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb22c58-dd64-4d59-aba1-9906ffd5070c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:11.779434 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1526/3096] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:08:11.788274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb22c58-dd64-4d59-aba1-9906ffd5070c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:11.793140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d923031-ffa1-438e-bc7d-904a09666665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:11.794255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923031-ffa1-438e-bc7d-904a09666665 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:11.794600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923031-ffa1-438e-bc7d-904a09666665 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:11.794944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923031-ffa1-438e-bc7d-904a09666665 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:11.795713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d923031-ffa1-438e-bc7d-904a09666665 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:11.797740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d923031-ffa1-438e-bc7d-904a09666665 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:11.833204 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1571/3097] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:08:11 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:08:11.834109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2936407-71d6-42ed-940a-128e9b0b7fff service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:11.849470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2936407-71d6-42ed-940a-128e9b0b7fff service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:11.865616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:11.931650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4ca6f-2966-48b9-bcaa-212021f0fbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:11.932488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4ca6f-2966-48b9-bcaa-212021f0fbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:11.933030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4ca6f-2966-48b9-bcaa-212021f0fbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:11.933399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4ca6f-2966-48b9-bcaa-212021f0fbd7 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:11.934291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4ca6f-2966-48b9-bcaa-212021f0fbd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:11.936697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4ca6f-2966-48b9-bcaa-212021f0fbd7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:11.961853 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1527/3098] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:08:11 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:08:11.967947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d923031-ffa1-438e-bc7d-904a09666665 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:11.974022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d923031-ffa1-438e-bc7d-904a09666665 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:11.978828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729a911-e6d0-4bf0-941d-ded00f90065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:11.979486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729a911-e6d0-4bf0-941d-ded00f90065f admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:11.979935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729a911-e6d0-4bf0-941d-ded00f90065f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:11.980257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729a911-e6d0-4bf0-941d-ded00f90065f admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:11.980980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729a911-e6d0-4bf0-941d-ded00f90065f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:11.982581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729a911-e6d0-4bf0-941d-ded00f90065f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:11.993596 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1572/3099] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:11.997794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4ca6f-2966-48b9-bcaa-212021f0fbd7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:12.009362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4ca6f-2966-48b9-bcaa-212021f0fbd7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:12.015229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1c1d0-b9cc-4fcb-9690-5aa25b4d663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:12.015961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1c1d0-b9cc-4fcb-9690-5aa25b4d663d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:12.016217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1c1d0-b9cc-4fcb-9690-5aa25b4d663d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:12.016836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1c1d0-b9cc-4fcb-9690-5aa25b4d663d admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:12.017339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1c1d0-b9cc-4fcb-9690-5aa25b4d663d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:12.018897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1c1d0-b9cc-4fcb-9690-5aa25b4d663d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:12.030378 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1528/3100] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:08:12.035225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729a911-e6d0-4bf0-941d-ded00f90065f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:12.051085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729a911-e6d0-4bf0-941d-ded00f90065f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:12.055840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcedb4e-d464-4f9f-ae37-440528317119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:12.056890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcedb4e-d464-4f9f-ae37-440528317119 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:12.057237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcedb4e-d464-4f9f-ae37-440528317119 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:12.057588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcedb4e-d464-4f9f-ae37-440528317119 admin admin] PATH_INFO: `/v3/projects/3e6374f0dc6f46e9b0cdead21e69a4fa/users/3a8b9e1d931342d3a06dcf3d7076f28c/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:12.059276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1c1d0-b9cc-4fcb-9690-5aa25b4d663d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:12.074311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcedb4e-d464-4f9f-ae37-440528317119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6374f0dc6f46e9b0cdead21e69a4fa, user_id=3a8b9e1d931342d3a06dcf3d7076f28c, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:12.077435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcedb4e-d464-4f9f-ae37-440528317119 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:12.108142 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1573/3101] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:08:12 2022] PUT /identity/v3/projects/3e6374f0dc6f46e9b0cdead21e69a4fa/users/3a8b9e1d931342d3a06dcf3d7076f28c/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:12.114348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73fa40-c8b1-4a65-be68-ee01918bdb69 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:12.114826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73fa40-c8b1-4a65-be68-ee01918bdb69 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:12.115554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73fa40-c8b1-4a65-be68-ee01918bdb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:12.145626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1c1d0-b9cc-4fcb-9690-5aa25b4d663d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:12.158827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-aa73fa40-c8b1-4a65-be68-ee01918bdb69 None None] MFA Rules not processed for user `3a8b9e1d931342d3a06dcf3d7076f28c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:12.160410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-aa73fa40-c8b1-4a65-be68-ee01918bdb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:12.242082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d7d8d-6ea0-4a60-affa-19d1a3ff89dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:12.243437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d7d8d-6ea0-4a60-affa-19d1a3ff89dc service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:12.243721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d7d8d-6ea0-4a60-affa-19d1a3ff89dc service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:12.243994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d7d8d-6ea0-4a60-affa-19d1a3ff89dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:12.250433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0e5d7d8d-6ea0-4a60-affa-19d1a3ff89dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:12.250619 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1574/3102] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:12.258251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73fa40-c8b1-4a65-be68-ee01918bdb69 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:12.259666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-aa73fa40-c8b1-4a65-be68-ee01918bdb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:12.277428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73fa40-c8b1-4a65-be68-ee01918bdb69 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:12.285656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c44f55-589f-4c07-bc94-b1efb046515d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:12.286511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c44f55-589f-4c07-bc94-b1efb046515d service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:12.286800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c44f55-589f-4c07-bc94-b1efb046515d service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:12.287080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c44f55-589f-4c07-bc94-b1efb046515d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:12.295091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:12.301405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c44f55-589f-4c07-bc94-b1efb046515d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:12.308193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c44f55-589f-4c07-bc94-b1efb046515d service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:12.329608 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1575/3103] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:12.332782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d7d8d-6ea0-4a60-affa-19d1a3ff89dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:12.334657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d7d8d-6ea0-4a60-affa-19d1a3ff89dc service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:12.348637 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1529/3104] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:12.369095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c44f55-589f-4c07-bc94-b1efb046515d service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:12.373352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-16c44f55-589f-4c07-bc94-b1efb046515d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:12.454116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:12.483309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c44f55-589f-4c07-bc94-b1efb046515d service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:12.488668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39d0c8-56ec-4e77-85ed-b71bdf29200a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:12.489696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39d0c8-56ec-4e77-85ed-b71bdf29200a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:12.490016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39d0c8-56ec-4e77-85ed-b71bdf29200a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:12.490372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39d0c8-56ec-4e77-85ed-b71bdf29200a admin admin] PATH_INFO: `/v3/users/b20959ef471349ba8c0cba87579d2dc3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:12.491846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39d0c8-56ec-4e77-85ed-b71bdf29200a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20959ef471349ba8c0cba87579d2dc3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:12.494733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39d0c8-56ec-4e77-85ed-b71bdf29200a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:12.538789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f94112-08d2-43c8-adea-7e7d629bc825 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:12.539372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f94112-08d2-43c8-adea-7e7d629bc825 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:12.539921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f94112-08d2-43c8-adea-7e7d629bc825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:12.566214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0f39d0c8-56ec-4e77-85ed-b71bdf29200a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20959ef471349ba8c0cba87579d2dc3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:12.577405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0f39d0c8-56ec-4e77-85ed-b71bdf29200a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20959ef471349ba8c0cba87579d2dc3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:12.578438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0f39d0c8-56ec-4e77-85ed-b71bdf29200a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20959ef471349ba8c0cba87579d2dc3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:12.578602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-96f94112-08d2-43c8-adea-7e7d629bc825 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:12.579644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0f39d0c8-56ec-4e77-85ed-b71bdf29200a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20959ef471349ba8c0cba87579d2dc3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:12.582070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-96f94112-08d2-43c8-adea-7e7d629bc825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:12.606743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0f39d0c8-56ec-4e77-85ed-b71bdf29200a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20959ef471349ba8c0cba87579d2dc3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:12.628868 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1576/3105] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:08:12 2022] DELETE /identity/v3/users/b20959ef471349ba8c0cba87579d2dc3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:12.633058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e489880-fbe9-481c-99bf-a064ff93fe71 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:12.633426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e489880-fbe9-481c-99bf-a064ff93fe71 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:12.633721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e489880-fbe9-481c-99bf-a064ff93fe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:12.653463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3e489880-fbe9-481c-99bf-a064ff93fe71 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:12.654698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3e489880-fbe9-481c-99bf-a064ff93fe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:12.677869 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1530/3106] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:08:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:08:12.700112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f94112-08d2-43c8-adea-7e7d629bc825 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:12.701516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-96f94112-08d2-43c8-adea-7e7d629bc825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:12.726599 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1577/3107] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:08:12.737031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e489880-fbe9-481c-99bf-a064ff93fe71 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:12.739306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3e489880-fbe9-481c-99bf-a064ff93fe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:12.784626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f94112-08d2-43c8-adea-7e7d629bc825 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:12.810720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e489880-fbe9-481c-99bf-a064ff93fe71 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:12.815814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0709b3-1615-49f4-bfb6-81bd6ff8a0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:12.816741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0709b3-1615-49f4-bfb6-81bd6ff8a0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:12.817205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0709b3-1615-49f4-bfb6-81bd6ff8a0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:12.817556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0709b3-1615-49f4-bfb6-81bd6ff8a0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:12.829366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0709b3-1615-49f4-bfb6-81bd6ff8a0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:12.831477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0709b3-1615-49f4-bfb6-81bd6ff8a0e0 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:12.844394 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1578/3108] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:08:12.858597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd84da8-1be3-4baf-a3f8-bd237cb5de37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:12.859844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd84da8-1be3-4baf-a3f8-bd237cb5de37 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:12.860499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd84da8-1be3-4baf-a3f8-bd237cb5de37 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:12.860943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd84da8-1be3-4baf-a3f8-bd237cb5de37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:12.889462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:12.943675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd84da8-1be3-4baf-a3f8-bd237cb5de37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:12.945520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd84da8-1be3-4baf-a3f8-bd237cb5de37 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:12.956591 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1531/3109] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:08:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:08:13.109103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e230d97-a362-4be5-84de-eef877294f9d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:13.110233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e230d97-a362-4be5-84de-eef877294f9d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:13.110701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e230d97-a362-4be5-84de-eef877294f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:13.124534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:13.131830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1e230d97-a362-4be5-84de-eef877294f9d None None] MFA Rules not processed for user `3a8b9e1d931342d3a06dcf3d7076f28c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:13.134318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1e230d97-a362-4be5-84de-eef877294f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:13.220918 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1579/3110] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:13.394101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd84da8-1be3-4baf-a3f8-bd237cb5de37 service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:13.395787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fcd84da8-1be3-4baf-a3f8-bd237cb5de37 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:13.409888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd84da8-1be3-4baf-a3f8-bd237cb5de37 service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:13.415333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c634a-b2f2-40f2-b509-fd167bc5e296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:13.416618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c634a-b2f2-40f2-b509-fd167bc5e296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:13.416895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c634a-b2f2-40f2-b509-fd167bc5e296 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:13.417527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c634a-b2f2-40f2-b509-fd167bc5e296 admin admin] PATH_INFO: `/v3/projects/e11f8356b092424299996ee25929ac33` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:13.419318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c634a-b2f2-40f2-b509-fd167bc5e296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11f8356b092424299996ee25929ac33)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:13.421454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c634a-b2f2-40f2-b509-fd167bc5e296 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:13.488048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-879c634a-b2f2-40f2-b509-fd167bc5e296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11f8356b092424299996ee25929ac33', 'request_id': 'req-879c634a-b2f2-40f2-b509-fd167bc5e296'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:13.495397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-879c634a-b2f2-40f2-b509-fd167bc5e296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11f8356b092424299996ee25929ac33', 'request_id': 'req-879c634a-b2f2-40f2-b509-fd167bc5e296'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:13.506985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-879c634a-b2f2-40f2-b509-fd167bc5e296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11f8356b092424299996ee25929ac33', 'request_id': 'req-879c634a-b2f2-40f2-b509-fd167bc5e296'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:13.516329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-879c634a-b2f2-40f2-b509-fd167bc5e296 admin admin] The token cache is being invalidate because project e11f8356b092424299996ee25929ac33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:08:13.516623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-879c634a-b2f2-40f2-b509-fd167bc5e296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:13.517284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-879c634a-b2f2-40f2-b509-fd167bc5e296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:13.518864 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1532/3111] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:08:13 2022] DELETE /identity/v3/projects/e11f8356b092424299996ee25929ac33 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:13.522939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e230d97-a362-4be5-84de-eef877294f9d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:13.537501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e230d97-a362-4be5-84de-eef877294f9d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:13.544677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616663f2-5ce5-44a6-b9c4-60e2b50cdca5 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:13.544978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616663f2-5ce5-44a6-b9c4-60e2b50cdca5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:13.545230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616663f2-5ce5-44a6-b9c4-60e2b50cdca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:13.563688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-616663f2-5ce5-44a6-b9c4-60e2b50cdca5 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:13.565696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-616663f2-5ce5-44a6-b9c4-60e2b50cdca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:13.600315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cc828-cb70-4424-af7e-284df0a3ca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:13.601197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc828-cb70-4424-af7e-284df0a3ca67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:13.601472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc828-cb70-4424-af7e-284df0a3ca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:13.602326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cc828-cb70-4424-af7e-284df0a3ca67 admin admin] PATH_INFO: `/v3/users/837004ee9a4541e3b2faff3b2672ca4f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:13.603331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cc828-cb70-4424-af7e-284df0a3ca67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=837004ee9a4541e3b2faff3b2672ca4f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:13.605621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cc828-cb70-4424-af7e-284df0a3ca67 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:13.640756 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1533/3112] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:08:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:08:13.649593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616663f2-5ce5-44a6-b9c4-60e2b50cdca5 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:13.651569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-616663f2-5ce5-44a6-b9c4-60e2b50cdca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:13.679685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-389cc828-cb70-4424-af7e-284df0a3ca67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '837004ee9a4541e3b2faff3b2672ca4f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:13.696140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-389cc828-cb70-4424-af7e-284df0a3ca67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '837004ee9a4541e3b2faff3b2672ca4f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:13.696815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-389cc828-cb70-4424-af7e-284df0a3ca67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '837004ee9a4541e3b2faff3b2672ca4f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:13.697697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-389cc828-cb70-4424-af7e-284df0a3ca67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '837004ee9a4541e3b2faff3b2672ca4f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:13.713075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-389cc828-cb70-4424-af7e-284df0a3ca67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '837004ee9a4541e3b2faff3b2672ca4f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:13.742294 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1580/3113] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:08:13 2022] DELETE /identity/v3/users/837004ee9a4541e3b2faff3b2672ca4f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:13.744028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:13.769949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616663f2-5ce5-44a6-b9c4-60e2b50cdca5 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:13.846116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f6083-fa1a-4a6b-a288-5aaf22592f27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:13.847670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f6083-fa1a-4a6b-a288-5aaf22592f27 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:13.847670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f6083-fa1a-4a6b-a288-5aaf22592f27 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:13.847670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f6083-fa1a-4a6b-a288-5aaf22592f27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:13.849849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ee5f6083-fa1a-4a6b-a288-5aaf22592f27 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:13.921522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f6083-fa1a-4a6b-a288-5aaf22592f27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:13.923334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f6083-fa1a-4a6b-a288-5aaf22592f27 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:13.934453 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1534/3114] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:08:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 02 21:08:14.118029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cc828-cb70-4424-af7e-284df0a3ca67 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:14.120132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-389cc828-cb70-4424-af7e-284df0a3ca67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:14.175951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:14.242044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cc828-cb70-4424-af7e-284df0a3ca67 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:14.252235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c77c3-81f3-4666-8c48-cd200dbd5e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:14.253706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c77c3-81f3-4666-8c48-cd200dbd5e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:14.253998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c77c3-81f3-4666-8c48-cd200dbd5e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:14.254275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c77c3-81f3-4666-8c48-cd200dbd5e5c admin admin] PATH_INFO: `/v3/users/3a8b9e1d931342d3a06dcf3d7076f28c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:14.255601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c77c3-81f3-4666-8c48-cd200dbd5e5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a8b9e1d931342d3a06dcf3d7076f28c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:14.258445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c77c3-81f3-4666-8c48-cd200dbd5e5c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:14.332321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d42c77c3-81f3-4666-8c48-cd200dbd5e5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a8b9e1d931342d3a06dcf3d7076f28c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:14.364983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d42c77c3-81f3-4666-8c48-cd200dbd5e5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a8b9e1d931342d3a06dcf3d7076f28c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:14.365839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d42c77c3-81f3-4666-8c48-cd200dbd5e5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a8b9e1d931342d3a06dcf3d7076f28c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:14.366537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d42c77c3-81f3-4666-8c48-cd200dbd5e5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a8b9e1d931342d3a06dcf3d7076f28c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:14.388841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d42c77c3-81f3-4666-8c48-cd200dbd5e5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a8b9e1d931342d3a06dcf3d7076f28c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:14.435531 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1581/3115] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:08:14 2022] DELETE /identity/v3/users/3a8b9e1d931342d3a06dcf3d7076f28c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:14.440718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd031b5-ee7e-4412-8b3a-15f998cb1292 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:14.441759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd031b5-ee7e-4412-8b3a-15f998cb1292 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:14.442072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd031b5-ee7e-4412-8b3a-15f998cb1292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:14.478981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9bd031b5-ee7e-4412-8b3a-15f998cb1292 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:14.480248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9bd031b5-ee7e-4412-8b3a-15f998cb1292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:14.625957 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1535/3116] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:14.633046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c77c3-81f3-4666-8c48-cd200dbd5e5c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:14.634624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d42c77c3-81f3-4666-8c48-cd200dbd5e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:14.659375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd031b5-ee7e-4412-8b3a-15f998cb1292 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:14.661065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9bd031b5-ee7e-4412-8b3a-15f998cb1292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:14.686354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd031b5-ee7e-4412-8b3a-15f998cb1292 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:14.694079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa8d0a-eb91-470c-b6e9-e7328046e16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:14.695853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa8d0a-eb91-470c-b6e9-e7328046e16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:14.696307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa8d0a-eb91-470c-b6e9-e7328046e16c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:14.696770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa8d0a-eb91-470c-b6e9-e7328046e16c admin admin] PATH_INFO: `/v3/projects/c188b782e83f45fabc149f9293772616` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:14.700094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa8d0a-eb91-470c-b6e9-e7328046e16c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c188b782e83f45fabc149f9293772616)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:14.700581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa8d0a-eb91-470c-b6e9-e7328046e16c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:14.738918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c77c3-81f3-4666-8c48-cd200dbd5e5c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:14.745575 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4be55-bce2-4256-845a-805588c782bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:14.748067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4be55-bce2-4256-845a-805588c782bc service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:14.748959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4be55-bce2-4256-845a-805588c782bc service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:14.749449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4be55-bce2-4256-845a-805588c782bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:14.754226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:14.761302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4be55-bce2-4256-845a-805588c782bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:14.763506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4be55-bce2-4256-845a-805588c782bc service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:14.777465 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1582/3117] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:14.782261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-28fa8d0a-eb91-470c-b6e9-e7328046e16c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c188b782e83f45fabc149f9293772616', 'request_id': 'req-28fa8d0a-eb91-470c-b6e9-e7328046e16c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:14.790267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-28fa8d0a-eb91-470c-b6e9-e7328046e16c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c188b782e83f45fabc149f9293772616', 'request_id': 'req-28fa8d0a-eb91-470c-b6e9-e7328046e16c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:14.797849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-28fa8d0a-eb91-470c-b6e9-e7328046e16c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c188b782e83f45fabc149f9293772616', 'request_id': 'req-28fa8d0a-eb91-470c-b6e9-e7328046e16c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:14.820450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-28fa8d0a-eb91-470c-b6e9-e7328046e16c admin admin] The token cache is being invalidate because project c188b782e83f45fabc149f9293772616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:08:14.821054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-28fa8d0a-eb91-470c-b6e9-e7328046e16c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:14.821963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-28fa8d0a-eb91-470c-b6e9-e7328046e16c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:14.827972 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1536/3118] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:08:14 2022] DELETE /identity/v3/projects/c188b782e83f45fabc149f9293772616 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:14.830060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636a5ce-0d9c-4e0f-b5cd-e405ce832cd0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:14.830814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636a5ce-0d9c-4e0f-b5cd-e405ce832cd0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:14.831328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636a5ce-0d9c-4e0f-b5cd-e405ce832cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:14.871735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6636a5ce-0d9c-4e0f-b5cd-e405ce832cd0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:14.875453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6636a5ce-0d9c-4e0f-b5cd-e405ce832cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:14.965637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:15.009529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d80a-a698-4b13-a776-b1c667c4ee21 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.010199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d80a-a698-4b13-a776-b1c667c4ee21 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.010586 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1583/3119] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:08:15.010889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d80a-a698-4b13-a776-b1c667c4ee21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.046961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0be4d80a-a698-4b13-a776-b1c667c4ee21 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:15.048442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0be4d80a-a698-4b13-a776-b1c667c4ee21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:15.070915 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1537/3120] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:15.074899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636a5ce-0d9c-4e0f-b5cd-e405ce832cd0 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:15.098702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636a5ce-0d9c-4e0f-b5cd-e405ce832cd0 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:15.105946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f6ef8-9b46-4554-89e5-e42fd4c1c787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:15.106625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f6ef8-9b46-4554-89e5-e42fd4c1c787 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.106907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f6ef8-9b46-4554-89e5-e42fd4c1c787 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.107639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f6ef8-9b46-4554-89e5-e42fd4c1c787 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.107969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f6ef8-9b46-4554-89e5-e42fd4c1c787 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:08:15.108233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f6ef8-9b46-4554-89e5-e42fd4c1c787 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:15.109968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f6ef8-9b46-4554-89e5-e42fd4c1c787 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:15.126361 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1584/3121] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:08:15.128006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4d80a-a698-4b13-a776-b1c667c4ee21 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:15.139543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4d80a-a698-4b13-a776-b1c667c4ee21 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:15.148359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f81543-9696-4bcc-a0ad-97e87541286a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:15.149147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f81543-9696-4bcc-a0ad-97e87541286a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.149505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f81543-9696-4bcc-a0ad-97e87541286a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.149859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f81543-9696-4bcc-a0ad-97e87541286a admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.150669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f81543-9696-4bcc-a0ad-97e87541286a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:15.152690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f81543-9696-4bcc-a0ad-97e87541286a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:15.192819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f6ef8-9b46-4554-89e5-e42fd4c1c787 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:15.196100 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1538/3122] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:08:15 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:08:15.208600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f6ef8-9b46-4554-89e5-e42fd4c1c787 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:15.308484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742f2a9-acdf-4505-929e-cfb236a90045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:15.309438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742f2a9-acdf-4505-929e-cfb236a90045 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.309661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742f2a9-acdf-4505-929e-cfb236a90045 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.310116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742f2a9-acdf-4505-929e-cfb236a90045 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.311188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742f2a9-acdf-4505-929e-cfb236a90045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:15.313194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742f2a9-acdf-4505-929e-cfb236a90045 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:15.349722 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1585/3123] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:08:15 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:08:15.351302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f81543-9696-4bcc-a0ad-97e87541286a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:15.371239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f81543-9696-4bcc-a0ad-97e87541286a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:15.376490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd0d30-3150-466b-918e-cb4cb421aab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:15.377187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd0d30-3150-466b-918e-cb4cb421aab0 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.377454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd0d30-3150-466b-918e-cb4cb421aab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.377760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd0d30-3150-466b-918e-cb4cb421aab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.378535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd0d30-3150-466b-918e-cb4cb421aab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:15.380344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd0d30-3150-466b-918e-cb4cb421aab0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:15.392161 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1539/3124] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:15.397948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742f2a9-acdf-4505-929e-cfb236a90045 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:15.398621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd0d30-3150-466b-918e-cb4cb421aab0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:15.398770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8742f2a9-acdf-4505-929e-cfb236a90045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:15.409685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd0d30-3150-466b-918e-cb4cb421aab0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:15.414583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebdc6bf-fdf4-4644-9ad7-78425a9a4ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:15.415767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdc6bf-fdf4-4644-9ad7-78425a9a4ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.415767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdc6bf-fdf4-4644-9ad7-78425a9a4ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.416032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdc6bf-fdf4-4644-9ad7-78425a9a4ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.416565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebdc6bf-fdf4-4644-9ad7-78425a9a4ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:15.418176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebdc6bf-fdf4-4644-9ad7-78425a9a4ee8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:15.420948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742f2a9-acdf-4505-929e-cfb236a90045 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:15.427069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66bb3a-0e83-45b8-8199-154798e7eec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:15.428321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66bb3a-0e83-45b8-8199-154798e7eec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.428321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66bb3a-0e83-45b8-8199-154798e7eec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.428566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66bb3a-0e83-45b8-8199-154798e7eec4 admin admin] PATH_INFO: `/v3/projects/3e6374f0dc6f46e9b0cdead21e69a4fa` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.429905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66bb3a-0e83-45b8-8199-154798e7eec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6374f0dc6f46e9b0cdead21e69a4fa)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:15.430148 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1540/3125] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:15.431928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66bb3a-0e83-45b8-8199-154798e7eec4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:15.434144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebdc6bf-fdf4-4644-9ad7-78425a9a4ee8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:15.446657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebdc6bf-fdf4-4644-9ad7-78425a9a4ee8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:15.452379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235579c-fbab-42cf-8607-e472cfbbc4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:15.453500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235579c-fbab-42cf-8607-e472cfbbc4f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.453853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235579c-fbab-42cf-8607-e472cfbbc4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.454196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235579c-fbab-42cf-8607-e472cfbbc4f2 admin admin] PATH_INFO: `/v3/projects/7cd138b817eb422591e9bc94163efadd/users/75ae0c662e20465db6b854244a0a61f4/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.470505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235579c-fbab-42cf-8607-e472cfbbc4f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd138b817eb422591e9bc94163efadd, user_id=75ae0c662e20465db6b854244a0a61f4, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:15.473647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235579c-fbab-42cf-8607-e472cfbbc4f2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:15.489385 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1541/3126] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:08:15 2022] PUT /identity/v3/projects/7cd138b817eb422591e9bc94163efadd/users/75ae0c662e20465db6b854244a0a61f4/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:08:15.501018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9c66bb3a-0e83-45b8-8199-154798e7eec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6374f0dc6f46e9b0cdead21e69a4fa', 'request_id': 'req-9c66bb3a-0e83-45b8-8199-154798e7eec4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:15.501285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a12bec-d09c-4c5e-ba63-203fc8e67015 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.501715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a12bec-d09c-4c5e-ba63-203fc8e67015 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.501984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a12bec-d09c-4c5e-ba63-203fc8e67015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.511440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9c66bb3a-0e83-45b8-8199-154798e7eec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6374f0dc6f46e9b0cdead21e69a4fa', 'request_id': 'req-9c66bb3a-0e83-45b8-8199-154798e7eec4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:15.519925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9c66bb3a-0e83-45b8-8199-154798e7eec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6374f0dc6f46e9b0cdead21e69a4fa', 'request_id': 'req-9c66bb3a-0e83-45b8-8199-154798e7eec4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:15.531337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9c66bb3a-0e83-45b8-8199-154798e7eec4 admin admin] The token cache is being invalidate because project 3e6374f0dc6f46e9b0cdead21e69a4fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:08:15.531626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9c66bb3a-0e83-45b8-8199-154798e7eec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:15.532337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9c66bb3a-0e83-45b8-8199-154798e7eec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:15.532756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-39a12bec-d09c-4c5e-ba63-203fc8e67015 None None] MFA Rules not processed for user `75ae0c662e20465db6b854244a0a61f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:15.533984 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1586/3127] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:08:15 2022] DELETE /identity/v3/projects/3e6374f0dc6f46e9b0cdead21e69a4fa => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:15.534423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-39a12bec-d09c-4c5e-ba63-203fc8e67015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:15.538888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a59797-83ed-4b53-bae2-834b9c60b3a9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.539373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a59797-83ed-4b53-bae2-834b9c60b3a9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.539820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a59797-83ed-4b53-bae2-834b9c60b3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.562805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b8a59797-83ed-4b53-bae2-834b9c60b3a9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:15.564071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b8a59797-83ed-4b53-bae2-834b9c60b3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:15.606396 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1542/3128] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:15.610846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a12bec-d09c-4c5e-ba63-203fc8e67015 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:15.612290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-39a12bec-d09c-4c5e-ba63-203fc8e67015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:15.616821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:15.632400 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1587/3129] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:15.641179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e6d2c-bf80-4d46-a9e5-97f12a8e80b9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.641544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e6d2c-bf80-4d46-a9e5-97f12a8e80b9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.641890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e6d2c-bf80-4d46-a9e5-97f12a8e80b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.647520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:15.661068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-582e6d2c-bf80-4d46-a9e5-97f12a8e80b9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:15.662276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-582e6d2c-bf80-4d46-a9e5-97f12a8e80b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:15.670710 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1588/3130] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:08:15.675083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e6d2c-bf80-4d46-a9e5-97f12a8e80b9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:15.680798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a12bec-d09c-4c5e-ba63-203fc8e67015 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:15.685199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e6d2c-bf80-4d46-a9e5-97f12a8e80b9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:15.686090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a865f3-1dc4-429c-8f66-730364003817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:15.686766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a865f3-1dc4-429c-8f66-730364003817 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.687050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a865f3-1dc4-429c-8f66-730364003817 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.687323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a865f3-1dc4-429c-8f66-730364003817 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.688071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a865f3-1dc4-429c-8f66-730364003817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:15.689942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d093c-a86c-4d35-9bb0-b676c155dc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:15.690094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a865f3-1dc4-429c-8f66-730364003817 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:15.690606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d093c-a86c-4d35-9bb0-b676c155dc94 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.690891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d093c-a86c-4d35-9bb0-b676c155dc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.691505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d093c-a86c-4d35-9bb0-b676c155dc94 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.692267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d093c-a86c-4d35-9bb0-b676c155dc94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:08:15.692577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d093c-a86c-4d35-9bb0-b676c155dc94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:15.694181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d093c-a86c-4d35-9bb0-b676c155dc94 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:15.706593 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1589/3131] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:08:15.711394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d093c-a86c-4d35-9bb0-b676c155dc94 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:15.723319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d093c-a86c-4d35-9bb0-b676c155dc94 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:15.727391 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1543/3132] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:08:15 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:08:15.728441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a865f3-1dc4-429c-8f66-730364003817 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:15.784483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc79d39-3dd4-42d1-84dd-c4d1b20ad559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:15.785090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc79d39-3dd4-42d1-84dd-c4d1b20ad559 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.785373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc79d39-3dd4-42d1-84dd-c4d1b20ad559 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.785651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc79d39-3dd4-42d1-84dd-c4d1b20ad559 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.786446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc79d39-3dd4-42d1-84dd-c4d1b20ad559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:15.788301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc79d39-3dd4-42d1-84dd-c4d1b20ad559 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:15.798812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a865f3-1dc4-429c-8f66-730364003817 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:15.806582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af77b4f-1800-46d8-b767-a31319160ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:15.807519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af77b4f-1800-46d8-b767-a31319160ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.807969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af77b4f-1800-46d8-b767-a31319160ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.808450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af77b4f-1800-46d8-b767-a31319160ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.809607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af77b4f-1800-46d8-b767-a31319160ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:15.811811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af77b4f-1800-46d8-b767-a31319160ce9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:15.823623 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1590/3133] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:08:15 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:08:15.827762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc79d39-3dd4-42d1-84dd-c4d1b20ad559 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:15.839513 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1544/3134] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:08:15 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:08:15.843543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af77b4f-1800-46d8-b767-a31319160ce9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:15.855308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af77b4f-1800-46d8-b767-a31319160ce9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:15.904834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc79d39-3dd4-42d1-84dd-c4d1b20ad559 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:15.909979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7b9ff-db06-456a-b8f8-936072e349b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:15.910825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b9ff-db06-456a-b8f8-936072e349b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.911168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b9ff-db06-456a-b8f8-936072e349b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.911511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b9ff-db06-456a-b8f8-936072e349b4 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.912287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7b9ff-db06-456a-b8f8-936072e349b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:15.914288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7b9ff-db06-456a-b8f8-936072e349b4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:15.932780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b366c-705e-4745-b65c-4dd73345b654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:15.933459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b366c-705e-4745-b65c-4dd73345b654 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.933740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b366c-705e-4745-b65c-4dd73345b654 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.934015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b366c-705e-4745-b65c-4dd73345b654 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.934741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b366c-705e-4745-b65c-4dd73345b654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:15.937896 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1591/3135] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:08:15 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:08:15.938116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b366c-705e-4745-b65c-4dd73345b654 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:15.940892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7b9ff-db06-456a-b8f8-936072e349b4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:15.948108 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1545/3136] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:15.951475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7b9ff-db06-456a-b8f8-936072e349b4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:15.951977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b366c-705e-4745-b65c-4dd73345b654 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:15.959502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c1aae-d0af-4df4-9df9-7f55074a1d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:15.960248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c1aae-d0af-4df4-9df9-7f55074a1d3a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.960533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c1aae-d0af-4df4-9df9-7f55074a1d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.961533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c1aae-d0af-4df4-9df9-7f55074a1d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.961891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b366c-705e-4745-b65c-4dd73345b654 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:15.962269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c1aae-d0af-4df4-9df9-7f55074a1d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:15.963899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c1aae-d0af-4df4-9df9-7f55074a1d3a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:15.966436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f7bee-f10f-448c-8427-638395afddfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:15.967330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f7bee-f10f-448c-8427-638395afddfc admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.967610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f7bee-f10f-448c-8427-638395afddfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.967885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f7bee-f10f-448c-8427-638395afddfc admin admin] PATH_INFO: `/v3/projects/009d610a379a4f4ca7144c40cbb997a9/users/990c295a34444e15bc39e48a5708265c/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:15.977756 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1592/3137] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:15.978877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c1aae-d0af-4df4-9df9-7f55074a1d3a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:15.984221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f7bee-f10f-448c-8427-638395afddfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=009d610a379a4f4ca7144c40cbb997a9, user_id=990c295a34444e15bc39e48a5708265c, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:15.986938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f7bee-f10f-448c-8427-638395afddfc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:15.992565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c1aae-d0af-4df4-9df9-7f55074a1d3a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:15.997829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f52e7b-1c1a-46c7-b175-a7f432c95af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:15.998598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f52e7b-1c1a-46c7-b175-a7f432c95af4 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:15.999309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f52e7b-1c1a-46c7-b175-a7f432c95af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:15.999645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f52e7b-1c1a-46c7-b175-a7f432c95af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:16.000511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f52e7b-1c1a-46c7-b175-a7f432c95af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:16.002552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f52e7b-1c1a-46c7-b175-a7f432c95af4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:16.004786 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1546/3138] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:08:15 2022] PUT /identity/v3/projects/009d610a379a4f4ca7144c40cbb997a9/users/990c295a34444e15bc39e48a5708265c/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:08:16.008875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f7bee-f10f-448c-8427-638395afddfc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:16.015888 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1593/3139] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:16.020747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f52e7b-1c1a-46c7-b175-a7f432c95af4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:16.033874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:16.036240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f52e7b-1c1a-46c7-b175-a7f432c95af4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:16.061716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:16.084720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f7bee-f10f-448c-8427-638395afddfc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:16.096306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b34944-8252-4de1-be46-ba6589188c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:16.096734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b34944-8252-4de1-be46-ba6589188c4c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:16.097069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b34944-8252-4de1-be46-ba6589188c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:16.097353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b34944-8252-4de1-be46-ba6589188c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:16.098077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b34944-8252-4de1-be46-ba6589188c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:16.099711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b34944-8252-4de1-be46-ba6589188c4c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:16.104099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8518a-6022-4536-8115-0f1f8bfd3171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:16.105175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8518a-6022-4536-8115-0f1f8bfd3171 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:16.105467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8518a-6022-4536-8115-0f1f8bfd3171 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:16.105747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8518a-6022-4536-8115-0f1f8bfd3171 admin admin] PATH_INFO: `/v3/projects/c8d4f80c124f406c8b97e6f9f77b2249/users/363483eb93ab469384ea6d81ee1c88cb/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:16.110658 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1547/3140] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:16.115189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b34944-8252-4de1-be46-ba6589188c4c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:16.122933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8518a-6022-4536-8115-0f1f8bfd3171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d4f80c124f406c8b97e6f9f77b2249, user_id=363483eb93ab469384ea6d81ee1c88cb, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:16.125699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8518a-6022-4536-8115-0f1f8bfd3171 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:16.127147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b34944-8252-4de1-be46-ba6589188c4c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:16.132689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30ec86-87af-4737-8b85-f194f77dfb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:16.133778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30ec86-87af-4737-8b85-f194f77dfb72 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:16.134104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30ec86-87af-4737-8b85-f194f77dfb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:16.134623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30ec86-87af-4737-8b85-f194f77dfb72 admin admin] PATH_INFO: `/v3/projects/009d610a379a4f4ca7144c40cbb997a9/users/990c295a34444e15bc39e48a5708265c/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:16.136931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30ec86-87af-4737-8b85-f194f77dfb72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=009d610a379a4f4ca7144c40cbb997a9, user_id=990c295a34444e15bc39e48a5708265c, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:16.139773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30ec86-87af-4737-8b85-f194f77dfb72 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:16.144082 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1594/3141] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:08:16 2022] PUT /identity/v3/projects/c8d4f80c124f406c8b97e6f9f77b2249/users/363483eb93ab469384ea6d81ee1c88cb/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:16.148915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cd5a5-8e84-40fd-8704-d7412a479425 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:16.149328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cd5a5-8e84-40fd-8704-d7412a479425 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:16.149798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cd5a5-8e84-40fd-8704-d7412a479425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:16.150679 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1548/3142] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:08:16 2022] PUT /identity/v3/projects/009d610a379a4f4ca7144c40cbb997a9/users/990c295a34444e15bc39e48a5708265c/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:08:16.161395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193e3b1-35cb-4be9-a688-87b0c8bc547e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:16.161805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193e3b1-35cb-4be9-a688-87b0c8bc547e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:16.162847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193e3b1-35cb-4be9-a688-87b0c8bc547e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:16.167822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-984cd5a5-8e84-40fd-8704-d7412a479425 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:16.169650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-984cd5a5-8e84-40fd-8704-d7412a479425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:16.191638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8193e3b1-35cb-4be9-a688-87b0c8bc547e None None] MFA Rules not processed for user `990c295a34444e15bc39e48a5708265c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:16.192978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8193e3b1-35cb-4be9-a688-87b0c8bc547e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:16.236323 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1595/3143] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:08:16.248646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cd5a5-8e84-40fd-8704-d7412a479425 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:16.250055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-984cd5a5-8e84-40fd-8704-d7412a479425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:16.286146 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1549/3144] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:08:16.301201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa4d14-2363-4943-b285-5088a05461dc None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:16.301579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa4d14-2363-4943-b285-5088a05461dc None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:16.301789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa4d14-2363-4943-b285-5088a05461dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:16.320633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-16aa4d14-2363-4943-b285-5088a05461dc None None] MFA Rules not processed for user `75ae0c662e20465db6b854244a0a61f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:16.321866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-16aa4d14-2363-4943-b285-5088a05461dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:16.322104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cd5a5-8e84-40fd-8704-d7412a479425 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:16.327250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476de2ce-4fb5-4362-8538-9bbfc2d8bb10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:16.327554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476de2ce-4fb5-4362-8538-9bbfc2d8bb10 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:16.327830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476de2ce-4fb5-4362-8538-9bbfc2d8bb10 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:16.328182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476de2ce-4fb5-4362-8538-9bbfc2d8bb10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:16.337852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476de2ce-4fb5-4362-8538-9bbfc2d8bb10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:16.339302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476de2ce-4fb5-4362-8538-9bbfc2d8bb10 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:16.351355 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1596/3145] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:08:16.407396 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1550/3146] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:16.611246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476de2ce-4fb5-4362-8538-9bbfc2d8bb10 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:16.611246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-476de2ce-4fb5-4362-8538-9bbfc2d8bb10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:16.682601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:16.708832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476de2ce-4fb5-4362-8538-9bbfc2d8bb10 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:16.717846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d81e3-dde8-4d58-aa8c-16483d3ae3ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:16.718597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d81e3-dde8-4d58-aa8c-16483d3ae3ad service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:16.718883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d81e3-dde8-4d58-aa8c-16483d3ae3ad service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:16.719154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d81e3-dde8-4d58-aa8c-16483d3ae3ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:16.730473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d81e3-dde8-4d58-aa8c-16483d3ae3ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:16.732799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d81e3-dde8-4d58-aa8c-16483d3ae3ad service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:16.744441 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1597/3147] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:23.874927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a7379-519f-4538-9570-561143fdc364 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:23.875437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a7379-519f-4538-9570-561143fdc364 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:23.875546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a7379-519f-4538-9570-561143fdc364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:23.938775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d34a7379-519f-4538-9570-561143fdc364 None None] MFA Rules not processed for user `363483eb93ab469384ea6d81ee1c88cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:23.939977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d34a7379-519f-4538-9570-561143fdc364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:23.973120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:24.058588 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1551/3148] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:24.070943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d81e3-dde8-4d58-aa8c-16483d3ae3ad service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:24.074102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-524d81e3-dde8-4d58-aa8c-16483d3ae3ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:24.093535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d81e3-dde8-4d58-aa8c-16483d3ae3ad service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:24.105132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211e3dc-9f68-407b-b03f-fbd0d689859a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:24.105429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211e3dc-9f68-407b-b03f-fbd0d689859a service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:24.107830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211e3dc-9f68-407b-b03f-fbd0d689859a service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:24.107830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211e3dc-9f68-407b-b03f-fbd0d689859a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:24.130864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211e3dc-9f68-407b-b03f-fbd0d689859a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:24.132537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211e3dc-9f68-407b-b03f-fbd0d689859a service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:24.159294 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1598/3149] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:27.584660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dc508-91a0-42ef-a541-907a2b364978 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:27.585555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dc508-91a0-42ef-a541-907a2b364978 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:27.585830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dc508-91a0-42ef-a541-907a2b364978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:27.604872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c75dc508-91a0-42ef-a541-907a2b364978 None None] MFA Rules not processed for user `8b345a42784d4df79caab6d667117418`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:27.606441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c75dc508-91a0-42ef-a541-907a2b364978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:27.666580 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1552/3150] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:28.994194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211e3dc-9f68-407b-b03f-fbd0d689859a service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:28.998940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f211e3dc-9f68-407b-b03f-fbd0d689859a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:29.016369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211e3dc-9f68-407b-b03f-fbd0d689859a service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:29.022345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cc212-dac9-4905-99bb-62c9ba0c11ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:29.023352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc212-dac9-4905-99bb-62c9ba0c11ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:29.023744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc212-dac9-4905-99bb-62c9ba0c11ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:29.024144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc212-dac9-4905-99bb-62c9ba0c11ac admin admin] PATH_INFO: `/v3/users/27059ad6d23e4faf8f09c22cf6ee1475` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:29.025447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cc212-dac9-4905-99bb-62c9ba0c11ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=27059ad6d23e4faf8f09c22cf6ee1475)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:29.027791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cc212-dac9-4905-99bb-62c9ba0c11ac admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:29.113167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-220cc212-dac9-4905-99bb-62c9ba0c11ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27059ad6d23e4faf8f09c22cf6ee1475'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:29.123496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-220cc212-dac9-4905-99bb-62c9ba0c11ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27059ad6d23e4faf8f09c22cf6ee1475'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:29.124993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-220cc212-dac9-4905-99bb-62c9ba0c11ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27059ad6d23e4faf8f09c22cf6ee1475'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:29.125888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-220cc212-dac9-4905-99bb-62c9ba0c11ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27059ad6d23e4faf8f09c22cf6ee1475'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:29.140495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-220cc212-dac9-4905-99bb-62c9ba0c11ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27059ad6d23e4faf8f09c22cf6ee1475'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:29.167332 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1599/3151] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:08:28 2022] DELETE /identity/v3/users/27059ad6d23e4faf8f09c22cf6ee1475 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:29.625275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dc508-91a0-42ef-a541-907a2b364978 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:29.637522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dc508-91a0-42ef-a541-907a2b364978 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:29.711050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a37e67-5685-4c2a-bb7d-4f2842fbc555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:29.712091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a37e67-5685-4c2a-bb7d-4f2842fbc555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:29.712436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a37e67-5685-4c2a-bb7d-4f2842fbc555 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:29.712794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a37e67-5685-4c2a-bb7d-4f2842fbc555 admin admin] PATH_INFO: `/v3/projects/73fe5e9f9b7e401488333f601eaa80ac` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:29.714041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a37e67-5685-4c2a-bb7d-4f2842fbc555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73fe5e9f9b7e401488333f601eaa80ac)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:29.715985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a37e67-5685-4c2a-bb7d-4f2842fbc555 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:29.766119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7a37e67-5685-4c2a-bb7d-4f2842fbc555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73fe5e9f9b7e401488333f601eaa80ac', 'request_id': 'req-e7a37e67-5685-4c2a-bb7d-4f2842fbc555'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:29.772827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7a37e67-5685-4c2a-bb7d-4f2842fbc555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73fe5e9f9b7e401488333f601eaa80ac', 'request_id': 'req-e7a37e67-5685-4c2a-bb7d-4f2842fbc555'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:29.778377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7a37e67-5685-4c2a-bb7d-4f2842fbc555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73fe5e9f9b7e401488333f601eaa80ac', 'request_id': 'req-e7a37e67-5685-4c2a-bb7d-4f2842fbc555'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:29.782331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:29.793825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7a37e67-5685-4c2a-bb7d-4f2842fbc555 admin admin] The token cache is being invalidate because project 73fe5e9f9b7e401488333f601eaa80ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:08:29.794599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7a37e67-5685-4c2a-bb7d-4f2842fbc555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:29.795777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7a37e67-5685-4c2a-bb7d-4f2842fbc555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:29.801170 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1553/3152] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:08:29 2022] DELETE /identity/v3/projects/73fe5e9f9b7e401488333f601eaa80ac => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:08:29.802756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a20bd5-9b4f-4273-bdbf-dea904ea2e8c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:29.803046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a20bd5-9b4f-4273-bdbf-dea904ea2e8c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:29.803317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a20bd5-9b4f-4273-bdbf-dea904ea2e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:29.822626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f5a20bd5-9b4f-4273-bdbf-dea904ea2e8c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:29.823738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f5a20bd5-9b4f-4273-bdbf-dea904ea2e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:29.888937 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1600/3153] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:29.896677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc60014-39e9-4bb4-9359-dff47dcf95cd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:29.896970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc60014-39e9-4bb4-9359-dff47dcf95cd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:29.897251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc60014-39e9-4bb4-9359-dff47dcf95cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:29.917241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-dbc60014-39e9-4bb4-9359-dff47dcf95cd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:29.918477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dbc60014-39e9-4bb4-9359-dff47dcf95cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:29.927111 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1554/3154] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:29.933244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a20bd5-9b4f-4273-bdbf-dea904ea2e8c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:29.945316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a20bd5-9b4f-4273-bdbf-dea904ea2e8c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:29.950493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c8cec-3f98-4db1-b919-7bcd0e286c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:29.951679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c8cec-3f98-4db1-b919-7bcd0e286c8d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:29.951968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c8cec-3f98-4db1-b919-7bcd0e286c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:29.952279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c8cec-3f98-4db1-b919-7bcd0e286c8d admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:29.953012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c8cec-3f98-4db1-b919-7bcd0e286c8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:08:29.953321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c8cec-3f98-4db1-b919-7bcd0e286c8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:29.954945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c8cec-3f98-4db1-b919-7bcd0e286c8d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:29.967228 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1601/3155] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:08:29.971542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc60014-39e9-4bb4-9359-dff47dcf95cd None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:29.981510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc60014-39e9-4bb4-9359-dff47dcf95cd None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:29.987997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2498d3-5009-4ad5-80d0-69dd08fa091d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:29.988705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2498d3-5009-4ad5-80d0-69dd08fa091d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:29.988983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2498d3-5009-4ad5-80d0-69dd08fa091d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:29.989246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2498d3-5009-4ad5-80d0-69dd08fa091d admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:29.989941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2498d3-5009-4ad5-80d0-69dd08fa091d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:29.992281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2498d3-5009-4ad5-80d0-69dd08fa091d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:30.027097 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1555/3156] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:08:29 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:08:30.031673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c8cec-3f98-4db1-b919-7bcd0e286c8d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:30.043655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c8cec-3f98-4db1-b919-7bcd0e286c8d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:30.076012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:30.129641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf33d7-4083-41bb-b59e-825ef11c43fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:30.131288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf33d7-4083-41bb-b59e-825ef11c43fa admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:30.131288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf33d7-4083-41bb-b59e-825ef11c43fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:30.131582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf33d7-4083-41bb-b59e-825ef11c43fa admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:30.132478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf33d7-4083-41bb-b59e-825ef11c43fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:30.134842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf33d7-4083-41bb-b59e-825ef11c43fa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:30.167230 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1602/3157] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:08:30 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:08:30.169058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2498d3-5009-4ad5-80d0-69dd08fa091d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:30.193977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2498d3-5009-4ad5-80d0-69dd08fa091d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:30.205553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cf4e2-ed72-4c80-a33e-4f1b1dcda0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:30.206412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cf4e2-ed72-4c80-a33e-4f1b1dcda0cf admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:30.206786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cf4e2-ed72-4c80-a33e-4f1b1dcda0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:30.207155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cf4e2-ed72-4c80-a33e-4f1b1dcda0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:30.207990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61cf4e2-ed72-4c80-a33e-4f1b1dcda0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:30.216060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61cf4e2-ed72-4c80-a33e-4f1b1dcda0cf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:30.228082 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1556/3158] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:30.232021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf33d7-4083-41bb-b59e-825ef11c43fa admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:30.248374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf33d7-4083-41bb-b59e-825ef11c43fa admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:30.254615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c08d2-a382-46bc-ad1a-d8920d23a0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:30.255302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c08d2-a382-46bc-ad1a-d8920d23a0ff admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:30.255583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c08d2-a382-46bc-ad1a-d8920d23a0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:30.255860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c08d2-a382-46bc-ad1a-d8920d23a0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:30.257341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c08d2-a382-46bc-ad1a-d8920d23a0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:30.258271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c08d2-a382-46bc-ad1a-d8920d23a0ff admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:30.274505 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1603/3159] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:30.275652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cf4e2-ed72-4c80-a33e-4f1b1dcda0cf admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:30.296329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cf4e2-ed72-4c80-a33e-4f1b1dcda0cf admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:30.311720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820e3a8-b15d-4d20-a7bd-2920223f2c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:30.314156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820e3a8-b15d-4d20-a7bd-2920223f2c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:30.314747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820e3a8-b15d-4d20-a7bd-2920223f2c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:30.315254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820e3a8-b15d-4d20-a7bd-2920223f2c83 admin admin] PATH_INFO: `/v3/projects/90cdcd51251b4b8b8b58802cdbc1713c/users/8b412fbcf382468c97d7d4f688f5e5b3/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:30.338684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820e3a8-b15d-4d20-a7bd-2920223f2c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90cdcd51251b4b8b8b58802cdbc1713c, user_id=8b412fbcf382468c97d7d4f688f5e5b3, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:30.341775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820e3a8-b15d-4d20-a7bd-2920223f2c83 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:30.368167 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1557/3160] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:08:30 2022] PUT /identity/v3/projects/90cdcd51251b4b8b8b58802cdbc1713c/users/8b412fbcf382468c97d7d4f688f5e5b3/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:30.372442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558e4b0-52fb-47aa-b148-2b654b42fec2 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:30.372993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558e4b0-52fb-47aa-b148-2b654b42fec2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:30.372993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558e4b0-52fb-47aa-b148-2b654b42fec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:30.414221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4558e4b0-52fb-47aa-b148-2b654b42fec2 None None] MFA Rules not processed for user `8b412fbcf382468c97d7d4f688f5e5b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:30.416218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4558e4b0-52fb-47aa-b148-2b654b42fec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:30.495166 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1604/3161] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:30.506050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4287f-eb6d-4202-ae99-cc5483df0440 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:30.506339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4287f-eb6d-4202-ae99-cc5483df0440 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:30.506697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4287f-eb6d-4202-ae99-cc5483df0440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:30.524112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-68d4287f-eb6d-4202-ae99-cc5483df0440 None None] MFA Rules not processed for user `8b412fbcf382468c97d7d4f688f5e5b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:30.525326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-68d4287f-eb6d-4202-ae99-cc5483df0440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:30.541242 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1558/3162] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:30.558299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558e4b0-52fb-47aa-b148-2b654b42fec2 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:30.559751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4558e4b0-52fb-47aa-b148-2b654b42fec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:30.664097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558e4b0-52fb-47aa-b148-2b654b42fec2 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:30.670898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f22df2-4cf3-43b4-9f00-50c76dc0fe6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:30.671597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f22df2-4cf3-43b4-9f00-50c76dc0fe6a service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:30.671948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f22df2-4cf3-43b4-9f00-50c76dc0fe6a service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:30.672320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f22df2-4cf3-43b4-9f00-50c76dc0fe6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:30.681129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f22df2-4cf3-43b4-9f00-50c76dc0fe6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:30.682752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f22df2-4cf3-43b4-9f00-50c76dc0fe6a service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:30.696630 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1605/3163] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:31.641585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a25bf0-77e0-4087-9f4b-8fb84bd0fc5f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:31.642431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a25bf0-77e0-4087-9f4b-8fb84bd0fc5f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:31.642881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a25bf0-77e0-4087-9f4b-8fb84bd0fc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:31.688023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-76a25bf0-77e0-4087-9f4b-8fb84bd0fc5f None None] MFA Rules not processed for user `8b412fbcf382468c97d7d4f688f5e5b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:31.690395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-76a25bf0-77e0-4087-9f4b-8fb84bd0fc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:31.719177 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1559/3164] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:33.752351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e22f8-d38a-4b71-b5c9-0cd2d733e8a5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:33.752928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e22f8-d38a-4b71-b5c9-0cd2d733e8a5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:33.752928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e22f8-d38a-4b71-b5c9-0cd2d733e8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:33.791217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6c7e22f8-d38a-4b71-b5c9-0cd2d733e8a5 None None] MFA Rules not processed for user `3fefe83ec0664f6188af74ea4b5c1291`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:33.797740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6c7e22f8-d38a-4b71-b5c9-0cd2d733e8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:33.830160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:33.924640 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1606/3165] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:37.573011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a25bf0-77e0-4087-9f4b-8fb84bd0fc5f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:37.575393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-76a25bf0-77e0-4087-9f4b-8fb84bd0fc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:37.689681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a25bf0-77e0-4087-9f4b-8fb84bd0fc5f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:37.696237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb9966-7e16-4deb-ad9e-953806db7cf8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:37.696904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb9966-7e16-4deb-ad9e-953806db7cf8 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:37.697361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb9966-7e16-4deb-ad9e-953806db7cf8 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:37.697822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb9966-7e16-4deb-ad9e-953806db7cf8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:37.700843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4cdb9966-7e16-4deb-ad9e-953806db7cf8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:37.714954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb9966-7e16-4deb-ad9e-953806db7cf8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:37.716596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb9966-7e16-4deb-ad9e-953806db7cf8 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:37.728580 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1560/3166] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:08:39.837460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e22f8-d38a-4b71-b5c9-0cd2d733e8a5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:39.854714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e22f8-d38a-4b71-b5c9-0cd2d733e8a5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:39.861709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897eece7-fc0e-4bcb-b234-502b9d747589 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:39.862726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eece7-fc0e-4bcb-b234-502b9d747589 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:39.863255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eece7-fc0e-4bcb-b234-502b9d747589 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:39.863704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eece7-fc0e-4bcb-b234-502b9d747589 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:39.865608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-897eece7-fc0e-4bcb-b234-502b9d747589 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:39.989183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897eece7-fc0e-4bcb-b234-502b9d747589 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:40.013807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897eece7-fc0e-4bcb-b234-502b9d747589 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:40.031412 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1607/3167] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:42.244266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb9966-7e16-4deb-ad9e-953806db7cf8 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:42.244870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4cdb9966-7e16-4deb-ad9e-953806db7cf8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:42.268633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb9966-7e16-4deb-ad9e-953806db7cf8 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:42.285620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7f81c-b164-4aeb-8be2-09af254b9aa8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:42.286563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7f81c-b164-4aeb-8be2-09af254b9aa8 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:42.286834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7f81c-b164-4aeb-8be2-09af254b9aa8 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:42.287326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7f81c-b164-4aeb-8be2-09af254b9aa8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:42.289642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4cc7f81c-b164-4aeb-8be2-09af254b9aa8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:42.321506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7f81c-b164-4aeb-8be2-09af254b9aa8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:42.323326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7f81c-b164-4aeb-8be2-09af254b9aa8 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:42.342101 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1561/3168] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:42.388814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897eece7-fc0e-4bcb-b234-502b9d747589 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:42.390293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-897eece7-fc0e-4bcb-b234-502b9d747589 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:42.500493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897eece7-fc0e-4bcb-b234-502b9d747589 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:42.505831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267078fd-2afb-49d7-95d6-5f5fb189d2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:42.507448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267078fd-2afb-49d7-95d6-5f5fb189d2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:42.509102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267078fd-2afb-49d7-95d6-5f5fb189d2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:42.509599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267078fd-2afb-49d7-95d6-5f5fb189d2a3 admin admin] PATH_INFO: `/v3/users/363483eb93ab469384ea6d81ee1c88cb` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:42.512799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267078fd-2afb-49d7-95d6-5f5fb189d2a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=363483eb93ab469384ea6d81ee1c88cb)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:42.515981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267078fd-2afb-49d7-95d6-5f5fb189d2a3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:42.582149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-267078fd-2afb-49d7-95d6-5f5fb189d2a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '363483eb93ab469384ea6d81ee1c88cb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:42.597484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-267078fd-2afb-49d7-95d6-5f5fb189d2a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '363483eb93ab469384ea6d81ee1c88cb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:42.598114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-267078fd-2afb-49d7-95d6-5f5fb189d2a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '363483eb93ab469384ea6d81ee1c88cb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:42.598721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-267078fd-2afb-49d7-95d6-5f5fb189d2a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '363483eb93ab469384ea6d81ee1c88cb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:42.605197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:42.611629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-267078fd-2afb-49d7-95d6-5f5fb189d2a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '363483eb93ab469384ea6d81ee1c88cb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:42.634083 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1608/3169] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:08:42 2022] DELETE /identity/v3/users/363483eb93ab469384ea6d81ee1c88cb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:42.850105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7f81c-b164-4aeb-8be2-09af254b9aa8 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:42.860560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7f81c-b164-4aeb-8be2-09af254b9aa8 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:42.915070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:42.924005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2e60d-85dd-430f-a441-5b2e3618ef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:42.925424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2e60d-85dd-430f-a441-5b2e3618ef34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:42.926279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2e60d-85dd-430f-a441-5b2e3618ef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:42.926558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2e60d-85dd-430f-a441-5b2e3618ef34 admin admin] PATH_INFO: `/v3/projects/c8d4f80c124f406c8b97e6f9f77b2249` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:42.928027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2e60d-85dd-430f-a441-5b2e3618ef34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d4f80c124f406c8b97e6f9f77b2249)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:42.929999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2e60d-85dd-430f-a441-5b2e3618ef34 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:42.979504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-07f2e60d-85dd-430f-a441-5b2e3618ef34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d4f80c124f406c8b97e6f9f77b2249', 'request_id': 'req-07f2e60d-85dd-430f-a441-5b2e3618ef34'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:42.986519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-07f2e60d-85dd-430f-a441-5b2e3618ef34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d4f80c124f406c8b97e6f9f77b2249', 'request_id': 'req-07f2e60d-85dd-430f-a441-5b2e3618ef34'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:42.997756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-07f2e60d-85dd-430f-a441-5b2e3618ef34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d4f80c124f406c8b97e6f9f77b2249', 'request_id': 'req-07f2e60d-85dd-430f-a441-5b2e3618ef34'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:43.016670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-07f2e60d-85dd-430f-a441-5b2e3618ef34 admin admin] The token cache is being invalidate because project c8d4f80c124f406c8b97e6f9f77b2249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:08:43.016966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-07f2e60d-85dd-430f-a441-5b2e3618ef34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:43.017813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-07f2e60d-85dd-430f-a441-5b2e3618ef34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:43.019840 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1562/3170] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:08:42 2022] DELETE /identity/v3/projects/c8d4f80c124f406c8b97e6f9f77b2249 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:43.032871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f348c6d-6e79-4d85-b910-2eeb9f9c2e7c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:43.032871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f348c6d-6e79-4d85-b910-2eeb9f9c2e7c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:43.032871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f348c6d-6e79-4d85-b910-2eeb9f9c2e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:43.047473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4f348c6d-6e79-4d85-b910-2eeb9f9c2e7c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:43.048752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4f348c6d-6e79-4d85-b910-2eeb9f9c2e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:43.114968 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1609/3171] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:43.122925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b73a7c-ce59-4958-809a-bc18d0d0f054 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:43.123244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b73a7c-ce59-4958-809a-bc18d0d0f054 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:43.123518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b73a7c-ce59-4958-809a-bc18d0d0f054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:43.141907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-83b73a7c-ce59-4958-809a-bc18d0d0f054 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:43.143114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-83b73a7c-ce59-4958-809a-bc18d0d0f054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:43.151357 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1563/3172] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:08:43.155520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f348c6d-6e79-4d85-b910-2eeb9f9c2e7c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:43.165242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f348c6d-6e79-4d85-b910-2eeb9f9c2e7c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:43.169908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4eb31-0bc5-4cf8-9c50-ff0a85e342c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:43.170592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4eb31-0bc5-4cf8-9c50-ff0a85e342c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:43.170853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4eb31-0bc5-4cf8-9c50-ff0a85e342c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:43.171488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4eb31-0bc5-4cf8-9c50-ff0a85e342c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:43.172265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4eb31-0bc5-4cf8-9c50-ff0a85e342c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:08:43.172560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4eb31-0bc5-4cf8-9c50-ff0a85e342c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:43.174160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4eb31-0bc5-4cf8-9c50-ff0a85e342c5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:43.185656 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1610/3173] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:08:43.189929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b73a7c-ce59-4958-809a-bc18d0d0f054 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:43.199595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b73a7c-ce59-4958-809a-bc18d0d0f054 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:43.204737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ec1c9-af8f-4e6a-b802-9a358dd6084b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:43.205405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ec1c9-af8f-4e6a-b802-9a358dd6084b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:43.205689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ec1c9-af8f-4e6a-b802-9a358dd6084b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:43.205994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ec1c9-af8f-4e6a-b802-9a358dd6084b admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:43.206769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ec1c9-af8f-4e6a-b802-9a358dd6084b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:43.208775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ec1c9-af8f-4e6a-b802-9a358dd6084b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:43.239009 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1564/3174] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:08:43 2022] POST /identity/v3/projects => generated 411 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:08:43.240135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4eb31-0bc5-4cf8-9c50-ff0a85e342c5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:43.252574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4eb31-0bc5-4cf8-9c50-ff0a85e342c5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:43.323111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e433d-6eb9-4a37-8267-a372ebd8d997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:43.323798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e433d-6eb9-4a37-8267-a372ebd8d997 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:43.324097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e433d-6eb9-4a37-8267-a372ebd8d997 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:43.324507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e433d-6eb9-4a37-8267-a372ebd8d997 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:43.325220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e433d-6eb9-4a37-8267-a372ebd8d997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:43.327174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e433d-6eb9-4a37-8267-a372ebd8d997 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:43.353307 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1611/3175] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:08:43 2022] POST /identity/v3/users => generated 306 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:08:43.357482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ec1c9-af8f-4e6a-b802-9a358dd6084b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:43.369191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ec1c9-af8f-4e6a-b802-9a358dd6084b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:43.374126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26883a69-efb3-4ef2-a9d1-f6f1b8e3c20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:43.374732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26883a69-efb3-4ef2-a9d1-f6f1b8e3c20e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:43.375013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26883a69-efb3-4ef2-a9d1-f6f1b8e3c20e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:43.375424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26883a69-efb3-4ef2-a9d1-f6f1b8e3c20e admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:43.376185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26883a69-efb3-4ef2-a9d1-f6f1b8e3c20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:43.377794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26883a69-efb3-4ef2-a9d1-f6f1b8e3c20e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:43.390016 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1565/3176] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:43.393921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e433d-6eb9-4a37-8267-a372ebd8d997 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:43.406357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e433d-6eb9-4a37-8267-a372ebd8d997 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:43.411357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e021f-1d3c-4fc6-8798-61b5becfb6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:43.412030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e021f-1d3c-4fc6-8798-61b5becfb6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:43.412449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e021f-1d3c-4fc6-8798-61b5becfb6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:43.412637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e021f-1d3c-4fc6-8798-61b5becfb6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:43.413352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e021f-1d3c-4fc6-8798-61b5becfb6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:43.414970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e021f-1d3c-4fc6-8798-61b5becfb6e0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:43.426354 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1612/3177] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:43.430631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26883a69-efb3-4ef2-a9d1-f6f1b8e3c20e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:43.440838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26883a69-efb3-4ef2-a9d1-f6f1b8e3c20e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:43.445792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e9a12-fb68-41a0-8ebd-e40c8df11a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:43.446687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e9a12-fb68-41a0-8ebd-e40c8df11a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:43.446942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e9a12-fb68-41a0-8ebd-e40c8df11a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:43.447220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e9a12-fb68-41a0-8ebd-e40c8df11a53 admin admin] PATH_INFO: `/v3/projects/a54682a0b9f34993a0e616507695307e/users/62a0c1f583944bd092abc02293fcb316/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:43.463006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e9a12-fb68-41a0-8ebd-e40c8df11a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a54682a0b9f34993a0e616507695307e, user_id=62a0c1f583944bd092abc02293fcb316, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:43.466504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e9a12-fb68-41a0-8ebd-e40c8df11a53 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:43.490694 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1566/3178] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:08:43 2022] PUT /identity/v3/projects/a54682a0b9f34993a0e616507695307e/users/62a0c1f583944bd092abc02293fcb316/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:43.496413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5acc0-114b-4c85-a600-57533e830861 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:43.496761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5acc0-114b-4c85-a600-57533e830861 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:43.497105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5acc0-114b-4c85-a600-57533e830861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:43.515699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-72e5acc0-114b-4c85-a600-57533e830861 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:43.516947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-72e5acc0-114b-4c85-a600-57533e830861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:43.557014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:43.586035 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1613/3179] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:43.596069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e9a12-fb68-41a0-8ebd-e40c8df11a53 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:43.602552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d72e9a12-fb68-41a0-8ebd-e40c8df11a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:43.694509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e9a12-fb68-41a0-8ebd-e40c8df11a53 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:43.698303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2633f-08a4-4a30-9325-f83762103bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:43.698954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2633f-08a4-4a30-9325-f83762103bfb service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:43.699237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2633f-08a4-4a30-9325-f83762103bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:43.699515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2633f-08a4-4a30-9325-f83762103bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:43.709971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2633f-08a4-4a30-9325-f83762103bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:43.711433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2633f-08a4-4a30-9325-f83762103bfb service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:43.722748 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1567/3180] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:08:45.006804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9de284-3ae2-4a8e-a6e2-9ea5885d9779 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:45.007697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9de284-3ae2-4a8e-a6e2-9ea5885d9779 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:45.008069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9de284-3ae2-4a8e-a6e2-9ea5885d9779 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:45.009904 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1614/3181] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:08:45.024300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6c9d9-878b-45bc-947b-321586253e71 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:45.024785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6c9d9-878b-45bc-947b-321586253e71 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:45.024893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6c9d9-878b-45bc-947b-321586253e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:45.055318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b8c6c9d9-878b-45bc-947b-321586253e71 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:45.056819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b8c6c9d9-878b-45bc-947b-321586253e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:45.099043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:45.197732 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1568/3182] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:08:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:45.222931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9de284-3ae2-4a8e-a6e2-9ea5885d9779 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:45.225366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0c9de284-3ae2-4a8e-a6e2-9ea5885d9779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:45.244140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9de284-3ae2-4a8e-a6e2-9ea5885d9779 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:45.251828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008ed28-34b2-4838-a611-a839260dfba5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:45.252808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008ed28-34b2-4838-a611-a839260dfba5 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:45.253263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008ed28-34b2-4838-a611-a839260dfba5 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:45.256517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008ed28-34b2-4838-a611-a839260dfba5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:45.276158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008ed28-34b2-4838-a611-a839260dfba5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:45.278678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008ed28-34b2-4838-a611-a839260dfba5 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:45.313217 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1615/3183] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:47.536526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6c9d9-878b-45bc-947b-321586253e71 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:47.537988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b8c6c9d9-878b-45bc-947b-321586253e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:47.556366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6c9d9-878b-45bc-947b-321586253e71 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:47.562288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b477b46-3e7a-468d-9e9e-2e0b57edde7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:47.563398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b477b46-3e7a-468d-9e9e-2e0b57edde7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:47.563772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b477b46-3e7a-468d-9e9e-2e0b57edde7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:47.565143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b477b46-3e7a-468d-9e9e-2e0b57edde7c admin admin] PATH_INFO: `/v3/users/75ae0c662e20465db6b854244a0a61f4` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:47.566553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b477b46-3e7a-468d-9e9e-2e0b57edde7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ae0c662e20465db6b854244a0a61f4)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:47.569282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b477b46-3e7a-468d-9e9e-2e0b57edde7c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:47.686343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0b477b46-3e7a-468d-9e9e-2e0b57edde7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ae0c662e20465db6b854244a0a61f4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:47.703656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0b477b46-3e7a-468d-9e9e-2e0b57edde7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ae0c662e20465db6b854244a0a61f4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:47.714950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0b477b46-3e7a-468d-9e9e-2e0b57edde7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ae0c662e20465db6b854244a0a61f4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:47.715871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0b477b46-3e7a-468d-9e9e-2e0b57edde7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ae0c662e20465db6b854244a0a61f4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:47.717401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0b477b46-3e7a-468d-9e9e-2e0b57edde7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ae0c662e20465db6b854244a0a61f4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:47.754958 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1569/3184] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:08:47 2022] DELETE /identity/v3/users/75ae0c662e20465db6b854244a0a61f4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:47.756166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fe691-5ee9-4911-9f3d-aea726aa562a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:47.756593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fe691-5ee9-4911-9f3d-aea726aa562a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:47.756867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fe691-5ee9-4911-9f3d-aea726aa562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:47.788641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-625fe691-5ee9-4911-9f3d-aea726aa562a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:47.792708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-625fe691-5ee9-4911-9f3d-aea726aa562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:47.962325 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1616/3185] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:47.991326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b477b46-3e7a-468d-9e9e-2e0b57edde7c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:47.993322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0b477b46-3e7a-468d-9e9e-2e0b57edde7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:48.115737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b477b46-3e7a-468d-9e9e-2e0b57edde7c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:48.125696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843acb6-bf42-4b89-a47b-ec958630c7f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:48.126427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843acb6-bf42-4b89-a47b-ec958630c7f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:48.126723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843acb6-bf42-4b89-a47b-ec958630c7f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:48.127296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843acb6-bf42-4b89-a47b-ec958630c7f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:48.145982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843acb6-bf42-4b89-a47b-ec958630c7f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:48.148661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843acb6-bf42-4b89-a47b-ec958630c7f5 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:48.174174 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1570/3186] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:48.656622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fe691-5ee9-4911-9f3d-aea726aa562a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:48.659322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-625fe691-5ee9-4911-9f3d-aea726aa562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:48.685708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fe691-5ee9-4911-9f3d-aea726aa562a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:48.695091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad7447-c3b3-4c37-9ed1-a822a432009d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:48.697589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad7447-c3b3-4c37-9ed1-a822a432009d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:48.698079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad7447-c3b3-4c37-9ed1-a822a432009d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:48.698747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad7447-c3b3-4c37-9ed1-a822a432009d admin admin] PATH_INFO: `/v3/projects/7cd138b817eb422591e9bc94163efadd` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:48.702040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad7447-c3b3-4c37-9ed1-a822a432009d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cd138b817eb422591e9bc94163efadd)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:48.705510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad7447-c3b3-4c37-9ed1-a822a432009d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:48.817783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-90ad7447-c3b3-4c37-9ed1-a822a432009d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd138b817eb422591e9bc94163efadd', 'request_id': 'req-90ad7447-c3b3-4c37-9ed1-a822a432009d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:48.835376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-90ad7447-c3b3-4c37-9ed1-a822a432009d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd138b817eb422591e9bc94163efadd', 'request_id': 'req-90ad7447-c3b3-4c37-9ed1-a822a432009d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:48.847337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-90ad7447-c3b3-4c37-9ed1-a822a432009d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd138b817eb422591e9bc94163efadd', 'request_id': 'req-90ad7447-c3b3-4c37-9ed1-a822a432009d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:48.876271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-90ad7447-c3b3-4c37-9ed1-a822a432009d admin admin] The token cache is being invalidate because project 7cd138b817eb422591e9bc94163efadd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:08:48.876401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-90ad7447-c3b3-4c37-9ed1-a822a432009d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:48.879444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-90ad7447-c3b3-4c37-9ed1-a822a432009d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:48.889867 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1617/3187] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:08:48 2022] DELETE /identity/v3/projects/7cd138b817eb422591e9bc94163efadd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:48.897346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843acb6-bf42-4b89-a47b-ec958630c7f5 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:48.904971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843acb6-bf42-4b89-a47b-ec958630c7f5 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:48.991714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:49.056300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33ff9a-c56f-4f8c-bd2c-512506ba4120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:49.057258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33ff9a-c56f-4f8c-bd2c-512506ba4120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:49.057538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33ff9a-c56f-4f8c-bd2c-512506ba4120 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:49.057812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33ff9a-c56f-4f8c-bd2c-512506ba4120 admin admin] PATH_INFO: `/v3/users/990c295a34444e15bc39e48a5708265c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:49.059289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33ff9a-c56f-4f8c-bd2c-512506ba4120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=990c295a34444e15bc39e48a5708265c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:49.062239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33ff9a-c56f-4f8c-bd2c-512506ba4120 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:49.171046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5d33ff9a-c56f-4f8c-bd2c-512506ba4120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '990c295a34444e15bc39e48a5708265c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:49.196290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5d33ff9a-c56f-4f8c-bd2c-512506ba4120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '990c295a34444e15bc39e48a5708265c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:49.212770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5d33ff9a-c56f-4f8c-bd2c-512506ba4120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '990c295a34444e15bc39e48a5708265c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:49.213562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5d33ff9a-c56f-4f8c-bd2c-512506ba4120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '990c295a34444e15bc39e48a5708265c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:49.214871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5d33ff9a-c56f-4f8c-bd2c-512506ba4120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '990c295a34444e15bc39e48a5708265c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:49.284094 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1571/3188] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:08:48 2022] DELETE /identity/v3/users/990c295a34444e15bc39e48a5708265c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:50.660010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad7447-c3b3-4c37-9ed1-a822a432009d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:50.662208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-90ad7447-c3b3-4c37-9ed1-a822a432009d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:50.692504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad7447-c3b3-4c37-9ed1-a822a432009d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:50.875357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:50.914825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356f982-72a6-4738-af5e-5631ed5c3d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:50.916636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356f982-72a6-4738-af5e-5631ed5c3d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:50.917311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356f982-72a6-4738-af5e-5631ed5c3d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:50.917835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356f982-72a6-4738-af5e-5631ed5c3d32 admin admin] PATH_INFO: `/v3/projects/009d610a379a4f4ca7144c40cbb997a9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:50.920078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356f982-72a6-4738-af5e-5631ed5c3d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=009d610a379a4f4ca7144c40cbb997a9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:50.923810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356f982-72a6-4738-af5e-5631ed5c3d32 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:51.063217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9356f982-72a6-4738-af5e-5631ed5c3d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '009d610a379a4f4ca7144c40cbb997a9', 'request_id': 'req-9356f982-72a6-4738-af5e-5631ed5c3d32'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:51.078369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9356f982-72a6-4738-af5e-5631ed5c3d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '009d610a379a4f4ca7144c40cbb997a9', 'request_id': 'req-9356f982-72a6-4738-af5e-5631ed5c3d32'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:51.103039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9356f982-72a6-4738-af5e-5631ed5c3d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '009d610a379a4f4ca7144c40cbb997a9', 'request_id': 'req-9356f982-72a6-4738-af5e-5631ed5c3d32'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:51.122763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9356f982-72a6-4738-af5e-5631ed5c3d32 admin admin] The token cache is being invalidate because project 009d610a379a4f4ca7144c40cbb997a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:08:51.123005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9356f982-72a6-4738-af5e-5631ed5c3d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:51.123944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9356f982-72a6-4738-af5e-5631ed5c3d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:51.125887 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1618/3189] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:08:50 2022] DELETE /identity/v3/projects/009d610a379a4f4ca7144c40cbb997a9 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:51.135429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91db78a-cf18-4eff-b0c5-2ea31a9df3b0 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:51.135902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91db78a-cf18-4eff-b0c5-2ea31a9df3b0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:51.136500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91db78a-cf18-4eff-b0c5-2ea31a9df3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:51.144978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e2f22-072d-44d9-8124-a12cddecece7 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:51.145505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e2f22-072d-44d9-8124-a12cddecece7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:51.146172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e2f22-072d-44d9-8124-a12cddecece7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:51.161007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c91db78a-cf18-4eff-b0c5-2ea31a9df3b0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:51.162517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c91db78a-cf18-4eff-b0c5-2ea31a9df3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:51.173946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-590e2f22-072d-44d9-8124-a12cddecece7 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:51.175572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-590e2f22-072d-44d9-8124-a12cddecece7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:51.254954 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1619/3190] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:08:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:51.260250 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1572/3191] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:51.265843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee4e3-8a55-4ce9-b584-953fd349c454 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:51.266890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee4e3-8a55-4ce9-b584-953fd349c454 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:51.266890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ee4e3-8a55-4ce9-b584-953fd349c454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:51.272088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91db78a-cf18-4eff-b0c5-2ea31a9df3b0 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:51.273685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c91db78a-cf18-4eff-b0c5-2ea31a9df3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:51.297967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a87ee4e3-8a55-4ce9-b584-953fd349c454 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:51.298735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a87ee4e3-8a55-4ce9-b584-953fd349c454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:51.309722 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1620/3192] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:51.315822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ee4e3-8a55-4ce9-b584-953fd349c454 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:51.330896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ee4e3-8a55-4ce9-b584-953fd349c454 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:51.339140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce75984-32e0-4edc-af99-dbd6ad1d6f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:51.339836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce75984-32e0-4edc-af99-dbd6ad1d6f6f admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:51.340401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce75984-32e0-4edc-af99-dbd6ad1d6f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:51.340675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce75984-32e0-4edc-af99-dbd6ad1d6f6f admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:51.341542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce75984-32e0-4edc-af99-dbd6ad1d6f6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:08:51.342221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce75984-32e0-4edc-af99-dbd6ad1d6f6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:51.343940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce75984-32e0-4edc-af99-dbd6ad1d6f6f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:51.361392 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1621/3193] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:08:51.363101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce75984-32e0-4edc-af99-dbd6ad1d6f6f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:51.379251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:51.383906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce75984-32e0-4edc-af99-dbd6ad1d6f6f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:51.394066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030ff68-9d25-4bc5-a798-5069b9118932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:51.395251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030ff68-9d25-4bc5-a798-5069b9118932 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:51.396203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030ff68-9d25-4bc5-a798-5069b9118932 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:51.396702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030ff68-9d25-4bc5-a798-5069b9118932 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:51.398466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030ff68-9d25-4bc5-a798-5069b9118932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:51.406819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030ff68-9d25-4bc5-a798-5069b9118932 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:51.407485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91db78a-cf18-4eff-b0c5-2ea31a9df3b0 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:51.419230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f81f1-29ff-44b5-9473-e8e901d23eca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:51.420462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f81f1-29ff-44b5-9473-e8e901d23eca service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:51.420764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f81f1-29ff-44b5-9473-e8e901d23eca service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:51.421309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f81f1-29ff-44b5-9473-e8e901d23eca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:51.435899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f81f1-29ff-44b5-9473-e8e901d23eca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:51.438050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f81f1-29ff-44b5-9473-e8e901d23eca service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:51.475979 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1573/3194] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:08:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:08:51.479705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f81f1-29ff-44b5-9473-e8e901d23eca service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:51.488358 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1622/3195] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:08:51 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:08:51.493983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f81f1-29ff-44b5-9473-e8e901d23eca service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:51.726241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feef472-fcc2-472c-bfa4-46f262262e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:51.727983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feef472-fcc2-472c-bfa4-46f262262e05 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:51.728174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feef472-fcc2-472c-bfa4-46f262262e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:51.728484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feef472-fcc2-472c-bfa4-46f262262e05 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:51.729347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feef472-fcc2-472c-bfa4-46f262262e05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:51.731416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feef472-fcc2-472c-bfa4-46f262262e05 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:51.774026 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1574/3196] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:08:51 2022] POST /identity/v3/users => generated 291 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:08:51.776906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030ff68-9d25-4bc5-a798-5069b9118932 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:51.793717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030ff68-9d25-4bc5-a798-5069b9118932 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:51.807140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc637bc7-2c57-42de-ae23-bbbc672e0ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:51.808239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc637bc7-2c57-42de-ae23-bbbc672e0ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:51.810959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc637bc7-2c57-42de-ae23-bbbc672e0ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:51.811427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc637bc7-2c57-42de-ae23-bbbc672e0ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:51.812658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc637bc7-2c57-42de-ae23-bbbc672e0ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:51.814666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc637bc7-2c57-42de-ae23-bbbc672e0ce4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:51.838682 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1623/3197] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:51.842478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feef472-fcc2-472c-bfa4-46f262262e05 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:51.868915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feef472-fcc2-472c-bfa4-46f262262e05 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:51.882643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40212e79-509e-46f3-896a-bd24581be65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:51.886150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40212e79-509e-46f3-896a-bd24581be65e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:51.886640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40212e79-509e-46f3-896a-bd24581be65e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:51.887105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40212e79-509e-46f3-896a-bd24581be65e admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:51.889280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40212e79-509e-46f3-896a-bd24581be65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:51.891415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40212e79-509e-46f3-896a-bd24581be65e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:51.909903 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1575/3198] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:51.917192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc637bc7-2c57-42de-ae23-bbbc672e0ce4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:51.940844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc637bc7-2c57-42de-ae23-bbbc672e0ce4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:51.950725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852269d1-a7eb-4025-88f3-0b47be9baa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:51.951799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852269d1-a7eb-4025-88f3-0b47be9baa62 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:51.952080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852269d1-a7eb-4025-88f3-0b47be9baa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:51.952742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852269d1-a7eb-4025-88f3-0b47be9baa62 admin admin] PATH_INFO: `/v3/projects/3c650a441b5743218dd836516af37205/users/bf06c95dc9e14d47b1fc72579b74edb2/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:51.982900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852269d1-a7eb-4025-88f3-0b47be9baa62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c650a441b5743218dd836516af37205, user_id=bf06c95dc9e14d47b1fc72579b74edb2, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:51.986700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852269d1-a7eb-4025-88f3-0b47be9baa62 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:52.033217 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1624/3199] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:08:51 2022] PUT /identity/v3/projects/3c650a441b5743218dd836516af37205/users/bf06c95dc9e14d47b1fc72579b74edb2/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:52.044271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0bdaa8-99ce-4575-808b-ea20e94ec75e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:52.044806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0bdaa8-99ce-4575-808b-ea20e94ec75e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:52.045284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0bdaa8-99ce-4575-808b-ea20e94ec75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:52.083145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4f0bdaa8-99ce-4575-808b-ea20e94ec75e None None] MFA Rules not processed for user `bf06c95dc9e14d47b1fc72579b74edb2`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:52.084617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4f0bdaa8-99ce-4575-808b-ea20e94ec75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:52.249738 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1576/3200] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:52.558998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852269d1-a7eb-4025-88f3-0b47be9baa62 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:52.563172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-852269d1-a7eb-4025-88f3-0b47be9baa62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:52.597883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:52.759316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852269d1-a7eb-4025-88f3-0b47be9baa62 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:52.771197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33103811-6128-436a-b16a-862801779c0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:52.773859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33103811-6128-436a-b16a-862801779c0f service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:52.774338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33103811-6128-436a-b16a-862801779c0f service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:52.774832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33103811-6128-436a-b16a-862801779c0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:52.809482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33103811-6128-436a-b16a-862801779c0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:52.811730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33103811-6128-436a-b16a-862801779c0f service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:52.826803 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1625/3201] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:52.905614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0bdaa8-99ce-4575-808b-ea20e94ec75e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:52.992478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:53.023721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0bdaa8-99ce-4575-808b-ea20e94ec75e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:53.035792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ed5d4-5c39-4cf4-8a35-7b2efe1acc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:53.037254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ed5d4-5c39-4cf4-8a35-7b2efe1acc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:53.037254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ed5d4-5c39-4cf4-8a35-7b2efe1acc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:53.037604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ed5d4-5c39-4cf4-8a35-7b2efe1acc74 admin admin] PATH_INFO: `/v3/users/bf06c95dc9e14d47b1fc72579b74edb2` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:53.039388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ed5d4-5c39-4cf4-8a35-7b2efe1acc74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf06c95dc9e14d47b1fc72579b74edb2)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:53.041066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ed5d4-5c39-4cf4-8a35-7b2efe1acc74 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:53.167390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5c6ed5d4-5c39-4cf4-8a35-7b2efe1acc74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf06c95dc9e14d47b1fc72579b74edb2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:53.187028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5c6ed5d4-5c39-4cf4-8a35-7b2efe1acc74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf06c95dc9e14d47b1fc72579b74edb2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:53.199672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5c6ed5d4-5c39-4cf4-8a35-7b2efe1acc74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf06c95dc9e14d47b1fc72579b74edb2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:53.200714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5c6ed5d4-5c39-4cf4-8a35-7b2efe1acc74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf06c95dc9e14d47b1fc72579b74edb2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:53.202604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5c6ed5d4-5c39-4cf4-8a35-7b2efe1acc74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf06c95dc9e14d47b1fc72579b74edb2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:53.247342 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1577/3202] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:08:52 2022] DELETE /identity/v3/users/bf06c95dc9e14d47b1fc72579b74edb2 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:53.251077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b329a6-5d12-4a6f-8e13-c0c679f94305 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:53.251536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b329a6-5d12-4a6f-8e13-c0c679f94305 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:53.252014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b329a6-5d12-4a6f-8e13-c0c679f94305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:53.279813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-21b329a6-5d12-4a6f-8e13-c0c679f94305 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:53.281576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-21b329a6-5d12-4a6f-8e13-c0c679f94305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:53.384752 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1626/3203] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:53.394528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ed5d4-5c39-4cf4-8a35-7b2efe1acc74 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:53.396290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5c6ed5d4-5c39-4cf4-8a35-7b2efe1acc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:53.477528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ed5d4-5c39-4cf4-8a35-7b2efe1acc74 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:53.482749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31bd2b-2485-4e99-b7aa-d15e8044f7b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:53.483548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31bd2b-2485-4e99-b7aa-d15e8044f7b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:53.483912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31bd2b-2485-4e99-b7aa-d15e8044f7b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:53.484315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31bd2b-2485-4e99-b7aa-d15e8044f7b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:53.495466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31bd2b-2485-4e99-b7aa-d15e8044f7b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:53.497179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31bd2b-2485-4e99-b7aa-d15e8044f7b0 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:53.508412 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1578/3204] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:53.857786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b329a6-5d12-4a6f-8e13-c0c679f94305 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:53.862265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-21b329a6-5d12-4a6f-8e13-c0c679f94305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:53.903712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b329a6-5d12-4a6f-8e13-c0c679f94305 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:53.913882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d3714-af25-4223-a602-d6662d09d784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:53.916137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d3714-af25-4223-a602-d6662d09d784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:53.916991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d3714-af25-4223-a602-d6662d09d784 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:53.917493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d3714-af25-4223-a602-d6662d09d784 admin admin] PATH_INFO: `/v3/projects/3c650a441b5743218dd836516af37205` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:53.928847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d3714-af25-4223-a602-d6662d09d784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c650a441b5743218dd836516af37205)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:53.931564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d3714-af25-4223-a602-d6662d09d784 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:54.009202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-850d3714-af25-4223-a602-d6662d09d784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c650a441b5743218dd836516af37205', 'request_id': 'req-850d3714-af25-4223-a602-d6662d09d784'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:54.021105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-850d3714-af25-4223-a602-d6662d09d784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c650a441b5743218dd836516af37205', 'request_id': 'req-850d3714-af25-4223-a602-d6662d09d784'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:54.030888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-850d3714-af25-4223-a602-d6662d09d784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c650a441b5743218dd836516af37205', 'request_id': 'req-850d3714-af25-4223-a602-d6662d09d784'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:54.055426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-850d3714-af25-4223-a602-d6662d09d784 admin admin] The token cache is being invalidate because project 3c650a441b5743218dd836516af37205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:08:54.055806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-850d3714-af25-4223-a602-d6662d09d784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:54.057600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-850d3714-af25-4223-a602-d6662d09d784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:54.065352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad5905-1eea-4c06-b329-8b7d0f9827b6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:54.065840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad5905-1eea-4c06-b329-8b7d0f9827b6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:54.066769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad5905-1eea-4c06-b329-8b7d0f9827b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:54.066908 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1627/3205] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:08:53 2022] DELETE /identity/v3/projects/3c650a441b5743218dd836516af37205 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:54.098569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-93ad5905-1eea-4c06-b329-8b7d0f9827b6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:54.099803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-93ad5905-1eea-4c06-b329-8b7d0f9827b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:54.186612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67d7f-d4a8-4768-9ed6-74f85ff1dd26 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:54.187181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67d7f-d4a8-4768-9ed6-74f85ff1dd26 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:54.187616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67d7f-d4a8-4768-9ed6-74f85ff1dd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:54.224956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-89d67d7f-d4a8-4768-9ed6-74f85ff1dd26 None None] MFA Rules not processed for user `62a0c1f583944bd092abc02293fcb316`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:54.226067 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1579/3206] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:54.226198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-89d67d7f-d4a8-4768-9ed6-74f85ff1dd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:54.235045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99336c33-e65a-4d68-994f-f06b92c15ee9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:54.236455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99336c33-e65a-4d68-994f-f06b92c15ee9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:54.236932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99336c33-e65a-4d68-994f-f06b92c15ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:54.238148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:54.284156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-99336c33-e65a-4d68-994f-f06b92c15ee9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:54.285459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-99336c33-e65a-4d68-994f-f06b92c15ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:54.308104 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1580/3207] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:54.311709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99336c33-e65a-4d68-994f-f06b92c15ee9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:54.338125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99336c33-e65a-4d68-994f-f06b92c15ee9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:54.350444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777676fa-44ff-4cd4-94ca-c459e88e8da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:54.353097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777676fa-44ff-4cd4-94ca-c459e88e8da7 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:54.353679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777676fa-44ff-4cd4-94ca-c459e88e8da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:54.354183 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1628/3208] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:54 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:08:54.354347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777676fa-44ff-4cd4-94ca-c459e88e8da7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:54.355199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777676fa-44ff-4cd4-94ca-c459e88e8da7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:08:54.355541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777676fa-44ff-4cd4-94ca-c459e88e8da7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:54.358486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777676fa-44ff-4cd4-94ca-c459e88e8da7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:54.362652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:54.363913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00ce1d-9e9c-420e-892c-4077d5417205 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:54.364286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00ce1d-9e9c-420e-892c-4077d5417205 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:54.364630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00ce1d-9e9c-420e-892c-4077d5417205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:54.389685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4c00ce1d-9e9c-420e-892c-4077d5417205 None None] MFA Rules not processed for user `62a0c1f583944bd092abc02293fcb316`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:54.391096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4c00ce1d-9e9c-420e-892c-4077d5417205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:54.393216 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1581/3209] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:08:54.394832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777676fa-44ff-4cd4-94ca-c459e88e8da7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:54.403350 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1629/3210] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:54 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:54.411746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00ce1d-9e9c-420e-892c-4077d5417205 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:54.418373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4c00ce1d-9e9c-420e-892c-4077d5417205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:54.429076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777676fa-44ff-4cd4-94ca-c459e88e8da7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:54.449420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffa5c1-cab3-477e-87b0-21b7c70ec3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:54.450250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffa5c1-cab3-477e-87b0-21b7c70ec3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:54.450414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffa5c1-cab3-477e-87b0-21b7c70ec3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:54.450664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffa5c1-cab3-477e-87b0-21b7c70ec3b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:54.451364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffa5c1-cab3-477e-87b0-21b7c70ec3b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:54.453326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffa5c1-cab3-477e-87b0-21b7c70ec3b6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:54.528251 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1582/3211] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:08:54 2022] POST /identity/v3/projects => generated 361 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:08:54.531531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffa5c1-cab3-477e-87b0-21b7c70ec3b6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:54.552156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00ce1d-9e9c-420e-892c-4077d5417205 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:54.624028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffa5c1-cab3-477e-87b0-21b7c70ec3b6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:54.631783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712da70-a847-422c-9037-ffae817c92d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:54.632670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712da70-a847-422c-9037-ffae817c92d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:54.632954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712da70-a847-422c-9037-ffae817c92d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:54.633260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712da70-a847-422c-9037-ffae817c92d1 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:54.634047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712da70-a847-422c-9037-ffae817c92d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:54.637155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712da70-a847-422c-9037-ffae817c92d1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:54.668471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5bef2-f6a4-44a6-8c77-6e945baf8cd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:54.669344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5bef2-f6a4-44a6-8c77-6e945baf8cd2 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:54.669745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5bef2-f6a4-44a6-8c77-6e945baf8cd2 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:54.670088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5bef2-f6a4-44a6-8c77-6e945baf8cd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:54.676218 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1583/3212] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:08:54 2022] POST /identity/v3/users => generated 281 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:08:54.677746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712da70-a847-422c-9037-ffae817c92d1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:54.702076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712da70-a847-422c-9037-ffae817c92d1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:54.708225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a502cb-96c0-408d-bf6d-084d2557260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:54.709154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a502cb-96c0-408d-bf6d-084d2557260c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:54.709551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a502cb-96c0-408d-bf6d-084d2557260c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:54.709830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a502cb-96c0-408d-bf6d-084d2557260c admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:54.710645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a502cb-96c0-408d-bf6d-084d2557260c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:54.712372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a502cb-96c0-408d-bf6d-084d2557260c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:54.728251 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1584/3213] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:08:54.731911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:54.734140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a502cb-96c0-408d-bf6d-084d2557260c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:54.755612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a502cb-96c0-408d-bf6d-084d2557260c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:54.762870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836ea2b-54df-4bf3-8aaf-4d2c9bf0a523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:54.763178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5bef2-f6a4-44a6-8c77-6e945baf8cd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:54.764002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836ea2b-54df-4bf3-8aaf-4d2c9bf0a523 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:54.764475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836ea2b-54df-4bf3-8aaf-4d2c9bf0a523 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:54.764905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836ea2b-54df-4bf3-8aaf-4d2c9bf0a523 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:54.765783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836ea2b-54df-4bf3-8aaf-4d2c9bf0a523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:54.767500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5bef2-f6a4-44a6-8c77-6e945baf8cd2 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:54.768329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836ea2b-54df-4bf3-8aaf-4d2c9bf0a523 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:54.786191 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1630/3214] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:54 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:08:54.787923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5bef2-f6a4-44a6-8c77-6e945baf8cd2 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:54.797690 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1585/3215] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:54.809248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5bef2-f6a4-44a6-8c77-6e945baf8cd2 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:54.812253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09f3ea-c1e0-47fd-a156-44bfee36e177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:54.813168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09f3ea-c1e0-47fd-a156-44bfee36e177 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:54.813450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09f3ea-c1e0-47fd-a156-44bfee36e177 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:54.813727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09f3ea-c1e0-47fd-a156-44bfee36e177 admin admin] PATH_INFO: `/v3/projects/ac6604f4ab7042229f3ce9de463ea513/users/12d6747cb7d844d9a12df3e67e42be4d/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:54.839022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09f3ea-c1e0-47fd-a156-44bfee36e177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac6604f4ab7042229f3ce9de463ea513, user_id=12d6747cb7d844d9a12df3e67e42be4d, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:54.847718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09f3ea-c1e0-47fd-a156-44bfee36e177 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:54.880936 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1631/3216] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:08:54 2022] PUT /identity/v3/projects/ac6604f4ab7042229f3ce9de463ea513/users/12d6747cb7d844d9a12df3e67e42be4d/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:54.881846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4edbd8-a8c7-4080-878c-a287bf37f124 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:54.881846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4edbd8-a8c7-4080-878c-a287bf37f124 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:54.882064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4edbd8-a8c7-4080-878c-a287bf37f124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:54.933886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-de4edbd8-a8c7-4080-878c-a287bf37f124 None None] MFA Rules not processed for user `12d6747cb7d844d9a12df3e67e42be4d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:54.935527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-de4edbd8-a8c7-4080-878c-a287bf37f124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:55.079901 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1586/3217] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:08:55.674895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09f3ea-c1e0-47fd-a156-44bfee36e177 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:55.676748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3e09f3ea-c1e0-47fd-a156-44bfee36e177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:55.782004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09f3ea-c1e0-47fd-a156-44bfee36e177 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:55.789358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0863345-a99c-4212-9efa-ccfdfe1caf33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:55.790026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0863345-a99c-4212-9efa-ccfdfe1caf33 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:55.790309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0863345-a99c-4212-9efa-ccfdfe1caf33 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:55.790587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0863345-a99c-4212-9efa-ccfdfe1caf33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:55.803535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0863345-a99c-4212-9efa-ccfdfe1caf33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:55.805853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0863345-a99c-4212-9efa-ccfdfe1caf33 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:55.822304 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1632/3218] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:55.891284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4edbd8-a8c7-4080-878c-a287bf37f124 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:56.007812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:56.113439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4edbd8-a8c7-4080-878c-a287bf37f124 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:56.127205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e995bc-b59b-4387-95be-2afa243c5507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:56.128400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e995bc-b59b-4387-95be-2afa243c5507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:56.129587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e995bc-b59b-4387-95be-2afa243c5507 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:56.132124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e995bc-b59b-4387-95be-2afa243c5507 admin admin] PATH_INFO: `/v3/users/12d6747cb7d844d9a12df3e67e42be4d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:56.136144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e995bc-b59b-4387-95be-2afa243c5507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d6747cb7d844d9a12df3e67e42be4d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:56.141495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e995bc-b59b-4387-95be-2afa243c5507 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:56.287794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d4e995bc-b59b-4387-95be-2afa243c5507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d6747cb7d844d9a12df3e67e42be4d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:56.306025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d4e995bc-b59b-4387-95be-2afa243c5507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d6747cb7d844d9a12df3e67e42be4d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:56.320794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d4e995bc-b59b-4387-95be-2afa243c5507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d6747cb7d844d9a12df3e67e42be4d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:56.324465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d4e995bc-b59b-4387-95be-2afa243c5507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d6747cb7d844d9a12df3e67e42be4d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:56.325295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d4e995bc-b59b-4387-95be-2afa243c5507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d6747cb7d844d9a12df3e67e42be4d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:56.393566 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1587/3219] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:08:55 2022] DELETE /identity/v3/users/12d6747cb7d844d9a12df3e67e42be4d => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:56.393787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0c62f-e7e5-4024-95bc-cf5b8c6b6c2f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:56.393787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0c62f-e7e5-4024-95bc-cf5b8c6b6c2f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:56.393787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0c62f-e7e5-4024-95bc-cf5b8c6b6c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:56.432959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f1c0c62f-e7e5-4024-95bc-cf5b8c6b6c2f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:56.438204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f1c0c62f-e7e5-4024-95bc-cf5b8c6b6c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:56.693696 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1633/3220] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:56.700006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e995bc-b59b-4387-95be-2afa243c5507 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:56.702521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d4e995bc-b59b-4387-95be-2afa243c5507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:56.847378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e995bc-b59b-4387-95be-2afa243c5507 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:56.858427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cd43b-1d9d-4d43-8b7e-e2fb93cb3adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:56.859036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cd43b-1d9d-4d43-8b7e-e2fb93cb3adc service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:56.862498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cd43b-1d9d-4d43-8b7e-e2fb93cb3adc service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:56.862745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cd43b-1d9d-4d43-8b7e-e2fb93cb3adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:56.913387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64cd43b-1d9d-4d43-8b7e-e2fb93cb3adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:56.919510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64cd43b-1d9d-4d43-8b7e-e2fb93cb3adc service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:57.006844 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1588/3221] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:57.599785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0c62f-e7e5-4024-95bc-cf5b8c6b6c2f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:57.602484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f1c0c62f-e7e5-4024-95bc-cf5b8c6b6c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:57.635693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0c62f-e7e5-4024-95bc-cf5b8c6b6c2f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:57.650296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562dbf2-f82a-47ce-9fe7-0fc4b7840a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:57.651529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562dbf2-f82a-47ce-9fe7-0fc4b7840a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:57.652028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562dbf2-f82a-47ce-9fe7-0fc4b7840a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:57.652656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562dbf2-f82a-47ce-9fe7-0fc4b7840a38 admin admin] PATH_INFO: `/v3/projects/ac6604f4ab7042229f3ce9de463ea513` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:57.654166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562dbf2-f82a-47ce-9fe7-0fc4b7840a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac6604f4ab7042229f3ce9de463ea513)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:57.661684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562dbf2-f82a-47ce-9fe7-0fc4b7840a38 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:57.748977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:57.775561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9562dbf2-f82a-47ce-9fe7-0fc4b7840a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac6604f4ab7042229f3ce9de463ea513', 'request_id': 'req-9562dbf2-f82a-47ce-9fe7-0fc4b7840a38'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:57.808602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9562dbf2-f82a-47ce-9fe7-0fc4b7840a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac6604f4ab7042229f3ce9de463ea513', 'request_id': 'req-9562dbf2-f82a-47ce-9fe7-0fc4b7840a38'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:57.841102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9562dbf2-f82a-47ce-9fe7-0fc4b7840a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac6604f4ab7042229f3ce9de463ea513', 'request_id': 'req-9562dbf2-f82a-47ce-9fe7-0fc4b7840a38'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:57.886173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9562dbf2-f82a-47ce-9fe7-0fc4b7840a38 admin admin] The token cache is being invalidate because project ac6604f4ab7042229f3ce9de463ea513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:08:57.886412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9562dbf2-f82a-47ce-9fe7-0fc4b7840a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:57.887154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9562dbf2-f82a-47ce-9fe7-0fc4b7840a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:08:57.890681 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1634/3222] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:08:57 2022] DELETE /identity/v3/projects/ac6604f4ab7042229f3ce9de463ea513 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:57.895713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26411e9-cb43-4cdb-b42b-7bd0deb2a69b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:57.896373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26411e9-cb43-4cdb-b42b-7bd0deb2a69b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:57.898156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26411e9-cb43-4cdb-b42b-7bd0deb2a69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:57.945124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f26411e9-cb43-4cdb-b42b-7bd0deb2a69b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:57.950228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f26411e9-cb43-4cdb-b42b-7bd0deb2a69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:58.062797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:58.081108 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1589/3223] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:58.090565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290db69e-b60e-40ed-8076-7e6f33be8ddf None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:58.092602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290db69e-b60e-40ed-8076-7e6f33be8ddf None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:58.094955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290db69e-b60e-40ed-8076-7e6f33be8ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:58.128082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-290db69e-b60e-40ed-8076-7e6f33be8ddf None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:58.129790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-290db69e-b60e-40ed-8076-7e6f33be8ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:58.140156 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1635/3224] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:58.144346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26411e9-cb43-4cdb-b42b-7bd0deb2a69b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:58.160508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26411e9-cb43-4cdb-b42b-7bd0deb2a69b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:58.167983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c561aef-5bd6-47d8-9ded-7966e6cd6dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:58.169736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c561aef-5bd6-47d8-9ded-7966e6cd6dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:58.170404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c561aef-5bd6-47d8-9ded-7966e6cd6dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:58.171105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c561aef-5bd6-47d8-9ded-7966e6cd6dc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:58.172727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c561aef-5bd6-47d8-9ded-7966e6cd6dc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:08:58.173265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c561aef-5bd6-47d8-9ded-7966e6cd6dc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:58.176524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c561aef-5bd6-47d8-9ded-7966e6cd6dc5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:58.201055 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1590/3225] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:08:58.205643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290db69e-b60e-40ed-8076-7e6f33be8ddf None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:58.230141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290db69e-b60e-40ed-8076-7e6f33be8ddf None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:58.237091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15a567-2615-476a-a2d9-ab436408f468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:58.237895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a567-2615-476a-a2d9-ab436408f468 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:58.238180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a567-2615-476a-a2d9-ab436408f468 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:58.238460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a567-2615-476a-a2d9-ab436408f468 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:58.239431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15a567-2615-476a-a2d9-ab436408f468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:58.242037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15a567-2615-476a-a2d9-ab436408f468 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:58.290143 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1636/3226] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:08:58 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:08:58.294156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c561aef-5bd6-47d8-9ded-7966e6cd6dc5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:58.312747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c561aef-5bd6-47d8-9ded-7966e6cd6dc5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:58.467483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05737d6-92cd-419a-add8-5836fdad0454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:58.468246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05737d6-92cd-419a-add8-5836fdad0454 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:58.468537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05737d6-92cd-419a-add8-5836fdad0454 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:58.468818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05737d6-92cd-419a-add8-5836fdad0454 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:58.469533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05737d6-92cd-419a-add8-5836fdad0454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:58.472658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05737d6-92cd-419a-add8-5836fdad0454 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:58.522462 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1591/3227] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:08:58 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:08:58.523500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15a567-2615-476a-a2d9-ab436408f468 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:58.546540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15a567-2615-476a-a2d9-ab436408f468 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:58.552477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845f996-d63e-49ae-884c-96c00a63c713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:58.553503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845f996-d63e-49ae-884c-96c00a63c713 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:58.553947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845f996-d63e-49ae-884c-96c00a63c713 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:58.554385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845f996-d63e-49ae-884c-96c00a63c713 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:58.555488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845f996-d63e-49ae-884c-96c00a63c713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:58.557368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845f996-d63e-49ae-884c-96c00a63c713 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:58.591702 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1637/3228] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:08:58.595787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05737d6-92cd-419a-add8-5836fdad0454 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:58.613010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05737d6-92cd-419a-add8-5836fdad0454 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:58.619959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17167ce-43d7-49de-9560-96f416ff75c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:58.621086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17167ce-43d7-49de-9560-96f416ff75c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:58.621717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17167ce-43d7-49de-9560-96f416ff75c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:58.622222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17167ce-43d7-49de-9560-96f416ff75c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:58.623190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17167ce-43d7-49de-9560-96f416ff75c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:58.625638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17167ce-43d7-49de-9560-96f416ff75c2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:58.646588 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1592/3229] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:08:58.650784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845f996-d63e-49ae-884c-96c00a63c713 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:58.665153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845f996-d63e-49ae-884c-96c00a63c713 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:58.699192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a09671-f9c7-404c-8787-b0861bfdca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:58.699993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a09671-f9c7-404c-8787-b0861bfdca18 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:58.700303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a09671-f9c7-404c-8787-b0861bfdca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:58.700582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a09671-f9c7-404c-8787-b0861bfdca18 admin admin] PATH_INFO: `/v3/projects/d93a2b945dc646148653736a366e67e7/users/1e4df9d2e6b7481f839f36b0ec557949/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:58.745700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a09671-f9c7-404c-8787-b0861bfdca18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93a2b945dc646148653736a366e67e7, user_id=1e4df9d2e6b7481f839f36b0ec557949, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:58.748677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a09671-f9c7-404c-8787-b0861bfdca18 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:58.799688 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1638/3230] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:08:58 2022] PUT /identity/v3/projects/d93a2b945dc646148653736a366e67e7/users/1e4df9d2e6b7481f839f36b0ec557949/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:08:58.805592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6e7e1-c3cb-44d7-950e-fadb6b0ff23e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:58.805982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6e7e1-c3cb-44d7-950e-fadb6b0ff23e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:58.806358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6e7e1-c3cb-44d7-950e-fadb6b0ff23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:58.838113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c3e6e7e1-c3cb-44d7-950e-fadb6b0ff23e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:08:58.839523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c3e6e7e1-c3cb-44d7-950e-fadb6b0ff23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:58.985371 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1593/3231] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:08:59.051286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a09671-f9c7-404c-8787-b0861bfdca18 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:08:59.057016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-76a09671-f9c7-404c-8787-b0861bfdca18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:08:59.202570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a09671-f9c7-404c-8787-b0861bfdca18 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:08:59.211422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c850cd4-529b-4559-bba4-f1e7e065194c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:08:59.212274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c850cd4-529b-4559-bba4-f1e7e065194c service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:08:59.212664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c850cd4-529b-4559-bba4-f1e7e065194c service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:08:59.212998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c850cd4-529b-4559-bba4-f1e7e065194c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:08:59.256115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c850cd4-529b-4559-bba4-f1e7e065194c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:08:59.258556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c850cd4-529b-4559-bba4-f1e7e065194c service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:08:59.274382 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1639/3232] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:08:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:09:08.956970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=70,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:09.267173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=5,keystone:SELECT=64,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:09.785362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85cb2f-ef9c-49dc-9593-ad36657f3e85 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:09.786545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85cb2f-ef9c-49dc-9593-ad36657f3e85 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:09.786993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85cb2f-ef9c-49dc-9593-ad36657f3e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:09.815859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1c85cb2f-ef9c-49dc-9593-ad36657f3e85 None None] MFA Rules not processed for user `8b345a42784d4df79caab6d667117418`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:09.818202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1c85cb2f-ef9c-49dc-9593-ad36657f3e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:09.935380 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1594/3233] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:10.487074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c850cd4-529b-4559-bba4-f1e7e065194c service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:10.488718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0c850cd4-529b-4559-bba4-f1e7e065194c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:10.512749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c850cd4-529b-4559-bba4-f1e7e065194c service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:10.526047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9af0d-f11f-4298-b3f8-9693631b80e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:10.528377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9af0d-f11f-4298-b3f8-9693631b80e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:10.530104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9af0d-f11f-4298-b3f8-9693631b80e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:10.530394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9af0d-f11f-4298-b3f8-9693631b80e4 admin admin] PATH_INFO: `/v3/users/097020096c1c4ff2b67800be67cd708a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:10.535669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9af0d-f11f-4298-b3f8-9693631b80e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=097020096c1c4ff2b67800be67cd708a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:10.537915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9af0d-f11f-4298-b3f8-9693631b80e4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:10.666397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-19c9af0d-f11f-4298-b3f8-9693631b80e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '097020096c1c4ff2b67800be67cd708a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:10.695345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-19c9af0d-f11f-4298-b3f8-9693631b80e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '097020096c1c4ff2b67800be67cd708a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:10.696061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-19c9af0d-f11f-4298-b3f8-9693631b80e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '097020096c1c4ff2b67800be67cd708a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:10.697549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-19c9af0d-f11f-4298-b3f8-9693631b80e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '097020096c1c4ff2b67800be67cd708a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:10.715925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-19c9af0d-f11f-4298-b3f8-9693631b80e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '097020096c1c4ff2b67800be67cd708a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:10.745516 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1640/3234] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:09:10 2022] DELETE /identity/v3/users/097020096c1c4ff2b67800be67cd708a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:11.226113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af5d5f-77d0-4355-8cd6-0576060097f2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:11.226573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af5d5f-77d0-4355-8cd6-0576060097f2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:11.226643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af5d5f-77d0-4355-8cd6-0576060097f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:11.279287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-97af5d5f-77d0-4355-8cd6-0576060097f2 None None] MFA Rules not processed for user `1e4df9d2e6b7481f839f36b0ec557949`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:11.281500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-97af5d5f-77d0-4355-8cd6-0576060097f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:11.362968 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1595/3235] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:11.679606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9af0d-f11f-4298-b3f8-9693631b80e4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:11.682041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-19c9af0d-f11f-4298-b3f8-9693631b80e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:11.792491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af5d5f-77d0-4355-8cd6-0576060097f2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:11.792491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-97af5d5f-77d0-4355-8cd6-0576060097f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:11.810580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9af0d-f11f-4298-b3f8-9693631b80e4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:11.819203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024470a-7a7a-4c0b-87f4-673076ef3077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:11.820437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024470a-7a7a-4c0b-87f4-673076ef3077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:11.820678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024470a-7a7a-4c0b-87f4-673076ef3077 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:11.820948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024470a-7a7a-4c0b-87f4-673076ef3077 admin admin] PATH_INFO: `/v3/projects/426d63ca5cfa48e19a7156d1b848447e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:11.823169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024470a-7a7a-4c0b-87f4-673076ef3077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=426d63ca5cfa48e19a7156d1b848447e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:11.826548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024470a-7a7a-4c0b-87f4-673076ef3077 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:11.959408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af5d5f-77d0-4355-8cd6-0576060097f2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:11.972562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fc269-e4e3-452a-8746-9444115c4c54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:11.974155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fc269-e4e3-452a-8746-9444115c4c54 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:11.974626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fc269-e4e3-452a-8746-9444115c4c54 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:11.975083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fc269-e4e3-452a-8746-9444115c4c54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:12.004511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fc269-e4e3-452a-8746-9444115c4c54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:12.008263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fc269-e4e3-452a-8746-9444115c4c54 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:12.046638 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1596/3236] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:09:12.067581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1024470a-7a7a-4c0b-87f4-673076ef3077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426d63ca5cfa48e19a7156d1b848447e', 'request_id': 'req-1024470a-7a7a-4c0b-87f4-673076ef3077'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:12.130660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1024470a-7a7a-4c0b-87f4-673076ef3077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426d63ca5cfa48e19a7156d1b848447e', 'request_id': 'req-1024470a-7a7a-4c0b-87f4-673076ef3077'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:12.140746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1024470a-7a7a-4c0b-87f4-673076ef3077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426d63ca5cfa48e19a7156d1b848447e', 'request_id': 'req-1024470a-7a7a-4c0b-87f4-673076ef3077'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:12.195645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1024470a-7a7a-4c0b-87f4-673076ef3077 admin admin] The token cache is being invalidate because project 426d63ca5cfa48e19a7156d1b848447e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:09:12.196095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1024470a-7a7a-4c0b-87f4-673076ef3077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:12.198656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1024470a-7a7a-4c0b-87f4-673076ef3077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:12.200740 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1641/3237] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:09:11 2022] DELETE /identity/v3/projects/426d63ca5cfa48e19a7156d1b848447e => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:12.204783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fc269-e4e3-452a-8746-9444115c4c54 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:12.220793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fc269-e4e3-452a-8746-9444115c4c54 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:12.264795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:12.387587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d8949-cfb0-4899-a44a-1fce4ff1e4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:12.388510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d8949-cfb0-4899-a44a-1fce4ff1e4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:12.388790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d8949-cfb0-4899-a44a-1fce4ff1e4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:12.389210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d8949-cfb0-4899-a44a-1fce4ff1e4d6 admin admin] PATH_INFO: `/v3/users/8819f845cd904f8b8cd2a38eb059cb07` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:12.390932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d8949-cfb0-4899-a44a-1fce4ff1e4d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8819f845cd904f8b8cd2a38eb059cb07)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:12.393050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d8949-cfb0-4899-a44a-1fce4ff1e4d6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:12.498405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024470a-7a7a-4c0b-87f4-673076ef3077 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:12.501401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1024470a-7a7a-4c0b-87f4-673076ef3077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:12.523391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:12.549685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024470a-7a7a-4c0b-87f4-673076ef3077 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:12.562313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d10d8949-cfb0-4899-a44a-1fce4ff1e4d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8819f845cd904f8b8cd2a38eb059cb07'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:12.582187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d10d8949-cfb0-4899-a44a-1fce4ff1e4d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8819f845cd904f8b8cd2a38eb059cb07'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:12.585278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88204ae-b059-48b1-992f-d018e82e9074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:12.587172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88204ae-b059-48b1-992f-d018e82e9074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:12.587714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88204ae-b059-48b1-992f-d018e82e9074 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:12.588888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88204ae-b059-48b1-992f-d018e82e9074 admin admin] PATH_INFO: `/v3/users/3fefe83ec0664f6188af74ea4b5c1291` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:12.590714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88204ae-b059-48b1-992f-d018e82e9074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fefe83ec0664f6188af74ea4b5c1291)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:12.594972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88204ae-b059-48b1-992f-d018e82e9074 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:12.622656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d10d8949-cfb0-4899-a44a-1fce4ff1e4d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8819f845cd904f8b8cd2a38eb059cb07'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:12.622656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d10d8949-cfb0-4899-a44a-1fce4ff1e4d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8819f845cd904f8b8cd2a38eb059cb07'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:12.622656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d10d8949-cfb0-4899-a44a-1fce4ff1e4d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8819f845cd904f8b8cd2a38eb059cb07'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:12.706225 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1597/3238] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:09:12 2022] DELETE /identity/v3/users/8819f845cd904f8b8cd2a38eb059cb07 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:12.708086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b88204ae-b059-48b1-992f-d018e82e9074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fefe83ec0664f6188af74ea4b5c1291'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:12.733072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b88204ae-b059-48b1-992f-d018e82e9074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fefe83ec0664f6188af74ea4b5c1291'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:12.733708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b88204ae-b059-48b1-992f-d018e82e9074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fefe83ec0664f6188af74ea4b5c1291'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:12.734359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b88204ae-b059-48b1-992f-d018e82e9074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fefe83ec0664f6188af74ea4b5c1291'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:12.754599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b88204ae-b059-48b1-992f-d018e82e9074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fefe83ec0664f6188af74ea4b5c1291'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:12.814301 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1642/3239] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:09:12 2022] DELETE /identity/v3/users/3fefe83ec0664f6188af74ea4b5c1291 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:13.366495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d8949-cfb0-4899-a44a-1fce4ff1e4d6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:13.368409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d10d8949-cfb0-4899-a44a-1fce4ff1e4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:13.548574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d8949-cfb0-4899-a44a-1fce4ff1e4d6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:13.552350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88204ae-b059-48b1-992f-d018e82e9074 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:13.556619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b88204ae-b059-48b1-992f-d018e82e9074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:13.725849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:13.759139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768424a0-7681-4b22-a18f-f55594d8ddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:13.763859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768424a0-7681-4b22-a18f-f55594d8ddb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:13.764028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768424a0-7681-4b22-a18f-f55594d8ddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:13.764406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768424a0-7681-4b22-a18f-f55594d8ddb9 admin admin] PATH_INFO: `/v3/projects/d942b3d30344459ab6d6b7de865cb085` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:13.768959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768424a0-7681-4b22-a18f-f55594d8ddb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d942b3d30344459ab6d6b7de865cb085)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:13.770606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88204ae-b059-48b1-992f-d018e82e9074 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:13.771438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768424a0-7681-4b22-a18f-f55594d8ddb9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:13.806202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02182d86-e71e-4462-82d1-f148af064dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:13.807107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02182d86-e71e-4462-82d1-f148af064dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:13.807380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02182d86-e71e-4462-82d1-f148af064dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:13.807652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02182d86-e71e-4462-82d1-f148af064dfd admin admin] PATH_INFO: `/v3/projects/8576652bfe8441e0985297d016a1ca9b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:13.809645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02182d86-e71e-4462-82d1-f148af064dfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8576652bfe8441e0985297d016a1ca9b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:13.821774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02182d86-e71e-4462-82d1-f148af064dfd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:13.919522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-768424a0-7681-4b22-a18f-f55594d8ddb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd942b3d30344459ab6d6b7de865cb085', 'request_id': 'req-768424a0-7681-4b22-a18f-f55594d8ddb9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:13.930517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-02182d86-e71e-4462-82d1-f148af064dfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8576652bfe8441e0985297d016a1ca9b', 'request_id': 'req-02182d86-e71e-4462-82d1-f148af064dfd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:13.931484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-768424a0-7681-4b22-a18f-f55594d8ddb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd942b3d30344459ab6d6b7de865cb085', 'request_id': 'req-768424a0-7681-4b22-a18f-f55594d8ddb9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:13.940316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-768424a0-7681-4b22-a18f-f55594d8ddb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd942b3d30344459ab6d6b7de865cb085', 'request_id': 'req-768424a0-7681-4b22-a18f-f55594d8ddb9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:13.969028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-02182d86-e71e-4462-82d1-f148af064dfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8576652bfe8441e0985297d016a1ca9b', 'request_id': 'req-02182d86-e71e-4462-82d1-f148af064dfd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:13.970945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-768424a0-7681-4b22-a18f-f55594d8ddb9 admin admin] The token cache is being invalidate because project d942b3d30344459ab6d6b7de865cb085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:09:13.971490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-768424a0-7681-4b22-a18f-f55594d8ddb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:13.972337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-768424a0-7681-4b22-a18f-f55594d8ddb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:13.979554 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1598/3240] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:09:13 2022] DELETE /identity/v3/projects/d942b3d30344459ab6d6b7de865cb085 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:13.981466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08014cfe-1c58-4283-b223-1c4027c429dc None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:13.981855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08014cfe-1c58-4283-b223-1c4027c429dc None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:13.982253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08014cfe-1c58-4283-b223-1c4027c429dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:13.989614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-02182d86-e71e-4462-82d1-f148af064dfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8576652bfe8441e0985297d016a1ca9b', 'request_id': 'req-02182d86-e71e-4462-82d1-f148af064dfd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:14.013685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-02182d86-e71e-4462-82d1-f148af064dfd admin admin] The token cache is being invalidate because project 8576652bfe8441e0985297d016a1ca9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:09:14.014241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-02182d86-e71e-4462-82d1-f148af064dfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:14.015948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-02182d86-e71e-4462-82d1-f148af064dfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:14.020863 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1643/3241] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:09:13 2022] DELETE /identity/v3/projects/8576652bfe8441e0985297d016a1ca9b => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:09:14.026964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7eca8-21db-445f-8ad1-84d21e7a7a49 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:14.027446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7eca8-21db-445f-8ad1-84d21e7a7a49 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:14.027885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7eca8-21db-445f-8ad1-84d21e7a7a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:14.032878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-08014cfe-1c58-4283-b223-1c4027c429dc None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:14.034466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-08014cfe-1c58-4283-b223-1c4027c429dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:14.041688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:14.066688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d1d7eca8-21db-445f-8ad1-84d21e7a7a49 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:14.069620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d1d7eca8-21db-445f-8ad1-84d21e7a7a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:14.165092 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1599/3242] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:14.166843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019527e-7346-4133-abd9-24a690eea5fd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:14.167130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019527e-7346-4133-abd9-24a690eea5fd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:14.167678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019527e-7346-4133-abd9-24a690eea5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:14.211694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2019527e-7346-4133-abd9-24a690eea5fd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:14.212877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2019527e-7346-4133-abd9-24a690eea5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:14.232669 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1644/3243] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:09:14.233953 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1600/3244] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:09:14.239569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7eca8-21db-445f-8ad1-84d21e7a7a49 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:14.240726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2eaa6-0032-4f84-be34-ac3b186781c3 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:14.241148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2eaa6-0032-4f84-be34-ac3b186781c3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:14.241635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2eaa6-0032-4f84-be34-ac3b186781c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:14.253008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7eca8-21db-445f-8ad1-84d21e7a7a49 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:14.258588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fb146-fb28-410b-8d7b-ff19aa79b1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:14.259370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fb146-fb28-410b-8d7b-ff19aa79b1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:14.259797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fb146-fb28-410b-8d7b-ff19aa79b1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:14.260186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fb146-fb28-410b-8d7b-ff19aa79b1a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:14.261039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fb146-fb28-410b-8d7b-ff19aa79b1a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:09:14.261410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fb146-fb28-410b-8d7b-ff19aa79b1a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:14.263221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fb146-fb28-410b-8d7b-ff19aa79b1a1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:14.280697 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1645/3245] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:09:14.280967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fb146-fb28-410b-8d7b-ff19aa79b1a1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:14.300697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fb146-fb28-410b-8d7b-ff19aa79b1a1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:14.318270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845c79e-39e1-4045-a7ce-baf75922de20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:14.319264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845c79e-39e1-4045-a7ce-baf75922de20 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:14.319751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845c79e-39e1-4045-a7ce-baf75922de20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:14.320100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5ba2eaa6-0032-4f84-be34-ac3b186781c3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:14.320226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845c79e-39e1-4045-a7ce-baf75922de20 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:14.321338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845c79e-39e1-4045-a7ce-baf75922de20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:14.323626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845c79e-39e1-4045-a7ce-baf75922de20 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:14.324740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5ba2eaa6-0032-4f84-be34-ac3b186781c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:14.340947 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1601/3246] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:14.352146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2eaa6-0032-4f84-be34-ac3b186781c3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:14.373020 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1646/3247] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:09:14 2022] POST /identity/v3/projects => generated 395 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:09:14.374022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845c79e-39e1-4045-a7ce-baf75922de20 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:14.375758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2eaa6-0032-4f84-be34-ac3b186781c3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:14.496354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b727e6-b3d6-4762-be7e-b72e233a3332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:14.508564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b727e6-b3d6-4762-be7e-b72e233a3332 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:14.508895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b727e6-b3d6-4762-be7e-b72e233a3332 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:14.509177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b727e6-b3d6-4762-be7e-b72e233a3332 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:14.509975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b727e6-b3d6-4762-be7e-b72e233a3332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:09:14.510764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b727e6-b3d6-4762-be7e-b72e233a3332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:14.512528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b727e6-b3d6-4762-be7e-b72e233a3332 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:14.523672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:14.541280 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1602/3248] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:09:14.542265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b727e6-b3d6-4762-be7e-b72e233a3332 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:14.572732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b727e6-b3d6-4762-be7e-b72e233a3332 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:14.588507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82304d35-4cf0-4369-8817-7a1aebd88d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:14.589196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82304d35-4cf0-4369-8817-7a1aebd88d89 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:14.589810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82304d35-4cf0-4369-8817-7a1aebd88d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:14.590370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82304d35-4cf0-4369-8817-7a1aebd88d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:14.593304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845c79e-39e1-4045-a7ce-baf75922de20 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:14.594071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82304d35-4cf0-4369-8817-7a1aebd88d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:14.598665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82304d35-4cf0-4369-8817-7a1aebd88d89 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:14.607310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b096d58-4206-4df4-8fc0-17c8ef75940f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:14.608420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b096d58-4206-4df4-8fc0-17c8ef75940f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:14.608823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b096d58-4206-4df4-8fc0-17c8ef75940f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:14.609111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b096d58-4206-4df4-8fc0-17c8ef75940f admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:14.613169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b096d58-4206-4df4-8fc0-17c8ef75940f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:14.615303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b096d58-4206-4df4-8fc0-17c8ef75940f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:14.729841 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1647/3249] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:09:14 2022] POST /identity/v3/users => generated 298 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:09:14.731885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b096d58-4206-4df4-8fc0-17c8ef75940f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:14.737512 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1603/3250] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:09:14 2022] POST /identity/v3/projects => generated 397 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:09:14.740493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82304d35-4cf0-4369-8817-7a1aebd88d89 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:14.755429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b096d58-4206-4df4-8fc0-17c8ef75940f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:14.862589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaaf32-6395-4a28-9189-a85b7db80a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:14.864554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaaf32-6395-4a28-9189-a85b7db80a73 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:14.865072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaaf32-6395-4a28-9189-a85b7db80a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:14.865550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaaf32-6395-4a28-9189-a85b7db80a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:14.866508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eaaf32-6395-4a28-9189-a85b7db80a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:14.868465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eaaf32-6395-4a28-9189-a85b7db80a73 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:14.875221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:14.898752 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1648/3251] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:09:14.902498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaaf32-6395-4a28-9189-a85b7db80a73 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:14.927265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaaf32-6395-4a28-9189-a85b7db80a73 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:14.945869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30893-84b1-4ceb-b4f7-b898c1c54ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:14.948413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30893-84b1-4ceb-b4f7-b898c1c54ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:14.950650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30893-84b1-4ceb-b4f7-b898c1c54ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:14.952254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30893-84b1-4ceb-b4f7-b898c1c54ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:14.953856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30893-84b1-4ceb-b4f7-b898c1c54ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:14.954474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82304d35-4cf0-4369-8817-7a1aebd88d89 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:14.961686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30893-84b1-4ceb-b4f7-b898c1c54ed6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:14.976866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9298d6-dbe3-4e31-b36a-831e9cddeba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:14.980639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9298d6-dbe3-4e31-b36a-831e9cddeba5 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:14.980928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9298d6-dbe3-4e31-b36a-831e9cddeba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:14.981795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9298d6-dbe3-4e31-b36a-831e9cddeba5 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:14.982529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9298d6-dbe3-4e31-b36a-831e9cddeba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:14.996671 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1649/3252] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:09:15.001195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9298d6-dbe3-4e31-b36a-831e9cddeba5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:15.002017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30893-84b1-4ceb-b4f7-b898c1c54ed6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:15.021673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30893-84b1-4ceb-b4f7-b898c1c54ed6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:15.041713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef46a9-8721-446b-8d6e-c96b1be4cdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:15.043086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef46a9-8721-446b-8d6e-c96b1be4cdb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:15.043833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef46a9-8721-446b-8d6e-c96b1be4cdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:15.044362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef46a9-8721-446b-8d6e-c96b1be4cdb4 admin admin] PATH_INFO: `/v3/projects/8e7f077e621143d2b88d15523524a992/users/1cd6dc876f6a4812bcf1970c0afe86a7/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:15.085338 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1604/3253] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:09:14 2022] POST /identity/v3/users => generated 299 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:09:15.086152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef46a9-8721-446b-8d6e-c96b1be4cdb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7f077e621143d2b88d15523524a992, user_id=1cd6dc876f6a4812bcf1970c0afe86a7, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:15.090880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef46a9-8721-446b-8d6e-c96b1be4cdb4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:15.099841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9298d6-dbe3-4e31-b36a-831e9cddeba5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:15.127373 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1650/3254] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:09:15 2022] PUT /identity/v3/projects/8e7f077e621143d2b88d15523524a992/users/1cd6dc876f6a4812bcf1970c0afe86a7/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:09:15.140584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea019616-7778-4c6c-be66-d1955c381b51 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:15.141238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea019616-7778-4c6c-be66-d1955c381b51 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:15.141631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea019616-7778-4c6c-be66-d1955c381b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:15.151623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9298d6-dbe3-4e31-b36a-831e9cddeba5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:15.230394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ea019616-7778-4c6c-be66-d1955c381b51 None None] MFA Rules not processed for user `1cd6dc876f6a4812bcf1970c0afe86a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:15.231618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ea019616-7778-4c6c-be66-d1955c381b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:15.361112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4015997-1688-466f-8549-34ad8b92a9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:15.362345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4015997-1688-466f-8549-34ad8b92a9ba admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:15.366522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4015997-1688-466f-8549-34ad8b92a9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:15.378028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4015997-1688-466f-8549-34ad8b92a9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:15.382162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4015997-1688-466f-8549-34ad8b92a9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:15.392782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4015997-1688-466f-8549-34ad8b92a9ba admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:15.426009 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1651/3255] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:09:15.444708 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1605/3256] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:09:15.448950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea019616-7778-4c6c-be66-d1955c381b51 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:15.463312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea019616-7778-4c6c-be66-d1955c381b51 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:15.479150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd0c5f-4e07-407b-ac97-44a48354689b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:15.479903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd0c5f-4e07-407b-ac97-44a48354689b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:15.480228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd0c5f-4e07-407b-ac97-44a48354689b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:15.481937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd0c5f-4e07-407b-ac97-44a48354689b admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:15.482655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd0c5f-4e07-407b-ac97-44a48354689b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:15.484325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd0c5f-4e07-407b-ac97-44a48354689b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:15.492886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4015997-1688-466f-8549-34ad8b92a9ba admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:15.496666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c4015997-1688-466f-8549-34ad8b92a9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:15.516077 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1652/3257] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:09:15.520617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd0c5f-4e07-407b-ac97-44a48354689b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:15.542345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd0c5f-4e07-407b-ac97-44a48354689b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:15.553457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f3ec3-2d88-4ffa-abcc-b081df572a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:15.554831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f3ec3-2d88-4ffa-abcc-b081df572a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:15.555041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f3ec3-2d88-4ffa-abcc-b081df572a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:15.555965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f3ec3-2d88-4ffa-abcc-b081df572a59 admin admin] PATH_INFO: `/v3/projects/90c7a815db0145889cf47ebcca5843f6/users/ae104851a64c4638abd70af95f27d4fa/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:15.595231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f3ec3-2d88-4ffa-abcc-b081df572a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c7a815db0145889cf47ebcca5843f6, user_id=ae104851a64c4638abd70af95f27d4fa, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:15.597961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f3ec3-2d88-4ffa-abcc-b081df572a59 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:15.647162 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1653/3258] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:09:15 2022] PUT /identity/v3/projects/90c7a815db0145889cf47ebcca5843f6/users/ae104851a64c4638abd70af95f27d4fa/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:09:15.652657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe2422-240b-41c9-b003-521d066fed90 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:15.652946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe2422-240b-41c9-b003-521d066fed90 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:15.653265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe2422-240b-41c9-b003-521d066fed90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:15.658693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:15.681647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4015997-1688-466f-8549-34ad8b92a9ba admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:15.700470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-44fe2422-240b-41c9-b003-521d066fed90 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:15.701863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-44fe2422-240b-41c9-b003-521d066fed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:15.793130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c8c19-aa3b-4dff-9d69-58b1fa975b68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:15.808458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c8c19-aa3b-4dff-9d69-58b1fa975b68 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:15.809874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c8c19-aa3b-4dff-9d69-58b1fa975b68 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:15.810368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c8c19-aa3b-4dff-9d69-58b1fa975b68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:15.828378 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1654/3259] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:15.844301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe2422-240b-41c9-b003-521d066fed90 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:15.848383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-44fe2422-240b-41c9-b003-521d066fed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:15.878514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:15.968547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c8c19-aa3b-4dff-9d69-58b1fa975b68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:15.974794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c8c19-aa3b-4dff-9d69-58b1fa975b68 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:16.010237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe2422-240b-41c9-b003-521d066fed90 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:16.019582 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1606/3260] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:09:16.020197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25f4f5-a9a1-4beb-a222-d40d4360d48d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:16.021002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25f4f5-a9a1-4beb-a222-d40d4360d48d service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:16.021287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25f4f5-a9a1-4beb-a222-d40d4360d48d service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:16.021566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25f4f5-a9a1-4beb-a222-d40d4360d48d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:16.033607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0846bb-de9b-4c61-bce6-29ac7c2ea110 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:16.034765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0846bb-de9b-4c61-bce6-29ac7c2ea110 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:16.035179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0846bb-de9b-4c61-bce6-29ac7c2ea110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:16.035979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25f4f5-a9a1-4beb-a222-d40d4360d48d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:16.037511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25f4f5-a9a1-4beb-a222-d40d4360d48d service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:16.069512 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1655/3261] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:09:16.090163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6e0846bb-de9b-4c61-bce6-29ac7c2ea110 None None] MFA Rules not processed for user `1e4df9d2e6b7481f839f36b0ec557949`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:16.094800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6e0846bb-de9b-4c61-bce6-29ac7c2ea110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:16.238521 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1607/3262] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:16.397212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25f4f5-a9a1-4beb-a222-d40d4360d48d service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:16.420513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25f4f5-a9a1-4beb-a222-d40d4360d48d service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:16.432787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39ed01-4047-4892-a083-ed1e5c37e00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:16.433882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39ed01-4047-4892-a083-ed1e5c37e00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:16.436229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39ed01-4047-4892-a083-ed1e5c37e00e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:16.436527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39ed01-4047-4892-a083-ed1e5c37e00e admin admin] PATH_INFO: `/v3/users/1cd6dc876f6a4812bcf1970c0afe86a7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:16.439437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39ed01-4047-4892-a083-ed1e5c37e00e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd6dc876f6a4812bcf1970c0afe86a7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:16.443863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39ed01-4047-4892-a083-ed1e5c37e00e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:16.605686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ae39ed01-4047-4892-a083-ed1e5c37e00e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd6dc876f6a4812bcf1970c0afe86a7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:16.624967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ae39ed01-4047-4892-a083-ed1e5c37e00e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd6dc876f6a4812bcf1970c0afe86a7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:16.626800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ae39ed01-4047-4892-a083-ed1e5c37e00e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd6dc876f6a4812bcf1970c0afe86a7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:16.630127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ae39ed01-4047-4892-a083-ed1e5c37e00e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd6dc876f6a4812bcf1970c0afe86a7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:16.645863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ae39ed01-4047-4892-a083-ed1e5c37e00e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd6dc876f6a4812bcf1970c0afe86a7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:16.680444 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1656/3263] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:09:16 2022] DELETE /identity/v3/users/1cd6dc876f6a4812bcf1970c0afe86a7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:16.684896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92a074-0a76-434c-a323-52b4ad51e442 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:16.685357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92a074-0a76-434c-a323-52b4ad51e442 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:16.685442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92a074-0a76-434c-a323-52b4ad51e442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:16.724486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3d92a074-0a76-434c-a323-52b4ad51e442 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:16.730519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3d92a074-0a76-434c-a323-52b4ad51e442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:16.802676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:16.835588 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1608/3264] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:16.880004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39ed01-4047-4892-a083-ed1e5c37e00e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:16.881755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ae39ed01-4047-4892-a083-ed1e5c37e00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:16.956248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39ed01-4047-4892-a083-ed1e5c37e00e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:16.965906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fde905-3338-4b1e-afcb-a796adb6d1b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:16.966693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fde905-3338-4b1e-afcb-a796adb6d1b4 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:16.994822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fde905-3338-4b1e-afcb-a796adb6d1b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:16.995233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fde905-3338-4b1e-afcb-a796adb6d1b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:17.026428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fde905-3338-4b1e-afcb-a796adb6d1b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:17.027794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fde905-3338-4b1e-afcb-a796adb6d1b4 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:17.054620 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1657/3265] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:09:18.698742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92a074-0a76-434c-a323-52b4ad51e442 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:18.701919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3d92a074-0a76-434c-a323-52b4ad51e442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:18.719114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92a074-0a76-434c-a323-52b4ad51e442 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:18.724406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c87b3-4565-4d63-8343-ab30d3ef3393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:18.725957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c87b3-4565-4d63-8343-ab30d3ef3393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:18.726473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c87b3-4565-4d63-8343-ab30d3ef3393 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:18.726960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c87b3-4565-4d63-8343-ab30d3ef3393 admin admin] PATH_INFO: `/v3/projects/8e7f077e621143d2b88d15523524a992` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:18.728488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c87b3-4565-4d63-8343-ab30d3ef3393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7f077e621143d2b88d15523524a992)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:18.730698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c87b3-4565-4d63-8343-ab30d3ef3393 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:18.797034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-979c87b3-4565-4d63-8343-ab30d3ef3393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7f077e621143d2b88d15523524a992', 'request_id': 'req-979c87b3-4565-4d63-8343-ab30d3ef3393'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:18.809567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-979c87b3-4565-4d63-8343-ab30d3ef3393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7f077e621143d2b88d15523524a992', 'request_id': 'req-979c87b3-4565-4d63-8343-ab30d3ef3393'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:18.822006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-979c87b3-4565-4d63-8343-ab30d3ef3393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7f077e621143d2b88d15523524a992', 'request_id': 'req-979c87b3-4565-4d63-8343-ab30d3ef3393'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:18.871401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-979c87b3-4565-4d63-8343-ab30d3ef3393 admin admin] The token cache is being invalidate because project 8e7f077e621143d2b88d15523524a992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:09:18.871918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-979c87b3-4565-4d63-8343-ab30d3ef3393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:18.873887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-979c87b3-4565-4d63-8343-ab30d3ef3393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:18.879362 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1609/3266] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:09:18 2022] DELETE /identity/v3/projects/8e7f077e621143d2b88d15523524a992 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:18.881740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa55e62-4136-4e39-9b4b-15caee8c955b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:18.882233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa55e62-4136-4e39-9b4b-15caee8c955b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:18.882478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa55e62-4136-4e39-9b4b-15caee8c955b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:18.914874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1fa55e62-4136-4e39-9b4b-15caee8c955b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:18.916165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1fa55e62-4136-4e39-9b4b-15caee8c955b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:18.991908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:19.094595 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1658/3267] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:19.103958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407c5db-bf8e-41d7-b4f2-65a14ce021c7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:19.104576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407c5db-bf8e-41d7-b4f2-65a14ce021c7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:19.104861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407c5db-bf8e-41d7-b4f2-65a14ce021c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:19.143694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa55e62-4136-4e39-9b4b-15caee8c955b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:19.145989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1fa55e62-4136-4e39-9b4b-15caee8c955b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:19.162556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3407c5db-bf8e-41d7-b4f2-65a14ce021c7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:19.166399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3407c5db-bf8e-41d7-b4f2-65a14ce021c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:19.178008 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1610/3268] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:19.182631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407c5db-bf8e-41d7-b4f2-65a14ce021c7 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:19.202666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407c5db-bf8e-41d7-b4f2-65a14ce021c7 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:19.212324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631b848-e037-4a86-a04e-7e81e4c6d1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:19.213425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631b848-e037-4a86-a04e-7e81e4c6d1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:19.217066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631b848-e037-4a86-a04e-7e81e4c6d1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:19.218337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631b848-e037-4a86-a04e-7e81e4c6d1e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:19.219481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631b848-e037-4a86-a04e-7e81e4c6d1e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:09:19.219990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631b848-e037-4a86-a04e-7e81e4c6d1e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:19.221978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631b848-e037-4a86-a04e-7e81e4c6d1e3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:19.257090 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1611/3269] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:09:19.258514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631b848-e037-4a86-a04e-7e81e4c6d1e3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:19.270160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631b848-e037-4a86-a04e-7e81e4c6d1e3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:19.279964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608e836-3737-4569-a8f6-47873dae20db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:19.286846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608e836-3737-4569-a8f6-47873dae20db admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:19.287498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608e836-3737-4569-a8f6-47873dae20db admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:19.288253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608e836-3737-4569-a8f6-47873dae20db admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:19.289177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608e836-3737-4569-a8f6-47873dae20db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:19.291621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608e836-3737-4569-a8f6-47873dae20db admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:19.301289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa55e62-4136-4e39-9b4b-15caee8c955b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:19.315232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694937f-5ddb-4724-8720-a08ede64a19e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:19.316024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694937f-5ddb-4724-8720-a08ede64a19e service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:19.316432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694937f-5ddb-4724-8720-a08ede64a19e service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:19.316957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694937f-5ddb-4724-8720-a08ede64a19e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:19.320849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f694937f-5ddb-4724-8720-a08ede64a19e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:19.340140 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1612/3270] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:09:19 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:09:19.342138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608e836-3737-4569-a8f6-47873dae20db admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:19.346593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694937f-5ddb-4724-8720-a08ede64a19e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:19.351800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694937f-5ddb-4724-8720-a08ede64a19e service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:19.406613 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1659/3271] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:09:19.489728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608e836-3737-4569-a8f6-47873dae20db admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:19.502324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c045cb-b7d7-492d-bfa0-1e91e0bae7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:19.503051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c045cb-b7d7-492d-bfa0-1e91e0bae7c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:19.503315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c045cb-b7d7-492d-bfa0-1e91e0bae7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:19.503590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c045cb-b7d7-492d-bfa0-1e91e0bae7c2 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:19.504326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c045cb-b7d7-492d-bfa0-1e91e0bae7c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:19.506339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c045cb-b7d7-492d-bfa0-1e91e0bae7c2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:19.563459 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1613/3272] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:09:19 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:09:19.564364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694937f-5ddb-4724-8720-a08ede64a19e service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:19.578703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694937f-5ddb-4724-8720-a08ede64a19e service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:19.590803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ee5e0-e584-462b-a120-4a5a0249016c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:19.600796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ee5e0-e584-462b-a120-4a5a0249016c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:19.600796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ee5e0-e584-462b-a120-4a5a0249016c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:19.600796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ee5e0-e584-462b-a120-4a5a0249016c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:19.600796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ee5e0-e584-462b-a120-4a5a0249016c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:19.600796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ee5e0-e584-462b-a120-4a5a0249016c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:19.619510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c045cb-b7d7-492d-bfa0-1e91e0bae7c2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:19.626417 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1660/3273] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:09:19.630969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c045cb-b7d7-492d-bfa0-1e91e0bae7c2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:19.637124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16427d6a-e263-4992-bf14-170d90a1c3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:19.637928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16427d6a-e263-4992-bf14-170d90a1c3dd admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:19.638369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16427d6a-e263-4992-bf14-170d90a1c3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:19.638915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16427d6a-e263-4992-bf14-170d90a1c3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:19.639853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16427d6a-e263-4992-bf14-170d90a1c3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:19.641832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16427d6a-e263-4992-bf14-170d90a1c3dd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:19.662336 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1614/3274] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:09:19.663868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ee5e0-e584-462b-a120-4a5a0249016c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:19.686546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ee5e0-e584-462b-a120-4a5a0249016c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:19.702411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f9a75-0fa2-4c0f-981d-2c65c09d33e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:19.703499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f9a75-0fa2-4c0f-981d-2c65c09d33e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:19.703812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f9a75-0fa2-4c0f-981d-2c65c09d33e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:19.704022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f9a75-0fa2-4c0f-981d-2c65c09d33e7 admin admin] PATH_INFO: `/v3/projects/06805320ad824cdfa235bde734d4bfb3/users/fc6a12832de045808553a7a28e86cea3/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:19.727417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f9a75-0fa2-4c0f-981d-2c65c09d33e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06805320ad824cdfa235bde734d4bfb3, user_id=fc6a12832de045808553a7a28e86cea3, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:19.730833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f9a75-0fa2-4c0f-981d-2c65c09d33e7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:19.757200 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1661/3275] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:09:19 2022] PUT /identity/v3/projects/06805320ad824cdfa235bde734d4bfb3/users/fc6a12832de045808553a7a28e86cea3/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:09:19.771965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bdff7-1992-4862-b21b-51135f3e63a9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:19.772589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bdff7-1992-4862-b21b-51135f3e63a9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:19.772589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bdff7-1992-4862-b21b-51135f3e63a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:19.779234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:19.854844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d25bdff7-1992-4862-b21b-51135f3e63a9 None None] MFA Rules not processed for user `fc6a12832de045808553a7a28e86cea3`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:19.854844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d25bdff7-1992-4862-b21b-51135f3e63a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:20.042070 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1615/3276] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:20.145988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f9a75-0fa2-4c0f-981d-2c65c09d33e7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:20.149047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-702f9a75-0fa2-4c0f-981d-2c65c09d33e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:20.277584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f9a75-0fa2-4c0f-981d-2c65c09d33e7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:20.285813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c882505-99a1-4aa3-aadf-d3598a076c86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:20.286435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c882505-99a1-4aa3-aadf-d3598a076c86 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:20.286942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c882505-99a1-4aa3-aadf-d3598a076c86 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:20.287436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c882505-99a1-4aa3-aadf-d3598a076c86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:20.297479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c882505-99a1-4aa3-aadf-d3598a076c86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:20.299664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c882505-99a1-4aa3-aadf-d3598a076c86 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:20.310918 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1662/3277] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:09:20.644928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bdff7-1992-4862-b21b-51135f3e63a9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:20.762581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bdff7-1992-4862-b21b-51135f3e63a9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:20.768450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf62ee-8ff3-474a-aefa-461e69beffee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:20.769527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf62ee-8ff3-474a-aefa-461e69beffee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:20.769976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf62ee-8ff3-474a-aefa-461e69beffee admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:20.770384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf62ee-8ff3-474a-aefa-461e69beffee admin admin] PATH_INFO: `/v3/users/fc6a12832de045808553a7a28e86cea3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:20.771911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf62ee-8ff3-474a-aefa-461e69beffee admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc6a12832de045808553a7a28e86cea3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:20.774188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf62ee-8ff3-474a-aefa-461e69beffee admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:20.841947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5fdf62ee-8ff3-474a-aefa-461e69beffee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc6a12832de045808553a7a28e86cea3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:20.855310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5fdf62ee-8ff3-474a-aefa-461e69beffee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc6a12832de045808553a7a28e86cea3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:20.872723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5fdf62ee-8ff3-474a-aefa-461e69beffee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc6a12832de045808553a7a28e86cea3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:20.874214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5fdf62ee-8ff3-474a-aefa-461e69beffee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc6a12832de045808553a7a28e86cea3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:20.875669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5fdf62ee-8ff3-474a-aefa-461e69beffee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc6a12832de045808553a7a28e86cea3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:20.903632 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1616/3278] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:09:20 2022] DELETE /identity/v3/users/fc6a12832de045808553a7a28e86cea3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:20.905155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942903d6-0171-42be-9ddb-441e1a07deb8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:20.905449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942903d6-0171-42be-9ddb-441e1a07deb8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:20.905728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942903d6-0171-42be-9ddb-441e1a07deb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:20.926383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-942903d6-0171-42be-9ddb-441e1a07deb8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:20.928771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-942903d6-0171-42be-9ddb-441e1a07deb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:20.939895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:21.014408 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1663/3279] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:21.029405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf62ee-8ff3-474a-aefa-461e69beffee admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:21.031054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5fdf62ee-8ff3-474a-aefa-461e69beffee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:21.055496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:21.155680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf62ee-8ff3-474a-aefa-461e69beffee admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:21.162637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c6900-8e10-4c78-8be2-3ec167e45077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:21.163704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c6900-8e10-4c78-8be2-3ec167e45077 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:21.164330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c6900-8e10-4c78-8be2-3ec167e45077 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:21.164839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c6900-8e10-4c78-8be2-3ec167e45077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:21.187671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c6900-8e10-4c78-8be2-3ec167e45077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:21.189191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c6900-8e10-4c78-8be2-3ec167e45077 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:21.202717 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1617/3280] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:09:22.369468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942903d6-0171-42be-9ddb-441e1a07deb8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:22.373359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-942903d6-0171-42be-9ddb-441e1a07deb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:22.386988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942903d6-0171-42be-9ddb-441e1a07deb8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:22.393555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93185b6-09bd-456d-8e7d-e09a7bddcae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:22.394911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93185b6-09bd-456d-8e7d-e09a7bddcae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:22.395338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93185b6-09bd-456d-8e7d-e09a7bddcae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:22.395786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93185b6-09bd-456d-8e7d-e09a7bddcae8 admin admin] PATH_INFO: `/v3/projects/06805320ad824cdfa235bde734d4bfb3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:22.397489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93185b6-09bd-456d-8e7d-e09a7bddcae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06805320ad824cdfa235bde734d4bfb3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:22.399847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93185b6-09bd-456d-8e7d-e09a7bddcae8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:22.473105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f93185b6-09bd-456d-8e7d-e09a7bddcae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06805320ad824cdfa235bde734d4bfb3', 'request_id': 'req-f93185b6-09bd-456d-8e7d-e09a7bddcae8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:22.485593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f93185b6-09bd-456d-8e7d-e09a7bddcae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06805320ad824cdfa235bde734d4bfb3', 'request_id': 'req-f93185b6-09bd-456d-8e7d-e09a7bddcae8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:22.495383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f93185b6-09bd-456d-8e7d-e09a7bddcae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06805320ad824cdfa235bde734d4bfb3', 'request_id': 'req-f93185b6-09bd-456d-8e7d-e09a7bddcae8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:22.513859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f93185b6-09bd-456d-8e7d-e09a7bddcae8 admin admin] The token cache is being invalidate because project 06805320ad824cdfa235bde734d4bfb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:09:22.514315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f93185b6-09bd-456d-8e7d-e09a7bddcae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:22.515612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f93185b6-09bd-456d-8e7d-e09a7bddcae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:22.517310 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1664/3281] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:09:22 2022] DELETE /identity/v3/projects/06805320ad824cdfa235bde734d4bfb3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:22.530673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b6854-c01e-4aea-b80b-805c77e418b5 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:22.531269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b6854-c01e-4aea-b80b-805c77e418b5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:22.531269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b6854-c01e-4aea-b80b-805c77e418b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:22.552681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-db8b6854-c01e-4aea-b80b-805c77e418b5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:22.554563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-db8b6854-c01e-4aea-b80b-805c77e418b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:22.715835 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1618/3282] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:22.723627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f06d0-8f03-4c6f-a3aa-fbe30c8b9928 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:22.724008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f06d0-8f03-4c6f-a3aa-fbe30c8b9928 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:22.724308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f06d0-8f03-4c6f-a3aa-fbe30c8b9928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:22.751282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9d9f06d0-8f03-4c6f-a3aa-fbe30c8b9928 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:22.752678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9d9f06d0-8f03-4c6f-a3aa-fbe30c8b9928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:22.765048 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1665/3283] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:22.766508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b6854-c01e-4aea-b80b-805c77e418b5 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:22.779629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b6854-c01e-4aea-b80b-805c77e418b5 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:22.786453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8f213-21bd-4d9f-b5ab-9bb311a2e28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:22.788153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8f213-21bd-4d9f-b5ab-9bb311a2e28e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:22.788678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8f213-21bd-4d9f-b5ab-9bb311a2e28e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:22.789154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8f213-21bd-4d9f-b5ab-9bb311a2e28e admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:22.790105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8f213-21bd-4d9f-b5ab-9bb311a2e28e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:09:22.790624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8f213-21bd-4d9f-b5ab-9bb311a2e28e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:22.795182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8f213-21bd-4d9f-b5ab-9bb311a2e28e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:22.814195 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1619/3284] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:09:22.818835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f06d0-8f03-4c6f-a3aa-fbe30c8b9928 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:22.830572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f06d0-8f03-4c6f-a3aa-fbe30c8b9928 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:22.837375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48debc0-a458-4dbf-bd8f-ee08f832a500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:22.838266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48debc0-a458-4dbf-bd8f-ee08f832a500 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:22.838568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48debc0-a458-4dbf-bd8f-ee08f832a500 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:22.839232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48debc0-a458-4dbf-bd8f-ee08f832a500 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:22.839550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48debc0-a458-4dbf-bd8f-ee08f832a500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:22.842082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48debc0-a458-4dbf-bd8f-ee08f832a500 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:22.889755 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1666/3285] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:09:22 2022] POST /identity/v3/projects => generated 397 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:09:22.891883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8f213-21bd-4d9f-b5ab-9bb311a2e28e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:22.904698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8f213-21bd-4d9f-b5ab-9bb311a2e28e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:22.997701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb6b05-2c3b-4caa-a3bb-5d53b689dc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:22.998879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb6b05-2c3b-4caa-a3bb-5d53b689dc2a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:22.999392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb6b05-2c3b-4caa-a3bb-5d53b689dc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:23.002291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb6b05-2c3b-4caa-a3bb-5d53b689dc2a admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:23.003541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb6b05-2c3b-4caa-a3bb-5d53b689dc2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:23.005861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb6b05-2c3b-4caa-a3bb-5d53b689dc2a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:23.045696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48debc0-a458-4dbf-bd8f-ee08f832a500 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:23.047156 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1620/3286] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:09:22 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:09:23.058728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48debc0-a458-4dbf-bd8f-ee08f832a500 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:23.064177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ed401-0f40-4bdb-92d9-502f5b4768f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:23.064859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ed401-0f40-4bdb-92d9-502f5b4768f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:23.065144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ed401-0f40-4bdb-92d9-502f5b4768f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:23.065419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ed401-0f40-4bdb-92d9-502f5b4768f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:23.066159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ed401-0f40-4bdb-92d9-502f5b4768f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:23.067931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ed401-0f40-4bdb-92d9-502f5b4768f3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:23.084095 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1667/3287] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:09:23.087832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb6b05-2c3b-4caa-a3bb-5d53b689dc2a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:23.101991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb6b05-2c3b-4caa-a3bb-5d53b689dc2a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:23.110083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f76927-c214-4f71-9314-0f83496aa3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:23.111516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f76927-c214-4f71-9314-0f83496aa3df admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:23.111890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f76927-c214-4f71-9314-0f83496aa3df admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:23.112299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f76927-c214-4f71-9314-0f83496aa3df admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:23.113126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f76927-c214-4f71-9314-0f83496aa3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:23.115688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f76927-c214-4f71-9314-0f83496aa3df admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:23.141496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ed401-0f40-4bdb-92d9-502f5b4768f3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:23.161488 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1621/3288] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:09:23.166030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ed401-0f40-4bdb-92d9-502f5b4768f3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:23.176149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af7cf4-fd9f-42fc-ab6e-c0c80119f9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:23.177729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af7cf4-fd9f-42fc-ab6e-c0c80119f9fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:23.178897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af7cf4-fd9f-42fc-ab6e-c0c80119f9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:23.179430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af7cf4-fd9f-42fc-ab6e-c0c80119f9fa admin admin] PATH_INFO: `/v3/projects/0f9d84cb672744259fd2e632c2374599/users/acb734b254b64b87a38e22d98e929080/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:23.215721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af7cf4-fd9f-42fc-ab6e-c0c80119f9fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f9d84cb672744259fd2e632c2374599, user_id=acb734b254b64b87a38e22d98e929080, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:23.220104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af7cf4-fd9f-42fc-ab6e-c0c80119f9fa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:23.257811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a6ad5-62a6-42af-9eec-1615476aea9b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:23.258122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a6ad5-62a6-42af-9eec-1615476aea9b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:23.258385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a6ad5-62a6-42af-9eec-1615476aea9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:23.260225 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1668/3289] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:09:23 2022] PUT /identity/v3/projects/0f9d84cb672744259fd2e632c2374599/users/acb734b254b64b87a38e22d98e929080/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:23.310721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b71a6ad5-62a6-42af-9eec-1615476aea9b None None] MFA Rules not processed for user `acb734b254b64b87a38e22d98e929080`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:23.313200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b71a6ad5-62a6-42af-9eec-1615476aea9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:23.345167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:23.452648 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1622/3290] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:24.088117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af7cf4-fd9f-42fc-ab6e-c0c80119f9fa admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:24.090113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-10af7cf4-fd9f-42fc-ab6e-c0c80119f9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:24.177441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:24.304372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af7cf4-fd9f-42fc-ab6e-c0c80119f9fa admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:24.311158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4da185-5b6c-4e50-a67d-52935dd53b1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:24.312068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4da185-5b6c-4e50-a67d-52935dd53b1e service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:24.314500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4da185-5b6c-4e50-a67d-52935dd53b1e service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:24.315060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4da185-5b6c-4e50-a67d-52935dd53b1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:24.326649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4da185-5b6c-4e50-a67d-52935dd53b1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:24.328874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4da185-5b6c-4e50-a67d-52935dd53b1e service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:24.344328 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1669/3291] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:09:24.531865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3707c1-6fcf-4d8c-a091-44677d7edd82 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:24.533904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3707c1-6fcf-4d8c-a091-44677d7edd82 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:24.539178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3707c1-6fcf-4d8c-a091-44677d7edd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:24.597674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8f3707c1-6fcf-4d8c-a091-44677d7edd82 None None] MFA Rules not processed for user `acb734b254b64b87a38e22d98e929080`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:24.606033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8f3707c1-6fcf-4d8c-a091-44677d7edd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:24.625636 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1623/3292] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:26.287699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66152bbf-6e44-40ef-aaf1-63f6ef685df8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:26.288792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66152bbf-6e44-40ef-aaf1-63f6ef685df8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:26.289311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66152bbf-6e44-40ef-aaf1-63f6ef685df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:26.352113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-66152bbf-6e44-40ef-aaf1-63f6ef685df8 None None] MFA Rules not processed for user `ae104851a64c4638abd70af95f27d4fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:26.353801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-66152bbf-6e44-40ef-aaf1-63f6ef685df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:26.380367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3707c1-6fcf-4d8c-a091-44677d7edd82 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:26.530628 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1670/3293] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:26.543376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16648b-6075-4b82-87ac-b98fc56b77a4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:26.543999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16648b-6075-4b82-87ac-b98fc56b77a4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:26.544437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16648b-6075-4b82-87ac-b98fc56b77a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:26.602405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4c16648b-6075-4b82-87ac-b98fc56b77a4 None None] MFA Rules not processed for user `ae104851a64c4638abd70af95f27d4fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:26.607975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4c16648b-6075-4b82-87ac-b98fc56b77a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:26.633478 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1671/3294] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:09:26.671827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3707c1-6fcf-4d8c-a091-44677d7edd82 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:26.701615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73098b1-1fa8-4e5b-bc06-420619b95c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:26.702529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73098b1-1fa8-4e5b-bc06-420619b95c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:26.702806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73098b1-1fa8-4e5b-bc06-420619b95c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:26.703068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73098b1-1fa8-4e5b-bc06-420619b95c0f admin admin] PATH_INFO: `/v3/users/acb734b254b64b87a38e22d98e929080` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:26.704332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73098b1-1fa8-4e5b-bc06-420619b95c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=acb734b254b64b87a38e22d98e929080)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:26.706269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73098b1-1fa8-4e5b-bc06-420619b95c0f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:26.735056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16648b-6075-4b82-87ac-b98fc56b77a4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:26.738100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4c16648b-6075-4b82-87ac-b98fc56b77a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:26.776011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16648b-6075-4b82-87ac-b98fc56b77a4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:26.797808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c04cee-d5af-434b-aee1-7c14ac96deef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:26.807011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c04cee-d5af-434b-aee1-7c14ac96deef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:26.808386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c04cee-d5af-434b-aee1-7c14ac96deef admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:26.808736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c04cee-d5af-434b-aee1-7c14ac96deef admin admin] PATH_INFO: `/v3/users/8b412fbcf382468c97d7d4f688f5e5b3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:26.812233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c04cee-d5af-434b-aee1-7c14ac96deef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b412fbcf382468c97d7d4f688f5e5b3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:26.824411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c04cee-d5af-434b-aee1-7c14ac96deef admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:26.878629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a73098b1-1fa8-4e5b-bc06-420619b95c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acb734b254b64b87a38e22d98e929080'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:26.892470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a73098b1-1fa8-4e5b-bc06-420619b95c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acb734b254b64b87a38e22d98e929080'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:26.903136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a73098b1-1fa8-4e5b-bc06-420619b95c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acb734b254b64b87a38e22d98e929080'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:26.906185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a73098b1-1fa8-4e5b-bc06-420619b95c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acb734b254b64b87a38e22d98e929080'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:26.908075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a73098b1-1fa8-4e5b-bc06-420619b95c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acb734b254b64b87a38e22d98e929080'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:26.949973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31c04cee-d5af-434b-aee1-7c14ac96deef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b412fbcf382468c97d7d4f688f5e5b3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:26.958541 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1624/3295] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:09:26 2022] DELETE /identity/v3/users/acb734b254b64b87a38e22d98e929080 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:09:26.960146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd517cc8-7d57-4887-b98b-56ac900e4d39 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:26.960907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd517cc8-7d57-4887-b98b-56ac900e4d39 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:26.961195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd517cc8-7d57-4887-b98b-56ac900e4d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:26.975221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31c04cee-d5af-434b-aee1-7c14ac96deef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b412fbcf382468c97d7d4f688f5e5b3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:26.975526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31c04cee-d5af-434b-aee1-7c14ac96deef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b412fbcf382468c97d7d4f688f5e5b3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:26.976449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31c04cee-d5af-434b-aee1-7c14ac96deef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b412fbcf382468c97d7d4f688f5e5b3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:26.993654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31c04cee-d5af-434b-aee1-7c14ac96deef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b412fbcf382468c97d7d4f688f5e5b3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:27.001877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-cd517cc8-7d57-4887-b98b-56ac900e4d39 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:27.006930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cd517cc8-7d57-4887-b98b-56ac900e4d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:27.033180 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1672/3296] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:09:26 2022] DELETE /identity/v3/users/8b412fbcf382468c97d7d4f688f5e5b3 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:09:27.041037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0aab5-5be3-4c57-90e3-d9111f66c15e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:27.042302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0aab5-5be3-4c57-90e3-d9111f66c15e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:27.042790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0aab5-5be3-4c57-90e3-d9111f66c15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:27.067796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:27.109722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-00a0aab5-5be3-4c57-90e3-d9111f66c15e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:27.111269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-00a0aab5-5be3-4c57-90e3-d9111f66c15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:27.123760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:27.193525 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1625/3297] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:27.223684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd517cc8-7d57-4887-b98b-56ac900e4d39 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:27.223878 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1673/3298] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:27.228337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cd517cc8-7d57-4887-b98b-56ac900e4d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:27.251857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0aab5-5be3-4c57-90e3-d9111f66c15e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:27.253987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-00a0aab5-5be3-4c57-90e3-d9111f66c15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:27.312301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd517cc8-7d57-4887-b98b-56ac900e4d39 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:27.393910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1462349-44cb-4c21-b6a3-af11bd4ed15a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:27.395700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1462349-44cb-4c21-b6a3-af11bd4ed15a service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:27.396295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1462349-44cb-4c21-b6a3-af11bd4ed15a service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:27.396947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1462349-44cb-4c21-b6a3-af11bd4ed15a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:27.400005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0aab5-5be3-4c57-90e3-d9111f66c15e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:27.409684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8cc08-eaf8-4391-a805-773ac534f0e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:27.410307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8cc08-eaf8-4391-a805-773ac534f0e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:27.410579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8cc08-eaf8-4391-a805-773ac534f0e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:27.410842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8cc08-eaf8-4391-a805-773ac534f0e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:27.411744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1462349-44cb-4c21-b6a3-af11bd4ed15a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:27.413736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1462349-44cb-4c21-b6a3-af11bd4ed15a service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:27.425963 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1626/3299] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:09:27.428286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8cc08-eaf8-4391-a805-773ac534f0e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:27.430032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8cc08-eaf8-4391-a805-773ac534f0e6 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:27.440398 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1674/3300] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:09:27.503487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1462349-44cb-4c21-b6a3-af11bd4ed15a service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:27.505065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e1462349-44cb-4c21-b6a3-af11bd4ed15a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:27.639337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1462349-44cb-4c21-b6a3-af11bd4ed15a service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:27.652452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed3a63-2c20-4019-9cb5-77a4ba56eb71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:27.653178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed3a63-2c20-4019-9cb5-77a4ba56eb71 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:27.653491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed3a63-2c20-4019-9cb5-77a4ba56eb71 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:27.654174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed3a63-2c20-4019-9cb5-77a4ba56eb71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:27.659738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a1ed3a63-2c20-4019-9cb5-77a4ba56eb71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:27.688348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:27.754206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed3a63-2c20-4019-9cb5-77a4ba56eb71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:27.756822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed3a63-2c20-4019-9cb5-77a4ba56eb71 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:27.769753 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1627/3301] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:09:27.886515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8cc08-eaf8-4391-a805-773ac534f0e6 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:27.888066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-19c8cc08-eaf8-4391-a805-773ac534f0e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:27.902545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8cc08-eaf8-4391-a805-773ac534f0e6 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:27.908016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18350c86-81ca-4cc7-85be-4bcdd3222d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:27.908931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18350c86-81ca-4cc7-85be-4bcdd3222d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:27.909218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18350c86-81ca-4cc7-85be-4bcdd3222d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:27.909933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18350c86-81ca-4cc7-85be-4bcdd3222d57 admin admin] PATH_INFO: `/v3/projects/90cdcd51251b4b8b8b58802cdbc1713c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:27.910984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18350c86-81ca-4cc7-85be-4bcdd3222d57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90cdcd51251b4b8b8b58802cdbc1713c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:27.913279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18350c86-81ca-4cc7-85be-4bcdd3222d57 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:28.007611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-18350c86-81ca-4cc7-85be-4bcdd3222d57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90cdcd51251b4b8b8b58802cdbc1713c', 'request_id': 'req-18350c86-81ca-4cc7-85be-4bcdd3222d57'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:28.019072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-18350c86-81ca-4cc7-85be-4bcdd3222d57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90cdcd51251b4b8b8b58802cdbc1713c', 'request_id': 'req-18350c86-81ca-4cc7-85be-4bcdd3222d57'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:28.028207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-18350c86-81ca-4cc7-85be-4bcdd3222d57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90cdcd51251b4b8b8b58802cdbc1713c', 'request_id': 'req-18350c86-81ca-4cc7-85be-4bcdd3222d57'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:28.041975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-18350c86-81ca-4cc7-85be-4bcdd3222d57 admin admin] The token cache is being invalidate because project 90cdcd51251b4b8b8b58802cdbc1713c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:09:28.042484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-18350c86-81ca-4cc7-85be-4bcdd3222d57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:28.044097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-18350c86-81ca-4cc7-85be-4bcdd3222d57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:28.045024 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1675/3302] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:09:27 2022] DELETE /identity/v3/projects/90cdcd51251b4b8b8b58802cdbc1713c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:28.050338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488b38f-a8dc-4231-b53c-c311f0c2b795 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:28.050631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488b38f-a8dc-4231-b53c-c311f0c2b795 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:28.050907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488b38f-a8dc-4231-b53c-c311f0c2b795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:28.081043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1488b38f-a8dc-4231-b53c-c311f0c2b795 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:28.082965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1488b38f-a8dc-4231-b53c-c311f0c2b795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:28.188215 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1628/3303] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:28.192806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5787f-55a8-4b35-85e2-a1518e126a3d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:28.193109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5787f-55a8-4b35-85e2-a1518e126a3d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:28.193893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5787f-55a8-4b35-85e2-a1518e126a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:28.221863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-00d5787f-55a8-4b35-85e2-a1518e126a3d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:28.223224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-00d5787f-55a8-4b35-85e2-a1518e126a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:28.231960 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1676/3304] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:28.236029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488b38f-a8dc-4231-b53c-c311f0c2b795 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:28.252959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488b38f-a8dc-4231-b53c-c311f0c2b795 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:28.260570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83e78e-bbed-4ccc-8a05-8c30a440b2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:28.261248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83e78e-bbed-4ccc-8a05-8c30a440b2af admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:28.261522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83e78e-bbed-4ccc-8a05-8c30a440b2af admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:28.264226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83e78e-bbed-4ccc-8a05-8c30a440b2af admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:28.265117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83e78e-bbed-4ccc-8a05-8c30a440b2af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:09:28.265319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83e78e-bbed-4ccc-8a05-8c30a440b2af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:28.266977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83e78e-bbed-4ccc-8a05-8c30a440b2af admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:28.281129 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1629/3305] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:09:28.285977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5787f-55a8-4b35-85e2-a1518e126a3d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:28.302600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5787f-55a8-4b35-85e2-a1518e126a3d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:28.309264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36b735-aa0b-4da9-a6c7-7bb032d25696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:28.310578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36b735-aa0b-4da9-a6c7-7bb032d25696 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:28.311231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36b735-aa0b-4da9-a6c7-7bb032d25696 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:28.311791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36b735-aa0b-4da9-a6c7-7bb032d25696 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:28.312706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36b735-aa0b-4da9-a6c7-7bb032d25696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:28.315320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36b735-aa0b-4da9-a6c7-7bb032d25696 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:28.351043 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1677/3306] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:09:28 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:09:28.355703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83e78e-bbed-4ccc-8a05-8c30a440b2af admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:28.368016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83e78e-bbed-4ccc-8a05-8c30a440b2af admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:28.507335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90535a-0762-4323-9172-c25f8066ea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:28.508523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90535a-0762-4323-9172-c25f8066ea6e admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:28.508859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90535a-0762-4323-9172-c25f8066ea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:28.512607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90535a-0762-4323-9172-c25f8066ea6e admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:28.513511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90535a-0762-4323-9172-c25f8066ea6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:28.515572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90535a-0762-4323-9172-c25f8066ea6e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:28.561811 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1630/3307] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:09:28 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:09:28.565764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36b735-aa0b-4da9-a6c7-7bb032d25696 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:28.577071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36b735-aa0b-4da9-a6c7-7bb032d25696 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:28.604720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a07825-eb99-4a69-adb6-6eb6a9a18e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:28.610595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a07825-eb99-4a69-adb6-6eb6a9a18e0c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:28.610915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a07825-eb99-4a69-adb6-6eb6a9a18e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:28.611200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a07825-eb99-4a69-adb6-6eb6a9a18e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:28.611995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a07825-eb99-4a69-adb6-6eb6a9a18e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:28.613706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a07825-eb99-4a69-adb6-6eb6a9a18e0c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:28.627368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:28.647737 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1678/3308] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:09:28.652400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90535a-0762-4323-9172-c25f8066ea6e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:28.668590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90535a-0762-4323-9172-c25f8066ea6e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:28.681653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd6efb-c386-4ee3-ad38-7648925e7294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:28.682348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd6efb-c386-4ee3-ad38-7648925e7294 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:28.682613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd6efb-c386-4ee3-ad38-7648925e7294 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:28.683072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd6efb-c386-4ee3-ad38-7648925e7294 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:28.683802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd6efb-c386-4ee3-ad38-7648925e7294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:28.685452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd6efb-c386-4ee3-ad38-7648925e7294 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:28.697437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a07825-eb99-4a69-adb6-6eb6a9a18e0c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:28.700615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f9a07825-eb99-4a69-adb6-6eb6a9a18e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:28.721095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a07825-eb99-4a69-adb6-6eb6a9a18e0c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:28.727775 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1631/3309] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:09:28.729361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd6efb-c386-4ee3-ad38-7648925e7294 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:28.731547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f89005-67e3-400b-966a-ffa7992bde70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:28.732686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f89005-67e3-400b-966a-ffa7992bde70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:28.733043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f89005-67e3-400b-966a-ffa7992bde70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:28.733392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f89005-67e3-400b-966a-ffa7992bde70 admin admin] PATH_INFO: `/v3/projects/0f9d84cb672744259fd2e632c2374599` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:28.734869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f89005-67e3-400b-966a-ffa7992bde70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f9d84cb672744259fd2e632c2374599)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:28.737294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f89005-67e3-400b-966a-ffa7992bde70 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:28.752647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd6efb-c386-4ee3-ad38-7648925e7294 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:28.767386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412047a-8ce9-4c46-83ba-4cfa2b68836d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:28.768365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412047a-8ce9-4c46-83ba-4cfa2b68836d admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:28.768651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412047a-8ce9-4c46-83ba-4cfa2b68836d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:28.768799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412047a-8ce9-4c46-83ba-4cfa2b68836d admin admin] PATH_INFO: `/v3/projects/2652c1d42aaf4f12ae2561ce0574cd74/users/8aa30bbc54064a5492836308770c0131/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:28.793863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412047a-8ce9-4c46-83ba-4cfa2b68836d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2652c1d42aaf4f12ae2561ce0574cd74, user_id=8aa30bbc54064a5492836308770c0131, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:28.796710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-65f89005-67e3-400b-966a-ffa7992bde70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f9d84cb672744259fd2e632c2374599', 'request_id': 'req-65f89005-67e3-400b-966a-ffa7992bde70'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:28.797218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412047a-8ce9-4c46-83ba-4cfa2b68836d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:28.809240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:28.809827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-65f89005-67e3-400b-966a-ffa7992bde70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f9d84cb672744259fd2e632c2374599', 'request_id': 'req-65f89005-67e3-400b-966a-ffa7992bde70'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:28.819582 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1632/3310] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:09:28 2022] PUT /identity/v3/projects/2652c1d42aaf4f12ae2561ce0574cd74/users/8aa30bbc54064a5492836308770c0131/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:09:28.819799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-65f89005-67e3-400b-966a-ffa7992bde70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f9d84cb672744259fd2e632c2374599', 'request_id': 'req-65f89005-67e3-400b-966a-ffa7992bde70'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:28.831295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87caa23b-4418-4fb8-9a0e-dcb21efd13e1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:28.831623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87caa23b-4418-4fb8-9a0e-dcb21efd13e1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:28.832067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87caa23b-4418-4fb8-9a0e-dcb21efd13e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:28.838806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-65f89005-67e3-400b-966a-ffa7992bde70 admin admin] The token cache is being invalidate because project 0f9d84cb672744259fd2e632c2374599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:09:28.839323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-65f89005-67e3-400b-966a-ffa7992bde70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:28.840018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-65f89005-67e3-400b-966a-ffa7992bde70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:28.849189 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1679/3311] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:09:28 2022] DELETE /identity/v3/projects/0f9d84cb672744259fd2e632c2374599 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:28.850736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935573f-7abe-4038-8344-e39ebce3eb74 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:28.851285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935573f-7abe-4038-8344-e39ebce3eb74 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:28.851571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935573f-7abe-4038-8344-e39ebce3eb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:28.881167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8935573f-7abe-4038-8344-e39ebce3eb74 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:28.885454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-87caa23b-4418-4fb8-9a0e-dcb21efd13e1 None None] MFA Rules not processed for user `8aa30bbc54064a5492836308770c0131`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:28.887435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-87caa23b-4418-4fb8-9a0e-dcb21efd13e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:28.888250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8935573f-7abe-4038-8344-e39ebce3eb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:29.035307 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1680/3312] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:29.037023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e80ff-357a-4cf3-bd2d-a949686eb8e8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:29.037390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e80ff-357a-4cf3-bd2d-a949686eb8e8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:29.037741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e80ff-357a-4cf3-bd2d-a949686eb8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:29.040129 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1633/3313] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:09:29.050077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6e69a-5e19-45c3-96ce-980231bd444b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:29.050366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6e69a-5e19-45c3-96ce-980231bd444b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:29.050642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6e69a-5e19-45c3-96ce-980231bd444b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:29.057995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f14e80ff-357a-4cf3-bd2d-a949686eb8e8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:29.059433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f14e80ff-357a-4cf3-bd2d-a949686eb8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:29.069524 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1681/3314] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:29.074674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e80ff-357a-4cf3-bd2d-a949686eb8e8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:29.085249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-01d6e69a-5e19-45c3-96ce-980231bd444b None None] MFA Rules not processed for user `8aa30bbc54064a5492836308770c0131`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:29.086804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-01d6e69a-5e19-45c3-96ce-980231bd444b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:29.102655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e80ff-357a-4cf3-bd2d-a949686eb8e8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:29.108068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5519fa-9588-44b6-8186-e0992a277450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:29.110107 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1634/3315] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:29.110226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5519fa-9588-44b6-8186-e0992a277450 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:29.110302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5519fa-9588-44b6-8186-e0992a277450 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:29.110689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5519fa-9588-44b6-8186-e0992a277450 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:29.112212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5519fa-9588-44b6-8186-e0992a277450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:09:29.112212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5519fa-9588-44b6-8186-e0992a277450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:29.113604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5519fa-9588-44b6-8186-e0992a277450 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:29.130556 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1682/3316] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:09:29.134600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6e69a-5e19-45c3-96ce-980231bd444b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:29.146256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6e69a-5e19-45c3-96ce-980231bd444b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:29.151004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee2693-99a7-43ec-8524-f814a4b45da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:29.151675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee2693-99a7-43ec-8524-f814a4b45da0 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:29.151962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee2693-99a7-43ec-8524-f814a4b45da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:29.152273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee2693-99a7-43ec-8524-f814a4b45da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:29.152972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee2693-99a7-43ec-8524-f814a4b45da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:29.154941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee2693-99a7-43ec-8524-f814a4b45da0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:29.212989 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1635/3317] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:09:29 2022] POST /identity/v3/projects => generated 405 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:09:29.217469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5519fa-9588-44b6-8186-e0992a277450 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:29.228676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5519fa-9588-44b6-8186-e0992a277450 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:29.312519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c55b3-8723-4743-8376-d3b963a56a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:29.313532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c55b3-8723-4743-8376-d3b963a56a1a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:29.313894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c55b3-8723-4743-8376-d3b963a56a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:29.314244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c55b3-8723-4743-8376-d3b963a56a1a admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:29.315029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c55b3-8723-4743-8376-d3b963a56a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:29.317066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c55b3-8723-4743-8376-d3b963a56a1a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:29.327722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:29.348082 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1683/3318] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:09:29 2022] POST /identity/v3/users => generated 303 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:09:29.350699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee2693-99a7-43ec-8524-f814a4b45da0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:29.366889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee2693-99a7-43ec-8524-f814a4b45da0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:29.375786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ed971-f01e-4994-aff8-7c394ae1d21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:29.376695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ed971-f01e-4994-aff8-7c394ae1d21a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:29.376877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ed971-f01e-4994-aff8-7c394ae1d21a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:29.377571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ed971-f01e-4994-aff8-7c394ae1d21a admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:29.378092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ed971-f01e-4994-aff8-7c394ae1d21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:29.380154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ed971-f01e-4994-aff8-7c394ae1d21a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:29.403386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c55b3-8723-4743-8376-d3b963a56a1a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:29.404513 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1636/3319] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:09:29.414568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c55b3-8723-4743-8376-d3b963a56a1a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:29.419966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cfbac-d32e-4779-8bf5-9ea9525987af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:29.420828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cfbac-d32e-4779-8bf5-9ea9525987af admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:29.421118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cfbac-d32e-4779-8bf5-9ea9525987af admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:29.421395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cfbac-d32e-4779-8bf5-9ea9525987af admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:29.422182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cfbac-d32e-4779-8bf5-9ea9525987af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:29.425036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cfbac-d32e-4779-8bf5-9ea9525987af admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:29.446033 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1684/3320] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:09:29.450592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ed971-f01e-4994-aff8-7c394ae1d21a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:29.461554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ed971-f01e-4994-aff8-7c394ae1d21a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:29.473899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83e523-3470-486a-8b0f-17c560998cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:29.474984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83e523-3470-486a-8b0f-17c560998cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:29.475187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83e523-3470-486a-8b0f-17c560998cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:29.475454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83e523-3470-486a-8b0f-17c560998cc9 admin admin] PATH_INFO: `/v3/projects/e463fddac31c452296829260cfacc694/users/7cac5256d6b6458899f85d8762a03d90/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:29.495465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83e523-3470-486a-8b0f-17c560998cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e463fddac31c452296829260cfacc694, user_id=7cac5256d6b6458899f85d8762a03d90, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:29.498369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83e523-3470-486a-8b0f-17c560998cc9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:29.518632 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1637/3321] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:09:29 2022] PUT /identity/v3/projects/e463fddac31c452296829260cfacc694/users/7cac5256d6b6458899f85d8762a03d90/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:29.523531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062931a-c410-49b1-b4ee-a31de8becf5f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:29.523828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062931a-c410-49b1-b4ee-a31de8becf5f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:29.524145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062931a-c410-49b1-b4ee-a31de8becf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:29.544743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b062931a-c410-49b1-b4ee-a31de8becf5f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:29.546221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b062931a-c410-49b1-b4ee-a31de8becf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:29.635821 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1685/3322] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:29.648427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83e523-3470-486a-8b0f-17c560998cc9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:29.650501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ef83e523-3470-486a-8b0f-17c560998cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:29.782906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83e523-3470-486a-8b0f-17c560998cc9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:29.801756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6d3bc-bbc0-4589-bbfc-ec2556ff03bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:29.803162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6d3bc-bbc0-4589-bbfc-ec2556ff03bd service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:29.803338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6d3bc-bbc0-4589-bbfc-ec2556ff03bd service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:29.803579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6d3bc-bbc0-4589-bbfc-ec2556ff03bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:29.826584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6d3bc-bbc0-4589-bbfc-ec2556ff03bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:29.828200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6d3bc-bbc0-4589-bbfc-ec2556ff03bd service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:29.853289 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1638/3323] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:09:30.582113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062931a-c410-49b1-b4ee-a31de8becf5f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:30.585785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b062931a-c410-49b1-b4ee-a31de8becf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:30.811454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062931a-c410-49b1-b4ee-a31de8becf5f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:30.824190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75c654-3ed2-471e-8def-17c7ec0ee7f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:30.825116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75c654-3ed2-471e-8def-17c7ec0ee7f5 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:30.825407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75c654-3ed2-471e-8def-17c7ec0ee7f5 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:30.825688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75c654-3ed2-471e-8def-17c7ec0ee7f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:30.937031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75c654-3ed2-471e-8def-17c7ec0ee7f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:30.939052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75c654-3ed2-471e-8def-17c7ec0ee7f5 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:30.962861 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1686/3324] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:09:38.240374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b8de3-fd6b-4574-b1d1-9ccfacec5f56 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:38.240862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b8de3-fd6b-4574-b1d1-9ccfacec5f56 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:38.241480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b8de3-fd6b-4574-b1d1-9ccfacec5f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:38.272929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1e3b8de3-fd6b-4574-b1d1-9ccfacec5f56 None None] MFA Rules not processed for user `7cac5256d6b6458899f85d8762a03d90`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:38.274301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1e3b8de3-fd6b-4574-b1d1-9ccfacec5f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:38.296868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:38.356489 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1639/3325] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:38.360945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75c654-3ed2-471e-8def-17c7ec0ee7f5 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:38.372579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75c654-3ed2-471e-8def-17c7ec0ee7f5 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:38.377704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf29d0-87bb-4e3e-8f79-96ec0e5ecd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:38.378270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf29d0-87bb-4e3e-8f79-96ec0e5ecd5a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:38.378561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf29d0-87bb-4e3e-8f79-96ec0e5ecd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:38.378829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf29d0-87bb-4e3e-8f79-96ec0e5ecd5a admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:38.379929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf29d0-87bb-4e3e-8f79-96ec0e5ecd5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:38.382189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf29d0-87bb-4e3e-8f79-96ec0e5ecd5a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:38.416607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:38.438795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b8de3-fd6b-4574-b1d1-9ccfacec5f56 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:38.439017 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1687/3326] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:09:38 2022] POST /identity/v3/projects => generated 405 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:09:38.453350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b8de3-fd6b-4574-b1d1-9ccfacec5f56 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:38.508945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf29d0-87bb-4e3e-8f79-96ec0e5ecd5a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:38.512223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fbaf29d0-87bb-4e3e-8f79-96ec0e5ecd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:38.619404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d813b9-e300-48cb-bcf1-d73eee3b9607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:38.620368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d813b9-e300-48cb-bcf1-d73eee3b9607 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:38.620958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d813b9-e300-48cb-bcf1-d73eee3b9607 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:38.621240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d813b9-e300-48cb-bcf1-d73eee3b9607 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:38.622095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d813b9-e300-48cb-bcf1-d73eee3b9607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:38.624810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d813b9-e300-48cb-bcf1-d73eee3b9607 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:38.642366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf29d0-87bb-4e3e-8f79-96ec0e5ecd5a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:38.648745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38e8e6-a28b-4089-8629-ef4c5d1acc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:38.649809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38e8e6-a28b-4089-8629-ef4c5d1acc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:38.650089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38e8e6-a28b-4089-8629-ef4c5d1acc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:38.650367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38e8e6-a28b-4089-8629-ef4c5d1acc8f admin admin] PATH_INFO: `/v3/users/5198cb44d38d495794cc8b0fc5d9d4c3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:38.651615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be38e8e6-a28b-4089-8629-ef4c5d1acc8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5198cb44d38d495794cc8b0fc5d9d4c3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:38.653606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be38e8e6-a28b-4089-8629-ef4c5d1acc8f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:38.655961 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1640/3327] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:09:38 2022] POST /identity/v3/users => generated 303 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:09:38.659373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d813b9-e300-48cb-bcf1-d73eee3b9607 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:38.680566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d813b9-e300-48cb-bcf1-d73eee3b9607 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:38.689620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b49ebe-98be-428f-af34-656ae8582bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:38.690717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b49ebe-98be-428f-af34-656ae8582bbd admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:38.690934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b49ebe-98be-428f-af34-656ae8582bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:38.691156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b49ebe-98be-428f-af34-656ae8582bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:38.692509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b49ebe-98be-428f-af34-656ae8582bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:38.694878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b49ebe-98be-428f-af34-656ae8582bbd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:38.719814 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1641/3328] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:09:38.723891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b49ebe-98be-428f-af34-656ae8582bbd admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:38.745856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-be38e8e6-a28b-4089-8629-ef4c5d1acc8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5198cb44d38d495794cc8b0fc5d9d4c3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:38.749753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b49ebe-98be-428f-af34-656ae8582bbd admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:38.757114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513f504-5255-4fb8-940d-848302d98798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:38.761230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513f504-5255-4fb8-940d-848302d98798 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:38.762034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513f504-5255-4fb8-940d-848302d98798 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:38.762530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513f504-5255-4fb8-940d-848302d98798 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:38.763967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513f504-5255-4fb8-940d-848302d98798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:38.764842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-be38e8e6-a28b-4089-8629-ef4c5d1acc8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5198cb44d38d495794cc8b0fc5d9d4c3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:38.765569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-be38e8e6-a28b-4089-8629-ef4c5d1acc8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5198cb44d38d495794cc8b0fc5d9d4c3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:38.766301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-be38e8e6-a28b-4089-8629-ef4c5d1acc8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5198cb44d38d495794cc8b0fc5d9d4c3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:38.767483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513f504-5255-4fb8-940d-848302d98798 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:38.783486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-be38e8e6-a28b-4089-8629-ef4c5d1acc8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5198cb44d38d495794cc8b0fc5d9d4c3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:38.792536 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1642/3329] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:09:38.796449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513f504-5255-4fb8-940d-848302d98798 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:38.801874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b513f504-5255-4fb8-940d-848302d98798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:38.833127 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1688/3330] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:09:38 2022] DELETE /identity/v3/users/5198cb44d38d495794cc8b0fc5d9d4c3 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:09:38.837664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5936b31-75e5-4037-8c36-5fcd2009b878 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:38.837973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5936b31-75e5-4037-8c36-5fcd2009b878 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:38.839121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5936b31-75e5-4037-8c36-5fcd2009b878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:38.867787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513f504-5255-4fb8-940d-848302d98798 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:38.875246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d5936b31-75e5-4037-8c36-5fcd2009b878 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:38.876599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d5936b31-75e5-4037-8c36-5fcd2009b878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:38.998215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd29018-d8af-4db8-9bb9-ebcdff04c8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:38.999405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd29018-d8af-4db8-9bb9-ebcdff04c8b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:39.000171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd29018-d8af-4db8-9bb9-ebcdff04c8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:39.000537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd29018-d8af-4db8-9bb9-ebcdff04c8b6 admin admin] PATH_INFO: `/v3/projects/078e36fe8f6a4a979b730924cf4c5650/users/2b47897146d948138d6a22dfffd7b8a1/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:39.012080 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1689/3331] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:39.020007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd29018-d8af-4db8-9bb9-ebcdff04c8b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078e36fe8f6a4a979b730924cf4c5650, user_id=2b47897146d948138d6a22dfffd7b8a1, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:39.023254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd29018-d8af-4db8-9bb9-ebcdff04c8b6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:39.023817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5936b31-75e5-4037-8c36-5fcd2009b878 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:39.025357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d5936b31-75e5-4037-8c36-5fcd2009b878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:39.051031 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1643/3332] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:09:38 2022] PUT /identity/v3/projects/078e36fe8f6a4a979b730924cf4c5650/users/2b47897146d948138d6a22dfffd7b8a1/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:39.055465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:39.130465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5936b31-75e5-4037-8c36-5fcd2009b878 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:39.302204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228afc45-ba79-451d-8f5d-a7d7d5fe6356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:39.303186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228afc45-ba79-451d-8f5d-a7d7d5fe6356 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:39.303469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228afc45-ba79-451d-8f5d-a7d7d5fe6356 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:39.303782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228afc45-ba79-451d-8f5d-a7d7d5fe6356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:39.406020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228afc45-ba79-451d-8f5d-a7d7d5fe6356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:39.407753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228afc45-ba79-451d-8f5d-a7d7d5fe6356 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:39.444780 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1690/3333] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:09:40.343755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd29018-d8af-4db8-9bb9-ebcdff04c8b6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:40.353270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dbd29018-d8af-4db8-9bb9-ebcdff04c8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:40.392773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd29018-d8af-4db8-9bb9-ebcdff04c8b6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:40.402687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9ec35-2eba-4eb9-897c-ca7bf3c1decb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:40.404401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9ec35-2eba-4eb9-897c-ca7bf3c1decb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:40.404704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9ec35-2eba-4eb9-897c-ca7bf3c1decb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:40.404999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9ec35-2eba-4eb9-897c-ca7bf3c1decb admin admin] PATH_INFO: `/v3/projects/381ec26b4d1240b4889b5ecfebf02610` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:40.424756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9ec35-2eba-4eb9-897c-ca7bf3c1decb admin admin] RBAC: Authorizing `identity:delete_project(project_id=381ec26b4d1240b4889b5ecfebf02610)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:40.426978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9ec35-2eba-4eb9-897c-ca7bf3c1decb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:40.430143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:40.571030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-14b9ec35-2eba-4eb9-897c-ca7bf3c1decb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '381ec26b4d1240b4889b5ecfebf02610', 'request_id': 'req-14b9ec35-2eba-4eb9-897c-ca7bf3c1decb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:40.582599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-14b9ec35-2eba-4eb9-897c-ca7bf3c1decb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '381ec26b4d1240b4889b5ecfebf02610', 'request_id': 'req-14b9ec35-2eba-4eb9-897c-ca7bf3c1decb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:40.591355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-14b9ec35-2eba-4eb9-897c-ca7bf3c1decb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '381ec26b4d1240b4889b5ecfebf02610', 'request_id': 'req-14b9ec35-2eba-4eb9-897c-ca7bf3c1decb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:40.614318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-14b9ec35-2eba-4eb9-897c-ca7bf3c1decb admin admin] The token cache is being invalidate because project 381ec26b4d1240b4889b5ecfebf02610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:09:40.615204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-14b9ec35-2eba-4eb9-897c-ca7bf3c1decb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:40.616098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-14b9ec35-2eba-4eb9-897c-ca7bf3c1decb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:40.618456 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1644/3334] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:09:40 2022] DELETE /identity/v3/projects/381ec26b4d1240b4889b5ecfebf02610 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:40.625874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228afc45-ba79-451d-8f5d-a7d7d5fe6356 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:40.644949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228afc45-ba79-451d-8f5d-a7d7d5fe6356 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:40.786759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdaeb43-4f86-43f8-aaad-d7c68f405574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:40.805397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdaeb43-4f86-43f8-aaad-d7c68f405574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:40.805714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdaeb43-4f86-43f8-aaad-d7c68f405574 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:40.806064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdaeb43-4f86-43f8-aaad-d7c68f405574 admin admin] PATH_INFO: `/v3/users/d948dace8b5e4ad1a11b00b1140f2ddf` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:40.808490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdaeb43-4f86-43f8-aaad-d7c68f405574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d948dace8b5e4ad1a11b00b1140f2ddf)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:40.811025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdaeb43-4f86-43f8-aaad-d7c68f405574 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:40.866936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:40.891657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2fdaeb43-4f86-43f8-aaad-d7c68f405574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd948dace8b5e4ad1a11b00b1140f2ddf'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:40.906213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2fdaeb43-4f86-43f8-aaad-d7c68f405574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd948dace8b5e4ad1a11b00b1140f2ddf'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:40.907515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2fdaeb43-4f86-43f8-aaad-d7c68f405574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd948dace8b5e4ad1a11b00b1140f2ddf'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:40.908359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2fdaeb43-4f86-43f8-aaad-d7c68f405574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd948dace8b5e4ad1a11b00b1140f2ddf'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:40.918315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2fdaeb43-4f86-43f8-aaad-d7c68f405574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd948dace8b5e4ad1a11b00b1140f2ddf'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:40.941035 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1691/3335] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:09:40 2022] DELETE /identity/v3/users/d948dace8b5e4ad1a11b00b1140f2ddf => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:41.567237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9ec35-2eba-4eb9-897c-ca7bf3c1decb admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:41.569307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-14b9ec35-2eba-4eb9-897c-ca7bf3c1decb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:41.591871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9ec35-2eba-4eb9-897c-ca7bf3c1decb admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:41.700281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba4697-bfbc-4375-9fd1-ca53979c54d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:41.703551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba4697-bfbc-4375-9fd1-ca53979c54d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:41.704020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba4697-bfbc-4375-9fd1-ca53979c54d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:41.704468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba4697-bfbc-4375-9fd1-ca53979c54d2 admin admin] PATH_INFO: `/v3/projects/f98c80749a084cc49245163c6add17cb` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:41.707190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba4697-bfbc-4375-9fd1-ca53979c54d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f98c80749a084cc49245163c6add17cb)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:41.709669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba4697-bfbc-4375-9fd1-ca53979c54d2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:41.829596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d4ba4697-bfbc-4375-9fd1-ca53979c54d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f98c80749a084cc49245163c6add17cb', 'request_id': 'req-d4ba4697-bfbc-4375-9fd1-ca53979c54d2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:41.840346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d4ba4697-bfbc-4375-9fd1-ca53979c54d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f98c80749a084cc49245163c6add17cb', 'request_id': 'req-d4ba4697-bfbc-4375-9fd1-ca53979c54d2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:41.849569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d4ba4697-bfbc-4375-9fd1-ca53979c54d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f98c80749a084cc49245163c6add17cb', 'request_id': 'req-d4ba4697-bfbc-4375-9fd1-ca53979c54d2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:41.871973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d4ba4697-bfbc-4375-9fd1-ca53979c54d2 admin admin] The token cache is being invalidate because project f98c80749a084cc49245163c6add17cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:09:41.872340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d4ba4697-bfbc-4375-9fd1-ca53979c54d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:41.873040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d4ba4697-bfbc-4375-9fd1-ca53979c54d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:41.884412 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1645/3336] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:09:41 2022] DELETE /identity/v3/projects/f98c80749a084cc49245163c6add17cb => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:41.885052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d682c2f-706e-4a31-a93b-54bdf626c67b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:41.885594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d682c2f-706e-4a31-a93b-54bdf626c67b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:41.885702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d682c2f-706e-4a31-a93b-54bdf626c67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:41.915542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2d682c2f-706e-4a31-a93b-54bdf626c67b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:41.917188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2d682c2f-706e-4a31-a93b-54bdf626c67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:41.992450 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1692/3337] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:42.001394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da0c77-ae7b-4d8e-9756-145a1f74c7f5 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:42.001710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da0c77-ae7b-4d8e-9756-145a1f74c7f5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:42.001972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da0c77-ae7b-4d8e-9756-145a1f74c7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:42.028015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b2da0c77-ae7b-4d8e-9756-145a1f74c7f5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:42.029801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b2da0c77-ae7b-4d8e-9756-145a1f74c7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:42.043582 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1646/3338] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:42.043917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d682c2f-706e-4a31-a93b-54bdf626c67b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:42.054941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d682c2f-706e-4a31-a93b-54bdf626c67b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:42.066367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0865c45-fc83-437b-a579-e67403bace92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:42.069289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0865c45-fc83-437b-a579-e67403bace92 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:42.069613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0865c45-fc83-437b-a579-e67403bace92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:42.069895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0865c45-fc83-437b-a579-e67403bace92 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:42.072607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0865c45-fc83-437b-a579-e67403bace92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:09:42.073017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0865c45-fc83-437b-a579-e67403bace92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:42.076874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0865c45-fc83-437b-a579-e67403bace92 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:42.104092 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1693/3339] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:09:42.110992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da0c77-ae7b-4d8e-9756-145a1f74c7f5 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:42.131904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da0c77-ae7b-4d8e-9756-145a1f74c7f5 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:42.152410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae688985-9d6f-4010-9eeb-90d4ac4241e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:42.153731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae688985-9d6f-4010-9eeb-90d4ac4241e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:42.154192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae688985-9d6f-4010-9eeb-90d4ac4241e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:42.154503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae688985-9d6f-4010-9eeb-90d4ac4241e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:42.155155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae688985-9d6f-4010-9eeb-90d4ac4241e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:42.157405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae688985-9d6f-4010-9eeb-90d4ac4241e8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:42.177439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:42.210767 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1647/3340] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:09:42 2022] POST /identity/v3/projects => generated 399 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:09:42.211447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0865c45-fc83-437b-a579-e67403bace92 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:42.222260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0865c45-fc83-437b-a579-e67403bace92 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:42.338098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ed8aa-d97e-4cb9-bb69-6eb64b0205fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:42.338349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ed8aa-d97e-4cb9-bb69-6eb64b0205fb admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:42.338838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ed8aa-d97e-4cb9-bb69-6eb64b0205fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:42.338981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ed8aa-d97e-4cb9-bb69-6eb64b0205fb admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:42.346746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ed8aa-d97e-4cb9-bb69-6eb64b0205fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:42.348264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ed8aa-d97e-4cb9-bb69-6eb64b0205fb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:42.386760 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1694/3341] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:09:42 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:09:42.391101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae688985-9d6f-4010-9eeb-90d4ac4241e8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:42.425118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae688985-9d6f-4010-9eeb-90d4ac4241e8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:42.434159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654dec8-cbc8-4b5a-a137-cf81e0e45175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:42.436184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654dec8-cbc8-4b5a-a137-cf81e0e45175 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:42.436532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654dec8-cbc8-4b5a-a137-cf81e0e45175 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:42.436732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654dec8-cbc8-4b5a-a137-cf81e0e45175 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:42.437471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654dec8-cbc8-4b5a-a137-cf81e0e45175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:42.444283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654dec8-cbc8-4b5a-a137-cf81e0e45175 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:42.489187 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1648/3342] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:09:42.489508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ed8aa-d97e-4cb9-bb69-6eb64b0205fb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:42.507812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ed8aa-d97e-4cb9-bb69-6eb64b0205fb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:42.515410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38598d87-4dea-473f-8278-370b5b9bacd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:42.516130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38598d87-4dea-473f-8278-370b5b9bacd7 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:42.516467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38598d87-4dea-473f-8278-370b5b9bacd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:42.517553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38598d87-4dea-473f-8278-370b5b9bacd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:42.517553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38598d87-4dea-473f-8278-370b5b9bacd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:42.519472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38598d87-4dea-473f-8278-370b5b9bacd7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:42.535455 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1695/3343] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:09:42.536805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654dec8-cbc8-4b5a-a137-cf81e0e45175 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:42.551760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654dec8-cbc8-4b5a-a137-cf81e0e45175 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:42.560766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a84362-4ad7-4ebd-9a09-3baf59fe7800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:42.562135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a84362-4ad7-4ebd-9a09-3baf59fe7800 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:42.562425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a84362-4ad7-4ebd-9a09-3baf59fe7800 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:42.562712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a84362-4ad7-4ebd-9a09-3baf59fe7800 admin admin] PATH_INFO: `/v3/projects/dffcfd79372c47e89be4acbdc042d510/users/b3b24a3216aa4eba8a9a90c109c3b491/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:42.589620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a84362-4ad7-4ebd-9a09-3baf59fe7800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dffcfd79372c47e89be4acbdc042d510, user_id=b3b24a3216aa4eba8a9a90c109c3b491, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:42.594124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a84362-4ad7-4ebd-9a09-3baf59fe7800 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:42.620946 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1649/3344] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:09:42 2022] PUT /identity/v3/projects/dffcfd79372c47e89be4acbdc042d510/users/b3b24a3216aa4eba8a9a90c109c3b491/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:42.622772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b6ac2-bc06-4cd2-89aa-d16e9cb07cc5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:42.623362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b6ac2-bc06-4cd2-89aa-d16e9cb07cc5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:42.623362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b6ac2-bc06-4cd2-89aa-d16e9cb07cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:42.657478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0d2b6ac2-bc06-4cd2-89aa-d16e9cb07cc5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:42.661486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0d2b6ac2-bc06-4cd2-89aa-d16e9cb07cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:42.682490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:42.787189 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1696/3345] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:42.809093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a84362-4ad7-4ebd-9a09-3baf59fe7800 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:42.811844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d8a84362-4ad7-4ebd-9a09-3baf59fe7800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:42.888946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a84362-4ad7-4ebd-9a09-3baf59fe7800 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:42.892773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2d6f6-20ff-4164-a6f2-05da5ce9e68e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:42.893440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2d6f6-20ff-4164-a6f2-05da5ce9e68e service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:42.893793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2d6f6-20ff-4164-a6f2-05da5ce9e68e service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:42.894070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2d6f6-20ff-4164-a6f2-05da5ce9e68e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:42.905643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2d6f6-20ff-4164-a6f2-05da5ce9e68e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:42.907109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2d6f6-20ff-4164-a6f2-05da5ce9e68e service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:42.921735 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1650/3346] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:09:45.172692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b6ac2-bc06-4cd2-89aa-d16e9cb07cc5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:45.175847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0d2b6ac2-bc06-4cd2-89aa-d16e9cb07cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:45.383304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b6ac2-bc06-4cd2-89aa-d16e9cb07cc5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:45.408466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8b00c-ab88-49ee-badf-16e587791b36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:45.409255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8b00c-ab88-49ee-badf-16e587791b36 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:45.409609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8b00c-ab88-49ee-badf-16e587791b36 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:45.409805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8b00c-ab88-49ee-badf-16e587791b36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:45.412538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a8e8b00c-ab88-49ee-badf-16e587791b36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:45.561825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8b00c-ab88-49ee-badf-16e587791b36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:45.563823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8b00c-ab88-49ee-badf-16e587791b36 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:45.600592 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1697/3347] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:09:46.859724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb5cc1-dbc7-498c-acbf-3fda6a2060c9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:46.860362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb5cc1-dbc7-498c-acbf-3fda6a2060c9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:46.860362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb5cc1-dbc7-498c-acbf-3fda6a2060c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:46.917923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-beeb5cc1-dbc7-498c-acbf-3fda6a2060c9 None None] MFA Rules not processed for user `2b47897146d948138d6a22dfffd7b8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:46.920383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-beeb5cc1-dbc7-498c-acbf-3fda6a2060c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:47.053331 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1651/3348] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:46 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:47.063236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eeed8-19bb-461f-bf71-7c81b6f2a862 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:47.063699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eeed8-19bb-461f-bf71-7c81b6f2a862 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:47.064024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eeed8-19bb-461f-bf71-7c81b6f2a862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:47.109046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ff7eeed8-19bb-461f-bf71-7c81b6f2a862 None None] MFA Rules not processed for user `7cac5256d6b6458899f85d8762a03d90`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:47.111189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ff7eeed8-19bb-461f-bf71-7c81b6f2a862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:47.260613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:47.313177 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1698/3349] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:47.324551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb5cc1-dbc7-498c-acbf-3fda6a2060c9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:47.368902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb5cc1-dbc7-498c-acbf-3fda6a2060c9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:47.377990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52349fc0-fbe3-43ab-9cc1-859561656b19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:47.379130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52349fc0-fbe3-43ab-9cc1-859561656b19 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:47.379605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52349fc0-fbe3-43ab-9cc1-859561656b19 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:47.380573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52349fc0-fbe3-43ab-9cc1-859561656b19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:47.383241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-52349fc0-fbe3-43ab-9cc1-859561656b19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:47.408024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52349fc0-fbe3-43ab-9cc1-859561656b19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:47.418953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52349fc0-fbe3-43ab-9cc1-859561656b19 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:47.466322 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1652/3350] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:47 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:09:57.212963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7eeed8-19bb-461f-bf71-7c81b6f2a862 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:57.215798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ff7eeed8-19bb-461f-bf71-7c81b6f2a862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:57.236567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7eeed8-19bb-461f-bf71-7c81b6f2a862 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:57.242885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff57211-12cf-4bb4-8a3e-44f6e7b20e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:57.244170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff57211-12cf-4bb4-8a3e-44f6e7b20e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:57.244456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff57211-12cf-4bb4-8a3e-44f6e7b20e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:57.245420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff57211-12cf-4bb4-8a3e-44f6e7b20e14 admin admin] PATH_INFO: `/v3/users/62a0c1f583944bd092abc02293fcb316` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:57.246885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff57211-12cf-4bb4-8a3e-44f6e7b20e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a0c1f583944bd092abc02293fcb316)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:57.248995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff57211-12cf-4bb4-8a3e-44f6e7b20e14 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:57.317960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1ff57211-12cf-4bb4-8a3e-44f6e7b20e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a0c1f583944bd092abc02293fcb316'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:57.345226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1ff57211-12cf-4bb4-8a3e-44f6e7b20e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a0c1f583944bd092abc02293fcb316'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:57.346793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1ff57211-12cf-4bb4-8a3e-44f6e7b20e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a0c1f583944bd092abc02293fcb316'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:57.347685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1ff57211-12cf-4bb4-8a3e-44f6e7b20e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a0c1f583944bd092abc02293fcb316'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:57.359732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1ff57211-12cf-4bb4-8a3e-44f6e7b20e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a0c1f583944bd092abc02293fcb316'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:57.384123 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1699/3351] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:09:57 2022] DELETE /identity/v3/users/62a0c1f583944bd092abc02293fcb316 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:57.434637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:INSERT=2,keystone:SELECT=81 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:57.694029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52349fc0-fbe3-43ab-9cc1-859561656b19 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:57.716953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52349fc0-fbe3-43ab-9cc1-859561656b19 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:57.855837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58850912-4322-4654-948b-701d2f2ee946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:57.857684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58850912-4322-4654-948b-701d2f2ee946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:57.858271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58850912-4322-4654-948b-701d2f2ee946 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:57.858922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58850912-4322-4654-948b-701d2f2ee946 admin admin] PATH_INFO: `/v3/projects/a54682a0b9f34993a0e616507695307e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:57.861570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58850912-4322-4654-948b-701d2f2ee946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a54682a0b9f34993a0e616507695307e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:57.863670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58850912-4322-4654-948b-701d2f2ee946 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:57.979138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-58850912-4322-4654-948b-701d2f2ee946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a54682a0b9f34993a0e616507695307e', 'request_id': 'req-58850912-4322-4654-948b-701d2f2ee946'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:57.990499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-58850912-4322-4654-948b-701d2f2ee946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a54682a0b9f34993a0e616507695307e', 'request_id': 'req-58850912-4322-4654-948b-701d2f2ee946'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:58.006439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-58850912-4322-4654-948b-701d2f2ee946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a54682a0b9f34993a0e616507695307e', 'request_id': 'req-58850912-4322-4654-948b-701d2f2ee946'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:58.027585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-58850912-4322-4654-948b-701d2f2ee946 admin admin] The token cache is being invalidate because project a54682a0b9f34993a0e616507695307e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:09:58.028074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-58850912-4322-4654-948b-701d2f2ee946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:58.029613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-58850912-4322-4654-948b-701d2f2ee946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:09:58.032444 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1653/3352] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:09:57 2022] DELETE /identity/v3/projects/a54682a0b9f34993a0e616507695307e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:58.037560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a742201-9dbf-4c96-8116-5eb8e66d3d80 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:58.038125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a742201-9dbf-4c96-8116-5eb8e66d3d80 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:58.038590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a742201-9dbf-4c96-8116-5eb8e66d3d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:58.063039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7a742201-9dbf-4c96-8116-5eb8e66d3d80 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:58.064508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7a742201-9dbf-4c96-8116-5eb8e66d3d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:58.154305 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1700/3353] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:09:58.163625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23aa65b-b16f-4f01-b178-23ff213f1935 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:58.164996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23aa65b-b16f-4f01-b178-23ff213f1935 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:58.165493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23aa65b-b16f-4f01-b178-23ff213f1935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:58.197268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c23aa65b-b16f-4f01-b178-23ff213f1935 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:58.198653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c23aa65b-b16f-4f01-b178-23ff213f1935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:58.207988 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1654/3354] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:58.213269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a742201-9dbf-4c96-8116-5eb8e66d3d80 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:58.224605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a742201-9dbf-4c96-8116-5eb8e66d3d80 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:58.229368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1419c-5fcb-4a0f-9e84-4876d389472e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:58.230046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1419c-5fcb-4a0f-9e84-4876d389472e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:58.230355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1419c-5fcb-4a0f-9e84-4876d389472e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:58.230630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1419c-5fcb-4a0f-9e84-4876d389472e admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:58.231365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1419c-5fcb-4a0f-9e84-4876d389472e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:09:58.231701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1419c-5fcb-4a0f-9e84-4876d389472e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:58.233379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1419c-5fcb-4a0f-9e84-4876d389472e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:58.252318 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1701/3355] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:09:58.253244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23aa65b-b16f-4f01-b178-23ff213f1935 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:58.263645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23aa65b-b16f-4f01-b178-23ff213f1935 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:58.269786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717aab7-58b0-424e-8fd0-3a26c59ac965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:58.270543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717aab7-58b0-424e-8fd0-3a26c59ac965 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:58.270917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717aab7-58b0-424e-8fd0-3a26c59ac965 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:58.271261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717aab7-58b0-424e-8fd0-3a26c59ac965 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:58.272207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717aab7-58b0-424e-8fd0-3a26c59ac965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:58.274892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717aab7-58b0-424e-8fd0-3a26c59ac965 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:58.306434 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1655/3356] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:09:58 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:09:58.310943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1419c-5fcb-4a0f-9e84-4876d389472e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:58.322065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1419c-5fcb-4a0f-9e84-4876d389472e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:58.380111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:58.393934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb728e8-968f-4954-b24f-591b40fcb6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:58.395078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb728e8-968f-4954-b24f-591b40fcb6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:58.395359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb728e8-968f-4954-b24f-591b40fcb6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:58.395635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb728e8-968f-4954-b24f-591b40fcb6a5 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:58.396375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb728e8-968f-4954-b24f-591b40fcb6a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:58.398414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb728e8-968f-4954-b24f-591b40fcb6a5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:58.423563 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1702/3357] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:09:58 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:09:58.424886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717aab7-58b0-424e-8fd0-3a26c59ac965 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:58.436243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717aab7-58b0-424e-8fd0-3a26c59ac965 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:58.441510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353fe18-85bd-4b47-aaf9-f23d0073946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:58.442955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353fe18-85bd-4b47-aaf9-f23d0073946b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:58.443257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353fe18-85bd-4b47-aaf9-f23d0073946b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:58.443641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353fe18-85bd-4b47-aaf9-f23d0073946b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:58.444409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353fe18-85bd-4b47-aaf9-f23d0073946b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:58.446054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353fe18-85bd-4b47-aaf9-f23d0073946b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:58.457687 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1656/3358] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:09:58.461856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb728e8-968f-4954-b24f-591b40fcb6a5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:58.473533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb728e8-968f-4954-b24f-591b40fcb6a5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:58.479338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a42a3-ff18-4c71-a6a3-c508ce7e30f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:58.480015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a42a3-ff18-4c71-a6a3-c508ce7e30f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:58.480333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a42a3-ff18-4c71-a6a3-c508ce7e30f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:58.480609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a42a3-ff18-4c71-a6a3-c508ce7e30f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:58.481330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a42a3-ff18-4c71-a6a3-c508ce7e30f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:58.482939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a42a3-ff18-4c71-a6a3-c508ce7e30f0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:58.493921 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1703/3359] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:09:58.501755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353fe18-85bd-4b47-aaf9-f23d0073946b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:58.512333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353fe18-85bd-4b47-aaf9-f23d0073946b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:58.517289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393005d-1121-449d-b6ca-f70ea4e40904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:58.518181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393005d-1121-449d-b6ca-f70ea4e40904 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:58.518455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393005d-1121-449d-b6ca-f70ea4e40904 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:58.519079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393005d-1121-449d-b6ca-f70ea4e40904 admin admin] PATH_INFO: `/v3/projects/c3f6b014bf864b6aa1a1d980f4dd70b0/users/e1eb8b2dbe5e4d1d96891039f146bffe/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:58.535127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393005d-1121-449d-b6ca-f70ea4e40904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f6b014bf864b6aa1a1d980f4dd70b0, user_id=e1eb8b2dbe5e4d1d96891039f146bffe, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:58.537849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393005d-1121-449d-b6ca-f70ea4e40904 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:58.553477 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1657/3360] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:09:58 2022] PUT /identity/v3/projects/c3f6b014bf864b6aa1a1d980f4dd70b0/users/e1eb8b2dbe5e4d1d96891039f146bffe/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:09:58.564971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fbae8-1585-43c8-9b78-d2bc8f28a6aa None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:58.565337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fbae8-1585-43c8-9b78-d2bc8f28a6aa None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:58.565683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fbae8-1585-43c8-9b78-d2bc8f28a6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:58.595350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-da2fbae8-1585-43c8-9b78-d2bc8f28a6aa None None] MFA Rules not processed for user `e1eb8b2dbe5e4d1d96891039f146bffe`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:58.596553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-da2fbae8-1585-43c8-9b78-d2bc8f28a6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:58.683652 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1704/3361] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:09:58.692661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393005d-1121-449d-b6ca-f70ea4e40904 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:58.695435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5393005d-1121-449d-b6ca-f70ea4e40904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:58.761021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:58.826005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393005d-1121-449d-b6ca-f70ea4e40904 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:58.837632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82a74b-9834-4e2d-90f3-42ec0bb04142 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:58.838319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82a74b-9834-4e2d-90f3-42ec0bb04142 service glance] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:58.838597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82a74b-9834-4e2d-90f3-42ec0bb04142 service glance] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:58.838875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82a74b-9834-4e2d-90f3-42ec0bb04142 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:58.861481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82a74b-9834-4e2d-90f3-42ec0bb04142 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:58.870344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82a74b-9834-4e2d-90f3-42ec0bb04142 service glance] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:58.893483 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1658/3362] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:09:59.049688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be661c5-485c-42fb-a860-2625e57de495 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:59.049688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be661c5-485c-42fb-a860-2625e57de495 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:59.049936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be661c5-485c-42fb-a860-2625e57de495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:59.083338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2be661c5-485c-42fb-a860-2625e57de495 None None] MFA Rules not processed for user `b3b24a3216aa4eba8a9a90c109c3b491`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:59.084678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2be661c5-485c-42fb-a860-2625e57de495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:59.170359 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1705/3363] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:59.178591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d7928-86c0-4787-b618-2d2559328348 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:59.178881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d7928-86c0-4787-b618-2d2559328348 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:59.179479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d7928-86c0-4787-b618-2d2559328348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:59.200028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-104d7928-86c0-4787-b618-2d2559328348 None None] MFA Rules not processed for user `b3b24a3216aa4eba8a9a90c109c3b491`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:09:59.201629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-104d7928-86c0-4787-b618-2d2559328348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:59.215224 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1659/3364] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:09:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:09:59.222203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be661c5-485c-42fb-a860-2625e57de495 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:09:59.223687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2be661c5-485c-42fb-a860-2625e57de495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:09:59.302547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:59.333306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be661c5-485c-42fb-a860-2625e57de495 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:09:59.340759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28114ae3-cd45-49de-aac7-88db5a51950c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:09:59.342247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28114ae3-cd45-49de-aac7-88db5a51950c service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:09:59.343023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28114ae3-cd45-49de-aac7-88db5a51950c service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:09:59.343023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28114ae3-cd45-49de-aac7-88db5a51950c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:09:59.352987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28114ae3-cd45-49de-aac7-88db5a51950c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:09:59.354955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28114ae3-cd45-49de-aac7-88db5a51950c service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:09:59.365604 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1706/3365] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:09:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:10:00.053654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916fc64-59ff-4693-9384-37854db75cfb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:00.055038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916fc64-59ff-4693-9384-37854db75cfb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:00.055498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916fc64-59ff-4693-9384-37854db75cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:00.108281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9916fc64-59ff-4693-9384-37854db75cfb None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:00.115768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9916fc64-59ff-4693-9384-37854db75cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:00.196250 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1660/3366] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:10:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:00.263513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28114ae3-cd45-49de-aac7-88db5a51950c service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:00.265894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-28114ae3-cd45-49de-aac7-88db5a51950c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:00.379145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28114ae3-cd45-49de-aac7-88db5a51950c service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:00.386329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb00e6-dd5d-4bca-8c4b-87f433841cfb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:00.387135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb00e6-dd5d-4bca-8c4b-87f433841cfb service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:00.387513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb00e6-dd5d-4bca-8c4b-87f433841cfb service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:00.387908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb00e6-dd5d-4bca-8c4b-87f433841cfb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:00.398160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb00e6-dd5d-4bca-8c4b-87f433841cfb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:00.400744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb00e6-dd5d-4bca-8c4b-87f433841cfb service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:00.452222 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1707/3367] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:10:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:10:02.703557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127472a-189e-4e6a-97cf-e48e58e48b47 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:02.704147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127472a-189e-4e6a-97cf-e48e58e48b47 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:02.704147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127472a-189e-4e6a-97cf-e48e58e48b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:02.745152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6127472a-189e-4e6a-97cf-e48e58e48b47 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:02.746687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6127472a-189e-4e6a-97cf-e48e58e48b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:02.757036 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1661/3368] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:10:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:02.784171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb00e6-dd5d-4bca-8c4b-87f433841cfb service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:02.803133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb00e6-dd5d-4bca-8c4b-87f433841cfb service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:02.819850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c228479-bcbe-4f8a-84c3-be49b49d79f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:02.820573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c228479-bcbe-4f8a-84c3-be49b49d79f8 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:02.820858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c228479-bcbe-4f8a-84c3-be49b49d79f8 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:02.821140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c228479-bcbe-4f8a-84c3-be49b49d79f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:02.847147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c228479-bcbe-4f8a-84c3-be49b49d79f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:02.848887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c228479-bcbe-4f8a-84c3-be49b49d79f8 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:02.867393 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1708/3369] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:10:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:10:04.440146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e70eb-5c44-4e41-b615-168bcc47789a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:04.441418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e70eb-5c44-4e41-b615-168bcc47789a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:04.441903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e70eb-5c44-4e41-b615-168bcc47789a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:04.476535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0c0e70eb-5c44-4e41-b615-168bcc47789a None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:04.477880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0c0e70eb-5c44-4e41-b615-168bcc47789a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:04.493986 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1662/3370] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:10:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:04.506922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c228479-bcbe-4f8a-84c3-be49b49d79f8 service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:04.532105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c228479-bcbe-4f8a-84c3-be49b49d79f8 service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:04.546229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4361e03-d4e6-48c1-9ec2-2406e4f2153a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:04.547035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4361e03-d4e6-48c1-9ec2-2406e4f2153a service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:04.547386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4361e03-d4e6-48c1-9ec2-2406e4f2153a service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:04.547753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4361e03-d4e6-48c1-9ec2-2406e4f2153a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:04.600461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4361e03-d4e6-48c1-9ec2-2406e4f2153a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:04.602484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4361e03-d4e6-48c1-9ec2-2406e4f2153a service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:04.635610 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1709/3371] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:10:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:10:05.233829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f91c2-4c00-4e6f-a04d-4a3511287651 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:05.234188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f91c2-4c00-4e6f-a04d-4a3511287651 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:05.234533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f91c2-4c00-4e6f-a04d-4a3511287651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:05.253744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f40f91c2-4c00-4e6f-a04d-4a3511287651 None None] MFA Rules not processed for user `e1eb8b2dbe5e4d1d96891039f146bffe`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:05.255072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f40f91c2-4c00-4e6f-a04d-4a3511287651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:05.263015 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1663/3372] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:05.854649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c75a01-faf3-424b-81da-208bc663a069 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:05.855652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c75a01-faf3-424b-81da-208bc663a069 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:05.856400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c75a01-faf3-424b-81da-208bc663a069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:05.910088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d3c75a01-faf3-424b-81da-208bc663a069 None None] MFA Rules not processed for user `e1eb8b2dbe5e4d1d96891039f146bffe`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:05.914087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d3c75a01-faf3-424b-81da-208bc663a069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:05.937178 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1710/3373] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:07.043451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f91c2-4c00-4e6f-a04d-4a3511287651 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:07.045235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f40f91c2-4c00-4e6f-a04d-4a3511287651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:07.172970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f91c2-4c00-4e6f-a04d-4a3511287651 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:07.179587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f7c30-2286-46b0-a7d4-3885d8021237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:07.180750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f7c30-2286-46b0-a7d4-3885d8021237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:07.181206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f7c30-2286-46b0-a7d4-3885d8021237 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:07.181633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f7c30-2286-46b0-a7d4-3885d8021237 admin admin] PATH_INFO: `/v3/users/ae104851a64c4638abd70af95f27d4fa` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:07.183236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f7c30-2286-46b0-a7d4-3885d8021237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae104851a64c4638abd70af95f27d4fa)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:07.185417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f7c30-2286-46b0-a7d4-3885d8021237 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:07.265588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eb7f7c30-2286-46b0-a7d4-3885d8021237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae104851a64c4638abd70af95f27d4fa'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:07.272331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:07.287309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eb7f7c30-2286-46b0-a7d4-3885d8021237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae104851a64c4638abd70af95f27d4fa'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:07.303387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eb7f7c30-2286-46b0-a7d4-3885d8021237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae104851a64c4638abd70af95f27d4fa'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:07.304655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eb7f7c30-2286-46b0-a7d4-3885d8021237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae104851a64c4638abd70af95f27d4fa'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:07.305593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eb7f7c30-2286-46b0-a7d4-3885d8021237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae104851a64c4638abd70af95f27d4fa'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:07.341948 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1664/3374] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:10:07 2022] DELETE /identity/v3/users/ae104851a64c4638abd70af95f27d4fa => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:07.394881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c75a01-faf3-424b-81da-208bc663a069 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:07.396608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d3c75a01-faf3-424b-81da-208bc663a069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:07.423684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c75a01-faf3-424b-81da-208bc663a069 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:07.511940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3787d58-615c-455c-bd81-e6df48723c42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:07.512880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3787d58-615c-455c-bd81-e6df48723c42 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:07.513343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3787d58-615c-455c-bd81-e6df48723c42 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:07.513680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3787d58-615c-455c-bd81-e6df48723c42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:07.515948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b3787d58-615c-455c-bd81-e6df48723c42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:07.565742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:07.600837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f7c30-2286-46b0-a7d4-3885d8021237 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:07.602794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-eb7f7c30-2286-46b0-a7d4-3885d8021237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:07.612351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3787d58-615c-455c-bd81-e6df48723c42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:07.613985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3787d58-615c-455c-bd81-e6df48723c42 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:07.633528 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1711/3375] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:10:07 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:10:07.711914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f7c30-2286-46b0-a7d4-3885d8021237 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:07.717951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f0966-4aa7-4b16-a2c5-9c65fa7f9e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:07.719038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f0966-4aa7-4b16-a2c5-9c65fa7f9e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:07.719526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f0966-4aa7-4b16-a2c5-9c65fa7f9e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:07.719974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f0966-4aa7-4b16-a2c5-9c65fa7f9e8a admin admin] PATH_INFO: `/v3/projects/90c7a815db0145889cf47ebcca5843f6` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:07.721359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f0966-4aa7-4b16-a2c5-9c65fa7f9e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c7a815db0145889cf47ebcca5843f6)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:07.723753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f0966-4aa7-4b16-a2c5-9c65fa7f9e8a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:07.787696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-224f0966-4aa7-4b16-a2c5-9c65fa7f9e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c7a815db0145889cf47ebcca5843f6', 'request_id': 'req-224f0966-4aa7-4b16-a2c5-9c65fa7f9e8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:07.796633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-224f0966-4aa7-4b16-a2c5-9c65fa7f9e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c7a815db0145889cf47ebcca5843f6', 'request_id': 'req-224f0966-4aa7-4b16-a2c5-9c65fa7f9e8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:07.804057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-224f0966-4aa7-4b16-a2c5-9c65fa7f9e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c7a815db0145889cf47ebcca5843f6', 'request_id': 'req-224f0966-4aa7-4b16-a2c5-9c65fa7f9e8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:07.822650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-224f0966-4aa7-4b16-a2c5-9c65fa7f9e8a admin admin] The token cache is being invalidate because project 90c7a815db0145889cf47ebcca5843f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:10:07.822946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-224f0966-4aa7-4b16-a2c5-9c65fa7f9e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:07.823988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-224f0966-4aa7-4b16-a2c5-9c65fa7f9e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:07.828127 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1665/3376] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:07 2022] DELETE /identity/v3/projects/90c7a815db0145889cf47ebcca5843f6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:10:07.830959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afd6ea-86ff-499e-a6cf-b3f70fcd415d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:07.831492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afd6ea-86ff-499e-a6cf-b3f70fcd415d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:07.831975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afd6ea-86ff-499e-a6cf-b3f70fcd415d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:07.854572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-42afd6ea-86ff-499e-a6cf-b3f70fcd415d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:07.856199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-42afd6ea-86ff-499e-a6cf-b3f70fcd415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:07.970726 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1712/3377] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:07.978734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5f8a2-557f-4014-8882-6d8f331c2de7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:07.979092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5f8a2-557f-4014-8882-6d8f331c2de7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:07.979461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5f8a2-557f-4014-8882-6d8f331c2de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:07.999417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e6a5f8a2-557f-4014-8882-6d8f331c2de7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:08.000864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e6a5f8a2-557f-4014-8882-6d8f331c2de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:08.017981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afd6ea-86ff-499e-a6cf-b3f70fcd415d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:08.020340 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1666/3378] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:08.030407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afd6ea-86ff-499e-a6cf-b3f70fcd415d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:08.048328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35b42a-b328-475e-a8d8-4f43dc8991e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:08.048949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35b42a-b328-475e-a8d8-4f43dc8991e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:08.049233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35b42a-b328-475e-a8d8-4f43dc8991e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:08.049508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35b42a-b328-475e-a8d8-4f43dc8991e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:08.050244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35b42a-b328-475e-a8d8-4f43dc8991e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:10:08.050550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35b42a-b328-475e-a8d8-4f43dc8991e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:08.052680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35b42a-b328-475e-a8d8-4f43dc8991e7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:08.071685 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1713/3379] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:10:08.072868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5f8a2-557f-4014-8882-6d8f331c2de7 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:08.093107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5f8a2-557f-4014-8882-6d8f331c2de7 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:08.102228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd456f-9365-4025-af95-57bef652faa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:08.102899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd456f-9365-4025-af95-57bef652faa9 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:08.103177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd456f-9365-4025-af95-57bef652faa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:08.103452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd456f-9365-4025-af95-57bef652faa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:08.104213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd456f-9365-4025-af95-57bef652faa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:08.106290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd456f-9365-4025-af95-57bef652faa9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:08.149910 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1667/3380] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:10:08 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:10:08.154139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35b42a-b328-475e-a8d8-4f43dc8991e7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:08.164533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35b42a-b328-475e-a8d8-4f43dc8991e7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:08.222250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d4f84-afdf-4e30-a0a1-9b0237a908d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:08.222934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d4f84-afdf-4e30-a0a1-9b0237a908d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:08.223214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d4f84-afdf-4e30-a0a1-9b0237a908d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:08.223489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d4f84-afdf-4e30-a0a1-9b0237a908d8 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:08.224235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d4f84-afdf-4e30-a0a1-9b0237a908d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:08.226799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d4f84-afdf-4e30-a0a1-9b0237a908d8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:08.250942 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1714/3381] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:10:08 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:10:08.259997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd456f-9365-4025-af95-57bef652faa9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:08.279233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd456f-9365-4025-af95-57bef652faa9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:08.287817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46242c5f-e542-47e0-93f0-09ddc38fd026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:08.289268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46242c5f-e542-47e0-93f0-09ddc38fd026 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:08.291018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46242c5f-e542-47e0-93f0-09ddc38fd026 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:08.291863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46242c5f-e542-47e0-93f0-09ddc38fd026 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:08.292125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46242c5f-e542-47e0-93f0-09ddc38fd026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:08.293771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46242c5f-e542-47e0-93f0-09ddc38fd026 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:08.316174 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1668/3382] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:10:08.317056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d4f84-afdf-4e30-a0a1-9b0237a908d8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:08.327666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d4f84-afdf-4e30-a0a1-9b0237a908d8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:08.332358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5441c54-7929-460b-af2c-f8fadb73a39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:08.333026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5441c54-7929-460b-af2c-f8fadb73a39d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:08.333306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5441c54-7929-460b-af2c-f8fadb73a39d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:08.333584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5441c54-7929-460b-af2c-f8fadb73a39d admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:08.334637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5441c54-7929-460b-af2c-f8fadb73a39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:08.336427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5441c54-7929-460b-af2c-f8fadb73a39d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:08.347813 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1715/3383] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:10:08.351688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46242c5f-e542-47e0-93f0-09ddc38fd026 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:08.367503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46242c5f-e542-47e0-93f0-09ddc38fd026 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:08.372420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda967a-c09c-4b8d-8f81-ceec5c5d66ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:08.373318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda967a-c09c-4b8d-8f81-ceec5c5d66ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:08.373596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda967a-c09c-4b8d-8f81-ceec5c5d66ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:08.373872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda967a-c09c-4b8d-8f81-ceec5c5d66ae admin admin] PATH_INFO: `/v3/projects/756410b2ad7345779f62a9db9835456f/users/419f3872408c4d8c9a2980d6397d0aea/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:08.389659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda967a-c09c-4b8d-8f81-ceec5c5d66ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=756410b2ad7345779f62a9db9835456f, user_id=419f3872408c4d8c9a2980d6397d0aea, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:08.392356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda967a-c09c-4b8d-8f81-ceec5c5d66ae admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:08.394598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:08.408285 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1669/3384] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:10:08 2022] PUT /identity/v3/projects/756410b2ad7345779f62a9db9835456f/users/419f3872408c4d8c9a2980d6397d0aea/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:10:08.413749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f592cc-efbd-4644-bbcf-ba6cfbb33402 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:08.414319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f592cc-efbd-4644-bbcf-ba6cfbb33402 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:08.414743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f592cc-efbd-4644-bbcf-ba6cfbb33402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:08.435152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b9f592cc-efbd-4644-bbcf-ba6cfbb33402 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:08.437866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b9f592cc-efbd-4644-bbcf-ba6cfbb33402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:08.468882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:08.510237 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1716/3385] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:08.517245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda967a-c09c-4b8d-8f81-ceec5c5d66ae admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:08.519017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bbda967a-c09c-4b8d-8f81-ceec5c5d66ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:08.582406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda967a-c09c-4b8d-8f81-ceec5c5d66ae admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:08.586314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a13185-a831-4622-849a-db64eb0b5afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:08.586973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a13185-a831-4622-849a-db64eb0b5afc service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:08.587253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a13185-a831-4622-849a-db64eb0b5afc service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:08.587531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a13185-a831-4622-849a-db64eb0b5afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:08.596782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a13185-a831-4622-849a-db64eb0b5afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:08.598227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a13185-a831-4622-849a-db64eb0b5afc service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:08.608284 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1670/3386] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:10:16.113261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f592cc-efbd-4644-bbcf-ba6cfbb33402 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:16.114765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b9f592cc-efbd-4644-bbcf-ba6cfbb33402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:16.136931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f592cc-efbd-4644-bbcf-ba6cfbb33402 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:16.145729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046e3eb-e182-447d-85c2-4bd1c02815c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:16.146632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046e3eb-e182-447d-85c2-4bd1c02815c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:16.150854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046e3eb-e182-447d-85c2-4bd1c02815c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:16.151387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046e3eb-e182-447d-85c2-4bd1c02815c5 admin admin] PATH_INFO: `/v3/users/8aa30bbc54064a5492836308770c0131` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:16.154635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046e3eb-e182-447d-85c2-4bd1c02815c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aa30bbc54064a5492836308770c0131)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:16.159651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046e3eb-e182-447d-85c2-4bd1c02815c5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:16.288221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5046e3eb-e182-447d-85c2-4bd1c02815c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aa30bbc54064a5492836308770c0131'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:16.317780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5046e3eb-e182-447d-85c2-4bd1c02815c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aa30bbc54064a5492836308770c0131'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:16.318515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5046e3eb-e182-447d-85c2-4bd1c02815c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aa30bbc54064a5492836308770c0131'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:16.319534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5046e3eb-e182-447d-85c2-4bd1c02815c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aa30bbc54064a5492836308770c0131'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:16.333746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5046e3eb-e182-447d-85c2-4bd1c02815c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aa30bbc54064a5492836308770c0131'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:16.431335 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1717/3387] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:10:16 2022] DELETE /identity/v3/users/8aa30bbc54064a5492836308770c0131 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:16.435733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1dfe8-3a8b-459b-97e4-45b323a40e3a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:16.436627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1dfe8-3a8b-459b-97e4-45b323a40e3a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:16.437044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1dfe8-3a8b-459b-97e4-45b323a40e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:16.463405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a9f1dfe8-3a8b-459b-97e4-45b323a40e3a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:16.464976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a9f1dfe8-3a8b-459b-97e4-45b323a40e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:16.584683 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1671/3388] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:16.671113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046e3eb-e182-447d-85c2-4bd1c02815c5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:16.673101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5046e3eb-e182-447d-85c2-4bd1c02815c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:16.841606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046e3eb-e182-447d-85c2-4bd1c02815c5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:16.848674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ca62e-3df5-41f1-848a-4ddade8bb24f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:16.850564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ca62e-3df5-41f1-848a-4ddade8bb24f service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:16.851131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ca62e-3df5-41f1-848a-4ddade8bb24f service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:16.851700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ca62e-3df5-41f1-848a-4ddade8bb24f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:16.870750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ca62e-3df5-41f1-848a-4ddade8bb24f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:16.873552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ca62e-3df5-41f1-848a-4ddade8bb24f service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:16.893241 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1718/3389] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:10:17.780370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03508d1-e595-4959-ab2d-c1ea950c0a0f None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:17.780968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03508d1-e595-4959-ab2d-c1ea950c0a0f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:17.780968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03508d1-e595-4959-ab2d-c1ea950c0a0f None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:17.782578 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1672/3390] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:10:17.787905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e8aa2-1b74-4435-85c8-09cd405cf86b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:17.788506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e8aa2-1b74-4435-85c8-09cd405cf86b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:17.788901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e8aa2-1b74-4435-85c8-09cd405cf86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:17.843579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-522e8aa2-1b74-4435-85c8-09cd405cf86b None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:17.848529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-522e8aa2-1b74-4435-85c8-09cd405cf86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:18.005165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:18.060254 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1719/3391] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:10:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:18.068101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03508d1-e595-4959-ab2d-c1ea950c0a0f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:18.070560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e03508d1-e595-4959-ab2d-c1ea950c0a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:18.103906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03508d1-e595-4959-ab2d-c1ea950c0a0f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:18.110949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4580cd2-b6ac-40e6-96cb-fc26e28e3d40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:18.111930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4580cd2-b6ac-40e6-96cb-fc26e28e3d40 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:18.112314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4580cd2-b6ac-40e6-96cb-fc26e28e3d40 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:18.112656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4580cd2-b6ac-40e6-96cb-fc26e28e3d40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:18.122627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4580cd2-b6ac-40e6-96cb-fc26e28e3d40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:18.126086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4580cd2-b6ac-40e6-96cb-fc26e28e3d40 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:18.141586 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1673/3392] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:10:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:10:19.161107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e8aa2-1b74-4435-85c8-09cd405cf86b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:19.163801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-522e8aa2-1b74-4435-85c8-09cd405cf86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:19.195122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e8aa2-1b74-4435-85c8-09cd405cf86b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:19.205857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619e436-dd68-45ce-b089-ffaeb014c78e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:19.208811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619e436-dd68-45ce-b089-ffaeb014c78e service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:19.210507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619e436-dd68-45ce-b089-ffaeb014c78e service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:19.212437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619e436-dd68-45ce-b089-ffaeb014c78e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:19.219732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6619e436-dd68-45ce-b089-ffaeb014c78e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:19.290832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619e436-dd68-45ce-b089-ffaeb014c78e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:19.297302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619e436-dd68-45ce-b089-ffaeb014c78e service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:19.329453 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1720/3393] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:10:19.482590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4580cd2-b6ac-40e6-96cb-fc26e28e3d40 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:19.483083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619e436-dd68-45ce-b089-ffaeb014c78e service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:19.484222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f4580cd2-b6ac-40e6-96cb-fc26e28e3d40 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:19.493023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619e436-dd68-45ce-b089-ffaeb014c78e service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:19.506497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fbbe6-1345-4fc0-b9c6-56624ce9f6c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:19.507212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fbbe6-1345-4fc0-b9c6-56624ce9f6c3 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:19.507490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fbbe6-1345-4fc0-b9c6-56624ce9f6c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:19.513041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fbbe6-1345-4fc0-b9c6-56624ce9f6c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:19.514402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4580cd2-b6ac-40e6-96cb-fc26e28e3d40 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:19.519054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2e6fbbe6-1345-4fc0-b9c6-56624ce9f6c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:19.522132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b8575-2d80-4533-8cb2-8ef51eb5c595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:19.524901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b8575-2d80-4533-8cb2-8ef51eb5c595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:19.525349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b8575-2d80-4533-8cb2-8ef51eb5c595 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:19.525775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b8575-2d80-4533-8cb2-8ef51eb5c595 admin admin] PATH_INFO: `/v3/projects/2652c1d42aaf4f12ae2561ce0574cd74` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:19.527161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b8575-2d80-4533-8cb2-8ef51eb5c595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2652c1d42aaf4f12ae2561ce0574cd74)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:19.531417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b8575-2d80-4533-8cb2-8ef51eb5c595 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:19.634280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-720b8575-2d80-4533-8cb2-8ef51eb5c595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2652c1d42aaf4f12ae2561ce0574cd74', 'request_id': 'req-720b8575-2d80-4533-8cb2-8ef51eb5c595'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:19.650329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-720b8575-2d80-4533-8cb2-8ef51eb5c595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2652c1d42aaf4f12ae2561ce0574cd74', 'request_id': 'req-720b8575-2d80-4533-8cb2-8ef51eb5c595'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:19.659888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fbbe6-1345-4fc0-b9c6-56624ce9f6c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:19.661881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fbbe6-1345-4fc0-b9c6-56624ce9f6c3 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:19.664821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-720b8575-2d80-4533-8cb2-8ef51eb5c595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2652c1d42aaf4f12ae2561ce0574cd74', 'request_id': 'req-720b8575-2d80-4533-8cb2-8ef51eb5c595'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:19.691485 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1721/3394] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:10:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:10:19.692097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-720b8575-2d80-4533-8cb2-8ef51eb5c595 admin admin] The token cache is being invalidate because project 2652c1d42aaf4f12ae2561ce0574cd74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:10:19.692385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-720b8575-2d80-4533-8cb2-8ef51eb5c595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:19.694417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-720b8575-2d80-4533-8cb2-8ef51eb5c595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:19.698600 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1674/3395] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:19 2022] DELETE /identity/v3/projects/2652c1d42aaf4f12ae2561ce0574cd74 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:19.703976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be74484-4d6d-4a18-af7a-daebd2bc74b1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:19.704654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be74484-4d6d-4a18-af7a-daebd2bc74b1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:19.705162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be74484-4d6d-4a18-af7a-daebd2bc74b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:19.734663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1be74484-4d6d-4a18-af7a-daebd2bc74b1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:19.737366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1be74484-4d6d-4a18-af7a-daebd2bc74b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:19.784498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b8575-2d80-4533-8cb2-8ef51eb5c595 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:19.786379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-720b8575-2d80-4533-8cb2-8ef51eb5c595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:19.807579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:19.883443 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1722/3396] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:19.893216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280729f-baf9-415a-9a66-84de153de874 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:19.895198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280729f-baf9-415a-9a66-84de153de874 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:19.895812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280729f-baf9-415a-9a66-84de153de874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:19.901562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b8575-2d80-4533-8cb2-8ef51eb5c595 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:19.907374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ec3c2-ae05-438e-b8b0-2bdb78857958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:19.908068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ec3c2-ae05-438e-b8b0-2bdb78857958 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:19.908488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ec3c2-ae05-438e-b8b0-2bdb78857958 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:19.909304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ec3c2-ae05-438e-b8b0-2bdb78857958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:19.912618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4c6ec3c2-ae05-438e-b8b0-2bdb78857958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:19.926406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ec3c2-ae05-438e-b8b0-2bdb78857958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:19.927137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c280729f-baf9-415a-9a66-84de153de874 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:19.928928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ec3c2-ae05-438e-b8b0-2bdb78857958 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:19.930217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c280729f-baf9-415a-9a66-84de153de874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:19.942398 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1675/3397] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:10:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:10:19.953027 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1723/3398] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:19.957820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ec3c2-ae05-438e-b8b0-2bdb78857958 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:19.972837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ec3c2-ae05-438e-b8b0-2bdb78857958 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:19.977940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed8461-4a33-439e-8545-f6d10a48fce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:19.978611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed8461-4a33-439e-8545-f6d10a48fce3 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:19.981081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed8461-4a33-439e-8545-f6d10a48fce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:19.981081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed8461-4a33-439e-8545-f6d10a48fce3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:19.981081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed8461-4a33-439e-8545-f6d10a48fce3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:10:19.981081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed8461-4a33-439e-8545-f6d10a48fce3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:19.982482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed8461-4a33-439e-8545-f6d10a48fce3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:19.996937 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1676/3399] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:10:20.001216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280729f-baf9-415a-9a66-84de153de874 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:20.012861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280729f-baf9-415a-9a66-84de153de874 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:20.019683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dbd71-e1ee-4d77-86d8-a812699e2a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:20.020537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dbd71-e1ee-4d77-86d8-a812699e2a19 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:20.020918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dbd71-e1ee-4d77-86d8-a812699e2a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:20.021290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dbd71-e1ee-4d77-86d8-a812699e2a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:20.022219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7dbd71-e1ee-4d77-86d8-a812699e2a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:20.024641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7dbd71-e1ee-4d77-86d8-a812699e2a19 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:20.058363 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1724/3400] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:10:19 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:10:20.063549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed8461-4a33-439e-8545-f6d10a48fce3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:20.077312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed8461-4a33-439e-8545-f6d10a48fce3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:20.194521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8490a-9012-4e10-b851-d4113701949a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:20.195335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8490a-9012-4e10-b851-d4113701949a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:20.196115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8490a-9012-4e10-b851-d4113701949a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:20.198129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8490a-9012-4e10-b851-d4113701949a admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:20.198129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8490a-9012-4e10-b851-d4113701949a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:20.199986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8490a-9012-4e10-b851-d4113701949a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:20.241364 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1677/3401] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:10:20 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:10:20.245241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dbd71-e1ee-4d77-86d8-a812699e2a19 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:20.267799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dbd71-e1ee-4d77-86d8-a812699e2a19 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:20.273852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374cfb9-340f-4d72-9fd8-ff5e35e35ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:20.274885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374cfb9-340f-4d72-9fd8-ff5e35e35ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:20.275309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374cfb9-340f-4d72-9fd8-ff5e35e35ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:20.276266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374cfb9-340f-4d72-9fd8-ff5e35e35ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:20.277158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374cfb9-340f-4d72-9fd8-ff5e35e35ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:20.280196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374cfb9-340f-4d72-9fd8-ff5e35e35ca0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:20.297006 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1725/3402] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:10:20.301507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8490a-9012-4e10-b851-d4113701949a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:20.320543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8490a-9012-4e10-b851-d4113701949a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:20.334902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7217565-844e-42c1-90e0-b981b1fe5b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:20.336320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7217565-844e-42c1-90e0-b981b1fe5b53 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:20.336983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7217565-844e-42c1-90e0-b981b1fe5b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:20.337429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7217565-844e-42c1-90e0-b981b1fe5b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:20.338543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7217565-844e-42c1-90e0-b981b1fe5b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:20.341333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7217565-844e-42c1-90e0-b981b1fe5b53 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:20.362499 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1678/3403] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:10:20.365947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374cfb9-340f-4d72-9fd8-ff5e35e35ca0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:20.388547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374cfb9-340f-4d72-9fd8-ff5e35e35ca0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:20.395459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233079a3-569d-4cbc-b20b-c5deece08a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:20.396519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233079a3-569d-4cbc-b20b-c5deece08a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:20.396915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233079a3-569d-4cbc-b20b-c5deece08a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:20.397412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233079a3-569d-4cbc-b20b-c5deece08a75 admin admin] PATH_INFO: `/v3/projects/a5e078c0b16e4a169f7a5ef294ab52e9/users/1e96036ac8194c49b2cdb98529f22f70/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:20.441025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233079a3-569d-4cbc-b20b-c5deece08a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e078c0b16e4a169f7a5ef294ab52e9, user_id=1e96036ac8194c49b2cdb98529f22f70, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:20.444266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233079a3-569d-4cbc-b20b-c5deece08a75 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:20.456600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:20.527309 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1726/3404] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:10:20 2022] PUT /identity/v3/projects/a5e078c0b16e4a169f7a5ef294ab52e9/users/1e96036ac8194c49b2cdb98529f22f70/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:10:20.532549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae783ad-a381-4b0d-abae-ca533a8041f4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:20.533038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae783ad-a381-4b0d-abae-ca533a8041f4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:20.533127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae783ad-a381-4b0d-abae-ca533a8041f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:20.572224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-eae783ad-a381-4b0d-abae-ca533a8041f4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:20.576205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-eae783ad-a381-4b0d-abae-ca533a8041f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:20.689448 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1679/3405] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:20.721299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233079a3-569d-4cbc-b20b-c5deece08a75 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:20.789745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233079a3-569d-4cbc-b20b-c5deece08a75 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:20.793998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74973b3-d7ac-4d8f-9e6a-212e11524812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:20.794778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74973b3-d7ac-4d8f-9e6a-212e11524812 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:20.795139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74973b3-d7ac-4d8f-9e6a-212e11524812 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:20.795483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74973b3-d7ac-4d8f-9e6a-212e11524812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:20.815021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74973b3-d7ac-4d8f-9e6a-212e11524812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:20.816931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74973b3-d7ac-4d8f-9e6a-212e11524812 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:20.832912 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1727/3406] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:10:21.801897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4ede3-ec4d-4114-a018-a8f47440cebf None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:21.803718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4ede3-ec4d-4114-a018-a8f47440cebf None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:21.804182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4ede3-ec4d-4114-a018-a8f47440cebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:21.920982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-27d4ede3-ec4d-4114-a018-a8f47440cebf None None] MFA Rules not processed for user `419f3872408c4d8c9a2980d6397d0aea`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:21.923678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-27d4ede3-ec4d-4114-a018-a8f47440cebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:21.931412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:22.104311 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1680/3407] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:22.481750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74973b3-d7ac-4d8f-9e6a-212e11524812 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:22.483346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d74973b3-d7ac-4d8f-9e6a-212e11524812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:22.600676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74973b3-d7ac-4d8f-9e6a-212e11524812 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:22.609283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd0b25-e301-4834-a5f0-ccb4e38b1646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:22.610490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd0b25-e301-4834-a5f0-ccb4e38b1646 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:22.610977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd0b25-e301-4834-a5f0-ccb4e38b1646 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:22.611480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd0b25-e301-4834-a5f0-ccb4e38b1646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:22.641931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd0b25-e301-4834-a5f0-ccb4e38b1646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:22.645631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd0b25-e301-4834-a5f0-ccb4e38b1646 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:22.682098 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1728/3408] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:10:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:10:29.904760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cf30c-269d-4cac-a8cc-f6187085877a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:29.905617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cf30c-269d-4cac-a8cc-f6187085877a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:29.906138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cf30c-269d-4cac-a8cc-f6187085877a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:29.947355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e33cf30c-269d-4cac-a8cc-f6187085877a None None] MFA Rules not processed for user `419f3872408c4d8c9a2980d6397d0aea`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:29.948901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e33cf30c-269d-4cac-a8cc-f6187085877a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:29.975148 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1681/3409] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:32.064121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd0b25-e301-4834-a5f0-ccb4e38b1646 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:32.066297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c7fd0b25-e301-4834-a5f0-ccb4e38b1646 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:32.087934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd0b25-e301-4834-a5f0-ccb4e38b1646 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:32.094711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44efff-f37b-4bdd-a02e-608c823b53fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:32.095918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44efff-f37b-4bdd-a02e-608c823b53fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:32.096398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44efff-f37b-4bdd-a02e-608c823b53fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:32.097031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44efff-f37b-4bdd-a02e-608c823b53fd admin admin] PATH_INFO: `/v3/users/1e4df9d2e6b7481f839f36b0ec557949` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:32.098491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44efff-f37b-4bdd-a02e-608c823b53fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4df9d2e6b7481f839f36b0ec557949)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:32.104732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44efff-f37b-4bdd-a02e-608c823b53fd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:32.170596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9b44efff-f37b-4bdd-a02e-608c823b53fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4df9d2e6b7481f839f36b0ec557949'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:32.184168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9b44efff-f37b-4bdd-a02e-608c823b53fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4df9d2e6b7481f839f36b0ec557949'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:32.185028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9b44efff-f37b-4bdd-a02e-608c823b53fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4df9d2e6b7481f839f36b0ec557949'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:32.185773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9b44efff-f37b-4bdd-a02e-608c823b53fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4df9d2e6b7481f839f36b0ec557949'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:32.198091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9b44efff-f37b-4bdd-a02e-608c823b53fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4df9d2e6b7481f839f36b0ec557949'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:32.211707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:32.224398 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1729/3410] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:10:32 2022] DELETE /identity/v3/users/1e4df9d2e6b7481f839f36b0ec557949 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:33.304886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cf30c-269d-4cac-a8cc-f6187085877a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:33.326047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cf30c-269d-4cac-a8cc-f6187085877a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:33.510991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21513c62-429f-41b3-b1ed-0a86b24773ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:33.511898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21513c62-429f-41b3-b1ed-0a86b24773ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:33.513960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21513c62-429f-41b3-b1ed-0a86b24773ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:33.515294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21513c62-429f-41b3-b1ed-0a86b24773ad admin admin] PATH_INFO: `/v3/projects/d93a2b945dc646148653736a366e67e7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:33.521846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21513c62-429f-41b3-b1ed-0a86b24773ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d93a2b945dc646148653736a366e67e7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:33.531545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21513c62-429f-41b3-b1ed-0a86b24773ad admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:33.665640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21513c62-429f-41b3-b1ed-0a86b24773ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93a2b945dc646148653736a366e67e7', 'request_id': 'req-21513c62-429f-41b3-b1ed-0a86b24773ad'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:33.699591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21513c62-429f-41b3-b1ed-0a86b24773ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93a2b945dc646148653736a366e67e7', 'request_id': 'req-21513c62-429f-41b3-b1ed-0a86b24773ad'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:33.728859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21513c62-429f-41b3-b1ed-0a86b24773ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93a2b945dc646148653736a366e67e7', 'request_id': 'req-21513c62-429f-41b3-b1ed-0a86b24773ad'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:33.770546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21513c62-429f-41b3-b1ed-0a86b24773ad admin admin] The token cache is being invalidate because project d93a2b945dc646148653736a366e67e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:10:33.770930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21513c62-429f-41b3-b1ed-0a86b24773ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:33.771537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21513c62-429f-41b3-b1ed-0a86b24773ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:33.773242 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1682/3411] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:33 2022] DELETE /identity/v3/projects/d93a2b945dc646148653736a366e67e7 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:33.780701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c70f2-34ae-45dd-8e84-486421b94311 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:33.781250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c70f2-34ae-45dd-8e84-486421b94311 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:33.781250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c70f2-34ae-45dd-8e84-486421b94311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:33.824232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-983c70f2-34ae-45dd-8e84-486421b94311 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:33.825976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-983c70f2-34ae-45dd-8e84-486421b94311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:33.956858 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1730/3412] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:33.965719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e290e-bb79-457f-b2d1-69e95e1e6821 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:33.966060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e290e-bb79-457f-b2d1-69e95e1e6821 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:33.966413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e290e-bb79-457f-b2d1-69e95e1e6821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:34.006429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-483e290e-bb79-457f-b2d1-69e95e1e6821 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:34.008382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-483e290e-bb79-457f-b2d1-69e95e1e6821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:34.026536 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1683/3413] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:34.030236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c70f2-34ae-45dd-8e84-486421b94311 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:34.042191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c70f2-34ae-45dd-8e84-486421b94311 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:34.049459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650708d-30de-4901-b182-5cd8a856813b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:34.050491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650708d-30de-4901-b182-5cd8a856813b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:34.050913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650708d-30de-4901-b182-5cd8a856813b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:34.051307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650708d-30de-4901-b182-5cd8a856813b admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:34.052769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650708d-30de-4901-b182-5cd8a856813b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:10:34.053219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650708d-30de-4901-b182-5cd8a856813b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:34.055456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650708d-30de-4901-b182-5cd8a856813b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:34.075699 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1731/3414] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:10:34.080006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e290e-bb79-457f-b2d1-69e95e1e6821 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:34.102274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e290e-bb79-457f-b2d1-69e95e1e6821 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:34.109888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c154e1-fbc2-4248-9f16-c41e0833c341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:34.111201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c154e1-fbc2-4248-9f16-c41e0833c341 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:34.112545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c154e1-fbc2-4248-9f16-c41e0833c341 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:34.112889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c154e1-fbc2-4248-9f16-c41e0833c341 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:34.115289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c154e1-fbc2-4248-9f16-c41e0833c341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:34.121712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c154e1-fbc2-4248-9f16-c41e0833c341 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:34.170524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:34.189003 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1684/3415] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:10:34 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:10:34.193331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650708d-30de-4901-b182-5cd8a856813b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:34.221335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650708d-30de-4901-b182-5cd8a856813b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:34.346345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dbee3-fc3c-4acf-b726-d318df9d051e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:34.347226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dbee3-fc3c-4acf-b726-d318df9d051e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:34.347548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dbee3-fc3c-4acf-b726-d318df9d051e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:34.347882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dbee3-fc3c-4acf-b726-d318df9d051e admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:34.349347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638dbee3-fc3c-4acf-b726-d318df9d051e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:34.351720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638dbee3-fc3c-4acf-b726-d318df9d051e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:34.384523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c154e1-fbc2-4248-9f16-c41e0833c341 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:34.385028 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1732/3416] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:10:34 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:10:34.415593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c154e1-fbc2-4248-9f16-c41e0833c341 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:34.421925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b0c08-8047-402e-b867-31dffc95913c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:34.426297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b0c08-8047-402e-b867-31dffc95913c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:34.427172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b0c08-8047-402e-b867-31dffc95913c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:34.428082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b0c08-8047-402e-b867-31dffc95913c admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:34.429255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b0c08-8047-402e-b867-31dffc95913c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:34.431162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b0c08-8047-402e-b867-31dffc95913c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:34.464691 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1685/3417] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:10:34.467320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dbee3-fc3c-4acf-b726-d318df9d051e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:34.491083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dbee3-fc3c-4acf-b726-d318df9d051e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:34.499475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821544b-7a87-4eff-bb32-6a37c97b1d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:34.501209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821544b-7a87-4eff-bb32-6a37c97b1d16 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:34.501738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821544b-7a87-4eff-bb32-6a37c97b1d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:34.502987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821544b-7a87-4eff-bb32-6a37c97b1d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:34.504018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821544b-7a87-4eff-bb32-6a37c97b1d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:34.506095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821544b-7a87-4eff-bb32-6a37c97b1d16 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:34.524463 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1733/3418] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:10:34.525271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b0c08-8047-402e-b867-31dffc95913c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:34.555235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b0c08-8047-402e-b867-31dffc95913c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:34.570386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea17e22-3bd5-42e8-8774-8fcdb16e6c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:34.573850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea17e22-3bd5-42e8-8774-8fcdb16e6c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:34.574139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea17e22-3bd5-42e8-8774-8fcdb16e6c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:34.574419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea17e22-3bd5-42e8-8774-8fcdb16e6c93 admin admin] PATH_INFO: `/v3/projects/116d106003e54750a7e57d37e6a8798a/users/1412af7535c24b5fa139fd87431375ca/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:34.593276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea17e22-3bd5-42e8-8774-8fcdb16e6c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=116d106003e54750a7e57d37e6a8798a, user_id=1412af7535c24b5fa139fd87431375ca, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:34.596595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea17e22-3bd5-42e8-8774-8fcdb16e6c93 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:34.614643 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1686/3419] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:10:34 2022] PUT /identity/v3/projects/116d106003e54750a7e57d37e6a8798a/users/1412af7535c24b5fa139fd87431375ca/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:10:34.620839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d3046-9ca5-4af0-8972-70c6b09f2a1c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:34.621563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d3046-9ca5-4af0-8972-70c6b09f2a1c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:34.622540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d3046-9ca5-4af0-8972-70c6b09f2a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:34.689519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9b6d3046-9ca5-4af0-8972-70c6b09f2a1c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:34.691245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9b6d3046-9ca5-4af0-8972-70c6b09f2a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:34.850168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:34.882073 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1734/3420] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:34.911393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea17e22-3bd5-42e8-8774-8fcdb16e6c93 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:34.917699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dea17e22-3bd5-42e8-8774-8fcdb16e6c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:35.115802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea17e22-3bd5-42e8-8774-8fcdb16e6c93 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:35.128266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bd0d4-ee6a-4400-9703-9b7a9c623681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:35.128949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bd0d4-ee6a-4400-9703-9b7a9c623681 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:35.129220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bd0d4-ee6a-4400-9703-9b7a9c623681 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:35.129491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bd0d4-ee6a-4400-9703-9b7a9c623681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:35.151522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bd0d4-ee6a-4400-9703-9b7a9c623681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:35.153044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bd0d4-ee6a-4400-9703-9b7a9c623681 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:35.166097 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1687/3421] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:10:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:10:37.733221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3af78-5874-4058-bc25-403d4f3d7beb None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:37.733736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3af78-5874-4058-bc25-403d4f3d7beb None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:37.733736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3af78-5874-4058-bc25-403d4f3d7beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:37.795861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-88d3af78-5874-4058-bc25-403d4f3d7beb None None] MFA Rules not processed for user `1e96036ac8194c49b2cdb98529f22f70`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:37.797521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-88d3af78-5874-4058-bc25-403d4f3d7beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:38.007778 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1735/3422] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:45.159265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:45.673892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bd0d4-ee6a-4400-9703-9b7a9c623681 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:45.675551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-321bd0d4-ee6a-4400-9703-9b7a9c623681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:45.865458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bd0d4-ee6a-4400-9703-9b7a9c623681 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:45.871881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88748214-d8f3-4c4e-abcb-99e13d0fa5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:45.873019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88748214-d8f3-4c4e-abcb-99e13d0fa5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:45.873950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88748214-d8f3-4c4e-abcb-99e13d0fa5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:45.874486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88748214-d8f3-4c4e-abcb-99e13d0fa5a4 admin admin] PATH_INFO: `/v3/users/7cac5256d6b6458899f85d8762a03d90` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:45.875901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88748214-d8f3-4c4e-abcb-99e13d0fa5a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cac5256d6b6458899f85d8762a03d90)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:45.878415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88748214-d8f3-4c4e-abcb-99e13d0fa5a4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:45.994044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-88748214-d8f3-4c4e-abcb-99e13d0fa5a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cac5256d6b6458899f85d8762a03d90'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:46.010017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-88748214-d8f3-4c4e-abcb-99e13d0fa5a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cac5256d6b6458899f85d8762a03d90'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:46.027497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-88748214-d8f3-4c4e-abcb-99e13d0fa5a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cac5256d6b6458899f85d8762a03d90'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:46.028323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-88748214-d8f3-4c4e-abcb-99e13d0fa5a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cac5256d6b6458899f85d8762a03d90'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:46.029441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-88748214-d8f3-4c4e-abcb-99e13d0fa5a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cac5256d6b6458899f85d8762a03d90'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:46.105227 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1688/3423] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:10:45 2022] DELETE /identity/v3/users/7cac5256d6b6458899f85d8762a03d90 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:46.198404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90053df2-2d90-4d4c-bf19-4c9ce0e5ef5b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:46.199296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90053df2-2d90-4d4c-bf19-4c9ce0e5ef5b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:46.199736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90053df2-2d90-4d4c-bf19-4c9ce0e5ef5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:46.234743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-90053df2-2d90-4d4c-bf19-4c9ce0e5ef5b None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:46.235891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-90053df2-2d90-4d4c-bf19-4c9ce0e5ef5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:46.316066 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1736/3424] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:10:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:46.331624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88748214-d8f3-4c4e-abcb-99e13d0fa5a4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:46.333593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-88748214-d8f3-4c4e-abcb-99e13d0fa5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:46.521464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88748214-d8f3-4c4e-abcb-99e13d0fa5a4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:46.527026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f24c5-b5b3-4792-8211-eb2130066022 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:46.527694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f24c5-b5b3-4792-8211-eb2130066022 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:46.527975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f24c5-b5b3-4792-8211-eb2130066022 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:46.528280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f24c5-b5b3-4792-8211-eb2130066022 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:46.547639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f24c5-b5b3-4792-8211-eb2130066022 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:46.552514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f24c5-b5b3-4792-8211-eb2130066022 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:46.564567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:46.582931 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1689/3425] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:10:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:10:47.079064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90053df2-2d90-4d4c-bf19-4c9ce0e5ef5b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:47.080845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-90053df2-2d90-4d4c-bf19-4c9ce0e5ef5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:47.381443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90053df2-2d90-4d4c-bf19-4c9ce0e5ef5b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:47.388632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc56018-55b3-4632-881d-381b95fb6b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:47.389630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc56018-55b3-4632-881d-381b95fb6b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:47.390135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc56018-55b3-4632-881d-381b95fb6b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:47.390582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc56018-55b3-4632-881d-381b95fb6b5a admin admin] PATH_INFO: `/v3/projects/e463fddac31c452296829260cfacc694` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:47.395922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc56018-55b3-4632-881d-381b95fb6b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e463fddac31c452296829260cfacc694)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:47.398686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc56018-55b3-4632-881d-381b95fb6b5a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:47.493033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:47.497831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e608c-a47f-4ce7-831e-bfcc625115e7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:47.498372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e608c-a47f-4ce7-831e-bfcc625115e7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:47.498372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e608c-a47f-4ce7-831e-bfcc625115e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:47.511419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-acc56018-55b3-4632-881d-381b95fb6b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e463fddac31c452296829260cfacc694', 'request_id': 'req-acc56018-55b3-4632-881d-381b95fb6b5a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:47.536223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-acc56018-55b3-4632-881d-381b95fb6b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e463fddac31c452296829260cfacc694', 'request_id': 'req-acc56018-55b3-4632-881d-381b95fb6b5a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:47.553085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-acc56018-55b3-4632-881d-381b95fb6b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e463fddac31c452296829260cfacc694', 'request_id': 'req-acc56018-55b3-4632-881d-381b95fb6b5a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:47.553826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a11e608c-a47f-4ce7-831e-bfcc625115e7 None None] MFA Rules not processed for user `b3b24a3216aa4eba8a9a90c109c3b491`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:47.559828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a11e608c-a47f-4ce7-831e-bfcc625115e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:47.581144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-acc56018-55b3-4632-881d-381b95fb6b5a admin admin] The token cache is being invalidate because project e463fddac31c452296829260cfacc694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:10:47.581523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-acc56018-55b3-4632-881d-381b95fb6b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:47.582125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-acc56018-55b3-4632-881d-381b95fb6b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:47.584062 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1737/3426] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:47 2022] DELETE /identity/v3/projects/e463fddac31c452296829260cfacc694 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:47.587863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc56018-55b3-4632-881d-381b95fb6b5a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:47.589325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-acc56018-55b3-4632-881d-381b95fb6b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:47.715830 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1690/3427] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:10:47.737275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc56018-55b3-4632-881d-381b95fb6b5a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:47.746706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77e380-7299-4c95-b268-7c4ea681c5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:47.747714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77e380-7299-4c95-b268-7c4ea681c5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:47.747977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77e380-7299-4c95-b268-7c4ea681c5db admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:47.748328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77e380-7299-4c95-b268-7c4ea681c5db admin admin] PATH_INFO: `/v3/users/2b47897146d948138d6a22dfffd7b8a1` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:47.750160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77e380-7299-4c95-b268-7c4ea681c5db admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b47897146d948138d6a22dfffd7b8a1)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:47.753363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77e380-7299-4c95-b268-7c4ea681c5db admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:47.868204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0d77e380-7299-4c95-b268-7c4ea681c5db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b47897146d948138d6a22dfffd7b8a1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:47.890627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0d77e380-7299-4c95-b268-7c4ea681c5db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b47897146d948138d6a22dfffd7b8a1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:47.891379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0d77e380-7299-4c95-b268-7c4ea681c5db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b47897146d948138d6a22dfffd7b8a1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:47.892182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0d77e380-7299-4c95-b268-7c4ea681c5db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b47897146d948138d6a22dfffd7b8a1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:47.910882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0d77e380-7299-4c95-b268-7c4ea681c5db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b47897146d948138d6a22dfffd7b8a1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:47.952098 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1738/3428] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:10:47 2022] DELETE /identity/v3/users/2b47897146d948138d6a22dfffd7b8a1 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:50.635101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e608c-a47f-4ce7-831e-bfcc625115e7 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:50.637886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a11e608c-a47f-4ce7-831e-bfcc625115e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:50.695991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e608c-a47f-4ce7-831e-bfcc625115e7 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:50.876535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e419b15-347b-4343-804d-306d48223182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:50.877870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e419b15-347b-4343-804d-306d48223182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:50.879496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e419b15-347b-4343-804d-306d48223182 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:50.881216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e419b15-347b-4343-804d-306d48223182 admin admin] PATH_INFO: `/v3/users/1e96036ac8194c49b2cdb98529f22f70` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:50.885709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e419b15-347b-4343-804d-306d48223182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e96036ac8194c49b2cdb98529f22f70)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:50.888993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e419b15-347b-4343-804d-306d48223182 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:51.012177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2e419b15-347b-4343-804d-306d48223182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e96036ac8194c49b2cdb98529f22f70'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:51.046159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2e419b15-347b-4343-804d-306d48223182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e96036ac8194c49b2cdb98529f22f70'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:51.061109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2e419b15-347b-4343-804d-306d48223182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e96036ac8194c49b2cdb98529f22f70'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:51.061109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2e419b15-347b-4343-804d-306d48223182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e96036ac8194c49b2cdb98529f22f70'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:51.062252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2e419b15-347b-4343-804d-306d48223182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e96036ac8194c49b2cdb98529f22f70'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:51.095246 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1691/3429] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:10:50 2022] DELETE /identity/v3/users/1e96036ac8194c49b2cdb98529f22f70 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:51.392221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77e380-7299-4c95-b268-7c4ea681c5db admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:51.393768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0d77e380-7299-4c95-b268-7c4ea681c5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:51.421472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77e380-7299-4c95-b268-7c4ea681c5db admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:51.522059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:51.554590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4a70e-7811-40e7-b13b-81c9db00f9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:51.555501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4a70e-7811-40e7-b13b-81c9db00f9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:51.555783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4a70e-7811-40e7-b13b-81c9db00f9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:51.556177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4a70e-7811-40e7-b13b-81c9db00f9d7 admin admin] PATH_INFO: `/v3/projects/a5e078c0b16e4a169f7a5ef294ab52e9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:51.557581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4a70e-7811-40e7-b13b-81c9db00f9d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e078c0b16e4a169f7a5ef294ab52e9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:51.560111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4a70e-7811-40e7-b13b-81c9db00f9d7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:51.765963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dad4a70e-7811-40e7-b13b-81c9db00f9d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e078c0b16e4a169f7a5ef294ab52e9', 'request_id': 'req-dad4a70e-7811-40e7-b13b-81c9db00f9d7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:51.776363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dad4a70e-7811-40e7-b13b-81c9db00f9d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e078c0b16e4a169f7a5ef294ab52e9', 'request_id': 'req-dad4a70e-7811-40e7-b13b-81c9db00f9d7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:51.791440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dad4a70e-7811-40e7-b13b-81c9db00f9d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e078c0b16e4a169f7a5ef294ab52e9', 'request_id': 'req-dad4a70e-7811-40e7-b13b-81c9db00f9d7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:51.810093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dad4a70e-7811-40e7-b13b-81c9db00f9d7 admin admin] The token cache is being invalidate because project a5e078c0b16e4a169f7a5ef294ab52e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:10:51.810908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dad4a70e-7811-40e7-b13b-81c9db00f9d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:51.812905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dad4a70e-7811-40e7-b13b-81c9db00f9d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:51.823932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70234ab4-4aa3-4690-8f7f-1fa4093f12ff None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:51.825575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70234ab4-4aa3-4690-8f7f-1fa4093f12ff None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:51.826187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70234ab4-4aa3-4690-8f7f-1fa4093f12ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:51.839604 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1739/3430] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:51 2022] DELETE /identity/v3/projects/a5e078c0b16e4a169f7a5ef294ab52e9 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:51.882118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:51.933444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-70234ab4-4aa3-4690-8f7f-1fa4093f12ff None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:51.935242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-70234ab4-4aa3-4690-8f7f-1fa4093f12ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:51.940554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4a70e-7811-40e7-b13b-81c9db00f9d7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:51.942028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dad4a70e-7811-40e7-b13b-81c9db00f9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:52.149663 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1692/3431] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:52.159499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb181ce-1074-4433-a0f8-9879dbc31132 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:52.159782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb181ce-1074-4433-a0f8-9879dbc31132 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:52.160108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb181ce-1074-4433-a0f8-9879dbc31132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:52.190360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4a70e-7811-40e7-b13b-81c9db00f9d7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:52.193871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fbb181ce-1074-4433-a0f8-9879dbc31132 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:52.195305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fbb181ce-1074-4433-a0f8-9879dbc31132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:52.214232 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1693/3432] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:10:52.219371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb181ce-1074-4433-a0f8-9879dbc31132 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:52.227474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a53fe-4492-4b96-be08-ebcbc07451e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:52.229120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a53fe-4492-4b96-be08-ebcbc07451e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:52.229409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a53fe-4492-4b96-be08-ebcbc07451e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:52.229700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a53fe-4492-4b96-be08-ebcbc07451e0 admin admin] PATH_INFO: `/v3/projects/078e36fe8f6a4a979b730924cf4c5650` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:52.232219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a53fe-4492-4b96-be08-ebcbc07451e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=078e36fe8f6a4a979b730924cf4c5650)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:52.234389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a53fe-4492-4b96-be08-ebcbc07451e0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:52.236224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb181ce-1074-4433-a0f8-9879dbc31132 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:52.251050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c260a-77b2-4d27-9eaa-77c06694a28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:52.251856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c260a-77b2-4d27-9eaa-77c06694a28e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:52.252170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c260a-77b2-4d27-9eaa-77c06694a28e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:52.252452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c260a-77b2-4d27-9eaa-77c06694a28e admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:52.253188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c260a-77b2-4d27-9eaa-77c06694a28e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:10:52.253675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c260a-77b2-4d27-9eaa-77c06694a28e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:52.258569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c260a-77b2-4d27-9eaa-77c06694a28e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:52.290811 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1694/3433] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:10:52.291865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c260a-77b2-4d27-9eaa-77c06694a28e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:52.308640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c260a-77b2-4d27-9eaa-77c06694a28e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:52.315495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5f2a53fe-4492-4b96-be08-ebcbc07451e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078e36fe8f6a4a979b730924cf4c5650', 'request_id': 'req-5f2a53fe-4492-4b96-be08-ebcbc07451e0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:52.337872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5f2a53fe-4492-4b96-be08-ebcbc07451e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078e36fe8f6a4a979b730924cf4c5650', 'request_id': 'req-5f2a53fe-4492-4b96-be08-ebcbc07451e0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:52.348834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5f2a53fe-4492-4b96-be08-ebcbc07451e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078e36fe8f6a4a979b730924cf4c5650', 'request_id': 'req-5f2a53fe-4492-4b96-be08-ebcbc07451e0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:52.370702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5f2a53fe-4492-4b96-be08-ebcbc07451e0 admin admin] The token cache is being invalidate because project 078e36fe8f6a4a979b730924cf4c5650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:10:52.370702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5f2a53fe-4492-4b96-be08-ebcbc07451e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:52.372096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5f2a53fe-4492-4b96-be08-ebcbc07451e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:52.373771 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1740/3434] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:51 2022] DELETE /identity/v3/projects/078e36fe8f6a4a979b730924cf4c5650 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:52.379512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfada2-703b-4c49-847d-861a7abad0a0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:52.379985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfada2-703b-4c49-847d-861a7abad0a0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:52.380466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfada2-703b-4c49-847d-861a7abad0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:52.388473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:52.408794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bdbfada2-703b-4c49-847d-861a7abad0a0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:52.411321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bdbfada2-703b-4c49-847d-861a7abad0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:52.438534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd157b-7d74-4844-ab01-4dfc34b1af7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:52.439232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd157b-7d74-4844-ab01-4dfc34b1af7f admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:52.439520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd157b-7d74-4844-ab01-4dfc34b1af7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:52.439800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd157b-7d74-4844-ab01-4dfc34b1af7f admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:52.440557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd157b-7d74-4844-ab01-4dfc34b1af7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:52.442499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd157b-7d74-4844-ab01-4dfc34b1af7f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:52.495723 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1695/3435] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:10:52 2022] POST /identity/v3/projects => generated 389 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:10:52.497056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd157b-7d74-4844-ab01-4dfc34b1af7f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:52.502085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cebd157b-7d74-4844-ab01-4dfc34b1af7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:52.507618 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1741/3436] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:52.511240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfada2-703b-4c49-847d-861a7abad0a0 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:52.516934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bdbfada2-703b-4c49-847d-861a7abad0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:52.556815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfada2-703b-4c49-847d-861a7abad0a0 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:52.664989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd157b-7d74-4844-ab01-4dfc34b1af7f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:52.687256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c86f1f-cb14-48fb-8fb2-992869746b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:52.688324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c86f1f-cb14-48fb-8fb2-992869746b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:52.688669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c86f1f-cb14-48fb-8fb2-992869746b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:52.689011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c86f1f-cb14-48fb-8fb2-992869746b34 admin admin] PATH_INFO: `/v3/users/45991293f65c4c22a91afa74cf8179ce` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:52.692662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c86f1f-cb14-48fb-8fb2-992869746b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45991293f65c4c22a91afa74cf8179ce)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:52.697865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c86f1f-cb14-48fb-8fb2-992869746b34 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:52.700406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:52.756079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e32c23-59bf-4508-a16c-23d037c82a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:52.756079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e32c23-59bf-4508-a16c-23d037c82a53 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:52.756079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e32c23-59bf-4508-a16c-23d037c82a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:52.756079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e32c23-59bf-4508-a16c-23d037c82a53 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:52.756717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e32c23-59bf-4508-a16c-23d037c82a53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:52.766763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e32c23-59bf-4508-a16c-23d037c82a53 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:52.822194 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1742/3437] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:10:52 2022] POST /identity/v3/users => generated 295 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:10:52.823828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea6516-8c69-4f4b-9fdd-e7cc1f47a043 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:52.826369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea6516-8c69-4f4b-9fdd-e7cc1f47a043 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:52.826654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea6516-8c69-4f4b-9fdd-e7cc1f47a043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:52.851419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c9c86f1f-cb14-48fb-8fb2-992869746b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45991293f65c4c22a91afa74cf8179ce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:52.876895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4aea6516-8c69-4f4b-9fdd-e7cc1f47a043 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:52.878617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4aea6516-8c69-4f4b-9fdd-e7cc1f47a043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:52.907887 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1743/3438] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:52.907887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea6516-8c69-4f4b-9fdd-e7cc1f47a043 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:52.909438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c9c86f1f-cb14-48fb-8fb2-992869746b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45991293f65c4c22a91afa74cf8179ce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:52.924648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c9c86f1f-cb14-48fb-8fb2-992869746b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45991293f65c4c22a91afa74cf8179ce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:52.926639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c9c86f1f-cb14-48fb-8fb2-992869746b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45991293f65c4c22a91afa74cf8179ce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:52.928462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c9c86f1f-cb14-48fb-8fb2-992869746b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45991293f65c4c22a91afa74cf8179ce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:52.936245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea6516-8c69-4f4b-9fdd-e7cc1f47a043 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:52.954295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2b31e-a6f8-482f-b55f-5d540c20f138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:52.958058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2b31e-a6f8-482f-b55f-5d540c20f138 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:52.958165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2b31e-a6f8-482f-b55f-5d540c20f138 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:52.958487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2b31e-a6f8-482f-b55f-5d540c20f138 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:52.994725 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1696/3439] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:10:52 2022] DELETE /identity/v3/users/45991293f65c4c22a91afa74cf8179ce => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:52.994725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c86f1f-cb14-48fb-8fb2-992869746b34 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:52.996808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2b31e-a6f8-482f-b55f-5d540c20f138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:52.998009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c9c86f1f-cb14-48fb-8fb2-992869746b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:53.007521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2b31e-a6f8-482f-b55f-5d540c20f138 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:53.050769 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1744/3440] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:10:53.051903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2b31e-a6f8-482f-b55f-5d540c20f138 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:53.062026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f1e2b31e-a6f8-482f-b55f-5d540c20f138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:53.130588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2b31e-a6f8-482f-b55f-5d540c20f138 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:53.174496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c86f1f-cb14-48fb-8fb2-992869746b34 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:53.187306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1758cd2-3278-4f55-a2dc-8dbff269c844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:53.188223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1758cd2-3278-4f55-a2dc-8dbff269c844 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:53.188505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1758cd2-3278-4f55-a2dc-8dbff269c844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:53.188776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1758cd2-3278-4f55-a2dc-8dbff269c844 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:53.189683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1758cd2-3278-4f55-a2dc-8dbff269c844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:10:53.189991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1758cd2-3278-4f55-a2dc-8dbff269c844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:53.196166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1758cd2-3278-4f55-a2dc-8dbff269c844 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:53.225423 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1697/3441] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:10:53.232398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1758cd2-3278-4f55-a2dc-8dbff269c844 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:53.247668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1758cd2-3278-4f55-a2dc-8dbff269c844 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:53.254432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf8593-aee3-4fdf-ba7a-0c26ee24c633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:53.255323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf8593-aee3-4fdf-ba7a-0c26ee24c633 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:53.255603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf8593-aee3-4fdf-ba7a-0c26ee24c633 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:53.255884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf8593-aee3-4fdf-ba7a-0c26ee24c633 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:53.256619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf8593-aee3-4fdf-ba7a-0c26ee24c633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:53.259176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf8593-aee3-4fdf-ba7a-0c26ee24c633 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:53.309774 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1698/3442] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:10:53 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:10:53.311469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf8593-aee3-4fdf-ba7a-0c26ee24c633 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:53.364517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974939c-34da-4292-bca3-5976a5fdecd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:53.365582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974939c-34da-4292-bca3-5976a5fdecd5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:53.366133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974939c-34da-4292-bca3-5976a5fdecd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:53.367414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974939c-34da-4292-bca3-5976a5fdecd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:53.380667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974939c-34da-4292-bca3-5976a5fdecd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:53.386159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974939c-34da-4292-bca3-5976a5fdecd5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:53.413744 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1745/3443] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:10:53.413744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974939c-34da-4292-bca3-5976a5fdecd5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:53.416924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e974939c-34da-4292-bca3-5976a5fdecd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:53.434488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974939c-34da-4292-bca3-5976a5fdecd5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:53.441579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:53.445861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:53.458555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf8593-aee3-4fdf-ba7a-0c26ee24c633 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:53.467610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d63f4-32bd-4857-8c86-2c981bcac2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:53.469853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d63f4-32bd-4857-8c86-2c981bcac2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:53.471304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d63f4-32bd-4857-8c86-2c981bcac2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:53.472015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d63f4-32bd-4857-8c86-2c981bcac2e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:53.473410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d63f4-32bd-4857-8c86-2c981bcac2e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:53.479877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d63f4-32bd-4857-8c86-2c981bcac2e2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:53.512405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9ca03-343a-45af-9e7b-ea974e1a0fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:53.514232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9ca03-343a-45af-9e7b-ea974e1a0fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:53.514823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9ca03-343a-45af-9e7b-ea974e1a0fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:53.515229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9ca03-343a-45af-9e7b-ea974e1a0fb3 admin admin] PATH_INFO: `/v3/projects/63b8773841e44baab20aa0677e027de7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:53.518226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9ca03-343a-45af-9e7b-ea974e1a0fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63b8773841e44baab20aa0677e027de7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:53.521061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9ca03-343a-45af-9e7b-ea974e1a0fb3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:53.560004 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1699/3444] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:10:53 2022] POST /identity/v3/users => generated 283 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:10:53.572276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d63f4-32bd-4857-8c86-2c981bcac2e2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:53.601947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d63f4-32bd-4857-8c86-2c981bcac2e2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:53.652315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c1f9ca03-343a-45af-9e7b-ea974e1a0fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63b8773841e44baab20aa0677e027de7', 'request_id': 'req-c1f9ca03-343a-45af-9e7b-ea974e1a0fb3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:53.686314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c1f9ca03-343a-45af-9e7b-ea974e1a0fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63b8773841e44baab20aa0677e027de7', 'request_id': 'req-c1f9ca03-343a-45af-9e7b-ea974e1a0fb3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:53.697934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c1f9ca03-343a-45af-9e7b-ea974e1a0fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63b8773841e44baab20aa0677e027de7', 'request_id': 'req-c1f9ca03-343a-45af-9e7b-ea974e1a0fb3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:53.726551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c1f9ca03-343a-45af-9e7b-ea974e1a0fb3 admin admin] The token cache is being invalidate because project 63b8773841e44baab20aa0677e027de7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:10:53.727032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c1f9ca03-343a-45af-9e7b-ea974e1a0fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:53.729953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c1f9ca03-343a-45af-9e7b-ea974e1a0fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:53.732485 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1746/3445] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:53 2022] DELETE /identity/v3/projects/63b8773841e44baab20aa0677e027de7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:53.735541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9ca03-343a-45af-9e7b-ea974e1a0fb3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:53.738990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c1f9ca03-343a-45af-9e7b-ea974e1a0fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:53.806778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f6f04-0235-42da-bc84-3289456180fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:53.808279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f6f04-0235-42da-bc84-3289456180fd admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:53.808492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f6f04-0235-42da-bc84-3289456180fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:53.808774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f6f04-0235-42da-bc84-3289456180fd admin admin] PATH_INFO: `/v3/projects/f644f2d1c56c43cf851deb020af7161e/users/984631f5a77a48c5a9619e33e608dd59/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:53.854551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f6f04-0235-42da-bc84-3289456180fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f644f2d1c56c43cf851deb020af7161e, user_id=984631f5a77a48c5a9619e33e608dd59, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:53.861822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f6f04-0235-42da-bc84-3289456180fd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:53.901710 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1700/3446] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:10:53 2022] PUT /identity/v3/projects/f644f2d1c56c43cf851deb020af7161e/users/984631f5a77a48c5a9619e33e608dd59/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:53.906610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f6f04-0235-42da-bc84-3289456180fd admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:53.908523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4e6f6f04-0235-42da-bc84-3289456180fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:53.933294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9ca03-343a-45af-9e7b-ea974e1a0fb3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:54.004190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:54.030042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c4e5c-2fb9-419f-8e6d-a348960d9180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:54.032195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c4e5c-2fb9-419f-8e6d-a348960d9180 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:54.033954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c4e5c-2fb9-419f-8e6d-a348960d9180 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:54.034613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c4e5c-2fb9-419f-8e6d-a348960d9180 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:54.036333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c4e5c-2fb9-419f-8e6d-a348960d9180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:54.041552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c4e5c-2fb9-419f-8e6d-a348960d9180 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:54.044742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f6f04-0235-42da-bc84-3289456180fd admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:54.063157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fad654-95d3-4a66-997f-c5ae8b1df33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:54.064074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fad654-95d3-4a66-997f-c5ae8b1df33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:54.064361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fad654-95d3-4a66-997f-c5ae8b1df33f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:54.064757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fad654-95d3-4a66-997f-c5ae8b1df33f admin admin] PATH_INFO: `/v3/users/bd452195a8d8423a9957773af081b75f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:54.067129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fad654-95d3-4a66-997f-c5ae8b1df33f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd452195a8d8423a9957773af081b75f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:54.069573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fad654-95d3-4a66-997f-c5ae8b1df33f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:54.073634 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1747/3447] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:10:54.076102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d5667-9199-4a4b-af08-0341e2094a1f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:54.076608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d5667-9199-4a4b-af08-0341e2094a1f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:54.079243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d5667-9199-4a4b-af08-0341e2094a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:54.119400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3a5d5667-9199-4a4b-af08-0341e2094a1f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:54.121443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3a5d5667-9199-4a4b-af08-0341e2094a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:54.134784 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1748/3448] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:54.136603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d5667-9199-4a4b-af08-0341e2094a1f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:54.159609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d5667-9199-4a4b-af08-0341e2094a1f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:54.167244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ac059-9923-4b62-bfad-22608daa5c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:54.168297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ac059-9923-4b62-bfad-22608daa5c12 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:54.168848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ac059-9923-4b62-bfad-22608daa5c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:54.169433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ac059-9923-4b62-bfad-22608daa5c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:54.170568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ac059-9923-4b62-bfad-22608daa5c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:54.172830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ac059-9923-4b62-bfad-22608daa5c12 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:54.186685 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1749/3449] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:10:54.188418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ac059-9923-4b62-bfad-22608daa5c12 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:54.193480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d41ac059-9923-4b62-bfad-22608daa5c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:54.236203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-60fad654-95d3-4a66-997f-c5ae8b1df33f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd452195a8d8423a9957773af081b75f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:54.262466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-60fad654-95d3-4a66-997f-c5ae8b1df33f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd452195a8d8423a9957773af081b75f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:54.276097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-60fad654-95d3-4a66-997f-c5ae8b1df33f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd452195a8d8423a9957773af081b75f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:54.278747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-60fad654-95d3-4a66-997f-c5ae8b1df33f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd452195a8d8423a9957773af081b75f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:54.279747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-60fad654-95d3-4a66-997f-c5ae8b1df33f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd452195a8d8423a9957773af081b75f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:54.285255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:54.328756 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1701/3450] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:10:53 2022] DELETE /identity/v3/users/bd452195a8d8423a9957773af081b75f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:54.337145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fad654-95d3-4a66-997f-c5ae8b1df33f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:54.342073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-60fad654-95d3-4a66-997f-c5ae8b1df33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:54.455766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ac059-9923-4b62-bfad-22608daa5c12 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:54.504907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fad654-95d3-4a66-997f-c5ae8b1df33f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:54.520006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee11a7d-0ccb-4fab-a027-cbe941228515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:54.525678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee11a7d-0ccb-4fab-a027-cbe941228515 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:54.525963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee11a7d-0ccb-4fab-a027-cbe941228515 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:54.526281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee11a7d-0ccb-4fab-a027-cbe941228515 admin admin] PATH_INFO: `/v3/projects/3f17bacb94754dc58235cc9c7e6e9ffa/users/43088fda1a024ace873c4a7db0bb5e39/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:54.577973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee11a7d-0ccb-4fab-a027-cbe941228515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f17bacb94754dc58235cc9c7e6e9ffa, user_id=43088fda1a024ace873c4a7db0bb5e39, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:54.585811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee11a7d-0ccb-4fab-a027-cbe941228515 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:54.615464 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1702/3451] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:10:54 2022] PUT /identity/v3/projects/3f17bacb94754dc58235cc9c7e6e9ffa/users/43088fda1a024ace873c4a7db0bb5e39/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:54.630279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9448777-cb51-46ce-aa3a-1176b1ba95dc None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:54.630638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9448777-cb51-46ce-aa3a-1176b1ba95dc None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:54.630934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9448777-cb51-46ce-aa3a-1176b1ba95dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:54.633056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932640a7-2848-4d36-b532-6ab3a8ad5e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:54.633837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932640a7-2848-4d36-b532-6ab3a8ad5e51 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:54.634048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932640a7-2848-4d36-b532-6ab3a8ad5e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:54.634310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932640a7-2848-4d36-b532-6ab3a8ad5e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:54.641085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-932640a7-2848-4d36-b532-6ab3a8ad5e51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:54.685851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932640a7-2848-4d36-b532-6ab3a8ad5e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:54.687367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932640a7-2848-4d36-b532-6ab3a8ad5e51 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:54.709070 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1750/3452] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:10:54.720569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b9448777-cb51-46ce-aa3a-1176b1ba95dc None None] MFA Rules not processed for user `43088fda1a024ace873c4a7db0bb5e39`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:54.721759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b9448777-cb51-46ce-aa3a-1176b1ba95dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:54.787102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c684d-2011-413c-80b5-cc7ec75f186b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:54.787438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c684d-2011-413c-80b5-cc7ec75f186b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:54.787721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c684d-2011-413c-80b5-cc7ec75f186b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:54.851528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-cb5c684d-2011-413c-80b5-cc7ec75f186b None None] MFA Rules not processed for user `1412af7535c24b5fa139fd87431375ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:54.851940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cb5c684d-2011-413c-80b5-cc7ec75f186b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:54.989614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:55.080751 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1703/3453] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:55.082009 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1751/3454] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:10:55.082982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c684d-2011-413c-80b5-cc7ec75f186b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:55.098018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cb5c684d-2011-413c-80b5-cc7ec75f186b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:55.109939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9448777-cb51-46ce-aa3a-1176b1ba95dc None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:55.120769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b9448777-cb51-46ce-aa3a-1176b1ba95dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:55.282024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c684d-2011-413c-80b5-cc7ec75f186b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:55.299167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cc084-2718-4901-a4bb-ceeacaa4c692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:55.305371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cc084-2718-4901-a4bb-ceeacaa4c692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:55.305694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cc084-2718-4901-a4bb-ceeacaa4c692 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:55.309529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cc084-2718-4901-a4bb-ceeacaa4c692 admin admin] PATH_INFO: `/v3/projects/d23ade532437415e802030f18fe78d01` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:55.315455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cc084-2718-4901-a4bb-ceeacaa4c692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d23ade532437415e802030f18fe78d01)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:55.322265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cc084-2718-4901-a4bb-ceeacaa4c692 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:55.380396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:55.471029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d77cc084-2718-4901-a4bb-ceeacaa4c692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd23ade532437415e802030f18fe78d01', 'request_id': 'req-d77cc084-2718-4901-a4bb-ceeacaa4c692'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:55.496508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d77cc084-2718-4901-a4bb-ceeacaa4c692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd23ade532437415e802030f18fe78d01', 'request_id': 'req-d77cc084-2718-4901-a4bb-ceeacaa4c692'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:55.507518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d77cc084-2718-4901-a4bb-ceeacaa4c692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd23ade532437415e802030f18fe78d01', 'request_id': 'req-d77cc084-2718-4901-a4bb-ceeacaa4c692'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:55.535067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d77cc084-2718-4901-a4bb-ceeacaa4c692 admin admin] The token cache is being invalidate because project d23ade532437415e802030f18fe78d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:10:55.535391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d77cc084-2718-4901-a4bb-ceeacaa4c692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:55.537662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d77cc084-2718-4901-a4bb-ceeacaa4c692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:55.541869 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1752/3455] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:55 2022] DELETE /identity/v3/projects/d23ade532437415e802030f18fe78d01 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:55.542848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cc084-2718-4901-a4bb-ceeacaa4c692 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:55.548274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d77cc084-2718-4901-a4bb-ceeacaa4c692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:55.584454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9448777-cb51-46ce-aa3a-1176b1ba95dc None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:55.752227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cc084-2718-4901-a4bb-ceeacaa4c692 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:55.771606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45565a4f-819f-4565-a159-928311233c1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:55.772795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565a4f-819f-4565-a159-928311233c1a service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:55.773524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565a4f-819f-4565-a159-928311233c1a service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:55.774012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565a4f-819f-4565-a159-928311233c1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:55.779116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-45565a4f-819f-4565-a159-928311233c1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:55.781245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe4982-d270-45b1-aa27-6b6d65fd6298 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:55.783258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe4982-d270-45b1-aa27-6b6d65fd6298 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:55.784021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe4982-d270-45b1-aa27-6b6d65fd6298 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:55.784897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe4982-d270-45b1-aa27-6b6d65fd6298 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:55.791092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3ebe4982-d270-45b1-aa27-6b6d65fd6298 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:55.804911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:55.942183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45565a4f-819f-4565-a159-928311233c1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:55.963380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45565a4f-819f-4565-a159-928311233c1a service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:55.968795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe4982-d270-45b1-aa27-6b6d65fd6298 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:55.972916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe4982-d270-45b1-aa27-6b6d65fd6298 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:56.003699 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1704/3456] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:10:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 896 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:10:56.008392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f58a3-14b0-4930-b334-5bb47198b9c0 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:56.008864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f58a3-14b0-4930-b334-5bb47198b9c0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:56.009155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f58a3-14b0-4930-b334-5bb47198b9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:56.023222 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1753/3457] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:10:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:10:56.035129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e1e4b-7944-45a7-89c3-583778aa7d31 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:56.035877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e1e4b-7944-45a7-89c3-583778aa7d31 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:56.036448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e1e4b-7944-45a7-89c3-583778aa7d31 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:56.038445 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1754/3458] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:10:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 21:10:56.050924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e1e4b-7944-45a7-89c3-583778aa7d31 None None] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:10:56.052613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d04f58a3-14b0-4930-b334-5bb47198b9c0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:56.053502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f43e1e4b-7944-45a7-89c3-583778aa7d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:56.065614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d04f58a3-14b0-4930-b334-5bb47198b9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:56.141303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e1e4b-7944-45a7-89c3-583778aa7d31 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:56.188954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e1e4b-7944-45a7-89c3-583778aa7d31 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:56.207629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a67e0-a5d4-4b1b-88f4-5e6fd5f8c9f9 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43088fda1a024ace873c4a7db0bb5e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f17bacb94754dc58235cc9c7e6e9ffa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:56.208753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a67e0-a5d4-4b1b-88f4-5e6fd5f8c9f9 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:56.209038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a67e0-a5d4-4b1b-88f4-5e6fd5f8c9f9 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:56.209315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a67e0-a5d4-4b1b-88f4-5e6fd5f8c9f9 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] PATH_INFO: `/v3/projects/3f17bacb94754dc58235cc9c7e6e9ffa` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:56.214822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a67e0-a5d4-4b1b-88f4-5e6fd5f8c9f9 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] RBAC: Authorizing `identity:get_project(project_id=3f17bacb94754dc58235cc9c7e6e9ffa)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:56.216845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a67e0-a5d4-4b1b-88f4-5e6fd5f8c9f9 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:56.229291 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1755/3459] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:10:56 2022] GET /identity/v3/projects/3f17bacb94754dc58235cc9c7e6e9ffa => generated 365 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:10:56.309726 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1705/3460] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:56.318118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc10512-b42b-4f8b-b2d2-760dcf780194 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:56.318466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc10512-b42b-4f8b-b2d2-760dcf780194 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:56.318677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc10512-b42b-4f8b-b2d2-760dcf780194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:56.353209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3bc10512-b42b-4f8b-b2d2-760dcf780194 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:56.355168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3bc10512-b42b-4f8b-b2d2-760dcf780194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:56.358249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f58a3-14b0-4930-b334-5bb47198b9c0 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:56.359627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d04f58a3-14b0-4930-b334-5bb47198b9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:56.370008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:56.392475 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1756/3461] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:10:56.393286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc10512-b42b-4f8b-b2d2-760dcf780194 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:56.425920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc10512-b42b-4f8b-b2d2-760dcf780194 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:56.443169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdeab7-b7c5-4700-a712-c6fba950cbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:56.443937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdeab7-b7c5-4700-a712-c6fba950cbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:56.444482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdeab7-b7c5-4700-a712-c6fba950cbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:56.445195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdeab7-b7c5-4700-a712-c6fba950cbe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:56.445714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdeab7-b7c5-4700-a712-c6fba950cbe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:10:56.446072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdeab7-b7c5-4700-a712-c6fba950cbe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:56.449221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdeab7-b7c5-4700-a712-c6fba950cbe2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:56.473634 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1757/3462] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:10:56.476859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdeab7-b7c5-4700-a712-c6fba950cbe2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:56.496598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdeab7-b7c5-4700-a712-c6fba950cbe2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:56.511046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f58a3-14b0-4930-b334-5bb47198b9c0 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:56.525472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6318f-8fc5-4494-8ac7-a67350af380a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:56.526152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6318f-8fc5-4494-8ac7-a67350af380a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:56.526445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6318f-8fc5-4494-8ac7-a67350af380a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:56.526692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6318f-8fc5-4494-8ac7-a67350af380a admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:56.527398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6318f-8fc5-4494-8ac7-a67350af380a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:56.529340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6318f-8fc5-4494-8ac7-a67350af380a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:56.532382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a0d0e-d9cc-446c-8b92-acb850ad7d3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:56.533188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a0d0e-d9cc-446c-8b92-acb850ad7d3a service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:56.533545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a0d0e-d9cc-446c-8b92-acb850ad7d3a service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:56.533835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a0d0e-d9cc-446c-8b92-acb850ad7d3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:56.536897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d76a0d0e-d9cc-446c-8b92-acb850ad7d3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:56.569374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a0d0e-d9cc-446c-8b92-acb850ad7d3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:56.571569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a0d0e-d9cc-446c-8b92-acb850ad7d3a service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:56.604093 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1758/3463] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:10:56 2022] POST /identity/v3/projects => generated 391 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:10:56.607698 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1706/3464] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:10:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:10:56.611116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6318f-8fc5-4494-8ac7-a67350af380a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:56.745563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6318f-8fc5-4494-8ac7-a67350af380a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:56.757455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e042a6-b7f3-475d-826c-79a3cbbc81ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:56.758159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e042a6-b7f3-475d-826c-79a3cbbc81ef admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:56.758443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e042a6-b7f3-475d-826c-79a3cbbc81ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:56.758730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e042a6-b7f3-475d-826c-79a3cbbc81ef admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:56.759649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e042a6-b7f3-475d-826c-79a3cbbc81ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:56.766460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a0d0e-d9cc-446c-8b92-acb850ad7d3a service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:56.776732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e042a6-b7f3-475d-826c-79a3cbbc81ef admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:56.780306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a0d0e-d9cc-446c-8b92-acb850ad7d3a service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:56.845109 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1759/3465] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:10:56 2022] POST /identity/v3/users => generated 296 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:10:56.847994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e042a6-b7f3-475d-826c-79a3cbbc81ef admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:56.882012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e042a6-b7f3-475d-826c-79a3cbbc81ef admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:56.905561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4088459-d7a1-4b4d-bf4d-15099b5ca4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:56.906321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4088459-d7a1-4b4d-bf4d-15099b5ca4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:56.906615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4088459-d7a1-4b4d-bf4d-15099b5ca4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:56.906815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4088459-d7a1-4b4d-bf4d-15099b5ca4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:56.907511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4088459-d7a1-4b4d-bf4d-15099b5ca4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:56.909173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4088459-d7a1-4b4d-bf4d-15099b5ca4a9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:56.960379 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1760/3466] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:10:56.963818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4088459-d7a1-4b4d-bf4d-15099b5ca4a9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:56.969705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a833cc1-e9f7-4678-9aa4-13c4e7573dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:56.972873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a833cc1-e9f7-4678-9aa4-13c4e7573dbe service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:56.973442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a833cc1-e9f7-4678-9aa4-13c4e7573dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:56.973726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a833cc1-e9f7-4678-9aa4-13c4e7573dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:56.981430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5a833cc1-e9f7-4678-9aa4-13c4e7573dbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:57.003651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4088459-d7a1-4b4d-bf4d-15099b5ca4a9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:57.019885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe5f49-a123-41d9-8d51-8869693c754c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:57.022602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe5f49-a123-41d9-8d51-8869693c754c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:57.023964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe5f49-a123-41d9-8d51-8869693c754c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:57.025196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe5f49-a123-41d9-8d51-8869693c754c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:57.027357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe5f49-a123-41d9-8d51-8869693c754c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:57.030702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe5f49-a123-41d9-8d51-8869693c754c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:57.089464 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1761/3467] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:10:57.095571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe5f49-a123-41d9-8d51-8869693c754c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:57.130523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe5f49-a123-41d9-8d51-8869693c754c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:57.148242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d5b80-8d1f-48bf-a65d-50a95c6b35a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:57.151525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d5b80-8d1f-48bf-a65d-50a95c6b35a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:57.152876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d5b80-8d1f-48bf-a65d-50a95c6b35a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:57.153011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d5b80-8d1f-48bf-a65d-50a95c6b35a9 admin admin] PATH_INFO: `/v3/projects/d8523eb97eba43f4b819bc5d252bdcb7/users/d876976637504a83859b09a4ef0d3406/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:57.207183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a833cc1-e9f7-4678-9aa4-13c4e7573dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:57.208948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d5b80-8d1f-48bf-a65d-50a95c6b35a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8523eb97eba43f4b819bc5d252bdcb7, user_id=d876976637504a83859b09a4ef0d3406, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:57.211373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a833cc1-e9f7-4678-9aa4-13c4e7573dbe service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:57.222127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d5b80-8d1f-48bf-a65d-50a95c6b35a9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:57.243803 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1707/3468] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:10:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:10:57.276624 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1762/3469] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:10:57 2022] PUT /identity/v3/projects/d8523eb97eba43f4b819bc5d252bdcb7/users/d876976637504a83859b09a4ef0d3406/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:57.283737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0627292-b173-4a72-a2ec-0b9f8f0f832d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:57.284093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0627292-b173-4a72-a2ec-0b9f8f0f832d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:57.284366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0627292-b173-4a72-a2ec-0b9f8f0f832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:57.318967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a0627292-b173-4a72-a2ec-0b9f8f0f832d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:57.320307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a0627292-b173-4a72-a2ec-0b9f8f0f832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:57.400071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:57.460325 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1708/3470] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:10:57.496803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d5b80-8d1f-48bf-a65d-50a95c6b35a9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:57.501215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1c7d5b80-8d1f-48bf-a65d-50a95c6b35a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:57.509807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:57.706907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d5b80-8d1f-48bf-a65d-50a95c6b35a9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:57.720501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb0913-ed4c-41b6-978a-19a16d03cc30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:57.721429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb0913-ed4c-41b6-978a-19a16d03cc30 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:57.727702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb0913-ed4c-41b6-978a-19a16d03cc30 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:57.728229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb0913-ed4c-41b6-978a-19a16d03cc30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:57.755138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb0913-ed4c-41b6-978a-19a16d03cc30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:57.757035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb0913-ed4c-41b6-978a-19a16d03cc30 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:57.781342 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1763/3471] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:10:57.786771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b53045-894f-4677-b730-d41e8158af77 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:57.786771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b53045-894f-4677-b730-d41e8158af77 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:57.787212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b53045-894f-4677-b730-d41e8158af77 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:57.789006 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1709/3472] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:10:57.799342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb0913-ed4c-41b6-978a-19a16d03cc30 service neutron] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:10:58.033371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb0913-ed4c-41b6-978a-19a16d03cc30 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:58.188156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb0913-ed4c-41b6-978a-19a16d03cc30 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:58.200057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5924c-345a-453c-9a0c-2443e93ac0a4 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43088fda1a024ace873c4a7db0bb5e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f17bacb94754dc58235cc9c7e6e9ffa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:58.201092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5924c-345a-453c-9a0c-2443e93ac0a4 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:58.201379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5924c-345a-453c-9a0c-2443e93ac0a4 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:58.201666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5924c-345a-453c-9a0c-2443e93ac0a4 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] PATH_INFO: `/v3/projects/3f17bacb94754dc58235cc9c7e6e9ffa` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:58.207921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5924c-345a-453c-9a0c-2443e93ac0a4 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] RBAC: Authorizing `identity:get_project(project_id=3f17bacb94754dc58235cc9c7e6e9ffa)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:58.210514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5924c-345a-453c-9a0c-2443e93ac0a4 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:58.216184 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1764/3473] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:10:57 2022] GET /identity/v3/projects/3f17bacb94754dc58235cc9c7e6e9ffa => generated 365 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:10:58.410581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6752b-ed9e-4d13-b085-a4e3c291ea2f None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:58.411543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6752b-ed9e-4d13-b085-a4e3c291ea2f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:58.411976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6752b-ed9e-4d13-b085-a4e3c291ea2f None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:58.413960 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1710/3474] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:10:58.424292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5924c-345a-453c-9a0c-2443e93ac0a4 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:10:58.452434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5924c-345a-453c-9a0c-2443e93ac0a4 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:58.486720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5924c-345a-453c-9a0c-2443e93ac0a4 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:58.505825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55845f9-48ee-493d-b4c6-c11a146a3366 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43088fda1a024ace873c4a7db0bb5e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f17bacb94754dc58235cc9c7e6e9ffa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:58.506784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55845f9-48ee-493d-b4c6-c11a146a3366 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:58.507075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55845f9-48ee-493d-b4c6-c11a146a3366 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:58.514664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55845f9-48ee-493d-b4c6-c11a146a3366 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] PATH_INFO: `/v3/projects/3f17bacb94754dc58235cc9c7e6e9ffa` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:58.516534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55845f9-48ee-493d-b4c6-c11a146a3366 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] RBAC: Authorizing `identity:get_project(project_id=3f17bacb94754dc58235cc9c7e6e9ffa)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:58.522270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55845f9-48ee-493d-b4c6-c11a146a3366 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:58.526560 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1765/3475] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:10:58 2022] GET /identity/v3/projects/3f17bacb94754dc58235cc9c7e6e9ffa => generated 365 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:10:58.571807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3fc44-3fa1-425e-8f08-5e64b520a29b None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:58.573570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3fc44-3fa1-425e-8f08-5e64b520a29b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:58.575689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3fc44-3fa1-425e-8f08-5e64b520a29b None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:58.578794 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1711/3476] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:10:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:10:58.620060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55845f9-48ee-493d-b4c6-c11a146a3366 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:10:58.656906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55845f9-48ee-493d-b4c6-c11a146a3366 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:58.683453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55845f9-48ee-493d-b4c6-c11a146a3366 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:58.696148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cdc69-6df2-4588-8078-6ad4ad4e6000 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43088fda1a024ace873c4a7db0bb5e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f17bacb94754dc58235cc9c7e6e9ffa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:58.697537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cdc69-6df2-4588-8078-6ad4ad4e6000 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:58.697924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cdc69-6df2-4588-8078-6ad4ad4e6000 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:58.698308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cdc69-6df2-4588-8078-6ad4ad4e6000 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] PATH_INFO: `/v3/projects/3f17bacb94754dc58235cc9c7e6e9ffa` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:58.700978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0cdc69-6df2-4588-8078-6ad4ad4e6000 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] RBAC: Authorizing `identity:get_project(project_id=3f17bacb94754dc58235cc9c7e6e9ffa)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:58.708859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0cdc69-6df2-4588-8078-6ad4ad4e6000 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:58.713362 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1766/3477] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:10:58 2022] GET /identity/v3/projects/3f17bacb94754dc58235cc9c7e6e9ffa => generated 365 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:10:58.918113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41320735-5fff-4141-9691-7ea06b9e4d3b None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:58.918636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41320735-5fff-4141-9691-7ea06b9e4d3b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:58.919090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41320735-5fff-4141-9691-7ea06b9e4d3b None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:58.920661 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1712/3478] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:10:58.931829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cdc69-6df2-4588-8078-6ad4ad4e6000 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:10:58.955711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cdc69-6df2-4588-8078-6ad4ad4e6000 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:58.973087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cdc69-6df2-4588-8078-6ad4ad4e6000 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:58.987532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed507e0-893f-47cc-a32e-3ada74974d59 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43088fda1a024ace873c4a7db0bb5e39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f17bacb94754dc58235cc9c7e6e9ffa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:58.988746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed507e0-893f-47cc-a32e-3ada74974d59 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:58.989183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed507e0-893f-47cc-a32e-3ada74974d59 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:58.989633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed507e0-893f-47cc-a32e-3ada74974d59 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] PATH_INFO: `/v3/projects/3f17bacb94754dc58235cc9c7e6e9ffa` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:58.991082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed507e0-893f-47cc-a32e-3ada74974d59 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] RBAC: Authorizing `identity:get_project(project_id=3f17bacb94754dc58235cc9c7e6e9ffa)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:58.993225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed507e0-893f-47cc-a32e-3ada74974d59 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:58.995563 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1767/3479] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:10:58 2022] GET /identity/v3/projects/3f17bacb94754dc58235cc9c7e6e9ffa => generated 365 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:10:59.077193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41320735-5fff-4141-9691-7ea06b9e4d3b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:10:59.082601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-41320735-5fff-4141-9691-7ea06b9e4d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:59.114306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41320735-5fff-4141-9691-7ea06b9e4d3b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:10:59.127757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a2acd-6dc9-406d-b3e3-75d7450979b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:10:59.128900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a2acd-6dc9-406d-b3e3-75d7450979b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:59.129280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a2acd-6dc9-406d-b3e3-75d7450979b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:59.129649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a2acd-6dc9-406d-b3e3-75d7450979b1 admin admin] PATH_INFO: `/v3/users/43088fda1a024ace873c4a7db0bb5e39` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:59.131972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a2acd-6dc9-406d-b3e3-75d7450979b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43088fda1a024ace873c4a7db0bb5e39)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:10:59.146816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a2acd-6dc9-406d-b3e3-75d7450979b1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:10:59.282287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c5a2acd-6dc9-406d-b3e3-75d7450979b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43088fda1a024ace873c4a7db0bb5e39'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:59.324241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c5a2acd-6dc9-406d-b3e3-75d7450979b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43088fda1a024ace873c4a7db0bb5e39'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:59.337844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c5a2acd-6dc9-406d-b3e3-75d7450979b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43088fda1a024ace873c4a7db0bb5e39'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:59.340071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c5a2acd-6dc9-406d-b3e3-75d7450979b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43088fda1a024ace873c4a7db0bb5e39'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:59.347320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c5a2acd-6dc9-406d-b3e3-75d7450979b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43088fda1a024ace873c4a7db0bb5e39'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:10:59.406730 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1713/3480] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:10:59 2022] DELETE /identity/v3/users/43088fda1a024ace873c4a7db0bb5e39 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:10:59.411362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909ee83-90b7-426a-b34b-644fc896e459 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:10:59.411932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909ee83-90b7-426a-b34b-644fc896e459 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:10:59.414757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909ee83-90b7-426a-b34b-644fc896e459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:10:59.458409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0909ee83-90b7-426a-b34b-644fc896e459 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:10:59.459786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0909ee83-90b7-426a-b34b-644fc896e459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:10:59.508625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:59.618489 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1768/3481] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:00.011615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a2acd-6dc9-406d-b3e3-75d7450979b1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:00.013220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2c5a2acd-6dc9-406d-b3e3-75d7450979b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:00.230186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a2acd-6dc9-406d-b3e3-75d7450979b1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:00.249826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d48d69-a70c-4927-b7dd-47fa2c1271a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:00.250996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d48d69-a70c-4927-b7dd-47fa2c1271a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:00.251475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d48d69-a70c-4927-b7dd-47fa2c1271a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:00.251931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d48d69-a70c-4927-b7dd-47fa2c1271a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:00.266453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d48d69-a70c-4927-b7dd-47fa2c1271a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:00.269798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d48d69-a70c-4927-b7dd-47fa2c1271a9 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:00.293128 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1714/3482] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:11:01.858150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909ee83-90b7-426a-b34b-644fc896e459 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:01.864012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0909ee83-90b7-426a-b34b-644fc896e459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:01.894145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909ee83-90b7-426a-b34b-644fc896e459 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:01.927280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6ab9d-92e6-49d8-83c9-09550d408647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:01.929041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6ab9d-92e6-49d8-83c9-09550d408647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:01.929578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6ab9d-92e6-49d8-83c9-09550d408647 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:01.930155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6ab9d-92e6-49d8-83c9-09550d408647 admin admin] PATH_INFO: `/v3/projects/3f17bacb94754dc58235cc9c7e6e9ffa` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:01.932261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6ab9d-92e6-49d8-83c9-09550d408647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f17bacb94754dc58235cc9c7e6e9ffa)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:01.936708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6ab9d-92e6-49d8-83c9-09550d408647 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:02.060381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2db6ab9d-92e6-49d8-83c9-09550d408647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f17bacb94754dc58235cc9c7e6e9ffa', 'request_id': 'req-2db6ab9d-92e6-49d8-83c9-09550d408647'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:02.098046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2db6ab9d-92e6-49d8-83c9-09550d408647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f17bacb94754dc58235cc9c7e6e9ffa', 'request_id': 'req-2db6ab9d-92e6-49d8-83c9-09550d408647'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:02.108323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2db6ab9d-92e6-49d8-83c9-09550d408647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f17bacb94754dc58235cc9c7e6e9ffa', 'request_id': 'req-2db6ab9d-92e6-49d8-83c9-09550d408647'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:02.153114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2db6ab9d-92e6-49d8-83c9-09550d408647 admin admin] The token cache is being invalidate because project 3f17bacb94754dc58235cc9c7e6e9ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:02.153893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2db6ab9d-92e6-49d8-83c9-09550d408647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:02.155487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2db6ab9d-92e6-49d8-83c9-09550d408647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:02.162403 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1769/3483] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:01 2022] DELETE /identity/v3/projects/3f17bacb94754dc58235cc9c7e6e9ffa => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:02.169188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cd8d1-bc29-4b80-a53c-aab5f7627bf2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:02.170653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cd8d1-bc29-4b80-a53c-aab5f7627bf2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:02.171304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9cd8d1-bc29-4b80-a53c-aab5f7627bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:02.207687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3f9cd8d1-bc29-4b80-a53c-aab5f7627bf2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:02.209571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3f9cd8d1-bc29-4b80-a53c-aab5f7627bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:02.380397 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1715/3484] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:02.388567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a634c55-9934-4a5b-b2de-a0fb5a35d75f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:02.391406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a634c55-9934-4a5b-b2de-a0fb5a35d75f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:02.396396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a634c55-9934-4a5b-b2de-a0fb5a35d75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:02.437528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7a634c55-9934-4a5b-b2de-a0fb5a35d75f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:02.438999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7a634c55-9934-4a5b-b2de-a0fb5a35d75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:02.463223 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1770/3485] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:02.468112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cd8d1-bc29-4b80-a53c-aab5f7627bf2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:02.479747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:02.490333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9cd8d1-bc29-4b80-a53c-aab5f7627bf2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:02.512843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4828dae-e773-4ace-8d16-0dc7779f6e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:02.516451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4828dae-e773-4ace-8d16-0dc7779f6e14 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:02.517099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4828dae-e773-4ace-8d16-0dc7779f6e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:02.518556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4828dae-e773-4ace-8d16-0dc7779f6e14 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:02.520505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4828dae-e773-4ace-8d16-0dc7779f6e14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:11:02.520822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4828dae-e773-4ace-8d16-0dc7779f6e14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:02.525311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4828dae-e773-4ace-8d16-0dc7779f6e14 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:02.579783 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1716/3486] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:02.581388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a634c55-9934-4a5b-b2de-a0fb5a35d75f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:02.594849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a634c55-9934-4a5b-b2de-a0fb5a35d75f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:02.607484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646199f-20a7-4c98-a429-b365a08266b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:02.608375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646199f-20a7-4c98-a429-b365a08266b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:02.608753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646199f-20a7-4c98-a429-b365a08266b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:02.609125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646199f-20a7-4c98-a429-b365a08266b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:02.609943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646199f-20a7-4c98-a429-b365a08266b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:02.614440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646199f-20a7-4c98-a429-b365a08266b9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:02.699253 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1771/3487] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:11:02 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:02.700486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4828dae-e773-4ace-8d16-0dc7779f6e14 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:02.724771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4828dae-e773-4ace-8d16-0dc7779f6e14 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:02.917558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f555357-6a78-43fc-b6cc-cada783e797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:02.918576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f555357-6a78-43fc-b6cc-cada783e797b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:02.918964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f555357-6a78-43fc-b6cc-cada783e797b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:02.919338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f555357-6a78-43fc-b6cc-cada783e797b admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:02.920757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f555357-6a78-43fc-b6cc-cada783e797b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:02.934258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f555357-6a78-43fc-b6cc-cada783e797b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:02.973528 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1717/3488] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:11:02 2022] POST /identity/v3/users => generated 292 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:02.975147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646199f-20a7-4c98-a429-b365a08266b9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:02.989571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646199f-20a7-4c98-a429-b365a08266b9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:03.004937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05517f-3f63-4b96-bd31-c650a0d86e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:03.005809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05517f-3f63-4b96-bd31-c650a0d86e4c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:03.006198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05517f-3f63-4b96-bd31-c650a0d86e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:03.006582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05517f-3f63-4b96-bd31-c650a0d86e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:03.007525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05517f-3f63-4b96-bd31-c650a0d86e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:03.009363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05517f-3f63-4b96-bd31-c650a0d86e4c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:03.033823 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1772/3489] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:11:03.035125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f555357-6a78-43fc-b6cc-cada783e797b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:03.056210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f555357-6a78-43fc-b6cc-cada783e797b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:03.069091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce560c-1047-4412-b6ef-317affbf7902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:03.069925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce560c-1047-4412-b6ef-317affbf7902 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:03.086469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce560c-1047-4412-b6ef-317affbf7902 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:03.100567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce560c-1047-4412-b6ef-317affbf7902 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:03.101495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce560c-1047-4412-b6ef-317affbf7902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:03.103246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce560c-1047-4412-b6ef-317affbf7902 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:03.155746 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1718/3490] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:11:03.157064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05517f-3f63-4b96-bd31-c650a0d86e4c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:03.170713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05517f-3f63-4b96-bd31-c650a0d86e4c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:03.182581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63668d0-4b0c-4361-856e-37e314292587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:03.183680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63668d0-4b0c-4361-856e-37e314292587 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:03.185294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63668d0-4b0c-4361-856e-37e314292587 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:03.186935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63668d0-4b0c-4361-856e-37e314292587 admin admin] PATH_INFO: `/v3/projects/01a157232bd54d46ad99f8655ebb40b2/users/094610d1808a479b99ce0fe5c2bac033/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:03.253352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63668d0-4b0c-4361-856e-37e314292587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a157232bd54d46ad99f8655ebb40b2, user_id=094610d1808a479b99ce0fe5c2bac033, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:03.257533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63668d0-4b0c-4361-856e-37e314292587 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:03.284889 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1773/3491] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:11:03 2022] PUT /identity/v3/projects/01a157232bd54d46ad99f8655ebb40b2/users/094610d1808a479b99ce0fe5c2bac033/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:03.297623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655c3d1-a886-4468-9e18-054b053773cc None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:03.301382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655c3d1-a886-4468-9e18-054b053773cc None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:03.301937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655c3d1-a886-4468-9e18-054b053773cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:03.395923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d655c3d1-a886-4468-9e18-054b053773cc None None] MFA Rules not processed for user `094610d1808a479b99ce0fe5c2bac033`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:03.397241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d655c3d1-a886-4468-9e18-054b053773cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:03.568505 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1719/3492] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:03.576669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63668d0-4b0c-4361-856e-37e314292587 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:03.579580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b63668d0-4b0c-4361-856e-37e314292587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:03.705061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:03.777597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63668d0-4b0c-4361-856e-37e314292587 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:03.789415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bcf33-4cf2-4e2c-8551-ec933ae6a9a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:03.790257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bcf33-4cf2-4e2c-8551-ec933ae6a9a4 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:03.790783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bcf33-4cf2-4e2c-8551-ec933ae6a9a4 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:03.791170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bcf33-4cf2-4e2c-8551-ec933ae6a9a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:03.837099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283bcf33-4cf2-4e2c-8551-ec933ae6a9a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:03.843659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283bcf33-4cf2-4e2c-8551-ec933ae6a9a4 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:03.868651 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1774/3493] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:11:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:11:06.212272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5530b-a639-4931-9828-b246343eea95 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:06.215920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5530b-a639-4931-9828-b246343eea95 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:06.216536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5530b-a639-4931-9828-b246343eea95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:06.258816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1ef5530b-a639-4931-9828-b246343eea95 None None] MFA Rules not processed for user `8b345a42784d4df79caab6d667117418`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:06.262763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1ef5530b-a639-4931-9828-b246343eea95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:06.301154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bcf33-4cf2-4e2c-8551-ec933ae6a9a4 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:06.303768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-283bcf33-4cf2-4e2c-8551-ec933ae6a9a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:06.517365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bcf33-4cf2-4e2c-8551-ec933ae6a9a4 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:06.521300 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1720/3494] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:06.527117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485d66d-0be6-4fc7-9576-4ddca21ecb81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:06.528794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485d66d-0be6-4fc7-9576-4ddca21ecb81 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:06.530638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485d66d-0be6-4fc7-9576-4ddca21ecb81 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:06.531219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485d66d-0be6-4fc7-9576-4ddca21ecb81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:06.535543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8485d66d-0be6-4fc7-9576-4ddca21ecb81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:06.549449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485d66d-0be6-4fc7-9576-4ddca21ecb81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:06.551155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485d66d-0be6-4fc7-9576-4ddca21ecb81 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:06.567158 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1775/3495] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:11:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:11:07.161597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846d2f1-2f03-4c69-9714-9de7950fb9da None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:07.162115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846d2f1-2f03-4c69-9714-9de7950fb9da None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:07.162495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846d2f1-2f03-4c69-9714-9de7950fb9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:07.177118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:07.226296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b846d2f1-2f03-4c69-9714-9de7950fb9da None None] MFA Rules not processed for user `1412af7535c24b5fa139fd87431375ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:07.230033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b846d2f1-2f03-4c69-9714-9de7950fb9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:07.453415 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1721/3496] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:10.807432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0327b5b-f8c8-4266-b127-5e19c1616c3b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:10.808114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0327b5b-f8c8-4266-b127-5e19c1616c3b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:10.808377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0327b5b-f8c8-4266-b127-5e19c1616c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:10.867323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a0327b5b-f8c8-4266-b127-5e19c1616c3b None None] MFA Rules not processed for user `d876976637504a83859b09a4ef0d3406`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:10.870390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a0327b5b-f8c8-4266-b127-5e19c1616c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:11.064605 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1776/3497] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:11.074534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b5bec-e8c3-472b-99af-cfb7d616c5d8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:11.075537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b5bec-e8c3-472b-99af-cfb7d616c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:11.076058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b5bec-e8c3-472b-99af-cfb7d616c5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:11.112218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e47b5bec-e8c3-472b-99af-cfb7d616c5d8 None None] MFA Rules not processed for user `d876976637504a83859b09a4ef0d3406`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:11.113619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e47b5bec-e8c3-472b-99af-cfb7d616c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:11.138662 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1722/3498] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:11.141867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0327b5b-f8c8-4266-b127-5e19c1616c3b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:11.176896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0327b5b-f8c8-4266-b127-5e19c1616c3b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:11.197914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32dc4b-540c-403d-80d4-27348f774a25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:11.198926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32dc4b-540c-403d-80d4-27348f774a25 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:11.199225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32dc4b-540c-403d-80d4-27348f774a25 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:11.200462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32dc4b-540c-403d-80d4-27348f774a25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:11.223747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32dc4b-540c-403d-80d4-27348f774a25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:11.225432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32dc4b-540c-403d-80d4-27348f774a25 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:11.258899 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1777/3499] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:11:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:11:11.970923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b5bec-e8c3-472b-99af-cfb7d616c5d8 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:11.972996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e47b5bec-e8c3-472b-99af-cfb7d616c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:12.135977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b5bec-e8c3-472b-99af-cfb7d616c5d8 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:12.142688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e7d22-fec4-4bd4-b610-699cce36c98d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:12.143922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e7d22-fec4-4bd4-b610-699cce36c98d service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:12.144473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e7d22-fec4-4bd4-b610-699cce36c98d service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:12.144957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e7d22-fec4-4bd4-b610-699cce36c98d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:12.147419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-667e7d22-fec4-4bd4-b610-699cce36c98d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:12.162208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e7d22-fec4-4bd4-b610-699cce36c98d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:12.164643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e7d22-fec4-4bd4-b610-699cce36c98d service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:12.178864 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1723/3500] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:11:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:11:13.788182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1c987-6068-491c-80be-bfe511ca741f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:13.789461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1c987-6068-491c-80be-bfe511ca741f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:13.790144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1c987-6068-491c-80be-bfe511ca741f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:13.865233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-47c1c987-6068-491c-80be-bfe511ca741f None None] MFA Rules not processed for user `984631f5a77a48c5a9619e33e608dd59`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:13.875365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-47c1c987-6068-491c-80be-bfe511ca741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:14.045797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:14.085817 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1778/3501] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:14.482209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e7d22-fec4-4bd4-b610-699cce36c98d service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:14.515857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e7d22-fec4-4bd4-b610-699cce36c98d service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:14.536281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8949e-c9bd-48a5-914b-0aed7117c8ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:14.538122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8949e-c9bd-48a5-914b-0aed7117c8ea service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:14.538406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8949e-c9bd-48a5-914b-0aed7117c8ea service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:14.539887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8949e-c9bd-48a5-914b-0aed7117c8ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:14.561271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8949e-c9bd-48a5-914b-0aed7117c8ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:14.565705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8949e-c9bd-48a5-914b-0aed7117c8ea service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:14.602689 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1724/3502] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:11:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:11:17.674411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1c987-6068-491c-80be-bfe511ca741f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:17.833706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1c987-6068-491c-80be-bfe511ca741f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:17.856116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73995c-b2db-401e-9f2f-dd66af9a96af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:17.857049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73995c-b2db-401e-9f2f-dd66af9a96af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:17.857496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73995c-b2db-401e-9f2f-dd66af9a96af admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:17.857912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73995c-b2db-401e-9f2f-dd66af9a96af admin admin] PATH_INFO: `/v3/users/094610d1808a479b99ce0fe5c2bac033` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:17.859857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73995c-b2db-401e-9f2f-dd66af9a96af admin admin] RBAC: Authorizing `identity:delete_user(user_id=094610d1808a479b99ce0fe5c2bac033)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:17.862052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73995c-b2db-401e-9f2f-dd66af9a96af admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:18.026813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4f73995c-b2db-401e-9f2f-dd66af9a96af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094610d1808a479b99ce0fe5c2bac033'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:18.051240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4f73995c-b2db-401e-9f2f-dd66af9a96af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094610d1808a479b99ce0fe5c2bac033'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:18.052242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4f73995c-b2db-401e-9f2f-dd66af9a96af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094610d1808a479b99ce0fe5c2bac033'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:18.053970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4f73995c-b2db-401e-9f2f-dd66af9a96af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094610d1808a479b99ce0fe5c2bac033'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:18.077840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4f73995c-b2db-401e-9f2f-dd66af9a96af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094610d1808a479b99ce0fe5c2bac033'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:18.143632 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1779/3503] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:11:17 2022] DELETE /identity/v3/users/094610d1808a479b99ce0fe5c2bac033 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:18.145533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7e9a9-8f71-4869-8590-de3b5d4db83c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:18.145998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7e9a9-8f71-4869-8590-de3b5d4db83c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:18.146146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7e9a9-8f71-4869-8590-de3b5d4db83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:18.194731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a9f7e9a9-8f71-4869-8590-de3b5d4db83c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:18.198292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a9f7e9a9-8f71-4869-8590-de3b5d4db83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:18.337547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:18.356414 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1725/3504] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:18.420828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73995c-b2db-401e-9f2f-dd66af9a96af admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:18.423786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4f73995c-b2db-401e-9f2f-dd66af9a96af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:18.581125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73995c-b2db-401e-9f2f-dd66af9a96af admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:18.585303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147399f5-f246-4e8b-9949-b225d6531f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:18.587665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147399f5-f246-4e8b-9949-b225d6531f4f service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:18.588066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147399f5-f246-4e8b-9949-b225d6531f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:18.588456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147399f5-f246-4e8b-9949-b225d6531f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:18.598487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:18.601496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147399f5-f246-4e8b-9949-b225d6531f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:18.603800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147399f5-f246-4e8b-9949-b225d6531f4f service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:18.633057 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1780/3505] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:11:19.839169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca405e4e-9e38-44df-a47d-3ed0abb96d33 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:19.840135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca405e4e-9e38-44df-a47d-3ed0abb96d33 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:19.840646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca405e4e-9e38-44df-a47d-3ed0abb96d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:19.880139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ca405e4e-9e38-44df-a47d-3ed0abb96d33 None None] MFA Rules not processed for user `984631f5a77a48c5a9619e33e608dd59`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:19.883780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ca405e4e-9e38-44df-a47d-3ed0abb96d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:20.052407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147399f5-f246-4e8b-9949-b225d6531f4f service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:20.054521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-147399f5-f246-4e8b-9949-b225d6531f4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:20.090965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147399f5-f246-4e8b-9949-b225d6531f4f service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:20.117960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bc90b-6326-4a91-9d26-1d22432e8efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:20.121666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bc90b-6326-4a91-9d26-1d22432e8efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:20.123661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bc90b-6326-4a91-9d26-1d22432e8efa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:20.124818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bc90b-6326-4a91-9d26-1d22432e8efa admin admin] PATH_INFO: `/v3/projects/01a157232bd54d46ad99f8655ebb40b2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:20.130413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6bc90b-6326-4a91-9d26-1d22432e8efa admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a157232bd54d46ad99f8655ebb40b2)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:20.153790 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1726/3506] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:20.154206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6bc90b-6326-4a91-9d26-1d22432e8efa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:20.307991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eb6bc90b-6326-4a91-9d26-1d22432e8efa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a157232bd54d46ad99f8655ebb40b2', 'request_id': 'req-eb6bc90b-6326-4a91-9d26-1d22432e8efa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:20.331459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eb6bc90b-6326-4a91-9d26-1d22432e8efa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a157232bd54d46ad99f8655ebb40b2', 'request_id': 'req-eb6bc90b-6326-4a91-9d26-1d22432e8efa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:20.341308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eb6bc90b-6326-4a91-9d26-1d22432e8efa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a157232bd54d46ad99f8655ebb40b2', 'request_id': 'req-eb6bc90b-6326-4a91-9d26-1d22432e8efa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:20.375898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eb6bc90b-6326-4a91-9d26-1d22432e8efa admin admin] The token cache is being invalidate because project 01a157232bd54d46ad99f8655ebb40b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:20.376707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eb6bc90b-6326-4a91-9d26-1d22432e8efa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:20.377602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eb6bc90b-6326-4a91-9d26-1d22432e8efa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:20.379805 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1781/3507] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:20 2022] DELETE /identity/v3/projects/01a157232bd54d46ad99f8655ebb40b2 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:20.386283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80515d-c3c4-45c9-b4ca-b5d9ccfb37af None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:20.386571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80515d-c3c4-45c9-b4ca-b5d9ccfb37af None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:20.388216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80515d-c3c4-45c9-b4ca-b5d9ccfb37af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:20.433117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8a80515d-c3c4-45c9-b4ca-b5d9ccfb37af None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:20.436838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8a80515d-c3c4-45c9-b4ca-b5d9ccfb37af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:20.533221 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1727/3508] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:20.544466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4746b3-e12b-4ccc-8034-4027065be471 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:20.545006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4746b3-e12b-4ccc-8034-4027065be471 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:20.545500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4746b3-e12b-4ccc-8034-4027065be471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:20.570031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ae4746b3-e12b-4ccc-8034-4027065be471 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:20.571529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ae4746b3-e12b-4ccc-8034-4027065be471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:20.582955 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1782/3509] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:20.587284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80515d-c3c4-45c9-b4ca-b5d9ccfb37af None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:20.601067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80515d-c3c4-45c9-b4ca-b5d9ccfb37af None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:20.612296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4891ea0-f007-4967-a8cb-87603fd3ad4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:20.614115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4891ea0-f007-4967-a8cb-87603fd3ad4e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:20.614590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4891ea0-f007-4967-a8cb-87603fd3ad4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:20.615040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4891ea0-f007-4967-a8cb-87603fd3ad4e admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:20.616257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4891ea0-f007-4967-a8cb-87603fd3ad4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:11:20.617279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4891ea0-f007-4967-a8cb-87603fd3ad4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:20.619476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4891ea0-f007-4967-a8cb-87603fd3ad4e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:20.637896 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1728/3510] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:20.638761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4746b3-e12b-4ccc-8034-4027065be471 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:20.666100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4746b3-e12b-4ccc-8034-4027065be471 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:20.698558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2f032-3ade-4da7-8c16-b94f5001b044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:20.699635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2f032-3ade-4da7-8c16-b94f5001b044 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:20.700460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2f032-3ade-4da7-8c16-b94f5001b044 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:20.701914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2f032-3ade-4da7-8c16-b94f5001b044 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:20.703339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2f032-3ade-4da7-8c16-b94f5001b044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:20.713379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2f032-3ade-4da7-8c16-b94f5001b044 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:20.767842 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1783/3511] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:11:20 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:11:20.772177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4891ea0-f007-4967-a8cb-87603fd3ad4e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:20.783717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4891ea0-f007-4967-a8cb-87603fd3ad4e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:20.905462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242b829-fbe9-4617-b4a2-e0f14a5370b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:20.906165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242b829-fbe9-4617-b4a2-e0f14a5370b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:20.906653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242b829-fbe9-4617-b4a2-e0f14a5370b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:20.906930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242b829-fbe9-4617-b4a2-e0f14a5370b5 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:20.907641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242b829-fbe9-4617-b4a2-e0f14a5370b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:20.909647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242b829-fbe9-4617-b4a2-e0f14a5370b5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:20.974080 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1729/3512] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:11:20 2022] POST /identity/v3/users => generated 288 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:20.976409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2f032-3ade-4da7-8c16-b94f5001b044 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:20.993885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2f032-3ade-4da7-8c16-b94f5001b044 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:21.003514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7c197-fde2-41cd-929b-41611bbc9cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:21.004243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7c197-fde2-41cd-929b-41611bbc9cbf admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:21.004520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7c197-fde2-41cd-929b-41611bbc9cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:21.004787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7c197-fde2-41cd-929b-41611bbc9cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:21.005622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7c197-fde2-41cd-929b-41611bbc9cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:21.007283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7c197-fde2-41cd-929b-41611bbc9cbf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:21.031595 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1784/3513] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:11:21.032782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242b829-fbe9-4617-b4a2-e0f14a5370b5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:21.046860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242b829-fbe9-4617-b4a2-e0f14a5370b5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:21.066872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1afc74-d801-4e70-88ce-a480c8544708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:21.067836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1afc74-d801-4e70-88ce-a480c8544708 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:21.068557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1afc74-d801-4e70-88ce-a480c8544708 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:21.069289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1afc74-d801-4e70-88ce-a480c8544708 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:21.070181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1afc74-d801-4e70-88ce-a480c8544708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:21.072016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1afc74-d801-4e70-88ce-a480c8544708 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:21.101303 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1730/3514] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:11:21.106289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7c197-fde2-41cd-929b-41611bbc9cbf admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:21.119114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7c197-fde2-41cd-929b-41611bbc9cbf admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:21.138267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b8aa5-7f4a-477d-9301-cb9b40a7d210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:21.139826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b8aa5-7f4a-477d-9301-cb9b40a7d210 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:21.139826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b8aa5-7f4a-477d-9301-cb9b40a7d210 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:21.140224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b8aa5-7f4a-477d-9301-cb9b40a7d210 admin admin] PATH_INFO: `/v3/projects/bce5da4df3944261b7625edb9d2b384b/users/1ea6fb09d0be4595b7d5ba8902afe681/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:21.172919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b8aa5-7f4a-477d-9301-cb9b40a7d210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce5da4df3944261b7625edb9d2b384b, user_id=1ea6fb09d0be4595b7d5ba8902afe681, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:21.177209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b8aa5-7f4a-477d-9301-cb9b40a7d210 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:21.203520 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1785/3515] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:11:21 2022] PUT /identity/v3/projects/bce5da4df3944261b7625edb9d2b384b/users/1ea6fb09d0be4595b7d5ba8902afe681/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:21.214493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a424bd-e982-4299-b4b8-a53c781b4dc6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:21.215586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a424bd-e982-4299-b4b8-a53c781b4dc6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:21.216237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a424bd-e982-4299-b4b8-a53c781b4dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:21.253270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:21.269717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a7a424bd-e982-4299-b4b8-a53c781b4dc6 None None] MFA Rules not processed for user `1ea6fb09d0be4595b7d5ba8902afe681`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:21.271033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a7a424bd-e982-4299-b4b8-a53c781b4dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:21.421551 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1731/3516] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:21.425146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b8aa5-7f4a-477d-9301-cb9b40a7d210 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:21.528906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b8aa5-7f4a-477d-9301-cb9b40a7d210 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:21.535231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f103be2-81c9-48bf-a6c5-a6acd88d3087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:21.535925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f103be2-81c9-48bf-a6c5-a6acd88d3087 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:21.536888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f103be2-81c9-48bf-a6c5-a6acd88d3087 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:21.537177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f103be2-81c9-48bf-a6c5-a6acd88d3087 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:21.537892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f103be2-81c9-48bf-a6c5-a6acd88d3087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:21.540380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f103be2-81c9-48bf-a6c5-a6acd88d3087 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:21.600532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:21.609383 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1786/3517] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:11:21 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:21.613340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a424bd-e982-4299-b4b8-a53c781b4dc6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:21.641043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a424bd-e982-4299-b4b8-a53c781b4dc6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:21.791909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93c637-9ee6-4b2f-b963-2598dc50748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:21.792685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93c637-9ee6-4b2f-b963-2598dc50748c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:21.792991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93c637-9ee6-4b2f-b963-2598dc50748c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:21.798415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93c637-9ee6-4b2f-b963-2598dc50748c admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:21.801046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93c637-9ee6-4b2f-b963-2598dc50748c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:21.810671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93c637-9ee6-4b2f-b963-2598dc50748c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:21.867661 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1732/3518] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:11:21 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:21.872103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f103be2-81c9-48bf-a6c5-a6acd88d3087 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:21.899390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f103be2-81c9-48bf-a6c5-a6acd88d3087 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:21.930137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e153bd6-dcb4-416a-9fa4-d33c189cfc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:21.931963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e153bd6-dcb4-416a-9fa4-d33c189cfc71 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:21.932315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e153bd6-dcb4-416a-9fa4-d33c189cfc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:21.932642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e153bd6-dcb4-416a-9fa4-d33c189cfc71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:21.933468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e153bd6-dcb4-416a-9fa4-d33c189cfc71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:21.937058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e153bd6-dcb4-416a-9fa4-d33c189cfc71 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:21.968087 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1787/3519] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:11:21.972490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93c637-9ee6-4b2f-b963-2598dc50748c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:21.983588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93c637-9ee6-4b2f-b963-2598dc50748c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:21.997081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8588e-d6da-4c84-976f-2e7fb3fbf155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:21.998034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8588e-d6da-4c84-976f-2e7fb3fbf155 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:21.998337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8588e-d6da-4c84-976f-2e7fb3fbf155 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:21.998618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8588e-d6da-4c84-976f-2e7fb3fbf155 admin admin] PATH_INFO: `/v3/projects/4f9e430120ad491ca2e0d1f2c4f2cbbb/users/c47179a39a96457a90012c2cd84a511f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:22.032826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8588e-d6da-4c84-976f-2e7fb3fbf155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f9e430120ad491ca2e0d1f2c4f2cbbb, user_id=c47179a39a96457a90012c2cd84a511f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:22.038887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8588e-d6da-4c84-976f-2e7fb3fbf155 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:22.063460 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1733/3520] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:11:21 2022] PUT /identity/v3/projects/4f9e430120ad491ca2e0d1f2c4f2cbbb/users/c47179a39a96457a90012c2cd84a511f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:22.067740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e153bd6-dcb4-416a-9fa4-d33c189cfc71 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:22.084317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e153bd6-dcb4-416a-9fa4-d33c189cfc71 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:22.222712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a280e33-b6cd-4602-b96b-c5202610ed9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:22.223487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a280e33-b6cd-4602-b96b-c5202610ed9a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:22.225214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a280e33-b6cd-4602-b96b-c5202610ed9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:22.225478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a280e33-b6cd-4602-b96b-c5202610ed9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:22.226248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a280e33-b6cd-4602-b96b-c5202610ed9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:22.228619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a280e33-b6cd-4602-b96b-c5202610ed9a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:22.251730 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1788/3521] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:11:22.252179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8588e-d6da-4c84-976f-2e7fb3fbf155 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:22.268164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8588e-d6da-4c84-976f-2e7fb3fbf155 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:22.288416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77337f78-b5c1-45ae-838b-7cd57672d025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:22.289764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77337f78-b5c1-45ae-838b-7cd57672d025 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:22.290383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77337f78-b5c1-45ae-838b-7cd57672d025 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:22.290822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77337f78-b5c1-45ae-838b-7cd57672d025 admin admin] PATH_INFO: `/v3/projects/4f9e430120ad491ca2e0d1f2c4f2cbbb/users/c47179a39a96457a90012c2cd84a511f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:22.293719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77337f78-b5c1-45ae-838b-7cd57672d025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f9e430120ad491ca2e0d1f2c4f2cbbb, user_id=c47179a39a96457a90012c2cd84a511f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:22.297704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77337f78-b5c1-45ae-838b-7cd57672d025 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:22.320417 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1734/3522] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:11:22 2022] PUT /identity/v3/projects/4f9e430120ad491ca2e0d1f2c4f2cbbb/users/c47179a39a96457a90012c2cd84a511f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:11:22.413308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525af65-323e-4016-b935-8a195405d478 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:22.413601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525af65-323e-4016-b935-8a195405d478 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:22.413928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525af65-323e-4016-b935-8a195405d478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:22.455046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7525af65-323e-4016-b935-8a195405d478 None None] MFA Rules not processed for user `c47179a39a96457a90012c2cd84a511f`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:22.456633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7525af65-323e-4016-b935-8a195405d478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:22.638660 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1789/3523] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:22.643564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77337f78-b5c1-45ae-838b-7cd57672d025 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:22.659186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77337f78-b5c1-45ae-838b-7cd57672d025 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:22.666258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf129609-8b27-442c-a49a-93eac5ec77fb tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47179a39a96457a90012c2cd84a511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9e430120ad491ca2e0d1f2c4f2cbbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:22.667204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf129609-8b27-442c-a49a-93eac5ec77fb tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:22.667638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf129609-8b27-442c-a49a-93eac5ec77fb tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:22.668257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf129609-8b27-442c-a49a-93eac5ec77fb tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:22.669317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf129609-8b27-442c-a49a-93eac5ec77fb tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:22.671883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf129609-8b27-442c-a49a-93eac5ec77fb tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:22.721703 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1735/3524] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:11:22 2022] POST /identity/v3/projects => generated 350 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:22.725117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525af65-323e-4016-b935-8a195405d478 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:22.736707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525af65-323e-4016-b935-8a195405d478 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:22.827002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e96a66-eb35-4033-810d-0fea73a9f7e0 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47179a39a96457a90012c2cd84a511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9e430120ad491ca2e0d1f2c4f2cbbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:22.828244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e96a66-eb35-4033-810d-0fea73a9f7e0 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:22.828244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e96a66-eb35-4033-810d-0fea73a9f7e0 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:22.829408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e96a66-eb35-4033-810d-0fea73a9f7e0 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:22.829408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e96a66-eb35-4033-810d-0fea73a9f7e0 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:22.831790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e96a66-eb35-4033-810d-0fea73a9f7e0 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:22.833751 ncdv-master-1 devstack@keystone.service[91078]: WARNING keystone.server.flask.common [None req-e0e96a66-eb35-4033-810d-0fea73a9f7e0 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 02 21:11:22.859678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:22.893350 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1790/3525] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:11:22 2022] POST /identity/v3/projects => generated 349 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:22.895322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf129609-8b27-442c-a49a-93eac5ec77fb tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:22.913076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf129609-8b27-442c-a49a-93eac5ec77fb tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:22.954272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:23.005683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206a8e3-e994-4076-b58c-71905db89b3a tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47179a39a96457a90012c2cd84a511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9e430120ad491ca2e0d1f2c4f2cbbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:23.009329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206a8e3-e994-4076-b58c-71905db89b3a tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:23.009915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206a8e3-e994-4076-b58c-71905db89b3a tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:23.010767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206a8e3-e994-4076-b58c-71905db89b3a tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] PATH_INFO: `/v3/users/1ea6fb09d0be4595b7d5ba8902afe681` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:23.013884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206a8e3-e994-4076-b58c-71905db89b3a tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorizing `identity:get_user(user_id=1ea6fb09d0be4595b7d5ba8902afe681)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:23.017797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206a8e3-e994-4076-b58c-71905db89b3a tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:23.027697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e96a66-eb35-4033-810d-0fea73a9f7e0 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:23.039162 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1736/3526] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:11:22 2022] GET /identity/v3/users/1ea6fb09d0be4595b7d5ba8902afe681 => generated 288 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:23.044233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e96a66-eb35-4033-810d-0fea73a9f7e0 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:23.051873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec71ba-3f0d-483c-b51a-90e7d15373d1 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47179a39a96457a90012c2cd84a511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9e430120ad491ca2e0d1f2c4f2cbbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:23.052736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec71ba-3f0d-483c-b51a-90e7d15373d1 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:23.053476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec71ba-3f0d-483c-b51a-90e7d15373d1 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:23.053888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec71ba-3f0d-483c-b51a-90e7d15373d1 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:23.054833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec71ba-3f0d-483c-b51a-90e7d15373d1 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:23.057202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec71ba-3f0d-483c-b51a-90e7d15373d1 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:23.119180 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1791/3527] 10.222.0.43 () {60 vars in 1161 bytes} [Sat Jul 2 21:11:23 2022] POST /identity/v3/credentials => generated 431 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:23.123564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206a8e3-e994-4076-b58c-71905db89b3a tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:23.148529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206a8e3-e994-4076-b58c-71905db89b3a tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:23.166408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c6459-f807-48ba-86cc-8622af4cb094 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47179a39a96457a90012c2cd84a511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9e430120ad491ca2e0d1f2c4f2cbbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:23.171050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6459-f807-48ba-86cc-8622af4cb094 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:23.171344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6459-f807-48ba-86cc-8622af4cb094 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:23.171633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6459-f807-48ba-86cc-8622af4cb094 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] PATH_INFO: `/v3/credentials/d46b0b142c8e034c0e75fcd7276fd01216364ebcdfa4788e9978fafe5b98e211` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:23.182277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c6459-f807-48ba-86cc-8622af4cb094 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=d46b0b142c8e034c0e75fcd7276fd01216364ebcdfa4788e9978fafe5b98e211)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:23.192007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c6459-f807-48ba-86cc-8622af4cb094 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:23.194147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c6459-f807-48ba-86cc-8622af4cb094 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=d46b0b142c8e034c0e75fcd7276fd01216364ebcdfa4788e9978fafe5b98e211)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:23.204466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c6459-f807-48ba-86cc-8622af4cb094 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:23.222008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec71ba-3f0d-483c-b51a-90e7d15373d1 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:23.223991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-04ec71ba-3f0d-483c-b51a-90e7d15373d1 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:23.262176 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1737/3528] 10.222.0.43 () {60 vars in 1357 bytes} [Sat Jul 2 21:11:23 2022] PATCH /identity/v3/credentials/d46b0b142c8e034c0e75fcd7276fd01216364ebcdfa4788e9978fafe5b98e211 => generated 436 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:23.263510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c6459-f807-48ba-86cc-8622af4cb094 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:23.294497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c6459-f807-48ba-86cc-8622af4cb094 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:23.316216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c68eb-3501-4f7b-9901-c5c80738655b tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47179a39a96457a90012c2cd84a511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9e430120ad491ca2e0d1f2c4f2cbbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:23.317849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c68eb-3501-4f7b-9901-c5c80738655b tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:23.318137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c68eb-3501-4f7b-9901-c5c80738655b tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:23.319616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c68eb-3501-4f7b-9901-c5c80738655b tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] PATH_INFO: `/v3/credentials/d46b0b142c8e034c0e75fcd7276fd01216364ebcdfa4788e9978fafe5b98e211` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:23.322069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c68eb-3501-4f7b-9901-c5c80738655b tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=d46b0b142c8e034c0e75fcd7276fd01216364ebcdfa4788e9978fafe5b98e211)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:23.326236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c68eb-3501-4f7b-9901-c5c80738655b tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:23.333550 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1738/3529] 10.222.0.43 () {58 vars in 1334 bytes} [Sat Jul 2 21:11:23 2022] GET /identity/v3/credentials/d46b0b142c8e034c0e75fcd7276fd01216364ebcdfa4788e9978fafe5b98e211 => generated 436 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:23.335454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c68eb-3501-4f7b-9901-c5c80738655b tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:23.370595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c68eb-3501-4f7b-9901-c5c80738655b tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:23.386550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65e239-1fb8-4614-879e-7ac4f4772c70 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47179a39a96457a90012c2cd84a511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9e430120ad491ca2e0d1f2c4f2cbbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:23.390214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65e239-1fb8-4614-879e-7ac4f4772c70 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:23.390656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65e239-1fb8-4614-879e-7ac4f4772c70 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:23.391894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65e239-1fb8-4614-879e-7ac4f4772c70 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] PATH_INFO: `/v3/credentials/d46b0b142c8e034c0e75fcd7276fd01216364ebcdfa4788e9978fafe5b98e211` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:23.400874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65e239-1fb8-4614-879e-7ac4f4772c70 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=d46b0b142c8e034c0e75fcd7276fd01216364ebcdfa4788e9978fafe5b98e211)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:23.404601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65e239-1fb8-4614-879e-7ac4f4772c70 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:23.440622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec71ba-3f0d-483c-b51a-90e7d15373d1 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:23.467536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e25b2-11a8-458c-9249-4bc3dadf038c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:23.468471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e25b2-11a8-458c-9249-4bc3dadf038c service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:23.469032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e25b2-11a8-458c-9249-4bc3dadf038c service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:23.471013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e25b2-11a8-458c-9249-4bc3dadf038c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:23.475838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-922e25b2-11a8-458c-9249-4bc3dadf038c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:23.483058 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1739/3530] 10.222.0.43 () {58 vars in 1337 bytes} [Sat Jul 2 21:11:23 2022] DELETE /identity/v3/credentials/d46b0b142c8e034c0e75fcd7276fd01216364ebcdfa4788e9978fafe5b98e211 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:23.490591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65e239-1fb8-4614-879e-7ac4f4772c70 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:23.519736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65e239-1fb8-4614-879e-7ac4f4772c70 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:23.529288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3254544-5a64-4a93-a0b3-0c1dae29ef5b tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47179a39a96457a90012c2cd84a511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9e430120ad491ca2e0d1f2c4f2cbbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:23.536227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3254544-5a64-4a93-a0b3-0c1dae29ef5b tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:23.536779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3254544-5a64-4a93-a0b3-0c1dae29ef5b tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:23.537155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3254544-5a64-4a93-a0b3-0c1dae29ef5b tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:23.539740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3254544-5a64-4a93-a0b3-0c1dae29ef5b tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:23.541987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e25b2-11a8-458c-9249-4bc3dadf038c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:23.543540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3254544-5a64-4a93-a0b3-0c1dae29ef5b tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:23.548262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e25b2-11a8-458c-9249-4bc3dadf038c service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:23.590854 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1740/3531] 10.222.0.43 () {60 vars in 1161 bytes} [Sat Jul 2 21:11:23 2022] POST /identity/v3/credentials => generated 429 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:23.594694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3254544-5a64-4a93-a0b3-0c1dae29ef5b tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:23.598065 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1792/3532] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:11:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:11:23.633354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3254544-5a64-4a93-a0b3-0c1dae29ef5b tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:23.656014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd66a7-e32d-48a0-91ce-ab81cdcada51 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47179a39a96457a90012c2cd84a511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9e430120ad491ca2e0d1f2c4f2cbbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:23.657837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd66a7-e32d-48a0-91ce-ab81cdcada51 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:23.658555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd66a7-e32d-48a0-91ce-ab81cdcada51 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:23.658555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd66a7-e32d-48a0-91ce-ab81cdcada51 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:23.659422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd66a7-e32d-48a0-91ce-ab81cdcada51 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:23.662162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd66a7-e32d-48a0-91ce-ab81cdcada51 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:23.700141 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1741/3533] 10.222.0.43 () {60 vars in 1161 bytes} [Sat Jul 2 21:11:23 2022] POST /identity/v3/credentials => generated 430 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:23.704318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e25b2-11a8-458c-9249-4bc3dadf038c service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:23.753647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e25b2-11a8-458c-9249-4bc3dadf038c service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:23.764117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78633e77-6218-4b6a-9405-e7ccc5756943 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47179a39a96457a90012c2cd84a511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9e430120ad491ca2e0d1f2c4f2cbbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:23.765857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78633e77-6218-4b6a-9405-e7ccc5756943 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:23.766438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78633e77-6218-4b6a-9405-e7ccc5756943 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:23.766875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78633e77-6218-4b6a-9405-e7ccc5756943 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:23.767765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78633e77-6218-4b6a-9405-e7ccc5756943 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:23.769886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78633e77-6218-4b6a-9405-e7ccc5756943 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:23.817272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78633e77-6218-4b6a-9405-e7ccc5756943 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:23.820008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78633e77-6218-4b6a-9405-e7ccc5756943 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:23.824584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78633e77-6218-4b6a-9405-e7ccc5756943 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:23.828131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78633e77-6218-4b6a-9405-e7ccc5756943 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:23.831012 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1793/3534] 10.222.0.43 () {58 vars in 1139 bytes} [Sat Jul 2 21:11:23 2022] GET /identity/v3/credentials => generated 944 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:23.835365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd66a7-e32d-48a0-91ce-ab81cdcada51 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:23.852508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd66a7-e32d-48a0-91ce-ab81cdcada51 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:23.862755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e1a1d-bf04-4ca3-b528-2cb299afc4fb tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47179a39a96457a90012c2cd84a511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9e430120ad491ca2e0d1f2c4f2cbbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:23.863761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e1a1d-bf04-4ca3-b528-2cb299afc4fb tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:23.864135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e1a1d-bf04-4ca3-b528-2cb299afc4fb tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:23.864350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e1a1d-bf04-4ca3-b528-2cb299afc4fb tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] PATH_INFO: `/v3/credentials/b63ce4279a6241d0992314f4f52e35cda079cb8e6a1efb8bdd588152ad0178cb` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:23.870358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e1a1d-bf04-4ca3-b528-2cb299afc4fb tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=b63ce4279a6241d0992314f4f52e35cda079cb8e6a1efb8bdd588152ad0178cb)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:23.872271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e1a1d-bf04-4ca3-b528-2cb299afc4fb tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:23.913761 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1742/3535] 10.222.0.43 () {58 vars in 1337 bytes} [Sat Jul 2 21:11:23 2022] DELETE /identity/v3/credentials/b63ce4279a6241d0992314f4f52e35cda079cb8e6a1efb8bdd588152ad0178cb => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:23.918479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78633e77-6218-4b6a-9405-e7ccc5756943 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:23.933737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78633e77-6218-4b6a-9405-e7ccc5756943 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:23.947214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c529989-f04c-4ec9-95ab-77537c9bbd47 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47179a39a96457a90012c2cd84a511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9e430120ad491ca2e0d1f2c4f2cbbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:23.949442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c529989-f04c-4ec9-95ab-77537c9bbd47 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:23.952231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c529989-f04c-4ec9-95ab-77537c9bbd47 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:23.953996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c529989-f04c-4ec9-95ab-77537c9bbd47 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] PATH_INFO: `/v3/credentials/f96f90852303f9ed69a9582be2a7336f7d4247b4724f804ced91a75a6b20a576` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:23.958347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c529989-f04c-4ec9-95ab-77537c9bbd47 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=f96f90852303f9ed69a9582be2a7336f7d4247b4724f804ced91a75a6b20a576)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:23.967862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c529989-f04c-4ec9-95ab-77537c9bbd47 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:24.005730 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1794/3536] 10.222.0.43 () {58 vars in 1337 bytes} [Sat Jul 2 21:11:23 2022] DELETE /identity/v3/credentials/f96f90852303f9ed69a9582be2a7336f7d4247b4724f804ced91a75a6b20a576 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:24.012742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e1a1d-bf04-4ca3-b528-2cb299afc4fb tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:24.023821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e1a1d-bf04-4ca3-b528-2cb299afc4fb tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:24.029324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258e9df-4d97-417a-87b8-5cdadd14f5c2 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47179a39a96457a90012c2cd84a511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9e430120ad491ca2e0d1f2c4f2cbbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:24.030344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258e9df-4d97-417a-87b8-5cdadd14f5c2 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:24.031304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258e9df-4d97-417a-87b8-5cdadd14f5c2 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:24.031304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258e9df-4d97-417a-87b8-5cdadd14f5c2 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] PATH_INFO: `/v3/projects/356384e79a984a01ae75abc4baa46894` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:24.032288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258e9df-4d97-417a-87b8-5cdadd14f5c2 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorizing `identity:delete_project(project_id=356384e79a984a01ae75abc4baa46894)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:24.040304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258e9df-4d97-417a-87b8-5cdadd14f5c2 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:24.110135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1258e9df-4d97-417a-87b8-5cdadd14f5c2 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '356384e79a984a01ae75abc4baa46894', 'request_id': 'req-1258e9df-4d97-417a-87b8-5cdadd14f5c2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:24.120239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1258e9df-4d97-417a-87b8-5cdadd14f5c2 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '356384e79a984a01ae75abc4baa46894', 'request_id': 'req-1258e9df-4d97-417a-87b8-5cdadd14f5c2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:24.129285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1258e9df-4d97-417a-87b8-5cdadd14f5c2 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '356384e79a984a01ae75abc4baa46894', 'request_id': 'req-1258e9df-4d97-417a-87b8-5cdadd14f5c2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:24.148449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1258e9df-4d97-417a-87b8-5cdadd14f5c2 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] The token cache is being invalidate because project 356384e79a984a01ae75abc4baa46894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:24.148870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1258e9df-4d97-417a-87b8-5cdadd14f5c2 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:24.149794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1258e9df-4d97-417a-87b8-5cdadd14f5c2 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:24.151774 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1743/3537] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:24 2022] DELETE /identity/v3/projects/356384e79a984a01ae75abc4baa46894 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:24.155990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c529989-f04c-4ec9-95ab-77537c9bbd47 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:24.157998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4c529989-f04c-4ec9-95ab-77537c9bbd47 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:24.173593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c529989-f04c-4ec9-95ab-77537c9bbd47 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:24.283689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9610465-7f5d-4a22-acac-7e211c391323 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c47179a39a96457a90012c2cd84a511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f9e430120ad491ca2e0d1f2c4f2cbbb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:24.284885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9610465-7f5d-4a22-acac-7e211c391323 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:24.285282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9610465-7f5d-4a22-acac-7e211c391323 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:24.285658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9610465-7f5d-4a22-acac-7e211c391323 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] PATH_INFO: `/v3/projects/c2a1629a6fb547f4ab8e25a8ce3d045b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:24.289873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9610465-7f5d-4a22-acac-7e211c391323 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c2a1629a6fb547f4ab8e25a8ce3d045b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:24.295962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9610465-7f5d-4a22-acac-7e211c391323 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:24.397706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:24.401549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e9610465-7f5d-4a22-acac-7e211c391323 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2a1629a6fb547f4ab8e25a8ce3d045b', 'request_id': 'req-e9610465-7f5d-4a22-acac-7e211c391323'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:24.422435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e9610465-7f5d-4a22-acac-7e211c391323 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2a1629a6fb547f4ab8e25a8ce3d045b', 'request_id': 'req-e9610465-7f5d-4a22-acac-7e211c391323'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:24.437328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e9610465-7f5d-4a22-acac-7e211c391323 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2a1629a6fb547f4ab8e25a8ce3d045b', 'request_id': 'req-e9610465-7f5d-4a22-acac-7e211c391323'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:24.461129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e9610465-7f5d-4a22-acac-7e211c391323 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] The token cache is being invalidate because project c2a1629a6fb547f4ab8e25a8ce3d045b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:24.461654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e9610465-7f5d-4a22-acac-7e211c391323 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:24.467230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e9610465-7f5d-4a22-acac-7e211c391323 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:24.470905 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1795/3538] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:24 2022] DELETE /identity/v3/projects/c2a1629a6fb547f4ab8e25a8ce3d045b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:24.475119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258e9df-4d97-417a-87b8-5cdadd14f5c2 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:24.478863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1258e9df-4d97-417a-87b8-5cdadd14f5c2 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:24.567390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:24.598392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258e9df-4d97-417a-87b8-5cdadd14f5c2 tempest-CredentialsTestJSON-1537265427 tempest-CredentialsTestJSON-1537265427-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:24.751623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0eac8-e1ed-4082-88d6-c9df5ee82c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:24.754334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0eac8-e1ed-4082-88d6-c9df5ee82c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:24.754617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0eac8-e1ed-4082-88d6-c9df5ee82c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:24.754894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0eac8-e1ed-4082-88d6-c9df5ee82c06 admin admin] PATH_INFO: `/v3/users/1ea6fb09d0be4595b7d5ba8902afe681` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:24.757770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0eac8-e1ed-4082-88d6-c9df5ee82c06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea6fb09d0be4595b7d5ba8902afe681)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:24.763835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0eac8-e1ed-4082-88d6-c9df5ee82c06 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:24.877291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f2a0eac8-e1ed-4082-88d6-c9df5ee82c06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea6fb09d0be4595b7d5ba8902afe681'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:24.900707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f2a0eac8-e1ed-4082-88d6-c9df5ee82c06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea6fb09d0be4595b7d5ba8902afe681'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:24.909668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f2a0eac8-e1ed-4082-88d6-c9df5ee82c06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea6fb09d0be4595b7d5ba8902afe681'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:24.910969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f2a0eac8-e1ed-4082-88d6-c9df5ee82c06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea6fb09d0be4595b7d5ba8902afe681'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:24.911948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f2a0eac8-e1ed-4082-88d6-c9df5ee82c06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea6fb09d0be4595b7d5ba8902afe681'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:24.941847 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1744/3539] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:11:24 2022] DELETE /identity/v3/users/1ea6fb09d0be4595b7d5ba8902afe681 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:24.944550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a7a1e-83be-4981-b4ac-0b506c67ec7f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:24.944550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a7a1e-83be-4981-b4ac-0b506c67ec7f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:24.944550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a7a1e-83be-4981-b4ac-0b506c67ec7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:24.968070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-177a7a1e-83be-4981-b4ac-0b506c67ec7f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:24.969661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-177a7a1e-83be-4981-b4ac-0b506c67ec7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:25.117519 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1796/3540] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:25.174404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0eac8-e1ed-4082-88d6-c9df5ee82c06 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:25.177508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f2a0eac8-e1ed-4082-88d6-c9df5ee82c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:25.299494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0eac8-e1ed-4082-88d6-c9df5ee82c06 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:25.310502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefe585-9477-4bfa-89cf-247c9cde1ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:25.311265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefe585-9477-4bfa-89cf-247c9cde1ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:25.311544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefe585-9477-4bfa-89cf-247c9cde1ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:25.311800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefe585-9477-4bfa-89cf-247c9cde1ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:25.334292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefe585-9477-4bfa-89cf-247c9cde1ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:25.335978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefe585-9477-4bfa-89cf-247c9cde1ca8 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:25.347349 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1745/3541] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:11:26.098587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a7a1e-83be-4981-b4ac-0b506c67ec7f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:26.101274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-177a7a1e-83be-4981-b4ac-0b506c67ec7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:26.129202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a7a1e-83be-4981-b4ac-0b506c67ec7f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:26.141972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a37412-c95b-4ed6-814e-320be8ab2060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:26.150104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a37412-c95b-4ed6-814e-320be8ab2060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:26.150423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a37412-c95b-4ed6-814e-320be8ab2060 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:26.150713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a37412-c95b-4ed6-814e-320be8ab2060 admin admin] PATH_INFO: `/v3/projects/bce5da4df3944261b7625edb9d2b384b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:26.152866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a37412-c95b-4ed6-814e-320be8ab2060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce5da4df3944261b7625edb9d2b384b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:26.155933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a37412-c95b-4ed6-814e-320be8ab2060 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:26.232069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f5a37412-c95b-4ed6-814e-320be8ab2060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce5da4df3944261b7625edb9d2b384b', 'request_id': 'req-f5a37412-c95b-4ed6-814e-320be8ab2060'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:26.242172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f5a37412-c95b-4ed6-814e-320be8ab2060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce5da4df3944261b7625edb9d2b384b', 'request_id': 'req-f5a37412-c95b-4ed6-814e-320be8ab2060'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:26.249725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f5a37412-c95b-4ed6-814e-320be8ab2060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce5da4df3944261b7625edb9d2b384b', 'request_id': 'req-f5a37412-c95b-4ed6-814e-320be8ab2060'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:26.263977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f5a37412-c95b-4ed6-814e-320be8ab2060 admin admin] The token cache is being invalidate because project bce5da4df3944261b7625edb9d2b384b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:26.264337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f5a37412-c95b-4ed6-814e-320be8ab2060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:26.265288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f5a37412-c95b-4ed6-814e-320be8ab2060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:26.267273 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1797/3542] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:26 2022] DELETE /identity/v3/projects/bce5da4df3944261b7625edb9d2b384b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:26.271264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefe585-9477-4bfa-89cf-247c9cde1ca8 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:26.304677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefe585-9477-4bfa-89cf-247c9cde1ca8 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:26.323628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:26.436926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c23c6-f0da-4107-9e9b-f31a5a999348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:26.437911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c23c6-f0da-4107-9e9b-f31a5a999348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:26.438253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c23c6-f0da-4107-9e9b-f31a5a999348 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:26.438641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c23c6-f0da-4107-9e9b-f31a5a999348 admin admin] PATH_INFO: `/v3/users/c47179a39a96457a90012c2cd84a511f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:26.439914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c23c6-f0da-4107-9e9b-f31a5a999348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47179a39a96457a90012c2cd84a511f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:26.442544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c23c6-f0da-4107-9e9b-f31a5a999348 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:26.532148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-747c23c6-f0da-4107-9e9b-f31a5a999348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47179a39a96457a90012c2cd84a511f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:26.545998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-747c23c6-f0da-4107-9e9b-f31a5a999348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47179a39a96457a90012c2cd84a511f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:26.555640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-747c23c6-f0da-4107-9e9b-f31a5a999348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47179a39a96457a90012c2cd84a511f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:26.556480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-747c23c6-f0da-4107-9e9b-f31a5a999348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47179a39a96457a90012c2cd84a511f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:26.557616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-747c23c6-f0da-4107-9e9b-f31a5a999348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47179a39a96457a90012c2cd84a511f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:26.588620 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1746/3543] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:11:26 2022] DELETE /identity/v3/users/c47179a39a96457a90012c2cd84a511f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:27.349294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a37412-c95b-4ed6-814e-320be8ab2060 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:27.351858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f5a37412-c95b-4ed6-814e-320be8ab2060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:27.366184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a37412-c95b-4ed6-814e-320be8ab2060 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:27.435522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:27.443878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292ab5a-79e8-45e6-819a-134ad850ba2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:27.444858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292ab5a-79e8-45e6-819a-134ad850ba2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:27.445302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292ab5a-79e8-45e6-819a-134ad850ba2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:27.445618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292ab5a-79e8-45e6-819a-134ad850ba2a admin admin] PATH_INFO: `/v3/projects/4f9e430120ad491ca2e0d1f2c4f2cbbb` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:27.447028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292ab5a-79e8-45e6-819a-134ad850ba2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f9e430120ad491ca2e0d1f2c4f2cbbb)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:27.449041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292ab5a-79e8-45e6-819a-134ad850ba2a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:27.499031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d292ab5a-79e8-45e6-819a-134ad850ba2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f9e430120ad491ca2e0d1f2c4f2cbbb', 'request_id': 'req-d292ab5a-79e8-45e6-819a-134ad850ba2a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:27.508847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d292ab5a-79e8-45e6-819a-134ad850ba2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f9e430120ad491ca2e0d1f2c4f2cbbb', 'request_id': 'req-d292ab5a-79e8-45e6-819a-134ad850ba2a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:27.515499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d292ab5a-79e8-45e6-819a-134ad850ba2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f9e430120ad491ca2e0d1f2c4f2cbbb', 'request_id': 'req-d292ab5a-79e8-45e6-819a-134ad850ba2a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:27.526078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d292ab5a-79e8-45e6-819a-134ad850ba2a admin admin] The token cache is being invalidate because project 4f9e430120ad491ca2e0d1f2c4f2cbbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:27.526363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d292ab5a-79e8-45e6-819a-134ad850ba2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:27.527030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d292ab5a-79e8-45e6-819a-134ad850ba2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:27.528644 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1798/3544] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:27 2022] DELETE /identity/v3/projects/4f9e430120ad491ca2e0d1f2c4f2cbbb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:27.533647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d175b7-8412-445c-8dc2-becd9c5e7814 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:27.534134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d175b7-8412-445c-8dc2-becd9c5e7814 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:27.534231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d175b7-8412-445c-8dc2-becd9c5e7814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:27.552476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-96d175b7-8412-445c-8dc2-becd9c5e7814 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:27.554121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-96d175b7-8412-445c-8dc2-becd9c5e7814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:27.625769 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1747/3545] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:27.633617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c194cc-02d2-4ce5-8b4b-076b83f3ce0a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:27.633906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c194cc-02d2-4ce5-8b4b-076b83f3ce0a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:27.634184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c194cc-02d2-4ce5-8b4b-076b83f3ce0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:27.654111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-07c194cc-02d2-4ce5-8b4b-076b83f3ce0a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:27.655319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-07c194cc-02d2-4ce5-8b4b-076b83f3ce0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:27.664734 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1799/3546] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:27.669623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d175b7-8412-445c-8dc2-becd9c5e7814 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:27.681229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d175b7-8412-445c-8dc2-becd9c5e7814 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:27.685932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb10ea-ba57-4b23-8375-8d722758ec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:27.686626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb10ea-ba57-4b23-8375-8d722758ec45 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:27.686925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb10ea-ba57-4b23-8375-8d722758ec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:27.687196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb10ea-ba57-4b23-8375-8d722758ec45 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:27.687900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb10ea-ba57-4b23-8375-8d722758ec45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:11:27.688232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb10ea-ba57-4b23-8375-8d722758ec45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:27.690474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb10ea-ba57-4b23-8375-8d722758ec45 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:27.705262 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1748/3547] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:27.710341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c194cc-02d2-4ce5-8b4b-076b83f3ce0a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:27.720487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c194cc-02d2-4ce5-8b4b-076b83f3ce0a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:27.726660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b51ea-3678-434a-97a2-713d17e5f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:27.727507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b51ea-3678-434a-97a2-713d17e5f65f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:27.727800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b51ea-3678-434a-97a2-713d17e5f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:27.728198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b51ea-3678-434a-97a2-713d17e5f65f admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:27.728984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b51ea-3678-434a-97a2-713d17e5f65f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:27.730959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b51ea-3678-434a-97a2-713d17e5f65f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:27.772261 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1800/3548] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:11:27 2022] POST /identity/v3/projects => generated 389 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:27.773424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb10ea-ba57-4b23-8375-8d722758ec45 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:27.802017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb10ea-ba57-4b23-8375-8d722758ec45 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:27.831479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:27.894937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f938d-8026-4a83-82ec-017ea2bc7eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:27.895727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f938d-8026-4a83-82ec-017ea2bc7eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:27.896149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f938d-8026-4a83-82ec-017ea2bc7eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:27.896677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f938d-8026-4a83-82ec-017ea2bc7eb8 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:27.897519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f938d-8026-4a83-82ec-017ea2bc7eb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:27.899803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f938d-8026-4a83-82ec-017ea2bc7eb8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:27.944030 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1749/3549] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:11:27 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:27.946145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b51ea-3678-434a-97a2-713d17e5f65f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:27.957420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b51ea-3678-434a-97a2-713d17e5f65f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:27.974829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b930ac-4604-44b9-a441-55de5fdf0861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:27.975763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b930ac-4604-44b9-a441-55de5fdf0861 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:27.976252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b930ac-4604-44b9-a441-55de5fdf0861 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:27.976598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b930ac-4604-44b9-a441-55de5fdf0861 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:27.977492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b930ac-4604-44b9-a441-55de5fdf0861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:27.979735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b930ac-4604-44b9-a441-55de5fdf0861 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:28.009739 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1801/3550] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:11:28.014084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f938d-8026-4a83-82ec-017ea2bc7eb8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:28.034913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f938d-8026-4a83-82ec-017ea2bc7eb8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:28.042041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edb2e2-0ce6-4a0f-87e0-a6d2033c744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:28.043408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edb2e2-0ce6-4a0f-87e0-a6d2033c744b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:28.043768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edb2e2-0ce6-4a0f-87e0-a6d2033c744b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:28.044160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edb2e2-0ce6-4a0f-87e0-a6d2033c744b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:28.045367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edb2e2-0ce6-4a0f-87e0-a6d2033c744b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:28.047802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edb2e2-0ce6-4a0f-87e0-a6d2033c744b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:28.064188 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1750/3551] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:11:28.068160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b930ac-4604-44b9-a441-55de5fdf0861 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:28.081058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b930ac-4604-44b9-a441-55de5fdf0861 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:28.089476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c985fe4-f561-4ad9-9804-f3c31faaa5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:28.090480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c985fe4-f561-4ad9-9804-f3c31faaa5b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:28.090828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c985fe4-f561-4ad9-9804-f3c31faaa5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:28.091309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c985fe4-f561-4ad9-9804-f3c31faaa5b1 admin admin] PATH_INFO: `/v3/projects/0cceb265a28b4a25b06c5e0d8fb9a3f9/users/e87b6604cdbe40c1ad9c11bc719052da/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:28.114105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c985fe4-f561-4ad9-9804-f3c31faaa5b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cceb265a28b4a25b06c5e0d8fb9a3f9, user_id=e87b6604cdbe40c1ad9c11bc719052da, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:28.119529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c985fe4-f561-4ad9-9804-f3c31faaa5b1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:28.146963 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1802/3552] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:11:28 2022] PUT /identity/v3/projects/0cceb265a28b4a25b06c5e0d8fb9a3f9/users/e87b6604cdbe40c1ad9c11bc719052da/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:11:28.158519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d3ad6-5008-4566-9879-869fef121e1f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:28.158814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d3ad6-5008-4566-9879-869fef121e1f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:28.159188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d3ad6-5008-4566-9879-869fef121e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:28.203142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-174d3ad6-5008-4566-9879-869fef121e1f None None] MFA Rules not processed for user `e87b6604cdbe40c1ad9c11bc719052da`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:28.204981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-174d3ad6-5008-4566-9879-869fef121e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:28.284182 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1751/3553] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:28.287439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c985fe4-f561-4ad9-9804-f3c31faaa5b1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:28.368264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c985fe4-f561-4ad9-9804-f3c31faaa5b1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:28.374960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b161998-8258-4daf-ab13-9caf3124cc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:28.375773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b161998-8258-4daf-ab13-9caf3124cc70 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:28.376169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b161998-8258-4daf-ab13-9caf3124cc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:28.376521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b161998-8258-4daf-ab13-9caf3124cc70 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:28.377403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b161998-8258-4daf-ab13-9caf3124cc70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:28.379538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b161998-8258-4daf-ab13-9caf3124cc70 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:28.416875 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1803/3554] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:11:28 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:28.421302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d3ad6-5008-4566-9879-869fef121e1f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:28.435156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d3ad6-5008-4566-9879-869fef121e1f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:28.501474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec3e92-f283-4579-b9b9-12ab77db3510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:28.502157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec3e92-f283-4579-b9b9-12ab77db3510 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:28.502568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec3e92-f283-4579-b9b9-12ab77db3510 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:28.502852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec3e92-f283-4579-b9b9-12ab77db3510 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:28.503547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec3e92-f283-4579-b9b9-12ab77db3510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:28.505558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec3e92-f283-4579-b9b9-12ab77db3510 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:28.537119 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1752/3555] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:11:28 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:28.541328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b161998-8258-4daf-ab13-9caf3124cc70 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:28.551983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b161998-8258-4daf-ab13-9caf3124cc70 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:28.562404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb1516-7118-4468-92a1-b1ca66a4e4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:28.562720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb1516-7118-4468-92a1-b1ca66a4e4cc admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:28.562969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb1516-7118-4468-92a1-b1ca66a4e4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:28.563363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb1516-7118-4468-92a1-b1ca66a4e4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:28.564197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb1516-7118-4468-92a1-b1ca66a4e4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:28.565835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb1516-7118-4468-92a1-b1ca66a4e4cc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:28.568653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:28.594123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec3e92-f283-4579-b9b9-12ab77db3510 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:28.594326 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1804/3556] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:11:28.607248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec3e92-f283-4579-b9b9-12ab77db3510 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:28.612997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c169d-571b-42da-8dfd-c938953c7a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:28.613992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c169d-571b-42da-8dfd-c938953c7a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:28.614425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c169d-571b-42da-8dfd-c938953c7a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:28.614707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c169d-571b-42da-8dfd-c938953c7a67 admin admin] PATH_INFO: `/v3/projects/1d06f6a094f2494dbb3bcb0fb4d3c410/users/e86e0b6455aa490db90d6286737ca43e/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:28.636422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c169d-571b-42da-8dfd-c938953c7a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d06f6a094f2494dbb3bcb0fb4d3c410, user_id=e86e0b6455aa490db90d6286737ca43e, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:28.639165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c169d-571b-42da-8dfd-c938953c7a67 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:28.641467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:28.654562 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1753/3557] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:11:28 2022] PUT /identity/v3/projects/1d06f6a094f2494dbb3bcb0fb4d3c410/users/e86e0b6455aa490db90d6286737ca43e/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:11:28.658845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb1516-7118-4468-92a1-b1ca66a4e4cc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:28.669280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb1516-7118-4468-92a1-b1ca66a4e4cc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:28.728771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045ce5d-0d06-4ff3-9621-03248bc01628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:28.729691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045ce5d-0d06-4ff3-9621-03248bc01628 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:28.729974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045ce5d-0d06-4ff3-9621-03248bc01628 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:28.730252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045ce5d-0d06-4ff3-9621-03248bc01628 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:28.730969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045ce5d-0d06-4ff3-9621-03248bc01628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:28.732747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045ce5d-0d06-4ff3-9621-03248bc01628 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:28.742973 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1805/3558] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:11:28.747468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c169d-571b-42da-8dfd-c938953c7a67 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:28.758440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c169d-571b-42da-8dfd-c938953c7a67 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:28.763393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0968a87-8eaa-4bc8-937b-e26ce6c2d43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:28.764326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0968a87-8eaa-4bc8-937b-e26ce6c2d43b admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:28.764610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0968a87-8eaa-4bc8-937b-e26ce6c2d43b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:28.764885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0968a87-8eaa-4bc8-937b-e26ce6c2d43b admin admin] PATH_INFO: `/v3/projects/1d06f6a094f2494dbb3bcb0fb4d3c410/users/e86e0b6455aa490db90d6286737ca43e/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:28.767320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0968a87-8eaa-4bc8-937b-e26ce6c2d43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d06f6a094f2494dbb3bcb0fb4d3c410, user_id=e86e0b6455aa490db90d6286737ca43e, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:28.769951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0968a87-8eaa-4bc8-937b-e26ce6c2d43b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:28.780756 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1754/3559] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:11:28 2022] PUT /identity/v3/projects/1d06f6a094f2494dbb3bcb0fb4d3c410/users/e86e0b6455aa490db90d6286737ca43e/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:28.792213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc17605-5c48-4e24-8674-d6029ce8fe5f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:28.792504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc17605-5c48-4e24-8674-d6029ce8fe5f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:28.792785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc17605-5c48-4e24-8674-d6029ce8fe5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:28.819877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2dc17605-5c48-4e24-8674-d6029ce8fe5f None None] MFA Rules not processed for user `e86e0b6455aa490db90d6286737ca43e`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:28.821145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2dc17605-5c48-4e24-8674-d6029ce8fe5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:28.890149 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1806/3560] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:28.895553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0968a87-8eaa-4bc8-937b-e26ce6c2d43b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:28.907203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0968a87-8eaa-4bc8-937b-e26ce6c2d43b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:28.912942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393d4e3-9ddc-4588-8c73-48f4eabc3a1a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:28.913612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393d4e3-9ddc-4588-8c73-48f4eabc3a1a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:28.913946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393d4e3-9ddc-4588-8c73-48f4eabc3a1a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:28.914222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393d4e3-9ddc-4588-8c73-48f4eabc3a1a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:28.914934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393d4e3-9ddc-4588-8c73-48f4eabc3a1a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:28.915950 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-6393d4e3-9ddc-4588-8c73-48f4eabc3a1a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:28.915950 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:11:28.915950 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:11:28.916868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393d4e3-9ddc-4588-8c73-48f4eabc3a1a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:28.934040 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1755/3561] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:11:28 2022] POST /identity/v3/domains => generated 275 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:28.938396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc17605-5c48-4e24-8674-d6029ce8fe5f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:28.947850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc17605-5c48-4e24-8674-d6029ce8fe5f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:29.009546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36205424-14f8-4faf-bcde-effb7bca9fa1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:29.010431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36205424-14f8-4faf-bcde-effb7bca9fa1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:29.010714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36205424-14f8-4faf-bcde-effb7bca9fa1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:29.010997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36205424-14f8-4faf-bcde-effb7bca9fa1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/f4d4709c70fb40918938d220d3df9e49/config` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:29.011762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36205424-14f8-4faf-bcde-effb7bca9fa1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=f4d4709c70fb40918938d220d3df9e49)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:29.012843 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-36205424-14f8-4faf-bcde-effb7bca9fa1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:29.012843 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:11:29.012843 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:11:29.013790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36205424-14f8-4faf-bcde-effb7bca9fa1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:29.040352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:29.059850 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1807/3562] 10.222.0.43 () {60 vars in 1268 bytes} [Sat Jul 2 21:11:28 2022] PUT /identity/v3/domains/f4d4709c70fb40918938d220d3df9e49/config => generated 138 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:11:29.061215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393d4e3-9ddc-4588-8c73-48f4eabc3a1a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:29.072157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393d4e3-9ddc-4588-8c73-48f4eabc3a1a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:29.077485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396eda3f-38f1-49b3-9f78-a623f539df74 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:29.078367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eda3f-38f1-49b3-9f78-a623f539df74 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:29.078649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eda3f-38f1-49b3-9f78-a623f539df74 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:29.078926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eda3f-38f1-49b3-9f78-a623f539df74 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/f4d4709c70fb40918938d220d3df9e49/config/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:29.080636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396eda3f-38f1-49b3-9f78-a623f539df74 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f4d4709c70fb40918938d220d3df9e49, group=identity)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:29.081471 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-396eda3f-38f1-49b3-9f78-a623f539df74 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:29.081471 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:11:29.081471 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:11:29.082378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396eda3f-38f1-49b3-9f78-a623f539df74 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:29.090893 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1756/3563] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:11:29 2022] GET /identity/v3/domains/f4d4709c70fb40918938d220d3df9e49/config/identity => generated 45 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:29.095395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36205424-14f8-4faf-bcde-effb7bca9fa1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:29.106903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36205424-14f8-4faf-bcde-effb7bca9fa1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:29.112636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf2e29-f26a-43e4-ac85-a709a7cc9b05 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:29.113542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf2e29-f26a-43e4-ac85-a709a7cc9b05 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:29.113824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf2e29-f26a-43e4-ac85-a709a7cc9b05 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:29.114100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf2e29-f26a-43e4-ac85-a709a7cc9b05 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/f4d4709c70fb40918938d220d3df9e49/config/identity/driver` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:29.115592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf2e29-f26a-43e4-ac85-a709a7cc9b05 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f4d4709c70fb40918938d220d3df9e49, group=identity, option=driver)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:29.116746 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-69bf2e29-f26a-43e4-ac85-a709a7cc9b05 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:29.116746 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:11:29.116746 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:11:29.117655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf2e29-f26a-43e4-ac85-a709a7cc9b05 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:29.127667 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1808/3564] 10.222.0.43 () {58 vars in 1295 bytes} [Sat Jul 2 21:11:29 2022] GET /identity/v3/domains/f4d4709c70fb40918938d220d3df9e49/config/identity/driver => generated 31 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:29.129402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396eda3f-38f1-49b3-9f78-a623f539df74 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:29.140235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396eda3f-38f1-49b3-9f78-a623f539df74 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:29.145158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb5023-2513-4baf-ba7e-cd5ff6a16598 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:29.146017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb5023-2513-4baf-ba7e-cd5ff6a16598 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:29.146422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb5023-2513-4baf-ba7e-cd5ff6a16598 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:29.146690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb5023-2513-4baf-ba7e-cd5ff6a16598 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/f4d4709c70fb40918938d220d3df9e49/config/ldap` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:29.147994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb5023-2513-4baf-ba7e-cd5ff6a16598 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f4d4709c70fb40918938d220d3df9e49, group=ldap)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:29.149629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb5023-2513-4baf-ba7e-cd5ff6a16598 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:29.154448 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1757/3565] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:11:29 2022] GET /identity/v3/domains/f4d4709c70fb40918938d220d3df9e49/config/ldap => generated 106 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:29.159286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf2e29-f26a-43e4-ac85-a709a7cc9b05 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:29.170358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf2e29-f26a-43e4-ac85-a709a7cc9b05 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:29.178878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b0479-1e01-4389-a836-1adf3bb28098 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:29.179864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b0479-1e01-4389-a836-1adf3bb28098 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:29.180074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b0479-1e01-4389-a836-1adf3bb28098 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:29.180359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b0479-1e01-4389-a836-1adf3bb28098 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/f4d4709c70fb40918938d220d3df9e49/config/ldap/url` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:29.181602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b0479-1e01-4389-a836-1adf3bb28098 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f4d4709c70fb40918938d220d3df9e49, group=ldap, option=url)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:29.183390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b0479-1e01-4389-a836-1adf3bb28098 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:29.189247 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1809/3566] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:11:29 2022] GET /identity/v3/domains/f4d4709c70fb40918938d220d3df9e49/config/ldap/url => generated 46 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:29.193470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb5023-2513-4baf-ba7e-cd5ff6a16598 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:29.205668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb5023-2513-4baf-ba7e-cd5ff6a16598 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:29.212240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673a3b0-2fd1-4aee-8ceb-a85f1fb19278 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:29.213192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673a3b0-2fd1-4aee-8ceb-a85f1fb19278 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:29.214038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673a3b0-2fd1-4aee-8ceb-a85f1fb19278 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:29.214354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673a3b0-2fd1-4aee-8ceb-a85f1fb19278 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/f4d4709c70fb40918938d220d3df9e49/config/ldap/user_tree_dn` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:29.215709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673a3b0-2fd1-4aee-8ceb-a85f1fb19278 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f4d4709c70fb40918938d220d3df9e49, group=ldap, option=user_tree_dn)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:29.217605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673a3b0-2fd1-4aee-8ceb-a85f1fb19278 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:29.225489 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1758/3567] 10.222.0.43 () {58 vars in 1301 bytes} [Sat Jul 2 21:11:29 2022] GET /identity/v3/domains/f4d4709c70fb40918938d220d3df9e49/config/ldap/user_tree_dn => generated 63 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:29.233294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b0479-1e01-4389-a836-1adf3bb28098 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:29.248736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b0479-1e01-4389-a836-1adf3bb28098 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:29.257585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca01c13-94f0-48ca-b545-82b7a22b1ca7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:29.258774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca01c13-94f0-48ca-b545-82b7a22b1ca7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:29.259128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca01c13-94f0-48ca-b545-82b7a22b1ca7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:29.259472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca01c13-94f0-48ca-b545-82b7a22b1ca7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/f4d4709c70fb40918938d220d3df9e49/config` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:29.260248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca01c13-94f0-48ca-b545-82b7a22b1ca7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=f4d4709c70fb40918938d220d3df9e49)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:29.261340 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-cca01c13-94f0-48ca-b545-82b7a22b1ca7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:29.261340 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:11:29.261340 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:11:29.262377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca01c13-94f0-48ca-b545-82b7a22b1ca7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:29.273731 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1810/3568] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:11:29 2022] DELETE /identity/v3/domains/f4d4709c70fb40918938d220d3df9e49/config => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:29.278037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673a3b0-2fd1-4aee-8ceb-a85f1fb19278 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:29.289111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673a3b0-2fd1-4aee-8ceb-a85f1fb19278 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:29.293965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def343d1-304c-469f-8a31-5d30bd2312ca tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:29.294863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def343d1-304c-469f-8a31-5d30bd2312ca tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:29.295145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def343d1-304c-469f-8a31-5d30bd2312ca tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:29.295416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def343d1-304c-469f-8a31-5d30bd2312ca tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/f4d4709c70fb40918938d220d3df9e49` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:29.296759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def343d1-304c-469f-8a31-5d30bd2312ca tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f4d4709c70fb40918938d220d3df9e49)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:29.297779 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-def343d1-304c-469f-8a31-5d30bd2312ca tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:29.297779 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:11:29.297779 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:11:29.298729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def343d1-304c-469f-8a31-5d30bd2312ca tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:29.325981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-def343d1-304c-469f-8a31-5d30bd2312ca tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f4d4709c70fb40918938d220d3df9e49'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:29.326463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-def343d1-304c-469f-8a31-5d30bd2312ca tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f4d4709c70fb40918938d220d3df9e49'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:29.358107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-def343d1-304c-469f-8a31-5d30bd2312ca tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f4d4709c70fb40918938d220d3df9e49'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:29.358768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-def343d1-304c-469f-8a31-5d30bd2312ca tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f4d4709c70fb40918938d220d3df9e49'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:29.361390 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1759/3569] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:11:29 2022] PATCH /identity/v3/domains/f4d4709c70fb40918938d220d3df9e49 => generated 276 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:29.365486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca01c13-94f0-48ca-b545-82b7a22b1ca7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:29.367259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cca01c13-94f0-48ca-b545-82b7a22b1ca7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:29.380535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca01c13-94f0-48ca-b545-82b7a22b1ca7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:29.443198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:29.443956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:29.444357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:29.444645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/f4d4709c70fb40918938d220d3df9e49` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:29.456665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f4d4709c70fb40918938d220d3df9e49)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:29.457800 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:29.457800 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:11:29.457800 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:11:29.459427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:29.500817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f4d4709c70fb40918938d220d3df9e49'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:29.520903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f4d4709c70fb40918938d220d3df9e49'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:29.568994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d4709c70fb40918938d220d3df9e49', 'request_id': 'req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:29.578246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d4709c70fb40918938d220d3df9e49', 'request_id': 'req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:29.594138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d4709c70fb40918938d220d3df9e49', 'request_id': 'req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:29.614600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] The token cache is being invalidate because project f4d4709c70fb40918938d220d3df9e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:29.615270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:29.616655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:29.630320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f4d4709c70fb40918938d220d3df9e49', 'request_id': 'req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:29.631239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f4d4709c70fb40918938d220d3df9e49', 'request_id': 'req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:29.631999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f4d4709c70fb40918938d220d3df9e49', 'request_id': 'req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:29.638273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=14,keystone:INSERT=2,keystone:SELECT=84 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:29.651625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def343d1-304c-469f-8a31-5d30bd2312ca tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:29.652330 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1811/3570] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:11:29 2022] DELETE /identity/v3/domains/f4d4709c70fb40918938d220d3df9e49 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:29.663093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def343d1-304c-469f-8a31-5d30bd2312ca tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:29.755713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267ad8c-4a9f-4beb-a798-6acacd6557cb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:29.757306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267ad8c-4a9f-4beb-a798-6acacd6557cb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:29.757850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267ad8c-4a9f-4beb-a798-6acacd6557cb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:29.758391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267ad8c-4a9f-4beb-a798-6acacd6557cb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:29.759614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267ad8c-4a9f-4beb-a798-6acacd6557cb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:29.761855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267ad8c-4a9f-4beb-a798-6acacd6557cb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:29.793052 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1760/3571] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:11:29 2022] POST /identity/v3/domains => generated 277 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:11:29.797196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:29.798913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:29.815880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c8604-b669-4dcb-b1f8-7fd8005c8ee6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:29.892133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bd9a2-40f5-42e0-8673-135f3ceb5ad1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:29.893342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bd9a2-40f5-42e0-8673-135f3ceb5ad1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:29.893911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bd9a2-40f5-42e0-8673-135f3ceb5ad1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:29.894337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bd9a2-40f5-42e0-8673-135f3ceb5ad1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0022035330304cd5ac67ccf326c51d74/config` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:29.895272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581bd9a2-40f5-42e0-8673-135f3ceb5ad1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=0022035330304cd5ac67ccf326c51d74)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:29.897448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581bd9a2-40f5-42e0-8673-135f3ceb5ad1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:29.953922 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1812/3572] 10.222.0.43 () {60 vars in 1268 bytes} [Sat Jul 2 21:11:29 2022] PUT /identity/v3/domains/0022035330304cd5ac67ccf326c51d74/config => generated 138 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:11:29.958332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267ad8c-4a9f-4beb-a798-6acacd6557cb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:29.971210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267ad8c-4a9f-4beb-a798-6acacd6557cb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:29.976697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e43c9e-a817-48f1-9f39-4f350b213cc3 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:29.977698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e43c9e-a817-48f1-9f39-4f350b213cc3 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:29.978084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e43c9e-a817-48f1-9f39-4f350b213cc3 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:29.978488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e43c9e-a817-48f1-9f39-4f350b213cc3 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0022035330304cd5ac67ccf326c51d74/config` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:29.979412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e43c9e-a817-48f1-9f39-4f350b213cc3 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=0022035330304cd5ac67ccf326c51d74)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:29.980582 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-55e43c9e-a817-48f1-9f39-4f350b213cc3 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:29.980582 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:11:29.980582 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:11:29.981928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e43c9e-a817-48f1-9f39-4f350b213cc3 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:30.027389 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1761/3573] 10.222.0.43 () {60 vars in 1270 bytes} [Sat Jul 2 21:11:29 2022] PATCH /identity/v3/domains/0022035330304cd5ac67ccf326c51d74/config => generated 141 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:30.028378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bd9a2-40f5-42e0-8673-135f3ceb5ad1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:30.045234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bd9a2-40f5-42e0-8673-135f3ceb5ad1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:30.052188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8077d26-e0b9-4fa0-9365-5fca8e91b490 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:30.053800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8077d26-e0b9-4fa0-9365-5fca8e91b490 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:30.054051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8077d26-e0b9-4fa0-9365-5fca8e91b490 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:30.054467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8077d26-e0b9-4fa0-9365-5fca8e91b490 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0022035330304cd5ac67ccf326c51d74/config` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:30.056068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8077d26-e0b9-4fa0-9365-5fca8e91b490 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=0022035330304cd5ac67ccf326c51d74)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:30.057861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8077d26-e0b9-4fa0-9365-5fca8e91b490 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:30.063839 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1813/3574] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:11:30 2022] GET /identity/v3/domains/0022035330304cd5ac67ccf326c51d74/config => generated 141 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:30.067990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e43c9e-a817-48f1-9f39-4f350b213cc3 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:30.078983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e43c9e-a817-48f1-9f39-4f350b213cc3 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:30.084078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f4660-fb99-467c-82c9-8319fa23ce70 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:30.086148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f4660-fb99-467c-82c9-8319fa23ce70 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:30.086540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f4660-fb99-467c-82c9-8319fa23ce70 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:30.086915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f4660-fb99-467c-82c9-8319fa23ce70 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0022035330304cd5ac67ccf326c51d74/config` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:30.087949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f4660-fb99-467c-82c9-8319fa23ce70 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=0022035330304cd5ac67ccf326c51d74)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:30.088858 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-fb1f4660-fb99-467c-82c9-8319fa23ce70 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:30.088858 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:11:30.088858 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:11:30.090000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f4660-fb99-467c-82c9-8319fa23ce70 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:30.103896 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1762/3575] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:11:30 2022] DELETE /identity/v3/domains/0022035330304cd5ac67ccf326c51d74/config => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:30.108278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8077d26-e0b9-4fa0-9365-5fca8e91b490 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:30.121152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8077d26-e0b9-4fa0-9365-5fca8e91b490 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:30.126575 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c92bee-1e2d-4edc-9d4e-29ed1c4055af tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:30.127864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c92bee-1e2d-4edc-9d4e-29ed1c4055af tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:30.128268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c92bee-1e2d-4edc-9d4e-29ed1c4055af tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:30.128640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c92bee-1e2d-4edc-9d4e-29ed1c4055af tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0022035330304cd5ac67ccf326c51d74/config` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:30.130182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c92bee-1e2d-4edc-9d4e-29ed1c4055af tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=0022035330304cd5ac67ccf326c51d74)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:30.131839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c92bee-1e2d-4edc-9d4e-29ed1c4055af tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:30.145203 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-e0c92bee-1e2d-4edc-9d4e-29ed1c4055af tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Could not find any options in domain configuration for domain 0022035330304cd5ac67ccf326c51d74.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 0022035330304cd5ac67ccf326c51d74. Jul 02 21:11:30.145203 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:30.145203 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:11:30.145203 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:11:30.145203 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:11:30.145203 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:11:30.145203 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:11:30.145203 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:11:30.145203 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:11:30.145203 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:11:30.145203 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:11:30.145203 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:11:30.145203 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 02 21:11:30.146350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 02 21:11:30.146350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 02 21:11:30.146350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 02 21:11:30.146350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:11:30.146350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:11:30.146350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 02 21:11:30.146350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 02 21:11:30.146350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 0022035330304cd5ac67ccf326c51d74. Jul 02 21:11:30.146350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:30.148368 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1814/3576] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:11:30 2022] GET /identity/v3/domains/0022035330304cd5ac67ccf326c51d74/config => generated 151 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:11:30.152641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f4660-fb99-467c-82c9-8319fa23ce70 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:30.164374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f4660-fb99-467c-82c9-8319fa23ce70 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:30.169730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82e697-7b42-4468-8ba9-f07e2bdddf22 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:30.171214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82e697-7b42-4468-8ba9-f07e2bdddf22 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:30.171214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82e697-7b42-4468-8ba9-f07e2bdddf22 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:30.171444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82e697-7b42-4468-8ba9-f07e2bdddf22 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0022035330304cd5ac67ccf326c51d74/config` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:30.172198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82e697-7b42-4468-8ba9-f07e2bdddf22 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=0022035330304cd5ac67ccf326c51d74)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:30.173927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82e697-7b42-4468-8ba9-f07e2bdddf22 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:30.181036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:INSERT=7,keystone:SELECT=82,keystone:UPDATE=1,keystone:DELETE=10 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:30.188591 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1763/3577] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:11:30 2022] DELETE /identity/v3/domains/0022035330304cd5ac67ccf326c51d74/config => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:11:30.190186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c92bee-1e2d-4edc-9d4e-29ed1c4055af tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:30.207122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c92bee-1e2d-4edc-9d4e-29ed1c4055af tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:30.219031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215482c-4659-4578-8156-423555841f86 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:30.220139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215482c-4659-4578-8156-423555841f86 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:30.220567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215482c-4659-4578-8156-423555841f86 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:30.220855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215482c-4659-4578-8156-423555841f86 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0022035330304cd5ac67ccf326c51d74` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:30.223003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215482c-4659-4578-8156-423555841f86 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0022035330304cd5ac67ccf326c51d74)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:30.224102 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-6215482c-4659-4578-8156-423555841f86 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:30.224102 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:11:30.224102 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:11:30.224976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215482c-4659-4578-8156-423555841f86 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:30.251500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6215482c-4659-4578-8156-423555841f86 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0022035330304cd5ac67ccf326c51d74'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:30.253185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6215482c-4659-4578-8156-423555841f86 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0022035330304cd5ac67ccf326c51d74'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:30.282339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6215482c-4659-4578-8156-423555841f86 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0022035330304cd5ac67ccf326c51d74'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:30.282998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6215482c-4659-4578-8156-423555841f86 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0022035330304cd5ac67ccf326c51d74'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:30.285739 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1815/3578] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:11:30 2022] PATCH /identity/v3/domains/0022035330304cd5ac67ccf326c51d74 => generated 278 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:30.289707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82e697-7b42-4468-8ba9-f07e2bdddf22 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:30.291442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3c82e697-7b42-4468-8ba9-f07e2bdddf22 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:30.306354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82e697-7b42-4468-8ba9-f07e2bdddf22 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:30.368909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:30.369855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:30.370231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:30.370578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0022035330304cd5ac67ccf326c51d74` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:30.382852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0022035330304cd5ac67ccf326c51d74)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:30.383969 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:30.383969 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:11:30.383969 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:11:30.385137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:30.415576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0022035330304cd5ac67ccf326c51d74'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:30.443128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0022035330304cd5ac67ccf326c51d74'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:30.496268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0022035330304cd5ac67ccf326c51d74', 'request_id': 'req-3ffe5920-8c36-4527-876a-06da4159880e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:30.503788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0022035330304cd5ac67ccf326c51d74', 'request_id': 'req-3ffe5920-8c36-4527-876a-06da4159880e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:30.511529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0022035330304cd5ac67ccf326c51d74', 'request_id': 'req-3ffe5920-8c36-4527-876a-06da4159880e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:30.533320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] The token cache is being invalidate because project 0022035330304cd5ac67ccf326c51d74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:30.533896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:30.534794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:30.546679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0022035330304cd5ac67ccf326c51d74', 'request_id': 'req-3ffe5920-8c36-4527-876a-06da4159880e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:30.547857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0022035330304cd5ac67ccf326c51d74', 'request_id': 'req-3ffe5920-8c36-4527-876a-06da4159880e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:30.548503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0022035330304cd5ac67ccf326c51d74', 'request_id': 'req-3ffe5920-8c36-4527-876a-06da4159880e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:30.559791 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1764/3579] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:11:30 2022] DELETE /identity/v3/domains/0022035330304cd5ac67ccf326c51d74 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:30.565366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215482c-4659-4578-8156-423555841f86 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:30.576503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215482c-4659-4578-8156-423555841f86 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:30.652686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb926480-d45d-492c-a3c9-b6b6704c468e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:30.653374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb926480-d45d-492c-a3c9-b6b6704c468e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:30.653664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb926480-d45d-492c-a3c9-b6b6704c468e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:30.653942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb926480-d45d-492c-a3c9-b6b6704c468e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:30.654696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb926480-d45d-492c-a3c9-b6b6704c468e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:30.655736 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-fb926480-d45d-492c-a3c9-b6b6704c468e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:30.655736 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:11:30.655736 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:11:30.657131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb926480-d45d-492c-a3c9-b6b6704c468e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:30.676204 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1816/3580] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:11:30 2022] POST /identity/v3/domains => generated 277 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:30.681852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:30.685265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:30.702444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe5920-8c36-4527-876a-06da4159880e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:30.743852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:30.770157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40bfb2-61e8-481e-a221-59f9acea820f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:30.771016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40bfb2-61e8-481e-a221-59f9acea820f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:30.771304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40bfb2-61e8-481e-a221-59f9acea820f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:30.771583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40bfb2-61e8-481e-a221-59f9acea820f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a/config` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:30.772407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40bfb2-61e8-481e-a221-59f9acea820f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=0f34783da7ab42b49b4c5e56cb5ff55a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:30.773432 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-bd40bfb2-61e8-481e-a221-59f9acea820f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:30.773432 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:11:30.773432 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:11:30.774322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40bfb2-61e8-481e-a221-59f9acea820f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:30.812658 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1765/3581] 10.222.0.43 () {60 vars in 1268 bytes} [Sat Jul 2 21:11:30 2022] PUT /identity/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a/config => generated 138 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:11:30.813998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb926480-d45d-492c-a3c9-b6b6704c468e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:30.825258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb926480-d45d-492c-a3c9-b6b6704c468e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:30.829970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bf637-b399-423a-a1d4-b8cf60c633cf tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:30.830865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bf637-b399-423a-a1d4-b8cf60c633cf tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:30.831155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bf637-b399-423a-a1d4-b8cf60c633cf tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:30.831428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bf637-b399-423a-a1d4-b8cf60c633cf tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a/config/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:30.832463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bf637-b399-423a-a1d4-b8cf60c633cf tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=0f34783da7ab42b49b4c5e56cb5ff55a, group=identity)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:30.833529 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-ce0bf637-b399-423a-a1d4-b8cf60c633cf tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:30.833529 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:11:30.833529 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:11:30.834426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bf637-b399-423a-a1d4-b8cf60c633cf tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:30.836399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:30.868297 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1817/3582] 10.222.0.43 () {60 vars in 1296 bytes} [Sat Jul 2 21:11:30 2022] PATCH /identity/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a/config/identity => generated 177 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:30.872610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40bfb2-61e8-481e-a221-59f9acea820f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:30.883015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40bfb2-61e8-481e-a221-59f9acea820f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:30.888078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732ca10-1bb4-4b51-8f47-d9a29f3cc892 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:30.888984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732ca10-1bb4-4b51-8f47-d9a29f3cc892 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:30.889265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732ca10-1bb4-4b51-8f47-d9a29f3cc892 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:30.889538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732ca10-1bb4-4b51-8f47-d9a29f3cc892 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a/config/identity/driver` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:30.890262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732ca10-1bb4-4b51-8f47-d9a29f3cc892 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=0f34783da7ab42b49b4c5e56cb5ff55a, group=identity, option=driver)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:30.891850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732ca10-1bb4-4b51-8f47-d9a29f3cc892 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:30.916176 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1766/3583] 10.222.0.43 () {60 vars in 1317 bytes} [Sat Jul 2 21:11:30 2022] PATCH /identity/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a/config/identity/driver => generated 177 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:11:30.920270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bf637-b399-423a-a1d4-b8cf60c633cf tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:30.930550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bf637-b399-423a-a1d4-b8cf60c633cf tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:30.935518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e41b6-dd5a-45e9-8959-da20db992a80 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:30.936427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e41b6-dd5a-45e9-8959-da20db992a80 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:30.936708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e41b6-dd5a-45e9-8959-da20db992a80 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:30.936985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e41b6-dd5a-45e9-8959-da20db992a80 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a/config/identity/driver` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:30.937677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e41b6-dd5a-45e9-8959-da20db992a80 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=0f34783da7ab42b49b4c5e56cb5ff55a, group=identity, option=driver)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:30.939300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e41b6-dd5a-45e9-8959-da20db992a80 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:30.957592 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1818/3584] 10.222.0.43 () {58 vars in 1298 bytes} [Sat Jul 2 21:11:30 2022] DELETE /identity/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a/config/identity/driver => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:30.961985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732ca10-1bb4-4b51-8f47-d9a29f3cc892 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:30.972731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732ca10-1bb4-4b51-8f47-d9a29f3cc892 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:30.978377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae223c-bfb4-4033-bf79-15812bceafa0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:30.979596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae223c-bfb4-4033-bf79-15812bceafa0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:30.980019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae223c-bfb4-4033-bf79-15812bceafa0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:30.980461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae223c-bfb4-4033-bf79-15812bceafa0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a/config/identity/driver` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:30.982089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae223c-bfb4-4033-bf79-15812bceafa0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=0f34783da7ab42b49b4c5e56cb5ff55a, group=identity, option=driver)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:30.983690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae223c-bfb4-4033-bf79-15812bceafa0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:30.998037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-64ae223c-bfb4-4033-bf79-15812bceafa0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Could not find option driver in group identity in domain configuration for domain 0f34783da7ab42b49b4c5e56cb5ff55a.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 0f34783da7ab42b49b4c5e56cb5ff55a. Jul 02 21:11:30.998037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:30.998037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:11:30.998037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:11:30.998037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:11:30.998037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:11:30.998037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:11:30.998037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:11:30.998037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:11:30.998037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:11:30.998037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:11:30.998037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:11:30.998037 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 02 21:11:30.998983 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 02 21:11:30.998983 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 02 21:11:30.998983 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 02 21:11:30.998983 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:11:30.998983 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:11:30.998983 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 02 21:11:30.998983 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 02 21:11:30.998983 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 0f34783da7ab42b49b4c5e56cb5ff55a. Jul 02 21:11:30.998983 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:11:30.999620 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1767/3585] 10.222.0.43 () {58 vars in 1295 bytes} [Sat Jul 2 21:11:30 2022] GET /identity/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a/config/identity/driver => generated 171 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:11:31.003918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e41b6-dd5a-45e9-8959-da20db992a80 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:31.020297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e41b6-dd5a-45e9-8959-da20db992a80 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:31.035298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc9831-ce12-46f1-9088-87fa79a5a7e4 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:31.036679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc9831-ce12-46f1-9088-87fa79a5a7e4 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:31.037102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc9831-ce12-46f1-9088-87fa79a5a7e4 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:31.037476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc9831-ce12-46f1-9088-87fa79a5a7e4 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a/config/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:31.038963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc9831-ce12-46f1-9088-87fa79a5a7e4 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=0f34783da7ab42b49b4c5e56cb5ff55a, group=identity)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:31.042371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc9831-ce12-46f1-9088-87fa79a5a7e4 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:31.066080 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1819/3586] 10.222.0.43 () {58 vars in 1277 bytes} [Sat Jul 2 21:11:31 2022] DELETE /identity/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a/config/identity => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:31.070538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae223c-bfb4-4033-bf79-15812bceafa0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:31.081231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae223c-bfb4-4033-bf79-15812bceafa0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:31.086236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ff84e-6cad-42db-bfde-39fa65ee522a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:31.087162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ff84e-6cad-42db-bfde-39fa65ee522a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:31.087446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ff84e-6cad-42db-bfde-39fa65ee522a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:31.087725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ff84e-6cad-42db-bfde-39fa65ee522a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a/config/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:31.089046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ff84e-6cad-42db-bfde-39fa65ee522a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=0f34783da7ab42b49b4c5e56cb5ff55a, group=identity)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:31.090613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ff84e-6cad-42db-bfde-39fa65ee522a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:31.104779 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-995ff84e-6cad-42db-bfde-39fa65ee522a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Could not find group identity in domain configuration for domain 0f34783da7ab42b49b4c5e56cb5ff55a.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 0f34783da7ab42b49b4c5e56cb5ff55a. Jul 02 21:11:31.104779 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:31.104779 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:11:31.104779 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:11:31.104779 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:11:31.104779 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:11:31.104779 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:11:31.104779 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:11:31.104779 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:11:31.104779 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:11:31.104779 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:11:31.104779 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:11:31.104779 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 02 21:11:31.105763 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 02 21:11:31.105763 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 02 21:11:31.105763 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 02 21:11:31.105763 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:11:31.105763 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:11:31.105763 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 02 21:11:31.105763 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 02 21:11:31.105763 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 0f34783da7ab42b49b4c5e56cb5ff55a. Jul 02 21:11:31.105763 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:11:31.106407 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1768/3587] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:11:31 2022] GET /identity/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a/config/identity => generated 154 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:11:31.110382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc9831-ce12-46f1-9088-87fa79a5a7e4 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:31.120598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc9831-ce12-46f1-9088-87fa79a5a7e4 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:31.125208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff875d7-534c-4a4f-a7ee-3edcea729987 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:31.126068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff875d7-534c-4a4f-a7ee-3edcea729987 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:31.126353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff875d7-534c-4a4f-a7ee-3edcea729987 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:31.126633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff875d7-534c-4a4f-a7ee-3edcea729987 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a/config` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:31.127284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff875d7-534c-4a4f-a7ee-3edcea729987 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=0f34783da7ab42b49b4c5e56cb5ff55a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:31.128919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff875d7-534c-4a4f-a7ee-3edcea729987 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:31.138861 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1820/3588] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:11:31 2022] DELETE /identity/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a/config => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:31.143147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ff84e-6cad-42db-bfde-39fa65ee522a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:31.153884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ff84e-6cad-42db-bfde-39fa65ee522a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:31.159803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893d63c-3d3a-404f-bcbb-c5681acfa572 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:31.160709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893d63c-3d3a-404f-bcbb-c5681acfa572 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:31.160985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893d63c-3d3a-404f-bcbb-c5681acfa572 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:31.161259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893d63c-3d3a-404f-bcbb-c5681acfa572 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:31.162727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893d63c-3d3a-404f-bcbb-c5681acfa572 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0f34783da7ab42b49b4c5e56cb5ff55a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:31.164487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893d63c-3d3a-404f-bcbb-c5681acfa572 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:31.188652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0893d63c-3d3a-404f-bcbb-c5681acfa572 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0f34783da7ab42b49b4c5e56cb5ff55a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:31.189524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0893d63c-3d3a-404f-bcbb-c5681acfa572 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0f34783da7ab42b49b4c5e56cb5ff55a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:31.219499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0893d63c-3d3a-404f-bcbb-c5681acfa572 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0f34783da7ab42b49b4c5e56cb5ff55a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:31.220279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0893d63c-3d3a-404f-bcbb-c5681acfa572 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0f34783da7ab42b49b4c5e56cb5ff55a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:31.226311 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1769/3589] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:11:31 2022] PATCH /identity/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a => generated 278 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:31.227649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff875d7-534c-4a4f-a7ee-3edcea729987 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:31.231389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-aff875d7-534c-4a4f-a7ee-3edcea729987 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:31.244926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff875d7-534c-4a4f-a7ee-3edcea729987 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:31.314596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:31.315495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:31.316233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:31.327753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:31.343229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0f34783da7ab42b49b4c5e56cb5ff55a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:31.345218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:31.377996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0f34783da7ab42b49b4c5e56cb5ff55a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:31.388529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0f34783da7ab42b49b4c5e56cb5ff55a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:31.450464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f34783da7ab42b49b4c5e56cb5ff55a', 'request_id': 'req-63417506-0512-4adf-8ccc-d9c9069dfd8d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:31.453330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:31.465975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f34783da7ab42b49b4c5e56cb5ff55a', 'request_id': 'req-63417506-0512-4adf-8ccc-d9c9069dfd8d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:31.486995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f34783da7ab42b49b4c5e56cb5ff55a', 'request_id': 'req-63417506-0512-4adf-8ccc-d9c9069dfd8d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:31.531635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] The token cache is being invalidate because project 0f34783da7ab42b49b4c5e56cb5ff55a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:31.532505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:31.533530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:31.574299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0f34783da7ab42b49b4c5e56cb5ff55a', 'request_id': 'req-63417506-0512-4adf-8ccc-d9c9069dfd8d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:31.575082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0f34783da7ab42b49b4c5e56cb5ff55a', 'request_id': 'req-63417506-0512-4adf-8ccc-d9c9069dfd8d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:31.575714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0f34783da7ab42b49b4c5e56cb5ff55a', 'request_id': 'req-63417506-0512-4adf-8ccc-d9c9069dfd8d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:31.599430 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1821/3590] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:11:31 2022] DELETE /identity/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:31.600915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893d63c-3d3a-404f-bcbb-c5681acfa572 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:31.653084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893d63c-3d3a-404f-bcbb-c5681acfa572 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:31.855011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a650b91-6ab8-4a7c-808d-f3ca5a4c96ee tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:31.856812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a650b91-6ab8-4a7c-808d-f3ca5a4c96ee tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:31.857191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a650b91-6ab8-4a7c-808d-f3ca5a4c96ee tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:31.860720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a650b91-6ab8-4a7c-808d-f3ca5a4c96ee tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:31.860720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a650b91-6ab8-4a7c-808d-f3ca5a4c96ee tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:31.863622 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-1a650b91-6ab8-4a7c-808d-f3ca5a4c96ee tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:31.863622 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:11:31.863622 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:11:31.866732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a650b91-6ab8-4a7c-808d-f3ca5a4c96ee tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:31.880088 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1770/3591] 10.222.0.43 () {58 vars in 1172 bytes} [Sat Jul 2 21:11:31 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:11:31.881274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:31.883288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:31.903126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63417506-0512-4adf-8ccc-d9c9069dfd8d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:31.926008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91929101-89df-4bdd-85da-74150b303462 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:31.926881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91929101-89df-4bdd-85da-74150b303462 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:31.927737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91929101-89df-4bdd-85da-74150b303462 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:31.927737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91929101-89df-4bdd-85da-74150b303462 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:31.927993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91929101-89df-4bdd-85da-74150b303462 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:31.929507 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-91929101-89df-4bdd-85da-74150b303462 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:31.929507 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:11:31.929507 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:11:31.930409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91929101-89df-4bdd-85da-74150b303462 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:31.934581 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1822/3592] 10.222.0.43 () {58 vars in 1199 bytes} [Sat Jul 2 21:11:31 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:31.936134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a650b91-6ab8-4a7c-808d-f3ca5a4c96ee tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:31.946870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a650b91-6ab8-4a7c-808d-f3ca5a4c96ee tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:31.964771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cbfbe-77ec-4fec-8f4b-6d72dded44f2 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:31.965590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cbfbe-77ec-4fec-8f4b-6d72dded44f2 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:31.965875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cbfbe-77ec-4fec-8f4b-6d72dded44f2 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:31.966145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cbfbe-77ec-4fec-8f4b-6d72dded44f2 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:31.966809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cbfbe-77ec-4fec-8f4b-6d72dded44f2 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:31.968472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cbfbe-77ec-4fec-8f4b-6d72dded44f2 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:31.971325 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1771/3593] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:11:31 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:31.975554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91929101-89df-4bdd-85da-74150b303462 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:31.999071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91929101-89df-4bdd-85da-74150b303462 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.006177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933d59a-bdea-4de4-b6b8-fff844099f44 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.008581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933d59a-bdea-4de4-b6b8-fff844099f44 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.009730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933d59a-bdea-4de4-b6b8-fff844099f44 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.010266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933d59a-bdea-4de4-b6b8-fff844099f44 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.011231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933d59a-bdea-4de4-b6b8-fff844099f44 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.016411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933d59a-bdea-4de4-b6b8-fff844099f44 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.021502 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1823/3594] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:31 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:32.025881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cbfbe-77ec-4fec-8f4b-6d72dded44f2 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.036813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cbfbe-77ec-4fec-8f4b-6d72dded44f2 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.045723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac1b37-feeb-4a16-8ffb-e43173e1c618 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.046669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac1b37-feeb-4a16-8ffb-e43173e1c618 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.047025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac1b37-feeb-4a16-8ffb-e43173e1c618 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.047377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac1b37-feeb-4a16-8ffb-e43173e1c618 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.048525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac1b37-feeb-4a16-8ffb-e43173e1c618 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.050609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac1b37-feeb-4a16-8ffb-e43173e1c618 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.056055 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1772/3595] 10.222.0.43 () {58 vars in 1187 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:11:32.058194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933d59a-bdea-4de4-b6b8-fff844099f44 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.072228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933d59a-bdea-4de4-b6b8-fff844099f44 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.085433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adceb0-065b-4093-8e59-8f24793e1e7a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.086225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adceb0-065b-4093-8e59-8f24793e1e7a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.086512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adceb0-065b-4093-8e59-8f24793e1e7a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.086788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adceb0-065b-4093-8e59-8f24793e1e7a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.087442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adceb0-065b-4093-8e59-8f24793e1e7a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.089417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adceb0-065b-4093-8e59-8f24793e1e7a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.094655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac1b37-feeb-4a16-8ffb-e43173e1c618 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.095214 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1824/3596] 10.222.0.43 () {58 vars in 1199 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:32.113861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac1b37-feeb-4a16-8ffb-e43173e1c618 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.126880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b8a04-3ddc-4679-908b-f10913137398 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.129369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b8a04-3ddc-4679-908b-f10913137398 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.130926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b8a04-3ddc-4679-908b-f10913137398 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.131221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b8a04-3ddc-4679-908b-f10913137398 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.131964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b8a04-3ddc-4679-908b-f10913137398 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.135588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b8a04-3ddc-4679-908b-f10913137398 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.142935 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1773/3597] 10.222.0.43 () {58 vars in 1202 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:32.144188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adceb0-065b-4093-8e59-8f24793e1e7a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.154789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adceb0-065b-4093-8e59-8f24793e1e7a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.159858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad1fcb-f45f-4f4b-a48c-ee5908df888a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.160686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad1fcb-f45f-4f4b-a48c-ee5908df888a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.160969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad1fcb-f45f-4f4b-a48c-ee5908df888a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.161249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad1fcb-f45f-4f4b-a48c-ee5908df888a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.161954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad1fcb-f45f-4f4b-a48c-ee5908df888a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.163657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad1fcb-f45f-4f4b-a48c-ee5908df888a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.167941 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1825/3598] 10.222.0.43 () {58 vars in 1208 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 02 21:11:32.169697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b8a04-3ddc-4679-908b-f10913137398 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.187940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b8a04-3ddc-4679-908b-f10913137398 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.197339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf4ea2-9706-4329-a6d1-22855c49150c tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.198150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf4ea2-9706-4329-a6d1-22855c49150c tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.198436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf4ea2-9706-4329-a6d1-22855c49150c tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.198720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf4ea2-9706-4329-a6d1-22855c49150c tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.199971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf4ea2-9706-4329-a6d1-22855c49150c tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.206258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf4ea2-9706-4329-a6d1-22855c49150c tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.210631 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1774/3599] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:32.211938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad1fcb-f45f-4f4b-a48c-ee5908df888a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.225938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad1fcb-f45f-4f4b-a48c-ee5908df888a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.235258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a462719-16cc-4589-81b3-72ac4dba699f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.236831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a462719-16cc-4589-81b3-72ac4dba699f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.237240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a462719-16cc-4589-81b3-72ac4dba699f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.237884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a462719-16cc-4589-81b3-72ac4dba699f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.238657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a462719-16cc-4589-81b3-72ac4dba699f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.240933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a462719-16cc-4589-81b3-72ac4dba699f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.242401 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1826/3600] 10.222.0.43 () {58 vars in 1217 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 02 21:11:32.246594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf4ea2-9706-4329-a6d1-22855c49150c tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.261017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf4ea2-9706-4329-a6d1-22855c49150c tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.268383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcca50-5fd3-4ae6-8b7b-18addb60be25 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.269082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcca50-5fd3-4ae6-8b7b-18addb60be25 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.269545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcca50-5fd3-4ae6-8b7b-18addb60be25 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.270593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcca50-5fd3-4ae6-8b7b-18addb60be25 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.271555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadcca50-5fd3-4ae6-8b7b-18addb60be25 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.273267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadcca50-5fd3-4ae6-8b7b-18addb60be25 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.278839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a462719-16cc-4589-81b3-72ac4dba699f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.293771 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1775/3601] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:32.296809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a462719-16cc-4589-81b3-72ac4dba699f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.303952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee6e68-9111-4cfc-9ea0-d0be01e9722f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.304781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee6e68-9111-4cfc-9ea0-d0be01e9722f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.305064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee6e68-9111-4cfc-9ea0-d0be01e9722f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.305340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee6e68-9111-4cfc-9ea0-d0be01e9722f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.306000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee6e68-9111-4cfc-9ea0-d0be01e9722f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.308305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee6e68-9111-4cfc-9ea0-d0be01e9722f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.310242 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1827/3602] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:32.314224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcca50-5fd3-4ae6-8b7b-18addb60be25 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.330848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:32.343921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcca50-5fd3-4ae6-8b7b-18addb60be25 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.358416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ffdcb-19e0-4fb5-b297-3f2468c0c87a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.361225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ffdcb-19e0-4fb5-b297-3f2468c0c87a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.361985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ffdcb-19e0-4fb5-b297-3f2468c0c87a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.362500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ffdcb-19e0-4fb5-b297-3f2468c0c87a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.363560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ffdcb-19e0-4fb5-b297-3f2468c0c87a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.366498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ffdcb-19e0-4fb5-b297-3f2468c0c87a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.368879 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1776/3603] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 02 21:11:32.373514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee6e68-9111-4cfc-9ea0-d0be01e9722f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.388886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee6e68-9111-4cfc-9ea0-d0be01e9722f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.403264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46e382-056f-45ac-978d-efc16703a7ea tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.404474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46e382-056f-45ac-978d-efc16703a7ea tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.404704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46e382-056f-45ac-978d-efc16703a7ea tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.405081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46e382-056f-45ac-978d-efc16703a7ea tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.405864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46e382-056f-45ac-978d-efc16703a7ea tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.409265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46e382-056f-45ac-978d-efc16703a7ea tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.415430 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1828/3604] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:32.419342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ffdcb-19e0-4fb5-b297-3f2468c0c87a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.458846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ffdcb-19e0-4fb5-b297-3f2468c0c87a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.479356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a30c77-645a-466c-ba86-0282080ee40b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.480193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a30c77-645a-466c-ba86-0282080ee40b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.480480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a30c77-645a-466c-ba86-0282080ee40b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.480757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a30c77-645a-466c-ba86-0282080ee40b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.481438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a30c77-645a-466c-ba86-0282080ee40b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.483047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a30c77-645a-466c-ba86-0282080ee40b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.486932 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1777/3605] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:32.488697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46e382-056f-45ac-978d-efc16703a7ea tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.539777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46e382-056f-45ac-978d-efc16703a7ea tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.566030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b79921-c3f6-4436-9e81-93c39c1eb778 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.568548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b79921-c3f6-4436-9e81-93c39c1eb778 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.568956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b79921-c3f6-4436-9e81-93c39c1eb778 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.569633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b79921-c3f6-4436-9e81-93c39c1eb778 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.570692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b79921-c3f6-4436-9e81-93c39c1eb778 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.574249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b79921-c3f6-4436-9e81-93c39c1eb778 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.577824 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1829/3606] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:32.582232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a30c77-645a-466c-ba86-0282080ee40b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.600924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a30c77-645a-466c-ba86-0282080ee40b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.612136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b80f4-df6c-41b7-b066-6769ccd6c931 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.612954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b80f4-df6c-41b7-b066-6769ccd6c931 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.613413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b80f4-df6c-41b7-b066-6769ccd6c931 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.613705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b80f4-df6c-41b7-b066-6769ccd6c931 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.615138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b80f4-df6c-41b7-b066-6769ccd6c931 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.617403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b80f4-df6c-41b7-b066-6769ccd6c931 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.619619 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1778/3607] 10.222.0.43 () {58 vars in 1241 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:32.623156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b79921-c3f6-4436-9e81-93c39c1eb778 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.634923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b79921-c3f6-4436-9e81-93c39c1eb778 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.642562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4857da-9f9a-42af-b10e-d4a253a1dd9f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.643566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4857da-9f9a-42af-b10e-d4a253a1dd9f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.644163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4857da-9f9a-42af-b10e-d4a253a1dd9f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.644543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4857da-9f9a-42af-b10e-d4a253a1dd9f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.645332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4857da-9f9a-42af-b10e-d4a253a1dd9f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.647513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4857da-9f9a-42af-b10e-d4a253a1dd9f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.649320 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1830/3608] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:32.653384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b80f4-df6c-41b7-b066-6769ccd6c931 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.667340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b80f4-df6c-41b7-b066-6769ccd6c931 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.673953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22cc8d-2198-41b7-8109-d93b1c2aaced tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.674764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22cc8d-2198-41b7-8109-d93b1c2aaced tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.675371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22cc8d-2198-41b7-8109-d93b1c2aaced tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.675371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22cc8d-2198-41b7-8109-d93b1c2aaced tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.675983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22cc8d-2198-41b7-8109-d93b1c2aaced tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.686486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22cc8d-2198-41b7-8109-d93b1c2aaced tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.694694 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1779/3609] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:32.707413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4857da-9f9a-42af-b10e-d4a253a1dd9f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.734539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4857da-9f9a-42af-b10e-d4a253a1dd9f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.749072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3730ee-3e18-4a48-a5f7-5598eb8d0d25 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.749985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3730ee-3e18-4a48-a5f7-5598eb8d0d25 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.750294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3730ee-3e18-4a48-a5f7-5598eb8d0d25 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.750680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3730ee-3e18-4a48-a5f7-5598eb8d0d25 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.751242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3730ee-3e18-4a48-a5f7-5598eb8d0d25 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.753125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3730ee-3e18-4a48-a5f7-5598eb8d0d25 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.761432 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1831/3610] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:32.765571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22cc8d-2198-41b7-8109-d93b1c2aaced tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.783265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22cc8d-2198-41b7-8109-d93b1c2aaced tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.798997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223e262-22c3-461d-996d-7b895e9aa0cb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.801319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223e262-22c3-461d-996d-7b895e9aa0cb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.801805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223e262-22c3-461d-996d-7b895e9aa0cb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.802293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223e262-22c3-461d-996d-7b895e9aa0cb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.804299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223e262-22c3-461d-996d-7b895e9aa0cb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.806151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223e262-22c3-461d-996d-7b895e9aa0cb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.812866 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1780/3611] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:32.815842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3730ee-3e18-4a48-a5f7-5598eb8d0d25 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.838148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3730ee-3e18-4a48-a5f7-5598eb8d0d25 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.849762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524298e7-2d0e-410e-851f-c138b06cef57 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.850692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524298e7-2d0e-410e-851f-c138b06cef57 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.851293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524298e7-2d0e-410e-851f-c138b06cef57 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.851624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524298e7-2d0e-410e-851f-c138b06cef57 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.852387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524298e7-2d0e-410e-851f-c138b06cef57 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.855234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524298e7-2d0e-410e-851f-c138b06cef57 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.859533 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1832/3612] 10.222.0.43 () {58 vars in 1256 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 02 21:11:32.860806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223e262-22c3-461d-996d-7b895e9aa0cb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.872214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223e262-22c3-461d-996d-7b895e9aa0cb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.878126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9d0ab-b992-4c91-8c0f-7a7d54ee359e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.879143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9d0ab-b992-4c91-8c0f-7a7d54ee359e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.879665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9d0ab-b992-4c91-8c0f-7a7d54ee359e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.880140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9d0ab-b992-4c91-8c0f-7a7d54ee359e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.880970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9d0ab-b992-4c91-8c0f-7a7d54ee359e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.883921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9d0ab-b992-4c91-8c0f-7a7d54ee359e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.885449 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1781/3613] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:32.889877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524298e7-2d0e-410e-851f-c138b06cef57 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:32.957708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524298e7-2d0e-410e-851f-c138b06cef57 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:32.971937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f2419-e576-47d5-8c33-c51bfa39525b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:32.972886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f2419-e576-47d5-8c33-c51bfa39525b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:32.973173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f2419-e576-47d5-8c33-c51bfa39525b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:32.975115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f2419-e576-47d5-8c33-c51bfa39525b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:32.976284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f2419-e576-47d5-8c33-c51bfa39525b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:32.980561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f2419-e576-47d5-8c33-c51bfa39525b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:32.982699 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1833/3614] 10.222.0.43 () {58 vars in 1241 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:32.987435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9d0ab-b992-4c91-8c0f-7a7d54ee359e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.000289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9d0ab-b992-4c91-8c0f-7a7d54ee359e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.006485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db45cb-e72d-4805-bb16-d6ad4462868e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.007834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db45cb-e72d-4805-bb16-d6ad4462868e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.008386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db45cb-e72d-4805-bb16-d6ad4462868e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.008892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db45cb-e72d-4805-bb16-d6ad4462868e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.009753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db45cb-e72d-4805-bb16-d6ad4462868e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.011843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db45cb-e72d-4805-bb16-d6ad4462868e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.016711 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1782/3615] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:11:32 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.017996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f2419-e576-47d5-8c33-c51bfa39525b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.030588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f2419-e576-47d5-8c33-c51bfa39525b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.036236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab73a3-3b49-466a-90f0-e912903bff45 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.037171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab73a3-3b49-466a-90f0-e912903bff45 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.037458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab73a3-3b49-466a-90f0-e912903bff45 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.037736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab73a3-3b49-466a-90f0-e912903bff45 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.038505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab73a3-3b49-466a-90f0-e912903bff45 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.040148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab73a3-3b49-466a-90f0-e912903bff45 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.044670 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1834/3616] 10.222.0.43 () {58 vars in 1253 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 02 21:11:33.046382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db45cb-e72d-4805-bb16-d6ad4462868e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.053009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02431d1a-b817-403b-83df-cc3807f66c81 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.054693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02431d1a-b817-403b-83df-cc3807f66c81 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.054984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02431d1a-b817-403b-83df-cc3807f66c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.058960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db45cb-e72d-4805-bb16-d6ad4462868e tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.070900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107080c-2eda-4ac2-95ed-4b0646356934 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.071733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107080c-2eda-4ac2-95ed-4b0646356934 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.072014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107080c-2eda-4ac2-95ed-4b0646356934 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.072387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107080c-2eda-4ac2-95ed-4b0646356934 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.073089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107080c-2eda-4ac2-95ed-4b0646356934 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.075244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107080c-2eda-4ac2-95ed-4b0646356934 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.076741 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1783/3617] 10.222.0.43 () {58 vars in 1289 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.080785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107080c-2eda-4ac2-95ed-4b0646356934 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.095092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107080c-2eda-4ac2-95ed-4b0646356934 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.100742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55b4b5-b371-44ec-a72d-0c098bb93454 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.101553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55b4b5-b371-44ec-a72d-0c098bb93454 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.101833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55b4b5-b371-44ec-a72d-0c098bb93454 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.102195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55b4b5-b371-44ec-a72d-0c098bb93454 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.102851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55b4b5-b371-44ec-a72d-0c098bb93454 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.104666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55b4b5-b371-44ec-a72d-0c098bb93454 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.108823 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1784/3618] 10.222.0.43 () {58 vars in 1256 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.110185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-02431d1a-b817-403b-83df-cc3807f66c81 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:33.111401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-02431d1a-b817-403b-83df-cc3807f66c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:33.112370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55b4b5-b371-44ec-a72d-0c098bb93454 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.124459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55b4b5-b371-44ec-a72d-0c098bb93454 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.130685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f450f-1a2f-4460-87ec-ff074299f3d4 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.132005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f450f-1a2f-4460-87ec-ff074299f3d4 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.132599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f450f-1a2f-4460-87ec-ff074299f3d4 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.133166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f450f-1a2f-4460-87ec-ff074299f3d4 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.134056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f450f-1a2f-4460-87ec-ff074299f3d4 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.136205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f450f-1a2f-4460-87ec-ff074299f3d4 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.142305 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1785/3619] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 02 21:11:33.143515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f450f-1a2f-4460-87ec-ff074299f3d4 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.157275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f450f-1a2f-4460-87ec-ff074299f3d4 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.167438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b7048-7567-4a9a-87e2-65cf122d3240 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.168824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b7048-7567-4a9a-87e2-65cf122d3240 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.169184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b7048-7567-4a9a-87e2-65cf122d3240 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.169628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b7048-7567-4a9a-87e2-65cf122d3240 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.170290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b7048-7567-4a9a-87e2-65cf122d3240 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.171998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b7048-7567-4a9a-87e2-65cf122d3240 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.176075 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1786/3620] 10.222.0.43 () {58 vars in 1307 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.177274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b7048-7567-4a9a-87e2-65cf122d3240 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.178031 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1835/3621] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:11:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:11:33.190119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b7048-7567-4a9a-87e2-65cf122d3240 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.192940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02431d1a-b817-403b-83df-cc3807f66c81 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.195513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-02431d1a-b817-403b-83df-cc3807f66c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:33.198034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483b10e-79cc-4c66-90b9-e9d13dbbe3c7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.199298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483b10e-79cc-4c66-90b9-e9d13dbbe3c7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.199298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483b10e-79cc-4c66-90b9-e9d13dbbe3c7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.199482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483b10e-79cc-4c66-90b9-e9d13dbbe3c7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.200278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483b10e-79cc-4c66-90b9-e9d13dbbe3c7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.202175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483b10e-79cc-4c66-90b9-e9d13dbbe3c7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.203811 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1787/3622] 10.222.0.43 () {58 vars in 1289 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 02 21:11:33.207492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483b10e-79cc-4c66-90b9-e9d13dbbe3c7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.218424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483b10e-79cc-4c66-90b9-e9d13dbbe3c7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.223381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0af57-9ed3-4c57-8e92-c9fe8a837b75 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.224365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0af57-9ed3-4c57-8e92-c9fe8a837b75 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.224780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0af57-9ed3-4c57-8e92-c9fe8a837b75 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.225065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0af57-9ed3-4c57-8e92-c9fe8a837b75 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.225845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0af57-9ed3-4c57-8e92-c9fe8a837b75 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.227441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0af57-9ed3-4c57-8e92-c9fe8a837b75 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.228971 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1788/3623] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 02 21:11:33.233525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0af57-9ed3-4c57-8e92-c9fe8a837b75 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.244797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0af57-9ed3-4c57-8e92-c9fe8a837b75 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.249769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11482755-b988-4485-bf92-ad14f91ee108 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.250550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11482755-b988-4485-bf92-ad14f91ee108 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.250830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11482755-b988-4485-bf92-ad14f91ee108 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.251103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11482755-b988-4485-bf92-ad14f91ee108 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.251747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11482755-b988-4485-bf92-ad14f91ee108 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.253376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11482755-b988-4485-bf92-ad14f91ee108 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.254904 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1789/3624] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 02 21:11:33.258552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11482755-b988-4485-bf92-ad14f91ee108 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.270654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11482755-b988-4485-bf92-ad14f91ee108 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.276336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d09460-75e0-4fff-bfa9-b81b8138ece6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.277135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d09460-75e0-4fff-bfa9-b81b8138ece6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.277414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d09460-75e0-4fff-bfa9-b81b8138ece6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.277713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d09460-75e0-4fff-bfa9-b81b8138ece6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.278533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d09460-75e0-4fff-bfa9-b81b8138ece6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.280195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d09460-75e0-4fff-bfa9-b81b8138ece6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.281362 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1790/3625] 10.222.0.43 () {58 vars in 1241 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 02 21:11:33.285218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=7,keystone:SELECT=93 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:33.285376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d09460-75e0-4fff-bfa9-b81b8138ece6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.289284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02431d1a-b817-403b-83df-cc3807f66c81 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.297077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d09460-75e0-4fff-bfa9-b81b8138ece6 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.297436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b391c68-bca1-4c55-8aa9-ebcc36859557 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.298111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b391c68-bca1-4c55-8aa9-ebcc36859557 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.298397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b391c68-bca1-4c55-8aa9-ebcc36859557 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.298679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b391c68-bca1-4c55-8aa9-ebcc36859557 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.302310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb4c88-e668-4a3e-ad20-ebde6b9ebe4c tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.303512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb4c88-e668-4a3e-ad20-ebde6b9ebe4c tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.303866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb4c88-e668-4a3e-ad20-ebde6b9ebe4c tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.304107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb4c88-e668-4a3e-ad20-ebde6b9ebe4c tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.304796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb4c88-e668-4a3e-ad20-ebde6b9ebe4c tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.306677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb4c88-e668-4a3e-ad20-ebde6b9ebe4c tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.311313 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1791/3626] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.312383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb4c88-e668-4a3e-ad20-ebde6b9ebe4c tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.312522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b391c68-bca1-4c55-8aa9-ebcc36859557 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.314425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b391c68-bca1-4c55-8aa9-ebcc36859557 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.322503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb4c88-e668-4a3e-ad20-ebde6b9ebe4c tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.326728 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1836/3627] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 02 21:11:33.327716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c9c79-c1f8-47ea-9e9c-8d630443b874 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.328676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c9c79-c1f8-47ea-9e9c-8d630443b874 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.328992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c9c79-c1f8-47ea-9e9c-8d630443b874 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.329336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c9c79-c1f8-47ea-9e9c-8d630443b874 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.330081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c9c79-c1f8-47ea-9e9c-8d630443b874 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.332170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c9c79-c1f8-47ea-9e9c-8d630443b874 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.333711 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1792/3628] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 02 21:11:33.337661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b391c68-bca1-4c55-8aa9-ebcc36859557 service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.350165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b391c68-bca1-4c55-8aa9-ebcc36859557 service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.375535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ad870-3a8c-4027-b224-54864636ad13 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.376972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ad870-3a8c-4027-b224-54864636ad13 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.377474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ad870-3a8c-4027-b224-54864636ad13 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.377978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ad870-3a8c-4027-b224-54864636ad13 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.378800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ad870-3a8c-4027-b224-54864636ad13 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.380629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ad870-3a8c-4027-b224-54864636ad13 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.382435 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1837/3629] 10.222.0.43 () {58 vars in 1253 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.387022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c9c79-c1f8-47ea-9e9c-8d630443b874 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.405426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c9c79-c1f8-47ea-9e9c-8d630443b874 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.410522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b07741-dd6b-4507-b279-d95607ec85a1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.411338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b07741-dd6b-4507-b279-d95607ec85a1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.411626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b07741-dd6b-4507-b279-d95607ec85a1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.414287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b07741-dd6b-4507-b279-d95607ec85a1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.414287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b07741-dd6b-4507-b279-d95607ec85a1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.417920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b07741-dd6b-4507-b279-d95607ec85a1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.420135 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1793/3630] 10.222.0.43 () {58 vars in 1256 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.423531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ad870-3a8c-4027-b224-54864636ad13 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.441440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ad870-3a8c-4027-b224-54864636ad13 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.451506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c6610-a791-4c8d-bf09-62b161c532c0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.452402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c6610-a791-4c8d-bf09-62b161c532c0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.452682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c6610-a791-4c8d-bf09-62b161c532c0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.452962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c6610-a791-4c8d-bf09-62b161c532c0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.453680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c6610-a791-4c8d-bf09-62b161c532c0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.455304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c6610-a791-4c8d-bf09-62b161c532c0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.456636 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1838/3631] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.464765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b07741-dd6b-4507-b279-d95607ec85a1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.478686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b07741-dd6b-4507-b279-d95607ec85a1 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.496685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bfb19-12e6-400c-bebc-2a00650af4f8 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.497566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bfb19-12e6-400c-bebc-2a00650af4f8 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.497851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bfb19-12e6-400c-bebc-2a00650af4f8 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.498349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bfb19-12e6-400c-bebc-2a00650af4f8 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.499018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bfb19-12e6-400c-bebc-2a00650af4f8 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.500778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bfb19-12e6-400c-bebc-2a00650af4f8 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.502587 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1794/3632] 10.222.0.43 () {58 vars in 1256 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.506577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c6610-a791-4c8d-bf09-62b161c532c0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.518294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c6610-a791-4c8d-bf09-62b161c532c0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.523559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dd067-b849-4ec5-a2f5-17985d0c74bb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.524437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dd067-b849-4ec5-a2f5-17985d0c74bb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.525026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dd067-b849-4ec5-a2f5-17985d0c74bb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.525026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dd067-b849-4ec5-a2f5-17985d0c74bb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.527225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69dd067-b849-4ec5-a2f5-17985d0c74bb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.530407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69dd067-b849-4ec5-a2f5-17985d0c74bb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.531757 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1839/3633] 10.222.0.43 () {58 vars in 1292 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.537772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bfb19-12e6-400c-bebc-2a00650af4f8 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.554086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bfb19-12e6-400c-bebc-2a00650af4f8 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.560454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f22e6b-64be-4a01-ba8b-cc8b1d8d8f73 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.562594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f22e6b-64be-4a01-ba8b-cc8b1d8d8f73 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.562744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f22e6b-64be-4a01-ba8b-cc8b1d8d8f73 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.563069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f22e6b-64be-4a01-ba8b-cc8b1d8d8f73 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.564671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f22e6b-64be-4a01-ba8b-cc8b1d8d8f73 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.576968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f22e6b-64be-4a01-ba8b-cc8b1d8d8f73 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.579024 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1795/3634] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.592347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dd067-b849-4ec5-a2f5-17985d0c74bb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.619178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dd067-b849-4ec5-a2f5-17985d0c74bb tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.625116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a41d93-b1ad-4e23-87a3-72750ce2b378 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.626087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a41d93-b1ad-4e23-87a3-72750ce2b378 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.626653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a41d93-b1ad-4e23-87a3-72750ce2b378 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.626805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a41d93-b1ad-4e23-87a3-72750ce2b378 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.627887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a41d93-b1ad-4e23-87a3-72750ce2b378 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.629653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a41d93-b1ad-4e23-87a3-72750ce2b378 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.631033 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1840/3635] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.635859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f22e6b-64be-4a01-ba8b-cc8b1d8d8f73 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.651787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f22e6b-64be-4a01-ba8b-cc8b1d8d8f73 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.665220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa52633-b532-44b6-98c9-eeac3d88fb4a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.667661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa52633-b532-44b6-98c9-eeac3d88fb4a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.668074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa52633-b532-44b6-98c9-eeac3d88fb4a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.668582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa52633-b532-44b6-98c9-eeac3d88fb4a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.669828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa52633-b532-44b6-98c9-eeac3d88fb4a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.672850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa52633-b532-44b6-98c9-eeac3d88fb4a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.674936 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1796/3636] 10.222.0.43 () {58 vars in 1211 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.679495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a41d93-b1ad-4e23-87a3-72750ce2b378 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.691894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a41d93-b1ad-4e23-87a3-72750ce2b378 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.698898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045de63-5f63-48bb-8dd4-b9105c816b10 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.699834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045de63-5f63-48bb-8dd4-b9105c816b10 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.700340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045de63-5f63-48bb-8dd4-b9105c816b10 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.700718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045de63-5f63-48bb-8dd4-b9105c816b10 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.701478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045de63-5f63-48bb-8dd4-b9105c816b10 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.704114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045de63-5f63-48bb-8dd4-b9105c816b10 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.706531 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1841/3637] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.711132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa52633-b532-44b6-98c9-eeac3d88fb4a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.725875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa52633-b532-44b6-98c9-eeac3d88fb4a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.733587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09883c-cebf-4ab4-bc94-51a52ce29111 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.734524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09883c-cebf-4ab4-bc94-51a52ce29111 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.735059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09883c-cebf-4ab4-bc94-51a52ce29111 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.735846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09883c-cebf-4ab4-bc94-51a52ce29111 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.736804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09883c-cebf-4ab4-bc94-51a52ce29111 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.739435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09883c-cebf-4ab4-bc94-51a52ce29111 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.744428 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1797/3638] 10.222.0.43 () {58 vars in 1214 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.746101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045de63-5f63-48bb-8dd4-b9105c816b10 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.762069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045de63-5f63-48bb-8dd4-b9105c816b10 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.769398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40899ca3-f468-4b0e-86ac-caa6515f0e8b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.770643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40899ca3-f468-4b0e-86ac-caa6515f0e8b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.771367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40899ca3-f468-4b0e-86ac-caa6515f0e8b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.771857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40899ca3-f468-4b0e-86ac-caa6515f0e8b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.772802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40899ca3-f468-4b0e-86ac-caa6515f0e8b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.780969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40899ca3-f468-4b0e-86ac-caa6515f0e8b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.786806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09883c-cebf-4ab4-bc94-51a52ce29111 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.802090 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1842/3639] 10.222.0.43 () {58 vars in 1217 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.803508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09883c-cebf-4ab4-bc94-51a52ce29111 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.828724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad085e8c-3a6a-418c-aa00-131a99c9593f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.830433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad085e8c-3a6a-418c-aa00-131a99c9593f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.830940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad085e8c-3a6a-418c-aa00-131a99c9593f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.831420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad085e8c-3a6a-418c-aa00-131a99c9593f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.832751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad085e8c-3a6a-418c-aa00-131a99c9593f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.834696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad085e8c-3a6a-418c-aa00-131a99c9593f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.839465 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1798/3640] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 02 21:11:33.846087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40899ca3-f468-4b0e-86ac-caa6515f0e8b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.861983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40899ca3-f468-4b0e-86ac-caa6515f0e8b tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.869915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4db5a9-cd95-4473-bdfd-10f0e29696a7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.871967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4db5a9-cd95-4473-bdfd-10f0e29696a7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.872625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4db5a9-cd95-4473-bdfd-10f0e29696a7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.873169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4db5a9-cd95-4473-bdfd-10f0e29696a7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.874482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4db5a9-cd95-4473-bdfd-10f0e29696a7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.877483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4db5a9-cd95-4473-bdfd-10f0e29696a7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.879412 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1843/3641] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.884677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad085e8c-3a6a-418c-aa00-131a99c9593f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.900371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad085e8c-3a6a-418c-aa00-131a99c9593f tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.907717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f90d06-cecc-48fb-bd78-3a85906ea3a2 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.909046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f90d06-cecc-48fb-bd78-3a85906ea3a2 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.909475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f90d06-cecc-48fb-bd78-3a85906ea3a2 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.909996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f90d06-cecc-48fb-bd78-3a85906ea3a2 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.910842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f90d06-cecc-48fb-bd78-3a85906ea3a2 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.912802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f90d06-cecc-48fb-bd78-3a85906ea3a2 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.920815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4db5a9-cd95-4473-bdfd-10f0e29696a7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.922081 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1799/3642] 10.222.0.43 () {58 vars in 1259 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.935032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4db5a9-cd95-4473-bdfd-10f0e29696a7 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.942673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1078f-4612-4f6c-8938-c04e3b669879 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.943601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1078f-4612-4f6c-8938-c04e3b669879 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.943952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1078f-4612-4f6c-8938-c04e3b669879 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.944404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1078f-4612-4f6c-8938-c04e3b669879 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.945124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1078f-4612-4f6c-8938-c04e3b669879 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.951361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1078f-4612-4f6c-8938-c04e3b669879 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.957271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f90d06-cecc-48fb-bd78-3a85906ea3a2 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:33.964937 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1844/3643] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:33.974879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f90d06-cecc-48fb-bd78-3a85906ea3a2 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:33.983987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72f31c-3f78-4672-b337-27cde81b56ab tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:33.985152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72f31c-3f78-4672-b337-27cde81b56ab tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:33.986554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72f31c-3f78-4672-b337-27cde81b56ab tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:33.987187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72f31c-3f78-4672-b337-27cde81b56ab tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:33.987953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72f31c-3f78-4672-b337-27cde81b56ab tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:33.990164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72f31c-3f78-4672-b337-27cde81b56ab tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:33.998085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1078f-4612-4f6c-8938-c04e3b669879 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:34.008061 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1800/3644] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:34.011063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1078f-4612-4f6c-8938-c04e3b669879 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:34.024712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e943f-6462-4fb4-a41e-ad5f4115b73d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:34.025549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e943f-6462-4fb4-a41e-ad5f4115b73d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:34.025828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e943f-6462-4fb4-a41e-ad5f4115b73d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:34.026102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e943f-6462-4fb4-a41e-ad5f4115b73d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:34.027694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e943f-6462-4fb4-a41e-ad5f4115b73d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:34.029495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e943f-6462-4fb4-a41e-ad5f4115b73d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:34.031426 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1845/3645] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:33 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:34.035486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72f31c-3f78-4672-b337-27cde81b56ab tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:34.056410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72f31c-3f78-4672-b337-27cde81b56ab tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:34.068147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a2461-c23f-499d-9355-a579e78818b0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:34.072783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a2461-c23f-499d-9355-a579e78818b0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:34.073088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a2461-c23f-499d-9355-a579e78818b0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:34.073377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a2461-c23f-499d-9355-a579e78818b0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:34.074160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a2461-c23f-499d-9355-a579e78818b0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:34.076091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a2461-c23f-499d-9355-a579e78818b0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:34.077069 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1801/3646] 10.222.0.43 () {58 vars in 1277 bytes} [Sat Jul 2 21:11:34 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:11:34.089848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e943f-6462-4fb4-a41e-ad5f4115b73d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:34.121410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e943f-6462-4fb4-a41e-ad5f4115b73d tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:34.133157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e7942-b4b6-4f8c-bb35-1dba17d36108 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:34.134731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e7942-b4b6-4f8c-bb35-1dba17d36108 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:34.135026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e7942-b4b6-4f8c-bb35-1dba17d36108 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:34.135462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e7942-b4b6-4f8c-bb35-1dba17d36108 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:34.149946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e7942-b4b6-4f8c-bb35-1dba17d36108 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 21:11:34.180184 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-b69e7942-b4b6-4f8c-bb35-1dba17d36108 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Could not find domain: 0f34783da7ab42b49b4c5e56cb5ff55a.: keystone.exception.DomainNotFound: Could not find domain: 0f34783da7ab42b49b4c5e56cb5ff55a. Jul 02 21:11:34.180184 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:34.180184 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 21:11:34.180184 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 21:11:34.180184 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:11:34.180184 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:11:34.180184 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:11:34.180184 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:11:34.180184 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0f34783da7ab42b49b4c5e56cb5ff55a. Jul 02 21:11:34.180184 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:34.180184 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:11:34.180184 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:34.180184 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:34.180184 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:11:34.180184 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:11:34.181281 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:11:34.181281 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:11:34.181281 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:11:34.181281 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:11:34.181281 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:11:34.181281 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:11:34.181281 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:11:34.181281 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:11:34.181281 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 02 21:11:34.181281 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 02 21:11:34.181281 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 21:11:34.181281 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 21:11:34.181281 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 21:11:34.181281 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 21:11:34.181281 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:11:34.181281 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:11:34.182250 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:11:34.182250 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:11:34.182250 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:11:34.182250 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:11:34.182250 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:11:34.182250 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 21:11:34.182250 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:11:34.182250 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:11:34.182250 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:11:34.182250 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:11:34.182250 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:11:34.182250 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:11:34.182250 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:11:34.182250 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:11:34.182250 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 21:11:34.182250 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 21:11:34.182250 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0f34783da7ab42b49b4c5e56cb5ff55a. Jul 02 21:11:34.183261 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:34.186873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a2461-c23f-499d-9355-a579e78818b0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:34.187303 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1846/3647] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:11:34 2022] PATCH /identity/v3/domains/0f34783da7ab42b49b4c5e56cb5ff55a => generated 112 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:11:34.200020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a2461-c23f-499d-9355-a579e78818b0 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:34.207813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b88d2-fb4d-44e7-a7a9-1cd4c1cfc77a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:34.208746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b88d2-fb4d-44e7-a7a9-1cd4c1cfc77a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:34.209027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b88d2-fb4d-44e7-a7a9-1cd4c1cfc77a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:34.209301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b88d2-fb4d-44e7-a7a9-1cd4c1cfc77a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/0022035330304cd5ac67ccf326c51d74` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:34.223975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b88d2-fb4d-44e7-a7a9-1cd4c1cfc77a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 21:11:34.239823 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-b54b88d2-fb4d-44e7-a7a9-1cd4c1cfc77a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Could not find domain: 0022035330304cd5ac67ccf326c51d74.: keystone.exception.DomainNotFound: Could not find domain: 0022035330304cd5ac67ccf326c51d74. Jul 02 21:11:34.239823 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:34.239823 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 21:11:34.239823 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 21:11:34.239823 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:11:34.239823 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:11:34.239823 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:11:34.239823 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:11:34.239823 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0022035330304cd5ac67ccf326c51d74. Jul 02 21:11:34.239823 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:11:34.239823 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:11:34.239823 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:11:34.239823 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:34.239823 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:11:34.239823 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:11:34.240800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:11:34.240800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:11:34.240800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:11:34.240800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:11:34.240800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:11:34.240800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:11:34.240800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:11:34.240800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:11:34.240800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 02 21:11:34.240800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 02 21:11:34.240800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 21:11:34.240800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 21:11:34.240800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 21:11:34.240800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 21:11:34.240800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:11:34.240800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:11:34.241895 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:11:34.241895 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:11:34.241895 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:11:34.241895 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:11:34.241895 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:11:34.241895 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 21:11:34.241895 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:11:34.241895 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:11:34.241895 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:11:34.241895 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:11:34.241895 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:11:34.241895 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:11:34.241895 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:11:34.241895 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:11:34.241895 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 21:11:34.241895 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 21:11:34.241895 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0022035330304cd5ac67ccf326c51d74. Jul 02 21:11:34.242876 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:11:34.242876 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1802/3648] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:11:34 2022] PATCH /identity/v3/domains/0022035330304cd5ac67ccf326c51d74 => generated 112 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:11:34.247021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e7942-b4b6-4f8c-bb35-1dba17d36108 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:34.273155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e7942-b4b6-4f8c-bb35-1dba17d36108 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:34.288934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a79dd-a00b-49e7-8e55-169dda786481 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86e0b6455aa490db90d6286737ca43e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:34.289892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a79dd-a00b-49e7-8e55-169dda786481 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:34.290176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a79dd-a00b-49e7-8e55-169dda786481 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:34.290453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a79dd-a00b-49e7-8e55-169dda786481 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] PATH_INFO: `/v3/domains/f4d4709c70fb40918938d220d3df9e49` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:34.307901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a79dd-a00b-49e7-8e55-169dda786481 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 21:11:34.320726 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-127a79dd-a00b-49e7-8e55-169dda786481 tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Could not find domain: f4d4709c70fb40918938d220d3df9e49.: keystone.exception.DomainNotFound: Could not find domain: f4d4709c70fb40918938d220d3df9e49. Jul 02 21:11:34.320726 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:34.320726 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 21:11:34.320726 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 21:11:34.320726 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:11:34.320726 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:11:34.320726 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:11:34.320726 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:11:34.320726 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f4d4709c70fb40918938d220d3df9e49. Jul 02 21:11:34.320726 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:34.320726 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:11:34.320726 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:34.320726 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:34.320726 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:11:34.320726 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:11:34.321722 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:11:34.321722 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:11:34.321722 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:11:34.321722 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:11:34.321722 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:11:34.321722 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:11:34.321722 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:11:34.321722 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:11:34.321722 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 02 21:11:34.321722 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 02 21:11:34.321722 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 21:11:34.321722 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 21:11:34.321722 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 21:11:34.321722 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 21:11:34.321722 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:11:34.321722 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:11:34.322650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:11:34.322650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:11:34.322650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:11:34.322650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:11:34.322650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:11:34.322650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 21:11:34.322650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:11:34.322650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:11:34.322650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:11:34.322650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:11:34.322650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:11:34.322650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:11:34.322650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:11:34.322650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:11:34.322650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 21:11:34.322650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 21:11:34.322650 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f4d4709c70fb40918938d220d3df9e49. Jul 02 21:11:34.323646 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:34.323646 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1847/3649] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:11:34 2022] PATCH /identity/v3/domains/f4d4709c70fb40918938d220d3df9e49 => generated 112 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:11:34.327236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b88d2-fb4d-44e7-a7a9-1cd4c1cfc77a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:34.329551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b54b88d2-fb4d-44e7-a7a9-1cd4c1cfc77a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:34.475401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b88d2-fb4d-44e7-a7a9-1cd4c1cfc77a tempest-DomainConfigurationTestJSON-82598484 tempest-DomainConfigurationTestJSON-82598484-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:34.483926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0af35-ad3a-49af-93ef-936a94cffb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:34.485070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0af35-ad3a-49af-93ef-936a94cffb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:34.485481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0af35-ad3a-49af-93ef-936a94cffb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:34.485866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0af35-ad3a-49af-93ef-936a94cffb76 admin admin] PATH_INFO: `/v3/users/e87b6604cdbe40c1ad9c11bc719052da` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:34.488148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0af35-ad3a-49af-93ef-936a94cffb76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e87b6604cdbe40c1ad9c11bc719052da)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:34.489960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0af35-ad3a-49af-93ef-936a94cffb76 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:34.558532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:34.560970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d7d0af35-ad3a-49af-93ef-936a94cffb76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e87b6604cdbe40c1ad9c11bc719052da'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:34.576397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d7d0af35-ad3a-49af-93ef-936a94cffb76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e87b6604cdbe40c1ad9c11bc719052da'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:34.600262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d7d0af35-ad3a-49af-93ef-936a94cffb76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e87b6604cdbe40c1ad9c11bc719052da'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:34.602718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d7d0af35-ad3a-49af-93ef-936a94cffb76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e87b6604cdbe40c1ad9c11bc719052da'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:34.603561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d7d0af35-ad3a-49af-93ef-936a94cffb76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e87b6604cdbe40c1ad9c11bc719052da'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:34.633201 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1803/3650] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:11:34 2022] DELETE /identity/v3/users/e87b6604cdbe40c1ad9c11bc719052da => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:34.637532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7108428-e62c-4e12-a6cd-8d945e421786 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:34.638312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7108428-e62c-4e12-a6cd-8d945e421786 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:34.638312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7108428-e62c-4e12-a6cd-8d945e421786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:34.670984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b7108428-e62c-4e12-a6cd-8d945e421786 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:34.672636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b7108428-e62c-4e12-a6cd-8d945e421786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:34.827383 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1848/3651] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:34.834757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0af35-ad3a-49af-93ef-936a94cffb76 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:34.840098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d7d0af35-ad3a-49af-93ef-936a94cffb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:34.926497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0af35-ad3a-49af-93ef-936a94cffb76 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:34.930680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90346b6-00af-48cb-af1d-ab50802e8830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:34.931413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90346b6-00af-48cb-af1d-ab50802e8830 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:34.931775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90346b6-00af-48cb-af1d-ab50802e8830 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:34.932154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90346b6-00af-48cb-af1d-ab50802e8830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:34.948502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90346b6-00af-48cb-af1d-ab50802e8830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:34.950562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90346b6-00af-48cb-af1d-ab50802e8830 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:34.963062 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1804/3652] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:11:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:11:35.434542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7108428-e62c-4e12-a6cd-8d945e421786 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:35.436776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b7108428-e62c-4e12-a6cd-8d945e421786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:35.451474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7108428-e62c-4e12-a6cd-8d945e421786 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:35.456778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c5551-f354-4aae-9a08-ab81e6c58048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:35.457790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c5551-f354-4aae-9a08-ab81e6c58048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:35.458142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c5551-f354-4aae-9a08-ab81e6c58048 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:35.458486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c5551-f354-4aae-9a08-ab81e6c58048 admin admin] PATH_INFO: `/v3/projects/0cceb265a28b4a25b06c5e0d8fb9a3f9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:35.459788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c5551-f354-4aae-9a08-ab81e6c58048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cceb265a28b4a25b06c5e0d8fb9a3f9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:35.461934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c5551-f354-4aae-9a08-ab81e6c58048 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:35.524322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-376c5551-f354-4aae-9a08-ab81e6c58048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cceb265a28b4a25b06c5e0d8fb9a3f9', 'request_id': 'req-376c5551-f354-4aae-9a08-ab81e6c58048'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:35.534561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-376c5551-f354-4aae-9a08-ab81e6c58048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cceb265a28b4a25b06c5e0d8fb9a3f9', 'request_id': 'req-376c5551-f354-4aae-9a08-ab81e6c58048'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:35.543890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-376c5551-f354-4aae-9a08-ab81e6c58048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cceb265a28b4a25b06c5e0d8fb9a3f9', 'request_id': 'req-376c5551-f354-4aae-9a08-ab81e6c58048'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:35.559420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-376c5551-f354-4aae-9a08-ab81e6c58048 admin admin] The token cache is being invalidate because project 0cceb265a28b4a25b06c5e0d8fb9a3f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:35.559776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-376c5551-f354-4aae-9a08-ab81e6c58048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:35.560447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-376c5551-f354-4aae-9a08-ab81e6c58048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:35.562496 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1849/3653] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:35 2022] DELETE /identity/v3/projects/0cceb265a28b4a25b06c5e0d8fb9a3f9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:35.566768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90346b6-00af-48cb-af1d-ab50802e8830 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:35.581194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90346b6-00af-48cb-af1d-ab50802e8830 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:35.704139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c91ecd-d628-463a-99ec-3c3bfb2b9997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:35.705038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c91ecd-d628-463a-99ec-3c3bfb2b9997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:35.705324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c91ecd-d628-463a-99ec-3c3bfb2b9997 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:35.705598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c91ecd-d628-463a-99ec-3c3bfb2b9997 admin admin] PATH_INFO: `/v3/users/e86e0b6455aa490db90d6286737ca43e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:35.706803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c91ecd-d628-463a-99ec-3c3bfb2b9997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e86e0b6455aa490db90d6286737ca43e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:35.710198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c91ecd-d628-463a-99ec-3c3bfb2b9997 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:35.790443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-91c91ecd-d628-463a-99ec-3c3bfb2b9997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e86e0b6455aa490db90d6286737ca43e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:35.802157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-91c91ecd-d628-463a-99ec-3c3bfb2b9997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e86e0b6455aa490db90d6286737ca43e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:35.813956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-91c91ecd-d628-463a-99ec-3c3bfb2b9997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e86e0b6455aa490db90d6286737ca43e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:35.815365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-91c91ecd-d628-463a-99ec-3c3bfb2b9997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e86e0b6455aa490db90d6286737ca43e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:35.816528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-91c91ecd-d628-463a-99ec-3c3bfb2b9997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e86e0b6455aa490db90d6286737ca43e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:35.819305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:35.848710 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1805/3654] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:11:35 2022] DELETE /identity/v3/users/e86e0b6455aa490db90d6286737ca43e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:36.289674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c5551-f354-4aae-9a08-ab81e6c58048 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:36.291496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-376c5551-f354-4aae-9a08-ab81e6c58048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:36.317199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c5551-f354-4aae-9a08-ab81e6c58048 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:36.405907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:36.569793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc90c02-183d-4fc0-bdbc-03b35d1fc5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:36.571175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90c02-183d-4fc0-bdbc-03b35d1fc5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:36.571683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90c02-183d-4fc0-bdbc-03b35d1fc5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:36.572383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90c02-183d-4fc0-bdbc-03b35d1fc5fc admin admin] PATH_INFO: `/v3/projects/1d06f6a094f2494dbb3bcb0fb4d3c410` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:36.575545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc90c02-183d-4fc0-bdbc-03b35d1fc5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d06f6a094f2494dbb3bcb0fb4d3c410)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:36.579390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc90c02-183d-4fc0-bdbc-03b35d1fc5fc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:36.773608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3fc90c02-183d-4fc0-bdbc-03b35d1fc5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'request_id': 'req-3fc90c02-183d-4fc0-bdbc-03b35d1fc5fc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:36.798586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3fc90c02-183d-4fc0-bdbc-03b35d1fc5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'request_id': 'req-3fc90c02-183d-4fc0-bdbc-03b35d1fc5fc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:36.810605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3fc90c02-183d-4fc0-bdbc-03b35d1fc5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d06f6a094f2494dbb3bcb0fb4d3c410', 'request_id': 'req-3fc90c02-183d-4fc0-bdbc-03b35d1fc5fc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:36.843863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3fc90c02-183d-4fc0-bdbc-03b35d1fc5fc admin admin] The token cache is being invalidate because project 1d06f6a094f2494dbb3bcb0fb4d3c410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:36.844416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3fc90c02-183d-4fc0-bdbc-03b35d1fc5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:36.849211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3fc90c02-183d-4fc0-bdbc-03b35d1fc5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:36.854959 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1850/3655] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:36 2022] DELETE /identity/v3/projects/1d06f6a094f2494dbb3bcb0fb4d3c410 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:36.860496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e3c2a-c151-4520-bdc4-74dcc7fbe21a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:36.860903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e3c2a-c151-4520-bdc4-74dcc7fbe21a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:36.861081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e3c2a-c151-4520-bdc4-74dcc7fbe21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:36.900752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5f4e3c2a-c151-4520-bdc4-74dcc7fbe21a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:36.902475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5f4e3c2a-c151-4520-bdc4-74dcc7fbe21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:37.020473 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1806/3656] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:37.028517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff874386-acbc-4be1-b72f-3e46da0e6424 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:37.029384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff874386-acbc-4be1-b72f-3e46da0e6424 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:37.029945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff874386-acbc-4be1-b72f-3e46da0e6424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:37.055906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ff874386-acbc-4be1-b72f-3e46da0e6424 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:37.058334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ff874386-acbc-4be1-b72f-3e46da0e6424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:37.086953 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1851/3657] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:37.087835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e3c2a-c151-4520-bdc4-74dcc7fbe21a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:37.108265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e3c2a-c151-4520-bdc4-74dcc7fbe21a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:37.133072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f870b30-3b42-4dda-a35f-b848081015c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:37.133833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f870b30-3b42-4dda-a35f-b848081015c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:37.134150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f870b30-3b42-4dda-a35f-b848081015c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:37.134349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f870b30-3b42-4dda-a35f-b848081015c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:37.135064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f870b30-3b42-4dda-a35f-b848081015c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:11:37.145098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f870b30-3b42-4dda-a35f-b848081015c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:37.147195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f870b30-3b42-4dda-a35f-b848081015c9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:37.168531 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1807/3658] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:37.172599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff874386-acbc-4be1-b72f-3e46da0e6424 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:37.186242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff874386-acbc-4be1-b72f-3e46da0e6424 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:37.196565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869e5c0-f5a3-4dfa-88c3-053cf5bed6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:37.197355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869e5c0-f5a3-4dfa-88c3-053cf5bed6dd admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:37.197861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869e5c0-f5a3-4dfa-88c3-053cf5bed6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:37.198419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869e5c0-f5a3-4dfa-88c3-053cf5bed6dd admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:37.199142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869e5c0-f5a3-4dfa-88c3-053cf5bed6dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:37.201192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869e5c0-f5a3-4dfa-88c3-053cf5bed6dd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:37.268946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f870b30-3b42-4dda-a35f-b848081015c9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:37.273576 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1852/3659] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:11:37 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:37.327131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f870b30-3b42-4dda-a35f-b848081015c9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:37.448297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47270737-e6ff-4a7d-8f23-a70ca508760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:37.448916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47270737-e6ff-4a7d-8f23-a70ca508760b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:37.449253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47270737-e6ff-4a7d-8f23-a70ca508760b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:37.449474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47270737-e6ff-4a7d-8f23-a70ca508760b admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:37.450163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47270737-e6ff-4a7d-8f23-a70ca508760b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:37.452467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47270737-e6ff-4a7d-8f23-a70ca508760b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:37.485609 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1808/3660] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:11:37 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:37.490690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869e5c0-f5a3-4dfa-88c3-053cf5bed6dd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:37.509357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869e5c0-f5a3-4dfa-88c3-053cf5bed6dd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:37.517600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab8c9c-2182-4a4a-99cb-33c600fa9a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:37.519466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab8c9c-2182-4a4a-99cb-33c600fa9a60 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:37.519466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab8c9c-2182-4a4a-99cb-33c600fa9a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:37.519466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab8c9c-2182-4a4a-99cb-33c600fa9a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:37.520351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab8c9c-2182-4a4a-99cb-33c600fa9a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:37.529612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab8c9c-2182-4a4a-99cb-33c600fa9a60 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:37.554785 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1853/3661] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:11:37.559068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47270737-e6ff-4a7d-8f23-a70ca508760b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:37.590020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47270737-e6ff-4a7d-8f23-a70ca508760b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:37.603700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9d0ed-d37b-4bb4-b4f6-ec8378aaefb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:37.604596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9d0ed-d37b-4bb4-b4f6-ec8378aaefb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:37.604962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9d0ed-d37b-4bb4-b4f6-ec8378aaefb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:37.605302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9d0ed-d37b-4bb4-b4f6-ec8378aaefb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:37.606219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9d0ed-d37b-4bb4-b4f6-ec8378aaefb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:37.608593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9d0ed-d37b-4bb4-b4f6-ec8378aaefb0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:37.634015 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1809/3662] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:11:37.639631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab8c9c-2182-4a4a-99cb-33c600fa9a60 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:37.658176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab8c9c-2182-4a4a-99cb-33c600fa9a60 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:37.668571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d3b23-1275-4bac-9997-f67948bada7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:37.669495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d3b23-1275-4bac-9997-f67948bada7e admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:37.669780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d3b23-1275-4bac-9997-f67948bada7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:37.670072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d3b23-1275-4bac-9997-f67948bada7e admin admin] PATH_INFO: `/v3/projects/52f65b023c754c41b0576c8a2c59dbf4/users/98ed29675cef4215a07a816f35efc100/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:37.678487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db157f67-89c8-41b3-9970-4a98a9bb25de None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:37.678954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db157f67-89c8-41b3-9970-4a98a9bb25de None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:37.679374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db157f67-89c8-41b3-9970-4a98a9bb25de None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:37.681602 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1810/3663] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:11:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:11:37.687713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c271b6-014a-436b-a839-3150c651a336 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:37.688169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c271b6-014a-436b-a839-3150c651a336 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:37.688608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c271b6-014a-436b-a839-3150c651a336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:37.691704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d3b23-1275-4bac-9997-f67948bada7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f65b023c754c41b0576c8a2c59dbf4, user_id=98ed29675cef4215a07a816f35efc100, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:37.694557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d3b23-1275-4bac-9997-f67948bada7e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:37.727613 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1854/3664] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:11:37 2022] PUT /identity/v3/projects/52f65b023c754c41b0576c8a2c59dbf4/users/98ed29675cef4215a07a816f35efc100/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:11:37.729722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166a5d1-f114-458e-a189-95f3e20b9ba4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:37.730019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166a5d1-f114-458e-a189-95f3e20b9ba4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:37.736578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166a5d1-f114-458e-a189-95f3e20b9ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:37.789592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-75c271b6-014a-436b-a839-3150c651a336 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:37.790722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9166a5d1-f114-458e-a189-95f3e20b9ba4 None None] MFA Rules not processed for user `98ed29675cef4215a07a816f35efc100`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:37.791609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-75c271b6-014a-436b-a839-3150c651a336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:37.792387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9166a5d1-f114-458e-a189-95f3e20b9ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:37.851418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:37.858677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:37.910337 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1855/3665] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:37.920778 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1811/3666] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:11:37.925114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166a5d1-f114-458e-a189-95f3e20b9ba4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:37.942305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c271b6-014a-436b-a839-3150c651a336 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:37.943957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-75c271b6-014a-436b-a839-3150c651a336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:37.962015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c271b6-014a-436b-a839-3150c651a336 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:37.968526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346edf1-bf90-4187-bc5d-c003c476e4b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:37.969228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346edf1-bf90-4187-bc5d-c003c476e4b7 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:37.969723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346edf1-bf90-4187-bc5d-c003c476e4b7 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:37.969956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346edf1-bf90-4187-bc5d-c003c476e4b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:37.980743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346edf1-bf90-4187-bc5d-c003c476e4b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:37.982537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346edf1-bf90-4187-bc5d-c003c476e4b7 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:37.994679 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1812/3667] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:11:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:11:38.026076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166a5d1-f114-458e-a189-95f3e20b9ba4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:38.031925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26651bb-6178-4004-ac2f-cf14f1d8fb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:38.032803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26651bb-6178-4004-ac2f-cf14f1d8fb0e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:38.033366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26651bb-6178-4004-ac2f-cf14f1d8fb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:38.033735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26651bb-6178-4004-ac2f-cf14f1d8fb0e admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:38.034731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26651bb-6178-4004-ac2f-cf14f1d8fb0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:38.036871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26651bb-6178-4004-ac2f-cf14f1d8fb0e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:38.102612 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1856/3668] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:11:37 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:38.109030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346edf1-bf90-4187-bc5d-c003c476e4b7 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:38.145965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346edf1-bf90-4187-bc5d-c003c476e4b7 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:38.257033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82b93f-7638-4489-a7ed-b35bead78bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:38.270046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82b93f-7638-4489-a7ed-b35bead78bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:38.270713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82b93f-7638-4489-a7ed-b35bead78bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:38.271001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82b93f-7638-4489-a7ed-b35bead78bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:38.272068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82b93f-7638-4489-a7ed-b35bead78bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:38.275962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82b93f-7638-4489-a7ed-b35bead78bc0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:38.322892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26651bb-6178-4004-ac2f-cf14f1d8fb0e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:38.333372 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1813/3669] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:11:38 2022] POST /identity/v3/users => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:38.335574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26651bb-6178-4004-ac2f-cf14f1d8fb0e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:38.342360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d96d8-b5de-422a-b3ed-a43fe8cbf253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:38.343059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d96d8-b5de-422a-b3ed-a43fe8cbf253 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:38.343340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d96d8-b5de-422a-b3ed-a43fe8cbf253 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:38.343624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d96d8-b5de-422a-b3ed-a43fe8cbf253 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:38.344464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d96d8-b5de-422a-b3ed-a43fe8cbf253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:38.346027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d96d8-b5de-422a-b3ed-a43fe8cbf253 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:38.362103 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1857/3670] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:11:38.362838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82b93f-7638-4489-a7ed-b35bead78bc0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:38.379343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82b93f-7638-4489-a7ed-b35bead78bc0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:38.391823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffede0-37ba-4dbe-9736-21db3f5b68f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:38.392832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffede0-37ba-4dbe-9736-21db3f5b68f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:38.393123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffede0-37ba-4dbe-9736-21db3f5b68f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:38.393406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffede0-37ba-4dbe-9736-21db3f5b68f8 admin admin] PATH_INFO: `/v3/projects/5d3a0a19e7dd4b42b31cabd939ed453b/users/befbb3620cf74303b72fe451c19fe86b/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:38.463956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffede0-37ba-4dbe-9736-21db3f5b68f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d3a0a19e7dd4b42b31cabd939ed453b, user_id=befbb3620cf74303b72fe451c19fe86b, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:38.467113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffede0-37ba-4dbe-9736-21db3f5b68f8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:38.488255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8255ce-aba4-4b14-b38d-2374197651f1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:38.488596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8255ce-aba4-4b14-b38d-2374197651f1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:38.495605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8255ce-aba4-4b14-b38d-2374197651f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:38.510846 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1814/3671] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:11:38 2022] PUT /identity/v3/projects/5d3a0a19e7dd4b42b31cabd939ed453b/users/befbb3620cf74303b72fe451c19fe86b/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:11:38.515358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffede0-37ba-4dbe-9736-21db3f5b68f8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:38.544081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ac8255ce-aba4-4b14-b38d-2374197651f1 None None] MFA Rules not processed for user `b3b24a3216aa4eba8a9a90c109c3b491`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:38.545412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ac8255ce-aba4-4b14-b38d-2374197651f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:38.696773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffede0-37ba-4dbe-9736-21db3f5b68f8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:38.710763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7d56a-f6e7-42ee-9665-afb23da18d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:38.711810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7d56a-f6e7-42ee-9665-afb23da18d07 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:38.712310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7d56a-f6e7-42ee-9665-afb23da18d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:38.712732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7d56a-f6e7-42ee-9665-afb23da18d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:38.714212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7d56a-f6e7-42ee-9665-afb23da18d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:38.716068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7d56a-f6e7-42ee-9665-afb23da18d07 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:38.722397 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1858/3672] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:38.735563 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1815/3673] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:11:38.744452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8255ce-aba4-4b14-b38d-2374197651f1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:38.759279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8255ce-aba4-4b14-b38d-2374197651f1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:38.765525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8a0fd-c603-4307-aac3-df9f558cb35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:38.766375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8a0fd-c603-4307-aac3-df9f558cb35c admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:38.766817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8a0fd-c603-4307-aac3-df9f558cb35c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:38.767254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8a0fd-c603-4307-aac3-df9f558cb35c admin admin] PATH_INFO: `/v3/projects/5d3a0a19e7dd4b42b31cabd939ed453b/users/befbb3620cf74303b72fe451c19fe86b/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:38.770683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8a0fd-c603-4307-aac3-df9f558cb35c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d3a0a19e7dd4b42b31cabd939ed453b, user_id=befbb3620cf74303b72fe451c19fe86b, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:38.774061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8a0fd-c603-4307-aac3-df9f558cb35c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:38.807357 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1859/3674] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:11:38 2022] PUT /identity/v3/projects/5d3a0a19e7dd4b42b31cabd939ed453b/users/befbb3620cf74303b72fe451c19fe86b/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:38.821544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e451d-4ab9-4762-aa51-bfc93b4e9dc2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:38.823302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e451d-4ab9-4762-aa51-bfc93b4e9dc2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:38.823967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e451d-4ab9-4762-aa51-bfc93b4e9dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:38.882400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ce3e451d-4ab9-4762-aa51-bfc93b4e9dc2 None None] MFA Rules not processed for user `befbb3620cf74303b72fe451c19fe86b`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:38.883746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ce3e451d-4ab9-4762-aa51-bfc93b4e9dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:38.895620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:39.002418 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1816/3675] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:39.007872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8a0fd-c603-4307-aac3-df9f558cb35c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:39.021938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8a0fd-c603-4307-aac3-df9f558cb35c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:39.028188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208d260-e233-468c-9089-3779fbbed25a tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befbb3620cf74303b72fe451c19fe86b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d3a0a19e7dd4b42b31cabd939ed453b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:39.028875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d260-e233-468c-9089-3779fbbed25a tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:39.029143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d260-e233-468c-9089-3779fbbed25a tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:39.029429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d260-e233-468c-9089-3779fbbed25a tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:39.038342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208d260-e233-468c-9089-3779fbbed25a tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:39.045014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208d260-e233-468c-9089-3779fbbed25a tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-5208d260-e233-468c-9089-3779fbbed25a tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invalid input for field 'name': '' is too short Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: Failed validating 'minLength' in schema['properties']['name']: Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: On instance['name']: Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: Failed validating 'minLength' in schema['properties']['name']: Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: On instance['name']: Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: '' Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise error Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application On instance['name']: Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application '' Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:39.100440 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:11:39.106347 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:39.106347 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:39.106347 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:11:39.106347 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:11:39.106347 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:11:39.106347 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:11:39.106347 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:11:39.106347 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:11:39.106347 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:11:39.106347 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:11:39.106347 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:11:39.106347 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:11:39.106347 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jul 02 21:11:39.106347 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jul 02 21:11:39.106347 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 02 21:11:39.106347 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 02 21:11:39.106347 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 02 21:11:39.108349 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 02 21:11:39.108349 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 02 21:11:39.108349 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:39.108349 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 02 21:11:39.108349 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 02 21:11:39.108349 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:39.108349 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application On instance['name']: Jul 02 21:11:39.108349 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application '' Jul 02 21:11:39.108349 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:39.108349 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1860/3676] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:11:39 2022] POST /identity/v3/domains => generated 283 bytes in 94 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 02 21:11:39.112613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e451d-4ab9-4762-aa51-bfc93b4e9dc2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:39.136883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e451d-4ab9-4762-aa51-bfc93b4e9dc2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:39.151942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156ebaa-113b-4fb8-ab63-5f1724ce6ec0 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befbb3620cf74303b72fe451c19fe86b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d3a0a19e7dd4b42b31cabd939ed453b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:39.152784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156ebaa-113b-4fb8-ab63-5f1724ce6ec0 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:39.153186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156ebaa-113b-4fb8-ab63-5f1724ce6ec0 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:39.153474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156ebaa-113b-4fb8-ab63-5f1724ce6ec0 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:39.154770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156ebaa-113b-4fb8-ab63-5f1724ce6ec0 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:39.156358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156ebaa-113b-4fb8-ab63-5f1724ce6ec0 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-b156ebaa-113b-4fb8-ab63-5f1724ce6ec0 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: Failed validating 'maxLength' in schema['properties']['name']: Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: On instance['name']: Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: Failed validating 'maxLength' in schema['properties']['name']: Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: On instance['name']: Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise error Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 02 21:11:39.170903 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:11:39.172453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application On instance['name']: Jul 02 21:11:39.172453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 02 21:11:39.172453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:11:39.172453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:11:39.172453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:11:39.172453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:39.172453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:11:39.172453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:11:39.172453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:11:39.172453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:11:39.172453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:11:39.172453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:11:39.172453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:11:39.172453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:11:39.172453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:11:39.172453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:11:39.172453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jul 02 21:11:39.172453 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jul 02 21:11:39.178998 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 02 21:11:39.178998 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 02 21:11:39.178998 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 02 21:11:39.178998 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 02 21:11:39.178998 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:11:39.178998 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:11:39.178998 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 02 21:11:39.178998 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 02 21:11:39.178998 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:11:39.178998 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application On instance['name']: Jul 02 21:11:39.178998 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 02 21:11:39.178998 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:11:39.178998 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1817/3677] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:11:39 2022] POST /identity/v3/domains => generated 412 bytes in 61 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 02 21:11:39.182874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208d260-e233-468c-9089-3779fbbed25a tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:39.194015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208d260-e233-468c-9089-3779fbbed25a tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:39.212489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d81e0-c93a-4207-bc7c-87ae01bd26a3 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befbb3620cf74303b72fe451c19fe86b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d3a0a19e7dd4b42b31cabd939ed453b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:39.214455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d81e0-c93a-4207-bc7c-87ae01bd26a3 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:39.215504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d81e0-c93a-4207-bc7c-87ae01bd26a3 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:39.216596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d81e0-c93a-4207-bc7c-87ae01bd26a3 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:39.217521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d81e0-c93a-4207-bc7c-87ae01bd26a3 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:39.221000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d81e0-c93a-4207-bc7c-87ae01bd26a3 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:39.242776 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1861/3678] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:11:39 2022] POST /identity/v3/domains => generated 277 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:39.247123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156ebaa-113b-4fb8-ab63-5f1724ce6ec0 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:39.260438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156ebaa-113b-4fb8-ab63-5f1724ce6ec0 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:39.354395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04c7f1-59a8-49b6-9526-41954e9fa901 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befbb3620cf74303b72fe451c19fe86b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d3a0a19e7dd4b42b31cabd939ed453b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:39.355314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04c7f1-59a8-49b6-9526-41954e9fa901 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:39.355612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04c7f1-59a8-49b6-9526-41954e9fa901 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:39.355891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04c7f1-59a8-49b6-9526-41954e9fa901 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] PATH_INFO: `/v3/domains/29097edc175840b09da48eab43c3ca34` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:39.370482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04c7f1-59a8-49b6-9526-41954e9fa901 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=29097edc175840b09da48eab43c3ca34)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:39.372264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04c7f1-59a8-49b6-9526-41954e9fa901 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:39.396161 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-0f04c7f1-59a8-49b6-9526-41954e9fa901 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jul 02 21:11:39.396161 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:39.396161 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:11:39.396161 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:11:39.396161 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:11:39.396161 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:11:39.396161 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:11:39.396161 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:11:39.396161 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:11:39.396161 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:11:39.396161 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:11:39.396161 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:11:39.396161 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Jul 02 21:11:39.396161 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Jul 02 21:11:39.397177 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:11:39.397177 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:11:39.397177 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Jul 02 21:11:39.397177 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Jul 02 21:11:39.397177 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Jul 02 21:11:39.397177 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jul 02 21:11:39.397177 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jul 02 21:11:39.397177 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:11:39.397922 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1818/3679] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:11:39 2022] DELETE /identity/v3/domains/29097edc175840b09da48eab43c3ca34 => generated 120 bytes in 151 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:11:39.401753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d81e0-c93a-4207-bc7c-87ae01bd26a3 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:39.413164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d81e0-c93a-4207-bc7c-87ae01bd26a3 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:39.423190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edaaf8-3191-4bea-9d13-d0fb49574be4 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befbb3620cf74303b72fe451c19fe86b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d3a0a19e7dd4b42b31cabd939ed453b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:39.424247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edaaf8-3191-4bea-9d13-d0fb49574be4 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:39.424597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edaaf8-3191-4bea-9d13-d0fb49574be4 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:39.426100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edaaf8-3191-4bea-9d13-d0fb49574be4 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] PATH_INFO: `/v3/domains/29097edc175840b09da48eab43c3ca34` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:39.429567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edaaf8-3191-4bea-9d13-d0fb49574be4 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=29097edc175840b09da48eab43c3ca34)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:39.433232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edaaf8-3191-4bea-9d13-d0fb49574be4 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:39.459737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:39.465446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-76edaaf8-3191-4bea-9d13-d0fb49574be4 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '29097edc175840b09da48eab43c3ca34'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:39.467461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-76edaaf8-3191-4bea-9d13-d0fb49574be4 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '29097edc175840b09da48eab43c3ca34'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:39.501943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-76edaaf8-3191-4bea-9d13-d0fb49574be4 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '29097edc175840b09da48eab43c3ca34'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:39.503228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-76edaaf8-3191-4bea-9d13-d0fb49574be4 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '29097edc175840b09da48eab43c3ca34'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:39.509847 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1862/3680] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:11:39 2022] PATCH /identity/v3/domains/29097edc175840b09da48eab43c3ca34 => generated 278 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:39.511812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04c7f1-59a8-49b6-9526-41954e9fa901 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:39.513995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0f04c7f1-59a8-49b6-9526-41954e9fa901 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:39.527958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04c7f1-59a8-49b6-9526-41954e9fa901 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:39.669857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befbb3620cf74303b72fe451c19fe86b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d3a0a19e7dd4b42b31cabd939ed453b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:39.670899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:39.671017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:39.671297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] PATH_INFO: `/v3/domains/29097edc175840b09da48eab43c3ca34` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:39.710773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=29097edc175840b09da48eab43c3ca34)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:39.712794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:39.748720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:39.755368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '29097edc175840b09da48eab43c3ca34'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:39.792916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '29097edc175840b09da48eab43c3ca34'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:39.898720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29097edc175840b09da48eab43c3ca34', 'request_id': 'req-899a025f-da50-4064-bb13-27c8e5cd39af'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:39.909127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29097edc175840b09da48eab43c3ca34', 'request_id': 'req-899a025f-da50-4064-bb13-27c8e5cd39af'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:39.917060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29097edc175840b09da48eab43c3ca34', 'request_id': 'req-899a025f-da50-4064-bb13-27c8e5cd39af'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:39.971033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] The token cache is being invalidate because project 29097edc175840b09da48eab43c3ca34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:39.971345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:39.972153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:39.982871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '29097edc175840b09da48eab43c3ca34', 'request_id': 'req-899a025f-da50-4064-bb13-27c8e5cd39af'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:39.983813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '29097edc175840b09da48eab43c3ca34', 'request_id': 'req-899a025f-da50-4064-bb13-27c8e5cd39af'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:39.984546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '29097edc175840b09da48eab43c3ca34', 'request_id': 'req-899a025f-da50-4064-bb13-27c8e5cd39af'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:40.003811 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1819/3681] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:11:39 2022] DELETE /identity/v3/domains/29097edc175840b09da48eab43c3ca34 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:40.005632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edaaf8-3191-4bea-9d13-d0fb49574be4 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:40.019746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edaaf8-3191-4bea-9d13-d0fb49574be4 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:40.263149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8ee9c-7e28-414f-9db0-5debcc0a42c2 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befbb3620cf74303b72fe451c19fe86b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d3a0a19e7dd4b42b31cabd939ed453b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:40.270473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8ee9c-7e28-414f-9db0-5debcc0a42c2 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:40.270718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8ee9c-7e28-414f-9db0-5debcc0a42c2 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:40.273609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8ee9c-7e28-414f-9db0-5debcc0a42c2 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] PATH_INFO: `/v3/domains/bddabff1bcac4432a8d0d70fdfeb8c06` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:40.313534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8ee9c-7e28-414f-9db0-5debcc0a42c2 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 21:11:40.327366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-fce8ee9c-7e28-414f-9db0-5debcc0a42c2 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Could not find domain: bddabff1bcac4432a8d0d70fdfeb8c06.: keystone.exception.DomainNotFound: Could not find domain: bddabff1bcac4432a8d0d70fdfeb8c06. Jul 02 21:11:40.327366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:40.327366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 21:11:40.327366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 21:11:40.327366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:11:40.327366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:11:40.327366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:11:40.327366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:11:40.327366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bddabff1bcac4432a8d0d70fdfeb8c06. Jul 02 21:11:40.327366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:40.327366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:11:40.327366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:40.327366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:40.327366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:11:40.327366 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:11:40.328497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:11:40.328497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:11:40.328497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:11:40.328497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:11:40.328497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:11:40.328497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:11:40.328497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:11:40.328497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:11:40.328497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Jul 02 21:11:40.328497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Jul 02 21:11:40.328497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 21:11:40.328497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 21:11:40.328497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 21:11:40.328497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 21:11:40.328497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:11:40.328497 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:11:40.329532 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:11:40.329532 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:11:40.329532 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:11:40.329532 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:11:40.329532 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:11:40.329532 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 21:11:40.329532 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:11:40.329532 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:11:40.329532 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:11:40.329532 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:11:40.329532 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:11:40.329532 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:11:40.329532 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:11:40.329532 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:11:40.329532 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 21:11:40.329532 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 21:11:40.329532 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: bddabff1bcac4432a8d0d70fdfeb8c06. Jul 02 21:11:40.330563 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:40.333723 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1863/3682] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:11:40 2022] DELETE /identity/v3/domains/bddabff1bcac4432a8d0d70fdfeb8c06 => generated 112 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:11:40.334467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:40.336330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:40.365057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a025f-da50-4064-bb13-27c8e5cd39af tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:40.378009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcf86f-fbf3-45f9-a434-dfa2401ed72f tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befbb3620cf74303b72fe451c19fe86b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d3a0a19e7dd4b42b31cabd939ed453b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:40.379743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcf86f-fbf3-45f9-a434-dfa2401ed72f tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:40.379743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcf86f-fbf3-45f9-a434-dfa2401ed72f tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:40.380026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcf86f-fbf3-45f9-a434-dfa2401ed72f tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:40.380766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcf86f-fbf3-45f9-a434-dfa2401ed72f tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:40.387683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcf86f-fbf3-45f9-a434-dfa2401ed72f tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:40.422240 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1820/3683] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:11:40 2022] POST /identity/v3/domains => generated 252 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:40.428921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8ee9c-7e28-414f-9db0-5debcc0a42c2 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:40.446654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8ee9c-7e28-414f-9db0-5debcc0a42c2 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:40.581348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb8be2-ecea-46d7-a405-8d796ee2519d tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befbb3620cf74303b72fe451c19fe86b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d3a0a19e7dd4b42b31cabd939ed453b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:40.583508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb8be2-ecea-46d7-a405-8d796ee2519d tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:40.584620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb8be2-ecea-46d7-a405-8d796ee2519d tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:40.585283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb8be2-ecea-46d7-a405-8d796ee2519d tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:40.586353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb8be2-ecea-46d7-a405-8d796ee2519d tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:40.588570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb8be2-ecea-46d7-a405-8d796ee2519d tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:40.602796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.sql.core [None req-54fb8be2-ecea-46d7-a405-8d796ee2519d tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-393740697' for key 'project.ixu_project_name_domain_id'") Jul 02 21:11:40.602796 ncdv-master-1 devstack@keystone.service[91078]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 02 21:11:40.602796 ncdv-master-1 devstack@keystone.service[91078]: [parameters: {'id': '34aa2189a4564d1a8fb10acbae6ea2df', 'name': 'tempest-domain-dup-393740697', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jul 02 21:11:40.602796 ncdv-master-1 devstack@keystone.service[91078]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91078) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 02 21:11:40.613413 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-54fb8be2-ecea-46d7-a405-8d796ee2519d tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-393740697.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-393740697. Jul 02 21:11:40.613413 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:40.613413 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 21:11:40.613413 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 21:11:40.613413 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 21:11:40.613413 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 21:11:40.613413 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 21:11:40.613413 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 21:11:40.613413 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 21:11:40.613413 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application conn.query(q) Jul 02 21:11:40.613413 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 21:11:40.613413 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 21:11:40.613413 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 21:11:40.614527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application result.read() Jul 02 21:11:40.614527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 21:11:40.614527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 21:11:40.614527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 21:11:40.614527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 21:11:40.614527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 21:11:40.614527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 21:11:40.614527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 21:11:40.614527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 21:11:40.614527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-393740697' for key 'project.ixu_project_name_domain_id'") Jul 02 21:11:40.614527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:40.614527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 02 21:11:40.614527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:40.614527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:40.614527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 02 21:11:40.614527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 02 21:11:40.614527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 02 21:11:40.614527 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 02 21:11:40.615655 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 21:11:40.615655 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application next(self.gen) Jul 02 21:11:40.615655 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 02 21:11:40.615655 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application yield resource Jul 02 21:11:40.615655 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 21:11:40.615655 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application next(self.gen) Jul 02 21:11:40.615655 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 02 21:11:40.615655 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.session.rollback() Jul 02 21:11:40.615655 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:11:40.615655 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.force_reraise() Jul 02 21:11:40.615655 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:11:40.615655 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise self.value Jul 02 21:11:40.615655 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 02 21:11:40.615655 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 02 21:11:40.615655 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 02 21:11:40.615655 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application session.commit() Jul 02 21:11:40.615655 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 02 21:11:40.617248 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 02 21:11:40.617248 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 02 21:11:40.617248 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._prepare_impl() Jul 02 21:11:40.617248 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 02 21:11:40.617248 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.session.flush() Jul 02 21:11:40.617248 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 02 21:11:40.617248 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._flush(objects) Jul 02 21:11:40.617248 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 02 21:11:40.617248 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 02 21:11:40.617248 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 02 21:11:40.617248 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application compat.raise_( Jul 02 21:11:40.617248 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 21:11:40.617248 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception Jul 02 21:11:40.617248 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 02 21:11:40.617248 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application flush_context.execute() Jul 02 21:11:40.617248 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 02 21:11:40.617248 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rec.execute(self) Jul 02 21:11:40.618850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 02 21:11:40.618850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 02 21:11:40.618850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 02 21:11:40.618850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 02 21:11:40.618850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 02 21:11:40.618850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 02 21:11:40.618850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 02 21:11:40.618850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 02 21:11:40.618850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 02 21:11:40.618850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 02 21:11:40.618850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 02 21:11:40.618850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 02 21:11:40.618850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 02 21:11:40.618850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 02 21:11:40.618850 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 02 21:11:40.620418 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 02 21:11:40.620418 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 21:11:40.620418 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception Jul 02 21:11:40.620418 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 21:11:40.620418 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 21:11:40.620418 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 21:11:40.620418 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 21:11:40.620418 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 21:11:40.620418 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 21:11:40.620418 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 21:11:40.620418 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application conn.query(q) Jul 02 21:11:40.620418 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 21:11:40.620418 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 21:11:40.620418 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 21:11:40.620418 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application result.read() Jul 02 21:11:40.620418 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 21:11:40.620418 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 21:11:40.622908 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 21:11:40.622908 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 21:11:40.622908 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 21:11:40.622908 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 21:11:40.622908 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 21:11:40.622908 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 21:11:40.622908 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-393740697' for key 'project.ixu_project_name_domain_id'") Jul 02 21:11:40.622908 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 02 21:11:40.622908 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [parameters: {'id': '34aa2189a4564d1a8fb10acbae6ea2df', 'name': 'tempest-domain-dup-393740697', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jul 02 21:11:40.622908 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 02 21:11:40.622908 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:40.622908 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:11:40.622908 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:40.622908 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:40.624402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 02 21:11:40.624402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 02 21:11:40.624402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 02 21:11:40.624402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 02 21:11:40.624402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-393740697. Jul 02 21:11:40.624402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:40.624402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:11:40.624402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:40.624402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:40.624402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:11:40.624402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:11:40.624402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:11:40.624402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:11:40.624402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:11:40.624402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:11:40.624402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:11:40.624402 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:11:40.626198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:11:40.626198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:11:40.626198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Jul 02 21:11:40.626198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Jul 02 21:11:40.626198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:11:40.626198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:11:40.626198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Jul 02 21:11:40.626198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Jul 02 21:11:40.626198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:11:40.626198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:11:40.626198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 02 21:11:40.626198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 02 21:11:40.626198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-393740697. Jul 02 21:11:40.626198 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:11:40.626198 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1864/3684] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:11:40 2022] POST /identity/v3/domains => generated 211 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 02 21:11:40.627741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcf86f-fbf3-45f9-a434-dfa2401ed72f tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:40.635180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcf86f-fbf3-45f9-a434-dfa2401ed72f tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:40.653363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac4b69-85e5-4cf7-9cdd-8135feb82b89 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befbb3620cf74303b72fe451c19fe86b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d3a0a19e7dd4b42b31cabd939ed453b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:40.654258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac4b69-85e5-4cf7-9cdd-8135feb82b89 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:40.654686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac4b69-85e5-4cf7-9cdd-8135feb82b89 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:40.654953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac4b69-85e5-4cf7-9cdd-8135feb82b89 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] PATH_INFO: `/v3/domains/7c0b4e1923d74b249264515d34c4c7ef` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:40.681500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac4b69-85e5-4cf7-9cdd-8135feb82b89 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7c0b4e1923d74b249264515d34c4c7ef)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:40.683388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac4b69-85e5-4cf7-9cdd-8135feb82b89 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:40.722946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-15ac4b69-85e5-4cf7-9cdd-8135feb82b89 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7c0b4e1923d74b249264515d34c4c7ef'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:40.723716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-15ac4b69-85e5-4cf7-9cdd-8135feb82b89 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7c0b4e1923d74b249264515d34c4c7ef'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:40.769237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-15ac4b69-85e5-4cf7-9cdd-8135feb82b89 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7c0b4e1923d74b249264515d34c4c7ef'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:40.770635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-15ac4b69-85e5-4cf7-9cdd-8135feb82b89 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7c0b4e1923d74b249264515d34c4c7ef'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:40.774829 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1821/3685] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:11:40 2022] PATCH /identity/v3/domains/7c0b4e1923d74b249264515d34c4c7ef => generated 253 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:40.778951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb8be2-ecea-46d7-a405-8d796ee2519d tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:40.781150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-54fb8be2-ecea-46d7-a405-8d796ee2519d tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:40.806345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb8be2-ecea-46d7-a405-8d796ee2519d tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:40.905009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befbb3620cf74303b72fe451c19fe86b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d3a0a19e7dd4b42b31cabd939ed453b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:40.906496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:40.907175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:40.907758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] PATH_INFO: `/v3/domains/7c0b4e1923d74b249264515d34c4c7ef` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:40.923475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7c0b4e1923d74b249264515d34c4c7ef)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:40.926568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:40.949426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:40.966394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7c0b4e1923d74b249264515d34c4c7ef'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:40.984927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7c0b4e1923d74b249264515d34c4c7ef'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:41.057466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0b4e1923d74b249264515d34c4c7ef', 'request_id': 'req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:41.074996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0b4e1923d74b249264515d34c4c7ef', 'request_id': 'req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:41.092603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0b4e1923d74b249264515d34c4c7ef', 'request_id': 'req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:41.130747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] The token cache is being invalidate because project 7c0b4e1923d74b249264515d34c4c7ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:41.131289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:41.132435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:41.153874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7c0b4e1923d74b249264515d34c4c7ef', 'request_id': 'req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:41.154700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7c0b4e1923d74b249264515d34c4c7ef', 'request_id': 'req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:41.155548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7c0b4e1923d74b249264515d34c4c7ef', 'request_id': 'req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:41.172687 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1865/3686] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:11:40 2022] DELETE /identity/v3/domains/7c0b4e1923d74b249264515d34c4c7ef => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:41.173413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac4b69-85e5-4cf7-9cdd-8135feb82b89 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:41.185234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac4b69-85e5-4cf7-9cdd-8135feb82b89 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:41.289798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ddfa3-021e-4443-93ed-b0886ec265b1 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'befbb3620cf74303b72fe451c19fe86b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d3a0a19e7dd4b42b31cabd939ed453b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:41.290723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ddfa3-021e-4443-93ed-b0886ec265b1 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:41.291007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ddfa3-021e-4443-93ed-b0886ec265b1 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:41.291285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ddfa3-021e-4443-93ed-b0886ec265b1 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] PATH_INFO: `/v3/domains/29097edc175840b09da48eab43c3ca34` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:41.293895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:41.300021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ddfa3-021e-4443-93ed-b0886ec265b1 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 21:11:41.321572 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-9c0ddfa3-021e-4443-93ed-b0886ec265b1 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Could not find domain: 29097edc175840b09da48eab43c3ca34.: keystone.exception.DomainNotFound: Could not find domain: 29097edc175840b09da48eab43c3ca34. Jul 02 21:11:41.321572 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:41.321572 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 21:11:41.321572 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 21:11:41.321572 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:11:41.321572 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:11:41.321572 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:11:41.321572 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:11:41.321572 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 29097edc175840b09da48eab43c3ca34. Jul 02 21:11:41.321572 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:11:41.321572 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:11:41.321572 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:11:41.321572 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:11:41.321572 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:11:41.321572 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:11:41.322889 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:11:41.322889 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:11:41.322889 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:11:41.322889 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:11:41.322889 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:11:41.322889 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:11:41.322889 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:11:41.322889 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:11:41.322889 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 02 21:11:41.322889 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 02 21:11:41.322889 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 21:11:41.322889 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 21:11:41.322889 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 21:11:41.322889 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 21:11:41.322889 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:11:41.322889 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:11:41.324022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:11:41.324022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:11:41.324022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:11:41.324022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:11:41.324022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:11:41.324022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 21:11:41.324022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:11:41.324022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:11:41.324022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:11:41.324022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:11:41.324022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:11:41.324022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:11:41.324022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:11:41.324022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:11:41.324022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 21:11:41.324022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 21:11:41.324022 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 29097edc175840b09da48eab43c3ca34. Jul 02 21:11:41.325140 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:11:41.331403 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1822/3687] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:11:41 2022] PATCH /identity/v3/domains/29097edc175840b09da48eab43c3ca34 => generated 112 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 02 21:11:41.339226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:41.355481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:41.526185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cc0e7-23ff-44f7-8a5f-b4e9f84ae8f6 tempest-DomainsNegativeTestJSON-1486146762 tempest-DomainsNegativeTestJSON-1486146762-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:41.535913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c71972-c4e6-498f-b756-f3b013f507ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:41.537953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c71972-c4e6-498f-b756-f3b013f507ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:41.542775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c71972-c4e6-498f-b756-f3b013f507ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:41.543458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c71972-c4e6-498f-b756-f3b013f507ab admin admin] PATH_INFO: `/v3/users/98ed29675cef4215a07a816f35efc100` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:41.545681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c71972-c4e6-498f-b756-f3b013f507ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ed29675cef4215a07a816f35efc100)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:41.548099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c71972-c4e6-498f-b756-f3b013f507ab admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:41.685360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b3c71972-c4e6-498f-b756-f3b013f507ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ed29675cef4215a07a816f35efc100'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:41.701742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b3c71972-c4e6-498f-b756-f3b013f507ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ed29675cef4215a07a816f35efc100'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:41.706452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b3c71972-c4e6-498f-b756-f3b013f507ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ed29675cef4215a07a816f35efc100'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:41.710557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b3c71972-c4e6-498f-b756-f3b013f507ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ed29675cef4215a07a816f35efc100'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:41.712189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:41.731039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b3c71972-c4e6-498f-b756-f3b013f507ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ed29675cef4215a07a816f35efc100'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:41.787817 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1866/3688] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:11:41 2022] DELETE /identity/v3/users/98ed29675cef4215a07a816f35efc100 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:41.792688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd4ef0-63fa-4713-b9c1-ab3736b3939c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:41.793407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd4ef0-63fa-4713-b9c1-ab3736b3939c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:41.793883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd4ef0-63fa-4713-b9c1-ab3736b3939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:41.857822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-70cd4ef0-63fa-4713-b9c1-ab3736b3939c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:41.860224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-70cd4ef0-63fa-4713-b9c1-ab3736b3939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:41.907969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419b15e-7a38-4ae4-a7e9-915b335ac9d0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:41.908236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419b15e-7a38-4ae4-a7e9-915b335ac9d0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:41.908752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419b15e-7a38-4ae4-a7e9-915b335ac9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:42.043300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0419b15e-7a38-4ae4-a7e9-915b335ac9d0 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:42.047136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0419b15e-7a38-4ae4-a7e9-915b335ac9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:42.093932 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1823/3689] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:42.105133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd4ef0-63fa-4713-b9c1-ab3736b3939c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:42.109630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-70cd4ef0-63fa-4713-b9c1-ab3736b3939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:42.179746 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1867/3690] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:11:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:42.189748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419b15e-7a38-4ae4-a7e9-915b335ac9d0 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:42.193896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0419b15e-7a38-4ae4-a7e9-915b335ac9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:42.214219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd4ef0-63fa-4713-b9c1-ab3736b3939c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:42.224248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9724a0-ad82-408c-a017-345aad147f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:42.226139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9724a0-ad82-408c-a017-345aad147f21 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:42.232506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9724a0-ad82-408c-a017-345aad147f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:42.233072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9724a0-ad82-408c-a017-345aad147f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:42.254510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9724a0-ad82-408c-a017-345aad147f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:42.256454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9724a0-ad82-408c-a017-345aad147f21 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:42.275637 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1824/3691] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:11:42.365674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419b15e-7a38-4ae4-a7e9-915b335ac9d0 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:42.375186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a54247-e308-4cd8-b18f-1d4bb4cf52bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:42.375984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a54247-e308-4cd8-b18f-1d4bb4cf52bb service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:42.376429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a54247-e308-4cd8-b18f-1d4bb4cf52bb service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:42.376772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a54247-e308-4cd8-b18f-1d4bb4cf52bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:42.390616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a54247-e308-4cd8-b18f-1d4bb4cf52bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:42.392391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a54247-e308-4cd8-b18f-1d4bb4cf52bb service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:42.405967 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1868/3692] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:11:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 02 21:11:43.184063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9724a0-ad82-408c-a017-345aad147f21 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:43.185577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ff9724a0-ad82-408c-a017-345aad147f21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:43.221300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9724a0-ad82-408c-a017-345aad147f21 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:43.243565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41d027-129a-4b7c-9856-e7c8e30ea902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:43.244418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41d027-129a-4b7c-9856-e7c8e30ea902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:43.244702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41d027-129a-4b7c-9856-e7c8e30ea902 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:43.244993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41d027-129a-4b7c-9856-e7c8e30ea902 admin admin] PATH_INFO: `/v3/projects/52f65b023c754c41b0576c8a2c59dbf4` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:43.247870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41d027-129a-4b7c-9856-e7c8e30ea902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f65b023c754c41b0576c8a2c59dbf4)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:43.255930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41d027-129a-4b7c-9856-e7c8e30ea902 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:43.445299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2f41d027-129a-4b7c-9856-e7c8e30ea902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f65b023c754c41b0576c8a2c59dbf4', 'request_id': 'req-2f41d027-129a-4b7c-9856-e7c8e30ea902'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:43.478033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2f41d027-129a-4b7c-9856-e7c8e30ea902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f65b023c754c41b0576c8a2c59dbf4', 'request_id': 'req-2f41d027-129a-4b7c-9856-e7c8e30ea902'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:43.522728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2f41d027-129a-4b7c-9856-e7c8e30ea902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f65b023c754c41b0576c8a2c59dbf4', 'request_id': 'req-2f41d027-129a-4b7c-9856-e7c8e30ea902'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:43.580101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2f41d027-129a-4b7c-9856-e7c8e30ea902 admin admin] The token cache is being invalidate because project 52f65b023c754c41b0576c8a2c59dbf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:43.582416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2f41d027-129a-4b7c-9856-e7c8e30ea902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:43.583575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2f41d027-129a-4b7c-9856-e7c8e30ea902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:43.588665 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1825/3693] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:43 2022] DELETE /identity/v3/projects/52f65b023c754c41b0576c8a2c59dbf4 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:43.593316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a54247-e308-4cd8-b18f-1d4bb4cf52bb service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:43.631679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a54247-e308-4cd8-b18f-1d4bb4cf52bb service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:43.697424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:43.930927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7ae1d-cef6-4f78-8ba2-14a5fc530f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:43.933121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7ae1d-cef6-4f78-8ba2-14a5fc530f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:43.933121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7ae1d-cef6-4f78-8ba2-14a5fc530f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:43.933121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7ae1d-cef6-4f78-8ba2-14a5fc530f33 admin admin] PATH_INFO: `/v3/users/befbb3620cf74303b72fe451c19fe86b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:43.934608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7ae1d-cef6-4f78-8ba2-14a5fc530f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=befbb3620cf74303b72fe451c19fe86b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:43.937057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7ae1d-cef6-4f78-8ba2-14a5fc530f33 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:44.047644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-62e7ae1d-cef6-4f78-8ba2-14a5fc530f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'befbb3620cf74303b72fe451c19fe86b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:44.081577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-62e7ae1d-cef6-4f78-8ba2-14a5fc530f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'befbb3620cf74303b72fe451c19fe86b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:44.082951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-62e7ae1d-cef6-4f78-8ba2-14a5fc530f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'befbb3620cf74303b72fe451c19fe86b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:44.083816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-62e7ae1d-cef6-4f78-8ba2-14a5fc530f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'befbb3620cf74303b72fe451c19fe86b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:44.096623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-62e7ae1d-cef6-4f78-8ba2-14a5fc530f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'befbb3620cf74303b72fe451c19fe86b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:44.159763 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1869/3694] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:11:43 2022] DELETE /identity/v3/users/befbb3620cf74303b72fe451c19fe86b => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:45.813996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41d027-129a-4b7c-9856-e7c8e30ea902 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:45.816287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2f41d027-129a-4b7c-9856-e7c8e30ea902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:45.892475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:45.949212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41d027-129a-4b7c-9856-e7c8e30ea902 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:46.068162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ccae9-a927-43bf-a86c-528fb996b42f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:46.068900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ccae9-a927-43bf-a86c-528fb996b42f service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:46.069235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ccae9-a927-43bf-a86c-528fb996b42f service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:46.069514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ccae9-a927-43bf-a86c-528fb996b42f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:46.074775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7f4ccae9-a927-43bf-a86c-528fb996b42f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:46.108988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ccae9-a927-43bf-a86c-528fb996b42f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:46.110500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ccae9-a927-43bf-a86c-528fb996b42f service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:46.139477 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1826/3695] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:11:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:11:46.328246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7ae1d-cef6-4f78-8ba2-14a5fc530f33 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:46.330139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-62e7ae1d-cef6-4f78-8ba2-14a5fc530f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:46.350315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7ae1d-cef6-4f78-8ba2-14a5fc530f33 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:46.359522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289780f-cee9-4d46-819f-8019d65e2518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:46.360243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289780f-cee9-4d46-819f-8019d65e2518 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:46.360530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289780f-cee9-4d46-819f-8019d65e2518 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:46.360804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289780f-cee9-4d46-819f-8019d65e2518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:46.383104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289780f-cee9-4d46-819f-8019d65e2518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:46.384568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289780f-cee9-4d46-819f-8019d65e2518 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:46.403838 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1870/3696] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:11:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:11:47.380160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ccae9-a927-43bf-a86c-528fb996b42f service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:47.381829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7f4ccae9-a927-43bf-a86c-528fb996b42f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:47.614337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ccae9-a927-43bf-a86c-528fb996b42f service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:47.662733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c838e50-ddea-4865-bf09-b0d32bacd816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:47.662733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c838e50-ddea-4865-bf09-b0d32bacd816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:47.662733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c838e50-ddea-4865-bf09-b0d32bacd816 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:47.662733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c838e50-ddea-4865-bf09-b0d32bacd816 admin admin] PATH_INFO: `/v3/projects/5d3a0a19e7dd4b42b31cabd939ed453b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:47.675246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c838e50-ddea-4865-bf09-b0d32bacd816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d3a0a19e7dd4b42b31cabd939ed453b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:47.692292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c838e50-ddea-4865-bf09-b0d32bacd816 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:47.814587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9c838e50-ddea-4865-bf09-b0d32bacd816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d3a0a19e7dd4b42b31cabd939ed453b', 'request_id': 'req-9c838e50-ddea-4865-bf09-b0d32bacd816'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:47.822218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9c838e50-ddea-4865-bf09-b0d32bacd816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d3a0a19e7dd4b42b31cabd939ed453b', 'request_id': 'req-9c838e50-ddea-4865-bf09-b0d32bacd816'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:47.843026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9c838e50-ddea-4865-bf09-b0d32bacd816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d3a0a19e7dd4b42b31cabd939ed453b', 'request_id': 'req-9c838e50-ddea-4865-bf09-b0d32bacd816'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:47.865596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9c838e50-ddea-4865-bf09-b0d32bacd816 admin admin] The token cache is being invalidate because project 5d3a0a19e7dd4b42b31cabd939ed453b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:47.866036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9c838e50-ddea-4865-bf09-b0d32bacd816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:47.866821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9c838e50-ddea-4865-bf09-b0d32bacd816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:47.872443 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1827/3697] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:47 2022] DELETE /identity/v3/projects/5d3a0a19e7dd4b42b31cabd939ed453b => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:47.875179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a9b59-6b23-40ac-9cf7-1d7664ec04d0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:47.875700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a9b59-6b23-40ac-9cf7-1d7664ec04d0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:47.876019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a9b59-6b23-40ac-9cf7-1d7664ec04d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:47.928127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2b0a9b59-6b23-40ac-9cf7-1d7664ec04d0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:47.931804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2b0a9b59-6b23-40ac-9cf7-1d7664ec04d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:48.055660 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1871/3698] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:48.057148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43af5c2-7b0f-408b-96f2-14d9aa776e23 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:48.057561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43af5c2-7b0f-408b-96f2-14d9aa776e23 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:48.057905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43af5c2-7b0f-408b-96f2-14d9aa776e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:48.100636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c43af5c2-7b0f-408b-96f2-14d9aa776e23 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:48.102001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c43af5c2-7b0f-408b-96f2-14d9aa776e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:48.127217 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1828/3699] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:48.129140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a9b59-6b23-40ac-9cf7-1d7664ec04d0 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:48.144726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a9b59-6b23-40ac-9cf7-1d7664ec04d0 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:48.155974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d71f7-b335-4ac4-98c7-bd75c949535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:48.157239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d71f7-b335-4ac4-98c7-bd75c949535b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:48.165066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d71f7-b335-4ac4-98c7-bd75c949535b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:48.166303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d71f7-b335-4ac4-98c7-bd75c949535b admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:48.167313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d71f7-b335-4ac4-98c7-bd75c949535b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:11:48.167821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d71f7-b335-4ac4-98c7-bd75c949535b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:48.173061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d71f7-b335-4ac4-98c7-bd75c949535b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:48.207205 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1872/3700] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:48.208185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43af5c2-7b0f-408b-96f2-14d9aa776e23 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:48.221256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43af5c2-7b0f-408b-96f2-14d9aa776e23 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:48.234931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5353fe-ec05-417e-9298-807fd860b35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:48.235701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5353fe-ec05-417e-9298-807fd860b35d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:48.236070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5353fe-ec05-417e-9298-807fd860b35d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:48.236488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5353fe-ec05-417e-9298-807fd860b35d admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:48.237269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5353fe-ec05-417e-9298-807fd860b35d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:48.244810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5353fe-ec05-417e-9298-807fd860b35d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:48.255178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:48.321646 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1829/3701] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:11:48 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:11:48.323361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d71f7-b335-4ac4-98c7-bd75c949535b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:48.349790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d71f7-b335-4ac4-98c7-bd75c949535b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:48.367861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:48.596731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9982fe-78c5-4dbb-8f6c-0173558b0552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:48.597630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9982fe-78c5-4dbb-8f6c-0173558b0552 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:48.598169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9982fe-78c5-4dbb-8f6c-0173558b0552 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:48.598548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9982fe-78c5-4dbb-8f6c-0173558b0552 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:48.599339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9982fe-78c5-4dbb-8f6c-0173558b0552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:48.601762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9982fe-78c5-4dbb-8f6c-0173558b0552 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:48.642947 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1873/3702] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:11:48 2022] POST /identity/v3/users => generated 283 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:48.644372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5353fe-ec05-417e-9298-807fd860b35d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:48.668300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5353fe-ec05-417e-9298-807fd860b35d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:48.683409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d7e72-484f-4020-b34c-c9ed6616171c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:48.684136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d7e72-484f-4020-b34c-c9ed6616171c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:48.684428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d7e72-484f-4020-b34c-c9ed6616171c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:48.684705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d7e72-484f-4020-b34c-c9ed6616171c admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:48.685443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d7e72-484f-4020-b34c-c9ed6616171c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:48.687668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d7e72-484f-4020-b34c-c9ed6616171c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:48.726809 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1830/3703] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:11:48.728083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9982fe-78c5-4dbb-8f6c-0173558b0552 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:48.750756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9982fe-78c5-4dbb-8f6c-0173558b0552 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:48.767042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1f671-ce17-444a-9b6a-2a028bcb27ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:48.767752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1f671-ce17-444a-9b6a-2a028bcb27ed admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:48.768070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1f671-ce17-444a-9b6a-2a028bcb27ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:48.768397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1f671-ce17-444a-9b6a-2a028bcb27ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:48.769184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1f671-ce17-444a-9b6a-2a028bcb27ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:48.770837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1f671-ce17-444a-9b6a-2a028bcb27ed admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:48.819710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d7e72-484f-4020-b34c-c9ed6616171c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:48.827266 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1874/3704] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:11:48.831359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d7e72-484f-4020-b34c-c9ed6616171c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:48.842053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f601f-12e9-452e-b627-075c548e4241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:48.842984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f601f-12e9-452e-b627-075c548e4241 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:48.843268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f601f-12e9-452e-b627-075c548e4241 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:48.843574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f601f-12e9-452e-b627-075c548e4241 admin admin] PATH_INFO: `/v3/projects/2d68fcccf81f4513883a9216fc5229bf/users/d51c860aa66347c28afea95f1d4e38ce/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:48.884186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f601f-12e9-452e-b627-075c548e4241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d68fcccf81f4513883a9216fc5229bf, user_id=d51c860aa66347c28afea95f1d4e38ce, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:48.886879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f601f-12e9-452e-b627-075c548e4241 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:48.921978 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1831/3705] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:11:48 2022] PUT /identity/v3/projects/2d68fcccf81f4513883a9216fc5229bf/users/d51c860aa66347c28afea95f1d4e38ce/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:48.933624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbf2f6-a27a-467c-b20b-beee6b4f0be2 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:48.934165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbf2f6-a27a-467c-b20b-beee6b4f0be2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:48.934165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbf2f6-a27a-467c-b20b-beee6b4f0be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:48.988058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a1cbf2f6-a27a-467c-b20b-beee6b4f0be2 None None] MFA Rules not processed for user `d51c860aa66347c28afea95f1d4e38ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:48.989305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a1cbf2f6-a27a-467c-b20b-beee6b4f0be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:49.184577 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1875/3706] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:49.188855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f601f-12e9-452e-b627-075c548e4241 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:49.327472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f601f-12e9-452e-b627-075c548e4241 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:49.352907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae53c0-87ea-4f1b-9423-69c386ee1f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:49.353367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae53c0-87ea-4f1b-9423-69c386ee1f99 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:49.353586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae53c0-87ea-4f1b-9423-69c386ee1f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:49.353863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae53c0-87ea-4f1b-9423-69c386ee1f99 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:49.355855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae53c0-87ea-4f1b-9423-69c386ee1f99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:49.357835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae53c0-87ea-4f1b-9423-69c386ee1f99 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:49.443197 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1832/3707] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:11:49 2022] POST /identity/v3/projects => generated 367 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:49.447725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbf2f6-a27a-467c-b20b-beee6b4f0be2 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:49.462865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbf2f6-a27a-467c-b20b-beee6b4f0be2 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:49.598360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db8e5e-13d7-4cc9-ba64-d9f97cfa2b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:49.599375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db8e5e-13d7-4cc9-ba64-d9f97cfa2b4f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:49.599809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db8e5e-13d7-4cc9-ba64-d9f97cfa2b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:49.600392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db8e5e-13d7-4cc9-ba64-d9f97cfa2b4f admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:49.601525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db8e5e-13d7-4cc9-ba64-d9f97cfa2b4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:49.603670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db8e5e-13d7-4cc9-ba64-d9f97cfa2b4f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:49.652872 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1876/3708] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:11:49 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:49.656549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae53c0-87ea-4f1b-9423-69c386ee1f99 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:49.671384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae53c0-87ea-4f1b-9423-69c386ee1f99 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:49.679277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb273af5-d454-4976-a897-753ff2db6ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:49.680315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb273af5-d454-4976-a897-753ff2db6ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:49.680766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb273af5-d454-4976-a897-753ff2db6ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:49.681269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb273af5-d454-4976-a897-753ff2db6ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:49.682049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb273af5-d454-4976-a897-753ff2db6ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:49.683829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb273af5-d454-4976-a897-753ff2db6ae8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:49.696935 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1833/3709] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:11:49.700878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db8e5e-13d7-4cc9-ba64-d9f97cfa2b4f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:49.708057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:49.712512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db8e5e-13d7-4cc9-ba64-d9f97cfa2b4f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:49.718885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80caa0-305a-4715-89a3-16323a42b2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:49.720186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80caa0-305a-4715-89a3-16323a42b2c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:49.720688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80caa0-305a-4715-89a3-16323a42b2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:49.721152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80caa0-305a-4715-89a3-16323a42b2c3 admin admin] PATH_INFO: `/v3/projects/747a0cdf18dc419aadd89bbb5b4019b1/users/22b0eefae3f34c0f94bf3ac52312a845/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:49.740858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80caa0-305a-4715-89a3-16323a42b2c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=747a0cdf18dc419aadd89bbb5b4019b1, user_id=22b0eefae3f34c0f94bf3ac52312a845, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:49.744353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80caa0-305a-4715-89a3-16323a42b2c3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:49.802388 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1877/3710] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:11:49 2022] PUT /identity/v3/projects/747a0cdf18dc419aadd89bbb5b4019b1/users/22b0eefae3f34c0f94bf3ac52312a845/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:49.804234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb273af5-d454-4976-a897-753ff2db6ae8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:49.816819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb273af5-d454-4976-a897-753ff2db6ae8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:49.930133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1c5ce-179f-4ccf-bcc9-bc415c3b4678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:49.930881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1c5ce-179f-4ccf-bcc9-bc415c3b4678 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:49.990676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1c5ce-179f-4ccf-bcc9-bc415c3b4678 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:49.990676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1c5ce-179f-4ccf-bcc9-bc415c3b4678 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:49.990676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1c5ce-179f-4ccf-bcc9-bc415c3b4678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:49.990676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1c5ce-179f-4ccf-bcc9-bc415c3b4678 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:50.027344 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1834/3711] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:11:50.047740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80caa0-305a-4715-89a3-16323a42b2c3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:50.079109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80caa0-305a-4715-89a3-16323a42b2c3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:50.102173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7066467-a5dc-4fbf-a242-860fc540e41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:50.102173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7066467-a5dc-4fbf-a242-860fc540e41a admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:50.102173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7066467-a5dc-4fbf-a242-860fc540e41a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:50.102173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7066467-a5dc-4fbf-a242-860fc540e41a admin admin] PATH_INFO: `/v3/projects/747a0cdf18dc419aadd89bbb5b4019b1/users/22b0eefae3f34c0f94bf3ac52312a845/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:50.102680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7066467-a5dc-4fbf-a242-860fc540e41a admin admin] RBAC: Authorizing `identity:create_grant(project_id=747a0cdf18dc419aadd89bbb5b4019b1, user_id=22b0eefae3f34c0f94bf3ac52312a845, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:50.120391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7066467-a5dc-4fbf-a242-860fc540e41a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:50.176968 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1878/3712] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:11:50 2022] PUT /identity/v3/projects/747a0cdf18dc419aadd89bbb5b4019b1/users/22b0eefae3f34c0f94bf3ac52312a845/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:50.190097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae909f4-5d11-469a-8af4-4da0958895cc None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:50.190403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae909f4-5d11-469a-8af4-4da0958895cc None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:50.190717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae909f4-5d11-469a-8af4-4da0958895cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:50.243735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bae909f4-5d11-469a-8af4-4da0958895cc None None] MFA Rules not processed for user `22b0eefae3f34c0f94bf3ac52312a845`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:50.245188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bae909f4-5d11-469a-8af4-4da0958895cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:50.278256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:50.431492 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1835/3713] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:50.437024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7066467-a5dc-4fbf-a242-860fc540e41a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:50.452818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7066467-a5dc-4fbf-a242-860fc540e41a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:50.457970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99d453-5178-4790-88d2-2d1cefce114d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:50.458975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99d453-5178-4790-88d2-2d1cefce114d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:50.459362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99d453-5178-4790-88d2-2d1cefce114d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:50.459780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99d453-5178-4790-88d2-2d1cefce114d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:50.461130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99d453-5178-4790-88d2-2d1cefce114d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:50.463542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99d453-5178-4790-88d2-2d1cefce114d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:50.534835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae909f4-5d11-469a-8af4-4da0958895cc None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:50.550970 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1879/3714] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:11:50 2022] POST /identity/v3/projects => generated 359 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:50.556156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae909f4-5d11-469a-8af4-4da0958895cc None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:50.697618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a6dbe-cca6-4bb4-9804-c06f3c4ffe5a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:50.698332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a6dbe-cca6-4bb4-9804-c06f3c4ffe5a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:50.698602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a6dbe-cca6-4bb4-9804-c06f3c4ffe5a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:50.698882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a6dbe-cca6-4bb4-9804-c06f3c4ffe5a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:50.699869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a6dbe-cca6-4bb4-9804-c06f3c4ffe5a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:50.706014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a6dbe-cca6-4bb4-9804-c06f3c4ffe5a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:50.755310 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1836/3715] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:11:50 2022] POST /identity/v3/users => generated 371 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:50.756909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99d453-5178-4790-88d2-2d1cefce114d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:50.771848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99d453-5178-4790-88d2-2d1cefce114d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:50.777044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33c15d-8e1e-4924-bcca-e1e2cd3e44b9 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:50.777967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33c15d-8e1e-4924-bcca-e1e2cd3e44b9 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:50.778458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33c15d-8e1e-4924-bcca-e1e2cd3e44b9 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:50.778840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33c15d-8e1e-4924-bcca-e1e2cd3e44b9 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/users/16773bf03ba54924aea5629b624f1130` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:50.800754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33c15d-8e1e-4924-bcca-e1e2cd3e44b9 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:get_user(user_id=16773bf03ba54924aea5629b624f1130)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:50.803185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33c15d-8e1e-4924-bcca-e1e2cd3e44b9 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:50.812091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a6dbe-cca6-4bb4-9804-c06f3c4ffe5a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:50.824136 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1880/3716] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:11:50 2022] GET /identity/v3/users/16773bf03ba54924aea5629b624f1130 => generated 371 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:50.829704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a6dbe-cca6-4bb4-9804-c06f3c4ffe5a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:50.834780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799ac2c-0e63-4e9a-bab6-a0b468b66671 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:50.836110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799ac2c-0e63-4e9a-bab6-a0b468b66671 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:50.836494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799ac2c-0e63-4e9a-bab6-a0b468b66671 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:50.836867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799ac2c-0e63-4e9a-bab6-a0b468b66671 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/users/16773bf03ba54924aea5629b624f1130` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:50.838424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799ac2c-0e63-4e9a-bab6-a0b468b66671 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:delete_user(user_id=16773bf03ba54924aea5629b624f1130)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:50.842234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799ac2c-0e63-4e9a-bab6-a0b468b66671 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:50.917981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5799ac2c-0e63-4e9a-bab6-a0b468b66671 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16773bf03ba54924aea5629b624f1130'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:50.931335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5799ac2c-0e63-4e9a-bab6-a0b468b66671 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16773bf03ba54924aea5629b624f1130'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:50.942978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5799ac2c-0e63-4e9a-bab6-a0b468b66671 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16773bf03ba54924aea5629b624f1130'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:50.944299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5799ac2c-0e63-4e9a-bab6-a0b468b66671 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16773bf03ba54924aea5629b624f1130'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:50.945449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5799ac2c-0e63-4e9a-bab6-a0b468b66671 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16773bf03ba54924aea5629b624f1130'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:50.982636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33c15d-8e1e-4924-bcca-e1e2cd3e44b9 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:50.985383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1d33c15d-8e1e-4924-bcca-e1e2cd3e44b9 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:50.986895 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1837/3717] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:11:50 2022] DELETE /identity/v3/users/16773bf03ba54924aea5629b624f1130 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:51.034845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33c15d-8e1e-4924-bcca-e1e2cd3e44b9 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:51.169341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422cb09-6527-4958-9f49-cf21af9d7296 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:51.170974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422cb09-6527-4958-9f49-cf21af9d7296 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:51.172127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422cb09-6527-4958-9f49-cf21af9d7296 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:51.172569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422cb09-6527-4958-9f49-cf21af9d7296 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/projects/ed710b9a74eb42aa99183b4b55642328` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:51.174095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422cb09-6527-4958-9f49-cf21af9d7296 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ed710b9a74eb42aa99183b4b55642328)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:51.176352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422cb09-6527-4958-9f49-cf21af9d7296 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:51.278985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f422cb09-6527-4958-9f49-cf21af9d7296 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed710b9a74eb42aa99183b4b55642328', 'request_id': 'req-f422cb09-6527-4958-9f49-cf21af9d7296'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:51.301012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f422cb09-6527-4958-9f49-cf21af9d7296 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed710b9a74eb42aa99183b4b55642328', 'request_id': 'req-f422cb09-6527-4958-9f49-cf21af9d7296'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:51.317494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f422cb09-6527-4958-9f49-cf21af9d7296 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed710b9a74eb42aa99183b4b55642328', 'request_id': 'req-f422cb09-6527-4958-9f49-cf21af9d7296'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:51.358343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f422cb09-6527-4958-9f49-cf21af9d7296 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] The token cache is being invalidate because project ed710b9a74eb42aa99183b4b55642328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:51.358641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f422cb09-6527-4958-9f49-cf21af9d7296 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:51.360787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f422cb09-6527-4958-9f49-cf21af9d7296 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:51.371974 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1881/3718] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:50 2022] DELETE /identity/v3/projects/ed710b9a74eb42aa99183b4b55642328 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:51.372196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799ac2c-0e63-4e9a-bab6-a0b468b66671 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:51.391049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799ac2c-0e63-4e9a-bab6-a0b468b66671 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:51.402146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:51.521035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ba5b1-5c5a-426e-8a60-51af8b0aca4d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:51.521728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ba5b1-5c5a-426e-8a60-51af8b0aca4d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:51.522001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ba5b1-5c5a-426e-8a60-51af8b0aca4d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:51.522990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ba5b1-5c5a-426e-8a60-51af8b0aca4d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:51.523686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ba5b1-5c5a-426e-8a60-51af8b0aca4d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:51.525607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ba5b1-5c5a-426e-8a60-51af8b0aca4d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:51.566575 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1838/3719] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:11:51 2022] POST /identity/v3/projects => generated 357 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:51.570442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422cb09-6527-4958-9f49-cf21af9d7296 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:51.572021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f422cb09-6527-4958-9f49-cf21af9d7296 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:51.586915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422cb09-6527-4958-9f49-cf21af9d7296 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:51.614438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:51.686314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da4910-6bb0-408c-819d-de5c97634afa tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:51.687389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da4910-6bb0-408c-819d-de5c97634afa tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:51.687564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da4910-6bb0-408c-819d-de5c97634afa tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:51.688222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da4910-6bb0-408c-819d-de5c97634afa tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:51.694429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da4910-6bb0-408c-819d-de5c97634afa tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:51.696538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da4910-6bb0-408c-819d-de5c97634afa tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:51.741772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ba5b1-5c5a-426e-8a60-51af8b0aca4d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:51.748432 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1882/3720] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:11:51 2022] POST /identity/v3/users => generated 414 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:51.757555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ba5b1-5c5a-426e-8a60-51af8b0aca4d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:51.762903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabc35f-74be-4af6-8910-793cfb961b9a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:51.763709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabc35f-74be-4af6-8910-793cfb961b9a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:51.764119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabc35f-74be-4af6-8910-793cfb961b9a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:51.764862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabc35f-74be-4af6-8910-793cfb961b9a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:51.765735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabc35f-74be-4af6-8910-793cfb961b9a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:51.767049 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-beabc35f-74be-4af6-8910-793cfb961b9a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:51.767049 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:11:51.767049 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:11:51.768230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabc35f-74be-4af6-8910-793cfb961b9a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:51.813021 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1839/3721] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:11:51 2022] POST /identity/v3/roles => generated 239 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:11:51.814655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da4910-6bb0-408c-819d-de5c97634afa tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:51.855924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da4910-6bb0-408c-819d-de5c97634afa tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:51.869958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44ff37-743c-4671-a5d1-21af57cc85d2 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:51.870970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44ff37-743c-4671-a5d1-21af57cc85d2 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:51.871323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44ff37-743c-4671-a5d1-21af57cc85d2 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:51.871684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44ff37-743c-4671-a5d1-21af57cc85d2 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/users/be3f8804185d480d88ed2d5802a6a9da` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:51.903559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44ff37-743c-4671-a5d1-21af57cc85d2 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:get_user(user_id=be3f8804185d480d88ed2d5802a6a9da)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:51.908640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44ff37-743c-4671-a5d1-21af57cc85d2 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:51.911962 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1883/3722] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:11:51 2022] GET /identity/v3/users/be3f8804185d480d88ed2d5802a6a9da => generated 414 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:51.915577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabc35f-74be-4af6-8910-793cfb961b9a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:51.932771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabc35f-74be-4af6-8910-793cfb961b9a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:51.939926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd816f9-815a-4b62-855f-8aa9a1ed7b42 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:51.941228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd816f9-815a-4b62-855f-8aa9a1ed7b42 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:51.941739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd816f9-815a-4b62-855f-8aa9a1ed7b42 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:51.942194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd816f9-815a-4b62-855f-8aa9a1ed7b42 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/roles/24e1181e94b24024817dd34acb813a1b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:51.944683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd816f9-815a-4b62-855f-8aa9a1ed7b42 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:get_role(role_id=24e1181e94b24024817dd34acb813a1b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:51.946042 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-bdd816f9-815a-4b62-855f-8aa9a1ed7b42 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:51.946042 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:11:51.946042 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:11:51.947089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd816f9-815a-4b62-855f-8aa9a1ed7b42 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:51.951722 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1840/3723] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:11:51 2022] GET /identity/v3/roles/24e1181e94b24024817dd34acb813a1b => generated 239 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:51.952968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44ff37-743c-4671-a5d1-21af57cc85d2 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:51.967048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44ff37-743c-4671-a5d1-21af57cc85d2 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:51.974277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6b8f9-b088-4da2-a707-59c5033c530d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:51.975242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6b8f9-b088-4da2-a707-59c5033c530d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:51.976111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6b8f9-b088-4da2-a707-59c5033c530d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:51.976353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6b8f9-b088-4da2-a707-59c5033c530d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:51.977251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6b8f9-b088-4da2-a707-59c5033c530d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:51.979348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6b8f9-b088-4da2-a707-59c5033c530d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:52.045414 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1884/3724] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:11:51 2022] POST /identity/v3/projects => generated 359 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:52.049290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd816f9-815a-4b62-855f-8aa9a1ed7b42 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:52.064528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd816f9-815a-4b62-855f-8aa9a1ed7b42 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:52.169043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8bc3c-f9a2-4973-8434-556f60d521e0 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:52.179161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8bc3c-f9a2-4973-8434-556f60d521e0 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:52.179161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8bc3c-f9a2-4973-8434-556f60d521e0 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:52.179161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8bc3c-f9a2-4973-8434-556f60d521e0 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/projects/a9328ca0f26c44128f9ecec85f225dd8` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:52.179161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8bc3c-f9a2-4973-8434-556f60d521e0 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:get_project(project_id=a9328ca0f26c44128f9ecec85f225dd8)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:52.179161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8bc3c-f9a2-4973-8434-556f60d521e0 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:52.179774 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1841/3725] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:11:52 2022] GET /identity/v3/projects/a9328ca0f26c44128f9ecec85f225dd8 => generated 359 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:11:52.181837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6b8f9-b088-4da2-a707-59c5033c530d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:52.196008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6b8f9-b088-4da2-a707-59c5033c530d tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:52.201691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cfafd-ab55-4f41-af6b-2d90b0f119b0 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:52.202656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cfafd-ab55-4f41-af6b-2d90b0f119b0 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:52.202934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cfafd-ab55-4f41-af6b-2d90b0f119b0 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:52.203209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cfafd-ab55-4f41-af6b-2d90b0f119b0 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/projects/a9328ca0f26c44128f9ecec85f225dd8/users/be3f8804185d480d88ed2d5802a6a9da/roles/24e1181e94b24024817dd34acb813a1b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:52.205729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cfafd-ab55-4f41-af6b-2d90b0f119b0 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a9328ca0f26c44128f9ecec85f225dd8, user_id=be3f8804185d480d88ed2d5802a6a9da, role_id=24e1181e94b24024817dd34acb813a1b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:52.208680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cfafd-ab55-4f41-af6b-2d90b0f119b0 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:52.228624 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1885/3726] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:11:52 2022] PUT /identity/v3/projects/a9328ca0f26c44128f9ecec85f225dd8/users/be3f8804185d480d88ed2d5802a6a9da/roles/24e1181e94b24024817dd34acb813a1b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:11:52.233451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8bc3c-f9a2-4973-8434-556f60d521e0 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:52.245155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8bc3c-f9a2-4973-8434-556f60d521e0 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:52.325721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f509ff1-e3ac-40f5-8c60-483aaf1ee3ef tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:52.326401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f509ff1-e3ac-40f5-8c60-483aaf1ee3ef tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:52.326683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f509ff1-e3ac-40f5-8c60-483aaf1ee3ef tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:52.326959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f509ff1-e3ac-40f5-8c60-483aaf1ee3ef tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:52.327654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f509ff1-e3ac-40f5-8c60-483aaf1ee3ef tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:52.329612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f509ff1-e3ac-40f5-8c60-483aaf1ee3ef tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:52.373235 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1842/3727] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:11:52 2022] POST /identity/v3/projects => generated 359 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:52.377829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cfafd-ab55-4f41-af6b-2d90b0f119b0 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:52.395241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cfafd-ab55-4f41-af6b-2d90b0f119b0 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:52.492167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c6a58-3737-45f7-a5ca-b63add2048f4 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:52.493014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c6a58-3737-45f7-a5ca-b63add2048f4 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:52.493302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c6a58-3737-45f7-a5ca-b63add2048f4 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:52.493582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c6a58-3737-45f7-a5ca-b63add2048f4 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/projects/3dafbe45be8241c3abf3503ad3a9b99d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:52.494802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c6a58-3737-45f7-a5ca-b63add2048f4 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:get_project(project_id=3dafbe45be8241c3abf3503ad3a9b99d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:52.496930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c6a58-3737-45f7-a5ca-b63add2048f4 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:52.498683 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1886/3728] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:11:52 2022] GET /identity/v3/projects/3dafbe45be8241c3abf3503ad3a9b99d => generated 359 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:52.503183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f509ff1-e3ac-40f5-8c60-483aaf1ee3ef tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:52.509231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:52.517199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f509ff1-e3ac-40f5-8c60-483aaf1ee3ef tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:52.532591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47823a-3809-4d72-8829-b6c89cec51a5 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:52.533636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47823a-3809-4d72-8829-b6c89cec51a5 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:52.536361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47823a-3809-4d72-8829-b6c89cec51a5 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:52.536751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47823a-3809-4d72-8829-b6c89cec51a5 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/projects/3dafbe45be8241c3abf3503ad3a9b99d/users/be3f8804185d480d88ed2d5802a6a9da/roles/24e1181e94b24024817dd34acb813a1b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:52.544097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47823a-3809-4d72-8829-b6c89cec51a5 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3dafbe45be8241c3abf3503ad3a9b99d, user_id=be3f8804185d480d88ed2d5802a6a9da, role_id=24e1181e94b24024817dd34acb813a1b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:52.544798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47823a-3809-4d72-8829-b6c89cec51a5 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:52.563349 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1843/3729] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:11:52 2022] PUT /identity/v3/projects/3dafbe45be8241c3abf3503ad3a9b99d/users/be3f8804185d480d88ed2d5802a6a9da/roles/24e1181e94b24024817dd34acb813a1b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:11:52.567994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c6a58-3737-45f7-a5ca-b63add2048f4 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:52.579415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c6a58-3737-45f7-a5ca-b63add2048f4 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:52.665862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b15035-c10b-4ef0-a8d8-18e4b16bf9aa tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:52.666760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b15035-c10b-4ef0-a8d8-18e4b16bf9aa tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:52.667043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b15035-c10b-4ef0-a8d8-18e4b16bf9aa tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:52.667319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b15035-c10b-4ef0-a8d8-18e4b16bf9aa tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/users/be3f8804185d480d88ed2d5802a6a9da/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:52.669114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b15035-c10b-4ef0-a8d8-18e4b16bf9aa tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=be3f8804185d480d88ed2d5802a6a9da)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:52.671595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b15035-c10b-4ef0-a8d8-18e4b16bf9aa tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:52.676420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:52.722642 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1887/3730] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:11:52 2022] GET /identity/v3/users/be3f8804185d480d88ed2d5802a6a9da/projects => generated 842 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:52.727140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47823a-3809-4d72-8829-b6c89cec51a5 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:52.738163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47823a-3809-4d72-8829-b6c89cec51a5 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:52.745824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ef688-2561-47af-a6e0-3e439baad998 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:52.752476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ef688-2561-47af-a6e0-3e439baad998 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:52.752770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ef688-2561-47af-a6e0-3e439baad998 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:52.753056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ef688-2561-47af-a6e0-3e439baad998 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/projects/3dafbe45be8241c3abf3503ad3a9b99d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:52.754374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ef688-2561-47af-a6e0-3e439baad998 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3dafbe45be8241c3abf3503ad3a9b99d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:52.756299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ef688-2561-47af-a6e0-3e439baad998 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:52.826130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-193ef688-2561-47af-a6e0-3e439baad998 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dafbe45be8241c3abf3503ad3a9b99d', 'request_id': 'req-193ef688-2561-47af-a6e0-3e439baad998'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:52.835432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-193ef688-2561-47af-a6e0-3e439baad998 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dafbe45be8241c3abf3503ad3a9b99d', 'request_id': 'req-193ef688-2561-47af-a6e0-3e439baad998'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:52.842393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-193ef688-2561-47af-a6e0-3e439baad998 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dafbe45be8241c3abf3503ad3a9b99d', 'request_id': 'req-193ef688-2561-47af-a6e0-3e439baad998'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:52.865645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-193ef688-2561-47af-a6e0-3e439baad998 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] The token cache is being invalidate because project 3dafbe45be8241c3abf3503ad3a9b99d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:52.866108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-193ef688-2561-47af-a6e0-3e439baad998 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:52.866885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-193ef688-2561-47af-a6e0-3e439baad998 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:52.868942 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1844/3731] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:52 2022] DELETE /identity/v3/projects/3dafbe45be8241c3abf3503ad3a9b99d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:52.873035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b15035-c10b-4ef0-a8d8-18e4b16bf9aa tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:52.875213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-55b15035-c10b-4ef0-a8d8-18e4b16bf9aa tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:52.895421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b15035-c10b-4ef0-a8d8-18e4b16bf9aa tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:53.013644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5aadf-6085-4200-a6d9-5febb05bc90f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:53.014475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5aadf-6085-4200-a6d9-5febb05bc90f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:53.015683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5aadf-6085-4200-a6d9-5febb05bc90f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:53.015976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5aadf-6085-4200-a6d9-5febb05bc90f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/projects/a9328ca0f26c44128f9ecec85f225dd8` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:53.017513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5aadf-6085-4200-a6d9-5febb05bc90f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a9328ca0f26c44128f9ecec85f225dd8)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:53.019514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5aadf-6085-4200-a6d9-5febb05bc90f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:53.118083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9dc5aadf-6085-4200-a6d9-5febb05bc90f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9328ca0f26c44128f9ecec85f225dd8', 'request_id': 'req-9dc5aadf-6085-4200-a6d9-5febb05bc90f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:53.140425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9dc5aadf-6085-4200-a6d9-5febb05bc90f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9328ca0f26c44128f9ecec85f225dd8', 'request_id': 'req-9dc5aadf-6085-4200-a6d9-5febb05bc90f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:53.149474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9dc5aadf-6085-4200-a6d9-5febb05bc90f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9328ca0f26c44128f9ecec85f225dd8', 'request_id': 'req-9dc5aadf-6085-4200-a6d9-5febb05bc90f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:53.174718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9dc5aadf-6085-4200-a6d9-5febb05bc90f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] The token cache is being invalidate because project a9328ca0f26c44128f9ecec85f225dd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:53.175558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9dc5aadf-6085-4200-a6d9-5febb05bc90f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:53.176826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9dc5aadf-6085-4200-a6d9-5febb05bc90f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:53.179467 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1888/3732] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:52 2022] DELETE /identity/v3/projects/a9328ca0f26c44128f9ecec85f225dd8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:53.183491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ef688-2561-47af-a6e0-3e439baad998 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:53.203182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ef688-2561-47af-a6e0-3e439baad998 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:53.313439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63ddc4-1850-4535-bb22-7b6ac388dc0a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:53.316135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63ddc4-1850-4535-bb22-7b6ac388dc0a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:53.316522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63ddc4-1850-4535-bb22-7b6ac388dc0a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:53.316909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63ddc4-1850-4535-bb22-7b6ac388dc0a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/roles/24e1181e94b24024817dd34acb813a1b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:53.321666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63ddc4-1850-4535-bb22-7b6ac388dc0a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:delete_role(role_id=24e1181e94b24024817dd34acb813a1b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:53.324212 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-6f63ddc4-1850-4535-bb22-7b6ac388dc0a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:53.324212 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:11:53.324212 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:11:53.326015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63ddc4-1850-4535-bb22-7b6ac388dc0a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:53.442147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6f63ddc4-1850-4535-bb22-7b6ac388dc0a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invalidating the token cache because role 24e1181e94b24024817dd34acb813a1b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:53.442414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6f63ddc4-1850-4535-bb22-7b6ac388dc0a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:53.443075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6f63ddc4-1850-4535-bb22-7b6ac388dc0a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:53.447990 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1845/3733] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:11:53 2022] DELETE /identity/v3/roles/24e1181e94b24024817dd34acb813a1b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:53.449980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5aadf-6085-4200-a6d9-5febb05bc90f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:53.455735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9dc5aadf-6085-4200-a6d9-5febb05bc90f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:53.482139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5aadf-6085-4200-a6d9-5febb05bc90f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:53.626178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b4001-b20c-45cd-b4db-b9fbadd8058a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:53.627870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b4001-b20c-45cd-b4db-b9fbadd8058a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:53.628426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b4001-b20c-45cd-b4db-b9fbadd8058a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:53.628571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b4001-b20c-45cd-b4db-b9fbadd8058a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/users/be3f8804185d480d88ed2d5802a6a9da` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:53.630302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b4001-b20c-45cd-b4db-b9fbadd8058a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:delete_user(user_id=be3f8804185d480d88ed2d5802a6a9da)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:53.633786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b4001-b20c-45cd-b4db-b9fbadd8058a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:53.639068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:53.751256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-538b4001-b20c-45cd-b4db-b9fbadd8058a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be3f8804185d480d88ed2d5802a6a9da'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:53.771690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-538b4001-b20c-45cd-b4db-b9fbadd8058a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be3f8804185d480d88ed2d5802a6a9da'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:53.772801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-538b4001-b20c-45cd-b4db-b9fbadd8058a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be3f8804185d480d88ed2d5802a6a9da'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:53.773871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-538b4001-b20c-45cd-b4db-b9fbadd8058a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be3f8804185d480d88ed2d5802a6a9da'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:53.787877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-538b4001-b20c-45cd-b4db-b9fbadd8058a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be3f8804185d480d88ed2d5802a6a9da'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:53.820541 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1889/3734] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:11:53 2022] DELETE /identity/v3/users/be3f8804185d480d88ed2d5802a6a9da => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:53.821812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63ddc4-1850-4535-bb22-7b6ac388dc0a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:53.823486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6f63ddc4-1850-4535-bb22-7b6ac388dc0a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:53.838721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63ddc4-1850-4535-bb22-7b6ac388dc0a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:53.875976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:53.912595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03648f42-6d81-4618-abe8-6ef91382de65 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:53.913606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03648f42-6d81-4618-abe8-6ef91382de65 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:53.913999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03648f42-6d81-4618-abe8-6ef91382de65 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:53.914276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03648f42-6d81-4618-abe8-6ef91382de65 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/projects/b47f17ad2a284e8cb7ac1afbb3a5ab5c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:53.915876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03648f42-6d81-4618-abe8-6ef91382de65 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b47f17ad2a284e8cb7ac1afbb3a5ab5c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:53.919144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03648f42-6d81-4618-abe8-6ef91382de65 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:53.988577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03648f42-6d81-4618-abe8-6ef91382de65 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b47f17ad2a284e8cb7ac1afbb3a5ab5c', 'request_id': 'req-03648f42-6d81-4618-abe8-6ef91382de65'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:54.001051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03648f42-6d81-4618-abe8-6ef91382de65 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b47f17ad2a284e8cb7ac1afbb3a5ab5c', 'request_id': 'req-03648f42-6d81-4618-abe8-6ef91382de65'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:54.014135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03648f42-6d81-4618-abe8-6ef91382de65 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b47f17ad2a284e8cb7ac1afbb3a5ab5c', 'request_id': 'req-03648f42-6d81-4618-abe8-6ef91382de65'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:54.064325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03648f42-6d81-4618-abe8-6ef91382de65 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] The token cache is being invalidate because project b47f17ad2a284e8cb7ac1afbb3a5ab5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:54.064705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03648f42-6d81-4618-abe8-6ef91382de65 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:54.066879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03648f42-6d81-4618-abe8-6ef91382de65 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:54.071225 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1846/3735] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:53 2022] DELETE /identity/v3/projects/b47f17ad2a284e8cb7ac1afbb3a5ab5c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:54.077284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b4001-b20c-45cd-b4db-b9fbadd8058a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:54.078823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-538b4001-b20c-45cd-b4db-b9fbadd8058a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:54.107162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b4001-b20c-45cd-b4db-b9fbadd8058a tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:54.295609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c09d4e-d52a-47da-b40f-b80ea96593ea tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:54.296880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c09d4e-d52a-47da-b40f-b80ea96593ea tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:54.297168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c09d4e-d52a-47da-b40f-b80ea96593ea tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:54.298850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c09d4e-d52a-47da-b40f-b80ea96593ea tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/users/d51c860aa66347c28afea95f1d4e38ce` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:54.298975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c09d4e-d52a-47da-b40f-b80ea96593ea tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:update_user(user_id=d51c860aa66347c28afea95f1d4e38ce)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:54.300498 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-f5c09d4e-d52a-47da-b40f-b80ea96593ea tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:54.300498 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:11:54.300498 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:11:54.302032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c09d4e-d52a-47da-b40f-b80ea96593ea tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:54.394381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f5c09d4e-d52a-47da-b40f-b80ea96593ea tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd51c860aa66347c28afea95f1d4e38ce'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:54.432248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f5c09d4e-d52a-47da-b40f-b80ea96593ea tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invalidating the token cache because user d51c860aa66347c28afea95f1d4e38ce was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:54.432771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f5c09d4e-d52a-47da-b40f-b80ea96593ea tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:54.433915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f5c09d4e-d52a-47da-b40f-b80ea96593ea tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:54.436732 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1890/3736] 10.222.0.43 () {60 vars in 1242 bytes} [Sat Jul 2 21:11:54 2022] PATCH /identity/v3/users/d51c860aa66347c28afea95f1d4e38ce => generated 296 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:54.443757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1d74c-0a2f-4362-a66d-194c65300d9b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:54.444706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1d74c-0a2f-4362-a66d-194c65300d9b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:54.445069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1d74c-0a2f-4362-a66d-194c65300d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:54.517150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-eac1d74c-0a2f-4362-a66d-194c65300d9b None None] MFA Rules not processed for user `d51c860aa66347c28afea95f1d4e38ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:54.521147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-eac1d74c-0a2f-4362-a66d-194c65300d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:54.545624 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1847/3737] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:54 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 21:11:54.549768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c09d4e-d52a-47da-b40f-b80ea96593ea tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:54.551833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f5c09d4e-d52a-47da-b40f-b80ea96593ea tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:54.573736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c09d4e-d52a-47da-b40f-b80ea96593ea tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:54.595535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f6da2-55d8-4be9-8a13-8707e0057dbc tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:54.596769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f6da2-55d8-4be9-8a13-8707e0057dbc tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:54.597194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f6da2-55d8-4be9-8a13-8707e0057dbc tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:54.597817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f6da2-55d8-4be9-8a13-8707e0057dbc tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/users/d51c860aa66347c28afea95f1d4e38ce` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:54.599512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f6da2-55d8-4be9-8a13-8707e0057dbc tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:update_user(user_id=d51c860aa66347c28afea95f1d4e38ce)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:54.602561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f6da2-55d8-4be9-8a13-8707e0057dbc tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:54.667514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e92f6da2-55d8-4be9-8a13-8707e0057dbc tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd51c860aa66347c28afea95f1d4e38ce'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:54.692310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e92f6da2-55d8-4be9-8a13-8707e0057dbc tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invalidating the token cache because user d51c860aa66347c28afea95f1d4e38ce was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:54.693248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e92f6da2-55d8-4be9-8a13-8707e0057dbc tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:54.694848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e92f6da2-55d8-4be9-8a13-8707e0057dbc tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:54.697707 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1891/3738] 10.222.0.43 () {60 vars in 1242 bytes} [Sat Jul 2 21:11:54 2022] PATCH /identity/v3/users/d51c860aa66347c28afea95f1d4e38ce => generated 296 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:54.701532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1d74c-0a2f-4362-a66d-194c65300d9b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:54.719117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1d74c-0a2f-4362-a66d-194c65300d9b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:54.727747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482b1ae-04fe-4b46-a554-f21a13676571 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:54.730326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482b1ae-04fe-4b46-a554-f21a13676571 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:54.730701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482b1ae-04fe-4b46-a554-f21a13676571 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:54.731486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482b1ae-04fe-4b46-a554-f21a13676571 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/users/d51c860aa66347c28afea95f1d4e38ce` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:54.770737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482b1ae-04fe-4b46-a554-f21a13676571 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:update_user(user_id=d51c860aa66347c28afea95f1d4e38ce)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:54.772512 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-d482b1ae-04fe-4b46-a554-f21a13676571 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:54.772512 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:11:54.772512 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:11:54.773979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482b1ae-04fe-4b46-a554-f21a13676571 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:54.842257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d482b1ae-04fe-4b46-a554-f21a13676571 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd51c860aa66347c28afea95f1d4e38ce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:54.856674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d482b1ae-04fe-4b46-a554-f21a13676571 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invalidating the token cache because user d51c860aa66347c28afea95f1d4e38ce was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:54.858007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d482b1ae-04fe-4b46-a554-f21a13676571 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:54.859333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d482b1ae-04fe-4b46-a554-f21a13676571 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:54.866210 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1848/3739] 10.222.0.43 () {60 vars in 1242 bytes} [Sat Jul 2 21:11:54 2022] PATCH /identity/v3/users/d51c860aa66347c28afea95f1d4e38ce => generated 296 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:11:54.870352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514e72a-d477-4f0c-b050-811d6e9215fe None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:54.870644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514e72a-d477-4f0c-b050-811d6e9215fe None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:54.870918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514e72a-d477-4f0c-b050-811d6e9215fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:54.973629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9514e72a-d477-4f0c-b050-811d6e9215fe None None] MFA Rules not processed for user `d51c860aa66347c28afea95f1d4e38ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:54.978253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9514e72a-d477-4f0c-b050-811d6e9215fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:54.987429 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1892/3740] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:54 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 21:11:54.987740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482b1ae-04fe-4b46-a554-f21a13676571 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:54.990000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d482b1ae-04fe-4b46-a554-f21a13676571 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:55.014147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482b1ae-04fe-4b46-a554-f21a13676571 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:55.030475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781371d3-e8b1-4a79-9ec6-cc34d3801685 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:55.035812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781371d3-e8b1-4a79-9ec6-cc34d3801685 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:55.035812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781371d3-e8b1-4a79-9ec6-cc34d3801685 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:55.035812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781371d3-e8b1-4a79-9ec6-cc34d3801685 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/users/d51c860aa66347c28afea95f1d4e38ce` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:55.036738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781371d3-e8b1-4a79-9ec6-cc34d3801685 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:update_user(user_id=d51c860aa66347c28afea95f1d4e38ce)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:55.039020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781371d3-e8b1-4a79-9ec6-cc34d3801685 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:55.116185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-781371d3-e8b1-4a79-9ec6-cc34d3801685 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd51c860aa66347c28afea95f1d4e38ce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:55.131262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-781371d3-e8b1-4a79-9ec6-cc34d3801685 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invalidating the token cache because user d51c860aa66347c28afea95f1d4e38ce was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:55.131826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-781371d3-e8b1-4a79-9ec6-cc34d3801685 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:55.132605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-781371d3-e8b1-4a79-9ec6-cc34d3801685 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:55.135141 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1849/3741] 10.222.0.43 () {60 vars in 1242 bytes} [Sat Jul 2 21:11:54 2022] PATCH /identity/v3/users/d51c860aa66347c28afea95f1d4e38ce => generated 296 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:11:55.140120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514e72a-d477-4f0c-b050-811d6e9215fe None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:55.159229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514e72a-d477-4f0c-b050-811d6e9215fe None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:55.167679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e9353-dd14-4633-acc9-cf47e5297050 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:55.168496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e9353-dd14-4633-acc9-cf47e5297050 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:55.168785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e9353-dd14-4633-acc9-cf47e5297050 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:55.169065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e9353-dd14-4633-acc9-cf47e5297050 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:55.169756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e9353-dd14-4633-acc9-cf47e5297050 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:55.171681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e9353-dd14-4633-acc9-cf47e5297050 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:55.181418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=80,keystone:DELETE=12,keystone:INSERT=6,keystone:UPDATE=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:55.227395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781371d3-e8b1-4a79-9ec6-cc34d3801685 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:55.228920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-781371d3-e8b1-4a79-9ec6-cc34d3801685 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:55.232623 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1893/3742] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:11:55 2022] POST /identity/v3/users => generated 264 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:55.251413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781371d3-e8b1-4a79-9ec6-cc34d3801685 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:55.258009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac4898-bac4-46ba-a60c-0b2c51917be3 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:55.259799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac4898-bac4-46ba-a60c-0b2c51917be3 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:55.260235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac4898-bac4-46ba-a60c-0b2c51917be3 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:55.260608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac4898-bac4-46ba-a60c-0b2c51917be3 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/users/6a1fb07ab47444bdb36cb35aca65256f/password` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:55.327207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=82,keystone:DELETE=11,keystone:INSERT=5,keystone:UPDATE=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:55.376438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-36ac4898-bac4-46ba-a60c-0b2c51917be3 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6a1fb07ab47444bdb36cb35aca65256f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:55.401650 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1850/3743] 10.222.0.43 () {60 vars in 1268 bytes} [Sat Jul 2 21:11:55 2022] POST /identity/v3/users/6a1fb07ab47444bdb36cb35aca65256f/password => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:56.407863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a077fe8-2622-4dd7-bbb6-925545bb96fd None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:56.408557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a077fe8-2622-4dd7-bbb6-925545bb96fd None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:56.408661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a077fe8-2622-4dd7-bbb6-925545bb96fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:56.447346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2a077fe8-2622-4dd7-bbb6-925545bb96fd None None] MFA Rules not processed for user `6a1fb07ab47444bdb36cb35aca65256f`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:56.447346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2a077fe8-2622-4dd7-bbb6-925545bb96fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:56.450927 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1894/3744] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:56 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 21:11:56.455123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac4898-bac4-46ba-a60c-0b2c51917be3 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:56.474237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac4898-bac4-46ba-a60c-0b2c51917be3 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:56.488742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cee5d4-4c4c-44af-a36e-a31f337074e3 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:56.489419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cee5d4-4c4c-44af-a36e-a31f337074e3 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:56.489704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cee5d4-4c4c-44af-a36e-a31f337074e3 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:56.489988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cee5d4-4c4c-44af-a36e-a31f337074e3 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:56.514273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cee5d4-4c4c-44af-a36e-a31f337074e3 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:56.516995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cee5d4-4c4c-44af-a36e-a31f337074e3 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:56.561280 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1851/3745] 10.222.0.43 () {56 vars in 1262 bytes} [Sat Jul 2 21:11:56 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:56.565145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a077fe8-2622-4dd7-bbb6-925545bb96fd None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:56.586506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a077fe8-2622-4dd7-bbb6-925545bb96fd None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:56.593951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e94a8-aa73-4b06-82df-dc98b0f32a89 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:56.595036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e94a8-aa73-4b06-82df-dc98b0f32a89 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:56.595460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e94a8-aa73-4b06-82df-dc98b0f32a89 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:56.595886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e94a8-aa73-4b06-82df-dc98b0f32a89 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/users/6a1fb07ab47444bdb36cb35aca65256f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:56.597300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e94a8-aa73-4b06-82df-dc98b0f32a89 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6a1fb07ab47444bdb36cb35aca65256f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:56.600004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e94a8-aa73-4b06-82df-dc98b0f32a89 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:56.743183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a16e94a8-aa73-4b06-82df-dc98b0f32a89 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a1fb07ab47444bdb36cb35aca65256f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:56.766525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a16e94a8-aa73-4b06-82df-dc98b0f32a89 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a1fb07ab47444bdb36cb35aca65256f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:56.767602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a16e94a8-aa73-4b06-82df-dc98b0f32a89 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a1fb07ab47444bdb36cb35aca65256f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:56.768522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a16e94a8-aa73-4b06-82df-dc98b0f32a89 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a1fb07ab47444bdb36cb35aca65256f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:56.782807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a16e94a8-aa73-4b06-82df-dc98b0f32a89 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a1fb07ab47444bdb36cb35aca65256f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:56.849330 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1895/3746] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:11:56 2022] DELETE /identity/v3/users/6a1fb07ab47444bdb36cb35aca65256f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:56.855910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cee5d4-4c4c-44af-a36e-a31f337074e3 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:56.871367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cee5d4-4c4c-44af-a36e-a31f337074e3 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:57.027170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b3ad6-2fbc-4d64-aea8-6e260f0d400e tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:57.027714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b3ad6-2fbc-4d64-aea8-6e260f0d400e tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:57.028326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b3ad6-2fbc-4d64-aea8-6e260f0d400e tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:57.028999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b3ad6-2fbc-4d64-aea8-6e260f0d400e tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:57.029396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b3ad6-2fbc-4d64-aea8-6e260f0d400e tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:57.031464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b3ad6-2fbc-4d64-aea8-6e260f0d400e tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:57.105173 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1852/3747] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:11:56 2022] POST /identity/v3/users => generated 364 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:11:57.105956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e94a8-aa73-4b06-82df-dc98b0f32a89 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:57.116681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a16e94a8-aa73-4b06-82df-dc98b0f32a89 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:57.149584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b3ad6-2fbc-4d64-aea8-6e260f0d400e tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:57.150689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e94a8-aa73-4b06-82df-dc98b0f32a89 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:57.154783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-561b3ad6-2fbc-4d64-aea8-6e260f0d400e tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:57.160968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e86bbd-b98f-4223-b7f4-dbb95a03e777 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:57.161818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e86bbd-b98f-4223-b7f4-dbb95a03e777 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:57.162184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e86bbd-b98f-4223-b7f4-dbb95a03e777 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:57.162355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e86bbd-b98f-4223-b7f4-dbb95a03e777 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:57.163133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e86bbd-b98f-4223-b7f4-dbb95a03e777 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:57.166465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e86bbd-b98f-4223-b7f4-dbb95a03e777 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:57.260703 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1896/3748] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:11:57 2022] POST /identity/v3/projects => generated 359 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:11:57.264211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e86bbd-b98f-4223-b7f4-dbb95a03e777 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:57.355920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b3ad6-2fbc-4d64-aea8-6e260f0d400e tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:57.489331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e86bbd-b98f-4223-b7f4-dbb95a03e777 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:57.506029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91633cbd-e597-4c58-afbc-d400de3d2367 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:57.511085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91633cbd-e597-4c58-afbc-d400de3d2367 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:57.511411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91633cbd-e597-4c58-afbc-d400de3d2367 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:57.512305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91633cbd-e597-4c58-afbc-d400de3d2367 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/users/91e6056c11134de9ab2a3773fd86cc05` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:57.646518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:INSERT=5,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:57.734103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91633cbd-e597-4c58-afbc-d400de3d2367 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:update_user(user_id=91e6056c11134de9ab2a3773fd86cc05)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:57.748344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91633cbd-e597-4c58-afbc-d400de3d2367 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:57.795658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93390ce9-7856-4c4e-9b97-60304da3c521 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:57.797783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93390ce9-7856-4c4e-9b97-60304da3c521 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:57.798216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93390ce9-7856-4c4e-9b97-60304da3c521 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:57.798499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93390ce9-7856-4c4e-9b97-60304da3c521 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:57.800833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-93390ce9-7856-4c4e-9b97-60304da3c521 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:57.820988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93390ce9-7856-4c4e-9b97-60304da3c521 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:57.823260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93390ce9-7856-4c4e-9b97-60304da3c521 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:57.889747 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1897/3750] 10.222.0.43 () {60 vars in 1243 bytes} [Sat Jul 2 21:11:57 2022] PATCH /identity/v3/users/91e6056c11134de9ab2a3773fd86cc05 => generated 520 bytes in 628 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:57.890002 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1853/3750] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:11:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:11:57.890693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91633cbd-e597-4c58-afbc-d400de3d2367 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:57.894231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93390ce9-7856-4c4e-9b97-60304da3c521 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:57.895182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-91633cbd-e597-4c58-afbc-d400de3d2367 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:57.935611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91633cbd-e597-4c58-afbc-d400de3d2367 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:57.940762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93390ce9-7856-4c4e-9b97-60304da3c521 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:57.947199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160b95f-0a39-4eb0-8dca-e2b0af9f810f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:57.950940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160b95f-0a39-4eb0-8dca-e2b0af9f810f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:57.951420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160b95f-0a39-4eb0-8dca-e2b0af9f810f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:57.951896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160b95f-0a39-4eb0-8dca-e2b0af9f810f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/users/91e6056c11134de9ab2a3773fd86cc05` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:57.955456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205b11b-8ba5-4054-88b7-9c8220d91d66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:57.956157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205b11b-8ba5-4054-88b7-9c8220d91d66 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:57.956446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205b11b-8ba5-4054-88b7-9c8220d91d66 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:57.956721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205b11b-8ba5-4054-88b7-9c8220d91d66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:57.958682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7205b11b-8ba5-4054-88b7-9c8220d91d66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:57.976099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=4,keystone:SELECT=84,keystone:DELETE=10,keystone:UPDATE=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:57.990316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205b11b-8ba5-4054-88b7-9c8220d91d66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:57.992376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205b11b-8ba5-4054-88b7-9c8220d91d66 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:57.998096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160b95f-0a39-4eb0-8dca-e2b0af9f810f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:get_user(user_id=91e6056c11134de9ab2a3773fd86cc05)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:58.003096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160b95f-0a39-4eb0-8dca-e2b0af9f810f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:58.008019 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1854/3751] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:11:57 2022] GET /identity/v3/users/91e6056c11134de9ab2a3773fd86cc05 => generated 388 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:11:58.011117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160b95f-0a39-4eb0-8dca-e2b0af9f810f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:58.016476 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1898/3752] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:11:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:11:58.057202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160b95f-0a39-4eb0-8dca-e2b0af9f810f tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:58.068197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b4925-6e08-4ee6-b280-2e4ab5465132 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:58.069546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b4925-6e08-4ee6-b280-2e4ab5465132 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:58.070320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b4925-6e08-4ee6-b280-2e4ab5465132 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:58.072299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b4925-6e08-4ee6-b280-2e4ab5465132 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/projects/73dfd3cbbed04d57964f3128daef5c53` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:58.074862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b4925-6e08-4ee6-b280-2e4ab5465132 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:delete_project(project_id=73dfd3cbbed04d57964f3128daef5c53)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:58.083086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b4925-6e08-4ee6-b280-2e4ab5465132 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:58.217647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c18b4925-6e08-4ee6-b280-2e4ab5465132 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73dfd3cbbed04d57964f3128daef5c53', 'request_id': 'req-c18b4925-6e08-4ee6-b280-2e4ab5465132'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:58.227715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c18b4925-6e08-4ee6-b280-2e4ab5465132 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73dfd3cbbed04d57964f3128daef5c53', 'request_id': 'req-c18b4925-6e08-4ee6-b280-2e4ab5465132'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:58.233041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c18b4925-6e08-4ee6-b280-2e4ab5465132 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73dfd3cbbed04d57964f3128daef5c53', 'request_id': 'req-c18b4925-6e08-4ee6-b280-2e4ab5465132'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:58.249239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c18b4925-6e08-4ee6-b280-2e4ab5465132 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] The token cache is being invalidate because project 73dfd3cbbed04d57964f3128daef5c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:58.249843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c18b4925-6e08-4ee6-b280-2e4ab5465132 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:58.250742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c18b4925-6e08-4ee6-b280-2e4ab5465132 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:58.253055 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1855/3753] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:58 2022] DELETE /identity/v3/projects/73dfd3cbbed04d57964f3128daef5c53 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:58.257097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205b11b-8ba5-4054-88b7-9c8220d91d66 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:58.278772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205b11b-8ba5-4054-88b7-9c8220d91d66 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:58.363051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f118d0-51ed-4a27-a9a3-14b691af2b10 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22b0eefae3f34c0f94bf3ac52312a845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '747a0cdf18dc419aadd89bbb5b4019b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:58.364117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f118d0-51ed-4a27-a9a3-14b691af2b10 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:58.364412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f118d0-51ed-4a27-a9a3-14b691af2b10 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:58.365284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f118d0-51ed-4a27-a9a3-14b691af2b10 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] PATH_INFO: `/v3/users/91e6056c11134de9ab2a3773fd86cc05` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:58.366259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f118d0-51ed-4a27-a9a3-14b691af2b10 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorizing `identity:delete_user(user_id=91e6056c11134de9ab2a3773fd86cc05)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:58.368390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f118d0-51ed-4a27-a9a3-14b691af2b10 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:58.439861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a0f118d0-51ed-4a27-a9a3-14b691af2b10 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e6056c11134de9ab2a3773fd86cc05'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:58.451872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a0f118d0-51ed-4a27-a9a3-14b691af2b10 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e6056c11134de9ab2a3773fd86cc05'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:58.453627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a0f118d0-51ed-4a27-a9a3-14b691af2b10 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e6056c11134de9ab2a3773fd86cc05'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:58.454734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a0f118d0-51ed-4a27-a9a3-14b691af2b10 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e6056c11134de9ab2a3773fd86cc05'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:58.465790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a0f118d0-51ed-4a27-a9a3-14b691af2b10 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e6056c11134de9ab2a3773fd86cc05'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:58.491152 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1899/3754] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:11:58 2022] DELETE /identity/v3/users/91e6056c11134de9ab2a3773fd86cc05 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:58.497043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b4925-6e08-4ee6-b280-2e4ab5465132 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:58.499374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c18b4925-6e08-4ee6-b280-2e4ab5465132 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:58.594651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b4925-6e08-4ee6-b280-2e4ab5465132 tempest-UsersV3TestJSON-1651091737 tempest-UsersV3TestJSON-1651091737-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:58.657033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:58.665383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9dfe7-e653-4a16-ad7b-1cbd637499c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:58.666681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9dfe7-e653-4a16-ad7b-1cbd637499c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:58.667698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9dfe7-e653-4a16-ad7b-1cbd637499c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:58.669614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9dfe7-e653-4a16-ad7b-1cbd637499c4 admin admin] PATH_INFO: `/v3/users/d51c860aa66347c28afea95f1d4e38ce` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:58.708710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9dfe7-e653-4a16-ad7b-1cbd637499c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d51c860aa66347c28afea95f1d4e38ce)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:58.710848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9dfe7-e653-4a16-ad7b-1cbd637499c4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:58.799710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dea9dfe7-e653-4a16-ad7b-1cbd637499c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd51c860aa66347c28afea95f1d4e38ce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:58.836217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dea9dfe7-e653-4a16-ad7b-1cbd637499c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd51c860aa66347c28afea95f1d4e38ce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:58.862009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dea9dfe7-e653-4a16-ad7b-1cbd637499c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd51c860aa66347c28afea95f1d4e38ce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:58.864352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dea9dfe7-e653-4a16-ad7b-1cbd637499c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd51c860aa66347c28afea95f1d4e38ce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:58.866810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dea9dfe7-e653-4a16-ad7b-1cbd637499c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd51c860aa66347c28afea95f1d4e38ce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:58.933442 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1856/3755] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:11:58 2022] DELETE /identity/v3/users/d51c860aa66347c28afea95f1d4e38ce => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:58.938428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e443b69-9b38-4320-b41d-5881fc5fe51e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:58.938943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e443b69-9b38-4320-b41d-5881fc5fe51e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:58.939387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e443b69-9b38-4320-b41d-5881fc5fe51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:58.972057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8e443b69-9b38-4320-b41d-5881fc5fe51e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:11:58.973448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8e443b69-9b38-4320-b41d-5881fc5fe51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:59.112070 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1900/3756] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:11:59.123123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9dfe7-e653-4a16-ad7b-1cbd637499c4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:59.125374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dea9dfe7-e653-4a16-ad7b-1cbd637499c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:59.215919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9dfe7-e653-4a16-ad7b-1cbd637499c4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:59.238146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1b623-5cd9-4328-9e01-f9f613bd9fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:59.243321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1b623-5cd9-4328-9e01-f9f613bd9fee service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:59.243797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1b623-5cd9-4328-9e01-f9f613bd9fee service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:59.244307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1b623-5cd9-4328-9e01-f9f613bd9fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:59.263382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1b623-5cd9-4328-9e01-f9f613bd9fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:59.265452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1b623-5cd9-4328-9e01-f9f613bd9fee service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:59.282195 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1857/3757] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:11:59.643891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e443b69-9b38-4320-b41d-5881fc5fe51e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:59.648448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8e443b69-9b38-4320-b41d-5881fc5fe51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:11:59.671872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e443b69-9b38-4320-b41d-5881fc5fe51e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:59.683708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48443335-89b0-4cf2-a9ca-07b838e0f9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:59.685437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48443335-89b0-4cf2-a9ca-07b838e0f9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:59.690238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48443335-89b0-4cf2-a9ca-07b838e0f9da admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:59.690789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48443335-89b0-4cf2-a9ca-07b838e0f9da admin admin] PATH_INFO: `/v3/projects/2d68fcccf81f4513883a9216fc5229bf` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:11:59.693399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48443335-89b0-4cf2-a9ca-07b838e0f9da admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d68fcccf81f4513883a9216fc5229bf)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:11:59.700162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48443335-89b0-4cf2-a9ca-07b838e0f9da admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:11:59.714846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:59.791217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-48443335-89b0-4cf2-a9ca-07b838e0f9da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d68fcccf81f4513883a9216fc5229bf', 'request_id': 'req-48443335-89b0-4cf2-a9ca-07b838e0f9da'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:59.807771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-48443335-89b0-4cf2-a9ca-07b838e0f9da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d68fcccf81f4513883a9216fc5229bf', 'request_id': 'req-48443335-89b0-4cf2-a9ca-07b838e0f9da'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:59.818037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-48443335-89b0-4cf2-a9ca-07b838e0f9da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d68fcccf81f4513883a9216fc5229bf', 'request_id': 'req-48443335-89b0-4cf2-a9ca-07b838e0f9da'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:59.833421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-48443335-89b0-4cf2-a9ca-07b838e0f9da admin admin] The token cache is being invalidate because project 2d68fcccf81f4513883a9216fc5229bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:11:59.834137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-48443335-89b0-4cf2-a9ca-07b838e0f9da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:59.835083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-48443335-89b0-4cf2-a9ca-07b838e0f9da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:11:59.853067 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1901/3758] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:59 2022] DELETE /identity/v3/projects/2d68fcccf81f4513883a9216fc5229bf => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:11:59.857405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1b623-5cd9-4328-9e01-f9f613bd9fee service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:11:59.871504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1b623-5cd9-4328-9e01-f9f613bd9fee service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:11:59.996295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be911b4-7e7e-4bbb-92b7-1c5badf7b72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:11:59.997834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be911b4-7e7e-4bbb-92b7-1c5badf7b72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:11:59.998627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be911b4-7e7e-4bbb-92b7-1c5badf7b72d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:11:59.999064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be911b4-7e7e-4bbb-92b7-1c5badf7b72d admin admin] PATH_INFO: `/v3/users/22b0eefae3f34c0f94bf3ac52312a845` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:00.004349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be911b4-7e7e-4bbb-92b7-1c5badf7b72d admin admin] RBAC: Authorizing `identity:delete_user(user_id=22b0eefae3f34c0f94bf3ac52312a845)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:00.007193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be911b4-7e7e-4bbb-92b7-1c5badf7b72d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:00.031386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:00.087797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2be911b4-7e7e-4bbb-92b7-1c5badf7b72d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22b0eefae3f34c0f94bf3ac52312a845'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:00.111426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2be911b4-7e7e-4bbb-92b7-1c5badf7b72d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22b0eefae3f34c0f94bf3ac52312a845'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:00.125202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2be911b4-7e7e-4bbb-92b7-1c5badf7b72d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22b0eefae3f34c0f94bf3ac52312a845'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:00.125947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2be911b4-7e7e-4bbb-92b7-1c5badf7b72d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22b0eefae3f34c0f94bf3ac52312a845'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:00.126556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2be911b4-7e7e-4bbb-92b7-1c5badf7b72d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22b0eefae3f34c0f94bf3ac52312a845'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:00.154904 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1858/3759] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:11:59 2022] DELETE /identity/v3/users/22b0eefae3f34c0f94bf3ac52312a845 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:00.568211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48443335-89b0-4cf2-a9ca-07b838e0f9da admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:00.570867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-48443335-89b0-4cf2-a9ca-07b838e0f9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:00.588698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48443335-89b0-4cf2-a9ca-07b838e0f9da admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:00.670957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81af962-0940-4fdc-b97e-847d061f67dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:00.671859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81af962-0940-4fdc-b97e-847d061f67dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:00.672457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81af962-0940-4fdc-b97e-847d061f67dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:00.672942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81af962-0940-4fdc-b97e-847d061f67dc admin admin] PATH_INFO: `/v3/projects/747a0cdf18dc419aadd89bbb5b4019b1` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:00.674785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81af962-0940-4fdc-b97e-847d061f67dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=747a0cdf18dc419aadd89bbb5b4019b1)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:00.677147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81af962-0940-4fdc-b97e-847d061f67dc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:00.737241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c81af962-0940-4fdc-b97e-847d061f67dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '747a0cdf18dc419aadd89bbb5b4019b1', 'request_id': 'req-c81af962-0940-4fdc-b97e-847d061f67dc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:00.748792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c81af962-0940-4fdc-b97e-847d061f67dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '747a0cdf18dc419aadd89bbb5b4019b1', 'request_id': 'req-c81af962-0940-4fdc-b97e-847d061f67dc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:00.756519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c81af962-0940-4fdc-b97e-847d061f67dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '747a0cdf18dc419aadd89bbb5b4019b1', 'request_id': 'req-c81af962-0940-4fdc-b97e-847d061f67dc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:00.769767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c81af962-0940-4fdc-b97e-847d061f67dc admin admin] The token cache is being invalidate because project 747a0cdf18dc419aadd89bbb5b4019b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:12:00.770328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c81af962-0940-4fdc-b97e-847d061f67dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:00.771048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c81af962-0940-4fdc-b97e-847d061f67dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:00.773369 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1902/3760] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:00 2022] DELETE /identity/v3/projects/747a0cdf18dc419aadd89bbb5b4019b1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:00.778629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e015f-7d11-43d9-bd3d-3ef84e73967f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:00.778881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e015f-7d11-43d9-bd3d-3ef84e73967f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:00.779159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e015f-7d11-43d9-bd3d-3ef84e73967f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:00.799936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-756e015f-7d11-43d9-bd3d-3ef84e73967f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:00.801173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-756e015f-7d11-43d9-bd3d-3ef84e73967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:00.865395 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1859/3761] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:00.873860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb40c27-3609-4b69-8dd0-172fea79e706 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:00.874122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb40c27-3609-4b69-8dd0-172fea79e706 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:00.874403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb40c27-3609-4b69-8dd0-172fea79e706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:00.893345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-cdb40c27-3609-4b69-8dd0-172fea79e706 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:00.894546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cdb40c27-3609-4b69-8dd0-172fea79e706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:00.902851 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1903/3762] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:00.907593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e015f-7d11-43d9-bd3d-3ef84e73967f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:00.918165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e015f-7d11-43d9-bd3d-3ef84e73967f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:00.923158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29626645-3959-47d7-bf3e-7ffa3ea42158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:00.923886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29626645-3959-47d7-bf3e-7ffa3ea42158 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:00.924263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29626645-3959-47d7-bf3e-7ffa3ea42158 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:00.924614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29626645-3959-47d7-bf3e-7ffa3ea42158 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:00.925407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29626645-3959-47d7-bf3e-7ffa3ea42158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:12:00.925792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29626645-3959-47d7-bf3e-7ffa3ea42158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:00.927403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29626645-3959-47d7-bf3e-7ffa3ea42158 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:00.940142 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1860/3763] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:12:00.945305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb40c27-3609-4b69-8dd0-172fea79e706 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:00.955059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb40c27-3609-4b69-8dd0-172fea79e706 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:00.960163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58591c4d-c059-4061-8d9d-18a12667e167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:00.960822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58591c4d-c059-4061-8d9d-18a12667e167 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:00.961107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58591c4d-c059-4061-8d9d-18a12667e167 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:00.961383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58591c4d-c059-4061-8d9d-18a12667e167 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:00.962077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58591c4d-c059-4061-8d9d-18a12667e167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:00.965850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58591c4d-c059-4061-8d9d-18a12667e167 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:00.983770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:00.996558 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1904/3764] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:12:00 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:12:00.997747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29626645-3959-47d7-bf3e-7ffa3ea42158 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:01.009743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29626645-3959-47d7-bf3e-7ffa3ea42158 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:01.068525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507c45d-2bc4-4b1f-abc1-ffb4f984c1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:01.069380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507c45d-2bc4-4b1f-abc1-ffb4f984c1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:01.069753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507c45d-2bc4-4b1f-abc1-ffb4f984c1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:01.070121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507c45d-2bc4-4b1f-abc1-ffb4f984c1a6 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:01.071765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507c45d-2bc4-4b1f-abc1-ffb4f984c1a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:01.074256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507c45d-2bc4-4b1f-abc1-ffb4f984c1a6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:01.099109 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1861/3765] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:12:00 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:12:01.103596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58591c4d-c059-4061-8d9d-18a12667e167 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:01.114615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58591c4d-c059-4061-8d9d-18a12667e167 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:01.120861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c8668-2d3c-4978-9684-23110f83e530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:01.121546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c8668-2d3c-4978-9684-23110f83e530 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:01.121895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c8668-2d3c-4978-9684-23110f83e530 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:01.122168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c8668-2d3c-4978-9684-23110f83e530 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:01.122907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c8668-2d3c-4978-9684-23110f83e530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:01.124573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c8668-2d3c-4978-9684-23110f83e530 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:01.136023 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1905/3766] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:01.141245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507c45d-2bc4-4b1f-abc1-ffb4f984c1a6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:01.147780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:01.152077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507c45d-2bc4-4b1f-abc1-ffb4f984c1a6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:01.168365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8287c-169c-46f2-a906-5f9103238096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:01.170830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8287c-169c-46f2-a906-5f9103238096 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:01.171692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8287c-169c-46f2-a906-5f9103238096 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:01.172076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8287c-169c-46f2-a906-5f9103238096 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:01.172958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8287c-169c-46f2-a906-5f9103238096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:01.174710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8287c-169c-46f2-a906-5f9103238096 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:01.191207 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1862/3767] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:01.195710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c8668-2d3c-4978-9684-23110f83e530 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:01.212184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c8668-2d3c-4978-9684-23110f83e530 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:01.218459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edae22-26a9-4049-aed3-46eee2b3a20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:01.219374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edae22-26a9-4049-aed3-46eee2b3a20e admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:01.219654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edae22-26a9-4049-aed3-46eee2b3a20e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:01.219927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edae22-26a9-4049-aed3-46eee2b3a20e admin admin] PATH_INFO: `/v3/projects/6f1be96a47b047188a095ed9ce815737/users/7be1ed1be246473384d85c165a39fa26/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:01.250683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edae22-26a9-4049-aed3-46eee2b3a20e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1be96a47b047188a095ed9ce815737, user_id=7be1ed1be246473384d85c165a39fa26, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:01.253607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edae22-26a9-4049-aed3-46eee2b3a20e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:01.268619 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1906/3768] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:12:01 2022] PUT /identity/v3/projects/6f1be96a47b047188a095ed9ce815737/users/7be1ed1be246473384d85c165a39fa26/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:12:01.280750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165c400-3273-4a34-ae04-63bf78853c3e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:01.281037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165c400-3273-4a34-ae04-63bf78853c3e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:01.281313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165c400-3273-4a34-ae04-63bf78853c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:01.310776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f165c400-3273-4a34-ae04-63bf78853c3e None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:01.312104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f165c400-3273-4a34-ae04-63bf78853c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:01.408099 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1863/3769] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:01.410571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edae22-26a9-4049-aed3-46eee2b3a20e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:01.424337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edae22-26a9-4049-aed3-46eee2b3a20e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:01.430282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9dbbe-9710-44cf-9fc9-80feb11413db tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be1ed1be246473384d85c165a39fa26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1be96a47b047188a095ed9ce815737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:01.431728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9dbbe-9710-44cf-9fc9-80feb11413db tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:01.432206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9dbbe-9710-44cf-9fc9-80feb11413db tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:01.432496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9dbbe-9710-44cf-9fc9-80feb11413db tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] PATH_INFO: `/v3/users/7be1ed1be246473384d85c165a39fa26/password` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:01.488013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-08c9dbbe-9710-44cf-9fc9-80feb11413db tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7be1ed1be246473384d85c165a39fa26'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:01.502991 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1907/3770] 10.222.0.43 () {60 vars in 1268 bytes} [Sat Jul 2 21:12:01 2022] POST /identity/v3/users/7be1ed1be246473384d85c165a39fa26/password => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:02.506567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37076617-6d3d-47f8-b204-2e874a06062f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:02.507045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37076617-6d3d-47f8-b204-2e874a06062f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:02.507170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37076617-6d3d-47f8-b204-2e874a06062f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:02.559783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-37076617-6d3d-47f8-b204-2e874a06062f None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:02.564452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-37076617-6d3d-47f8-b204-2e874a06062f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:02.584160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba7373-1588-4b81-9d4b-d315c5d5f98a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:02.584644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba7373-1588-4b81-9d4b-d315c5d5f98a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:02.584970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba7373-1588-4b81-9d4b-d315c5d5f98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:02.598743 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1864/3771] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:02 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:02.619393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1dba7373-1588-4b81-9d4b-d315c5d5f98a None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:02.620809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1dba7373-1588-4b81-9d4b-d315c5d5f98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:02.639818 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1908/3772] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:02.644759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37076617-6d3d-47f8-b204-2e874a06062f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:02.663647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37076617-6d3d-47f8-b204-2e874a06062f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:02.678931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393db90c-5430-47c0-8a54-42184b4aa25f tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be1ed1be246473384d85c165a39fa26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1be96a47b047188a095ed9ce815737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:02.678931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393db90c-5430-47c0-8a54-42184b4aa25f tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:02.678931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393db90c-5430-47c0-8a54-42184b4aa25f tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:02.679338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393db90c-5430-47c0-8a54-42184b4aa25f tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] PATH_INFO: `/v3/users/7be1ed1be246473384d85c165a39fa26/password` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:02.741750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-393db90c-5430-47c0-8a54-42184b4aa25f tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 02 21:12:02.741750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:12:02.741750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:12:02.741750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:12:02.741750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:12:02.741750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:12:02.741750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:12:02.741750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:12:02.741750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:12:02.741750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:12:02.741750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:12:02.741750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:12:02.741750 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 02 21:12:02.742911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 02 21:12:02.742911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jul 02 21:12:02.742911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jul 02 21:12:02.742911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:12:02.742911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:12:02.742911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 21:12:02.742911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 21:12:02.742911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jul 02 21:12:02.742911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jul 02 21:12:02.742911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jul 02 21:12:02.742911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jul 02 21:12:02.742911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jul 02 21:12:02.742911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jul 02 21:12:02.742911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 02 21:12:02.742911 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:12:02.744833 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1865/3773] 10.222.0.43 () {60 vars in 1268 bytes} [Sat Jul 2 21:12:02 2022] POST /identity/v3/users/7be1ed1be246473384d85c165a39fa26/password => generated 188 bytes in 101 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 02 21:12:02.749869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba7373-1588-4b81-9d4b-d315c5d5f98a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:02.760186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba7373-1588-4b81-9d4b-d315c5d5f98a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:02.764300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46a5fd-adb6-4186-8b9c-9682e73b41a5 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be1ed1be246473384d85c165a39fa26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1be96a47b047188a095ed9ce815737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:02.765264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46a5fd-adb6-4186-8b9c-9682e73b41a5 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:02.765744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46a5fd-adb6-4186-8b9c-9682e73b41a5 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:02.766105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46a5fd-adb6-4186-8b9c-9682e73b41a5 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] PATH_INFO: `/v3/users/7be1ed1be246473384d85c165a39fa26/password` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:02.811659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-1a46a5fd-adb6-4186-8b9c-9682e73b41a5 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 02 21:12:02.811659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:12:02.811659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:12:02.811659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:12:02.811659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:12:02.811659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:12:02.811659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:12:02.811659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:12:02.811659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:12:02.811659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:12:02.811659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:12:02.811659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:12:02.811659 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 02 21:12:02.812894 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 02 21:12:02.812894 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jul 02 21:12:02.812894 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jul 02 21:12:02.812894 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:12:02.812894 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:12:02.812894 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 21:12:02.812894 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 21:12:02.812894 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jul 02 21:12:02.812894 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jul 02 21:12:02.812894 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jul 02 21:12:02.812894 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jul 02 21:12:02.812894 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jul 02 21:12:02.812894 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jul 02 21:12:02.812894 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 02 21:12:02.812894 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:12:02.813821 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1909/3774] 10.222.0.43 () {60 vars in 1268 bytes} [Sat Jul 2 21:12:02 2022] POST /identity/v3/users/7be1ed1be246473384d85c165a39fa26/password => generated 188 bytes in 64 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 02 21:12:02.817379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393db90c-5430-47c0-8a54-42184b4aa25f tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:02.828982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393db90c-5430-47c0-8a54-42184b4aa25f tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:02.834258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f372e3-fedb-4e62-bd50-d0840c2856a5 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be1ed1be246473384d85c165a39fa26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1be96a47b047188a095ed9ce815737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:02.835204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f372e3-fedb-4e62-bd50-d0840c2856a5 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:02.835491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f372e3-fedb-4e62-bd50-d0840c2856a5 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:02.835767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f372e3-fedb-4e62-bd50-d0840c2856a5 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] PATH_INFO: `/v3/users/7be1ed1be246473384d85c165a39fa26/password` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:02.898205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-57f372e3-fedb-4e62-bd50-d0840c2856a5 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7be1ed1be246473384d85c165a39fa26'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:02.919192 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1866/3775] 10.222.0.43 () {60 vars in 1268 bytes} [Sat Jul 2 21:12:02 2022] POST /identity/v3/users/7be1ed1be246473384d85c165a39fa26/password => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:03.923637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7910aec-eda9-47cf-9ae6-4cf2938c753c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:03.924213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7910aec-eda9-47cf-9ae6-4cf2938c753c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:03.924566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7910aec-eda9-47cf-9ae6-4cf2938c753c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:03.972224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b7910aec-eda9-47cf-9ae6-4cf2938c753c None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:03.974520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b7910aec-eda9-47cf-9ae6-4cf2938c753c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:03.979760 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1910/3776] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:03 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:03.984902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626565b8-f161-4a9d-8cf2-a69559ee205e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:03.985880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626565b8-f161-4a9d-8cf2-a69559ee205e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:03.986311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626565b8-f161-4a9d-8cf2-a69559ee205e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:04.019449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-626565b8-f161-4a9d-8cf2-a69559ee205e None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:04.024138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-626565b8-f161-4a9d-8cf2-a69559ee205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:04.042184 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1867/3777] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:04.046556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7910aec-eda9-47cf-9ae6-4cf2938c753c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:04.066722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7910aec-eda9-47cf-9ae6-4cf2938c753c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:04.086507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cafdbc-67de-49ec-82c8-a09b31366995 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be1ed1be246473384d85c165a39fa26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1be96a47b047188a095ed9ce815737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:04.087422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cafdbc-67de-49ec-82c8-a09b31366995 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:04.087700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cafdbc-67de-49ec-82c8-a09b31366995 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:04.087979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cafdbc-67de-49ec-82c8-a09b31366995 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] PATH_INFO: `/v3/users/7be1ed1be246473384d85c165a39fa26/password` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:04.220760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-83cafdbc-67de-49ec-82c8-a09b31366995 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7be1ed1be246473384d85c165a39fa26'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:04.257600 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1911/3778] 10.222.0.43 () {60 vars in 1268 bytes} [Sat Jul 2 21:12:04 2022] POST /identity/v3/users/7be1ed1be246473384d85c165a39fa26/password => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:05.266477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a0262-1e73-4e64-b5be-d3ed9d95f30a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:05.267519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a0262-1e73-4e64-b5be-d3ed9d95f30a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:05.267519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a0262-1e73-4e64-b5be-d3ed9d95f30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:05.294712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-819a0262-1e73-4e64-b5be-d3ed9d95f30a None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:05.296187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-819a0262-1e73-4e64-b5be-d3ed9d95f30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:05.299871 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1868/3779] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:05 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:05.305445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0a127-dfe0-47f8-80af-850f394c864e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:05.305921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0a127-dfe0-47f8-80af-850f394c864e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:05.306025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0a127-dfe0-47f8-80af-850f394c864e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:05.325582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4ae0a127-dfe0-47f8-80af-850f394c864e None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:05.327224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4ae0a127-dfe0-47f8-80af-850f394c864e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:05.337683 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1912/3780] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:05.342946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a0262-1e73-4e64-b5be-d3ed9d95f30a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:05.357210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a0262-1e73-4e64-b5be-d3ed9d95f30a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:05.362574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57709ff-a759-44dc-9554-5ea0f392740d tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be1ed1be246473384d85c165a39fa26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1be96a47b047188a095ed9ce815737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:05.363679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57709ff-a759-44dc-9554-5ea0f392740d tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:05.364307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57709ff-a759-44dc-9554-5ea0f392740d tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:05.364735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57709ff-a759-44dc-9554-5ea0f392740d tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] PATH_INFO: `/v3/users/7be1ed1be246473384d85c165a39fa26/password` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:05.430236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e57709ff-a759-44dc-9554-5ea0f392740d tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7be1ed1be246473384d85c165a39fa26'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:05.444162 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1869/3781] 10.222.0.43 () {60 vars in 1268 bytes} [Sat Jul 2 21:12:05 2022] POST /identity/v3/users/7be1ed1be246473384d85c165a39fa26/password => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:12:06.452143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff9f48-42f7-4dff-bca1-be9738d03c19 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:06.452684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff9f48-42f7-4dff-bca1-be9738d03c19 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:06.452794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff9f48-42f7-4dff-bca1-be9738d03c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:06.494356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ebff9f48-42f7-4dff-bca1-be9738d03c19 None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:06.497179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ebff9f48-42f7-4dff-bca1-be9738d03c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:06.511791 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1913/3782] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:06 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:06.515811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d08054-3ed8-4c61-a297-e3bba2080030 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:06.516359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d08054-3ed8-4c61-a297-e3bba2080030 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:06.516452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d08054-3ed8-4c61-a297-e3bba2080030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:06.541719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-43d08054-3ed8-4c61-a297-e3bba2080030 None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:06.544461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-43d08054-3ed8-4c61-a297-e3bba2080030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:06.555007 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1870/3783] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:06.559758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff9f48-42f7-4dff-bca1-be9738d03c19 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:06.575038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff9f48-42f7-4dff-bca1-be9738d03c19 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:06.580349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f204acc-b926-4911-8a29-2bf96b06a9cb tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be1ed1be246473384d85c165a39fa26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1be96a47b047188a095ed9ce815737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:06.581469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f204acc-b926-4911-8a29-2bf96b06a9cb tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:06.581770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f204acc-b926-4911-8a29-2bf96b06a9cb tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:06.582262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f204acc-b926-4911-8a29-2bf96b06a9cb tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] PATH_INFO: `/v3/users/7be1ed1be246473384d85c165a39fa26/password` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:06.654631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8f204acc-b926-4911-8a29-2bf96b06a9cb tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7be1ed1be246473384d85c165a39fa26'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:06.676571 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1914/3784] 10.222.0.43 () {60 vars in 1268 bytes} [Sat Jul 2 21:12:06 2022] POST /identity/v3/users/7be1ed1be246473384d85c165a39fa26/password => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:07.123740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836a049-c432-4954-8a95-488e4bfe0c42 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:07.124030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836a049-c432-4954-8a95-488e4bfe0c42 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:07.124518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836a049-c432-4954-8a95-488e4bfe0c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:07.148755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c836a049-c432-4954-8a95-488e4bfe0c42 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:07.151547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c836a049-c432-4954-8a95-488e4bfe0c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:07.185340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:07.231342 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1871/3785] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:12:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:12:07.259680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f204acc-b926-4911-8a29-2bf96b06a9cb tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:07.263267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8f204acc-b926-4911-8a29-2bf96b06a9cb tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:07.311713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=85,keystone:INSERT=7,keystone:UPDATE=3,keystone:DELETE=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:07.364910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f204acc-b926-4911-8a29-2bf96b06a9cb tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:07.370363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e915250-f826-40df-b769-768ef8fb8f90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:07.371170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e915250-f826-40df-b769-768ef8fb8f90 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:07.371578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e915250-f826-40df-b769-768ef8fb8f90 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:07.372552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e915250-f826-40df-b769-768ef8fb8f90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:07.385846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e915250-f826-40df-b769-768ef8fb8f90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:07.388753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e915250-f826-40df-b769-768ef8fb8f90 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:07.399571 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1915/3786] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 02 21:12:07.682877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c77d84-5afd-44bc-8b87-e0aafc54cf25 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:07.683646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c77d84-5afd-44bc-8b87-e0aafc54cf25 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:07.684101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c77d84-5afd-44bc-8b87-e0aafc54cf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:07.711954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-23c77d84-5afd-44bc-8b87-e0aafc54cf25 None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:07.713388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-23c77d84-5afd-44bc-8b87-e0aafc54cf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:07.717944 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1872/3787] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:07 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:08.723392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c887d81-3b97-4991-b4d2-8b72e4d0a866 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:08.724492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c887d81-3b97-4991-b4d2-8b72e4d0a866 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:08.724980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c887d81-3b97-4991-b4d2-8b72e4d0a866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:08.753528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0c887d81-3b97-4991-b4d2-8b72e4d0a866 None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:08.754922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0c887d81-3b97-4991-b4d2-8b72e4d0a866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:08.769204 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1916/3788] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:08.772764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79097dd0-30cc-472e-8f99-107b0e4d992a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:08.773538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79097dd0-30cc-472e-8f99-107b0e4d992a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:08.773538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79097dd0-30cc-472e-8f99-107b0e4d992a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:08.803415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-79097dd0-30cc-472e-8f99-107b0e4d992a None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:08.807703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-79097dd0-30cc-472e-8f99-107b0e4d992a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:08.816661 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1873/3789] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:08 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:08.822074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a3175-8776-4839-a048-915e57d52937 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:08.822363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a3175-8776-4839-a048-915e57d52937 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:08.822642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a3175-8776-4839-a048-915e57d52937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:08.986980 ncdv-master-1 devstack@keystone.service[91078]: WARNING keystone.server.flask.application [None req-fd7a3175-8776-4839-a048-915e57d52937 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.43: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 02 21:12:08.991652 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1917/3790] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:08 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 168 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 02 21:12:08.995098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bb365-fd1a-4c97-aefc-1d436591d1ef None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:08.995596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bb365-fd1a-4c97-aefc-1d436591d1ef None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:08.995596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bb365-fd1a-4c97-aefc-1d436591d1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:09.068574 ncdv-master-1 devstack@keystone.service[91077]: WARNING keystone.server.flask.application [None req-a30bb365-fd1a-4c97-aefc-1d436591d1ef None None] Authorization failed. The request you have made requires authentication. from 10.222.0.43: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 02 21:12:09.073603 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1874/3791] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:08 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 79 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 02 21:12:09.082999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f7b41-b7b3-4f02-9a0c-bae51344fe8a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:09.082999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f7b41-b7b3-4f02-9a0c-bae51344fe8a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:09.082999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f7b41-b7b3-4f02-9a0c-bae51344fe8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:09.123213 ncdv-master-1 devstack@keystone.service[91078]: WARNING keystone.server.flask.application [None req-660f7b41-b7b3-4f02-9a0c-bae51344fe8a None None] Authorization failed. The request you have made requires authentication. from 10.222.0.43: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 02 21:12:09.127335 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1918/3792] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:09 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 49 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 02 21:12:10.767929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1dfab-0432-41e6-a59d-bcdb190a4d61 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:10.768916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1dfab-0432-41e6-a59d-bcdb190a4d61 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:10.769406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1dfab-0432-41e6-a59d-bcdb190a4d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:10.804674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-39e1dfab-0432-41e6-a59d-bcdb190a4d61 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:10.806310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-39e1dfab-0432-41e6-a59d-bcdb190a4d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:10.831031 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1875/3793] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:12:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:10.862581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f7b41-b7b3-4f02-9a0c-bae51344fe8a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:10.892532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f7b41-b7b3-4f02-9a0c-bae51344fe8a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:10.900879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a3aa3-b520-4bda-b9c0-3b6aa547df78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:10.902515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a3aa3-b520-4bda-b9c0-3b6aa547df78 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:10.902999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a3aa3-b520-4bda-b9c0-3b6aa547df78 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:10.903488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a3aa3-b520-4bda-b9c0-3b6aa547df78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:10.917588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a3aa3-b520-4bda-b9c0-3b6aa547df78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:10.920356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a3aa3-b520-4bda-b9c0-3b6aa547df78 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:10.933945 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1919/3794] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:12.946673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1dfab-0432-41e6-a59d-bcdb190a4d61 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:12.950262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-39e1dfab-0432-41e6-a59d-bcdb190a4d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:13.181452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1dfab-0432-41e6-a59d-bcdb190a4d61 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:13.186779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38326e78-2851-4d9f-b7bd-501039c83e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:13.187864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38326e78-2851-4d9f-b7bd-501039c83e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:13.188379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38326e78-2851-4d9f-b7bd-501039c83e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:13.188810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38326e78-2851-4d9f-b7bd-501039c83e22 admin admin] PATH_INFO: `/v3/users/d876976637504a83859b09a4ef0d3406` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:13.190760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38326e78-2851-4d9f-b7bd-501039c83e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d876976637504a83859b09a4ef0d3406)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:13.193321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38326e78-2851-4d9f-b7bd-501039c83e22 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:13.296233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-38326e78-2851-4d9f-b7bd-501039c83e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd876976637504a83859b09a4ef0d3406'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:13.315744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-38326e78-2851-4d9f-b7bd-501039c83e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd876976637504a83859b09a4ef0d3406'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:13.360729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-38326e78-2851-4d9f-b7bd-501039c83e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd876976637504a83859b09a4ef0d3406'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:13.361967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-38326e78-2851-4d9f-b7bd-501039c83e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd876976637504a83859b09a4ef0d3406'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:13.365463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-38326e78-2851-4d9f-b7bd-501039c83e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd876976637504a83859b09a4ef0d3406'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:13.428630 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1876/3795] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:12:12 2022] DELETE /identity/v3/users/d876976637504a83859b09a4ef0d3406 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:13.961459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a3aa3-b520-4bda-b9c0-3b6aa547df78 service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:13.986029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a3aa3-b520-4bda-b9c0-3b6aa547df78 service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:14.177560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d557f6-f539-430c-9eed-5549644d8149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:14.183104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d557f6-f539-430c-9eed-5549644d8149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:14.183574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d557f6-f539-430c-9eed-5549644d8149 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:14.183953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d557f6-f539-430c-9eed-5549644d8149 admin admin] PATH_INFO: `/v3/projects/d8523eb97eba43f4b819bc5d252bdcb7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:14.185458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d557f6-f539-430c-9eed-5549644d8149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8523eb97eba43f4b819bc5d252bdcb7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:14.190807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d557f6-f539-430c-9eed-5549644d8149 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:14.297271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-59d557f6-f539-430c-9eed-5549644d8149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8523eb97eba43f4b819bc5d252bdcb7', 'request_id': 'req-59d557f6-f539-430c-9eed-5549644d8149'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:14.313655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-59d557f6-f539-430c-9eed-5549644d8149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8523eb97eba43f4b819bc5d252bdcb7', 'request_id': 'req-59d557f6-f539-430c-9eed-5549644d8149'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:14.329232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-59d557f6-f539-430c-9eed-5549644d8149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8523eb97eba43f4b819bc5d252bdcb7', 'request_id': 'req-59d557f6-f539-430c-9eed-5549644d8149'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:14.339558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:14.349536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-59d557f6-f539-430c-9eed-5549644d8149 admin admin] The token cache is being invalidate because project d8523eb97eba43f4b819bc5d252bdcb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:12:14.349896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-59d557f6-f539-430c-9eed-5549644d8149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:14.350687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-59d557f6-f539-430c-9eed-5549644d8149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:14.360418 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1920/3796] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:13 2022] DELETE /identity/v3/projects/d8523eb97eba43f4b819bc5d252bdcb7 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:14.361831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e34da-48fa-431d-b709-378735d7777a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:14.362356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e34da-48fa-431d-b709-378735d7777a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:14.362497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e34da-48fa-431d-b709-378735d7777a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:14.387814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ca9e34da-48fa-431d-b709-378735d7777a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:14.392982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ca9e34da-48fa-431d-b709-378735d7777a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:14.404029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:14.567314 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1877/3797] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:14.575999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba799b5d-8280-4751-8606-f18ac372c0b4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:14.579596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba799b5d-8280-4751-8606-f18ac372c0b4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:14.581830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba799b5d-8280-4751-8606-f18ac372c0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:14.680208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ba799b5d-8280-4751-8606-f18ac372c0b4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:14.680208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ba799b5d-8280-4751-8606-f18ac372c0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:14.720598 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1921/3798] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:14.721899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e34da-48fa-431d-b709-378735d7777a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:14.743262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e34da-48fa-431d-b709-378735d7777a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:14.762243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c10ba7-8b09-423e-a6e5-2f61052d55f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:14.762949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c10ba7-8b09-423e-a6e5-2f61052d55f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:14.763239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c10ba7-8b09-423e-a6e5-2f61052d55f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:14.763517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c10ba7-8b09-423e-a6e5-2f61052d55f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:14.764300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c10ba7-8b09-423e-a6e5-2f61052d55f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:12:14.764609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c10ba7-8b09-423e-a6e5-2f61052d55f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:14.766270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c10ba7-8b09-423e-a6e5-2f61052d55f2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:14.813666 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1878/3799] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:12:14.814829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba799b5d-8280-4751-8606-f18ac372c0b4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:14.834286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba799b5d-8280-4751-8606-f18ac372c0b4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:14.839255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37741ac7-fedd-401f-9ed3-db9672a9807d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:14.839948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37741ac7-fedd-401f-9ed3-db9672a9807d admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:14.840313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37741ac7-fedd-401f-9ed3-db9672a9807d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:14.840595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37741ac7-fedd-401f-9ed3-db9672a9807d admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:14.841365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37741ac7-fedd-401f-9ed3-db9672a9807d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:14.854318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37741ac7-fedd-401f-9ed3-db9672a9807d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:14.908257 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1922/3800] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:12:14 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:12:14.911277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c10ba7-8b09-423e-a6e5-2f61052d55f2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:14.927750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c10ba7-8b09-423e-a6e5-2f61052d55f2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:15.081096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a74f7-1d8b-4305-b381-4d83a1634b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:15.081096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a74f7-1d8b-4305-b381-4d83a1634b62 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:15.081096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a74f7-1d8b-4305-b381-4d83a1634b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:15.081096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a74f7-1d8b-4305-b381-4d83a1634b62 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:15.081936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a74f7-1d8b-4305-b381-4d83a1634b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:15.085736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a74f7-1d8b-4305-b381-4d83a1634b62 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:15.149192 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1879/3801] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:12:14 2022] POST /identity/v3/users => generated 290 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:12:15.152181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37741ac7-fedd-401f-9ed3-db9672a9807d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:15.165766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37741ac7-fedd-401f-9ed3-db9672a9807d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:15.198104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfdbf5-c2df-46e3-9dc6-ff70fd8b298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:15.198827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfdbf5-c2df-46e3-9dc6-ff70fd8b298d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:15.199112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfdbf5-c2df-46e3-9dc6-ff70fd8b298d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:15.199702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfdbf5-c2df-46e3-9dc6-ff70fd8b298d admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:15.200153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfdbf5-c2df-46e3-9dc6-ff70fd8b298d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:15.202331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfdbf5-c2df-46e3-9dc6-ff70fd8b298d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:15.260579 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1923/3802] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:15.264910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a74f7-1d8b-4305-b381-4d83a1634b62 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:15.278710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a74f7-1d8b-4305-b381-4d83a1634b62 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:15.325330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc636ad9-62c1-4679-b948-01acd3d46609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:15.326324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc636ad9-62c1-4679-b948-01acd3d46609 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:15.327374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc636ad9-62c1-4679-b948-01acd3d46609 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:15.327935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc636ad9-62c1-4679-b948-01acd3d46609 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:15.328836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc636ad9-62c1-4679-b948-01acd3d46609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:15.348956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc636ad9-62c1-4679-b948-01acd3d46609 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:15.379529 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1880/3803] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:15.382438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfdbf5-c2df-46e3-9dc6-ff70fd8b298d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:15.417690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfdbf5-c2df-46e3-9dc6-ff70fd8b298d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:15.450695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5205362-1e65-4b9f-9e32-e6b011046a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:15.451620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5205362-1e65-4b9f-9e32-e6b011046a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:15.451620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5205362-1e65-4b9f-9e32-e6b011046a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:15.451818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5205362-1e65-4b9f-9e32-e6b011046a08 admin admin] PATH_INFO: `/v3/projects/f41113b377ec49a5a23587dd0d67f440/users/bf59cddfcf2a4e9eb7f1e94f553b118b/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:15.564170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5205362-1e65-4b9f-9e32-e6b011046a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41113b377ec49a5a23587dd0d67f440, user_id=bf59cddfcf2a4e9eb7f1e94f553b118b, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:15.565317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5205362-1e65-4b9f-9e32-e6b011046a08 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:15.690875 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1924/3804] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:12:15 2022] PUT /identity/v3/projects/f41113b377ec49a5a23587dd0d67f440/users/bf59cddfcf2a4e9eb7f1e94f553b118b/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:15.710791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faba77-6060-49df-8d3f-1136c3572cc7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:15.711471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faba77-6060-49df-8d3f-1136c3572cc7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:15.711881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faba77-6060-49df-8d3f-1136c3572cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:15.795241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-81faba77-6060-49df-8d3f-1136c3572cc7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:15.802986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-81faba77-6060-49df-8d3f-1136c3572cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:15.972326 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1881/3805] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:15.994305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5205362-1e65-4b9f-9e32-e6b011046a08 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:15.996237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b5205362-1e65-4b9f-9e32-e6b011046a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:16.153464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5205362-1e65-4b9f-9e32-e6b011046a08 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:16.160551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6a1db-b166-4761-9d47-ee7c94f6c62d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:16.161344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6a1db-b166-4761-9d47-ee7c94f6c62d service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:16.161738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6a1db-b166-4761-9d47-ee7c94f6c62d service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:16.162116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6a1db-b166-4761-9d47-ee7c94f6c62d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:16.177819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6a1db-b166-4761-9d47-ee7c94f6c62d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:16.180436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6a1db-b166-4761-9d47-ee7c94f6c62d service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:16.195116 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1925/3806] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:12:16.836429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faba77-6060-49df-8d3f-1136c3572cc7 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:16.843145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-81faba77-6060-49df-8d3f-1136c3572cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:16.864819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faba77-6060-49df-8d3f-1136c3572cc7 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:16.870496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871bc2d-c4e1-4090-8d2e-a374f82b9c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:16.872508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871bc2d-c4e1-4090-8d2e-a374f82b9c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:16.872800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871bc2d-c4e1-4090-8d2e-a374f82b9c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:16.873112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871bc2d-c4e1-4090-8d2e-a374f82b9c05 admin admin] PATH_INFO: `/v3/users/b3b24a3216aa4eba8a9a90c109c3b491` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:16.874460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871bc2d-c4e1-4090-8d2e-a374f82b9c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b24a3216aa4eba8a9a90c109c3b491)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:16.876585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871bc2d-c4e1-4090-8d2e-a374f82b9c05 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:16.897504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:17.005255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9871bc2d-c4e1-4090-8d2e-a374f82b9c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b24a3216aa4eba8a9a90c109c3b491'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:17.029496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9871bc2d-c4e1-4090-8d2e-a374f82b9c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b24a3216aa4eba8a9a90c109c3b491'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:17.039268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9871bc2d-c4e1-4090-8d2e-a374f82b9c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b24a3216aa4eba8a9a90c109c3b491'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:17.042671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9871bc2d-c4e1-4090-8d2e-a374f82b9c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b24a3216aa4eba8a9a90c109c3b491'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:17.043334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9871bc2d-c4e1-4090-8d2e-a374f82b9c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b24a3216aa4eba8a9a90c109c3b491'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:17.103192 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1882/3807] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:12:16 2022] DELETE /identity/v3/users/b3b24a3216aa4eba8a9a90c109c3b491 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:17.793164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6a1db-b166-4761-9d47-ee7c94f6c62d service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:17.815572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6a1db-b166-4761-9d47-ee7c94f6c62d service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:18.056398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66480e-97dc-41d5-9725-798ef1096805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:18.058368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66480e-97dc-41d5-9725-798ef1096805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:18.058745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66480e-97dc-41d5-9725-798ef1096805 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:18.059348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66480e-97dc-41d5-9725-798ef1096805 admin admin] PATH_INFO: `/v3/projects/dffcfd79372c47e89be4acbdc042d510` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:18.060911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66480e-97dc-41d5-9725-798ef1096805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dffcfd79372c47e89be4acbdc042d510)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:18.063940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66480e-97dc-41d5-9725-798ef1096805 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:18.213901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:18.238331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-df66480e-97dc-41d5-9725-798ef1096805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dffcfd79372c47e89be4acbdc042d510', 'request_id': 'req-df66480e-97dc-41d5-9725-798ef1096805'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:18.271968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-df66480e-97dc-41d5-9725-798ef1096805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dffcfd79372c47e89be4acbdc042d510', 'request_id': 'req-df66480e-97dc-41d5-9725-798ef1096805'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:18.288702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-df66480e-97dc-41d5-9725-798ef1096805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dffcfd79372c47e89be4acbdc042d510', 'request_id': 'req-df66480e-97dc-41d5-9725-798ef1096805'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:18.314621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-df66480e-97dc-41d5-9725-798ef1096805 admin admin] The token cache is being invalidate because project dffcfd79372c47e89be4acbdc042d510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:12:18.314984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-df66480e-97dc-41d5-9725-798ef1096805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:18.315761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-df66480e-97dc-41d5-9725-798ef1096805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:18.321769 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1926/3808] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:17 2022] DELETE /identity/v3/projects/dffcfd79372c47e89be4acbdc042d510 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:18.323732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b59622-82ef-40a5-89e2-31857fb8722b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:18.324141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b59622-82ef-40a5-89e2-31857fb8722b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:18.324487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b59622-82ef-40a5-89e2-31857fb8722b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:18.373343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-73b59622-82ef-40a5-89e2-31857fb8722b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:18.374311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-73b59622-82ef-40a5-89e2-31857fb8722b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:18.622456 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1883/3809] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:18.632495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b47e8c-9150-45da-9481-1e9d862d3f4c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:18.632859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b47e8c-9150-45da-9481-1e9d862d3f4c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:18.633182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b47e8c-9150-45da-9481-1e9d862d3f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:18.690838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-95b47e8c-9150-45da-9481-1e9d862d3f4c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:18.702517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-95b47e8c-9150-45da-9481-1e9d862d3f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:18.744518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b59622-82ef-40a5-89e2-31857fb8722b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:18.760531 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1927/3810] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:18.761120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b59622-82ef-40a5-89e2-31857fb8722b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:18.776781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050c370-df3f-4873-acc1-7868be9116f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:18.777618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050c370-df3f-4873-acc1-7868be9116f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:18.778008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050c370-df3f-4873-acc1-7868be9116f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:18.778387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050c370-df3f-4873-acc1-7868be9116f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:18.779244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050c370-df3f-4873-acc1-7868be9116f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:12:18.779657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050c370-df3f-4873-acc1-7868be9116f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:18.783629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050c370-df3f-4873-acc1-7868be9116f8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:18.821021 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1884/3811] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:12:18.822492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b47e8c-9150-45da-9481-1e9d862d3f4c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:18.837777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b47e8c-9150-45da-9481-1e9d862d3f4c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:18.851972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe878c-aeeb-47ac-986a-d5247dcb09c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:18.863331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe878c-aeeb-47ac-986a-d5247dcb09c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:18.863331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe878c-aeeb-47ac-986a-d5247dcb09c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:18.863331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe878c-aeeb-47ac-986a-d5247dcb09c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:18.863331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe878c-aeeb-47ac-986a-d5247dcb09c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:18.863331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe878c-aeeb-47ac-986a-d5247dcb09c9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:18.970074 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1928/3812] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:12:18 2022] POST /identity/v3/projects => generated 399 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:12:18.975606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050c370-df3f-4873-acc1-7868be9116f8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:18.992495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050c370-df3f-4873-acc1-7868be9116f8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:19.130896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afaf1f-f4cf-4780-bfa6-8c4e4e10b473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:19.132558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afaf1f-f4cf-4780-bfa6-8c4e4e10b473 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:19.133051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afaf1f-f4cf-4780-bfa6-8c4e4e10b473 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:19.133840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afaf1f-f4cf-4780-bfa6-8c4e4e10b473 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:19.134925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8afaf1f-f4cf-4780-bfa6-8c4e4e10b473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:19.137545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8afaf1f-f4cf-4780-bfa6-8c4e4e10b473 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:19.183871 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1885/3813] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:12:18 2022] POST /identity/v3/users => generated 300 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:12:19.184180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe878c-aeeb-47ac-986a-d5247dcb09c9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:19.200149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe878c-aeeb-47ac-986a-d5247dcb09c9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:19.216525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fdaab-4868-4480-b7f1-e9976c0d1685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:19.217346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fdaab-4868-4480-b7f1-e9976c0d1685 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:19.217559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fdaab-4868-4480-b7f1-e9976c0d1685 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:19.217806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fdaab-4868-4480-b7f1-e9976c0d1685 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:19.218547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fdaab-4868-4480-b7f1-e9976c0d1685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:19.226099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fdaab-4868-4480-b7f1-e9976c0d1685 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:19.254347 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1929/3814] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:19.256665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afaf1f-f4cf-4780-bfa6-8c4e4e10b473 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:19.276246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afaf1f-f4cf-4780-bfa6-8c4e4e10b473 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:19.287079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24828bc-1774-4535-8480-f4a8cbfdc090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:19.287843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24828bc-1774-4535-8480-f4a8cbfdc090 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:19.288155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24828bc-1774-4535-8480-f4a8cbfdc090 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:19.288482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24828bc-1774-4535-8480-f4a8cbfdc090 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:19.291374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24828bc-1774-4535-8480-f4a8cbfdc090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:19.293960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24828bc-1774-4535-8480-f4a8cbfdc090 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:19.295542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:19.316526 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1886/3815] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:19.317714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fdaab-4868-4480-b7f1-e9976c0d1685 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:19.342209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fdaab-4868-4480-b7f1-e9976c0d1685 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:19.347840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5047e9-48fd-455b-829a-6ce66d02da4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:19.348806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5047e9-48fd-455b-829a-6ce66d02da4b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:19.349091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5047e9-48fd-455b-829a-6ce66d02da4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:19.349365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5047e9-48fd-455b-829a-6ce66d02da4b admin admin] PATH_INFO: `/v3/projects/66e4808fc53c4fea8a84d0ff8c58c718/users/841970d31bb3498eb7daef3c915ade39/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:19.386210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5047e9-48fd-455b-829a-6ce66d02da4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e4808fc53c4fea8a84d0ff8c58c718, user_id=841970d31bb3498eb7daef3c915ade39, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:19.395447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5047e9-48fd-455b-829a-6ce66d02da4b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:19.442473 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1930/3816] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:12:19 2022] PUT /identity/v3/projects/66e4808fc53c4fea8a84d0ff8c58c718/users/841970d31bb3498eb7daef3c915ade39/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:19.454364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ee557-3216-45aa-883f-132752e5c4ab None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:19.455991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ee557-3216-45aa-883f-132752e5c4ab None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:19.456359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ee557-3216-45aa-883f-132752e5c4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:19.516295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c09ee557-3216-45aa-883f-132752e5c4ab None None] MFA Rules not processed for user `841970d31bb3498eb7daef3c915ade39`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:19.519467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c09ee557-3216-45aa-883f-132752e5c4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:19.621428 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1887/3817] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:19.635344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5047e9-48fd-455b-829a-6ce66d02da4b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:19.638005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1d5047e9-48fd-455b-829a-6ce66d02da4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:19.842521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5047e9-48fd-455b-829a-6ce66d02da4b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:19.849150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a951da0-9baf-4323-b0f0-0fc81f9274d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:19.849992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a951da0-9baf-4323-b0f0-0fc81f9274d3 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:19.850170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a951da0-9baf-4323-b0f0-0fc81f9274d3 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:19.850403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a951da0-9baf-4323-b0f0-0fc81f9274d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:19.877745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a951da0-9baf-4323-b0f0-0fc81f9274d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:19.879945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a951da0-9baf-4323-b0f0-0fc81f9274d3 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:19.895589 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1931/3818] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:12:20.140617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eeff0c-223f-4154-b32c-8d3f4c19527b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:20.141337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eeff0c-223f-4154-b32c-8d3f4c19527b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:20.141829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eeff0c-223f-4154-b32c-8d3f4c19527b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:20.255977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-92eeff0c-223f-4154-b32c-8d3f4c19527b None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:20.257558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-92eeff0c-223f-4154-b32c-8d3f4c19527b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:20.276857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a951da0-9baf-4323-b0f0-0fc81f9274d3 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:20.277898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0a951da0-9baf-4323-b0f0-0fc81f9274d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:20.287838 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1888/3819] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:20 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:20.440845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:20.461098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a951da0-9baf-4323-b0f0-0fc81f9274d3 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:20.474424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13da19e-39d1-4cf3-a548-deb6585c92d7 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be1ed1be246473384d85c165a39fa26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1be96a47b047188a095ed9ce815737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:20.481637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13da19e-39d1-4cf3-a548-deb6585c92d7 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:20.483774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13da19e-39d1-4cf3-a548-deb6585c92d7 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:20.484322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13da19e-39d1-4cf3-a548-deb6585c92d7 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] PATH_INFO: `/v3/users/7be1ed1be246473384d85c165a39fa26/password` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:20.591127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b13da19e-39d1-4cf3-a548-deb6585c92d7 tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7be1ed1be246473384d85c165a39fa26'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:20.622002 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1932/3820] 10.222.0.43 () {60 vars in 1268 bytes} [Sat Jul 2 21:12:20 2022] POST /identity/v3/users/7be1ed1be246473384d85c165a39fa26/password => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:21.627567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec847d31-1659-47e3-be04-3501f122eab6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:21.628182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec847d31-1659-47e3-be04-3501f122eab6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:21.628182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec847d31-1659-47e3-be04-3501f122eab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:21.709685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ec847d31-1659-47e3-be04-3501f122eab6 None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:21.710949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ec847d31-1659-47e3-be04-3501f122eab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:21.735750 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1889/3821] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:21 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:21.736371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd92f9-89bf-46dd-9c9c-02ab5290d64d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:21.736901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd92f9-89bf-46dd-9c9c-02ab5290d64d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:21.736997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd92f9-89bf-46dd-9c9c-02ab5290d64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:21.825963 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-07fd92f9-89bf-46dd-9c9c-02ab5290d64d None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 02 21:12:21.825963 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:12:21.825963 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:12:21.825963 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:12:21.825963 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:12:21.825963 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:12:21.825963 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:12:21.825963 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:12:21.825963 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:12:21.825963 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:12:21.825963 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:12:21.825963 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:12:21.825963 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 02 21:12:21.825963 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 02 21:12:21.825963 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Jul 02 21:12:21.825963 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Jul 02 21:12:21.827211 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Jul 02 21:12:21.827211 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Jul 02 21:12:21.827211 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Jul 02 21:12:21.827211 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Jul 02 21:12:21.827211 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Jul 02 21:12:21.827211 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Jul 02 21:12:21.827211 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Jul 02 21:12:21.827211 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Jul 02 21:12:21.827211 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:12:21.827211 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:12:21.827211 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 02 21:12:21.827211 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 02 21:12:21.827211 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 02 21:12:21.827211 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 02 21:12:21.827211 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:12:21.827211 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:12:21.828843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 02 21:12:21.828843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 02 21:12:21.828843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:12:21.828843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:12:21.828843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 02 21:12:21.828843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 02 21:12:21.828843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:12:21.828843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:12:21.828843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 02 21:12:21.828843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 02 21:12:21.828843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 02 21:12:21.828843 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:12:21.828843 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1933/3822] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:21 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 21:12:21.833082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99833c0e-f063-44e4-9f6c-a68cc4be9219 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:21.833373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99833c0e-f063-44e4-9f6c-a68cc4be9219 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:21.833645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99833c0e-f063-44e4-9f6c-a68cc4be9219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:21.952567 ncdv-master-1 devstack@keystone.service[91077]: WARNING keystone.server.flask.application [None req-99833c0e-f063-44e4-9f6c-a68cc4be9219 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.43: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 02 21:12:21.961976 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1890/3823] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:21 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 130 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 02 21:12:21.962402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe137bd6-7a55-4f5b-869d-40e056bae03c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:21.962882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe137bd6-7a55-4f5b-869d-40e056bae03c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:21.963345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe137bd6-7a55-4f5b-869d-40e056bae03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:22.043299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fe137bd6-7a55-4f5b-869d-40e056bae03c None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:22.047468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fe137bd6-7a55-4f5b-869d-40e056bae03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:22.070004 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1934/3824] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:12:22.072161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99833c0e-f063-44e4-9f6c-a68cc4be9219 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:22.102746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99833c0e-f063-44e4-9f6c-a68cc4be9219 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:22.122541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467ccd3-a408-4f0e-8340-aad9a5f479bb tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be1ed1be246473384d85c165a39fa26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1be96a47b047188a095ed9ce815737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:22.136493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467ccd3-a408-4f0e-8340-aad9a5f479bb tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:22.139652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467ccd3-a408-4f0e-8340-aad9a5f479bb tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:22.139877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467ccd3-a408-4f0e-8340-aad9a5f479bb tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] PATH_INFO: `/v3/users/7be1ed1be246473384d85c165a39fa26/password` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:22.314230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d467ccd3-a408-4f0e-8340-aad9a5f479bb tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7be1ed1be246473384d85c165a39fa26'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:22.339775 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1891/3825] 10.222.0.43 () {60 vars in 1268 bytes} [Sat Jul 2 21:12:22 2022] POST /identity/v3/users/7be1ed1be246473384d85c165a39fa26/password => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:23.348183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e432381-b59d-482f-950b-4f77ae814f03 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:23.349222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e432381-b59d-482f-950b-4f77ae814f03 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:23.349721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e432381-b59d-482f-950b-4f77ae814f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:23.374397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5e432381-b59d-482f-950b-4f77ae814f03 None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:23.376078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5e432381-b59d-482f-950b-4f77ae814f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:23.386610 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1935/3826] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:23 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:23.391839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f152f-f84a-4748-8ffb-8cda443fd60e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:23.393403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f152f-f84a-4748-8ffb-8cda443fd60e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:23.393902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f152f-f84a-4748-8ffb-8cda443fd60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:23.428652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bb2f152f-f84a-4748-8ffb-8cda443fd60e None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:23.432350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bb2f152f-f84a-4748-8ffb-8cda443fd60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:23.454450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e432381-b59d-482f-950b-4f77ae814f03 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:23.469368 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1892/3827] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:23.471190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e432381-b59d-482f-950b-4f77ae814f03 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:23.495989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451af59-3c12-4f13-965d-f515e1ba68bc tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be1ed1be246473384d85c165a39fa26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1be96a47b047188a095ed9ce815737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:23.497474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451af59-3c12-4f13-965d-f515e1ba68bc tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:23.497965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451af59-3c12-4f13-965d-f515e1ba68bc tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:23.498450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451af59-3c12-4f13-965d-f515e1ba68bc tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] PATH_INFO: `/v3/users/7be1ed1be246473384d85c165a39fa26/password` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:23.581229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a451af59-3c12-4f13-965d-f515e1ba68bc tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7be1ed1be246473384d85c165a39fa26'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:23.610943 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1936/3828] 10.222.0.43 () {60 vars in 1268 bytes} [Sat Jul 2 21:12:23 2022] POST /identity/v3/users/7be1ed1be246473384d85c165a39fa26/password => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:24.617347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8110b-6008-49c2-bf12-80c35abe7532 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:24.618292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8110b-6008-49c2-bf12-80c35abe7532 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:24.619328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8110b-6008-49c2-bf12-80c35abe7532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:24.648079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-59e8110b-6008-49c2-bf12-80c35abe7532 None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:24.649619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-59e8110b-6008-49c2-bf12-80c35abe7532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:24.659125 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1893/3829] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:24 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:24.663880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e296f-4fe0-4c7e-8a8c-e0b4c80acb9e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:24.664824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e296f-4fe0-4c7e-8a8c-e0b4c80acb9e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:24.665279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e296f-4fe0-4c7e-8a8c-e0b4c80acb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:24.709278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-513e296f-4fe0-4c7e-8a8c-e0b4c80acb9e None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:24.710918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-513e296f-4fe0-4c7e-8a8c-e0b4c80acb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:24.718807 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1937/3830] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:24.723153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8110b-6008-49c2-bf12-80c35abe7532 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:24.741375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8110b-6008-49c2-bf12-80c35abe7532 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:24.746729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80d794-7442-45e7-aafe-1efd4b85141e tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be1ed1be246473384d85c165a39fa26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f1be96a47b047188a095ed9ce815737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:24.749021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80d794-7442-45e7-aafe-1efd4b85141e tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:24.751467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80d794-7442-45e7-aafe-1efd4b85141e tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:24.751993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80d794-7442-45e7-aafe-1efd4b85141e tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] PATH_INFO: `/v3/users/7be1ed1be246473384d85c165a39fa26/password` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:24.845687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fb80d794-7442-45e7-aafe-1efd4b85141e tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7be1ed1be246473384d85c165a39fa26'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:24.869322 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1894/3831] 10.222.0.43 () {60 vars in 1268 bytes} [Sat Jul 2 21:12:24 2022] POST /identity/v3/users/7be1ed1be246473384d85c165a39fa26/password => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:25.489212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abb53c-6384-4f9d-8cc8-017f8554181b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:25.489589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abb53c-6384-4f9d-8cc8-017f8554181b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:25.489976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abb53c-6384-4f9d-8cc8-017f8554181b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:25.537057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80d794-7442-45e7-aafe-1efd4b85141e tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:25.539124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-47abb53c-6384-4f9d-8cc8-017f8554181b None None] MFA Rules not processed for user `bf59cddfcf2a4e9eb7f1e94f553b118b`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:25.540330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-47abb53c-6384-4f9d-8cc8-017f8554181b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:25.561019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:UPDATE=4,keystone:INSERT=4,keystone:DELETE=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:25.688874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80d794-7442-45e7-aafe-1efd4b85141e tempest-IdentityV3UsersTest-2053615778 tempest-IdentityV3UsersTest-2053615778-project] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:25.696795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9bb10-81a2-4fd5-b010-7c05163dd15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:25.697927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9bb10-81a2-4fd5-b010-7c05163dd15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:25.698443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9bb10-81a2-4fd5-b010-7c05163dd15a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:25.698899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9bb10-81a2-4fd5-b010-7c05163dd15a admin admin] PATH_INFO: `/v3/users/841970d31bb3498eb7daef3c915ade39` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:25.700787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9bb10-81a2-4fd5-b010-7c05163dd15a admin admin] RBAC: Authorizing `identity:delete_user(user_id=841970d31bb3498eb7daef3c915ade39)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:25.703130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9bb10-81a2-4fd5-b010-7c05163dd15a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:25.703939 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1938/3832] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:25.716975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abb53c-6384-4f9d-8cc8-017f8554181b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:25.746798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abb53c-6384-4f9d-8cc8-017f8554181b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:25.758884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5fa0f-d1a4-4253-9182-127bb38d5081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:25.759869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5fa0f-d1a4-4253-9182-127bb38d5081 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:25.760324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5fa0f-d1a4-4253-9182-127bb38d5081 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:25.760955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5fa0f-d1a4-4253-9182-127bb38d5081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:25.776725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5fa0f-d1a4-4253-9182-127bb38d5081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:25.778599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5fa0f-d1a4-4253-9182-127bb38d5081 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:25.808489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bfd9bb10-81a2-4fd5-b010-7c05163dd15a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '841970d31bb3498eb7daef3c915ade39'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:25.828076 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1939/3833] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:12:25.828297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bfd9bb10-81a2-4fd5-b010-7c05163dd15a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '841970d31bb3498eb7daef3c915ade39'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:25.837150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bfd9bb10-81a2-4fd5-b010-7c05163dd15a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '841970d31bb3498eb7daef3c915ade39'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:25.837982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bfd9bb10-81a2-4fd5-b010-7c05163dd15a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '841970d31bb3498eb7daef3c915ade39'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:25.838680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bfd9bb10-81a2-4fd5-b010-7c05163dd15a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '841970d31bb3498eb7daef3c915ade39'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:25.862870 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1895/3834] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:12:25 2022] DELETE /identity/v3/users/841970d31bb3498eb7daef3c915ade39 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:25.867759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca18891-abd5-43a1-8ef2-38edfdc4445e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:25.868082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca18891-abd5-43a1-8ef2-38edfdc4445e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:25.868364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca18891-abd5-43a1-8ef2-38edfdc4445e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:25.875952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1982d-f04b-4f8c-bb23-536b35b8e901 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:25.877501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1982d-f04b-4f8c-bb23-536b35b8e901 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:25.878012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1982d-f04b-4f8c-bb23-536b35b8e901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:25.899472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f2f1982d-f04b-4f8c-bb23-536b35b8e901 None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:25.901323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f2f1982d-f04b-4f8c-bb23-536b35b8e901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:25.901500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fca18891-abd5-43a1-8ef2-38edfdc4445e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:25.902934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fca18891-abd5-43a1-8ef2-38edfdc4445e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:25.909595 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1896/3835] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:25 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:25.973598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:26.035971 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1940/3836] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:26.051658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1982d-f04b-4f8c-bb23-536b35b8e901 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:26.053380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f2f1982d-f04b-4f8c-bb23-536b35b8e901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:26.226476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1982d-f04b-4f8c-bb23-536b35b8e901 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:26.230997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c366d9-cee1-49b5-8cec-30c005db6e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:26.237581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c366d9-cee1-49b5-8cec-30c005db6e13 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:26.237929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c366d9-cee1-49b5-8cec-30c005db6e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:26.238205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c366d9-cee1-49b5-8cec-30c005db6e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:26.257440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c366d9-cee1-49b5-8cec-30c005db6e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:26.260160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c366d9-cee1-49b5-8cec-30c005db6e13 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:26.286302 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1897/3837] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:12:26.916885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e28cb-350b-4791-9a06-f7decc6bde8b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:26.917904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e28cb-350b-4791-9a06-f7decc6bde8b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:26.918524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e28cb-350b-4791-9a06-f7decc6bde8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:26.951083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-dd3e28cb-350b-4791-9a06-f7decc6bde8b None None] MFA Rules not processed for user `7be1ed1be246473384d85c165a39fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:26.956232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dd3e28cb-350b-4791-9a06-f7decc6bde8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:27.111982 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1941/3838] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:27.112967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c366d9-cee1-49b5-8cec-30c005db6e13 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:27.117278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-27c366d9-cee1-49b5-8cec-30c005db6e13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:27.149771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c366d9-cee1-49b5-8cec-30c005db6e13 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:27.174839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf430f-eea8-416e-938b-b67524f96ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:27.175756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf430f-eea8-416e-938b-b67524f96ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:27.176050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf430f-eea8-416e-938b-b67524f96ade admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:27.176358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf430f-eea8-416e-938b-b67524f96ade admin admin] PATH_INFO: `/v3/users/7be1ed1be246473384d85c165a39fa26` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:27.178359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf430f-eea8-416e-938b-b67524f96ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be1ed1be246473384d85c165a39fa26)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:27.181219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf430f-eea8-416e-938b-b67524f96ade admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:27.257231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:27.316375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-36bf430f-eea8-416e-938b-b67524f96ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be1ed1be246473384d85c165a39fa26'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:27.338894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-36bf430f-eea8-416e-938b-b67524f96ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be1ed1be246473384d85c165a39fa26'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:27.385616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-36bf430f-eea8-416e-938b-b67524f96ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be1ed1be246473384d85c165a39fa26'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:27.436220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-36bf430f-eea8-416e-938b-b67524f96ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be1ed1be246473384d85c165a39fa26'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:27.438710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-36bf430f-eea8-416e-938b-b67524f96ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be1ed1be246473384d85c165a39fa26'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:27.563363 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1898/3839] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:12:27 2022] DELETE /identity/v3/users/7be1ed1be246473384d85c165a39fa26 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:12:27.598020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e28cb-350b-4791-9a06-f7decc6bde8b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:27.601179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839c8a4-7d5b-4847-a35b-fe040ea74c2a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:27.602798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839c8a4-7d5b-4847-a35b-fe040ea74c2a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:27.603437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839c8a4-7d5b-4847-a35b-fe040ea74c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:27.611355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dd3e28cb-350b-4791-9a06-f7decc6bde8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:27.664329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e28cb-350b-4791-9a06-f7decc6bde8b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:27.667186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1839c8a4-7d5b-4847-a35b-fe040ea74c2a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:27.668463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1839c8a4-7d5b-4847-a35b-fe040ea74c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:27.801451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dacc9f-8cc0-4643-81e5-2d7a2f1a99c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:27.802738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dacc9f-8cc0-4643-81e5-2d7a2f1a99c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:27.803243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dacc9f-8cc0-4643-81e5-2d7a2f1a99c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:27.803671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dacc9f-8cc0-4643-81e5-2d7a2f1a99c6 admin admin] PATH_INFO: `/v3/projects/66e4808fc53c4fea8a84d0ff8c58c718` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:27.810560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dacc9f-8cc0-4643-81e5-2d7a2f1a99c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e4808fc53c4fea8a84d0ff8c58c718)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:27.813530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dacc9f-8cc0-4643-81e5-2d7a2f1a99c6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:27.849014 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1899/3840] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:27.867574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839c8a4-7d5b-4847-a35b-fe040ea74c2a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:27.870141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1839c8a4-7d5b-4847-a35b-fe040ea74c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:27.911639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-39dacc9f-8cc0-4643-81e5-2d7a2f1a99c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e4808fc53c4fea8a84d0ff8c58c718', 'request_id': 'req-39dacc9f-8cc0-4643-81e5-2d7a2f1a99c6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:27.928245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-39dacc9f-8cc0-4643-81e5-2d7a2f1a99c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e4808fc53c4fea8a84d0ff8c58c718', 'request_id': 'req-39dacc9f-8cc0-4643-81e5-2d7a2f1a99c6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:27.937065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-39dacc9f-8cc0-4643-81e5-2d7a2f1a99c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e4808fc53c4fea8a84d0ff8c58c718', 'request_id': 'req-39dacc9f-8cc0-4643-81e5-2d7a2f1a99c6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:27.965414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-39dacc9f-8cc0-4643-81e5-2d7a2f1a99c6 admin admin] The token cache is being invalidate because project 66e4808fc53c4fea8a84d0ff8c58c718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:12:27.965694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-39dacc9f-8cc0-4643-81e5-2d7a2f1a99c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:27.971991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-39dacc9f-8cc0-4643-81e5-2d7a2f1a99c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:27.976544 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1942/3841] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:27 2022] DELETE /identity/v3/projects/66e4808fc53c4fea8a84d0ff8c58c718 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:27.991736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea5ba0-3007-49f4-b337-2016324e66e3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:27.992371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea5ba0-3007-49f4-b337-2016324e66e3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:27.996507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea5ba0-3007-49f4-b337-2016324e66e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:28.045697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839c8a4-7d5b-4847-a35b-fe040ea74c2a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:28.052982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-92ea5ba0-3007-49f4-b337-2016324e66e3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:28.055050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-92ea5ba0-3007-49f4-b337-2016324e66e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:28.069470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:28.281021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3059828-7f86-4073-a8eb-750d06b8ba68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:28.281775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3059828-7f86-4073-a8eb-750d06b8ba68 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:28.282074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3059828-7f86-4073-a8eb-750d06b8ba68 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:28.282336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3059828-7f86-4073-a8eb-750d06b8ba68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:28.284969 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1943/3842] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:28.292595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d3059828-7f86-4073-a8eb-750d06b8ba68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:28.292792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34aef66-5e64-41f0-a9eb-554f62d8803b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:28.293167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34aef66-5e64-41f0-a9eb-554f62d8803b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:28.293613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34aef66-5e64-41f0-a9eb-554f62d8803b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:28.314351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3059828-7f86-4073-a8eb-750d06b8ba68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:28.315860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3059828-7f86-4073-a8eb-750d06b8ba68 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:28.322367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:28.328437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e34aef66-5e64-41f0-a9eb-554f62d8803b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:28.330502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e34aef66-5e64-41f0-a9eb-554f62d8803b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:28.346580 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1900/3843] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:12:28.357184 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1944/3844] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:28.358658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3059828-7f86-4073-a8eb-750d06b8ba68 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:28.388806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3059828-7f86-4073-a8eb-750d06b8ba68 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:28.399005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1b085-ec75-4d92-b38a-18d358e31e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:28.400471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1b085-ec75-4d92-b38a-18d358e31e3c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:28.400932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1b085-ec75-4d92-b38a-18d358e31e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:28.401355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1b085-ec75-4d92-b38a-18d358e31e3c admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:28.402241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1b085-ec75-4d92-b38a-18d358e31e3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:12:28.402700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1b085-ec75-4d92-b38a-18d358e31e3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:28.404545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1b085-ec75-4d92-b38a-18d358e31e3c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:28.435702 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1901/3845] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:12:28.440180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34aef66-5e64-41f0-a9eb-554f62d8803b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:28.451720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34aef66-5e64-41f0-a9eb-554f62d8803b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:28.457270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d23dd-9cbe-46ef-9a0a-972056012ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:28.458357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d23dd-9cbe-46ef-9a0a-972056012ddc admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:28.458815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d23dd-9cbe-46ef-9a0a-972056012ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:28.459258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d23dd-9cbe-46ef-9a0a-972056012ddc admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:28.460226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d23dd-9cbe-46ef-9a0a-972056012ddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:28.463869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d23dd-9cbe-46ef-9a0a-972056012ddc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:28.512901 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1945/3846] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:12:28 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:12:28.517584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1b085-ec75-4d92-b38a-18d358e31e3c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:28.534186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1b085-ec75-4d92-b38a-18d358e31e3c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:28.688296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1c72a-05cf-415b-bd69-9d1a64568796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:28.690278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1c72a-05cf-415b-bd69-9d1a64568796 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:28.690558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1c72a-05cf-415b-bd69-9d1a64568796 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:28.690835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1c72a-05cf-415b-bd69-9d1a64568796 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:28.691549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1c72a-05cf-415b-bd69-9d1a64568796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:28.698071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1c72a-05cf-415b-bd69-9d1a64568796 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:28.741895 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1902/3847] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:12:28 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:12:28.745712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d23dd-9cbe-46ef-9a0a-972056012ddc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:28.761611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d23dd-9cbe-46ef-9a0a-972056012ddc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:28.768591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff1ddb-0fc9-4587-ba41-d202b57c5293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:28.769561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff1ddb-0fc9-4587-ba41-d202b57c5293 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:28.769715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff1ddb-0fc9-4587-ba41-d202b57c5293 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:28.769914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff1ddb-0fc9-4587-ba41-d202b57c5293 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:28.770748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff1ddb-0fc9-4587-ba41-d202b57c5293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:28.773209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff1ddb-0fc9-4587-ba41-d202b57c5293 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:28.791136 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1946/3848] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:28.796579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1c72a-05cf-415b-bd69-9d1a64568796 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:28.819338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1c72a-05cf-415b-bd69-9d1a64568796 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:28.837714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a52fd-b92d-4ede-addd-e775cb98a48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:28.839422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a52fd-b92d-4ede-addd-e775cb98a48d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:28.839874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a52fd-b92d-4ede-addd-e775cb98a48d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:28.840334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a52fd-b92d-4ede-addd-e775cb98a48d admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:28.841216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a52fd-b92d-4ede-addd-e775cb98a48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:28.843052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a52fd-b92d-4ede-addd-e775cb98a48d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:28.877270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff1ddb-0fc9-4587-ba41-d202b57c5293 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:28.877526 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1903/3849] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:28.889192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff1ddb-0fc9-4587-ba41-d202b57c5293 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:28.914419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca749630-a8a3-4e4e-8d5d-75ff8278760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:28.915360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca749630-a8a3-4e4e-8d5d-75ff8278760f admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:28.915647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca749630-a8a3-4e4e-8d5d-75ff8278760f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:28.915926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca749630-a8a3-4e4e-8d5d-75ff8278760f admin admin] PATH_INFO: `/v3/projects/27477995aa5c488bb3a2b414a540ceba/users/365ef707d87d4d5d818a7e9388c65fa0/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:28.976468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca749630-a8a3-4e4e-8d5d-75ff8278760f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27477995aa5c488bb3a2b414a540ceba, user_id=365ef707d87d4d5d818a7e9388c65fa0, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:28.991017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca749630-a8a3-4e4e-8d5d-75ff8278760f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:29.024734 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1947/3850] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:12:28 2022] PUT /identity/v3/projects/27477995aa5c488bb3a2b414a540ceba/users/365ef707d87d4d5d818a7e9388c65fa0/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:12:29.030249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad189bb-5ab6-4d3c-b197-f0ba7dc75c59 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:29.030788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad189bb-5ab6-4d3c-b197-f0ba7dc75c59 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:29.031149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad189bb-5ab6-4d3c-b197-f0ba7dc75c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:29.070078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bad189bb-5ab6-4d3c-b197-f0ba7dc75c59 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:29.071965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bad189bb-5ab6-4d3c-b197-f0ba7dc75c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:29.204504 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1904/3851] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:29.224730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca749630-a8a3-4e4e-8d5d-75ff8278760f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:29.226644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ca749630-a8a3-4e4e-8d5d-75ff8278760f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:29.381384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca749630-a8a3-4e4e-8d5d-75ff8278760f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:29.381384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca537eb-b8e7-468d-b2cd-e4c57f574e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:29.381384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca537eb-b8e7-468d-b2cd-e4c57f574e9c service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:29.381384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca537eb-b8e7-468d-b2cd-e4c57f574e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:29.382288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca537eb-b8e7-468d-b2cd-e4c57f574e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:29.382288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca537eb-b8e7-468d-b2cd-e4c57f574e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:29.382288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca537eb-b8e7-468d-b2cd-e4c57f574e9c service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:29.382288 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1948/3852] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:12:29.671904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad189bb-5ab6-4d3c-b197-f0ba7dc75c59 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:29.673994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bad189bb-5ab6-4d3c-b197-f0ba7dc75c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:29.698972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad189bb-5ab6-4d3c-b197-f0ba7dc75c59 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:29.719336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7b878-1efa-43a9-bfa9-e61ab4c80f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:29.720931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7b878-1efa-43a9-bfa9-e61ab4c80f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:29.721222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7b878-1efa-43a9-bfa9-e61ab4c80f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:29.721500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7b878-1efa-43a9-bfa9-e61ab4c80f83 admin admin] PATH_INFO: `/v3/projects/6f1be96a47b047188a095ed9ce815737` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:29.723408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7b878-1efa-43a9-bfa9-e61ab4c80f83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f1be96a47b047188a095ed9ce815737)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:29.725503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7b878-1efa-43a9-bfa9-e61ab4c80f83 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:29.799713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7cd7b878-1efa-43a9-bfa9-e61ab4c80f83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f1be96a47b047188a095ed9ce815737', 'request_id': 'req-7cd7b878-1efa-43a9-bfa9-e61ab4c80f83'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:29.808734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7cd7b878-1efa-43a9-bfa9-e61ab4c80f83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f1be96a47b047188a095ed9ce815737', 'request_id': 'req-7cd7b878-1efa-43a9-bfa9-e61ab4c80f83'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:29.816336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:29.818694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7cd7b878-1efa-43a9-bfa9-e61ab4c80f83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f1be96a47b047188a095ed9ce815737', 'request_id': 'req-7cd7b878-1efa-43a9-bfa9-e61ab4c80f83'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:29.847867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7cd7b878-1efa-43a9-bfa9-e61ab4c80f83 admin admin] The token cache is being invalidate because project 6f1be96a47b047188a095ed9ce815737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:12:29.850691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7cd7b878-1efa-43a9-bfa9-e61ab4c80f83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:29.852348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7cd7b878-1efa-43a9-bfa9-e61ab4c80f83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:29.859162 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1905/3853] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:29 2022] DELETE /identity/v3/projects/6f1be96a47b047188a095ed9ce815737 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:29.864317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c950f47-6490-4f3c-b1f3-8d40736ceeb3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:29.864983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c950f47-6490-4f3c-b1f3-8d40736ceeb3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:29.865452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c950f47-6490-4f3c-b1f3-8d40736ceeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:29.919226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6c950f47-6490-4f3c-b1f3-8d40736ceeb3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:29.924823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6c950f47-6490-4f3c-b1f3-8d40736ceeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:30.087030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:30.124992 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1949/3854] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:30.133748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4301c33-8fca-4a08-8632-86dd8192b906 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:30.134220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4301c33-8fca-4a08-8632-86dd8192b906 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:30.134711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4301c33-8fca-4a08-8632-86dd8192b906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:30.181283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e4301c33-8fca-4a08-8632-86dd8192b906 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:30.184604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e4301c33-8fca-4a08-8632-86dd8192b906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:30.205551 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1906/3855] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:30.212532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c950f47-6490-4f3c-b1f3-8d40736ceeb3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:30.234519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c950f47-6490-4f3c-b1f3-8d40736ceeb3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:30.239402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0be02-b0ba-4375-aa1e-09f69b6d4ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:30.241416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0be02-b0ba-4375-aa1e-09f69b6d4ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:30.241736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0be02-b0ba-4375-aa1e-09f69b6d4ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:30.242025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0be02-b0ba-4375-aa1e-09f69b6d4ce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:30.243673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0be02-b0ba-4375-aa1e-09f69b6d4ce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:12:30.244363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0be02-b0ba-4375-aa1e-09f69b6d4ce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:30.246040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0be02-b0ba-4375-aa1e-09f69b6d4ce2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:30.277853 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1950/3856] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:12:30.281677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4301c33-8fca-4a08-8632-86dd8192b906 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:30.297475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4301c33-8fca-4a08-8632-86dd8192b906 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:30.309930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2cc2f-24e7-44e1-b296-8e8732f8e3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:30.310691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2cc2f-24e7-44e1-b296-8e8732f8e3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:30.311778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2cc2f-24e7-44e1-b296-8e8732f8e3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:30.312584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2cc2f-24e7-44e1-b296-8e8732f8e3a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:30.314002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2cc2f-24e7-44e1-b296-8e8732f8e3a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:30.317158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2cc2f-24e7-44e1-b296-8e8732f8e3a2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:30.381807 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1907/3857] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:12:30 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:12:30.385926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0be02-b0ba-4375-aa1e-09f69b6d4ce2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:30.405224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0be02-b0ba-4375-aa1e-09f69b6d4ce2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:30.524345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8e8c0-1acf-4fd8-8aad-e8e6782aeddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:30.527773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8e8c0-1acf-4fd8-8aad-e8e6782aeddc admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:30.528914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8e8c0-1acf-4fd8-8aad-e8e6782aeddc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:30.529204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8e8c0-1acf-4fd8-8aad-e8e6782aeddc admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:30.532210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8e8c0-1acf-4fd8-8aad-e8e6782aeddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:30.540426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8e8c0-1acf-4fd8-8aad-e8e6782aeddc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:30.581618 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1951/3858] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:12:30 2022] POST /identity/v3/users => generated 303 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:12:30.583652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2cc2f-24e7-44e1-b296-8e8732f8e3a2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:30.596336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2cc2f-24e7-44e1-b296-8e8732f8e3a2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:30.609766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff5967-9f86-452f-9e55-a0a5bd1b0456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:30.610481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff5967-9f86-452f-9e55-a0a5bd1b0456 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:30.610764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff5967-9f86-452f-9e55-a0a5bd1b0456 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:30.611044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff5967-9f86-452f-9e55-a0a5bd1b0456 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:30.611772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff5967-9f86-452f-9e55-a0a5bd1b0456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:30.614605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff5967-9f86-452f-9e55-a0a5bd1b0456 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:30.630247 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1908/3859] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:30.631969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8e8c0-1acf-4fd8-8aad-e8e6782aeddc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:30.644888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8e8c0-1acf-4fd8-8aad-e8e6782aeddc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:30.651464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba51843-0145-4f8c-92ea-594de3f0ae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:30.652801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba51843-0145-4f8c-92ea-594de3f0ae33 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:30.653602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba51843-0145-4f8c-92ea-594de3f0ae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:30.654050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba51843-0145-4f8c-92ea-594de3f0ae33 admin admin] PATH_INFO: `/v3/projects/d3391f8f95c34db0971df1e241f5f3ab/users/05e3a595ee7e411bbcc2a73ca52bd594/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:30.686265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba51843-0145-4f8c-92ea-594de3f0ae33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3391f8f95c34db0971df1e241f5f3ab, user_id=05e3a595ee7e411bbcc2a73ca52bd594, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:30.692861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba51843-0145-4f8c-92ea-594de3f0ae33 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:30.730031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff5967-9f86-452f-9e55-a0a5bd1b0456 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:30.736737 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1952/3860] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:12:30 2022] PUT /identity/v3/projects/d3391f8f95c34db0971df1e241f5f3ab/users/05e3a595ee7e411bbcc2a73ca52bd594/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:30.748944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff5967-9f86-452f-9e55-a0a5bd1b0456 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:30.863242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efac1ad-dab5-438b-8d66-dc0e291e1a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:30.864542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efac1ad-dab5-438b-8d66-dc0e291e1a76 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:30.864899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efac1ad-dab5-438b-8d66-dc0e291e1a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:30.865179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efac1ad-dab5-438b-8d66-dc0e291e1a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:30.866192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efac1ad-dab5-438b-8d66-dc0e291e1a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:30.869059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efac1ad-dab5-438b-8d66-dc0e291e1a76 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:30.884884 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1909/3861] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:30.889136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba51843-0145-4f8c-92ea-594de3f0ae33 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:30.906398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba51843-0145-4f8c-92ea-594de3f0ae33 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:30.923664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c7516-31a6-49d7-a093-27d9bb232ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:30.924751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c7516-31a6-49d7-a093-27d9bb232ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:30.925045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c7516-31a6-49d7-a093-27d9bb232ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:30.925403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c7516-31a6-49d7-a093-27d9bb232ad5 admin admin] PATH_INFO: `/v3/projects/d3391f8f95c34db0971df1e241f5f3ab/users/05e3a595ee7e411bbcc2a73ca52bd594/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:30.928351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c7516-31a6-49d7-a093-27d9bb232ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3391f8f95c34db0971df1e241f5f3ab, user_id=05e3a595ee7e411bbcc2a73ca52bd594, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:30.931755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c7516-31a6-49d7-a093-27d9bb232ad5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:30.964129 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1953/3862] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:12:30 2022] PUT /identity/v3/projects/d3391f8f95c34db0971df1e241f5f3ab/users/05e3a595ee7e411bbcc2a73ca52bd594/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:30.964465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402a2ac-9ab4-42bf-8af9-c94866f08130 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:30.964826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402a2ac-9ab4-42bf-8af9-c94866f08130 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:30.966452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402a2ac-9ab4-42bf-8af9-c94866f08130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:31.031717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3402a2ac-9ab4-42bf-8af9-c94866f08130 None None] MFA Rules not processed for user `05e3a595ee7e411bbcc2a73ca52bd594`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:31.033027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3402a2ac-9ab4-42bf-8af9-c94866f08130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:31.212973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c7516-31a6-49d7-a093-27d9bb232ad5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:31.218516 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1910/3863] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:31.331650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c7516-31a6-49d7-a093-27d9bb232ad5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:31.346627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2c38f-e9ce-4c3a-8f0f-9c9871e3ea86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:31.347569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2c38f-e9ce-4c3a-8f0f-9c9871e3ea86 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:31.348127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2c38f-e9ce-4c3a-8f0f-9c9871e3ea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:31.348635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2c38f-e9ce-4c3a-8f0f-9c9871e3ea86 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:31.349544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2c38f-e9ce-4c3a-8f0f-9c9871e3ea86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:31.352128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2c38f-e9ce-4c3a-8f0f-9c9871e3ea86 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:31.391374 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1954/3864] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:12:31 2022] POST /identity/v3/projects => generated 397 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:12:31.396015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402a2ac-9ab4-42bf-8af9-c94866f08130 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:31.412490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402a2ac-9ab4-42bf-8af9-c94866f08130 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:31.461633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:31.511444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65fb4c-9ae3-44c8-a9f7-0ec29b0daff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:31.512380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65fb4c-9ae3-44c8-a9f7-0ec29b0daff3 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:31.513059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65fb4c-9ae3-44c8-a9f7-0ec29b0daff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:31.513514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65fb4c-9ae3-44c8-a9f7-0ec29b0daff3 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:31.514364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65fb4c-9ae3-44c8-a9f7-0ec29b0daff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:31.516945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65fb4c-9ae3-44c8-a9f7-0ec29b0daff3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:31.560179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2c38f-e9ce-4c3a-8f0f-9c9871e3ea86 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:31.569622 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1911/3865] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:12:31 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:12:31.573963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2c38f-e9ce-4c3a-8f0f-9c9871e3ea86 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:31.581826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904dc39-531a-4045-b236-575d15cb3f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:31.582847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904dc39-531a-4045-b236-575d15cb3f46 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:31.583232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904dc39-531a-4045-b236-575d15cb3f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:31.583639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904dc39-531a-4045-b236-575d15cb3f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:31.584726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904dc39-531a-4045-b236-575d15cb3f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:31.587158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904dc39-531a-4045-b236-575d15cb3f46 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:31.604089 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1955/3866] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:31.606142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65fb4c-9ae3-44c8-a9f7-0ec29b0daff3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:31.618930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65fb4c-9ae3-44c8-a9f7-0ec29b0daff3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:31.624875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8dc02-7c6b-4cbc-a688-aedda7e15438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:31.625760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8dc02-7c6b-4cbc-a688-aedda7e15438 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:31.626708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8dc02-7c6b-4cbc-a688-aedda7e15438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:31.627154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8dc02-7c6b-4cbc-a688-aedda7e15438 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:31.628066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8dc02-7c6b-4cbc-a688-aedda7e15438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:31.629869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8dc02-7c6b-4cbc-a688-aedda7e15438 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:31.645994 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1912/3867] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:12:31.647562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904dc39-531a-4045-b236-575d15cb3f46 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:31.657358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:31.664555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904dc39-531a-4045-b236-575d15cb3f46 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:31.672701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d14aa-e786-4229-b44d-b87cd41261ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:31.673823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d14aa-e786-4229-b44d-b87cd41261ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:31.674188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d14aa-e786-4229-b44d-b87cd41261ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:31.674566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d14aa-e786-4229-b44d-b87cd41261ec admin admin] PATH_INFO: `/v3/projects/f5b511c66b5e4087bb47ff11838d5b08/users/c67e630b06a3427aa78015490bcbb75c/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:31.716111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d14aa-e786-4229-b44d-b87cd41261ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b511c66b5e4087bb47ff11838d5b08, user_id=c67e630b06a3427aa78015490bcbb75c, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:31.722908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d14aa-e786-4229-b44d-b87cd41261ec admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:31.746858 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1956/3868] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:12:31 2022] PUT /identity/v3/projects/f5b511c66b5e4087bb47ff11838d5b08/users/c67e630b06a3427aa78015490bcbb75c/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:12:31.757417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8ef4b-7f66-4856-9877-f62e9263e800 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:31.757893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8ef4b-7f66-4856-9877-f62e9263e800 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:31.758043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8ef4b-7f66-4856-9877-f62e9263e800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:31.817043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ffb8ef4b-7f66-4856-9877-f62e9263e800 None None] MFA Rules not processed for user `c67e630b06a3427aa78015490bcbb75c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:31.818346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ffb8ef4b-7f66-4856-9877-f62e9263e800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:31.945502 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1913/3869] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:31.960989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d14aa-e786-4229-b44d-b87cd41261ec admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:31.963044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b79d14aa-e786-4229-b44d-b87cd41261ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:32.296445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d14aa-e786-4229-b44d-b87cd41261ec admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:32.311510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ded238-f0f1-43c6-a67b-3707a1b28789 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:32.312520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ded238-f0f1-43c6-a67b-3707a1b28789 service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:32.313036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ded238-f0f1-43c6-a67b-3707a1b28789 service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:32.313463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ded238-f0f1-43c6-a67b-3707a1b28789 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:32.470030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ded238-f0f1-43c6-a67b-3707a1b28789 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:32.473776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ded238-f0f1-43c6-a67b-3707a1b28789 service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:32.506032 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1957/3870] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:12:33.098115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8ef4b-7f66-4856-9877-f62e9263e800 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:33.221488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8ef4b-7f66-4856-9877-f62e9263e800 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:33.248546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893da6cc-fe6a-4cf8-b181-591fe795e61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:33.250138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893da6cc-fe6a-4cf8-b181-591fe795e61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:33.252488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893da6cc-fe6a-4cf8-b181-591fe795e61b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:33.252488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893da6cc-fe6a-4cf8-b181-591fe795e61b admin admin] PATH_INFO: `/v3/users/05e3a595ee7e411bbcc2a73ca52bd594` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:33.255463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893da6cc-fe6a-4cf8-b181-591fe795e61b admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e3a595ee7e411bbcc2a73ca52bd594)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:33.260852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893da6cc-fe6a-4cf8-b181-591fe795e61b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:33.404926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:33.427284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-893da6cc-fe6a-4cf8-b181-591fe795e61b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e3a595ee7e411bbcc2a73ca52bd594'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:33.452169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-893da6cc-fe6a-4cf8-b181-591fe795e61b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e3a595ee7e411bbcc2a73ca52bd594'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:33.483797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-893da6cc-fe6a-4cf8-b181-591fe795e61b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e3a595ee7e411bbcc2a73ca52bd594'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:33.485543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-893da6cc-fe6a-4cf8-b181-591fe795e61b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e3a595ee7e411bbcc2a73ca52bd594'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:33.487404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-893da6cc-fe6a-4cf8-b181-591fe795e61b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e3a595ee7e411bbcc2a73ca52bd594'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:33.561226 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1914/3871] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:12:33 2022] DELETE /identity/v3/users/05e3a595ee7e411bbcc2a73ca52bd594 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:33.566043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaad47f-7611-497f-991c-60c14ac06f05 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:33.566539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaad47f-7611-497f-991c-60c14ac06f05 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:33.566638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaad47f-7611-497f-991c-60c14ac06f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:33.635462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4eaad47f-7611-497f-991c-60c14ac06f05 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:33.636744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4eaad47f-7611-497f-991c-60c14ac06f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:33.883395 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1958/3872] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:33.899370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fb5d9-ad1c-448a-80b4-493fe8e990de None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:33.900340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fb5d9-ad1c-448a-80b4-493fe8e990de None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:33.900770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fb5d9-ad1c-448a-80b4-493fe8e990de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:33.965833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e07fb5d9-ad1c-448a-80b4-493fe8e990de None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:33.969842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e07fb5d9-ad1c-448a-80b4-493fe8e990de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:33.979428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaad47f-7611-497f-991c-60c14ac06f05 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:33.981516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4eaad47f-7611-497f-991c-60c14ac06f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:34.014878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:34.187023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaad47f-7611-497f-991c-60c14ac06f05 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:34.192666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117c04f-1f4f-4d16-bec2-33128afbeeef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:34.194083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117c04f-1f4f-4d16-bec2-33128afbeeef service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:34.194561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117c04f-1f4f-4d16-bec2-33128afbeeef service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:34.194851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117c04f-1f4f-4d16-bec2-33128afbeeef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:34.208870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117c04f-1f4f-4d16-bec2-33128afbeeef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:34.210477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117c04f-1f4f-4d16-bec2-33128afbeeef service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:34.212911 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1915/3873] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:34.226100 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1959/3874] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:12:34.229367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fb5d9-ad1c-448a-80b4-493fe8e990de None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:34.230851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e07fb5d9-ad1c-448a-80b4-493fe8e990de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:34.465079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fb5d9-ad1c-448a-80b4-493fe8e990de None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:34.472079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4f066-08fa-46d9-94c6-4d18771468dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:34.473135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4f066-08fa-46d9-94c6-4d18771468dc service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:34.473691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4f066-08fa-46d9-94c6-4d18771468dc service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:34.474191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4f066-08fa-46d9-94c6-4d18771468dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:34.494168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4f066-08fa-46d9-94c6-4d18771468dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:34.504723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4f066-08fa-46d9-94c6-4d18771468dc service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:34.528961 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1916/3875] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:35.177525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30226a2a-c8a4-474c-a204-cce152103cb6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:35.179955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30226a2a-c8a4-474c-a204-cce152103cb6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:35.183254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30226a2a-c8a4-474c-a204-cce152103cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:35.207345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-30226a2a-c8a4-474c-a204-cce152103cb6 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:35.208976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-30226a2a-c8a4-474c-a204-cce152103cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:35.227448 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1960/3876] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:12:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:35.243718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4f066-08fa-46d9-94c6-4d18771468dc service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:35.263470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4f066-08fa-46d9-94c6-4d18771468dc service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:35.278378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810749c-dc62-4c8d-bb66-20e5a49641e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:35.279059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810749c-dc62-4c8d-bb66-20e5a49641e4 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:35.279875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810749c-dc62-4c8d-bb66-20e5a49641e4 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:35.280371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810749c-dc62-4c8d-bb66-20e5a49641e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:35.302813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810749c-dc62-4c8d-bb66-20e5a49641e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:35.305201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810749c-dc62-4c8d-bb66-20e5a49641e4 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:35.319667 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1917/3877] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:35.542662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30226a2a-c8a4-474c-a204-cce152103cb6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:35.544293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-30226a2a-c8a4-474c-a204-cce152103cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:35.587084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30226a2a-c8a4-474c-a204-cce152103cb6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:35.607465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee5e48-d6e3-4062-ae71-8c6a39abfcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:35.608727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee5e48-d6e3-4062-ae71-8c6a39abfcb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:35.609009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee5e48-d6e3-4062-ae71-8c6a39abfcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:35.609744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee5e48-d6e3-4062-ae71-8c6a39abfcb1 admin admin] PATH_INFO: `/v3/projects/d3391f8f95c34db0971df1e241f5f3ab` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:35.611032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee5e48-d6e3-4062-ae71-8c6a39abfcb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3391f8f95c34db0971df1e241f5f3ab)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:35.613148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee5e48-d6e3-4062-ae71-8c6a39abfcb1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:35.705353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c6ee5e48-d6e3-4062-ae71-8c6a39abfcb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3391f8f95c34db0971df1e241f5f3ab', 'request_id': 'req-c6ee5e48-d6e3-4062-ae71-8c6a39abfcb1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:35.726687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c6ee5e48-d6e3-4062-ae71-8c6a39abfcb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3391f8f95c34db0971df1e241f5f3ab', 'request_id': 'req-c6ee5e48-d6e3-4062-ae71-8c6a39abfcb1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:35.736784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c6ee5e48-d6e3-4062-ae71-8c6a39abfcb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3391f8f95c34db0971df1e241f5f3ab', 'request_id': 'req-c6ee5e48-d6e3-4062-ae71-8c6a39abfcb1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:35.764454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c6ee5e48-d6e3-4062-ae71-8c6a39abfcb1 admin admin] The token cache is being invalidate because project d3391f8f95c34db0971df1e241f5f3ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:12:35.764990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c6ee5e48-d6e3-4062-ae71-8c6a39abfcb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:35.783963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c6ee5e48-d6e3-4062-ae71-8c6a39abfcb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:35.786084 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1961/3878] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:35 2022] DELETE /identity/v3/projects/d3391f8f95c34db0971df1e241f5f3ab => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:35.790736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810749c-dc62-4c8d-bb66-20e5a49641e4 service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:35.828086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee5e48-d6e3-4062-ae71-8c6a39abfcb1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:35.830777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c6ee5e48-d6e3-4062-ae71-8c6a39abfcb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:35.834759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810749c-dc62-4c8d-bb66-20e5a49641e4 service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:35.972642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:36.026776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923c853-89b5-460b-8866-283ddefeb064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:36.029249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923c853-89b5-460b-8866-283ddefeb064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:36.031353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923c853-89b5-460b-8866-283ddefeb064 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:36.031873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923c853-89b5-460b-8866-283ddefeb064 admin admin] PATH_INFO: `/v3/users/c67e630b06a3427aa78015490bcbb75c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:36.034315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923c853-89b5-460b-8866-283ddefeb064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c67e630b06a3427aa78015490bcbb75c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:36.039125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923c853-89b5-460b-8866-283ddefeb064 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:36.042662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee5e48-d6e3-4062-ae71-8c6a39abfcb1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:36.058804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b52c41-5e97-4d26-8ee1-254f63919bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:36.077170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b52c41-5e97-4d26-8ee1-254f63919bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:36.077510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b52c41-5e97-4d26-8ee1-254f63919bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:36.078934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b52c41-5e97-4d26-8ee1-254f63919bb7 admin admin] PATH_INFO: `/v3/users/bf59cddfcf2a4e9eb7f1e94f553b118b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:36.082590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b52c41-5e97-4d26-8ee1-254f63919bb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf59cddfcf2a4e9eb7f1e94f553b118b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:36.091853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b52c41-5e97-4d26-8ee1-254f63919bb7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:36.238123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:36.258733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c4b52c41-5e97-4d26-8ee1-254f63919bb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf59cddfcf2a4e9eb7f1e94f553b118b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:36.291541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3923c853-89b5-460b-8866-283ddefeb064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c67e630b06a3427aa78015490bcbb75c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:36.310199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3923c853-89b5-460b-8866-283ddefeb064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c67e630b06a3427aa78015490bcbb75c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:36.324191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c4b52c41-5e97-4d26-8ee1-254f63919bb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf59cddfcf2a4e9eb7f1e94f553b118b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:36.324570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3923c853-89b5-460b-8866-283ddefeb064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c67e630b06a3427aa78015490bcbb75c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:36.326880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c4b52c41-5e97-4d26-8ee1-254f63919bb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf59cddfcf2a4e9eb7f1e94f553b118b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:36.327861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c4b52c41-5e97-4d26-8ee1-254f63919bb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf59cddfcf2a4e9eb7f1e94f553b118b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:36.328107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3923c853-89b5-460b-8866-283ddefeb064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c67e630b06a3427aa78015490bcbb75c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:36.329245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3923c853-89b5-460b-8866-283ddefeb064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c67e630b06a3427aa78015490bcbb75c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:36.369016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c4b52c41-5e97-4d26-8ee1-254f63919bb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf59cddfcf2a4e9eb7f1e94f553b118b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:36.371296 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1918/3879] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:12:35 2022] DELETE /identity/v3/users/c67e630b06a3427aa78015490bcbb75c => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:36.373617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c851d-34a8-4e3a-96a6-6e7abc81fa6e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:36.388361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c851d-34a8-4e3a-96a6-6e7abc81fa6e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:36.389529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c851d-34a8-4e3a-96a6-6e7abc81fa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:36.437738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3c5c851d-34a8-4e3a-96a6-6e7abc81fa6e None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:36.443389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3c5c851d-34a8-4e3a-96a6-6e7abc81fa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:36.450899 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1962/3880] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:12:35 2022] DELETE /identity/v3/users/bf59cddfcf2a4e9eb7f1e94f553b118b => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:36.479843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b52c41-5e97-4d26-8ee1-254f63919bb7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:36.490974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c4b52c41-5e97-4d26-8ee1-254f63919bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:36.602234 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1919/3881] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:36.623433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c851d-34a8-4e3a-96a6-6e7abc81fa6e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:36.626335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3c5c851d-34a8-4e3a-96a6-6e7abc81fa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:36.704733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b52c41-5e97-4d26-8ee1-254f63919bb7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:36.714777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670afc23-2c04-4b06-8769-30b0ce4e4559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:36.715459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670afc23-2c04-4b06-8769-30b0ce4e4559 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:36.715741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670afc23-2c04-4b06-8769-30b0ce4e4559 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:36.716021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670afc23-2c04-4b06-8769-30b0ce4e4559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:36.721525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-670afc23-2c04-4b06-8769-30b0ce4e4559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:36.834046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c851d-34a8-4e3a-96a6-6e7abc81fa6e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:36.859901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56145ef6-a91d-4431-9492-d0f6eee85457 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:36.860631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56145ef6-a91d-4431-9492-d0f6eee85457 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:36.860918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56145ef6-a91d-4431-9492-d0f6eee85457 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:36.861197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56145ef6-a91d-4431-9492-d0f6eee85457 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:36.874942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:36.891316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56145ef6-a91d-4431-9492-d0f6eee85457 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:36.892992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56145ef6-a91d-4431-9492-d0f6eee85457 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:36.916353 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1920/3882] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 02 21:12:36.924193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670afc23-2c04-4b06-8769-30b0ce4e4559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:36.925965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670afc23-2c04-4b06-8769-30b0ce4e4559 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:36.964130 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1963/3883] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:12:37.760013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437b5f3-4fab-4159-92f2-f54f48a0ecbb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:37.760627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437b5f3-4fab-4159-92f2-f54f48a0ecbb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:37.760627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437b5f3-4fab-4159-92f2-f54f48a0ecbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:37.803487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2437b5f3-4fab-4159-92f2-f54f48a0ecbb None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:37.807437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2437b5f3-4fab-4159-92f2-f54f48a0ecbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:37.813146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670afc23-2c04-4b06-8769-30b0ce4e4559 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:37.815985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-670afc23-2c04-4b06-8769-30b0ce4e4559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:37.838575 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670afc23-2c04-4b06-8769-30b0ce4e4559 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:37.844226 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1921/3884] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:12:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:37.848926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437b5f3-4fab-4159-92f2-f54f48a0ecbb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:37.852904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2437b5f3-4fab-4159-92f2-f54f48a0ecbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:37.857981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debed47-23ad-4063-9327-bd7c26c55998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:37.859056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debed47-23ad-4063-9327-bd7c26c55998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:37.859338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debed47-23ad-4063-9327-bd7c26c55998 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:37.859611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debed47-23ad-4063-9327-bd7c26c55998 admin admin] PATH_INFO: `/v3/projects/f5b511c66b5e4087bb47ff11838d5b08` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:37.860968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debed47-23ad-4063-9327-bd7c26c55998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b511c66b5e4087bb47ff11838d5b08)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:37.866216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debed47-23ad-4063-9327-bd7c26c55998 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:37.886458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437b5f3-4fab-4159-92f2-f54f48a0ecbb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:37.896824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea43bca-5732-40b7-9f3b-fccb6cf07e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:37.900151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea43bca-5732-40b7-9f3b-fccb6cf07e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:37.901720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea43bca-5732-40b7-9f3b-fccb6cf07e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:37.902152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea43bca-5732-40b7-9f3b-fccb6cf07e82 admin admin] PATH_INFO: `/v3/projects/f41113b377ec49a5a23587dd0d67f440` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:37.905837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea43bca-5732-40b7-9f3b-fccb6cf07e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f41113b377ec49a5a23587dd0d67f440)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:37.910967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea43bca-5732-40b7-9f3b-fccb6cf07e82 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:37.990299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8debed47-23ad-4063-9327-bd7c26c55998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b511c66b5e4087bb47ff11838d5b08', 'request_id': 'req-8debed47-23ad-4063-9327-bd7c26c55998'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:37.999808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:38.011358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8debed47-23ad-4063-9327-bd7c26c55998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b511c66b5e4087bb47ff11838d5b08', 'request_id': 'req-8debed47-23ad-4063-9327-bd7c26c55998'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:38.023258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8debed47-23ad-4063-9327-bd7c26c55998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b511c66b5e4087bb47ff11838d5b08', 'request_id': 'req-8debed47-23ad-4063-9327-bd7c26c55998'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:38.043103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eea43bca-5732-40b7-9f3b-fccb6cf07e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f41113b377ec49a5a23587dd0d67f440', 'request_id': 'req-eea43bca-5732-40b7-9f3b-fccb6cf07e82'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:38.087684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8debed47-23ad-4063-9327-bd7c26c55998 admin admin] The token cache is being invalidate because project f5b511c66b5e4087bb47ff11838d5b08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:12:38.097433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8debed47-23ad-4063-9327-bd7c26c55998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:38.099886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eea43bca-5732-40b7-9f3b-fccb6cf07e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f41113b377ec49a5a23587dd0d67f440', 'request_id': 'req-eea43bca-5732-40b7-9f3b-fccb6cf07e82'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:38.102571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8debed47-23ad-4063-9327-bd7c26c55998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:38.108608 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1964/3885] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:37 2022] DELETE /identity/v3/projects/f5b511c66b5e4087bb47ff11838d5b08 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:38.110246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debed47-23ad-4063-9327-bd7c26c55998 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:38.114360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8debed47-23ad-4063-9327-bd7c26c55998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:38.120557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eea43bca-5732-40b7-9f3b-fccb6cf07e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f41113b377ec49a5a23587dd0d67f440', 'request_id': 'req-eea43bca-5732-40b7-9f3b-fccb6cf07e82'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:38.151125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eea43bca-5732-40b7-9f3b-fccb6cf07e82 admin admin] The token cache is being invalidate because project f41113b377ec49a5a23587dd0d67f440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:12:38.151867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eea43bca-5732-40b7-9f3b-fccb6cf07e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:38.154408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eea43bca-5732-40b7-9f3b-fccb6cf07e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:38.162433 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1922/3886] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:37 2022] DELETE /identity/v3/projects/f41113b377ec49a5a23587dd0d67f440 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:38.163633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b43306-cc05-44a2-8b11-187d18398cb1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:38.163928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b43306-cc05-44a2-8b11-187d18398cb1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:38.164491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b43306-cc05-44a2-8b11-187d18398cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:38.193395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-07b43306-cc05-44a2-8b11-187d18398cb1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:38.197297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-07b43306-cc05-44a2-8b11-187d18398cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:38.295706 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1923/3887] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:38.298199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ffe5b-ddcf-4bfe-9ec7-b0df4e9fe8d9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:38.298498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ffe5b-ddcf-4bfe-9ec7-b0df4e9fe8d9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:38.298774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ffe5b-ddcf-4bfe-9ec7-b0df4e9fe8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:38.317979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debed47-23ad-4063-9327-bd7c26c55998 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:38.358468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-727ffe5b-ddcf-4bfe-9ec7-b0df4e9fe8d9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:38.360941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-727ffe5b-ddcf-4bfe-9ec7-b0df4e9fe8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:38.384956 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1924/3888] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:38.386592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae08f-30c2-44aa-89a0-53d3f70b7ece None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:38.388130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae08f-30c2-44aa-89a0-53d3f70b7ece None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:38.389533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae08f-30c2-44aa-89a0-53d3f70b7ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:38.441741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-727ae08f-30c2-44aa-89a0-53d3f70b7ece None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:38.445582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-727ae08f-30c2-44aa-89a0-53d3f70b7ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:38.469594 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1925/3889] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:38.471101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b54b1e-fa67-4f6a-aed9-051633eb4fc6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:38.472143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b54b1e-fa67-4f6a-aed9-051633eb4fc6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:38.472566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b54b1e-fa67-4f6a-aed9-051633eb4fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:38.476159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee380c1-db2d-4d01-869f-56f4c1e76341 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:38.477175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee380c1-db2d-4d01-869f-56f4c1e76341 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:38.477927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee380c1-db2d-4d01-869f-56f4c1e76341 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:38.478377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee380c1-db2d-4d01-869f-56f4c1e76341 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:38.482292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-aee380c1-db2d-4d01-869f-56f4c1e76341 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:38.511760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e4b54b1e-fa67-4f6a-aed9-051633eb4fc6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:38.514988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e4b54b1e-fa67-4f6a-aed9-051633eb4fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:38.544210 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1926/3890] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:38.546454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b54b1e-fa67-4f6a-aed9-051633eb4fc6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:38.577385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b54b1e-fa67-4f6a-aed9-051633eb4fc6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:38.591402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c4798-1539-42e7-9584-be85b495eae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:38.594453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c4798-1539-42e7-9584-be85b495eae4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:38.594746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c4798-1539-42e7-9584-be85b495eae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:38.596387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c4798-1539-42e7-9584-be85b495eae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:38.596909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c4798-1539-42e7-9584-be85b495eae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:12:38.598307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c4798-1539-42e7-9584-be85b495eae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:38.602219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c4798-1539-42e7-9584-be85b495eae4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:38.615947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee380c1-db2d-4d01-869f-56f4c1e76341 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:38.620015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee380c1-db2d-4d01-869f-56f4c1e76341 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:38.633528 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1927/3891] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:12:38.634799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c4798-1539-42e7-9584-be85b495eae4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:38.649082 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1965/3892] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:38.656420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee380c1-db2d-4d01-869f-56f4c1e76341 service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:38.658843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c4798-1539-42e7-9584-be85b495eae4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:38.673870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615a13b-3314-40a6-8822-efe00ce4b94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:38.675792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615a13b-3314-40a6-8822-efe00ce4b94a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:38.676129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615a13b-3314-40a6-8822-efe00ce4b94a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:38.676549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615a13b-3314-40a6-8822-efe00ce4b94a admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:38.679358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615a13b-3314-40a6-8822-efe00ce4b94a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:12:38.679691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615a13b-3314-40a6-8822-efe00ce4b94a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:38.684778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615a13b-3314-40a6-8822-efe00ce4b94a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:38.695088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee380c1-db2d-4d01-869f-56f4c1e76341 service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:38.709701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd75f8-1279-44a1-9ea7-63818ef988c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:38.710556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd75f8-1279-44a1-9ea7-63818ef988c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:38.711562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd75f8-1279-44a1-9ea7-63818ef988c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:38.712537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd75f8-1279-44a1-9ea7-63818ef988c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:38.715231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd75f8-1279-44a1-9ea7-63818ef988c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:38.717362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd75f8-1279-44a1-9ea7-63818ef988c6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:38.734067 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1928/3893] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:12:38.737724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615a13b-3314-40a6-8822-efe00ce4b94a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:38.769241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615a13b-3314-40a6-8822-efe00ce4b94a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:38.791290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b0541-ef7d-459e-a58e-51a9159da25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:38.792109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b0541-ef7d-459e-a58e-51a9159da25e admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:38.792519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b0541-ef7d-459e-a58e-51a9159da25e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:38.793443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b0541-ef7d-459e-a58e-51a9159da25e admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:38.800117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b0541-ef7d-459e-a58e-51a9159da25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:38.807081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b0541-ef7d-459e-a58e-51a9159da25e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:38.817426 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1966/3894] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:12:38 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:12:38.819038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd75f8-1279-44a1-9ea7-63818ef988c6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:38.845751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:38.905103 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1929/3895] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:12:38 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:12:38.906734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b0541-ef7d-459e-a58e-51a9159da25e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:38.916633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:38.999070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd75f8-1279-44a1-9ea7-63818ef988c6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:39.123165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6695dfb-2936-4aea-8eda-c5f0f267b54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:39.123573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6695dfb-2936-4aea-8eda-c5f0f267b54a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:39.123980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6695dfb-2936-4aea-8eda-c5f0f267b54a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:39.132684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6695dfb-2936-4aea-8eda-c5f0f267b54a admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:39.134432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6695dfb-2936-4aea-8eda-c5f0f267b54a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:39.135609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b0541-ef7d-459e-a58e-51a9159da25e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:39.136914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6695dfb-2936-4aea-8eda-c5f0f267b54a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:39.149300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e3901-a44e-4734-aa7b-fd743e5334e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:39.150134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e3901-a44e-4734-aa7b-fd743e5334e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:39.150421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e3901-a44e-4734-aa7b-fd743e5334e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:39.150826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e3901-a44e-4734-aa7b-fd743e5334e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:39.151590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e3901-a44e-4734-aa7b-fd743e5334e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:39.156126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e3901-a44e-4734-aa7b-fd743e5334e2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:39.190969 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1967/3896] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:12:38 2022] POST /identity/v3/users => generated 287 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:12:39.198977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6695dfb-2936-4aea-8eda-c5f0f267b54a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:39.218865 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1930/3897] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:12:38 2022] POST /identity/v3/users => generated 288 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:12:39.222090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e3901-a44e-4734-aa7b-fd743e5334e2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:39.246719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e3901-a44e-4734-aa7b-fd743e5334e2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:39.249090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6695dfb-2936-4aea-8eda-c5f0f267b54a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:39.270178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a75e4f-a0fa-4763-aaf1-cce34b52fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:39.271312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829298b-82c3-41c3-bc77-8a8213606def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:39.274132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a75e4f-a0fa-4763-aaf1-cce34b52fbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:39.274297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829298b-82c3-41c3-bc77-8a8213606def admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:39.274603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829298b-82c3-41c3-bc77-8a8213606def admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:39.274894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829298b-82c3-41c3-bc77-8a8213606def admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:39.276920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829298b-82c3-41c3-bc77-8a8213606def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:39.277810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a75e4f-a0fa-4763-aaf1-cce34b52fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:39.277810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a75e4f-a0fa-4763-aaf1-cce34b52fbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:39.281075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829298b-82c3-41c3-bc77-8a8213606def admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:39.284768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a75e4f-a0fa-4763-aaf1-cce34b52fbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:39.289048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a75e4f-a0fa-4763-aaf1-cce34b52fbd1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:39.334976 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1931/3898] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:39.336901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829298b-82c3-41c3-bc77-8a8213606def admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:39.341286 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1968/3899] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:39.345643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a75e4f-a0fa-4763-aaf1-cce34b52fbd1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:39.376316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829298b-82c3-41c3-bc77-8a8213606def admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:39.394367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a75e4f-a0fa-4763-aaf1-cce34b52fbd1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:39.394631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c67dd-79c4-4935-b9c2-920209f13606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:39.395156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c67dd-79c4-4935-b9c2-920209f13606 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:39.395437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c67dd-79c4-4935-b9c2-920209f13606 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:39.395714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c67dd-79c4-4935-b9c2-920209f13606 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:39.396853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c67dd-79c4-4935-b9c2-920209f13606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:39.404737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c67dd-79c4-4935-b9c2-920209f13606 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:39.417446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f132581-7ae2-4fb4-9bf5-577df06c3db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:39.418155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f132581-7ae2-4fb4-9bf5-577df06c3db1 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:39.418441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f132581-7ae2-4fb4-9bf5-577df06c3db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:39.422401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f132581-7ae2-4fb4-9bf5-577df06c3db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:39.425931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f132581-7ae2-4fb4-9bf5-577df06c3db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:39.434707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f132581-7ae2-4fb4-9bf5-577df06c3db1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:39.441169 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1932/3900] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:39.446177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c67dd-79c4-4935-b9c2-920209f13606 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:39.484853 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1969/3901] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:39.490354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f132581-7ae2-4fb4-9bf5-577df06c3db1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:39.504761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c67dd-79c4-4935-b9c2-920209f13606 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:39.528806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a2b00-97ba-4b12-b662-8dbd9e8a5804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:39.536953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a2b00-97ba-4b12-b662-8dbd9e8a5804 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:39.537195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a2b00-97ba-4b12-b662-8dbd9e8a5804 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:39.539469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a2b00-97ba-4b12-b662-8dbd9e8a5804 admin admin] PATH_INFO: `/v3/projects/4874e0d6bff34bfc9e2672caafad9556/users/70f29fd685a149ea85207f47fcbb59d1/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:39.540975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f132581-7ae2-4fb4-9bf5-577df06c3db1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:39.594108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a2b00-97ba-4b12-b662-8dbd9e8a5804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4874e0d6bff34bfc9e2672caafad9556, user_id=70f29fd685a149ea85207f47fcbb59d1, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:39.594421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37293a36-f317-4d4c-9f2f-09d1382e6eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:39.598425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37293a36-f317-4d4c-9f2f-09d1382e6eab admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:39.602197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37293a36-f317-4d4c-9f2f-09d1382e6eab admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:39.602528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37293a36-f317-4d4c-9f2f-09d1382e6eab admin admin] PATH_INFO: `/v3/projects/adfc04cc54d442bc97008904050f2ed6/users/f6ce0b7afba546489bca7255614ee6c0/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:39.605344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a2b00-97ba-4b12-b662-8dbd9e8a5804 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:39.640314 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1933/3902] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:12:39 2022] PUT /identity/v3/projects/4874e0d6bff34bfc9e2672caafad9556/users/70f29fd685a149ea85207f47fcbb59d1/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:39.644595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ad6d-40ca-41d1-bfe4-fa7a98a47c45 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:39.646799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ad6d-40ca-41d1-bfe4-fa7a98a47c45 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:39.647522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ad6d-40ca-41d1-bfe4-fa7a98a47c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:39.682190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37293a36-f317-4d4c-9f2f-09d1382e6eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=adfc04cc54d442bc97008904050f2ed6, user_id=f6ce0b7afba546489bca7255614ee6c0, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:39.686357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37293a36-f317-4d4c-9f2f-09d1382e6eab admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:39.725553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d273ad6d-40ca-41d1-bfe4-fa7a98a47c45 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:39.729372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d273ad6d-40ca-41d1-bfe4-fa7a98a47c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:39.734123 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1970/3903] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:12:39 2022] PUT /identity/v3/projects/adfc04cc54d442bc97008904050f2ed6/users/f6ce0b7afba546489bca7255614ee6c0/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:39.744930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e48921-a839-4570-a601-fc139e8a2c55 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:39.745216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e48921-a839-4570-a601-fc139e8a2c55 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:39.745543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e48921-a839-4570-a601-fc139e8a2c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:39.851751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d6e48921-a839-4570-a601-fc139e8a2c55 None None] MFA Rules not processed for user `f6ce0b7afba546489bca7255614ee6c0`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:39.855720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d6e48921-a839-4570-a601-fc139e8a2c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:39.900333 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1934/3904] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:12:39.919768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273ad6d-40ca-41d1-bfe4-fa7a98a47c45 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:39.922719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d273ad6d-40ca-41d1-bfe4-fa7a98a47c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:39.969292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:40.031180 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1971/3905] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:40.047436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e48921-a839-4570-a601-fc139e8a2c55 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:40.049224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d6e48921-a839-4570-a601-fc139e8a2c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:40.116100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:40.122694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273ad6d-40ca-41d1-bfe4-fa7a98a47c45 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:40.135458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b564ad-71d9-45cc-86a2-223c0350ac5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:40.136783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b564ad-71d9-45cc-86a2-223c0350ac5b service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:40.137065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b564ad-71d9-45cc-86a2-223c0350ac5b service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:40.138874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b564ad-71d9-45cc-86a2-223c0350ac5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:40.165727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b564ad-71d9-45cc-86a2-223c0350ac5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:40.167337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b564ad-71d9-45cc-86a2-223c0350ac5b service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:40.208368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e48921-a839-4570-a601-fc139e8a2c55 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:40.211235 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1935/3906] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:12:40.227543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b1925-be30-42d4-987b-115feda3d63d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:40.228790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b1925-be30-42d4-987b-115feda3d63d service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:40.229081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b1925-be30-42d4-987b-115feda3d63d service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:40.229362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b1925-be30-42d4-987b-115feda3d63d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:40.245762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b1925-be30-42d4-987b-115feda3d63d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:40.247413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b1925-be30-42d4-987b-115feda3d63d service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:40.272242 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1972/3907] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:12:40.496614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8af372-5d22-4158-b103-3aefe0d8e964 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:40.496966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8af372-5d22-4158-b103-3aefe0d8e964 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:40.499758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8af372-5d22-4158-b103-3aefe0d8e964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:40.542870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fd8af372-5d22-4158-b103-3aefe0d8e964 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:40.544334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fd8af372-5d22-4158-b103-3aefe0d8e964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:40.678087 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1936/3908] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:12:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:40.696143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b1925-be30-42d4-987b-115feda3d63d service glance] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:40.697609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ae6b1925-be30-42d4-987b-115feda3d63d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:40.879392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b1925-be30-42d4-987b-115feda3d63d service glance] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:40.892563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b9076-55b8-4a8f-be6e-4cb2bd90c1ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:40.898610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b9076-55b8-4a8f-be6e-4cb2bd90c1ad service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:40.898610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b9076-55b8-4a8f-be6e-4cb2bd90c1ad service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:40.898610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b9076-55b8-4a8f-be6e-4cb2bd90c1ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:40.929337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b9076-55b8-4a8f-be6e-4cb2bd90c1ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:40.931258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b9076-55b8-4a8f-be6e-4cb2bd90c1ad service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:40.954286 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1973/3909] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:41.656763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f78f1-9041-4bec-b4ec-722dab6e1b14 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:41.657691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f78f1-9041-4bec-b4ec-722dab6e1b14 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:41.658125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f78f1-9041-4bec-b4ec-722dab6e1b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:41.709737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-dc1f78f1-9041-4bec-b4ec-722dab6e1b14 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:41.715367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dc1f78f1-9041-4bec-b4ec-722dab6e1b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:41.749263 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1937/3910] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:12:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:41.764831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b9076-55b8-4a8f-be6e-4cb2bd90c1ad service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:41.777158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b9076-55b8-4a8f-be6e-4cb2bd90c1ad service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:41.797629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf3ca6-849b-436f-bf84-8f9f75445922 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:41.799450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf3ca6-849b-436f-bf84-8f9f75445922 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:41.801141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf3ca6-849b-436f-bf84-8f9f75445922 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:41.802078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf3ca6-849b-436f-bf84-8f9f75445922 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:41.835308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf3ca6-849b-436f-bf84-8f9f75445922 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:41.838302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf3ca6-849b-436f-bf84-8f9f75445922 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:41.864636 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1974/3911] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:42.466711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064f8c7-68d9-4e94-a217-296cadc97d7a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:42.467151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064f8c7-68d9-4e94-a217-296cadc97d7a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:42.467532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064f8c7-68d9-4e94-a217-296cadc97d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:42.512116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c9261-8a3d-44e1-a69e-1004be42058a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:42.512673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c9261-8a3d-44e1-a69e-1004be42058a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:42.512673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c9261-8a3d-44e1-a69e-1004be42058a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:42.555962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-dd2c9261-8a3d-44e1-a69e-1004be42058a None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:42.557260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dd2c9261-8a3d-44e1-a69e-1004be42058a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:42.559001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f064f8c7-68d9-4e94-a217-296cadc97d7a None None] MFA Rules not processed for user `365ef707d87d4d5d818a7e9388c65fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:42.568329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f064f8c7-68d9-4e94-a217-296cadc97d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:42.582743 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1975/3912] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:12:42.655798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c9261-8a3d-44e1-a69e-1004be42058a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:42.688222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c9261-8a3d-44e1-a69e-1004be42058a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:42.701887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a6583-7653-4185-a33c-5e0bc64694c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:42.702897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a6583-7653-4185-a33c-5e0bc64694c9 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:42.703426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a6583-7653-4185-a33c-5e0bc64694c9 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:42.703776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a6583-7653-4185-a33c-5e0bc64694c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:42.719170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a6583-7653-4185-a33c-5e0bc64694c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:42.721027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a6583-7653-4185-a33c-5e0bc64694c9 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:42.737967 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1938/3913] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:42.759598 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1976/3914] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 02 21:12:42.781328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064f8c7-68d9-4e94-a217-296cadc97d7a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:42.793229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f064f8c7-68d9-4e94-a217-296cadc97d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:43.022824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064f8c7-68d9-4e94-a217-296cadc97d7a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:43.067262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90eddf-e786-40a0-b95b-c8bc37ccd145 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:43.068264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90eddf-e786-40a0-b95b-c8bc37ccd145 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:43.068752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90eddf-e786-40a0-b95b-c8bc37ccd145 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:43.069216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90eddf-e786-40a0-b95b-c8bc37ccd145 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:43.094554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90eddf-e786-40a0-b95b-c8bc37ccd145 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:43.099617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90eddf-e786-40a0-b95b-c8bc37ccd145 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:43.120155 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1939/3915] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:12:43.280318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fecf3-6c67-4080-a1db-5908d42d23c0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:43.280793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fecf3-6c67-4080-a1db-5908d42d23c0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:43.281271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fecf3-6c67-4080-a1db-5908d42d23c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:43.342930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ec4fecf3-6c67-4080-a1db-5908d42d23c0 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:43.345909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ec4fecf3-6c67-4080-a1db-5908d42d23c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:43.364621 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1977/3916] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:12:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:43.424398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90eddf-e786-40a0-b95b-c8bc37ccd145 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:43.439258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:43.455271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90eddf-e786-40a0-b95b-c8bc37ccd145 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:43.470698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cb638-90b8-45c6-8512-991e23ca12a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:43.473857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cb638-90b8-45c6-8512-991e23ca12a0 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:43.474146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cb638-90b8-45c6-8512-991e23ca12a0 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:43.474460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cb638-90b8-45c6-8512-991e23ca12a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:43.497007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cb638-90b8-45c6-8512-991e23ca12a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:43.498935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cb638-90b8-45c6-8512-991e23ca12a0 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:43.514419 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1940/3917] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 02 21:12:44.045371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90612f-c524-4019-9390-b3396678b58d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:44.046012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90612f-c524-4019-9390-b3396678b58d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:44.046546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90612f-c524-4019-9390-b3396678b58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:44.114300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ef90612f-c524-4019-9390-b3396678b58d None None] MFA Rules not processed for user `365ef707d87d4d5d818a7e9388c65fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:44.130647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ef90612f-c524-4019-9390-b3396678b58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:44.168805 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1978/3918] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:44.492749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba3b23-ce9b-4be6-8e8c-fff7112e70d9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:44.493352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba3b23-ce9b-4be6-8e8c-fff7112e70d9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:44.493352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba3b23-ce9b-4be6-8e8c-fff7112e70d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:44.543794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-80ba3b23-ce9b-4be6-8e8c-fff7112e70d9 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:44.549590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-80ba3b23-ce9b-4be6-8e8c-fff7112e70d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:44.580498 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1941/3919] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:12:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:12:44.600458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90612f-c524-4019-9390-b3396678b58d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:44.626437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90612f-c524-4019-9390-b3396678b58d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:44.642367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6f396-995c-4734-9f67-c0b25564c97d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:44.643308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6f396-995c-4734-9f67-c0b25564c97d service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:44.643753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6f396-995c-4734-9f67-c0b25564c97d service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:44.644212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6f396-995c-4734-9f67-c0b25564c97d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:44.663235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6f396-995c-4734-9f67-c0b25564c97d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:44.669366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6f396-995c-4734-9f67-c0b25564c97d service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:44.688949 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1979/3920] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:45.339348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941f9af-8fc4-47dc-8bdc-1c8a83415047 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:45.339888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941f9af-8fc4-47dc-8bdc-1c8a83415047 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:45.340194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941f9af-8fc4-47dc-8bdc-1c8a83415047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:45.397402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b941f9af-8fc4-47dc-8bdc-1c8a83415047 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:45.404649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b941f9af-8fc4-47dc-8bdc-1c8a83415047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:45.432197 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1942/3921] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:12:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:45.448883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6f396-995c-4734-9f67-c0b25564c97d service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:45.470657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6f396-995c-4734-9f67-c0b25564c97d service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:45.481911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21a7f4-79b0-48c1-9d18-9a717a860a73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:45.483026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21a7f4-79b0-48c1-9d18-9a717a860a73 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:45.483516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21a7f4-79b0-48c1-9d18-9a717a860a73 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:45.483963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21a7f4-79b0-48c1-9d18-9a717a860a73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:45.494639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21a7f4-79b0-48c1-9d18-9a717a860a73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:45.496893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21a7f4-79b0-48c1-9d18-9a717a860a73 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:45.513346 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1980/3922] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:46.161831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941f9af-8fc4-47dc-8bdc-1c8a83415047 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:46.164532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b941f9af-8fc4-47dc-8bdc-1c8a83415047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:46.190863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941f9af-8fc4-47dc-8bdc-1c8a83415047 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:46.206758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422327b-4f6b-4c81-8420-8711cab173d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:46.209407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422327b-4f6b-4c81-8420-8711cab173d4 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:46.212068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422327b-4f6b-4c81-8420-8711cab173d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:46.214234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422327b-4f6b-4c81-8420-8711cab173d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:46.225316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a422327b-4f6b-4c81-8420-8711cab173d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:46.267572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422327b-4f6b-4c81-8420-8711cab173d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:46.272953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422327b-4f6b-4c81-8420-8711cab173d4 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:46.307251 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1943/3923] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:12:47.826168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbd106-dddc-4d83-8c3d-89a2d8addfbe None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:47.827063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbd106-dddc-4d83-8c3d-89a2d8addfbe None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:47.827515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbd106-dddc-4d83-8c3d-89a2d8addfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:47.840663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:47.891816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e9fbd106-dddc-4d83-8c3d-89a2d8addfbe None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:47.894182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e9fbd106-dddc-4d83-8c3d-89a2d8addfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:47.938790 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1981/3924] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:12:47.948251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422327b-4f6b-4c81-8420-8711cab173d4 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:47.980158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422327b-4f6b-4c81-8420-8711cab173d4 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:47.993906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf1d3c-c14a-49ba-bbd2-3ac92812be22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:47.996196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf1d3c-c14a-49ba-bbd2-3ac92812be22 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:47.997169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf1d3c-c14a-49ba-bbd2-3ac92812be22 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:47.998247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf1d3c-c14a-49ba-bbd2-3ac92812be22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:48.022010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf1d3c-c14a-49ba-bbd2-3ac92812be22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:48.034739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf1d3c-c14a-49ba-bbd2-3ac92812be22 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:48.058053 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1944/3925] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:48.640123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6aec89-54f5-426f-bdab-b093039a2ed7 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:48.640397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6aec89-54f5-426f-bdab-b093039a2ed7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:48.640959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6aec89-54f5-426f-bdab-b093039a2ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:48.685677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ad6aec89-54f5-426f-bdab-b093039a2ed7 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:48.686928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ad6aec89-54f5-426f-bdab-b093039a2ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:48.715412 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1982/3926] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:12:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:48.777903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf1d3c-c14a-49ba-bbd2-3ac92812be22 service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:48.798573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf1d3c-c14a-49ba-bbd2-3ac92812be22 service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:48.814550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d839c9-9671-410d-b553-049f2fcf3d6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:48.816907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d839c9-9671-410d-b553-049f2fcf3d6a service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:48.820314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d839c9-9671-410d-b553-049f2fcf3d6a service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:48.820909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d839c9-9671-410d-b553-049f2fcf3d6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:48.857970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d839c9-9671-410d-b553-049f2fcf3d6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:48.859788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d839c9-9671-410d-b553-049f2fcf3d6a service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:48.883483 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1945/3927] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:49.221837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b0f25-194b-4e7f-80d8-d8b798d02a0e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:49.222402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b0f25-194b-4e7f-80d8-d8b798d02a0e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:49.222402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b0f25-194b-4e7f-80d8-d8b798d02a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:49.289783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-710b0f25-194b-4e7f-80d8-d8b798d02a0e None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:49.291049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-710b0f25-194b-4e7f-80d8-d8b798d02a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:49.331225 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1983/3928] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:12:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:12:49.367454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d839c9-9671-410d-b553-049f2fcf3d6a service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:49.403844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d839c9-9671-410d-b553-049f2fcf3d6a service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:49.445547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b856c-4a88-4021-9977-e4f4cfee8d29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:49.446438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b856c-4a88-4021-9977-e4f4cfee8d29 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:49.446831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b856c-4a88-4021-9977-e4f4cfee8d29 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:49.448346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b856c-4a88-4021-9977-e4f4cfee8d29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:49.463267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b856c-4a88-4021-9977-e4f4cfee8d29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:49.466238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b856c-4a88-4021-9977-e4f4cfee8d29 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:49.511440 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1946/3929] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:50.062714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd31cf-6ef2-48dc-9f79-e55222c686b7 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:50.062999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd31cf-6ef2-48dc-9f79-e55222c686b7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:50.063281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd31cf-6ef2-48dc-9f79-e55222c686b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:50.096814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-30bd31cf-6ef2-48dc-9f79-e55222c686b7 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:50.098066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-30bd31cf-6ef2-48dc-9f79-e55222c686b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:50.120597 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1984/3930] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:12:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:50.137058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b856c-4a88-4021-9977-e4f4cfee8d29 service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:50.148437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b856c-4a88-4021-9977-e4f4cfee8d29 service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:50.168018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6a5db-c145-409f-8498-408ab5c2c041 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:50.168703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6a5db-c145-409f-8498-408ab5c2c041 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:50.168987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6a5db-c145-409f-8498-408ab5c2c041 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:50.169265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6a5db-c145-409f-8498-408ab5c2c041 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:50.213597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6a5db-c145-409f-8498-408ab5c2c041 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:50.213597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6a5db-c145-409f-8498-408ab5c2c041 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:50.227446 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1947/3931] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:50.631181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bccb98-5bc2-49bd-9c8d-f30b750f49ea None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:50.632191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bccb98-5bc2-49bd-9c8d-f30b750f49ea None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:50.632673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bccb98-5bc2-49bd-9c8d-f30b750f49ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:50.684252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-42bccb98-5bc2-49bd-9c8d-f30b750f49ea None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:50.688977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-42bccb98-5bc2-49bd-9c8d-f30b750f49ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:50.706911 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1985/3932] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:12:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:12:50.738317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6a5db-c145-409f-8498-408ab5c2c041 service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:50.767302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6a5db-c145-409f-8498-408ab5c2c041 service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:50.792013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7005ee-e5dd-4bfc-9ef3-34cd4407cc5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:50.793062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7005ee-e5dd-4bfc-9ef3-34cd4407cc5f service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:50.793575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7005ee-e5dd-4bfc-9ef3-34cd4407cc5f service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:50.794051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7005ee-e5dd-4bfc-9ef3-34cd4407cc5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:50.807675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7005ee-e5dd-4bfc-9ef3-34cd4407cc5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:50.809825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7005ee-e5dd-4bfc-9ef3-34cd4407cc5f service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:50.826346 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1948/3933] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:51.193932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c614e-426d-4f8a-94df-64ef780e5c49 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:51.194337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c614e-426d-4f8a-94df-64ef780e5c49 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:51.194873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c614e-426d-4f8a-94df-64ef780e5c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:51.247681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7f1c614e-426d-4f8a-94df-64ef780e5c49 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:51.255392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7f1c614e-426d-4f8a-94df-64ef780e5c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:51.273915 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1986/3934] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:51.294214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7005ee-e5dd-4bfc-9ef3-34cd4407cc5f service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:51.321695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7005ee-e5dd-4bfc-9ef3-34cd4407cc5f service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:51.330091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798b023-b68e-4c8f-bc87-f7899c8cd665 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:51.331295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798b023-b68e-4c8f-bc87-f7899c8cd665 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:51.331811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798b023-b68e-4c8f-bc87-f7899c8cd665 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:51.341636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798b023-b68e-4c8f-bc87-f7899c8cd665 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:51.364920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798b023-b68e-4c8f-bc87-f7899c8cd665 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:51.373490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798b023-b68e-4c8f-bc87-f7899c8cd665 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:51.386408 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1949/3935] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:51.649723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c614e-426d-4f8a-94df-64ef780e5c49 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:51.678667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c614e-426d-4f8a-94df-64ef780e5c49 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:51.701256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb967120-7db9-4a7d-b7d9-2e7e8edbd9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:51.702368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb967120-7db9-4a7d-b7d9-2e7e8edbd9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:51.702651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb967120-7db9-4a7d-b7d9-2e7e8edbd9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:51.702914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb967120-7db9-4a7d-b7d9-2e7e8edbd9eb admin admin] PATH_INFO: `/v3/users/f6ce0b7afba546489bca7255614ee6c0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:51.704912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb967120-7db9-4a7d-b7d9-2e7e8edbd9eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ce0b7afba546489bca7255614ee6c0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:51.711989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb967120-7db9-4a7d-b7d9-2e7e8edbd9eb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:51.841233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eb967120-7db9-4a7d-b7d9-2e7e8edbd9eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ce0b7afba546489bca7255614ee6c0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:51.858916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eb967120-7db9-4a7d-b7d9-2e7e8edbd9eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ce0b7afba546489bca7255614ee6c0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:51.859481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eb967120-7db9-4a7d-b7d9-2e7e8edbd9eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ce0b7afba546489bca7255614ee6c0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:51.860671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eb967120-7db9-4a7d-b7d9-2e7e8edbd9eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ce0b7afba546489bca7255614ee6c0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:51.875753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eb967120-7db9-4a7d-b7d9-2e7e8edbd9eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ce0b7afba546489bca7255614ee6c0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:51.920072 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1987/3936] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:12:51 2022] DELETE /identity/v3/users/f6ce0b7afba546489bca7255614ee6c0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:51.929619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd6859-0adb-4d5c-984f-4b3fc0df91c7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:51.931128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd6859-0adb-4d5c-984f-4b3fc0df91c7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:51.932265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd6859-0adb-4d5c-984f-4b3fc0df91c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:51.975411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-92bd6859-0adb-4d5c-984f-4b3fc0df91c7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:51.978146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-92bd6859-0adb-4d5c-984f-4b3fc0df91c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:52.151837 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1950/3937] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:52.193503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb967120-7db9-4a7d-b7d9-2e7e8edbd9eb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:52.195272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-eb967120-7db9-4a7d-b7d9-2e7e8edbd9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:52.369446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb967120-7db9-4a7d-b7d9-2e7e8edbd9eb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:52.373258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32784a-0fec-4d59-b9c5-ca8db69c7a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:52.373924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32784a-0fec-4d59-b9c5-ca8db69c7a91 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:52.374203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32784a-0fec-4d59-b9c5-ca8db69c7a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:52.375079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32784a-0fec-4d59-b9c5-ca8db69c7a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:52.400968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32784a-0fec-4d59-b9c5-ca8db69c7a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:52.402268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32784a-0fec-4d59-b9c5-ca8db69c7a91 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:52.422526 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1988/3938] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:12:52.654899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf2c15-4823-4821-bf06-7b7b7312ab5a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:52.655821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf2c15-4823-4821-bf06-7b7b7312ab5a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:52.656364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf2c15-4823-4821-bf06-7b7b7312ab5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:52.718031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3fbf2c15-4823-4821-bf06-7b7b7312ab5a None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:52.721772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3fbf2c15-4823-4821-bf06-7b7b7312ab5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:52.886832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:52.941632 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1951/3939] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:12:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:52.957009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32784a-0fec-4d59-b9c5-ca8db69c7a91 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:52.958513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ba32784a-0fec-4d59-b9c5-ca8db69c7a91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:53.067454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:53.150294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32784a-0fec-4d59-b9c5-ca8db69c7a91 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:53.159435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb78851-b64b-4324-92b5-0f0bae26a114 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:53.160417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb78851-b64b-4324-92b5-0f0bae26a114 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:53.160922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb78851-b64b-4324-92b5-0f0bae26a114 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:53.161478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb78851-b64b-4324-92b5-0f0bae26a114 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:53.176958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb78851-b64b-4324-92b5-0f0bae26a114 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:53.180927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb78851-b64b-4324-92b5-0f0bae26a114 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:53.194867 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1989/3940] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:53.455111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cffc1-db1e-4744-a58f-54c4b673f4a9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:53.455402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cffc1-db1e-4744-a58f-54c4b673f4a9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:53.455679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cffc1-db1e-4744-a58f-54c4b673f4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:53.519097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-338cffc1-db1e-4744-a58f-54c4b673f4a9 None None] MFA Rules not processed for user `70f29fd685a149ea85207f47fcbb59d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:53.521144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-338cffc1-db1e-4744-a58f-54c4b673f4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:53.610829 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1952/3941] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:54.087602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb78851-b64b-4324-92b5-0f0bae26a114 service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:54.098852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cffc1-db1e-4744-a58f-54c4b673f4a9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:54.101396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ceb78851-b64b-4324-92b5-0f0bae26a114 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:54.102204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-338cffc1-db1e-4744-a58f-54c4b673f4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:54.142165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cffc1-db1e-4744-a58f-54c4b673f4a9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:54.149888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e697b51-08f9-47e1-b347-8353d10d3a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:54.151284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e697b51-08f9-47e1-b347-8353d10d3a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:54.151895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e697b51-08f9-47e1-b347-8353d10d3a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:54.169243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e697b51-08f9-47e1-b347-8353d10d3a3b admin admin] PATH_INFO: `/v3/projects/adfc04cc54d442bc97008904050f2ed6` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:54.171592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e697b51-08f9-47e1-b347-8353d10d3a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=adfc04cc54d442bc97008904050f2ed6)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:54.181687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e697b51-08f9-47e1-b347-8353d10d3a3b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:54.301693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e697b51-08f9-47e1-b347-8353d10d3a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adfc04cc54d442bc97008904050f2ed6', 'request_id': 'req-5e697b51-08f9-47e1-b347-8353d10d3a3b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:54.320642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb78851-b64b-4324-92b5-0f0bae26a114 service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:54.324776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e697b51-08f9-47e1-b347-8353d10d3a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adfc04cc54d442bc97008904050f2ed6', 'request_id': 'req-5e697b51-08f9-47e1-b347-8353d10d3a3b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:54.344650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e697b51-08f9-47e1-b347-8353d10d3a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adfc04cc54d442bc97008904050f2ed6', 'request_id': 'req-5e697b51-08f9-47e1-b347-8353d10d3a3b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:54.378900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e697b51-08f9-47e1-b347-8353d10d3a3b admin admin] The token cache is being invalidate because project adfc04cc54d442bc97008904050f2ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:12:54.379287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e697b51-08f9-47e1-b347-8353d10d3a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:54.380077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e697b51-08f9-47e1-b347-8353d10d3a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:54.384600 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1953/3942] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:54 2022] DELETE /identity/v3/projects/adfc04cc54d442bc97008904050f2ed6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:54.390920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cffe4-0978-489f-bd0d-8029337fe2e8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:54.390920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cffe4-0978-489f-bd0d-8029337fe2e8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:54.391209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cffe4-0978-489f-bd0d-8029337fe2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:54.441014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-442cffe4-0978-489f-bd0d-8029337fe2e8 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:54.442251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-442cffe4-0978-489f-bd0d-8029337fe2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:54.475002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3e02b-c86d-4b52-92fb-a44f1dd44da4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:54.475696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3e02b-c86d-4b52-92fb-a44f1dd44da4 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:54.475975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3e02b-c86d-4b52-92fb-a44f1dd44da4 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:54.476363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3e02b-c86d-4b52-92fb-a44f1dd44da4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:54.486687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3cb3e02b-c86d-4b52-92fb-a44f1dd44da4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:54.598690 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1954/3943] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:54.601212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08599722-ed8b-4115-ba59-2ed1859c71d1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:54.601507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08599722-ed8b-4115-ba59-2ed1859c71d1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:54.602724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08599722-ed8b-4115-ba59-2ed1859c71d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:54.638296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:54.639191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3e02b-c86d-4b52-92fb-a44f1dd44da4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:54.642889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3e02b-c86d-4b52-92fb-a44f1dd44da4 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:54.652701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-08599722-ed8b-4115-ba59-2ed1859c71d1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:54.655221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-08599722-ed8b-4115-ba59-2ed1859c71d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:54.661606 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1990/3944] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:12:54.666343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3e02b-c86d-4b52-92fb-a44f1dd44da4 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:54.668923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3cb3e02b-c86d-4b52-92fb-a44f1dd44da4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:54.685319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:54.847756 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1955/3945] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:54.849359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e2f31-3f4d-458b-bb78-54a90401f448 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:54.849721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e2f31-3f4d-458b-bb78-54a90401f448 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:54.850002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e2f31-3f4d-458b-bb78-54a90401f448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:54.891445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3e02b-c86d-4b52-92fb-a44f1dd44da4 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:54.916951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b55e2f31-3f4d-458b-bb78-54a90401f448 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:54.919975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b55e2f31-3f4d-458b-bb78-54a90401f448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:54.920915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566a51b-6c7a-4fde-8871-0ebdde4b9883 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:54.922340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566a51b-6c7a-4fde-8871-0ebdde4b9883 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:54.922859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566a51b-6c7a-4fde-8871-0ebdde4b9883 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:54.923102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566a51b-6c7a-4fde-8871-0ebdde4b9883 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:54.939428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566a51b-6c7a-4fde-8871-0ebdde4b9883 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:54.941096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566a51b-6c7a-4fde-8871-0ebdde4b9883 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:54.943880 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1956/3946] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:54.949616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e2f31-3f4d-458b-bb78-54a90401f448 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:54.971690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e2f31-3f4d-458b-bb78-54a90401f448 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:54.972813 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1991/3947] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:54.979561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1047f-6081-4170-aa6c-35261cca5606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:54.981105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1047f-6081-4170-aa6c-35261cca5606 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:54.981587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1047f-6081-4170-aa6c-35261cca5606 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:54.981941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1047f-6081-4170-aa6c-35261cca5606 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:54.982964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1047f-6081-4170-aa6c-35261cca5606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:12:54.983365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1047f-6081-4170-aa6c-35261cca5606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:54.985278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1047f-6081-4170-aa6c-35261cca5606 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:55.034548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566a51b-6c7a-4fde-8871-0ebdde4b9883 service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:55.043836 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1957/3948] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:12:55.058988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566a51b-6c7a-4fde-8871-0ebdde4b9883 service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:55.076508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3c822-7265-42a2-8086-faae214fd62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:55.077498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c822-7265-42a2-8086-faae214fd62e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:55.078014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c822-7265-42a2-8086-faae214fd62e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:55.078494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c822-7265-42a2-8086-faae214fd62e admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:55.079726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3c822-7265-42a2-8086-faae214fd62e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:55.082378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3c822-7265-42a2-8086-faae214fd62e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:55.145680 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1992/3949] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:12:55 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:12:55.146357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1047f-6081-4170-aa6c-35261cca5606 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:55.167914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1047f-6081-4170-aa6c-35261cca5606 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:55.347954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431e9ab-c7d5-4d55-a7c3-cbb0e0484b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:55.348679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431e9ab-c7d5-4d55-a7c3-cbb0e0484b0c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:55.348956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431e9ab-c7d5-4d55-a7c3-cbb0e0484b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:55.349249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431e9ab-c7d5-4d55-a7c3-cbb0e0484b0c admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:55.349979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431e9ab-c7d5-4d55-a7c3-cbb0e0484b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:55.352655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431e9ab-c7d5-4d55-a7c3-cbb0e0484b0c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:55.383319 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1958/3950] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:12:55 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:12:55.388168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3c822-7265-42a2-8086-faae214fd62e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:55.404169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3c822-7265-42a2-8086-faae214fd62e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:55.410380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d1d48-4062-41bc-bd9a-9d7161310a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:55.411438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d1d48-4062-41bc-bd9a-9d7161310a8a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:55.411923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d1d48-4062-41bc-bd9a-9d7161310a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:55.413087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d1d48-4062-41bc-bd9a-9d7161310a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:55.414281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d1d48-4062-41bc-bd9a-9d7161310a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:55.416196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d1d48-4062-41bc-bd9a-9d7161310a8a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:55.433655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431e9ab-c7d5-4d55-a7c3-cbb0e0484b0c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:55.442890 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1993/3951] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:55.447383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431e9ab-c7d5-4d55-a7c3-cbb0e0484b0c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:55.452774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7df58-babb-4b79-8bfc-784bb245bb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:55.453864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7df58-babb-4b79-8bfc-784bb245bb17 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:55.454483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7df58-babb-4b79-8bfc-784bb245bb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:55.454968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7df58-babb-4b79-8bfc-784bb245bb17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:55.455929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7df58-babb-4b79-8bfc-784bb245bb17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:55.457980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7df58-babb-4b79-8bfc-784bb245bb17 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:55.477394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d1d48-4062-41bc-bd9a-9d7161310a8a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:55.478346 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1959/3952] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:55.490223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d1d48-4062-41bc-bd9a-9d7161310a8a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:55.500268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e485bf-4876-493c-82f0-5c0b8639b8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:55.501472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e485bf-4876-493c-82f0-5c0b8639b8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:55.501971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e485bf-4876-493c-82f0-5c0b8639b8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:55.502449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e485bf-4876-493c-82f0-5c0b8639b8b5 admin admin] PATH_INFO: `/v3/projects/a284b28161a24f0cac5e83c76f135458/users/7b27c514c47c4b36b2eaceb00d405599/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:55.525910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e485bf-4876-493c-82f0-5c0b8639b8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a284b28161a24f0cac5e83c76f135458, user_id=7b27c514c47c4b36b2eaceb00d405599, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:55.529339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e485bf-4876-493c-82f0-5c0b8639b8b5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:55.562619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b0999-c2b9-4ead-9da8-115df0913507 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:55.562870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b0999-c2b9-4ead-9da8-115df0913507 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:55.562994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b0999-c2b9-4ead-9da8-115df0913507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:55.569321 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1994/3953] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:12:55 2022] PUT /identity/v3/projects/a284b28161a24f0cac5e83c76f135458/users/7b27c514c47c4b36b2eaceb00d405599/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:55.599019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-7e4b0999-c2b9-4ead-9da8-115df0913507 None None] MFA Rules not processed for user `7b27c514c47c4b36b2eaceb00d405599`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:55.600410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7e4b0999-c2b9-4ead-9da8-115df0913507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:55.673034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:55.689270 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1960/3954] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:55.695199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e485bf-4876-493c-82f0-5c0b8639b8b5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:55.784246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e485bf-4876-493c-82f0-5c0b8639b8b5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:55.791885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4522a21-19a2-4237-ad12-cdad295b4536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:55.792921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4522a21-19a2-4237-ad12-cdad295b4536 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:55.793359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4522a21-19a2-4237-ad12-cdad295b4536 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:55.793787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4522a21-19a2-4237-ad12-cdad295b4536 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:55.794668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4522a21-19a2-4237-ad12-cdad295b4536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:55.800192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4522a21-19a2-4237-ad12-cdad295b4536 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:55.863642 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1995/3955] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:12:55 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:12:55.866826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b0999-c2b9-4ead-9da8-115df0913507 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:55.884534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b0999-c2b9-4ead-9da8-115df0913507 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:55.955006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b8ede-7b17-495a-b238-6caf9e55f402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:55.955706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b8ede-7b17-495a-b238-6caf9e55f402 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:55.956057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b8ede-7b17-495a-b238-6caf9e55f402 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:55.956357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b8ede-7b17-495a-b238-6caf9e55f402 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:55.957075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b8ede-7b17-495a-b238-6caf9e55f402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:55.959100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b8ede-7b17-495a-b238-6caf9e55f402 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:55.989229 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1961/3956] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:12:55 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:12:55.990595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4522a21-19a2-4237-ad12-cdad295b4536 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:56.004921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4522a21-19a2-4237-ad12-cdad295b4536 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:56.010614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d86268-4271-430c-8955-e735fe4a1a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:56.011493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d86268-4271-430c-8955-e735fe4a1a45 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:56.011907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d86268-4271-430c-8955-e735fe4a1a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:56.012312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d86268-4271-430c-8955-e735fe4a1a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:56.013198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d86268-4271-430c-8955-e735fe4a1a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:56.015040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d86268-4271-430c-8955-e735fe4a1a45 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:56.034746 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1996/3957] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:56.036534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b8ede-7b17-495a-b238-6caf9e55f402 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:56.064877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b8ede-7b17-495a-b238-6caf9e55f402 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:56.097816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d260e0d-bebc-4b25-8532-da390a6826fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:56.098355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d260e0d-bebc-4b25-8532-da390a6826fb admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:56.098664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d260e0d-bebc-4b25-8532-da390a6826fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:56.098929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d260e0d-bebc-4b25-8532-da390a6826fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:56.099719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d260e0d-bebc-4b25-8532-da390a6826fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:56.101366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d260e0d-bebc-4b25-8532-da390a6826fb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:56.129505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d86268-4271-430c-8955-e735fe4a1a45 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:56.130593 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1962/3958] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:12:56.144260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d86268-4271-430c-8955-e735fe4a1a45 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:56.151160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6de3e-d6ec-4b0a-a7b1-1f9145ae9edb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:56.151706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6de3e-d6ec-4b0a-a7b1-1f9145ae9edb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:56.151706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6de3e-d6ec-4b0a-a7b1-1f9145ae9edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:56.163062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81591919-80df-4d3b-8ca2-45c7b50e8575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:56.166043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81591919-80df-4d3b-8ca2-45c7b50e8575 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:56.166420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81591919-80df-4d3b-8ca2-45c7b50e8575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:56.168650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81591919-80df-4d3b-8ca2-45c7b50e8575 admin admin] PATH_INFO: `/v3/projects/0d88eb14a0f44f83a0e726e3a48829d1/users/95fc1bbefb1440688b42ddecb42d6099/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:56.190953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:56.194625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-7fd6de3e-d6ec-4b0a-a7b1-1f9145ae9edb None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:56.196874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7fd6de3e-d6ec-4b0a-a7b1-1f9145ae9edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:56.220195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81591919-80df-4d3b-8ca2-45c7b50e8575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d88eb14a0f44f83a0e726e3a48829d1, user_id=95fc1bbefb1440688b42ddecb42d6099, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:56.230329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81591919-80df-4d3b-8ca2-45c7b50e8575 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:56.260529 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1997/3959] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:12:56 2022] PUT /identity/v3/projects/0d88eb14a0f44f83a0e726e3a48829d1/users/95fc1bbefb1440688b42ddecb42d6099/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:12:56.271932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd95cc0-4281-4ee2-99fb-a5995994fe84 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:56.272573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd95cc0-4281-4ee2-99fb-a5995994fe84 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:56.273058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd95cc0-4281-4ee2-99fb-a5995994fe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:56.358052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2bd95cc0-4281-4ee2-99fb-a5995994fe84 None None] MFA Rules not processed for user `95fc1bbefb1440688b42ddecb42d6099`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:56.363205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2bd95cc0-4281-4ee2-99fb-a5995994fe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:56.397854 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1963/3960] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:12:56.404597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6de3e-d6ec-4b0a-a7b1-1f9145ae9edb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:56.606397 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1998/3961] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:12:56.617817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6de3e-d6ec-4b0a-a7b1-1f9145ae9edb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:56.674396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:56.764510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b69c5-a028-493c-ae61-8988bcc9d382 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:56.765179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b69c5-a028-493c-ae61-8988bcc9d382 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:56.765463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b69c5-a028-493c-ae61-8988bcc9d382 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:56.765735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b69c5-a028-493c-ae61-8988bcc9d382 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:56.863059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b69c5-a028-493c-ae61-8988bcc9d382 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:56.866745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b69c5-a028-493c-ae61-8988bcc9d382 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:56.889194 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1964/3962] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:12:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 02 21:12:57.144498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd95cc0-4281-4ee2-99fb-a5995994fe84 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:57.150315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2bd95cc0-4281-4ee2-99fb-a5995994fe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:57.153256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b69c5-a028-493c-ae61-8988bcc9d382 service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:57.154686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cf7b69c5-a028-493c-ae61-8988bcc9d382 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:57.314138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b69c5-a028-493c-ae61-8988bcc9d382 service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:57.368313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301a391-cf3e-4bc0-9b17-055262c4a253 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:57.368999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301a391-cf3e-4bc0-9b17-055262c4a253 service glance] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:57.369288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301a391-cf3e-4bc0-9b17-055262c4a253 service glance] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:57.369553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301a391-cf3e-4bc0-9b17-055262c4a253 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:57.407870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd95cc0-4281-4ee2-99fb-a5995994fe84 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:57.422363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488b305-876b-4967-86fd-23be92db38b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:57.425308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488b305-876b-4967-86fd-23be92db38b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:57.429833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488b305-876b-4967-86fd-23be92db38b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:57.430495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488b305-876b-4967-86fd-23be92db38b6 admin admin] PATH_INFO: `/v3/users/e1eb8b2dbe5e4d1d96891039f146bffe` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:57.433691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488b305-876b-4967-86fd-23be92db38b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1eb8b2dbe5e4d1d96891039f146bffe)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:57.437892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488b305-876b-4967-86fd-23be92db38b6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:57.584617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301a391-cf3e-4bc0-9b17-055262c4a253 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:57.586071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301a391-cf3e-4bc0-9b17-055262c4a253 service glance] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:57.606284 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1965/3963] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:12:57.625250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9488b305-876b-4967-86fd-23be92db38b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1eb8b2dbe5e4d1d96891039f146bffe'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:57.642920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9488b305-876b-4967-86fd-23be92db38b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1eb8b2dbe5e4d1d96891039f146bffe'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:57.643536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9488b305-876b-4967-86fd-23be92db38b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1eb8b2dbe5e4d1d96891039f146bffe'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:57.644194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9488b305-876b-4967-86fd-23be92db38b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1eb8b2dbe5e4d1d96891039f146bffe'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:57.662693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9488b305-876b-4967-86fd-23be92db38b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1eb8b2dbe5e4d1d96891039f146bffe'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:57.693410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:57.712701 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 1999/3964] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:12:57 2022] DELETE /identity/v3/users/e1eb8b2dbe5e4d1d96891039f146bffe => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:12:57.714865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0447c2-f025-452b-8de4-a5c257d8c0ab None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:57.715155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0447c2-f025-452b-8de4-a5c257d8c0ab None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:57.715602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0447c2-f025-452b-8de4-a5c257d8c0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:57.751476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4b0447c2-f025-452b-8de4-a5c257d8c0ab None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:57.753030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4b0447c2-f025-452b-8de4-a5c257d8c0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:57.780244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:57.880927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488b305-876b-4967-86fd-23be92db38b6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:57.882442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9488b305-876b-4967-86fd-23be92db38b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:57.924814 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1966/3965] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:57.975594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0447c2-f025-452b-8de4-a5c257d8c0ab None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:57.977527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4b0447c2-f025-452b-8de4-a5c257d8c0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:58.042843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488b305-876b-4967-86fd-23be92db38b6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:58.055731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f3da7-931f-4b95-ab1e-b8bcbf1ecb1d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:58.056630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f3da7-931f-4b95-ab1e-b8bcbf1ecb1d service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:58.056891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f3da7-931f-4b95-ab1e-b8bcbf1ecb1d service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:58.057165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f3da7-931f-4b95-ab1e-b8bcbf1ecb1d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:58.059194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-282f3da7-931f-4b95-ab1e-b8bcbf1ecb1d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:58.160562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0447c2-f025-452b-8de4-a5c257d8c0ab None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:58.179557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f39603-e2a8-428d-872d-a1bf04916eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:58.181917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f39603-e2a8-428d-872d-a1bf04916eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:58.183831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f39603-e2a8-428d-872d-a1bf04916eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:58.184267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f39603-e2a8-428d-872d-a1bf04916eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:58.215661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f39603-e2a8-428d-872d-a1bf04916eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:58.217515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f39603-e2a8-428d-872d-a1bf04916eb0 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:58.241784 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1967/3966] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:12:58.244860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f3da7-931f-4b95-ab1e-b8bcbf1ecb1d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:58.246443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f3da7-931f-4b95-ab1e-b8bcbf1ecb1d service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:58.257216 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2000/3967] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:12:58.285363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91986a84-3431-48af-9614-08face207ee6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:58.285836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91986a84-3431-48af-9614-08face207ee6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:58.286210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91986a84-3431-48af-9614-08face207ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:58.330136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-91986a84-3431-48af-9614-08face207ee6 None None] MFA Rules not processed for user `70f29fd685a149ea85207f47fcbb59d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:58.333225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-91986a84-3431-48af-9614-08face207ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:58.451814 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1968/3968] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:12:59.158789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f3da7-931f-4b95-ab1e-b8bcbf1ecb1d service glance] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:59.160550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-282f3da7-931f-4b95-ab1e-b8bcbf1ecb1d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:59.195141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f3da7-931f-4b95-ab1e-b8bcbf1ecb1d service glance] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:59.218736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf37625-e9f9-4049-b693-0613e0cead09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:59.220194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf37625-e9f9-4049-b693-0613e0cead09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:59.220707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf37625-e9f9-4049-b693-0613e0cead09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:59.221188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf37625-e9f9-4049-b693-0613e0cead09 admin admin] PATH_INFO: `/v3/users/7b27c514c47c4b36b2eaceb00d405599` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:59.223627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf37625-e9f9-4049-b693-0613e0cead09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b27c514c47c4b36b2eaceb00d405599)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:59.228956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf37625-e9f9-4049-b693-0613e0cead09 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:59.435977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3bf37625-e9f9-4049-b693-0613e0cead09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b27c514c47c4b36b2eaceb00d405599'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:59.459622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3bf37625-e9f9-4049-b693-0613e0cead09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b27c514c47c4b36b2eaceb00d405599'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:59.460303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3bf37625-e9f9-4049-b693-0613e0cead09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b27c514c47c4b36b2eaceb00d405599'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:59.460987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3bf37625-e9f9-4049-b693-0613e0cead09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b27c514c47c4b36b2eaceb00d405599'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:59.471165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91986a84-3431-48af-9614-08face207ee6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:59.472770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-91986a84-3431-48af-9614-08face207ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:59.474333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3bf37625-e9f9-4049-b693-0613e0cead09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b27c514c47c4b36b2eaceb00d405599'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:59.510589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91986a84-3431-48af-9614-08face207ee6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:12:59.517230 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2001/3969] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:12:59 2022] DELETE /identity/v3/users/7b27c514c47c4b36b2eaceb00d405599 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:12:59.524795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7ff6f-7f24-4202-ae20-60fe0894ebd6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:59.525083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7ff6f-7f24-4202-ae20-60fe0894ebd6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:59.525382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7ff6f-7f24-4202-ae20-60fe0894ebd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:59.525632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef76e51-0518-4e20-9023-0ca4eaeca202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:12:59.527378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef76e51-0518-4e20-9023-0ca4eaeca202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:59.527905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef76e51-0518-4e20-9023-0ca4eaeca202 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:59.528428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef76e51-0518-4e20-9023-0ca4eaeca202 admin admin] PATH_INFO: `/v3/projects/c3f6b014bf864b6aa1a1d980f4dd70b0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:59.534886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef76e51-0518-4e20-9023-0ca4eaeca202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3f6b014bf864b6aa1a1d980f4dd70b0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:12:59.537453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef76e51-0518-4e20-9023-0ca4eaeca202 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:12:59.567531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-35c7ff6f-7f24-4202-ae20-60fe0894ebd6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:59.569912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-35c7ff6f-7f24-4202-ae20-60fe0894ebd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:59.609707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:59.663674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ef76e51-0518-4e20-9023-0ca4eaeca202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'request_id': 'req-1ef76e51-0518-4e20-9023-0ca4eaeca202'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:59.680600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ef76e51-0518-4e20-9023-0ca4eaeca202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'request_id': 'req-1ef76e51-0518-4e20-9023-0ca4eaeca202'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:59.695202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:59.697654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ef76e51-0518-4e20-9023-0ca4eaeca202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'request_id': 'req-1ef76e51-0518-4e20-9023-0ca4eaeca202'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:59.707328 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2002/3970] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:12:59.733943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ef76e51-0518-4e20-9023-0ca4eaeca202 admin admin] The token cache is being invalidate because project c3f6b014bf864b6aa1a1d980f4dd70b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:12:59.734413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ef76e51-0518-4e20-9023-0ca4eaeca202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:59.735236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ef76e51-0518-4e20-9023-0ca4eaeca202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:12:59.737497 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1969/3971] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:59 2022] DELETE /identity/v3/projects/c3f6b014bf864b6aa1a1d980f4dd70b0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:12:59.743121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df2971-9716-46ff-873e-f490764db239 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:12:59.743284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df2971-9716-46ff-873e-f490764db239 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:12:59.743612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df2971-9716-46ff-873e-f490764db239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:12:59.758070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef76e51-0518-4e20-9023-0ca4eaeca202 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:12:59.775332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1ef76e51-0518-4e20-9023-0ca4eaeca202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:12:59.808957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-97df2971-9716-46ff-873e-f490764db239 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:12:59.808957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-97df2971-9716-46ff-873e-f490764db239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:00.016601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef76e51-0518-4e20-9023-0ca4eaeca202 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:00.027987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b6d0a-6406-4f24-b0bc-b1b00bb88f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:00.029061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b6d0a-6406-4f24-b0bc-b1b00bb88f65 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:00.031562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b6d0a-6406-4f24-b0bc-b1b00bb88f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:00.031838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b6d0a-6406-4f24-b0bc-b1b00bb88f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:00.040964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8a4b6d0a-6406-4f24-b0bc-b1b00bb88f65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:00.063412 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2003/3972] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:00.071584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61679b45-2ef4-4a95-b10d-ebf9729aa465 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:00.072204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61679b45-2ef4-4a95-b10d-ebf9729aa465 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:00.072559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61679b45-2ef4-4a95-b10d-ebf9729aa465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:00.082045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b6d0a-6406-4f24-b0bc-b1b00bb88f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:00.090156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b6d0a-6406-4f24-b0bc-b1b00bb88f65 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:00.126230 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1970/3973] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:00.143743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-61679b45-2ef4-4a95-b10d-ebf9729aa465 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:00.145141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-61679b45-2ef4-4a95-b10d-ebf9729aa465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:00.165884 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2004/3974] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:00.173491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b6d0a-6406-4f24-b0bc-b1b00bb88f65 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:00.187321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b6d0a-6406-4f24-b0bc-b1b00bb88f65 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:00.202307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf26152-c2de-4b76-86f9-b723e4be45b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:00.203223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf26152-c2de-4b76-86f9-b723e4be45b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:00.203931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf26152-c2de-4b76-86f9-b723e4be45b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:00.204058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf26152-c2de-4b76-86f9-b723e4be45b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:00.204778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf26152-c2de-4b76-86f9-b723e4be45b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:13:00.205089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf26152-c2de-4b76-86f9-b723e4be45b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:00.210745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf26152-c2de-4b76-86f9-b723e4be45b9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:00.250014 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1971/3975] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:13:00.252749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61679b45-2ef4-4a95-b10d-ebf9729aa465 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:00.286248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61679b45-2ef4-4a95-b10d-ebf9729aa465 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:00.302495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73692bc1-b0f2-470f-bd43-69a3a97bbc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:00.308932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73692bc1-b0f2-470f-bd43-69a3a97bbc94 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:00.312273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73692bc1-b0f2-470f-bd43-69a3a97bbc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:00.312901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73692bc1-b0f2-470f-bd43-69a3a97bbc94 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:00.315539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73692bc1-b0f2-470f-bd43-69a3a97bbc94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:00.322810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73692bc1-b0f2-470f-bd43-69a3a97bbc94 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:00.391535 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2005/3976] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:13:00 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:00.392692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf26152-c2de-4b76-86f9-b723e4be45b9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:00.419032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf26152-c2de-4b76-86f9-b723e4be45b9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:00.620124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8381c-2938-40b4-b502-2631a43de669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:00.620841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8381c-2938-40b4-b502-2631a43de669 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:00.621126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8381c-2938-40b4-b502-2631a43de669 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:00.621409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8381c-2938-40b4-b502-2631a43de669 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:00.628673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8381c-2938-40b4-b502-2631a43de669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:00.630940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8381c-2938-40b4-b502-2631a43de669 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:00.691947 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1972/3977] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:13:00 2022] POST /identity/v3/users => generated 287 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:00.696389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73692bc1-b0f2-470f-bd43-69a3a97bbc94 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:00.711145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73692bc1-b0f2-470f-bd43-69a3a97bbc94 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:00.734697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c0273-a60b-46c8-a588-de1db63c61bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:00.735555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c0273-a60b-46c8-a588-de1db63c61bc admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:00.735943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c0273-a60b-46c8-a588-de1db63c61bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:00.736679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c0273-a60b-46c8-a588-de1db63c61bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:00.737237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c0273-a60b-46c8-a588-de1db63c61bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:00.739162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c0273-a60b-46c8-a588-de1db63c61bc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:00.778075 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2006/3978] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:00.778227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8381c-2938-40b4-b502-2631a43de669 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:00.792405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8381c-2938-40b4-b502-2631a43de669 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:00.805742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c66dd-8eb7-4a88-9e4a-7537be384ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:00.808030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c66dd-8eb7-4a88-9e4a-7537be384ffc admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:00.809592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c66dd-8eb7-4a88-9e4a-7537be384ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:00.809873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c66dd-8eb7-4a88-9e4a-7537be384ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:00.811669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c66dd-8eb7-4a88-9e4a-7537be384ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:00.816882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c66dd-8eb7-4a88-9e4a-7537be384ffc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:00.867183 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1973/3979] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:00.872730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c0273-a60b-46c8-a588-de1db63c61bc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:00.886607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c0273-a60b-46c8-a588-de1db63c61bc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:00.887909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb3b82-04ed-413c-8ae4-319bd439f272 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:00.890585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb3b82-04ed-413c-8ae4-319bd439f272 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:00.890844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb3b82-04ed-413c-8ae4-319bd439f272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:00.897320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f858b1-4916-4743-8ef8-d8f7368534fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:00.901213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f858b1-4916-4743-8ef8-d8f7368534fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:00.901213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f858b1-4916-4743-8ef8-d8f7368534fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:00.902666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f858b1-4916-4743-8ef8-d8f7368534fe admin admin] PATH_INFO: `/v3/projects/763faa5aa9894c6993b26c59764cdf4a/users/08656d37cd7148fc82b2629d814fcaf2/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:00.940082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-56eb3b82-04ed-413c-8ae4-319bd439f272 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:00.940082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-56eb3b82-04ed-413c-8ae4-319bd439f272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:00.944255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f858b1-4916-4743-8ef8-d8f7368534fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=763faa5aa9894c6993b26c59764cdf4a, user_id=08656d37cd7148fc82b2629d814fcaf2, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:00.951944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f858b1-4916-4743-8ef8-d8f7368534fe admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:01.001386 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2007/3980] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:13:00 2022] PUT /identity/v3/projects/763faa5aa9894c6993b26c59764cdf4a/users/08656d37cd7148fc82b2629d814fcaf2/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:01.003466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a5e41-82be-416d-9055-4bc6bfefd37f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:01.003816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a5e41-82be-416d-9055-4bc6bfefd37f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:01.004206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a5e41-82be-416d-9055-4bc6bfefd37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:01.048274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-694a5e41-82be-416d-9055-4bc6bfefd37f None None] MFA Rules not processed for user `08656d37cd7148fc82b2629d814fcaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:01.049731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-694a5e41-82be-416d-9055-4bc6bfefd37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:01.141593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:01.143669 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1974/3981] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:01.167423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb3b82-04ed-413c-8ae4-319bd439f272 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:01.173770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-56eb3b82-04ed-413c-8ae4-319bd439f272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:01.183773 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2008/3982] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:01.199818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a5e41-82be-416d-9055-4bc6bfefd37f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:01.200800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:01.203566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-694a5e41-82be-416d-9055-4bc6bfefd37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:01.371847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a5e41-82be-416d-9055-4bc6bfefd37f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:01.379352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad339ca6-6d97-4a61-8a52-bc866866dc8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:01.380509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad339ca6-6d97-4a61-8a52-bc866866dc8c service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:01.381196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad339ca6-6d97-4a61-8a52-bc866866dc8c service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:01.381686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad339ca6-6d97-4a61-8a52-bc866866dc8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:01.397023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb3b82-04ed-413c-8ae4-319bd439f272 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:01.397963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad339ca6-6d97-4a61-8a52-bc866866dc8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:01.399954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad339ca6-6d97-4a61-8a52-bc866866dc8c service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:01.424844 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2009/3983] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:13:01.499209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ca54-4232-4529-bb99-ff883ff6d099 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:01.501357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ca54-4232-4529-bb99-ff883ff6d099 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:01.501657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ca54-4232-4529-bb99-ff883ff6d099 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:01.501933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ca54-4232-4529-bb99-ff883ff6d099 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:01.657047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508ca54-4232-4529-bb99-ff883ff6d099 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:01.659753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508ca54-4232-4529-bb99-ff883ff6d099 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:01.680750 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1975/3984] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:13:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:13:01.953679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad339ca6-6d97-4a61-8a52-bc866866dc8c service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:01.955416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ad339ca6-6d97-4a61-8a52-bc866866dc8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:02.199047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad339ca6-6d97-4a61-8a52-bc866866dc8c service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:02.206695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31641e-d03a-4a5f-9569-a1c680e2c211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:02.208180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31641e-d03a-4a5f-9569-a1c680e2c211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:02.208919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31641e-d03a-4a5f-9569-a1c680e2c211 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:02.209445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31641e-d03a-4a5f-9569-a1c680e2c211 admin admin] PATH_INFO: `/v3/projects/a284b28161a24f0cac5e83c76f135458` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:02.210941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31641e-d03a-4a5f-9569-a1c680e2c211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a284b28161a24f0cac5e83c76f135458)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:02.215055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31641e-d03a-4a5f-9569-a1c680e2c211 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:02.348826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1b31641e-d03a-4a5f-9569-a1c680e2c211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a284b28161a24f0cac5e83c76f135458', 'request_id': 'req-1b31641e-d03a-4a5f-9569-a1c680e2c211'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:02.367363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1b31641e-d03a-4a5f-9569-a1c680e2c211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a284b28161a24f0cac5e83c76f135458', 'request_id': 'req-1b31641e-d03a-4a5f-9569-a1c680e2c211'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:02.393011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1b31641e-d03a-4a5f-9569-a1c680e2c211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a284b28161a24f0cac5e83c76f135458', 'request_id': 'req-1b31641e-d03a-4a5f-9569-a1c680e2c211'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:02.408152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1b31641e-d03a-4a5f-9569-a1c680e2c211 admin admin] The token cache is being invalidate because project a284b28161a24f0cac5e83c76f135458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:13:02.408573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1b31641e-d03a-4a5f-9569-a1c680e2c211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:02.409537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1b31641e-d03a-4a5f-9569-a1c680e2c211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:02.416760 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2010/3985] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:13:01 2022] DELETE /identity/v3/projects/a284b28161a24f0cac5e83c76f135458 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:02.418153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ca54-4232-4529-bb99-ff883ff6d099 service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:02.437269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ca54-4232-4529-bb99-ff883ff6d099 service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:02.535092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:02.582664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96db61-66ed-46e1-ad19-85521194480a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:02.583603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96db61-66ed-46e1-ad19-85521194480a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:02.583951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96db61-66ed-46e1-ad19-85521194480a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:02.584254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96db61-66ed-46e1-ad19-85521194480a admin admin] PATH_INFO: `/v3/users/95fc1bbefb1440688b42ddecb42d6099` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:02.589384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96db61-66ed-46e1-ad19-85521194480a admin admin] RBAC: Authorizing `identity:delete_user(user_id=95fc1bbefb1440688b42ddecb42d6099)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:02.591340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96db61-66ed-46e1-ad19-85521194480a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:02.686089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0d96db61-66ed-46e1-ad19-85521194480a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95fc1bbefb1440688b42ddecb42d6099'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:02.702626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0d96db61-66ed-46e1-ad19-85521194480a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95fc1bbefb1440688b42ddecb42d6099'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:02.719676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0d96db61-66ed-46e1-ad19-85521194480a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95fc1bbefb1440688b42ddecb42d6099'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:02.724732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0d96db61-66ed-46e1-ad19-85521194480a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95fc1bbefb1440688b42ddecb42d6099'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:02.726030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0d96db61-66ed-46e1-ad19-85521194480a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95fc1bbefb1440688b42ddecb42d6099'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:02.729818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31641e-d03a-4a5f-9569-a1c680e2c211 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:02.731304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1b31641e-d03a-4a5f-9569-a1c680e2c211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:02.746582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:02.752026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31641e-d03a-4a5f-9569-a1c680e2c211 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:02.762311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043f4fb-11c1-4ad1-ae27-449e23260b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:02.764846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043f4fb-11c1-4ad1-ae27-449e23260b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:02.766086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043f4fb-11c1-4ad1-ae27-449e23260b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:02.766725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043f4fb-11c1-4ad1-ae27-449e23260b65 admin admin] PATH_INFO: `/v3/users/8b345a42784d4df79caab6d667117418` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:02.768872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043f4fb-11c1-4ad1-ae27-449e23260b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b345a42784d4df79caab6d667117418)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:02.771963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043f4fb-11c1-4ad1-ae27-449e23260b65 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:02.801958 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1976/3986] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:13:02 2022] DELETE /identity/v3/users/95fc1bbefb1440688b42ddecb42d6099 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:02.872322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7043f4fb-11c1-4ad1-ae27-449e23260b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b345a42784d4df79caab6d667117418'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:02.900185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7043f4fb-11c1-4ad1-ae27-449e23260b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b345a42784d4df79caab6d667117418'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:02.902936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7043f4fb-11c1-4ad1-ae27-449e23260b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b345a42784d4df79caab6d667117418'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:02.905523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7043f4fb-11c1-4ad1-ae27-449e23260b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b345a42784d4df79caab6d667117418'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:02.917321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7043f4fb-11c1-4ad1-ae27-449e23260b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b345a42784d4df79caab6d667117418'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:02.966952 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2011/3987] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:13:02 2022] DELETE /identity/v3/users/8b345a42784d4df79caab6d667117418 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:03.378036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96db61-66ed-46e1-ad19-85521194480a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:03.383853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043f4fb-11c1-4ad1-ae27-449e23260b65 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:03.385721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7043f4fb-11c1-4ad1-ae27-449e23260b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:03.386018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0d96db61-66ed-46e1-ad19-85521194480a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:03.506440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043f4fb-11c1-4ad1-ae27-449e23260b65 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:03.511231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abb3c3-1989-4423-a416-0d0743f2cdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:03.512146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abb3c3-1989-4423-a416-0d0743f2cdf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:03.512433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abb3c3-1989-4423-a416-0d0743f2cdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:03.512718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abb3c3-1989-4423-a416-0d0743f2cdf4 admin admin] PATH_INFO: `/v3/projects/8c234eb1b17242368d279c164a6045d4` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:03.514049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abb3c3-1989-4423-a416-0d0743f2cdf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c234eb1b17242368d279c164a6045d4)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:03.516215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abb3c3-1989-4423-a416-0d0743f2cdf4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:03.549952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96db61-66ed-46e1-ad19-85521194480a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:03.565535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c08ea-4c59-424b-81b9-36ff14eabe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:03.566575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c08ea-4c59-424b-81b9-36ff14eabe8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:03.566954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c08ea-4c59-424b-81b9-36ff14eabe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:03.577563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c08ea-4c59-424b-81b9-36ff14eabe8a admin admin] PATH_INFO: `/v3/projects/0d88eb14a0f44f83a0e726e3a48829d1` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:03.580300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c08ea-4c59-424b-81b9-36ff14eabe8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d88eb14a0f44f83a0e726e3a48829d1)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:03.582516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c08ea-4c59-424b-81b9-36ff14eabe8a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:03.594466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-49abb3c3-1989-4423-a416-0d0743f2cdf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c234eb1b17242368d279c164a6045d4', 'request_id': 'req-49abb3c3-1989-4423-a416-0d0743f2cdf4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:03.606364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-49abb3c3-1989-4423-a416-0d0743f2cdf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c234eb1b17242368d279c164a6045d4', 'request_id': 'req-49abb3c3-1989-4423-a416-0d0743f2cdf4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:03.617810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-49abb3c3-1989-4423-a416-0d0743f2cdf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c234eb1b17242368d279c164a6045d4', 'request_id': 'req-49abb3c3-1989-4423-a416-0d0743f2cdf4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:03.658795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f3c08ea-4c59-424b-81b9-36ff14eabe8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d88eb14a0f44f83a0e726e3a48829d1', 'request_id': 'req-3f3c08ea-4c59-424b-81b9-36ff14eabe8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:03.662325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-49abb3c3-1989-4423-a416-0d0743f2cdf4 admin admin] The token cache is being invalidate because project 8c234eb1b17242368d279c164a6045d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:13:03.664325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-49abb3c3-1989-4423-a416-0d0743f2cdf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:03.665280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-49abb3c3-1989-4423-a416-0d0743f2cdf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:03.668618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f3c08ea-4c59-424b-81b9-36ff14eabe8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d88eb14a0f44f83a0e726e3a48829d1', 'request_id': 'req-3f3c08ea-4c59-424b-81b9-36ff14eabe8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:03.669321 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2012/3988] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:13:03 2022] DELETE /identity/v3/projects/8c234eb1b17242368d279c164a6045d4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:13:03.677191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207978e8-7455-49a0-b249-1d007062a48c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:03.681624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207978e8-7455-49a0-b249-1d007062a48c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:03.682037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207978e8-7455-49a0-b249-1d007062a48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:03.684098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f3c08ea-4c59-424b-81b9-36ff14eabe8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d88eb14a0f44f83a0e726e3a48829d1', 'request_id': 'req-3f3c08ea-4c59-424b-81b9-36ff14eabe8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:03.689841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:03.707657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:03.708235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f3c08ea-4c59-424b-81b9-36ff14eabe8a admin admin] The token cache is being invalidate because project 0d88eb14a0f44f83a0e726e3a48829d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:13:03.708775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f3c08ea-4c59-424b-81b9-36ff14eabe8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:03.710168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f3c08ea-4c59-424b-81b9-36ff14eabe8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:03.712664 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1977/3989] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:13:03 2022] DELETE /identity/v3/projects/0d88eb14a0f44f83a0e726e3a48829d1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:03.721483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c08ea-4c59-424b-81b9-36ff14eabe8a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:03.723339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3f3c08ea-4c59-424b-81b9-36ff14eabe8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:03.724669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-207978e8-7455-49a0-b249-1d007062a48c None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:03.726075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-207978e8-7455-49a0-b249-1d007062a48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:03.850904 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2013/3990] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:03.852539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52e227-01d6-45b0-84fc-d7ee60a8de4b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:03.852828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52e227-01d6-45b0-84fc-d7ee60a8de4b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:03.853155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52e227-01d6-45b0-84fc-d7ee60a8de4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:03.876796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c08ea-4c59-424b-81b9-36ff14eabe8a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:03.881646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6e52e227-01d6-45b0-84fc-d7ee60a8de4b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:03.883250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046f53e-5996-409e-b3f8-7f64e716a0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:03.883436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6e52e227-01d6-45b0-84fc-d7ee60a8de4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:03.884243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046f53e-5996-409e-b3f8-7f64e716a0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:03.884524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046f53e-5996-409e-b3f8-7f64e716a0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:03.884793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046f53e-5996-409e-b3f8-7f64e716a0bc admin admin] PATH_INFO: `/v3/users/8eef55086fdc488fbe5327d75bc6d949` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:03.886680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046f53e-5996-409e-b3f8-7f64e716a0bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eef55086fdc488fbe5327d75bc6d949)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:03.888721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046f53e-5996-409e-b3f8-7f64e716a0bc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:03.893018 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2014/3991] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:03.893888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52e227-01d6-45b0-84fc-d7ee60a8de4b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:03.900959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6e52e227-01d6-45b0-84fc-d7ee60a8de4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:03.923027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52e227-01d6-45b0-84fc-d7ee60a8de4b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:03.928671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351f7c4-6d4d-4fdb-aa51-7034f68e19cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:03.930219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351f7c4-6d4d-4fdb-aa51-7034f68e19cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:03.930810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351f7c4-6d4d-4fdb-aa51-7034f68e19cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:03.931247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351f7c4-6d4d-4fdb-aa51-7034f68e19cb admin admin] PATH_INFO: `/v3/users/08656d37cd7148fc82b2629d814fcaf2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:03.934196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351f7c4-6d4d-4fdb-aa51-7034f68e19cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=08656d37cd7148fc82b2629d814fcaf2)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:03.936198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351f7c4-6d4d-4fdb-aa51-7034f68e19cb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:03.969155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4046f53e-5996-409e-b3f8-7f64e716a0bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eef55086fdc488fbe5327d75bc6d949'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:03.981389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4046f53e-5996-409e-b3f8-7f64e716a0bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eef55086fdc488fbe5327d75bc6d949'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:03.998003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4046f53e-5996-409e-b3f8-7f64e716a0bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eef55086fdc488fbe5327d75bc6d949'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:03.998756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4046f53e-5996-409e-b3f8-7f64e716a0bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eef55086fdc488fbe5327d75bc6d949'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:03.999502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4046f53e-5996-409e-b3f8-7f64e716a0bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eef55086fdc488fbe5327d75bc6d949'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:04.004711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0351f7c4-6d4d-4fdb-aa51-7034f68e19cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08656d37cd7148fc82b2629d814fcaf2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:04.016456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0351f7c4-6d4d-4fdb-aa51-7034f68e19cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08656d37cd7148fc82b2629d814fcaf2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:04.018174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0351f7c4-6d4d-4fdb-aa51-7034f68e19cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08656d37cd7148fc82b2629d814fcaf2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:04.019115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0351f7c4-6d4d-4fdb-aa51-7034f68e19cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08656d37cd7148fc82b2629d814fcaf2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:04.031297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0351f7c4-6d4d-4fdb-aa51-7034f68e19cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08656d37cd7148fc82b2629d814fcaf2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:04.031508 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1978/3992] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:13:03 2022] DELETE /identity/v3/users/8eef55086fdc488fbe5327d75bc6d949 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:04.032248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046f53e-5996-409e-b3f8-7f64e716a0bc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:04.034143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4046f53e-5996-409e-b3f8-7f64e716a0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:04.067875 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2015/3993] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:13:03 2022] DELETE /identity/v3/users/08656d37cd7148fc82b2629d814fcaf2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:04.070150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193c79d-3f62-43e3-97b4-873cc865eb32 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:04.070606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193c79d-3f62-43e3-97b4-873cc865eb32 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:04.071190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193c79d-3f62-43e3-97b4-873cc865eb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:04.121887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4193c79d-3f62-43e3-97b4-873cc865eb32 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:04.125851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4193c79d-3f62-43e3-97b4-873cc865eb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:04.151196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046f53e-5996-409e-b3f8-7f64e716a0bc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:04.170969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:04.243929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb402eb-82e5-4636-83a3-b0a4ba1da366 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:04.244982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb402eb-82e5-4636-83a3-b0a4ba1da366 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:04.245361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb402eb-82e5-4636-83a3-b0a4ba1da366 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:04.245730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb402eb-82e5-4636-83a3-b0a4ba1da366 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:04.249103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9eb402eb-82e5-4636-83a3-b0a4ba1da366 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:04.266281 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2016/3994] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:04.267726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70139880-66f7-4acd-90e7-8309c35dac84 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:04.267923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70139880-66f7-4acd-90e7-8309c35dac84 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:04.268225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70139880-66f7-4acd-90e7-8309c35dac84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:04.299481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-70139880-66f7-4acd-90e7-8309c35dac84 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:04.301280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-70139880-66f7-4acd-90e7-8309c35dac84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:04.311793 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2017/3995] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:04.313153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70139880-66f7-4acd-90e7-8309c35dac84 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:04.333214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70139880-66f7-4acd-90e7-8309c35dac84 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:04.340088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ea011-244d-4a1a-a1e5-cb500d9a8ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:04.340958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ea011-244d-4a1a-a1e5-cb500d9a8ded admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:04.341394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ea011-244d-4a1a-a1e5-cb500d9a8ded admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:04.341799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ea011-244d-4a1a-a1e5-cb500d9a8ded admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:04.342832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ea011-244d-4a1a-a1e5-cb500d9a8ded admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:13:04.343293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ea011-244d-4a1a-a1e5-cb500d9a8ded admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:04.346301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ea011-244d-4a1a-a1e5-cb500d9a8ded admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:04.357130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:04.358908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb402eb-82e5-4636-83a3-b0a4ba1da366 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:04.362131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb402eb-82e5-4636-83a3-b0a4ba1da366 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:04.375431 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1979/3996] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:13:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:13:04.377628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb402eb-82e5-4636-83a3-b0a4ba1da366 service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:04.379885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9eb402eb-82e5-4636-83a3-b0a4ba1da366 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:04.382564 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2018/3997] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:13:04.383670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ea011-244d-4a1a-a1e5-cb500d9a8ded admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:04.392967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b75ea011-244d-4a1a-a1e5-cb500d9a8ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:04.428063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ea011-244d-4a1a-a1e5-cb500d9a8ded admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:04.444213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed3ef7-7421-4b0c-9718-369a305a5227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:04.445317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed3ef7-7421-4b0c-9718-369a305a5227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:04.445607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed3ef7-7421-4b0c-9718-369a305a5227 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:04.446566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed3ef7-7421-4b0c-9718-369a305a5227 admin admin] PATH_INFO: `/v3/projects/e46aa206719140e7a508bab446fe1d59` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:04.449102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed3ef7-7421-4b0c-9718-369a305a5227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e46aa206719140e7a508bab446fe1d59)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:04.450975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed3ef7-7421-4b0c-9718-369a305a5227 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:04.540980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb402eb-82e5-4636-83a3-b0a4ba1da366 service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:04.580344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be968e-54a4-4166-8331-f55af13e64aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:04.581279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be968e-54a4-4166-8331-f55af13e64aa service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:04.581560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be968e-54a4-4166-8331-f55af13e64aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:04.581839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be968e-54a4-4166-8331-f55af13e64aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:04.620401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be968e-54a4-4166-8331-f55af13e64aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:04.622419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be968e-54a4-4166-8331-f55af13e64aa service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:04.643781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cfed3ef7-7421-4b0c-9718-369a305a5227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e46aa206719140e7a508bab446fe1d59', 'request_id': 'req-cfed3ef7-7421-4b0c-9718-369a305a5227'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:04.661189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cfed3ef7-7421-4b0c-9718-369a305a5227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e46aa206719140e7a508bab446fe1d59', 'request_id': 'req-cfed3ef7-7421-4b0c-9718-369a305a5227'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:04.668332 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1980/3998] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:04.670404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be968e-54a4-4166-8331-f55af13e64aa service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:04.672117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cfed3ef7-7421-4b0c-9718-369a305a5227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e46aa206719140e7a508bab446fe1d59', 'request_id': 'req-cfed3ef7-7421-4b0c-9718-369a305a5227'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:04.698615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be968e-54a4-4166-8331-f55af13e64aa service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:04.702849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cfed3ef7-7421-4b0c-9718-369a305a5227 admin admin] The token cache is being invalidate because project e46aa206719140e7a508bab446fe1d59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:13:04.703255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cfed3ef7-7421-4b0c-9718-369a305a5227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:04.705689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cfed3ef7-7421-4b0c-9718-369a305a5227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:04.711655 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2019/3999] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:13:04 2022] DELETE /identity/v3/projects/e46aa206719140e7a508bab446fe1d59 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:04.719843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e47635-0e0d-4604-8c43-40299f3a09d0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:04.720628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e47635-0e0d-4604-8c43-40299f3a09d0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:04.721084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e47635-0e0d-4604-8c43-40299f3a09d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:04.753722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-15e47635-0e0d-4604-8c43-40299f3a09d0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:04.755624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-15e47635-0e0d-4604-8c43-40299f3a09d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:04.795598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69e658-13f1-46dc-89bb-2003278455ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:04.796697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69e658-13f1-46dc-89bb-2003278455ee admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:04.797134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69e658-13f1-46dc-89bb-2003278455ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:04.797603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69e658-13f1-46dc-89bb-2003278455ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:04.798560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69e658-13f1-46dc-89bb-2003278455ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:04.800830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69e658-13f1-46dc-89bb-2003278455ee admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:04.812435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:04.882553 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1981/4000] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:13:04 2022] POST /identity/v3/projects => generated 393 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:04.889515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69e658-13f1-46dc-89bb-2003278455ee admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:04.895232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ef69e658-13f1-46dc-89bb-2003278455ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:04.980773 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2020/4001] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:04.990746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48970105-4bf0-433f-887d-ed72825fd6ba None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:04.991038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48970105-4bf0-433f-887d-ed72825fd6ba None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:04.991325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48970105-4bf0-433f-887d-ed72825fd6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:05.043319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-48970105-4bf0-433f-887d-ed72825fd6ba None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:05.045238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-48970105-4bf0-433f-887d-ed72825fd6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:05.077038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69e658-13f1-46dc-89bb-2003278455ee admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:05.095299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766e2fe-8487-4023-b2d9-be59ee9a69e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:05.097774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766e2fe-8487-4023-b2d9-be59ee9a69e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:05.098295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766e2fe-8487-4023-b2d9-be59ee9a69e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:05.098448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766e2fe-8487-4023-b2d9-be59ee9a69e1 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:05.100677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766e2fe-8487-4023-b2d9-be59ee9a69e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:05.106407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766e2fe-8487-4023-b2d9-be59ee9a69e1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:05.140394 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1982/4002] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:13:04 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:05.141720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b205be-a52b-4a84-9b70-86d2fe292724 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:05.142017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b205be-a52b-4a84-9b70-86d2fe292724 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:05.142432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b205be-a52b-4a84-9b70-86d2fe292724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:05.182897 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2021/4003] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:05.183971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48970105-4bf0-433f-887d-ed72825fd6ba None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:05.194668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-73b205be-a52b-4a84-9b70-86d2fe292724 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:05.196969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-73b205be-a52b-4a84-9b70-86d2fe292724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:05.197133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48970105-4bf0-433f-887d-ed72825fd6ba None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:05.203613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f18685-b596-4a1d-a0d0-02e5d9b6a95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:05.205341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f18685-b596-4a1d-a0d0-02e5d9b6a95b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:05.205890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f18685-b596-4a1d-a0d0-02e5d9b6a95b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:05.206242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f18685-b596-4a1d-a0d0-02e5d9b6a95b admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:05.207504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f18685-b596-4a1d-a0d0-02e5d9b6a95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:05.209654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f18685-b596-4a1d-a0d0-02e5d9b6a95b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:05.230594 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2022/4004] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:05.231778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f18685-b596-4a1d-a0d0-02e5d9b6a95b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:05.249958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f18685-b596-4a1d-a0d0-02e5d9b6a95b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:05.257246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26dac7-36b6-4f58-abfa-f632c6b6707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:05.258119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26dac7-36b6-4f58-abfa-f632c6b6707b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:05.258517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26dac7-36b6-4f58-abfa-f632c6b6707b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:05.258936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26dac7-36b6-4f58-abfa-f632c6b6707b admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:05.261783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26dac7-36b6-4f58-abfa-f632c6b6707b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:13:05.262194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26dac7-36b6-4f58-abfa-f632c6b6707b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:05.264166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26dac7-36b6-4f58-abfa-f632c6b6707b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:05.276851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:05.297858 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2023/4005] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:13:05.298974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26dac7-36b6-4f58-abfa-f632c6b6707b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:05.315301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26dac7-36b6-4f58-abfa-f632c6b6707b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:05.316090 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1983/4006] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:13:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:05.316922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b205be-a52b-4a84-9b70-86d2fe292724 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:05.328162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a139a1a-60c2-4d26-adb9-c3ec875eb98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:05.329280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a139a1a-60c2-4d26-adb9-c3ec875eb98f admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:05.329655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a139a1a-60c2-4d26-adb9-c3ec875eb98f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:05.330852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a139a1a-60c2-4d26-adb9-c3ec875eb98f admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:05.331695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a139a1a-60c2-4d26-adb9-c3ec875eb98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:05.333897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a139a1a-60c2-4d26-adb9-c3ec875eb98f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:05.338811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b205be-a52b-4a84-9b70-86d2fe292724 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:05.350181 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2024/4007] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:05.351253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a139a1a-60c2-4d26-adb9-c3ec875eb98f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:05.351476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e8f46-9fd6-4aac-b010-fb5eedace650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:05.352223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e8f46-9fd6-4aac-b010-fb5eedace650 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:05.352497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e8f46-9fd6-4aac-b010-fb5eedace650 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:05.353174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e8f46-9fd6-4aac-b010-fb5eedace650 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:05.353666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5a139a1a-60c2-4d26-adb9-c3ec875eb98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:05.356495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e8f46-9fd6-4aac-b010-fb5eedace650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:05.358445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e8f46-9fd6-4aac-b010-fb5eedace650 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:05.412346 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1984/4008] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:13:05 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:05.416730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e8f46-9fd6-4aac-b010-fb5eedace650 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:05.464997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a139a1a-60c2-4d26-adb9-c3ec875eb98f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:05.513594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e8f46-9fd6-4aac-b010-fb5eedace650 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:05.522121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123ecc4-8b13-4358-a993-6dea9d3bb779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:05.523050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123ecc4-8b13-4358-a993-6dea9d3bb779 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:05.523336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123ecc4-8b13-4358-a993-6dea9d3bb779 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:05.523615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123ecc4-8b13-4358-a993-6dea9d3bb779 admin admin] PATH_INFO: `/v3/projects/cb2c1b60ff044961a421fa18a22bceb5/users/cd4b666d8dc24db78d7906380b5ffef5/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:05.526609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:05.541420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db30ed-b747-46a7-834c-9823ee594d02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:05.542169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db30ed-b747-46a7-834c-9823ee594d02 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:05.542455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db30ed-b747-46a7-834c-9823ee594d02 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:05.542802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db30ed-b747-46a7-834c-9823ee594d02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:05.548353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123ecc4-8b13-4358-a993-6dea9d3bb779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2c1b60ff044961a421fa18a22bceb5, user_id=cd4b666d8dc24db78d7906380b5ffef5, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:05.552859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123ecc4-8b13-4358-a993-6dea9d3bb779 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:05.581223 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1985/4009] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:13:05 2022] PUT /identity/v3/projects/cb2c1b60ff044961a421fa18a22bceb5/users/cd4b666d8dc24db78d7906380b5ffef5/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:05.584752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123ecc4-8b13-4358-a993-6dea9d3bb779 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:05.634167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db30ed-b747-46a7-834c-9823ee594d02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:05.635821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db30ed-b747-46a7-834c-9823ee594d02 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:05.644887 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2025/4010] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:13:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:13:05.652340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db30ed-b747-46a7-834c-9823ee594d02 service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:05.653770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-66db30ed-b747-46a7-834c-9823ee594d02 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:05.668482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123ecc4-8b13-4358-a993-6dea9d3bb779 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:05.672826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db30ed-b747-46a7-834c-9823ee594d02 service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:05.674183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2e47a-19e9-48f4-805f-470c7c3e601c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:05.675049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2e47a-19e9-48f4-805f-470c7c3e601c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:05.675419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2e47a-19e9-48f4-805f-470c7c3e601c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:05.675750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2e47a-19e9-48f4-805f-470c7c3e601c admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:05.676556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2e47a-19e9-48f4-805f-470c7c3e601c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:05.678587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2e47a-19e9-48f4-805f-470c7c3e601c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:05.681521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace29b71-7b89-4170-81f2-f1be48d4167c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:05.682597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace29b71-7b89-4170-81f2-f1be48d4167c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:05.682882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace29b71-7b89-4170-81f2-f1be48d4167c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:05.683165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace29b71-7b89-4170-81f2-f1be48d4167c admin admin] PATH_INFO: `/v3/projects/763faa5aa9894c6993b26c59764cdf4a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:05.684417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace29b71-7b89-4170-81f2-f1be48d4167c admin admin] RBAC: Authorizing `identity:delete_project(project_id=763faa5aa9894c6993b26c59764cdf4a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:05.686969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace29b71-7b89-4170-81f2-f1be48d4167c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:05.704850 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1986/4011] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:13:05 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:05.706137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b884c0-98ec-4f64-bed3-d2e1c1492f2e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:05.706744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b884c0-98ec-4f64-bed3-d2e1c1492f2e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:05.707117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b884c0-98ec-4f64-bed3-d2e1c1492f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:05.743634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:05.751727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-91b884c0-98ec-4f64-bed3-d2e1c1492f2e None None] MFA Rules not processed for user `cd4b666d8dc24db78d7906380b5ffef5`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:05.753157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-91b884c0-98ec-4f64-bed3-d2e1c1492f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:05.765269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ace29b71-7b89-4170-81f2-f1be48d4167c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '763faa5aa9894c6993b26c59764cdf4a', 'request_id': 'req-ace29b71-7b89-4170-81f2-f1be48d4167c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:05.777375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ace29b71-7b89-4170-81f2-f1be48d4167c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '763faa5aa9894c6993b26c59764cdf4a', 'request_id': 'req-ace29b71-7b89-4170-81f2-f1be48d4167c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:05.785399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ace29b71-7b89-4170-81f2-f1be48d4167c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '763faa5aa9894c6993b26c59764cdf4a', 'request_id': 'req-ace29b71-7b89-4170-81f2-f1be48d4167c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:05.800665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ace29b71-7b89-4170-81f2-f1be48d4167c admin admin] The token cache is being invalidate because project 763faa5aa9894c6993b26c59764cdf4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:13:05.800956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ace29b71-7b89-4170-81f2-f1be48d4167c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:05.801636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ace29b71-7b89-4170-81f2-f1be48d4167c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:05.803626 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2026/4012] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:13:05 2022] DELETE /identity/v3/projects/763faa5aa9894c6993b26c59764cdf4a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:05.804829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace29b71-7b89-4170-81f2-f1be48d4167c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:05.806388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ace29b71-7b89-4170-81f2-f1be48d4167c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:05.836636 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1987/4013] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:05.838525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11de4f0-310f-47b8-ae93-664bea6df43d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:05.838845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11de4f0-310f-47b8-ae93-664bea6df43d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:05.839124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11de4f0-310f-47b8-ae93-664bea6df43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:05.860784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d11de4f0-310f-47b8-ae93-664bea6df43d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:05.862281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d11de4f0-310f-47b8-ae93-664bea6df43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:05.878986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace29b71-7b89-4170-81f2-f1be48d4167c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:05.884340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb22cfb-e5a7-4e5b-8253-b61f7750e2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:05.885076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb22cfb-e5a7-4e5b-8253-b61f7750e2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:05.885356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb22cfb-e5a7-4e5b-8253-b61f7750e2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:05.885629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb22cfb-e5a7-4e5b-8253-b61f7750e2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:05.886941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb22cfb-e5a7-4e5b-8253-b61f7750e2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:05.889669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb22cfb-e5a7-4e5b-8253-b61f7750e2b7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:05.903559 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2027/4014] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:05.907277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb22cfb-e5a7-4e5b-8253-b61f7750e2b7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:05.909213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-afb22cfb-e5a7-4e5b-8253-b61f7750e2b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:05.925496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb22cfb-e5a7-4e5b-8253-b61f7750e2b7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:05.931152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda54045-889f-4f87-a3a1-cb360301f92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:05.931913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda54045-889f-4f87-a3a1-cb360301f92e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:05.932240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda54045-889f-4f87-a3a1-cb360301f92e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:05.932537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda54045-889f-4f87-a3a1-cb360301f92e admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:05.933201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda54045-889f-4f87-a3a1-cb360301f92e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:05.935143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda54045-889f-4f87-a3a1-cb360301f92e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:05.946949 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1988/4015] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:05.948285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11de4f0-310f-47b8-ae93-664bea6df43d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:05.954735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:05.963140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11de4f0-310f-47b8-ae93-664bea6df43d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:05.968762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55254c-7270-40b8-b6a7-158c77ec4131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:05.969432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55254c-7270-40b8-b6a7-158c77ec4131 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:05.969709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55254c-7270-40b8-b6a7-158c77ec4131 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:05.969971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55254c-7270-40b8-b6a7-158c77ec4131 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:05.971228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55254c-7270-40b8-b6a7-158c77ec4131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:05.972911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55254c-7270-40b8-b6a7-158c77ec4131 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:05.974481 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2028/4016] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:13:05 2022] POST /identity/v3/projects => generated 391 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:05.975878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d541eb8-6e95-46a1-a1e9-5e255f35eeb5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:05.976232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d541eb8-6e95-46a1-a1e9-5e255f35eeb5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:05.976512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d541eb8-6e95-46a1-a1e9-5e255f35eeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:05.992421 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1989/4017] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:05.993640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55254c-7270-40b8-b6a7-158c77ec4131 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:05.996165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6d541eb8-6e95-46a1-a1e9-5e255f35eeb5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:05.997424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6d541eb8-6e95-46a1-a1e9-5e255f35eeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:06.007396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55254c-7270-40b8-b6a7-158c77ec4131 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:06.079382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee600b-f4e0-4bb0-9fb4-dcf3cb13168c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:06.079382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee600b-f4e0-4bb0-9fb4-dcf3cb13168c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:06.079382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee600b-f4e0-4bb0-9fb4-dcf3cb13168c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:06.079382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee600b-f4e0-4bb0-9fb4-dcf3cb13168c admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:06.079848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee600b-f4e0-4bb0-9fb4-dcf3cb13168c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:06.081093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee600b-f4e0-4bb0-9fb4-dcf3cb13168c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:06.098007 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2029/4018] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:06.098918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d541eb8-6e95-46a1-a1e9-5e255f35eeb5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:06.115533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d541eb8-6e95-46a1-a1e9-5e255f35eeb5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:06.121680 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1990/4019] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:13:05 2022] POST /identity/v3/users => generated 302 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:06.121680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee600b-f4e0-4bb0-9fb4-dcf3cb13168c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:06.125283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1736f-338f-4a25-a187-ddefc6cd5cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:06.126198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1736f-338f-4a25-a187-ddefc6cd5cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:06.126513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1736f-338f-4a25-a187-ddefc6cd5cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:06.126890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1736f-338f-4a25-a187-ddefc6cd5cdb admin admin] PATH_INFO: `/v3/projects/79a9f342331e41468cfbf45d04f8d623/users/19fe81e09ba144b393a3809b89c6f8d5/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:06.139492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee600b-f4e0-4bb0-9fb4-dcf3cb13168c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:06.145071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1736f-338f-4a25-a187-ddefc6cd5cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a9f342331e41468cfbf45d04f8d623, user_id=19fe81e09ba144b393a3809b89c6f8d5, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:06.145316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080e4d3-902c-4ffb-81b6-f92154e0df0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:06.145909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080e4d3-902c-4ffb-81b6-f92154e0df0c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:06.146218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080e4d3-902c-4ffb-81b6-f92154e0df0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:06.146495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080e4d3-902c-4ffb-81b6-f92154e0df0c admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:06.147363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080e4d3-902c-4ffb-81b6-f92154e0df0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:13:06.147673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080e4d3-902c-4ffb-81b6-f92154e0df0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:06.148908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1736f-338f-4a25-a187-ddefc6cd5cdb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:06.149352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080e4d3-902c-4ffb-81b6-f92154e0df0c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:06.165967 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1991/4020] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:13:06.166438 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2030/4021] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:13:06 2022] PUT /identity/v3/projects/79a9f342331e41468cfbf45d04f8d623/users/19fe81e09ba144b393a3809b89c6f8d5/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:06.167512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080e4d3-902c-4ffb-81b6-f92154e0df0c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:06.169879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1736f-338f-4a25-a187-ddefc6cd5cdb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:06.189064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:06.199671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080e4d3-902c-4ffb-81b6-f92154e0df0c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:06.275766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1736f-338f-4a25-a187-ddefc6cd5cdb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:06.284862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde97b4-91a0-4647-a161-1369d7332c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:06.285510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde97b4-91a0-4647-a161-1369d7332c47 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:06.285802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde97b4-91a0-4647-a161-1369d7332c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:06.286102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde97b4-91a0-4647-a161-1369d7332c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:06.286842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde97b4-91a0-4647-a161-1369d7332c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:06.288150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602e362-3c9e-477d-819e-81e05a1f452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:06.288833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602e362-3c9e-477d-819e-81e05a1f452d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:06.288970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde97b4-91a0-4647-a161-1369d7332c47 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:06.289148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602e362-3c9e-477d-819e-81e05a1f452d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:06.289375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602e362-3c9e-477d-819e-81e05a1f452d admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:06.290454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602e362-3c9e-477d-819e-81e05a1f452d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:06.292174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602e362-3c9e-477d-819e-81e05a1f452d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:06.306338 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1992/4022] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:06.309729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c1553-5b8a-48da-8bde-8106116209ca None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:06.310012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c1553-5b8a-48da-8bde-8106116209ca None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:06.310297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c1553-5b8a-48da-8bde-8106116209ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:06.329858 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2031/4023] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:13:06 2022] POST /identity/v3/projects => generated 389 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:13:06.331654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde97b4-91a0-4647-a161-1369d7332c47 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:06.341739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9a8c1553-5b8a-48da-8bde-8106116209ca None None] MFA Rules not processed for user `19fe81e09ba144b393a3809b89c6f8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:06.343070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9a8c1553-5b8a-48da-8bde-8106116209ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:06.411464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:06.426470 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1993/4024] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:06.428003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c1553-5b8a-48da-8bde-8106116209ca None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:06.431139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde97b4-91a0-4647-a161-1369d7332c47 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:06.436933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51600e-5cb0-4aae-b2fa-60236d2d76e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:06.438082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51600e-5cb0-4aae-b2fa-60236d2d76e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:06.438561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51600e-5cb0-4aae-b2fa-60236d2d76e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:06.439015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51600e-5cb0-4aae-b2fa-60236d2d76e0 admin admin] PATH_INFO: `/v3/projects/661a8e05098b4f6f8e6fe0cbb0f933cb/users/3a7bff017bf143308ff79947e41ab056/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:06.440741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c1553-5b8a-48da-8bde-8106116209ca None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:06.446133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750e03e-9b38-411d-97dd-019c0c01f23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:06.446963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750e03e-9b38-411d-97dd-019c0c01f23d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:06.447176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750e03e-9b38-411d-97dd-019c0c01f23d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:06.447487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750e03e-9b38-411d-97dd-019c0c01f23d admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:06.448228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750e03e-9b38-411d-97dd-019c0c01f23d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:06.450293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750e03e-9b38-411d-97dd-019c0c01f23d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:06.470142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51600e-5cb0-4aae-b2fa-60236d2d76e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=661a8e05098b4f6f8e6fe0cbb0f933cb, user_id=3a7bff017bf143308ff79947e41ab056, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:06.472888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51600e-5cb0-4aae-b2fa-60236d2d76e0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:06.483244 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1994/4025] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:13:06 2022] POST /identity/v3/users => generated 295 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:06.483244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750e03e-9b38-411d-97dd-019c0c01f23d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:06.504503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750e03e-9b38-411d-97dd-019c0c01f23d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:06.510588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f817279-b847-4141-8472-909417681c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:06.511486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f817279-b847-4141-8472-909417681c81 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:06.511768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f817279-b847-4141-8472-909417681c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:06.512258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f817279-b847-4141-8472-909417681c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:06.513046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f817279-b847-4141-8472-909417681c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:06.515333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f817279-b847-4141-8472-909417681c81 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:06.520988 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2032/4026] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:13:06 2022] PUT /identity/v3/projects/661a8e05098b4f6f8e6fe0cbb0f933cb/users/3a7bff017bf143308ff79947e41ab056/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:06.521638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51600e-5cb0-4aae-b2fa-60236d2d76e0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:06.568153 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1995/4027] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:13:06 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:06.569989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f817279-b847-4141-8472-909417681c81 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:06.613203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51600e-5cb0-4aae-b2fa-60236d2d76e0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:06.634187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:06.648856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f817279-b847-4141-8472-909417681c81 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:06.654802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8d141-249d-45ae-b4ce-0f8260d7383f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:06.655078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8d141-249d-45ae-b4ce-0f8260d7383f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:06.655359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8d141-249d-45ae-b4ce-0f8260d7383f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:06.655640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8d141-249d-45ae-b4ce-0f8260d7383f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:06.656393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8d141-249d-45ae-b4ce-0f8260d7383f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:06.658352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8d141-249d-45ae-b4ce-0f8260d7383f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:06.674384 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1996/4028] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:06.674384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8d141-249d-45ae-b4ce-0f8260d7383f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:06.685835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff10d3e-5bdc-4af2-9ad3-6b89972e903d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:06.686590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8d141-249d-45ae-b4ce-0f8260d7383f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:06.686738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff10d3e-5bdc-4af2-9ad3-6b89972e903d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:06.686892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff10d3e-5bdc-4af2-9ad3-6b89972e903d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:06.687286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff10d3e-5bdc-4af2-9ad3-6b89972e903d admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:06.688109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff10d3e-5bdc-4af2-9ad3-6b89972e903d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:06.689872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff10d3e-5bdc-4af2-9ad3-6b89972e903d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:06.693102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d145f59-09a9-4dd3-993c-0903ad3cc860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:06.693880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d145f59-09a9-4dd3-993c-0903ad3cc860 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:06.694727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d145f59-09a9-4dd3-993c-0903ad3cc860 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:06.695008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d145f59-09a9-4dd3-993c-0903ad3cc860 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:06.695703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d145f59-09a9-4dd3-993c-0903ad3cc860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:06.697653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d145f59-09a9-4dd3-993c-0903ad3cc860 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:06.701235 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2033/4029] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:06.705455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff10d3e-5bdc-4af2-9ad3-6b89972e903d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:06.718227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff10d3e-5bdc-4af2-9ad3-6b89972e903d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:06.723769 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1997/4030] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:13:06 2022] POST /identity/v3/users => generated 300 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:06.724584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d145f59-09a9-4dd3-993c-0903ad3cc860 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:06.727440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd39792-ef12-41c0-8ad4-973e914dce6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:06.728603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd39792-ef12-41c0-8ad4-973e914dce6a admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:06.729103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd39792-ef12-41c0-8ad4-973e914dce6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:06.729598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd39792-ef12-41c0-8ad4-973e914dce6a admin admin] PATH_INFO: `/v3/projects/661a8e05098b4f6f8e6fe0cbb0f933cb/users/3a7bff017bf143308ff79947e41ab056/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:06.737285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d145f59-09a9-4dd3-993c-0903ad3cc860 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:06.742193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd39792-ef12-41c0-8ad4-973e914dce6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=661a8e05098b4f6f8e6fe0cbb0f933cb, user_id=3a7bff017bf143308ff79947e41ab056, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:06.745049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd39792-ef12-41c0-8ad4-973e914dce6a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:06.751850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23fe31-8b0e-4bdb-badd-9d8175db8a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:06.752719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23fe31-8b0e-4bdb-badd-9d8175db8a1d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:06.753014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23fe31-8b0e-4bdb-badd-9d8175db8a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:06.753296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23fe31-8b0e-4bdb-badd-9d8175db8a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:06.754082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23fe31-8b0e-4bdb-badd-9d8175db8a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:06.755757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23fe31-8b0e-4bdb-badd-9d8175db8a1d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:06.772065 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2034/4031] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:13:06 2022] PUT /identity/v3/projects/661a8e05098b4f6f8e6fe0cbb0f933cb/users/3a7bff017bf143308ff79947e41ab056/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:06.772065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd39792-ef12-41c0-8ad4-973e914dce6a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:06.772530 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1998/4032] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:06.775032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23fe31-8b0e-4bdb-badd-9d8175db8a1d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:06.787074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23fe31-8b0e-4bdb-badd-9d8175db8a1d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:06.874864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd39792-ef12-41c0-8ad4-973e914dce6a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:06.880115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684f059-a0f9-46da-b63d-83d64e9e7ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:06.881050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684f059-a0f9-46da-b63d-83d64e9e7ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:06.881333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684f059-a0f9-46da-b63d-83d64e9e7ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:06.881598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684f059-a0f9-46da-b63d-83d64e9e7ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:06.881877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c0240-9054-46c7-b62a-56f74d3b8d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:06.882316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684f059-a0f9-46da-b63d-83d64e9e7ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:06.882830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c0240-9054-46c7-b62a-56f74d3b8d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:06.883048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c0240-9054-46c7-b62a-56f74d3b8d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:06.883324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c0240-9054-46c7-b62a-56f74d3b8d12 admin admin] PATH_INFO: `/v3/projects/a927eaf3d2da468480235dd4a065cdf6/users/40cbbd03a54c452a95fb84bc891bdfbb/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:06.884190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684f059-a0f9-46da-b63d-83d64e9e7ac3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:06.901859 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2035/4033] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:06.901859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4fcb5-da69-4bca-b74b-6e0b54da5c5e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:06.901859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4fcb5-da69-4bca-b74b-6e0b54da5c5e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:06.901859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4fcb5-da69-4bca-b74b-6e0b54da5c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:06.904889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c0240-9054-46c7-b62a-56f74d3b8d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a927eaf3d2da468480235dd4a065cdf6, user_id=40cbbd03a54c452a95fb84bc891bdfbb, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:06.907974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c0240-9054-46c7-b62a-56f74d3b8d12 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:06.939075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8ca4fcb5-da69-4bca-b74b-6e0b54da5c5e None None] MFA Rules not processed for user `3a7bff017bf143308ff79947e41ab056`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:06.941233 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 1999/4034] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:13:06 2022] PUT /identity/v3/projects/a927eaf3d2da468480235dd4a065cdf6/users/40cbbd03a54c452a95fb84bc891bdfbb/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:06.942214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c0240-9054-46c7-b62a-56f74d3b8d12 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:06.945165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8ca4fcb5-da69-4bca-b74b-6e0b54da5c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:06.952742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:07.029838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c0240-9054-46c7-b62a-56f74d3b8d12 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:07.036006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27656aa8-81bd-4db6-a186-dab868f039a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:07.036916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27656aa8-81bd-4db6-a186-dab868f039a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:07.037263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27656aa8-81bd-4db6-a186-dab868f039a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:07.037693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27656aa8-81bd-4db6-a186-dab868f039a5 admin admin] PATH_INFO: `/v3/projects/40591bf3c1f84e09923f58cdfb142fb4/users/8d4ba4991979468bac74996b6b9d7f62/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:07.054719 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2036/4035] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:07.054719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39c102-648f-4410-be08-4f7ae077bfb8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:07.054719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39c102-648f-4410-be08-4f7ae077bfb8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:07.054719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39c102-648f-4410-be08-4f7ae077bfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:07.057351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27656aa8-81bd-4db6-a186-dab868f039a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40591bf3c1f84e09923f58cdfb142fb4, user_id=8d4ba4991979468bac74996b6b9d7f62, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:07.060151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27656aa8-81bd-4db6-a186-dab868f039a5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:07.073897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5a39c102-648f-4410-be08-4f7ae077bfb8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:07.076027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5a39c102-648f-4410-be08-4f7ae077bfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:07.088979 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2000/4036] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:13:06 2022] PUT /identity/v3/projects/40591bf3c1f84e09923f58cdfb142fb4/users/8d4ba4991979468bac74996b6b9d7f62/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:07.088979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27656aa8-81bd-4db6-a186-dab868f039a5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:07.090090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-27656aa8-81bd-4db6-a186-dab868f039a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:07.104461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:07.151867 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2037/4037] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:07.152822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39c102-648f-4410-be08-4f7ae077bfb8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:07.163588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27656aa8-81bd-4db6-a186-dab868f039a5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:07.163816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39c102-648f-4410-be08-4f7ae077bfb8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:07.169104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfdbce-62bf-4c9a-ac7f-b9bf3ea4e2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:07.169340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c8b4d-c203-4637-89d3-e3ff5d948611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:07.169941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfdbce-62bf-4c9a-ac7f-b9bf3ea4e2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:07.170062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c8b4d-c203-4637-89d3-e3ff5d948611 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:07.170263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c8b4d-c203-4637-89d3-e3ff5d948611 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:07.170374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfdbce-62bf-4c9a-ac7f-b9bf3ea4e2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:07.170530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c8b4d-c203-4637-89d3-e3ff5d948611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:07.170759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfdbce-62bf-4c9a-ac7f-b9bf3ea4e2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:07.171603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfdbce-62bf-4c9a-ac7f-b9bf3ea4e2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:07.173356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfdbce-62bf-4c9a-ac7f-b9bf3ea4e2d1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:07.186461 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2038/4038] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:07.187723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfdbce-62bf-4c9a-ac7f-b9bf3ea4e2d1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:07.199109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfdbce-62bf-4c9a-ac7f-b9bf3ea4e2d1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:07.204867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04148adf-de73-4d8e-bcba-f5395e7986e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:07.205529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04148adf-de73-4d8e-bcba-f5395e7986e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:07.205879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04148adf-de73-4d8e-bcba-f5395e7986e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:07.206079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04148adf-de73-4d8e-bcba-f5395e7986e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:07.217007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04148adf-de73-4d8e-bcba-f5395e7986e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:07.218457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04148adf-de73-4d8e-bcba-f5395e7986e6 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:07.229361 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2039/4039] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:07.231859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04148adf-de73-4d8e-bcba-f5395e7986e6 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:07.246284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04148adf-de73-4d8e-bcba-f5395e7986e6 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:07.253158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbed50d-a8bb-41f3-b30c-e1ec5700935e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:07.254110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbed50d-a8bb-41f3-b30c-e1ec5700935e admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:07.254514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbed50d-a8bb-41f3-b30c-e1ec5700935e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:07.254821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbed50d-a8bb-41f3-b30c-e1ec5700935e admin admin] PATH_INFO: `/v3/projects/40591bf3c1f84e09923f58cdfb142fb4/users/8d4ba4991979468bac74996b6b9d7f62/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:07.260370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbed50d-a8bb-41f3-b30c-e1ec5700935e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40591bf3c1f84e09923f58cdfb142fb4, user_id=8d4ba4991979468bac74996b6b9d7f62, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:07.261726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c8b4d-c203-4637-89d3-e3ff5d948611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:07.263697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c8b4d-c203-4637-89d3-e3ff5d948611 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:07.266461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbed50d-a8bb-41f3-b30c-e1ec5700935e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:07.282321 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2001/4040] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:07.292117 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2040/4041] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:13:07 2022] PUT /identity/v3/projects/40591bf3c1f84e09923f58cdfb142fb4/users/8d4ba4991979468bac74996b6b9d7f62/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:07.294532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c671d-83c8-4ab3-a5fb-41e62f26c424 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:07.294826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c671d-83c8-4ab3-a5fb-41e62f26c424 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:07.295142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c671d-83c8-4ab3-a5fb-41e62f26c424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:07.343577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-635c671d-83c8-4ab3-a5fb-41e62f26c424 None None] MFA Rules not processed for user `8d4ba4991979468bac74996b6b9d7f62`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:07.345497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-635c671d-83c8-4ab3-a5fb-41e62f26c424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:07.377852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:07.445834 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2002/4042] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:07.451583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dec05-9044-4a68-a5e0-349c853db4e8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:07.451886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dec05-9044-4a68-a5e0-349c853db4e8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:07.453401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dec05-9044-4a68-a5e0-349c853db4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:07.519165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1e6dec05-9044-4a68-a5e0-349c853db4e8 None None] MFA Rules not processed for user `19fe81e09ba144b393a3809b89c6f8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:07.523619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1e6dec05-9044-4a68-a5e0-349c853db4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:07.601162 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2041/4043] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:13:07.914480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c671d-83c8-4ab3-a5fb-41e62f26c424 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:07.915949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-635c671d-83c8-4ab3-a5fb-41e62f26c424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:08.073693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c671d-83c8-4ab3-a5fb-41e62f26c424 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:08.081115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b8c85-9d81-44eb-8c97-c2b5be5162da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:08.082085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8c85-9d81-44eb-8c97-c2b5be5162da service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:08.082525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8c85-9d81-44eb-8c97-c2b5be5162da service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:08.082951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8c85-9d81-44eb-8c97-c2b5be5162da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:08.105325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b8c85-9d81-44eb-8c97-c2b5be5162da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:08.106871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b8c85-9d81-44eb-8c97-c2b5be5162da service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:08.130681 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2003/4044] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:13.401296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dec05-9044-4a68-a5e0-349c853db4e8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:13.519751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dec05-9044-4a68-a5e0-349c853db4e8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:13.529204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee6b28-1d22-4010-8b67-0f9166ff73e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:13.532080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee6b28-1d22-4010-8b67-0f9166ff73e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:13.532080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee6b28-1d22-4010-8b67-0f9166ff73e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:13.532080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee6b28-1d22-4010-8b67-0f9166ff73e7 admin admin] PATH_INFO: `/v3/users/cd4b666d8dc24db78d7906380b5ffef5` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:13.532695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee6b28-1d22-4010-8b67-0f9166ff73e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd4b666d8dc24db78d7906380b5ffef5)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:13.535522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee6b28-1d22-4010-8b67-0f9166ff73e7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:13.603643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:13.618917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-daee6b28-1d22-4010-8b67-0f9166ff73e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd4b666d8dc24db78d7906380b5ffef5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:13.628514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-daee6b28-1d22-4010-8b67-0f9166ff73e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd4b666d8dc24db78d7906380b5ffef5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:13.629666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-daee6b28-1d22-4010-8b67-0f9166ff73e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd4b666d8dc24db78d7906380b5ffef5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:13.630019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-daee6b28-1d22-4010-8b67-0f9166ff73e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd4b666d8dc24db78d7906380b5ffef5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:13.647591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-daee6b28-1d22-4010-8b67-0f9166ff73e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd4b666d8dc24db78d7906380b5ffef5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:13.675454 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2042/4045] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:13:13 2022] DELETE /identity/v3/users/cd4b666d8dc24db78d7906380b5ffef5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:13.680222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef347a9-b247-4f4d-b8d6-83bb96eb4c4a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:13.680728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef347a9-b247-4f4d-b8d6-83bb96eb4c4a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:13.680843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef347a9-b247-4f4d-b8d6-83bb96eb4c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:13.699294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-7ef347a9-b247-4f4d-b8d6-83bb96eb4c4a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:13.700618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7ef347a9-b247-4f4d-b8d6-83bb96eb4c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:13.759950 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2004/4046] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:13.769733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee6b28-1d22-4010-8b67-0f9166ff73e7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:13.771379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-daee6b28-1d22-4010-8b67-0f9166ff73e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:13.829536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee6b28-1d22-4010-8b67-0f9166ff73e7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:13.833326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af842b-7cac-4fd3-8df4-d75b315650a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:13.834067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af842b-7cac-4fd3-8df4-d75b315650a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:13.834343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af842b-7cac-4fd3-8df4-d75b315650a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:13.834613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af842b-7cac-4fd3-8df4-d75b315650a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:13.855082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af842b-7cac-4fd3-8df4-d75b315650a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:13.856965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af842b-7cac-4fd3-8df4-d75b315650a6 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:13.867655 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2043/4047] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:14.172187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef347a9-b247-4f4d-b8d6-83bb96eb4c4a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:14.175481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7ef347a9-b247-4f4d-b8d6-83bb96eb4c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:14.194259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef347a9-b247-4f4d-b8d6-83bb96eb4c4a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:14.200102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799f96d-dc06-423a-9361-61d6e6c34f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:14.201897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799f96d-dc06-423a-9361-61d6e6c34f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:14.202213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799f96d-dc06-423a-9361-61d6e6c34f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:14.202489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799f96d-dc06-423a-9361-61d6e6c34f83 admin admin] PATH_INFO: `/v3/projects/cb2c1b60ff044961a421fa18a22bceb5` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:14.204302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799f96d-dc06-423a-9361-61d6e6c34f83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb2c1b60ff044961a421fa18a22bceb5)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:14.206448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799f96d-dc06-423a-9361-61d6e6c34f83 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:14.269224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:14.276429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b799f96d-dc06-423a-9361-61d6e6c34f83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb2c1b60ff044961a421fa18a22bceb5', 'request_id': 'req-b799f96d-dc06-423a-9361-61d6e6c34f83'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:14.286041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b799f96d-dc06-423a-9361-61d6e6c34f83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb2c1b60ff044961a421fa18a22bceb5', 'request_id': 'req-b799f96d-dc06-423a-9361-61d6e6c34f83'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:14.294722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b799f96d-dc06-423a-9361-61d6e6c34f83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb2c1b60ff044961a421fa18a22bceb5', 'request_id': 'req-b799f96d-dc06-423a-9361-61d6e6c34f83'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:14.312122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b799f96d-dc06-423a-9361-61d6e6c34f83 admin admin] The token cache is being invalidate because project cb2c1b60ff044961a421fa18a22bceb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:13:14.312122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b799f96d-dc06-423a-9361-61d6e6c34f83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:14.313073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b799f96d-dc06-423a-9361-61d6e6c34f83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:14.315123 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2005/4048] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:13:14 2022] DELETE /identity/v3/projects/cb2c1b60ff044961a421fa18a22bceb5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:14.319036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af842b-7cac-4fd3-8df4-d75b315650a6 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:14.330284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af842b-7cac-4fd3-8df4-d75b315650a6 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:14.394762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ade42d-d1b7-4cfe-b63a-d37cbe8352ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:14.395688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ade42d-d1b7-4cfe-b63a-d37cbe8352ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:14.396319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ade42d-d1b7-4cfe-b63a-d37cbe8352ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:14.396319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ade42d-d1b7-4cfe-b63a-d37cbe8352ca admin admin] PATH_INFO: `/v3/users/3a7bff017bf143308ff79947e41ab056` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:14.398019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ade42d-d1b7-4cfe-b63a-d37cbe8352ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a7bff017bf143308ff79947e41ab056)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:14.400453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ade42d-d1b7-4cfe-b63a-d37cbe8352ca admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:14.497956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-28ade42d-d1b7-4cfe-b63a-d37cbe8352ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a7bff017bf143308ff79947e41ab056'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:14.512490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-28ade42d-d1b7-4cfe-b63a-d37cbe8352ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a7bff017bf143308ff79947e41ab056'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:14.517758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-28ade42d-d1b7-4cfe-b63a-d37cbe8352ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a7bff017bf143308ff79947e41ab056'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:14.518995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-28ade42d-d1b7-4cfe-b63a-d37cbe8352ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a7bff017bf143308ff79947e41ab056'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:14.523633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:14.535474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-28ade42d-d1b7-4cfe-b63a-d37cbe8352ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a7bff017bf143308ff79947e41ab056'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:14.589452 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2044/4049] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:13:14 2022] DELETE /identity/v3/users/3a7bff017bf143308ff79947e41ab056 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:14.936283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799f96d-dc06-423a-9361-61d6e6c34f83 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:14.939271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b799f96d-dc06-423a-9361-61d6e6c34f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:14.955762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799f96d-dc06-423a-9361-61d6e6c34f83 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:14.999627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805ef39-7c83-4566-8a76-1bd826537b90 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:14.999923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805ef39-7c83-4566-8a76-1bd826537b90 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:15.000236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805ef39-7c83-4566-8a76-1bd826537b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:15.045813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9805ef39-7c83-4566-8a76-1bd826537b90 None None] MFA Rules not processed for user `419f3872408c4d8c9a2980d6397d0aea`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:15.047301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9805ef39-7c83-4566-8a76-1bd826537b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:15.138365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2cb1e-9531-49e1-90bf-cff8b9dfdd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:15.139838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2cb1e-9531-49e1-90bf-cff8b9dfdd92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:15.140398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2cb1e-9531-49e1-90bf-cff8b9dfdd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:15.140907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2cb1e-9531-49e1-90bf-cff8b9dfdd92 admin admin] PATH_INFO: `/v3/projects/661a8e05098b4f6f8e6fe0cbb0f933cb` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:15.142488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2cb1e-9531-49e1-90bf-cff8b9dfdd92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=661a8e05098b4f6f8e6fe0cbb0f933cb)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:15.144827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2cb1e-9531-49e1-90bf-cff8b9dfdd92 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:15.172812 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2045/4050] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:15.236476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-61b2cb1e-9531-49e1-90bf-cff8b9dfdd92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '661a8e05098b4f6f8e6fe0cbb0f933cb', 'request_id': 'req-61b2cb1e-9531-49e1-90bf-cff8b9dfdd92'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:15.247008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-61b2cb1e-9531-49e1-90bf-cff8b9dfdd92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '661a8e05098b4f6f8e6fe0cbb0f933cb', 'request_id': 'req-61b2cb1e-9531-49e1-90bf-cff8b9dfdd92'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:15.257016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-61b2cb1e-9531-49e1-90bf-cff8b9dfdd92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '661a8e05098b4f6f8e6fe0cbb0f933cb', 'request_id': 'req-61b2cb1e-9531-49e1-90bf-cff8b9dfdd92'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:15.280395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-61b2cb1e-9531-49e1-90bf-cff8b9dfdd92 admin admin] The token cache is being invalidate because project 661a8e05098b4f6f8e6fe0cbb0f933cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:13:15.280834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-61b2cb1e-9531-49e1-90bf-cff8b9dfdd92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:15.281735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-61b2cb1e-9531-49e1-90bf-cff8b9dfdd92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:15.284179 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2006/4051] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:13:14 2022] DELETE /identity/v3/projects/661a8e05098b4f6f8e6fe0cbb0f933cb => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:15.288858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91cb66-f328-4186-a241-0075f066c7ec None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:15.289274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91cb66-f328-4186-a241-0075f066c7ec None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:15.289744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91cb66-f328-4186-a241-0075f066c7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:15.315965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fd91cb66-f328-4186-a241-0075f066c7ec None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:15.317298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fd91cb66-f328-4186-a241-0075f066c7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:15.425187 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2046/4052] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:13:15.433139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81336b92-7358-4f40-8502-8bee0f65a7d1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:15.433617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81336b92-7358-4f40-8502-8bee0f65a7d1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:15.433925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81336b92-7358-4f40-8502-8bee0f65a7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:15.491909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-81336b92-7358-4f40-8502-8bee0f65a7d1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:15.493206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-81336b92-7358-4f40-8502-8bee0f65a7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:15.516937 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2007/4053] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:15.521323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91cb66-f328-4186-a241-0075f066c7ec None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:15.533905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91cb66-f328-4186-a241-0075f066c7ec None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:15.539665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87bc4f-c901-4369-8421-96bcaddebaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:15.540639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87bc4f-c901-4369-8421-96bcaddebaaa admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:15.541123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87bc4f-c901-4369-8421-96bcaddebaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:15.541577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87bc4f-c901-4369-8421-96bcaddebaaa admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:15.542623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87bc4f-c901-4369-8421-96bcaddebaaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:13:15.543155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87bc4f-c901-4369-8421-96bcaddebaaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:15.544853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87bc4f-c901-4369-8421-96bcaddebaaa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:15.562972 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2047/4054] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:13:15.565167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81336b92-7358-4f40-8502-8bee0f65a7d1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:15.575560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81336b92-7358-4f40-8502-8bee0f65a7d1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:15.581627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bf8af-c4fa-47cc-9a2c-9172fee98a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:15.582311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bf8af-c4fa-47cc-9a2c-9172fee98a0f admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:15.582583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bf8af-c4fa-47cc-9a2c-9172fee98a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:15.582855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bf8af-c4fa-47cc-9a2c-9172fee98a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:15.583703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bf8af-c4fa-47cc-9a2c-9172fee98a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:15.586020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bf8af-c4fa-47cc-9a2c-9172fee98a0f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:15.624689 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2008/4055] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:13:15 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:15.625874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87bc4f-c901-4369-8421-96bcaddebaaa admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:15.644208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87bc4f-c901-4369-8421-96bcaddebaaa admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:15.742770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec3b63-25c5-4d45-ac83-513aa6d04a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:15.743821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec3b63-25c5-4d45-ac83-513aa6d04a37 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:15.744327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec3b63-25c5-4d45-ac83-513aa6d04a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:15.744749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec3b63-25c5-4d45-ac83-513aa6d04a37 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:15.745708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec3b63-25c5-4d45-ac83-513aa6d04a37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:15.747814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec3b63-25c5-4d45-ac83-513aa6d04a37 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:15.760551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:15.784351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bf8af-c4fa-47cc-9a2c-9172fee98a0f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:15.792339 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2048/4056] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:13:15 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:15.800778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bf8af-c4fa-47cc-9a2c-9172fee98a0f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:15.807148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15f85f-8f04-4ab3-a987-ee9e1ff78183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:15.808149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15f85f-8f04-4ab3-a987-ee9e1ff78183 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:15.808635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15f85f-8f04-4ab3-a987-ee9e1ff78183 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:15.809109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15f85f-8f04-4ab3-a987-ee9e1ff78183 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:15.810351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15f85f-8f04-4ab3-a987-ee9e1ff78183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:15.813687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15f85f-8f04-4ab3-a987-ee9e1ff78183 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:15.845081 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2009/4057] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:15.847741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec3b63-25c5-4d45-ac83-513aa6d04a37 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:15.864930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec3b63-25c5-4d45-ac83-513aa6d04a37 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:15.872776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a8ee0-598c-45ea-adbd-02f870e723cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:15.873740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a8ee0-598c-45ea-adbd-02f870e723cf admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:15.873942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a8ee0-598c-45ea-adbd-02f870e723cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:15.874268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a8ee0-598c-45ea-adbd-02f870e723cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:15.875002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a8ee0-598c-45ea-adbd-02f870e723cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:15.877086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a8ee0-598c-45ea-adbd-02f870e723cf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:15.895959 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2049/4058] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:15.896697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15f85f-8f04-4ab3-a987-ee9e1ff78183 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:15.909746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15f85f-8f04-4ab3-a987-ee9e1ff78183 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:15.921488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3cf49-ff72-4b8e-b94c-34cea97f5485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:15.922417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3cf49-ff72-4b8e-b94c-34cea97f5485 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:15.922702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3cf49-ff72-4b8e-b94c-34cea97f5485 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:15.923088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3cf49-ff72-4b8e-b94c-34cea97f5485 admin admin] PATH_INFO: `/v3/projects/d6d5b15406ec441a97789340a85ddb9b/users/c8262b9f4fae40869082cdb355b25a90/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:15.961107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3cf49-ff72-4b8e-b94c-34cea97f5485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d5b15406ec441a97789340a85ddb9b, user_id=c8262b9f4fae40869082cdb355b25a90, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:15.972320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3cf49-ff72-4b8e-b94c-34cea97f5485 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:15.989426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:16.015480 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2010/4059] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:13:15 2022] PUT /identity/v3/projects/d6d5b15406ec441a97789340a85ddb9b/users/c8262b9f4fae40869082cdb355b25a90/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:13:16.027557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69579a40-82ca-4b83-b0bc-d1d1cfdc7b34 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:16.027895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69579a40-82ca-4b83-b0bc-d1d1cfdc7b34 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:16.028341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69579a40-82ca-4b83-b0bc-d1d1cfdc7b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:16.106184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-69579a40-82ca-4b83-b0bc-d1d1cfdc7b34 None None] MFA Rules not processed for user `c8262b9f4fae40869082cdb355b25a90`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:16.108072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-69579a40-82ca-4b83-b0bc-d1d1cfdc7b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:16.271049 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2050/4060] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:16.294162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3cf49-ff72-4b8e-b94c-34cea97f5485 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:16.296202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ecd3cf49-ff72-4b8e-b94c-34cea97f5485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:16.435116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3cf49-ff72-4b8e-b94c-34cea97f5485 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:16.447854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0797c73-6a3a-40f8-8cef-81d59ab7d654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:16.448766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0797c73-6a3a-40f8-8cef-81d59ab7d654 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:16.449571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0797c73-6a3a-40f8-8cef-81d59ab7d654 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:16.456146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0797c73-6a3a-40f8-8cef-81d59ab7d654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:16.487574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0797c73-6a3a-40f8-8cef-81d59ab7d654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:16.505081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0797c73-6a3a-40f8-8cef-81d59ab7d654 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:16.562518 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2011/4061] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:16.649370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69579a40-82ca-4b83-b0bc-d1d1cfdc7b34 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:16.791589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69579a40-82ca-4b83-b0bc-d1d1cfdc7b34 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:16.801616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd6bed-50fb-42d9-afe4-97456231ae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:16.803734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd6bed-50fb-42d9-afe4-97456231ae00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:16.807254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd6bed-50fb-42d9-afe4-97456231ae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:16.807656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd6bed-50fb-42d9-afe4-97456231ae00 admin admin] PATH_INFO: `/v3/users/c8262b9f4fae40869082cdb355b25a90` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:16.811535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd6bed-50fb-42d9-afe4-97456231ae00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8262b9f4fae40869082cdb355b25a90)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:16.815081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd6bed-50fb-42d9-afe4-97456231ae00 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:16.922651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dbfd6bed-50fb-42d9-afe4-97456231ae00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8262b9f4fae40869082cdb355b25a90'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:16.939168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dbfd6bed-50fb-42d9-afe4-97456231ae00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8262b9f4fae40869082cdb355b25a90'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:16.940192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dbfd6bed-50fb-42d9-afe4-97456231ae00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8262b9f4fae40869082cdb355b25a90'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:16.940962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dbfd6bed-50fb-42d9-afe4-97456231ae00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8262b9f4fae40869082cdb355b25a90'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:16.957580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dbfd6bed-50fb-42d9-afe4-97456231ae00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8262b9f4fae40869082cdb355b25a90'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:16.992471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:17.013992 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2051/4062] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:13:16 2022] DELETE /identity/v3/users/c8262b9f4fae40869082cdb355b25a90 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:17.016407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f699ac-9405-4229-920d-22b74eea54f6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:17.016937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f699ac-9405-4229-920d-22b74eea54f6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:17.017530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f699ac-9405-4229-920d-22b74eea54f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:17.061062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e7f699ac-9405-4229-920d-22b74eea54f6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:17.064790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e7f699ac-9405-4229-920d-22b74eea54f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:17.219834 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2012/4063] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:17.266254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd6bed-50fb-42d9-afe4-97456231ae00 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:17.268007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dbfd6bed-50fb-42d9-afe4-97456231ae00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:17.451015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd6bed-50fb-42d9-afe4-97456231ae00 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:17.459620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e764e46-a1b4-4f94-b910-bdc1330e6b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:17.460336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e764e46-a1b4-4f94-b910-bdc1330e6b4c service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:17.460621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e764e46-a1b4-4f94-b910-bdc1330e6b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:17.460900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e764e46-a1b4-4f94-b910-bdc1330e6b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:17.486369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e764e46-a1b4-4f94-b910-bdc1330e6b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:17.488027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e764e46-a1b4-4f94-b910-bdc1330e6b4c service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:17.515158 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2052/4064] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:18.239007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b884590-8612-4d46-9f5c-dbb1f1f00120 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:18.240351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b884590-8612-4d46-9f5c-dbb1f1f00120 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:18.241366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b884590-8612-4d46-9f5c-dbb1f1f00120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:18.307332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8b884590-8612-4d46-9f5c-dbb1f1f00120 None None] MFA Rules not processed for user `40cbbd03a54c452a95fb84bc891bdfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:18.309169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8b884590-8612-4d46-9f5c-dbb1f1f00120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:18.455294 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2013/4065] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:18.479275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e764e46-a1b4-4f94-b910-bdc1330e6b4c service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:18.480789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8e764e46-a1b4-4f94-b910-bdc1330e6b4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:18.485838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b884590-8612-4d46-9f5c-dbb1f1f00120 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:18.487547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8b884590-8612-4d46-9f5c-dbb1f1f00120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:18.504027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e764e46-a1b4-4f94-b910-bdc1330e6b4c service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:18.511751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821f2a3-ed33-4ddc-afec-0e1629f61ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:18.513469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821f2a3-ed33-4ddc-afec-0e1629f61ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:18.513809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821f2a3-ed33-4ddc-afec-0e1629f61ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:18.514096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821f2a3-ed33-4ddc-afec-0e1629f61ac8 admin admin] PATH_INFO: `/v3/projects/d6d5b15406ec441a97789340a85ddb9b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:18.515344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821f2a3-ed33-4ddc-afec-0e1629f61ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6d5b15406ec441a97789340a85ddb9b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:18.518407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821f2a3-ed33-4ddc-afec-0e1629f61ac8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:18.586745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:18.614505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1821f2a3-ed33-4ddc-afec-0e1629f61ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6d5b15406ec441a97789340a85ddb9b', 'request_id': 'req-1821f2a3-ed33-4ddc-afec-0e1629f61ac8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:18.624999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1821f2a3-ed33-4ddc-afec-0e1629f61ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6d5b15406ec441a97789340a85ddb9b', 'request_id': 'req-1821f2a3-ed33-4ddc-afec-0e1629f61ac8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:18.633530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1821f2a3-ed33-4ddc-afec-0e1629f61ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6d5b15406ec441a97789340a85ddb9b', 'request_id': 'req-1821f2a3-ed33-4ddc-afec-0e1629f61ac8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:18.641546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b884590-8612-4d46-9f5c-dbb1f1f00120 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:18.648976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1821f2a3-ed33-4ddc-afec-0e1629f61ac8 admin admin] The token cache is being invalidate because project d6d5b15406ec441a97789340a85ddb9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:13:18.649581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1821f2a3-ed33-4ddc-afec-0e1629f61ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:18.650420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1821f2a3-ed33-4ddc-afec-0e1629f61ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:18.656879 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2053/4066] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:13:18 2022] DELETE /identity/v3/projects/d6d5b15406ec441a97789340a85ddb9b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:18.659632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006d72a-7df3-43b4-b339-8789646e4af7 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:18.661108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006d72a-7df3-43b4-b339-8789646e4af7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:18.661566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006d72a-7df3-43b4-b339-8789646e4af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:18.701496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d006d72a-7df3-43b4-b339-8789646e4af7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:18.702974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d006d72a-7df3-43b4-b339-8789646e4af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:18.754156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef16e0-c249-4295-a7d1-b602ebcbc0df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:18.754852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef16e0-c249-4295-a7d1-b602ebcbc0df service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:18.755117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef16e0-c249-4295-a7d1-b602ebcbc0df service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:18.755554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef16e0-c249-4295-a7d1-b602ebcbc0df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:18.761059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-59ef16e0-c249-4295-a7d1-b602ebcbc0df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:18.795883 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2054/4067] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:18.805625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e8867-b6b9-4d06-8746-96efc4d0a285 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:18.806016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e8867-b6b9-4d06-8746-96efc4d0a285 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:18.806389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e8867-b6b9-4d06-8746-96efc4d0a285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:18.830706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6a4e8867-b6b9-4d06-8746-96efc4d0a285 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:18.832504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6a4e8867-b6b9-4d06-8746-96efc4d0a285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:18.854511 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2055/4068] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:18.854675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef16e0-c249-4295-a7d1-b602ebcbc0df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:18.855630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e8867-b6b9-4d06-8746-96efc4d0a285 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:18.856816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef16e0-c249-4295-a7d1-b602ebcbc0df service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:18.866199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e8867-b6b9-4d06-8746-96efc4d0a285 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:18.868234 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2014/4069] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:13:18.871245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b1a1f-126b-436c-a93c-0144aa030c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:18.871909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b1a1f-126b-436c-a93c-0144aa030c1c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:18.872238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b1a1f-126b-436c-a93c-0144aa030c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:18.872514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b1a1f-126b-436c-a93c-0144aa030c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:18.873240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b1a1f-126b-436c-a93c-0144aa030c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:13:18.873543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b1a1f-126b-436c-a93c-0144aa030c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:18.875162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b1a1f-126b-436c-a93c-0144aa030c1c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:18.884659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:18.888885 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2056/4070] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:13:18.893479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef16e0-c249-4295-a7d1-b602ebcbc0df service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:18.905078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef16e0-c249-4295-a7d1-b602ebcbc0df service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:18.909510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f61a68-3e03-4666-bad1-48bdbcbb165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:18.910481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f61a68-3e03-4666-bad1-48bdbcbb165c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:18.910904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f61a68-3e03-4666-bad1-48bdbcbb165c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:18.911030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f61a68-3e03-4666-bad1-48bdbcbb165c admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:18.911788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f61a68-3e03-4666-bad1-48bdbcbb165c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:18.913897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f61a68-3e03-4666-bad1-48bdbcbb165c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:18.945520 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2015/4071] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:13:18 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:18.947126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b1a1f-126b-436c-a93c-0144aa030c1c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:18.963804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b1a1f-126b-436c-a93c-0144aa030c1c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:19.080539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0fd29-b73c-48f7-90f8-637b3b2be3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:19.081501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0fd29-b73c-48f7-90f8-637b3b2be3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:19.082005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0fd29-b73c-48f7-90f8-637b3b2be3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:19.082474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0fd29-b73c-48f7-90f8-637b3b2be3f5 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:19.084638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0fd29-b73c-48f7-90f8-637b3b2be3f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:19.087308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0fd29-b73c-48f7-90f8-637b3b2be3f5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:19.123738 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2057/4072] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:13:18 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:19.125299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f61a68-3e03-4666-bad1-48bdbcbb165c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:19.143351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f61a68-3e03-4666-bad1-48bdbcbb165c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:19.150118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53463f2c-4f06-46e8-984e-996b82b22d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:19.150922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53463f2c-4f06-46e8-984e-996b82b22d5f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:19.151289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53463f2c-4f06-46e8-984e-996b82b22d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:19.151648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53463f2c-4f06-46e8-984e-996b82b22d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:19.152504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53463f2c-4f06-46e8-984e-996b82b22d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:19.154244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53463f2c-4f06-46e8-984e-996b82b22d5f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:19.168197 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2016/4073] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:19.172354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0fd29-b73c-48f7-90f8-637b3b2be3f5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:19.184711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0fd29-b73c-48f7-90f8-637b3b2be3f5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:19.191835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8432364-9404-433b-91e9-a343d2e10c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:19.192843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8432364-9404-433b-91e9-a343d2e10c4f admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:19.193417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8432364-9404-433b-91e9-a343d2e10c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:19.193834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8432364-9404-433b-91e9-a343d2e10c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:19.194715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8432364-9404-433b-91e9-a343d2e10c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:19.197253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8432364-9404-433b-91e9-a343d2e10c4f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:19.212166 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2058/4074] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:19.216450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53463f2c-4f06-46e8-984e-996b82b22d5f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:19.230552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53463f2c-4f06-46e8-984e-996b82b22d5f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:19.242630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b37ef-7289-4beb-8991-e92e6e929184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:19.243796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b37ef-7289-4beb-8991-e92e6e929184 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:19.244173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b37ef-7289-4beb-8991-e92e6e929184 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:19.247389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b37ef-7289-4beb-8991-e92e6e929184 admin admin] PATH_INFO: `/v3/projects/e26cb2d066de4563beb1eb8fae144cb9/users/f6d66b833cf046f5b0db50a027dc35c7/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:19.264885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b37ef-7289-4beb-8991-e92e6e929184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26cb2d066de4563beb1eb8fae144cb9, user_id=f6d66b833cf046f5b0db50a027dc35c7, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:19.267832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b37ef-7289-4beb-8991-e92e6e929184 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:19.292071 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2017/4075] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:13:19 2022] PUT /identity/v3/projects/e26cb2d066de4563beb1eb8fae144cb9/users/f6d66b833cf046f5b0db50a027dc35c7/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:19.303067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffc777-48c3-45c0-973d-9c96dcdecd84 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:19.303381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffc777-48c3-45c0-973d-9c96dcdecd84 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:19.303638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffc777-48c3-45c0-973d-9c96dcdecd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:19.338555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-31ffc777-48c3-45c0-973d-9c96dcdecd84 None None] MFA Rules not processed for user `f6d66b833cf046f5b0db50a027dc35c7`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:19.339858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-31ffc777-48c3-45c0-973d-9c96dcdecd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:19.442932 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2059/4076] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:19.447834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b37ef-7289-4beb-8991-e92e6e929184 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:19.449697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-196b37ef-7289-4beb-8991-e92e6e929184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:19.464005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:19.525744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b37ef-7289-4beb-8991-e92e6e929184 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:19.531031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6146bbd-b33c-430f-a7d5-f35a2e88febe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:19.532371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6146bbd-b33c-430f-a7d5-f35a2e88febe service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:19.532849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6146bbd-b33c-430f-a7d5-f35a2e88febe service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:19.533184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6146bbd-b33c-430f-a7d5-f35a2e88febe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:19.546387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6146bbd-b33c-430f-a7d5-f35a2e88febe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:19.548004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6146bbd-b33c-430f-a7d5-f35a2e88febe service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:19.586154 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2018/4077] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:22.621612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da449f5-b16c-42ef-803b-241f20feafa6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:22.622633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da449f5-b16c-42ef-803b-241f20feafa6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:22.623191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da449f5-b16c-42ef-803b-241f20feafa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:22.683441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6da449f5-b16c-42ef-803b-241f20feafa6 None None] MFA Rules not processed for user `365ef707d87d4d5d818a7e9388c65fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:22.684928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6da449f5-b16c-42ef-803b-241f20feafa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:22.725641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6146bbd-b33c-430f-a7d5-f35a2e88febe service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:22.727230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d6146bbd-b33c-430f-a7d5-f35a2e88febe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:22.804655 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2060/4078] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:22.880904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6146bbd-b33c-430f-a7d5-f35a2e88febe service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:22.899977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb340a-82b5-44f0-aa30-ede8ed631022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:22.900691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb340a-82b5-44f0-aa30-ede8ed631022 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:22.900979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb340a-82b5-44f0-aa30-ede8ed631022 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:22.901485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb340a-82b5-44f0-aa30-ede8ed631022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:22.909129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-14fb340a-82b5-44f0-aa30-ede8ed631022 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:23.066223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb340a-82b5-44f0-aa30-ede8ed631022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:23.068031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb340a-82b5-44f0-aa30-ede8ed631022 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:23.120509 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2019/4079] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:23.233685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da449f5-b16c-42ef-803b-241f20feafa6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:23.251064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da449f5-b16c-42ef-803b-241f20feafa6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:23.266369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722090e3-b4bd-4558-bdc6-625e3d070275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:23.267622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722090e3-b4bd-4558-bdc6-625e3d070275 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:23.268804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722090e3-b4bd-4558-bdc6-625e3d070275 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:23.269154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722090e3-b4bd-4558-bdc6-625e3d070275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:23.280567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-722090e3-b4bd-4558-bdc6-625e3d070275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:23.309912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722090e3-b4bd-4558-bdc6-625e3d070275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:23.314355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722090e3-b4bd-4558-bdc6-625e3d070275 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:23.330197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:23.341109 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2061/4080] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:13:24.956826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0683e75-731f-45c3-9e31-ed80180f89d9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:24.957344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0683e75-731f-45c3-9e31-ed80180f89d9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:24.957450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0683e75-731f-45c3-9e31-ed80180f89d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:24.998318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c0683e75-731f-45c3-9e31-ed80180f89d9 None None] MFA Rules not processed for user `19fe81e09ba144b393a3809b89c6f8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:24.999889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c0683e75-731f-45c3-9e31-ed80180f89d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:25.123828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:25.160947 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2020/4081] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:35.141646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:38.773238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722090e3-b4bd-4558-bdc6-625e3d070275 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:38.776350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-722090e3-b4bd-4558-bdc6-625e3d070275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:38.958850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722090e3-b4bd-4558-bdc6-625e3d070275 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:38.962502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab73a4-fe3a-4acb-8cdc-55713d21342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:38.963429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab73a4-fe3a-4acb-8cdc-55713d21342c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:38.963709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab73a4-fe3a-4acb-8cdc-55713d21342c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:38.963988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab73a4-fe3a-4acb-8cdc-55713d21342c admin admin] PATH_INFO: `/v3/users/70f29fd685a149ea85207f47fcbb59d1` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:38.965225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab73a4-fe3a-4acb-8cdc-55713d21342c admin admin] RBAC: Authorizing `identity:delete_user(user_id=70f29fd685a149ea85207f47fcbb59d1)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:38.967219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab73a4-fe3a-4acb-8cdc-55713d21342c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:39.029854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2dab73a4-fe3a-4acb-8cdc-55713d21342c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70f29fd685a149ea85207f47fcbb59d1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:39.043443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2dab73a4-fe3a-4acb-8cdc-55713d21342c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70f29fd685a149ea85207f47fcbb59d1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:39.044543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2dab73a4-fe3a-4acb-8cdc-55713d21342c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70f29fd685a149ea85207f47fcbb59d1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:39.045445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2dab73a4-fe3a-4acb-8cdc-55713d21342c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70f29fd685a149ea85207f47fcbb59d1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:39.072029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2dab73a4-fe3a-4acb-8cdc-55713d21342c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70f29fd685a149ea85207f47fcbb59d1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:39.125082 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2062/4082] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:13:38 2022] DELETE /identity/v3/users/70f29fd685a149ea85207f47fcbb59d1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:39.166827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0683e75-731f-45c3-9e31-ed80180f89d9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:39.168489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c0683e75-731f-45c3-9e31-ed80180f89d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:39.275557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0683e75-731f-45c3-9e31-ed80180f89d9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:39.277189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab73a4-fe3a-4acb-8cdc-55713d21342c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:39.279423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2dab73a4-fe3a-4acb-8cdc-55713d21342c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:39.347837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bff4e2-1c21-458a-a801-9400152355ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:39.349532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bff4e2-1c21-458a-a801-9400152355ca service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:39.349980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bff4e2-1c21-458a-a801-9400152355ca service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:39.350437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bff4e2-1c21-458a-a801-9400152355ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:39.353347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-49bff4e2-1c21-458a-a801-9400152355ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:39.374558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bff4e2-1c21-458a-a801-9400152355ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:39.376259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bff4e2-1c21-458a-a801-9400152355ca service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:39.383009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab73a4-fe3a-4acb-8cdc-55713d21342c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:39.389215 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2021/4083] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:39.393470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1c9e6-325d-470a-ad54-0d93bf6be799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:39.394699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1c9e6-325d-470a-ad54-0d93bf6be799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:39.395173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1c9e6-325d-470a-ad54-0d93bf6be799 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:39.395709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1c9e6-325d-470a-ad54-0d93bf6be799 admin admin] PATH_INFO: `/v3/users/1412af7535c24b5fa139fd87431375ca` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:39.397209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1c9e6-325d-470a-ad54-0d93bf6be799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1412af7535c24b5fa139fd87431375ca)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:39.399988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1c9e6-325d-470a-ad54-0d93bf6be799 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:39.427856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:39.473416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-26c1c9e6-325d-470a-ad54-0d93bf6be799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1412af7535c24b5fa139fd87431375ca'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:39.493005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-26c1c9e6-325d-470a-ad54-0d93bf6be799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1412af7535c24b5fa139fd87431375ca'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:39.494081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-26c1c9e6-325d-470a-ad54-0d93bf6be799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1412af7535c24b5fa139fd87431375ca'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:39.494901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-26c1c9e6-325d-470a-ad54-0d93bf6be799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1412af7535c24b5fa139fd87431375ca'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:39.506263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-26c1c9e6-325d-470a-ad54-0d93bf6be799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1412af7535c24b5fa139fd87431375ca'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:39.529777 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2063/4084] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:13:39 2022] DELETE /identity/v3/users/1412af7535c24b5fa139fd87431375ca => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:39.855639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bff4e2-1c21-458a-a801-9400152355ca service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:39.857096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-49bff4e2-1c21-458a-a801-9400152355ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:39.889778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bff4e2-1c21-458a-a801-9400152355ca service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:40.040334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa913dcf-5518-46b9-b6b1-35cb28f95b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:40.041692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa913dcf-5518-46b9-b6b1-35cb28f95b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:40.042102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa913dcf-5518-46b9-b6b1-35cb28f95b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:40.042456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa913dcf-5518-46b9-b6b1-35cb28f95b1b admin admin] PATH_INFO: `/v3/projects/4874e0d6bff34bfc9e2672caafad9556` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:40.046285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa913dcf-5518-46b9-b6b1-35cb28f95b1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4874e0d6bff34bfc9e2672caafad9556)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:40.048702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa913dcf-5518-46b9-b6b1-35cb28f95b1b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:40.112761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:40.133473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa913dcf-5518-46b9-b6b1-35cb28f95b1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4874e0d6bff34bfc9e2672caafad9556', 'request_id': 'req-fa913dcf-5518-46b9-b6b1-35cb28f95b1b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:40.149917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa913dcf-5518-46b9-b6b1-35cb28f95b1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4874e0d6bff34bfc9e2672caafad9556', 'request_id': 'req-fa913dcf-5518-46b9-b6b1-35cb28f95b1b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:40.160783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa913dcf-5518-46b9-b6b1-35cb28f95b1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4874e0d6bff34bfc9e2672caafad9556', 'request_id': 'req-fa913dcf-5518-46b9-b6b1-35cb28f95b1b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:40.179819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa913dcf-5518-46b9-b6b1-35cb28f95b1b admin admin] The token cache is being invalidate because project 4874e0d6bff34bfc9e2672caafad9556 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:13:40.180568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa913dcf-5518-46b9-b6b1-35cb28f95b1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:40.182159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa913dcf-5518-46b9-b6b1-35cb28f95b1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:40.190671 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2022/4085] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:13:39 2022] DELETE /identity/v3/projects/4874e0d6bff34bfc9e2672caafad9556 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:40.192845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9a2f9-ca32-4711-b9d4-201e47dcc6fe None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:40.193335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9a2f9-ca32-4711-b9d4-201e47dcc6fe None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:40.193335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9a2f9-ca32-4711-b9d4-201e47dcc6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:40.197248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa913dcf-5518-46b9-b6b1-35cb28f95b1b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:40.200722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fa913dcf-5518-46b9-b6b1-35cb28f95b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:40.225966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-19c9a2f9-ca32-4711-b9d4-201e47dcc6fe None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:40.227540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-19c9a2f9-ca32-4711-b9d4-201e47dcc6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:40.324130 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2064/4086] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:40.331651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d13ba-9bbd-4aef-8272-dd8dcecd5dba None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:40.332699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d13ba-9bbd-4aef-8272-dd8dcecd5dba None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:40.333113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d13ba-9bbd-4aef-8272-dd8dcecd5dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:40.342559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa913dcf-5518-46b9-b6b1-35cb28f95b1b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:40.350151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e08543-f762-45be-b2f4-1c1fb8f88e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:40.351632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e08543-f762-45be-b2f4-1c1fb8f88e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:40.351916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e08543-f762-45be-b2f4-1c1fb8f88e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:40.352333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e08543-f762-45be-b2f4-1c1fb8f88e0d admin admin] PATH_INFO: `/v3/projects/116d106003e54750a7e57d37e6a8798a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:40.354125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e08543-f762-45be-b2f4-1c1fb8f88e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=116d106003e54750a7e57d37e6a8798a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:40.355548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e08543-f762-45be-b2f4-1c1fb8f88e0d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:40.372020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6e2d13ba-9bbd-4aef-8272-dd8dcecd5dba None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:40.373269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6e2d13ba-9bbd-4aef-8272-dd8dcecd5dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:40.396839 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2065/4087] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:40.397802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d13ba-9bbd-4aef-8272-dd8dcecd5dba None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:40.411539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d13ba-9bbd-4aef-8272-dd8dcecd5dba None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:40.428974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a62fa-ccce-433b-b34e-d33222a8bbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:40.428974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a62fa-ccce-433b-b34e-d33222a8bbc4 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:40.432454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a62fa-ccce-433b-b34e-d33222a8bbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:40.432871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a62fa-ccce-433b-b34e-d33222a8bbc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:40.433638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a62fa-ccce-433b-b34e-d33222a8bbc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:13:40.435042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a62fa-ccce-433b-b34e-d33222a8bbc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:40.437464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a62fa-ccce-433b-b34e-d33222a8bbc4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:40.446463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-18e08543-f762-45be-b2f4-1c1fb8f88e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '116d106003e54750a7e57d37e6a8798a', 'request_id': 'req-18e08543-f762-45be-b2f4-1c1fb8f88e0d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:40.455659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-18e08543-f762-45be-b2f4-1c1fb8f88e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '116d106003e54750a7e57d37e6a8798a', 'request_id': 'req-18e08543-f762-45be-b2f4-1c1fb8f88e0d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:40.463362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-18e08543-f762-45be-b2f4-1c1fb8f88e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '116d106003e54750a7e57d37e6a8798a', 'request_id': 'req-18e08543-f762-45be-b2f4-1c1fb8f88e0d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:40.467138 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2066/4088] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:13:40.473242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a62fa-ccce-433b-b34e-d33222a8bbc4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:40.484617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-18e08543-f762-45be-b2f4-1c1fb8f88e0d admin admin] The token cache is being invalidate because project 116d106003e54750a7e57d37e6a8798a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:13:40.484912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-18e08543-f762-45be-b2f4-1c1fb8f88e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:40.486127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-18e08543-f762-45be-b2f4-1c1fb8f88e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:40.492923 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2023/4089] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:13:40 2022] DELETE /identity/v3/projects/116d106003e54750a7e57d37e6a8798a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:40.507763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376a422-a48f-4670-9f65-a77582df1eac None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:40.508118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376a422-a48f-4670-9f65-a77582df1eac None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:40.508400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376a422-a48f-4670-9f65-a77582df1eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:40.510459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a62fa-ccce-433b-b34e-d33222a8bbc4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:40.563537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d376a422-a48f-4670-9f65-a77582df1eac None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:40.566283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d376a422-a48f-4670-9f65-a77582df1eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:40.643329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881093f0-8dce-43a4-84bb-d6c662a23e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:40.644219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881093f0-8dce-43a4-84bb-d6c662a23e7e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:40.647493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881093f0-8dce-43a4-84bb-d6c662a23e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:40.647493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881093f0-8dce-43a4-84bb-d6c662a23e7e admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:40.647493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881093f0-8dce-43a4-84bb-d6c662a23e7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:40.650911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881093f0-8dce-43a4-84bb-d6c662a23e7e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:40.697735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:40.738928 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2024/4090] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:40.741790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bff68-41b9-4769-a493-fbd1e5570162 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:40.742270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bff68-41b9-4769-a493-fbd1e5570162 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:40.742796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bff68-41b9-4769-a493-fbd1e5570162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:40.744650 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2067/4091] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:13:40 2022] POST /identity/v3/projects => generated 393 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:40.748801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881093f0-8dce-43a4-84bb-d6c662a23e7e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:40.752572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-881093f0-8dce-43a4-84bb-d6c662a23e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:40.768097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-792bff68-41b9-4769-a493-fbd1e5570162 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:40.769225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:40.769942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-792bff68-41b9-4769-a493-fbd1e5570162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:40.880207 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2025/4092] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:40.884103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bff68-41b9-4769-a493-fbd1e5570162 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:40.894455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881093f0-8dce-43a4-84bb-d6c662a23e7e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:40.896646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bff68-41b9-4769-a493-fbd1e5570162 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:40.899920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625952b2-bf95-44f3-b94f-ef5641dbaf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:40.900583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625952b2-bf95-44f3-b94f-ef5641dbaf3c admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:40.900827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625952b2-bf95-44f3-b94f-ef5641dbaf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:40.901053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625952b2-bf95-44f3-b94f-ef5641dbaf3c admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:40.901779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625952b2-bf95-44f3-b94f-ef5641dbaf3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:40.903941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625952b2-bf95-44f3-b94f-ef5641dbaf3c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:40.915984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a5a86-9751-499d-a160-25759b0cd78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:40.917287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a5a86-9751-499d-a160-25759b0cd78d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:40.918045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a5a86-9751-499d-a160-25759b0cd78d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:40.918389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a5a86-9751-499d-a160-25759b0cd78d admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:40.919355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a5a86-9751-499d-a160-25759b0cd78d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:13:40.919732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a5a86-9751-499d-a160-25759b0cd78d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:40.923489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a5a86-9751-499d-a160-25759b0cd78d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:40.932570 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2068/4093] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:13:40 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:40.936593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625952b2-bf95-44f3-b94f-ef5641dbaf3c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:40.945805 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2026/4094] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:13:40.950147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a5a86-9751-499d-a160-25759b0cd78d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:40.957274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625952b2-bf95-44f3-b94f-ef5641dbaf3c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:40.962313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a5a86-9751-499d-a160-25759b0cd78d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:40.966817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00952609-ea91-41f5-af98-a2374528a238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:40.967375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c13c0-d0c2-4603-a1d4-08535100be4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:40.967873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00952609-ea91-41f5-af98-a2374528a238 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:40.968019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c13c0-d0c2-4603-a1d4-08535100be4a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:40.968351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c13c0-d0c2-4603-a1d4-08535100be4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:40.968471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00952609-ea91-41f5-af98-a2374528a238 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:40.968629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c13c0-d0c2-4603-a1d4-08535100be4a admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:40.969331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c13c0-d0c2-4603-a1d4-08535100be4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:40.969449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00952609-ea91-41f5-af98-a2374528a238 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:40.970274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00952609-ea91-41f5-af98-a2374528a238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:40.971270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c13c0-d0c2-4603-a1d4-08535100be4a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:40.972439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00952609-ea91-41f5-af98-a2374528a238 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:40.989511 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2069/4095] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:13:40.990765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00952609-ea91-41f5-af98-a2374528a238 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:41.015749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00952609-ea91-41f5-af98-a2374528a238 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:41.021250 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2027/4096] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:13:40 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:13:41.022214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c13c0-d0c2-4603-a1d4-08535100be4a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:41.121979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c13c0-d0c2-4603-a1d4-08535100be4a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:41.127300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ba876-9314-4378-976d-e45d998efeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:41.128129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ba876-9314-4378-976d-e45d998efeb1 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:41.128511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ba876-9314-4378-976d-e45d998efeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:41.128993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ba876-9314-4378-976d-e45d998efeb1 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:41.129666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ba876-9314-4378-976d-e45d998efeb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:41.132113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ba876-9314-4378-976d-e45d998efeb1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:41.132399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cbfb4-dcf0-4af3-af53-3dd40c71bdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:41.133089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cbfb4-dcf0-4af3-af53-3dd40c71bdef admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:41.133375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cbfb4-dcf0-4af3-af53-3dd40c71bdef admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:41.133658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cbfb4-dcf0-4af3-af53-3dd40c71bdef admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:41.135029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cbfb4-dcf0-4af3-af53-3dd40c71bdef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:41.137745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cbfb4-dcf0-4af3-af53-3dd40c71bdef admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:41.153478 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2070/4097] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:41.158176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cbfb4-dcf0-4af3-af53-3dd40c71bdef admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:41.165330 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2028/4098] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:13:41 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:41.166396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ba876-9314-4378-976d-e45d998efeb1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:41.170200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cbfb4-dcf0-4af3-af53-3dd40c71bdef admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:41.176006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691a7f1-63c4-44e2-8090-76ca79754d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:41.176994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691a7f1-63c4-44e2-8090-76ca79754d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:41.177277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691a7f1-63c4-44e2-8090-76ca79754d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:41.177554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691a7f1-63c4-44e2-8090-76ca79754d51 admin admin] PATH_INFO: `/v3/projects/ae35822336ca48cd9f497419d0226268/users/da701099fee44f03824febc2034358fa/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:41.180137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ba876-9314-4378-976d-e45d998efeb1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:41.186886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1c0da-46a1-4d27-9751-0d7cc15d4883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:41.187661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1c0da-46a1-4d27-9751-0d7cc15d4883 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:41.188080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1c0da-46a1-4d27-9751-0d7cc15d4883 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:41.188398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1c0da-46a1-4d27-9751-0d7cc15d4883 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:41.189177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1c0da-46a1-4d27-9751-0d7cc15d4883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:41.191935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1c0da-46a1-4d27-9751-0d7cc15d4883 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:41.198115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691a7f1-63c4-44e2-8090-76ca79754d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae35822336ca48cd9f497419d0226268, user_id=da701099fee44f03824febc2034358fa, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:41.202012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691a7f1-63c4-44e2-8090-76ca79754d51 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:41.209037 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2029/4099] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:41.210724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1c0da-46a1-4d27-9751-0d7cc15d4883 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:41.229842 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2071/4100] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:13:41 2022] PUT /identity/v3/projects/ae35822336ca48cd9f497419d0226268/users/da701099fee44f03824febc2034358fa/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:41.235425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a49f2-784f-4639-934f-568cfbcd7452 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:41.236129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a49f2-784f-4639-934f-568cfbcd7452 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:41.236776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a49f2-784f-4639-934f-568cfbcd7452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:41.238502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1c0da-46a1-4d27-9751-0d7cc15d4883 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:41.313375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ed4a49f2-784f-4639-934f-568cfbcd7452 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:41.315008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ed4a49f2-784f-4639-934f-568cfbcd7452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:41.315550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:41.398049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdb3fc-ec14-44ff-98b2-a44bba0d7179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:41.398751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdb3fc-ec14-44ff-98b2-a44bba0d7179 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:41.399032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdb3fc-ec14-44ff-98b2-a44bba0d7179 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:41.399309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdb3fc-ec14-44ff-98b2-a44bba0d7179 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:41.400082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdb3fc-ec14-44ff-98b2-a44bba0d7179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:41.407691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdb3fc-ec14-44ff-98b2-a44bba0d7179 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:41.412081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:41.440544 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2072/4101] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:41.442622 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2030/4102] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:41.447369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a49f2-784f-4639-934f-568cfbcd7452 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:41.462009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdb3fc-ec14-44ff-98b2-a44bba0d7179 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:41.463999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c3bdb3fc-ec14-44ff-98b2-a44bba0d7179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:41.473639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a49f2-784f-4639-934f-568cfbcd7452 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:41.487744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1b44b-ac5e-4d1f-b3b1-62a726e7ae9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:41.488584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1b44b-ac5e-4d1f-b3b1-62a726e7ae9e admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:41.488874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1b44b-ac5e-4d1f-b3b1-62a726e7ae9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:41.489353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1b44b-ac5e-4d1f-b3b1-62a726e7ae9e admin admin] PATH_INFO: `/v3/projects/b7da173babe7403fa85f5aab929e3068/users/0f5b2e7e4efe478abdc85fc51fa064de/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:41.531682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1b44b-ac5e-4d1f-b3b1-62a726e7ae9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7da173babe7403fa85f5aab929e3068, user_id=0f5b2e7e4efe478abdc85fc51fa064de, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:41.541012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1b44b-ac5e-4d1f-b3b1-62a726e7ae9e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:41.570361 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2073/4103] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:13:41 2022] PUT /identity/v3/projects/b7da173babe7403fa85f5aab929e3068/users/0f5b2e7e4efe478abdc85fc51fa064de/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:41.571955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdb3fc-ec14-44ff-98b2-a44bba0d7179 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:41.578752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afb794-78a0-4856-abe8-fd39c3cd44ab None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:41.579046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afb794-78a0-4856-abe8-fd39c3cd44ab None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:41.579326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afb794-78a0-4856-abe8-fd39c3cd44ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:41.600896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-33afb794-78a0-4856-abe8-fd39c3cd44ab None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:41.602331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-33afb794-78a0-4856-abe8-fd39c3cd44ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:41.668280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdeac3c-a52b-41be-9ee9-9e2930572ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:41.668939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeac3c-a52b-41be-9ee9-9e2930572ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:41.669212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeac3c-a52b-41be-9ee9-9e2930572ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:41.669490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeac3c-a52b-41be-9ee9-9e2930572ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:41.697358 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2074/4104] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:41.709845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afb794-78a0-4856-abe8-fd39c3cd44ab None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:41.713552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-33afb794-78a0-4856-abe8-fd39c3cd44ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:41.737207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afb794-78a0-4856-abe8-fd39c3cd44ab None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:41.748487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85599a1a-22e6-4c51-adcf-a3558594522b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:41.749456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85599a1a-22e6-4c51-adcf-a3558594522b service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:41.751558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85599a1a-22e6-4c51-adcf-a3558594522b service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:41.752021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85599a1a-22e6-4c51-adcf-a3558594522b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:41.763552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85599a1a-22e6-4c51-adcf-a3558594522b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:41.765671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85599a1a-22e6-4c51-adcf-a3558594522b service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:41.793987 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2075/4105] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:41.802210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdeac3c-a52b-41be-9ee9-9e2930572ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:41.803769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdeac3c-a52b-41be-9ee9-9e2930572ab5 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:41.818371 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2031/4106] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:43.342121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85599a1a-22e6-4c51-adcf-a3558594522b service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:43.345708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-85599a1a-22e6-4c51-adcf-a3558594522b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:43.416199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85599a1a-22e6-4c51-adcf-a3558594522b service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:43.431226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fcd2b-d349-494d-a244-a95c9dc7b3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:43.435261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fcd2b-d349-494d-a244-a95c9dc7b3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:43.435261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fcd2b-d349-494d-a244-a95c9dc7b3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:43.435261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fcd2b-d349-494d-a244-a95c9dc7b3c0 admin admin] PATH_INFO: `/v3/users/f6d66b833cf046f5b0db50a027dc35c7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:43.435261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fcd2b-d349-494d-a244-a95c9dc7b3c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d66b833cf046f5b0db50a027dc35c7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:43.437230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fcd2b-d349-494d-a244-a95c9dc7b3c0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:43.530915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-923fcd2b-d349-494d-a244-a95c9dc7b3c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d66b833cf046f5b0db50a027dc35c7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:43.546186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-923fcd2b-d349-494d-a244-a95c9dc7b3c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d66b833cf046f5b0db50a027dc35c7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:43.548966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-923fcd2b-d349-494d-a244-a95c9dc7b3c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d66b833cf046f5b0db50a027dc35c7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:43.550507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-923fcd2b-d349-494d-a244-a95c9dc7b3c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d66b833cf046f5b0db50a027dc35c7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:43.563956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-923fcd2b-d349-494d-a244-a95c9dc7b3c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d66b833cf046f5b0db50a027dc35c7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:43.598991 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2076/4107] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:13:43 2022] DELETE /identity/v3/users/f6d66b833cf046f5b0db50a027dc35c7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:43.600904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeef0cc-16a3-427e-8b57-89345ade0fdc None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:43.601754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeef0cc-16a3-427e-8b57-89345ade0fdc None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:43.602209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeef0cc-16a3-427e-8b57-89345ade0fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:43.621597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-efeef0cc-16a3-427e-8b57-89345ade0fdc None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:43.623380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-efeef0cc-16a3-427e-8b57-89345ade0fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:43.664881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:43.697100 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2032/4108] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:13:43.752451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fcd2b-d349-494d-a244-a95c9dc7b3c0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:43.754171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-923fcd2b-d349-494d-a244-a95c9dc7b3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:43.800457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:43.839540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fcd2b-d349-494d-a244-a95c9dc7b3c0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:43.848940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1814f2-8d3b-4d32-ae5f-6a1fd0fb39fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:43.849761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1814f2-8d3b-4d32-ae5f-6a1fd0fb39fd service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:43.850177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1814f2-8d3b-4d32-ae5f-6a1fd0fb39fd service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:43.850594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1814f2-8d3b-4d32-ae5f-6a1fd0fb39fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:43.870394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1814f2-8d3b-4d32-ae5f-6a1fd0fb39fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:43.872188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1814f2-8d3b-4d32-ae5f-6a1fd0fb39fd service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:43.885781 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2077/4109] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:45.221232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeef0cc-16a3-427e-8b57-89345ade0fdc None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:45.223837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-efeef0cc-16a3-427e-8b57-89345ade0fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:45.242132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeef0cc-16a3-427e-8b57-89345ade0fdc None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:45.251431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17555361-f3f7-4645-b59e-d93f3a39e9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:45.254242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17555361-f3f7-4645-b59e-d93f3a39e9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:45.254789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17555361-f3f7-4645-b59e-d93f3a39e9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:45.255936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17555361-f3f7-4645-b59e-d93f3a39e9bf admin admin] PATH_INFO: `/v3/projects/e26cb2d066de4563beb1eb8fae144cb9` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:45.257527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17555361-f3f7-4645-b59e-d93f3a39e9bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26cb2d066de4563beb1eb8fae144cb9)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:45.260572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17555361-f3f7-4645-b59e-d93f3a39e9bf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:45.408399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-17555361-f3f7-4645-b59e-d93f3a39e9bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26cb2d066de4563beb1eb8fae144cb9', 'request_id': 'req-17555361-f3f7-4645-b59e-d93f3a39e9bf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:45.439080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-17555361-f3f7-4645-b59e-d93f3a39e9bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26cb2d066de4563beb1eb8fae144cb9', 'request_id': 'req-17555361-f3f7-4645-b59e-d93f3a39e9bf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:45.453960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-17555361-f3f7-4645-b59e-d93f3a39e9bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26cb2d066de4563beb1eb8fae144cb9', 'request_id': 'req-17555361-f3f7-4645-b59e-d93f3a39e9bf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:45.482787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-17555361-f3f7-4645-b59e-d93f3a39e9bf admin admin] The token cache is being invalidate because project e26cb2d066de4563beb1eb8fae144cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:13:45.483868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-17555361-f3f7-4645-b59e-d93f3a39e9bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:45.486122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-17555361-f3f7-4645-b59e-d93f3a39e9bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:45.490288 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2033/4110] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:13:45 2022] DELETE /identity/v3/projects/e26cb2d066de4563beb1eb8fae144cb9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:45.494886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0079ba-fffd-4670-8f0e-10c4717c8603 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:45.496193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0079ba-fffd-4670-8f0e-10c4717c8603 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:45.496610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0079ba-fffd-4670-8f0e-10c4717c8603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:45.542022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8c0079ba-fffd-4670-8f0e-10c4717c8603 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:45.544173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8c0079ba-fffd-4670-8f0e-10c4717c8603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:45.667293 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2078/4111] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:45.674771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b281260-dd43-416d-b4bb-ca851c6cd290 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:45.675129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b281260-dd43-416d-b4bb-ca851c6cd290 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:45.675320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b281260-dd43-416d-b4bb-ca851c6cd290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:45.701202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0b281260-dd43-416d-b4bb-ca851c6cd290 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:45.702687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0b281260-dd43-416d-b4bb-ca851c6cd290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:45.712574 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2034/4112] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:45.716952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0079ba-fffd-4670-8f0e-10c4717c8603 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:45.740604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0079ba-fffd-4670-8f0e-10c4717c8603 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:45.753267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d030808-d539-4296-b65e-00c16fda51d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:45.753958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d030808-d539-4296-b65e-00c16fda51d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:45.754243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d030808-d539-4296-b65e-00c16fda51d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:45.754521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d030808-d539-4296-b65e-00c16fda51d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:45.756151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d030808-d539-4296-b65e-00c16fda51d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:13:45.757513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d030808-d539-4296-b65e-00c16fda51d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:45.760096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d030808-d539-4296-b65e-00c16fda51d6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:45.778186 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2079/4113] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:13:45.782416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b281260-dd43-416d-b4bb-ca851c6cd290 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:45.792844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b281260-dd43-416d-b4bb-ca851c6cd290 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:45.799320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e74f3-1df7-4bd1-b568-2c3b7bcc7208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:45.799996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e74f3-1df7-4bd1-b568-2c3b7bcc7208 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:45.800326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e74f3-1df7-4bd1-b568-2c3b7bcc7208 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:45.800591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e74f3-1df7-4bd1-b568-2c3b7bcc7208 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:45.801304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e74f3-1df7-4bd1-b568-2c3b7bcc7208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:45.805708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e74f3-1df7-4bd1-b568-2c3b7bcc7208 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:45.845552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d030808-d539-4296-b65e-00c16fda51d6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:45.854060 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2035/4114] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:13:45 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:45.858449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d030808-d539-4296-b65e-00c16fda51d6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:45.988511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3ac9f-ca03-4532-bce9-ec8345b0e0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:45.989408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3ac9f-ca03-4532-bce9-ec8345b0e0be admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:45.989647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3ac9f-ca03-4532-bce9-ec8345b0e0be admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:45.989929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3ac9f-ca03-4532-bce9-ec8345b0e0be admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:45.990651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3ac9f-ca03-4532-bce9-ec8345b0e0be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:46.002291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3ac9f-ca03-4532-bce9-ec8345b0e0be admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:46.053107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e74f3-1df7-4bd1-b568-2c3b7bcc7208 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:46.061160 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2080/4115] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:13:45 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:13:46.070359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e74f3-1df7-4bd1-b568-2c3b7bcc7208 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:46.083229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5392eb1-5985-4bcd-bd0b-df5ac51e1541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:46.084192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5392eb1-5985-4bcd-bd0b-df5ac51e1541 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:46.084482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5392eb1-5985-4bcd-bd0b-df5ac51e1541 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:46.084759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5392eb1-5985-4bcd-bd0b-df5ac51e1541 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:46.097715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5392eb1-5985-4bcd-bd0b-df5ac51e1541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:46.100072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5392eb1-5985-4bcd-bd0b-df5ac51e1541 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:46.112583 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2036/4116] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:46.116837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3ac9f-ca03-4532-bce9-ec8345b0e0be admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:46.128390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3ac9f-ca03-4532-bce9-ec8345b0e0be admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:46.134359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710f3e4-88c8-41ec-9acb-fd8041a46ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:46.135326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710f3e4-88c8-41ec-9acb-fd8041a46ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:46.135613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710f3e4-88c8-41ec-9acb-fd8041a46ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:46.135895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710f3e4-88c8-41ec-9acb-fd8041a46ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:46.136682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710f3e4-88c8-41ec-9acb-fd8041a46ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:46.139100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710f3e4-88c8-41ec-9acb-fd8041a46ff4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:46.158342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5392eb1-5985-4bcd-bd0b-df5ac51e1541 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:46.159238 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2081/4117] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:46.172677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5392eb1-5985-4bcd-bd0b-df5ac51e1541 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:46.177364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0f02e-5ca6-4e77-a29f-d56ce0ff5df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:46.179754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0f02e-5ca6-4e77-a29f-d56ce0ff5df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:46.180056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0f02e-5ca6-4e77-a29f-d56ce0ff5df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:46.180919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0f02e-5ca6-4e77-a29f-d56ce0ff5df1 admin admin] PATH_INFO: `/v3/projects/1be3cd7248984862a1186b2286efe935/users/dbd25deaf48741b9888a6421d650916f/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:46.219612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0f02e-5ca6-4e77-a29f-d56ce0ff5df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be3cd7248984862a1186b2286efe935, user_id=dbd25deaf48741b9888a6421d650916f, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:46.223186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0f02e-5ca6-4e77-a29f-d56ce0ff5df1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:46.250249 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2037/4118] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:13:46 2022] PUT /identity/v3/projects/1be3cd7248984862a1186b2286efe935/users/dbd25deaf48741b9888a6421d650916f/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:46.253502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebe798-4eff-44c8-82d0-21bdcbb27d32 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:46.253835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebe798-4eff-44c8-82d0-21bdcbb27d32 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:46.254116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebe798-4eff-44c8-82d0-21bdcbb27d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:46.310869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-23ebe798-4eff-44c8-82d0-21bdcbb27d32 None None] MFA Rules not processed for user `dbd25deaf48741b9888a6421d650916f`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:46.311742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-23ebe798-4eff-44c8-82d0-21bdcbb27d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:46.406010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:46.481481 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2082/4119] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:46.521594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0f02e-5ca6-4e77-a29f-d56ce0ff5df1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:46.523750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-65b0f02e-5ca6-4e77-a29f-d56ce0ff5df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:46.661399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0f02e-5ca6-4e77-a29f-d56ce0ff5df1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:46.670535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c4ed2-0433-49d1-87cd-09d150e26c74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:46.671308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c4ed2-0433-49d1-87cd-09d150e26c74 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:46.672310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c4ed2-0433-49d1-87cd-09d150e26c74 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:46.672684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c4ed2-0433-49d1-87cd-09d150e26c74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:46.708995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c4ed2-0433-49d1-87cd-09d150e26c74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:46.710641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c4ed2-0433-49d1-87cd-09d150e26c74 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:46.746140 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2038/4120] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:47.784743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebe798-4eff-44c8-82d0-21bdcbb27d32 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:47.786760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-23ebe798-4eff-44c8-82d0-21bdcbb27d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:47.877515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebe798-4eff-44c8-82d0-21bdcbb27d32 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:47.884323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4aa31-2958-4419-b550-b385b3577870 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:47.885207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4aa31-2958-4419-b550-b385b3577870 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:47.885704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4aa31-2958-4419-b550-b385b3577870 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:47.886236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4aa31-2958-4419-b550-b385b3577870 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:47.889898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-28c4aa31-2958-4419-b550-b385b3577870 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:47.903220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4aa31-2958-4419-b550-b385b3577870 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:47.904935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4aa31-2958-4419-b550-b385b3577870 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:47.916768 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2083/4121] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:54.946986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c4ed2-0433-49d1-87cd-09d150e26c74 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:54.954383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:54.964266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c4ed2-0433-49d1-87cd-09d150e26c74 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:54.979425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a7552-a9fd-4b13-b940-c8f830085eff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:54.980577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a7552-a9fd-4b13-b940-c8f830085eff service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:54.981027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a7552-a9fd-4b13-b940-c8f830085eff service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:54.982984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a7552-a9fd-4b13-b940-c8f830085eff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:55.003335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1b8a7552-a9fd-4b13-b940-c8f830085eff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:55.033562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4aa31-2958-4419-b550-b385b3577870 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:55.036885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-28c4aa31-2958-4419-b550-b385b3577870 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:55.065409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a7552-a9fd-4b13-b940-c8f830085eff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:55.070544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a7552-a9fd-4b13-b940-c8f830085eff service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:55.100767 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2039/4122] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:55.214483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4aa31-2958-4419-b550-b385b3577870 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:55.236271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48525655-35c2-4861-93e2-a705bd638c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:55.240533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48525655-35c2-4861-93e2-a705bd638c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:55.241094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48525655-35c2-4861-93e2-a705bd638c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:55.241526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48525655-35c2-4861-93e2-a705bd638c14 admin admin] PATH_INFO: `/v3/users/40cbbd03a54c452a95fb84bc891bdfbb` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:55.243468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48525655-35c2-4861-93e2-a705bd638c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40cbbd03a54c452a95fb84bc891bdfbb)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:55.245720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48525655-35c2-4861-93e2-a705bd638c14 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:55.367850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-48525655-35c2-4861-93e2-a705bd638c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40cbbd03a54c452a95fb84bc891bdfbb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:55.391058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-48525655-35c2-4861-93e2-a705bd638c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40cbbd03a54c452a95fb84bc891bdfbb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:55.391745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-48525655-35c2-4861-93e2-a705bd638c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40cbbd03a54c452a95fb84bc891bdfbb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:55.392473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-48525655-35c2-4861-93e2-a705bd638c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40cbbd03a54c452a95fb84bc891bdfbb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:55.399132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:55.405429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-48525655-35c2-4861-93e2-a705bd638c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40cbbd03a54c452a95fb84bc891bdfbb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:55.447633 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2084/4123] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:13:55 2022] DELETE /identity/v3/users/40cbbd03a54c452a95fb84bc891bdfbb => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:55.483916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e26b0b-7db7-4799-9706-bc502d448298 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:55.484248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e26b0b-7db7-4799-9706-bc502d448298 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:55.484858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e26b0b-7db7-4799-9706-bc502d448298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:55.529341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-90e26b0b-7db7-4799-9706-bc502d448298 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:55.530857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-90e26b0b-7db7-4799-9706-bc502d448298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:55.666738 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2040/4124] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:13:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:55.701901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48525655-35c2-4861-93e2-a705bd638c14 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:55.704742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-48525655-35c2-4861-93e2-a705bd638c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:55.855865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48525655-35c2-4861-93e2-a705bd638c14 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:55.871820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a54acb-b191-466c-9d7a-e34974ec7f21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:55.873556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a54acb-b191-466c-9d7a-e34974ec7f21 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:55.873947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a54acb-b191-466c-9d7a-e34974ec7f21 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:55.874235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a54acb-b191-466c-9d7a-e34974ec7f21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:55.889826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a54acb-b191-466c-9d7a-e34974ec7f21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:55.893802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a54acb-b191-466c-9d7a-e34974ec7f21 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:55.909967 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2085/4125] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:13:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:13:56.400406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e26b0b-7db7-4799-9706-bc502d448298 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:56.401958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-90e26b0b-7db7-4799-9706-bc502d448298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:56.719311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e26b0b-7db7-4799-9706-bc502d448298 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:56.734337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891bb5e-8167-4219-bf2f-69043d932591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:56.735716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891bb5e-8167-4219-bf2f-69043d932591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:56.736337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891bb5e-8167-4219-bf2f-69043d932591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:56.736818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891bb5e-8167-4219-bf2f-69043d932591 admin admin] PATH_INFO: `/v3/projects/a927eaf3d2da468480235dd4a065cdf6` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:56.743756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891bb5e-8167-4219-bf2f-69043d932591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a927eaf3d2da468480235dd4a065cdf6)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:56.746229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891bb5e-8167-4219-bf2f-69043d932591 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:56.878178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c891bb5e-8167-4219-bf2f-69043d932591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a927eaf3d2da468480235dd4a065cdf6', 'request_id': 'req-c891bb5e-8167-4219-bf2f-69043d932591'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:56.900733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c891bb5e-8167-4219-bf2f-69043d932591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a927eaf3d2da468480235dd4a065cdf6', 'request_id': 'req-c891bb5e-8167-4219-bf2f-69043d932591'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:56.919056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c891bb5e-8167-4219-bf2f-69043d932591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a927eaf3d2da468480235dd4a065cdf6', 'request_id': 'req-c891bb5e-8167-4219-bf2f-69043d932591'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:56.950616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c891bb5e-8167-4219-bf2f-69043d932591 admin admin] The token cache is being invalidate because project a927eaf3d2da468480235dd4a065cdf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:13:56.951178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c891bb5e-8167-4219-bf2f-69043d932591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:56.952385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c891bb5e-8167-4219-bf2f-69043d932591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:56.954798 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2041/4126] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:13:56 2022] DELETE /identity/v3/projects/a927eaf3d2da468480235dd4a065cdf6 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:56.962829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7ef63-9653-4bc4-861f-f65480e391ad None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:56.963431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7ef63-9653-4bc4-861f-f65480e391ad None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:56.963431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7ef63-9653-4bc4-861f-f65480e391ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:57.017672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b9c7ef63-9653-4bc4-861f-f65480e391ad None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:57.024448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b9c7ef63-9653-4bc4-861f-f65480e391ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:57.328091 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2086/4127] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:57.330189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc288d-50bc-4a04-b87c-97f6b1da7870 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:57.330189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc288d-50bc-4a04-b87c-97f6b1da7870 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:57.330481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc288d-50bc-4a04-b87c-97f6b1da7870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:57.427670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c9fc288d-50bc-4a04-b87c-97f6b1da7870 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:57.428988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c9fc288d-50bc-4a04-b87c-97f6b1da7870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:57.487472 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2042/4128] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:57.492649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7ef63-9653-4bc4-861f-f65480e391ad None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:57.509344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7ef63-9653-4bc4-861f-f65480e391ad None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:57.529045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901e86b-5b67-4382-afdb-fcf3c8476e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:57.529756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901e86b-5b67-4382-afdb-fcf3c8476e2a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:57.530041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901e86b-5b67-4382-afdb-fcf3c8476e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:57.530321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901e86b-5b67-4382-afdb-fcf3c8476e2a admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:57.531068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901e86b-5b67-4382-afdb-fcf3c8476e2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:13:57.531368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901e86b-5b67-4382-afdb-fcf3c8476e2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:57.553141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901e86b-5b67-4382-afdb-fcf3c8476e2a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:57.617705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc288d-50bc-4a04-b87c-97f6b1da7870 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:57.619157 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2087/4129] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:13:57.634244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc288d-50bc-4a04-b87c-97f6b1da7870 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:57.654314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed633b-6e48-4f07-aff6-0c827d0bf433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:57.655523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed633b-6e48-4f07-aff6-0c827d0bf433 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:57.655830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed633b-6e48-4f07-aff6-0c827d0bf433 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:57.656115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed633b-6e48-4f07-aff6-0c827d0bf433 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:57.656852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed633b-6e48-4f07-aff6-0c827d0bf433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:57.663821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed633b-6e48-4f07-aff6-0c827d0bf433 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:57.708714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da936855-af33-472a-8ea9-13bfbda0d858 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:57.709090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da936855-af33-472a-8ea9-13bfbda0d858 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:57.709434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da936855-af33-472a-8ea9-13bfbda0d858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:57.719019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:57.753473 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2043/4130] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:13:57 2022] POST /identity/v3/projects => generated 405 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:57.757763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed633b-6e48-4f07-aff6-0c827d0bf433 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:57.819004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-da936855-af33-472a-8ea9-13bfbda0d858 None None] MFA Rules not processed for user `0f5b2e7e4efe478abdc85fc51fa064de`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:57.825355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-da936855-af33-472a-8ea9-13bfbda0d858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:57.950605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed633b-6e48-4f07-aff6-0c827d0bf433 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:57.964540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2c72b-6d52-4be2-89dd-2e3e9f435353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:57.964540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2c72b-6d52-4be2-89dd-2e3e9f435353 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:57.964897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2c72b-6d52-4be2-89dd-2e3e9f435353 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:57.965140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2c72b-6d52-4be2-89dd-2e3e9f435353 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:57.965930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2c72b-6d52-4be2-89dd-2e3e9f435353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:57.972207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2c72b-6d52-4be2-89dd-2e3e9f435353 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:58.016743 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2044/4131] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:13:57 2022] POST /identity/v3/users => generated 303 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:58.017928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2c72b-6d52-4be2-89dd-2e3e9f435353 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:58.023788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-11e2c72b-6d52-4be2-89dd-2e3e9f435353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:58.050792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:58.056812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2c72b-6d52-4be2-89dd-2e3e9f435353 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:58.083883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6540372-a673-4951-b4de-d476939be6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:58.084982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6540372-a673-4951-b4de-d476939be6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:58.085359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6540372-a673-4951-b4de-d476939be6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:58.086380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6540372-a673-4951-b4de-d476939be6bb admin admin] PATH_INFO: `/v3/users/19fe81e09ba144b393a3809b89c6f8d5` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:58.087254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6540372-a673-4951-b4de-d476939be6bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=19fe81e09ba144b393a3809b89c6f8d5)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:58.097842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6540372-a673-4951-b4de-d476939be6bb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:58.159746 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2088/4132] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:58.161131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da936855-af33-472a-8ea9-13bfbda0d858 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:58.200188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da936855-af33-472a-8ea9-13bfbda0d858 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:58.208776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c6540372-a673-4951-b4de-d476939be6bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19fe81e09ba144b393a3809b89c6f8d5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:58.225532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c6540372-a673-4951-b4de-d476939be6bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19fe81e09ba144b393a3809b89c6f8d5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:58.230143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c7aa8-b17e-415a-b431-bb92f01c1aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:58.230848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c7aa8-b17e-415a-b431-bb92f01c1aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:58.231134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c7aa8-b17e-415a-b431-bb92f01c1aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:58.231413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c7aa8-b17e-415a-b431-bb92f01c1aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:58.232287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c7aa8-b17e-415a-b431-bb92f01c1aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:58.235405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c7aa8-b17e-415a-b431-bb92f01c1aa7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:58.249823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c6540372-a673-4951-b4de-d476939be6bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19fe81e09ba144b393a3809b89c6f8d5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:58.251943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c6540372-a673-4951-b4de-d476939be6bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19fe81e09ba144b393a3809b89c6f8d5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:58.253715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c6540372-a673-4951-b4de-d476939be6bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19fe81e09ba144b393a3809b89c6f8d5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:13:58.261434 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2089/4133] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:58.262401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c7aa8-b17e-415a-b431-bb92f01c1aa7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:58.271091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a33c7aa8-b17e-415a-b431-bb92f01c1aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:58.303919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c7aa8-b17e-415a-b431-bb92f01c1aa7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:58.305628 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2045/4134] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:13:58 2022] DELETE /identity/v3/users/19fe81e09ba144b393a3809b89c6f8d5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:58.307469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6540372-a673-4951-b4de-d476939be6bb admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:58.312609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c6540372-a673-4951-b4de-d476939be6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:58.426863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:58.437466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6540372-a673-4951-b4de-d476939be6bb admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:58.453527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef44856-1b65-4d78-9584-9e16f0902e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:58.454947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef44856-1b65-4d78-9584-9e16f0902e2c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:58.457518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef44856-1b65-4d78-9584-9e16f0902e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:58.458043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef44856-1b65-4d78-9584-9e16f0902e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:58.460683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef44856-1b65-4d78-9584-9e16f0902e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:58.465188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef44856-1b65-4d78-9584-9e16f0902e2c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:58.477987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800a849-e463-44d6-9e78-c27e250599e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:58.478707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800a849-e463-44d6-9e78-c27e250599e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:58.478973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800a849-e463-44d6-9e78-c27e250599e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:58.479250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800a849-e463-44d6-9e78-c27e250599e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:58.479963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800a849-e463-44d6-9e78-c27e250599e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:58.484598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800a849-e463-44d6-9e78-c27e250599e2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:58.530252 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2090/4135] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:13:58 2022] POST /identity/v3/projects => generated 377 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:58.533580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db994687-6a60-4d19-8cee-892075a6aa86 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:58.533934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db994687-6a60-4d19-8cee-892075a6aa86 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:58.534222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db994687-6a60-4d19-8cee-892075a6aa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:58.561880 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2046/4136] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:58.562914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef44856-1b65-4d78-9584-9e16f0902e2c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:58.584417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-db994687-6a60-4d19-8cee-892075a6aa86 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:58.585697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-db994687-6a60-4d19-8cee-892075a6aa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:58.605250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef44856-1b65-4d78-9584-9e16f0902e2c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:58.743017 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2091/4137] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:58.743967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db994687-6a60-4d19-8cee-892075a6aa86 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:58.764959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e6ca9-8a08-489c-b6b5-c1be50252832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:58.766005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e6ca9-8a08-489c-b6b5-c1be50252832 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:58.766972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e6ca9-8a08-489c-b6b5-c1be50252832 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:58.767443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e6ca9-8a08-489c-b6b5-c1be50252832 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:58.767769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db994687-6a60-4d19-8cee-892075a6aa86 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:58.768651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e6ca9-8a08-489c-b6b5-c1be50252832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:58.771039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e6ca9-8a08-489c-b6b5-c1be50252832 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:58.798078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9981b-9a7e-4e36-b42b-29903e392f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:58.799121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9981b-9a7e-4e36-b42b-29903e392f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:58.799409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9981b-9a7e-4e36-b42b-29903e392f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:58.799689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9981b-9a7e-4e36-b42b-29903e392f25 admin admin] PATH_INFO: `/v3/projects/f6facae2ace740f68128a626ba49e42a/users/54460739a1234cad987fe9593d443afe/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:58.836533 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2047/4138] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:13:58 2022] POST /identity/v3/users => generated 295 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:13:58.836533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e6ca9-8a08-489c-b6b5-c1be50252832 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:58.843611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3a0e6ca9-8a08-489c-b6b5-c1be50252832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:58.853168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9981b-9a7e-4e36-b42b-29903e392f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6facae2ace740f68128a626ba49e42a, user_id=54460739a1234cad987fe9593d443afe, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:58.856118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9981b-9a7e-4e36-b42b-29903e392f25 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:58.903555 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2092/4139] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:13:58 2022] PUT /identity/v3/projects/f6facae2ace740f68128a626ba49e42a/users/54460739a1234cad987fe9593d443afe/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:58.904612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9981b-9a7e-4e36-b42b-29903e392f25 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:58.999097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:59.011735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e6ca9-8a08-489c-b6b5-c1be50252832 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:59.053661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9981b-9a7e-4e36-b42b-29903e392f25 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:59.072887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db05797-b700-49a5-a37d-75aead4d815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:59.073928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db05797-b700-49a5-a37d-75aead4d815c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:59.074368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db05797-b700-49a5-a37d-75aead4d815c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:59.074804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db05797-b700-49a5-a37d-75aead4d815c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:59.076196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db05797-b700-49a5-a37d-75aead4d815c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:59.078005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db05797-b700-49a5-a37d-75aead4d815c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:59.120124 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2093/4140] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:59.121718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef38ca9-1e80-40a2-b873-177caf9368c4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:59.122012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef38ca9-1e80-40a2-b873-177caf9368c4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:59.122295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef38ca9-1e80-40a2-b873-177caf9368c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:59.163704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268aec6-09b3-479f-a3dc-0b9132156fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:59.164738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268aec6-09b3-479f-a3dc-0b9132156fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:59.165135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268aec6-09b3-479f-a3dc-0b9132156fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:59.165642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268aec6-09b3-479f-a3dc-0b9132156fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:59.173072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2ef38ca9-1e80-40a2-b873-177caf9368c4 None None] MFA Rules not processed for user `da701099fee44f03824febc2034358fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:59.174393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2ef38ca9-1e80-40a2-b873-177caf9368c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:59.186613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268aec6-09b3-479f-a3dc-0b9132156fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:59.188777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268aec6-09b3-479f-a3dc-0b9132156fc0 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:59.215756 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2048/4141] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:59.221364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e12a2f-d7ac-4186-801c-f8ac3b65f1e9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:59.221829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e12a2f-d7ac-4186-801c-f8ac3b65f1e9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:59.222295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e12a2f-d7ac-4186-801c-f8ac3b65f1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:59.261199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-85e12a2f-d7ac-4186-801c-f8ac3b65f1e9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:59.261199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-85e12a2f-d7ac-4186-801c-f8ac3b65f1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:59.275197 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2049/4142] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:59.276740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e12a2f-d7ac-4186-801c-f8ac3b65f1e9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:59.296306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e12a2f-d7ac-4186-801c-f8ac3b65f1e9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:59.306462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60eb15-d7cf-4230-b399-c566a615de29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:59.308477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60eb15-d7cf-4230-b399-c566a615de29 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:59.309277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60eb15-d7cf-4230-b399-c566a615de29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:59.309781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60eb15-d7cf-4230-b399-c566a615de29 admin admin] PATH_INFO: `/v3/projects/eda7085d60394c79b9efc8b998c7cba1/users/7ba1811c5fc342fd931553bc3682d866/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:59.330076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60eb15-d7cf-4230-b399-c566a615de29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda7085d60394c79b9efc8b998c7cba1, user_id=7ba1811c5fc342fd931553bc3682d866, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:59.333991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60eb15-d7cf-4230-b399-c566a615de29 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:59.365649 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2094/4143] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:59.366853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef38ca9-1e80-40a2-b873-177caf9368c4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:59.370628 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2050/4144] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:13:59 2022] PUT /identity/v3/projects/eda7085d60394c79b9efc8b998c7cba1/users/7ba1811c5fc342fd931553bc3682d866/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:59.376434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60eb15-d7cf-4230-b399-c566a615de29 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:59.387980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef38ca9-1e80-40a2-b873-177caf9368c4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:59.428985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:59.505711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca674a-96ef-4ce9-8199-2cbcd1436e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:59.506283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca674a-96ef-4ce9-8199-2cbcd1436e28 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:59.506563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca674a-96ef-4ce9-8199-2cbcd1436e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:59.506839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca674a-96ef-4ce9-8199-2cbcd1436e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:59.556767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60eb15-d7cf-4230-b399-c566a615de29 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:59.568261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98797552-ef8c-49bf-b3da-0ffe4160e369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:59.568961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98797552-ef8c-49bf-b3da-0ffe4160e369 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:59.569239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98797552-ef8c-49bf-b3da-0ffe4160e369 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:59.571690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98797552-ef8c-49bf-b3da-0ffe4160e369 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:59.572871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98797552-ef8c-49bf-b3da-0ffe4160e369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:59.574524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98797552-ef8c-49bf-b3da-0ffe4160e369 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:59.606475 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2051/4145] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:13:59.610587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da80cf9-9387-44c8-b814-770987e9233b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:59.610887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da80cf9-9387-44c8-b814-770987e9233b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:59.611145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da80cf9-9387-44c8-b814-770987e9233b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:59.647792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca674a-96ef-4ce9-8199-2cbcd1436e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:59.649296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca674a-96ef-4ce9-8199-2cbcd1436e28 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:59.653236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5da80cf9-9387-44c8-b814-770987e9233b None None] MFA Rules not processed for user `da701099fee44f03824febc2034358fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:13:59.654483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5da80cf9-9387-44c8-b814-770987e9233b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:13:59.671642 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2095/4146] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:13:59.672563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca674a-96ef-4ce9-8199-2cbcd1436e28 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:59.695336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca674a-96ef-4ce9-8199-2cbcd1436e28 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:13:59.703344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179a6cd-3087-4ba9-8ed1-618aa059f36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:13:59.704380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179a6cd-3087-4ba9-8ed1-618aa059f36b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:13:59.704575 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179a6cd-3087-4ba9-8ed1-618aa059f36b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:13:59.704863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179a6cd-3087-4ba9-8ed1-618aa059f36b admin admin] PATH_INFO: `/v3/projects/eda7085d60394c79b9efc8b998c7cba1/users/7ba1811c5fc342fd931553bc3682d866/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:13:59.713100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179a6cd-3087-4ba9-8ed1-618aa059f36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda7085d60394c79b9efc8b998c7cba1, user_id=7ba1811c5fc342fd931553bc3682d866, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:13:59.715872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179a6cd-3087-4ba9-8ed1-618aa059f36b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:13:59.731925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:59.749003 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2096/4147] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:13:59 2022] PUT /identity/v3/projects/eda7085d60394c79b9efc8b998c7cba1/users/7ba1811c5fc342fd931553bc3682d866/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:13:59.823603 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2052/4148] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:13:59.835092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179a6cd-3087-4ba9-8ed1-618aa059f36b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:13:59.837041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7179a6cd-3087-4ba9-8ed1-618aa059f36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:00.036555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179a6cd-3087-4ba9-8ed1-618aa059f36b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:00.055265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fafe15-645b-4a93-9233-73fce372c43b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:00.056331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fafe15-645b-4a93-9233-73fce372c43b service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:00.056331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fafe15-645b-4a93-9233-73fce372c43b service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:00.056607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fafe15-645b-4a93-9233-73fce372c43b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:00.242764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fafe15-645b-4a93-9233-73fce372c43b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:00.244747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fafe15-645b-4a93-9233-73fce372c43b service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:00.277237 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2097/4149] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:13:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:14:00.487449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da80cf9-9387-44c8-b814-770987e9233b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:00.490052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5da80cf9-9387-44c8-b814-770987e9233b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:00.522675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da80cf9-9387-44c8-b814-770987e9233b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:00.681779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb3c7f-3611-4d13-b0e9-f0e4236c846a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:00.682743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb3c7f-3611-4d13-b0e9-f0e4236c846a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:00.683868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb3c7f-3611-4d13-b0e9-f0e4236c846a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:00.685305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb3c7f-3611-4d13-b0e9-f0e4236c846a admin admin] PATH_INFO: `/v3/projects/79a9f342331e41468cfbf45d04f8d623` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:00.687988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb3c7f-3611-4d13-b0e9-f0e4236c846a admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a9f342331e41468cfbf45d04f8d623)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:00.692158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb3c7f-3611-4d13-b0e9-f0e4236c846a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:00.827300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b6bb3c7f-3611-4d13-b0e9-f0e4236c846a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a9f342331e41468cfbf45d04f8d623', 'request_id': 'req-b6bb3c7f-3611-4d13-b0e9-f0e4236c846a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:00.851707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b6bb3c7f-3611-4d13-b0e9-f0e4236c846a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a9f342331e41468cfbf45d04f8d623', 'request_id': 'req-b6bb3c7f-3611-4d13-b0e9-f0e4236c846a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:00.854804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:00.878117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b6bb3c7f-3611-4d13-b0e9-f0e4236c846a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a9f342331e41468cfbf45d04f8d623', 'request_id': 'req-b6bb3c7f-3611-4d13-b0e9-f0e4236c846a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:00.915826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b6bb3c7f-3611-4d13-b0e9-f0e4236c846a admin admin] The token cache is being invalidate because project 79a9f342331e41468cfbf45d04f8d623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:14:00.916310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b6bb3c7f-3611-4d13-b0e9-f0e4236c846a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:00.917803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b6bb3c7f-3611-4d13-b0e9-f0e4236c846a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:00.921114 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2053/4150] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:14:00 2022] DELETE /identity/v3/projects/79a9f342331e41468cfbf45d04f8d623 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:00.926984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fafe15-645b-4a93-9233-73fce372c43b service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:00.956209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fafe15-645b-4a93-9233-73fce372c43b service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:01.121073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda2b6f-6fbc-499f-b3bd-88818e7da5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:01.122756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda2b6f-6fbc-499f-b3bd-88818e7da5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:01.123199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda2b6f-6fbc-499f-b3bd-88818e7da5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:01.124467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda2b6f-6fbc-499f-b3bd-88818e7da5ca admin admin] PATH_INFO: `/v3/users/8d4ba4991979468bac74996b6b9d7f62` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:01.128108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda2b6f-6fbc-499f-b3bd-88818e7da5ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d4ba4991979468bac74996b6b9d7f62)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:01.137042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda2b6f-6fbc-499f-b3bd-88818e7da5ca admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:01.307692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:01.327813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cdda2b6f-6fbc-499f-b3bd-88818e7da5ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d4ba4991979468bac74996b6b9d7f62'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:01.345455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cdda2b6f-6fbc-499f-b3bd-88818e7da5ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d4ba4991979468bac74996b6b9d7f62'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:01.346234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cdda2b6f-6fbc-499f-b3bd-88818e7da5ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d4ba4991979468bac74996b6b9d7f62'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:01.347209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cdda2b6f-6fbc-499f-b3bd-88818e7da5ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d4ba4991979468bac74996b6b9d7f62'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:01.373300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cdda2b6f-6fbc-499f-b3bd-88818e7da5ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d4ba4991979468bac74996b6b9d7f62'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:01.414120 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2098/4151] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:14:00 2022] DELETE /identity/v3/users/8d4ba4991979468bac74996b6b9d7f62 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:04.752142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb3c7f-3611-4d13-b0e9-f0e4236c846a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:04.753905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b6bb3c7f-3611-4d13-b0e9-f0e4236c846a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:04.834519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb3c7f-3611-4d13-b0e9-f0e4236c846a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:05.188990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3a06f-a368-450b-b1f1-59beacebfc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:05.190508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3a06f-a368-450b-b1f1-59beacebfc1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:05.191220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3a06f-a368-450b-b1f1-59beacebfc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:05.191220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3a06f-a368-450b-b1f1-59beacebfc1c admin admin] PATH_INFO: `/v3/projects/40591bf3c1f84e09923f58cdfb142fb4` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:05.193126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3a06f-a368-450b-b1f1-59beacebfc1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=40591bf3c1f84e09923f58cdfb142fb4)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:05.195358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3a06f-a368-450b-b1f1-59beacebfc1c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:05.316407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-44a3a06f-a368-450b-b1f1-59beacebfc1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40591bf3c1f84e09923f58cdfb142fb4', 'request_id': 'req-44a3a06f-a368-450b-b1f1-59beacebfc1c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:05.337293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-44a3a06f-a368-450b-b1f1-59beacebfc1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40591bf3c1f84e09923f58cdfb142fb4', 'request_id': 'req-44a3a06f-a368-450b-b1f1-59beacebfc1c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:05.379972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-44a3a06f-a368-450b-b1f1-59beacebfc1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40591bf3c1f84e09923f58cdfb142fb4', 'request_id': 'req-44a3a06f-a368-450b-b1f1-59beacebfc1c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:05.462368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-44a3a06f-a368-450b-b1f1-59beacebfc1c admin admin] The token cache is being invalidate because project 40591bf3c1f84e09923f58cdfb142fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:14:05.462673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-44a3a06f-a368-450b-b1f1-59beacebfc1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:05.464070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-44a3a06f-a368-450b-b1f1-59beacebfc1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:05.471171 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2054/4152] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:14:04 2022] DELETE /identity/v3/projects/40591bf3c1f84e09923f58cdfb142fb4 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:05.473087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387834e0-9bb6-4f71-afb7-9682f75e4b1e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:05.473556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387834e0-9bb6-4f71-afb7-9682f75e4b1e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:05.473663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387834e0-9bb6-4f71-afb7-9682f75e4b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:05.595190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-387834e0-9bb6-4f71-afb7-9682f75e4b1e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:05.609629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-387834e0-9bb6-4f71-afb7-9682f75e4b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:05.879701 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2099/4153] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:05.883034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cf0ac-8a47-4065-a4e7-6379360a4c24 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:05.883544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cf0ac-8a47-4065-a4e7-6379360a4c24 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:05.883764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cf0ac-8a47-4065-a4e7-6379360a4c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:05.938701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c09cf0ac-8a47-4065-a4e7-6379360a4c24 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:05.939971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c09cf0ac-8a47-4065-a4e7-6379360a4c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:05.988160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387834e0-9bb6-4f71-afb7-9682f75e4b1e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:06.000907 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2055/4154] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:06.003939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387834e0-9bb6-4f71-afb7-9682f75e4b1e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:06.047823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e3675-6cfd-4cfe-be9c-0848d8df741f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:06.052902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e3675-6cfd-4cfe-be9c-0848d8df741f admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:06.058951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e3675-6cfd-4cfe-be9c-0848d8df741f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:06.059251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e3675-6cfd-4cfe-be9c-0848d8df741f admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:06.060268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e3675-6cfd-4cfe-be9c-0848d8df741f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:14:06.065234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e3675-6cfd-4cfe-be9c-0848d8df741f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:06.067488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e3675-6cfd-4cfe-be9c-0848d8df741f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:06.120900 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2100/4155] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:14:06.126341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cf0ac-8a47-4065-a4e7-6379360a4c24 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:06.139897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cf0ac-8a47-4065-a4e7-6379360a4c24 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:06.162898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cef85-f56e-4368-85e4-8e90444ddadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:06.166305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cef85-f56e-4368-85e4-8e90444ddadf admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:06.169365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cef85-f56e-4368-85e4-8e90444ddadf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:06.169893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cef85-f56e-4368-85e4-8e90444ddadf admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:06.172961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cef85-f56e-4368-85e4-8e90444ddadf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:06.178208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cef85-f56e-4368-85e4-8e90444ddadf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:06.296876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e3675-6cfd-4cfe-be9c-0848d8df741f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:06.297821 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2056/4156] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:14:06 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:14:06.314315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e3675-6cfd-4cfe-be9c-0848d8df741f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:06.546988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f94a70-fe6e-4d10-a395-d5e25d2265ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:06.548561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f94a70-fe6e-4d10-a395-d5e25d2265ce admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:06.549075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f94a70-fe6e-4d10-a395-d5e25d2265ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:06.549562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f94a70-fe6e-4d10-a395-d5e25d2265ce admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:06.550506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f94a70-fe6e-4d10-a395-d5e25d2265ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:06.552874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f94a70-fe6e-4d10-a395-d5e25d2265ce admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:06.604415 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2101/4157] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:14:06 2022] POST /identity/v3/users => generated 287 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:14:06.608466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cef85-f56e-4368-85e4-8e90444ddadf admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:06.624382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cef85-f56e-4368-85e4-8e90444ddadf admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:06.646920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68ba55-a894-471e-9b1f-16953f73abab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:06.647436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68ba55-a894-471e-9b1f-16953f73abab admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:06.647719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68ba55-a894-471e-9b1f-16953f73abab admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:06.647996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68ba55-a894-471e-9b1f-16953f73abab admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:06.653738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68ba55-a894-471e-9b1f-16953f73abab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:06.655270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68ba55-a894-471e-9b1f-16953f73abab admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:06.710696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f94a70-fe6e-4d10-a395-d5e25d2265ce admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:06.711141 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2057/4158] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:14:06.725149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f94a70-fe6e-4d10-a395-d5e25d2265ce admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:06.744524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59120cbe-377c-4f5b-850e-8d480140fdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:06.745674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59120cbe-377c-4f5b-850e-8d480140fdbd admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:06.746191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59120cbe-377c-4f5b-850e-8d480140fdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:06.746831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59120cbe-377c-4f5b-850e-8d480140fdbd admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:06.748214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59120cbe-377c-4f5b-850e-8d480140fdbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:06.750150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59120cbe-377c-4f5b-850e-8d480140fdbd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:06.778182 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2102/4159] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:14:06.781058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68ba55-a894-471e-9b1f-16953f73abab admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:06.794551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68ba55-a894-471e-9b1f-16953f73abab admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:06.824904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b7ae0-89b5-46d0-ba45-7bb2ae49e094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:06.825920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b7ae0-89b5-46d0-ba45-7bb2ae49e094 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:06.826208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b7ae0-89b5-46d0-ba45-7bb2ae49e094 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:06.826486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b7ae0-89b5-46d0-ba45-7bb2ae49e094 admin admin] PATH_INFO: `/v3/projects/4a3573b91d3f463e92ef7aa2335812f7/users/b2c22799e7ec4abca28aacf4f8e7a573/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:06.914451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b7ae0-89b5-46d0-ba45-7bb2ae49e094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a3573b91d3f463e92ef7aa2335812f7, user_id=b2c22799e7ec4abca28aacf4f8e7a573, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:06.918724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b7ae0-89b5-46d0-ba45-7bb2ae49e094 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:06.964258 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2058/4160] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:14:06 2022] PUT /identity/v3/projects/4a3573b91d3f463e92ef7aa2335812f7/users/b2c22799e7ec4abca28aacf4f8e7a573/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:06.965910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c2b8e-f17d-4439-a065-1f336430c313 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:06.966310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c2b8e-f17d-4439-a065-1f336430c313 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:06.966709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c2b8e-f17d-4439-a065-1f336430c313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:07.041093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-731c2b8e-f17d-4439-a065-1f336430c313 None None] MFA Rules not processed for user `b2c22799e7ec4abca28aacf4f8e7a573`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:07.043101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-731c2b8e-f17d-4439-a065-1f336430c313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:07.064613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:07.263189 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2103/4161] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:07.267803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b7ae0-89b5-46d0-ba45-7bb2ae49e094 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:07.283656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:07.402805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b7ae0-89b5-46d0-ba45-7bb2ae49e094 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:07.415601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e730a-dc5e-4954-9cc2-8f759f51c7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:07.416316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e730a-dc5e-4954-9cc2-8f759f51c7c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:07.416596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e730a-dc5e-4954-9cc2-8f759f51c7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:07.416970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e730a-dc5e-4954-9cc2-8f759f51c7c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:07.417675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e730a-dc5e-4954-9cc2-8f759f51c7c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:07.419602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e730a-dc5e-4954-9cc2-8f759f51c7c1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:07.485571 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2059/4162] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:14:07 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:14:07.487146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c2b8e-f17d-4439-a065-1f336430c313 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:07.504820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c2b8e-f17d-4439-a065-1f336430c313 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:07.657214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69c4a7-c9c1-4dd9-9cb6-ef43e1aaae9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:07.658653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69c4a7-c9c1-4dd9-9cb6-ef43e1aaae9c admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:07.659105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69c4a7-c9c1-4dd9-9cb6-ef43e1aaae9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:07.659548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69c4a7-c9c1-4dd9-9cb6-ef43e1aaae9c admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:07.660538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69c4a7-c9c1-4dd9-9cb6-ef43e1aaae9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:07.662679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69c4a7-c9c1-4dd9-9cb6-ef43e1aaae9c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:07.719278 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2104/4163] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:14:07 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:14:07.722482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e730a-dc5e-4954-9cc2-8f759f51c7c1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:07.743964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e730a-dc5e-4954-9cc2-8f759f51c7c1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:07.761675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d3122-1212-40fe-b564-80b15e899767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:07.762583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d3122-1212-40fe-b564-80b15e899767 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:07.764976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d3122-1212-40fe-b564-80b15e899767 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:07.765267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d3122-1212-40fe-b564-80b15e899767 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:07.770111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d3122-1212-40fe-b564-80b15e899767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:07.781338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d3122-1212-40fe-b564-80b15e899767 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:07.831364 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2060/4164] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:14:07.834372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69c4a7-c9c1-4dd9-9cb6-ef43e1aaae9c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:07.858555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69c4a7-c9c1-4dd9-9cb6-ef43e1aaae9c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:07.883661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba6ff9-578c-4362-8600-8c701dbc2476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:07.896281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba6ff9-578c-4362-8600-8c701dbc2476 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:07.896707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba6ff9-578c-4362-8600-8c701dbc2476 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:07.901207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba6ff9-578c-4362-8600-8c701dbc2476 admin admin] PATH_INFO: `/v3/projects/83670234cf9a4b71970483fb216b568b/users/f2746cc1ce74452a990383a83d44c997/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:07.974660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba6ff9-578c-4362-8600-8c701dbc2476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83670234cf9a4b71970483fb216b568b, user_id=f2746cc1ce74452a990383a83d44c997, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:07.977854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba6ff9-578c-4362-8600-8c701dbc2476 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:08.009980 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2105/4165] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:14:07 2022] PUT /identity/v3/projects/83670234cf9a4b71970483fb216b568b/users/f2746cc1ce74452a990383a83d44c997/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:14:08.011345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d3122-1212-40fe-b564-80b15e899767 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:08.025828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d3122-1212-40fe-b564-80b15e899767 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:08.174036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412648ca-37cd-44d7-a726-6cdbb18c106b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:08.174909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412648ca-37cd-44d7-a726-6cdbb18c106b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:08.175284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412648ca-37cd-44d7-a726-6cdbb18c106b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:08.175645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412648ca-37cd-44d7-a726-6cdbb18c106b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:08.176929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412648ca-37cd-44d7-a726-6cdbb18c106b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:08.178773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412648ca-37cd-44d7-a726-6cdbb18c106b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:08.217887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba6ff9-578c-4362-8600-8c701dbc2476 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:08.220163 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2061/4166] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:14:08.235133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba6ff9-578c-4362-8600-8c701dbc2476 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:08.255012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18310882-1209-45ce-b452-4f00b56c5b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:08.255951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18310882-1209-45ce-b452-4f00b56c5b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:08.256333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18310882-1209-45ce-b452-4f00b56c5b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:08.256614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18310882-1209-45ce-b452-4f00b56c5b00 admin admin] PATH_INFO: `/v3/projects/83670234cf9a4b71970483fb216b568b/users/f2746cc1ce74452a990383a83d44c997/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:08.259805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18310882-1209-45ce-b452-4f00b56c5b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83670234cf9a4b71970483fb216b568b, user_id=f2746cc1ce74452a990383a83d44c997, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:08.261744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18310882-1209-45ce-b452-4f00b56c5b00 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:08.289507 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2106/4167] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:14:08 2022] PUT /identity/v3/projects/83670234cf9a4b71970483fb216b568b/users/f2746cc1ce74452a990383a83d44c997/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:14:08.299601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd06ed-7de1-498e-a1c6-8c20a6aa0e1a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:08.300301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd06ed-7de1-498e-a1c6-8c20a6aa0e1a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:08.300817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd06ed-7de1-498e-a1c6-8c20a6aa0e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:08.416499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-16cd06ed-7de1-498e-a1c6-8c20a6aa0e1a None None] MFA Rules not processed for user `f2746cc1ce74452a990383a83d44c997`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:08.419154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-16cd06ed-7de1-498e-a1c6-8c20a6aa0e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:08.711921 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2062/4168] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:08.719004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18310882-1209-45ce-b452-4f00b56c5b00 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:08.736152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18310882-1209-45ce-b452-4f00b56c5b00 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:08.759071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c757ee-e4fd-4ec6-8534-193e7320e1dc tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:08.761299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c757ee-e4fd-4ec6-8534-193e7320e1dc tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:08.763134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c757ee-e4fd-4ec6-8534-193e7320e1dc tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:08.765990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c757ee-e4fd-4ec6-8534-193e7320e1dc tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:08.767046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c757ee-e4fd-4ec6-8534-193e7320e1dc tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:14:08.770061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c757ee-e4fd-4ec6-8534-193e7320e1dc tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:08.774267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c757ee-e4fd-4ec6-8534-193e7320e1dc tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:08.840914 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2107/4169] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:14:08.845059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd06ed-7de1-498e-a1c6-8c20a6aa0e1a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:08.851750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:08.858366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd06ed-7de1-498e-a1c6-8c20a6aa0e1a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:08.871028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53e4bf-81aa-40dd-96cb-4b04b1819104 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:08.871963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53e4bf-81aa-40dd-96cb-4b04b1819104 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:08.872653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53e4bf-81aa-40dd-96cb-4b04b1819104 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:08.873319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53e4bf-81aa-40dd-96cb-4b04b1819104 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:08.875810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53e4bf-81aa-40dd-96cb-4b04b1819104 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:08.878017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53e4bf-81aa-40dd-96cb-4b04b1819104 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:08.950772 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2063/4170] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:14:08 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:14:08.955040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c757ee-e4fd-4ec6-8534-193e7320e1dc tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:08.976934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c757ee-e4fd-4ec6-8534-193e7320e1dc tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:09.110994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:09.149001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2979dc-7c7f-4f2a-af98-2f2468988852 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:09.149811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2979dc-7c7f-4f2a-af98-2f2468988852 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:09.150234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2979dc-7c7f-4f2a-af98-2f2468988852 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:09.150555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2979dc-7c7f-4f2a-af98-2f2468988852 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:09.151562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2979dc-7c7f-4f2a-af98-2f2468988852 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:14:09.151935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2979dc-7c7f-4f2a-af98-2f2468988852 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:09.153653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2979dc-7c7f-4f2a-af98-2f2468988852 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:09.189907 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2108/4171] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:14:09.704099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53e4bf-81aa-40dd-96cb-4b04b1819104 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:09.706092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6a53e4bf-81aa-40dd-96cb-4b04b1819104 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:09.843715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53e4bf-81aa-40dd-96cb-4b04b1819104 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:09.852828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a192e-20c1-4984-bd45-71a3fc31bef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:09.853879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a192e-20c1-4984-bd45-71a3fc31bef8 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:09.854459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a192e-20c1-4984-bd45-71a3fc31bef8 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:09.854920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a192e-20c1-4984-bd45-71a3fc31bef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:09.869222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a192e-20c1-4984-bd45-71a3fc31bef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:09.872881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a192e-20c1-4984-bd45-71a3fc31bef8 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:09.905676 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2064/4172] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:14:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:14:09.912339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032501b0-6dad-4f4a-ac79-524e38baaa60 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:09.912870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032501b0-6dad-4f4a-ac79-524e38baaa60 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:09.913305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032501b0-6dad-4f4a-ac79-524e38baaa60 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:09.915321 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2109/4173] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:14:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:14:09.922807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a192e-20c1-4984-bd45-71a3fc31bef8 service nova] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:14:09.939364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a192e-20c1-4984-bd45-71a3fc31bef8 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:09.953857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a192e-20c1-4984-bd45-71a3fc31bef8 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:09.961241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c5887-2d02-4acd-831f-fe558cc25b25 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:09.962406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c5887-2d02-4acd-831f-fe558cc25b25 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:09.962865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c5887-2d02-4acd-831f-fe558cc25b25 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:09.963344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c5887-2d02-4acd-831f-fe558cc25b25 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/projects/24ed1303fdf44bdba765b0adf987a5d1` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:09.964988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c5887-2d02-4acd-831f-fe558cc25b25 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:get_project(project_id=24ed1303fdf44bdba765b0adf987a5d1)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:09.970836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c5887-2d02-4acd-831f-fe558cc25b25 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:09.973307 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2065/4174] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:14:09 2022] GET /identity/v3/projects/24ed1303fdf44bdba765b0adf987a5d1 => generated 371 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:14:11.699231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4c62a-45f9-447e-a1f5-239ecfd2eb87 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:11.700547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4c62a-45f9-447e-a1f5-239ecfd2eb87 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:11.701046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4c62a-45f9-447e-a1f5-239ecfd2eb87 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:11.703896 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2110/4175] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:14:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:14:11.721179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c5887-2d02-4acd-831f-fe558cc25b25 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:14:11.743351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c5887-2d02-4acd-831f-fe558cc25b25 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:11.757599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c5887-2d02-4acd-831f-fe558cc25b25 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:11.763039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44024eb2-ba88-4aaa-b5af-4da45cdb28bb tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:11.764409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44024eb2-ba88-4aaa-b5af-4da45cdb28bb tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:11.764849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44024eb2-ba88-4aaa-b5af-4da45cdb28bb tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:11.765275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44024eb2-ba88-4aaa-b5af-4da45cdb28bb tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/projects/24ed1303fdf44bdba765b0adf987a5d1` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:11.768446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44024eb2-ba88-4aaa-b5af-4da45cdb28bb tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:get_project(project_id=24ed1303fdf44bdba765b0adf987a5d1)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:11.771675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44024eb2-ba88-4aaa-b5af-4da45cdb28bb tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:11.777052 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2066/4176] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:14:11 2022] GET /identity/v3/projects/24ed1303fdf44bdba765b0adf987a5d1 => generated 371 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:14:13.243577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69192552-495c-4c44-8a5b-b7228fb9f422 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:13.244208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69192552-495c-4c44-8a5b-b7228fb9f422 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:13.244384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69192552-495c-4c44-8a5b-b7228fb9f422 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:13.246782 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2111/4177] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:14:13.252387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44024eb2-ba88-4aaa-b5af-4da45cdb28bb tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:14:13.255057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-44024eb2-ba88-4aaa-b5af-4da45cdb28bb tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:13.290846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44024eb2-ba88-4aaa-b5af-4da45cdb28bb tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:13.310079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44024eb2-ba88-4aaa-b5af-4da45cdb28bb tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:13.318648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013285d-dc17-42e2-b56f-4813122afcba tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:13.321010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013285d-dc17-42e2-b56f-4813122afcba tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:13.321741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013285d-dc17-42e2-b56f-4813122afcba tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:13.322950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013285d-dc17-42e2-b56f-4813122afcba tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/projects/24ed1303fdf44bdba765b0adf987a5d1` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:13.332827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013285d-dc17-42e2-b56f-4813122afcba tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:get_project(project_id=24ed1303fdf44bdba765b0adf987a5d1)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:13.334949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013285d-dc17-42e2-b56f-4813122afcba tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:13.347825 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2067/4178] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:14:13 2022] GET /identity/v3/projects/24ed1303fdf44bdba765b0adf987a5d1 => generated 371 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:14:13.372917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69192552-495c-4c44-8a5b-b7228fb9f422 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:13.393062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69192552-495c-4c44-8a5b-b7228fb9f422 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:13.411263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:13.412692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:13.413270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:13.413757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/projects/24ed1303fdf44bdba765b0adf987a5d1` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:13.415415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:delete_project(project_id=24ed1303fdf44bdba765b0adf987a5d1)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:13.418545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:13.509280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24ed1303fdf44bdba765b0adf987a5d1', 'request_id': 'req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:13.528148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24ed1303fdf44bdba765b0adf987a5d1', 'request_id': 'req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:13.559911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24ed1303fdf44bdba765b0adf987a5d1', 'request_id': 'req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:13.590266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] The token cache is being invalidate because project 24ed1303fdf44bdba765b0adf987a5d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:14:13.592364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:13.593948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:13.600451 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2112/4179] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:14:13 2022] DELETE /identity/v3/projects/24ed1303fdf44bdba765b0adf987a5d1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:14.168965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f575739-6944-430d-86ef-b35a6d2ce95a None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:14.169885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f575739-6944-430d-86ef-b35a6d2ce95a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:14.170922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f575739-6944-430d-86ef-b35a6d2ce95a None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:14.172655 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2068/4180] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:14:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:14:14.191971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:14:14.195355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:14.470184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:14.472442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:14.618982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728ef14-9eb0-4b5f-9105-6f4e16341f5c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:14.645774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e148a1-8725-4f3f-9795-0cd2fa247f76 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:14.647977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e148a1-8725-4f3f-9795-0cd2fa247f76 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:14.648549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e148a1-8725-4f3f-9795-0cd2fa247f76 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:14.649079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e148a1-8725-4f3f-9795-0cd2fa247f76 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/projects/4a3573b91d3f463e92ef7aa2335812f7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:14.650510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e148a1-8725-4f3f-9795-0cd2fa247f76 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:get_project(project_id=4a3573b91d3f463e92ef7aa2335812f7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:14.652933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e148a1-8725-4f3f-9795-0cd2fa247f76 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:14.655240 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2113/4181] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:14:14 2022] GET /identity/v3/projects/4a3573b91d3f463e92ef7aa2335812f7 => generated 373 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:14:14.678215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f575739-6944-430d-86ef-b35a6d2ce95a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:14.711683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f575739-6944-430d-86ef-b35a6d2ce95a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:14.723080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cfe35-bfa4-4e5d-b9b7-cbd2c2dc479d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:14.723770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cfe35-bfa4-4e5d-b9b7-cbd2c2dc479d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:14.724069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cfe35-bfa4-4e5d-b9b7-cbd2c2dc479d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:14.724580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cfe35-bfa4-4e5d-b9b7-cbd2c2dc479d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:14.725250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cfe35-bfa4-4e5d-b9b7-cbd2c2dc479d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:14:14.725567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cfe35-bfa4-4e5d-b9b7-cbd2c2dc479d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:14.727197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cfe35-bfa4-4e5d-b9b7-cbd2c2dc479d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:14.759972 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2069/4182] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:14:14.761216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e148a1-8725-4f3f-9795-0cd2fa247f76 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:14.768531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:14.777111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e148a1-8725-4f3f-9795-0cd2fa247f76 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:14.802339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885b3ed-8542-4498-9c28-abd8abfb9dc5 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:14.803028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885b3ed-8542-4498-9c28-abd8abfb9dc5 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:14.803310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885b3ed-8542-4498-9c28-abd8abfb9dc5 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:14.803587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885b3ed-8542-4498-9c28-abd8abfb9dc5 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:14.804678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885b3ed-8542-4498-9c28-abd8abfb9dc5 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:14.837278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885b3ed-8542-4498-9c28-abd8abfb9dc5 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:14.955478 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2114/4183] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:14:14 2022] POST /identity/v3/projects => generated 371 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:14:14.959492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cfe35-bfa4-4e5d-b9b7-cbd2c2dc479d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:14.985122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cfe35-bfa4-4e5d-b9b7-cbd2c2dc479d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:15.225655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb60ff-1879-4f3f-8142-97f590bd8bf7 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:15.226643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb60ff-1879-4f3f-8142-97f590bd8bf7 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:15.231689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb60ff-1879-4f3f-8142-97f590bd8bf7 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:15.232257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb60ff-1879-4f3f-8142-97f590bd8bf7 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:15.233243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb60ff-1879-4f3f-8142-97f590bd8bf7 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:14:15.234614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb60ff-1879-4f3f-8142-97f590bd8bf7 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:15.236511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb60ff-1879-4f3f-8142-97f590bd8bf7 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:15.272191 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2070/4184] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:14:15.648617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79728152-7ff2-484a-a918-c659565ce4d0 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:15.649206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79728152-7ff2-484a-a918-c659565ce4d0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:15.649206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79728152-7ff2-484a-a918-c659565ce4d0 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:15.651040 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2115/4185] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:14:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:14:15.657468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb60ff-1879-4f3f-8142-97f590bd8bf7 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:14:15.761908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:15.878693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb60ff-1879-4f3f-8142-97f590bd8bf7 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:15.898634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb60ff-1879-4f3f-8142-97f590bd8bf7 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:15.908802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856d6f0-74b9-4dea-abd7-f7ba14db0a2c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:15.909988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856d6f0-74b9-4dea-abd7-f7ba14db0a2c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:15.912733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856d6f0-74b9-4dea-abd7-f7ba14db0a2c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:15.913260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856d6f0-74b9-4dea-abd7-f7ba14db0a2c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/projects/b22e8286030640d3ad067ac82d5d5624` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:15.916994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856d6f0-74b9-4dea-abd7-f7ba14db0a2c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:get_project(project_id=b22e8286030640d3ad067ac82d5d5624)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:15.923884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856d6f0-74b9-4dea-abd7-f7ba14db0a2c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:15.927618 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2071/4186] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:14:15 2022] GET /identity/v3/projects/b22e8286030640d3ad067ac82d5d5624 => generated 371 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:14:16.919127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a885e89-bde3-4ccf-bd63-5682e963b129 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:16.919647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a885e89-bde3-4ccf-bd63-5682e963b129 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:16.919765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a885e89-bde3-4ccf-bd63-5682e963b129 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:16.921436 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2116/4187] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:14:16.926499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856d6f0-74b9-4dea-abd7-f7ba14db0a2c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:14:16.928812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7856d6f0-74b9-4dea-abd7-f7ba14db0a2c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:16.965654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856d6f0-74b9-4dea-abd7-f7ba14db0a2c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:16.995917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856d6f0-74b9-4dea-abd7-f7ba14db0a2c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:17.008958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc1cfc-90b7-40e6-80d5-d47996b5011d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:17.010723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc1cfc-90b7-40e6-80d5-d47996b5011d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:17.011599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc1cfc-90b7-40e6-80d5-d47996b5011d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:17.020334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc1cfc-90b7-40e6-80d5-d47996b5011d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/projects/b22e8286030640d3ad067ac82d5d5624` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:17.022035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc1cfc-90b7-40e6-80d5-d47996b5011d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:get_project(project_id=b22e8286030640d3ad067ac82d5d5624)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:17.026985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc1cfc-90b7-40e6-80d5-d47996b5011d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:17.032764 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2072/4188] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:14:16 2022] GET /identity/v3/projects/b22e8286030640d3ad067ac82d5d5624 => generated 371 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:14:17.149911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a885e89-bde3-4ccf-bd63-5682e963b129 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:17.187445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a885e89-bde3-4ccf-bd63-5682e963b129 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:17.217839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b2849-6954-4d73-8ba4-3c8b82737524 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:17.217839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b2849-6954-4d73-8ba4-3c8b82737524 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:17.217839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b2849-6954-4d73-8ba4-3c8b82737524 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:17.218132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b2849-6954-4d73-8ba4-3c8b82737524 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:17.219523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b2849-6954-4d73-8ba4-3c8b82737524 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:14:17.219523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b2849-6954-4d73-8ba4-3c8b82737524 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:17.220230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b2849-6954-4d73-8ba4-3c8b82737524 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:17.729277 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2117/4189] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 579 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:14:17.730436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc1cfc-90b7-40e6-80d5-d47996b5011d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:17.741280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc1cfc-90b7-40e6-80d5-d47996b5011d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:17.761960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd74f10-426f-449a-ac78-75a42ff01357 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:17.762661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd74f10-426f-449a-ac78-75a42ff01357 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:17.762948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd74f10-426f-449a-ac78-75a42ff01357 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:17.763226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd74f10-426f-449a-ac78-75a42ff01357 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:17.763943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd74f10-426f-449a-ac78-75a42ff01357 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:17.768408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd74f10-426f-449a-ac78-75a42ff01357 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:17.833801 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2073/4190] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:14:17 2022] POST /identity/v3/users => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:14:17.838717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b2849-6954-4d73-8ba4-3c8b82737524 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:17.860125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b2849-6954-4d73-8ba4-3c8b82737524 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:17.873624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e418c9-f077-4109-9c49-e7a110baa98c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:17.873905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e418c9-f077-4109-9c49-e7a110baa98c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:17.874218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e418c9-f077-4109-9c49-e7a110baa98c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:17.874773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e418c9-f077-4109-9c49-e7a110baa98c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:17.877917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e418c9-f077-4109-9c49-e7a110baa98c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:14:17.878270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e418c9-f077-4109-9c49-e7a110baa98c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:17.883997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e418c9-f077-4109-9c49-e7a110baa98c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:17.914889 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2118/4191] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:14:18.189051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4878a09-d0f5-4f6f-954a-e7d590639501 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:18.189533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4878a09-d0f5-4f6f-954a-e7d590639501 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:18.189642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4878a09-d0f5-4f6f-954a-e7d590639501 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:18.190990 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2074/4192] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:14:18.206600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e418c9-f077-4109-9c49-e7a110baa98c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:14:18.227367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e418c9-f077-4109-9c49-e7a110baa98c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:18.245833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e418c9-f077-4109-9c49-e7a110baa98c tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:18.261848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69165b-1b82-4885-98ee-2455afa9fda9 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:18.262842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69165b-1b82-4885-98ee-2455afa9fda9 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:18.263200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69165b-1b82-4885-98ee-2455afa9fda9 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:18.263548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69165b-1b82-4885-98ee-2455afa9fda9 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/projects/b22e8286030640d3ad067ac82d5d5624` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:18.271445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69165b-1b82-4885-98ee-2455afa9fda9 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:get_project(project_id=b22e8286030640d3ad067ac82d5d5624)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:18.273744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69165b-1b82-4885-98ee-2455afa9fda9 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:18.275742 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2119/4193] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:14:18 2022] GET /identity/v3/projects/b22e8286030640d3ad067ac82d5d5624 => generated 371 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:14:19.142804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e012885-c319-4357-9edc-7c96b0e4d834 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:19.143404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e012885-c319-4357-9edc-7c96b0e4d834 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:19.143889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e012885-c319-4357-9edc-7c96b0e4d834 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:19.146215 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2075/4194] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:14:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:14:19.172867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69165b-1b82-4885-98ee-2455afa9fda9 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:14:19.194642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69165b-1b82-4885-98ee-2455afa9fda9 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:19.230593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69165b-1b82-4885-98ee-2455afa9fda9 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:19.250091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fec6d2-6d2f-49f0-99bf-55f9d3513829 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:19.251413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fec6d2-6d2f-49f0-99bf-55f9d3513829 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:19.251703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fec6d2-6d2f-49f0-99bf-55f9d3513829 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:19.251986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fec6d2-6d2f-49f0-99bf-55f9d3513829 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/projects/b22e8286030640d3ad067ac82d5d5624` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:19.255910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fec6d2-6d2f-49f0-99bf-55f9d3513829 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:get_project(project_id=b22e8286030640d3ad067ac82d5d5624)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:19.279280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fec6d2-6d2f-49f0-99bf-55f9d3513829 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:19.282466 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2120/4195] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:14:19 2022] GET /identity/v3/projects/b22e8286030640d3ad067ac82d5d5624 => generated 371 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:14:19.370797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e012885-c319-4357-9edc-7c96b0e4d834 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:19.408908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e012885-c319-4357-9edc-7c96b0e4d834 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:19.427663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24dabb-422f-4ec0-80fa-5d9c7d59ee17 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:19.430184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24dabb-422f-4ec0-80fa-5d9c7d59ee17 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:19.430694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24dabb-422f-4ec0-80fa-5d9c7d59ee17 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:19.434278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24dabb-422f-4ec0-80fa-5d9c7d59ee17 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/users/3b5cc347db6f4fdaa771521657ee15c3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:19.474329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03e00f-1ff3-4229-a954-7fa96c69a2ba None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:19.474614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03e00f-1ff3-4229-a954-7fa96c69a2ba None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:19.475981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03e00f-1ff3-4229-a954-7fa96c69a2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:19.491433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24dabb-422f-4ec0-80fa-5d9c7d59ee17 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3b5cc347db6f4fdaa771521657ee15c3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:19.497459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24dabb-422f-4ec0-80fa-5d9c7d59ee17 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:19.584386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fa03e00f-1ff3-4229-a954-7fa96c69a2ba None None] MFA Rules not processed for user `54460739a1234cad987fe9593d443afe`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:19.591489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fa03e00f-1ff3-4229-a954-7fa96c69a2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:19.631993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7c24dabb-422f-4ec0-80fa-5d9c7d59ee17 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b5cc347db6f4fdaa771521657ee15c3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:19.660626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7c24dabb-422f-4ec0-80fa-5d9c7d59ee17 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b5cc347db6f4fdaa771521657ee15c3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:19.685182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7c24dabb-422f-4ec0-80fa-5d9c7d59ee17 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b5cc347db6f4fdaa771521657ee15c3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:19.687029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7c24dabb-422f-4ec0-80fa-5d9c7d59ee17 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b5cc347db6f4fdaa771521657ee15c3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:19.688180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7c24dabb-422f-4ec0-80fa-5d9c7d59ee17 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b5cc347db6f4fdaa771521657ee15c3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:19.735818 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2076/4196] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:14:19 2022] DELETE /identity/v3/users/3b5cc347db6f4fdaa771521657ee15c3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:19.739483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8e8ea-7343-48e1-91cb-2c20586ad61a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:19.740819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8e8ea-7343-48e1-91cb-2c20586ad61a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:19.741219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8e8ea-7343-48e1-91cb-2c20586ad61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:19.786575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bef8e8ea-7343-48e1-91cb-2c20586ad61a None None] MFA Rules not processed for user `419f3872408c4d8c9a2980d6397d0aea`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:19.788924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bef8e8ea-7343-48e1-91cb-2c20586ad61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:19.800066 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2121/4197] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:19.800066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03e00f-1ff3-4229-a954-7fa96c69a2ba None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:19.800066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fa03e00f-1ff3-4229-a954-7fa96c69a2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:19.843704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03e00f-1ff3-4229-a954-7fa96c69a2ba None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:19.901559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:19.942035 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2077/4198] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:20.072781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d3cd2-99eb-4ae8-90eb-0eaefe6dac1b tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:20.073533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d3cd2-99eb-4ae8-90eb-0eaefe6dac1b tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:20.073818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d3cd2-99eb-4ae8-90eb-0eaefe6dac1b tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:20.074178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d3cd2-99eb-4ae8-90eb-0eaefe6dac1b tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/projects/b22e8286030640d3ad067ac82d5d5624` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:20.085144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d3cd2-99eb-4ae8-90eb-0eaefe6dac1b tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b22e8286030640d3ad067ac82d5d5624)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:20.087122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d3cd2-99eb-4ae8-90eb-0eaefe6dac1b tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:20.096935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8e8ea-7343-48e1-91cb-2c20586ad61a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:20.098519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bef8e8ea-7343-48e1-91cb-2c20586ad61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:20.141747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:20.192014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f57d3cd2-99eb-4ae8-90eb-0eaefe6dac1b tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b22e8286030640d3ad067ac82d5d5624', 'request_id': 'req-f57d3cd2-99eb-4ae8-90eb-0eaefe6dac1b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:20.209028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f57d3cd2-99eb-4ae8-90eb-0eaefe6dac1b tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b22e8286030640d3ad067ac82d5d5624', 'request_id': 'req-f57d3cd2-99eb-4ae8-90eb-0eaefe6dac1b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:20.233771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f57d3cd2-99eb-4ae8-90eb-0eaefe6dac1b tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b22e8286030640d3ad067ac82d5d5624', 'request_id': 'req-f57d3cd2-99eb-4ae8-90eb-0eaefe6dac1b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:20.279434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f57d3cd2-99eb-4ae8-90eb-0eaefe6dac1b tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] The token cache is being invalidate because project b22e8286030640d3ad067ac82d5d5624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:14:20.279717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f57d3cd2-99eb-4ae8-90eb-0eaefe6dac1b tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:20.284467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f57d3cd2-99eb-4ae8-90eb-0eaefe6dac1b tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:20.297947 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2122/4199] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:14:19 2022] DELETE /identity/v3/projects/b22e8286030640d3ad067ac82d5d5624 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:20.317029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8e8ea-7343-48e1-91cb-2c20586ad61a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:20.331078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dafc4-ff4b-4950-94ee-64f43fdbcdb0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:20.331361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dafc4-ff4b-4950-94ee-64f43fdbcdb0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:20.331774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dafc4-ff4b-4950-94ee-64f43fdbcdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:20.390937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5d0dafc4-ff4b-4950-94ee-64f43fdbcdb0 None None] MFA Rules not processed for user `7ba1811c5fc342fd931553bc3682d866`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:20.393350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5d0dafc4-ff4b-4950-94ee-64f43fdbcdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:20.545272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fa4c0-558a-4f44-b9a6-e4b9c48a9072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:20.549574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fa4c0-558a-4f44-b9a6-e4b9c48a9072 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:20.549888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fa4c0-558a-4f44-b9a6-e4b9c48a9072 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:20.550143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fa4c0-558a-4f44-b9a6-e4b9c48a9072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:20.559519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5f5fa4c0-558a-4f44-b9a6-e4b9c48a9072 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:20.645289 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2123/4200] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:20.657065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dafc4-ff4b-4950-94ee-64f43fdbcdb0 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:20.658637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5d0dafc4-ff4b-4950-94ee-64f43fdbcdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:20.721018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fa4c0-558a-4f44-b9a6-e4b9c48a9072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:20.727482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fa4c0-558a-4f44-b9a6-e4b9c48a9072 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:20.777825 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2078/4201] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:14:20 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:14:20.890226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dafc4-ff4b-4950-94ee-64f43fdbcdb0 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:20.906454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7cf06-84a2-4fe1-875b-02c2bb8c42fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:20.910835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7cf06-84a2-4fe1-875b-02c2bb8c42fc service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:20.911396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7cf06-84a2-4fe1-875b-02c2bb8c42fc service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:20.911678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7cf06-84a2-4fe1-875b-02c2bb8c42fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:20.918318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-59b7cf06-84a2-4fe1-875b-02c2bb8c42fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:21.017638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:21.073859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7cf06-84a2-4fe1-875b-02c2bb8c42fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:21.077193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7cf06-84a2-4fe1-875b-02c2bb8c42fc service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:21.116279 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2124/4202] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:14:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:14:22.624867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858911cf-4665-4054-b78b-a60cb79eb399 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:22.625832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858911cf-4665-4054-b78b-a60cb79eb399 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:22.626411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858911cf-4665-4054-b78b-a60cb79eb399 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:22.628951 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2079/4203] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:14:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:14:22.634594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7cf06-84a2-4fe1-875b-02c2bb8c42fc service cinder] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:14:22.639287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-59b7cf06-84a2-4fe1-875b-02c2bb8c42fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:22.694942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7cf06-84a2-4fe1-875b-02c2bb8c42fc service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:22.698803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-59b7cf06-84a2-4fe1-875b-02c2bb8c42fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:22.889536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7cf06-84a2-4fe1-875b-02c2bb8c42fc service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:22.905877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9348fd-0603-4aa4-be63-850de174aff6 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:22.906794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9348fd-0603-4aa4-be63-850de174aff6 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:22.907076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9348fd-0603-4aa4-be63-850de174aff6 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:22.907353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9348fd-0603-4aa4-be63-850de174aff6 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/projects/4a3573b91d3f463e92ef7aa2335812f7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:22.910459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9348fd-0603-4aa4-be63-850de174aff6 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:get_project(project_id=4a3573b91d3f463e92ef7aa2335812f7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:22.913115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9348fd-0603-4aa4-be63-850de174aff6 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:22.915559 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2125/4204] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:14:22 2022] GET /identity/v3/projects/4a3573b91d3f463e92ef7aa2335812f7 => generated 373 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:14:24.527079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95357bd9-1857-4419-ac55-44afd189bb40 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:24.528077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95357bd9-1857-4419-ac55-44afd189bb40 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:24.528077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95357bd9-1857-4419-ac55-44afd189bb40 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:24.529311 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2080/4205] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:14:24.560446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9348fd-0603-4aa4-be63-850de174aff6 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:14:24.597097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9348fd-0603-4aa4-be63-850de174aff6 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:24.636422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9348fd-0603-4aa4-be63-850de174aff6 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:24.646091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d16928-d951-4e6b-8d8e-f6e95f9422e3 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:24.650401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d16928-d951-4e6b-8d8e-f6e95f9422e3 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:24.652694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d16928-d951-4e6b-8d8e-f6e95f9422e3 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:24.654373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d16928-d951-4e6b-8d8e-f6e95f9422e3 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/projects/4a3573b91d3f463e92ef7aa2335812f7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:24.658348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d16928-d951-4e6b-8d8e-f6e95f9422e3 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:get_project(project_id=4a3573b91d3f463e92ef7aa2335812f7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:24.667252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d16928-d951-4e6b-8d8e-f6e95f9422e3 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:24.675197 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2126/4206] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:14:24 2022] GET /identity/v3/projects/4a3573b91d3f463e92ef7aa2335812f7 => generated 373 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:14:25.209179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95357bd9-1857-4419-ac55-44afd189bb40 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:25.211283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-95357bd9-1857-4419-ac55-44afd189bb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:25.320530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:25.409720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d16928-d951-4e6b-8d8e-f6e95f9422e3 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:25.411974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-65d16928-d951-4e6b-8d8e-f6e95f9422e3 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:25.502465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95357bd9-1857-4419-ac55-44afd189bb40 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:25.529791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2106a4-1107-41cc-b304-82b90e6ba625 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:25.530467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2106a4-1107-41cc-b304-82b90e6ba625 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:25.530923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2106a4-1107-41cc-b304-82b90e6ba625 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:25.531202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2106a4-1107-41cc-b304-82b90e6ba625 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:25.538646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ad2106a4-1107-41cc-b304-82b90e6ba625 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:25.606536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2106a4-1107-41cc-b304-82b90e6ba625 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:25.611363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2106a4-1107-41cc-b304-82b90e6ba625 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:25.639457 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2081/4207] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:14:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:14:25.687971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d16928-d951-4e6b-8d8e-f6e95f9422e3 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:25.698598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38e8ee-5fa7-4573-bc5e-1fbee0be05ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:25.699758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38e8ee-5fa7-4573-bc5e-1fbee0be05ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:25.700064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38e8ee-5fa7-4573-bc5e-1fbee0be05ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:25.700961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38e8ee-5fa7-4573-bc5e-1fbee0be05ab admin admin] PATH_INFO: `/v3/users/dbd25deaf48741b9888a6421d650916f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:25.729829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38e8ee-5fa7-4573-bc5e-1fbee0be05ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd25deaf48741b9888a6421d650916f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:25.732625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38e8ee-5fa7-4573-bc5e-1fbee0be05ab admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:25.937406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6f38e8ee-5fa7-4573-bc5e-1fbee0be05ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd25deaf48741b9888a6421d650916f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:25.959828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6f38e8ee-5fa7-4573-bc5e-1fbee0be05ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd25deaf48741b9888a6421d650916f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:25.961071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6f38e8ee-5fa7-4573-bc5e-1fbee0be05ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd25deaf48741b9888a6421d650916f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:25.962072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6f38e8ee-5fa7-4573-bc5e-1fbee0be05ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd25deaf48741b9888a6421d650916f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:25.998228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6f38e8ee-5fa7-4573-bc5e-1fbee0be05ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd25deaf48741b9888a6421d650916f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:26.022954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e5f0d-197e-4da0-93c4-ff8b92d0fcd3 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:26.025604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:26.027770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e5f0d-197e-4da0-93c4-ff8b92d0fcd3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:26.028377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e5f0d-197e-4da0-93c4-ff8b92d0fcd3 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:26.031203 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2082/4208] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:14:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 21:14:26.061885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e5f0d-197e-4da0-93c4-ff8b92d0fcd3 None None] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:14:26.066833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-231e5f0d-197e-4da0-93c4-ff8b92d0fcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:26.088005 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2127/4209] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:14:25 2022] DELETE /identity/v3/users/dbd25deaf48741b9888a6421d650916f => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:14:26.093858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baf4fb-080d-4715-bcc1-b21739c02482 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:26.094398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baf4fb-080d-4715-bcc1-b21739c02482 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:26.094832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baf4fb-080d-4715-bcc1-b21739c02482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:26.121005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e5f0d-197e-4da0-93c4-ff8b92d0fcd3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:26.123384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-231e5f0d-197e-4da0-93c4-ff8b92d0fcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:26.150887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e5f0d-197e-4da0-93c4-ff8b92d0fcd3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:26.152616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-76baf4fb-080d-4715-bcc1-b21739c02482 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:26.155024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-76baf4fb-080d-4715-bcc1-b21739c02482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:26.415169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075adc7-1d42-4b6e-9ce4-5b6cb380832e tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2746cc1ce74452a990383a83d44c997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83670234cf9a4b71970483fb216b568b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:26.420300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075adc7-1d42-4b6e-9ce4-5b6cb380832e tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:26.422076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075adc7-1d42-4b6e-9ce4-5b6cb380832e tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:26.423028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075adc7-1d42-4b6e-9ce4-5b6cb380832e tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] PATH_INFO: `/v3/projects/4a3573b91d3f463e92ef7aa2335812f7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:26.428516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075adc7-1d42-4b6e-9ce4-5b6cb380832e tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorizing `identity:get_project(project_id=4a3573b91d3f463e92ef7aa2335812f7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:26.435945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075adc7-1d42-4b6e-9ce4-5b6cb380832e tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:26.448582 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2083/4210] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:14:26 2022] GET /identity/v3/projects/4a3573b91d3f463e92ef7aa2335812f7 => generated 373 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:14:26.459375 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2128/4211] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:26.474817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075adc7-1d42-4b6e-9ce4-5b6cb380832e tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:26.479195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2075adc7-1d42-4b6e-9ce4-5b6cb380832e tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:26.691657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075adc7-1d42-4b6e-9ce4-5b6cb380832e tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:26.704121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee654a-e8f9-4b97-9953-4b289f71665b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:26.705354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee654a-e8f9-4b97-9953-4b289f71665b service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:26.706329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee654a-e8f9-4b97-9953-4b289f71665b service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:26.708332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee654a-e8f9-4b97-9953-4b289f71665b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:26.755804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee654a-e8f9-4b97-9953-4b289f71665b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:26.758580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee654a-e8f9-4b97-9953-4b289f71665b service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:26.810002 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2084/4212] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:14:27.262536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76baf4fb-080d-4715-bcc1-b21739c02482 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:27.266447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-76baf4fb-080d-4715-bcc1-b21739c02482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:27.300221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76baf4fb-080d-4715-bcc1-b21739c02482 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:27.315177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835c6ed-6560-455b-b555-bb13b5fbf894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:27.318557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835c6ed-6560-455b-b555-bb13b5fbf894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:27.320357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835c6ed-6560-455b-b555-bb13b5fbf894 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:27.321640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835c6ed-6560-455b-b555-bb13b5fbf894 admin admin] PATH_INFO: `/v3/users/b2c22799e7ec4abca28aacf4f8e7a573` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:27.324788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835c6ed-6560-455b-b555-bb13b5fbf894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c22799e7ec4abca28aacf4f8e7a573)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:27.330269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835c6ed-6560-455b-b555-bb13b5fbf894 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:27.437687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b835c6ed-6560-455b-b555-bb13b5fbf894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c22799e7ec4abca28aacf4f8e7a573'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:27.458048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b835c6ed-6560-455b-b555-bb13b5fbf894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c22799e7ec4abca28aacf4f8e7a573'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:27.458912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b835c6ed-6560-455b-b555-bb13b5fbf894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c22799e7ec4abca28aacf4f8e7a573'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:27.459664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b835c6ed-6560-455b-b555-bb13b5fbf894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c22799e7ec4abca28aacf4f8e7a573'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:27.469434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b835c6ed-6560-455b-b555-bb13b5fbf894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c22799e7ec4abca28aacf4f8e7a573'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:27.501901 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2129/4213] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:14:27 2022] DELETE /identity/v3/users/b2c22799e7ec4abca28aacf4f8e7a573 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:27.508149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25272fe0-4117-481b-9412-bcdc275925fe None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:27.508434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25272fe0-4117-481b-9412-bcdc275925fe None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:27.508705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25272fe0-4117-481b-9412-bcdc275925fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:27.531081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-25272fe0-4117-481b-9412-bcdc275925fe None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:27.532911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-25272fe0-4117-481b-9412-bcdc275925fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:27.584594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835c6ed-6560-455b-b555-bb13b5fbf894 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:27.587090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b835c6ed-6560-455b-b555-bb13b5fbf894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:27.615811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:27.641930 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2085/4214] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:14:27.686502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25272fe0-4117-481b-9412-bcdc275925fe None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:27.688718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-25272fe0-4117-481b-9412-bcdc275925fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:27.765461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:27.776965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835c6ed-6560-455b-b555-bb13b5fbf894 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:27.790331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0908a86-7668-43a0-8e41-4e46d9a80d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:27.791295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0908a86-7668-43a0-8e41-4e46d9a80d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:27.791608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0908a86-7668-43a0-8e41-4e46d9a80d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:27.791885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0908a86-7668-43a0-8e41-4e46d9a80d6c admin admin] PATH_INFO: `/v3/projects/1be3cd7248984862a1186b2286efe935` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:27.800708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0908a86-7668-43a0-8e41-4e46d9a80d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be3cd7248984862a1186b2286efe935)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:27.803351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0908a86-7668-43a0-8e41-4e46d9a80d6c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:27.846228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25272fe0-4117-481b-9412-bcdc275925fe None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:27.856480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4665e-7a95-480e-a9fd-0898cde0f60f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:27.857150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4665e-7a95-480e-a9fd-0898cde0f60f service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:27.857425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4665e-7a95-480e-a9fd-0898cde0f60f service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:27.857697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4665e-7a95-480e-a9fd-0898cde0f60f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:27.874967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4665e-7a95-480e-a9fd-0898cde0f60f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:27.877124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4665e-7a95-480e-a9fd-0898cde0f60f service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:27.912130 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2086/4215] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:14:27.913026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d0908a86-7668-43a0-8e41-4e46d9a80d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be3cd7248984862a1186b2286efe935', 'request_id': 'req-d0908a86-7668-43a0-8e41-4e46d9a80d6c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:27.934055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d0908a86-7668-43a0-8e41-4e46d9a80d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be3cd7248984862a1186b2286efe935', 'request_id': 'req-d0908a86-7668-43a0-8e41-4e46d9a80d6c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:27.948831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d0908a86-7668-43a0-8e41-4e46d9a80d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be3cd7248984862a1186b2286efe935', 'request_id': 'req-d0908a86-7668-43a0-8e41-4e46d9a80d6c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:27.969105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d0908a86-7668-43a0-8e41-4e46d9a80d6c admin admin] The token cache is being invalidate because project 1be3cd7248984862a1186b2286efe935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:14:27.970478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d0908a86-7668-43a0-8e41-4e46d9a80d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:27.972773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d0908a86-7668-43a0-8e41-4e46d9a80d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:27.975233 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2130/4216] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:14:27 2022] DELETE /identity/v3/projects/1be3cd7248984862a1186b2286efe935 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:14:27.980393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde39eff-725f-4423-b851-d2c9bb6a47f6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:27.980665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde39eff-725f-4423-b851-d2c9bb6a47f6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:27.981142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde39eff-725f-4423-b851-d2c9bb6a47f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:28.011695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-dde39eff-725f-4423-b851-d2c9bb6a47f6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:28.013530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dde39eff-725f-4423-b851-d2c9bb6a47f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:28.192174 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2087/4217] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:28.199821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200d2a6-164a-4075-904c-400add5b1c31 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:28.200250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200d2a6-164a-4075-904c-400add5b1c31 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:28.200616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200d2a6-164a-4075-904c-400add5b1c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:28.257474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e200d2a6-164a-4075-904c-400add5b1c31 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:28.260176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e200d2a6-164a-4075-904c-400add5b1c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:28.294292 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2131/4218] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:28.298409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde39eff-725f-4423-b851-d2c9bb6a47f6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:28.315808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde39eff-725f-4423-b851-d2c9bb6a47f6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:28.337508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e74d40-d1d3-4c0b-87d6-389a5b0f694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:28.338956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e74d40-d1d3-4c0b-87d6-389a5b0f694a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:28.339813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e74d40-d1d3-4c0b-87d6-389a5b0f694a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:28.340731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e74d40-d1d3-4c0b-87d6-389a5b0f694a admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:28.342255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e74d40-d1d3-4c0b-87d6-389a5b0f694a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:14:28.342656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e74d40-d1d3-4c0b-87d6-389a5b0f694a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:28.347103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e74d40-d1d3-4c0b-87d6-389a5b0f694a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:28.366944 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2088/4219] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:14:28.371718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200d2a6-164a-4075-904c-400add5b1c31 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:28.385786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200d2a6-164a-4075-904c-400add5b1c31 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:28.394036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f9f55-aec4-4e4e-a373-259d97426a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:28.395133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f9f55-aec4-4e4e-a373-259d97426a89 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:28.395633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f9f55-aec4-4e4e-a373-259d97426a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:28.396165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f9f55-aec4-4e4e-a373-259d97426a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:28.397470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f9f55-aec4-4e4e-a373-259d97426a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:28.400375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f9f55-aec4-4e4e-a373-259d97426a89 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:28.442285 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2132/4220] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:14:28 2022] POST /identity/v3/projects => generated 357 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:14:28.443486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e74d40-d1d3-4c0b-87d6-389a5b0f694a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:28.458640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e74d40-d1d3-4c0b-87d6-389a5b0f694a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:28.652649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9def761-9b37-4ded-979a-6c17ed81ec06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:28.653372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9def761-9b37-4ded-979a-6c17ed81ec06 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:28.653642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9def761-9b37-4ded-979a-6c17ed81ec06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:28.653930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9def761-9b37-4ded-979a-6c17ed81ec06 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:28.654606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9def761-9b37-4ded-979a-6c17ed81ec06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:28.656620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9def761-9b37-4ded-979a-6c17ed81ec06 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:28.702400 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2089/4221] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:14:28 2022] POST /identity/v3/users => generated 279 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:14:28.703415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f9f55-aec4-4e4e-a373-259d97426a89 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:28.719578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f9f55-aec4-4e4e-a373-259d97426a89 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:28.725345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01c3f3-1cf7-4404-a7cb-9a407e73f6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:28.726291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01c3f3-1cf7-4404-a7cb-9a407e73f6cd admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:28.726886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01c3f3-1cf7-4404-a7cb-9a407e73f6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:28.727387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01c3f3-1cf7-4404-a7cb-9a407e73f6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:28.730312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01c3f3-1cf7-4404-a7cb-9a407e73f6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:28.731998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01c3f3-1cf7-4404-a7cb-9a407e73f6cd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:28.757268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9def761-9b37-4ded-979a-6c17ed81ec06 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:28.770392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9def761-9b37-4ded-979a-6c17ed81ec06 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:28.771982 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2133/4222] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:14:28.780750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a06dc-3d46-45a6-8a07-53cff0741267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:28.782158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a06dc-3d46-45a6-8a07-53cff0741267 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:28.782295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a06dc-3d46-45a6-8a07-53cff0741267 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:28.782576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a06dc-3d46-45a6-8a07-53cff0741267 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:28.783350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a06dc-3d46-45a6-8a07-53cff0741267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:28.785363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a06dc-3d46-45a6-8a07-53cff0741267 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:28.810096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01c3f3-1cf7-4404-a7cb-9a407e73f6cd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:28.810356 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2090/4223] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:14:28.834168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01c3f3-1cf7-4404-a7cb-9a407e73f6cd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:28.855235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba0ab2-b9f8-48aa-ad64-211bc9b95bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:28.855421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba0ab2-b9f8-48aa-ad64-211bc9b95bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:28.855661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba0ab2-b9f8-48aa-ad64-211bc9b95bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:28.855944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba0ab2-b9f8-48aa-ad64-211bc9b95bb1 admin admin] PATH_INFO: `/v3/projects/b9c2863e9580421e909babc1b6f00052/users/1badf76d64734107b7c05c42413fb192/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:28.909358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba0ab2-b9f8-48aa-ad64-211bc9b95bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c2863e9580421e909babc1b6f00052, user_id=1badf76d64734107b7c05c42413fb192, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:28.915807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba0ab2-b9f8-48aa-ad64-211bc9b95bb1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:28.964762 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2134/4224] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:14:28 2022] PUT /identity/v3/projects/b9c2863e9580421e909babc1b6f00052/users/1badf76d64734107b7c05c42413fb192/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:28.967034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c40293-8c80-4e04-b518-de1bd2cbc840 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:28.967580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c40293-8c80-4e04-b518-de1bd2cbc840 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:28.967580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c40293-8c80-4e04-b518-de1bd2cbc840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:28.983477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:29.021223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-34c40293-8c80-4e04-b518-de1bd2cbc840 None None] MFA Rules not processed for user `1badf76d64734107b7c05c42413fb192`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:29.022711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-34c40293-8c80-4e04-b518-de1bd2cbc840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:29.163083 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2091/4225] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:28 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:29.277392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba0ab2-b9f8-48aa-ad64-211bc9b95bb1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:29.281123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-77ba0ab2-b9f8-48aa-ad64-211bc9b95bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:29.379588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba0ab2-b9f8-48aa-ad64-211bc9b95bb1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:29.396778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03170a0e-a146-4ba4-bb2e-f7ebcca90524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:29.399727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03170a0e-a146-4ba4-bb2e-f7ebcca90524 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:29.400066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03170a0e-a146-4ba4-bb2e-f7ebcca90524 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:29.400438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03170a0e-a146-4ba4-bb2e-f7ebcca90524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:29.419996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03170a0e-a146-4ba4-bb2e-f7ebcca90524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:29.423997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03170a0e-a146-4ba4-bb2e-f7ebcca90524 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:29.436241 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2135/4226] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:14:29 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:14:29.496695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c40293-8c80-4e04-b518-de1bd2cbc840 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:29.498572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-34c40293-8c80-4e04-b518-de1bd2cbc840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:29.619510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c40293-8c80-4e04-b518-de1bd2cbc840 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:29.627330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cb92a-5b26-4462-8f9d-f83106adf0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:29.628407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cb92a-5b26-4462-8f9d-f83106adf0a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:29.628760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cb92a-5b26-4462-8f9d-f83106adf0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:29.629105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cb92a-5b26-4462-8f9d-f83106adf0a9 admin admin] PATH_INFO: `/v3/projects/4a3573b91d3f463e92ef7aa2335812f7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:29.630757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cb92a-5b26-4462-8f9d-f83106adf0a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a3573b91d3f463e92ef7aa2335812f7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:29.633438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cb92a-5b26-4462-8f9d-f83106adf0a9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:29.730591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b23cb92a-5b26-4462-8f9d-f83106adf0a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a3573b91d3f463e92ef7aa2335812f7', 'request_id': 'req-b23cb92a-5b26-4462-8f9d-f83106adf0a9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:29.740176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b23cb92a-5b26-4462-8f9d-f83106adf0a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a3573b91d3f463e92ef7aa2335812f7', 'request_id': 'req-b23cb92a-5b26-4462-8f9d-f83106adf0a9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:29.748070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b23cb92a-5b26-4462-8f9d-f83106adf0a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a3573b91d3f463e92ef7aa2335812f7', 'request_id': 'req-b23cb92a-5b26-4462-8f9d-f83106adf0a9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:29.774620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b23cb92a-5b26-4462-8f9d-f83106adf0a9 admin admin] The token cache is being invalidate because project 4a3573b91d3f463e92ef7aa2335812f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:14:29.776772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b23cb92a-5b26-4462-8f9d-f83106adf0a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:29.777727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b23cb92a-5b26-4462-8f9d-f83106adf0a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:29.787910 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2092/4227] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:14:29 2022] DELETE /identity/v3/projects/4a3573b91d3f463e92ef7aa2335812f7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:29.791926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03170a0e-a146-4ba4-bb2e-f7ebcca90524 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:29.826872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03170a0e-a146-4ba4-bb2e-f7ebcca90524 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:29.870882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:29.989273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d7349-e825-491c-b4a7-bd0b534ea09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:29.990187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d7349-e825-491c-b4a7-bd0b534ea09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:29.990472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d7349-e825-491c-b4a7-bd0b534ea09b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:29.990747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d7349-e825-491c-b4a7-bd0b534ea09b admin admin] PATH_INFO: `/v3/users/f2746cc1ce74452a990383a83d44c997` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:29.992144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d7349-e825-491c-b4a7-bd0b534ea09b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2746cc1ce74452a990383a83d44c997)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:29.994956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d7349-e825-491c-b4a7-bd0b534ea09b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:30.103640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-003d7349-e825-491c-b4a7-bd0b534ea09b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2746cc1ce74452a990383a83d44c997'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:30.129985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-003d7349-e825-491c-b4a7-bd0b534ea09b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2746cc1ce74452a990383a83d44c997'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:30.130181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-003d7349-e825-491c-b4a7-bd0b534ea09b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2746cc1ce74452a990383a83d44c997'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:30.131266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-003d7349-e825-491c-b4a7-bd0b534ea09b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2746cc1ce74452a990383a83d44c997'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:30.143806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-003d7349-e825-491c-b4a7-bd0b534ea09b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2746cc1ce74452a990383a83d44c997'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:30.198973 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2136/4228] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:14:29 2022] DELETE /identity/v3/users/f2746cc1ce74452a990383a83d44c997 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:31.839704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cb92a-5b26-4462-8f9d-f83106adf0a9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:31.842605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b23cb92a-5b26-4462-8f9d-f83106adf0a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:31.860935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cb92a-5b26-4462-8f9d-f83106adf0a9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:31.890062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:31.981958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56876ac7-b42c-4615-864f-2802c50d1dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:31.983289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56876ac7-b42c-4615-864f-2802c50d1dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:31.983802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56876ac7-b42c-4615-864f-2802c50d1dea admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:31.984442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56876ac7-b42c-4615-864f-2802c50d1dea admin admin] PATH_INFO: `/v3/projects/83670234cf9a4b71970483fb216b568b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:31.985903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56876ac7-b42c-4615-864f-2802c50d1dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=83670234cf9a4b71970483fb216b568b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:31.988334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56876ac7-b42c-4615-864f-2802c50d1dea admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:32.090109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-56876ac7-b42c-4615-864f-2802c50d1dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83670234cf9a4b71970483fb216b568b', 'request_id': 'req-56876ac7-b42c-4615-864f-2802c50d1dea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:32.102804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-56876ac7-b42c-4615-864f-2802c50d1dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83670234cf9a4b71970483fb216b568b', 'request_id': 'req-56876ac7-b42c-4615-864f-2802c50d1dea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:32.120558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-56876ac7-b42c-4615-864f-2802c50d1dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83670234cf9a4b71970483fb216b568b', 'request_id': 'req-56876ac7-b42c-4615-864f-2802c50d1dea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:32.145767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-56876ac7-b42c-4615-864f-2802c50d1dea admin admin] The token cache is being invalidate because project 83670234cf9a4b71970483fb216b568b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:14:32.146067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-56876ac7-b42c-4615-864f-2802c50d1dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:32.149767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-56876ac7-b42c-4615-864f-2802c50d1dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:32.151832 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2093/4229] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:14:31 2022] DELETE /identity/v3/projects/83670234cf9a4b71970483fb216b568b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:32.160129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78022492-7c91-4d63-888d-5ff980e99b56 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:32.160788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78022492-7c91-4d63-888d-5ff980e99b56 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:32.161036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78022492-7c91-4d63-888d-5ff980e99b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:32.205382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-78022492-7c91-4d63-888d-5ff980e99b56 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:32.206507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-78022492-7c91-4d63-888d-5ff980e99b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:32.337308 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2137/4230] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:32.348694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc8a9e-1bac-4c60-8495-902ac483ee3d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:32.349375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc8a9e-1bac-4c60-8495-902ac483ee3d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:32.349869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc8a9e-1bac-4c60-8495-902ac483ee3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:32.390686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-36bc8a9e-1bac-4c60-8495-902ac483ee3d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:32.393384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-36bc8a9e-1bac-4c60-8495-902ac483ee3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:32.408181 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2094/4231] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:32.414094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78022492-7c91-4d63-888d-5ff980e99b56 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:32.427173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78022492-7c91-4d63-888d-5ff980e99b56 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:32.442688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e436f9-37a3-440f-b407-34e5c7e3ffb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:32.443990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e436f9-37a3-440f-b407-34e5c7e3ffb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:32.444594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e436f9-37a3-440f-b407-34e5c7e3ffb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:32.445084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e436f9-37a3-440f-b407-34e5c7e3ffb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:32.446119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e436f9-37a3-440f-b407-34e5c7e3ffb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:14:32.446789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e436f9-37a3-440f-b407-34e5c7e3ffb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:32.453242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e436f9-37a3-440f-b407-34e5c7e3ffb0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:32.472692 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2138/4232] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:14:32.473624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc8a9e-1bac-4c60-8495-902ac483ee3d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:32.484886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc8a9e-1bac-4c60-8495-902ac483ee3d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:32.490649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e423aed-9199-489e-a217-562ab434cad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:32.491778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e423aed-9199-489e-a217-562ab434cad8 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:32.492282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e423aed-9199-489e-a217-562ab434cad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:32.492734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e423aed-9199-489e-a217-562ab434cad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:32.493623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e423aed-9199-489e-a217-562ab434cad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:32.495741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e423aed-9199-489e-a217-562ab434cad8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:32.539045 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2095/4233] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:14:32 2022] POST /identity/v3/projects => generated 395 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:14:32.542914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e436f9-37a3-440f-b407-34e5c7e3ffb0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:32.559151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e436f9-37a3-440f-b407-34e5c7e3ffb0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:32.600547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:32.642121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff53182-f45a-4836-a903-769e2f5a6d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:32.643100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff53182-f45a-4836-a903-769e2f5a6d0f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:32.643560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff53182-f45a-4836-a903-769e2f5a6d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:32.644399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff53182-f45a-4836-a903-769e2f5a6d0f admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:32.645453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff53182-f45a-4836-a903-769e2f5a6d0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:32.647924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff53182-f45a-4836-a903-769e2f5a6d0f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:32.675157 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2139/4234] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:14:32 2022] POST /identity/v3/users => generated 298 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:14:32.680898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e423aed-9199-489e-a217-562ab434cad8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:32.696635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e423aed-9199-489e-a217-562ab434cad8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:32.704076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516ab9c-9335-4bdf-b546-c9e436fe2ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:32.704930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516ab9c-9335-4bdf-b546-c9e436fe2ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:32.705317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516ab9c-9335-4bdf-b546-c9e436fe2ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:32.705696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516ab9c-9335-4bdf-b546-c9e436fe2ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:32.706565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516ab9c-9335-4bdf-b546-c9e436fe2ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:32.709060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516ab9c-9335-4bdf-b546-c9e436fe2ed7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:32.736845 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2096/4235] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:14:32.739167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff53182-f45a-4836-a903-769e2f5a6d0f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:32.752797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff53182-f45a-4836-a903-769e2f5a6d0f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:32.764822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41691c5a-1ca3-43df-a775-5c540f3fb682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:32.766668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41691c5a-1ca3-43df-a775-5c540f3fb682 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:32.767998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41691c5a-1ca3-43df-a775-5c540f3fb682 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:32.770857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41691c5a-1ca3-43df-a775-5c540f3fb682 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:32.772836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41691c5a-1ca3-43df-a775-5c540f3fb682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:32.776702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41691c5a-1ca3-43df-a775-5c540f3fb682 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:32.812487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516ab9c-9335-4bdf-b546-c9e436fe2ed7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:32.822104 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2140/4236] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:14:32.832400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516ab9c-9335-4bdf-b546-c9e436fe2ed7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:32.837131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d047fd7-7c9e-4c09-b5c8-0dbe6f48a562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:32.838160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d047fd7-7c9e-4c09-b5c8-0dbe6f48a562 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:32.838458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d047fd7-7c9e-4c09-b5c8-0dbe6f48a562 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:32.838719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d047fd7-7c9e-4c09-b5c8-0dbe6f48a562 admin admin] PATH_INFO: `/v3/projects/4b21ffb35f1c4be7b4f58889b8be7fae/users/6f727ff1b49246268c55900aa1cc3a1b/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:32.856364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d047fd7-7c9e-4c09-b5c8-0dbe6f48a562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b21ffb35f1c4be7b4f58889b8be7fae, user_id=6f727ff1b49246268c55900aa1cc3a1b, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:32.859884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d047fd7-7c9e-4c09-b5c8-0dbe6f48a562 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:32.878732 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2097/4237] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:14:32 2022] PUT /identity/v3/projects/4b21ffb35f1c4be7b4f58889b8be7fae/users/6f727ff1b49246268c55900aa1cc3a1b/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:32.906633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc45b0b-5ed0-4fbe-881e-dec16d5464a6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:32.907546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc45b0b-5ed0-4fbe-881e-dec16d5464a6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:32.908985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc45b0b-5ed0-4fbe-881e-dec16d5464a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:32.978016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7dc45b0b-5ed0-4fbe-881e-dec16d5464a6 None None] MFA Rules not processed for user `6f727ff1b49246268c55900aa1cc3a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:32.979667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7dc45b0b-5ed0-4fbe-881e-dec16d5464a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:33.101303 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2141/4238] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:33.107248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d047fd7-7c9e-4c09-b5c8-0dbe6f48a562 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:33.166069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:33.180221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d047fd7-7c9e-4c09-b5c8-0dbe6f48a562 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:33.187491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53d86b-75da-4b40-8ce0-a4b3ecb01b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:33.188225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53d86b-75da-4b40-8ce0-a4b3ecb01b86 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:33.188909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53d86b-75da-4b40-8ce0-a4b3ecb01b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:33.189269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53d86b-75da-4b40-8ce0-a4b3ecb01b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:33.190518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53d86b-75da-4b40-8ce0-a4b3ecb01b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:33.193754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53d86b-75da-4b40-8ce0-a4b3ecb01b86 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:33.232632 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2098/4239] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:14:33 2022] POST /identity/v3/projects => generated 395 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:14:33.236673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc45b0b-5ed0-4fbe-881e-dec16d5464a6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:33.255434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc45b0b-5ed0-4fbe-881e-dec16d5464a6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:33.332390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a112e-62fd-49c6-b885-e894f12e8e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:33.333411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a112e-62fd-49c6-b885-e894f12e8e39 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:33.333821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a112e-62fd-49c6-b885-e894f12e8e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:33.334187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a112e-62fd-49c6-b885-e894f12e8e39 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:33.335059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a112e-62fd-49c6-b885-e894f12e8e39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:33.338440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a112e-62fd-49c6-b885-e894f12e8e39 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:33.367744 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2142/4240] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:14:33 2022] POST /identity/v3/users => generated 304 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:14:33.372061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53d86b-75da-4b40-8ce0-a4b3ecb01b86 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:33.392477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53d86b-75da-4b40-8ce0-a4b3ecb01b86 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:33.406605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a1748-ac1d-40a1-9f58-c4926717e122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:33.407305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a1748-ac1d-40a1-9f58-c4926717e122 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:33.407592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a1748-ac1d-40a1-9f58-c4926717e122 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:33.413397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a1748-ac1d-40a1-9f58-c4926717e122 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:33.414327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a1748-ac1d-40a1-9f58-c4926717e122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:33.419453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a1748-ac1d-40a1-9f58-c4926717e122 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:33.438805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a112e-62fd-49c6-b885-e894f12e8e39 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:33.449985 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2099/4241] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:14:33.453888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a112e-62fd-49c6-b885-e894f12e8e39 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:33.468908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718d173-9af3-45ac-8f54-a3de81e43a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:33.469832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718d173-9af3-45ac-8f54-a3de81e43a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:33.470110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718d173-9af3-45ac-8f54-a3de81e43a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:33.470387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718d173-9af3-45ac-8f54-a3de81e43a50 admin admin] PATH_INFO: `/v3/projects/02b73382dc7c47599c8e21d3b62d5728/users/7d0751a5fe8e49b78d58e9d66deb306a/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:33.502255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718d173-9af3-45ac-8f54-a3de81e43a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b73382dc7c47599c8e21d3b62d5728, user_id=7d0751a5fe8e49b78d58e9d66deb306a, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:33.505872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718d173-9af3-45ac-8f54-a3de81e43a50 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:33.554201 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2143/4242] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:14:33 2022] PUT /identity/v3/projects/02b73382dc7c47599c8e21d3b62d5728/users/7d0751a5fe8e49b78d58e9d66deb306a/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:33.562648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a1748-ac1d-40a1-9f58-c4926717e122 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:33.592966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a1748-ac1d-40a1-9f58-c4926717e122 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:33.792821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951d646-91a8-4856-826b-0c117398318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:33.794522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951d646-91a8-4856-826b-0c117398318f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:33.795211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951d646-91a8-4856-826b-0c117398318f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:33.795497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951d646-91a8-4856-826b-0c117398318f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:33.796577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951d646-91a8-4856-826b-0c117398318f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:33.798245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951d646-91a8-4856-826b-0c117398318f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:33.837324 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2100/4243] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:14:33.841608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718d173-9af3-45ac-8f54-a3de81e43a50 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:33.867415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718d173-9af3-45ac-8f54-a3de81e43a50 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:33.902032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d44b5a-04b1-421f-9e8c-f8ec95eb7f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:33.903116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d44b5a-04b1-421f-9e8c-f8ec95eb7f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:33.904652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d44b5a-04b1-421f-9e8c-f8ec95eb7f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:33.904935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d44b5a-04b1-421f-9e8c-f8ec95eb7f5d admin admin] PATH_INFO: `/v3/projects/02b73382dc7c47599c8e21d3b62d5728/users/7d0751a5fe8e49b78d58e9d66deb306a/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:33.909730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d44b5a-04b1-421f-9e8c-f8ec95eb7f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b73382dc7c47599c8e21d3b62d5728, user_id=7d0751a5fe8e49b78d58e9d66deb306a, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:33.912736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d44b5a-04b1-421f-9e8c-f8ec95eb7f5d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:33.932590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:33.966946 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2144/4244] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:14:33 2022] PUT /identity/v3/projects/02b73382dc7c47599c8e21d3b62d5728/users/7d0751a5fe8e49b78d58e9d66deb306a/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:33.983940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a562e-6503-4065-a16e-6f20421f15bd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:33.985801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a562e-6503-4065-a16e-6f20421f15bd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:33.990532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a562e-6503-4065-a16e-6f20421f15bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:34.118443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9c6a562e-6503-4065-a16e-6f20421f15bd None None] MFA Rules not processed for user `7d0751a5fe8e49b78d58e9d66deb306a`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:34.130305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9c6a562e-6503-4065-a16e-6f20421f15bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:34.293122 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2101/4245] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:34.313931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81e2db-4b53-4024-a67f-cb46f3b27de6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:34.315395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81e2db-4b53-4024-a67f-cb46f3b27de6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:34.315904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81e2db-4b53-4024-a67f-cb46f3b27de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:34.356617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-dc81e2db-4b53-4024-a67f-cb46f3b27de6 None None] MFA Rules not processed for user `6f727ff1b49246268c55900aa1cc3a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:34.359799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dc81e2db-4b53-4024-a67f-cb46f3b27de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:34.523871 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2145/4246] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:34.737316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a562e-6503-4065-a16e-6f20421f15bd None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:34.739345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9c6a562e-6503-4065-a16e-6f20421f15bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:34.775800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81e2db-4b53-4024-a67f-cb46f3b27de6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:34.777289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dc81e2db-4b53-4024-a67f-cb46f3b27de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:34.800740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:34.848153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a562e-6503-4065-a16e-6f20421f15bd None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:34.865152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36d036-30d3-44cd-8f94-0740ae07898f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:34.866887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36d036-30d3-44cd-8f94-0740ae07898f service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:34.867339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36d036-30d3-44cd-8f94-0740ae07898f service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:34.867830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36d036-30d3-44cd-8f94-0740ae07898f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:34.903167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36d036-30d3-44cd-8f94-0740ae07898f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:34.905620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36d036-30d3-44cd-8f94-0740ae07898f service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:34.927577 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2102/4247] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:14:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:14:34.945812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81e2db-4b53-4024-a67f-cb46f3b27de6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:34.953420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715720a2-3fc3-4425-aae2-9f9152fe6155 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:34.953675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715720a2-3fc3-4425-aae2-9f9152fe6155 service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:34.953783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715720a2-3fc3-4425-aae2-9f9152fe6155 service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:34.954073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715720a2-3fc3-4425-aae2-9f9152fe6155 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:34.966445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-715720a2-3fc3-4425-aae2-9f9152fe6155 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:34.989068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715720a2-3fc3-4425-aae2-9f9152fe6155 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:34.990586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715720a2-3fc3-4425-aae2-9f9152fe6155 service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:35.021977 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2146/4248] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:14:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:14:35.265514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36d036-30d3-44cd-8f94-0740ae07898f service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:35.267458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2f36d036-30d3-44cd-8f94-0740ae07898f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:35.347475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36d036-30d3-44cd-8f94-0740ae07898f service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:35.351628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bfd09-ef0c-4d77-9d1c-59b064eb2bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:35.352526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bfd09-ef0c-4d77-9d1c-59b064eb2bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:35.352968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bfd09-ef0c-4d77-9d1c-59b064eb2bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:35.353456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bfd09-ef0c-4d77-9d1c-59b064eb2bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:35.355476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0a9bfd09-ef0c-4d77-9d1c-59b064eb2bb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:35.369944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bfd09-ef0c-4d77-9d1c-59b064eb2bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:35.371928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bfd09-ef0c-4d77-9d1c-59b064eb2bb8 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:35.383565 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2103/4249] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:14:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:14:35.632250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715720a2-3fc3-4425-aae2-9f9152fe6155 service glance] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:35.644938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715720a2-3fc3-4425-aae2-9f9152fe6155 service glance] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:35.656377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a0fe4-4b6a-4df5-b81f-969a2b17f5e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:35.657176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a0fe4-4b6a-4df5-b81f-969a2b17f5e3 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:35.657980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a0fe4-4b6a-4df5-b81f-969a2b17f5e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:35.658463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a0fe4-4b6a-4df5-b81f-969a2b17f5e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:35.661679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f16a0fe4-4b6a-4df5-b81f-969a2b17f5e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:35.694931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a0fe4-4b6a-4df5-b81f-969a2b17f5e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:35.696726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a0fe4-4b6a-4df5-b81f-969a2b17f5e3 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:35.727945 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2147/4250] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:14:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:14:40.570136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bfd09-ef0c-4d77-9d1c-59b064eb2bb8 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:40.571688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0a9bfd09-ef0c-4d77-9d1c-59b064eb2bb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:40.692993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bfd09-ef0c-4d77-9d1c-59b064eb2bb8 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:40.700857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c747c0-7665-4b9a-9e0d-300404b777ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:40.703476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c747c0-7665-4b9a-9e0d-300404b777ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:40.703984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c747c0-7665-4b9a-9e0d-300404b777ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:40.704498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c747c0-7665-4b9a-9e0d-300404b777ec admin admin] PATH_INFO: `/v3/users/365ef707d87d4d5d818a7e9388c65fa0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:40.707385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c747c0-7665-4b9a-9e0d-300404b777ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=365ef707d87d4d5d818a7e9388c65fa0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:40.710052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c747c0-7665-4b9a-9e0d-300404b777ec admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:40.800110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7c747c0-7665-4b9a-9e0d-300404b777ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '365ef707d87d4d5d818a7e9388c65fa0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:40.808228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7c747c0-7665-4b9a-9e0d-300404b777ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '365ef707d87d4d5d818a7e9388c65fa0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:40.824083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7c747c0-7665-4b9a-9e0d-300404b777ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '365ef707d87d4d5d818a7e9388c65fa0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:40.826348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7c747c0-7665-4b9a-9e0d-300404b777ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '365ef707d87d4d5d818a7e9388c65fa0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:40.827046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7c747c0-7665-4b9a-9e0d-300404b777ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '365ef707d87d4d5d818a7e9388c65fa0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:40.858422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:40.881055 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2104/4251] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:14:40 2022] DELETE /identity/v3/users/365ef707d87d4d5d818a7e9388c65fa0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:42.429793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a0fe4-4b6a-4df5-b81f-969a2b17f5e3 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:42.442138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a0fe4-4b6a-4df5-b81f-969a2b17f5e3 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:42.511439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5964224-030a-40fb-9962-dbbc61b0a84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:42.512617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5964224-030a-40fb-9962-dbbc61b0a84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:42.512781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5964224-030a-40fb-9962-dbbc61b0a84d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:42.513693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5964224-030a-40fb-9962-dbbc61b0a84d admin admin] PATH_INFO: `/v3/projects/27477995aa5c488bb3a2b414a540ceba` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:42.515197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5964224-030a-40fb-9962-dbbc61b0a84d admin admin] RBAC: Authorizing `identity:delete_project(project_id=27477995aa5c488bb3a2b414a540ceba)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:42.518249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5964224-030a-40fb-9962-dbbc61b0a84d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:42.585164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:42.610533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a5964224-030a-40fb-9962-dbbc61b0a84d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27477995aa5c488bb3a2b414a540ceba', 'request_id': 'req-a5964224-030a-40fb-9962-dbbc61b0a84d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:42.621060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a5964224-030a-40fb-9962-dbbc61b0a84d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27477995aa5c488bb3a2b414a540ceba', 'request_id': 'req-a5964224-030a-40fb-9962-dbbc61b0a84d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:42.630178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a5964224-030a-40fb-9962-dbbc61b0a84d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27477995aa5c488bb3a2b414a540ceba', 'request_id': 'req-a5964224-030a-40fb-9962-dbbc61b0a84d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:42.645781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a5964224-030a-40fb-9962-dbbc61b0a84d admin admin] The token cache is being invalidate because project 27477995aa5c488bb3a2b414a540ceba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:14:42.646076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a5964224-030a-40fb-9962-dbbc61b0a84d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:42.647193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a5964224-030a-40fb-9962-dbbc61b0a84d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:42.648861 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2148/4252] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:14:42 2022] DELETE /identity/v3/projects/27477995aa5c488bb3a2b414a540ceba => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:42.653991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482a34e-fad2-4e73-8231-07136ef8be4a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:42.654841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482a34e-fad2-4e73-8231-07136ef8be4a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:42.655124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482a34e-fad2-4e73-8231-07136ef8be4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:42.676596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1482a34e-fad2-4e73-8231-07136ef8be4a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:42.678165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1482a34e-fad2-4e73-8231-07136ef8be4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:42.768671 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2105/4253] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:14:42.769090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b4459-0f8c-4fc2-8a6a-9b260fec1a7e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:42.769464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b4459-0f8c-4fc2-8a6a-9b260fec1a7e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:42.769806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b4459-0f8c-4fc2-8a6a-9b260fec1a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:42.799212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bf7b4459-0f8c-4fc2-8a6a-9b260fec1a7e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:42.801098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bf7b4459-0f8c-4fc2-8a6a-9b260fec1a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:42.818066 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2149/4254] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:42.819877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482a34e-fad2-4e73-8231-07136ef8be4a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:42.834798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482a34e-fad2-4e73-8231-07136ef8be4a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:42.840887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c946ca1-7a0d-4758-a84e-d4e4f85c0ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:42.843383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c946ca1-7a0d-4758-a84e-d4e4f85c0ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:42.843707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c946ca1-7a0d-4758-a84e-d4e4f85c0ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:42.844122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c946ca1-7a0d-4758-a84e-d4e4f85c0ab1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:42.844874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c946ca1-7a0d-4758-a84e-d4e4f85c0ab1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:14:42.845181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c946ca1-7a0d-4758-a84e-d4e4f85c0ab1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:42.848782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c946ca1-7a0d-4758-a84e-d4e4f85c0ab1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:42.865246 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2106/4255] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:14:42.869530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b4459-0f8c-4fc2-8a6a-9b260fec1a7e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:42.883394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b4459-0f8c-4fc2-8a6a-9b260fec1a7e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:42.889722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff0e2f-2b1a-4b74-b522-979d1bdff71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:42.890596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff0e2f-2b1a-4b74-b522-979d1bdff71e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:42.890596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff0e2f-2b1a-4b74-b522-979d1bdff71e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:42.890848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff0e2f-2b1a-4b74-b522-979d1bdff71e admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:42.891721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff0e2f-2b1a-4b74-b522-979d1bdff71e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:42.896556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff0e2f-2b1a-4b74-b522-979d1bdff71e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:42.927427 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2150/4256] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:14:42 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:14:42.931679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c946ca1-7a0d-4758-a84e-d4e4f85c0ab1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:42.942967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c946ca1-7a0d-4758-a84e-d4e4f85c0ab1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:43.036664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20b9b1-7f9b-4633-97b3-42d1ed1f78cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:43.037725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20b9b1-7f9b-4633-97b3-42d1ed1f78cd admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:43.038065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20b9b1-7f9b-4633-97b3-42d1ed1f78cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:43.038409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20b9b1-7f9b-4633-97b3-42d1ed1f78cd admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:43.039587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20b9b1-7f9b-4633-97b3-42d1ed1f78cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:43.042369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20b9b1-7f9b-4633-97b3-42d1ed1f78cd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:43.082756 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2107/4257] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:14:42 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:14:43.083467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff0e2f-2b1a-4b74-b522-979d1bdff71e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:43.094955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff0e2f-2b1a-4b74-b522-979d1bdff71e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:43.101444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0db285-f612-43cb-a166-a8c212ef020a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:43.102214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0db285-f612-43cb-a166-a8c212ef020a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:43.102552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0db285-f612-43cb-a166-a8c212ef020a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:43.102888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0db285-f612-43cb-a166-a8c212ef020a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:43.103675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0db285-f612-43cb-a166-a8c212ef020a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:43.105501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0db285-f612-43cb-a166-a8c212ef020a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:43.119386 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2151/4258] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:14:43.123567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20b9b1-7f9b-4633-97b3-42d1ed1f78cd admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:43.136033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20b9b1-7f9b-4633-97b3-42d1ed1f78cd admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:43.142054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7fda-683e-4737-8e51-b1599dbe7f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:43.142540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7fda-683e-4737-8e51-b1599dbe7f1b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:43.142823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7fda-683e-4737-8e51-b1599dbe7f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:43.143097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7fda-683e-4737-8e51-b1599dbe7f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:43.143890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce7fda-683e-4737-8e51-b1599dbe7f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:43.146225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce7fda-683e-4737-8e51-b1599dbe7f1b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:43.159167 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2108/4259] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:14:43.163086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0db285-f612-43cb-a166-a8c212ef020a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:43.173504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0db285-f612-43cb-a166-a8c212ef020a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:43.179983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968b7a1-3544-4613-918f-cc567dde95b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:43.180978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968b7a1-3544-4613-918f-cc567dde95b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:43.181262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968b7a1-3544-4613-918f-cc567dde95b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:43.181536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968b7a1-3544-4613-918f-cc567dde95b1 admin admin] PATH_INFO: `/v3/projects/ebcb0a2922d64d6e8d0c4114e10b954d/users/649c6088b26049ba9a765be082f38259/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:43.230547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968b7a1-3544-4613-918f-cc567dde95b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebcb0a2922d64d6e8d0c4114e10b954d, user_id=649c6088b26049ba9a765be082f38259, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:43.236217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968b7a1-3544-4613-918f-cc567dde95b1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:43.267052 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2152/4260] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:14:43 2022] PUT /identity/v3/projects/ebcb0a2922d64d6e8d0c4114e10b954d/users/649c6088b26049ba9a765be082f38259/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:14:43.272572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436104ac-cc6d-41eb-953d-400b1e8c0f69 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:43.273183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436104ac-cc6d-41eb-953d-400b1e8c0f69 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:43.273708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436104ac-cc6d-41eb-953d-400b1e8c0f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:43.313882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-436104ac-cc6d-41eb-953d-400b1e8c0f69 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:43.315162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-436104ac-cc6d-41eb-953d-400b1e8c0f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:43.438221 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2109/4261] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:43.461820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968b7a1-3544-4613-918f-cc567dde95b1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:43.464778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3968b7a1-3544-4613-918f-cc567dde95b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:43.598289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968b7a1-3544-4613-918f-cc567dde95b1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:43.612287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300d1bf-8729-4845-b3c5-5a00a9efe36b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:43.613665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300d1bf-8729-4845-b3c5-5a00a9efe36b service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:43.615276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300d1bf-8729-4845-b3c5-5a00a9efe36b service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:43.615631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300d1bf-8729-4845-b3c5-5a00a9efe36b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:43.640084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300d1bf-8729-4845-b3c5-5a00a9efe36b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:43.643050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300d1bf-8729-4845-b3c5-5a00a9efe36b service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:43.676344 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2153/4262] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:14:45.300749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f55ff-980b-4bba-a133-9a134656ffa8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:45.301220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f55ff-980b-4bba-a133-9a134656ffa8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:45.301320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f55ff-980b-4bba-a133-9a134656ffa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:45.315072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:45.356631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bf6f55ff-980b-4bba-a133-9a134656ffa8 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:45.361482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bf6f55ff-980b-4bba-a133-9a134656ffa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:45.514560 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2110/4263] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:14:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:45.528959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300d1bf-8729-4845-b3c5-5a00a9efe36b service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:45.530409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d300d1bf-8729-4845-b3c5-5a00a9efe36b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:45.668359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:45.725290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300d1bf-8729-4845-b3c5-5a00a9efe36b service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:45.736426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f2928-27b4-4c15-a6bf-f9e4a6d685cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:45.737183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f2928-27b4-4c15-a6bf-f9e4a6d685cc service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:45.737576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f2928-27b4-4c15-a6bf-f9e4a6d685cc service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:45.737905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f2928-27b4-4c15-a6bf-f9e4a6d685cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:45.761494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f2928-27b4-4c15-a6bf-f9e4a6d685cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:45.765900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f2928-27b4-4c15-a6bf-f9e4a6d685cc service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:45.792018 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2154/4264] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:14:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:14:50.098826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775c65a-3873-4445-a99c-f6322af20da6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:50.100068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775c65a-3873-4445-a99c-f6322af20da6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:50.100830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775c65a-3873-4445-a99c-f6322af20da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:50.126871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-7775c65a-3873-4445-a99c-f6322af20da6 None None] MFA Rules not processed for user `0f5b2e7e4efe478abdc85fc51fa064de`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:50.134154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7775c65a-3873-4445-a99c-f6322af20da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:50.266246 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2111/4265] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:50.275909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985288d8-a5ae-4eb4-84ac-f16ed23c49b1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:50.276503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985288d8-a5ae-4eb4-84ac-f16ed23c49b1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:50.276503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985288d8-a5ae-4eb4-84ac-f16ed23c49b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:50.309373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-985288d8-a5ae-4eb4-84ac-f16ed23c49b1 None None] MFA Rules not processed for user `0f5b2e7e4efe478abdc85fc51fa064de`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:50.310907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-985288d8-a5ae-4eb4-84ac-f16ed23c49b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:50.343552 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2155/4266] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:57.310468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775c65a-3873-4445-a99c-f6322af20da6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:57.312068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7775c65a-3873-4445-a99c-f6322af20da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:57.338002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775c65a-3873-4445-a99c-f6322af20da6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:57.347587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97d205-3bf3-4a5f-aa6f-95e3ed07c1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:57.348714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97d205-3bf3-4a5f-aa6f-95e3ed07c1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:57.349061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97d205-3bf3-4a5f-aa6f-95e3ed07c1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:57.349401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97d205-3bf3-4a5f-aa6f-95e3ed07c1ae admin admin] PATH_INFO: `/v3/users/54460739a1234cad987fe9593d443afe` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:57.350686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97d205-3bf3-4a5f-aa6f-95e3ed07c1ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=54460739a1234cad987fe9593d443afe)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:57.354891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97d205-3bf3-4a5f-aa6f-95e3ed07c1ae admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:57.448433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8e97d205-3bf3-4a5f-aa6f-95e3ed07c1ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54460739a1234cad987fe9593d443afe'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:57.463349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8e97d205-3bf3-4a5f-aa6f-95e3ed07c1ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54460739a1234cad987fe9593d443afe'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:57.477634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8e97d205-3bf3-4a5f-aa6f-95e3ed07c1ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54460739a1234cad987fe9593d443afe'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:57.478676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8e97d205-3bf3-4a5f-aa6f-95e3ed07c1ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54460739a1234cad987fe9593d443afe'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:57.479918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8e97d205-3bf3-4a5f-aa6f-95e3ed07c1ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54460739a1234cad987fe9593d443afe'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:57.523126 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2112/4267] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:14:57 2022] DELETE /identity/v3/users/54460739a1234cad987fe9593d443afe => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:58.396551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985288d8-a5ae-4eb4-84ac-f16ed23c49b1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:58.411268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985288d8-a5ae-4eb4-84ac-f16ed23c49b1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:58.536670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c27ee1-94ef-48ca-9ecc-702875e3f58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:58.537560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c27ee1-94ef-48ca-9ecc-702875e3f58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:58.537840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c27ee1-94ef-48ca-9ecc-702875e3f58f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:58.538115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c27ee1-94ef-48ca-9ecc-702875e3f58f admin admin] PATH_INFO: `/v3/projects/f6facae2ace740f68128a626ba49e42a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:58.539328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c27ee1-94ef-48ca-9ecc-702875e3f58f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6facae2ace740f68128a626ba49e42a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:58.541323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c27ee1-94ef-48ca-9ecc-702875e3f58f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:58.603817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-90c27ee1-94ef-48ca-9ecc-702875e3f58f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6facae2ace740f68128a626ba49e42a', 'request_id': 'req-90c27ee1-94ef-48ca-9ecc-702875e3f58f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:58.619845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-90c27ee1-94ef-48ca-9ecc-702875e3f58f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6facae2ace740f68128a626ba49e42a', 'request_id': 'req-90c27ee1-94ef-48ca-9ecc-702875e3f58f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:58.628882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-90c27ee1-94ef-48ca-9ecc-702875e3f58f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6facae2ace740f68128a626ba49e42a', 'request_id': 'req-90c27ee1-94ef-48ca-9ecc-702875e3f58f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:58.654838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-90c27ee1-94ef-48ca-9ecc-702875e3f58f admin admin] The token cache is being invalidate because project f6facae2ace740f68128a626ba49e42a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:14:58.655144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-90c27ee1-94ef-48ca-9ecc-702875e3f58f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:58.655970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-90c27ee1-94ef-48ca-9ecc-702875e3f58f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:14:58.667163 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2156/4268] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:14:58 2022] DELETE /identity/v3/projects/f6facae2ace740f68128a626ba49e42a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:14:58.669526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66567e-4444-4f9e-a10a-6d71fe71503f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:58.670045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66567e-4444-4f9e-a10a-6d71fe71503f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:58.671006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66567e-4444-4f9e-a10a-6d71fe71503f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:58.691554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5d66567e-4444-4f9e-a10a-6d71fe71503f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:58.692955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5d66567e-4444-4f9e-a10a-6d71fe71503f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:58.721825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:58.772796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b0e5b-1fac-4d06-9523-0399a239ba02 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:58.773176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b0e5b-1fac-4d06-9523-0399a239ba02 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:58.773526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b0e5b-1fac-4d06-9523-0399a239ba02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:58.792496 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2113/4269] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:58.816848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f56b0e5b-1fac-4d06-9523-0399a239ba02 None None] MFA Rules not processed for user `649c6088b26049ba9a765be082f38259`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:58.818493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f56b0e5b-1fac-4d06-9523-0399a239ba02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:58.875274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a7f78-7d35-4282-8a5e-1d7968295274 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:58.875871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a7f78-7d35-4282-8a5e-1d7968295274 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:58.876283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a7f78-7d35-4282-8a5e-1d7968295274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:58.900367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-682a7f78-7d35-4282-8a5e-1d7968295274 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:58.900611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:58.902278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-682a7f78-7d35-4282-8a5e-1d7968295274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:58.914177 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2157/4270] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:58.921983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b0e5b-1fac-4d06-9523-0399a239ba02 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:58.923880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f56b0e5b-1fac-4d06-9523-0399a239ba02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:58.927498 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2114/4271] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:58.940628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a7f78-7d35-4282-8a5e-1d7968295274 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:58.955104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a7f78-7d35-4282-8a5e-1d7968295274 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:58.960541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056c081-bb02-4c9c-949a-0608e5925c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:58.961212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056c081-bb02-4c9c-949a-0608e5925c84 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:58.961682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056c081-bb02-4c9c-949a-0608e5925c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:58.962129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056c081-bb02-4c9c-949a-0608e5925c84 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:58.963035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056c081-bb02-4c9c-949a-0608e5925c84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:14:58.963515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056c081-bb02-4c9c-949a-0608e5925c84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:58.965398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056c081-bb02-4c9c-949a-0608e5925c84 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:58.996928 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2115/4272] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:14:59.000945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056c081-bb02-4c9c-949a-0608e5925c84 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:59.013130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056c081-bb02-4c9c-949a-0608e5925c84 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:59.019753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e365bd0-da65-4d54-ba8a-3f4df2494dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:59.021048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e365bd0-da65-4d54-ba8a-3f4df2494dfc admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:59.021544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e365bd0-da65-4d54-ba8a-3f4df2494dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:59.021983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e365bd0-da65-4d54-ba8a-3f4df2494dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:59.023697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b0e5b-1fac-4d06-9523-0399a239ba02 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:59.024545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e365bd0-da65-4d54-ba8a-3f4df2494dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:59.026978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c8754-edd1-4467-b54e-491c2d7da0db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:59.027957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c8754-edd1-4467-b54e-491c2d7da0db service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:59.028482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c8754-edd1-4467-b54e-491c2d7da0db service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:59.028854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c8754-edd1-4467-b54e-491c2d7da0db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:59.029813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e365bd0-da65-4d54-ba8a-3f4df2494dfc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:59.041840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c8754-edd1-4467-b54e-491c2d7da0db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:59.043924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c8754-edd1-4467-b54e-491c2d7da0db service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:59.068851 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2158/4273] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:14:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:14:59.073056 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2116/4274] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:14:58 2022] POST /identity/v3/projects => generated 395 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:14:59.074888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c8754-edd1-4467-b54e-491c2d7da0db service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:59.095420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c8754-edd1-4467-b54e-491c2d7da0db service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:59.191949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d843a-d82d-42cf-8927-80a11c4acb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:59.193312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d843a-d82d-42cf-8927-80a11c4acb51 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:59.193800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d843a-d82d-42cf-8927-80a11c4acb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:59.194922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d843a-d82d-42cf-8927-80a11c4acb51 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:59.196170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d843a-d82d-42cf-8927-80a11c4acb51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:59.198310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d843a-d82d-42cf-8927-80a11c4acb51 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:59.233715 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2159/4275] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:14:59 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:14:59.237947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e365bd0-da65-4d54-ba8a-3f4df2494dfc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:59.249195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e365bd0-da65-4d54-ba8a-3f4df2494dfc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:59.255428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cd717-5473-4fa1-b146-92ce83b71fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:59.257424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cd717-5473-4fa1-b146-92ce83b71fbd admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:59.257424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cd717-5473-4fa1-b146-92ce83b71fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:59.257424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cd717-5473-4fa1-b146-92ce83b71fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:59.258225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cd717-5473-4fa1-b146-92ce83b71fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:59.260828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cd717-5473-4fa1-b146-92ce83b71fbd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:59.279024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d843a-d82d-42cf-8927-80a11c4acb51 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:59.290270 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2117/4276] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:14:59.291168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d843a-d82d-42cf-8927-80a11c4acb51 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:59.297837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4c6b3-d894-41c8-b135-c05308e0234c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:59.298147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4c6b3-d894-41c8-b135-c05308e0234c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:59.298372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4c6b3-d894-41c8-b135-c05308e0234c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:59.299080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4c6b3-d894-41c8-b135-c05308e0234c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:59.299877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4c6b3-d894-41c8-b135-c05308e0234c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:59.302660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4c6b3-d894-41c8-b135-c05308e0234c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:59.319795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cd717-5473-4fa1-b146-92ce83b71fbd admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:14:59.331413 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2160/4277] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:14:59.332546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cd717-5473-4fa1-b146-92ce83b71fbd admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:14:59.350875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee4492-e94e-4630-9bdf-cb494cd3027d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:14:59.352448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee4492-e94e-4630-9bdf-cb494cd3027d admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:59.353550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee4492-e94e-4630-9bdf-cb494cd3027d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:59.354009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee4492-e94e-4630-9bdf-cb494cd3027d admin admin] PATH_INFO: `/v3/projects/4bcba662c7b648d39ac1d11cbc9762ed/users/63b4fe8dc61f479ba74ed1c03f918132/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:59.379804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee4492-e94e-4630-9bdf-cb494cd3027d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bcba662c7b648d39ac1d11cbc9762ed, user_id=63b4fe8dc61f479ba74ed1c03f918132, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:14:59.384763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee4492-e94e-4630-9bdf-cb494cd3027d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:14:59.412442 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2118/4278] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:14:59 2022] PUT /identity/v3/projects/4bcba662c7b648d39ac1d11cbc9762ed/users/63b4fe8dc61f479ba74ed1c03f918132/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:14:59.420292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d409c-8126-490b-8636-dda717b9d20c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:59.420292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d409c-8126-490b-8636-dda717b9d20c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:59.420292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d409c-8126-490b-8636-dda717b9d20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:59.465643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-912d409c-8126-490b-8636-dda717b9d20c None None] MFA Rules not processed for user `63b4fe8dc61f479ba74ed1c03f918132`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:59.467642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-912d409c-8126-490b-8636-dda717b9d20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:59.579753 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2161/4279] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:14:59.580079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787519e4-52db-4731-b4e9-35753b7ae3e0 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:14:59.580297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787519e4-52db-4731-b4e9-35753b7ae3e0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:14:59.580780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787519e4-52db-4731-b4e9-35753b7ae3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:14:59.641323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-787519e4-52db-4731-b4e9-35753b7ae3e0 None None] MFA Rules not processed for user `63b4fe8dc61f479ba74ed1c03f918132`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:14:59.643620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-787519e4-52db-4731-b4e9-35753b7ae3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:14:59.664007 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2119/4280] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:14:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:15:00.383959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d409c-8126-490b-8636-dda717b9d20c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:00.390108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-912d409c-8126-490b-8636-dda717b9d20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:00.410747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:00.499426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d409c-8126-490b-8636-dda717b9d20c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:00.525825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d102bd-950e-44c0-b055-d2f458f89f43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:00.529148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d102bd-950e-44c0-b055-d2f458f89f43 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:00.529619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d102bd-950e-44c0-b055-d2f458f89f43 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:00.530111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d102bd-950e-44c0-b055-d2f458f89f43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:00.557549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d102bd-950e-44c0-b055-d2f458f89f43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:00.563386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d102bd-950e-44c0-b055-d2f458f89f43 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:00.588242 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2162/4281] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:15:00.633242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b2e6c-6d97-44cd-986a-12bc9a844b15 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:00.634165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b2e6c-6d97-44cd-986a-12bc9a844b15 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:00.634635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b2e6c-6d97-44cd-986a-12bc9a844b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:00.678124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4f6b2e6c-6d97-44cd-986a-12bc9a844b15 None None] MFA Rules not processed for user `63b4fe8dc61f479ba74ed1c03f918132`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:00.679697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4f6b2e6c-6d97-44cd-986a-12bc9a844b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:00.717987 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2120/4282] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:01.442185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd46e3-3f3a-4039-91f4-ef218c676f8e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:01.442499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd46e3-3f3a-4039-91f4-ef218c676f8e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:01.442775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd46e3-3f3a-4039-91f4-ef218c676f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:01.501578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4fcd46e3-3f3a-4039-91f4-ef218c676f8e None None] MFA Rules not processed for user `63b4fe8dc61f479ba74ed1c03f918132`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:01.502906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4fcd46e3-3f3a-4039-91f4-ef218c676f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:01.535279 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2163/4283] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:02.049551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa87f03-ccda-4efd-922f-e2f864504cfa None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:02.050657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa87f03-ccda-4efd-922f-e2f864504cfa None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:02.051225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa87f03-ccda-4efd-922f-e2f864504cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:02.090729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-caa87f03-ccda-4efd-922f-e2f864504cfa None None] MFA Rules not processed for user `63b4fe8dc61f479ba74ed1c03f918132`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:02.092507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-caa87f03-ccda-4efd-922f-e2f864504cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:02.115823 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2121/4284] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:15:03.380209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb3363-1f44-4a4b-b773-5613ff63cf03 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:03.381624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb3363-1f44-4a4b-b773-5613ff63cf03 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:03.382212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb3363-1f44-4a4b-b773-5613ff63cf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:03.431067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8beb3363-1f44-4a4b-b773-5613ff63cf03 None None] MFA Rules not processed for user `63b4fe8dc61f479ba74ed1c03f918132`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:03.436680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8beb3363-1f44-4a4b-b773-5613ff63cf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:03.475167 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2164/4285] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:15:03.675463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6363c36-e3e8-4412-9a2f-7251529ec38b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:03.676439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6363c36-e3e8-4412-9a2f-7251529ec38b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:03.676869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6363c36-e3e8-4412-9a2f-7251529ec38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:03.709725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f6363c36-e3e8-4412-9a2f-7251529ec38b None None] MFA Rules not processed for user `649c6088b26049ba9a765be082f38259`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:03.712323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f6363c36-e3e8-4412-9a2f-7251529ec38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:03.829338 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2122/4286] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:04.171813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb3363-1f44-4a4b-b773-5613ff63cf03 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:04.179609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8beb3363-1f44-4a4b-b773-5613ff63cf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:04.195167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6363c36-e3e8-4412-9a2f-7251529ec38b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:04.311697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:04.380178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb3363-1f44-4a4b-b773-5613ff63cf03 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:04.382736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6363c36-e3e8-4412-9a2f-7251529ec38b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:04.388912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9807220-4e8f-491b-a0c7-2a807eee5184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:04.390732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9807220-4e8f-491b-a0c7-2a807eee5184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:04.391185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9807220-4e8f-491b-a0c7-2a807eee5184 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:04.391629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9807220-4e8f-491b-a0c7-2a807eee5184 admin admin] PATH_INFO: `/v3/users/63b4fe8dc61f479ba74ed1c03f918132` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:04.393502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9807220-4e8f-491b-a0c7-2a807eee5184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63b4fe8dc61f479ba74ed1c03f918132)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:04.395641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9807220-4e8f-491b-a0c7-2a807eee5184 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:04.396207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638a01d-a4aa-4a8a-85c2-ecd3c996b09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:04.397443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638a01d-a4aa-4a8a-85c2-ecd3c996b09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:04.397732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638a01d-a4aa-4a8a-85c2-ecd3c996b09b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:04.398003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638a01d-a4aa-4a8a-85c2-ecd3c996b09b admin admin] PATH_INFO: `/v3/users/6f727ff1b49246268c55900aa1cc3a1b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:04.399671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638a01d-a4aa-4a8a-85c2-ecd3c996b09b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f727ff1b49246268c55900aa1cc3a1b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:04.402624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638a01d-a4aa-4a8a-85c2-ecd3c996b09b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:04.485647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b9807220-4e8f-491b-a0c7-2a807eee5184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63b4fe8dc61f479ba74ed1c03f918132'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:04.528071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b9807220-4e8f-491b-a0c7-2a807eee5184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63b4fe8dc61f479ba74ed1c03f918132'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:04.545880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b9807220-4e8f-491b-a0c7-2a807eee5184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63b4fe8dc61f479ba74ed1c03f918132'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:04.546567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b9807220-4e8f-491b-a0c7-2a807eee5184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63b4fe8dc61f479ba74ed1c03f918132'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:04.547805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b9807220-4e8f-491b-a0c7-2a807eee5184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63b4fe8dc61f479ba74ed1c03f918132'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:04.551668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b638a01d-a4aa-4a8a-85c2-ecd3c996b09b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f727ff1b49246268c55900aa1cc3a1b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:04.570047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b638a01d-a4aa-4a8a-85c2-ecd3c996b09b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f727ff1b49246268c55900aa1cc3a1b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:04.572640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b638a01d-a4aa-4a8a-85c2-ecd3c996b09b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f727ff1b49246268c55900aa1cc3a1b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:04.574266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b638a01d-a4aa-4a8a-85c2-ecd3c996b09b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f727ff1b49246268c55900aa1cc3a1b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:04.584684 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2123/4287] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:15:04 2022] DELETE /identity/v3/users/63b4fe8dc61f479ba74ed1c03f918132 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:04.589828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40389951-337c-449b-9a2b-facc966a5b14 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:04.590135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40389951-337c-449b-9a2b-facc966a5b14 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:04.590390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40389951-337c-449b-9a2b-facc966a5b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:04.595721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b638a01d-a4aa-4a8a-85c2-ecd3c996b09b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f727ff1b49246268c55900aa1cc3a1b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:04.623298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-40389951-337c-449b-9a2b-facc966a5b14 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:04.624603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-40389951-337c-449b-9a2b-facc966a5b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:04.643485 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2165/4288] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:15:04 2022] DELETE /identity/v3/users/6f727ff1b49246268c55900aa1cc3a1b => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:15:04.650873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c092b73-6acd-43b9-8459-10be078f3031 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:04.651707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c092b73-6acd-43b9-8459-10be078f3031 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:04.652311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c092b73-6acd-43b9-8459-10be078f3031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:04.663906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:04.727779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7c092b73-6acd-43b9-8459-10be078f3031 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:04.734950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7c092b73-6acd-43b9-8459-10be078f3031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:04.815834 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2124/4289] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:04.915061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40389951-337c-449b-9a2b-facc966a5b14 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:04.917047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-40389951-337c-449b-9a2b-facc966a5b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:04.925249 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2166/4290] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:04.967696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c092b73-6acd-43b9-8459-10be078f3031 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:04.969963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7c092b73-6acd-43b9-8459-10be078f3031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:05.129324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40389951-337c-449b-9a2b-facc966a5b14 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:05.136942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:05.171369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c092b73-6acd-43b9-8459-10be078f3031 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:05.195340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76bfe5-f779-4cb6-a29c-0f4bf42b6dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:05.196884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76bfe5-f779-4cb6-a29c-0f4bf42b6dad service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:05.200072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76bfe5-f779-4cb6-a29c-0f4bf42b6dad service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:05.201900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76bfe5-f779-4cb6-a29c-0f4bf42b6dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:05.238798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76bfe5-f779-4cb6-a29c-0f4bf42b6dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:05.240294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76bfe5-f779-4cb6-a29c-0f4bf42b6dad service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:05.242767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012f4c2-ddf7-4e8b-a26b-ad575f0eb87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:05.243530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012f4c2-ddf7-4e8b-a26b-ad575f0eb87e service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:05.245583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012f4c2-ddf7-4e8b-a26b-ad575f0eb87e service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:05.245951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012f4c2-ddf7-4e8b-a26b-ad575f0eb87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:05.265186 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2167/4291] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:15:05.267465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012f4c2-ddf7-4e8b-a26b-ad575f0eb87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:05.272769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012f4c2-ddf7-4e8b-a26b-ad575f0eb87e service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:05.294211 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2125/4292] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:15:06.259497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76bfe5-f779-4cb6-a29c-0f4bf42b6dad service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:06.262911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9b76bfe5-f779-4cb6-a29c-0f4bf42b6dad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:06.283806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76bfe5-f779-4cb6-a29c-0f4bf42b6dad service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:06.291488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464612f2-f508-4745-b964-65f42039cf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:06.293404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464612f2-f508-4745-b964-65f42039cf72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:06.293928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464612f2-f508-4745-b964-65f42039cf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:06.294763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464612f2-f508-4745-b964-65f42039cf72 admin admin] PATH_INFO: `/v3/projects/4b21ffb35f1c4be7b4f58889b8be7fae` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:06.298352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464612f2-f508-4745-b964-65f42039cf72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b21ffb35f1c4be7b4f58889b8be7fae)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:06.303419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464612f2-f508-4745-b964-65f42039cf72 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:06.401746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-464612f2-f508-4745-b964-65f42039cf72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b21ffb35f1c4be7b4f58889b8be7fae', 'request_id': 'req-464612f2-f508-4745-b964-65f42039cf72'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:06.431415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-464612f2-f508-4745-b964-65f42039cf72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b21ffb35f1c4be7b4f58889b8be7fae', 'request_id': 'req-464612f2-f508-4745-b964-65f42039cf72'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:06.462577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-464612f2-f508-4745-b964-65f42039cf72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b21ffb35f1c4be7b4f58889b8be7fae', 'request_id': 'req-464612f2-f508-4745-b964-65f42039cf72'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:06.517960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-464612f2-f508-4745-b964-65f42039cf72 admin admin] The token cache is being invalidate because project 4b21ffb35f1c4be7b4f58889b8be7fae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:15:06.518304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-464612f2-f508-4745-b964-65f42039cf72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:06.519355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-464612f2-f508-4745-b964-65f42039cf72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:06.526731 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2168/4293] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:15:06 2022] DELETE /identity/v3/projects/4b21ffb35f1c4be7b4f58889b8be7fae => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:06.528400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012f4c2-ddf7-4e8b-a26b-ad575f0eb87e service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:06.546369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012f4c2-ddf7-4e8b-a26b-ad575f0eb87e service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:06.705482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc6a94-1669-42b8-8997-949374f62df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:06.707079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc6a94-1669-42b8-8997-949374f62df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:06.707377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc6a94-1669-42b8-8997-949374f62df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:06.707778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc6a94-1669-42b8-8997-949374f62df6 admin admin] PATH_INFO: `/v3/users/7d0751a5fe8e49b78d58e9d66deb306a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:06.709353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc6a94-1669-42b8-8997-949374f62df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d0751a5fe8e49b78d58e9d66deb306a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:06.711341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc6a94-1669-42b8-8997-949374f62df6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:06.837115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03fc6a94-1669-42b8-8997-949374f62df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d0751a5fe8e49b78d58e9d66deb306a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:06.856698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03fc6a94-1669-42b8-8997-949374f62df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d0751a5fe8e49b78d58e9d66deb306a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:06.868819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03fc6a94-1669-42b8-8997-949374f62df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d0751a5fe8e49b78d58e9d66deb306a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:06.869606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03fc6a94-1669-42b8-8997-949374f62df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d0751a5fe8e49b78d58e9d66deb306a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:06.872804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03fc6a94-1669-42b8-8997-949374f62df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d0751a5fe8e49b78d58e9d66deb306a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:06.923709 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2126/4294] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:15:06 2022] DELETE /identity/v3/users/7d0751a5fe8e49b78d58e9d66deb306a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:07.037609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464612f2-f508-4745-b964-65f42039cf72 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:07.039246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-464612f2-f508-4745-b964-65f42039cf72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:07.062956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464612f2-f508-4745-b964-65f42039cf72 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:07.126447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:07.186713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8c974-70cd-4309-84ee-8b32f02d5b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:07.188147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8c974-70cd-4309-84ee-8b32f02d5b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:07.188651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8c974-70cd-4309-84ee-8b32f02d5b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:07.189226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8c974-70cd-4309-84ee-8b32f02d5b44 admin admin] PATH_INFO: `/v3/projects/4bcba662c7b648d39ac1d11cbc9762ed` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:07.191737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8c974-70cd-4309-84ee-8b32f02d5b44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bcba662c7b648d39ac1d11cbc9762ed)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:07.195492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8c974-70cd-4309-84ee-8b32f02d5b44 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:07.274392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ebe8c974-70cd-4309-84ee-8b32f02d5b44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bcba662c7b648d39ac1d11cbc9762ed', 'request_id': 'req-ebe8c974-70cd-4309-84ee-8b32f02d5b44'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:07.289444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ebe8c974-70cd-4309-84ee-8b32f02d5b44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bcba662c7b648d39ac1d11cbc9762ed', 'request_id': 'req-ebe8c974-70cd-4309-84ee-8b32f02d5b44'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:07.300476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ebe8c974-70cd-4309-84ee-8b32f02d5b44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bcba662c7b648d39ac1d11cbc9762ed', 'request_id': 'req-ebe8c974-70cd-4309-84ee-8b32f02d5b44'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:07.316219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ebe8c974-70cd-4309-84ee-8b32f02d5b44 admin admin] The token cache is being invalidate because project 4bcba662c7b648d39ac1d11cbc9762ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:15:07.317369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ebe8c974-70cd-4309-84ee-8b32f02d5b44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:07.318277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ebe8c974-70cd-4309-84ee-8b32f02d5b44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:07.320978 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2169/4295] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:15:07 2022] DELETE /identity/v3/projects/4bcba662c7b648d39ac1d11cbc9762ed => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:07.329073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f3e51-88b1-43d9-986f-6ad8caaf22df None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:07.330745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f3e51-88b1-43d9-986f-6ad8caaf22df None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:07.331374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f3e51-88b1-43d9-986f-6ad8caaf22df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:07.373689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-335f3e51-88b1-43d9-986f-6ad8caaf22df None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:07.375384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-335f3e51-88b1-43d9-986f-6ad8caaf22df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:07.410178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:07.475637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea850b-51c3-4096-84b2-219c5a51508c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:07.475637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea850b-51c3-4096-84b2-219c5a51508c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:07.475991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea850b-51c3-4096-84b2-219c5a51508c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:07.480162 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2127/4296] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:07.530413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-13ea850b-51c3-4096-84b2-219c5a51508c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:07.532484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-13ea850b-51c3-4096-84b2-219c5a51508c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:07.549570 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2170/4297] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:07.552502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f3e51-88b1-43d9-986f-6ad8caaf22df None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:07.574465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f3e51-88b1-43d9-986f-6ad8caaf22df None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:07.592421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a051b3-5512-46bb-9791-a03f4a58d305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:07.593920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a051b3-5512-46bb-9791-a03f4a58d305 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:07.594356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a051b3-5512-46bb-9791-a03f4a58d305 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:07.595039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a051b3-5512-46bb-9791-a03f4a58d305 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:07.596476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a051b3-5512-46bb-9791-a03f4a58d305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:15:07.597687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a051b3-5512-46bb-9791-a03f4a58d305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:07.604735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a051b3-5512-46bb-9791-a03f4a58d305 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:07.666794 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2128/4298] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:15:07.667585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea850b-51c3-4096-84b2-219c5a51508c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:07.680686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea850b-51c3-4096-84b2-219c5a51508c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:07.695680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947f66c-5cac-4f53-a0eb-870ffec0d25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:07.696447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947f66c-5cac-4f53-a0eb-870ffec0d25d admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:07.696728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947f66c-5cac-4f53-a0eb-870ffec0d25d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:07.697061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947f66c-5cac-4f53-a0eb-870ffec0d25d admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:07.697765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947f66c-5cac-4f53-a0eb-870ffec0d25d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:07.699770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947f66c-5cac-4f53-a0eb-870ffec0d25d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:07.766739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a051b3-5512-46bb-9791-a03f4a58d305 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:07.767358 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2171/4299] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:15:07 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:15:07.779644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a051b3-5512-46bb-9791-a03f4a58d305 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:07.895011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87f9de-6e69-4d7e-8da0-73be7d80af90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:07.895747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87f9de-6e69-4d7e-8da0-73be7d80af90 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:07.896248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87f9de-6e69-4d7e-8da0-73be7d80af90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:07.896390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87f9de-6e69-4d7e-8da0-73be7d80af90 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:07.897046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87f9de-6e69-4d7e-8da0-73be7d80af90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:07.899221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87f9de-6e69-4d7e-8da0-73be7d80af90 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:07.905602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947f66c-5cac-4f53-a0eb-870ffec0d25d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:07.908507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a947f66c-5cac-4f53-a0eb-870ffec0d25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:07.933072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947f66c-5cac-4f53-a0eb-870ffec0d25d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:07.943883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39824c-be84-4ee9-8b3c-5310aa95d2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:07.945035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39824c-be84-4ee9-8b3c-5310aa95d2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:07.945319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39824c-be84-4ee9-8b3c-5310aa95d2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:07.945613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39824c-be84-4ee9-8b3c-5310aa95d2fb admin admin] PATH_INFO: `/v3/projects/02b73382dc7c47599c8e21d3b62d5728` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:07.957896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39824c-be84-4ee9-8b3c-5310aa95d2fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b73382dc7c47599c8e21d3b62d5728)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:07.967883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39824c-be84-4ee9-8b3c-5310aa95d2fb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:07.972291 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2129/4300] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:15:07 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:15:07.973374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87f9de-6e69-4d7e-8da0-73be7d80af90 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:07.993480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87f9de-6e69-4d7e-8da0-73be7d80af90 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:08.003208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc155983-7752-48c9-bfcb-e08b6217f25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:08.003907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc155983-7752-48c9-bfcb-e08b6217f25c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:08.004279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc155983-7752-48c9-bfcb-e08b6217f25c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:08.004675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc155983-7752-48c9-bfcb-e08b6217f25c admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:08.005872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc155983-7752-48c9-bfcb-e08b6217f25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:08.008288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc155983-7752-48c9-bfcb-e08b6217f25c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:08.041102 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2130/4301] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:08.043324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc155983-7752-48c9-bfcb-e08b6217f25c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:08.062865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc155983-7752-48c9-bfcb-e08b6217f25c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:08.081294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c39824c-be84-4ee9-8b3c-5310aa95d2fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b73382dc7c47599c8e21d3b62d5728', 'request_id': 'req-3c39824c-be84-4ee9-8b3c-5310aa95d2fb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:08.110415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c39824c-be84-4ee9-8b3c-5310aa95d2fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b73382dc7c47599c8e21d3b62d5728', 'request_id': 'req-3c39824c-be84-4ee9-8b3c-5310aa95d2fb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:08.173935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c39824c-be84-4ee9-8b3c-5310aa95d2fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b73382dc7c47599c8e21d3b62d5728', 'request_id': 'req-3c39824c-be84-4ee9-8b3c-5310aa95d2fb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:08.222634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c39824c-be84-4ee9-8b3c-5310aa95d2fb admin admin] The token cache is being invalidate because project 02b73382dc7c47599c8e21d3b62d5728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:15:08.223067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c39824c-be84-4ee9-8b3c-5310aa95d2fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:08.226560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c39824c-be84-4ee9-8b3c-5310aa95d2fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:08.233668 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2172/4302] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:15:07 2022] DELETE /identity/v3/projects/02b73382dc7c47599c8e21d3b62d5728 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:08.238888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd0c9d-ba8b-4d0a-9fe4-667dff4208d0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:08.239246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd0c9d-ba8b-4d0a-9fe4-667dff4208d0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:08.240756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd0c9d-ba8b-4d0a-9fe4-667dff4208d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:08.294902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7dfd0c9d-ba8b-4d0a-9fe4-667dff4208d0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:08.304815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7dfd0c9d-ba8b-4d0a-9fe4-667dff4208d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:08.307486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1bb77-a9e7-440d-9a31-759fd75c502a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:08.308949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1bb77-a9e7-440d-9a31-759fd75c502a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:08.310801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1bb77-a9e7-440d-9a31-759fd75c502a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:08.313268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1bb77-a9e7-440d-9a31-759fd75c502a admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:08.316028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1bb77-a9e7-440d-9a31-759fd75c502a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:08.329667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1bb77-a9e7-440d-9a31-759fd75c502a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:08.346040 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2173/4303] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:15:08.362605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de676d-b2ad-442d-b7d1-a7d47906bd6f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:08.363111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de676d-b2ad-442d-b7d1-a7d47906bd6f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:08.373951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de676d-b2ad-442d-b7d1-a7d47906bd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:08.404448 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2131/4304] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:08.415287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1bb77-a9e7-440d-9a31-759fd75c502a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:08.425327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-adb1bb77-a9e7-440d-9a31-759fd75c502a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:08.471042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:08.492025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f4de676d-b2ad-442d-b7d1-a7d47906bd6f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:08.493331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f4de676d-b2ad-442d-b7d1-a7d47906bd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:08.514467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1bb77-a9e7-440d-9a31-759fd75c502a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:08.533959 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2174/4305] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:08.534928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de676d-b2ad-442d-b7d1-a7d47906bd6f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:08.543786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c379f-d12c-4d13-8f78-4652e4353edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:08.544976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c379f-d12c-4d13-8f78-4652e4353edd admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:08.545394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c379f-d12c-4d13-8f78-4652e4353edd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:08.545774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c379f-d12c-4d13-8f78-4652e4353edd admin admin] PATH_INFO: `/v3/projects/d505023bb41e4c7cb4f65f6ff69c121e/users/af79a7ef254d4df1806f6b5c2f91a4c3/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:08.556460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de676d-b2ad-442d-b7d1-a7d47906bd6f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:08.577348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edff742-09c6-4804-8bf6-b05d7d1a9b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:08.578052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edff742-09c6-4804-8bf6-b05d7d1a9b75 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:08.578330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edff742-09c6-4804-8bf6-b05d7d1a9b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:08.578607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edff742-09c6-4804-8bf6-b05d7d1a9b75 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:08.579682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edff742-09c6-4804-8bf6-b05d7d1a9b75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:15:08.579996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edff742-09c6-4804-8bf6-b05d7d1a9b75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:08.589301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edff742-09c6-4804-8bf6-b05d7d1a9b75 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:08.594558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c379f-d12c-4d13-8f78-4652e4353edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d505023bb41e4c7cb4f65f6ff69c121e, user_id=af79a7ef254d4df1806f6b5c2f91a4c3, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:08.602014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c379f-d12c-4d13-8f78-4652e4353edd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:08.632673 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2175/4306] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:15:08.638831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edff742-09c6-4804-8bf6-b05d7d1a9b75 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:08.641113 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2132/4307] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:15:08 2022] PUT /identity/v3/projects/d505023bb41e4c7cb4f65f6ff69c121e/users/af79a7ef254d4df1806f6b5c2f91a4c3/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:08.644741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d057f4-d808-4331-be02-75652d18377e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:08.645170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d057f4-d808-4331-be02-75652d18377e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:08.646032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d057f4-d808-4331-be02-75652d18377e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:08.683615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edff742-09c6-4804-8bf6-b05d7d1a9b75 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:08.689505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-30d057f4-d808-4331-be02-75652d18377e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:08.693623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-30d057f4-d808-4331-be02-75652d18377e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:08.701684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:08.855633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9948dde-21c8-4a11-ac9e-9cea36713d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:08.857838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9948dde-21c8-4a11-ac9e-9cea36713d97 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:08.857838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9948dde-21c8-4a11-ac9e-9cea36713d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:08.857838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9948dde-21c8-4a11-ac9e-9cea36713d97 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:08.858173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9948dde-21c8-4a11-ac9e-9cea36713d97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:08.860432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9948dde-21c8-4a11-ac9e-9cea36713d97 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:08.881029 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2133/4308] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:08.899591 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2176/4309] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:15:08 2022] POST /identity/v3/projects => generated 373 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:15:08.903951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d057f4-d808-4331-be02-75652d18377e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:08.914852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d057f4-d808-4331-be02-75652d18377e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:08.923334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9948dde-21c8-4a11-ac9e-9cea36713d97 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:08.929137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a9948dde-21c8-4a11-ac9e-9cea36713d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:09.036944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9948dde-21c8-4a11-ac9e-9cea36713d97 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:09.043650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89885113-da3b-4570-b4d1-5834e6c2570e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:09.044416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89885113-da3b-4570-b4d1-5834e6c2570e service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:09.044722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89885113-da3b-4570-b4d1-5834e6c2570e service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:09.044978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89885113-da3b-4570-b4d1-5834e6c2570e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:09.049425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410bef5-58a4-4333-847c-3544a6d79600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:09.050495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410bef5-58a4-4333-847c-3544a6d79600 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:09.051812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410bef5-58a4-4333-847c-3544a6d79600 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:09.056086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410bef5-58a4-4333-847c-3544a6d79600 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:09.057600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410bef5-58a4-4333-847c-3544a6d79600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:09.058294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89885113-da3b-4570-b4d1-5834e6c2570e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:09.059868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89885113-da3b-4570-b4d1-5834e6c2570e service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:09.061119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410bef5-58a4-4333-847c-3544a6d79600 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:09.073143 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2177/4310] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:15:09.106636 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2134/4311] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:15:08 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:15:09.112883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89885113-da3b-4570-b4d1-5834e6c2570e service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:09.129038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89885113-da3b-4570-b4d1-5834e6c2570e service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:09.136105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29193a66-f9a5-4c3a-acf0-58fa48bae81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:09.136887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29193a66-f9a5-4c3a-acf0-58fa48bae81a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:09.137199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29193a66-f9a5-4c3a-acf0-58fa48bae81a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:09.138407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29193a66-f9a5-4c3a-acf0-58fa48bae81a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:09.138762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29193a66-f9a5-4c3a-acf0-58fa48bae81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:09.140958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29193a66-f9a5-4c3a-acf0-58fa48bae81a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:09.172189 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2178/4312] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:09.174215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410bef5-58a4-4333-847c-3544a6d79600 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:09.194310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410bef5-58a4-4333-847c-3544a6d79600 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:09.199844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad3e25-87d0-4940-b2f9-f118393ab2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:09.200673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad3e25-87d0-4940-b2f9-f118393ab2be admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:09.201050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad3e25-87d0-4940-b2f9-f118393ab2be admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:09.201465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad3e25-87d0-4940-b2f9-f118393ab2be admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:09.202301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad3e25-87d0-4940-b2f9-f118393ab2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:09.204434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad3e25-87d0-4940-b2f9-f118393ab2be admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:09.226027 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2135/4313] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:09.226746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29193a66-f9a5-4c3a-acf0-58fa48bae81a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:09.241976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29193a66-f9a5-4c3a-acf0-58fa48bae81a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:09.269280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d183c1-14c9-4e5a-a002-cf0c94c51614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:09.270184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d183c1-14c9-4e5a-a002-cf0c94c51614 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:09.270444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d183c1-14c9-4e5a-a002-cf0c94c51614 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:09.270824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d183c1-14c9-4e5a-a002-cf0c94c51614 admin admin] PATH_INFO: `/v3/projects/19872a49ec264233a46bd7efb908f2ba/users/ad75c47e5e1f4d3ea6f7643eff6c9e0d/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:09.301051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d183c1-14c9-4e5a-a002-cf0c94c51614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19872a49ec264233a46bd7efb908f2ba, user_id=ad75c47e5e1f4d3ea6f7643eff6c9e0d, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:09.306766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d183c1-14c9-4e5a-a002-cf0c94c51614 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:09.340344 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2179/4314] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:15:09 2022] PUT /identity/v3/projects/19872a49ec264233a46bd7efb908f2ba/users/ad75c47e5e1f4d3ea6f7643eff6c9e0d/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:15:09.351900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ecb73-6985-4a06-8f55-1a0e6dab6b78 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:09.352350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ecb73-6985-4a06-8f55-1a0e6dab6b78 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:09.352472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ecb73-6985-4a06-8f55-1a0e6dab6b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:09.440346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-039ecb73-6985-4a06-8f55-1a0e6dab6b78 None None] MFA Rules not processed for user `ad75c47e5e1f4d3ea6f7643eff6c9e0d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:09.442898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-039ecb73-6985-4a06-8f55-1a0e6dab6b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:09.622175 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2136/4315] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:09.625905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d183c1-14c9-4e5a-a002-cf0c94c51614 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:09.767087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:09.851730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d183c1-14c9-4e5a-a002-cf0c94c51614 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:09.860858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8b8c1-c812-4dff-9d73-ef85f55edae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:09.861789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8b8c1-c812-4dff-9d73-ef85f55edae9 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:09.862071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8b8c1-c812-4dff-9d73-ef85f55edae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:09.862350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8b8c1-c812-4dff-9d73-ef85f55edae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:09.863132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8b8c1-c812-4dff-9d73-ef85f55edae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:09.865560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8b8c1-c812-4dff-9d73-ef85f55edae9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:09.913708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ecb73-6985-4a06-8f55-1a0e6dab6b78 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:09.923514 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2180/4316] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:15:09 2022] POST /identity/v3/projects => generated 375 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:15:09.930098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ecb73-6985-4a06-8f55-1a0e6dab6b78 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:09.951528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:10.035415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b285d-546b-449f-b4fc-00678e084061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:10.036403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b285d-546b-449f-b4fc-00678e084061 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:10.036777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b285d-546b-449f-b4fc-00678e084061 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:10.037125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b285d-546b-449f-b4fc-00678e084061 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:10.037919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b285d-546b-449f-b4fc-00678e084061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:10.040426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b285d-546b-449f-b4fc-00678e084061 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:10.073418 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2137/4317] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:15:09 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:15:10.080608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8b8c1-c812-4dff-9d73-ef85f55edae9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:10.095499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8b8c1-c812-4dff-9d73-ef85f55edae9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:10.102657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d216671-4a50-42c3-b1ce-ac820ae192fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:10.103463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d216671-4a50-42c3-b1ce-ac820ae192fd admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:10.103811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d216671-4a50-42c3-b1ce-ac820ae192fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:10.104175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d216671-4a50-42c3-b1ce-ac820ae192fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:10.105108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d216671-4a50-42c3-b1ce-ac820ae192fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:10.106955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d216671-4a50-42c3-b1ce-ac820ae192fd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:10.124805 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2181/4318] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:10.128949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b285d-546b-449f-b4fc-00678e084061 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:10.154539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b285d-546b-449f-b4fc-00678e084061 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:10.169443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e117b99-f05f-4c31-bf2d-cc632c9ff4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:10.170600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e117b99-f05f-4c31-bf2d-cc632c9ff4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:10.171039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e117b99-f05f-4c31-bf2d-cc632c9ff4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:10.171481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e117b99-f05f-4c31-bf2d-cc632c9ff4c8 admin admin] PATH_INFO: `/v3/projects/b7bfed6e7f5b4de7bb25083eeb325eac/users/c202a89922e04728ae40298a2f36538e/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:10.215836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e117b99-f05f-4c31-bf2d-cc632c9ff4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7bfed6e7f5b4de7bb25083eeb325eac, user_id=c202a89922e04728ae40298a2f36538e, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:10.219337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e117b99-f05f-4c31-bf2d-cc632c9ff4c8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:10.246700 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2138/4319] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:15:10 2022] PUT /identity/v3/projects/b7bfed6e7f5b4de7bb25083eeb325eac/users/c202a89922e04728ae40298a2f36538e/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:10.250704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d216671-4a50-42c3-b1ce-ac820ae192fd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:10.276166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d216671-4a50-42c3-b1ce-ac820ae192fd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:10.381149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf9be9-8e39-4971-b469-6f59531ae65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:10.382978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf9be9-8e39-4971-b469-6f59531ae65f admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:10.383496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf9be9-8e39-4971-b469-6f59531ae65f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:10.388243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf9be9-8e39-4971-b469-6f59531ae65f admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:10.389026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf9be9-8e39-4971-b469-6f59531ae65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:10.391282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf9be9-8e39-4971-b469-6f59531ae65f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:10.412889 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2182/4320] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:10.413452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e117b99-f05f-4c31-bf2d-cc632c9ff4c8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:10.425605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e117b99-f05f-4c31-bf2d-cc632c9ff4c8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:10.434298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ebe59-6f1d-4c61-98a9-17e22fc99c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:10.435020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ebe59-6f1d-4c61-98a9-17e22fc99c06 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:10.435469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ebe59-6f1d-4c61-98a9-17e22fc99c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:10.435747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ebe59-6f1d-4c61-98a9-17e22fc99c06 admin admin] PATH_INFO: `/v3/projects/b7bfed6e7f5b4de7bb25083eeb325eac/users/c202a89922e04728ae40298a2f36538e/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:10.439291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ebe59-6f1d-4c61-98a9-17e22fc99c06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7bfed6e7f5b4de7bb25083eeb325eac, user_id=c202a89922e04728ae40298a2f36538e, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:10.442513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ebe59-6f1d-4c61-98a9-17e22fc99c06 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:10.464143 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2139/4321] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:15:10 2022] PUT /identity/v3/projects/b7bfed6e7f5b4de7bb25083eeb325eac/users/c202a89922e04728ae40298a2f36538e/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:15:10.474369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaf4d0-bcea-411e-98fe-375c159d21d3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:10.474369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaf4d0-bcea-411e-98fe-375c159d21d3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:10.475962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaf4d0-bcea-411e-98fe-375c159d21d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:10.508347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5dcaf4d0-bcea-411e-98fe-375c159d21d3 None None] MFA Rules not processed for user `c202a89922e04728ae40298a2f36538e`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:10.509514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5dcaf4d0-bcea-411e-98fe-375c159d21d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:10.617337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76d2c4-2a11-4a08-b643-2ebeb499de45 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:10.617873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76d2c4-2a11-4a08-b643-2ebeb499de45 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:10.618716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76d2c4-2a11-4a08-b643-2ebeb499de45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:10.629848 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2183/4322] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:10.641191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-eb76d2c4-2a11-4a08-b643-2ebeb499de45 None None] MFA Rules not processed for user `ad75c47e5e1f4d3ea6f7643eff6c9e0d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:10.642744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-eb76d2c4-2a11-4a08-b643-2ebeb499de45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:10.731302 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2140/4323] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:12.965083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaf4d0-bcea-411e-98fe-375c159d21d3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:12.969327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5dcaf4d0-bcea-411e-98fe-375c159d21d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:13.054096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:13.115662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaf4d0-bcea-411e-98fe-375c159d21d3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:13.123903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42644671-c6ca-4dc7-8256-452b4da87d4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:13.124986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42644671-c6ca-4dc7-8256-452b4da87d4d service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:13.125686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42644671-c6ca-4dc7-8256-452b4da87d4d service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:13.126182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42644671-c6ca-4dc7-8256-452b4da87d4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:13.152281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42644671-c6ca-4dc7-8256-452b4da87d4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:13.154828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42644671-c6ca-4dc7-8256-452b4da87d4d service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:13.171406 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2184/4324] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:15:18.973563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75922645-d6ad-409a-9ab6-89d98b101e7c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:18.975252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75922645-d6ad-409a-9ab6-89d98b101e7c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:18.975546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75922645-d6ad-409a-9ab6-89d98b101e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:19.053217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-75922645-d6ad-409a-9ab6-89d98b101e7c None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:19.055335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-75922645-d6ad-409a-9ab6-89d98b101e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:19.247461 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2141/4325] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:15:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:19.280743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42644671-c6ca-4dc7-8256-452b4da87d4d service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:19.283062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-42644671-c6ca-4dc7-8256-452b4da87d4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:19.421194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42644671-c6ca-4dc7-8256-452b4da87d4d service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:19.430481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f1736-8527-4b4a-8887-2090dd6e7cf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:19.431467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f1736-8527-4b4a-8887-2090dd6e7cf6 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:19.431914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f1736-8527-4b4a-8887-2090dd6e7cf6 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:19.432596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f1736-8527-4b4a-8887-2090dd6e7cf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:19.472718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f1736-8527-4b4a-8887-2090dd6e7cf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:19.474523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f1736-8527-4b4a-8887-2090dd6e7cf6 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:19.498267 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2185/4326] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:15:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:15:24.639328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75922645-d6ad-409a-9ab6-89d98b101e7c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:24.641442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-75922645-d6ad-409a-9ab6-89d98b101e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:24.660859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75922645-d6ad-409a-9ab6-89d98b101e7c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:24.667429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded8208-0de8-46b7-a8bf-928e3fa097f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:24.668475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded8208-0de8-46b7-a8bf-928e3fa097f0 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:24.668951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded8208-0de8-46b7-a8bf-928e3fa097f0 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:24.669400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded8208-0de8-46b7-a8bf-928e3fa097f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:24.671435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3ded8208-0de8-46b7-a8bf-928e3fa097f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:24.700199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:24.802668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded8208-0de8-46b7-a8bf-928e3fa097f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:24.804917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded8208-0de8-46b7-a8bf-928e3fa097f0 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:24.876940 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2142/4327] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:15:25.892912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2f58e-df15-437e-be93-e2a93e8211c6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:25.894155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2f58e-df15-437e-be93-e2a93e8211c6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:25.894847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2f58e-df15-437e-be93-e2a93e8211c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:25.961378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-92d2f58e-df15-437e-be93-e2a93e8211c6 None None] MFA Rules not processed for user `af79a7ef254d4df1806f6b5c2f91a4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:25.964756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-92d2f58e-df15-437e-be93-e2a93e8211c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:26.136620 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2186/4328] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:26.147440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff9f41-41a4-4eb4-8a6c-e2d3c99f672e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:26.148016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff9f41-41a4-4eb4-8a6c-e2d3c99f672e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:26.148016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff9f41-41a4-4eb4-8a6c-e2d3c99f672e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:26.179316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-13ff9f41-41a4-4eb4-8a6c-e2d3c99f672e None None] MFA Rules not processed for user `af79a7ef254d4df1806f6b5c2f91a4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:26.181129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-13ff9f41-41a4-4eb4-8a6c-e2d3c99f672e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:26.189578 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2143/4329] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:27.487220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2f58e-df15-437e-be93-e2a93e8211c6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:27.502572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2f58e-df15-437e-be93-e2a93e8211c6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:27.517068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52a53f-7fa4-49c6-aa50-9b675a3eefb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:27.517896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52a53f-7fa4-49c6-aa50-9b675a3eefb3 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:27.519672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52a53f-7fa4-49c6-aa50-9b675a3eefb3 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:27.520919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52a53f-7fa4-49c6-aa50-9b675a3eefb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:27.537508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52a53f-7fa4-49c6-aa50-9b675a3eefb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:27.539397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52a53f-7fa4-49c6-aa50-9b675a3eefb3 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:27.552625 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2187/4330] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:15:36.165830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=22 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:37.545390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:45.157860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff9f41-41a4-4eb4-8a6c-e2d3c99f672e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:45.172077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-13ff9f41-41a4-4eb4-8a6c-e2d3c99f672e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:45.258298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff9f41-41a4-4eb4-8a6c-e2d3c99f672e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:45.265667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb108584-26f6-439c-b9f4-e035057bb758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:45.266914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb108584-26f6-439c-b9f4-e035057bb758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:45.267404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb108584-26f6-439c-b9f4-e035057bb758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:45.267869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb108584-26f6-439c-b9f4-e035057bb758 admin admin] PATH_INFO: `/v3/users/1badf76d64734107b7c05c42413fb192` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:45.269362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb108584-26f6-439c-b9f4-e035057bb758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1badf76d64734107b7c05c42413fb192)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:45.272171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb108584-26f6-439c-b9f4-e035057bb758 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:45.370969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cb108584-26f6-439c-b9f4-e035057bb758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1badf76d64734107b7c05c42413fb192'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:45.388451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cb108584-26f6-439c-b9f4-e035057bb758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1badf76d64734107b7c05c42413fb192'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:45.426965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cb108584-26f6-439c-b9f4-e035057bb758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1badf76d64734107b7c05c42413fb192'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:45.428715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cb108584-26f6-439c-b9f4-e035057bb758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1badf76d64734107b7c05c42413fb192'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:45.429562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cb108584-26f6-439c-b9f4-e035057bb758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1badf76d64734107b7c05c42413fb192'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:45.464732 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2144/4331] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:15:45 2022] DELETE /identity/v3/users/1badf76d64734107b7c05c42413fb192 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:45.466458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57548147-11d1-4698-a289-2c9fe31ac926 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:45.467459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57548147-11d1-4698-a289-2c9fe31ac926 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:45.467734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57548147-11d1-4698-a289-2c9fe31ac926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:45.517538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-57548147-11d1-4698-a289-2c9fe31ac926 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:45.519659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-57548147-11d1-4698-a289-2c9fe31ac926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:45.662270 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2188/4332] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:45.672951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb108584-26f6-439c-b9f4-e035057bb758 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:45.674522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cb108584-26f6-439c-b9f4-e035057bb758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:45.814621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb108584-26f6-439c-b9f4-e035057bb758 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:45.823215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a3a19-9160-454d-aafd-77bc5563ab69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:45.824695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a3a19-9160-454d-aafd-77bc5563ab69 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:45.824979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a3a19-9160-454d-aafd-77bc5563ab69 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:45.827403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a3a19-9160-454d-aafd-77bc5563ab69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:45.853143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a3a19-9160-454d-aafd-77bc5563ab69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:45.863752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a3a19-9160-454d-aafd-77bc5563ab69 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:45.884686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57548147-11d1-4698-a289-2c9fe31ac926 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:45.886343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-57548147-11d1-4698-a289-2c9fe31ac926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:45.901755 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2145/4333] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:15:45.902932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57548147-11d1-4698-a289-2c9fe31ac926 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:45.927893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34508c8-67b6-4119-b768-868f83178d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:45.930904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34508c8-67b6-4119-b768-868f83178d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:45.931190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34508c8-67b6-4119-b768-868f83178d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:45.931471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34508c8-67b6-4119-b768-868f83178d56 admin admin] PATH_INFO: `/v3/users/da701099fee44f03824febc2034358fa` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:45.939391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34508c8-67b6-4119-b768-868f83178d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da701099fee44f03824febc2034358fa)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:45.941435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34508c8-67b6-4119-b768-868f83178d56 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:46.042118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c34508c8-67b6-4119-b768-868f83178d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da701099fee44f03824febc2034358fa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:46.069275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c34508c8-67b6-4119-b768-868f83178d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da701099fee44f03824febc2034358fa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:46.070772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c34508c8-67b6-4119-b768-868f83178d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da701099fee44f03824febc2034358fa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:46.071619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c34508c8-67b6-4119-b768-868f83178d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da701099fee44f03824febc2034358fa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:46.085971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c34508c8-67b6-4119-b768-868f83178d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da701099fee44f03824febc2034358fa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:46.133440 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2189/4334] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:15:45 2022] DELETE /identity/v3/users/da701099fee44f03824febc2034358fa => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:46.514412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a3a19-9160-454d-aafd-77bc5563ab69 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:46.515873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-727a3a19-9160-454d-aafd-77bc5563ab69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:46.531013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a3a19-9160-454d-aafd-77bc5563ab69 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:46.570020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:46.644158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f81df8-7d88-459a-941c-0d703b282417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:46.646065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f81df8-7d88-459a-941c-0d703b282417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:46.646682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f81df8-7d88-459a-941c-0d703b282417 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:46.647134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f81df8-7d88-459a-941c-0d703b282417 admin admin] PATH_INFO: `/v3/projects/b9c2863e9580421e909babc1b6f00052` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:46.657246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f81df8-7d88-459a-941c-0d703b282417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9c2863e9580421e909babc1b6f00052)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:46.659658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f81df8-7d88-459a-941c-0d703b282417 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:46.926929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-63f81df8-7d88-459a-941c-0d703b282417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9c2863e9580421e909babc1b6f00052', 'request_id': 'req-63f81df8-7d88-459a-941c-0d703b282417'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:46.935543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-63f81df8-7d88-459a-941c-0d703b282417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9c2863e9580421e909babc1b6f00052', 'request_id': 'req-63f81df8-7d88-459a-941c-0d703b282417'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:46.956065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-63f81df8-7d88-459a-941c-0d703b282417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9c2863e9580421e909babc1b6f00052', 'request_id': 'req-63f81df8-7d88-459a-941c-0d703b282417'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:46.994580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-63f81df8-7d88-459a-941c-0d703b282417 admin admin] The token cache is being invalidate because project b9c2863e9580421e909babc1b6f00052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:15:46.994907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-63f81df8-7d88-459a-941c-0d703b282417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:46.999458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-63f81df8-7d88-459a-941c-0d703b282417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:47.009089 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2146/4335] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:15:46 2022] DELETE /identity/v3/projects/b9c2863e9580421e909babc1b6f00052 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:47.010898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5382e-04d0-4806-8d7a-3727327c5025 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:47.011309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5382e-04d0-4806-8d7a-3727327c5025 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:47.011419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5382e-04d0-4806-8d7a-3727327c5025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:47.043517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fda5382e-04d0-4806-8d7a-3727327c5025 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:47.044807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fda5382e-04d0-4806-8d7a-3727327c5025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:47.178749 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2190/4336] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:47.186846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a083a22-0417-445a-994e-3fdadfd297fb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:47.187154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a083a22-0417-445a-994e-3fdadfd297fb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:47.187453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a083a22-0417-445a-994e-3fdadfd297fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:47.222453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5a083a22-0417-445a-994e-3fdadfd297fb None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:47.230953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5a083a22-0417-445a-994e-3fdadfd297fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:47.247456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5382e-04d0-4806-8d7a-3727327c5025 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:47.250340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fda5382e-04d0-4806-8d7a-3727327c5025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:47.276475 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2147/4337] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:47.280110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a083a22-0417-445a-994e-3fdadfd297fb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:47.296626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5382e-04d0-4806-8d7a-3727327c5025 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:47.300178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a083a22-0417-445a-994e-3fdadfd297fb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:47.309509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71630a-194f-4530-8feb-179cc15cffe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:47.310480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71630a-194f-4530-8feb-179cc15cffe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:47.311504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71630a-194f-4530-8feb-179cc15cffe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:47.312674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71630a-194f-4530-8feb-179cc15cffe6 admin admin] PATH_INFO: `/v3/projects/ae35822336ca48cd9f497419d0226268` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:47.313740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e48af-8c9e-4edf-9fa5-185b833e1fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:47.314570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e48af-8c9e-4edf-9fa5-185b833e1fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:47.314914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e48af-8c9e-4edf-9fa5-185b833e1fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:47.315289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e48af-8c9e-4edf-9fa5-185b833e1fb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:47.315855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71630a-194f-4530-8feb-179cc15cffe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae35822336ca48cd9f497419d0226268)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:47.316171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e48af-8c9e-4edf-9fa5-185b833e1fb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:15:47.322485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71630a-194f-4530-8feb-179cc15cffe6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:47.328559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e48af-8c9e-4edf-9fa5-185b833e1fb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:47.334701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e48af-8c9e-4edf-9fa5-185b833e1fb4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:47.335978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:47.392797 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2148/4338] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:15:47.395190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e48af-8c9e-4edf-9fa5-185b833e1fb4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:47.414223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4c71630a-194f-4530-8feb-179cc15cffe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae35822336ca48cd9f497419d0226268', 'request_id': 'req-4c71630a-194f-4530-8feb-179cc15cffe6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:47.419848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e48af-8c9e-4edf-9fa5-185b833e1fb4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:47.425661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4c71630a-194f-4530-8feb-179cc15cffe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae35822336ca48cd9f497419d0226268', 'request_id': 'req-4c71630a-194f-4530-8feb-179cc15cffe6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:47.436757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4c71630a-194f-4530-8feb-179cc15cffe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae35822336ca48cd9f497419d0226268', 'request_id': 'req-4c71630a-194f-4530-8feb-179cc15cffe6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:47.452973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4c71630a-194f-4530-8feb-179cc15cffe6 admin admin] The token cache is being invalidate because project ae35822336ca48cd9f497419d0226268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:15:47.453482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4c71630a-194f-4530-8feb-179cc15cffe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:47.454565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4c71630a-194f-4530-8feb-179cc15cffe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:47.457558 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2191/4339] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:15:47 2022] DELETE /identity/v3/projects/ae35822336ca48cd9f497419d0226268 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:15:47.462754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5884dc-5187-4d4b-a32c-bb77743771ba None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:47.464545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5884dc-5187-4d4b-a32c-bb77743771ba None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:47.465025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5884dc-5187-4d4b-a32c-bb77743771ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:47.504755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9f5884dc-5187-4d4b-a32c-bb77743771ba None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:47.506416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9f5884dc-5187-4d4b-a32c-bb77743771ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:47.513957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ce35d-801a-4d69-9f08-02899b911ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:47.514627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ce35d-801a-4d69-9f08-02899b911ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:47.515240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ce35d-801a-4d69-9f08-02899b911ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:47.515240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ce35d-801a-4d69-9f08-02899b911ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:47.516282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ce35d-801a-4d69-9f08-02899b911ec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:47.518151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ce35d-801a-4d69-9f08-02899b911ec1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:47.566460 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2149/4340] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:15:47 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:15:47.569448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ce35d-801a-4d69-9f08-02899b911ec1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:47.571084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-525ce35d-801a-4d69-9f08-02899b911ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:47.577847 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2192/4341] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:47.586120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:47.586306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c0c51-0b1c-46fb-aff8-0cca05564bd0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:47.587381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c0c51-0b1c-46fb-aff8-0cca05564bd0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:47.588196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c0c51-0b1c-46fb-aff8-0cca05564bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:47.608013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c01c0c51-0b1c-46fb-aff8-0cca05564bd0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:47.609274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c01c0c51-0b1c-46fb-aff8-0cca05564bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:47.652308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ce35d-801a-4d69-9f08-02899b911ec1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:47.658014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f874aca-9df5-4fb3-95ec-aeee442ba2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:47.667389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f874aca-9df5-4fb3-95ec-aeee442ba2ec admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:47.667821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f874aca-9df5-4fb3-95ec-aeee442ba2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:47.668131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f874aca-9df5-4fb3-95ec-aeee442ba2ec admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:47.668847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f874aca-9df5-4fb3-95ec-aeee442ba2ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:47.670783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f874aca-9df5-4fb3-95ec-aeee442ba2ec admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:47.677321 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2193/4342] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:15:47.682440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c0c51-0b1c-46fb-aff8-0cca05564bd0 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:47.693943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c0c51-0b1c-46fb-aff8-0cca05564bd0 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:47.700932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2491432-be1f-4331-8f62-dc8c55a525af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:47.702083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2491432-be1f-4331-8f62-dc8c55a525af admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:47.702525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2491432-be1f-4331-8f62-dc8c55a525af admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:47.703013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2491432-be1f-4331-8f62-dc8c55a525af admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:47.704271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2491432-be1f-4331-8f62-dc8c55a525af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:15:47.704910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2491432-be1f-4331-8f62-dc8c55a525af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:47.708283 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2150/4343] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:15:47 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:15:47.708655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2491432-be1f-4331-8f62-dc8c55a525af admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:47.712775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f874aca-9df5-4fb3-95ec-aeee442ba2ec admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:47.726889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f874aca-9df5-4fb3-95ec-aeee442ba2ec admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:47.732248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74261ee-e48f-4144-819c-1f99cee71131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:47.732944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74261ee-e48f-4144-819c-1f99cee71131 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:47.733226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74261ee-e48f-4144-819c-1f99cee71131 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:47.733497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74261ee-e48f-4144-819c-1f99cee71131 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:47.734322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74261ee-e48f-4144-819c-1f99cee71131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:47.736145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74261ee-e48f-4144-819c-1f99cee71131 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:47.745962 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2194/4344] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:15:47.748126 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2151/4345] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:47.750383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2491432-be1f-4331-8f62-dc8c55a525af admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:47.751823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74261ee-e48f-4144-819c-1f99cee71131 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:47.761739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2491432-be1f-4331-8f62-dc8c55a525af admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:47.763330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74261ee-e48f-4144-819c-1f99cee71131 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:47.767699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e954c8-ab56-4be7-b67e-110728757df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:47.768408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e954c8-ab56-4be7-b67e-110728757df3 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:47.768623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94296b-352d-41f9-98aa-5c180b9d926b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:47.768785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e954c8-ab56-4be7-b67e-110728757df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:47.768945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e954c8-ab56-4be7-b67e-110728757df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:47.769292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94296b-352d-41f9-98aa-5c180b9d926b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:47.769588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94296b-352d-41f9-98aa-5c180b9d926b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:47.769714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e954c8-ab56-4be7-b67e-110728757df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:47.769843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94296b-352d-41f9-98aa-5c180b9d926b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:47.770562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94296b-352d-41f9-98aa-5c180b9d926b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:47.771672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e954c8-ab56-4be7-b67e-110728757df3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:47.772177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94296b-352d-41f9-98aa-5c180b9d926b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:47.785620 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2152/4346] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:47.792882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94296b-352d-41f9-98aa-5c180b9d926b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:47.803007 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2195/4347] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:15:47 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:15:47.806458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94296b-352d-41f9-98aa-5c180b9d926b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:47.807711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e954c8-ab56-4be7-b67e-110728757df3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:47.813084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:47.873959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4cda5-b948-47f4-be7d-49e19b89ba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:47.875207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4cda5-b948-47f4-be7d-49e19b89ba58 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:47.875494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4cda5-b948-47f4-be7d-49e19b89ba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:47.876733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4cda5-b948-47f4-be7d-49e19b89ba58 admin admin] PATH_INFO: `/v3/projects/3450bf6c92624a0ab9d21441456bf16a/users/5994e251d365416b8e0be24a671175d4/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:47.889517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e954c8-ab56-4be7-b67e-110728757df3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:47.892326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4cda5-b948-47f4-be7d-49e19b89ba58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3450bf6c92624a0ab9d21441456bf16a, user_id=5994e251d365416b8e0be24a671175d4, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:47.895009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4cda5-b948-47f4-be7d-49e19b89ba58 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:47.895551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cd767-6df0-4fb2-bc90-62c84ba8207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:47.896467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cd767-6df0-4fb2-bc90-62c84ba8207f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:47.896912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cd767-6df0-4fb2-bc90-62c84ba8207f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:47.897479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cd767-6df0-4fb2-bc90-62c84ba8207f admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:47.898827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cd767-6df0-4fb2-bc90-62c84ba8207f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:47.901079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cd767-6df0-4fb2-bc90-62c84ba8207f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:47.916153 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2153/4348] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:15:47 2022] PUT /identity/v3/projects/3450bf6c92624a0ab9d21441456bf16a/users/5994e251d365416b8e0be24a671175d4/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:47.921641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59034519-e656-4ca6-bc25-d59dc4ccdc2c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:47.921934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59034519-e656-4ca6-bc25-d59dc4ccdc2c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:47.922220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59034519-e656-4ca6-bc25-d59dc4ccdc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:47.925657 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2196/4349] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:15:47 2022] POST /identity/v3/users => generated 283 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:15:47.929927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cd767-6df0-4fb2-bc90-62c84ba8207f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:47.940206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cd767-6df0-4fb2-bc90-62c84ba8207f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:47.954790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-59034519-e656-4ca6-bc25-d59dc4ccdc2c None None] MFA Rules not processed for user `5994e251d365416b8e0be24a671175d4`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:47.956391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-59034519-e656-4ca6-bc25-d59dc4ccdc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:48.002611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c273702-c1e5-48dc-8609-4423fb86b042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:48.003939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c273702-c1e5-48dc-8609-4423fb86b042 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:48.004325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c273702-c1e5-48dc-8609-4423fb86b042 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:48.005173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c273702-c1e5-48dc-8609-4423fb86b042 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:48.005479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c273702-c1e5-48dc-8609-4423fb86b042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:48.007784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c273702-c1e5-48dc-8609-4423fb86b042 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:48.018700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:48.021962 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2197/4350] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:48.023037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c273702-c1e5-48dc-8609-4423fb86b042 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:48.035632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c273702-c1e5-48dc-8609-4423fb86b042 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:48.044277 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2154/4351] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:48.047987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50192279-ee89-45c7-8086-231bf0e2c37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:48.048918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50192279-ee89-45c7-8086-231bf0e2c37b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:48.049296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50192279-ee89-45c7-8086-231bf0e2c37b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:48.049677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50192279-ee89-45c7-8086-231bf0e2c37b admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:48.050486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50192279-ee89-45c7-8086-231bf0e2c37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:48.052235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50192279-ee89-45c7-8086-231bf0e2c37b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:48.056698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59034519-e656-4ca6-bc25-d59dc4ccdc2c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:48.058129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-59034519-e656-4ca6-bc25-d59dc4ccdc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:48.069276 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2198/4352] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:48.076905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50192279-ee89-45c7-8086-231bf0e2c37b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:48.098900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50192279-ee89-45c7-8086-231bf0e2c37b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:48.117025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a36ad-a0e5-4be1-9fc3-8eb0fa160fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:48.118132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a36ad-a0e5-4be1-9fc3-8eb0fa160fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:48.118451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a36ad-a0e5-4be1-9fc3-8eb0fa160fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:48.118691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a36ad-a0e5-4be1-9fc3-8eb0fa160fcc admin admin] PATH_INFO: `/v3/projects/b2cb5a5828464cbca51a02bc6d54cbef/users/f60806c651164a679e1f4dcb0321f782/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:48.140108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a36ad-a0e5-4be1-9fc3-8eb0fa160fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2cb5a5828464cbca51a02bc6d54cbef, user_id=f60806c651164a679e1f4dcb0321f782, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:48.142867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a36ad-a0e5-4be1-9fc3-8eb0fa160fcc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:48.149841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59034519-e656-4ca6-bc25-d59dc4ccdc2c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:48.158370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de1d2b-e1f6-4e3d-abed-f22faa72793f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:48.159262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de1d2b-e1f6-4e3d-abed-f22faa72793f service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:48.159519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de1d2b-e1f6-4e3d-abed-f22faa72793f service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:48.159879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de1d2b-e1f6-4e3d-abed-f22faa72793f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:48.180209 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2199/4353] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:15:48 2022] PUT /identity/v3/projects/b2cb5a5828464cbca51a02bc6d54cbef/users/f60806c651164a679e1f4dcb0321f782/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:48.192225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22545a3e-d45b-40b3-931f-4a0c7b37d6b9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:48.192708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22545a3e-d45b-40b3-931f-4a0c7b37d6b9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:48.193161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22545a3e-d45b-40b3-931f-4a0c7b37d6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:48.194425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de1d2b-e1f6-4e3d-abed-f22faa72793f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:48.197501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de1d2b-e1f6-4e3d-abed-f22faa72793f service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:48.225214 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2155/4354] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:15:48.248321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-22545a3e-d45b-40b3-931f-4a0c7b37d6b9 None None] MFA Rules not processed for user `f60806c651164a679e1f4dcb0321f782`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:48.250813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-22545a3e-d45b-40b3-931f-4a0c7b37d6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:48.300195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:48.330918 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2200/4355] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:48.344576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de1d2b-e1f6-4e3d-abed-f22faa72793f service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:48.346870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-60de1d2b-e1f6-4e3d-abed-f22faa72793f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:48.445458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de1d2b-e1f6-4e3d-abed-f22faa72793f service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:48.522883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdc81b-3ece-479f-9607-52384f3d3f4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:48.523585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdc81b-3ece-479f-9607-52384f3d3f4e service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:48.524610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdc81b-3ece-479f-9607-52384f3d3f4e service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:48.524905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdc81b-3ece-479f-9607-52384f3d3f4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:48.535512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdc81b-3ece-479f-9607-52384f3d3f4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:48.537316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdc81b-3ece-479f-9607-52384f3d3f4e service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:48.547513 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2156/4356] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:15:48.590427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22545a3e-d45b-40b3-931f-4a0c7b37d6b9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:48.666042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdc81b-3ece-479f-9607-52384f3d3f4e service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:48.698189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:48.706650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22545a3e-d45b-40b3-931f-4a0c7b37d6b9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:48.712030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9da40-fdfb-4131-b5fc-9cc5e5204ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:48.713193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9da40-fdfb-4131-b5fc-9cc5e5204ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:48.713629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9da40-fdfb-4131-b5fc-9cc5e5204ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:48.714003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9da40-fdfb-4131-b5fc-9cc5e5204ea7 admin admin] PATH_INFO: `/v3/users/f60806c651164a679e1f4dcb0321f782` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:48.715360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9da40-fdfb-4131-b5fc-9cc5e5204ea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f60806c651164a679e1f4dcb0321f782)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:48.717640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9da40-fdfb-4131-b5fc-9cc5e5204ea7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:48.786741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdc81b-3ece-479f-9607-52384f3d3f4e service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:48.794924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0077147-1d52-4241-ac7a-45011ee86ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:48.814587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0077147-1d52-4241-ac7a-45011ee86ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:48.816413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0077147-1d52-4241-ac7a-45011ee86ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:48.824251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0077147-1d52-4241-ac7a-45011ee86ed5 admin admin] PATH_INFO: `/v3/users/5994e251d365416b8e0be24a671175d4` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:48.826983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0077147-1d52-4241-ac7a-45011ee86ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5994e251d365416b8e0be24a671175d4)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:48.828962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0077147-1d52-4241-ac7a-45011ee86ed5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:48.842460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cfd9da40-fdfb-4131-b5fc-9cc5e5204ea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f60806c651164a679e1f4dcb0321f782'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:48.856161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cfd9da40-fdfb-4131-b5fc-9cc5e5204ea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f60806c651164a679e1f4dcb0321f782'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:48.858077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cfd9da40-fdfb-4131-b5fc-9cc5e5204ea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f60806c651164a679e1f4dcb0321f782'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:48.859156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cfd9da40-fdfb-4131-b5fc-9cc5e5204ea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f60806c651164a679e1f4dcb0321f782'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:48.870864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cfd9da40-fdfb-4131-b5fc-9cc5e5204ea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f60806c651164a679e1f4dcb0321f782'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:48.914235 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2201/4357] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:15:48 2022] DELETE /identity/v3/users/f60806c651164a679e1f4dcb0321f782 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:48.918355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58aaa3-3491-4292-a80f-826b7a868b33 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:48.918644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58aaa3-3491-4292-a80f-826b7a868b33 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:48.918921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58aaa3-3491-4292-a80f-826b7a868b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:48.941113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c0077147-1d52-4241-ac7a-45011ee86ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5994e251d365416b8e0be24a671175d4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:48.941980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8c58aaa3-3491-4292-a80f-826b7a868b33 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:48.943386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8c58aaa3-3491-4292-a80f-826b7a868b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:48.964233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c0077147-1d52-4241-ac7a-45011ee86ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5994e251d365416b8e0be24a671175d4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:48.981546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c0077147-1d52-4241-ac7a-45011ee86ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5994e251d365416b8e0be24a671175d4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:48.983938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c0077147-1d52-4241-ac7a-45011ee86ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5994e251d365416b8e0be24a671175d4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:48.985299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c0077147-1d52-4241-ac7a-45011ee86ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5994e251d365416b8e0be24a671175d4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:49.017504 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2157/4358] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:15:48 2022] DELETE /identity/v3/users/5994e251d365416b8e0be24a671175d4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:49.022082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdef6a0-3e35-4119-85ce-24cac451e268 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:49.022370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdef6a0-3e35-4119-85ce-24cac451e268 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:49.022645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdef6a0-3e35-4119-85ce-24cac451e268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:49.046528 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2202/4359] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:49.057637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58aaa3-3491-4292-a80f-826b7a868b33 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:49.059403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8c58aaa3-3491-4292-a80f-826b7a868b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:49.067931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8cdef6a0-3e35-4119-85ce-24cac451e268 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:49.070164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:49.072176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8cdef6a0-3e35-4119-85ce-24cac451e268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:49.188012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58aaa3-3491-4292-a80f-826b7a868b33 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:49.216622 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2158/4360] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:49.226968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdef6a0-3e35-4119-85ce-24cac451e268 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:49.267273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08043f3-eebf-40ad-a617-692aa566a7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:49.270203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08043f3-eebf-40ad-a617-692aa566a7af service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:49.270203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08043f3-eebf-40ad-a617-692aa566a7af service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:49.270203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08043f3-eebf-40ad-a617-692aa566a7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:49.286416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08043f3-eebf-40ad-a617-692aa566a7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:49.289751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08043f3-eebf-40ad-a617-692aa566a7af service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:49.295091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:49.306081 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2203/4361] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:15:49.332282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdef6a0-3e35-4119-85ce-24cac451e268 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:49.339690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdf8ae-8895-444d-89a0-48b6442b94f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:49.340873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdf8ae-8895-444d-89a0-48b6442b94f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:49.341265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdf8ae-8895-444d-89a0-48b6442b94f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:49.342420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdf8ae-8895-444d-89a0-48b6442b94f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:49.357666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abdf8ae-8895-444d-89a0-48b6442b94f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:49.359531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abdf8ae-8895-444d-89a0-48b6442b94f5 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:49.374375 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2159/4362] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:15:50.239143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08043f3-eebf-40ad-a617-692aa566a7af service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:50.244465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c08043f3-eebf-40ad-a617-692aa566a7af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:50.282019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08043f3-eebf-40ad-a617-692aa566a7af service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:50.298521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf499b4-1c69-4d0c-a17e-8f796159eb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:50.302538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf499b4-1c69-4d0c-a17e-8f796159eb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:50.307058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf499b4-1c69-4d0c-a17e-8f796159eb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:50.307886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf499b4-1c69-4d0c-a17e-8f796159eb2e admin admin] PATH_INFO: `/v3/projects/b2cb5a5828464cbca51a02bc6d54cbef` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:50.314543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf499b4-1c69-4d0c-a17e-8f796159eb2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2cb5a5828464cbca51a02bc6d54cbef)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:50.316787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf499b4-1c69-4d0c-a17e-8f796159eb2e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:50.353644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdf8ae-8895-444d-89a0-48b6442b94f5 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:50.355345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6abdf8ae-8895-444d-89a0-48b6442b94f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:50.378298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdf8ae-8895-444d-89a0-48b6442b94f5 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:50.395079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a10cb-d518-4412-947c-35e730cdc073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:50.396083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a10cb-d518-4412-947c-35e730cdc073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:50.396657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a10cb-d518-4412-947c-35e730cdc073 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:50.397241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a10cb-d518-4412-947c-35e730cdc073 admin admin] PATH_INFO: `/v3/projects/3450bf6c92624a0ab9d21441456bf16a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:50.399023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a10cb-d518-4412-947c-35e730cdc073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3450bf6c92624a0ab9d21441456bf16a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:50.401338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a10cb-d518-4412-947c-35e730cdc073 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:50.431401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ecf499b4-1c69-4d0c-a17e-8f796159eb2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2cb5a5828464cbca51a02bc6d54cbef', 'request_id': 'req-ecf499b4-1c69-4d0c-a17e-8f796159eb2e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:50.453961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ecf499b4-1c69-4d0c-a17e-8f796159eb2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2cb5a5828464cbca51a02bc6d54cbef', 'request_id': 'req-ecf499b4-1c69-4d0c-a17e-8f796159eb2e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:50.467094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ecf499b4-1c69-4d0c-a17e-8f796159eb2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2cb5a5828464cbca51a02bc6d54cbef', 'request_id': 'req-ecf499b4-1c69-4d0c-a17e-8f796159eb2e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:50.504014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ecf499b4-1c69-4d0c-a17e-8f796159eb2e admin admin] The token cache is being invalidate because project b2cb5a5828464cbca51a02bc6d54cbef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:15:50.504453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ecf499b4-1c69-4d0c-a17e-8f796159eb2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:50.507562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ecf499b4-1c69-4d0c-a17e-8f796159eb2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:50.516300 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2204/4363] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:15:50 2022] DELETE /identity/v3/projects/b2cb5a5828464cbca51a02bc6d54cbef => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:50.518654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0eabe-12e0-4454-80b5-44b74cb0e773 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:50.519031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0eabe-12e0-4454-80b5-44b74cb0e773 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:50.519414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0eabe-12e0-4454-80b5-44b74cb0e773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:50.523771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-619a10cb-d518-4412-947c-35e730cdc073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3450bf6c92624a0ab9d21441456bf16a', 'request_id': 'req-619a10cb-d518-4412-947c-35e730cdc073'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:50.540522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-619a10cb-d518-4412-947c-35e730cdc073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3450bf6c92624a0ab9d21441456bf16a', 'request_id': 'req-619a10cb-d518-4412-947c-35e730cdc073'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:50.557881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-619a10cb-d518-4412-947c-35e730cdc073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3450bf6c92624a0ab9d21441456bf16a', 'request_id': 'req-619a10cb-d518-4412-947c-35e730cdc073'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:50.565161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b4f0eabe-12e0-4454-80b5-44b74cb0e773 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:50.575795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b4f0eabe-12e0-4454-80b5-44b74cb0e773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:50.593711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-619a10cb-d518-4412-947c-35e730cdc073 admin admin] The token cache is being invalidate because project 3450bf6c92624a0ab9d21441456bf16a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:15:50.593971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-619a10cb-d518-4412-947c-35e730cdc073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:50.594672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-619a10cb-d518-4412-947c-35e730cdc073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:50.596668 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2160/4364] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:15:50 2022] DELETE /identity/v3/projects/3450bf6c92624a0ab9d21441456bf16a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:15:50.601934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc57b89-9ccb-4f15-9715-fda29e14bfc9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:50.601934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc57b89-9ccb-4f15-9715-fda29e14bfc9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:50.602196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc57b89-9ccb-4f15-9715-fda29e14bfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:50.641316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9dc57b89-9ccb-4f15-9715-fda29e14bfc9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:50.642697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9dc57b89-9ccb-4f15-9715-fda29e14bfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:50.692733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:50.730565 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2205/4365] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:50.732638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83bbe3-dd0b-42fb-b28d-3fe9e28e1b3f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:50.733022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83bbe3-dd0b-42fb-b28d-3fe9e28e1b3f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:50.733559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83bbe3-dd0b-42fb-b28d-3fe9e28e1b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:50.772967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-be83bbe3-dd0b-42fb-b28d-3fe9e28e1b3f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:50.774293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-be83bbe3-dd0b-42fb-b28d-3fe9e28e1b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:50.786597 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2206/4366] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:50.786813 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2161/4367] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:15:50.794412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc57b89-9ccb-4f15-9715-fda29e14bfc9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:50.795649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dea5c-da7a-4395-a371-f0378460c78f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:50.801566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dea5c-da7a-4395-a371-f0378460c78f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:50.802453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dea5c-da7a-4395-a371-f0378460c78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:50.810813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc57b89-9ccb-4f15-9715-fda29e14bfc9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:50.819997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eecb2a-914b-4e28-87e5-82cd3a298bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:50.820830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eecb2a-914b-4e28-87e5-82cd3a298bbe admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:50.821341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eecb2a-914b-4e28-87e5-82cd3a298bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:50.822033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eecb2a-914b-4e28-87e5-82cd3a298bbe admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:50.822997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eecb2a-914b-4e28-87e5-82cd3a298bbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:15:50.823485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eecb2a-914b-4e28-87e5-82cd3a298bbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:50.836398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eecb2a-914b-4e28-87e5-82cd3a298bbe admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:50.879391 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2162/4368] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:15:50.880900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-251dea5c-da7a-4395-a371-f0378460c78f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:50.882169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-251dea5c-da7a-4395-a371-f0378460c78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:50.884315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eecb2a-914b-4e28-87e5-82cd3a298bbe admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:50.899407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eecb2a-914b-4e28-87e5-82cd3a298bbe admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:50.906893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfba197-318c-44b2-a8e0-7f1cb783a44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:50.907927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfba197-318c-44b2-a8e0-7f1cb783a44b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:50.908413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfba197-318c-44b2-a8e0-7f1cb783a44b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:50.908943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfba197-318c-44b2-a8e0-7f1cb783a44b admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:50.910120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfba197-318c-44b2-a8e0-7f1cb783a44b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:50.910744 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2207/4369] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:50.912721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfba197-318c-44b2-a8e0-7f1cb783a44b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:50.914821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dea5c-da7a-4395-a371-f0378460c78f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:50.929393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dea5c-da7a-4395-a371-f0378460c78f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:50.935460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14a30b-129c-4368-aca5-20017175cb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:50.936529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14a30b-129c-4368-aca5-20017175cb5d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:50.938798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14a30b-129c-4368-aca5-20017175cb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:50.939081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14a30b-129c-4368-aca5-20017175cb5d admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:50.940151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14a30b-129c-4368-aca5-20017175cb5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:15:50.940151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14a30b-129c-4368-aca5-20017175cb5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:50.941711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14a30b-129c-4368-aca5-20017175cb5d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:50.949622 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2163/4370] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:15:50 2022] POST /identity/v3/projects => generated 361 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:15:50.953726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfba197-318c-44b2-a8e0-7f1cb783a44b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:50.962321 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2208/4371] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:15:50.966633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14a30b-129c-4368-aca5-20017175cb5d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:50.977527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14a30b-129c-4368-aca5-20017175cb5d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:50.988652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:51.029970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfba197-318c-44b2-a8e0-7f1cb783a44b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:51.036434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea196a6-f8ba-4e27-ac18-39929dd64dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:51.037110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea196a6-f8ba-4e27-ac18-39929dd64dfa admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:51.037678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea196a6-f8ba-4e27-ac18-39929dd64dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:51.037678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea196a6-f8ba-4e27-ac18-39929dd64dfa admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:51.038338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea196a6-f8ba-4e27-ac18-39929dd64dfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:51.040557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea196a6-f8ba-4e27-ac18-39929dd64dfa admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:51.044797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af4287-3275-4442-8b22-2b858245eed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:51.045606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af4287-3275-4442-8b22-2b858245eed5 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:51.045806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af4287-3275-4442-8b22-2b858245eed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:51.046432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af4287-3275-4442-8b22-2b858245eed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:51.047152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af4287-3275-4442-8b22-2b858245eed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:51.049544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af4287-3275-4442-8b22-2b858245eed5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:51.069468 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2164/4372] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:15:50 2022] POST /identity/v3/users => generated 281 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:15:51.073322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea196a6-f8ba-4e27-ac18-39929dd64dfa admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:51.083631 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2209/4373] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:15:50 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:15:51.085338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea196a6-f8ba-4e27-ac18-39929dd64dfa admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:51.087503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af4287-3275-4442-8b22-2b858245eed5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:51.154670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe31710-6e23-48e0-8479-11fdc789073f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:51.155562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe31710-6e23-48e0-8479-11fdc789073f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:51.155811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe31710-6e23-48e0-8479-11fdc789073f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:51.156189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe31710-6e23-48e0-8479-11fdc789073f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:51.157061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe31710-6e23-48e0-8479-11fdc789073f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:51.158877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe31710-6e23-48e0-8479-11fdc789073f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:51.168174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af4287-3275-4442-8b22-2b858245eed5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:51.173043 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2165/4374] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:15:51.173634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac520e-777f-4ff2-85df-a6e84bc4aecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:51.174387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac520e-777f-4ff2-85df-a6e84bc4aecd admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:51.174737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac520e-777f-4ff2-85df-a6e84bc4aecd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:51.175079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac520e-777f-4ff2-85df-a6e84bc4aecd admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:51.176940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac520e-777f-4ff2-85df-a6e84bc4aecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:51.177315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe31710-6e23-48e0-8479-11fdc789073f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:51.179724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac520e-777f-4ff2-85df-a6e84bc4aecd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:51.192930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe31710-6e23-48e0-8479-11fdc789073f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:51.201217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1334c-8edc-4b63-b4e2-de7806150c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:51.203899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1334c-8edc-4b63-b4e2-de7806150c9a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:51.204888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1334c-8edc-4b63-b4e2-de7806150c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:51.210495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1334c-8edc-4b63-b4e2-de7806150c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:51.210495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1334c-8edc-4b63-b4e2-de7806150c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:51.210495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1334c-8edc-4b63-b4e2-de7806150c9a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:51.211157 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2210/4375] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:15:51 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:15:51.212166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac520e-777f-4ff2-85df-a6e84bc4aecd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:51.223836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac520e-777f-4ff2-85df-a6e84bc4aecd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:51.228331 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2166/4376] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:15:51.229202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c96cff-46dd-459a-99a6-4bdec8eae35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:51.229955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c96cff-46dd-459a-99a6-4bdec8eae35c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:51.230335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c96cff-46dd-459a-99a6-4bdec8eae35c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:51.230707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c96cff-46dd-459a-99a6-4bdec8eae35c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:51.231704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c96cff-46dd-459a-99a6-4bdec8eae35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:51.233640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c96cff-46dd-459a-99a6-4bdec8eae35c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:51.236699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1334c-8edc-4b63-b4e2-de7806150c9a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:51.245477 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2211/4377] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:51.250382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c96cff-46dd-459a-99a6-4bdec8eae35c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:51.254389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1334c-8edc-4b63-b4e2-de7806150c9a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:51.260684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6304f-5c95-400d-885e-01006921e615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:51.261964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6304f-5c95-400d-885e-01006921e615 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:51.262343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6304f-5c95-400d-885e-01006921e615 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:51.262883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6304f-5c95-400d-885e-01006921e615 admin admin] PATH_INFO: `/v3/projects/df27a9c6c999443c8a1cf0d689cf9527/users/97e41048cd8141b5b3bbc1e42eb382cb/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:51.265001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c96cff-46dd-459a-99a6-4bdec8eae35c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:51.271872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970482b-d01e-4350-a8d5-fb0b71a53937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:51.273047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970482b-d01e-4350-a8d5-fb0b71a53937 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:51.273560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970482b-d01e-4350-a8d5-fb0b71a53937 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:51.274007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970482b-d01e-4350-a8d5-fb0b71a53937 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:51.275391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970482b-d01e-4350-a8d5-fb0b71a53937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:51.278007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970482b-d01e-4350-a8d5-fb0b71a53937 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:51.293883 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2212/4378] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:51.294076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6304f-5c95-400d-885e-01006921e615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df27a9c6c999443c8a1cf0d689cf9527, user_id=97e41048cd8141b5b3bbc1e42eb382cb, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:51.294933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6304f-5c95-400d-885e-01006921e615 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:51.295718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970482b-d01e-4350-a8d5-fb0b71a53937 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:51.311580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970482b-d01e-4350-a8d5-fb0b71a53937 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:51.322110 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2167/4379] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:15:51 2022] PUT /identity/v3/projects/df27a9c6c999443c8a1cf0d689cf9527/users/97e41048cd8141b5b3bbc1e42eb382cb/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:51.322543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:51.335401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47a028-8ce2-4dce-828a-49ef277cb527 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:51.335825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47a028-8ce2-4dce-828a-49ef277cb527 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:51.336442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47a028-8ce2-4dce-828a-49ef277cb527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:51.379156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2a47a028-8ce2-4dce-828a-49ef277cb527 None None] MFA Rules not processed for user `97e41048cd8141b5b3bbc1e42eb382cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:51.380634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2a47a028-8ce2-4dce-828a-49ef277cb527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:51.387052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daddfb-cea5-48b4-b790-6af53868d0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:51.388026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daddfb-cea5-48b4-b790-6af53868d0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:51.388287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daddfb-cea5-48b4-b790-6af53868d0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:51.388568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daddfb-cea5-48b4-b790-6af53868d0a2 admin admin] PATH_INFO: `/v3/projects/c71e0c400aa1407f81c69e5341fe1d89/users/5ce94b54e7d943768a6e573b4ce758a6/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:51.410349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94daddfb-cea5-48b4-b790-6af53868d0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c71e0c400aa1407f81c69e5341fe1d89, user_id=5ce94b54e7d943768a6e573b4ce758a6, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:51.419180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94daddfb-cea5-48b4-b790-6af53868d0a2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:51.439554 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2213/4380] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:15:51 2022] PUT /identity/v3/projects/c71e0c400aa1407f81c69e5341fe1d89/users/5ce94b54e7d943768a6e573b4ce758a6/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:15:51.449957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59286619-12cb-494c-b7fd-e1e83b59ec4d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:51.450315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59286619-12cb-494c-b7fd-e1e83b59ec4d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:51.450667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59286619-12cb-494c-b7fd-e1e83b59ec4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:51.479036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-59286619-12cb-494c-b7fd-e1e83b59ec4d None None] MFA Rules not processed for user `5ce94b54e7d943768a6e573b4ce758a6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:51.480487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-59286619-12cb-494c-b7fd-e1e83b59ec4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:51.488711 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2168/4381] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:51.522805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47a028-8ce2-4dce-828a-49ef277cb527 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:51.534400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47a028-8ce2-4dce-828a-49ef277cb527 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:51.538175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:51.573080 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2214/4382] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:15:51.578257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59286619-12cb-494c-b7fd-e1e83b59ec4d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:51.626622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a4fe6-c438-46e3-8fe5-fdeaad418990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:51.627641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a4fe6-c438-46e3-8fe5-fdeaad418990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:51.628861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a4fe6-c438-46e3-8fe5-fdeaad418990 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:51.629220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a4fe6-c438-46e3-8fe5-fdeaad418990 admin admin] PATH_INFO: `/v3/users/97e41048cd8141b5b3bbc1e42eb382cb` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:51.630575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a4fe6-c438-46e3-8fe5-fdeaad418990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e41048cd8141b5b3bbc1e42eb382cb)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:51.632599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a4fe6-c438-46e3-8fe5-fdeaad418990 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:51.660524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59286619-12cb-494c-b7fd-e1e83b59ec4d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:51.665829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83058ff-dc9e-4f4a-a46b-dc35dfa70a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:51.666504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83058ff-dc9e-4f4a-a46b-dc35dfa70a21 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:51.666835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83058ff-dc9e-4f4a-a46b-dc35dfa70a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:51.667113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83058ff-dc9e-4f4a-a46b-dc35dfa70a21 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:51.667862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83058ff-dc9e-4f4a-a46b-dc35dfa70a21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:51.670074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83058ff-dc9e-4f4a-a46b-dc35dfa70a21 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:51.708437 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2215/4383] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:15:51 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:15:51.709398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83058ff-dc9e-4f4a-a46b-dc35dfa70a21 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:51.710464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-429a4fe6-c438-46e3-8fe5-fdeaad418990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e41048cd8141b5b3bbc1e42eb382cb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:51.725118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:51.730798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-429a4fe6-c438-46e3-8fe5-fdeaad418990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e41048cd8141b5b3bbc1e42eb382cb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:51.739971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-429a4fe6-c438-46e3-8fe5-fdeaad418990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e41048cd8141b5b3bbc1e42eb382cb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:51.740932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-429a4fe6-c438-46e3-8fe5-fdeaad418990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e41048cd8141b5b3bbc1e42eb382cb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:51.741751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-429a4fe6-c438-46e3-8fe5-fdeaad418990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e41048cd8141b5b3bbc1e42eb382cb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:51.766469 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2169/4384] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:15:51 2022] DELETE /identity/v3/users/97e41048cd8141b5b3bbc1e42eb382cb => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:51.771213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93463e-4ed6-4415-a769-fe4207998f92 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:51.771628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93463e-4ed6-4415-a769-fe4207998f92 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:51.772030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93463e-4ed6-4415-a769-fe4207998f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:51.791023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0f93463e-4ed6-4415-a769-fe4207998f92 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:51.792276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0f93463e-4ed6-4415-a769-fe4207998f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:51.817871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83058ff-dc9e-4f4a-a46b-dc35dfa70a21 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:51.891270 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2170/4385] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:15:51.903607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b02bf-6e95-4257-bad1-75662c33f62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:51.904920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93463e-4ed6-4415-a769-fe4207998f92 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:51.906391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0f93463e-4ed6-4415-a769-fe4207998f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:51.908852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b02bf-6e95-4257-bad1-75662c33f62b admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:51.909590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b02bf-6e95-4257-bad1-75662c33f62b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:51.910389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b02bf-6e95-4257-bad1-75662c33f62b admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:51.911755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b02bf-6e95-4257-bad1-75662c33f62b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:51.916231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b02bf-6e95-4257-bad1-75662c33f62b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:51.956155 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2216/4386] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:15:51 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:15:51.958884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b02bf-6e95-4257-bad1-75662c33f62b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:51.963207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:51.963406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ce9b02bf-6e95-4257-bad1-75662c33f62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:51.987158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b02bf-6e95-4257-bad1-75662c33f62b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:51.996600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c0e28-6679-45ab-a4d8-01103c686654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:51.997884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c0e28-6679-45ab-a4d8-01103c686654 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:51.998345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c0e28-6679-45ab-a4d8-01103c686654 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:51.998946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c0e28-6679-45ab-a4d8-01103c686654 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:51.999860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c0e28-6679-45ab-a4d8-01103c686654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:52.003725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c0e28-6679-45ab-a4d8-01103c686654 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:52.007992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93463e-4ed6-4415-a769-fe4207998f92 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:52.021812 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2217/4387] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:52.023076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c0e28-6679-45ab-a4d8-01103c686654 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:52.027072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec19f26-6329-48c2-8131-bb94bf6f4828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:52.027886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec19f26-6329-48c2-8131-bb94bf6f4828 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:52.028914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec19f26-6329-48c2-8131-bb94bf6f4828 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:52.029682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec19f26-6329-48c2-8131-bb94bf6f4828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:52.037276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c0e28-6679-45ab-a4d8-01103c686654 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:52.043535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b34a76-2145-4a49-b0b4-8ba2cc2e1bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:52.045587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b34a76-2145-4a49-b0b4-8ba2cc2e1bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:52.046930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b34a76-2145-4a49-b0b4-8ba2cc2e1bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:52.046930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b34a76-2145-4a49-b0b4-8ba2cc2e1bc0 admin admin] PATH_INFO: `/v3/projects/300a791abd8e4470b569b0b79dc0cfea/users/b5355434718f43c89156bee7bd939aa7/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:52.051126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec19f26-6329-48c2-8131-bb94bf6f4828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:52.055042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec19f26-6329-48c2-8131-bb94bf6f4828 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:52.070092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b34a76-2145-4a49-b0b4-8ba2cc2e1bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=300a791abd8e4470b569b0b79dc0cfea, user_id=b5355434718f43c89156bee7bd939aa7, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:52.073413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b34a76-2145-4a49-b0b4-8ba2cc2e1bc0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:52.096429 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2171/4388] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:15:52.101481 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2218/4389] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:15:52 2022] PUT /identity/v3/projects/300a791abd8e4470b569b0b79dc0cfea/users/b5355434718f43c89156bee7bd939aa7/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:52.106096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec19f26-6329-48c2-8131-bb94bf6f4828 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:52.118860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec19f26-6329-48c2-8131-bb94bf6f4828 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:52.271821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f64bc-ddd4-4c06-8289-c4b5fa76d5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:52.272616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f64bc-ddd4-4c06-8289-c4b5fa76d5ef admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:52.272958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f64bc-ddd4-4c06-8289-c4b5fa76d5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:52.273318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f64bc-ddd4-4c06-8289-c4b5fa76d5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:52.274109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f64bc-ddd4-4c06-8289-c4b5fa76d5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:52.279534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f64bc-ddd4-4c06-8289-c4b5fa76d5ef admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:52.304622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b34a76-2145-4a49-b0b4-8ba2cc2e1bc0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:52.311127 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2172/4390] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:52.315841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b34a76-2145-4a49-b0b4-8ba2cc2e1bc0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:52.327479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53563130-e482-47a8-8ecd-6e88c946bfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:52.328446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53563130-e482-47a8-8ecd-6e88c946bfa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:52.328787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53563130-e482-47a8-8ecd-6e88c946bfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:52.329227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53563130-e482-47a8-8ecd-6e88c946bfa4 admin admin] PATH_INFO: `/v3/projects/300a791abd8e4470b569b0b79dc0cfea/users/b5355434718f43c89156bee7bd939aa7/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:52.333311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53563130-e482-47a8-8ecd-6e88c946bfa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=300a791abd8e4470b569b0b79dc0cfea, user_id=b5355434718f43c89156bee7bd939aa7, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:52.336084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53563130-e482-47a8-8ecd-6e88c946bfa4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:52.375002 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2219/4391] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:15:52 2022] PUT /identity/v3/projects/300a791abd8e4470b569b0b79dc0cfea/users/b5355434718f43c89156bee7bd939aa7/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:52.378107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca8f4a-fa00-43e7-acd3-95fdd2afdec4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:52.378404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca8f4a-fa00-43e7-acd3-95fdd2afdec4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:52.378677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca8f4a-fa00-43e7-acd3-95fdd2afdec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:52.431718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-91ca8f4a-fa00-43e7-acd3-95fdd2afdec4 None None] MFA Rules not processed for user `b5355434718f43c89156bee7bd939aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:52.432994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-91ca8f4a-fa00-43e7-acd3-95fdd2afdec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:52.551137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53563130-e482-47a8-8ecd-6e88c946bfa4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:52.553468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-53563130-e482-47a8-8ecd-6e88c946bfa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:52.618076 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2173/4392] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:52.631953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca8f4a-fa00-43e7-acd3-95fdd2afdec4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:52.633382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-91ca8f4a-fa00-43e7-acd3-95fdd2afdec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:52.686585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:52.691191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53563130-e482-47a8-8ecd-6e88c946bfa4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:52.699282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082dcbc-0e1b-4092-bc44-4456d74f0c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:52.700206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082dcbc-0e1b-4092-bc44-4456d74f0c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:52.700489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082dcbc-0e1b-4092-bc44-4456d74f0c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:52.700765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082dcbc-0e1b-4092-bc44-4456d74f0c65 admin admin] PATH_INFO: `/v3/projects/df27a9c6c999443c8a1cf0d689cf9527` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:52.702346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082dcbc-0e1b-4092-bc44-4456d74f0c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df27a9c6c999443c8a1cf0d689cf9527)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:52.704638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082dcbc-0e1b-4092-bc44-4456d74f0c65 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:52.730060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca8f4a-fa00-43e7-acd3-95fdd2afdec4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:52.736169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65625a58-b4ae-4735-ab28-fd48ecc9d089 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:52.736840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65625a58-b4ae-4735-ab28-fd48ecc9d089 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:52.737123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65625a58-b4ae-4735-ab28-fd48ecc9d089 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:52.737905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65625a58-b4ae-4735-ab28-fd48ecc9d089 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:52.746615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:52.752676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65625a58-b4ae-4735-ab28-fd48ecc9d089 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:52.759063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65625a58-b4ae-4735-ab28-fd48ecc9d089 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:52.775214 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2174/4393] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:15:52.779245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0082dcbc-0e1b-4092-bc44-4456d74f0c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df27a9c6c999443c8a1cf0d689cf9527', 'request_id': 'req-0082dcbc-0e1b-4092-bc44-4456d74f0c65'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:52.790166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0082dcbc-0e1b-4092-bc44-4456d74f0c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df27a9c6c999443c8a1cf0d689cf9527', 'request_id': 'req-0082dcbc-0e1b-4092-bc44-4456d74f0c65'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:52.798831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0082dcbc-0e1b-4092-bc44-4456d74f0c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df27a9c6c999443c8a1cf0d689cf9527', 'request_id': 'req-0082dcbc-0e1b-4092-bc44-4456d74f0c65'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:52.814712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0082dcbc-0e1b-4092-bc44-4456d74f0c65 admin admin] The token cache is being invalidate because project df27a9c6c999443c8a1cf0d689cf9527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:15:52.815194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0082dcbc-0e1b-4092-bc44-4456d74f0c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:52.815782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0082dcbc-0e1b-4092-bc44-4456d74f0c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:52.822847 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2220/4394] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:15:52 2022] DELETE /identity/v3/projects/df27a9c6c999443c8a1cf0d689cf9527 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:15:52.824680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316d7e2-5270-4bf7-9268-c3d397cfa02f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:52.824966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316d7e2-5270-4bf7-9268-c3d397cfa02f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:52.825240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316d7e2-5270-4bf7-9268-c3d397cfa02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:52.849159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5316d7e2-5270-4bf7-9268-c3d397cfa02f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:52.850630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5316d7e2-5270-4bf7-9268-c3d397cfa02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:52.923041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082dcbc-0e1b-4092-bc44-4456d74f0c65 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:52.925002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0082dcbc-0e1b-4092-bc44-4456d74f0c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:52.977330 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2175/4395] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:52.986771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e5e66-9b3e-499c-87a9-b5594ffdf734 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:52.987161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e5e66-9b3e-499c-87a9-b5594ffdf734 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:52.987538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e5e66-9b3e-499c-87a9-b5594ffdf734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:53.002264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082dcbc-0e1b-4092-bc44-4456d74f0c65 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:53.006790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23706a85-7c6f-4d1b-adce-e562bceba8dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:53.007657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23706a85-7c6f-4d1b-adce-e562bceba8dc service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:53.007819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23706a85-7c6f-4d1b-adce-e562bceba8dc service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:53.008000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23706a85-7c6f-4d1b-adce-e562bceba8dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:53.010228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-23706a85-7c6f-4d1b-adce-e562bceba8dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:53.018157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a17e5e66-9b3e-499c-87a9-b5594ffdf734 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:53.019419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a17e5e66-9b3e-499c-87a9-b5594ffdf734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:53.037589 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2176/4396] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:53.038907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e5e66-9b3e-499c-87a9-b5594ffdf734 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:53.050122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e5e66-9b3e-499c-87a9-b5594ffdf734 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:53.056904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22318adf-77e3-4247-b928-0ef1526e2c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:53.057988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22318adf-77e3-4247-b928-0ef1526e2c8f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:53.058271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22318adf-77e3-4247-b928-0ef1526e2c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:53.059211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22318adf-77e3-4247-b928-0ef1526e2c8f admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:53.060404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22318adf-77e3-4247-b928-0ef1526e2c8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:15:53.060404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22318adf-77e3-4247-b928-0ef1526e2c8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:53.062809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22318adf-77e3-4247-b928-0ef1526e2c8f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:53.083866 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2177/4397] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:15:53.085150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22318adf-77e3-4247-b928-0ef1526e2c8f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:53.097602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22318adf-77e3-4247-b928-0ef1526e2c8f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:53.117080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f896c0f-9d97-4f55-9adc-af1072b43244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:53.118139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f896c0f-9d97-4f55-9adc-af1072b43244 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:53.118568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f896c0f-9d97-4f55-9adc-af1072b43244 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:53.118849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f896c0f-9d97-4f55-9adc-af1072b43244 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:53.119612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f896c0f-9d97-4f55-9adc-af1072b43244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:53.122207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f896c0f-9d97-4f55-9adc-af1072b43244 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:53.130852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23706a85-7c6f-4d1b-adce-e562bceba8dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:53.132604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23706a85-7c6f-4d1b-adce-e562bceba8dc service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:53.153433 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2221/4398] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:15:53.170483 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2178/4399] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:15:53 2022] POST /identity/v3/projects => generated 369 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:15:53.175270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23706a85-7c6f-4d1b-adce-e562bceba8dc service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:53.202186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23706a85-7c6f-4d1b-adce-e562bceba8dc service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:53.283518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:53.309124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a544b-bf33-4320-8aef-2f5f040738cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:53.309909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a544b-bf33-4320-8aef-2f5f040738cb admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:53.310910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a544b-bf33-4320-8aef-2f5f040738cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:53.311061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a544b-bf33-4320-8aef-2f5f040738cb admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:53.311680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a544b-bf33-4320-8aef-2f5f040738cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:53.314042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a544b-bf33-4320-8aef-2f5f040738cb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:53.344395 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2222/4400] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:15:53 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:15:53.349112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f896c0f-9d97-4f55-9adc-af1072b43244 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:53.363242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f896c0f-9d97-4f55-9adc-af1072b43244 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:53.372791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1791d8b-7d1d-425d-b985-1c7932bf868d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:53.373570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1791d8b-7d1d-425d-b985-1c7932bf868d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:53.373853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1791d8b-7d1d-425d-b985-1c7932bf868d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:53.374269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1791d8b-7d1d-425d-b985-1c7932bf868d admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:53.375086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1791d8b-7d1d-425d-b985-1c7932bf868d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:53.383120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1791d8b-7d1d-425d-b985-1c7932bf868d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:53.421668 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2179/4401] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:15:53.425792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a544b-bf33-4320-8aef-2f5f040738cb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:53.440647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a544b-bf33-4320-8aef-2f5f040738cb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:53.450147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ba51d-dfcf-43a2-8565-f3842b396a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:53.451202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ba51d-dfcf-43a2-8565-f3842b396a60 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:53.451518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ba51d-dfcf-43a2-8565-f3842b396a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:53.451857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ba51d-dfcf-43a2-8565-f3842b396a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:53.452844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ba51d-dfcf-43a2-8565-f3842b396a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:53.456142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ba51d-dfcf-43a2-8565-f3842b396a60 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:53.487106 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2223/4402] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:53.491607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1791d8b-7d1d-425d-b985-1c7932bf868d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:53.507266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1791d8b-7d1d-425d-b985-1c7932bf868d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:53.514062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3c000-3a4a-463d-8817-678e9eab68d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:53.515836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3c000-3a4a-463d-8817-678e9eab68d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:53.516344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3c000-3a4a-463d-8817-678e9eab68d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:53.517038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3c000-3a4a-463d-8817-678e9eab68d8 admin admin] PATH_INFO: `/v3/projects/861629fed81e4d4a9dde5168b522892e/users/8ab6c21ed10748a4995132123d9e69d7/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:53.547034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3c000-3a4a-463d-8817-678e9eab68d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=861629fed81e4d4a9dde5168b522892e, user_id=8ab6c21ed10748a4995132123d9e69d7, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:53.550666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3c000-3a4a-463d-8817-678e9eab68d8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:53.580091 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2180/4403] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:15:53 2022] PUT /identity/v3/projects/861629fed81e4d4a9dde5168b522892e/users/8ab6c21ed10748a4995132123d9e69d7/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:15:53.589523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f03da6-e13a-45ca-9c10-a5831ea2279a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:53.589932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f03da6-e13a-45ca-9c10-a5831ea2279a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:53.590825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f03da6-e13a-45ca-9c10-a5831ea2279a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:53.639868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-31f03da6-e13a-45ca-9c10-a5831ea2279a None None] MFA Rules not processed for user `8ab6c21ed10748a4995132123d9e69d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:53.641163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-31f03da6-e13a-45ca-9c10-a5831ea2279a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:53.729237 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2224/4404] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:53.733353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3c000-3a4a-463d-8817-678e9eab68d8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:53.840328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3c000-3a4a-463d-8817-678e9eab68d8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:53.845989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebd298-8423-4fe9-ae31-88932f62068c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:53.846755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebd298-8423-4fe9-ae31-88932f62068c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:53.847081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebd298-8423-4fe9-ae31-88932f62068c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:53.847424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebd298-8423-4fe9-ae31-88932f62068c admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:53.849298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebd298-8423-4fe9-ae31-88932f62068c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:53.850982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebd298-8423-4fe9-ae31-88932f62068c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:53.884587 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2181/4405] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:15:53 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:15:53.888395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f03da6-e13a-45ca-9c10-a5831ea2279a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:53.908862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f03da6-e13a-45ca-9c10-a5831ea2279a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:54.030267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b920ea-40c1-4b53-b6fb-5088f3d5673f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:54.031128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b920ea-40c1-4b53-b6fb-5088f3d5673f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:54.031515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b920ea-40c1-4b53-b6fb-5088f3d5673f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:54.031932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b920ea-40c1-4b53-b6fb-5088f3d5673f admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:54.033181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b920ea-40c1-4b53-b6fb-5088f3d5673f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:54.034981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b920ea-40c1-4b53-b6fb-5088f3d5673f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:54.069228 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2225/4406] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:15:53 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:15:54.073234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebd298-8423-4fe9-ae31-88932f62068c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:54.100032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:54.107266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebd298-8423-4fe9-ae31-88932f62068c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:54.114798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0952df4-f92e-479d-91bc-1917106d618b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:54.116605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0952df4-f92e-479d-91bc-1917106d618b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:54.116957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0952df4-f92e-479d-91bc-1917106d618b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:54.117301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0952df4-f92e-479d-91bc-1917106d618b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:54.118306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0952df4-f92e-479d-91bc-1917106d618b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:54.120785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0952df4-f92e-479d-91bc-1917106d618b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:54.135513 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2182/4407] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:54.141576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b920ea-40c1-4b53-b6fb-5088f3d5673f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:54.154467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b920ea-40c1-4b53-b6fb-5088f3d5673f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:54.163888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7a945-e103-46ed-b169-0e14402d3269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:54.164905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7a945-e103-46ed-b169-0e14402d3269 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:54.165185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7a945-e103-46ed-b169-0e14402d3269 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:54.165463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7a945-e103-46ed-b169-0e14402d3269 admin admin] PATH_INFO: `/v3/projects/4c4418d5efc542a88b29f122910b85ae/users/72e54259e3f4410a83a7a5450cec1eb0/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:54.191576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7a945-e103-46ed-b169-0e14402d3269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4418d5efc542a88b29f122910b85ae, user_id=72e54259e3f4410a83a7a5450cec1eb0, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:54.209212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a7a945-e103-46ed-b169-0e14402d3269 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:54.234053 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2226/4408] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:15:54 2022] PUT /identity/v3/projects/4c4418d5efc542a88b29f122910b85ae/users/72e54259e3f4410a83a7a5450cec1eb0/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:54.239166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0952df4-f92e-479d-91bc-1917106d618b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:54.261047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0952df4-f92e-479d-91bc-1917106d618b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:54.409479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c400eb-978c-4606-88e3-e32ea3a14b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:54.411242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c400eb-978c-4606-88e3-e32ea3a14b85 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:54.411533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c400eb-978c-4606-88e3-e32ea3a14b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:54.411811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c400eb-978c-4606-88e3-e32ea3a14b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:54.413699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c400eb-978c-4606-88e3-e32ea3a14b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:54.415487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c400eb-978c-4606-88e3-e32ea3a14b85 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:54.428681 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2183/4409] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:54.433672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7a945-e103-46ed-b169-0e14402d3269 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:54.451231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7a945-e103-46ed-b169-0e14402d3269 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:54.457660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d576e9a-28d1-40d3-b6a9-f588ac1e5b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:54.461289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d576e9a-28d1-40d3-b6a9-f588ac1e5b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:54.461569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d576e9a-28d1-40d3-b6a9-f588ac1e5b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:54.461841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d576e9a-28d1-40d3-b6a9-f588ac1e5b13 admin admin] PATH_INFO: `/v3/projects/4c4418d5efc542a88b29f122910b85ae/users/72e54259e3f4410a83a7a5450cec1eb0/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:54.482651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d576e9a-28d1-40d3-b6a9-f588ac1e5b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4418d5efc542a88b29f122910b85ae, user_id=72e54259e3f4410a83a7a5450cec1eb0, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:54.488876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d576e9a-28d1-40d3-b6a9-f588ac1e5b13 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:54.513449 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2227/4410] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:15:54 2022] PUT /identity/v3/projects/4c4418d5efc542a88b29f122910b85ae/users/72e54259e3f4410a83a7a5450cec1eb0/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:15:54.515773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf1659-224d-4612-9277-3bcb0605b73c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:54.516361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf1659-224d-4612-9277-3bcb0605b73c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:54.516888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf1659-224d-4612-9277-3bcb0605b73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:54.580748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-65cf1659-224d-4612-9277-3bcb0605b73c None None] MFA Rules not processed for user `72e54259e3f4410a83a7a5450cec1eb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:54.582495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-65cf1659-224d-4612-9277-3bcb0605b73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:54.685897 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2184/4411] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:54.690424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d576e9a-28d1-40d3-b6a9-f588ac1e5b13 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:54.697637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:54.710374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d576e9a-28d1-40d3-b6a9-f588ac1e5b13 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:54.719944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c82c7-75fa-4a67-8d6e-4aebd644c58e tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:54.722210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c82c7-75fa-4a67-8d6e-4aebd644c58e tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:54.722502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c82c7-75fa-4a67-8d6e-4aebd644c58e tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:54.723498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c82c7-75fa-4a67-8d6e-4aebd644c58e tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:54.724294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c82c7-75fa-4a67-8d6e-4aebd644c58e tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:54.726901 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-6d6c82c7-75fa-4a67-8d6e-4aebd644c58e tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:15:54.726901 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:15:54.726901 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:15:54.727349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c82c7-75fa-4a67-8d6e-4aebd644c58e tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:54.760416 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2228/4412] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:15:54 2022] POST /identity/v3/services => generated 289 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:15:54.761575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf1659-224d-4612-9277-3bcb0605b73c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:54.774912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf1659-224d-4612-9277-3bcb0605b73c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:54.809641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c7ce9-1ecf-4e5f-a006-3ea02a5d3733 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:54.810270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c7ce9-1ecf-4e5f-a006-3ea02a5d3733 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:54.810626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c7ce9-1ecf-4e5f-a006-3ea02a5d3733 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:54.811045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c7ce9-1ecf-4e5f-a006-3ea02a5d3733 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:54.823295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c7ce9-1ecf-4e5f-a006-3ea02a5d3733 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:54.825191 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-7f7c7ce9-1ecf-4e5f-a006-3ea02a5d3733 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:15:54.825191 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:15:54.825191 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:15:54.827145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c7ce9-1ecf-4e5f-a006-3ea02a5d3733 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:54.885648 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-7f7c7ce9-1ecf-4e5f-a006-3ea02a5d3733 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-956190106. To ensure interoperability, identifiers should be a valid uuid. Jul 02 21:15:54.885648 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 02 21:15:54.885648 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:15:54.929456 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2185/4413] 10.222.0.43 () {60 vars in 1155 bytes} [Sat Jul 2 21:15:54 2022] POST /identity/v3/endpoints => generated 359 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:15:54.933589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c82c7-75fa-4a67-8d6e-4aebd644c58e tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:54.947907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c82c7-75fa-4a67-8d6e-4aebd644c58e tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:54.971847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff24ee-48a4-45c2-bb39-b02e47a5c5a9 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:54.974358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff24ee-48a4-45c2-bb39-b02e47a5c5a9 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:54.974731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff24ee-48a4-45c2-bb39-b02e47a5c5a9 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:54.975569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff24ee-48a4-45c2-bb39-b02e47a5c5a9 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/regions/tempest-region-956190106` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:54.976740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff24ee-48a4-45c2-bb39-b02e47a5c5a9 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-956190106)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:54.978217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff24ee-48a4-45c2-bb39-b02e47a5c5a9 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:54.980596 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2229/4414] 10.222.0.43 () {58 vars in 1202 bytes} [Sat Jul 2 21:15:54 2022] GET /identity/v3/regions/tempest-region-956190106 => generated 178 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:15:54.985327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c7ce9-1ecf-4e5f-a006-3ea02a5d3733 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:54.998465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c7ce9-1ecf-4e5f-a006-3ea02a5d3733 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:55.006185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dfb40-86af-403d-98eb-099a89db9307 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:55.007102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dfb40-86af-403d-98eb-099a89db9307 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:55.007606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dfb40-86af-403d-98eb-099a89db9307 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:55.008318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dfb40-86af-403d-98eb-099a89db9307 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:55.009465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dfb40-86af-403d-98eb-099a89db9307 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:55.011104 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-fd5dfb40-86af-403d-98eb-099a89db9307 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:15:55.011104 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:15:55.011104 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:15:55.012424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dfb40-86af-403d-98eb-099a89db9307 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:55.050208 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2186/4415] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:15:54 2022] POST /identity/v3/services => generated 290 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:15:55.051867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff24ee-48a4-45c2-bb39-b02e47a5c5a9 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:55.084743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff24ee-48a4-45c2-bb39-b02e47a5c5a9 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:55.123628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dfb40-86af-403d-98eb-099a89db9307 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:55.125509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fd5dfb40-86af-403d-98eb-099a89db9307 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:55.130926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98647da-c2e0-4740-a677-02a4c0c3ffc4 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:55.131862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98647da-c2e0-4740-a677-02a4c0c3ffc4 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:55.132383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98647da-c2e0-4740-a677-02a4c0c3ffc4 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:55.132883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98647da-c2e0-4740-a677-02a4c0c3ffc4 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:55.134056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98647da-c2e0-4740-a677-02a4c0c3ffc4 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:55.135750 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-b98647da-c2e0-4740-a677-02a4c0c3ffc4 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:15:55.135750 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:15:55.135750 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:15:55.137109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98647da-c2e0-4740-a677-02a4c0c3ffc4 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:55.154724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:55.164355 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-b98647da-c2e0-4740-a677-02a4c0c3ffc4 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2015295920. To ensure interoperability, identifiers should be a valid uuid. Jul 02 21:15:55.164355 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 02 21:15:55.164355 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:15:55.214303 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2230/4416] 10.222.0.43 () {60 vars in 1155 bytes} [Sat Jul 2 21:15:55 2022] POST /identity/v3/endpoints => generated 362 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:15:55.221480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98647da-c2e0-4740-a677-02a4c0c3ffc4 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:55.284366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98647da-c2e0-4740-a677-02a4c0c3ffc4 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:55.294781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b83573-f2f3-4706-8835-7af5d5219287 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:55.296848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b83573-f2f3-4706-8835-7af5d5219287 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:55.298833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b83573-f2f3-4706-8835-7af5d5219287 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:55.299129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b83573-f2f3-4706-8835-7af5d5219287 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/regions/tempest-region-2015295920` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:55.299834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b83573-f2f3-4706-8835-7af5d5219287 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2015295920)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:55.304399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b83573-f2f3-4706-8835-7af5d5219287 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:55.309193 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2231/4417] 10.222.0.43 () {58 vars in 1205 bytes} [Sat Jul 2 21:15:55 2022] GET /identity/v3/regions/tempest-region-2015295920 => generated 180 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:15:55.312769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b83573-f2f3-4706-8835-7af5d5219287 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:55.331884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b83573-f2f3-4706-8835-7af5d5219287 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:55.338907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dfb40-86af-403d-98eb-099a89db9307 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:55.342945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd1b5-9089-4115-832f-22078f2aafdf tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:55.344019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd1b5-9089-4115-832f-22078f2aafdf tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:55.346404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd1b5-9089-4115-832f-22078f2aafdf tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:55.346724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd1b5-9089-4115-832f-22078f2aafdf tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:55.347502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abd1b5-9089-4115-832f-22078f2aafdf tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:55.349211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abd1b5-9089-4115-832f-22078f2aafdf tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:55.368925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303479dd-b4c9-4d6b-aa64-4c2822ef76b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:55.370470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303479dd-b4c9-4d6b-aa64-4c2822ef76b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:55.371027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303479dd-b4c9-4d6b-aa64-4c2822ef76b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:55.371601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303479dd-b4c9-4d6b-aa64-4c2822ef76b8 admin admin] PATH_INFO: `/v3/users/af79a7ef254d4df1806f6b5c2f91a4c3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:55.374564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303479dd-b4c9-4d6b-aa64-4c2822ef76b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af79a7ef254d4df1806f6b5c2f91a4c3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:55.377357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303479dd-b4c9-4d6b-aa64-4c2822ef76b8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:55.399907 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-87abd1b5-9089-4115-832f-22078f2aafdf tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1751311103. To ensure interoperability, identifiers should be a valid uuid. Jul 02 21:15:55.399907 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 02 21:15:55.399907 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:15:55.454751 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2232/4418] 10.222.0.43 () {60 vars in 1155 bytes} [Sat Jul 2 21:15:55 2022] POST /identity/v3/endpoints => generated 361 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:15:55.460304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd1b5-9089-4115-832f-22078f2aafdf tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:55.497338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-303479dd-b4c9-4d6b-aa64-4c2822ef76b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af79a7ef254d4df1806f6b5c2f91a4c3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:55.505168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd1b5-9089-4115-832f-22078f2aafdf tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:55.512476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-303479dd-b4c9-4d6b-aa64-4c2822ef76b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af79a7ef254d4df1806f6b5c2f91a4c3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:55.528089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-303479dd-b4c9-4d6b-aa64-4c2822ef76b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af79a7ef254d4df1806f6b5c2f91a4c3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:55.528759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415f9e1-7b29-4268-9d9e-fc5806d5ef45 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:55.529692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415f9e1-7b29-4268-9d9e-fc5806d5ef45 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:55.530115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415f9e1-7b29-4268-9d9e-fc5806d5ef45 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:55.530241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-303479dd-b4c9-4d6b-aa64-4c2822ef76b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af79a7ef254d4df1806f6b5c2f91a4c3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:55.531161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415f9e1-7b29-4268-9d9e-fc5806d5ef45 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/regions/tempest-region-1751311103` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:55.531717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415f9e1-7b29-4268-9d9e-fc5806d5ef45 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1751311103)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:55.533166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-303479dd-b4c9-4d6b-aa64-4c2822ef76b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af79a7ef254d4df1806f6b5c2f91a4c3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:55.533401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415f9e1-7b29-4268-9d9e-fc5806d5ef45 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:55.539299 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2233/4419] 10.222.0.43 () {58 vars in 1205 bytes} [Sat Jul 2 21:15:55 2022] GET /identity/v3/regions/tempest-region-1751311103 => generated 180 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:15:55.540468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415f9e1-7b29-4268-9d9e-fc5806d5ef45 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:55.542776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c415f9e1-7b29-4268-9d9e-fc5806d5ef45 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:55.563889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415f9e1-7b29-4268-9d9e-fc5806d5ef45 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:55.575222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d79d2-08fb-4a2a-9588-c3f482fbc71a tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:55.576404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d79d2-08fb-4a2a-9588-c3f482fbc71a tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:55.578308 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2187/4420] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:15:55 2022] DELETE /identity/v3/users/af79a7ef254d4df1806f6b5c2f91a4c3 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:55.578453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d79d2-08fb-4a2a-9588-c3f482fbc71a tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:55.578566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d79d2-08fb-4a2a-9588-c3f482fbc71a tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:55.579693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d79d2-08fb-4a2a-9588-c3f482fbc71a tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:55.580830 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-591d79d2-08fb-4a2a-9588-c3f482fbc71a tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:15:55.580830 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:15:55.580830 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:15:55.582337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d79d2-08fb-4a2a-9588-c3f482fbc71a tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:55.593283 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2234/4421] 10.222.0.43 () {58 vars in 1133 bytes} [Sat Jul 2 21:15:55 2022] GET /identity/v3/endpoints => generated 4386 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:55.598343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303479dd-b4c9-4d6b-aa64-4c2822ef76b8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:55.680167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303479dd-b4c9-4d6b-aa64-4c2822ef76b8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:55.686880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2e525-597a-41bb-9651-8a8497482469 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:55.688854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2e525-597a-41bb-9651-8a8497482469 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:55.689218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2e525-597a-41bb-9651-8a8497482469 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:55.689597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2e525-597a-41bb-9651-8a8497482469 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/endpoints/f4d4336d84564e8ba81e872f07f656b4` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:55.698438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2e525-597a-41bb-9651-8a8497482469 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=f4d4336d84564e8ba81e872f07f656b4)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:55.699728 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-43d2e525-597a-41bb-9651-8a8497482469 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:15:55.699728 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:15:55.699728 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:15:55.700776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2e525-597a-41bb-9651-8a8497482469 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:55.707583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d79d2-08fb-4a2a-9588-c3f482fbc71a tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:55.712296 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2188/4422] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:15:55 2022] GET /identity/v3/endpoints/f4d4336d84564e8ba81e872f07f656b4 => generated 361 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:15:55.720800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d79d2-08fb-4a2a-9588-c3f482fbc71a tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:55.728094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00369d8-eadd-4e78-8403-f693511f0407 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:55.729422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00369d8-eadd-4e78-8403-f693511f0407 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:55.729777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00369d8-eadd-4e78-8403-f693511f0407 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:55.730148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00369d8-eadd-4e78-8403-f693511f0407 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/endpoints/f4d4336d84564e8ba81e872f07f656b4` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:55.731714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00369d8-eadd-4e78-8403-f693511f0407 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=f4d4336d84564e8ba81e872f07f656b4)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:55.733954 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-a00369d8-eadd-4e78-8403-f693511f0407 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:15:55.733954 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:15:55.733954 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:15:55.735177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00369d8-eadd-4e78-8403-f693511f0407 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:55.749846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a00369d8-eadd-4e78-8403-f693511f0407 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'f4d4336d84564e8ba81e872f07f656b4', 'request_id': 'req-a00369d8-eadd-4e78-8403-f693511f0407'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:55.768808 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2235/4423] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:55 2022] DELETE /identity/v3/endpoints/f4d4336d84564e8ba81e872f07f656b4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:55.769668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2e525-597a-41bb-9651-8a8497482469 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:55.781733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2e525-597a-41bb-9651-8a8497482469 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:55.801875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:55.810439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33addeaf-e9c4-480c-9e97-6c74c34d59c5 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:55.812442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33addeaf-e9c4-480c-9e97-6c74c34d59c5 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:55.812807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33addeaf-e9c4-480c-9e97-6c74c34d59c5 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:55.813626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33addeaf-e9c4-480c-9e97-6c74c34d59c5 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:55.813940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33addeaf-e9c4-480c-9e97-6c74c34d59c5 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:55.819149 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-33addeaf-e9c4-480c-9e97-6c74c34d59c5 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:15:55.819149 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:15:55.819149 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:15:55.819737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00369d8-eadd-4e78-8403-f693511f0407 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:55.821622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33addeaf-e9c4-480c-9e97-6c74c34d59c5 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:55.821918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a00369d8-eadd-4e78-8403-f693511f0407 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:55.834575 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2189/4424] 10.222.0.43 () {58 vars in 1133 bytes} [Sat Jul 2 21:15:55 2022] GET /identity/v3/endpoints => generated 4038 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:15:55.839068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33addeaf-e9c4-480c-9e97-6c74c34d59c5 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:55.852778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33addeaf-e9c4-480c-9e97-6c74c34d59c5 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:55.859041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b60a3d-35fb-40e4-a9e6-9538d03fc705 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:55.860500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b60a3d-35fb-40e4-a9e6-9538d03fc705 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:55.861018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b60a3d-35fb-40e4-a9e6-9538d03fc705 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:55.861366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b60a3d-35fb-40e4-a9e6-9538d03fc705 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/endpoints/f4d4336d84564e8ba81e872f07f656b4` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:55.868368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b60a3d-35fb-40e4-a9e6-9538d03fc705 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 21:15:55.926452 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-50b60a3d-35fb-40e4-a9e6-9538d03fc705 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Could not find endpoint: f4d4336d84564e8ba81e872f07f656b4.: keystone.exception.EndpointNotFound: Could not find endpoint: f4d4336d84564e8ba81e872f07f656b4. Jul 02 21:15:55.926452 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:15:55.926452 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Jul 02 21:15:55.926452 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Jul 02 21:15:55.926452 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 02 21:15:55.926452 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._iter().one() Jul 02 21:15:55.926452 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 02 21:15:55.926452 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._only_one_row( Jul 02 21:15:55.926452 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 02 21:15:55.926452 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 02 21:15:55.926452 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 02 21:15:55.926452 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:15:55.926452 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:15:55.926452 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:15:55.926452 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:15:55.926452 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Jul 02 21:15:55.928302 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Jul 02 21:15:55.928302 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Jul 02 21:15:55.928302 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Jul 02 21:15:55.928302 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Jul 02 21:15:55.928302 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jul 02 21:15:55.928302 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: f4d4336d84564e8ba81e872f07f656b4. Jul 02 21:15:55.928302 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:15:55.928302 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:15:55.928302 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:15:55.928302 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:15:55.928302 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:15:55.928302 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:15:55.928302 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:15:55.928302 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:15:55.928302 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:15:55.928302 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:15:55.928302 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:15:55.929699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:15:55.929699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:15:55.929699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:15:55.929699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Jul 02 21:15:55.929699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Jul 02 21:15:55.929699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 21:15:55.929699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 21:15:55.929699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 21:15:55.929699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 21:15:55.929699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:15:55.929699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:15:55.929699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:15:55.929699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:15:55.929699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:15:55.929699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:15:55.929699 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:15:55.931799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 21:15:55.931799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:15:55.931799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:15:55.931799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:15:55.931799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:15:55.931799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:15:55.931799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:15:55.931799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:15:55.931799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:15:55.931799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Jul 02 21:15:55.931799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jul 02 21:15:55.931799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: f4d4336d84564e8ba81e872f07f656b4. Jul 02 21:15:55.931799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:15:55.933666 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2190/4425] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:55 2022] DELETE /identity/v3/endpoints/f4d4336d84564e8ba81e872f07f656b4 => generated 114 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:15:55.936966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b60a3d-35fb-40e4-a9e6-9538d03fc705 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:55.955629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:55.965328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b60a3d-35fb-40e4-a9e6-9538d03fc705 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:55.977902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd793a-054e-4048-a0e8-1e6e79a2a5d9 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:55.979071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd793a-054e-4048-a0e8-1e6e79a2a5d9 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:55.980011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd793a-054e-4048-a0e8-1e6e79a2a5d9 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:55.980507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd793a-054e-4048-a0e8-1e6e79a2a5d9 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/regions/tempest-region-1751311103` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:55.981898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd793a-054e-4048-a0e8-1e6e79a2a5d9 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1751311103)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:55.983512 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-66dd793a-054e-4048-a0e8-1e6e79a2a5d9 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:15:55.983512 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:15:55.983512 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:15:55.984443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd793a-054e-4048-a0e8-1e6e79a2a5d9 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:55.988415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00369d8-eadd-4e78-8403-f693511f0407 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:55.996451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44243167-24b3-4058-9c27-d1f9099c87f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:55.997582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44243167-24b3-4058-9c27-d1f9099c87f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:55.998270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44243167-24b3-4058-9c27-d1f9099c87f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:55.998703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44243167-24b3-4058-9c27-d1f9099c87f5 admin admin] PATH_INFO: `/v3/projects/d505023bb41e4c7cb4f65f6ff69c121e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:56.000539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44243167-24b3-4058-9c27-d1f9099c87f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d505023bb41e4c7cb4f65f6ff69c121e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:56.003864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44243167-24b3-4058-9c27-d1f9099c87f5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:56.007801 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-66dd793a-054e-4048-a0e8-1e6e79a2a5d9 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1751311103. To ensure interoperability, identifiers should be a valid uuid. Jul 02 21:15:56.007801 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 02 21:15:56.007801 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:15:56.018089 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2191/4426] 10.222.0.43 () {58 vars in 1208 bytes} [Sat Jul 2 21:15:55 2022] DELETE /identity/v3/regions/tempest-region-1751311103 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:56.023032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd793a-054e-4048-a0e8-1e6e79a2a5d9 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:56.071777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd793a-054e-4048-a0e8-1e6e79a2a5d9 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:56.092775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-44243167-24b3-4058-9c27-d1f9099c87f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd505023bb41e4c7cb4f65f6ff69c121e', 'request_id': 'req-44243167-24b3-4058-9c27-d1f9099c87f5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:56.104841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-44243167-24b3-4058-9c27-d1f9099c87f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd505023bb41e4c7cb4f65f6ff69c121e', 'request_id': 'req-44243167-24b3-4058-9c27-d1f9099c87f5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:56.113886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-44243167-24b3-4058-9c27-d1f9099c87f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd505023bb41e4c7cb4f65f6ff69c121e', 'request_id': 'req-44243167-24b3-4058-9c27-d1f9099c87f5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:56.132841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-44243167-24b3-4058-9c27-d1f9099c87f5 admin admin] The token cache is being invalidate because project d505023bb41e4c7cb4f65f6ff69c121e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:15:56.133140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-44243167-24b3-4058-9c27-d1f9099c87f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:56.133912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-44243167-24b3-4058-9c27-d1f9099c87f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:56.141024 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2236/4427] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:15:55 2022] DELETE /identity/v3/projects/d505023bb41e4c7cb4f65f6ff69c121e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:56.145487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fba8f-c13e-4538-bcd6-adda7fb77d91 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:56.145869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fba8f-c13e-4538-bcd6-adda7fb77d91 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:56.146157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fba8f-c13e-4538-bcd6-adda7fb77d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:56.152548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def49ed8-3efd-4d7c-82c3-e9829b487fe0 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:56.153322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def49ed8-3efd-4d7c-82c3-e9829b487fe0 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:56.153609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def49ed8-3efd-4d7c-82c3-e9829b487fe0 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:56.153887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def49ed8-3efd-4d7c-82c3-e9829b487fe0 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:56.155702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def49ed8-3efd-4d7c-82c3-e9829b487fe0 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:56.157784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def49ed8-3efd-4d7c-82c3-e9829b487fe0 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:56.168512 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2192/4428] 10.222.0.43 () {58 vars in 1133 bytes} [Sat Jul 2 21:15:56 2022] GET /identity/v3/endpoints => generated 4038 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:15:56.171489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5a8fba8f-c13e-4538-bcd6-adda7fb77d91 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:56.172908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def49ed8-3efd-4d7c-82c3-e9829b487fe0 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:56.175665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-def49ed8-3efd-4d7c-82c3-e9829b487fe0 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:56.189101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5a8fba8f-c13e-4538-bcd6-adda7fb77d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:56.195104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def49ed8-3efd-4d7c-82c3-e9829b487fe0 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:56.202468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bdc6b-92ec-40a5-9bb5-f6caded1b3ce tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:56.203513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bdc6b-92ec-40a5-9bb5-f6caded1b3ce tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:56.204385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bdc6b-92ec-40a5-9bb5-f6caded1b3ce tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:56.204385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bdc6b-92ec-40a5-9bb5-f6caded1b3ce tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:56.205484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bdc6b-92ec-40a5-9bb5-f6caded1b3ce tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Adding query filter params (service_id=e1461042c23e4f7fb2816938eebf8c1b) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:15:56.208083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bdc6b-92ec-40a5-9bb5-f6caded1b3ce tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:56.208259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bdc6b-92ec-40a5-9bb5-f6caded1b3ce tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:56.224272 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2193/4429] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:15:56 2022] GET /identity/v3/endpoints?service_id=e1461042c23e4f7fb2816938eebf8c1b => generated 501 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:15:56.228832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bdc6b-92ec-40a5-9bb5-f6caded1b3ce tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:56.253665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bdc6b-92ec-40a5-9bb5-f6caded1b3ce tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:56.264147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aac8a4-e0f1-45d8-9887-5620bee53e76 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:56.264804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aac8a4-e0f1-45d8-9887-5620bee53e76 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:56.265128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aac8a4-e0f1-45d8-9887-5620bee53e76 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:56.265371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aac8a4-e0f1-45d8-9887-5620bee53e76 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:56.267671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aac8a4-e0f1-45d8-9887-5620bee53e76 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Adding query filter params (service_id=4c9c5e584e83492888f4e36ab2036124) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:15:56.268018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aac8a4-e0f1-45d8-9887-5620bee53e76 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:56.269682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aac8a4-e0f1-45d8-9887-5620bee53e76 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:56.288890 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2194/4430] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:15:56 2022] GET /identity/v3/endpoints?service_id=4c9c5e584e83492888f4e36ab2036124 => generated 504 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:15:56.290138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aac8a4-e0f1-45d8-9887-5620bee53e76 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:56.311358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aac8a4-e0f1-45d8-9887-5620bee53e76 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:56.324233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76247a-ea9c-4c4e-ab97-37bc95b8a30f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:56.324880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76247a-ea9c-4c4e-ab97-37bc95b8a30f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:56.325169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76247a-ea9c-4c4e-ab97-37bc95b8a30f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:56.325448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76247a-ea9c-4c4e-ab97-37bc95b8a30f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:56.326193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76247a-ea9c-4c4e-ab97-37bc95b8a30f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:15:56.326503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76247a-ea9c-4c4e-ab97-37bc95b8a30f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:56.328148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76247a-ea9c-4c4e-ab97-37bc95b8a30f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:56.354648 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2195/4431] 10.222.0.43 () {58 vars in 1166 bytes} [Sat Jul 2 21:15:56 2022] GET /identity/v3/endpoints?interface=public => generated 3394 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:56.363135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76247a-ea9c-4c4e-ab97-37bc95b8a30f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:56.364022 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2237/4432] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:56 2022] POST /identity/v3/auth/tokens => generated 3861 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:56.372459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdab59-ae84-43fb-a49c-9e9a1714c63d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:56.372866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdab59-ae84-43fb-a49c-9e9a1714c63d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:56.373151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdab59-ae84-43fb-a49c-9e9a1714c63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:56.392691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76247a-ea9c-4c4e-ab97-37bc95b8a30f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:56.396126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-46fdab59-ae84-43fb-a49c-9e9a1714c63d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:56.397477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-46fdab59-ae84-43fb-a49c-9e9a1714c63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:56.400736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21933ca-8a95-452e-9e4e-66ea6533ac17 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:56.401476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21933ca-8a95-452e-9e4e-66ea6533ac17 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:56.401826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21933ca-8a95-452e-9e4e-66ea6533ac17 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:56.402229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21933ca-8a95-452e-9e4e-66ea6533ac17 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:56.402961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21933ca-8a95-452e-9e4e-66ea6533ac17 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:15:56.403351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21933ca-8a95-452e-9e4e-66ea6533ac17 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:56.405111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21933ca-8a95-452e-9e4e-66ea6533ac17 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:56.410137 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2238/4433] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:56 2022] POST /identity/v3/auth/tokens => generated 3861 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:56.411012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdab59-ae84-43fb-a49c-9e9a1714c63d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:56.422078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdab59-ae84-43fb-a49c-9e9a1714c63d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:56.427679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082703c-a238-47c3-bf44-5f760ec2fbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:56.428760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082703c-a238-47c3-bf44-5f760ec2fbc2 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:56.429265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082703c-a238-47c3-bf44-5f760ec2fbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:56.429548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082703c-a238-47c3-bf44-5f760ec2fbc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:56.430294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082703c-a238-47c3-bf44-5f760ec2fbc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:15:56.430598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082703c-a238-47c3-bf44-5f760ec2fbc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:56.432357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082703c-a238-47c3-bf44-5f760ec2fbc2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:56.436145 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2196/4434] 10.222.0.43 () {58 vars in 1170 bytes} [Sat Jul 2 21:15:56 2022] GET /identity/v3/endpoints?interface=internal => generated 479 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:15:56.442774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21933ca-8a95-452e-9e4e-66ea6533ac17 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:56.456341 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2239/4435] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:15:56.458200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082703c-a238-47c3-bf44-5f760ec2fbc2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:56.471493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082703c-a238-47c3-bf44-5f760ec2fbc2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:56.472719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21933ca-8a95-452e-9e4e-66ea6533ac17 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:56.486017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f869f73-8cf2-46dd-9734-9ffb9cc35bb8 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:56.487350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f869f73-8cf2-46dd-9734-9ffb9cc35bb8 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:56.487652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f869f73-8cf2-46dd-9734-9ffb9cc35bb8 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:56.487936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f869f73-8cf2-46dd-9734-9ffb9cc35bb8 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:56.488819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f869f73-8cf2-46dd-9734-9ffb9cc35bb8 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:56.490789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d6813-9d72-4d56-abb0-b2167b96a4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:56.491313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f869f73-8cf2-46dd-9734-9ffb9cc35bb8 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:56.492382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d6813-9d72-4d56-abb0-b2167b96a4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:56.492914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d6813-9d72-4d56-abb0-b2167b96a4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:56.493201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d6813-9d72-4d56-abb0-b2167b96a4c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:56.495151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d6813-9d72-4d56-abb0-b2167b96a4c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:56.498575 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d6813-9d72-4d56-abb0-b2167b96a4c4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:56.517499 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2197/4436] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:15:56 2022] POST /identity/v3/services => generated 289 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:15:56.521023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f869f73-8cf2-46dd-9734-9ffb9cc35bb8 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:56.561147 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2240/4437] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:15:56 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:15:56.566276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d6813-9d72-4d56-abb0-b2167b96a4c4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:56.576813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f869f73-8cf2-46dd-9734-9ffb9cc35bb8 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:56.630134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:56.659017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:56.675665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379dfc46-0608-4b97-a73f-a87ef28f18ca tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:56.679256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dfc46-0608-4b97-a73f-a87ef28f18ca tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:56.679603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dfc46-0608-4b97-a73f-a87ef28f18ca tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:56.679904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dfc46-0608-4b97-a73f-a87ef28f18ca tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:56.681423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379dfc46-0608-4b97-a73f-a87ef28f18ca tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:56.688872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379dfc46-0608-4b97-a73f-a87ef28f18ca tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:56.707857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d6813-9d72-4d56-abb0-b2167b96a4c4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:56.721056 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-379dfc46-0608-4b97-a73f-a87ef28f18ca tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-996254523. To ensure interoperability, identifiers should be a valid uuid. Jul 02 21:15:56.721056 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 02 21:15:56.721056 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:15:56.736339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f34775-7db1-4cfc-9e02-f2ae2df62144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:56.737196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f34775-7db1-4cfc-9e02-f2ae2df62144 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:56.737482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f34775-7db1-4cfc-9e02-f2ae2df62144 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:56.737761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f34775-7db1-4cfc-9e02-f2ae2df62144 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:56.738460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f34775-7db1-4cfc-9e02-f2ae2df62144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:56.752638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f34775-7db1-4cfc-9e02-f2ae2df62144 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:56.770682 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2198/4438] 10.222.0.43 () {60 vars in 1155 bytes} [Sat Jul 2 21:15:56 2022] POST /identity/v3/endpoints => generated 359 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:15:56.779421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379dfc46-0608-4b97-a73f-a87ef28f18ca tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:56.821882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379dfc46-0608-4b97-a73f-a87ef28f18ca tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:56.827792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1baf9c-f7ab-4e70-8f8a-53383c001e56 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:56.831457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1baf9c-f7ab-4e70-8f8a-53383c001e56 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:56.831457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1baf9c-f7ab-4e70-8f8a-53383c001e56 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:56.831751 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2241/4439] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:15:56 2022] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:15:56.831850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1baf9c-f7ab-4e70-8f8a-53383c001e56 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/regions/tempest-region-996254523` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:56.831850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1baf9c-f7ab-4e70-8f8a-53383c001e56 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-996254523)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:56.832027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1baf9c-f7ab-4e70-8f8a-53383c001e56 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:56.833381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f34775-7db1-4cfc-9e02-f2ae2df62144 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:56.837366 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2199/4440] 10.222.0.43 () {58 vars in 1202 bytes} [Sat Jul 2 21:15:56 2022] GET /identity/v3/regions/tempest-region-996254523 => generated 178 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:15:56.838918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1baf9c-f7ab-4e70-8f8a-53383c001e56 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:56.851695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1baf9c-f7ab-4e70-8f8a-53383c001e56 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:56.858807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac578f7-df2a-4d71-9d0d-25698ca36825 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:56.860284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac578f7-df2a-4d71-9d0d-25698ca36825 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:56.861099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac578f7-df2a-4d71-9d0d-25698ca36825 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:56.861630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac578f7-df2a-4d71-9d0d-25698ca36825 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/endpoints/197eb1ae5a704bf29b41ac1ba43e2480` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:56.863480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f34775-7db1-4cfc-9e02-f2ae2df62144 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:56.870039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac578f7-df2a-4d71-9d0d-25698ca36825 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=197eb1ae5a704bf29b41ac1ba43e2480)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:56.871460 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-0ac578f7-df2a-4d71-9d0d-25698ca36825 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:15:56.871460 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:15:56.871460 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:15:56.875014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac578f7-df2a-4d71-9d0d-25698ca36825 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:56.907260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945f7d7-5555-4c1a-94ac-b9f02d742b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:56.908005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945f7d7-5555-4c1a-94ac-b9f02d742b4e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:56.908336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945f7d7-5555-4c1a-94ac-b9f02d742b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:56.908616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945f7d7-5555-4c1a-94ac-b9f02d742b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:56.909350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945f7d7-5555-4c1a-94ac-b9f02d742b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:56.911844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945f7d7-5555-4c1a-94ac-b9f02d742b4e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:56.929644 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-0ac578f7-df2a-4d71-9d0d-25698ca36825 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1024467414. To ensure interoperability, identifiers should be a valid uuid. Jul 02 21:15:56.929644 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 02 21:15:56.929644 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:15:56.949372 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2242/4441] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:15:56.950596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945f7d7-5555-4c1a-94ac-b9f02d742b4e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:56.965352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945f7d7-5555-4c1a-94ac-b9f02d742b4e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:56.984776 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2200/4442] 10.222.0.43 () {60 vars in 1255 bytes} [Sat Jul 2 21:15:56 2022] PATCH /identity/v3/endpoints/197eb1ae5a704bf29b41ac1ba43e2480 => generated 364 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:15:56.986294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac578f7-df2a-4d71-9d0d-25698ca36825 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:57.004125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf15a57-bfd9-4072-a8cf-61c10e7e2b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:57.006596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf15a57-bfd9-4072-a8cf-61c10e7e2b43 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:57.007142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf15a57-bfd9-4072-a8cf-61c10e7e2b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:57.007640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf15a57-bfd9-4072-a8cf-61c10e7e2b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:57.008909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf15a57-bfd9-4072-a8cf-61c10e7e2b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:57.011895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf15a57-bfd9-4072-a8cf-61c10e7e2b43 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:57.031182 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2243/4443] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:15:57.033079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf15a57-bfd9-4072-a8cf-61c10e7e2b43 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:57.034716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac578f7-df2a-4d71-9d0d-25698ca36825 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:57.035877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1bf15a57-bfd9-4072-a8cf-61c10e7e2b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:57.043094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2c30f-1665-46ff-9533-b8f76fc398b4 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:57.043968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2c30f-1665-46ff-9533-b8f76fc398b4 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:57.045551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2c30f-1665-46ff-9533-b8f76fc398b4 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:57.046569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2c30f-1665-46ff-9533-b8f76fc398b4 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/regions/tempest-region-1024467414` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:57.049632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2c30f-1665-46ff-9533-b8f76fc398b4 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1024467414)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:57.050762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2c30f-1665-46ff-9533-b8f76fc398b4 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:57.071606 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2201/4444] 10.222.0.43 () {58 vars in 1205 bytes} [Sat Jul 2 21:15:56 2022] GET /identity/v3/regions/tempest-region-1024467414 => generated 180 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:15:57.075071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2c30f-1665-46ff-9533-b8f76fc398b4 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:57.134022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2c30f-1665-46ff-9533-b8f76fc398b4 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:57.145864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bcab1-b11b-4974-baa7-f02d335c6b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:57.148368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bcab1-b11b-4974-baa7-f02d335c6b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:57.148983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bcab1-b11b-4974-baa7-f02d335c6b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:57.149580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bcab1-b11b-4974-baa7-f02d335c6b19 admin admin] PATH_INFO: `/v3/projects/b59eba31be824dc79a797e0f756d1e2c/users/f194933a022742588069b78df9f1c177/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:57.171308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf15a57-bfd9-4072-a8cf-61c10e7e2b43 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:57.177885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bcab1-b11b-4974-baa7-f02d335c6b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b59eba31be824dc79a797e0f756d1e2c, user_id=f194933a022742588069b78df9f1c177, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:57.183308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bcab1-b11b-4974-baa7-f02d335c6b19 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:57.192426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00289a2-f011-4b6d-ba3b-411013d1a6ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:57.193097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00289a2-f011-4b6d-ba3b-411013d1a6ec service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:57.193658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00289a2-f011-4b6d-ba3b-411013d1a6ec service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:57.194026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00289a2-f011-4b6d-ba3b-411013d1a6ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:57.196776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f00289a2-f011-4b6d-ba3b-411013d1a6ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:57.216729 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2202/4445] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:15:57 2022] PUT /identity/v3/projects/b59eba31be824dc79a797e0f756d1e2c/users/f194933a022742588069b78df9f1c177/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:57.217820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bcab1-b11b-4974-baa7-f02d335c6b19 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:57.333202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:57.341809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00289a2-f011-4b6d-ba3b-411013d1a6ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:57.344505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00289a2-f011-4b6d-ba3b-411013d1a6ec service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:57.395490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bcab1-b11b-4974-baa7-f02d335c6b19 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:57.401397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516a12e-1466-4938-b4f9-36794b75dc1f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:57.402400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516a12e-1466-4938-b4f9-36794b75dc1f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:57.402750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516a12e-1466-4938-b4f9-36794b75dc1f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:57.403097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516a12e-1466-4938-b4f9-36794b75dc1f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/endpoints/197eb1ae5a704bf29b41ac1ba43e2480` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:57.411859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516a12e-1466-4938-b4f9-36794b75dc1f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=197eb1ae5a704bf29b41ac1ba43e2480)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:57.413038 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-8516a12e-1466-4938-b4f9-36794b75dc1f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:15:57.413038 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:15:57.413038 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:15:57.415164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516a12e-1466-4938-b4f9-36794b75dc1f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:57.423536 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2244/4446] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:57 2022] GET /identity/v3/auth/tokens => generated 4127 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:15:57.430068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c5e07-5898-4d0c-a64d-000583847fc7 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:57.431478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c5e07-5898-4d0c-a64d-000583847fc7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:57.432450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c5e07-5898-4d0c-a64d-000583847fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:57.444182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8516a12e-1466-4938-b4f9-36794b75dc1f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '197eb1ae5a704bf29b41ac1ba43e2480', 'request_id': 'req-8516a12e-1466-4938-b4f9-36794b75dc1f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:57.458576 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2203/4447] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:57 2022] DELETE /identity/v3/endpoints/197eb1ae5a704bf29b41ac1ba43e2480 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:57.459055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-876c5e07-5898-4d0c-a64d-000583847fc7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:57.461242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-876c5e07-5898-4d0c-a64d-000583847fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:57.464698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516a12e-1466-4938-b4f9-36794b75dc1f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:57.474839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:57.532729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516a12e-1466-4938-b4f9-36794b75dc1f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:57.548392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb47cbc-3121-4e5c-b281-e709c22f694f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:57.550021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb47cbc-3121-4e5c-b281-e709c22f694f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:57.550435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb47cbc-3121-4e5c-b281-e709c22f694f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:57.550722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb47cbc-3121-4e5c-b281-e709c22f694f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/regions/tempest-region-1024467414` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:57.551563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb47cbc-3121-4e5c-b281-e709c22f694f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1024467414)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:57.554276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb47cbc-3121-4e5c-b281-e709c22f694f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:57.628851 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2204/4448] 10.222.0.43 () {58 vars in 1208 bytes} [Sat Jul 2 21:15:57 2022] DELETE /identity/v3/regions/tempest-region-1024467414 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:57.633438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb47cbc-3121-4e5c-b281-e709c22f694f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:57.665551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb47cbc-3121-4e5c-b281-e709c22f694f tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:57.666446 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2245/4449] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:57 2022] POST /identity/v3/auth/tokens => generated 3994 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:57.667864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c5e07-5898-4d0c-a64d-000583847fc7 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:57.671729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ee92d-1269-47ba-be2a-bb70ae9cbafa tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:57.673086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ee92d-1269-47ba-be2a-bb70ae9cbafa tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:57.673474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ee92d-1269-47ba-be2a-bb70ae9cbafa tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:57.673850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ee92d-1269-47ba-be2a-bb70ae9cbafa tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/regions/tempest-region-996254523` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:57.674814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ee92d-1269-47ba-be2a-bb70ae9cbafa tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-996254523)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:57.676734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ee92d-1269-47ba-be2a-bb70ae9cbafa tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:57.711722 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2205/4450] 10.222.0.43 () {58 vars in 1205 bytes} [Sat Jul 2 21:15:57 2022] DELETE /identity/v3/regions/tempest-region-996254523 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:15:57.713152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ee92d-1269-47ba-be2a-bb70ae9cbafa tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:57.778712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c5e07-5898-4d0c-a64d-000583847fc7 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:57.801443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eff48-8b07-4f0d-95ab-64cf2b02bd83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:57.803666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eff48-8b07-4f0d-95ab-64cf2b02bd83 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:57.804242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eff48-8b07-4f0d-95ab-64cf2b02bd83 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:57.805598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021eff48-8b07-4f0d-95ab-64cf2b02bd83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:57.828253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-021eff48-8b07-4f0d-95ab-64cf2b02bd83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:57.836800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ee92d-1269-47ba-be2a-bb70ae9cbafa tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:57.841603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7fff7-bd2d-4cc4-9170-46db6fb24646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:57.842611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7fff7-bd2d-4cc4-9170-46db6fb24646 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:57.842901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7fff7-bd2d-4cc4-9170-46db6fb24646 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:57.843182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7fff7-bd2d-4cc4-9170-46db6fb24646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:57.857076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7fff7-bd2d-4cc4-9170-46db6fb24646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:57.858594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7fff7-bd2d-4cc4-9170-46db6fb24646 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:57.916714 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2206/4451] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:57 2022] GET /identity/v3/auth/tokens => generated 3994 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:15:57.917614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7fff7-bd2d-4cc4-9170-46db6fb24646 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:57.957333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021eff48-8b07-4f0d-95ab-64cf2b02bd83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:57.957525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7fff7-bd2d-4cc4-9170-46db6fb24646 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:57.959657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021eff48-8b07-4f0d-95ab-64cf2b02bd83 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:57.962600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e51aa8-6d45-4be5-916c-fc592f63adac tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:57.963909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e51aa8-6d45-4be5-916c-fc592f63adac tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:57.964243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e51aa8-6d45-4be5-916c-fc592f63adac tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:57.964674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e51aa8-6d45-4be5-916c-fc592f63adac tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/services/784c22893f1446bf83a9bfa1751fc311` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:57.965357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e51aa8-6d45-4be5-916c-fc592f63adac tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:delete_service(service_id=784c22893f1446bf83a9bfa1751fc311)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:57.966492 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-42e51aa8-6d45-4be5-916c-fc592f63adac tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:15:57.966492 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:15:57.966492 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:15:57.967414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e51aa8-6d45-4be5-916c-fc592f63adac tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:57.968568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:57.992003 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2246/4452] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:57 2022] GET /identity/v3/auth/tokens => generated 4127 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:15:58.012092 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2207/4453] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:15:57 2022] DELETE /identity/v3/services/784c22893f1446bf83a9bfa1751fc311 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:58.018319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eff48-8b07-4f0d-95ab-64cf2b02bd83 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:58.030778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021eff48-8b07-4f0d-95ab-64cf2b02bd83 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:58.050401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e1ac4-b520-47ad-8b45-32ad946c0774 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:58.051689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e1ac4-b520-47ad-8b45-32ad946c0774 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:58.051823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e1ac4-b520-47ad-8b45-32ad946c0774 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:58.052171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e1ac4-b520-47ad-8b45-32ad946c0774 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/endpoints/d22291997b074abda61214dc129476ac` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:58.059751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e1ac4-b520-47ad-8b45-32ad946c0774 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=d22291997b074abda61214dc129476ac)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:58.061292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e1ac4-b520-47ad-8b45-32ad946c0774 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:58.087199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c5e1ac4-b520-47ad-8b45-32ad946c0774 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'd22291997b074abda61214dc129476ac', 'request_id': 'req-3c5e1ac4-b520-47ad-8b45-32ad946c0774'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:58.099126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e51aa8-6d45-4be5-916c-fc592f63adac tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:58.101430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-42e51aa8-6d45-4be5-916c-fc592f63adac tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:58.108902 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2247/4454] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:58 2022] DELETE /identity/v3/endpoints/d22291997b074abda61214dc129476ac => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:58.113487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e1ac4-b520-47ad-8b45-32ad946c0774 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:58.156011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e51aa8-6d45-4be5-916c-fc592f63adac tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:58.159457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e1ac4-b520-47ad-8b45-32ad946c0774 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:58.176488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183dfda-9d66-48d9-8e6f-fbf29f91c975 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:58.179864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183dfda-9d66-48d9-8e6f-fbf29f91c975 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:58.180202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183dfda-9d66-48d9-8e6f-fbf29f91c975 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:58.181045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183dfda-9d66-48d9-8e6f-fbf29f91c975 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/regions/tempest-region-2015295920` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:58.181787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183dfda-9d66-48d9-8e6f-fbf29f91c975 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2015295920)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:58.186905 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-8183dfda-9d66-48d9-8e6f-fbf29f91c975 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:15:58.186905 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:15:58.186905 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:15:58.189196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183dfda-9d66-48d9-8e6f-fbf29f91c975 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:58.204911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b7966-c359-4258-923d-dc94fc8a7e8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:58.206573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b7966-c359-4258-923d-dc94fc8a7e8c service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:58.208080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b7966-c359-4258-923d-dc94fc8a7e8c service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:58.209990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b7966-c359-4258-923d-dc94fc8a7e8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:58.213485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-822b7966-c359-4258-923d-dc94fc8a7e8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:58.242295 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2248/4455] 10.222.0.43 () {58 vars in 1208 bytes} [Sat Jul 2 21:15:58 2022] DELETE /identity/v3/regions/tempest-region-2015295920 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:58.246463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183dfda-9d66-48d9-8e6f-fbf29f91c975 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:58.285881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183dfda-9d66-48d9-8e6f-fbf29f91c975 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:58.292179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9878c9-a8a8-4b41-bb28-8a29320a3c53 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:58.293122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9878c9-a8a8-4b41-bb28-8a29320a3c53 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:58.293466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9878c9-a8a8-4b41-bb28-8a29320a3c53 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:58.293905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9878c9-a8a8-4b41-bb28-8a29320a3c53 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/services/4c9c5e584e83492888f4e36ab2036124` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:58.295156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9878c9-a8a8-4b41-bb28-8a29320a3c53 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4c9c5e584e83492888f4e36ab2036124)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:58.295749 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-1b9878c9-a8a8-4b41-bb28-8a29320a3c53 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:15:58.295749 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:15:58.295749 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:15:58.296895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9878c9-a8a8-4b41-bb28-8a29320a3c53 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:58.332164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:58.355455 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2249/4456] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:15:58 2022] DELETE /identity/v3/services/4c9c5e584e83492888f4e36ab2036124 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:58.357643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9878c9-a8a8-4b41-bb28-8a29320a3c53 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:58.381364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b7966-c359-4258-923d-dc94fc8a7e8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:58.382985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b7966-c359-4258-923d-dc94fc8a7e8c service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:58.387081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9878c9-a8a8-4b41-bb28-8a29320a3c53 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:58.400735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee634f-c785-45bb-9cd4-706206186e17 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:58.401860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee634f-c785-45bb-9cd4-706206186e17 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:58.402157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee634f-c785-45bb-9cd4-706206186e17 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:58.402442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee634f-c785-45bb-9cd4-706206186e17 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/endpoints/99042c8fae4a44ad818aed491ca40505` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:58.410589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee634f-c785-45bb-9cd4-706206186e17 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=99042c8fae4a44ad818aed491ca40505)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:58.412393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee634f-c785-45bb-9cd4-706206186e17 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:58.426471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3bee634f-c785-45bb-9cd4-706206186e17 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '99042c8fae4a44ad818aed491ca40505', 'request_id': 'req-3bee634f-c785-45bb-9cd4-706206186e17'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:58.440226 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2208/4457] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:58 2022] GET /identity/v3/auth/tokens => generated 3623 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:15:58.466450 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2250/4458] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:58 2022] DELETE /identity/v3/endpoints/99042c8fae4a44ad818aed491ca40505 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:58.467208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b7966-c359-4258-923d-dc94fc8a7e8c service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:58.488425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b7966-c359-4258-923d-dc94fc8a7e8c service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:58.527856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe09f6f-ce50-4dff-b92d-5ef8927b6615 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:58.528746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe09f6f-ce50-4dff-b92d-5ef8927b6615 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:58.529028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe09f6f-ce50-4dff-b92d-5ef8927b6615 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:58.529304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe09f6f-ce50-4dff-b92d-5ef8927b6615 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/regions/tempest-region-956190106` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:58.532108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe09f6f-ce50-4dff-b92d-5ef8927b6615 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-956190106)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:58.533750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe09f6f-ce50-4dff-b92d-5ef8927b6615 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:58.579071 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2209/4459] 10.222.0.43 () {58 vars in 1205 bytes} [Sat Jul 2 21:15:58 2022] DELETE /identity/v3/regions/tempest-region-956190106 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:58.584013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee634f-c785-45bb-9cd4-706206186e17 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:58.600075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee634f-c785-45bb-9cd4-706206186e17 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:58.629414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335f074-9652-403d-91bc-a6fcd725a58b tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72e54259e3f4410a83a7a5450cec1eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c4418d5efc542a88b29f122910b85ae', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:58.630467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335f074-9652-403d-91bc-a6fcd725a58b tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:58.630792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335f074-9652-403d-91bc-a6fcd725a58b tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:58.631106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335f074-9652-403d-91bc-a6fcd725a58b tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] PATH_INFO: `/v3/services/e1461042c23e4f7fb2816938eebf8c1b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:58.631943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335f074-9652-403d-91bc-a6fcd725a58b tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e1461042c23e4f7fb2816938eebf8c1b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:58.633774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335f074-9652-403d-91bc-a6fcd725a58b tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:58.666585 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2251/4460] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:15:58 2022] DELETE /identity/v3/services/e1461042c23e4f7fb2816938eebf8c1b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:15:58.673491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe09f6f-ce50-4dff-b92d-5ef8927b6615 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:58.675404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9fe09f6f-ce50-4dff-b92d-5ef8927b6615 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:58.720564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe09f6f-ce50-4dff-b92d-5ef8927b6615 tempest-EndPointsTestJSON-46541110 tempest-EndPointsTestJSON-46541110-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:58.772455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ece8c8-0e62-436d-8a81-84d189467106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:58.784231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ece8c8-0e62-436d-8a81-84d189467106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:58.786630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ece8c8-0e62-436d-8a81-84d189467106 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:58.786971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ece8c8-0e62-436d-8a81-84d189467106 admin admin] PATH_INFO: `/v3/users/8ab6c21ed10748a4995132123d9e69d7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:58.793452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ece8c8-0e62-436d-8a81-84d189467106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab6c21ed10748a4995132123d9e69d7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:58.809622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ece8c8-0e62-436d-8a81-84d189467106 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:58.830433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7a1df-b1a7-43c5-bd26-27338a26abcb None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:58.830433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7a1df-b1a7-43c5-bd26-27338a26abcb None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:58.830433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7a1df-b1a7-43c5-bd26-27338a26abcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:58.889205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-32e7a1df-b1a7-43c5-bd26-27338a26abcb None None] MFA Rules not processed for user `649c6088b26049ba9a765be082f38259`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:58.892812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-32e7a1df-b1a7-43c5-bd26-27338a26abcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:59.017795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-96ece8c8-0e62-436d-8a81-84d189467106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab6c21ed10748a4995132123d9e69d7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:59.031857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:59.040871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-96ece8c8-0e62-436d-8a81-84d189467106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab6c21ed10748a4995132123d9e69d7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:59.066003 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2252/4461] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:59.071020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-96ece8c8-0e62-436d-8a81-84d189467106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab6c21ed10748a4995132123d9e69d7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:59.073335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-96ece8c8-0e62-436d-8a81-84d189467106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab6c21ed10748a4995132123d9e69d7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:59.073769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-96ece8c8-0e62-436d-8a81-84d189467106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab6c21ed10748a4995132123d9e69d7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:15:59.129245 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2210/4462] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:15:58 2022] DELETE /identity/v3/users/8ab6c21ed10748a4995132123d9e69d7 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:15:59.133858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ebddf-85e3-421d-9b41-886ac4a7864e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:59.134261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ebddf-85e3-421d-9b41-886ac4a7864e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:59.134666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ebddf-85e3-421d-9b41-886ac4a7864e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:59.158191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-018ebddf-85e3-421d-9b41-886ac4a7864e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:15:59.159469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-018ebddf-85e3-421d-9b41-886ac4a7864e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:59.410542 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2253/4463] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:15:59.444394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ece8c8-0e62-436d-8a81-84d189467106 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:15:59.446832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-96ece8c8-0e62-436d-8a81-84d189467106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:15:59.628914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:59.644684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ece8c8-0e62-436d-8a81-84d189467106 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:15:59.650699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542df69-d353-47ea-8ceb-a78de85df3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:15:59.651436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542df69-d353-47ea-8ceb-a78de85df3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:15:59.651705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542df69-d353-47ea-8ceb-a78de85df3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:15:59.652027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542df69-d353-47ea-8ceb-a78de85df3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:15:59.665649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542df69-d353-47ea-8ceb-a78de85df3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:15:59.667546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542df69-d353-47ea-8ceb-a78de85df3f0 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:15:59.708241 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2211/4464] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:15:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:01.062829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ebddf-85e3-421d-9b41-886ac4a7864e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:01.064851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-018ebddf-85e3-421d-9b41-886ac4a7864e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:01.113290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ebddf-85e3-421d-9b41-886ac4a7864e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:01.128508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef03371-d4a7-4caf-bbfd-b0dc8698a7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:01.129420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef03371-d4a7-4caf-bbfd-b0dc8698a7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:01.129829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef03371-d4a7-4caf-bbfd-b0dc8698a7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:01.134621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef03371-d4a7-4caf-bbfd-b0dc8698a7f8 admin admin] PATH_INFO: `/v3/projects/861629fed81e4d4a9dde5168b522892e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:01.136414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef03371-d4a7-4caf-bbfd-b0dc8698a7f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=861629fed81e4d4a9dde5168b522892e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:01.138410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef03371-d4a7-4caf-bbfd-b0dc8698a7f8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:01.270857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4ef03371-d4a7-4caf-bbfd-b0dc8698a7f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861629fed81e4d4a9dde5168b522892e', 'request_id': 'req-4ef03371-d4a7-4caf-bbfd-b0dc8698a7f8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:01.297133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4ef03371-d4a7-4caf-bbfd-b0dc8698a7f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861629fed81e4d4a9dde5168b522892e', 'request_id': 'req-4ef03371-d4a7-4caf-bbfd-b0dc8698a7f8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:01.305189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4ef03371-d4a7-4caf-bbfd-b0dc8698a7f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861629fed81e4d4a9dde5168b522892e', 'request_id': 'req-4ef03371-d4a7-4caf-bbfd-b0dc8698a7f8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:01.336185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4ef03371-d4a7-4caf-bbfd-b0dc8698a7f8 admin admin] The token cache is being invalidate because project 861629fed81e4d4a9dde5168b522892e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:01.336486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4ef03371-d4a7-4caf-bbfd-b0dc8698a7f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:01.337547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4ef03371-d4a7-4caf-bbfd-b0dc8698a7f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:01.339494 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2254/4465] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:01 2022] DELETE /identity/v3/projects/861629fed81e4d4a9dde5168b522892e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:01.343664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542df69-d353-47ea-8ceb-a78de85df3f0 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:01.363411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542df69-d353-47ea-8ceb-a78de85df3f0 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:01.526932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e50c08-3eec-4fe3-b06f-46f1d9a45d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:01.527857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e50c08-3eec-4fe3-b06f-46f1d9a45d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:01.528170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e50c08-3eec-4fe3-b06f-46f1d9a45d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:01.528445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e50c08-3eec-4fe3-b06f-46f1d9a45d72 admin admin] PATH_INFO: `/v3/users/72e54259e3f4410a83a7a5450cec1eb0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:01.532298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e50c08-3eec-4fe3-b06f-46f1d9a45d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e54259e3f4410a83a7a5450cec1eb0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:01.534515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e50c08-3eec-4fe3-b06f-46f1d9a45d72 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:01.676071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e1e50c08-3eec-4fe3-b06f-46f1d9a45d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e54259e3f4410a83a7a5450cec1eb0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:01.690947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e1e50c08-3eec-4fe3-b06f-46f1d9a45d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e54259e3f4410a83a7a5450cec1eb0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:01.717131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e1e50c08-3eec-4fe3-b06f-46f1d9a45d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e54259e3f4410a83a7a5450cec1eb0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:01.718365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e1e50c08-3eec-4fe3-b06f-46f1d9a45d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e54259e3f4410a83a7a5450cec1eb0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:01.719450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e1e50c08-3eec-4fe3-b06f-46f1d9a45d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e54259e3f4410a83a7a5450cec1eb0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:01.741636 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2212/4466] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:01 2022] DELETE /identity/v3/users/72e54259e3f4410a83a7a5450cec1eb0 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:02.623943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef03371-d4a7-4caf-bbfd-b0dc8698a7f8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:02.623943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4ef03371-d4a7-4caf-bbfd-b0dc8698a7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:02.644841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef03371-d4a7-4caf-bbfd-b0dc8698a7f8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:02.767435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c0bb8-f81d-464f-af9d-ac8b77dafbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:02.768397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c0bb8-f81d-464f-af9d-ac8b77dafbc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:02.768683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c0bb8-f81d-464f-af9d-ac8b77dafbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:02.768961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c0bb8-f81d-464f-af9d-ac8b77dafbc3 admin admin] PATH_INFO: `/v3/projects/4c4418d5efc542a88b29f122910b85ae` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:02.773437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c0bb8-f81d-464f-af9d-ac8b77dafbc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4418d5efc542a88b29f122910b85ae)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:02.775410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c0bb8-f81d-464f-af9d-ac8b77dafbc3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:02.827505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:02.943218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-070c0bb8-f81d-464f-af9d-ac8b77dafbc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4418d5efc542a88b29f122910b85ae', 'request_id': 'req-070c0bb8-f81d-464f-af9d-ac8b77dafbc3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:02.958154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-070c0bb8-f81d-464f-af9d-ac8b77dafbc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4418d5efc542a88b29f122910b85ae', 'request_id': 'req-070c0bb8-f81d-464f-af9d-ac8b77dafbc3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:02.968283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-070c0bb8-f81d-464f-af9d-ac8b77dafbc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4418d5efc542a88b29f122910b85ae', 'request_id': 'req-070c0bb8-f81d-464f-af9d-ac8b77dafbc3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:02.987616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-070c0bb8-f81d-464f-af9d-ac8b77dafbc3 admin admin] The token cache is being invalidate because project 4c4418d5efc542a88b29f122910b85ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:02.988567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-070c0bb8-f81d-464f-af9d-ac8b77dafbc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:02.990138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-070c0bb8-f81d-464f-af9d-ac8b77dafbc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:02.993741 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2255/4467] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:02 2022] DELETE /identity/v3/projects/4c4418d5efc542a88b29f122910b85ae => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:02.998757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355de0b9-fd8a-4a1f-ac09-4a7f69f0b6db None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:02.999270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355de0b9-fd8a-4a1f-ac09-4a7f69f0b6db None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:02.999526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355de0b9-fd8a-4a1f-ac09-4a7f69f0b6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:03.059881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-355de0b9-fd8a-4a1f-ac09-4a7f69f0b6db None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:03.070659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-355de0b9-fd8a-4a1f-ac09-4a7f69f0b6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:03.087997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c0bb8-f81d-464f-af9d-ac8b77dafbc3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:03.090077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-070c0bb8-f81d-464f-af9d-ac8b77dafbc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:03.168647 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2213/4468] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:16:03.178936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f47190-ac1a-4be0-af22-c0cd0b9dbb95 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:03.179220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f47190-ac1a-4be0-af22-c0cd0b9dbb95 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:03.179504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f47190-ac1a-4be0-af22-c0cd0b9dbb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:03.213717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c0bb8-f81d-464f-af9d-ac8b77dafbc3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:03.213988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e8f47190-ac1a-4be0-af22-c0cd0b9dbb95 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:03.215573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e8f47190-ac1a-4be0-af22-c0cd0b9dbb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:03.220614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32197c4-d5e5-4bb0-ac4a-26debe331dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:03.223157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32197c4-d5e5-4bb0-ac4a-26debe331dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:03.223956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32197c4-d5e5-4bb0-ac4a-26debe331dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:03.224626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32197c4-d5e5-4bb0-ac4a-26debe331dc7 admin admin] PATH_INFO: `/v3/users/5ce94b54e7d943768a6e573b4ce758a6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:03.226918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32197c4-d5e5-4bb0-ac4a-26debe331dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce94b54e7d943768a6e573b4ce758a6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:03.227827 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2214/4469] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:03.228963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f47190-ac1a-4be0-af22-c0cd0b9dbb95 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:03.230539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32197c4-d5e5-4bb0-ac4a-26debe331dc7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:03.233838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:03.242921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f47190-ac1a-4be0-af22-c0cd0b9dbb95 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:03.250091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b3459-b12d-4d7f-a77b-a31edf076ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:03.254142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b3459-b12d-4d7f-a77b-a31edf076ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:03.254498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b3459-b12d-4d7f-a77b-a31edf076ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:03.254869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b3459-b12d-4d7f-a77b-a31edf076ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:03.258332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b3459-b12d-4d7f-a77b-a31edf076ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:16:03.259121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b3459-b12d-4d7f-a77b-a31edf076ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:03.263669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b3459-b12d-4d7f-a77b-a31edf076ee1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:03.282530 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2215/4470] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:03.286351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b3459-b12d-4d7f-a77b-a31edf076ee1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:03.301411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b3459-b12d-4d7f-a77b-a31edf076ee1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:03.310660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768612a-1ad5-4d48-8253-9adf302aae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:03.311636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768612a-1ad5-4d48-8253-9adf302aae43 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:03.312204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768612a-1ad5-4d48-8253-9adf302aae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:03.312693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768612a-1ad5-4d48-8253-9adf302aae43 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:03.313725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768612a-1ad5-4d48-8253-9adf302aae43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:03.318169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768612a-1ad5-4d48-8253-9adf302aae43 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:03.383430 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2216/4471] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:03 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:03.387197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b32197c4-d5e5-4bb0-ac4a-26debe331dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce94b54e7d943768a6e573b4ce758a6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:03.389487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768612a-1ad5-4d48-8253-9adf302aae43 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:03.413391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b32197c4-d5e5-4bb0-ac4a-26debe331dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce94b54e7d943768a6e573b4ce758a6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:03.414128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b32197c4-d5e5-4bb0-ac4a-26debe331dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce94b54e7d943768a6e573b4ce758a6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:03.416227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b32197c4-d5e5-4bb0-ac4a-26debe331dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce94b54e7d943768a6e573b4ce758a6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:03.430065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b32197c4-d5e5-4bb0-ac4a-26debe331dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce94b54e7d943768a6e573b4ce758a6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:03.465173 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2256/4472] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:03 2022] DELETE /identity/v3/users/5ce94b54e7d943768a6e573b4ce758a6 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:16:03.471740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e88f0a-1776-4c64-87c6-cc0d8977551d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:03.472145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e88f0a-1776-4c64-87c6-cc0d8977551d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:03.472350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e88f0a-1776-4c64-87c6-cc0d8977551d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:03.501007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768612a-1ad5-4d48-8253-9adf302aae43 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:03.502488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b9e88f0a-1776-4c64-87c6-cc0d8977551d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:03.504025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b9e88f0a-1776-4c64-87c6-cc0d8977551d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:03.521946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:03.650658 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2257/4473] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:16:03.668873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebdef7-9eff-42b0-ba60-1bea91dc0362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:03.669703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebdef7-9eff-42b0-ba60-1bea91dc0362 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:03.673252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e88f0a-1776-4c64-87c6-cc0d8977551d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:03.674709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebdef7-9eff-42b0-ba60-1bea91dc0362 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:03.675678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b9e88f0a-1776-4c64-87c6-cc0d8977551d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:03.681228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebdef7-9eff-42b0-ba60-1bea91dc0362 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:03.684385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebdef7-9eff-42b0-ba60-1bea91dc0362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:03.687585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebdef7-9eff-42b0-ba60-1bea91dc0362 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:03.755470 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2217/4474] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:03 2022] POST /identity/v3/users => generated 285 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:03.764599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebdef7-9eff-42b0-ba60-1bea91dc0362 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:03.770158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-93ebdef7-9eff-42b0-ba60-1bea91dc0362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:03.804063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebdef7-9eff-42b0-ba60-1bea91dc0362 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:03.815775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69531f8d-0f11-4fe0-8287-db8a7b7c0c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:03.816545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69531f8d-0f11-4fe0-8287-db8a7b7c0c66 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:03.816821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69531f8d-0f11-4fe0-8287-db8a7b7c0c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:03.817092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69531f8d-0f11-4fe0-8287-db8a7b7c0c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:03.817820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69531f8d-0f11-4fe0-8287-db8a7b7c0c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:03.819441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69531f8d-0f11-4fe0-8287-db8a7b7c0c66 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:03.846041 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2218/4475] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:03.852443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e88f0a-1776-4c64-87c6-cc0d8977551d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:03.854258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69531f8d-0f11-4fe0-8287-db8a7b7c0c66 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:03.862451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372012b0-5537-4ec2-aa2a-e339aa85ad4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:03.863117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372012b0-5537-4ec2-aa2a-e339aa85ad4c service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:03.863403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372012b0-5537-4ec2-aa2a-e339aa85ad4c service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:03.863667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372012b0-5537-4ec2-aa2a-e339aa85ad4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:03.877553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69531f8d-0f11-4fe0-8287-db8a7b7c0c66 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:03.892294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372012b0-5537-4ec2-aa2a-e339aa85ad4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:03.893768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372012b0-5537-4ec2-aa2a-e339aa85ad4c service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:03.905698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e043553-8844-400d-8a37-76ec0666b123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:03.905856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e043553-8844-400d-8a37-76ec0666b123 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:03.906116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e043553-8844-400d-8a37-76ec0666b123 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:03.906395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e043553-8844-400d-8a37-76ec0666b123 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:03.907313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e043553-8844-400d-8a37-76ec0666b123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:03.908951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e043553-8844-400d-8a37-76ec0666b123 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:03.926468 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2258/4476] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:16:03.943401 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2219/4477] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:03.947861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372012b0-5537-4ec2-aa2a-e339aa85ad4c service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:03.964054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372012b0-5537-4ec2-aa2a-e339aa85ad4c service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:03.975477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc481970-dec1-4bbd-bace-674224d01225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:03.976425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc481970-dec1-4bbd-bace-674224d01225 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:03.976705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc481970-dec1-4bbd-bace-674224d01225 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:03.976983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc481970-dec1-4bbd-bace-674224d01225 admin admin] PATH_INFO: `/v3/projects/5eadd8cc917044fc94ad068f3897543d/users/d2eded4ff6ca4ec09597f3123b6cea26/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:04.009345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc481970-dec1-4bbd-bace-674224d01225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eadd8cc917044fc94ad068f3897543d, user_id=d2eded4ff6ca4ec09597f3123b6cea26, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:04.034922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc481970-dec1-4bbd-bace-674224d01225 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:04.071022 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2259/4478] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:03 2022] PUT /identity/v3/projects/5eadd8cc917044fc94ad068f3897543d/users/d2eded4ff6ca4ec09597f3123b6cea26/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:04.081891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132027d3-76ff-47bb-afff-72c29d88b70e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:04.082828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132027d3-76ff-47bb-afff-72c29d88b70e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:04.083248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132027d3-76ff-47bb-afff-72c29d88b70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:04.157511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-132027d3-76ff-47bb-afff-72c29d88b70e None None] MFA Rules not processed for user `d2eded4ff6ca4ec09597f3123b6cea26`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:04.160131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-132027d3-76ff-47bb-afff-72c29d88b70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:04.258238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:04.341346 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2220/4479] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:04.345715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc481970-dec1-4bbd-bace-674224d01225 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:04.461851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc481970-dec1-4bbd-bace-674224d01225 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:04.467199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833617b-5b23-4987-810a-0b4f97740cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:04.467993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833617b-5b23-4987-810a-0b4f97740cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:04.468499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833617b-5b23-4987-810a-0b4f97740cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:04.468821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833617b-5b23-4987-810a-0b4f97740cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:04.470239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833617b-5b23-4987-810a-0b4f97740cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:04.472141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833617b-5b23-4987-810a-0b4f97740cb1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:04.508070 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2260/4480] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:04 2022] POST /identity/v3/projects => generated 367 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:04.509634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132027d3-76ff-47bb-afff-72c29d88b70e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:04.521291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132027d3-76ff-47bb-afff-72c29d88b70e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:04.600776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765efa4-9681-47a7-9a00-a50957b93aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:04.601513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765efa4-9681-47a7-9a00-a50957b93aaf admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:04.601796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765efa4-9681-47a7-9a00-a50957b93aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:04.602357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765efa4-9681-47a7-9a00-a50957b93aaf admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:04.603072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765efa4-9681-47a7-9a00-a50957b93aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:04.605227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765efa4-9681-47a7-9a00-a50957b93aaf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:04.632054 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2221/4481] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:04 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:16:04.633528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833617b-5b23-4987-810a-0b4f97740cb1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:04.646147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833617b-5b23-4987-810a-0b4f97740cb1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:04.651952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0561ae-86bb-433a-bfb6-263113fd4f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:04.652832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0561ae-86bb-433a-bfb6-263113fd4f9b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:04.653598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0561ae-86bb-433a-bfb6-263113fd4f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:04.653598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0561ae-86bb-433a-bfb6-263113fd4f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:04.654376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0561ae-86bb-433a-bfb6-263113fd4f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:04.656123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0561ae-86bb-433a-bfb6-263113fd4f9b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:04.668899 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2261/4482] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:04.673250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765efa4-9681-47a7-9a00-a50957b93aaf admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:04.692108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765efa4-9681-47a7-9a00-a50957b93aaf admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:04.699151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a87ff3-7242-453a-91cf-3adfad870331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:04.700424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a87ff3-7242-453a-91cf-3adfad870331 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:04.701411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a87ff3-7242-453a-91cf-3adfad870331 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:04.702193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a87ff3-7242-453a-91cf-3adfad870331 admin admin] PATH_INFO: `/v3/projects/4d9296a4871349e3982edf61dfc2686c/users/6dafe2316bae433f9749f352f43e2e2f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:04.746280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a87ff3-7242-453a-91cf-3adfad870331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9296a4871349e3982edf61dfc2686c, user_id=6dafe2316bae433f9749f352f43e2e2f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:04.750460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a87ff3-7242-453a-91cf-3adfad870331 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:04.797770 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2222/4483] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:04 2022] PUT /identity/v3/projects/4d9296a4871349e3982edf61dfc2686c/users/6dafe2316bae433f9749f352f43e2e2f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:04.802222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0561ae-86bb-433a-bfb6-263113fd4f9b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:04.828321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0561ae-86bb-433a-bfb6-263113fd4f9b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:04.850626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:04.926081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773e166-8a9c-46c8-bb97-b4515a51a66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:04.927397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773e166-8a9c-46c8-bb97-b4515a51a66a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:04.928809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773e166-8a9c-46c8-bb97-b4515a51a66a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:04.929540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773e166-8a9c-46c8-bb97-b4515a51a66a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:04.931247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773e166-8a9c-46c8-bb97-b4515a51a66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:04.933369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773e166-8a9c-46c8-bb97-b4515a51a66a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:04.949841 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2262/4484] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:04.954349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a87ff3-7242-453a-91cf-3adfad870331 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:04.972149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a87ff3-7242-453a-91cf-3adfad870331 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:04.977695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd13a9-e26b-4a2d-8370-9e737a57cad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:04.978616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd13a9-e26b-4a2d-8370-9e737a57cad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:04.978885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd13a9-e26b-4a2d-8370-9e737a57cad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:04.979163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd13a9-e26b-4a2d-8370-9e737a57cad4 admin admin] PATH_INFO: `/v3/projects/4d9296a4871349e3982edf61dfc2686c/users/6dafe2316bae433f9749f352f43e2e2f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:04.981704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd13a9-e26b-4a2d-8370-9e737a57cad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9296a4871349e3982edf61dfc2686c, user_id=6dafe2316bae433f9749f352f43e2e2f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:04.985432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd13a9-e26b-4a2d-8370-9e737a57cad4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:05.022882 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2223/4485] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:04 2022] PUT /identity/v3/projects/4d9296a4871349e3982edf61dfc2686c/users/6dafe2316bae433f9749f352f43e2e2f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:05.024831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58f8e6-78c2-4c87-949b-d00bd28e3e8a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:05.025422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58f8e6-78c2-4c87-949b-d00bd28e3e8a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:05.025717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58f8e6-78c2-4c87-949b-d00bd28e3e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:05.079928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bd58f8e6-78c2-4c87-949b-d00bd28e3e8a None None] MFA Rules not processed for user `6dafe2316bae433f9749f352f43e2e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:05.081740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bd58f8e6-78c2-4c87-949b-d00bd28e3e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:05.184790 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2263/4486] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:05.189089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd13a9-e26b-4a2d-8370-9e737a57cad4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:05.210224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd13a9-e26b-4a2d-8370-9e737a57cad4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:05.231094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710e7b6-a71f-4ae8-a7bc-89680a16bd2d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:05.235961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710e7b6-a71f-4ae8-a7bc-89680a16bd2d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:05.236291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710e7b6-a71f-4ae8-a7bc-89680a16bd2d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:05.236552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710e7b6-a71f-4ae8-a7bc-89680a16bd2d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:05.237272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710e7b6-a71f-4ae8-a7bc-89680a16bd2d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:05.239999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710e7b6-a71f-4ae8-a7bc-89680a16bd2d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:05.310257 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2224/4487] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:16:05 2022] POST /identity/v3/projects => generated 328 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:05.314986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58f8e6-78c2-4c87-949b-d00bd28e3e8a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:05.330034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58f8e6-78c2-4c87-949b-d00bd28e3e8a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:05.412775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546fac9-250e-480a-9b5b-b58e71e544a8 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:05.413613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546fac9-250e-480a-9b5b-b58e71e544a8 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:05.414002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546fac9-250e-480a-9b5b-b58e71e544a8 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:05.414460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546fac9-250e-480a-9b5b-b58e71e544a8 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:05.415303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546fac9-250e-480a-9b5b-b58e71e544a8 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:05.417932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546fac9-250e-480a-9b5b-b58e71e544a8 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:05.452856 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2264/4488] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:05 2022] POST /identity/v3/users => generated 416 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:05.456228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710e7b6-a71f-4ae8-a7bc-89680a16bd2d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:05.470994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710e7b6-a71f-4ae8-a7bc-89680a16bd2d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:05.479025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a18b01-356d-4537-a2d9-a641d1b8b9ca tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:05.479262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a18b01-356d-4537-a2d9-a641d1b8b9ca tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:05.479911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a18b01-356d-4537-a2d9-a641d1b8b9ca tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:05.480301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a18b01-356d-4537-a2d9-a641d1b8b9ca tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:05.481113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a18b01-356d-4537-a2d9-a641d1b8b9ca tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:05.482862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a18b01-356d-4537-a2d9-a641d1b8b9ca tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:05.505326 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2225/4489] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:16:05 2022] POST /identity/v3/roles => generated 243 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:16:05.509437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546fac9-250e-480a-9b5b-b58e71e544a8 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:05.533989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546fac9-250e-480a-9b5b-b58e71e544a8 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:05.543626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95ddcd-2f25-46b9-ae31-4d8384e3a0f2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:05.544665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95ddcd-2f25-46b9-ae31-4d8384e3a0f2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:05.545130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95ddcd-2f25-46b9-ae31-4d8384e3a0f2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:05.545578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95ddcd-2f25-46b9-ae31-4d8384e3a0f2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:05.546815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95ddcd-2f25-46b9-ae31-4d8384e3a0f2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:05.548378 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-ab95ddcd-2f25-46b9-ae31-4d8384e3a0f2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:16:05.548378 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:16:05.548378 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:16:05.551398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95ddcd-2f25-46b9-ae31-4d8384e3a0f2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:05.572387 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2265/4490] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:16:05 2022] POST /identity/v3/roles => generated 246 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:05.575931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a18b01-356d-4537-a2d9-a641d1b8b9ca tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:05.605767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a18b01-356d-4537-a2d9-a641d1b8b9ca tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:05.611632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7a465-0f14-4a87-82ba-05f59bc7f2a5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:05.612882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7a465-0f14-4a87-82ba-05f59bc7f2a5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:05.613341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7a465-0f14-4a87-82ba-05f59bc7f2a5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:05.613793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7a465-0f14-4a87-82ba-05f59bc7f2a5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects/27bb958031264f288b402907e8a6a427/users/aad87bcc291a4fca9eccc8f83fc47665/roles/a8138c8db2aa4e32980fa036a39ea882` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:05.634748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7a465-0f14-4a87-82ba-05f59bc7f2a5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_grant(project_id=27bb958031264f288b402907e8a6a427, user_id=aad87bcc291a4fca9eccc8f83fc47665, role_id=a8138c8db2aa4e32980fa036a39ea882)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:05.637944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7a465-0f14-4a87-82ba-05f59bc7f2a5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:05.657551 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2226/4491] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:05 2022] PUT /identity/v3/projects/27bb958031264f288b402907e8a6a427/users/aad87bcc291a4fca9eccc8f83fc47665/roles/a8138c8db2aa4e32980fa036a39ea882 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:16:05.661904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95ddcd-2f25-46b9-ae31-4d8384e3a0f2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:05.676328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95ddcd-2f25-46b9-ae31-4d8384e3a0f2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:05.686547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:05.711914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7a465-0f14-4a87-82ba-05f59bc7f2a5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:05.714168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-40c7a465-0f14-4a87-82ba-05f59bc7f2a5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:05.776588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad267f44-3200-497b-91eb-4f0cd6b8e090 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:05.777667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad267f44-3200-497b-91eb-4f0cd6b8e090 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:05.778032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad267f44-3200-497b-91eb-4f0cd6b8e090 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:05.778356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad267f44-3200-497b-91eb-4f0cd6b8e090 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects/27bb958031264f288b402907e8a6a427/users/aad87bcc291a4fca9eccc8f83fc47665/roles/69f36fb3f4f244788ce40ec28202dfb7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:05.779369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:05.780842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad267f44-3200-497b-91eb-4f0cd6b8e090 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_grant(project_id=27bb958031264f288b402907e8a6a427, user_id=aad87bcc291a4fca9eccc8f83fc47665, role_id=69f36fb3f4f244788ce40ec28202dfb7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:05.785429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad267f44-3200-497b-91eb-4f0cd6b8e090 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:05.815046 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2266/4492] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:05 2022] PUT /identity/v3/projects/27bb958031264f288b402907e8a6a427/users/aad87bcc291a4fca9eccc8f83fc47665/roles/69f36fb3f4f244788ce40ec28202dfb7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:16:05.820030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad267f44-3200-497b-91eb-4f0cd6b8e090 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:05.840006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7a465-0f14-4a87-82ba-05f59bc7f2a5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:05.927695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9bf75-eb8f-432c-82a4-d6fc751b08a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:05.928599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9bf75-eb8f-432c-82a4-d6fc751b08a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:05.928885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9bf75-eb8f-432c-82a4-d6fc751b08a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:05.929409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9bf75-eb8f-432c-82a4-d6fc751b08a9 admin admin] PATH_INFO: `/v3/projects/c71e0c400aa1407f81c69e5341fe1d89` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:05.930427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9bf75-eb8f-432c-82a4-d6fc751b08a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c71e0c400aa1407f81c69e5341fe1d89)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:05.933033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9bf75-eb8f-432c-82a4-d6fc751b08a9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:05.935151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad267f44-3200-497b-91eb-4f0cd6b8e090 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:05.948320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c4f99-ee01-4294-ba97-49d369c9a3f6 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:05.949073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c4f99-ee01-4294-ba97-49d369c9a3f6 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:05.949353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c4f99-ee01-4294-ba97-49d369c9a3f6 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:05.949693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c4f99-ee01-4294-ba97-49d369c9a3f6 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:05.950468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c4f99-ee01-4294-ba97-49d369c9a3f6 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:05.951572 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-199c4f99-ee01-4294-ba97-49d369c9a3f6 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:16:05.951572 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:16:05.951572 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:16:05.953018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c4f99-ee01-4294-ba97-49d369c9a3f6 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:05.996372 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2267/4493] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:05 2022] GET /identity/v3/users => generated 8622 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:06.002216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c9b3-3e88-4a09-b539-212523d126b1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:06.002510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c9b3-3e88-4a09-b539-212523d126b1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:06.002843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c9b3-3e88-4a09-b539-212523d126b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:06.056433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cec9bf75-eb8f-432c-82a4-d6fc751b08a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c71e0c400aa1407f81c69e5341fe1d89', 'request_id': 'req-cec9bf75-eb8f-432c-82a4-d6fc751b08a9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:06.069342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cec9bf75-eb8f-432c-82a4-d6fc751b08a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c71e0c400aa1407f81c69e5341fe1d89', 'request_id': 'req-cec9bf75-eb8f-432c-82a4-d6fc751b08a9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:06.077098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9569c9b3-3e88-4a09-b539-212523d126b1 None None] MFA Rules not processed for user `aad87bcc291a4fca9eccc8f83fc47665`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:06.077890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cec9bf75-eb8f-432c-82a4-d6fc751b08a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c71e0c400aa1407f81c69e5341fe1d89', 'request_id': 'req-cec9bf75-eb8f-432c-82a4-d6fc751b08a9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:06.078821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9569c9b3-3e88-4a09-b539-212523d126b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:06.122356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cec9bf75-eb8f-432c-82a4-d6fc751b08a9 admin admin] The token cache is being invalidate because project c71e0c400aa1407f81c69e5341fe1d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:06.124405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cec9bf75-eb8f-432c-82a4-d6fc751b08a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:06.127406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cec9bf75-eb8f-432c-82a4-d6fc751b08a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:06.133610 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2227/4494] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:05 2022] DELETE /identity/v3/projects/c71e0c400aa1407f81c69e5341fe1d89 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:16:06.136628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9bf75-eb8f-432c-82a4-d6fc751b08a9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:06.139972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cec9bf75-eb8f-432c-82a4-d6fc751b08a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:06.173002 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2268/4495] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:16:06.174577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e12b2-d7ca-4db8-a378-826077c232ad None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:06.174867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e12b2-d7ca-4db8-a378-826077c232ad None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:06.175147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e12b2-d7ca-4db8-a378-826077c232ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:06.200616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f63e12b2-d7ca-4db8-a378-826077c232ad None None] MFA Rules not processed for user `aad87bcc291a4fca9eccc8f83fc47665`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:06.201958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f63e12b2-d7ca-4db8-a378-826077c232ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:06.230915 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2269/4496] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:06.243772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e12b2-d7ca-4db8-a378-826077c232ad None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:06.259352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e12b2-d7ca-4db8-a378-826077c232ad None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:06.266905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e315a45-dec6-4988-9d09-e4c69a5243cd tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad87bcc291a4fca9eccc8f83fc47665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27bb958031264f288b402907e8a6a427', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-977804635', 'tempest-DelegatedRole-463223644'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:06.268780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315a45-dec6-4988-9d09-e4c69a5243cd tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:06.269401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315a45-dec6-4988-9d09-e4c69a5243cd tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:06.270232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315a45-dec6-4988-9d09-e4c69a5243cd tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:06.271284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e315a45-dec6-4988-9d09-e4c69a5243cd tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] RBAC: Authorizing `identity:create_trust()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:06.273316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e315a45-dec6-4988-9d09-e4c69a5243cd tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:06.296310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:06.314261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9bf75-eb8f-432c-82a4-d6fc751b08a9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:06.321219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff5019-c130-48d8-a817-ac97877c45cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:06.322337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff5019-c130-48d8-a817-ac97877c45cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:06.322618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff5019-c130-48d8-a817-ac97877c45cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:06.322899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff5019-c130-48d8-a817-ac97877c45cc admin admin] PATH_INFO: `/v3/users/b5355434718f43c89156bee7bd939aa7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:06.324427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff5019-c130-48d8-a817-ac97877c45cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5355434718f43c89156bee7bd939aa7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:06.326579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff5019-c130-48d8-a817-ac97877c45cc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:06.329540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:06.405555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-87ff5019-c130-48d8-a817-ac97877c45cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5355434718f43c89156bee7bd939aa7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:06.412395 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2270/4497] 10.222.0.43 () {60 vars in 1173 bytes} [Sat Jul 2 21:16:06 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:06.416885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e315a45-dec6-4988-9d09-e4c69a5243cd tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:06.419365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3e315a45-dec6-4988-9d09-e4c69a5243cd tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:06.424503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-87ff5019-c130-48d8-a817-ac97877c45cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5355434718f43c89156bee7bd939aa7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:06.436137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-87ff5019-c130-48d8-a817-ac97877c45cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5355434718f43c89156bee7bd939aa7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:06.437741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-87ff5019-c130-48d8-a817-ac97877c45cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5355434718f43c89156bee7bd939aa7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:06.439041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-87ff5019-c130-48d8-a817-ac97877c45cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5355434718f43c89156bee7bd939aa7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:06.475169 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2228/4498] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:06 2022] DELETE /identity/v3/users/b5355434718f43c89156bee7bd939aa7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:06.520142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e315a45-dec6-4988-9d09-e4c69a5243cd tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:06.592567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa9b89-e134-4620-bc4f-7cbf750a6f64 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:06.593492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa9b89-e134-4620-bc4f-7cbf750a6f64 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:06.593639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa9b89-e134-4620-bc4f-7cbf750a6f64 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:06.593848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa9b89-e134-4620-bc4f-7cbf750a6f64 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:06.595016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa9b89-e134-4620-bc4f-7cbf750a6f64 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:06.596242 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-55aa9b89-e134-4620-bc4f-7cbf750a6f64 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:16:06.596242 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:16:06.596242 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:16:06.597204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa9b89-e134-4620-bc4f-7cbf750a6f64 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:06.613366 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2271/4499] 10.222.0.43 () {58 vars in 1154 bytes} [Sat Jul 2 21:16:06 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:06.617639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff5019-c130-48d8-a817-ac97877c45cc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:06.619961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-87ff5019-c130-48d8-a817-ac97877c45cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:06.777574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff5019-c130-48d8-a817-ac97877c45cc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:06.782666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a0beb-24cc-4c14-b005-d3b073a35377 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad87bcc291a4fca9eccc8f83fc47665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27bb958031264f288b402907e8a6a427', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-977804635', 'tempest-DelegatedRole-463223644'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:06.783532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a0beb-24cc-4c14-b005-d3b073a35377 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:06.784050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a0beb-24cc-4c14-b005-d3b073a35377 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:06.784220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a0beb-24cc-4c14-b005-d3b073a35377 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] PATH_INFO: `/v3/OS-TRUST/trusts/7f93ed7d081a423cbabe1ea5dabdc860` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:06.817565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a0beb-24cc-4c14-b005-d3b073a35377 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] RBAC: Authorizing `identity:delete_trust(trust_id=7f93ed7d081a423cbabe1ea5dabdc860)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:06.819077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a0beb-24cc-4c14-b005-d3b073a35377 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:06.881341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-547a0beb-24cc-4c14-b005-d3b073a35377 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '7f93ed7d081a423cbabe1ea5dabdc860', 'request_id': 'req-547a0beb-24cc-4c14-b005-d3b073a35377'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:06.894283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa9b89-e134-4620-bc4f-7cbf750a6f64 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:06.896363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-55aa9b89-e134-4620-bc4f-7cbf750a6f64 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:06.897141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-547a0beb-24cc-4c14-b005-d3b073a35377 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7f93ed7d081a423cbabe1ea5dabdc860', 'request_id': 'req-547a0beb-24cc-4c14-b005-d3b073a35377'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:06.897934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-547a0beb-24cc-4c14-b005-d3b073a35377 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7f93ed7d081a423cbabe1ea5dabdc860', 'request_id': 'req-547a0beb-24cc-4c14-b005-d3b073a35377'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:06.906470 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2229/4500] 10.222.0.43 () {58 vars in 1253 bytes} [Sat Jul 2 21:16:06 2022] DELETE /identity/v3/OS-TRUST/trusts/7f93ed7d081a423cbabe1ea5dabdc860 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:06.914991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a0beb-24cc-4c14-b005-d3b073a35377 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:06.917201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-547a0beb-24cc-4c14-b005-d3b073a35377 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:06.952914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a0beb-24cc-4c14-b005-d3b073a35377 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:06.959844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dcb885-9845-4862-b88a-3930bdaa4a12 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aad87bcc291a4fca9eccc8f83fc47665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27bb958031264f288b402907e8a6a427', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-977804635', 'tempest-DelegatedRole-463223644'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:06.961781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcb885-9845-4862-b88a-3930bdaa4a12 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:06.962115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcb885-9845-4862-b88a-3930bdaa4a12 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:06.962401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcb885-9845-4862-b88a-3930bdaa4a12 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] PATH_INFO: `/v3/OS-TRUST/trusts/7f93ed7d081a423cbabe1ea5dabdc860` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:07.018615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa9b89-e134-4620-bc4f-7cbf750a6f64 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:07.023446 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-47dcb885-9845-4862-b88a-3930bdaa4a12 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] Could not find trust: 7f93ed7d081a423cbabe1ea5dabdc860.: keystone.exception.TrustNotFound: Could not find trust: 7f93ed7d081a423cbabe1ea5dabdc860. Jul 02 21:16:07.023446 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:16:07.023446 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:16:07.023446 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:16:07.023446 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:16:07.023446 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:16:07.023446 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:16:07.023446 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:16:07.023446 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:16:07.023446 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:16:07.023446 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:16:07.023446 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:16:07.023446 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 02 21:16:07.023446 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 02 21:16:07.023446 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 02 21:16:07.024922 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 02 21:16:07.024922 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 02 21:16:07.024922 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 02 21:16:07.024922 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 02 21:16:07.024922 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 02 21:16:07.024922 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:16:07.024922 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:16:07.024922 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 02 21:16:07.024922 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 02 21:16:07.024922 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 02 21:16:07.024922 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 02 21:16:07.024922 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 7f93ed7d081a423cbabe1ea5dabdc860. Jul 02 21:16:07.024922 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:16:07.026208 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2230/4501] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:16:06 2022] GET /identity/v3/OS-TRUST/trusts/7f93ed7d081a423cbabe1ea5dabdc860 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 02 21:16:07.030338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dcb885-9845-4862-b88a-3930bdaa4a12 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:07.033561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-47dcb885-9845-4862-b88a-3930bdaa4a12 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:07.036800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa13f9-7555-412f-8a7b-92c8b0c9e0a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:07.039889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa13f9-7555-412f-8a7b-92c8b0c9e0a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:07.042641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa13f9-7555-412f-8a7b-92c8b0c9e0a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:07.043952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa13f9-7555-412f-8a7b-92c8b0c9e0a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:07.048650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1baa13f9-7555-412f-8a7b-92c8b0c9e0a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:07.068435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:07.076699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa13f9-7555-412f-8a7b-92c8b0c9e0a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:07.080154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa13f9-7555-412f-8a7b-92c8b0c9e0a2 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:07.092775 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2272/4502] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:07.099464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dcb885-9845-4862-b88a-3930bdaa4a12 tempest-TrustsV3TestJSON-672526365 tempest-user-1361352450] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:07.117579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa13f9-7555-412f-8a7b-92c8b0c9e0a2 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:07.119059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5456a0-3278-41a3-9869-de806dae9fbd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:07.119832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1baa13f9-7555-412f-8a7b-92c8b0c9e0a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:07.121080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5456a0-3278-41a3-9869-de806dae9fbd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:07.122952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5456a0-3278-41a3-9869-de806dae9fbd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:07.124156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5456a0-3278-41a3-9869-de806dae9fbd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles/69f36fb3f4f244788ce40ec28202dfb7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:07.132709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5456a0-3278-41a3-9869-de806dae9fbd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_role(role_id=69f36fb3f4f244788ce40ec28202dfb7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:07.141196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5456a0-3278-41a3-9869-de806dae9fbd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:07.245945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dd5456a0-3278-41a3-9869-de806dae9fbd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invalidating the token cache because role 69f36fb3f4f244788ce40ec28202dfb7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:07.246615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dd5456a0-3278-41a3-9869-de806dae9fbd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:07.247912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dd5456a0-3278-41a3-9869-de806dae9fbd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:07.250524 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2231/4503] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:07 2022] DELETE /identity/v3/roles/69f36fb3f4f244788ce40ec28202dfb7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:07.255480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5456a0-3278-41a3-9869-de806dae9fbd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:07.257923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dd5456a0-3278-41a3-9869-de806dae9fbd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:07.270995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:07.280117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa13f9-7555-412f-8a7b-92c8b0c9e0a2 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:07.365664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8473b04-710c-4177-bcfe-da3bb793fcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:07.366755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8473b04-710c-4177-bcfe-da3bb793fcfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:07.367142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8473b04-710c-4177-bcfe-da3bb793fcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:07.367546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8473b04-710c-4177-bcfe-da3bb793fcfd admin admin] PATH_INFO: `/v3/projects/300a791abd8e4470b569b0b79dc0cfea` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:07.369216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8473b04-710c-4177-bcfe-da3bb793fcfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=300a791abd8e4470b569b0b79dc0cfea)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:07.379802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8473b04-710c-4177-bcfe-da3bb793fcfd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:07.463516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e8473b04-710c-4177-bcfe-da3bb793fcfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '300a791abd8e4470b569b0b79dc0cfea', 'request_id': 'req-e8473b04-710c-4177-bcfe-da3bb793fcfd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:07.481283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5456a0-3278-41a3-9869-de806dae9fbd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:07.486065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e8473b04-710c-4177-bcfe-da3bb793fcfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '300a791abd8e4470b569b0b79dc0cfea', 'request_id': 'req-e8473b04-710c-4177-bcfe-da3bb793fcfd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:07.495902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e8473b04-710c-4177-bcfe-da3bb793fcfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '300a791abd8e4470b569b0b79dc0cfea', 'request_id': 'req-e8473b04-710c-4177-bcfe-da3bb793fcfd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:07.521986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e8473b04-710c-4177-bcfe-da3bb793fcfd admin admin] The token cache is being invalidate because project 300a791abd8e4470b569b0b79dc0cfea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:07.522295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e8473b04-710c-4177-bcfe-da3bb793fcfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:07.523055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e8473b04-710c-4177-bcfe-da3bb793fcfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:07.525450 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2273/4504] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:07 2022] DELETE /identity/v3/projects/300a791abd8e4470b569b0b79dc0cfea => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:07.531429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80d601-1b16-49ad-b333-7c4e09cba776 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:07.531834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80d601-1b16-49ad-b333-7c4e09cba776 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:07.532253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80d601-1b16-49ad-b333-7c4e09cba776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:07.572641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4c80d601-1b16-49ad-b333-7c4e09cba776 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:07.576782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4c80d601-1b16-49ad-b333-7c4e09cba776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:07.601126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b0873-ce89-433c-80b0-e66cf16ecbb1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:07.602044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b0873-ce89-433c-80b0-e66cf16ecbb1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:07.602316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b0873-ce89-433c-80b0-e66cf16ecbb1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:07.602646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b0873-ce89-433c-80b0-e66cf16ecbb1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles/a8138c8db2aa4e32980fa036a39ea882` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:07.604388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b0873-ce89-433c-80b0-e66cf16ecbb1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a8138c8db2aa4e32980fa036a39ea882)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:07.606099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b0873-ce89-433c-80b0-e66cf16ecbb1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:07.645490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:07.695606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c85b0873-ce89-433c-80b0-e66cf16ecbb1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invalidating the token cache because role a8138c8db2aa4e32980fa036a39ea882 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:07.695606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c85b0873-ce89-433c-80b0-e66cf16ecbb1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:07.695606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c85b0873-ce89-433c-80b0-e66cf16ecbb1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:07.695606 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2232/4505] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:07 2022] DELETE /identity/v3/roles/a8138c8db2aa4e32980fa036a39ea882 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:07.696157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b0873-ce89-433c-80b0-e66cf16ecbb1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:07.696157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c85b0873-ce89-433c-80b0-e66cf16ecbb1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:07.731301 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2274/4506] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:16:07.732758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2f7e1-842d-4c45-8d1d-c61f8766d1cb None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:07.733284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2f7e1-842d-4c45-8d1d-c61f8766d1cb None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:07.733510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2f7e1-842d-4c45-8d1d-c61f8766d1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:07.771380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-37f2f7e1-842d-4c45-8d1d-c61f8766d1cb None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:07.774417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-37f2f7e1-842d-4c45-8d1d-c61f8766d1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:07.822949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b0873-ce89-433c-80b0-e66cf16ecbb1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:07.830753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf250d42-4aeb-4f4e-867d-d57b3dce5692 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:07.831762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf250d42-4aeb-4f4e-867d-d57b3dce5692 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:07.832158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf250d42-4aeb-4f4e-867d-d57b3dce5692 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:07.832501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf250d42-4aeb-4f4e-867d-d57b3dce5692 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/users/aad87bcc291a4fca9eccc8f83fc47665` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:07.833850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf250d42-4aeb-4f4e-867d-d57b3dce5692 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_user(user_id=aad87bcc291a4fca9eccc8f83fc47665)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:07.836177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf250d42-4aeb-4f4e-867d-d57b3dce5692 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:07.861897 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2275/4507] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:16:07.866613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2f7e1-842d-4c45-8d1d-c61f8766d1cb None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:07.867957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:07.882210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2f7e1-842d-4c45-8d1d-c61f8766d1cb None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:07.889836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37433792-f8de-425d-9298-541718e6a971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:07.891030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37433792-f8de-425d-9298-541718e6a971 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:07.892474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37433792-f8de-425d-9298-541718e6a971 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:07.893457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37433792-f8de-425d-9298-541718e6a971 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:07.894339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37433792-f8de-425d-9298-541718e6a971 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:16:07.894947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37433792-f8de-425d-9298-541718e6a971 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:07.896697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37433792-f8de-425d-9298-541718e6a971 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:07.921002 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2276/4508] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:07.927243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37433792-f8de-425d-9298-541718e6a971 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:07.929665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bf250d42-4aeb-4f4e-867d-d57b3dce5692 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad87bcc291a4fca9eccc8f83fc47665'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:07.941865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37433792-f8de-425d-9298-541718e6a971 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:07.948465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a65366-a62f-43d9-8545-b2c6586fb37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:07.949486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a65366-a62f-43d9-8545-b2c6586fb37a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:07.949776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a65366-a62f-43d9-8545-b2c6586fb37a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:07.950247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a65366-a62f-43d9-8545-b2c6586fb37a admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:07.950477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bf250d42-4aeb-4f4e-867d-d57b3dce5692 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad87bcc291a4fca9eccc8f83fc47665'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:07.950985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a65366-a62f-43d9-8545-b2c6586fb37a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:07.954203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a65366-a62f-43d9-8545-b2c6586fb37a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:07.960150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bf250d42-4aeb-4f4e-867d-d57b3dce5692 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad87bcc291a4fca9eccc8f83fc47665'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:07.961205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bf250d42-4aeb-4f4e-867d-d57b3dce5692 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad87bcc291a4fca9eccc8f83fc47665'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:07.962859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bf250d42-4aeb-4f4e-867d-d57b3dce5692 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad87bcc291a4fca9eccc8f83fc47665'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:08.013963 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2233/4509] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:07 2022] DELETE /identity/v3/users/aad87bcc291a4fca9eccc8f83fc47665 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:08.018361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf250d42-4aeb-4f4e-867d-d57b3dce5692 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:08.020358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bf250d42-4aeb-4f4e-867d-d57b3dce5692 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:08.028178 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2277/4510] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:07 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:08.030062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a65366-a62f-43d9-8545-b2c6586fb37a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:08.032057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-96a65366-a62f-43d9-8545-b2c6586fb37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:08.155090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf250d42-4aeb-4f4e-867d-d57b3dce5692 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:08.231297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a65366-a62f-43d9-8545-b2c6586fb37a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:08.247238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36473dc-583f-488d-aaf3-c2651c054d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:08.248205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36473dc-583f-488d-aaf3-c2651c054d0f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:08.248539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36473dc-583f-488d-aaf3-c2651c054d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:08.248863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36473dc-583f-488d-aaf3-c2651c054d0f admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:08.249569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36473dc-583f-488d-aaf3-c2651c054d0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:08.252343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36473dc-583f-488d-aaf3-c2651c054d0f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:08.260779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bb81e-b05e-435a-9772-53c01f736cb5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:08.261784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bb81e-b05e-435a-9772-53c01f736cb5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:08.262207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bb81e-b05e-435a-9772-53c01f736cb5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:08.262489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bb81e-b05e-435a-9772-53c01f736cb5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects/27bb958031264f288b402907e8a6a427` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:08.264384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bb81e-b05e-435a-9772-53c01f736cb5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_project(project_id=27bb958031264f288b402907e8a6a427)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:08.266521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bb81e-b05e-435a-9772-53c01f736cb5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:08.299221 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2278/4511] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:08 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:08.300302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36473dc-583f-488d-aaf3-c2651c054d0f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:08.311871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36473dc-583f-488d-aaf3-c2651c054d0f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:08.319068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5359080-ea19-4a1e-9e4a-7960246950a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:08.319762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5359080-ea19-4a1e-9e4a-7960246950a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:08.320078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5359080-ea19-4a1e-9e4a-7960246950a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:08.320337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5359080-ea19-4a1e-9e4a-7960246950a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:08.321436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5359080-ea19-4a1e-9e4a-7960246950a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:08.323759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5359080-ea19-4a1e-9e4a-7960246950a7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:08.347772 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2279/4512] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:08.354287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5359080-ea19-4a1e-9e4a-7960246950a7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:08.398104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:08.414820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-209bb81e-b05e-435a-9772-53c01f736cb5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27bb958031264f288b402907e8a6a427', 'request_id': 'req-209bb81e-b05e-435a-9772-53c01f736cb5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:08.416329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5359080-ea19-4a1e-9e4a-7960246950a7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:08.424457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-209bb81e-b05e-435a-9772-53c01f736cb5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27bb958031264f288b402907e8a6a427', 'request_id': 'req-209bb81e-b05e-435a-9772-53c01f736cb5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:08.434527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-209bb81e-b05e-435a-9772-53c01f736cb5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27bb958031264f288b402907e8a6a427', 'request_id': 'req-209bb81e-b05e-435a-9772-53c01f736cb5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:08.449509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:08.467430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-209bb81e-b05e-435a-9772-53c01f736cb5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] The token cache is being invalidate because project 27bb958031264f288b402907e8a6a427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:08.468444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-209bb81e-b05e-435a-9772-53c01f736cb5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:08.469394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-209bb81e-b05e-435a-9772-53c01f736cb5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:08.471897 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2234/4513] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:08 2022] DELETE /identity/v3/projects/27bb958031264f288b402907e8a6a427 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:08.478466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bb81e-b05e-435a-9772-53c01f736cb5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:08.493778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-209bb81e-b05e-435a-9772-53c01f736cb5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:08.559497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18293ae-eb36-40b6-8e7a-527be0d396c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:08.563821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18293ae-eb36-40b6-8e7a-527be0d396c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:08.564454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18293ae-eb36-40b6-8e7a-527be0d396c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:08.564914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18293ae-eb36-40b6-8e7a-527be0d396c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:08.565837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18293ae-eb36-40b6-8e7a-527be0d396c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:08.567804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18293ae-eb36-40b6-8e7a-527be0d396c8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:08.588107 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2280/4514] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:16:08.592647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18293ae-eb36-40b6-8e7a-527be0d396c8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:08.595481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c18293ae-eb36-40b6-8e7a-527be0d396c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:08.610178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18293ae-eb36-40b6-8e7a-527be0d396c8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:08.617711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41846d4c-de8f-4a7d-9f4b-28767cf61ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:08.619461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41846d4c-de8f-4a7d-9f4b-28767cf61ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:08.619947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41846d4c-de8f-4a7d-9f4b-28767cf61ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:08.620476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41846d4c-de8f-4a7d-9f4b-28767cf61ca9 admin admin] PATH_INFO: `/v3/projects/48c2689f6b72433fa3a0cfd9a441481f/users/ace2003567a44064bb848b39f6470cae/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:08.620666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bb81e-b05e-435a-9772-53c01f736cb5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:08.626012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a9528-4e2e-490e-b2a3-6c6deb08bb8c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:08.627163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a9528-4e2e-490e-b2a3-6c6deb08bb8c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:08.627688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a9528-4e2e-490e-b2a3-6c6deb08bb8c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:08.627973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a9528-4e2e-490e-b2a3-6c6deb08bb8c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:08.628731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a9528-4e2e-490e-b2a3-6c6deb08bb8c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:08.631108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a9528-4e2e-490e-b2a3-6c6deb08bb8c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:08.654428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41846d4c-de8f-4a7d-9f4b-28767cf61ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c2689f6b72433fa3a0cfd9a441481f, user_id=ace2003567a44064bb848b39f6470cae, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:08.658406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41846d4c-de8f-4a7d-9f4b-28767cf61ca9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:08.686992 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2281/4515] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:08 2022] PUT /identity/v3/projects/48c2689f6b72433fa3a0cfd9a441481f/users/ace2003567a44064bb848b39f6470cae/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:08.696118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41846d4c-de8f-4a7d-9f4b-28767cf61ca9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:08.696680 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2235/4516] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:16:08 2022] POST /identity/v3/projects => generated 328 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:08.699930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28123b5f-5d33-4749-8ba3-0a313a30323b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:08.700701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28123b5f-5d33-4749-8ba3-0a313a30323b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:08.701953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28123b5f-5d33-4749-8ba3-0a313a30323b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:08.751187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-28123b5f-5d33-4749-8ba3-0a313a30323b None None] MFA Rules not processed for user `ace2003567a44064bb848b39f6470cae`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:08.754218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-28123b5f-5d33-4749-8ba3-0a313a30323b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:08.805432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41846d4c-de8f-4a7d-9f4b-28767cf61ca9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:08.888532 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2236/4517] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:08.893504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28123b5f-5d33-4749-8ba3-0a313a30323b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:08.904396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68cf94-cfd8-4c06-a01d-db37e4a7f2e9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:08.905953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68cf94-cfd8-4c06-a01d-db37e4a7f2e9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:08.906484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68cf94-cfd8-4c06-a01d-db37e4a7f2e9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:08.906936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68cf94-cfd8-4c06-a01d-db37e4a7f2e9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:08.908461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68cf94-cfd8-4c06-a01d-db37e4a7f2e9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:08.911150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68cf94-cfd8-4c06-a01d-db37e4a7f2e9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:08.941267 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2282/4518] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:08 2022] POST /identity/v3/users => generated 413 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:08.945963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68cf94-cfd8-4c06-a01d-db37e4a7f2e9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:08.961722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68cf94-cfd8-4c06-a01d-db37e4a7f2e9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:08.967840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:08.969481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948347ff-a907-4a28-b0d6-82a0f5439fc9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:08.972846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948347ff-a907-4a28-b0d6-82a0f5439fc9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:08.974021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948347ff-a907-4a28-b0d6-82a0f5439fc9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:08.974484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948347ff-a907-4a28-b0d6-82a0f5439fc9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:08.976786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948347ff-a907-4a28-b0d6-82a0f5439fc9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:08.979445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948347ff-a907-4a28-b0d6-82a0f5439fc9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:08.998371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28123b5f-5d33-4749-8ba3-0a313a30323b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:09.005958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47ace8-9336-43ce-920d-c22040f955cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:09.007196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47ace8-9336-43ce-920d-c22040f955cf admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:09.008581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47ace8-9336-43ce-920d-c22040f955cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:09.008873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47ace8-9336-43ce-920d-c22040f955cf admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:09.009645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47ace8-9336-43ce-920d-c22040f955cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:09.012281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47ace8-9336-43ce-920d-c22040f955cf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:09.025779 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2283/4519] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:16:08 2022] POST /identity/v3/roles => generated 244 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:09.027717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948347ff-a907-4a28-b0d6-82a0f5439fc9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:09.042127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948347ff-a907-4a28-b0d6-82a0f5439fc9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:09.048401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011c965-4f4b-4738-b3f0-0842cede3d5f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:09.050004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011c965-4f4b-4738-b3f0-0842cede3d5f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:09.050488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011c965-4f4b-4738-b3f0-0842cede3d5f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:09.051450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011c965-4f4b-4738-b3f0-0842cede3d5f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:09.052692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011c965-4f4b-4738-b3f0-0842cede3d5f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:09.057142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011c965-4f4b-4738-b3f0-0842cede3d5f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:09.077567 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2237/4520] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:08 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:09.085120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:09.085329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47ace8-9336-43ce-920d-c22040f955cf admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:09.097244 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2284/4521] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:16:09 2022] POST /identity/v3/roles => generated 246 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:09.099275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011c965-4f4b-4738-b3f0-0842cede3d5f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:09.114749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011c965-4f4b-4738-b3f0-0842cede3d5f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:09.198873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b247d35-f8ce-42ae-a7f9-27397036e2c7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:09.199799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b247d35-f8ce-42ae-a7f9-27397036e2c7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:09.200114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b247d35-f8ce-42ae-a7f9-27397036e2c7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:09.200712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b247d35-f8ce-42ae-a7f9-27397036e2c7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects/82297c7c33cd4548af824fb579463468/users/865041a7dd7e474696aaa231f53acd6a/roles/5d5292e08fda41628c16339b885d91a5` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:09.205772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47ace8-9336-43ce-920d-c22040f955cf admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:09.210936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fd709-4d52-47ba-aaf8-bfcbd77ea13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:09.211821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fd709-4d52-47ba-aaf8-bfcbd77ea13e admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:09.212216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fd709-4d52-47ba-aaf8-bfcbd77ea13e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:09.212613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fd709-4d52-47ba-aaf8-bfcbd77ea13e admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:09.213701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fd709-4d52-47ba-aaf8-bfcbd77ea13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:09.215919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fd709-4d52-47ba-aaf8-bfcbd77ea13e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:09.250903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b247d35-f8ce-42ae-a7f9-27397036e2c7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_grant(project_id=82297c7c33cd4548af824fb579463468, user_id=865041a7dd7e474696aaa231f53acd6a, role_id=5d5292e08fda41628c16339b885d91a5)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:09.254409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b247d35-f8ce-42ae-a7f9-27397036e2c7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:09.270023 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2238/4522] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:09 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:09.273094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fd709-4d52-47ba-aaf8-bfcbd77ea13e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:09.297119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fd709-4d52-47ba-aaf8-bfcbd77ea13e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:09.315626 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2285/4523] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:09 2022] PUT /identity/v3/projects/82297c7c33cd4548af824fb579463468/users/865041a7dd7e474696aaa231f53acd6a/roles/5d5292e08fda41628c16339b885d91a5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:09.320977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b247d35-f8ce-42ae-a7f9-27397036e2c7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:09.435993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b247d35-f8ce-42ae-a7f9-27397036e2c7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:09.443480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3ae72-a446-4a7e-917e-0d84de0110b7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:09.445205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c599f-ecf0-429f-aa29-acc1209712d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:09.445740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3ae72-a446-4a7e-917e-0d84de0110b7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:09.445892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c599f-ecf0-429f-aa29-acc1209712d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:09.446160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c599f-ecf0-429f-aa29-acc1209712d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:09.446440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c599f-ecf0-429f-aa29-acc1209712d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:09.446721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3ae72-a446-4a7e-917e-0d84de0110b7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:09.447100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3ae72-a446-4a7e-917e-0d84de0110b7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects/82297c7c33cd4548af824fb579463468/users/865041a7dd7e474696aaa231f53acd6a/roles/717c74afba0f491c99a5279cd79d53f4` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:09.447260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c599f-ecf0-429f-aa29-acc1209712d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:09.449420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c599f-ecf0-429f-aa29-acc1209712d6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:09.452300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3ae72-a446-4a7e-917e-0d84de0110b7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_grant(project_id=82297c7c33cd4548af824fb579463468, user_id=865041a7dd7e474696aaa231f53acd6a, role_id=717c74afba0f491c99a5279cd79d53f4)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:09.455271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3ae72-a446-4a7e-917e-0d84de0110b7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:09.474655 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2239/4524] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:09 2022] GET /identity/v3/roles => generated 1892 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:09.476982 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2286/4525] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:09 2022] PUT /identity/v3/projects/82297c7c33cd4548af824fb579463468/users/865041a7dd7e474696aaa231f53acd6a/roles/717c74afba0f491c99a5279cd79d53f4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:09.485306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c599f-ecf0-429f-aa29-acc1209712d6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:09.485553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3ae72-a446-4a7e-917e-0d84de0110b7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:09.504880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c599f-ecf0-429f-aa29-acc1209712d6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:09.601410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:09.608169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3ae72-a446-4a7e-917e-0d84de0110b7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:09.609066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73657e6-63e0-4acd-b027-c4b3cbc8e71c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:09.609764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73657e6-63e0-4acd-b027-c4b3cbc8e71c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:09.610059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73657e6-63e0-4acd-b027-c4b3cbc8e71c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:09.610342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73657e6-63e0-4acd-b027-c4b3cbc8e71c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:09.611740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73657e6-63e0-4acd-b027-c4b3cbc8e71c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:09.612378 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-e73657e6-63e0-4acd-b027-c4b3cbc8e71c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:16:09.612378 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:16:09.612378 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:16:09.614158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73657e6-63e0-4acd-b027-c4b3cbc8e71c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:09.622063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f692c-b336-4548-8785-8922883a655c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:09.623267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f692c-b336-4548-8785-8922883a655c admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:09.624851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f692c-b336-4548-8785-8922883a655c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:09.624851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f692c-b336-4548-8785-8922883a655c admin admin] PATH_INFO: `/v3/projects/41e9cafe8111486b8902b2165022b646/users/53829ab0397a4bdcaea1a561e6160a08/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:09.643797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f692c-b336-4548-8785-8922883a655c admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e9cafe8111486b8902b2165022b646, user_id=53829ab0397a4bdcaea1a561e6160a08, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:09.646794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f692c-b336-4548-8785-8922883a655c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:09.660280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:09.660853 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2240/4526] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:09 2022] GET /identity/v3/users => generated 8895 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:09.666907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e557b0-17c9-49f7-bed5-af0c370470bd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:09.667102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e557b0-17c9-49f7-bed5-af0c370470bd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:09.667407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e557b0-17c9-49f7-bed5-af0c370470bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:09.668938 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2287/4527] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:09 2022] PUT /identity/v3/projects/41e9cafe8111486b8902b2165022b646/users/53829ab0397a4bdcaea1a561e6160a08/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:09.673808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f692c-b336-4548-8785-8922883a655c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:09.718226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-25e557b0-17c9-49f7-bed5-af0c370470bd None None] MFA Rules not processed for user `865041a7dd7e474696aaa231f53acd6a`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:09.719579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-25e557b0-17c9-49f7-bed5-af0c370470bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:09.777966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f692c-b336-4548-8785-8922883a655c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:09.783943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb872b67-2758-43d4-ae21-ce006663d589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:09.784919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb872b67-2758-43d4-ae21-ce006663d589 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:09.785552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb872b67-2758-43d4-ae21-ce006663d589 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:09.786040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb872b67-2758-43d4-ae21-ce006663d589 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:09.787007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb872b67-2758-43d4-ae21-ce006663d589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:09.788951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb872b67-2758-43d4-ae21-ce006663d589 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:09.805444 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2288/4528] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:09 2022] GET /identity/v3/roles => generated 1892 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:09.810655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb872b67-2758-43d4-ae21-ce006663d589 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:09.822323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb872b67-2758-43d4-ae21-ce006663d589 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:09.829004 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2241/4529] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:16:09.837731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d55f9-0b73-4c60-97ca-35b058257308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:09.837731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d55f9-0b73-4c60-97ca-35b058257308 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:09.837731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d55f9-0b73-4c60-97ca-35b058257308 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:09.837731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d55f9-0b73-4c60-97ca-35b058257308 admin admin] PATH_INFO: `/v3/projects/41e9cafe8111486b8902b2165022b646/users/53829ab0397a4bdcaea1a561e6160a08/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:09.838321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d55f9-0b73-4c60-97ca-35b058257308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e9cafe8111486b8902b2165022b646, user_id=53829ab0397a4bdcaea1a561e6160a08, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:09.840631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817098b6-5f8d-47ed-9566-f29bdcdeb890 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:09.840981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d55f9-0b73-4c60-97ca-35b058257308 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:09.841405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817098b6-5f8d-47ed-9566-f29bdcdeb890 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:09.841880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817098b6-5f8d-47ed-9566-f29bdcdeb890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:09.856415 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2289/4530] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:09 2022] PUT /identity/v3/projects/41e9cafe8111486b8902b2165022b646/users/53829ab0397a4bdcaea1a561e6160a08/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:09.862674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-817098b6-5f8d-47ed-9566-f29bdcdeb890 None None] MFA Rules not processed for user `865041a7dd7e474696aaa231f53acd6a`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:09.864216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-817098b6-5f8d-47ed-9566-f29bdcdeb890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:09.868731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2277d0e-36cd-4c0e-8b81-b9075971830b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:09.869022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2277d0e-36cd-4c0e-8b81-b9075971830b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:09.869305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2277d0e-36cd-4c0e-8b81-b9075971830b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:09.905610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e2277d0e-36cd-4c0e-8b81-b9075971830b None None] MFA Rules not processed for user `53829ab0397a4bdcaea1a561e6160a08`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:09.906393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e2277d0e-36cd-4c0e-8b81-b9075971830b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:09.942979 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2242/4531] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:09.947346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817098b6-5f8d-47ed-9566-f29bdcdeb890 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:09.958471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817098b6-5f8d-47ed-9566-f29bdcdeb890 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:09.965968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b05a5-649c-4be5-a0d3-71d46c44425f tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865041a7dd7e474696aaa231f53acd6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82297c7c33cd4548af824fb579463468', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-854356346', 'tempest-DelegatedRole-1746811357'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:09.967536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b05a5-649c-4be5-a0d3-71d46c44425f tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:09.967889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b05a5-649c-4be5-a0d3-71d46c44425f tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:09.968275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b05a5-649c-4be5-a0d3-71d46c44425f tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:09.969394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b05a5-649c-4be5-a0d3-71d46c44425f tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] RBAC: Authorizing `identity:create_trust()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:09.970803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b05a5-649c-4be5-a0d3-71d46c44425f tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:10.025577 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2290/4532] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:10.040480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2277d0e-36cd-4c0e-8b81-b9075971830b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:10.042128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e2277d0e-36cd-4c0e-8b81-b9075971830b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:10.109625 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2243/4533] 10.222.0.43 () {60 vars in 1173 bytes} [Sat Jul 2 21:16:09 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:10.111963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b05a5-649c-4be5-a0d3-71d46c44425f tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:10.135133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b05a5-649c-4be5-a0d3-71d46c44425f tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:10.150375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c147433-3478-473b-9e3b-37104069be72 tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865041a7dd7e474696aaa231f53acd6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82297c7c33cd4548af824fb579463468', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-854356346', 'tempest-DelegatedRole-1746811357'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:10.151051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c147433-3478-473b-9e3b-37104069be72 tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:10.151332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c147433-3478-473b-9e3b-37104069be72 tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:10.151605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c147433-3478-473b-9e3b-37104069be72 tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:10.152501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c147433-3478-473b-9e3b-37104069be72 tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:10.153882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c147433-3478-473b-9e3b-37104069be72 tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:10.157717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:10.169230 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2244/4534] 10.222.0.43 () {58 vars in 1251 bytes} [Sat Jul 2 21:16:10 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=865041a7dd7e474696aaa231f53acd6a => generated 611 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:16:10.170286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c147433-3478-473b-9e3b-37104069be72 tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:10.180116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2277d0e-36cd-4c0e-8b81-b9075971830b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:10.184269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62daba-17d0-4db0-b93b-04b3983a2bf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:10.184940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62daba-17d0-4db0-b93b-04b3983a2bf0 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:10.185263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62daba-17d0-4db0-b93b-04b3983a2bf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:10.185558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62daba-17d0-4db0-b93b-04b3983a2bf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:10.190685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c147433-3478-473b-9e3b-37104069be72 tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:10.201210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:10.201896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585f8c9-7ffc-4ab6-9aee-7e1324bea12c tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865041a7dd7e474696aaa231f53acd6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82297c7c33cd4548af824fb579463468', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-854356346', 'tempest-DelegatedRole-1746811357'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:10.202941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585f8c9-7ffc-4ab6-9aee-7e1324bea12c tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:10.203303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585f8c9-7ffc-4ab6-9aee-7e1324bea12c tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:10.203586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585f8c9-7ffc-4ab6-9aee-7e1324bea12c tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] PATH_INFO: `/v3/OS-TRUST/trusts/17951c0e4d0a48a18cbd41c634eff583` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:10.212697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585f8c9-7ffc-4ab6-9aee-7e1324bea12c tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] RBAC: Authorizing `identity:delete_trust(trust_id=17951c0e4d0a48a18cbd41c634eff583)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:10.214255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585f8c9-7ffc-4ab6-9aee-7e1324bea12c tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:10.242603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6585f8c9-7ffc-4ab6-9aee-7e1324bea12c tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '17951c0e4d0a48a18cbd41c634eff583', 'request_id': 'req-6585f8c9-7ffc-4ab6-9aee-7e1324bea12c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:10.255815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6585f8c9-7ffc-4ab6-9aee-7e1324bea12c tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '17951c0e4d0a48a18cbd41c634eff583', 'request_id': 'req-6585f8c9-7ffc-4ab6-9aee-7e1324bea12c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:10.256912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6585f8c9-7ffc-4ab6-9aee-7e1324bea12c tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '17951c0e4d0a48a18cbd41c634eff583', 'request_id': 'req-6585f8c9-7ffc-4ab6-9aee-7e1324bea12c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:10.267387 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2245/4535] 10.222.0.43 () {58 vars in 1253 bytes} [Sat Jul 2 21:16:10 2022] DELETE /identity/v3/OS-TRUST/trusts/17951c0e4d0a48a18cbd41c634eff583 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:10.271957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585f8c9-7ffc-4ab6-9aee-7e1324bea12c tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:10.273712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6585f8c9-7ffc-4ab6-9aee-7e1324bea12c tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:10.277247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62daba-17d0-4db0-b93b-04b3983a2bf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:10.278893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62daba-17d0-4db0-b93b-04b3983a2bf0 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:10.293559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585f8c9-7ffc-4ab6-9aee-7e1324bea12c tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:10.299945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458fc04-c108-4ebc-9b17-d46882245ce3 tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865041a7dd7e474696aaa231f53acd6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '82297c7c33cd4548af824fb579463468', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-854356346', 'tempest-DelegatedRole-1746811357'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:10.300457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458fc04-c108-4ebc-9b17-d46882245ce3 tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:10.300853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458fc04-c108-4ebc-9b17-d46882245ce3 tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:10.301245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458fc04-c108-4ebc-9b17-d46882245ce3 tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] PATH_INFO: `/v3/OS-TRUST/trusts/17951c0e4d0a48a18cbd41c634eff583` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:10.308015 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2291/4536] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:10.324123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-7458fc04-c108-4ebc-9b17-d46882245ce3 tempest-TrustsV3TestJSON-113541852 tempest-user-512959004] Could not find trust: 17951c0e4d0a48a18cbd41c634eff583.: keystone.exception.TrustNotFound: Could not find trust: 17951c0e4d0a48a18cbd41c634eff583. Jul 02 21:16:10.324123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:16:10.324123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:16:10.324123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:16:10.324123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:16:10.324123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:16:10.324123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:16:10.324123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:16:10.324123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:16:10.324123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:16:10.324123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:16:10.324123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:16:10.324123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 02 21:16:10.324123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 02 21:16:10.324123 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 02 21:16:10.325335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 02 21:16:10.325335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 02 21:16:10.325335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 02 21:16:10.325335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 02 21:16:10.325335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 02 21:16:10.325335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:16:10.325335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:16:10.325335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 02 21:16:10.325335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 02 21:16:10.325335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 02 21:16:10.325335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 02 21:16:10.325335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 17951c0e4d0a48a18cbd41c634eff583. Jul 02 21:16:10.325335 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:16:10.329670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62daba-17d0-4db0-b93b-04b3983a2bf0 service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:10.330202 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2246/4537] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:16:10 2022] GET /identity/v3/OS-TRUST/trusts/17951c0e4d0a48a18cbd41c634eff583 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:16:10.412464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62daba-17d0-4db0-b93b-04b3983a2bf0 service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:10.426592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfd8de-b344-4eda-aab8-f1fe9c78bdbb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:10.426592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfd8de-b344-4eda-aab8-f1fe9c78bdbb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:10.426592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfd8de-b344-4eda-aab8-f1fe9c78bdbb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:10.427153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfd8de-b344-4eda-aab8-f1fe9c78bdbb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles/717c74afba0f491c99a5279cd79d53f4` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:10.427153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cfd8de-b344-4eda-aab8-f1fe9c78bdbb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_role(role_id=717c74afba0f491c99a5279cd79d53f4)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:10.427153 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-99cfd8de-b344-4eda-aab8-f1fe9c78bdbb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:16:10.427153 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:16:10.427153 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:16:10.427153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cfd8de-b344-4eda-aab8-f1fe9c78bdbb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:10.430887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6206b-a5ee-44f3-be9b-cfc2b8efa89c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:10.430887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6206b-a5ee-44f3-be9b-cfc2b8efa89c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:10.430887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6206b-a5ee-44f3-be9b-cfc2b8efa89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:10.480689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9dd6206b-a5ee-44f3-be9b-cfc2b8efa89c None None] MFA Rules not processed for user `f194933a022742588069b78df9f1c177`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:10.482038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9dd6206b-a5ee-44f3-be9b-cfc2b8efa89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:10.508091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-99cfd8de-b344-4eda-aab8-f1fe9c78bdbb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invalidating the token cache because role 717c74afba0f491c99a5279cd79d53f4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:10.508387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-99cfd8de-b344-4eda-aab8-f1fe9c78bdbb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:10.509079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-99cfd8de-b344-4eda-aab8-f1fe9c78bdbb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:10.513361 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2292/4538] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:10 2022] DELETE /identity/v3/roles/717c74afba0f491c99a5279cd79d53f4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:16:10.517847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfd8de-b344-4eda-aab8-f1fe9c78bdbb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:10.519254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-99cfd8de-b344-4eda-aab8-f1fe9c78bdbb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:10.633790 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2247/4539] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:10.635382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659387e1-878e-4aea-8399-01cf7f1f9d72 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:10.635771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659387e1-878e-4aea-8399-01cf7f1f9d72 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:10.635937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659387e1-878e-4aea-8399-01cf7f1f9d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:10.654062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfd8de-b344-4eda-aab8-f1fe9c78bdbb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:10.668793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1371a-2789-410c-88d1-8036f65e85b2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:10.670054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1371a-2789-410c-88d1-8036f65e85b2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:10.670559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1371a-2789-410c-88d1-8036f65e85b2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:10.672186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1371a-2789-410c-88d1-8036f65e85b2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles/5d5292e08fda41628c16339b885d91a5` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:10.673191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-659387e1-878e-4aea-8399-01cf7f1f9d72 None None] MFA Rules not processed for user `f194933a022742588069b78df9f1c177`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:10.674612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-659387e1-878e-4aea-8399-01cf7f1f9d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:10.677679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1371a-2789-410c-88d1-8036f65e85b2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5d5292e08fda41628c16339b885d91a5)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:10.684377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1371a-2789-410c-88d1-8036f65e85b2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:10.722546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:10.763201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-49a1371a-2789-410c-88d1-8036f65e85b2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invalidating the token cache because role 5d5292e08fda41628c16339b885d91a5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:10.763544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-49a1371a-2789-410c-88d1-8036f65e85b2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:10.764319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-49a1371a-2789-410c-88d1-8036f65e85b2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:10.767975 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2293/4540] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:10 2022] DELETE /identity/v3/roles/5d5292e08fda41628c16339b885d91a5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:16:10.773505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1371a-2789-410c-88d1-8036f65e85b2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:10.778029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-49a1371a-2789-410c-88d1-8036f65e85b2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:10.818878 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2248/4541] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:10.826309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659387e1-878e-4aea-8399-01cf7f1f9d72 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:10.828088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-659387e1-878e-4aea-8399-01cf7f1f9d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:10.933093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:10.938138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1371a-2789-410c-88d1-8036f65e85b2 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:10.952494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69996afb-b5b3-414b-bd42-c014f453770d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:10.955683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69996afb-b5b3-414b-bd42-c014f453770d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:10.955980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69996afb-b5b3-414b-bd42-c014f453770d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:10.956291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69996afb-b5b3-414b-bd42-c014f453770d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/users/865041a7dd7e474696aaa231f53acd6a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:10.960002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69996afb-b5b3-414b-bd42-c014f453770d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_user(user_id=865041a7dd7e474696aaa231f53acd6a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:10.965211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69996afb-b5b3-414b-bd42-c014f453770d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:10.988675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659387e1-878e-4aea-8399-01cf7f1f9d72 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:11.071870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-69996afb-b5b3-414b-bd42-c014f453770d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '865041a7dd7e474696aaa231f53acd6a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:11.099442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-69996afb-b5b3-414b-bd42-c014f453770d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '865041a7dd7e474696aaa231f53acd6a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:11.100276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-69996afb-b5b3-414b-bd42-c014f453770d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '865041a7dd7e474696aaa231f53acd6a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:11.101165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-69996afb-b5b3-414b-bd42-c014f453770d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '865041a7dd7e474696aaa231f53acd6a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:11.121289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-69996afb-b5b3-414b-bd42-c014f453770d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '865041a7dd7e474696aaa231f53acd6a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:11.170385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e06440-0327-45e4-9887-b013d973ec7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:11.172356 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2294/4542] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:10 2022] DELETE /identity/v3/users/865041a7dd7e474696aaa231f53acd6a => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:16:11.175307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69996afb-b5b3-414b-bd42-c014f453770d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:11.177485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e06440-0327-45e4-9887-b013d973ec7c service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:11.179444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e06440-0327-45e4-9887-b013d973ec7c service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:11.179887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-69996afb-b5b3-414b-bd42-c014f453770d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:11.180080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e06440-0327-45e4-9887-b013d973ec7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:11.187417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-39e06440-0327-45e4-9887-b013d973ec7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:11.335335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e06440-0327-45e4-9887-b013d973ec7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:11.337241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e06440-0327-45e4-9887-b013d973ec7c service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:11.348852 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2249/4543] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:16:11.380597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69996afb-b5b3-414b-bd42-c014f453770d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:11.393301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ee244-69e7-4ba1-9337-3a65d112d225 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:11.394472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ee244-69e7-4ba1-9337-3a65d112d225 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:11.394917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ee244-69e7-4ba1-9337-3a65d112d225 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:11.395361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ee244-69e7-4ba1-9337-3a65d112d225 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects/82297c7c33cd4548af824fb579463468` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:11.396834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ee244-69e7-4ba1-9337-3a65d112d225 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_project(project_id=82297c7c33cd4548af824fb579463468)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:11.399583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ee244-69e7-4ba1-9337-3a65d112d225 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:11.421952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:11.563463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-447ee244-69e7-4ba1-9337-3a65d112d225 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82297c7c33cd4548af824fb579463468', 'request_id': 'req-447ee244-69e7-4ba1-9337-3a65d112d225'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:11.587256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-447ee244-69e7-4ba1-9337-3a65d112d225 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82297c7c33cd4548af824fb579463468', 'request_id': 'req-447ee244-69e7-4ba1-9337-3a65d112d225'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:11.598001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-447ee244-69e7-4ba1-9337-3a65d112d225 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82297c7c33cd4548af824fb579463468', 'request_id': 'req-447ee244-69e7-4ba1-9337-3a65d112d225'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:11.612793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-447ee244-69e7-4ba1-9337-3a65d112d225 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] The token cache is being invalidate because project 82297c7c33cd4548af824fb579463468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:11.613068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-447ee244-69e7-4ba1-9337-3a65d112d225 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:11.614241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-447ee244-69e7-4ba1-9337-3a65d112d225 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:11.615887 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2295/4544] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:11 2022] DELETE /identity/v3/projects/82297c7c33cd4548af824fb579463468 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:11.621527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e06440-0327-45e4-9887-b013d973ec7c service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:11.635276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e06440-0327-45e4-9887-b013d973ec7c service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:11.699752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c795d-eb10-4950-a642-880b58b0cb26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:11.701144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c795d-eb10-4950-a642-880b58b0cb26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:11.701287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c795d-eb10-4950-a642-880b58b0cb26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:11.701523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c795d-eb10-4950-a642-880b58b0cb26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:11.702373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c795d-eb10-4950-a642-880b58b0cb26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:11.704458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c795d-eb10-4950-a642-880b58b0cb26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:11.732396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:11.757523 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2250/4545] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:16:11 2022] POST /identity/v3/projects => generated 327 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:11.759150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ee244-69e7-4ba1-9337-3a65d112d225 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:11.762418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-447ee244-69e7-4ba1-9337-3a65d112d225 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:11.782164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ee244-69e7-4ba1-9337-3a65d112d225 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:11.883927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb2026-feb0-48ef-9867-08d61268df50 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:11.884662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb2026-feb0-48ef-9867-08d61268df50 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:11.884953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb2026-feb0-48ef-9867-08d61268df50 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:11.885242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb2026-feb0-48ef-9867-08d61268df50 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:11.886027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb2026-feb0-48ef-9867-08d61268df50 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:11.893000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb2026-feb0-48ef-9867-08d61268df50 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:11.953620 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2296/4546] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:11 2022] POST /identity/v3/users => generated 413 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:11.955507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c795d-eb10-4950-a642-880b58b0cb26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:11.971899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c795d-eb10-4950-a642-880b58b0cb26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:11.988735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eedbe3-b8a0-4190-89de-e646991869e7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:11.989438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eedbe3-b8a0-4190-89de-e646991869e7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:11.989722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eedbe3-b8a0-4190-89de-e646991869e7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:11.990198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eedbe3-b8a0-4190-89de-e646991869e7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:11.990956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eedbe3-b8a0-4190-89de-e646991869e7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:11.996472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eedbe3-b8a0-4190-89de-e646991869e7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:12.034331 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2251/4547] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:16:11 2022] POST /identity/v3/roles => generated 243 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:12.036546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb2026-feb0-48ef-9867-08d61268df50 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:12.055048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb2026-feb0-48ef-9867-08d61268df50 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:12.068217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dddb98-f3d3-41d5-94a7-2fb393c3e789 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:12.070657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dddb98-f3d3-41d5-94a7-2fb393c3e789 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:12.072207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dddb98-f3d3-41d5-94a7-2fb393c3e789 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:12.072704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dddb98-f3d3-41d5-94a7-2fb393c3e789 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:12.077237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dddb98-f3d3-41d5-94a7-2fb393c3e789 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:12.079302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dddb98-f3d3-41d5-94a7-2fb393c3e789 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:12.120098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eedbe3-b8a0-4190-89de-e646991869e7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:12.120343 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2297/4548] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:16:12 2022] POST /identity/v3/roles => generated 247 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:12.135424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eedbe3-b8a0-4190-89de-e646991869e7 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:12.146836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb1044-b192-4f0b-b3ea-b9faa56991d9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:12.147811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb1044-b192-4f0b-b3ea-b9faa56991d9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:12.148125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb1044-b192-4f0b-b3ea-b9faa56991d9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:12.148405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb1044-b192-4f0b-b3ea-b9faa56991d9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects/66aa9d8e3c04449b8c01faa99cd89508/users/247a4c39d9764e1996e0b89583a363c9/roles/e99bf68e9d62456a8a3bcc5e848c768a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:12.193865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb1044-b192-4f0b-b3ea-b9faa56991d9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_grant(project_id=66aa9d8e3c04449b8c01faa99cd89508, user_id=247a4c39d9764e1996e0b89583a363c9, role_id=e99bf68e9d62456a8a3bcc5e848c768a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:12.196700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb1044-b192-4f0b-b3ea-b9faa56991d9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:12.235386 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2252/4549] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:12 2022] PUT /identity/v3/projects/66aa9d8e3c04449b8c01faa99cd89508/users/247a4c39d9764e1996e0b89583a363c9/roles/e99bf68e9d62456a8a3bcc5e848c768a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:16:12.237746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dddb98-f3d3-41d5-94a7-2fb393c3e789 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:12.253415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dddb98-f3d3-41d5-94a7-2fb393c3e789 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:12.428858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a576d-e28e-4c0a-ba42-edbecd930068 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:12.428858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a576d-e28e-4c0a-ba42-edbecd930068 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:12.428858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a576d-e28e-4c0a-ba42-edbecd930068 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:12.429346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a576d-e28e-4c0a-ba42-edbecd930068 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects/66aa9d8e3c04449b8c01faa99cd89508/users/247a4c39d9764e1996e0b89583a363c9/roles/228840ccbe8a42b9ad5d5299b7780809` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:12.434193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a576d-e28e-4c0a-ba42-edbecd930068 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_grant(project_id=66aa9d8e3c04449b8c01faa99cd89508, user_id=247a4c39d9764e1996e0b89583a363c9, role_id=228840ccbe8a42b9ad5d5299b7780809)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:12.441764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a576d-e28e-4c0a-ba42-edbecd930068 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:12.470234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:12.485916 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2298/4550] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:12 2022] PUT /identity/v3/projects/66aa9d8e3c04449b8c01faa99cd89508/users/247a4c39d9764e1996e0b89583a363c9/roles/228840ccbe8a42b9ad5d5299b7780809 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:12.487106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb1044-b192-4f0b-b3ea-b9faa56991d9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:12.513374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb1044-b192-4f0b-b3ea-b9faa56991d9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:12.643860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a576d-e28e-4c0a-ba42-edbecd930068 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:12.646359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cd8a576d-e28e-4c0a-ba42-edbecd930068 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:12.708308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fec2b8-ad0c-4794-84d6-aa2590f3092b tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:12.709268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fec2b8-ad0c-4794-84d6-aa2590f3092b tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:12.710536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fec2b8-ad0c-4794-84d6-aa2590f3092b tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:12.710536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fec2b8-ad0c-4794-84d6-aa2590f3092b tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:12.711908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fec2b8-ad0c-4794-84d6-aa2590f3092b tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:12.736662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fec2b8-ad0c-4794-84d6-aa2590f3092b tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:12.823489 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2253/4551] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:12 2022] GET /identity/v3/users => generated 8895 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:16:12.828969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2c397-96e5-43aa-a5bb-813c48ce3e21 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:12.829482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2c397-96e5-43aa-a5bb-813c48ce3e21 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:12.830627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2c397-96e5-43aa-a5bb-813c48ce3e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:12.866304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a576d-e28e-4c0a-ba42-edbecd930068 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:12.878447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ef860-26a6-4171-9a97-fa371c6a78a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:12.879138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ef860-26a6-4171-9a97-fa371c6a78a9 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:12.879450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ef860-26a6-4171-9a97-fa371c6a78a9 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:12.879727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ef860-26a6-4171-9a97-fa371c6a78a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:12.885787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ec1ef860-26a6-4171-9a97-fa371c6a78a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:12.918802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ef860-26a6-4171-9a97-fa371c6a78a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:12.920498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ef860-26a6-4171-9a97-fa371c6a78a9 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:12.933594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-91b2c397-96e5-43aa-a5bb-813c48ce3e21 None None] MFA Rules not processed for user `247a4c39d9764e1996e0b89583a363c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:12.935123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-91b2c397-96e5-43aa-a5bb-813c48ce3e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:12.939346 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2299/4552] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:16:13.185793 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2254/4553] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:12 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:16:13.196971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745b8c0-10f2-4f87-8a8d-1513c71694ce None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:13.197535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745b8c0-10f2-4f87-8a8d-1513c71694ce None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:13.197535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745b8c0-10f2-4f87-8a8d-1513c71694ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:13.232620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2745b8c0-10f2-4f87-8a8d-1513c71694ce None None] MFA Rules not processed for user `247a4c39d9764e1996e0b89583a363c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:13.233916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2745b8c0-10f2-4f87-8a8d-1513c71694ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:13.251283 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2300/4554] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:13 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:13.255575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2c397-96e5-43aa-a5bb-813c48ce3e21 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:13.266180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2c397-96e5-43aa-a5bb-813c48ce3e21 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:13.294805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987c034-655d-4580-9d42-b079d43ebb5b tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '247a4c39d9764e1996e0b89583a363c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66aa9d8e3c04449b8c01faa99cd89508', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-444965583', 'tempest-NotDelegatedRole-1914795878'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:13.295168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987c034-655d-4580-9d42-b079d43ebb5b tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:13.295693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987c034-655d-4580-9d42-b079d43ebb5b tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:13.296499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987c034-655d-4580-9d42-b079d43ebb5b tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:13.297396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987c034-655d-4580-9d42-b079d43ebb5b tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: Authorizing `identity:create_trust()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:13.300457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987c034-655d-4580-9d42-b079d43ebb5b tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:13.349376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745b8c0-10f2-4f87-8a8d-1513c71694ce None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:13.352026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2745b8c0-10f2-4f87-8a8d-1513c71694ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:13.401343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:13.484666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745b8c0-10f2-4f87-8a8d-1513c71694ce None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:13.498672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30f63d-88f7-4ee4-afec-bb1da2a9cff1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:13.499430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30f63d-88f7-4ee4-afec-bb1da2a9cff1 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:13.499807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30f63d-88f7-4ee4-afec-bb1da2a9cff1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:13.500183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30f63d-88f7-4ee4-afec-bb1da2a9cff1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:13.502516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cf30f63d-88f7-4ee4-afec-bb1da2a9cff1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:13.509869 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2255/4555] 10.222.0.43 () {60 vars in 1173 bytes} [Sat Jul 2 21:16:13 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:13.513614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987c034-655d-4580-9d42-b079d43ebb5b tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:13.553083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987c034-655d-4580-9d42-b079d43ebb5b tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:13.569584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be257c-546f-4ea1-a1af-f558e867af75 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '247a4c39d9764e1996e0b89583a363c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66aa9d8e3c04449b8c01faa99cd89508', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-444965583', 'tempest-NotDelegatedRole-1914795878'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:13.572442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be257c-546f-4ea1-a1af-f558e867af75 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:13.573001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be257c-546f-4ea1-a1af-f558e867af75 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:13.579866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be257c-546f-4ea1-a1af-f558e867af75 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] PATH_INFO: `/v3/OS-TRUST/trusts/7e1cc4b2dcaf414999731452450fd85c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:13.586491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30f63d-88f7-4ee4-afec-bb1da2a9cff1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:13.588103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30f63d-88f7-4ee4-afec-bb1da2a9cff1 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:13.599194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be257c-546f-4ea1-a1af-f558e867af75 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: Authorizing `identity:get_trust(trust_id=7e1cc4b2dcaf414999731452450fd85c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:13.601143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be257c-546f-4ea1-a1af-f558e867af75 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:13.613583 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2301/4556] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:13.620085 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2256/4557] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:16:13 2022] GET /identity/v3/OS-TRUST/trusts/7e1cc4b2dcaf414999731452450fd85c => generated 858 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:13.624507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30f63d-88f7-4ee4-afec-bb1da2a9cff1 service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:13.639274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30f63d-88f7-4ee4-afec-bb1da2a9cff1 service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:13.645283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede6dfd-1c0e-4243-90f1-2a6c785c94c5 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '247a4c39d9764e1996e0b89583a363c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66aa9d8e3c04449b8c01faa99cd89508', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-444965583', 'tempest-NotDelegatedRole-1914795878'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:13.646293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede6dfd-1c0e-4243-90f1-2a6c785c94c5 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:13.646588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede6dfd-1c0e-4243-90f1-2a6c785c94c5 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:13.646907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede6dfd-1c0e-4243-90f1-2a6c785c94c5 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] PATH_INFO: `/v3/OS-TRUST/trusts/7e1cc4b2dcaf414999731452450fd85c/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:13.661126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede6dfd-1c0e-4243-90f1-2a6c785c94c5 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=7e1cc4b2dcaf414999731452450fd85c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:13.663247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede6dfd-1c0e-4243-90f1-2a6c785c94c5 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:13.675818 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2302/4558] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:16:13 2022] GET /identity/v3/OS-TRUST/trusts/7e1cc4b2dcaf414999731452450fd85c/roles => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:13.680598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be257c-546f-4ea1-a1af-f558e867af75 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:13.696513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be257c-546f-4ea1-a1af-f558e867af75 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:13.707842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7110a87-9197-4dd3-89f1-a24dc775e91b tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '247a4c39d9764e1996e0b89583a363c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66aa9d8e3c04449b8c01faa99cd89508', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-444965583', 'tempest-NotDelegatedRole-1914795878'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:13.709367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7110a87-9197-4dd3-89f1-a24dc775e91b tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:13.709947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7110a87-9197-4dd3-89f1-a24dc775e91b tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:13.709947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7110a87-9197-4dd3-89f1-a24dc775e91b tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] PATH_INFO: `/v3/OS-TRUST/trusts/7e1cc4b2dcaf414999731452450fd85c/roles/e99bf68e9d62456a8a3bcc5e848c768a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:13.719611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7110a87-9197-4dd3-89f1-a24dc775e91b tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7e1cc4b2dcaf414999731452450fd85c, role_id=e99bf68e9d62456a8a3bcc5e848c768a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:13.721796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7110a87-9197-4dd3-89f1-a24dc775e91b tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:13.733131 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2257/4559] 10.222.0.43 () {58 vars in 1367 bytes} [Sat Jul 2 21:16:13 2022] GET /identity/v3/OS-TRUST/trusts/7e1cc4b2dcaf414999731452450fd85c/roles/e99bf68e9d62456a8a3bcc5e848c768a => generated 243 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:13.737748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede6dfd-1c0e-4243-90f1-2a6c785c94c5 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:13.758836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede6dfd-1c0e-4243-90f1-2a6c785c94c5 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:13.768832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadc423-d82d-4ba1-9129-393d1f4a9b9e tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '247a4c39d9764e1996e0b89583a363c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66aa9d8e3c04449b8c01faa99cd89508', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-444965583', 'tempest-NotDelegatedRole-1914795878'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:13.777315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadc423-d82d-4ba1-9129-393d1f4a9b9e tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] REQUEST_METHOD: `HEAD` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:13.777493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadc423-d82d-4ba1-9129-393d1f4a9b9e tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:13.777792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadc423-d82d-4ba1-9129-393d1f4a9b9e tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] PATH_INFO: `/v3/OS-TRUST/trusts/7e1cc4b2dcaf414999731452450fd85c/roles/e99bf68e9d62456a8a3bcc5e848c768a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:13.779819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:13.825685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadc423-d82d-4ba1-9129-393d1f4a9b9e tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7e1cc4b2dcaf414999731452450fd85c, role_id=e99bf68e9d62456a8a3bcc5e848c768a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:13.830444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadc423-d82d-4ba1-9129-393d1f4a9b9e tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:13.841758 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2303/4560] 10.222.0.43 () {58 vars in 1368 bytes} [Sat Jul 2 21:16:13 2022] HEAD /identity/v3/OS-TRUST/trusts/7e1cc4b2dcaf414999731452450fd85c/roles/e99bf68e9d62456a8a3bcc5e848c768a => generated 0 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 02 21:16:13.846151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7110a87-9197-4dd3-89f1-a24dc775e91b tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:13.861670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7110a87-9197-4dd3-89f1-a24dc775e91b tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:13.879883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fba6f5-f145-4c77-bab2-1e93ff291130 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '247a4c39d9764e1996e0b89583a363c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66aa9d8e3c04449b8c01faa99cd89508', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-444965583', 'tempest-NotDelegatedRole-1914795878'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:13.880756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fba6f5-f145-4c77-bab2-1e93ff291130 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:13.881036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fba6f5-f145-4c77-bab2-1e93ff291130 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:13.881426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fba6f5-f145-4c77-bab2-1e93ff291130 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] PATH_INFO: `/v3/OS-TRUST/trusts/7e1cc4b2dcaf414999731452450fd85c/roles/228840ccbe8a42b9ad5d5299b7780809` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:13.899703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fba6f5-f145-4c77-bab2-1e93ff291130 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7e1cc4b2dcaf414999731452450fd85c, role_id=228840ccbe8a42b9ad5d5299b7780809)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:13.902447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fba6f5-f145-4c77-bab2-1e93ff291130 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:13.953732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-b9fba6f5-f145-4c77-bab2-1e93ff291130 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Could not find role: 228840ccbe8a42b9ad5d5299b7780809.: keystone.exception.RoleNotFound: Could not find role: 228840ccbe8a42b9ad5d5299b7780809. Jul 02 21:16:13.953732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:16:13.953732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:16:13.953732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:16:13.953732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:16:13.953732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:16:13.953732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:16:13.953732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:16:13.953732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:16:13.953732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:16:13.953732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:16:13.953732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:16:13.953732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 02 21:16:13.953732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 21:16:13.954900 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 228840ccbe8a42b9ad5d5299b7780809. Jul 02 21:16:13.954900 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:16:13.957790 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2258/4561] 10.222.0.43 () {58 vars in 1367 bytes} [Sat Jul 2 21:16:13 2022] GET /identity/v3/OS-TRUST/trusts/7e1cc4b2dcaf414999731452450fd85c/roles/228840ccbe8a42b9ad5d5299b7780809 => generated 110 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:16:13.963436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadc423-d82d-4ba1-9129-393d1f4a9b9e tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:13.985588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadc423-d82d-4ba1-9129-393d1f4a9b9e tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:14.006780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fd197-1725-41b6-888a-c00929e387fe tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '247a4c39d9764e1996e0b89583a363c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66aa9d8e3c04449b8c01faa99cd89508', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-444965583', 'tempest-NotDelegatedRole-1914795878'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:14.007704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fd197-1725-41b6-888a-c00929e387fe tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] REQUEST_METHOD: `HEAD` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:14.008064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fd197-1725-41b6-888a-c00929e387fe tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:14.008364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fd197-1725-41b6-888a-c00929e387fe tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] PATH_INFO: `/v3/OS-TRUST/trusts/7e1cc4b2dcaf414999731452450fd85c/roles/228840ccbe8a42b9ad5d5299b7780809` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:14.036438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fd197-1725-41b6-888a-c00929e387fe tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7e1cc4b2dcaf414999731452450fd85c, role_id=228840ccbe8a42b9ad5d5299b7780809)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:14.037990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fd197-1725-41b6-888a-c00929e387fe tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:14.070293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-b11fd197-1725-41b6-888a-c00929e387fe tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Could not find role: 228840ccbe8a42b9ad5d5299b7780809.: keystone.exception.RoleNotFound: Could not find role: 228840ccbe8a42b9ad5d5299b7780809. Jul 02 21:16:14.070293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:16:14.070293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:16:14.070293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:16:14.070293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:16:14.070293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:16:14.070293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:16:14.070293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:16:14.070293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:16:14.070293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:16:14.070293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:16:14.070293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:16:14.070293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 02 21:16:14.070293 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 21:16:14.071441 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 228840ccbe8a42b9ad5d5299b7780809. Jul 02 21:16:14.071441 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:16:14.076391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fba6f5-f145-4c77-bab2-1e93ff291130 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:14.076817 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2304/4562] 10.222.0.43 () {58 vars in 1368 bytes} [Sat Jul 2 21:16:13 2022] HEAD /identity/v3/OS-TRUST/trusts/7e1cc4b2dcaf414999731452450fd85c/roles/228840ccbe8a42b9ad5d5299b7780809 => generated 0 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 02 21:16:14.107193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fba6f5-f145-4c77-bab2-1e93ff291130 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:14.116310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7dcaa-699e-4172-b9b0-459932a1eae4 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '247a4c39d9764e1996e0b89583a363c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66aa9d8e3c04449b8c01faa99cd89508', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-444965583', 'tempest-NotDelegatedRole-1914795878'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:14.117256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7dcaa-699e-4172-b9b0-459932a1eae4 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:14.118137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7dcaa-699e-4172-b9b0-459932a1eae4 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:14.118531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7dcaa-699e-4172-b9b0-459932a1eae4 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] PATH_INFO: `/v3/OS-TRUST/trusts/7e1cc4b2dcaf414999731452450fd85c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:14.130191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7dcaa-699e-4172-b9b0-459932a1eae4 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: Authorizing `identity:delete_trust(trust_id=7e1cc4b2dcaf414999731452450fd85c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:14.132459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7dcaa-699e-4172-b9b0-459932a1eae4 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:14.216792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f0e7dcaa-699e-4172-b9b0-459932a1eae4 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '7e1cc4b2dcaf414999731452450fd85c', 'request_id': 'req-f0e7dcaa-699e-4172-b9b0-459932a1eae4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:14.232317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f0e7dcaa-699e-4172-b9b0-459932a1eae4 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7e1cc4b2dcaf414999731452450fd85c', 'request_id': 'req-f0e7dcaa-699e-4172-b9b0-459932a1eae4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:14.233130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f0e7dcaa-699e-4172-b9b0-459932a1eae4 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7e1cc4b2dcaf414999731452450fd85c', 'request_id': 'req-f0e7dcaa-699e-4172-b9b0-459932a1eae4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:14.255298 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2259/4563] 10.222.0.43 () {58 vars in 1253 bytes} [Sat Jul 2 21:16:14 2022] DELETE /identity/v3/OS-TRUST/trusts/7e1cc4b2dcaf414999731452450fd85c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:14.259560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fd197-1725-41b6-888a-c00929e387fe tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:14.262102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b11fd197-1725-41b6-888a-c00929e387fe tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:14.277120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fd197-1725-41b6-888a-c00929e387fe tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:14.287061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f9d9a-5ddf-4c9f-a28e-afa0c64fb933 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '247a4c39d9764e1996e0b89583a363c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66aa9d8e3c04449b8c01faa99cd89508', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-444965583', 'tempest-NotDelegatedRole-1914795878'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:14.288637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f9d9a-5ddf-4c9f-a28e-afa0c64fb933 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:14.289068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f9d9a-5ddf-4c9f-a28e-afa0c64fb933 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:14.289227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f9d9a-5ddf-4c9f-a28e-afa0c64fb933 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] PATH_INFO: `/v3/OS-TRUST/trusts/7e1cc4b2dcaf414999731452450fd85c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:14.316424 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-806f9d9a-5ddf-4c9f-a28e-afa0c64fb933 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Could not find trust: 7e1cc4b2dcaf414999731452450fd85c.: keystone.exception.TrustNotFound: Could not find trust: 7e1cc4b2dcaf414999731452450fd85c. Jul 02 21:16:14.316424 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:16:14.316424 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:16:14.316424 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:16:14.316424 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:16:14.316424 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:16:14.316424 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:16:14.316424 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:16:14.316424 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:16:14.316424 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:16:14.316424 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:16:14.316424 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:16:14.316424 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 02 21:16:14.316424 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 02 21:16:14.316424 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 02 21:16:14.318113 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 02 21:16:14.318113 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 02 21:16:14.318113 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 02 21:16:14.318113 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 02 21:16:14.318113 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 02 21:16:14.318113 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:16:14.318113 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:16:14.318113 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 02 21:16:14.318113 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 02 21:16:14.318113 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 02 21:16:14.318113 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 02 21:16:14.318113 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 7e1cc4b2dcaf414999731452450fd85c. Jul 02 21:16:14.318113 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:16:14.318113 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2305/4564] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:16:14 2022] GET /identity/v3/OS-TRUST/trusts/7e1cc4b2dcaf414999731452450fd85c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:16:14.323209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7dcaa-699e-4172-b9b0-459932a1eae4 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:14.324958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f0e7dcaa-699e-4172-b9b0-459932a1eae4 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:14.361618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7dcaa-699e-4172-b9b0-459932a1eae4 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:14.373094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a4be2-0cf3-45d4-bb23-cb3829bb7450 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:14.376655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a4be2-0cf3-45d4-bb23-cb3829bb7450 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:14.378307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a4be2-0cf3-45d4-bb23-cb3829bb7450 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:14.379182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a4be2-0cf3-45d4-bb23-cb3829bb7450 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles/228840ccbe8a42b9ad5d5299b7780809` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:14.384150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a4be2-0cf3-45d4-bb23-cb3829bb7450 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_role(role_id=228840ccbe8a42b9ad5d5299b7780809)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:14.386142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a4be2-0cf3-45d4-bb23-cb3829bb7450 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:14.480469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e68a4be2-0cf3-45d4-bb23-cb3829bb7450 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invalidating the token cache because role 228840ccbe8a42b9ad5d5299b7780809 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:14.480836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e68a4be2-0cf3-45d4-bb23-cb3829bb7450 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:14.485037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e68a4be2-0cf3-45d4-bb23-cb3829bb7450 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:14.491166 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2260/4565] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:14 2022] DELETE /identity/v3/roles/228840ccbe8a42b9ad5d5299b7780809 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:16:14.495918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f9d9a-5ddf-4c9f-a28e-afa0c64fb933 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:14.497872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-806f9d9a-5ddf-4c9f-a28e-afa0c64fb933 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:14.542045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f9d9a-5ddf-4c9f-a28e-afa0c64fb933 tempest-TrustsV3TestJSON-16394056 tempest-user-800972737] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:14.669009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea7fc7-ee70-4cca-83b8-1dd2c8346217 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:14.669996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea7fc7-ee70-4cca-83b8-1dd2c8346217 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:14.670291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea7fc7-ee70-4cca-83b8-1dd2c8346217 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:14.670574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea7fc7-ee70-4cca-83b8-1dd2c8346217 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles/e99bf68e9d62456a8a3bcc5e848c768a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:14.673654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea7fc7-ee70-4cca-83b8-1dd2c8346217 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e99bf68e9d62456a8a3bcc5e848c768a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:14.675422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea7fc7-ee70-4cca-83b8-1dd2c8346217 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:14.732834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-06ea7fc7-ee70-4cca-83b8-1dd2c8346217 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invalidating the token cache because role e99bf68e9d62456a8a3bcc5e848c768a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:14.733438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-06ea7fc7-ee70-4cca-83b8-1dd2c8346217 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:14.734181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-06ea7fc7-ee70-4cca-83b8-1dd2c8346217 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:14.736822 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2306/4566] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:14 2022] DELETE /identity/v3/roles/e99bf68e9d62456a8a3bcc5e848c768a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:14.741405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a4be2-0cf3-45d4-bb23-cb3829bb7450 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:14.762066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a4be2-0cf3-45d4-bb23-cb3829bb7450 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:14.845406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:14.863703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012eefc-baa1-42dc-be2a-2d0264335b13 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:14.867133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012eefc-baa1-42dc-be2a-2d0264335b13 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:14.867432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012eefc-baa1-42dc-be2a-2d0264335b13 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:14.867746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012eefc-baa1-42dc-be2a-2d0264335b13 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/users/247a4c39d9764e1996e0b89583a363c9` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:14.870546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012eefc-baa1-42dc-be2a-2d0264335b13 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_user(user_id=247a4c39d9764e1996e0b89583a363c9)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:14.874378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012eefc-baa1-42dc-be2a-2d0264335b13 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:14.958022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d012eefc-baa1-42dc-be2a-2d0264335b13 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247a4c39d9764e1996e0b89583a363c9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:14.983791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d012eefc-baa1-42dc-be2a-2d0264335b13 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247a4c39d9764e1996e0b89583a363c9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:15.011602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d012eefc-baa1-42dc-be2a-2d0264335b13 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247a4c39d9764e1996e0b89583a363c9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:15.013229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d012eefc-baa1-42dc-be2a-2d0264335b13 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247a4c39d9764e1996e0b89583a363c9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:15.014285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d012eefc-baa1-42dc-be2a-2d0264335b13 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247a4c39d9764e1996e0b89583a363c9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:15.092135 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2261/4567] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:14 2022] DELETE /identity/v3/users/247a4c39d9764e1996e0b89583a363c9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:15.093320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea7fc7-ee70-4cca-83b8-1dd2c8346217 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:15.095188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-06ea7fc7-ee70-4cca-83b8-1dd2c8346217 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:15.128357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea7fc7-ee70-4cca-83b8-1dd2c8346217 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:15.287041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab72936-3717-4a89-8bf1-d1a04b8db627 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:15.288979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab72936-3717-4a89-8bf1-d1a04b8db627 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:15.290360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab72936-3717-4a89-8bf1-d1a04b8db627 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:15.290816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab72936-3717-4a89-8bf1-d1a04b8db627 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects/66aa9d8e3c04449b8c01faa99cd89508` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:15.295103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab72936-3717-4a89-8bf1-d1a04b8db627 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_project(project_id=66aa9d8e3c04449b8c01faa99cd89508)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:15.297962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab72936-3717-4a89-8bf1-d1a04b8db627 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:15.357779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:15.399034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1ab72936-3717-4a89-8bf1-d1a04b8db627 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66aa9d8e3c04449b8c01faa99cd89508', 'request_id': 'req-1ab72936-3717-4a89-8bf1-d1a04b8db627'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:15.412355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1ab72936-3717-4a89-8bf1-d1a04b8db627 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66aa9d8e3c04449b8c01faa99cd89508', 'request_id': 'req-1ab72936-3717-4a89-8bf1-d1a04b8db627'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:15.428966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1ab72936-3717-4a89-8bf1-d1a04b8db627 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66aa9d8e3c04449b8c01faa99cd89508', 'request_id': 'req-1ab72936-3717-4a89-8bf1-d1a04b8db627'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:15.472719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1ab72936-3717-4a89-8bf1-d1a04b8db627 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] The token cache is being invalidate because project 66aa9d8e3c04449b8c01faa99cd89508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:15.473161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1ab72936-3717-4a89-8bf1-d1a04b8db627 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:15.474554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1ab72936-3717-4a89-8bf1-d1a04b8db627 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:15.476658 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2307/4568] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:15 2022] DELETE /identity/v3/projects/66aa9d8e3c04449b8c01faa99cd89508 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:15.482252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012eefc-baa1-42dc-be2a-2d0264335b13 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:15.483792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d012eefc-baa1-42dc-be2a-2d0264335b13 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:15.503301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012eefc-baa1-42dc-be2a-2d0264335b13 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:15.566504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31f575-c8c0-43f9-a272-361a429e1faa tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:15.567274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31f575-c8c0-43f9-a272-361a429e1faa tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:15.567802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31f575-c8c0-43f9-a272-361a429e1faa tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:15.568150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31f575-c8c0-43f9-a272-361a429e1faa tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:15.569021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31f575-c8c0-43f9-a272-361a429e1faa tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:15.571160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31f575-c8c0-43f9-a272-361a429e1faa tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:15.614551 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2262/4569] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:16:15 2022] POST /identity/v3/projects => generated 329 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:15.619622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab72936-3717-4a89-8bf1-d1a04b8db627 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:15.623929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1ab72936-3717-4a89-8bf1-d1a04b8db627 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:15.641196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab72936-3717-4a89-8bf1-d1a04b8db627 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:15.735712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51602a-7c13-481b-ac84-8ee4bde529d0 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:15.736449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51602a-7c13-481b-ac84-8ee4bde529d0 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:15.736796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51602a-7c13-481b-ac84-8ee4bde529d0 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:15.737085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51602a-7c13-481b-ac84-8ee4bde529d0 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:15.737796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51602a-7c13-481b-ac84-8ee4bde529d0 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:15.739791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51602a-7c13-481b-ac84-8ee4bde529d0 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:15.762920 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2308/4570] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:15 2022] POST /identity/v3/users => generated 410 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:16:15.767091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31f575-c8c0-43f9-a272-361a429e1faa tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:15.778446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31f575-c8c0-43f9-a272-361a429e1faa tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:15.783292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc38bba-6707-4808-b695-1160a1acfacd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:15.784103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38bba-6707-4808-b695-1160a1acfacd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:15.784422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38bba-6707-4808-b695-1160a1acfacd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:15.784700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38bba-6707-4808-b695-1160a1acfacd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:15.785438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc38bba-6707-4808-b695-1160a1acfacd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:15.787044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc38bba-6707-4808-b695-1160a1acfacd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:15.804099 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2263/4571] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:16:15 2022] POST /identity/v3/roles => generated 243 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:15.807186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51602a-7c13-481b-ac84-8ee4bde529d0 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:15.820189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51602a-7c13-481b-ac84-8ee4bde529d0 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:15.826837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ac349-2be4-4e06-a271-db8670d985c1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:15.827802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ac349-2be4-4e06-a271-db8670d985c1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:15.828978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ac349-2be4-4e06-a271-db8670d985c1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:15.829319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ac349-2be4-4e06-a271-db8670d985c1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:15.830303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ac349-2be4-4e06-a271-db8670d985c1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:15.832196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ac349-2be4-4e06-a271-db8670d985c1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:15.846954 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2309/4572] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:16:15 2022] POST /identity/v3/roles => generated 247 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:15.852358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc38bba-6707-4808-b695-1160a1acfacd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:15.863930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc38bba-6707-4808-b695-1160a1acfacd tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:15.869388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25269e7-8f6e-457f-abb5-da0af191b62a tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:15.870388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25269e7-8f6e-457f-abb5-da0af191b62a tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:15.870743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25269e7-8f6e-457f-abb5-da0af191b62a tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:15.871043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25269e7-8f6e-457f-abb5-da0af191b62a tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects/0f750ce20d804146bddce8139fb7f177/users/aae519a4bac946d285d367b3a9790e10/roles/0ce0834db80e42b4bd889a84572dd85e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:15.886937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25269e7-8f6e-457f-abb5-da0af191b62a tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0f750ce20d804146bddce8139fb7f177, user_id=aae519a4bac946d285d367b3a9790e10, role_id=0ce0834db80e42b4bd889a84572dd85e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:15.889624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25269e7-8f6e-457f-abb5-da0af191b62a tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:15.904399 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2264/4573] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:15 2022] PUT /identity/v3/projects/0f750ce20d804146bddce8139fb7f177/users/aae519a4bac946d285d367b3a9790e10/roles/0ce0834db80e42b4bd889a84572dd85e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:15.909119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ac349-2be4-4e06-a271-db8670d985c1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:15.921143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ac349-2be4-4e06-a271-db8670d985c1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:15.994614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd182303-ddee-4b44-aee7-8df4fa2e2f2a tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:15.996762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd182303-ddee-4b44-aee7-8df4fa2e2f2a tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:15.997248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd182303-ddee-4b44-aee7-8df4fa2e2f2a tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:15.998041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd182303-ddee-4b44-aee7-8df4fa2e2f2a tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects/0f750ce20d804146bddce8139fb7f177/users/aae519a4bac946d285d367b3a9790e10/roles/4cc03f6ac2864970b79726c0485a8d97` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:16.001649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd182303-ddee-4b44-aee7-8df4fa2e2f2a tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0f750ce20d804146bddce8139fb7f177, user_id=aae519a4bac946d285d367b3a9790e10, role_id=4cc03f6ac2864970b79726c0485a8d97)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:16.004428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd182303-ddee-4b44-aee7-8df4fa2e2f2a tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:16.022539 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2310/4574] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:15 2022] PUT /identity/v3/projects/0f750ce20d804146bddce8139fb7f177/users/aae519a4bac946d285d367b3a9790e10/roles/4cc03f6ac2864970b79726c0485a8d97 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:16.026701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25269e7-8f6e-457f-abb5-da0af191b62a tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:16.043732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25269e7-8f6e-457f-abb5-da0af191b62a tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:16.073023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:16.137124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50361377-f48c-49e0-9b47-85869ea9f8d9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:16.137896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50361377-f48c-49e0-9b47-85869ea9f8d9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:16.138194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50361377-f48c-49e0-9b47-85869ea9f8d9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:16.138458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50361377-f48c-49e0-9b47-85869ea9f8d9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:16.139221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50361377-f48c-49e0-9b47-85869ea9f8d9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:16.141229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50361377-f48c-49e0-9b47-85869ea9f8d9 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:16.175675 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2265/4575] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:16 2022] GET /identity/v3/users => generated 8892 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:16:16.181260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0ced4-1024-43b7-bd8d-e1df54efadb6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:16.181800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0ced4-1024-43b7-bd8d-e1df54efadb6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:16.182266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0ced4-1024-43b7-bd8d-e1df54efadb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:16.243278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0fe0ced4-1024-43b7-bd8d-e1df54efadb6 None None] MFA Rules not processed for user `aae519a4bac946d285d367b3a9790e10`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:16.244563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0fe0ced4-1024-43b7-bd8d-e1df54efadb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:16.258209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=5,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:16.336504 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2311/4576] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:16:16.410574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53084f69-534f-496e-9eb2-5b76e68ee16c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:16.410828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53084f69-534f-496e-9eb2-5b76e68ee16c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:16.411089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53084f69-534f-496e-9eb2-5b76e68ee16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:16.429123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-53084f69-534f-496e-9eb2-5b76e68ee16c None None] MFA Rules not processed for user `aae519a4bac946d285d367b3a9790e10`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:16.430330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-53084f69-534f-496e-9eb2-5b76e68ee16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:16.438136 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2266/4577] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:16.442516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0ced4-1024-43b7-bd8d-e1df54efadb6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:16.452421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0ced4-1024-43b7-bd8d-e1df54efadb6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:16.457198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6adc2-76f8-4754-af67-d2fab8c75316 tempest-TrustsV3TestJSON-1714188689 tempest-user-51298848] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae519a4bac946d285d367b3a9790e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f750ce20d804146bddce8139fb7f177', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1825472011', 'tempest-DelegatedRole-835800455'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:16.457837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6adc2-76f8-4754-af67-d2fab8c75316 tempest-TrustsV3TestJSON-1714188689 tempest-user-51298848] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:16.458110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6adc2-76f8-4754-af67-d2fab8c75316 tempest-TrustsV3TestJSON-1714188689 tempest-user-51298848] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:16.458386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6adc2-76f8-4754-af67-d2fab8c75316 tempest-TrustsV3TestJSON-1714188689 tempest-user-51298848] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:16.459112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6adc2-76f8-4754-af67-d2fab8c75316 tempest-TrustsV3TestJSON-1714188689 tempest-user-51298848] RBAC: Authorizing `identity:create_trust()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:16.460302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6adc2-76f8-4754-af67-d2fab8c75316 tempest-TrustsV3TestJSON-1714188689 tempest-user-51298848] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:16.580875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-f5e6adc2-76f8-4754-af67-d2fab8c75316 tempest-TrustsV3TestJSON-1714188689 tempest-user-51298848] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jul 02 21:16:16.580875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:16:16.580875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Jul 02 21:16:16.580875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Jul 02 21:16:16.580875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Jul 02 21:16:16.580875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Jul 02 21:16:16.580875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Jul 02 21:16:16.580875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:16:16.580875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:16:16.580875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:16:16.580875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:16:16.580875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Jul 02 21:16:16.580875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Jul 02 21:16:16.580875 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Jul 02 21:16:16.582093 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise ValueError(str(e)) Jul 02 21:16:16.582093 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Jul 02 21:16:16.582093 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:16:16.582093 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:16:16.582093 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:16:16.582093 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:16:16.582093 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:16:16.582093 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:16:16.582093 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:16:16.582093 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:16:16.582093 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:16:16.582093 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:16:16.582093 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:16:16.582093 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:16:16.582093 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:16:16.582093 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:16:16.582093 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Jul 02 21:16:16.582093 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Jul 02 21:16:16.583329 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Jul 02 21:16:16.583329 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Jul 02 21:16:16.583329 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Jul 02 21:16:16.583329 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Jul 02 21:16:16.583329 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jul 02 21:16:16.583329 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:16:16.587565 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2312/4578] 10.222.0.43 () {60 vars in 1173 bytes} [Sat Jul 2 21:16:16 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 142 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 02 21:16:16.588892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53084f69-534f-496e-9eb2-5b76e68ee16c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:16.608767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53084f69-534f-496e-9eb2-5b76e68ee16c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:16.618533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919be4fc-1050-443f-86af-04b70382939c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:16.620026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919be4fc-1050-443f-86af-04b70382939c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:16.620616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919be4fc-1050-443f-86af-04b70382939c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:16.621107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919be4fc-1050-443f-86af-04b70382939c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles/4cc03f6ac2864970b79726c0485a8d97` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:16.623766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919be4fc-1050-443f-86af-04b70382939c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4cc03f6ac2864970b79726c0485a8d97)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:16.625695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919be4fc-1050-443f-86af-04b70382939c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:16.691113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-919be4fc-1050-443f-86af-04b70382939c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invalidating the token cache because role 4cc03f6ac2864970b79726c0485a8d97 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:16.691871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-919be4fc-1050-443f-86af-04b70382939c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:16.692911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-919be4fc-1050-443f-86af-04b70382939c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:16.698573 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2267/4579] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:16 2022] DELETE /identity/v3/roles/4cc03f6ac2864970b79726c0485a8d97 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:16.699265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6adc2-76f8-4754-af67-d2fab8c75316 tempest-TrustsV3TestJSON-1714188689 tempest-user-51298848] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:16.701078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f5e6adc2-76f8-4754-af67-d2fab8c75316 tempest-TrustsV3TestJSON-1714188689 tempest-user-51298848] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:16.747836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6adc2-76f8-4754-af67-d2fab8c75316 tempest-TrustsV3TestJSON-1714188689 tempest-user-51298848] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:16.865778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8928e-419b-4b12-894c-924664cf5d79 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:16.866260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8928e-419b-4b12-894c-924664cf5d79 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:16.866640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8928e-419b-4b12-894c-924664cf5d79 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:16.866924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8928e-419b-4b12-894c-924664cf5d79 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles/0ce0834db80e42b4bd889a84572dd85e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:16.878216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8928e-419b-4b12-894c-924664cf5d79 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0ce0834db80e42b4bd889a84572dd85e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:16.879932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8928e-419b-4b12-894c-924664cf5d79 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:16.958855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-efd8928e-419b-4b12-894c-924664cf5d79 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invalidating the token cache because role 0ce0834db80e42b4bd889a84572dd85e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:16.959603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-efd8928e-419b-4b12-894c-924664cf5d79 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:16.960813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-efd8928e-419b-4b12-894c-924664cf5d79 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:16.963236 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2313/4580] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:16 2022] DELETE /identity/v3/roles/0ce0834db80e42b4bd889a84572dd85e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:16:16.967201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919be4fc-1050-443f-86af-04b70382939c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:16.983111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919be4fc-1050-443f-86af-04b70382939c tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:17.139225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fab13f-04db-4df2-9576-d31e6705ab67 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:17.140628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fab13f-04db-4df2-9576-d31e6705ab67 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:17.141110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fab13f-04db-4df2-9576-d31e6705ab67 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:17.141577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fab13f-04db-4df2-9576-d31e6705ab67 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/users/aae519a4bac946d285d367b3a9790e10` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:17.143122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fab13f-04db-4df2-9576-d31e6705ab67 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_user(user_id=aae519a4bac946d285d367b3a9790e10)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:17.145683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fab13f-04db-4df2-9576-d31e6705ab67 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:17.204335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-66fab13f-04db-4df2-9576-d31e6705ab67 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae519a4bac946d285d367b3a9790e10'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:17.221888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-66fab13f-04db-4df2-9576-d31e6705ab67 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae519a4bac946d285d367b3a9790e10'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:17.232695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-66fab13f-04db-4df2-9576-d31e6705ab67 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae519a4bac946d285d367b3a9790e10'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:17.233751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-66fab13f-04db-4df2-9576-d31e6705ab67 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae519a4bac946d285d367b3a9790e10'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:17.234509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-66fab13f-04db-4df2-9576-d31e6705ab67 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae519a4bac946d285d367b3a9790e10'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:17.244397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:17.263931 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2268/4581] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:16 2022] DELETE /identity/v3/users/aae519a4bac946d285d367b3a9790e10 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:17.269213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8928e-419b-4b12-894c-924664cf5d79 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:17.270614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-efd8928e-419b-4b12-894c-924664cf5d79 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:17.295581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8928e-419b-4b12-894c-924664cf5d79 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:17.330024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:17.419733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b1a4f-3d1b-4a28-8509-718a04bccacf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:17.420728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1a4f-3d1b-4a28-8509-718a04bccacf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:17.421013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1a4f-3d1b-4a28-8509-718a04bccacf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:17.421296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1a4f-3d1b-4a28-8509-718a04bccacf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects/0f750ce20d804146bddce8139fb7f177` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:17.423063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b1a4f-3d1b-4a28-8509-718a04bccacf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f750ce20d804146bddce8139fb7f177)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:17.425968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b1a4f-3d1b-4a28-8509-718a04bccacf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:17.488387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2d6b1a4f-3d1b-4a28-8509-718a04bccacf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f750ce20d804146bddce8139fb7f177', 'request_id': 'req-2d6b1a4f-3d1b-4a28-8509-718a04bccacf'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:17.500685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2d6b1a4f-3d1b-4a28-8509-718a04bccacf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f750ce20d804146bddce8139fb7f177', 'request_id': 'req-2d6b1a4f-3d1b-4a28-8509-718a04bccacf'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:17.508912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2d6b1a4f-3d1b-4a28-8509-718a04bccacf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f750ce20d804146bddce8139fb7f177', 'request_id': 'req-2d6b1a4f-3d1b-4a28-8509-718a04bccacf'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:17.521098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2d6b1a4f-3d1b-4a28-8509-718a04bccacf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] The token cache is being invalidate because project 0f750ce20d804146bddce8139fb7f177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:17.521355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2d6b1a4f-3d1b-4a28-8509-718a04bccacf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:17.522025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2d6b1a4f-3d1b-4a28-8509-718a04bccacf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:17.524498 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2314/4582] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:17 2022] DELETE /identity/v3/projects/0f750ce20d804146bddce8139fb7f177 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:17.529616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fab13f-04db-4df2-9576-d31e6705ab67 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:17.531126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-66fab13f-04db-4df2-9576-d31e6705ab67 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:17.547994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fab13f-04db-4df2-9576-d31e6705ab67 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:17.651509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18331723-8c3d-40cb-b2f5-094dea2a8782 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:17.652363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18331723-8c3d-40cb-b2f5-094dea2a8782 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:17.652705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18331723-8c3d-40cb-b2f5-094dea2a8782 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:17.653066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18331723-8c3d-40cb-b2f5-094dea2a8782 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:17.654189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18331723-8c3d-40cb-b2f5-094dea2a8782 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:17.656410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18331723-8c3d-40cb-b2f5-094dea2a8782 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:17.690610 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2269/4583] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:16:17 2022] POST /identity/v3/projects => generated 329 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:16:17.694482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b1a4f-3d1b-4a28-8509-718a04bccacf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:17.695993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2d6b1a4f-3d1b-4a28-8509-718a04bccacf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:17.711266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b1a4f-3d1b-4a28-8509-718a04bccacf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:17.804264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2d8b7-89d0-422e-ac9a-dd53bddbdd9d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:17.808554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2d8b7-89d0-422e-ac9a-dd53bddbdd9d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:17.808886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2d8b7-89d0-422e-ac9a-dd53bddbdd9d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:17.809461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2d8b7-89d0-422e-ac9a-dd53bddbdd9d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:17.809837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2d8b7-89d0-422e-ac9a-dd53bddbdd9d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:17.812324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2d8b7-89d0-422e-ac9a-dd53bddbdd9d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:17.842402 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2315/4584] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:17 2022] POST /identity/v3/users => generated 410 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:17.846560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18331723-8c3d-40cb-b2f5-094dea2a8782 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:17.859519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18331723-8c3d-40cb-b2f5-094dea2a8782 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:17.866020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bca42-87d4-479f-a6d2-c4badb4c86e5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:17.867488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bca42-87d4-479f-a6d2-c4badb4c86e5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:17.867968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bca42-87d4-479f-a6d2-c4badb4c86e5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:17.868431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bca42-87d4-479f-a6d2-c4badb4c86e5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:17.869356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bca42-87d4-479f-a6d2-c4badb4c86e5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:17.871722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bca42-87d4-479f-a6d2-c4badb4c86e5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:17.889955 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2270/4585] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:16:17 2022] POST /identity/v3/roles => generated 243 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:17.894877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2d8b7-89d0-422e-ac9a-dd53bddbdd9d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:17.913519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2d8b7-89d0-422e-ac9a-dd53bddbdd9d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:17.920366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e68d1f-35a5-463c-932f-6b96771b9b47 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:17.921494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e68d1f-35a5-463c-932f-6b96771b9b47 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:17.921494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e68d1f-35a5-463c-932f-6b96771b9b47 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:17.921760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e68d1f-35a5-463c-932f-6b96771b9b47 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:17.922421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e68d1f-35a5-463c-932f-6b96771b9b47 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:17.924104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e68d1f-35a5-463c-932f-6b96771b9b47 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:17.947810 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2316/4586] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:16:17 2022] POST /identity/v3/roles => generated 246 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:17.949237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bca42-87d4-479f-a6d2-c4badb4c86e5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:17.961960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bca42-87d4-479f-a6d2-c4badb4c86e5 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:17.967291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6482fa8-dd82-4c65-b450-dd010d87f2c3 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:17.968227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6482fa8-dd82-4c65-b450-dd010d87f2c3 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:17.968539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6482fa8-dd82-4c65-b450-dd010d87f2c3 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:17.968842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6482fa8-dd82-4c65-b450-dd010d87f2c3 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects/f902e10e0c1f457cb1dfd7a3da5e94c8/users/22bf18fea82744cf94122f073057f8ee/roles/e58d6de81f284671964d165ad0ed5b0a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:17.987058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6482fa8-dd82-4c65-b450-dd010d87f2c3 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f902e10e0c1f457cb1dfd7a3da5e94c8, user_id=22bf18fea82744cf94122f073057f8ee, role_id=e58d6de81f284671964d165ad0ed5b0a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:17.989765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6482fa8-dd82-4c65-b450-dd010d87f2c3 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:18.005140 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2271/4587] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:17 2022] PUT /identity/v3/projects/f902e10e0c1f457cb1dfd7a3da5e94c8/users/22bf18fea82744cf94122f073057f8ee/roles/e58d6de81f284671964d165ad0ed5b0a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:18.009663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e68d1f-35a5-463c-932f-6b96771b9b47 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:18.025020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e68d1f-35a5-463c-932f-6b96771b9b47 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:18.049425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:18.123398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69c7ca-1905-4c88-82d6-c4172344f098 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:18.124253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69c7ca-1905-4c88-82d6-c4172344f098 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:18.124545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69c7ca-1905-4c88-82d6-c4172344f098 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:18.124885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69c7ca-1905-4c88-82d6-c4172344f098 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects/f902e10e0c1f457cb1dfd7a3da5e94c8/users/22bf18fea82744cf94122f073057f8ee/roles/7ad7571f99b04aea83f7011c91a10f2e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:18.129047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69c7ca-1905-4c88-82d6-c4172344f098 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f902e10e0c1f457cb1dfd7a3da5e94c8, user_id=22bf18fea82744cf94122f073057f8ee, role_id=7ad7571f99b04aea83f7011c91a10f2e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:18.131830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69c7ca-1905-4c88-82d6-c4172344f098 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:18.159306 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2317/4588] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:18 2022] PUT /identity/v3/projects/f902e10e0c1f457cb1dfd7a3da5e94c8/users/22bf18fea82744cf94122f073057f8ee/roles/7ad7571f99b04aea83f7011c91a10f2e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:18.163511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6482fa8-dd82-4c65-b450-dd010d87f2c3 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:18.182118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6482fa8-dd82-4c65-b450-dd010d87f2c3 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:18.285984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b0290-5d6f-4ee3-8745-04214fdc1c2d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:18.286694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b0290-5d6f-4ee3-8745-04214fdc1c2d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:18.286977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b0290-5d6f-4ee3-8745-04214fdc1c2d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:18.287257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b0290-5d6f-4ee3-8745-04214fdc1c2d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:18.288127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b0290-5d6f-4ee3-8745-04214fdc1c2d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:18.301942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b0290-5d6f-4ee3-8745-04214fdc1c2d tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:18.339870 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2272/4589] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:18 2022] GET /identity/v3/users => generated 8892 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:18.342134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2c37e-0173-4ac9-89fc-144dae2f182e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:18.342825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2c37e-0173-4ac9-89fc-144dae2f182e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:18.343188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2c37e-0173-4ac9-89fc-144dae2f182e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:18.387477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8ae2c37e-0173-4ac9-89fc-144dae2f182e None None] MFA Rules not processed for user `22bf18fea82744cf94122f073057f8ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:18.388647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8ae2c37e-0173-4ac9-89fc-144dae2f182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:18.473461 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2318/4590] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:18 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:18.483667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d7845-dcb8-4235-ab77-44b676c0bb92 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:18.483951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d7845-dcb8-4235-ab77-44b676c0bb92 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:18.484380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d7845-dcb8-4235-ab77-44b676c0bb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:18.501747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-923d7845-dcb8-4235-ab77-44b676c0bb92 None None] MFA Rules not processed for user `22bf18fea82744cf94122f073057f8ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:18.502957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-923d7845-dcb8-4235-ab77-44b676c0bb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:18.510160 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2273/4591] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:18 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:18.514534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2c37e-0173-4ac9-89fc-144dae2f182e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:18.524663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2c37e-0173-4ac9-89fc-144dae2f182e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:18.529049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f169a-8a55-4601-bf0e-03a8d92a7311 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf18fea82744cf94122f073057f8ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f902e10e0c1f457cb1dfd7a3da5e94c8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-560503696', 'tempest-NotDelegatedRole-546646928'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:18.529708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f169a-8a55-4601-bf0e-03a8d92a7311 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:18.529988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f169a-8a55-4601-bf0e-03a8d92a7311 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:18.530265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f169a-8a55-4601-bf0e-03a8d92a7311 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:18.531028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f169a-8a55-4601-bf0e-03a8d92a7311 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: Authorizing `identity:create_trust()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:18.532320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4f169a-8a55-4601-bf0e-03a8d92a7311 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:18.614293 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2319/4592] 10.222.0.43 () {60 vars in 1173 bytes} [Sat Jul 2 21:16:18 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:18.618428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d7845-dcb8-4235-ab77-44b676c0bb92 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:18.627856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d7845-dcb8-4235-ab77-44b676c0bb92 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:18.632454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fd29f-a407-4d97-be57-0036651041a8 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf18fea82744cf94122f073057f8ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f902e10e0c1f457cb1dfd7a3da5e94c8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-560503696', 'tempest-NotDelegatedRole-546646928'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:18.633394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fd29f-a407-4d97-be57-0036651041a8 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:18.633737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fd29f-a407-4d97-be57-0036651041a8 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:18.634074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fd29f-a407-4d97-be57-0036651041a8 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] PATH_INFO: `/v3/OS-TRUST/trusts/0f569de7812f4371ae98106364c926f1` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:18.640626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fd29f-a407-4d97-be57-0036651041a8 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: Authorizing `identity:get_trust(trust_id=0f569de7812f4371ae98106364c926f1)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:18.642033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fd29f-a407-4d97-be57-0036651041a8 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:18.652102 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2274/4593] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:16:18 2022] GET /identity/v3/OS-TRUST/trusts/0f569de7812f4371ae98106364c926f1 => generated 833 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:18.653917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f169a-8a55-4601-bf0e-03a8d92a7311 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:18.664074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f169a-8a55-4601-bf0e-03a8d92a7311 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:18.668310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dc449-79e3-47b0-b233-0613b67f87fd tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf18fea82744cf94122f073057f8ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f902e10e0c1f457cb1dfd7a3da5e94c8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-560503696', 'tempest-NotDelegatedRole-546646928'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:18.669128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dc449-79e3-47b0-b233-0613b67f87fd tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:18.669404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dc449-79e3-47b0-b233-0613b67f87fd tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:18.669680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dc449-79e3-47b0-b233-0613b67f87fd tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] PATH_INFO: `/v3/OS-TRUST/trusts/0f569de7812f4371ae98106364c926f1/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:18.675987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dc449-79e3-47b0-b233-0613b67f87fd tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=0f569de7812f4371ae98106364c926f1)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:18.677484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dc449-79e3-47b0-b233-0613b67f87fd tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:18.685409 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2320/4594] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:16:18 2022] GET /identity/v3/OS-TRUST/trusts/0f569de7812f4371ae98106364c926f1/roles => generated 370 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:18.689240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fd29f-a407-4d97-be57-0036651041a8 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:18.698866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fd29f-a407-4d97-be57-0036651041a8 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:18.704073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa9eb2-b037-446b-bd1b-6025cdf49d27 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf18fea82744cf94122f073057f8ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f902e10e0c1f457cb1dfd7a3da5e94c8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-560503696', 'tempest-NotDelegatedRole-546646928'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:18.705075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa9eb2-b037-446b-bd1b-6025cdf49d27 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:18.705303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa9eb2-b037-446b-bd1b-6025cdf49d27 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:18.705560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa9eb2-b037-446b-bd1b-6025cdf49d27 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] PATH_INFO: `/v3/OS-TRUST/trusts/0f569de7812f4371ae98106364c926f1/roles/e58d6de81f284671964d165ad0ed5b0a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:18.708479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:18.713248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa9eb2-b037-446b-bd1b-6025cdf49d27 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0f569de7812f4371ae98106364c926f1, role_id=e58d6de81f284671964d165ad0ed5b0a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:18.714825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa9eb2-b037-446b-bd1b-6025cdf49d27 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:18.727065 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2275/4595] 10.222.0.43 () {58 vars in 1367 bytes} [Sat Jul 2 21:16:18 2022] GET /identity/v3/OS-TRUST/trusts/0f569de7812f4371ae98106364c926f1/roles/e58d6de81f284671964d165ad0ed5b0a => generated 243 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:16:18.731305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dc449-79e3-47b0-b233-0613b67f87fd tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:18.741847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dc449-79e3-47b0-b233-0613b67f87fd tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:18.746066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dd488-803a-49df-a4f9-a6ae11baac0a tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf18fea82744cf94122f073057f8ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f902e10e0c1f457cb1dfd7a3da5e94c8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-560503696', 'tempest-NotDelegatedRole-546646928'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:18.746924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dd488-803a-49df-a4f9-a6ae11baac0a tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] REQUEST_METHOD: `HEAD` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:18.747206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dd488-803a-49df-a4f9-a6ae11baac0a tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:18.747481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dd488-803a-49df-a4f9-a6ae11baac0a tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] PATH_INFO: `/v3/OS-TRUST/trusts/0f569de7812f4371ae98106364c926f1/roles/e58d6de81f284671964d165ad0ed5b0a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:18.752725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:18.754733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dd488-803a-49df-a4f9-a6ae11baac0a tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0f569de7812f4371ae98106364c926f1, role_id=e58d6de81f284671964d165ad0ed5b0a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:18.756334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dd488-803a-49df-a4f9-a6ae11baac0a tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:18.764318 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2321/4596] 10.222.0.43 () {58 vars in 1368 bytes} [Sat Jul 2 21:16:18 2022] HEAD /identity/v3/OS-TRUST/trusts/0f569de7812f4371ae98106364c926f1/roles/e58d6de81f284671964d165ad0ed5b0a => generated 0 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:18.768752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa9eb2-b037-446b-bd1b-6025cdf49d27 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:18.778074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa9eb2-b037-446b-bd1b-6025cdf49d27 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:18.784960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189da739-9207-4ad9-b282-ebf636846237 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf18fea82744cf94122f073057f8ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f902e10e0c1f457cb1dfd7a3da5e94c8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-560503696', 'tempest-NotDelegatedRole-546646928'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:18.784960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189da739-9207-4ad9-b282-ebf636846237 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:18.784960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189da739-9207-4ad9-b282-ebf636846237 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:18.785332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189da739-9207-4ad9-b282-ebf636846237 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] PATH_INFO: `/v3/OS-TRUST/trusts/0f569de7812f4371ae98106364c926f1/roles/7ad7571f99b04aea83f7011c91a10f2e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:18.790118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189da739-9207-4ad9-b282-ebf636846237 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0f569de7812f4371ae98106364c926f1, role_id=7ad7571f99b04aea83f7011c91a10f2e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:18.791552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189da739-9207-4ad9-b282-ebf636846237 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:18.805772 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-189da739-9207-4ad9-b282-ebf636846237 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Could not find role: 7ad7571f99b04aea83f7011c91a10f2e.: keystone.exception.RoleNotFound: Could not find role: 7ad7571f99b04aea83f7011c91a10f2e. Jul 02 21:16:18.805772 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:16:18.805772 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:16:18.805772 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:16:18.805772 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:16:18.805772 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:16:18.805772 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:16:18.805772 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:16:18.805772 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:16:18.805772 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:16:18.805772 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:16:18.805772 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:16:18.805772 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 02 21:16:18.805772 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 21:16:18.807036 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 7ad7571f99b04aea83f7011c91a10f2e. Jul 02 21:16:18.807036 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:16:18.807302 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2276/4597] 10.222.0.43 () {58 vars in 1367 bytes} [Sat Jul 2 21:16:18 2022] GET /identity/v3/OS-TRUST/trusts/0f569de7812f4371ae98106364c926f1/roles/7ad7571f99b04aea83f7011c91a10f2e => generated 110 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:16:18.811278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dd488-803a-49df-a4f9-a6ae11baac0a tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:18.821329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dd488-803a-49df-a4f9-a6ae11baac0a tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:18.825519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c7fee-32e1-4532-b130-5fededb61cbc tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf18fea82744cf94122f073057f8ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f902e10e0c1f457cb1dfd7a3da5e94c8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-560503696', 'tempest-NotDelegatedRole-546646928'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:18.826336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c7fee-32e1-4532-b130-5fededb61cbc tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] REQUEST_METHOD: `HEAD` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:18.826647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c7fee-32e1-4532-b130-5fededb61cbc tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:18.826928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c7fee-32e1-4532-b130-5fededb61cbc tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] PATH_INFO: `/v3/OS-TRUST/trusts/0f569de7812f4371ae98106364c926f1/roles/7ad7571f99b04aea83f7011c91a10f2e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:18.832763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c7fee-32e1-4532-b130-5fededb61cbc tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: Authorizing `identity:get_role_for_trust(trust_id=0f569de7812f4371ae98106364c926f1, role_id=7ad7571f99b04aea83f7011c91a10f2e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:18.834221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c7fee-32e1-4532-b130-5fededb61cbc tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:18.848324 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-878c7fee-32e1-4532-b130-5fededb61cbc tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Could not find role: 7ad7571f99b04aea83f7011c91a10f2e.: keystone.exception.RoleNotFound: Could not find role: 7ad7571f99b04aea83f7011c91a10f2e. Jul 02 21:16:18.848324 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:16:18.848324 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:16:18.848324 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:16:18.848324 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:16:18.848324 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:16:18.848324 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:16:18.848324 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:16:18.848324 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:16:18.848324 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:16:18.848324 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:16:18.848324 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:16:18.848324 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 02 21:16:18.848324 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 21:16:18.849685 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 7ad7571f99b04aea83f7011c91a10f2e. Jul 02 21:16:18.849685 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:16:18.849685 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2322/4598] 10.222.0.43 () {58 vars in 1368 bytes} [Sat Jul 2 21:16:18 2022] HEAD /identity/v3/OS-TRUST/trusts/0f569de7812f4371ae98106364c926f1/roles/7ad7571f99b04aea83f7011c91a10f2e => generated 0 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 02 21:16:18.853576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189da739-9207-4ad9-b282-ebf636846237 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:18.867134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189da739-9207-4ad9-b282-ebf636846237 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:18.874686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b9833-b3b3-4f1b-a693-aca6502927c7 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf18fea82744cf94122f073057f8ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f902e10e0c1f457cb1dfd7a3da5e94c8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-560503696', 'tempest-NotDelegatedRole-546646928'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:18.875616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b9833-b3b3-4f1b-a693-aca6502927c7 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:18.875884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b9833-b3b3-4f1b-a693-aca6502927c7 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:18.876235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b9833-b3b3-4f1b-a693-aca6502927c7 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] PATH_INFO: `/v3/OS-TRUST/trusts/0f569de7812f4371ae98106364c926f1` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:18.884687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b9833-b3b3-4f1b-a693-aca6502927c7 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: Authorizing `identity:delete_trust(trust_id=0f569de7812f4371ae98106364c926f1)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:18.887340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b9833-b3b3-4f1b-a693-aca6502927c7 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:18.907914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e76b9833-b3b3-4f1b-a693-aca6502927c7 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '0f569de7812f4371ae98106364c926f1', 'request_id': 'req-e76b9833-b3b3-4f1b-a693-aca6502927c7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:18.918288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e76b9833-b3b3-4f1b-a693-aca6502927c7 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '0f569de7812f4371ae98106364c926f1', 'request_id': 'req-e76b9833-b3b3-4f1b-a693-aca6502927c7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:18.919003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e76b9833-b3b3-4f1b-a693-aca6502927c7 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '0f569de7812f4371ae98106364c926f1', 'request_id': 'req-e76b9833-b3b3-4f1b-a693-aca6502927c7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:18.926561 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2277/4599] 10.222.0.43 () {58 vars in 1253 bytes} [Sat Jul 2 21:16:18 2022] DELETE /identity/v3/OS-TRUST/trusts/0f569de7812f4371ae98106364c926f1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:16:18.930734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c7fee-32e1-4532-b130-5fededb61cbc tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:18.932838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-878c7fee-32e1-4532-b130-5fededb61cbc tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:18.945449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c7fee-32e1-4532-b130-5fededb61cbc tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:18.950221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bff30-1a25-4ec3-b9ee-03a2cc4f4798 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22bf18fea82744cf94122f073057f8ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f902e10e0c1f457cb1dfd7a3da5e94c8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-560503696', 'tempest-NotDelegatedRole-546646928'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:18.951305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bff30-1a25-4ec3-b9ee-03a2cc4f4798 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:18.951600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bff30-1a25-4ec3-b9ee-03a2cc4f4798 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:18.951876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bff30-1a25-4ec3-b9ee-03a2cc4f4798 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] PATH_INFO: `/v3/OS-TRUST/trusts/0f569de7812f4371ae98106364c926f1` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:18.964970 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-431bff30-1a25-4ec3-b9ee-03a2cc4f4798 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Could not find trust: 0f569de7812f4371ae98106364c926f1.: keystone.exception.TrustNotFound: Could not find trust: 0f569de7812f4371ae98106364c926f1. Jul 02 21:16:18.964970 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:16:18.964970 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:16:18.964970 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:16:18.964970 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:16:18.964970 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:16:18.964970 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:16:18.964970 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:16:18.964970 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:16:18.964970 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:16:18.964970 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:16:18.964970 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:16:18.964970 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 02 21:16:18.964970 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 02 21:16:18.964970 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 02 21:16:18.966358 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 02 21:16:18.966358 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 02 21:16:18.966358 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 02 21:16:18.966358 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 02 21:16:18.966358 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 02 21:16:18.966358 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:16:18.966358 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:16:18.966358 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 02 21:16:18.966358 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 02 21:16:18.966358 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 02 21:16:18.966358 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 02 21:16:18.966358 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 0f569de7812f4371ae98106364c926f1. Jul 02 21:16:18.966358 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:16:18.966358 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2323/4600] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:16:18 2022] GET /identity/v3/OS-TRUST/trusts/0f569de7812f4371ae98106364c926f1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:16:18.970626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b9833-b3b3-4f1b-a693-aca6502927c7 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:18.972165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e76b9833-b3b3-4f1b-a693-aca6502927c7 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:18.987678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b9833-b3b3-4f1b-a693-aca6502927c7 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:18.992554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7f73e-6332-4dab-aad4-cb009a0df54b tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:18.993467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7f73e-6332-4dab-aad4-cb009a0df54b tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:18.993811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7f73e-6332-4dab-aad4-cb009a0df54b tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:18.994152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7f73e-6332-4dab-aad4-cb009a0df54b tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles/7ad7571f99b04aea83f7011c91a10f2e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:18.995684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7f73e-6332-4dab-aad4-cb009a0df54b tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7ad7571f99b04aea83f7011c91a10f2e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:18.997396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7f73e-6332-4dab-aad4-cb009a0df54b tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:19.042991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6ed7f73e-6332-4dab-aad4-cb009a0df54b tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invalidating the token cache because role 7ad7571f99b04aea83f7011c91a10f2e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:19.043355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6ed7f73e-6332-4dab-aad4-cb009a0df54b tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:19.044541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6ed7f73e-6332-4dab-aad4-cb009a0df54b tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:19.046786 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2278/4601] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:18 2022] DELETE /identity/v3/roles/7ad7571f99b04aea83f7011c91a10f2e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:16:19.051303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bff30-1a25-4ec3-b9ee-03a2cc4f4798 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:19.054192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-431bff30-1a25-4ec3-b9ee-03a2cc4f4798 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:19.072730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bff30-1a25-4ec3-b9ee-03a2cc4f4798 tempest-TrustsV3TestJSON-1258907910 tempest-user-63636042] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:19.142421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43af317-0057-4163-a32e-531771d2f332 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:19.143438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43af317-0057-4163-a32e-531771d2f332 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:19.143798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43af317-0057-4163-a32e-531771d2f332 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:19.144179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43af317-0057-4163-a32e-531771d2f332 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles/e58d6de81f284671964d165ad0ed5b0a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:19.145773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43af317-0057-4163-a32e-531771d2f332 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e58d6de81f284671964d165ad0ed5b0a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:19.147578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43af317-0057-4163-a32e-531771d2f332 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:19.199125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a43af317-0057-4163-a32e-531771d2f332 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invalidating the token cache because role e58d6de81f284671964d165ad0ed5b0a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:19.199432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a43af317-0057-4163-a32e-531771d2f332 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:19.203175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a43af317-0057-4163-a32e-531771d2f332 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:19.205671 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2324/4602] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:19 2022] DELETE /identity/v3/roles/e58d6de81f284671964d165ad0ed5b0a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:19.211672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7f73e-6332-4dab-aad4-cb009a0df54b tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:19.227164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7f73e-6332-4dab-aad4-cb009a0df54b tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:19.299976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd255d0f-8ab7-499d-8e90-be1d86da0a26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:19.300924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd255d0f-8ab7-499d-8e90-be1d86da0a26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:19.301420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd255d0f-8ab7-499d-8e90-be1d86da0a26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:19.301706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd255d0f-8ab7-499d-8e90-be1d86da0a26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/users/22bf18fea82744cf94122f073057f8ee` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:19.303289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd255d0f-8ab7-499d-8e90-be1d86da0a26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_user(user_id=22bf18fea82744cf94122f073057f8ee)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:19.305370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd255d0f-8ab7-499d-8e90-be1d86da0a26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:19.365133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cd255d0f-8ab7-499d-8e90-be1d86da0a26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22bf18fea82744cf94122f073057f8ee'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:19.374387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cd255d0f-8ab7-499d-8e90-be1d86da0a26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22bf18fea82744cf94122f073057f8ee'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:19.376250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=12 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:19.385543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cd255d0f-8ab7-499d-8e90-be1d86da0a26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22bf18fea82744cf94122f073057f8ee'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:19.386323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cd255d0f-8ab7-499d-8e90-be1d86da0a26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22bf18fea82744cf94122f073057f8ee'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:19.386955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cd255d0f-8ab7-499d-8e90-be1d86da0a26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22bf18fea82744cf94122f073057f8ee'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:19.409281 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2279/4603] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:19 2022] DELETE /identity/v3/users/22bf18fea82744cf94122f073057f8ee => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:19.413420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43af317-0057-4163-a32e-531771d2f332 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:19.415080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a43af317-0057-4163-a32e-531771d2f332 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:19.429961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43af317-0057-4163-a32e-531771d2f332 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:19.491697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f482ce-ef75-4b75-9416-a532ee7d5883 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:19.492608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f482ce-ef75-4b75-9416-a532ee7d5883 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:19.492897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f482ce-ef75-4b75-9416-a532ee7d5883 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:19.493175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f482ce-ef75-4b75-9416-a532ee7d5883 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects/f902e10e0c1f457cb1dfd7a3da5e94c8` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:19.494360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f482ce-ef75-4b75-9416-a532ee7d5883 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f902e10e0c1f457cb1dfd7a3da5e94c8)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:19.496334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f482ce-ef75-4b75-9416-a532ee7d5883 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:19.542498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:19.560949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b7f482ce-ef75-4b75-9416-a532ee7d5883 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f902e10e0c1f457cb1dfd7a3da5e94c8', 'request_id': 'req-b7f482ce-ef75-4b75-9416-a532ee7d5883'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:19.569426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b7f482ce-ef75-4b75-9416-a532ee7d5883 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f902e10e0c1f457cb1dfd7a3da5e94c8', 'request_id': 'req-b7f482ce-ef75-4b75-9416-a532ee7d5883'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:19.575859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b7f482ce-ef75-4b75-9416-a532ee7d5883 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f902e10e0c1f457cb1dfd7a3da5e94c8', 'request_id': 'req-b7f482ce-ef75-4b75-9416-a532ee7d5883'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:19.587619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b7f482ce-ef75-4b75-9416-a532ee7d5883 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] The token cache is being invalidate because project f902e10e0c1f457cb1dfd7a3da5e94c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:19.587908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b7f482ce-ef75-4b75-9416-a532ee7d5883 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:19.588744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b7f482ce-ef75-4b75-9416-a532ee7d5883 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:19.590619 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2325/4604] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:19 2022] DELETE /identity/v3/projects/f902e10e0c1f457cb1dfd7a3da5e94c8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:19.596298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd255d0f-8ab7-499d-8e90-be1d86da0a26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:19.597954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cd255d0f-8ab7-499d-8e90-be1d86da0a26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:19.612274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd255d0f-8ab7-499d-8e90-be1d86da0a26 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:19.681009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a3036-d3ee-4307-aac1-7c60972ae50f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:19.681930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a3036-d3ee-4307-aac1-7c60972ae50f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:19.682342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a3036-d3ee-4307-aac1-7c60972ae50f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:19.682722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a3036-d3ee-4307-aac1-7c60972ae50f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:19.683711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a3036-d3ee-4307-aac1-7c60972ae50f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:19.686477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a3036-d3ee-4307-aac1-7c60972ae50f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:19.719484 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2280/4605] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:16:19 2022] POST /identity/v3/projects => generated 328 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:19.723905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f482ce-ef75-4b75-9416-a532ee7d5883 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:19.725390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b7f482ce-ef75-4b75-9416-a532ee7d5883 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:19.738997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f482ce-ef75-4b75-9416-a532ee7d5883 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:19.799588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19c6a7-4f93-42a3-a359-5b4e3fca7236 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:19.800318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19c6a7-4f93-42a3-a359-5b4e3fca7236 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:19.800602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19c6a7-4f93-42a3-a359-5b4e3fca7236 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:19.800881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19c6a7-4f93-42a3-a359-5b4e3fca7236 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:19.801602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19c6a7-4f93-42a3-a359-5b4e3fca7236 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:19.803962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19c6a7-4f93-42a3-a359-5b4e3fca7236 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:19.835024 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2326/4606] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:19 2022] POST /identity/v3/users => generated 416 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:19.838069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a3036-d3ee-4307-aac1-7c60972ae50f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:19.849970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a3036-d3ee-4307-aac1-7c60972ae50f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:19.854827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca8479-b38a-449f-b24c-3001d21d4c8f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:19.855516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca8479-b38a-449f-b24c-3001d21d4c8f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:19.855812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca8479-b38a-449f-b24c-3001d21d4c8f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:19.856122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca8479-b38a-449f-b24c-3001d21d4c8f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:19.856887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca8479-b38a-449f-b24c-3001d21d4c8f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:19.858526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca8479-b38a-449f-b24c-3001d21d4c8f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:19.877069 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2281/4607] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:16:19 2022] POST /identity/v3/roles => generated 243 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:16:19.878444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19c6a7-4f93-42a3-a359-5b4e3fca7236 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:19.890435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19c6a7-4f93-42a3-a359-5b4e3fca7236 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:19.895799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9be8b-7ffe-41a1-a1ff-8a7d4b18df86 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:19.896525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9be8b-7ffe-41a1-a1ff-8a7d4b18df86 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:19.896807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9be8b-7ffe-41a1-a1ff-8a7d4b18df86 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:19.897084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9be8b-7ffe-41a1-a1ff-8a7d4b18df86 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:19.897864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9be8b-7ffe-41a1-a1ff-8a7d4b18df86 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:19.899495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9be8b-7ffe-41a1-a1ff-8a7d4b18df86 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:19.918190 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2327/4608] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:16:19 2022] POST /identity/v3/roles => generated 247 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:19.919413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca8479-b38a-449f-b24c-3001d21d4c8f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:19.932178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca8479-b38a-449f-b24c-3001d21d4c8f tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:19.937075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094aa73e-e8e3-44ff-8ab4-a0fccc9b2173 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:19.938018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aa73e-e8e3-44ff-8ab4-a0fccc9b2173 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:19.938299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aa73e-e8e3-44ff-8ab4-a0fccc9b2173 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:19.938576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aa73e-e8e3-44ff-8ab4-a0fccc9b2173 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects/c62d3db90f1e4a84b86bb11a59165cab/users/3ecd1906908d4381a5057c87b0b15ba5/roles/71d0f0d6c5274cd787486ba7acd03d68` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:19.955410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094aa73e-e8e3-44ff-8ab4-a0fccc9b2173 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c62d3db90f1e4a84b86bb11a59165cab, user_id=3ecd1906908d4381a5057c87b0b15ba5, role_id=71d0f0d6c5274cd787486ba7acd03d68)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:19.958196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094aa73e-e8e3-44ff-8ab4-a0fccc9b2173 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:19.972576 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2282/4609] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:19 2022] PUT /identity/v3/projects/c62d3db90f1e4a84b86bb11a59165cab/users/3ecd1906908d4381a5057c87b0b15ba5/roles/71d0f0d6c5274cd787486ba7acd03d68 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:16:19.976659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9be8b-7ffe-41a1-a1ff-8a7d4b18df86 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:19.987868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9be8b-7ffe-41a1-a1ff-8a7d4b18df86 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:20.050064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c11b2-4cf2-4ef6-9ccf-1774183a9d17 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:20.050994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c11b2-4cf2-4ef6-9ccf-1774183a9d17 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:20.051283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c11b2-4cf2-4ef6-9ccf-1774183a9d17 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:20.051563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c11b2-4cf2-4ef6-9ccf-1774183a9d17 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects/c62d3db90f1e4a84b86bb11a59165cab/users/3ecd1906908d4381a5057c87b0b15ba5/roles/37f33d97b0934f309b2e867f0625077f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:20.054307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c11b2-4cf2-4ef6-9ccf-1774183a9d17 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c62d3db90f1e4a84b86bb11a59165cab, user_id=3ecd1906908d4381a5057c87b0b15ba5, role_id=37f33d97b0934f309b2e867f0625077f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:20.057018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c11b2-4cf2-4ef6-9ccf-1774183a9d17 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:20.070302 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2328/4610] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:19 2022] PUT /identity/v3/projects/c62d3db90f1e4a84b86bb11a59165cab/users/3ecd1906908d4381a5057c87b0b15ba5/roles/37f33d97b0934f309b2e867f0625077f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:20.074436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094aa73e-e8e3-44ff-8ab4-a0fccc9b2173 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:20.086379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094aa73e-e8e3-44ff-8ab4-a0fccc9b2173 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:20.146953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b5ac8-020a-4a83-b75c-c170ba61bb63 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:20.147658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b5ac8-020a-4a83-b75c-c170ba61bb63 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:20.147946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b5ac8-020a-4a83-b75c-c170ba61bb63 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:20.148529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b5ac8-020a-4a83-b75c-c170ba61bb63 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:20.149311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b5ac8-020a-4a83-b75c-c170ba61bb63 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:20.151175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b5ac8-020a-4a83-b75c-c170ba61bb63 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:20.182243 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2283/4611] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:20 2022] GET /identity/v3/users => generated 8898 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:20.187782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf9b07-9db1-462c-84b7-7c2ff26aaea7 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:20.188115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf9b07-9db1-462c-84b7-7c2ff26aaea7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:20.188444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf9b07-9db1-462c-84b7-7c2ff26aaea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:20.226492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-daaf9b07-9db1-462c-84b7-7c2ff26aaea7 None None] MFA Rules not processed for user `3ecd1906908d4381a5057c87b0b15ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:20.228709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-daaf9b07-9db1-462c-84b7-7c2ff26aaea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:20.246777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=5,keystone:SELECT=88,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:20.311993 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2329/4612] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:20 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:20.323234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d487a-0071-46cc-957d-29ba3da30c40 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:20.323468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d487a-0071-46cc-957d-29ba3da30c40 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:20.323973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d487a-0071-46cc-957d-29ba3da30c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:20.342640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-143d487a-0071-46cc-957d-29ba3da30c40 None None] MFA Rules not processed for user `3ecd1906908d4381a5057c87b0b15ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:20.343939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-143d487a-0071-46cc-957d-29ba3da30c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:20.352209 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2284/4613] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:20 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:16:20.356468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf9b07-9db1-462c-84b7-7c2ff26aaea7 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:20.365786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf9b07-9db1-462c-84b7-7c2ff26aaea7 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:20.369948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b19fab-bd83-4d5d-8d35-13ad5cbb77fb tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ecd1906908d4381a5057c87b0b15ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c62d3db90f1e4a84b86bb11a59165cab', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-132851006', 'tempest-NotDelegatedRole-2074016586'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:20.370894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b19fab-bd83-4d5d-8d35-13ad5cbb77fb tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:20.371182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b19fab-bd83-4d5d-8d35-13ad5cbb77fb tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:20.371458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b19fab-bd83-4d5d-8d35-13ad5cbb77fb tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:20.372250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b19fab-bd83-4d5d-8d35-13ad5cbb77fb tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: Authorizing `identity:create_trust()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:20.373413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b19fab-bd83-4d5d-8d35-13ad5cbb77fb tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:20.465684 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2330/4614] 10.222.0.43 () {60 vars in 1173 bytes} [Sat Jul 2 21:16:20 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:20.470236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d487a-0071-46cc-957d-29ba3da30c40 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:20.480015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d487a-0071-46cc-957d-29ba3da30c40 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:20.485089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0afcce-83e0-4b25-a301-63783c43055e tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ecd1906908d4381a5057c87b0b15ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c62d3db90f1e4a84b86bb11a59165cab', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-132851006', 'tempest-NotDelegatedRole-2074016586'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:20.486144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0afcce-83e0-4b25-a301-63783c43055e tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:20.486431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0afcce-83e0-4b25-a301-63783c43055e tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:20.486891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0afcce-83e0-4b25-a301-63783c43055e tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] PATH_INFO: `/v3/OS-TRUST/trusts/cbbac27fc19b41709d22cb6a7a4bd231` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:20.490804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:20.498098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0afcce-83e0-4b25-a301-63783c43055e tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: Authorizing `identity:get_trust(trust_id=cbbac27fc19b41709d22cb6a7a4bd231)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:20.500895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0afcce-83e0-4b25-a301-63783c43055e tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:20.517225 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2285/4615] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:16:20 2022] GET /identity/v3/OS-TRUST/trusts/cbbac27fc19b41709d22cb6a7a4bd231 => generated 834 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:20.522369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b19fab-bd83-4d5d-8d35-13ad5cbb77fb tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:20.532368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b19fab-bd83-4d5d-8d35-13ad5cbb77fb tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:20.537245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ac345-c694-4f82-a75d-f9cbb6a2b365 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ecd1906908d4381a5057c87b0b15ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c62d3db90f1e4a84b86bb11a59165cab', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-132851006', 'tempest-NotDelegatedRole-2074016586'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:20.537954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ac345-c694-4f82-a75d-f9cbb6a2b365 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:20.538240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ac345-c694-4f82-a75d-f9cbb6a2b365 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:20.538519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ac345-c694-4f82-a75d-f9cbb6a2b365 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] PATH_INFO: `/v3/OS-TRUST/trusts/cbbac27fc19b41709d22cb6a7a4bd231/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:20.544628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ac345-c694-4f82-a75d-f9cbb6a2b365 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=cbbac27fc19b41709d22cb6a7a4bd231)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:20.546086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ac345-c694-4f82-a75d-f9cbb6a2b365 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:20.554040 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2331/4616] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:16:20 2022] GET /identity/v3/OS-TRUST/trusts/cbbac27fc19b41709d22cb6a7a4bd231/roles => generated 370 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:20.558374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0afcce-83e0-4b25-a301-63783c43055e tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:20.568626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0afcce-83e0-4b25-a301-63783c43055e tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:20.572844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104587cf-6aee-4133-8745-4ed2fb5ab688 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ecd1906908d4381a5057c87b0b15ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c62d3db90f1e4a84b86bb11a59165cab', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-132851006', 'tempest-NotDelegatedRole-2074016586'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:20.573674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104587cf-6aee-4133-8745-4ed2fb5ab688 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:20.573957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104587cf-6aee-4133-8745-4ed2fb5ab688 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:20.574237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104587cf-6aee-4133-8745-4ed2fb5ab688 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] PATH_INFO: `/v3/OS-TRUST/trusts/cbbac27fc19b41709d22cb6a7a4bd231/roles/71d0f0d6c5274cd787486ba7acd03d68` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:20.580932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104587cf-6aee-4133-8745-4ed2fb5ab688 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: Authorizing `identity:get_role_for_trust(trust_id=cbbac27fc19b41709d22cb6a7a4bd231, role_id=71d0f0d6c5274cd787486ba7acd03d68)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:20.582957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104587cf-6aee-4133-8745-4ed2fb5ab688 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:20.590867 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2286/4617] 10.222.0.43 () {58 vars in 1367 bytes} [Sat Jul 2 21:16:20 2022] GET /identity/v3/OS-TRUST/trusts/cbbac27fc19b41709d22cb6a7a4bd231/roles/71d0f0d6c5274cd787486ba7acd03d68 => generated 243 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:20.595117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ac345-c694-4f82-a75d-f9cbb6a2b365 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:20.605296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ac345-c694-4f82-a75d-f9cbb6a2b365 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:20.610025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49ddde-a3db-4c3f-aace-fdfa2ef4c563 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ecd1906908d4381a5057c87b0b15ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c62d3db90f1e4a84b86bb11a59165cab', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-132851006', 'tempest-NotDelegatedRole-2074016586'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:20.610823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49ddde-a3db-4c3f-aace-fdfa2ef4c563 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] REQUEST_METHOD: `HEAD` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:20.611129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49ddde-a3db-4c3f-aace-fdfa2ef4c563 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:20.611497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49ddde-a3db-4c3f-aace-fdfa2ef4c563 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] PATH_INFO: `/v3/OS-TRUST/trusts/cbbac27fc19b41709d22cb6a7a4bd231/roles/71d0f0d6c5274cd787486ba7acd03d68` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:20.618650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49ddde-a3db-4c3f-aace-fdfa2ef4c563 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: Authorizing `identity:get_role_for_trust(trust_id=cbbac27fc19b41709d22cb6a7a4bd231, role_id=71d0f0d6c5274cd787486ba7acd03d68)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:20.620264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49ddde-a3db-4c3f-aace-fdfa2ef4c563 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:20.628649 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2332/4618] 10.222.0.43 () {58 vars in 1368 bytes} [Sat Jul 2 21:16:20 2022] HEAD /identity/v3/OS-TRUST/trusts/cbbac27fc19b41709d22cb6a7a4bd231/roles/71d0f0d6c5274cd787486ba7acd03d68 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 02 21:16:20.632960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104587cf-6aee-4133-8745-4ed2fb5ab688 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:20.643443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104587cf-6aee-4133-8745-4ed2fb5ab688 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:20.648113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44713a5f-5a6e-4aa1-84dd-2816baf3f3aa tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ecd1906908d4381a5057c87b0b15ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c62d3db90f1e4a84b86bb11a59165cab', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-132851006', 'tempest-NotDelegatedRole-2074016586'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:20.649067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44713a5f-5a6e-4aa1-84dd-2816baf3f3aa tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:20.650091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44713a5f-5a6e-4aa1-84dd-2816baf3f3aa tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:20.650091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44713a5f-5a6e-4aa1-84dd-2816baf3f3aa tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] PATH_INFO: `/v3/OS-TRUST/trusts/cbbac27fc19b41709d22cb6a7a4bd231/roles/37f33d97b0934f309b2e867f0625077f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:20.656782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44713a5f-5a6e-4aa1-84dd-2816baf3f3aa tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: Authorizing `identity:get_role_for_trust(trust_id=cbbac27fc19b41709d22cb6a7a4bd231, role_id=37f33d97b0934f309b2e867f0625077f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:20.658345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44713a5f-5a6e-4aa1-84dd-2816baf3f3aa tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:20.673610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-44713a5f-5a6e-4aa1-84dd-2816baf3f3aa tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Could not find role: 37f33d97b0934f309b2e867f0625077f.: keystone.exception.RoleNotFound: Could not find role: 37f33d97b0934f309b2e867f0625077f. Jul 02 21:16:20.673610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:16:20.673610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:16:20.673610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:16:20.673610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:16:20.673610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:16:20.673610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:16:20.673610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:16:20.673610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:16:20.673610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:16:20.673610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:16:20.673610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:16:20.673610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 02 21:16:20.673610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 21:16:20.674935 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 37f33d97b0934f309b2e867f0625077f. Jul 02 21:16:20.674935 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:16:20.676115 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2287/4619] 10.222.0.43 () {58 vars in 1367 bytes} [Sat Jul 2 21:16:20 2022] GET /identity/v3/OS-TRUST/trusts/cbbac27fc19b41709d22cb6a7a4bd231/roles/37f33d97b0934f309b2e867f0625077f => generated 110 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:16:20.680789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49ddde-a3db-4c3f-aace-fdfa2ef4c563 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:20.691098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49ddde-a3db-4c3f-aace-fdfa2ef4c563 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:20.696069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed34f39-657a-4688-825a-6be6685dcb9a tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ecd1906908d4381a5057c87b0b15ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c62d3db90f1e4a84b86bb11a59165cab', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-132851006', 'tempest-NotDelegatedRole-2074016586'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:20.697075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed34f39-657a-4688-825a-6be6685dcb9a tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] REQUEST_METHOD: `HEAD` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:20.697361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed34f39-657a-4688-825a-6be6685dcb9a tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:20.697668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed34f39-657a-4688-825a-6be6685dcb9a tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] PATH_INFO: `/v3/OS-TRUST/trusts/cbbac27fc19b41709d22cb6a7a4bd231/roles/37f33d97b0934f309b2e867f0625077f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:20.704156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed34f39-657a-4688-825a-6be6685dcb9a tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: Authorizing `identity:get_role_for_trust(trust_id=cbbac27fc19b41709d22cb6a7a4bd231, role_id=37f33d97b0934f309b2e867f0625077f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:20.705631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed34f39-657a-4688-825a-6be6685dcb9a tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:20.720476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-9ed34f39-657a-4688-825a-6be6685dcb9a tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Could not find role: 37f33d97b0934f309b2e867f0625077f.: keystone.exception.RoleNotFound: Could not find role: 37f33d97b0934f309b2e867f0625077f. Jul 02 21:16:20.720476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:16:20.720476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:16:20.720476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:16:20.720476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:16:20.720476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:16:20.720476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:16:20.720476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:16:20.720476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:16:20.720476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:16:20.720476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:16:20.720476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:16:20.720476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 02 21:16:20.720476 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 21:16:20.721710 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 37f33d97b0934f309b2e867f0625077f. Jul 02 21:16:20.721710 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:16:20.723431 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2333/4620] 10.222.0.43 () {58 vars in 1368 bytes} [Sat Jul 2 21:16:20 2022] HEAD /identity/v3/OS-TRUST/trusts/cbbac27fc19b41709d22cb6a7a4bd231/roles/37f33d97b0934f309b2e867f0625077f => generated 0 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:16:20.727774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44713a5f-5a6e-4aa1-84dd-2816baf3f3aa tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:20.739811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44713a5f-5a6e-4aa1-84dd-2816baf3f3aa tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:20.745151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2188979-f2e1-4524-a3cc-71ee364f44a2 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ecd1906908d4381a5057c87b0b15ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c62d3db90f1e4a84b86bb11a59165cab', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-132851006', 'tempest-NotDelegatedRole-2074016586'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:20.746048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2188979-f2e1-4524-a3cc-71ee364f44a2 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:20.746332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2188979-f2e1-4524-a3cc-71ee364f44a2 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:20.746623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2188979-f2e1-4524-a3cc-71ee364f44a2 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] PATH_INFO: `/v3/OS-TRUST/trusts/cbbac27fc19b41709d22cb6a7a4bd231` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:20.753703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2188979-f2e1-4524-a3cc-71ee364f44a2 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: Authorizing `identity:delete_trust(trust_id=cbbac27fc19b41709d22cb6a7a4bd231)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:20.755153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2188979-f2e1-4524-a3cc-71ee364f44a2 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:20.778101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2188979-f2e1-4524-a3cc-71ee364f44a2 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'cbbac27fc19b41709d22cb6a7a4bd231', 'request_id': 'req-c2188979-f2e1-4524-a3cc-71ee364f44a2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:20.789963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2188979-f2e1-4524-a3cc-71ee364f44a2 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'cbbac27fc19b41709d22cb6a7a4bd231', 'request_id': 'req-c2188979-f2e1-4524-a3cc-71ee364f44a2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:20.791025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2188979-f2e1-4524-a3cc-71ee364f44a2 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'cbbac27fc19b41709d22cb6a7a4bd231', 'request_id': 'req-c2188979-f2e1-4524-a3cc-71ee364f44a2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:20.798962 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2288/4621] 10.222.0.43 () {58 vars in 1253 bytes} [Sat Jul 2 21:16:20 2022] DELETE /identity/v3/OS-TRUST/trusts/cbbac27fc19b41709d22cb6a7a4bd231 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:16:20.803557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed34f39-657a-4688-825a-6be6685dcb9a tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:20.805374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9ed34f39-657a-4688-825a-6be6685dcb9a tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:20.827075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed34f39-657a-4688-825a-6be6685dcb9a tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:20.831867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd647d-df4c-4d56-a172-4e4bfc9b9fe4 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ecd1906908d4381a5057c87b0b15ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c62d3db90f1e4a84b86bb11a59165cab', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-132851006', 'tempest-NotDelegatedRole-2074016586'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:20.833120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd647d-df4c-4d56-a172-4e4bfc9b9fe4 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:20.833508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd647d-df4c-4d56-a172-4e4bfc9b9fe4 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:20.833909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd647d-df4c-4d56-a172-4e4bfc9b9fe4 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] PATH_INFO: `/v3/OS-TRUST/trusts/cbbac27fc19b41709d22cb6a7a4bd231` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:20.848379 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-cdfd647d-df4c-4d56-a172-4e4bfc9b9fe4 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Could not find trust: cbbac27fc19b41709d22cb6a7a4bd231.: keystone.exception.TrustNotFound: Could not find trust: cbbac27fc19b41709d22cb6a7a4bd231. Jul 02 21:16:20.848379 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:16:20.848379 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:16:20.848379 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:16:20.848379 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:16:20.848379 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:16:20.848379 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:16:20.848379 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:16:20.848379 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:16:20.848379 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:16:20.848379 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:16:20.848379 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:16:20.848379 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 02 21:16:20.848379 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 02 21:16:20.848379 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 02 21:16:20.849800 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 02 21:16:20.849800 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 02 21:16:20.849800 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 02 21:16:20.849800 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 02 21:16:20.849800 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 02 21:16:20.849800 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:16:20.849800 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:16:20.849800 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 02 21:16:20.849800 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 02 21:16:20.849800 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 02 21:16:20.849800 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 02 21:16:20.849800 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: cbbac27fc19b41709d22cb6a7a4bd231. Jul 02 21:16:20.849800 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:16:20.852010 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2334/4622] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:16:20 2022] GET /identity/v3/OS-TRUST/trusts/cbbac27fc19b41709d22cb6a7a4bd231 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 02 21:16:20.864582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2188979-f2e1-4524-a3cc-71ee364f44a2 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:20.867296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c2188979-f2e1-4524-a3cc-71ee364f44a2 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:20.889982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2188979-f2e1-4524-a3cc-71ee364f44a2 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:20.895675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652facc-8607-4519-9141-faadeb7f3694 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:20.896801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652facc-8607-4519-9141-faadeb7f3694 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:20.897092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652facc-8607-4519-9141-faadeb7f3694 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:20.897362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652facc-8607-4519-9141-faadeb7f3694 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles/37f33d97b0934f309b2e867f0625077f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:20.899656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652facc-8607-4519-9141-faadeb7f3694 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_role(role_id=37f33d97b0934f309b2e867f0625077f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:20.901334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652facc-8607-4519-9141-faadeb7f3694 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:20.959389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2652facc-8607-4519-9141-faadeb7f3694 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invalidating the token cache because role 37f33d97b0934f309b2e867f0625077f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:20.959758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2652facc-8607-4519-9141-faadeb7f3694 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:20.961066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2652facc-8607-4519-9141-faadeb7f3694 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:20.962636 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2289/4623] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:20 2022] DELETE /identity/v3/roles/37f33d97b0934f309b2e867f0625077f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:20.966688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd647d-df4c-4d56-a172-4e4bfc9b9fe4 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:20.969057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cdfd647d-df4c-4d56-a172-4e4bfc9b9fe4 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:20.987719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd647d-df4c-4d56-a172-4e4bfc9b9fe4 tempest-TrustsV3TestJSON-637585089 tempest-user-1583479276] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:21.055036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:21.083446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29d29d-4481-4289-9b72-dc07d6491fbf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:21.084634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29d29d-4481-4289-9b72-dc07d6491fbf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:21.084924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29d29d-4481-4289-9b72-dc07d6491fbf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:21.085211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29d29d-4481-4289-9b72-dc07d6491fbf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/roles/71d0f0d6c5274cd787486ba7acd03d68` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:21.086847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29d29d-4481-4289-9b72-dc07d6491fbf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_role(role_id=71d0f0d6c5274cd787486ba7acd03d68)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:21.088608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29d29d-4481-4289-9b72-dc07d6491fbf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:21.135435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6d29d29d-4481-4289-9b72-dc07d6491fbf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invalidating the token cache because role 71d0f0d6c5274cd787486ba7acd03d68 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:21.135956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6d29d29d-4481-4289-9b72-dc07d6491fbf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:21.136720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6d29d29d-4481-4289-9b72-dc07d6491fbf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:21.138939 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2335/4624] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:20 2022] DELETE /identity/v3/roles/71d0f0d6c5274cd787486ba7acd03d68 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:21.143294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652facc-8607-4519-9141-faadeb7f3694 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:21.155314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652facc-8607-4519-9141-faadeb7f3694 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:21.227680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a3010-7629-407f-ae5d-8f1e7ae3d3cb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:21.228628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a3010-7629-407f-ae5d-8f1e7ae3d3cb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:21.228896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a3010-7629-407f-ae5d-8f1e7ae3d3cb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:21.229169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a3010-7629-407f-ae5d-8f1e7ae3d3cb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/users/3ecd1906908d4381a5057c87b0b15ba5` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:21.230431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a3010-7629-407f-ae5d-8f1e7ae3d3cb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3ecd1906908d4381a5057c87b0b15ba5)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:21.232408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a3010-7629-407f-ae5d-8f1e7ae3d3cb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:21.274388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=9 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:21.287122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-115a3010-7629-407f-ae5d-8f1e7ae3d3cb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ecd1906908d4381a5057c87b0b15ba5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:21.298197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-115a3010-7629-407f-ae5d-8f1e7ae3d3cb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ecd1906908d4381a5057c87b0b15ba5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:21.307896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-115a3010-7629-407f-ae5d-8f1e7ae3d3cb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ecd1906908d4381a5057c87b0b15ba5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:21.310720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-115a3010-7629-407f-ae5d-8f1e7ae3d3cb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ecd1906908d4381a5057c87b0b15ba5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:21.310720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-115a3010-7629-407f-ae5d-8f1e7ae3d3cb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ecd1906908d4381a5057c87b0b15ba5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:21.333694 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2290/4625] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:21 2022] DELETE /identity/v3/users/3ecd1906908d4381a5057c87b0b15ba5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:21.338349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29d29d-4481-4289-9b72-dc07d6491fbf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:21.340945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6d29d29d-4481-4289-9b72-dc07d6491fbf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:21.356480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29d29d-4481-4289-9b72-dc07d6491fbf tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:21.421729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a30bc6-35b7-4e4f-a278-14aa463c18f1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dafe2316bae433f9749f352f43e2e2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9296a4871349e3982edf61dfc2686c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:21.422614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a30bc6-35b7-4e4f-a278-14aa463c18f1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:21.423057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a30bc6-35b7-4e4f-a278-14aa463c18f1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:21.423500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a30bc6-35b7-4e4f-a278-14aa463c18f1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] PATH_INFO: `/v3/projects/c62d3db90f1e4a84b86bb11a59165cab` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:21.424738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a30bc6-35b7-4e4f-a278-14aa463c18f1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c62d3db90f1e4a84b86bb11a59165cab)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:21.426665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a30bc6-35b7-4e4f-a278-14aa463c18f1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:21.487669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d0a30bc6-35b7-4e4f-a278-14aa463c18f1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c62d3db90f1e4a84b86bb11a59165cab', 'request_id': 'req-d0a30bc6-35b7-4e4f-a278-14aa463c18f1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:21.492099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d0a30bc6-35b7-4e4f-a278-14aa463c18f1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c62d3db90f1e4a84b86bb11a59165cab', 'request_id': 'req-d0a30bc6-35b7-4e4f-a278-14aa463c18f1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:21.499806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d0a30bc6-35b7-4e4f-a278-14aa463c18f1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c62d3db90f1e4a84b86bb11a59165cab', 'request_id': 'req-d0a30bc6-35b7-4e4f-a278-14aa463c18f1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:21.510277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d0a30bc6-35b7-4e4f-a278-14aa463c18f1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] The token cache is being invalidate because project c62d3db90f1e4a84b86bb11a59165cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:21.510567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d0a30bc6-35b7-4e4f-a278-14aa463c18f1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:21.511218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d0a30bc6-35b7-4e4f-a278-14aa463c18f1 tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:21.513140 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2336/4626] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:21 2022] DELETE /identity/v3/projects/c62d3db90f1e4a84b86bb11a59165cab => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:21.519684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a3010-7629-407f-ae5d-8f1e7ae3d3cb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:21.521477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-115a3010-7629-407f-ae5d-8f1e7ae3d3cb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:21.596326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a3010-7629-407f-ae5d-8f1e7ae3d3cb tempest-TrustsV3TestJSON-163879424 tempest-TrustsV3TestJSON-163879424-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:21.669995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5c2b4-5655-48b7-b930-035ab15bc822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:21.670981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5c2b4-5655-48b7-b930-035ab15bc822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:21.671418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5c2b4-5655-48b7-b930-035ab15bc822 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:21.671888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5c2b4-5655-48b7-b930-035ab15bc822 admin admin] PATH_INFO: `/v3/users/d2eded4ff6ca4ec09597f3123b6cea26` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:21.673660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5c2b4-5655-48b7-b930-035ab15bc822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2eded4ff6ca4ec09597f3123b6cea26)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:21.675966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5c2b4-5655-48b7-b930-035ab15bc822 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:21.751595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bed5c2b4-5655-48b7-b930-035ab15bc822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2eded4ff6ca4ec09597f3123b6cea26'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:21.762483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bed5c2b4-5655-48b7-b930-035ab15bc822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2eded4ff6ca4ec09597f3123b6cea26'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:21.771620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bed5c2b4-5655-48b7-b930-035ab15bc822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2eded4ff6ca4ec09597f3123b6cea26'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:21.772715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bed5c2b4-5655-48b7-b930-035ab15bc822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2eded4ff6ca4ec09597f3123b6cea26'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:21.773549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bed5c2b4-5655-48b7-b930-035ab15bc822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2eded4ff6ca4ec09597f3123b6cea26'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:21.775016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:21.799151 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2291/4627] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:21 2022] DELETE /identity/v3/users/d2eded4ff6ca4ec09597f3123b6cea26 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:21.805073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74238869-8b1d-4373-85f9-16cf5585d4a9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:21.806039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74238869-8b1d-4373-85f9-16cf5585d4a9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:21.806546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74238869-8b1d-4373-85f9-16cf5585d4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:21.832253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-74238869-8b1d-4373-85f9-16cf5585d4a9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:21.833605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-74238869-8b1d-4373-85f9-16cf5585d4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:21.873135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:21.922693 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2337/4628] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:21.933665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5c2b4-5655-48b7-b930-035ab15bc822 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:21.935402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bed5c2b4-5655-48b7-b930-035ab15bc822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:22.003748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5c2b4-5655-48b7-b930-035ab15bc822 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:22.008197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43346fd0-b59b-4d6c-a0f7-1fdbc11b774e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:22.008916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43346fd0-b59b-4d6c-a0f7-1fdbc11b774e service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:22.009257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43346fd0-b59b-4d6c-a0f7-1fdbc11b774e service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:22.009592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43346fd0-b59b-4d6c-a0f7-1fdbc11b774e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:22.020199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43346fd0-b59b-4d6c-a0f7-1fdbc11b774e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:22.021727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43346fd0-b59b-4d6c-a0f7-1fdbc11b774e service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:22.031982 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2292/4629] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:22.351063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74238869-8b1d-4373-85f9-16cf5585d4a9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:22.353109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-74238869-8b1d-4373-85f9-16cf5585d4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:22.369997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74238869-8b1d-4373-85f9-16cf5585d4a9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:22.375516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf32d9-851b-4f5b-94e9-fc8d3ae11df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:22.376751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf32d9-851b-4f5b-94e9-fc8d3ae11df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:22.377026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf32d9-851b-4f5b-94e9-fc8d3ae11df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:22.377258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf32d9-851b-4f5b-94e9-fc8d3ae11df3 admin admin] PATH_INFO: `/v3/projects/5eadd8cc917044fc94ad068f3897543d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:22.378444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf32d9-851b-4f5b-94e9-fc8d3ae11df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eadd8cc917044fc94ad068f3897543d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:22.380399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf32d9-851b-4f5b-94e9-fc8d3ae11df3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:22.429700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c3bf32d9-851b-4f5b-94e9-fc8d3ae11df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eadd8cc917044fc94ad068f3897543d', 'request_id': 'req-c3bf32d9-851b-4f5b-94e9-fc8d3ae11df3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:22.437392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c3bf32d9-851b-4f5b-94e9-fc8d3ae11df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eadd8cc917044fc94ad068f3897543d', 'request_id': 'req-c3bf32d9-851b-4f5b-94e9-fc8d3ae11df3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:22.443791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c3bf32d9-851b-4f5b-94e9-fc8d3ae11df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eadd8cc917044fc94ad068f3897543d', 'request_id': 'req-c3bf32d9-851b-4f5b-94e9-fc8d3ae11df3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:22.455131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c3bf32d9-851b-4f5b-94e9-fc8d3ae11df3 admin admin] The token cache is being invalidate because project 5eadd8cc917044fc94ad068f3897543d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:22.455421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c3bf32d9-851b-4f5b-94e9-fc8d3ae11df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:22.456175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c3bf32d9-851b-4f5b-94e9-fc8d3ae11df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:22.457912 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2338/4630] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:22 2022] DELETE /identity/v3/projects/5eadd8cc917044fc94ad068f3897543d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:22.462148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43346fd0-b59b-4d6c-a0f7-1fdbc11b774e service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:22.473626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43346fd0-b59b-4d6c-a0f7-1fdbc11b774e service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:22.545351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e53b2-686e-41f5-8032-f70746201c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:22.546285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e53b2-686e-41f5-8032-f70746201c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:22.546606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e53b2-686e-41f5-8032-f70746201c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:22.546979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e53b2-686e-41f5-8032-f70746201c30 admin admin] PATH_INFO: `/v3/users/6dafe2316bae433f9749f352f43e2e2f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:22.548865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e53b2-686e-41f5-8032-f70746201c30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dafe2316bae433f9749f352f43e2e2f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:22.551021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e53b2-686e-41f5-8032-f70746201c30 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:22.610477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c17e53b2-686e-41f5-8032-f70746201c30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dafe2316bae433f9749f352f43e2e2f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:22.621923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c17e53b2-686e-41f5-8032-f70746201c30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dafe2316bae433f9749f352f43e2e2f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:22.631137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c17e53b2-686e-41f5-8032-f70746201c30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dafe2316bae433f9749f352f43e2e2f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:22.631841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c17e53b2-686e-41f5-8032-f70746201c30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dafe2316bae433f9749f352f43e2e2f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:22.632477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c17e53b2-686e-41f5-8032-f70746201c30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dafe2316bae433f9749f352f43e2e2f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:22.650202 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2293/4631] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:22 2022] DELETE /identity/v3/users/6dafe2316bae433f9749f352f43e2e2f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:22.948656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf32d9-851b-4f5b-94e9-fc8d3ae11df3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:22.950969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c3bf32d9-851b-4f5b-94e9-fc8d3ae11df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:22.976070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf32d9-851b-4f5b-94e9-fc8d3ae11df3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:23.051365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bea301-de2e-4f59-aa5c-fcc8658e5be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:23.054222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bea301-de2e-4f59-aa5c-fcc8658e5be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:23.054537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bea301-de2e-4f59-aa5c-fcc8658e5be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:23.054993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bea301-de2e-4f59-aa5c-fcc8658e5be8 admin admin] PATH_INFO: `/v3/projects/4d9296a4871349e3982edf61dfc2686c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:23.056387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bea301-de2e-4f59-aa5c-fcc8658e5be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9296a4871349e3982edf61dfc2686c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:23.058411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bea301-de2e-4f59-aa5c-fcc8658e5be8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:23.128680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a1bea301-de2e-4f59-aa5c-fcc8658e5be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9296a4871349e3982edf61dfc2686c', 'request_id': 'req-a1bea301-de2e-4f59-aa5c-fcc8658e5be8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:23.137434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a1bea301-de2e-4f59-aa5c-fcc8658e5be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9296a4871349e3982edf61dfc2686c', 'request_id': 'req-a1bea301-de2e-4f59-aa5c-fcc8658e5be8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:23.144360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a1bea301-de2e-4f59-aa5c-fcc8658e5be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9296a4871349e3982edf61dfc2686c', 'request_id': 'req-a1bea301-de2e-4f59-aa5c-fcc8658e5be8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:23.145822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:23.164731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a1bea301-de2e-4f59-aa5c-fcc8658e5be8 admin admin] The token cache is being invalidate because project 4d9296a4871349e3982edf61dfc2686c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:23.165162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a1bea301-de2e-4f59-aa5c-fcc8658e5be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:23.165906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a1bea301-de2e-4f59-aa5c-fcc8658e5be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:23.168090 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2339/4632] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:22 2022] DELETE /identity/v3/projects/4d9296a4871349e3982edf61dfc2686c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:23.172833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30184205-7257-4a47-82e7-022bc6593bff None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:23.173126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30184205-7257-4a47-82e7-022bc6593bff None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:23.173402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30184205-7257-4a47-82e7-022bc6593bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:23.180560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:23.197224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-30184205-7257-4a47-82e7-022bc6593bff None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:23.199591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-30184205-7257-4a47-82e7-022bc6593bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:23.265988 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2294/4633] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:16:23.274060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a63992-3066-49c4-8653-be9d958038e0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:23.274341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a63992-3066-49c4-8653-be9d958038e0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:23.274615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a63992-3066-49c4-8653-be9d958038e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:23.293486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-34a63992-3066-49c4-8653-be9d958038e0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:23.295121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-34a63992-3066-49c4-8653-be9d958038e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:23.306236 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2340/4634] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:23.310839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30184205-7257-4a47-82e7-022bc6593bff None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:23.321858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30184205-7257-4a47-82e7-022bc6593bff None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:23.327199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904904ab-4ee3-447e-891e-21f02b520c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:23.328131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904904ab-4ee3-447e-891e-21f02b520c08 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:23.328453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904904ab-4ee3-447e-891e-21f02b520c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:23.328828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904904ab-4ee3-447e-891e-21f02b520c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:23.329717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904904ab-4ee3-447e-891e-21f02b520c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:16:23.330026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904904ab-4ee3-447e-891e-21f02b520c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:23.332667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904904ab-4ee3-447e-891e-21f02b520c08 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:23.351557 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2295/4635] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:23.353002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a63992-3066-49c4-8653-be9d958038e0 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:23.364966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a63992-3066-49c4-8653-be9d958038e0 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:23.370389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d5d3f-d967-4844-b086-ba3037ff68a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:23.371056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d5d3f-d967-4844-b086-ba3037ff68a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:23.371340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d5d3f-d967-4844-b086-ba3037ff68a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:23.371612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d5d3f-d967-4844-b086-ba3037ff68a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:23.372389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d5d3f-d967-4844-b086-ba3037ff68a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:23.374311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d5d3f-d967-4844-b086-ba3037ff68a0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:23.406376 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2341/4636] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:23 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:23.407607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904904ab-4ee3-447e-891e-21f02b520c08 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:23.418392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904904ab-4ee3-447e-891e-21f02b520c08 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:23.475368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8a874-bc7a-45a3-944a-809dcce20bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:23.476121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8a874-bc7a-45a3-944a-809dcce20bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:23.476450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8a874-bc7a-45a3-944a-809dcce20bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:23.476756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8a874-bc7a-45a3-944a-809dcce20bf9 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:23.477446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8a874-bc7a-45a3-944a-809dcce20bf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:23.479373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8a874-bc7a-45a3-944a-809dcce20bf9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:23.502712 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2296/4637] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:23 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:23.507283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d5d3f-d967-4844-b086-ba3037ff68a0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:23.517986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d5d3f-d967-4844-b086-ba3037ff68a0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:23.524891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0315b1-f4f0-4762-8d98-280da58b6743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:23.525884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0315b1-f4f0-4762-8d98-280da58b6743 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:23.526287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0315b1-f4f0-4762-8d98-280da58b6743 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:23.526706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0315b1-f4f0-4762-8d98-280da58b6743 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:23.527904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0315b1-f4f0-4762-8d98-280da58b6743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:23.530189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0315b1-f4f0-4762-8d98-280da58b6743 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:23.545094 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2342/4638] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:23.549270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8a874-bc7a-45a3-944a-809dcce20bf9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:23.560167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8a874-bc7a-45a3-944a-809dcce20bf9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:23.566299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357373d-3b51-4c79-8ed8-2849d818ab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:23.566996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357373d-3b51-4c79-8ed8-2849d818ab14 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:23.567277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357373d-3b51-4c79-8ed8-2849d818ab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:23.567551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357373d-3b51-4c79-8ed8-2849d818ab14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:23.568318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357373d-3b51-4c79-8ed8-2849d818ab14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:23.569934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357373d-3b51-4c79-8ed8-2849d818ab14 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:23.581648 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2297/4639] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:23.585836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0315b1-f4f0-4762-8d98-280da58b6743 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:23.596662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0315b1-f4f0-4762-8d98-280da58b6743 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:23.602042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74276bba-7f99-4f31-b0a9-356a0fab4070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:23.602935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74276bba-7f99-4f31-b0a9-356a0fab4070 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:23.603219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74276bba-7f99-4f31-b0a9-356a0fab4070 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:23.603500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74276bba-7f99-4f31-b0a9-356a0fab4070 admin admin] PATH_INFO: `/v3/projects/531d44606b5f4cc0839cb08262a3d997/users/236f01edeebf460788068a287818c812/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:23.618600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74276bba-7f99-4f31-b0a9-356a0fab4070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=531d44606b5f4cc0839cb08262a3d997, user_id=236f01edeebf460788068a287818c812, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:23.621325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74276bba-7f99-4f31-b0a9-356a0fab4070 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:23.636105 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2343/4640] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:23 2022] PUT /identity/v3/projects/531d44606b5f4cc0839cb08262a3d997/users/236f01edeebf460788068a287818c812/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:23.646329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ec5e3-cd52-4d63-be70-b649a6a349e9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:23.646555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ec5e3-cd52-4d63-be70-b649a6a349e9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:23.646837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ec5e3-cd52-4d63-be70-b649a6a349e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:23.675427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-567ec5e3-cd52-4d63-be70-b649a6a349e9 None None] MFA Rules not processed for user `236f01edeebf460788068a287818c812`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:23.676683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-567ec5e3-cd52-4d63-be70-b649a6a349e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:23.740573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:23.746765 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2298/4641] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:23.751292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74276bba-7f99-4f31-b0a9-356a0fab4070 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:23.824160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74276bba-7f99-4f31-b0a9-356a0fab4070 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:23.829453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e3c29-830a-4eb8-a502-ca0dfd4b5431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:23.830688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e3c29-830a-4eb8-a502-ca0dfd4b5431 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:23.830688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e3c29-830a-4eb8-a502-ca0dfd4b5431 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:23.831140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e3c29-830a-4eb8-a502-ca0dfd4b5431 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:23.832106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e3c29-830a-4eb8-a502-ca0dfd4b5431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:23.834319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e3c29-830a-4eb8-a502-ca0dfd4b5431 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:23.870695 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2344/4642] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:23 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:16:23.875237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ec5e3-cd52-4d63-be70-b649a6a349e9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:23.888055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ec5e3-cd52-4d63-be70-b649a6a349e9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:23.983308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff49027-c37c-4230-8993-75ea2a85f26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:23.984047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff49027-c37c-4230-8993-75ea2a85f26a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:23.984392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff49027-c37c-4230-8993-75ea2a85f26a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:23.984843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff49027-c37c-4230-8993-75ea2a85f26a admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:23.985574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff49027-c37c-4230-8993-75ea2a85f26a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:23.988581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff49027-c37c-4230-8993-75ea2a85f26a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:24.014768 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2299/4643] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:23 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:24.016454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e3c29-830a-4eb8-a502-ca0dfd4b5431 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:24.030641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e3c29-830a-4eb8-a502-ca0dfd4b5431 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:24.036639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961656b8-b1b6-492b-a98c-0d96ac501ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:24.037311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961656b8-b1b6-492b-a98c-0d96ac501ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:24.037578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961656b8-b1b6-492b-a98c-0d96ac501ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:24.037855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961656b8-b1b6-492b-a98c-0d96ac501ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:24.038588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961656b8-b1b6-492b-a98c-0d96ac501ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:24.040279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961656b8-b1b6-492b-a98c-0d96ac501ff5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:24.057795 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2345/4644] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:24.061092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff49027-c37c-4230-8993-75ea2a85f26a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:24.071621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff49027-c37c-4230-8993-75ea2a85f26a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:24.076773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a2eb8-32c2-4e87-bc31-0b35c73e63c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:24.078041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a2eb8-32c2-4e87-bc31-0b35c73e63c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:24.079323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a2eb8-32c2-4e87-bc31-0b35c73e63c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:24.079870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a2eb8-32c2-4e87-bc31-0b35c73e63c9 admin admin] PATH_INFO: `/v3/projects/35cfc95f22fe49b3a418e3b9a59eb8cf/users/de0376f3dac247d786877b25fed45ee1/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:24.097690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a2eb8-32c2-4e87-bc31-0b35c73e63c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35cfc95f22fe49b3a418e3b9a59eb8cf, user_id=de0376f3dac247d786877b25fed45ee1, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:24.099952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a2eb8-32c2-4e87-bc31-0b35c73e63c9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:24.115901 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2300/4645] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:24 2022] PUT /identity/v3/projects/35cfc95f22fe49b3a418e3b9a59eb8cf/users/de0376f3dac247d786877b25fed45ee1/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:16:24.120297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961656b8-b1b6-492b-a98c-0d96ac501ff5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:24.130458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961656b8-b1b6-492b-a98c-0d96ac501ff5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:24.191799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3713f9-fde6-41aa-b4ef-54957999eed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:24.192508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3713f9-fde6-41aa-b4ef-54957999eed5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:24.192794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3713f9-fde6-41aa-b4ef-54957999eed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:24.193079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3713f9-fde6-41aa-b4ef-54957999eed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:24.193803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3713f9-fde6-41aa-b4ef-54957999eed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:24.195447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3713f9-fde6-41aa-b4ef-54957999eed5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:24.197062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:24.207039 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2346/4646] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:24.217126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a2eb8-32c2-4e87-bc31-0b35c73e63c9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:24.231901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a2eb8-32c2-4e87-bc31-0b35c73e63c9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:24.237819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e679050-a793-4ccb-8dc5-e11ec26fdf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:24.238727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e679050-a793-4ccb-8dc5-e11ec26fdf37 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:24.238989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e679050-a793-4ccb-8dc5-e11ec26fdf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:24.239783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e679050-a793-4ccb-8dc5-e11ec26fdf37 admin admin] PATH_INFO: `/v3/projects/35cfc95f22fe49b3a418e3b9a59eb8cf/users/de0376f3dac247d786877b25fed45ee1/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:24.249821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e679050-a793-4ccb-8dc5-e11ec26fdf37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35cfc95f22fe49b3a418e3b9a59eb8cf, user_id=de0376f3dac247d786877b25fed45ee1, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:24.252798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e679050-a793-4ccb-8dc5-e11ec26fdf37 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:24.266830 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2301/4647] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:24 2022] PUT /identity/v3/projects/35cfc95f22fe49b3a418e3b9a59eb8cf/users/de0376f3dac247d786877b25fed45ee1/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:24.278345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d07818-01cc-4ab6-af54-5ef418565557 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:24.278822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d07818-01cc-4ab6-af54-5ef418565557 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:24.279226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d07818-01cc-4ab6-af54-5ef418565557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:24.315093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d3d07818-01cc-4ab6-af54-5ef418565557 None None] MFA Rules not processed for user `de0376f3dac247d786877b25fed45ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:24.317151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d3d07818-01cc-4ab6-af54-5ef418565557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:24.432098 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2347/4648] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:24.434909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e679050-a793-4ccb-8dc5-e11ec26fdf37 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:24.445557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e679050-a793-4ccb-8dc5-e11ec26fdf37 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:24.450390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b46d6b-e0d1-49c5-b6e6-87ae9268b4bd tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de0376f3dac247d786877b25fed45ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35cfc95f22fe49b3a418e3b9a59eb8cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:24.451051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b46d6b-e0d1-49c5-b6e6-87ae9268b4bd tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:24.451333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b46d6b-e0d1-49c5-b6e6-87ae9268b4bd tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:24.451613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b46d6b-e0d1-49c5-b6e6-87ae9268b4bd tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:24.452342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b46d6b-e0d1-49c5-b6e6-87ae9268b4bd tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:24.454326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b46d6b-e0d1-49c5-b6e6-87ae9268b4bd tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:24.489071 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2302/4649] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:24 2022] POST /identity/v3/projects => generated 358 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:16:24.493430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d07818-01cc-4ab6-af54-5ef418565557 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:24.503164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d07818-01cc-4ab6-af54-5ef418565557 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:24.564727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada09ce-8fa7-4d7a-86aa-c981441ceae3 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de0376f3dac247d786877b25fed45ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35cfc95f22fe49b3a418e3b9a59eb8cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:24.565426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada09ce-8fa7-4d7a-86aa-c981441ceae3 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:24.565708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada09ce-8fa7-4d7a-86aa-c981441ceae3 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:24.565980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada09ce-8fa7-4d7a-86aa-c981441ceae3 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:24.566708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada09ce-8fa7-4d7a-86aa-c981441ceae3 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:24.568638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada09ce-8fa7-4d7a-86aa-c981441ceae3 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:24.595374 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2348/4650] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:24 2022] POST /identity/v3/users => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:24.599972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b46d6b-e0d1-49c5-b6e6-87ae9268b4bd tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:24.611986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b46d6b-e0d1-49c5-b6e6-87ae9268b4bd tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:24.617999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921b6ef-9182-4a47-9b87-7ac0d45c818c tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de0376f3dac247d786877b25fed45ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35cfc95f22fe49b3a418e3b9a59eb8cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:24.618783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b6ef-9182-4a47-9b87-7ac0d45c818c tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:24.619062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b6ef-9182-4a47-9b87-7ac0d45c818c tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:24.619335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b6ef-9182-4a47-9b87-7ac0d45c818c tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:24.620171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921b6ef-9182-4a47-9b87-7ac0d45c818c tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:16:24.620479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921b6ef-9182-4a47-9b87-7ac0d45c818c tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:24.622597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921b6ef-9182-4a47-9b87-7ac0d45c818c tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:24.658775 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2303/4651] 10.222.0.43 () {58 vars in 1156 bytes} [Sat Jul 2 21:16:24 2022] GET /identity/v3/users?domain_id=default => generated 8572 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:24.664077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada09ce-8fa7-4d7a-86aa-c981441ceae3 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:24.676243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada09ce-8fa7-4d7a-86aa-c981441ceae3 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:24.681780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29fdce-63a5-4dfc-9472-c0e185b73332 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de0376f3dac247d786877b25fed45ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35cfc95f22fe49b3a418e3b9a59eb8cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:24.682860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29fdce-63a5-4dfc-9472-c0e185b73332 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:24.683081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29fdce-63a5-4dfc-9472-c0e185b73332 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:24.683529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29fdce-63a5-4dfc-9472-c0e185b73332 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] PATH_INFO: `/v3/users/7f333d9d17504377bd95d2cfeffecab7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:24.702743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29fdce-63a5-4dfc-9472-c0e185b73332 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: Authorizing `identity:update_user(user_id=7f333d9d17504377bd95d2cfeffecab7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:24.705096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29fdce-63a5-4dfc-9472-c0e185b73332 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:24.744816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ee29fdce-63a5-4dfc-9472-c0e185b73332 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7f333d9d17504377bd95d2cfeffecab7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:24.754371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ee29fdce-63a5-4dfc-9472-c0e185b73332 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Invalidating the token cache because user 7f333d9d17504377bd95d2cfeffecab7 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:24.754698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ee29fdce-63a5-4dfc-9472-c0e185b73332 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:24.755394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ee29fdce-63a5-4dfc-9472-c0e185b73332 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:24.757705 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2349/4652] 10.222.0.43 () {60 vars in 1243 bytes} [Sat Jul 2 21:16:24 2022] PATCH /identity/v3/users/7f333d9d17504377bd95d2cfeffecab7 => generated 485 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:24.763508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedd3fa-0900-4bf7-9b1e-6b3bb9edd5d6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:24.763853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedd3fa-0900-4bf7-9b1e-6b3bb9edd5d6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:24.764287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedd3fa-0900-4bf7-9b1e-6b3bb9edd5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:24.780542 ncdv-master-1 devstack@keystone.service[91077]: WARNING keystone.auth.plugins.core [None req-4cedd3fa-0900-4bf7-9b1e-6b3bb9edd5d6 None None] User is disabled: 7f333d9d17504377bd95d2cfeffecab7: AssertionError: User is disabled: 7f333d9d17504377bd95d2cfeffecab7 Jul 02 21:16:24.796194 ncdv-master-1 devstack@keystone.service[91077]: WARNING keystone.server.flask.application [None req-4cedd3fa-0900-4bf7-9b1e-6b3bb9edd5d6 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.43: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 02 21:16:24.797650 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2304/4653] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:24 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 36 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 02 21:16:24.801930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29fdce-63a5-4dfc-9472-c0e185b73332 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:24.804191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ee29fdce-63a5-4dfc-9472-c0e185b73332 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:24.818088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29fdce-63a5-4dfc-9472-c0e185b73332 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:24.823245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0183e-4d8a-474f-98fd-e7ba094e3cce tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de0376f3dac247d786877b25fed45ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35cfc95f22fe49b3a418e3b9a59eb8cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:24.824212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0183e-4d8a-474f-98fd-e7ba094e3cce tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:24.824494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0183e-4d8a-474f-98fd-e7ba094e3cce tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:24.824851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0183e-4d8a-474f-98fd-e7ba094e3cce tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] PATH_INFO: `/v3/users/7f333d9d17504377bd95d2cfeffecab7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:24.839523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0183e-4d8a-474f-98fd-e7ba094e3cce tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7f333d9d17504377bd95d2cfeffecab7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:24.841539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0183e-4d8a-474f-98fd-e7ba094e3cce tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:24.854376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:24.887392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-78e0183e-4d8a-474f-98fd-e7ba094e3cce tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f333d9d17504377bd95d2cfeffecab7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:24.896632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-78e0183e-4d8a-474f-98fd-e7ba094e3cce tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f333d9d17504377bd95d2cfeffecab7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:24.897452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-78e0183e-4d8a-474f-98fd-e7ba094e3cce tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f333d9d17504377bd95d2cfeffecab7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:24.898349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-78e0183e-4d8a-474f-98fd-e7ba094e3cce tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f333d9d17504377bd95d2cfeffecab7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:24.905890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-78e0183e-4d8a-474f-98fd-e7ba094e3cce tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f333d9d17504377bd95d2cfeffecab7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:24.925250 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2350/4654] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:24 2022] DELETE /identity/v3/users/7f333d9d17504377bd95d2cfeffecab7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:24.930149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedd3fa-0900-4bf7-9b1e-6b3bb9edd5d6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:24.933709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4cedd3fa-0900-4bf7-9b1e-6b3bb9edd5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:25.003823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedd3fa-0900-4bf7-9b1e-6b3bb9edd5d6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:25.008540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bc2a7-0953-4930-bc3b-f018c0ecf2a9 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de0376f3dac247d786877b25fed45ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35cfc95f22fe49b3a418e3b9a59eb8cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:25.009423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bc2a7-0953-4930-bc3b-f018c0ecf2a9 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:25.009697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bc2a7-0953-4930-bc3b-f018c0ecf2a9 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:25.009964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bc2a7-0953-4930-bc3b-f018c0ecf2a9 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] PATH_INFO: `/v3/projects/fc5b1f6e624f4bd2bcd86a58c9b28ed1` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:25.011162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2bc2a7-0953-4930-bc3b-f018c0ecf2a9 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fc5b1f6e624f4bd2bcd86a58c9b28ed1)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:25.013547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2bc2a7-0953-4930-bc3b-f018c0ecf2a9 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:25.031128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:25.072823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa2bc2a7-0953-4930-bc3b-f018c0ecf2a9 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc5b1f6e624f4bd2bcd86a58c9b28ed1', 'request_id': 'req-fa2bc2a7-0953-4930-bc3b-f018c0ecf2a9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:25.087036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa2bc2a7-0953-4930-bc3b-f018c0ecf2a9 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc5b1f6e624f4bd2bcd86a58c9b28ed1', 'request_id': 'req-fa2bc2a7-0953-4930-bc3b-f018c0ecf2a9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:25.098687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa2bc2a7-0953-4930-bc3b-f018c0ecf2a9 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc5b1f6e624f4bd2bcd86a58c9b28ed1', 'request_id': 'req-fa2bc2a7-0953-4930-bc3b-f018c0ecf2a9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:25.119489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa2bc2a7-0953-4930-bc3b-f018c0ecf2a9 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] The token cache is being invalidate because project fc5b1f6e624f4bd2bcd86a58c9b28ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:25.119992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa2bc2a7-0953-4930-bc3b-f018c0ecf2a9 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:25.120728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa2bc2a7-0953-4930-bc3b-f018c0ecf2a9 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:25.122381 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2305/4655] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:24 2022] DELETE /identity/v3/projects/fc5b1f6e624f4bd2bcd86a58c9b28ed1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:25.128368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0183e-4d8a-474f-98fd-e7ba094e3cce tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:25.139682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0183e-4d8a-474f-98fd-e7ba094e3cce tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:25.207837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d8ced-d342-4539-ac6a-b00256be1c31 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de0376f3dac247d786877b25fed45ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35cfc95f22fe49b3a418e3b9a59eb8cf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:25.208496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d8ced-d342-4539-ac6a-b00256be1c31 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:25.208781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d8ced-d342-4539-ac6a-b00256be1c31 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:25.209062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d8ced-d342-4539-ac6a-b00256be1c31 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:25.209785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d8ced-d342-4539-ac6a-b00256be1c31 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:25.211818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d8ced-d342-4539-ac6a-b00256be1c31 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:25.225079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-f01d8ced-d342-4539-ac6a-b00256be1c31 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Could not find domain: 9d4a8cb1e6e043bb91fa686d26ac4f9c.: keystone.exception.DomainNotFound: Could not find domain: 9d4a8cb1e6e043bb91fa686d26ac4f9c. Jul 02 21:16:25.225079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:16:25.225079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 21:16:25.225079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 21:16:25.225079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:16:25.225079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:16:25.225079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:16:25.225079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:16:25.225079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9d4a8cb1e6e043bb91fa686d26ac4f9c. Jul 02 21:16:25.225079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:16:25.225079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:16:25.225079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:16:25.225079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:16:25.225079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:16:25.225079 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:16:25.226432 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:16:25.226432 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:16:25.226432 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:16:25.226432 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:16:25.226432 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:16:25.226432 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:16:25.226432 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:16:25.226432 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:16:25.226432 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 02 21:16:25.226432 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 02 21:16:25.226432 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:16:25.226432 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:16:25.226432 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 21:16:25.226432 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 21:16:25.226432 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 21:16:25.226432 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 21:16:25.226432 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Jul 02 21:16:25.227873 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Jul 02 21:16:25.227873 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:16:25.227873 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:16:25.227873 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:16:25.227873 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:16:25.227873 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:16:25.227873 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:16:25.227873 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:16:25.227873 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 21:16:25.227873 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:16:25.227873 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:16:25.227873 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:16:25.227873 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:16:25.227873 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:16:25.227873 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:16:25.227873 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:16:25.227873 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:16:25.229333 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 21:16:25.229333 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 21:16:25.229333 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9d4a8cb1e6e043bb91fa686d26ac4f9c. Jul 02 21:16:25.229333 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:16:25.229333 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2351/4656] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:25 2022] POST /identity/v3/users => generated 112 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:16:25.231152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bc2a7-0953-4930-bc3b-f018c0ecf2a9 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:25.232594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fa2bc2a7-0953-4930-bc3b-f018c0ecf2a9 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:25.322380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bc2a7-0953-4930-bc3b-f018c0ecf2a9 tempest-UsersNegativeTest-1181161370 tempest-UsersNegativeTest-1181161370-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:25.327749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa448825-e30f-4482-97ba-89b346392499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:25.328909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa448825-e30f-4482-97ba-89b346392499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:25.329187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa448825-e30f-4482-97ba-89b346392499 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:25.329462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa448825-e30f-4482-97ba-89b346392499 admin admin] PATH_INFO: `/v3/users/236f01edeebf460788068a287818c812` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:25.330829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa448825-e30f-4482-97ba-89b346392499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=236f01edeebf460788068a287818c812)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:25.333151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa448825-e30f-4482-97ba-89b346392499 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:25.400745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa448825-e30f-4482-97ba-89b346392499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236f01edeebf460788068a287818c812'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:25.411608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa448825-e30f-4482-97ba-89b346392499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236f01edeebf460788068a287818c812'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:25.420883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa448825-e30f-4482-97ba-89b346392499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236f01edeebf460788068a287818c812'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:25.421969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa448825-e30f-4482-97ba-89b346392499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236f01edeebf460788068a287818c812'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:25.422872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa448825-e30f-4482-97ba-89b346392499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236f01edeebf460788068a287818c812'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:25.445116 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2306/4657] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:25 2022] DELETE /identity/v3/users/236f01edeebf460788068a287818c812 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:25.449734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546be0e-52e1-4c10-8891-35a59095f3da None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:25.450127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546be0e-52e1-4c10-8891-35a59095f3da None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:25.450279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546be0e-52e1-4c10-8891-35a59095f3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:25.471859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c546be0e-52e1-4c10-8891-35a59095f3da None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:25.473057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c546be0e-52e1-4c10-8891-35a59095f3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:25.547564 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2352/4658] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:25.558981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa448825-e30f-4482-97ba-89b346392499 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:25.560580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fa448825-e30f-4482-97ba-89b346392499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:25.584286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:25.631138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa448825-e30f-4482-97ba-89b346392499 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:25.635557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3aebb-3cbf-43ae-85c5-9292d446e020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:25.636450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3aebb-3cbf-43ae-85c5-9292d446e020 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:25.636726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3aebb-3cbf-43ae-85c5-9292d446e020 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:25.636998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3aebb-3cbf-43ae-85c5-9292d446e020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:25.647916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3aebb-3cbf-43ae-85c5-9292d446e020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:25.649954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3aebb-3cbf-43ae-85c5-9292d446e020 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:25.660819 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2307/4659] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:25.947159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546be0e-52e1-4c10-8891-35a59095f3da None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:25.949702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c546be0e-52e1-4c10-8891-35a59095f3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:25.968675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546be0e-52e1-4c10-8891-35a59095f3da None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:25.974795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5600eb-4786-457a-8935-12f9d8115e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:25.975939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5600eb-4786-457a-8935-12f9d8115e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:25.976256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5600eb-4786-457a-8935-12f9d8115e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:25.976535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5600eb-4786-457a-8935-12f9d8115e93 admin admin] PATH_INFO: `/v3/projects/531d44606b5f4cc0839cb08262a3d997` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:25.977939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5600eb-4786-457a-8935-12f9d8115e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=531d44606b5f4cc0839cb08262a3d997)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:25.980303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5600eb-4786-457a-8935-12f9d8115e93 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:26.019819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:26.046791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4e5600eb-4786-457a-8935-12f9d8115e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '531d44606b5f4cc0839cb08262a3d997', 'request_id': 'req-4e5600eb-4786-457a-8935-12f9d8115e93'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:26.057434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4e5600eb-4786-457a-8935-12f9d8115e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '531d44606b5f4cc0839cb08262a3d997', 'request_id': 'req-4e5600eb-4786-457a-8935-12f9d8115e93'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:26.065382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4e5600eb-4786-457a-8935-12f9d8115e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '531d44606b5f4cc0839cb08262a3d997', 'request_id': 'req-4e5600eb-4786-457a-8935-12f9d8115e93'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:26.078161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4e5600eb-4786-457a-8935-12f9d8115e93 admin admin] The token cache is being invalidate because project 531d44606b5f4cc0839cb08262a3d997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:26.078161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4e5600eb-4786-457a-8935-12f9d8115e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:26.079510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4e5600eb-4786-457a-8935-12f9d8115e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:26.084793 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2353/4660] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:25 2022] DELETE /identity/v3/projects/531d44606b5f4cc0839cb08262a3d997 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:26.085867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3aebb-3cbf-43ae-85c5-9292d446e020 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:26.107101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3aebb-3cbf-43ae-85c5-9292d446e020 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:26.190658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6355f-a34d-4967-bef5-696980087c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:26.191635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6355f-a34d-4967-bef5-696980087c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:26.191769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6355f-a34d-4967-bef5-696980087c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:26.192058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6355f-a34d-4967-bef5-696980087c3d admin admin] PATH_INFO: `/v3/users/de0376f3dac247d786877b25fed45ee1` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:26.193440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6355f-a34d-4967-bef5-696980087c3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0376f3dac247d786877b25fed45ee1)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:26.196191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6355f-a34d-4967-bef5-696980087c3d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:26.255124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d1a6355f-a34d-4967-bef5-696980087c3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0376f3dac247d786877b25fed45ee1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:26.266355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d1a6355f-a34d-4967-bef5-696980087c3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0376f3dac247d786877b25fed45ee1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:26.273973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d1a6355f-a34d-4967-bef5-696980087c3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0376f3dac247d786877b25fed45ee1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:26.274599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d1a6355f-a34d-4967-bef5-696980087c3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0376f3dac247d786877b25fed45ee1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:26.275221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d1a6355f-a34d-4967-bef5-696980087c3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0376f3dac247d786877b25fed45ee1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:26.297038 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2308/4661] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:26 2022] DELETE /identity/v3/users/de0376f3dac247d786877b25fed45ee1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:26.626180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5600eb-4786-457a-8935-12f9d8115e93 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:26.627979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4e5600eb-4786-457a-8935-12f9d8115e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:26.642668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5600eb-4786-457a-8935-12f9d8115e93 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:26.709537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea1724-8358-4a5d-8d23-b89186a84562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:26.710409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea1724-8358-4a5d-8d23-b89186a84562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:26.710692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea1724-8358-4a5d-8d23-b89186a84562 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:26.710963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea1724-8358-4a5d-8d23-b89186a84562 admin admin] PATH_INFO: `/v3/projects/35cfc95f22fe49b3a418e3b9a59eb8cf` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:26.712158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea1724-8358-4a5d-8d23-b89186a84562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35cfc95f22fe49b3a418e3b9a59eb8cf)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:26.714089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea1724-8358-4a5d-8d23-b89186a84562 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:26.767897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7dea1724-8358-4a5d-8d23-b89186a84562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35cfc95f22fe49b3a418e3b9a59eb8cf', 'request_id': 'req-7dea1724-8358-4a5d-8d23-b89186a84562'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:26.777319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7dea1724-8358-4a5d-8d23-b89186a84562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35cfc95f22fe49b3a418e3b9a59eb8cf', 'request_id': 'req-7dea1724-8358-4a5d-8d23-b89186a84562'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:26.783960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7dea1724-8358-4a5d-8d23-b89186a84562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35cfc95f22fe49b3a418e3b9a59eb8cf', 'request_id': 'req-7dea1724-8358-4a5d-8d23-b89186a84562'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:26.794538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7dea1724-8358-4a5d-8d23-b89186a84562 admin admin] The token cache is being invalidate because project 35cfc95f22fe49b3a418e3b9a59eb8cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:26.794755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7dea1724-8358-4a5d-8d23-b89186a84562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:26.795404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7dea1724-8358-4a5d-8d23-b89186a84562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:26.797215 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2354/4662] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:26 2022] DELETE /identity/v3/projects/35cfc95f22fe49b3a418e3b9a59eb8cf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:16:26.804014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e870828-6f50-4805-a6c5-68c740b0c9c2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:26.804547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e870828-6f50-4805-a6c5-68c740b0c9c2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:26.804725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e870828-6f50-4805-a6c5-68c740b0c9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:26.824434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-7e870828-6f50-4805-a6c5-68c740b0c9c2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:26.825762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7e870828-6f50-4805-a6c5-68c740b0c9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:26.868311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:26.892857 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2309/4663] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:26.900927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8e08b-d851-4460-948f-d80ee25e4b30 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:26.901225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8e08b-d851-4460-948f-d80ee25e4b30 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:26.901504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8e08b-d851-4460-948f-d80ee25e4b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:26.922163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-eef8e08b-d851-4460-948f-d80ee25e4b30 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:26.923433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-eef8e08b-d851-4460-948f-d80ee25e4b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:26.932159 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2355/4664] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:26.936679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e870828-6f50-4805-a6c5-68c740b0c9c2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:26.946840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e870828-6f50-4805-a6c5-68c740b0c9c2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:26.951750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e71813-b409-4bf3-b65c-fa6cf64c4dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:26.952481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e71813-b409-4bf3-b65c-fa6cf64c4dda admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:26.952738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e71813-b409-4bf3-b65c-fa6cf64c4dda admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:26.953009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e71813-b409-4bf3-b65c-fa6cf64c4dda admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:26.953801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e71813-b409-4bf3-b65c-fa6cf64c4dda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:16:26.954103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e71813-b409-4bf3-b65c-fa6cf64c4dda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:26.955701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e71813-b409-4bf3-b65c-fa6cf64c4dda admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:26.968280 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2310/4665] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:26.972747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8e08b-d851-4460-948f-d80ee25e4b30 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:26.982421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8e08b-d851-4460-948f-d80ee25e4b30 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:26.987669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577129d8-36f9-4aaf-b1fc-068e7c96e830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:26.988323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577129d8-36f9-4aaf-b1fc-068e7c96e830 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:26.988601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577129d8-36f9-4aaf-b1fc-068e7c96e830 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:26.989122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577129d8-36f9-4aaf-b1fc-068e7c96e830 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:26.989957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577129d8-36f9-4aaf-b1fc-068e7c96e830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:26.992075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577129d8-36f9-4aaf-b1fc-068e7c96e830 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:27.021007 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2356/4666] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:26 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:27.025264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e71813-b409-4bf3-b65c-fa6cf64c4dda admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:27.036094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e71813-b409-4bf3-b65c-fa6cf64c4dda admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:27.099329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23aa49-39fd-4b8a-ad43-9df853e9271d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:27.100020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23aa49-39fd-4b8a-ad43-9df853e9271d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:27.100534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23aa49-39fd-4b8a-ad43-9df853e9271d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:27.100816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23aa49-39fd-4b8a-ad43-9df853e9271d admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:27.101724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23aa49-39fd-4b8a-ad43-9df853e9271d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:27.103925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23aa49-39fd-4b8a-ad43-9df853e9271d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:27.127435 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2311/4667] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:27 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:27.131586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577129d8-36f9-4aaf-b1fc-068e7c96e830 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:27.142952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577129d8-36f9-4aaf-b1fc-068e7c96e830 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:27.147810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3bfdf-dfb5-4c62-bbbd-a00bbdfdd485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:27.148521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3bfdf-dfb5-4c62-bbbd-a00bbdfdd485 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:27.148798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3bfdf-dfb5-4c62-bbbd-a00bbdfdd485 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:27.149089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3bfdf-dfb5-4c62-bbbd-a00bbdfdd485 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:27.149851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3bfdf-dfb5-4c62-bbbd-a00bbdfdd485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:27.151452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3bfdf-dfb5-4c62-bbbd-a00bbdfdd485 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:27.162118 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2357/4668] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:27.166258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23aa49-39fd-4b8a-ad43-9df853e9271d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:27.176650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23aa49-39fd-4b8a-ad43-9df853e9271d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:27.182801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce2400-6d5e-4147-83d2-37ada82f98f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:27.183510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce2400-6d5e-4147-83d2-37ada82f98f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:27.183823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce2400-6d5e-4147-83d2-37ada82f98f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:27.184136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce2400-6d5e-4147-83d2-37ada82f98f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:27.184913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce2400-6d5e-4147-83d2-37ada82f98f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:27.186646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce2400-6d5e-4147-83d2-37ada82f98f9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:27.201243 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2312/4669] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:27.202488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3bfdf-dfb5-4c62-bbbd-a00bbdfdd485 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:27.209478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:27.213636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3bfdf-dfb5-4c62-bbbd-a00bbdfdd485 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:27.220147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dde53-779a-4dac-866f-a9a7ced917b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:27.220992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dde53-779a-4dac-866f-a9a7ced917b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:27.221880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dde53-779a-4dac-866f-a9a7ced917b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:27.221880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dde53-779a-4dac-866f-a9a7ced917b8 admin admin] PATH_INFO: `/v3/projects/70246077ddc447f0a6520d4ade7f7eac/users/900432e42ce440ce9febb805a45d85d1/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:27.241087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1dde53-779a-4dac-866f-a9a7ced917b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70246077ddc447f0a6520d4ade7f7eac, user_id=900432e42ce440ce9febb805a45d85d1, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:27.243788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1dde53-779a-4dac-866f-a9a7ced917b8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:27.258635 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2358/4670] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:27 2022] PUT /identity/v3/projects/70246077ddc447f0a6520d4ade7f7eac/users/900432e42ce440ce9febb805a45d85d1/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:27.269145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d33d65-fabc-4645-81d8-0082c9427aac None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:27.269429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d33d65-fabc-4645-81d8-0082c9427aac None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:27.269701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d33d65-fabc-4645-81d8-0082c9427aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:27.297048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d4d33d65-fabc-4645-81d8-0082c9427aac None None] MFA Rules not processed for user `900432e42ce440ce9febb805a45d85d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:27.298302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d4d33d65-fabc-4645-81d8-0082c9427aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:27.389625 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2313/4671] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:27.394467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dde53-779a-4dac-866f-a9a7ced917b8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:27.408370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dde53-779a-4dac-866f-a9a7ced917b8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:27.413503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd431cc-1845-41a3-a7e2-091ea19769fb tempest-DefaultDomainTestJSON-1888929261 tempest-DefaultDomainTestJSON-1888929261-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '900432e42ce440ce9febb805a45d85d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70246077ddc447f0a6520d4ade7f7eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:27.414594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd431cc-1845-41a3-a7e2-091ea19769fb tempest-DefaultDomainTestJSON-1888929261 tempest-DefaultDomainTestJSON-1888929261-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:27.415202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd431cc-1845-41a3-a7e2-091ea19769fb tempest-DefaultDomainTestJSON-1888929261 tempest-DefaultDomainTestJSON-1888929261-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:27.415727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd431cc-1845-41a3-a7e2-091ea19769fb tempest-DefaultDomainTestJSON-1888929261 tempest-DefaultDomainTestJSON-1888929261-project] PATH_INFO: `/v3/domains/default` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:27.417132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd431cc-1845-41a3-a7e2-091ea19769fb tempest-DefaultDomainTestJSON-1888929261 tempest-DefaultDomainTestJSON-1888929261-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:27.419092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd431cc-1845-41a3-a7e2-091ea19769fb tempest-DefaultDomainTestJSON-1888929261 tempest-DefaultDomainTestJSON-1888929261-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:27.421598 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2359/4672] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:16:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:27.426302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d33d65-fabc-4645-81d8-0082c9427aac None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:27.474430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:27.509186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d33d65-fabc-4645-81d8-0082c9427aac None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:27.517594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b75d65-bd23-40a9-b9ed-ff101ac877b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:27.518857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b75d65-bd23-40a9-b9ed-ff101ac877b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:27.519140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b75d65-bd23-40a9-b9ed-ff101ac877b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:27.519411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b75d65-bd23-40a9-b9ed-ff101ac877b3 admin admin] PATH_INFO: `/v3/users/900432e42ce440ce9febb805a45d85d1` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:27.520983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b75d65-bd23-40a9-b9ed-ff101ac877b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=900432e42ce440ce9febb805a45d85d1)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:27.524303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b75d65-bd23-40a9-b9ed-ff101ac877b3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:27.596942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a0b75d65-bd23-40a9-b9ed-ff101ac877b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900432e42ce440ce9febb805a45d85d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:27.609106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a0b75d65-bd23-40a9-b9ed-ff101ac877b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900432e42ce440ce9febb805a45d85d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:27.625231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a0b75d65-bd23-40a9-b9ed-ff101ac877b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900432e42ce440ce9febb805a45d85d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:27.626300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a0b75d65-bd23-40a9-b9ed-ff101ac877b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900432e42ce440ce9febb805a45d85d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:27.626957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a0b75d65-bd23-40a9-b9ed-ff101ac877b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900432e42ce440ce9febb805a45d85d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:27.656114 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2314/4673] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:27 2022] DELETE /identity/v3/users/900432e42ce440ce9febb805a45d85d1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:27.659788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ab26d-f2da-4ca5-91fe-54ae78dd8ca0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:27.660282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ab26d-f2da-4ca5-91fe-54ae78dd8ca0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:27.660282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ab26d-f2da-4ca5-91fe-54ae78dd8ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:27.678515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-102ab26d-f2da-4ca5-91fe-54ae78dd8ca0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:27.680053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-102ab26d-f2da-4ca5-91fe-54ae78dd8ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:27.756608 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2360/4674] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:27.767324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b75d65-bd23-40a9-b9ed-ff101ac877b3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:27.769195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a0b75d65-bd23-40a9-b9ed-ff101ac877b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:27.837085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b75d65-bd23-40a9-b9ed-ff101ac877b3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:27.842277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541405da-af5a-4429-adc1-2cecb14b12b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:27.843051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541405da-af5a-4429-adc1-2cecb14b12b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:27.843401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541405da-af5a-4429-adc1-2cecb14b12b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:27.843833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541405da-af5a-4429-adc1-2cecb14b12b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:27.855500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541405da-af5a-4429-adc1-2cecb14b12b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:27.857154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541405da-af5a-4429-adc1-2cecb14b12b9 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:27.868963 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2315/4675] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:28.162690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ab26d-f2da-4ca5-91fe-54ae78dd8ca0 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:28.165520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-102ab26d-f2da-4ca5-91fe-54ae78dd8ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:28.381810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ab26d-f2da-4ca5-91fe-54ae78dd8ca0 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:28.389525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb31f58-1f1c-4b34-8bb5-ecba2e6b7404 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:28.391043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb31f58-1f1c-4b34-8bb5-ecba2e6b7404 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:28.391654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb31f58-1f1c-4b34-8bb5-ecba2e6b7404 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:28.392278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb31f58-1f1c-4b34-8bb5-ecba2e6b7404 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:28.394466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ebb31f58-1f1c-4b34-8bb5-ecba2e6b7404 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:28.414289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb31f58-1f1c-4b34-8bb5-ecba2e6b7404 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:28.417093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb31f58-1f1c-4b34-8bb5-ecba2e6b7404 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:28.439605 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2361/4676] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:28.656945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541405da-af5a-4429-adc1-2cecb14b12b9 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:28.658438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-541405da-af5a-4429-adc1-2cecb14b12b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:28.683747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541405da-af5a-4429-adc1-2cecb14b12b9 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:28.691039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517d940-5d36-4c09-8d2a-6621b68f3c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:28.692435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517d940-5d36-4c09-8d2a-6621b68f3c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:28.692891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517d940-5d36-4c09-8d2a-6621b68f3c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:28.693344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517d940-5d36-4c09-8d2a-6621b68f3c38 admin admin] PATH_INFO: `/v3/projects/70246077ddc447f0a6520d4ade7f7eac` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:28.694793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517d940-5d36-4c09-8d2a-6621b68f3c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70246077ddc447f0a6520d4ade7f7eac)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:28.697674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517d940-5d36-4c09-8d2a-6621b68f3c38 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:28.792887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6517d940-5d36-4c09-8d2a-6621b68f3c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70246077ddc447f0a6520d4ade7f7eac', 'request_id': 'req-6517d940-5d36-4c09-8d2a-6621b68f3c38'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:28.801314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6517d940-5d36-4c09-8d2a-6621b68f3c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70246077ddc447f0a6520d4ade7f7eac', 'request_id': 'req-6517d940-5d36-4c09-8d2a-6621b68f3c38'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:28.803399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:28.810065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6517d940-5d36-4c09-8d2a-6621b68f3c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70246077ddc447f0a6520d4ade7f7eac', 'request_id': 'req-6517d940-5d36-4c09-8d2a-6621b68f3c38'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:28.841061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6517d940-5d36-4c09-8d2a-6621b68f3c38 admin admin] The token cache is being invalidate because project 70246077ddc447f0a6520d4ade7f7eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:28.841801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6517d940-5d36-4c09-8d2a-6621b68f3c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:28.842381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6517d940-5d36-4c09-8d2a-6621b68f3c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:28.844470 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2316/4677] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:28 2022] DELETE /identity/v3/projects/70246077ddc447f0a6520d4ade7f7eac => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:28.854791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572caa6d-74ec-431d-881b-c84403bd1706 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:28.855364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572caa6d-74ec-431d-881b-c84403bd1706 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:28.855364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572caa6d-74ec-431d-881b-c84403bd1706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:28.893031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-572caa6d-74ec-431d-881b-c84403bd1706 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:28.894814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-572caa6d-74ec-431d-881b-c84403bd1706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:29.013028 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2362/4678] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:29.025289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09430ca7-0dd5-46d1-88d6-40a017d24605 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:29.025543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09430ca7-0dd5-46d1-88d6-40a017d24605 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:29.026152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09430ca7-0dd5-46d1-88d6-40a017d24605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:29.083778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-09430ca7-0dd5-46d1-88d6-40a017d24605 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:29.085335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-09430ca7-0dd5-46d1-88d6-40a017d24605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:29.100147 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2317/4679] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:29.101091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572caa6d-74ec-431d-881b-c84403bd1706 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:29.107411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:29.119944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572caa6d-74ec-431d-881b-c84403bd1706 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:29.130362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573544a5-6b12-4591-8d5f-45345049fda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:29.131475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573544a5-6b12-4591-8d5f-45345049fda9 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:29.131772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573544a5-6b12-4591-8d5f-45345049fda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:29.132235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573544a5-6b12-4591-8d5f-45345049fda9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:29.133127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573544a5-6b12-4591-8d5f-45345049fda9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:16:29.133615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573544a5-6b12-4591-8d5f-45345049fda9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:29.135658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573544a5-6b12-4591-8d5f-45345049fda9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:29.164929 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2363/4680] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:29.166183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09430ca7-0dd5-46d1-88d6-40a017d24605 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:29.177797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09430ca7-0dd5-46d1-88d6-40a017d24605 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:29.184619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15160c2c-0303-483e-8b75-a2b0555511da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:29.185289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15160c2c-0303-483e-8b75-a2b0555511da admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:29.185568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15160c2c-0303-483e-8b75-a2b0555511da admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:29.185843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15160c2c-0303-483e-8b75-a2b0555511da admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:29.186719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15160c2c-0303-483e-8b75-a2b0555511da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:29.188797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15160c2c-0303-483e-8b75-a2b0555511da admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:29.223229 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2318/4681] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:29 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:29.227756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573544a5-6b12-4591-8d5f-45345049fda9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:29.239358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573544a5-6b12-4591-8d5f-45345049fda9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:29.298377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6fff3-edd3-4150-bd21-7f731b5f403b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:29.299097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6fff3-edd3-4150-bd21-7f731b5f403b admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:29.299370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6fff3-edd3-4150-bd21-7f731b5f403b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:29.299651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6fff3-edd3-4150-bd21-7f731b5f403b admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:29.300390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6fff3-edd3-4150-bd21-7f731b5f403b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:29.302351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6fff3-edd3-4150-bd21-7f731b5f403b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:29.328170 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2364/4682] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:29 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:16:29.330694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15160c2c-0303-483e-8b75-a2b0555511da admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:29.342580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15160c2c-0303-483e-8b75-a2b0555511da admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:29.353673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfc899-a424-4b7a-a26d-d4636965baf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:29.354391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfc899-a424-4b7a-a26d-d4636965baf4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:29.354672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfc899-a424-4b7a-a26d-d4636965baf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:29.354948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfc899-a424-4b7a-a26d-d4636965baf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:29.355683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfc899-a424-4b7a-a26d-d4636965baf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:29.358329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfc899-a424-4b7a-a26d-d4636965baf4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:29.377040 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2319/4683] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:16:29.385095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6fff3-edd3-4150-bd21-7f731b5f403b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:29.401086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6fff3-edd3-4150-bd21-7f731b5f403b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:29.408476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a45331-02c6-47e5-ac25-b0ab1b586b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:29.409169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a45331-02c6-47e5-ac25-b0ab1b586b41 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:29.409591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a45331-02c6-47e5-ac25-b0ab1b586b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:29.409927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a45331-02c6-47e5-ac25-b0ab1b586b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:29.410668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a45331-02c6-47e5-ac25-b0ab1b586b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:29.412583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a45331-02c6-47e5-ac25-b0ab1b586b41 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:29.428533 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2365/4684] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:29.433850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfc899-a424-4b7a-a26d-d4636965baf4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:29.446544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfc899-a424-4b7a-a26d-d4636965baf4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:29.453291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278e4c2-0314-4071-aa66-eae146f33bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:29.455400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278e4c2-0314-4071-aa66-eae146f33bed admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:29.455758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278e4c2-0314-4071-aa66-eae146f33bed admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:29.456180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278e4c2-0314-4071-aa66-eae146f33bed admin admin] PATH_INFO: `/v3/projects/f71cec2f7a5b4f2e8eb2bebb2df31395/users/cca6f712d9a24dcbb909d9a674c31b7a/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:29.477587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278e4c2-0314-4071-aa66-eae146f33bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f71cec2f7a5b4f2e8eb2bebb2df31395, user_id=cca6f712d9a24dcbb909d9a674c31b7a, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:29.480846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278e4c2-0314-4071-aa66-eae146f33bed admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:29.505418 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2320/4685] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:29 2022] PUT /identity/v3/projects/f71cec2f7a5b4f2e8eb2bebb2df31395/users/cca6f712d9a24dcbb909d9a674c31b7a/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:29.516141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7ea9a-ee21-4952-b1d5-5c35f8daf30c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:29.516745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7ea9a-ee21-4952-b1d5-5c35f8daf30c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:29.517032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7ea9a-ee21-4952-b1d5-5c35f8daf30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:29.555654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0aa7ea9a-ee21-4952-b1d5-5c35f8daf30c None None] MFA Rules not processed for user `cca6f712d9a24dcbb909d9a674c31b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:29.556837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0aa7ea9a-ee21-4952-b1d5-5c35f8daf30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:29.676168 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2366/4686] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:29.679515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278e4c2-0314-4071-aa66-eae146f33bed admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:29.777532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278e4c2-0314-4071-aa66-eae146f33bed admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:29.784182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a30ffd-5b43-4a1c-8956-6d47bcd285e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:29.784877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a30ffd-5b43-4a1c-8956-6d47bcd285e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:29.785699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a30ffd-5b43-4a1c-8956-6d47bcd285e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:29.785699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a30ffd-5b43-4a1c-8956-6d47bcd285e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:29.786590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a30ffd-5b43-4a1c-8956-6d47bcd285e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:29.788934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a30ffd-5b43-4a1c-8956-6d47bcd285e5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:29.853125 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2321/4687] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:29 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:29.853695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7ea9a-ee21-4952-b1d5-5c35f8daf30c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:29.860802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7ea9a-ee21-4952-b1d5-5c35f8daf30c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:29.971636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:29.981713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246880e-ddc8-45f3-8aa9-6b1336b250ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:29.982666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246880e-ddc8-45f3-8aa9-6b1336b250ec admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:29.983050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246880e-ddc8-45f3-8aa9-6b1336b250ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:29.983384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246880e-ddc8-45f3-8aa9-6b1336b250ec admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:29.984182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246880e-ddc8-45f3-8aa9-6b1336b250ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:29.986788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246880e-ddc8-45f3-8aa9-6b1336b250ec admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:30.040082 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2367/4688] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:29 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:16:30.042821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a30ffd-5b43-4a1c-8956-6d47bcd285e5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:30.062666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a30ffd-5b43-4a1c-8956-6d47bcd285e5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:30.070259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7f470-7168-484e-b0e0-70614051dba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:30.071429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7f470-7168-484e-b0e0-70614051dba4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:30.072193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7f470-7168-484e-b0e0-70614051dba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:30.072661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7f470-7168-484e-b0e0-70614051dba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:30.074137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7f470-7168-484e-b0e0-70614051dba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:30.077770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7f470-7168-484e-b0e0-70614051dba4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:30.098524 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2322/4689] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:30.099568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246880e-ddc8-45f3-8aa9-6b1336b250ec admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:30.115517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246880e-ddc8-45f3-8aa9-6b1336b250ec admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:30.129807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6edb8-2488-4248-9084-04594ac33332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:30.133621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6edb8-2488-4248-9084-04594ac33332 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:30.134295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6edb8-2488-4248-9084-04594ac33332 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:30.134833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6edb8-2488-4248-9084-04594ac33332 admin admin] PATH_INFO: `/v3/projects/64f92553f03c430d9b780d7181289adf/users/953a09d7bd4747bfa7903b1845936e20/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:30.174322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6edb8-2488-4248-9084-04594ac33332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f92553f03c430d9b780d7181289adf, user_id=953a09d7bd4747bfa7903b1845936e20, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:30.176376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6edb8-2488-4248-9084-04594ac33332 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:30.211497 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2368/4690] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:30 2022] PUT /identity/v3/projects/64f92553f03c430d9b780d7181289adf/users/953a09d7bd4747bfa7903b1845936e20/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:16:30.213240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7f470-7168-484e-b0e0-70614051dba4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:30.232746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7f470-7168-484e-b0e0-70614051dba4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:30.324880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:30.343922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6edb8-2488-4248-9084-04594ac33332 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:30.345133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba687a-cec3-4a53-9f7a-827ac9e3039a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:30.345838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-88d6edb8-2488-4248-9084-04594ac33332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:30.345973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba687a-cec3-4a53-9f7a-827ac9e3039a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:30.346137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba687a-cec3-4a53-9f7a-827ac9e3039a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:30.347524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba687a-cec3-4a53-9f7a-827ac9e3039a admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:30.348801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba687a-cec3-4a53-9f7a-827ac9e3039a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:30.353985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba687a-cec3-4a53-9f7a-827ac9e3039a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:30.387593 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2323/4691] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:16:30.390254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba687a-cec3-4a53-9f7a-827ac9e3039a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:30.412865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba687a-cec3-4a53-9f7a-827ac9e3039a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:30.428975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2c9e9-d099-446d-b87d-6f6f880afaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:30.430101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c9e9-d099-446d-b87d-6f6f880afaa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:30.433501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c9e9-d099-446d-b87d-6f6f880afaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:30.434253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c9e9-d099-446d-b87d-6f6f880afaa6 admin admin] PATH_INFO: `/v3/projects/64f92553f03c430d9b780d7181289adf/users/953a09d7bd4747bfa7903b1845936e20/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:30.442831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2c9e9-d099-446d-b87d-6f6f880afaa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f92553f03c430d9b780d7181289adf, user_id=953a09d7bd4747bfa7903b1845936e20, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:30.452075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2c9e9-d099-446d-b87d-6f6f880afaa6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:30.476663 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2324/4692] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:30 2022] PUT /identity/v3/projects/64f92553f03c430d9b780d7181289adf/users/953a09d7bd4747bfa7903b1845936e20/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:30.490591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89400c60-5d65-42e0-9c06-8253c922697c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:30.491059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89400c60-5d65-42e0-9c06-8253c922697c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:30.491457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89400c60-5d65-42e0-9c06-8253c922697c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:30.546881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6edb8-2488-4248-9084-04594ac33332 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:30.558479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-89400c60-5d65-42e0-9c06-8253c922697c None None] MFA Rules not processed for user `953a09d7bd4747bfa7903b1845936e20`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:30.559176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-89400c60-5d65-42e0-9c06-8253c922697c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:30.666017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b24b5-47d2-4d17-b3ff-8531949a954e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:30.666879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b24b5-47d2-4d17-b3ff-8531949a954e service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:30.667162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b24b5-47d2-4d17-b3ff-8531949a954e service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:30.667624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b24b5-47d2-4d17-b3ff-8531949a954e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:30.671091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-562b24b5-47d2-4d17-b3ff-8531949a954e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:30.717350 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2325/4693] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:30.727802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89400c60-5d65-42e0-9c06-8253c922697c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:30.729722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-89400c60-5d65-42e0-9c06-8253c922697c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:30.803368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b24b5-47d2-4d17-b3ff-8531949a954e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:30.809727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b24b5-47d2-4d17-b3ff-8531949a954e service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:30.823155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:30.840010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89400c60-5d65-42e0-9c06-8253c922697c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:30.844908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76b5b4-2f9a-4256-b024-a68cb88888f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:30.845841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76b5b4-2f9a-4256-b024-a68cb88888f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:30.846363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76b5b4-2f9a-4256-b024-a68cb88888f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:30.846880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76b5b4-2f9a-4256-b024-a68cb88888f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:30.865989 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2369/4694] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:30.866581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76b5b4-2f9a-4256-b024-a68cb88888f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:30.868228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76b5b4-2f9a-4256-b024-a68cb88888f8 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:30.887827 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2326/4695] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:30 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:16:31.405415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b24b5-47d2-4d17-b3ff-8531949a954e service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:31.407799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-562b24b5-47d2-4d17-b3ff-8531949a954e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:31.548809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b24b5-47d2-4d17-b3ff-8531949a954e service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:31.555357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317447e-3d85-4d05-b04d-8c57d20548c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:31.556827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317447e-3d85-4d05-b04d-8c57d20548c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:31.557436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317447e-3d85-4d05-b04d-8c57d20548c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:31.557898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317447e-3d85-4d05-b04d-8c57d20548c7 admin admin] PATH_INFO: `/v3/users/ace2003567a44064bb848b39f6470cae` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:31.559807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317447e-3d85-4d05-b04d-8c57d20548c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace2003567a44064bb848b39f6470cae)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:31.563198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317447e-3d85-4d05-b04d-8c57d20548c7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:31.642167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f317447e-3d85-4d05-b04d-8c57d20548c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace2003567a44064bb848b39f6470cae'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:31.653684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f317447e-3d85-4d05-b04d-8c57d20548c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace2003567a44064bb848b39f6470cae'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:31.654764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f317447e-3d85-4d05-b04d-8c57d20548c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace2003567a44064bb848b39f6470cae'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:31.655423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f317447e-3d85-4d05-b04d-8c57d20548c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace2003567a44064bb848b39f6470cae'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:31.664880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f317447e-3d85-4d05-b04d-8c57d20548c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace2003567a44064bb848b39f6470cae'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:31.689773 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2370/4696] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:31 2022] DELETE /identity/v3/users/ace2003567a44064bb848b39f6470cae => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:31.691520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95235956-a22d-4334-b3dd-663b1c731dee None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:31.691810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95235956-a22d-4334-b3dd-663b1c731dee None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:31.692161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95235956-a22d-4334-b3dd-663b1c731dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:31.718430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-95235956-a22d-4334-b3dd-663b1c731dee None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:31.721086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-95235956-a22d-4334-b3dd-663b1c731dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:31.813803 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2327/4697] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:16:31.828113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317447e-3d85-4d05-b04d-8c57d20548c7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:31.830089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f317447e-3d85-4d05-b04d-8c57d20548c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:31.939316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317447e-3d85-4d05-b04d-8c57d20548c7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:31.945628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e53901-bf24-404b-8d74-00d405094c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:31.946311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e53901-bf24-404b-8d74-00d405094c54 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:31.946597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e53901-bf24-404b-8d74-00d405094c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:31.946875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e53901-bf24-404b-8d74-00d405094c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:31.961914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e53901-bf24-404b-8d74-00d405094c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:31.963822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e53901-bf24-404b-8d74-00d405094c54 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:31.978299 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2371/4698] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:32.728745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95235956-a22d-4334-b3dd-663b1c731dee None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:32.733876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-95235956-a22d-4334-b3dd-663b1c731dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:32.748428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:32.763385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95235956-a22d-4334-b3dd-663b1c731dee None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:32.772287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe80f8-939f-43ea-9e2d-91983175972a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:32.775609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe80f8-939f-43ea-9e2d-91983175972a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:32.775609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe80f8-939f-43ea-9e2d-91983175972a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:32.775609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe80f8-939f-43ea-9e2d-91983175972a admin admin] PATH_INFO: `/v3/projects/48c2689f6b72433fa3a0cfd9a441481f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:32.780109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe80f8-939f-43ea-9e2d-91983175972a admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c2689f6b72433fa3a0cfd9a441481f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:32.785348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe80f8-939f-43ea-9e2d-91983175972a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:32.875302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8bfe80f8-939f-43ea-9e2d-91983175972a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c2689f6b72433fa3a0cfd9a441481f', 'request_id': 'req-8bfe80f8-939f-43ea-9e2d-91983175972a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:32.884948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8bfe80f8-939f-43ea-9e2d-91983175972a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c2689f6b72433fa3a0cfd9a441481f', 'request_id': 'req-8bfe80f8-939f-43ea-9e2d-91983175972a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:32.910276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8bfe80f8-939f-43ea-9e2d-91983175972a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c2689f6b72433fa3a0cfd9a441481f', 'request_id': 'req-8bfe80f8-939f-43ea-9e2d-91983175972a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:32.936338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8bfe80f8-939f-43ea-9e2d-91983175972a admin admin] The token cache is being invalidate because project 48c2689f6b72433fa3a0cfd9a441481f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:32.936799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8bfe80f8-939f-43ea-9e2d-91983175972a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:32.937667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8bfe80f8-939f-43ea-9e2d-91983175972a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:32.942141 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2328/4699] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:32 2022] DELETE /identity/v3/projects/48c2689f6b72433fa3a0cfd9a441481f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:32.945897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e53901-bf24-404b-8d74-00d405094c54 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:32.965229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e53901-bf24-404b-8d74-00d405094c54 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:32.976009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:33.046474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e870a-81d3-4378-977a-eefd9aa71851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:33.047558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e870a-81d3-4378-977a-eefd9aa71851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:33.047852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e870a-81d3-4378-977a-eefd9aa71851 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:33.048164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e870a-81d3-4378-977a-eefd9aa71851 admin admin] PATH_INFO: `/v3/users/53829ab0397a4bdcaea1a561e6160a08` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:33.049530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e870a-81d3-4378-977a-eefd9aa71851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53829ab0397a4bdcaea1a561e6160a08)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:33.051588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e870a-81d3-4378-977a-eefd9aa71851 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:33.149398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a31e870a-81d3-4378-977a-eefd9aa71851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53829ab0397a4bdcaea1a561e6160a08'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:33.165216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a31e870a-81d3-4378-977a-eefd9aa71851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53829ab0397a4bdcaea1a561e6160a08'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:33.166581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a31e870a-81d3-4378-977a-eefd9aa71851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53829ab0397a4bdcaea1a561e6160a08'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:33.175217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a31e870a-81d3-4378-977a-eefd9aa71851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53829ab0397a4bdcaea1a561e6160a08'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:33.191446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a31e870a-81d3-4378-977a-eefd9aa71851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53829ab0397a4bdcaea1a561e6160a08'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:33.221307 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2372/4700] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:32 2022] DELETE /identity/v3/users/53829ab0397a4bdcaea1a561e6160a08 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:33.281603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe80f8-939f-43ea-9e2d-91983175972a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:33.282900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8bfe80f8-939f-43ea-9e2d-91983175972a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:33.298214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe80f8-939f-43ea-9e2d-91983175972a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:33.386521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f658a-2292-44de-88dc-83452ffe4d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:33.387430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f658a-2292-44de-88dc-83452ffe4d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:33.387708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f658a-2292-44de-88dc-83452ffe4d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:33.389065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f658a-2292-44de-88dc-83452ffe4d2b admin admin] PATH_INFO: `/v3/users/cca6f712d9a24dcbb909d9a674c31b7a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:33.389899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f658a-2292-44de-88dc-83452ffe4d2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca6f712d9a24dcbb909d9a674c31b7a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:33.392469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f658a-2292-44de-88dc-83452ffe4d2b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:33.479389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ca1f658a-2292-44de-88dc-83452ffe4d2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca6f712d9a24dcbb909d9a674c31b7a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:33.488932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ca1f658a-2292-44de-88dc-83452ffe4d2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca6f712d9a24dcbb909d9a674c31b7a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:33.498459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ca1f658a-2292-44de-88dc-83452ffe4d2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca6f712d9a24dcbb909d9a674c31b7a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:33.499160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ca1f658a-2292-44de-88dc-83452ffe4d2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca6f712d9a24dcbb909d9a674c31b7a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:33.500090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ca1f658a-2292-44de-88dc-83452ffe4d2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca6f712d9a24dcbb909d9a674c31b7a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:33.525855 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2329/4701] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:33 2022] DELETE /identity/v3/users/cca6f712d9a24dcbb909d9a674c31b7a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:33.531614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a019e-f00e-4d47-84e2-dbc7bc697b9e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:33.532262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a019e-f00e-4d47-84e2-dbc7bc697b9e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:33.532806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a019e-f00e-4d47-84e2-dbc7bc697b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:33.565761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-cd7a019e-f00e-4d47-84e2-dbc7bc697b9e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:33.568423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cd7a019e-f00e-4d47-84e2-dbc7bc697b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:33.664093 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2373/4702] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:33.669606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f658a-2292-44de-88dc-83452ffe4d2b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:33.671519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ca1f658a-2292-44de-88dc-83452ffe4d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:33.687499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:33.762921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f658a-2292-44de-88dc-83452ffe4d2b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:33.769467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f89afb-5efe-4a9e-914d-7b0821889724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:33.770208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f89afb-5efe-4a9e-914d-7b0821889724 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:33.770826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f89afb-5efe-4a9e-914d-7b0821889724 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:33.771070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f89afb-5efe-4a9e-914d-7b0821889724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:33.785194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f89afb-5efe-4a9e-914d-7b0821889724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:33.786841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f89afb-5efe-4a9e-914d-7b0821889724 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:33.801419 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2330/4703] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:16:34.016236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a019e-f00e-4d47-84e2-dbc7bc697b9e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:34.017757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cd7a019e-f00e-4d47-84e2-dbc7bc697b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:34.030953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a019e-f00e-4d47-84e2-dbc7bc697b9e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:34.037197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d442f-b043-49cf-9329-472e93d7aa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:34.038732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d442f-b043-49cf-9329-472e93d7aa6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:34.039180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d442f-b043-49cf-9329-472e93d7aa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:34.039795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d442f-b043-49cf-9329-472e93d7aa6d admin admin] PATH_INFO: `/v3/projects/41e9cafe8111486b8902b2165022b646` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:34.041239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d442f-b043-49cf-9329-472e93d7aa6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e9cafe8111486b8902b2165022b646)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:34.044246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d442f-b043-49cf-9329-472e93d7aa6d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:34.115685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:34.234823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-715d442f-b043-49cf-9329-472e93d7aa6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e9cafe8111486b8902b2165022b646', 'request_id': 'req-715d442f-b043-49cf-9329-472e93d7aa6d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:34.265089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-715d442f-b043-49cf-9329-472e93d7aa6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e9cafe8111486b8902b2165022b646', 'request_id': 'req-715d442f-b043-49cf-9329-472e93d7aa6d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:34.288871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-715d442f-b043-49cf-9329-472e93d7aa6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e9cafe8111486b8902b2165022b646', 'request_id': 'req-715d442f-b043-49cf-9329-472e93d7aa6d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:34.301715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-715d442f-b043-49cf-9329-472e93d7aa6d admin admin] The token cache is being invalidate because project 41e9cafe8111486b8902b2165022b646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:34.302734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-715d442f-b043-49cf-9329-472e93d7aa6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:34.303643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-715d442f-b043-49cf-9329-472e93d7aa6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:34.307110 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2374/4704] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:34 2022] DELETE /identity/v3/projects/41e9cafe8111486b8902b2165022b646 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:34.312910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022841e-af32-465c-a304-888a655ee818 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:34.313470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022841e-af32-465c-a304-888a655ee818 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:34.313809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022841e-af32-465c-a304-888a655ee818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:34.393315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f022841e-af32-465c-a304-888a655ee818 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:34.394492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f022841e-af32-465c-a304-888a655ee818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:34.415425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d442f-b043-49cf-9329-472e93d7aa6d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:34.417540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-715d442f-b043-49cf-9329-472e93d7aa6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:34.515023 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2331/4705] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:34.523679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327818e-9b81-48b7-80a9-4b5c7d12782e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:34.524684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327818e-9b81-48b7-80a9-4b5c7d12782e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:34.525222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327818e-9b81-48b7-80a9-4b5c7d12782e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:34.555289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6327818e-9b81-48b7-80a9-4b5c7d12782e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:34.557654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6327818e-9b81-48b7-80a9-4b5c7d12782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:34.568935 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2332/4706] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:16:34.574450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327818e-9b81-48b7-80a9-4b5c7d12782e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:34.589374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327818e-9b81-48b7-80a9-4b5c7d12782e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:34.612278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedbbf0-4e0f-4c3f-a66b-e214ab8600cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:34.613301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedbbf0-4e0f-4c3f-a66b-e214ab8600cb admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:34.613884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedbbf0-4e0f-4c3f-a66b-e214ab8600cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:34.615146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedbbf0-4e0f-4c3f-a66b-e214ab8600cb admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:34.616795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedbbf0-4e0f-4c3f-a66b-e214ab8600cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:16:34.617506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedbbf0-4e0f-4c3f-a66b-e214ab8600cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:34.619272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedbbf0-4e0f-4c3f-a66b-e214ab8600cb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:34.644553 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2333/4707] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:34.646547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedbbf0-4e0f-4c3f-a66b-e214ab8600cb admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:34.660176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d442f-b043-49cf-9329-472e93d7aa6d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:34.666974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ea485-8935-41bd-a75f-c5970200876b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:34.669078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ea485-8935-41bd-a75f-c5970200876b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:34.669499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ea485-8935-41bd-a75f-c5970200876b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:34.669768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ea485-8935-41bd-a75f-c5970200876b admin admin] PATH_INFO: `/v3/projects/f71cec2f7a5b4f2e8eb2bebb2df31395` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:34.671324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ea485-8935-41bd-a75f-c5970200876b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f71cec2f7a5b4f2e8eb2bebb2df31395)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:34.673745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ea485-8935-41bd-a75f-c5970200876b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:34.679585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedbbf0-4e0f-4c3f-a66b-e214ab8600cb admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:34.696895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe57a8c-e10c-406a-9521-2b668e53c11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:34.697852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe57a8c-e10c-406a-9521-2b668e53c11a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:34.698272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe57a8c-e10c-406a-9521-2b668e53c11a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:34.698950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe57a8c-e10c-406a-9521-2b668e53c11a admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:34.699777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe57a8c-e10c-406a-9521-2b668e53c11a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:34.701939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe57a8c-e10c-406a-9521-2b668e53c11a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:34.755437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f82ea485-8935-41bd-a75f-c5970200876b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f71cec2f7a5b4f2e8eb2bebb2df31395', 'request_id': 'req-f82ea485-8935-41bd-a75f-c5970200876b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:34.774800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f82ea485-8935-41bd-a75f-c5970200876b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f71cec2f7a5b4f2e8eb2bebb2df31395', 'request_id': 'req-f82ea485-8935-41bd-a75f-c5970200876b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:34.775333 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2334/4708] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:34 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:34.782837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe57a8c-e10c-406a-9521-2b668e53c11a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:34.787158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f82ea485-8935-41bd-a75f-c5970200876b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f71cec2f7a5b4f2e8eb2bebb2df31395', 'request_id': 'req-f82ea485-8935-41bd-a75f-c5970200876b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:34.805846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f82ea485-8935-41bd-a75f-c5970200876b admin admin] The token cache is being invalidate because project f71cec2f7a5b4f2e8eb2bebb2df31395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:34.814585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f82ea485-8935-41bd-a75f-c5970200876b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:34.815486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f82ea485-8935-41bd-a75f-c5970200876b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:34.817761 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2375/4709] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:34 2022] DELETE /identity/v3/projects/f71cec2f7a5b4f2e8eb2bebb2df31395 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:34.828987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ea485-8935-41bd-a75f-c5970200876b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:34.833405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f82ea485-8935-41bd-a75f-c5970200876b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:34.900071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe57a8c-e10c-406a-9521-2b668e53c11a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:34.907693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7f7ba-8364-40da-8961-69c8c648e363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:34.908588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7f7ba-8364-40da-8961-69c8c648e363 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:34.908962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7f7ba-8364-40da-8961-69c8c648e363 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:34.909397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7f7ba-8364-40da-8961-69c8c648e363 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:34.910408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7f7ba-8364-40da-8961-69c8c648e363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:34.914290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7f7ba-8364-40da-8961-69c8c648e363 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:34.934269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:34.982563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ea485-8935-41bd-a75f-c5970200876b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:34.984767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:34.990991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d33c5-af7a-46db-8b73-b93d41b756c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:34.992477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d33c5-af7a-46db-8b73-b93d41b756c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:34.992882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d33c5-af7a-46db-8b73-b93d41b756c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:34.993237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d33c5-af7a-46db-8b73-b93d41b756c4 admin admin] PATH_INFO: `/v3/users/953a09d7bd4747bfa7903b1845936e20` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:34.995026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d33c5-af7a-46db-8b73-b93d41b756c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=953a09d7bd4747bfa7903b1845936e20)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:34.998894 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2335/4710] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:34 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:35.000961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d33c5-af7a-46db-8b73-b93d41b756c4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:35.002700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7f7ba-8364-40da-8961-69c8c648e363 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:35.005407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c4d7f7ba-8364-40da-8961-69c8c648e363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:35.025852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7f7ba-8364-40da-8961-69c8c648e363 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:35.033047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ccf16-d809-4158-8d16-9003d1d4abf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:35.033989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ccf16-d809-4158-8d16-9003d1d4abf9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:35.034340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ccf16-d809-4158-8d16-9003d1d4abf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:35.034686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ccf16-d809-4158-8d16-9003d1d4abf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:35.035534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ccf16-d809-4158-8d16-9003d1d4abf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:35.037646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ccf16-d809-4158-8d16-9003d1d4abf9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:35.053520 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2336/4711] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:16:35.057312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ccf16-d809-4158-8d16-9003d1d4abf9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:35.085495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ccf16-d809-4158-8d16-9003d1d4abf9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:35.135873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d2631-9dc3-499c-97df-9e5ee89b114c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:35.136504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-945d33c5-af7a-46db-8b73-b93d41b756c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '953a09d7bd4747bfa7903b1845936e20'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:35.137253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d2631-9dc3-499c-97df-9e5ee89b114c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:35.137547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d2631-9dc3-499c-97df-9e5ee89b114c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:35.137873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d2631-9dc3-499c-97df-9e5ee89b114c admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:35.138961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d2631-9dc3-499c-97df-9e5ee89b114c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:35.144361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d2631-9dc3-499c-97df-9e5ee89b114c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:35.160998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-945d33c5-af7a-46db-8b73-b93d41b756c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '953a09d7bd4747bfa7903b1845936e20'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:35.161355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-945d33c5-af7a-46db-8b73-b93d41b756c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '953a09d7bd4747bfa7903b1845936e20'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:35.161981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-945d33c5-af7a-46db-8b73-b93d41b756c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '953a09d7bd4747bfa7903b1845936e20'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:35.165158 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2337/4712] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:35.172184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d2631-9dc3-499c-97df-9e5ee89b114c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:35.174209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-945d33c5-af7a-46db-8b73-b93d41b756c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '953a09d7bd4747bfa7903b1845936e20'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:35.176371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e07d2631-9dc3-499c-97df-9e5ee89b114c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:35.212652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d2631-9dc3-499c-97df-9e5ee89b114c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:35.227756 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2376/4713] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:34 2022] DELETE /identity/v3/users/953a09d7bd4747bfa7903b1845936e20 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:35.230848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e70e6-30f0-4527-9ae6-919f020b324d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:35.230848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e70e6-30f0-4527-9ae6-919f020b324d admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:35.230848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e70e6-30f0-4527-9ae6-919f020b324d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:35.231893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e70e6-30f0-4527-9ae6-919f020b324d admin admin] PATH_INFO: `/v3/projects/98655c9000bb488ca2ef25bca62b80f6/users/60a0ee3b243b4d96b8c9c77da4d698e9/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:35.271925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e70e6-30f0-4527-9ae6-919f020b324d admin admin] RBAC: Authorizing `identity:create_grant(project_id=98655c9000bb488ca2ef25bca62b80f6, user_id=60a0ee3b243b4d96b8c9c77da4d698e9, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:35.297311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e70e6-30f0-4527-9ae6-919f020b324d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:35.337987 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2338/4714] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:35 2022] PUT /identity/v3/projects/98655c9000bb488ca2ef25bca62b80f6/users/60a0ee3b243b4d96b8c9c77da4d698e9/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:35.348738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857e63a-858c-4861-9865-b0e1bb0a6167 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:35.349026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857e63a-858c-4861-9865-b0e1bb0a6167 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:35.349301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857e63a-858c-4861-9865-b0e1bb0a6167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:35.440482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4857e63a-858c-4861-9865-b0e1bb0a6167 None None] MFA Rules not processed for user `60a0ee3b243b4d96b8c9c77da4d698e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:35.443170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4857e63a-858c-4861-9865-b0e1bb0a6167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:35.629060 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2377/4715] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:35.639417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e70e6-30f0-4527-9ae6-919f020b324d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:35.727453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e70e6-30f0-4527-9ae6-919f020b324d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:35.733001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b0ab1-3305-4c23-8a04-49e693b59514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:35.733680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b0ab1-3305-4c23-8a04-49e693b59514 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:35.733964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b0ab1-3305-4c23-8a04-49e693b59514 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:35.734298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b0ab1-3305-4c23-8a04-49e693b59514 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:35.735079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b0ab1-3305-4c23-8a04-49e693b59514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:35.737701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b0ab1-3305-4c23-8a04-49e693b59514 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:35.772841 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2339/4716] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:35 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:35.774250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857e63a-858c-4861-9865-b0e1bb0a6167 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:35.786307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857e63a-858c-4861-9865-b0e1bb0a6167 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:35.851974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:35.867889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e46c5-2f09-4ea9-bfac-c8b6d16b08ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:35.868621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e46c5-2f09-4ea9-bfac-c8b6d16b08ca admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:35.868907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e46c5-2f09-4ea9-bfac-c8b6d16b08ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:35.869183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e46c5-2f09-4ea9-bfac-c8b6d16b08ca admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:35.869890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e46c5-2f09-4ea9-bfac-c8b6d16b08ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:35.872300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e46c5-2f09-4ea9-bfac-c8b6d16b08ca admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:35.909198 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2378/4717] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:35 2022] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:35.910607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b0ab1-3305-4c23-8a04-49e693b59514 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:35.922180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b0ab1-3305-4c23-8a04-49e693b59514 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:35.927091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db420f-99f4-4920-90ed-cc3a81c71251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:35.928186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db420f-99f4-4920-90ed-cc3a81c71251 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:35.928639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db420f-99f4-4920-90ed-cc3a81c71251 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:35.928960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db420f-99f4-4920-90ed-cc3a81c71251 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:35.929700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db420f-99f4-4920-90ed-cc3a81c71251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:35.931439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db420f-99f4-4920-90ed-cc3a81c71251 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:35.943914 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2340/4718] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:35.949067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e46c5-2f09-4ea9-bfac-c8b6d16b08ca admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:35.961832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e46c5-2f09-4ea9-bfac-c8b6d16b08ca admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:35.967358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6361655-0069-4e4f-8004-abafe694e4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:35.968293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6361655-0069-4e4f-8004-abafe694e4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:35.968697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6361655-0069-4e4f-8004-abafe694e4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:35.968984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6361655-0069-4e4f-8004-abafe694e4e8 admin admin] PATH_INFO: `/v3/projects/4d3b29afa449427996baf1da9eea1908/users/dbec7da04af74446a0778ac62195420d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:35.988679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6361655-0069-4e4f-8004-abafe694e4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d3b29afa449427996baf1da9eea1908, user_id=dbec7da04af74446a0778ac62195420d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:35.991598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6361655-0069-4e4f-8004-abafe694e4e8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:36.007516 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2379/4719] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:35 2022] PUT /identity/v3/projects/4d3b29afa449427996baf1da9eea1908/users/dbec7da04af74446a0778ac62195420d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:36.012055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db420f-99f4-4920-90ed-cc3a81c71251 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:36.024564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db420f-99f4-4920-90ed-cc3a81c71251 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:36.100885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6361655-0069-4e4f-8004-abafe694e4e8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:36.103033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c6361655-0069-4e4f-8004-abafe694e4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:36.105191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1f7da-32c8-4ac3-b0c3-75a22ef8cc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:36.105971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1f7da-32c8-4ac3-b0c3-75a22ef8cc7e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:36.107713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1f7da-32c8-4ac3-b0c3-75a22ef8cc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:36.107713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1f7da-32c8-4ac3-b0c3-75a22ef8cc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:36.107713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1f7da-32c8-4ac3-b0c3-75a22ef8cc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:36.109142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1f7da-32c8-4ac3-b0c3-75a22ef8cc7e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:36.123823 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2341/4720] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:36.124071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6361655-0069-4e4f-8004-abafe694e4e8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:36.124948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1f7da-32c8-4ac3-b0c3-75a22ef8cc7e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:36.127352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cda4e-5332-46d0-b5c1-eca6c797efc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:36.128475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cda4e-5332-46d0-b5c1-eca6c797efc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:36.128760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cda4e-5332-46d0-b5c1-eca6c797efc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:36.129041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cda4e-5332-46d0-b5c1-eca6c797efc1 admin admin] PATH_INFO: `/v3/projects/64f92553f03c430d9b780d7181289adf` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:36.131149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cda4e-5332-46d0-b5c1-eca6c797efc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64f92553f03c430d9b780d7181289adf)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:36.133422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cda4e-5332-46d0-b5c1-eca6c797efc1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:36.136680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1f7da-32c8-4ac3-b0c3-75a22ef8cc7e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:36.142821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265a59c-ff59-43b0-b885-cda62158996f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:36.143832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265a59c-ff59-43b0-b885-cda62158996f admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:36.144217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265a59c-ff59-43b0-b885-cda62158996f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:36.144747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265a59c-ff59-43b0-b885-cda62158996f admin admin] PATH_INFO: `/v3/projects/4d3b29afa449427996baf1da9eea1908/users/dbec7da04af74446a0778ac62195420d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:36.148778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265a59c-ff59-43b0-b885-cda62158996f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d3b29afa449427996baf1da9eea1908, user_id=dbec7da04af74446a0778ac62195420d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:36.151674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265a59c-ff59-43b0-b885-cda62158996f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:36.166055 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2342/4721] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:36 2022] PUT /identity/v3/projects/4d3b29afa449427996baf1da9eea1908/users/dbec7da04af74446a0778ac62195420d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:36.176913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd3780-e495-41c5-8413-a45e851e2459 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:36.177699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd3780-e495-41c5-8413-a45e851e2459 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:36.178412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd3780-e495-41c5-8413-a45e851e2459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:36.202469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:36.216639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e22cda4e-5332-46d0-b5c1-eca6c797efc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64f92553f03c430d9b780d7181289adf', 'request_id': 'req-e22cda4e-5332-46d0-b5c1-eca6c797efc1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:36.218152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-76bd3780-e495-41c5-8413-a45e851e2459 None None] MFA Rules not processed for user `dbec7da04af74446a0778ac62195420d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:36.220016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-76bd3780-e495-41c5-8413-a45e851e2459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:36.227730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e22cda4e-5332-46d0-b5c1-eca6c797efc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64f92553f03c430d9b780d7181289adf', 'request_id': 'req-e22cda4e-5332-46d0-b5c1-eca6c797efc1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:36.235431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e22cda4e-5332-46d0-b5c1-eca6c797efc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64f92553f03c430d9b780d7181289adf', 'request_id': 'req-e22cda4e-5332-46d0-b5c1-eca6c797efc1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:36.247075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e22cda4e-5332-46d0-b5c1-eca6c797efc1 admin admin] The token cache is being invalidate because project 64f92553f03c430d9b780d7181289adf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:36.247652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e22cda4e-5332-46d0-b5c1-eca6c797efc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:36.248473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e22cda4e-5332-46d0-b5c1-eca6c797efc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:36.250504 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2380/4722] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:36 2022] DELETE /identity/v3/projects/64f92553f03c430d9b780d7181289adf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:36.255575 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd950022-cc21-4de0-bf72-0a2e79d8e572 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:36.255990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd950022-cc21-4de0-bf72-0a2e79d8e572 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:36.256363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd950022-cc21-4de0-bf72-0a2e79d8e572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:36.277041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bd950022-cc21-4de0-bf72-0a2e79d8e572 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:36.278712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bd950022-cc21-4de0-bf72-0a2e79d8e572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:36.323098 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2343/4723] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:16:36.336867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd3780-e495-41c5-8413-a45e851e2459 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:36.339189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-76bd3780-e495-41c5-8413-a45e851e2459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:36.375077 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2381/4724] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:36.383779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539f696-b4fc-4d08-8952-85820cb74fec None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:36.386321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539f696-b4fc-4d08-8952-85820cb74fec None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:36.386321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539f696-b4fc-4d08-8952-85820cb74fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:36.415033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c539f696-b4fc-4d08-8952-85820cb74fec None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:36.416489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c539f696-b4fc-4d08-8952-85820cb74fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:36.426827 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2382/4725] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:36.431503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539f696-b4fc-4d08-8952-85820cb74fec None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:36.432325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd3780-e495-41c5-8413-a45e851e2459 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:36.437458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac799b7-7001-4ceb-b576-b4e36fa94eeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:36.438992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac799b7-7001-4ceb-b576-b4e36fa94eeb service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:36.439356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac799b7-7001-4ceb-b576-b4e36fa94eeb service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:36.439782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac799b7-7001-4ceb-b576-b4e36fa94eeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:36.444812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539f696-b4fc-4d08-8952-85820cb74fec None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:36.456838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac799b7-7001-4ceb-b576-b4e36fa94eeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:36.458569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac799b7-7001-4ceb-b576-b4e36fa94eeb service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:36.459399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887df3d-776d-4855-baba-9577c1da0214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:36.460433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887df3d-776d-4855-baba-9577c1da0214 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:36.460676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887df3d-776d-4855-baba-9577c1da0214 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:36.461023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887df3d-776d-4855-baba-9577c1da0214 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:36.461696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887df3d-776d-4855-baba-9577c1da0214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:16:36.462002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887df3d-776d-4855-baba-9577c1da0214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:36.463788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887df3d-776d-4855-baba-9577c1da0214 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:36.471803 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2344/4726] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:36.479134 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2383/4727] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:36.483021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac799b7-7001-4ceb-b576-b4e36fa94eeb service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:36.497526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac799b7-7001-4ceb-b576-b4e36fa94eeb service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:36.503143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e25832-f24c-4d84-92f1-96bc023ef7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:36.504020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e25832-f24c-4d84-92f1-96bc023ef7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:36.505149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e25832-f24c-4d84-92f1-96bc023ef7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:36.505149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e25832-f24c-4d84-92f1-96bc023ef7b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:36.505749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e25832-f24c-4d84-92f1-96bc023ef7b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:36.507954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e25832-f24c-4d84-92f1-96bc023ef7b3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:36.546199 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2345/4728] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:36 2022] POST /identity/v3/projects => generated 355 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:36.550832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887df3d-776d-4855-baba-9577c1da0214 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:36.564358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887df3d-776d-4855-baba-9577c1da0214 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:36.597893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:36.699981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f1323-22b6-4737-8749-2f330b39d790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:36.700725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f1323-22b6-4737-8749-2f330b39d790 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:36.701003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f1323-22b6-4737-8749-2f330b39d790 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:36.701275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f1323-22b6-4737-8749-2f330b39d790 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:36.701980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f1323-22b6-4737-8749-2f330b39d790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:36.704256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f1323-22b6-4737-8749-2f330b39d790 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:36.743919 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2384/4729] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:36 2022] POST /identity/v3/users => generated 278 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:36.751231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e25832-f24c-4d84-92f1-96bc023ef7b3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:36.773701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e25832-f24c-4d84-92f1-96bc023ef7b3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:36.786419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceff709-883f-4262-8a80-ba0b1134f712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:36.788602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceff709-883f-4262-8a80-ba0b1134f712 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:36.789117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceff709-883f-4262-8a80-ba0b1134f712 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:36.790594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceff709-883f-4262-8a80-ba0b1134f712 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:36.798136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceff709-883f-4262-8a80-ba0b1134f712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:36.804378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceff709-883f-4262-8a80-ba0b1134f712 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:36.867212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f1323-22b6-4737-8749-2f330b39d790 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:36.878067 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2346/4730] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:36.884166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f1323-22b6-4737-8749-2f330b39d790 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:36.895553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee6ada-a722-4267-a36c-182d8e3b3ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:36.913085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee6ada-a722-4267-a36c-182d8e3b3ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:36.913389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee6ada-a722-4267-a36c-182d8e3b3ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:36.915669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee6ada-a722-4267-a36c-182d8e3b3ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:36.917916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee6ada-a722-4267-a36c-182d8e3b3ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:36.924461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee6ada-a722-4267-a36c-182d8e3b3ce2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:36.958199 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2385/4731] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:36.962254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceff709-883f-4262-8a80-ba0b1134f712 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:36.987673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceff709-883f-4262-8a80-ba0b1134f712 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:37.001018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62b63f-5980-49de-a2c4-848886b69f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:37.003381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62b63f-5980-49de-a2c4-848886b69f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:37.004975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62b63f-5980-49de-a2c4-848886b69f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:37.005533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62b63f-5980-49de-a2c4-848886b69f58 admin admin] PATH_INFO: `/v3/projects/f0eafd030d67436787290da5463d9b0d/users/884368b082b042e5bf55963cd1417ca2/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:37.038836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62b63f-5980-49de-a2c4-848886b69f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0eafd030d67436787290da5463d9b0d, user_id=884368b082b042e5bf55963cd1417ca2, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:37.040219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee6ada-a722-4267-a36c-182d8e3b3ce2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:37.054162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62b63f-5980-49de-a2c4-848886b69f58 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:37.089279 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2347/4732] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:36 2022] PUT /identity/v3/projects/f0eafd030d67436787290da5463d9b0d/users/884368b082b042e5bf55963cd1417ca2/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:37.100514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef11a40-c425-4579-b6a3-4005b1f52055 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:37.101167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef11a40-c425-4579-b6a3-4005b1f52055 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:37.101682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef11a40-c425-4579-b6a3-4005b1f52055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:37.180581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee6ada-a722-4267-a36c-182d8e3b3ce2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:37.189198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-cef11a40-c425-4579-b6a3-4005b1f52055 None None] MFA Rules not processed for user `884368b082b042e5bf55963cd1417ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:37.193339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cef11a40-c425-4579-b6a3-4005b1f52055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:37.268952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:37.279191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481199b5-56bf-4084-aeab-cf7dcd1e20b4 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbec7da04af74446a0778ac62195420d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3b29afa449427996baf1da9eea1908', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:37.279908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481199b5-56bf-4084-aeab-cf7dcd1e20b4 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:37.281297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481199b5-56bf-4084-aeab-cf7dcd1e20b4 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:37.281761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481199b5-56bf-4084-aeab-cf7dcd1e20b4 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:37.285015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481199b5-56bf-4084-aeab-cf7dcd1e20b4 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:16:37.285336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481199b5-56bf-4084-aeab-cf7dcd1e20b4 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:37.290393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481199b5-56bf-4084-aeab-cf7dcd1e20b4 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:37.324998 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2386/4733] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:16:37.327874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481199b5-56bf-4084-aeab-cf7dcd1e20b4 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:37.344902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481199b5-56bf-4084-aeab-cf7dcd1e20b4 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:37.345887 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2348/4734] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:37 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:16:37.350917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef11a40-c425-4579-b6a3-4005b1f52055 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:37.358396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bdde2-5fe7-4b77-8b43-9ba61aef2e83 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbec7da04af74446a0778ac62195420d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3b29afa449427996baf1da9eea1908', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:37.361127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bdde2-5fe7-4b77-8b43-9ba61aef2e83 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:37.361751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bdde2-5fe7-4b77-8b43-9ba61aef2e83 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:37.362205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bdde2-5fe7-4b77-8b43-9ba61aef2e83 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:37.363359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bdde2-5fe7-4b77-8b43-9ba61aef2e83 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:37.370502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bdde2-5fe7-4b77-8b43-9ba61aef2e83 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:37.416263 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2387/4735] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:37 2022] POST /identity/v3/projects => generated 353 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:37.419742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bdde2-5fe7-4b77-8b43-9ba61aef2e83 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:37.437545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef11a40-c425-4579-b6a3-4005b1f52055 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:37.443929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:37.500134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bdde2-5fe7-4b77-8b43-9ba61aef2e83 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:37.508638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06797a37-2f19-48cc-ad1d-d853a5c2cb2f tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbec7da04af74446a0778ac62195420d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3b29afa449427996baf1da9eea1908', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:37.508850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06797a37-2f19-48cc-ad1d-d853a5c2cb2f tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:37.509225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06797a37-2f19-48cc-ad1d-d853a5c2cb2f tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:37.509515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06797a37-2f19-48cc-ad1d-d853a5c2cb2f tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:37.510529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06797a37-2f19-48cc-ad1d-d853a5c2cb2f tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:16:37.510894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06797a37-2f19-48cc-ad1d-d853a5c2cb2f tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:37.512751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06797a37-2f19-48cc-ad1d-d853a5c2cb2f tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:37.518704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff752d-e026-44fd-b08b-fb86586fec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:37.519778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff752d-e026-44fd-b08b-fb86586fec0e admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:37.520432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff752d-e026-44fd-b08b-fb86586fec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:37.520893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff752d-e026-44fd-b08b-fb86586fec0e admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:37.522263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff752d-e026-44fd-b08b-fb86586fec0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:37.524619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff752d-e026-44fd-b08b-fb86586fec0e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:37.531765 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2388/4736] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:37.562732 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2349/4737] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:37 2022] POST /identity/v3/projects => generated 357 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:37.567252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06797a37-2f19-48cc-ad1d-d853a5c2cb2f tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:37.584187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06797a37-2f19-48cc-ad1d-d853a5c2cb2f tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:37.586206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff752d-e026-44fd-b08b-fb86586fec0e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:37.665376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3e320-4a98-4b12-ac42-c41dee14858f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:37.666581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3e320-4a98-4b12-ac42-c41dee14858f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:37.668337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3e320-4a98-4b12-ac42-c41dee14858f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:37.668938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba3e320-4a98-4b12-ac42-c41dee14858f admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:37.670607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3e320-4a98-4b12-ac42-c41dee14858f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:37.674110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba3e320-4a98-4b12-ac42-c41dee14858f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:37.676018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff752d-e026-44fd-b08b-fb86586fec0e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:37.683338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf3f43-316d-48a5-8c72-725af1384219 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbec7da04af74446a0778ac62195420d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3b29afa449427996baf1da9eea1908', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:37.684638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf3f43-316d-48a5-8c72-725af1384219 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:37.684923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf3f43-316d-48a5-8c72-725af1384219 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:37.685197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf3f43-316d-48a5-8c72-725af1384219 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] PATH_INFO: `/v3/projects/10a20989cb4440eba979db557b7e1de1` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:37.686455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf3f43-316d-48a5-8c72-725af1384219 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] RBAC: Authorizing `identity:delete_project(project_id=10a20989cb4440eba979db557b7e1de1)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:37.688734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf3f43-316d-48a5-8c72-725af1384219 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:37.692776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:37.705545 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2389/4738] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:37 2022] POST /identity/v3/users => generated 285 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:37.709877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3e320-4a98-4b12-ac42-c41dee14858f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:37.722553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba3e320-4a98-4b12-ac42-c41dee14858f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:37.730845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104e36f-e430-4a06-9555-92be205b07ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:37.731847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104e36f-e430-4a06-9555-92be205b07ac admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:37.732621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104e36f-e430-4a06-9555-92be205b07ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:37.732919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104e36f-e430-4a06-9555-92be205b07ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:37.733909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104e36f-e430-4a06-9555-92be205b07ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:37.737612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104e36f-e430-4a06-9555-92be205b07ac admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:37.754935 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2390/4739] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:37.756487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104e36f-e430-4a06-9555-92be205b07ac admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:37.768386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104e36f-e430-4a06-9555-92be205b07ac admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:37.773763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2dbf3f43-316d-48a5-8c72-725af1384219 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a20989cb4440eba979db557b7e1de1', 'request_id': 'req-2dbf3f43-316d-48a5-8c72-725af1384219'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:37.781822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2dbf3f43-316d-48a5-8c72-725af1384219 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a20989cb4440eba979db557b7e1de1', 'request_id': 'req-2dbf3f43-316d-48a5-8c72-725af1384219'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:37.789394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2dbf3f43-316d-48a5-8c72-725af1384219 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a20989cb4440eba979db557b7e1de1', 'request_id': 'req-2dbf3f43-316d-48a5-8c72-725af1384219'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:37.813197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2dbf3f43-316d-48a5-8c72-725af1384219 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] The token cache is being invalidate because project 10a20989cb4440eba979db557b7e1de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:37.813503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2dbf3f43-316d-48a5-8c72-725af1384219 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:37.814736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2dbf3f43-316d-48a5-8c72-725af1384219 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:37.820432 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2350/4740] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:37 2022] DELETE /identity/v3/projects/10a20989cb4440eba979db557b7e1de1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:37.867912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040034e6-eb1c-40d0-8ae1-6e4207f37e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:37.869841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040034e6-eb1c-40d0-8ae1-6e4207f37e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:37.876374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040034e6-eb1c-40d0-8ae1-6e4207f37e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:37.876736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040034e6-eb1c-40d0-8ae1-6e4207f37e50 admin admin] PATH_INFO: `/v3/projects/2fb4e674ab77425689ecffe60170db19/users/ea19b9d7c6834b838cb1603cbbf78f98/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:37.900648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040034e6-eb1c-40d0-8ae1-6e4207f37e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb4e674ab77425689ecffe60170db19, user_id=ea19b9d7c6834b838cb1603cbbf78f98, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:37.903632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040034e6-eb1c-40d0-8ae1-6e4207f37e50 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:37.919966 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2391/4741] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:37 2022] PUT /identity/v3/projects/2fb4e674ab77425689ecffe60170db19/users/ea19b9d7c6834b838cb1603cbbf78f98/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:37.925178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf3f43-316d-48a5-8c72-725af1384219 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:37.927231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2dbf3f43-316d-48a5-8c72-725af1384219 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:37.952584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf3f43-316d-48a5-8c72-725af1384219 tempest-VolumeQuotaClassesTest-1404424267 tempest-VolumeQuotaClassesTest-1404424267-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:38.078998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f0899-21f0-4a2b-81fd-134407e9ff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:38.079806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f0899-21f0-4a2b-81fd-134407e9ff50 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:38.080075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f0899-21f0-4a2b-81fd-134407e9ff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:38.080360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f0899-21f0-4a2b-81fd-134407e9ff50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:38.081095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f0899-21f0-4a2b-81fd-134407e9ff50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:38.082708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f0899-21f0-4a2b-81fd-134407e9ff50 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:38.109390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040034e6-eb1c-40d0-8ae1-6e4207f37e50 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:38.110803 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2351/4742] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:16:38.128584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040034e6-eb1c-40d0-8ae1-6e4207f37e50 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:38.135972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2475d-4d1f-45b2-9347-7c63b79c686e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:38.136989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2475d-4d1f-45b2-9347-7c63b79c686e admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:38.137304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2475d-4d1f-45b2-9347-7c63b79c686e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:38.137607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2475d-4d1f-45b2-9347-7c63b79c686e admin admin] PATH_INFO: `/v3/projects/2fb4e674ab77425689ecffe60170db19/users/ea19b9d7c6834b838cb1603cbbf78f98/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:38.140602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2475d-4d1f-45b2-9347-7c63b79c686e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb4e674ab77425689ecffe60170db19, user_id=ea19b9d7c6834b838cb1603cbbf78f98, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:38.144106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2475d-4d1f-45b2-9347-7c63b79c686e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:38.157078 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2392/4743] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:38 2022] PUT /identity/v3/projects/2fb4e674ab77425689ecffe60170db19/users/ea19b9d7c6834b838cb1603cbbf78f98/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:38.168939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34690a13-c46c-4feb-b412-826e1fd698fc None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:38.170393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34690a13-c46c-4feb-b412-826e1fd698fc None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:38.170393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34690a13-c46c-4feb-b412-826e1fd698fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:38.173323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2475d-4d1f-45b2-9347-7c63b79c686e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:38.175370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ccb2475d-4d1f-45b2-9347-7c63b79c686e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:38.189655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:38.217900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-34690a13-c46c-4feb-b412-826e1fd698fc None None] MFA Rules not processed for user `ea19b9d7c6834b838cb1603cbbf78f98`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:38.219727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-34690a13-c46c-4feb-b412-826e1fd698fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:38.376437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2475d-4d1f-45b2-9347-7c63b79c686e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:38.388344 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2352/4744] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:38 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:38.389237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b28bf9-b83a-46bc-938d-b4a03cb639b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:38.391569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34690a13-c46c-4feb-b412-826e1fd698fc None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:38.392916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b28bf9-b83a-46bc-938d-b4a03cb639b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:38.396438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b28bf9-b83a-46bc-938d-b4a03cb639b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:38.400512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b28bf9-b83a-46bc-938d-b4a03cb639b6 admin admin] PATH_INFO: `/v3/users/60a0ee3b243b4d96b8c9c77da4d698e9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:38.403426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b28bf9-b83a-46bc-938d-b4a03cb639b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60a0ee3b243b4d96b8c9c77da4d698e9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:38.406676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b28bf9-b83a-46bc-938d-b4a03cb639b6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:38.408546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34690a13-c46c-4feb-b412-826e1fd698fc None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:38.418710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e703c24-2e57-4c0a-974b-ca9d2decc60a tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea19b9d7c6834b838cb1603cbbf78f98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fb4e674ab77425689ecffe60170db19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:38.436285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e703c24-2e57-4c0a-974b-ca9d2decc60a tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:38.436752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e703c24-2e57-4c0a-974b-ca9d2decc60a tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:38.437071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e703c24-2e57-4c0a-974b-ca9d2decc60a tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:38.437999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e703c24-2e57-4c0a-974b-ca9d2decc60a tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:16:38.438344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e703c24-2e57-4c0a-974b-ca9d2decc60a tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:38.440720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e703c24-2e57-4c0a-974b-ca9d2decc60a tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:38.459102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:38.474694 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2353/4745] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:38.480505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e703c24-2e57-4c0a-974b-ca9d2decc60a tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:38.501844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e703c24-2e57-4c0a-974b-ca9d2decc60a tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:38.510848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad35d8-fce7-4111-9dbe-c4a16a024797 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea19b9d7c6834b838cb1603cbbf78f98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fb4e674ab77425689ecffe60170db19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:38.511536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad35d8-fce7-4111-9dbe-c4a16a024797 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:38.511822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad35d8-fce7-4111-9dbe-c4a16a024797 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:38.512334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-40b28bf9-b83a-46bc-938d-b4a03cb639b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60a0ee3b243b4d96b8c9c77da4d698e9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:38.512557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad35d8-fce7-4111-9dbe-c4a16a024797 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:38.513424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad35d8-fce7-4111-9dbe-c4a16a024797 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:38.517225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad35d8-fce7-4111-9dbe-c4a16a024797 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:38.525085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-40b28bf9-b83a-46bc-938d-b4a03cb639b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60a0ee3b243b4d96b8c9c77da4d698e9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:38.526461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-40b28bf9-b83a-46bc-938d-b4a03cb639b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60a0ee3b243b4d96b8c9c77da4d698e9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:38.528254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-40b28bf9-b83a-46bc-938d-b4a03cb639b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60a0ee3b243b4d96b8c9c77da4d698e9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:38.546913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-40b28bf9-b83a-46bc-938d-b4a03cb639b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60a0ee3b243b4d96b8c9c77da4d698e9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:38.595228 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2354/4746] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:38 2022] POST /identity/v3/projects => generated 350 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:38.597995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad35d8-fce7-4111-9dbe-c4a16a024797 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:38.600960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e9ad35d8-fce7-4111-9dbe-c4a16a024797 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:38.612137 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2393/4747] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:38 2022] DELETE /identity/v3/users/60a0ee3b243b4d96b8c9c77da4d698e9 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:38.618273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391285d-16e3-4aa1-8a62-bdea2bb060aa None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:38.618557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391285d-16e3-4aa1-8a62-bdea2bb060aa None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:38.618832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391285d-16e3-4aa1-8a62-bdea2bb060aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:38.654092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1391285d-16e3-4aa1-8a62-bdea2bb060aa None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:38.655846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1391285d-16e3-4aa1-8a62-bdea2bb060aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:38.761369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad35d8-fce7-4111-9dbe-c4a16a024797 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:38.792644 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2394/4748] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:38.804507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391285d-16e3-4aa1-8a62-bdea2bb060aa None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:38.806956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1391285d-16e3-4aa1-8a62-bdea2bb060aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:38.865358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:38.919403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccafcf-da07-4337-94ec-584162a42dc0 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea19b9d7c6834b838cb1603cbbf78f98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fb4e674ab77425689ecffe60170db19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:38.919943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391285d-16e3-4aa1-8a62-bdea2bb060aa None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:38.920650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccafcf-da07-4337-94ec-584162a42dc0 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:38.921210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccafcf-da07-4337-94ec-584162a42dc0 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:38.922167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccafcf-da07-4337-94ec-584162a42dc0 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:38.923222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccafcf-da07-4337-94ec-584162a42dc0 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:16:38.923596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccafcf-da07-4337-94ec-584162a42dc0 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:38.925602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b04a51-1056-4abb-b949-728806d9cbb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:38.926200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccafcf-da07-4337-94ec-584162a42dc0 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:38.926826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b04a51-1056-4abb-b949-728806d9cbb4 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:38.927678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b04a51-1056-4abb-b949-728806d9cbb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:38.928635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b04a51-1056-4abb-b949-728806d9cbb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:38.941534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b04a51-1056-4abb-b949-728806d9cbb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:38.943618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b04a51-1056-4abb-b949-728806d9cbb4 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:38.953274 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2355/4749] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:38.964603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccafcf-da07-4337-94ec-584162a42dc0 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:38.966837 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2395/4750] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:38.980776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccafcf-da07-4337-94ec-584162a42dc0 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:38.985876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56042fd8-6a19-4805-8de0-34b97cea3ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:38.988226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56042fd8-6a19-4805-8de0-34b97cea3ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:38.988711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56042fd8-6a19-4805-8de0-34b97cea3ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:38.989305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56042fd8-6a19-4805-8de0-34b97cea3ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:39.005006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56042fd8-6a19-4805-8de0-34b97cea3ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:39.007020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56042fd8-6a19-4805-8de0-34b97cea3ea2 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:39.021360 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2356/4751] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:38 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:39.373894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b04a51-1056-4abb-b949-728806d9cbb4 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:39.389572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b04a51-1056-4abb-b949-728806d9cbb4 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:39.402477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c6237-6bd7-47e8-965a-e3df363271f5 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea19b9d7c6834b838cb1603cbbf78f98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fb4e674ab77425689ecffe60170db19', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:39.404199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c6237-6bd7-47e8-965a-e3df363271f5 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:39.405338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c6237-6bd7-47e8-965a-e3df363271f5 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:39.405635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c6237-6bd7-47e8-965a-e3df363271f5 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] PATH_INFO: `/v3/projects/7fcafebc272b4805b80f21caff4cb064` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:39.408318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c6237-6bd7-47e8-965a-e3df363271f5 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7fcafebc272b4805b80f21caff4cb064)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:39.412336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c6237-6bd7-47e8-965a-e3df363271f5 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:39.477252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56042fd8-6a19-4805-8de0-34b97cea3ea2 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:39.478962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-56042fd8-6a19-4805-8de0-34b97cea3ea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:39.505775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56042fd8-6a19-4805-8de0-34b97cea3ea2 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:39.522068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21060070-8fcd-4f62-92a7-67b9fec0f567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:39.523091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21060070-8fcd-4f62-92a7-67b9fec0f567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:39.523953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21060070-8fcd-4f62-92a7-67b9fec0f567 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:39.524318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21060070-8fcd-4f62-92a7-67b9fec0f567 admin admin] PATH_INFO: `/v3/users/649c6088b26049ba9a765be082f38259` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:39.527169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21060070-8fcd-4f62-92a7-67b9fec0f567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=649c6088b26049ba9a765be082f38259)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:39.533242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21060070-8fcd-4f62-92a7-67b9fec0f567 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:39.538304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-713c6237-6bd7-47e8-965a-e3df363271f5 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fcafebc272b4805b80f21caff4cb064', 'request_id': 'req-713c6237-6bd7-47e8-965a-e3df363271f5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:39.557455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-713c6237-6bd7-47e8-965a-e3df363271f5 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fcafebc272b4805b80f21caff4cb064', 'request_id': 'req-713c6237-6bd7-47e8-965a-e3df363271f5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:39.567436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-713c6237-6bd7-47e8-965a-e3df363271f5 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fcafebc272b4805b80f21caff4cb064', 'request_id': 'req-713c6237-6bd7-47e8-965a-e3df363271f5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:39.582309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-713c6237-6bd7-47e8-965a-e3df363271f5 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] The token cache is being invalidate because project 7fcafebc272b4805b80f21caff4cb064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:39.582616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-713c6237-6bd7-47e8-965a-e3df363271f5 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:39.583362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-713c6237-6bd7-47e8-965a-e3df363271f5 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:39.585454 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2396/4752] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:39 2022] DELETE /identity/v3/projects/7fcafebc272b4805b80f21caff4cb064 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:39.586420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c6237-6bd7-47e8-965a-e3df363271f5 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:39.588277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-713c6237-6bd7-47e8-965a-e3df363271f5 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:39.660926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21060070-8fcd-4f62-92a7-67b9fec0f567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '649c6088b26049ba9a765be082f38259'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:39.678760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21060070-8fcd-4f62-92a7-67b9fec0f567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '649c6088b26049ba9a765be082f38259'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:39.691807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:39.701514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21060070-8fcd-4f62-92a7-67b9fec0f567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '649c6088b26049ba9a765be082f38259'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:39.702493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21060070-8fcd-4f62-92a7-67b9fec0f567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '649c6088b26049ba9a765be082f38259'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:39.703355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21060070-8fcd-4f62-92a7-67b9fec0f567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '649c6088b26049ba9a765be082f38259'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:39.704665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c6237-6bd7-47e8-965a-e3df363271f5 tempest-QuotasTest-1188768086 tempest-QuotasTest-1188768086-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:39.713033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49d02a-2472-4d92-95ed-524f169d1ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:39.714268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49d02a-2472-4d92-95ed-524f169d1ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:39.714664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49d02a-2472-4d92-95ed-524f169d1ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:39.715009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49d02a-2472-4d92-95ed-524f169d1ccf admin admin] PATH_INFO: `/v3/projects/98655c9000bb488ca2ef25bca62b80f6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:39.717354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49d02a-2472-4d92-95ed-524f169d1ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=98655c9000bb488ca2ef25bca62b80f6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:39.719782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49d02a-2472-4d92-95ed-524f169d1ccf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:39.734934 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2357/4753] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:39 2022] DELETE /identity/v3/users/649c6088b26049ba9a765be082f38259 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:39.792062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8c49d02a-2472-4d92-95ed-524f169d1ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98655c9000bb488ca2ef25bca62b80f6', 'request_id': 'req-8c49d02a-2472-4d92-95ed-524f169d1ccf'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:39.793914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:39.803869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8c49d02a-2472-4d92-95ed-524f169d1ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98655c9000bb488ca2ef25bca62b80f6', 'request_id': 'req-8c49d02a-2472-4d92-95ed-524f169d1ccf'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:39.813218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8c49d02a-2472-4d92-95ed-524f169d1ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98655c9000bb488ca2ef25bca62b80f6', 'request_id': 'req-8c49d02a-2472-4d92-95ed-524f169d1ccf'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:39.827476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8c49d02a-2472-4d92-95ed-524f169d1ccf admin admin] The token cache is being invalidate because project 98655c9000bb488ca2ef25bca62b80f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:39.827910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8c49d02a-2472-4d92-95ed-524f169d1ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:39.829368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8c49d02a-2472-4d92-95ed-524f169d1ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:39.832086 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2397/4754] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:39 2022] DELETE /identity/v3/projects/98655c9000bb488ca2ef25bca62b80f6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:39.836280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21060070-8fcd-4f62-92a7-67b9fec0f567 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:39.838017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-21060070-8fcd-4f62-92a7-67b9fec0f567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:39.926894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21060070-8fcd-4f62-92a7-67b9fec0f567 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:40.030526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da00bd-2d29-48a4-a9c8-0a350b0b9f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:40.031382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da00bd-2d29-48a4-a9c8-0a350b0b9f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:40.033109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da00bd-2d29-48a4-a9c8-0a350b0b9f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:40.033583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da00bd-2d29-48a4-a9c8-0a350b0b9f8c admin admin] PATH_INFO: `/v3/users/dbec7da04af74446a0778ac62195420d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:40.035313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da00bd-2d29-48a4-a9c8-0a350b0b9f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbec7da04af74446a0778ac62195420d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:40.040544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da00bd-2d29-48a4-a9c8-0a350b0b9f8c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:40.137401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-41da00bd-2d29-48a4-a9c8-0a350b0b9f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbec7da04af74446a0778ac62195420d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:40.155795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-41da00bd-2d29-48a4-a9c8-0a350b0b9f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbec7da04af74446a0778ac62195420d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:40.177131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-41da00bd-2d29-48a4-a9c8-0a350b0b9f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbec7da04af74446a0778ac62195420d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:40.179572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-41da00bd-2d29-48a4-a9c8-0a350b0b9f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbec7da04af74446a0778ac62195420d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:40.180399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-41da00bd-2d29-48a4-a9c8-0a350b0b9f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbec7da04af74446a0778ac62195420d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:40.252431 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2358/4755] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:39 2022] DELETE /identity/v3/users/dbec7da04af74446a0778ac62195420d => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:40.453174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49d02a-2472-4d92-95ed-524f169d1ccf admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:40.456460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8c49d02a-2472-4d92-95ed-524f169d1ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:40.483825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49d02a-2472-4d92-95ed-524f169d1ccf admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:40.531592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da00bd-2d29-48a4-a9c8-0a350b0b9f8c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:40.534523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-41da00bd-2d29-48a4-a9c8-0a350b0b9f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:40.544775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:40.621582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e7386-e42d-4fd4-828d-bcd95c7538ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:40.623317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e7386-e42d-4fd4-828d-bcd95c7538ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:40.625104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e7386-e42d-4fd4-828d-bcd95c7538ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:40.626701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e7386-e42d-4fd4-828d-bcd95c7538ea admin admin] PATH_INFO: `/v3/projects/ebcb0a2922d64d6e8d0c4114e10b954d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:40.631921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e7386-e42d-4fd4-828d-bcd95c7538ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebcb0a2922d64d6e8d0c4114e10b954d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:40.636131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e7386-e42d-4fd4-828d-bcd95c7538ea admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:40.698670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da00bd-2d29-48a4-a9c8-0a350b0b9f8c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:40.708077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b4355-ac12-49cc-88bd-eef0c759c343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:40.709356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b4355-ac12-49cc-88bd-eef0c759c343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:40.709356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b4355-ac12-49cc-88bd-eef0c759c343 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:40.709921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b4355-ac12-49cc-88bd-eef0c759c343 admin admin] PATH_INFO: `/v3/users/ad75c47e5e1f4d3ea6f7643eff6c9e0d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:40.714657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b4355-ac12-49cc-88bd-eef0c759c343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad75c47e5e1f4d3ea6f7643eff6c9e0d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:40.717913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b4355-ac12-49cc-88bd-eef0c759c343 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:40.745994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2c1e7386-e42d-4fd4-828d-bcd95c7538ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'request_id': 'req-2c1e7386-e42d-4fd4-828d-bcd95c7538ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:40.759283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2c1e7386-e42d-4fd4-828d-bcd95c7538ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'request_id': 'req-2c1e7386-e42d-4fd4-828d-bcd95c7538ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:40.787777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2c1e7386-e42d-4fd4-828d-bcd95c7538ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'request_id': 'req-2c1e7386-e42d-4fd4-828d-bcd95c7538ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:40.807454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2c1e7386-e42d-4fd4-828d-bcd95c7538ea admin admin] The token cache is being invalidate because project ebcb0a2922d64d6e8d0c4114e10b954d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:40.808029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2c1e7386-e42d-4fd4-828d-bcd95c7538ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:40.808997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2c1e7386-e42d-4fd4-828d-bcd95c7538ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:40.816272 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2398/4756] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:40 2022] DELETE /identity/v3/projects/ebcb0a2922d64d6e8d0c4114e10b954d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:40.817311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e7386-e42d-4fd4-828d-bcd95c7538ea admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:40.818942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2c1e7386-e42d-4fd4-828d-bcd95c7538ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:40.819937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc3b4355-ac12-49cc-88bd-eef0c759c343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:40.831929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc3b4355-ac12-49cc-88bd-eef0c759c343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:40.846778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc3b4355-ac12-49cc-88bd-eef0c759c343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:40.848815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc3b4355-ac12-49cc-88bd-eef0c759c343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:40.850012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc3b4355-ac12-49cc-88bd-eef0c759c343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:40.879250 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2359/4757] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:40 2022] DELETE /identity/v3/users/ad75c47e5e1f4d3ea6f7643eff6c9e0d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:40.881238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f954d-a038-4dd4-864e-405237e7d9a6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:40.882231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f954d-a038-4dd4-864e-405237e7d9a6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:40.882738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f954d-a038-4dd4-864e-405237e7d9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:40.909361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a99f954d-a038-4dd4-864e-405237e7d9a6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:40.911249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a99f954d-a038-4dd4-864e-405237e7d9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:40.980185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e7386-e42d-4fd4-828d-bcd95c7538ea admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:41.012329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:41.102335 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2360/4758] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:41.102335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f942fb-ac16-48ab-8492-be14a5640b2c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:41.102335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f942fb-ac16-48ab-8492-be14a5640b2c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:41.102335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f942fb-ac16-48ab-8492-be14a5640b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:41.132631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f3978-71e6-43be-bf3f-bee1789f16bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:41.134350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f3978-71e6-43be-bf3f-bee1789f16bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:41.134808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f3978-71e6-43be-bf3f-bee1789f16bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:41.135388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f3978-71e6-43be-bf3f-bee1789f16bf admin admin] PATH_INFO: `/v3/users/884368b082b042e5bf55963cd1417ca2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:41.137325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f3978-71e6-43be-bf3f-bee1789f16bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=884368b082b042e5bf55963cd1417ca2)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:41.139657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f3978-71e6-43be-bf3f-bee1789f16bf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:41.150937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-83f942fb-ac16-48ab-8492-be14a5640b2c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:41.152661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-83f942fb-ac16-48ab-8492-be14a5640b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:41.164950 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2361/4759] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:41.165209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f942fb-ac16-48ab-8492-be14a5640b2c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:41.166768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-83f942fb-ac16-48ab-8492-be14a5640b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:41.183197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f942fb-ac16-48ab-8492-be14a5640b2c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:41.192354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d844617-f4c9-4daf-9195-6ddbdfd3a554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:41.193347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d844617-f4c9-4daf-9195-6ddbdfd3a554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:41.193628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d844617-f4c9-4daf-9195-6ddbdfd3a554 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:41.193948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d844617-f4c9-4daf-9195-6ddbdfd3a554 admin admin] PATH_INFO: `/v3/projects/4d3b29afa449427996baf1da9eea1908` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:41.195425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d844617-f4c9-4daf-9195-6ddbdfd3a554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d3b29afa449427996baf1da9eea1908)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:41.199232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d844617-f4c9-4daf-9195-6ddbdfd3a554 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:41.248183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:41.275481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-444f3978-71e6-43be-bf3f-bee1789f16bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '884368b082b042e5bf55963cd1417ca2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:41.296811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-444f3978-71e6-43be-bf3f-bee1789f16bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '884368b082b042e5bf55963cd1417ca2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:41.297607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-444f3978-71e6-43be-bf3f-bee1789f16bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '884368b082b042e5bf55963cd1417ca2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:41.298573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-444f3978-71e6-43be-bf3f-bee1789f16bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '884368b082b042e5bf55963cd1417ca2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:41.310537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0d844617-f4c9-4daf-9195-6ddbdfd3a554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d3b29afa449427996baf1da9eea1908', 'request_id': 'req-0d844617-f4c9-4daf-9195-6ddbdfd3a554'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:41.310787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-444f3978-71e6-43be-bf3f-bee1789f16bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '884368b082b042e5bf55963cd1417ca2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:41.318620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0d844617-f4c9-4daf-9195-6ddbdfd3a554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d3b29afa449427996baf1da9eea1908', 'request_id': 'req-0d844617-f4c9-4daf-9195-6ddbdfd3a554'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:41.326928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0d844617-f4c9-4daf-9195-6ddbdfd3a554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d3b29afa449427996baf1da9eea1908', 'request_id': 'req-0d844617-f4c9-4daf-9195-6ddbdfd3a554'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:41.339037 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2399/4760] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:40 2022] DELETE /identity/v3/users/884368b082b042e5bf55963cd1417ca2 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:41.340401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cd500-2d3d-4f58-a0ba-3f292c2beac4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:41.340934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cd500-2d3d-4f58-a0ba-3f292c2beac4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:41.341336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cd500-2d3d-4f58-a0ba-3f292c2beac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:41.361407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0d844617-f4c9-4daf-9195-6ddbdfd3a554 admin admin] The token cache is being invalidate because project 4d3b29afa449427996baf1da9eea1908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:41.361796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0d844617-f4c9-4daf-9195-6ddbdfd3a554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:41.364354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0d844617-f4c9-4daf-9195-6ddbdfd3a554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:41.366555 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2362/4761] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:41 2022] DELETE /identity/v3/projects/4d3b29afa449427996baf1da9eea1908 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:41.368347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d844617-f4c9-4daf-9195-6ddbdfd3a554 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:41.370001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0d844617-f4c9-4daf-9195-6ddbdfd3a554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:41.377715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b33cd500-2d3d-4f58-a0ba-3f292c2beac4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:41.380303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b33cd500-2d3d-4f58-a0ba-3f292c2beac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:41.487596 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2400/4762] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:41.492237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac5f88-39bd-4688-9d71-e183866fc734 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:41.492237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac5f88-39bd-4688-9d71-e183866fc734 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:41.493938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac5f88-39bd-4688-9d71-e183866fc734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:41.511282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d844617-f4c9-4daf-9195-6ddbdfd3a554 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:41.529982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-adac5f88-39bd-4688-9d71-e183866fc734 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:41.532087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-adac5f88-39bd-4688-9d71-e183866fc734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:41.549244 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2401/4763] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:41.551493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ead48-2d00-4173-8079-b588c3809812 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:41.560188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ead48-2d00-4173-8079-b588c3809812 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:41.560730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ead48-2d00-4173-8079-b588c3809812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:41.591300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f92ead48-2d00-4173-8079-b588c3809812 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:41.592887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f92ead48-2d00-4173-8079-b588c3809812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:41.604798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f0dde-02e1-4c4e-b69c-bd996f5cd712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:41.605624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f0dde-02e1-4c4e-b69c-bd996f5cd712 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:41.606058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f0dde-02e1-4c4e-b69c-bd996f5cd712 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:41.606332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f0dde-02e1-4c4e-b69c-bd996f5cd712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:41.606860 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2402/4764] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:41.608566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ead48-2d00-4173-8079-b588c3809812 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:41.608707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-169f0dde-02e1-4c4e-b69c-bd996f5cd712 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:41.622591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ead48-2d00-4173-8079-b588c3809812 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:41.627200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f0dde-02e1-4c4e-b69c-bd996f5cd712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:41.629048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f0dde-02e1-4c4e-b69c-bd996f5cd712 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:41.630557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedbdec-8ac6-4b41-8d32-5aa2a62808cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:41.631508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedbdec-8ac6-4b41-8d32-5aa2a62808cb admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:41.632011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedbdec-8ac6-4b41-8d32-5aa2a62808cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:41.632675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedbdec-8ac6-4b41-8d32-5aa2a62808cb admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:41.633894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedbdec-8ac6-4b41-8d32-5aa2a62808cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:16:41.634441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedbdec-8ac6-4b41-8d32-5aa2a62808cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:41.636497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedbdec-8ac6-4b41-8d32-5aa2a62808cb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:41.642337 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2363/4765] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:41.643238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f0dde-02e1-4c4e-b69c-bd996f5cd712 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:41.654577 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2403/4766] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:41.656505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d4390-1fec-4385-b76a-e6da1fa120e8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:41.656995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d4390-1fec-4385-b76a-e6da1fa120e8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:41.657485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d4390-1fec-4385-b76a-e6da1fa120e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:41.661570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f0dde-02e1-4c4e-b69c-bd996f5cd712 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:41.666615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e6fad-c47c-45f8-aa06-fc1d2dd0f0a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:41.667793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e6fad-c47c-45f8-aa06-fc1d2dd0f0a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:41.668529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e6fad-c47c-45f8-aa06-fc1d2dd0f0a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:41.668976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e6fad-c47c-45f8-aa06-fc1d2dd0f0a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:41.687794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e72d4390-1fec-4385-b76a-e6da1fa120e8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:41.689363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e72d4390-1fec-4385-b76a-e6da1fa120e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:41.690628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e6fad-c47c-45f8-aa06-fc1d2dd0f0a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:41.693453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e6fad-c47c-45f8-aa06-fc1d2dd0f0a5 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:41.700344 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2404/4767] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:41.701345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d4390-1fec-4385-b76a-e6da1fa120e8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:41.707540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:41.711116 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2364/4768] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:41.712296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e6fad-c47c-45f8-aa06-fc1d2dd0f0a5 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:41.715243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d4390-1fec-4385-b76a-e6da1fa120e8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:41.729014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e6fad-c47c-45f8-aa06-fc1d2dd0f0a5 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:41.731813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e5dfd-e7b0-4671-b704-aadb11a4090d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:41.732648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e5dfd-e7b0-4671-b704-aadb11a4090d admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:41.733564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e5dfd-e7b0-4671-b704-aadb11a4090d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:41.733564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e5dfd-e7b0-4671-b704-aadb11a4090d admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:41.734566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e5dfd-e7b0-4671-b704-aadb11a4090d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:41.736578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e5dfd-e7b0-4671-b704-aadb11a4090d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:41.744600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052492b8-79f6-442c-b5ee-43c4a435b2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:41.745286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052492b8-79f6-442c-b5ee-43c4a435b2ca admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:41.745638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052492b8-79f6-442c-b5ee-43c4a435b2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:41.745920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052492b8-79f6-442c-b5ee-43c4a435b2ca admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:41.746662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052492b8-79f6-442c-b5ee-43c4a435b2ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:16:41.746984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052492b8-79f6-442c-b5ee-43c4a435b2ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:41.752637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052492b8-79f6-442c-b5ee-43c4a435b2ca admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:41.780790 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2365/4769] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:41.785497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052492b8-79f6-442c-b5ee-43c4a435b2ca admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:41.805964 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2405/4770] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:41 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:41.823032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052492b8-79f6-442c-b5ee-43c4a435b2ca admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:41.836412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e5dfd-e7b0-4671-b704-aadb11a4090d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:41.935692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:41.973124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e5dfd-e7b0-4671-b704-aadb11a4090d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:41.980237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e1fc9-f4c3-4c89-8097-6aa3f4f422a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:41.981114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e1fc9-f4c3-4c89-8097-6aa3f4f422a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:41.981494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e1fc9-f4c3-4c89-8097-6aa3f4f422a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:41.981770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e1fc9-f4c3-4c89-8097-6aa3f4f422a8 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:41.982647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e1fc9-f4c3-4c89-8097-6aa3f4f422a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:41.986040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e1fc9-f4c3-4c89-8097-6aa3f4f422a8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:41.998025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328fb92-81f6-4563-829c-17e92b822f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:41.999025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328fb92-81f6-4563-829c-17e92b822f5f admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:41.999158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328fb92-81f6-4563-829c-17e92b822f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:41.999364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328fb92-81f6-4563-829c-17e92b822f5f admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:42.005446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328fb92-81f6-4563-829c-17e92b822f5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:42.007660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328fb92-81f6-4563-829c-17e92b822f5f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:42.031069 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2406/4771] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:41 2022] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:42.035394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e1fc9-f4c3-4c89-8097-6aa3f4f422a8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:42.049105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e1fc9-f4c3-4c89-8097-6aa3f4f422a8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:42.056826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897ab3c-7594-42d9-94b4-2caf9c5c684c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:42.057948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897ab3c-7594-42d9-94b4-2caf9c5c684c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:42.058421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897ab3c-7594-42d9-94b4-2caf9c5c684c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:42.058875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897ab3c-7594-42d9-94b4-2caf9c5c684c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:42.059811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897ab3c-7594-42d9-94b4-2caf9c5c684c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:42.061011 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2366/4772] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:41 2022] POST /identity/v3/projects => generated 385 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:42.061959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897ab3c-7594-42d9-94b4-2caf9c5c684c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:42.062137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328fb92-81f6-4563-829c-17e92b822f5f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:42.075620 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2407/4773] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:42.079844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897ab3c-7594-42d9-94b4-2caf9c5c684c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:42.092574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897ab3c-7594-42d9-94b4-2caf9c5c684c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:42.190043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328fb92-81f6-4563-829c-17e92b822f5f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:42.197033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce982b-fc77-43ed-8962-8b934c749289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:42.199247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce982b-fc77-43ed-8962-8b934c749289 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:42.199544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce982b-fc77-43ed-8962-8b934c749289 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:42.199851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce982b-fc77-43ed-8962-8b934c749289 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:42.200999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce982b-fc77-43ed-8962-8b934c749289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:42.204802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce982b-fc77-43ed-8962-8b934c749289 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:42.222255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3668f-0924-46a7-8a66-e12684aaed20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:42.222993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3668f-0924-46a7-8a66-e12684aaed20 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:42.223276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3668f-0924-46a7-8a66-e12684aaed20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:42.224539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3668f-0924-46a7-8a66-e12684aaed20 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:42.225589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3668f-0924-46a7-8a66-e12684aaed20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:42.228176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3668f-0924-46a7-8a66-e12684aaed20 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:42.261813 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2367/4774] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:42 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:42.266148 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2408/4775] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:42.267011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce982b-fc77-43ed-8962-8b934c749289 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:42.267851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3668f-0924-46a7-8a66-e12684aaed20 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:42.289757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce982b-fc77-43ed-8962-8b934c749289 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:42.293309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3668f-0924-46a7-8a66-e12684aaed20 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:42.302940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ad146-3f39-42e8-9564-b9ca8ea3eb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:42.303872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ad146-3f39-42e8-9564-b9ca8ea3eb42 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:42.304137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ad146-3f39-42e8-9564-b9ca8ea3eb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:42.304408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ad146-3f39-42e8-9564-b9ca8ea3eb42 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:42.308373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ad146-3f39-42e8-9564-b9ca8ea3eb42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:42.310037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ad146-3f39-42e8-9564-b9ca8ea3eb42 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:42.310296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395967d-bbbe-4ce6-8331-bf699ab4b4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:42.311074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395967d-bbbe-4ce6-8331-bf699ab4b4b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:42.312103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395967d-bbbe-4ce6-8331-bf699ab4b4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:42.312103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395967d-bbbe-4ce6-8331-bf699ab4b4b0 admin admin] PATH_INFO: `/v3/projects/6cc0bf706fb941f59a94a88a811468c7/users/4157aea6b829422398f3f1fcf3abe116/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:42.350949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395967d-bbbe-4ce6-8331-bf699ab4b4b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc0bf706fb941f59a94a88a811468c7, user_id=4157aea6b829422398f3f1fcf3abe116, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:42.354190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395967d-bbbe-4ce6-8331-bf699ab4b4b0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:42.357567 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2368/4776] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:42.365929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ad146-3f39-42e8-9564-b9ca8ea3eb42 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:42.390065 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2409/4777] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:42 2022] PUT /identity/v3/projects/6cc0bf706fb941f59a94a88a811468c7/users/4157aea6b829422398f3f1fcf3abe116/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:42.391020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ad146-3f39-42e8-9564-b9ca8ea3eb42 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:42.392104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a2248-742d-48d9-8d4b-4272183b6502 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:42.392512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a2248-742d-48d9-8d4b-4272183b6502 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:42.392953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a2248-742d-48d9-8d4b-4272183b6502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:42.429177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-261a2248-742d-48d9-8d4b-4272183b6502 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:42.430309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-261a2248-742d-48d9-8d4b-4272183b6502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:42.476822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:42.539816 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2410/4778] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:16:42.541850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a2248-742d-48d9-8d4b-4272183b6502 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:42.545681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-261a2248-742d-48d9-8d4b-4272183b6502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:42.551737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2017861-1ef0-4b91-aa4e-b36b14c08d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:42.553309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2017861-1ef0-4b91-aa4e-b36b14c08d76 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:42.553790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2017861-1ef0-4b91-aa4e-b36b14c08d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:42.554291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2017861-1ef0-4b91-aa4e-b36b14c08d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:42.555628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2017861-1ef0-4b91-aa4e-b36b14c08d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:42.560374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2017861-1ef0-4b91-aa4e-b36b14c08d76 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:42.583559 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2369/4779] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:42.583559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2017861-1ef0-4b91-aa4e-b36b14c08d76 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:42.603298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a2248-742d-48d9-8d4b-4272183b6502 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:42.614494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbeca62-fbb7-4799-b0ea-7e7ebcd05adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:42.616872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbeca62-fbb7-4799-b0ea-7e7ebcd05adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:42.617848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbeca62-fbb7-4799-b0ea-7e7ebcd05adc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:42.618333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbeca62-fbb7-4799-b0ea-7e7ebcd05adc admin admin] PATH_INFO: `/v3/projects/19872a49ec264233a46bd7efb908f2ba` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:42.620826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbeca62-fbb7-4799-b0ea-7e7ebcd05adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=19872a49ec264233a46bd7efb908f2ba)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:42.623437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbeca62-fbb7-4799-b0ea-7e7ebcd05adc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:42.646339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:42.698797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2017861-1ef0-4b91-aa4e-b36b14c08d76 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:42.709611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab36436-97bf-4a4a-96c3-7427782f0888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:42.710704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab36436-97bf-4a4a-96c3-7427782f0888 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:42.710704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab36436-97bf-4a4a-96c3-7427782f0888 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:42.711466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab36436-97bf-4a4a-96c3-7427782f0888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:42.726366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab36436-97bf-4a4a-96c3-7427782f0888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:42.728258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab36436-97bf-4a4a-96c3-7427782f0888 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:42.747526 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2370/4780] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:42.748555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab36436-97bf-4a4a-96c3-7427782f0888 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:42.748830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fbbeca62-fbb7-4799-b0ea-7e7ebcd05adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19872a49ec264233a46bd7efb908f2ba', 'request_id': 'req-fbbeca62-fbb7-4799-b0ea-7e7ebcd05adc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:42.766578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab36436-97bf-4a4a-96c3-7427782f0888 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:42.772452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fbbeca62-fbb7-4799-b0ea-7e7ebcd05adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19872a49ec264233a46bd7efb908f2ba', 'request_id': 'req-fbbeca62-fbb7-4799-b0ea-7e7ebcd05adc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:42.781563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fbbeca62-fbb7-4799-b0ea-7e7ebcd05adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19872a49ec264233a46bd7efb908f2ba', 'request_id': 'req-fbbeca62-fbb7-4799-b0ea-7e7ebcd05adc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:42.804107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fbbeca62-fbb7-4799-b0ea-7e7ebcd05adc admin admin] The token cache is being invalidate because project 19872a49ec264233a46bd7efb908f2ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:42.804271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fbbeca62-fbb7-4799-b0ea-7e7ebcd05adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:42.805205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fbbeca62-fbb7-4799-b0ea-7e7ebcd05adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:42.811448 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2411/4781] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:42 2022] DELETE /identity/v3/projects/19872a49ec264233a46bd7efb908f2ba => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:42.812703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbeca62-fbb7-4799-b0ea-7e7ebcd05adc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:42.814702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fbbeca62-fbb7-4799-b0ea-7e7ebcd05adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:42.900312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087a904-64a0-4c5c-b01e-6d38b9009caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:42.901439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087a904-64a0-4c5c-b01e-6d38b9009caf admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:42.901880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087a904-64a0-4c5c-b01e-6d38b9009caf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:42.902353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087a904-64a0-4c5c-b01e-6d38b9009caf admin admin] PATH_INFO: `/v3/projects/f2247d263b2f463e96c03a04d1405210/users/02e57fa01d2a4e7a8e6b398aabf2f453/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:42.932693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087a904-64a0-4c5c-b01e-6d38b9009caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2247d263b2f463e96c03a04d1405210, user_id=02e57fa01d2a4e7a8e6b398aabf2f453, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:42.935706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087a904-64a0-4c5c-b01e-6d38b9009caf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:42.936678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbeca62-fbb7-4799-b0ea-7e7ebcd05adc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:42.948844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776aae8-5553-432a-9648-f193f25b2f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:42.949700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776aae8-5553-432a-9648-f193f25b2f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:42.950002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776aae8-5553-432a-9648-f193f25b2f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:42.950264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776aae8-5553-432a-9648-f193f25b2f27 admin admin] PATH_INFO: `/v3/projects/f0eafd030d67436787290da5463d9b0d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:42.953699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776aae8-5553-432a-9648-f193f25b2f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0eafd030d67436787290da5463d9b0d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:42.955878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776aae8-5553-432a-9648-f193f25b2f27 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:42.962462 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2371/4782] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:42 2022] PUT /identity/v3/projects/f2247d263b2f463e96c03a04d1405210/users/02e57fa01d2a4e7a8e6b398aabf2f453/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:42.963904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087a904-64a0-4c5c-b01e-6d38b9009caf admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:42.966849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c087a904-64a0-4c5c-b01e-6d38b9009caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:43.069909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4776aae8-5553-432a-9648-f193f25b2f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0eafd030d67436787290da5463d9b0d', 'request_id': 'req-4776aae8-5553-432a-9648-f193f25b2f27'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:43.088695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4776aae8-5553-432a-9648-f193f25b2f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0eafd030d67436787290da5463d9b0d', 'request_id': 'req-4776aae8-5553-432a-9648-f193f25b2f27'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:43.096788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:43.114886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4776aae8-5553-432a-9648-f193f25b2f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0eafd030d67436787290da5463d9b0d', 'request_id': 'req-4776aae8-5553-432a-9648-f193f25b2f27'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:43.125660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087a904-64a0-4c5c-b01e-6d38b9009caf admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:43.139998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4776aae8-5553-432a-9648-f193f25b2f27 admin admin] The token cache is being invalidate because project f0eafd030d67436787290da5463d9b0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:43.140681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4776aae8-5553-432a-9648-f193f25b2f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:43.141433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4776aae8-5553-432a-9648-f193f25b2f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:43.147541 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2412/4783] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:42 2022] DELETE /identity/v3/projects/f0eafd030d67436787290da5463d9b0d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:43.148519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06561ee-411c-468e-8802-8d4ce4a093d3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:43.151716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06561ee-411c-468e-8802-8d4ce4a093d3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:43.151716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06561ee-411c-468e-8802-8d4ce4a093d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:43.225847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbbe03-7e88-4cba-bf0c-99e1763f828b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:43.227034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbbe03-7e88-4cba-bf0c-99e1763f828b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:43.227763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbbe03-7e88-4cba-bf0c-99e1763f828b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:43.228002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c06561ee-411c-468e-8802-8d4ce4a093d3 None None] MFA Rules not processed for user `02e57fa01d2a4e7a8e6b398aabf2f453`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:43.228155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbbe03-7e88-4cba-bf0c-99e1763f828b admin admin] PATH_INFO: `/v3/users/c202a89922e04728ae40298a2f36538e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:43.229677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbbe03-7e88-4cba-bf0c-99e1763f828b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c202a89922e04728ae40298a2f36538e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:43.231172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c06561ee-411c-468e-8802-8d4ce4a093d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:43.233346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbbe03-7e88-4cba-bf0c-99e1763f828b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:43.245515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:43.343927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-73dbbe03-7e88-4cba-bf0c-99e1763f828b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c202a89922e04728ae40298a2f36538e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:43.365175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-73dbbe03-7e88-4cba-bf0c-99e1763f828b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c202a89922e04728ae40298a2f36538e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:43.381900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-73dbbe03-7e88-4cba-bf0c-99e1763f828b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c202a89922e04728ae40298a2f36538e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:43.382762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-73dbbe03-7e88-4cba-bf0c-99e1763f828b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c202a89922e04728ae40298a2f36538e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:43.383490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-73dbbe03-7e88-4cba-bf0c-99e1763f828b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c202a89922e04728ae40298a2f36538e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:43.401600 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2413/4784] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:43.402715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06561ee-411c-468e-8802-8d4ce4a093d3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:43.409655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c06561ee-411c-468e-8802-8d4ce4a093d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:43.418742 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2372/4785] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:42 2022] DELETE /identity/v3/users/c202a89922e04728ae40298a2f36538e => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:43.422288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbbe03-7e88-4cba-bf0c-99e1763f828b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:43.422903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-73dbbe03-7e88-4cba-bf0c-99e1763f828b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:43.455458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06561ee-411c-468e-8802-8d4ce4a093d3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:43.518757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbbe03-7e88-4cba-bf0c-99e1763f828b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:43.522791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac5d98-4529-43cb-89f3-02b195f51954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:43.523566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac5d98-4529-43cb-89f3-02b195f51954 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:43.523946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac5d98-4529-43cb-89f3-02b195f51954 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:43.524273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac5d98-4529-43cb-89f3-02b195f51954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:43.526856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-82ac5d98-4529-43cb-89f3-02b195f51954 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:43.584497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bd574-330b-4ec4-a5a1-b7f32e17de7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:43.585394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bd574-330b-4ec4-a5a1-b7f32e17de7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:43.585675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bd574-330b-4ec4-a5a1-b7f32e17de7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:43.585949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bd574-330b-4ec4-a5a1-b7f32e17de7f admin admin] PATH_INFO: `/v3/users/ea19b9d7c6834b838cb1603cbbf78f98` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:43.587804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bd574-330b-4ec4-a5a1-b7f32e17de7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea19b9d7c6834b838cb1603cbbf78f98)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:43.589937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bd574-330b-4ec4-a5a1-b7f32e17de7f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:43.638554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac5d98-4529-43cb-89f3-02b195f51954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:43.640348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac5d98-4529-43cb-89f3-02b195f51954 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:43.652669 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2373/4786] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:43.663004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-539bd574-330b-4ec4-a5a1-b7f32e17de7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea19b9d7c6834b838cb1603cbbf78f98'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:43.673369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-539bd574-330b-4ec4-a5a1-b7f32e17de7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea19b9d7c6834b838cb1603cbbf78f98'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:43.674151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-539bd574-330b-4ec4-a5a1-b7f32e17de7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea19b9d7c6834b838cb1603cbbf78f98'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:43.674854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-539bd574-330b-4ec4-a5a1-b7f32e17de7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea19b9d7c6834b838cb1603cbbf78f98'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:43.685559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-539bd574-330b-4ec4-a5a1-b7f32e17de7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea19b9d7c6834b838cb1603cbbf78f98'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:43.700255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:43.719068 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2414/4787] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:43 2022] DELETE /identity/v3/users/ea19b9d7c6834b838cb1603cbbf78f98 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:44.528825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac5d98-4529-43cb-89f3-02b195f51954 service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:44.531103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-82ac5d98-4529-43cb-89f3-02b195f51954 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:44.569806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac5d98-4529-43cb-89f3-02b195f51954 service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:44.635730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:44.668687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07943b67-410f-4f38-861c-836d86aaefd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:44.669716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07943b67-410f-4f38-861c-836d86aaefd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:44.670141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07943b67-410f-4f38-861c-836d86aaefd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:44.670475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07943b67-410f-4f38-861c-836d86aaefd6 admin admin] PATH_INFO: `/v3/projects/b7bfed6e7f5b4de7bb25083eeb325eac` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:44.672394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07943b67-410f-4f38-861c-836d86aaefd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7bfed6e7f5b4de7bb25083eeb325eac)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:44.675598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07943b67-410f-4f38-861c-836d86aaefd6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:44.818085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-07943b67-410f-4f38-861c-836d86aaefd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7bfed6e7f5b4de7bb25083eeb325eac', 'request_id': 'req-07943b67-410f-4f38-861c-836d86aaefd6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:44.837409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-07943b67-410f-4f38-861c-836d86aaefd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7bfed6e7f5b4de7bb25083eeb325eac', 'request_id': 'req-07943b67-410f-4f38-861c-836d86aaefd6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:44.857928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-07943b67-410f-4f38-861c-836d86aaefd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7bfed6e7f5b4de7bb25083eeb325eac', 'request_id': 'req-07943b67-410f-4f38-861c-836d86aaefd6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:44.882271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-07943b67-410f-4f38-861c-836d86aaefd6 admin admin] The token cache is being invalidate because project b7bfed6e7f5b4de7bb25083eeb325eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:44.882492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-07943b67-410f-4f38-861c-836d86aaefd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:44.883092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-07943b67-410f-4f38-861c-836d86aaefd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:44.884724 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2374/4788] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:44 2022] DELETE /identity/v3/projects/b7bfed6e7f5b4de7bb25083eeb325eac => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:44.890210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6763dc0-4ba0-456a-99b2-85afebafc454 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:44.890781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6763dc0-4ba0-456a-99b2-85afebafc454 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:44.890781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6763dc0-4ba0-456a-99b2-85afebafc454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:44.936758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d6763dc0-4ba0-456a-99b2-85afebafc454 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:44.938154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d6763dc0-4ba0-456a-99b2-85afebafc454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:44.997727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07943b67-410f-4f38-861c-836d86aaefd6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:44.999880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-07943b67-410f-4f38-861c-836d86aaefd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:45.117537 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2415/4789] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:16:45.133728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ff847-3928-4f4f-9de5-28d516e7b289 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:45.138305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ff847-3928-4f4f-9de5-28d516e7b289 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:45.138729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ff847-3928-4f4f-9de5-28d516e7b289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:45.225244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-500ff847-3928-4f4f-9de5-28d516e7b289 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:45.233476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-500ff847-3928-4f4f-9de5-28d516e7b289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:45.236886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07943b67-410f-4f38-861c-836d86aaefd6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:45.249405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd3ef7-d638-4d87-b0cc-5b852d0e8c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:45.252912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd3ef7-d638-4d87-b0cc-5b852d0e8c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:45.253213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd3ef7-d638-4d87-b0cc-5b852d0e8c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:45.253491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd3ef7-d638-4d87-b0cc-5b852d0e8c09 admin admin] PATH_INFO: `/v3/projects/2fb4e674ab77425689ecffe60170db19` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:45.257040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd3ef7-d638-4d87-b0cc-5b852d0e8c09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb4e674ab77425689ecffe60170db19)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:45.267095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd3ef7-d638-4d87-b0cc-5b852d0e8c09 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:45.269167 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2416/4790] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:45.270450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ff847-3928-4f4f-9de5-28d516e7b289 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:45.310469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ff847-3928-4f4f-9de5-28d516e7b289 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:45.329320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42a4cd-1240-4d0e-ae2b-2ff6253ed70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:45.329320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42a4cd-1240-4d0e-ae2b-2ff6253ed70d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:45.329320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42a4cd-1240-4d0e-ae2b-2ff6253ed70d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:45.329320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42a4cd-1240-4d0e-ae2b-2ff6253ed70d admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:45.329825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42a4cd-1240-4d0e-ae2b-2ff6253ed70d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:16:45.329825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42a4cd-1240-4d0e-ae2b-2ff6253ed70d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:45.333967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42a4cd-1240-4d0e-ae2b-2ff6253ed70d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:45.370676 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2417/4791] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:45.371626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42a4cd-1240-4d0e-ae2b-2ff6253ed70d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:45.396584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42a4cd-1240-4d0e-ae2b-2ff6253ed70d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:45.418171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-07cd3ef7-d638-4d87-b0cc-5b852d0e8c09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb4e674ab77425689ecffe60170db19', 'request_id': 'req-07cd3ef7-d638-4d87-b0cc-5b852d0e8c09'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:45.434381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-07cd3ef7-d638-4d87-b0cc-5b852d0e8c09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb4e674ab77425689ecffe60170db19', 'request_id': 'req-07cd3ef7-d638-4d87-b0cc-5b852d0e8c09'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:45.451513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-07cd3ef7-d638-4d87-b0cc-5b852d0e8c09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb4e674ab77425689ecffe60170db19', 'request_id': 'req-07cd3ef7-d638-4d87-b0cc-5b852d0e8c09'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:45.482843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:45.497051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-07cd3ef7-d638-4d87-b0cc-5b852d0e8c09 admin admin] The token cache is being invalidate because project 2fb4e674ab77425689ecffe60170db19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:45.498647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-07cd3ef7-d638-4d87-b0cc-5b852d0e8c09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:45.503850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-07cd3ef7-d638-4d87-b0cc-5b852d0e8c09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:45.508530 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2375/4792] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:44 2022] DELETE /identity/v3/projects/2fb4e674ab77425689ecffe60170db19 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:45.516993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deee7a5-f3d3-45fc-846d-beecd603694d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:45.518137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deee7a5-f3d3-45fc-846d-beecd603694d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:45.518530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deee7a5-f3d3-45fc-846d-beecd603694d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:45.550617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1deee7a5-f3d3-45fc-846d-beecd603694d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:45.553456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb14cbd-da4c-4bdd-905a-7b1afa2cf1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:45.554740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1deee7a5-f3d3-45fc-846d-beecd603694d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:45.556612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb14cbd-da4c-4bdd-905a-7b1afa2cf1fa admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:45.559164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb14cbd-da4c-4bdd-905a-7b1afa2cf1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:45.559471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb14cbd-da4c-4bdd-905a-7b1afa2cf1fa admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:45.560139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb14cbd-da4c-4bdd-905a-7b1afa2cf1fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:45.562153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb14cbd-da4c-4bdd-905a-7b1afa2cf1fa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:45.577519 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2376/4793] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:45.580365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1110c5-a2b7-471f-9365-dcae6b5266e1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:45.580944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1110c5-a2b7-471f-9365-dcae6b5266e1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:45.581548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1110c5-a2b7-471f-9365-dcae6b5266e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:45.608832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8c1110c5-a2b7-471f-9365-dcae6b5266e1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:45.610910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8c1110c5-a2b7-471f-9365-dcae6b5266e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:45.627966 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2418/4794] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:45 2022] POST /identity/v3/projects => generated 395 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:45.630340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb14cbd-da4c-4bdd-905a-7b1afa2cf1fa admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:45.635397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ebb14cbd-da4c-4bdd-905a-7b1afa2cf1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:45.636683 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2377/4795] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:45.638365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1110c5-a2b7-471f-9365-dcae6b5266e1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:45.654239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1110c5-a2b7-471f-9365-dcae6b5266e1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:45.744734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ba181-696a-4499-85bc-59efc6876cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:45.745539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ba181-696a-4499-85bc-59efc6876cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:45.745919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ba181-696a-4499-85bc-59efc6876cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:45.746288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ba181-696a-4499-85bc-59efc6876cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:45.747433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ba181-696a-4499-85bc-59efc6876cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:16:45.747433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ba181-696a-4499-85bc-59efc6876cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:45.750388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ba181-696a-4499-85bc-59efc6876cf9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:45.778147 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2378/4796] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:45.788408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ba181-696a-4499-85bc-59efc6876cf9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:45.806766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ba181-696a-4499-85bc-59efc6876cf9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:45.813075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb14cbd-da4c-4bdd-905a-7b1afa2cf1fa admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:45.824599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacdb60-d3be-4501-8250-9a0950be83a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:45.825537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacdb60-d3be-4501-8250-9a0950be83a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:45.826242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733a09c-5ecf-45d3-b8c3-97bc69fdcf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:45.826411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacdb60-d3be-4501-8250-9a0950be83a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:45.826648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacdb60-d3be-4501-8250-9a0950be83a8 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:45.827801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733a09c-5ecf-45d3-b8c3-97bc69fdcf72 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:45.828395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733a09c-5ecf-45d3-b8c3-97bc69fdcf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:45.828883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733a09c-5ecf-45d3-b8c3-97bc69fdcf72 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:45.829836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacdb60-d3be-4501-8250-9a0950be83a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:45.829992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733a09c-5ecf-45d3-b8c3-97bc69fdcf72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:45.832439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733a09c-5ecf-45d3-b8c3-97bc69fdcf72 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:45.834145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacdb60-d3be-4501-8250-9a0950be83a8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:45.852648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:45.893860 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2419/4797] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:45 2022] POST /identity/v3/users => generated 298 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:45.894538 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2379/4798] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:45 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:45.894670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacdb60-d3be-4501-8250-9a0950be83a8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:45.895664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733a09c-5ecf-45d3-b8c3-97bc69fdcf72 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:45.914433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacdb60-d3be-4501-8250-9a0950be83a8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:46.083086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae23cbc-0493-4379-b160-9683de4170ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:46.083980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae23cbc-0493-4379-b160-9683de4170ea admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:46.086567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733a09c-5ecf-45d3-b8c3-97bc69fdcf72 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:46.086724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae23cbc-0493-4379-b160-9683de4170ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:46.087049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae23cbc-0493-4379-b160-9683de4170ea admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:46.087842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae23cbc-0493-4379-b160-9683de4170ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:46.090883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae23cbc-0493-4379-b160-9683de4170ea admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:46.100488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91cb5b-16b0-451b-92e5-b40857f69ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:46.101373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91cb5b-16b0-451b-92e5-b40857f69ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:46.101683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91cb5b-16b0-451b-92e5-b40857f69ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:46.102021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91cb5b-16b0-451b-92e5-b40857f69ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:46.102876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91cb5b-16b0-451b-92e5-b40857f69ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:46.104647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91cb5b-16b0-451b-92e5-b40857f69ea3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:46.118054 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2380/4799] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:46.118866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91cb5b-16b0-451b-92e5-b40857f69ea3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:46.120675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ed91cb5b-16b0-451b-92e5-b40857f69ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:46.130172 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2420/4800] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:45 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:46.131053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae23cbc-0493-4379-b160-9683de4170ea admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:46.138439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91cb5b-16b0-451b-92e5-b40857f69ea3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:46.141607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae23cbc-0493-4379-b160-9683de4170ea admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:46.145201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5ab74-491d-4b3a-b74e-0e9727b89d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:46.146099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5ab74-491d-4b3a-b74e-0e9727b89d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:46.146376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5ab74-491d-4b3a-b74e-0e9727b89d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:46.146928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5ab74-491d-4b3a-b74e-0e9727b89d76 admin admin] PATH_INFO: `/v3/users/f194933a022742588069b78df9f1c177` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:46.147077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c7d77-9a70-41e3-9be7-6430e8d8cf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:46.148329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5ab74-491d-4b3a-b74e-0e9727b89d76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f194933a022742588069b78df9f1c177)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:46.148571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c7d77-9a70-41e3-9be7-6430e8d8cf2e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:46.148818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c7d77-9a70-41e3-9be7-6430e8d8cf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:46.149090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c7d77-9a70-41e3-9be7-6430e8d8cf2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:46.149807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c7d77-9a70-41e3-9be7-6430e8d8cf2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:46.150311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5ab74-491d-4b3a-b74e-0e9727b89d76 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:46.151984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c7d77-9a70-41e3-9be7-6430e8d8cf2e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:46.164304 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2421/4801] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:46.165199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c7d77-9a70-41e3-9be7-6430e8d8cf2e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:46.176354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c7d77-9a70-41e3-9be7-6430e8d8cf2e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:46.182045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683e35c-2483-42d0-8bd5-9bc5b1f98382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:46.182721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e35c-2483-42d0-8bd5-9bc5b1f98382 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:46.183006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e35c-2483-42d0-8bd5-9bc5b1f98382 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:46.183280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e35c-2483-42d0-8bd5-9bc5b1f98382 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:46.184000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683e35c-2483-42d0-8bd5-9bc5b1f98382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:46.185695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683e35c-2483-42d0-8bd5-9bc5b1f98382 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:46.199018 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2422/4802] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:46.199968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683e35c-2483-42d0-8bd5-9bc5b1f98382 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:46.219407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683e35c-2483-42d0-8bd5-9bc5b1f98382 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:46.231953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-01b5ab74-491d-4b3a-b74e-0e9727b89d76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f194933a022742588069b78df9f1c177'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:46.234117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab64fdf-3ea4-4c7c-98ab-85056f8f55da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:46.235773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:46.236684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab64fdf-3ea4-4c7c-98ab-85056f8f55da admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:46.240578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab64fdf-3ea4-4c7c-98ab-85056f8f55da admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:46.241049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab64fdf-3ea4-4c7c-98ab-85056f8f55da admin admin] PATH_INFO: `/v3/projects/6ec66c4ca37f47dcb3d18f89f3fe2a75/users/7e89c1afe4de42e68f65d0a700c63b4e/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:46.259144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-01b5ab74-491d-4b3a-b74e-0e9727b89d76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f194933a022742588069b78df9f1c177'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:46.269831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-01b5ab74-491d-4b3a-b74e-0e9727b89d76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f194933a022742588069b78df9f1c177'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:46.271119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-01b5ab74-491d-4b3a-b74e-0e9727b89d76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f194933a022742588069b78df9f1c177'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:46.271564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab64fdf-3ea4-4c7c-98ab-85056f8f55da admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ec66c4ca37f47dcb3d18f89f3fe2a75, user_id=7e89c1afe4de42e68f65d0a700c63b4e, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:46.271880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-01b5ab74-491d-4b3a-b74e-0e9727b89d76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f194933a022742588069b78df9f1c177'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:46.274555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab64fdf-3ea4-4c7c-98ab-85056f8f55da admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:46.304597 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2423/4803] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:46 2022] PUT /identity/v3/projects/6ec66c4ca37f47dcb3d18f89f3fe2a75/users/7e89c1afe4de42e68f65d0a700c63b4e/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:46.309729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab64fdf-3ea4-4c7c-98ab-85056f8f55da admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:46.310662 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2381/4804] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:46 2022] DELETE /identity/v3/users/f194933a022742588069b78df9f1c177 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:46.312436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc472b3-f6fd-4b33-b961-f3415823f520 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:46.312911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc472b3-f6fd-4b33-b961-f3415823f520 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:46.313381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc472b3-f6fd-4b33-b961-f3415823f520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:46.315177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-eab64fdf-3ea4-4c7c-98ab-85056f8f55da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:46.368327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fcc472b3-f6fd-4b33-b961-f3415823f520 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:46.371296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fcc472b3-f6fd-4b33-b961-f3415823f520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:46.437665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab64fdf-3ea4-4c7c-98ab-85056f8f55da admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:46.537629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:46.571281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce3cbb-87b5-4721-a551-25409e60ad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:46.572628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce3cbb-87b5-4721-a551-25409e60ad75 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:46.573151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce3cbb-87b5-4721-a551-25409e60ad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:46.574321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce3cbb-87b5-4721-a551-25409e60ad75 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:46.575608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce3cbb-87b5-4721-a551-25409e60ad75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:46.577300 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2382/4805] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:46.578054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce3cbb-87b5-4721-a551-25409e60ad75 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:46.596869 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2424/4806] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:46.598356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc472b3-f6fd-4b33-b961-f3415823f520 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:46.611086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc472b3-f6fd-4b33-b961-f3415823f520 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:46.618310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da17278-318a-4ab7-a62d-ea2aaa799f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:46.619398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da17278-318a-4ab7-a62d-ea2aaa799f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:46.619752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da17278-318a-4ab7-a62d-ea2aaa799f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:46.620160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da17278-318a-4ab7-a62d-ea2aaa799f0c admin admin] PATH_INFO: `/v3/projects/8a37f54cef1b4aef9275b5170a0b1f15/users/427491532c5e411f890bb1293ab18131/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:46.645831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da17278-318a-4ab7-a62d-ea2aaa799f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a37f54cef1b4aef9275b5170a0b1f15, user_id=427491532c5e411f890bb1293ab18131, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:46.649751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da17278-318a-4ab7-a62d-ea2aaa799f0c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:46.654358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce3cbb-87b5-4721-a551-25409e60ad75 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:46.656877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-00ce3cbb-87b5-4721-a551-25409e60ad75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:46.684439 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2383/4807] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:46 2022] PUT /identity/v3/projects/8a37f54cef1b4aef9275b5170a0b1f15/users/427491532c5e411f890bb1293ab18131/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:46.691485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987a6a2-dcfc-453f-8fee-c9ea83b816db None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:46.691863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987a6a2-dcfc-453f-8fee-c9ea83b816db None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:46.693192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987a6a2-dcfc-453f-8fee-c9ea83b816db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:46.727417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1987a6a2-dcfc-453f-8fee-c9ea83b816db None None] MFA Rules not processed for user `427491532c5e411f890bb1293ab18131`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:46.728922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1987a6a2-dcfc-453f-8fee-c9ea83b816db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:46.757415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce3cbb-87b5-4721-a551-25409e60ad75 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:46.859957 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2384/4808] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:46.885553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987a6a2-dcfc-453f-8fee-c9ea83b816db None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:46.887570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1987a6a2-dcfc-453f-8fee-c9ea83b816db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:46.989950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff074af0-ce44-4cc0-9c82-ee7c0769e371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:46.990635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff074af0-ce44-4cc0-9c82-ee7c0769e371 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:46.990910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff074af0-ce44-4cc0-9c82-ee7c0769e371 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:46.991184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff074af0-ce44-4cc0-9c82-ee7c0769e371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:47.026157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:47.128251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987a6a2-dcfc-453f-8fee-c9ea83b816db None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:47.146584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10876704-ba38-49bf-9b15-7c8100ffe119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:47.148502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10876704-ba38-49bf-9b15-7c8100ffe119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:47.149000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10876704-ba38-49bf-9b15-7c8100ffe119 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:47.156931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10876704-ba38-49bf-9b15-7c8100ffe119 admin admin] PATH_INFO: `/v3/projects/b59eba31be824dc79a797e0f756d1e2c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:47.160581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10876704-ba38-49bf-9b15-7c8100ffe119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b59eba31be824dc79a797e0f756d1e2c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:47.164848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10876704-ba38-49bf-9b15-7c8100ffe119 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:47.203651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff074af0-ce44-4cc0-9c82-ee7c0769e371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:47.208489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff074af0-ce44-4cc0-9c82-ee7c0769e371 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:47.242477 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2425/4809] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:16:47.245469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff074af0-ce44-4cc0-9c82-ee7c0769e371 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:47.265870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff074af0-ce44-4cc0-9c82-ee7c0769e371 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:47.292447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-10876704-ba38-49bf-9b15-7c8100ffe119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b59eba31be824dc79a797e0f756d1e2c', 'request_id': 'req-10876704-ba38-49bf-9b15-7c8100ffe119'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:47.305967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-10876704-ba38-49bf-9b15-7c8100ffe119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b59eba31be824dc79a797e0f756d1e2c', 'request_id': 'req-10876704-ba38-49bf-9b15-7c8100ffe119'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:47.314282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-10876704-ba38-49bf-9b15-7c8100ffe119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b59eba31be824dc79a797e0f756d1e2c', 'request_id': 'req-10876704-ba38-49bf-9b15-7c8100ffe119'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:47.350844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-10876704-ba38-49bf-9b15-7c8100ffe119 admin admin] The token cache is being invalidate because project b59eba31be824dc79a797e0f756d1e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:47.351900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-10876704-ba38-49bf-9b15-7c8100ffe119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:47.353517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-10876704-ba38-49bf-9b15-7c8100ffe119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:47.357630 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2385/4810] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:46 2022] DELETE /identity/v3/projects/b59eba31be824dc79a797e0f756d1e2c => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:16:47.363455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d03b8b-2396-4139-b0d2-7698b5b09dc6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:47.364132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d03b8b-2396-4139-b0d2-7698b5b09dc6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:47.364746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d03b8b-2396-4139-b0d2-7698b5b09dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:47.378179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:47.396215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-53d03b8b-2396-4139-b0d2-7698b5b09dc6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:47.397791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-53d03b8b-2396-4139-b0d2-7698b5b09dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:47.400818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a2458-7963-497b-9362-b01a17d7ccb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:47.403516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a2458-7963-497b-9362-b01a17d7ccb9 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:47.404169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a2458-7963-497b-9362-b01a17d7ccb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:47.404697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a2458-7963-497b-9362-b01a17d7ccb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:47.409482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-212a2458-7963-497b-9362-b01a17d7ccb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:47.482720 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2386/4811] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:16:47.490823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66975a4-fd41-4b97-add8-7e2dda35f42d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:47.491151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66975a4-fd41-4b97-add8-7e2dda35f42d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:47.491432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66975a4-fd41-4b97-add8-7e2dda35f42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:47.511660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d66975a4-fd41-4b97-add8-7e2dda35f42d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:47.513048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d66975a4-fd41-4b97-add8-7e2dda35f42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:47.525747 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2387/4812] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:16:47.530053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66975a4-fd41-4b97-add8-7e2dda35f42d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:47.541926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66975a4-fd41-4b97-add8-7e2dda35f42d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:47.550599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e0ecb-c488-4705-a007-0fc0beecd368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:47.551615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e0ecb-c488-4705-a007-0fc0beecd368 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:47.552622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e0ecb-c488-4705-a007-0fc0beecd368 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:47.553278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e0ecb-c488-4705-a007-0fc0beecd368 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:47.554262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e0ecb-c488-4705-a007-0fc0beecd368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:16:47.554730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e0ecb-c488-4705-a007-0fc0beecd368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:47.557049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e0ecb-c488-4705-a007-0fc0beecd368 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:47.577037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a2458-7963-497b-9362-b01a17d7ccb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:47.577692 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2388/4813] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:47.578395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a2458-7963-497b-9362-b01a17d7ccb9 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:47.579014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e0ecb-c488-4705-a007-0fc0beecd368 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:47.599136 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2426/4814] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:47.613273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e0ecb-c488-4705-a007-0fc0beecd368 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:47.630872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5980ab-f32e-4abf-8aa6-3ad099ebd5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:47.631303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5980ab-f32e-4abf-8aa6-3ad099ebd5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:47.631567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5980ab-f32e-4abf-8aa6-3ad099ebd5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:47.631854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5980ab-f32e-4abf-8aa6-3ad099ebd5d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:47.632988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5980ab-f32e-4abf-8aa6-3ad099ebd5d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:47.634780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5980ab-f32e-4abf-8aa6-3ad099ebd5d2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:47.683580 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2389/4815] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:47 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:47.685122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a2458-7963-497b-9362-b01a17d7ccb9 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:47.698428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a2458-7963-497b-9362-b01a17d7ccb9 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:47.862728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52579a-7dec-4ad3-a5f4-8f6638d91a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:47.863741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52579a-7dec-4ad3-a5f4-8f6638d91a9b admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:47.864091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52579a-7dec-4ad3-a5f4-8f6638d91a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:47.864439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52579a-7dec-4ad3-a5f4-8f6638d91a9b admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:47.865417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52579a-7dec-4ad3-a5f4-8f6638d91a9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:47.868595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52579a-7dec-4ad3-a5f4-8f6638d91a9b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:47.922153 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2427/4816] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:47 2022] POST /identity/v3/users => generated 283 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:47.923016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5980ab-f32e-4abf-8aa6-3ad099ebd5d2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:47.938857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5980ab-f32e-4abf-8aa6-3ad099ebd5d2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:47.944082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91afa44-e1d7-471f-908a-7c55a13030ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:47.944903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91afa44-e1d7-471f-908a-7c55a13030ea admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:47.945254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91afa44-e1d7-471f-908a-7c55a13030ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:47.945697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91afa44-e1d7-471f-908a-7c55a13030ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:47.946645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91afa44-e1d7-471f-908a-7c55a13030ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:47.949124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91afa44-e1d7-471f-908a-7c55a13030ea admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:47.961235 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2390/4817] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:47.965691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52579a-7dec-4ad3-a5f4-8f6638d91a9b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:47.980801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52579a-7dec-4ad3-a5f4-8f6638d91a9b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:47.989350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48a4c0-df6c-46bf-a520-cf8ee07871f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:47.990269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48a4c0-df6c-46bf-a520-cf8ee07871f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:47.990872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48a4c0-df6c-46bf-a520-cf8ee07871f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:47.991129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48a4c0-df6c-46bf-a520-cf8ee07871f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:47.992026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48a4c0-df6c-46bf-a520-cf8ee07871f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:47.994383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48a4c0-df6c-46bf-a520-cf8ee07871f0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:48.010290 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2428/4818] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:48.014391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91afa44-e1d7-471f-908a-7c55a13030ea admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:48.034746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91afa44-e1d7-471f-908a-7c55a13030ea admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:48.044916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ac2ec-3eb8-4b8b-ac08-b44ce0b42b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:48.046007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ac2ec-3eb8-4b8b-ac08-b44ce0b42b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:48.046288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ac2ec-3eb8-4b8b-ac08-b44ce0b42b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:48.046564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ac2ec-3eb8-4b8b-ac08-b44ce0b42b0c admin admin] PATH_INFO: `/v3/projects/f989b228325c4640957dcfe068f652d3/users/4572a43d0b7e465eabd506fb52a502ba/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:48.062502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:48.104929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ac2ec-3eb8-4b8b-ac08-b44ce0b42b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f989b228325c4640957dcfe068f652d3, user_id=4572a43d0b7e465eabd506fb52a502ba, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:48.107660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ac2ec-3eb8-4b8b-ac08-b44ce0b42b0c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:48.142548 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2391/4819] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:48 2022] PUT /identity/v3/projects/f989b228325c4640957dcfe068f652d3/users/4572a43d0b7e465eabd506fb52a502ba/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:48.144367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b968f7-5493-46c5-9498-b7c68b81ef49 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:48.144664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b968f7-5493-46c5-9498-b7c68b81ef49 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:48.144948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b968f7-5493-46c5-9498-b7c68b81ef49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:48.194791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-84b968f7-5493-46c5-9498-b7c68b81ef49 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:48.197091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-84b968f7-5493-46c5-9498-b7c68b81ef49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:48.346396 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2429/4820] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:48.401743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ac2ec-3eb8-4b8b-ac08-b44ce0b42b0c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:48.406399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-014ac2ec-3eb8-4b8b-ac08-b44ce0b42b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:48.505860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ac2ec-3eb8-4b8b-ac08-b44ce0b42b0c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:48.509886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d142ff-4fc9-456a-81d7-d5238ebd168b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:48.510913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d142ff-4fc9-456a-81d7-d5238ebd168b service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:48.510913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d142ff-4fc9-456a-81d7-d5238ebd168b service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:48.511984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d142ff-4fc9-456a-81d7-d5238ebd168b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:48.525128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d142ff-4fc9-456a-81d7-d5238ebd168b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:48.527353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d142ff-4fc9-456a-81d7-d5238ebd168b service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:48.540185 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2392/4821] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:49.098236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c15ae-89ac-4d36-80c5-25e7ac90c0d2 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:49.098731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c15ae-89ac-4d36-80c5-25e7ac90c0d2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:49.098842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c15ae-89ac-4d36-80c5-25e7ac90c0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:49.134541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bc5c15ae-89ac-4d36-80c5-25e7ac90c0d2 None None] MFA Rules not processed for user `984631f5a77a48c5a9619e33e608dd59`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:49.135800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bc5c15ae-89ac-4d36-80c5-25e7ac90c0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:49.164086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:49.308125 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2430/4822] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:51.601329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d142ff-4fc9-456a-81d7-d5238ebd168b service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:51.603213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-62d142ff-4fc9-456a-81d7-d5238ebd168b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:51.627298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d142ff-4fc9-456a-81d7-d5238ebd168b service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:51.639827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d9bdf-5b5d-468b-91c2-3f492ba2f639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:51.641449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d9bdf-5b5d-468b-91c2-3f492ba2f639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:51.641639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d9bdf-5b5d-468b-91c2-3f492ba2f639 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:51.642654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d9bdf-5b5d-468b-91c2-3f492ba2f639 admin admin] PATH_INFO: `/v3/users/02e57fa01d2a4e7a8e6b398aabf2f453` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:51.647716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d9bdf-5b5d-468b-91c2-3f492ba2f639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02e57fa01d2a4e7a8e6b398aabf2f453)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:51.656287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d9bdf-5b5d-468b-91c2-3f492ba2f639 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:51.791176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-497d9bdf-5b5d-468b-91c2-3f492ba2f639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02e57fa01d2a4e7a8e6b398aabf2f453'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:51.813717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-497d9bdf-5b5d-468b-91c2-3f492ba2f639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02e57fa01d2a4e7a8e6b398aabf2f453'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:51.823608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-497d9bdf-5b5d-468b-91c2-3f492ba2f639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02e57fa01d2a4e7a8e6b398aabf2f453'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:51.824914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-497d9bdf-5b5d-468b-91c2-3f492ba2f639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02e57fa01d2a4e7a8e6b398aabf2f453'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:51.825990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-497d9bdf-5b5d-468b-91c2-3f492ba2f639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02e57fa01d2a4e7a8e6b398aabf2f453'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:51.879522 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2393/4823] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:16:51 2022] DELETE /identity/v3/users/02e57fa01d2a4e7a8e6b398aabf2f453 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:51.884251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e84b0-acc5-4920-8311-06b21897f454 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:51.884750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e84b0-acc5-4920-8311-06b21897f454 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:51.884846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e84b0-acc5-4920-8311-06b21897f454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:51.918291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5f3e84b0-acc5-4920-8311-06b21897f454 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:51.923498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5f3e84b0-acc5-4920-8311-06b21897f454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:52.086911 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2431/4824] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:52.114855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d9bdf-5b5d-468b-91c2-3f492ba2f639 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:52.116623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-497d9bdf-5b5d-468b-91c2-3f492ba2f639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:52.238127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d9bdf-5b5d-468b-91c2-3f492ba2f639 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:52.264081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9f78e-cf4b-4909-8113-5d271ad79aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:52.267572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f78e-cf4b-4909-8113-5d271ad79aee service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:52.268323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f78e-cf4b-4909-8113-5d271ad79aee service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:52.268841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f78e-cf4b-4909-8113-5d271ad79aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:52.315954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9f78e-cf4b-4909-8113-5d271ad79aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:52.322792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9f78e-cf4b-4909-8113-5d271ad79aee service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:52.349839 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2394/4825] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:52.689558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c19ca0-1a7e-4f20-a632-6abb77b23f2b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:52.690670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c19ca0-1a7e-4f20-a632-6abb77b23f2b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:52.691211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c19ca0-1a7e-4f20-a632-6abb77b23f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:52.763372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-45c19ca0-1a7e-4f20-a632-6abb77b23f2b None None] MFA Rules not processed for user `4157aea6b829422398f3f1fcf3abe116`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:52.766398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-45c19ca0-1a7e-4f20-a632-6abb77b23f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:52.974617 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2432/4826] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:52.975346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2025c02-c6ae-4ec4-8604-1eb036873adb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:52.975743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2025c02-c6ae-4ec4-8604-1eb036873adb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:52.975883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2025c02-c6ae-4ec4-8604-1eb036873adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:52.984483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:53.002674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d2025c02-c6ae-4ec4-8604-1eb036873adb None None] MFA Rules not processed for user `4157aea6b829422398f3f1fcf3abe116`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:53.006451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d2025c02-c6ae-4ec4-8604-1eb036873adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:53.021166 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2395/4827] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:53.042452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c19ca0-1a7e-4f20-a632-6abb77b23f2b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:53.044553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-45c19ca0-1a7e-4f20-a632-6abb77b23f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:53.189991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:53.273241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c19ca0-1a7e-4f20-a632-6abb77b23f2b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:53.295510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab9a5a-921a-45a8-a945-07b63cde4849 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:53.296862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab9a5a-921a-45a8-a945-07b63cde4849 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:53.298129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab9a5a-921a-45a8-a945-07b63cde4849 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:53.299710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab9a5a-921a-45a8-a945-07b63cde4849 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:53.338893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab9a5a-921a-45a8-a945-07b63cde4849 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:53.356783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab9a5a-921a-45a8-a945-07b63cde4849 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:53.383615 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2433/4828] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:54.515650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2025c02-c6ae-4ec4-8604-1eb036873adb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:54.517989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d2025c02-c6ae-4ec4-8604-1eb036873adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:54.622645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2025c02-c6ae-4ec4-8604-1eb036873adb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:54.653436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69f946-e5b4-4fe2-807a-ce578f4bd420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:54.669894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69f946-e5b4-4fe2-807a-ce578f4bd420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:54.670401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69f946-e5b4-4fe2-807a-ce578f4bd420 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:54.670985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69f946-e5b4-4fe2-807a-ce578f4bd420 admin admin] PATH_INFO: `/v3/projects/f2247d263b2f463e96c03a04d1405210` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:54.673748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69f946-e5b4-4fe2-807a-ce578f4bd420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2247d263b2f463e96c03a04d1405210)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:54.676350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69f946-e5b4-4fe2-807a-ce578f4bd420 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:54.931545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3c69f946-e5b4-4fe2-807a-ce578f4bd420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2247d263b2f463e96c03a04d1405210', 'request_id': 'req-3c69f946-e5b4-4fe2-807a-ce578f4bd420'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:54.996884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3c69f946-e5b4-4fe2-807a-ce578f4bd420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2247d263b2f463e96c03a04d1405210', 'request_id': 'req-3c69f946-e5b4-4fe2-807a-ce578f4bd420'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:55.016763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3c69f946-e5b4-4fe2-807a-ce578f4bd420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2247d263b2f463e96c03a04d1405210', 'request_id': 'req-3c69f946-e5b4-4fe2-807a-ce578f4bd420'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:55.053006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3c69f946-e5b4-4fe2-807a-ce578f4bd420 admin admin] The token cache is being invalidate because project f2247d263b2f463e96c03a04d1405210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:16:55.053610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3c69f946-e5b4-4fe2-807a-ce578f4bd420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:55.057479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3c69f946-e5b4-4fe2-807a-ce578f4bd420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:16:55.060457 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2396/4829] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:16:54 2022] DELETE /identity/v3/projects/f2247d263b2f463e96c03a04d1405210 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:55.066770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f11ed-f1e2-4d64-8415-a6349bfa20b7 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:55.067330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f11ed-f1e2-4d64-8415-a6349bfa20b7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:55.067694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f11ed-f1e2-4d64-8415-a6349bfa20b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:55.180354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6f4f11ed-f1e2-4d64-8415-a6349bfa20b7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:55.184807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6f4f11ed-f1e2-4d64-8415-a6349bfa20b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:55.381815 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2434/4830] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:55.391630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a728cb-f410-4882-81ec-e48a1d5da56a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:55.392820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a728cb-f410-4882-81ec-e48a1d5da56a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:55.393263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a728cb-f410-4882-81ec-e48a1d5da56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:55.445321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-50a728cb-f410-4882-81ec-e48a1d5da56a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:55.446898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-50a728cb-f410-4882-81ec-e48a1d5da56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:55.479432 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2397/4831] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:55.483281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f11ed-f1e2-4d64-8415-a6349bfa20b7 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:55.506738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f11ed-f1e2-4d64-8415-a6349bfa20b7 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:55.537342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfcaba-b89e-4f83-baa1-6efd0f9a9a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:55.539324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfcaba-b89e-4f83-baa1-6efd0f9a9a6b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:55.539626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfcaba-b89e-4f83-baa1-6efd0f9a9a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:55.540141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfcaba-b89e-4f83-baa1-6efd0f9a9a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:55.548357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfcaba-b89e-4f83-baa1-6efd0f9a9a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:16:55.549007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfcaba-b89e-4f83-baa1-6efd0f9a9a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:55.553223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfcaba-b89e-4f83-baa1-6efd0f9a9a6b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:55.584511 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2435/4832] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:16:55.589255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a728cb-f410-4882-81ec-e48a1d5da56a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:55.605442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a728cb-f410-4882-81ec-e48a1d5da56a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:55.618717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc459ce8-5afc-4939-a50c-1e1118560cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:55.619773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc459ce8-5afc-4939-a50c-1e1118560cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:55.620312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc459ce8-5afc-4939-a50c-1e1118560cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:55.620790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc459ce8-5afc-4939-a50c-1e1118560cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:55.636464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc459ce8-5afc-4939-a50c-1e1118560cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:55.654078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc459ce8-5afc-4939-a50c-1e1118560cc6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:55.722322 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2398/4833] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:16:55 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:16:55.724286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfcaba-b89e-4f83-baa1-6efd0f9a9a6b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:55.742743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfcaba-b89e-4f83-baa1-6efd0f9a9a6b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:55.901169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f9395-522a-493b-a231-8f8ed86067bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:55.903702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f9395-522a-493b-a231-8f8ed86067bd admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:55.904013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f9395-522a-493b-a231-8f8ed86067bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:55.904371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f9395-522a-493b-a231-8f8ed86067bd admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:55.906052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f9395-522a-493b-a231-8f8ed86067bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:55.911377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f9395-522a-493b-a231-8f8ed86067bd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:55.972802 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2436/4834] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:16:55 2022] POST /identity/v3/users => generated 288 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:16:55.974350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc459ce8-5afc-4939-a50c-1e1118560cc6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:56.029167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc459ce8-5afc-4939-a50c-1e1118560cc6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:56.045949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe85f1-6124-495f-8fe2-122ed97c2621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:56.048543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe85f1-6124-495f-8fe2-122ed97c2621 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:56.048830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe85f1-6124-495f-8fe2-122ed97c2621 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:56.050701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe85f1-6124-495f-8fe2-122ed97c2621 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:56.052299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe85f1-6124-495f-8fe2-122ed97c2621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:56.059517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe85f1-6124-495f-8fe2-122ed97c2621 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:56.117179 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2399/4835] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:16:56.119515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f9395-522a-493b-a231-8f8ed86067bd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:56.134000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f9395-522a-493b-a231-8f8ed86067bd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:56.150219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6367984-96b9-44cb-9952-57d004e29afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:56.150927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6367984-96b9-44cb-9952-57d004e29afb admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:56.151250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6367984-96b9-44cb-9952-57d004e29afb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:56.151568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6367984-96b9-44cb-9952-57d004e29afb admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:56.153941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6367984-96b9-44cb-9952-57d004e29afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:56.158432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6367984-96b9-44cb-9952-57d004e29afb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:56.199304 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2437/4836] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:16:56.203783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe85f1-6124-495f-8fe2-122ed97c2621 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:56.220571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe85f1-6124-495f-8fe2-122ed97c2621 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:56.250785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332b1bb-4718-4f60-85c5-7c19fa41a769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:56.256230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332b1bb-4718-4f60-85c5-7c19fa41a769 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:56.256520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332b1bb-4718-4f60-85c5-7c19fa41a769 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:56.258514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332b1bb-4718-4f60-85c5-7c19fa41a769 admin admin] PATH_INFO: `/v3/projects/7b769d890fea450699957ed0aa6bd804/users/466dc5d829ac45389fead7c50b68e608/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:56.323268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332b1bb-4718-4f60-85c5-7c19fa41a769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b769d890fea450699957ed0aa6bd804, user_id=466dc5d829ac45389fead7c50b68e608, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:56.331271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332b1bb-4718-4f60-85c5-7c19fa41a769 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:56.373286 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2400/4837] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:16:56 2022] PUT /identity/v3/projects/7b769d890fea450699957ed0aa6bd804/users/466dc5d829ac45389fead7c50b68e608/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:16:56.384736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f515c-520a-471a-8da2-b642066780c8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:56.385386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f515c-520a-471a-8da2-b642066780c8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:56.385933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f515c-520a-471a-8da2-b642066780c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:56.445169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1d6f515c-520a-471a-8da2-b642066780c8 None None] MFA Rules not processed for user `466dc5d829ac45389fead7c50b68e608`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:56.446459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1d6f515c-520a-471a-8da2-b642066780c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:56.495359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:56.560198 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2438/4838] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:16:56.572023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332b1bb-4718-4f60-85c5-7c19fa41a769 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:16:56.575449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e332b1bb-4718-4f60-85c5-7c19fa41a769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:56.694187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332b1bb-4718-4f60-85c5-7c19fa41a769 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:16:56.703954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588547d-470c-4755-a92d-624eb5039d18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:16:56.705638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588547d-470c-4755-a92d-624eb5039d18 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:56.707364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588547d-470c-4755-a92d-624eb5039d18 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:56.707669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588547d-470c-4755-a92d-624eb5039d18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:56.738771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588547d-470c-4755-a92d-624eb5039d18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:16:56.740275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588547d-470c-4755-a92d-624eb5039d18 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:16:56.772928 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2401/4839] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:16:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:16:59.409973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b2493-120d-40c4-af46-c78ff3b50246 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:16:59.410975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b2493-120d-40c4-af46-c78ff3b50246 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:16:59.411495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b2493-120d-40c4-af46-c78ff3b50246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:16:59.482756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5f3b2493-120d-40c4-af46-c78ff3b50246 None None] MFA Rules not processed for user `419f3872408c4d8c9a2980d6397d0aea`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:16:59.485696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5f3b2493-120d-40c4-af46-c78ff3b50246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:16:59.626020 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2439/4840] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:16:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:02.657132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60530fe-9084-4921-b3f3-f11e81a8af87 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:02.658447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60530fe-9084-4921-b3f3-f11e81a8af87 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:02.658930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60530fe-9084-4921-b3f3-f11e81a8af87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:02.763829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c60530fe-9084-4921-b3f3-f11e81a8af87 None None] MFA Rules not processed for user `7e89c1afe4de42e68f65d0a700c63b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:02.768575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c60530fe-9084-4921-b3f3-f11e81a8af87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:02.802314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:03.006197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b2493-120d-40c4-af46-c78ff3b50246 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:03.007801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5f3b2493-120d-40c4-af46-c78ff3b50246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:03.170742 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2402/4841] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:03.175744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d329931-1956-4228-b8d0-dfcac6d00939 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:03.177671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d329931-1956-4228-b8d0-dfcac6d00939 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:03.178346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d329931-1956-4228-b8d0-dfcac6d00939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:03.257760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b2493-120d-40c4-af46-c78ff3b50246 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:03.273617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8d329931-1956-4228-b8d0-dfcac6d00939 None None] MFA Rules not processed for user `7e89c1afe4de42e68f65d0a700c63b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:03.277576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8d329931-1956-4228-b8d0-dfcac6d00939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:03.281348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e6a8c-eb6e-4392-bcc5-51cc7b7afc6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:03.283579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e6a8c-eb6e-4392-bcc5-51cc7b7afc6a service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:03.284191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e6a8c-eb6e-4392-bcc5-51cc7b7afc6a service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:03.287132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e6a8c-eb6e-4392-bcc5-51cc7b7afc6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:03.295300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-011e6a8c-eb6e-4392-bcc5-51cc7b7afc6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:03.320008 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2403/4842] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:03.342912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d329931-1956-4228-b8d0-dfcac6d00939 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:03.359616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8d329931-1956-4228-b8d0-dfcac6d00939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:03.361140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e6a8c-eb6e-4392-bcc5-51cc7b7afc6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:03.361140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e6a8c-eb6e-4392-bcc5-51cc7b7afc6a service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:03.402025 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2440/4843] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:17:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:17:03.595213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d329931-1956-4228-b8d0-dfcac6d00939 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:03.612590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a9f0f-39cf-4a73-99af-e8360f7c153f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:03.613648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a9f0f-39cf-4a73-99af-e8360f7c153f service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:03.614094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a9f0f-39cf-4a73-99af-e8360f7c153f service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:03.614529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a9f0f-39cf-4a73-99af-e8360f7c153f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:03.636441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a9f0f-39cf-4a73-99af-e8360f7c153f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:03.638617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a9f0f-39cf-4a73-99af-e8360f7c153f service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:03.663202 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2404/4844] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:17:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:17:08.121681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e6a8c-eb6e-4392-bcc5-51cc7b7afc6a service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:08.327248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a9f0f-39cf-4a73-99af-e8360f7c153f service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:08.332484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7d3a9f0f-39cf-4a73-99af-e8360f7c153f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:08.340593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e6a8c-eb6e-4392-bcc5-51cc7b7afc6a service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:08.353186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc2db6-6575-4c3e-8887-3e82b8b0da66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:08.362206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc2db6-6575-4c3e-8887-3e82b8b0da66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:08.363331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc2db6-6575-4c3e-8887-3e82b8b0da66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:08.363809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc2db6-6575-4c3e-8887-3e82b8b0da66 admin admin] PATH_INFO: `/v3/users/466dc5d829ac45389fead7c50b68e608` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:08.369142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc2db6-6575-4c3e-8887-3e82b8b0da66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=466dc5d829ac45389fead7c50b68e608)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:08.371900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a9f0f-39cf-4a73-99af-e8360f7c153f service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:08.376609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc2db6-6575-4c3e-8887-3e82b8b0da66 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:08.392686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f3d07-85f8-4358-88b5-707f9aa760a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:08.393464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f3d07-85f8-4358-88b5-707f9aa760a7 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:08.393743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f3d07-85f8-4358-88b5-707f9aa760a7 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:08.394413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f3d07-85f8-4358-88b5-707f9aa760a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:08.402601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c37f3d07-85f8-4358-88b5-707f9aa760a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:08.415076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:08.441785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f3d07-85f8-4358-88b5-707f9aa760a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:08.444231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f3d07-85f8-4358-88b5-707f9aa760a7 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:08.472064 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2405/4845] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:17:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:17:08.530458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a9bc2db6-6575-4c3e-8887-3e82b8b0da66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '466dc5d829ac45389fead7c50b68e608'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:08.555615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a9bc2db6-6575-4c3e-8887-3e82b8b0da66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '466dc5d829ac45389fead7c50b68e608'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:08.556299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a9bc2db6-6575-4c3e-8887-3e82b8b0da66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '466dc5d829ac45389fead7c50b68e608'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:08.556951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a9bc2db6-6575-4c3e-8887-3e82b8b0da66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '466dc5d829ac45389fead7c50b68e608'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:08.576428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a9bc2db6-6575-4c3e-8887-3e82b8b0da66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '466dc5d829ac45389fead7c50b68e608'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:08.620082 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2441/4846] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:17:08 2022] DELETE /identity/v3/users/466dc5d829ac45389fead7c50b68e608 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:17:08.624874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f98fc-c597-4d4b-92a0-03756709ef77 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:08.625350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f98fc-c597-4d4b-92a0-03756709ef77 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:08.625484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f98fc-c597-4d4b-92a0-03756709ef77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:08.658688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-da1f98fc-c597-4d4b-92a0-03756709ef77 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:08.662884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-da1f98fc-c597-4d4b-92a0-03756709ef77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:08.798584 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2406/4847] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:08.870176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc2db6-6575-4c3e-8887-3e82b8b0da66 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:08.871668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a9bc2db6-6575-4c3e-8887-3e82b8b0da66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:09.029351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc2db6-6575-4c3e-8887-3e82b8b0da66 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:09.040627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b19e7-6ba6-4910-9d50-6ac466e34c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:09.041750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b19e7-6ba6-4910-9d50-6ac466e34c03 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:09.042410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b19e7-6ba6-4910-9d50-6ac466e34c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:09.042892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b19e7-6ba6-4910-9d50-6ac466e34c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:09.075152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b19e7-6ba6-4910-9d50-6ac466e34c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:09.080132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b19e7-6ba6-4910-9d50-6ac466e34c03 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:09.114370 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2442/4848] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:17:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:17:09.634389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f758c-df87-4eb6-8871-f01b2bf3f587 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:09.639462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f758c-df87-4eb6-8871-f01b2bf3f587 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:09.639753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f758c-df87-4eb6-8871-f01b2bf3f587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:09.728600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-387f758c-df87-4eb6-8871-f01b2bf3f587 None None] MFA Rules not processed for user `4572a43d0b7e465eabd506fb52a502ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:09.730585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-387f758c-df87-4eb6-8871-f01b2bf3f587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:09.742200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:09.870651 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2407/4849] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:09.881929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83215e9b-8083-4b30-a1ed-73ae912a4bc2 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:09.883042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83215e9b-8083-4b30-a1ed-73ae912a4bc2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:09.883692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83215e9b-8083-4b30-a1ed-73ae912a4bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:09.930630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-83215e9b-8083-4b30-a1ed-73ae912a4bc2 None None] MFA Rules not processed for user `4572a43d0b7e465eabd506fb52a502ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:09.933089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-83215e9b-8083-4b30-a1ed-73ae912a4bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:09.953742 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2443/4850] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:09.968224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f758c-df87-4eb6-8871-f01b2bf3f587 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:09.970622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-387f758c-df87-4eb6-8871-f01b2bf3f587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:10.172864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f758c-df87-4eb6-8871-f01b2bf3f587 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:10.187552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16c1b2-4e61-4190-ae3a-3de6b0480cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:10.188261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16c1b2-4e61-4190-ae3a-3de6b0480cbc service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:10.188733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16c1b2-4e61-4190-ae3a-3de6b0480cbc service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:10.189199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16c1b2-4e61-4190-ae3a-3de6b0480cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:10.209304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16c1b2-4e61-4190-ae3a-3de6b0480cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:10.211267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16c1b2-4e61-4190-ae3a-3de6b0480cbc service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:10.233319 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2408/4851] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:17:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:17:11.645269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83215e9b-8083-4b30-a1ed-73ae912a4bc2 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:11.647398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-83215e9b-8083-4b30-a1ed-73ae912a4bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:11.675014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83215e9b-8083-4b30-a1ed-73ae912a4bc2 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:11.747861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8998726-fa6b-4ed0-88b2-02e1d59b2a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:11.749010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8998726-fa6b-4ed0-88b2-02e1d59b2a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:11.749404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8998726-fa6b-4ed0-88b2-02e1d59b2a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:11.756429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8998726-fa6b-4ed0-88b2-02e1d59b2a9e admin admin] PATH_INFO: `/v3/projects/7b769d890fea450699957ed0aa6bd804` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:11.757982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8998726-fa6b-4ed0-88b2-02e1d59b2a9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b769d890fea450699957ed0aa6bd804)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:11.760188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8998726-fa6b-4ed0-88b2-02e1d59b2a9e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:11.874084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b8998726-fa6b-4ed0-88b2-02e1d59b2a9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b769d890fea450699957ed0aa6bd804', 'request_id': 'req-b8998726-fa6b-4ed0-88b2-02e1d59b2a9e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:11.896870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b8998726-fa6b-4ed0-88b2-02e1d59b2a9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b769d890fea450699957ed0aa6bd804', 'request_id': 'req-b8998726-fa6b-4ed0-88b2-02e1d59b2a9e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:11.910560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b8998726-fa6b-4ed0-88b2-02e1d59b2a9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b769d890fea450699957ed0aa6bd804', 'request_id': 'req-b8998726-fa6b-4ed0-88b2-02e1d59b2a9e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:11.942962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b8998726-fa6b-4ed0-88b2-02e1d59b2a9e admin admin] The token cache is being invalidate because project 7b769d890fea450699957ed0aa6bd804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:17:11.944280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b8998726-fa6b-4ed0-88b2-02e1d59b2a9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:11.946016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b8998726-fa6b-4ed0-88b2-02e1d59b2a9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:11.948323 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2444/4852] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:17:11 2022] DELETE /identity/v3/projects/7b769d890fea450699957ed0aa6bd804 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:17:11.953617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5d0c4-bd0d-4c62-b842-db3d5fa9e2ef None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:11.954152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5d0c4-bd0d-4c62-b842-db3d5fa9e2ef None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:11.955414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5d0c4-bd0d-4c62-b842-db3d5fa9e2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:11.992075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4df5d0c4-bd0d-4c62-b842-db3d5fa9e2ef None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:11.993928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4df5d0c4-bd0d-4c62-b842-db3d5fa9e2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:12.174592 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2409/4853] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:12.183329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbb041-4dbe-4e32-ad80-690779a4db99 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:12.183984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbb041-4dbe-4e32-ad80-690779a4db99 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:12.184500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbb041-4dbe-4e32-ad80-690779a4db99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:12.224150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b6dbb041-4dbe-4e32-ad80-690779a4db99 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:12.225790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b6dbb041-4dbe-4e32-ad80-690779a4db99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:12.252548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5d0c4-bd0d-4c62-b842-db3d5fa9e2ef None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:12.262296 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2445/4854] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:12.264320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5d0c4-bd0d-4c62-b842-db3d5fa9e2ef None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:12.283232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe6534-08ba-4253-9e53-4a2d728dc501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:12.284522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe6534-08ba-4253-9e53-4a2d728dc501 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:12.286722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe6534-08ba-4253-9e53-4a2d728dc501 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:12.287259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe6534-08ba-4253-9e53-4a2d728dc501 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:12.288324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe6534-08ba-4253-9e53-4a2d728dc501 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:17:12.293278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe6534-08ba-4253-9e53-4a2d728dc501 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:12.321575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe6534-08ba-4253-9e53-4a2d728dc501 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:12.420831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbb041-4dbe-4e32-ad80-690779a4db99 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:12.431860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:12.437004 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2410/4855] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:17:12.439561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbb041-4dbe-4e32-ad80-690779a4db99 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:12.452695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d211c-b125-44d1-a8cb-cf34f7f2fcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:12.455523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d211c-b125-44d1-a8cb-cf34f7f2fcea admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:12.456426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d211c-b125-44d1-a8cb-cf34f7f2fcea admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:12.456873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d211c-b125-44d1-a8cb-cf34f7f2fcea admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:12.459109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d211c-b125-44d1-a8cb-cf34f7f2fcea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:12.465543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d211c-b125-44d1-a8cb-cf34f7f2fcea admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:12.557096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe6534-08ba-4253-9e53-4a2d728dc501 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:12.574982 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2446/4856] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:17:12 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:17:12.593340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe6534-08ba-4253-9e53-4a2d728dc501 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:12.646598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:12.765304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d211c-b125-44d1-a8cb-cf34f7f2fcea admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:12.767949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2c5d211c-b125-44d1-a8cb-cf34f7f2fcea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:12.873374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d26d5-e42c-435c-9a4b-ac5813373d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:12.875573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d26d5-e42c-435c-9a4b-ac5813373d49 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:12.875862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d26d5-e42c-435c-9a4b-ac5813373d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:12.878173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d26d5-e42c-435c-9a4b-ac5813373d49 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:12.878977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d26d5-e42c-435c-9a4b-ac5813373d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:12.888868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d26d5-e42c-435c-9a4b-ac5813373d49 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:12.954707 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2411/4857] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:17:12 2022] POST /identity/v3/users => generated 288 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:17:12.963611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d26d5-e42c-435c-9a4b-ac5813373d49 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:12.995152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d26d5-e42c-435c-9a4b-ac5813373d49 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:13.010927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80268327-074a-445e-8c21-611cacf042a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:13.012396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80268327-074a-445e-8c21-611cacf042a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:13.017182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80268327-074a-445e-8c21-611cacf042a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:13.017472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80268327-074a-445e-8c21-611cacf042a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:13.023056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80268327-074a-445e-8c21-611cacf042a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:13.028081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80268327-074a-445e-8c21-611cacf042a4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:13.101638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d211c-b125-44d1-a8cb-cf34f7f2fcea admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:13.110250 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2412/4858] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:17:13.113072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80268327-074a-445e-8c21-611cacf042a4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:13.118151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b1d94-759b-4fdb-8e3a-9ac9edf9b4cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:13.143855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80268327-074a-445e-8c21-611cacf042a4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:13.144983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b1d94-759b-4fdb-8e3a-9ac9edf9b4cb service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:13.145280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b1d94-759b-4fdb-8e3a-9ac9edf9b4cb service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:13.145613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b1d94-759b-4fdb-8e3a-9ac9edf9b4cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:13.155121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-474b1d94-759b-4fdb-8e3a-9ac9edf9b4cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:13.157420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ca342-3e4a-4cd1-840d-a3562772a936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:13.160565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ca342-3e4a-4cd1-840d-a3562772a936 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:13.161036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ca342-3e4a-4cd1-840d-a3562772a936 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:13.162173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ca342-3e4a-4cd1-840d-a3562772a936 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:13.164435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ca342-3e4a-4cd1-840d-a3562772a936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:13.170569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ca342-3e4a-4cd1-840d-a3562772a936 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:13.211004 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2413/4859] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:17:13.215428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ca342-3e4a-4cd1-840d-a3562772a936 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:13.222859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b1d94-759b-4fdb-8e3a-9ac9edf9b4cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:13.229747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b1d94-759b-4fdb-8e3a-9ac9edf9b4cb service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:13.242734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ca342-3e4a-4cd1-840d-a3562772a936 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:13.258374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7fae2-bf70-408f-9e38-0b65bcb7e0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:13.259863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7fae2-bf70-408f-9e38-0b65bcb7e0ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:13.260435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7fae2-bf70-408f-9e38-0b65bcb7e0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:13.260942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7fae2-bf70-408f-9e38-0b65bcb7e0ec admin admin] PATH_INFO: `/v3/projects/e2b1245038184e93b3e6893d777b5ef1/users/529e1697898a4a91a39c8fa841462d8f/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:13.273658 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2447/4860] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:17:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:17:13.295430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7fae2-bf70-408f-9e38-0b65bcb7e0ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b1245038184e93b3e6893d777b5ef1, user_id=529e1697898a4a91a39c8fa841462d8f, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:13.306410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7fae2-bf70-408f-9e38-0b65bcb7e0ec admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:13.336309 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2414/4861] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:17:13 2022] PUT /identity/v3/projects/e2b1245038184e93b3e6893d777b5ef1/users/529e1697898a4a91a39c8fa841462d8f/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:17:13.349214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda8df0-eddf-4102-b4ab-56c966d3d2d6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:13.349511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda8df0-eddf-4102-b4ab-56c966d3d2d6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:13.350792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda8df0-eddf-4102-b4ab-56c966d3d2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:13.451021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7eda8df0-eddf-4102-b4ab-56c966d3d2d6 None None] MFA Rules not processed for user `529e1697898a4a91a39c8fa841462d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:13.468596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7eda8df0-eddf-4102-b4ab-56c966d3d2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:13.683615 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2448/4862] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:13.699611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7fae2-bf70-408f-9e38-0b65bcb7e0ec admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:13.702206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0fe7fae2-bf70-408f-9e38-0b65bcb7e0ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:13.864964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7fae2-bf70-408f-9e38-0b65bcb7e0ec admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:13.880663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242221f0-716b-4adf-99a8-4762a37e66de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:13.881256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242221f0-716b-4adf-99a8-4762a37e66de service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:13.881647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242221f0-716b-4adf-99a8-4762a37e66de service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:13.882036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242221f0-716b-4adf-99a8-4762a37e66de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:13.911371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242221f0-716b-4adf-99a8-4762a37e66de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:13.913153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242221f0-716b-4adf-99a8-4762a37e66de service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:13.966250 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2415/4863] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:17:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:17:23.674566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=74,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:23.949907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=67,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:28.995523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad81e6-b30f-44a9-bf76-e8127eaffef0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:28.996626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad81e6-b30f-44a9-bf76-e8127eaffef0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:28.997248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad81e6-b30f-44a9-bf76-e8127eaffef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:29.018659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-84ad81e6-b30f-44a9-bf76-e8127eaffef0 None None] MFA Rules not processed for user `419f3872408c4d8c9a2980d6397d0aea`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:29.020136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-84ad81e6-b30f-44a9-bf76-e8127eaffef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:29.128947 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2449/4864] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:33.340629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe92bda-4b8c-4407-a3eb-7370af8b42c3 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:33.341127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe92bda-4b8c-4407-a3eb-7370af8b42c3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:33.341438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe92bda-4b8c-4407-a3eb-7370af8b42c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:33.386209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8fe92bda-4b8c-4407-a3eb-7370af8b42c3 None None] MFA Rules not processed for user `7e89c1afe4de42e68f65d0a700c63b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:33.390004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8fe92bda-4b8c-4407-a3eb-7370af8b42c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:33.534788 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2416/4865] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:36.128415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad81e6-b30f-44a9-bf76-e8127eaffef0 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:36.351904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad81e6-b30f-44a9-bf76-e8127eaffef0 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:36.361445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f8ec7-b9ef-40ae-b77c-24462d899db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:36.362879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f8ec7-b9ef-40ae-b77c-24462d899db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:36.363374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f8ec7-b9ef-40ae-b77c-24462d899db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:36.363906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f8ec7-b9ef-40ae-b77c-24462d899db0 admin admin] PATH_INFO: `/v3/users/529e1697898a4a91a39c8fa841462d8f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:36.365598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f8ec7-b9ef-40ae-b77c-24462d899db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=529e1697898a4a91a39c8fa841462d8f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:36.368307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f8ec7-b9ef-40ae-b77c-24462d899db0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:36.462530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-672f8ec7-b9ef-40ae-b77c-24462d899db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '529e1697898a4a91a39c8fa841462d8f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:36.479042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-672f8ec7-b9ef-40ae-b77c-24462d899db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '529e1697898a4a91a39c8fa841462d8f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:36.480507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-672f8ec7-b9ef-40ae-b77c-24462d899db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '529e1697898a4a91a39c8fa841462d8f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:36.481501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-672f8ec7-b9ef-40ae-b77c-24462d899db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '529e1697898a4a91a39c8fa841462d8f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:36.493274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-672f8ec7-b9ef-40ae-b77c-24462d899db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '529e1697898a4a91a39c8fa841462d8f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:36.524859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d3e21-1da5-4bcf-957c-816056d05833 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:36.526308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d3e21-1da5-4bcf-957c-816056d05833 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:36.526595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d3e21-1da5-4bcf-957c-816056d05833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:36.534723 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2450/4866] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:17:36 2022] DELETE /identity/v3/users/529e1697898a4a91a39c8fa841462d8f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:17:36.555433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f85d3e21-1da5-4bcf-957c-816056d05833 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:36.557913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f85d3e21-1da5-4bcf-957c-816056d05833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:36.758110 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2417/4867] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:36.807476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f8ec7-b9ef-40ae-b77c-24462d899db0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:36.810857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-672f8ec7-b9ef-40ae-b77c-24462d899db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:36.871680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:36.964602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f8ec7-b9ef-40ae-b77c-24462d899db0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:36.971578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58544e5e-5ba5-4ddb-a77d-0c41dc015e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:36.972639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58544e5e-5ba5-4ddb-a77d-0c41dc015e67 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:36.973135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58544e5e-5ba5-4ddb-a77d-0c41dc015e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:36.974036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58544e5e-5ba5-4ddb-a77d-0c41dc015e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:36.999070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58544e5e-5ba5-4ddb-a77d-0c41dc015e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:37.001945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58544e5e-5ba5-4ddb-a77d-0c41dc015e67 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:37.014469 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2451/4868] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:17:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:17:38.558924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d3e21-1da5-4bcf-957c-816056d05833 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:38.561579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f85d3e21-1da5-4bcf-957c-816056d05833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:38.577792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d3e21-1da5-4bcf-957c-816056d05833 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:38.582882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1fcab-eb5e-469b-9b71-967843ef6c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:38.584241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1fcab-eb5e-469b-9b71-967843ef6c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:38.585013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1fcab-eb5e-469b-9b71-967843ef6c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:38.585295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1fcab-eb5e-469b-9b71-967843ef6c1a admin admin] PATH_INFO: `/v3/projects/e2b1245038184e93b3e6893d777b5ef1` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:38.586537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1fcab-eb5e-469b-9b71-967843ef6c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b1245038184e93b3e6893d777b5ef1)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:38.588476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1fcab-eb5e-469b-9b71-967843ef6c1a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:38.691493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ff1fcab-eb5e-469b-9b71-967843ef6c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b1245038184e93b3e6893d777b5ef1', 'request_id': 'req-1ff1fcab-eb5e-469b-9b71-967843ef6c1a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:38.700714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ff1fcab-eb5e-469b-9b71-967843ef6c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b1245038184e93b3e6893d777b5ef1', 'request_id': 'req-1ff1fcab-eb5e-469b-9b71-967843ef6c1a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:38.717432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ff1fcab-eb5e-469b-9b71-967843ef6c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b1245038184e93b3e6893d777b5ef1', 'request_id': 'req-1ff1fcab-eb5e-469b-9b71-967843ef6c1a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:38.757567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ff1fcab-eb5e-469b-9b71-967843ef6c1a admin admin] The token cache is being invalidate because project e2b1245038184e93b3e6893d777b5ef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:17:38.758179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ff1fcab-eb5e-469b-9b71-967843ef6c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:38.759052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ff1fcab-eb5e-469b-9b71-967843ef6c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:38.761094 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2418/4869] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:17:38 2022] DELETE /identity/v3/projects/e2b1245038184e93b3e6893d777b5ef1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:17:38.768259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635c2c6-d178-43e5-9e33-253f9823fc61 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:38.768900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635c2c6-d178-43e5-9e33-253f9823fc61 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:38.768900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635c2c6-d178-43e5-9e33-253f9823fc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:38.795238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f635c2c6-d178-43e5-9e33-253f9823fc61 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:38.797615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f635c2c6-d178-43e5-9e33-253f9823fc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:38.903115 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2452/4870] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:38.906835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7b3d9-9cae-4f2c-9a68-c2ee6d0fe606 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:38.907178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7b3d9-9cae-4f2c-9a68-c2ee6d0fe606 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:38.907405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7b3d9-9cae-4f2c-9a68-c2ee6d0fe606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:38.948976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b0b7b3d9-9cae-4f2c-9a68-c2ee6d0fe606 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:38.950291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b0b7b3d9-9cae-4f2c-9a68-c2ee6d0fe606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:38.977776 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2419/4871] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:38.981525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635c2c6-d178-43e5-9e33-253f9823fc61 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:39.010499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635c2c6-d178-43e5-9e33-253f9823fc61 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:39.015141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3d3ec-9ea8-4d3a-b3ac-9889e05da7f3 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:39.015432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3d3ec-9ea8-4d3a-b3ac-9889e05da7f3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:39.015714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3d3ec-9ea8-4d3a-b3ac-9889e05da7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:39.021751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82232ff-2c76-410d-8ee7-32f4b34849c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:39.022390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82232ff-2c76-410d-8ee7-32f4b34849c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:39.024478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82232ff-2c76-410d-8ee7-32f4b34849c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:39.024779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82232ff-2c76-410d-8ee7-32f4b34849c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:39.025545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82232ff-2c76-410d-8ee7-32f4b34849c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:17:39.025866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82232ff-2c76-410d-8ee7-32f4b34849c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:39.033442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82232ff-2c76-410d-8ee7-32f4b34849c1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:39.053397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bdb3d3ec-9ea8-4d3a-b3ac-9889e05da7f3 None None] MFA Rules not processed for user `4572a43d0b7e465eabd506fb52a502ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:39.054641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bdb3d3ec-9ea8-4d3a-b3ac-9889e05da7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:39.068277 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2453/4872] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:17:39.071954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82232ff-2c76-410d-8ee7-32f4b34849c1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:39.093734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82232ff-2c76-410d-8ee7-32f4b34849c1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:39.104872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b30ff-338b-43eb-966f-3af6d4f4d449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:39.105958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b30ff-338b-43eb-966f-3af6d4f4d449 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:39.105958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b30ff-338b-43eb-966f-3af6d4f4d449 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:39.106181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b30ff-338b-43eb-966f-3af6d4f4d449 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:39.106931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b30ff-338b-43eb-966f-3af6d4f4d449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:39.114027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:39.114766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b30ff-338b-43eb-966f-3af6d4f4d449 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:39.177182 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2454/4873] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:17:39 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:17:39.179740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b30ff-338b-43eb-966f-3af6d4f4d449 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:39.204781 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2420/4874] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:39.326932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b30ff-338b-43eb-966f-3af6d4f4d449 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:39.340858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc294e-8e41-4ed4-9602-804882d1aea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:39.342612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc294e-8e41-4ed4-9602-804882d1aea1 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:39.343398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc294e-8e41-4ed4-9602-804882d1aea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:39.343939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc294e-8e41-4ed4-9602-804882d1aea1 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:39.344900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc294e-8e41-4ed4-9602-804882d1aea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:39.347252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc294e-8e41-4ed4-9602-804882d1aea1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:39.385057 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2455/4875] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:17:39 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:17:39.389551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3d3ec-9ea8-4d3a-b3ac-9889e05da7f3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:39.409698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3d3ec-9ea8-4d3a-b3ac-9889e05da7f3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:39.419745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54389bcd-6172-4cf7-8480-e791f8444575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:39.420878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54389bcd-6172-4cf7-8480-e791f8444575 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:39.421918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54389bcd-6172-4cf7-8480-e791f8444575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:39.422817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54389bcd-6172-4cf7-8480-e791f8444575 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:39.424647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54389bcd-6172-4cf7-8480-e791f8444575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:39.427921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54389bcd-6172-4cf7-8480-e791f8444575 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:39.447934 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2421/4876] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:17:39.457422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc294e-8e41-4ed4-9602-804882d1aea1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:39.472639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc294e-8e41-4ed4-9602-804882d1aea1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:39.478794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13482bb-34cc-46f1-954f-94e3151026b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:39.479827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13482bb-34cc-46f1-954f-94e3151026b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:39.480407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13482bb-34cc-46f1-954f-94e3151026b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:39.480955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13482bb-34cc-46f1-954f-94e3151026b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:39.482973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13482bb-34cc-46f1-954f-94e3151026b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:39.485206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13482bb-34cc-46f1-954f-94e3151026b0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:39.501465 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2456/4877] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:17:39.505669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54389bcd-6172-4cf7-8480-e791f8444575 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:39.518458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54389bcd-6172-4cf7-8480-e791f8444575 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:39.523952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce254d-748c-4f7f-81f8-e5b7218dd0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:39.525169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce254d-748c-4f7f-81f8-e5b7218dd0ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:39.525683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce254d-748c-4f7f-81f8-e5b7218dd0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:39.526306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce254d-748c-4f7f-81f8-e5b7218dd0ff admin admin] PATH_INFO: `/v3/projects/c7534889ba5b48338c27c0556be3c6f0/users/2016769bf3a34d22992b45f9974b99a2/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:39.551028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce254d-748c-4f7f-81f8-e5b7218dd0ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7534889ba5b48338c27c0556be3c6f0, user_id=2016769bf3a34d22992b45f9974b99a2, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:39.555435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce254d-748c-4f7f-81f8-e5b7218dd0ff admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:39.589375 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2422/4878] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:17:39 2022] PUT /identity/v3/projects/c7534889ba5b48338c27c0556be3c6f0/users/2016769bf3a34d22992b45f9974b99a2/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:17:39.594893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4a6b6-3fb3-4d1c-b567-7685f32ae859 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:39.595301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4a6b6-3fb3-4d1c-b567-7685f32ae859 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:39.595668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4a6b6-3fb3-4d1c-b567-7685f32ae859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:39.617912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-26e4a6b6-3fb3-4d1c-b567-7685f32ae859 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:39.619792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-26e4a6b6-3fb3-4d1c-b567-7685f32ae859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:39.626924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:39.697862 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2457/4879] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:39.732832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce254d-748c-4f7f-81f8-e5b7218dd0ff admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:39.739778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-00ce254d-748c-4f7f-81f8-e5b7218dd0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:39.901312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce254d-748c-4f7f-81f8-e5b7218dd0ff admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:39.906258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf79f1-236b-4dc0-879c-fc44973497be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:39.907235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf79f1-236b-4dc0-879c-fc44973497be service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:39.908430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf79f1-236b-4dc0-879c-fc44973497be service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:39.908719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf79f1-236b-4dc0-879c-fc44973497be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:39.920698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf79f1-236b-4dc0-879c-fc44973497be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:39.925168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf79f1-236b-4dc0-879c-fc44973497be service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:39.942952 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2423/4880] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:17:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:17:41.081541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4a6b6-3fb3-4d1c-b567-7685f32ae859 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:41.083086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-26e4a6b6-3fb3-4d1c-b567-7685f32ae859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:41.271895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4a6b6-3fb3-4d1c-b567-7685f32ae859 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:41.279751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5ec4d-4c11-4e1e-a8d2-f2f85b892b78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:41.282077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5ec4d-4c11-4e1e-a8d2-f2f85b892b78 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:41.283580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5ec4d-4c11-4e1e-a8d2-f2f85b892b78 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:41.283871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5ec4d-4c11-4e1e-a8d2-f2f85b892b78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:41.286722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-70d5ec4d-4c11-4e1e-a8d2-f2f85b892b78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:41.306673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5ec4d-4c11-4e1e-a8d2-f2f85b892b78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:41.309230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5ec4d-4c11-4e1e-a8d2-f2f85b892b78 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:41.328502 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2458/4881] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:17:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:17:41.515056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ea4e5-092f-4b8d-aa1a-7c310fd93caa None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:41.515546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ea4e5-092f-4b8d-aa1a-7c310fd93caa None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:41.515715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ea4e5-092f-4b8d-aa1a-7c310fd93caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:41.546003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f7c01-f9b0-4a7c-95ca-d6298ee975ea None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:41.546562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f7c01-f9b0-4a7c-95ca-d6298ee975ea None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:41.547012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f7c01-f9b0-4a7c-95ca-d6298ee975ea None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:41.550045 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2459/4882] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:17:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 21:17:41.556467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9f7ea4e5-092f-4b8d-aa1a-7c310fd93caa None None] MFA Rules not processed for user `4572a43d0b7e465eabd506fb52a502ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:41.558307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9f7ea4e5-092f-4b8d-aa1a-7c310fd93caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:41.558939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c728db8-33c9-4a91-ad4f-a5c8ddbad932 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:41.559245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c728db8-33c9-4a91-ad4f-a5c8ddbad932 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:41.559708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c728db8-33c9-4a91-ad4f-a5c8ddbad932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:41.642388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8c728db8-33c9-4a91-ad4f-a5c8ddbad932 None None] MFA Rules not processed for user `684732cf5a004fb084ce0e523398c970`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:41.644173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8c728db8-33c9-4a91-ad4f-a5c8ddbad932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:41.658474 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2460/4883] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:17:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:41.658799 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2424/4884] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:41.660379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ea4e5-092f-4b8d-aa1a-7c310fd93caa None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:41.715035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ea4e5-092f-4b8d-aa1a-7c310fd93caa None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:41.768352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591923e9-5ce2-4254-bb78-6ecfa6b1ae51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:41.769760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591923e9-5ce2-4254-bb78-6ecfa6b1ae51 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:41.772727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591923e9-5ce2-4254-bb78-6ecfa6b1ae51 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:41.773652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591923e9-5ce2-4254-bb78-6ecfa6b1ae51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:41.780701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c728db8-33c9-4a91-ad4f-a5c8ddbad932 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:41.791045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-591923e9-5ce2-4254-bb78-6ecfa6b1ae51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:41.804542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c728db8-33c9-4a91-ad4f-a5c8ddbad932 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:41.828436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f54640-31c7-4b96-891d-dd5e8d31a706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:41.829249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f54640-31c7-4b96-891d-dd5e8d31a706 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:41.829524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f54640-31c7-4b96-891d-dd5e8d31a706 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:41.829809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f54640-31c7-4b96-891d-dd5e8d31a706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:41.859080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591923e9-5ce2-4254-bb78-6ecfa6b1ae51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:41.860795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591923e9-5ce2-4254-bb78-6ecfa6b1ae51 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:41.869421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f54640-31c7-4b96-891d-dd5e8d31a706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:41.875513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f54640-31c7-4b96-891d-dd5e8d31a706 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:41.899030 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2461/4885] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:17:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:17:41.909942 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2425/4886] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:17:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:17:42.943240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547cc1-8f1c-45d4-bed1-9d7cc67b287e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:42.943841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547cc1-8f1c-45d4-bed1-9d7cc67b287e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:42.943841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547cc1-8f1c-45d4-bed1-9d7cc67b287e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:42.997365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fd547cc1-8f1c-45d4-bed1-9d7cc67b287e None None] MFA Rules not processed for user `2016769bf3a34d22992b45f9974b99a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:42.998603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fd547cc1-8f1c-45d4-bed1-9d7cc67b287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:43.167378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:43.175392 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2462/4887] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:43.191142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591923e9-5ce2-4254-bb78-6ecfa6b1ae51 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:43.193488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-591923e9-5ce2-4254-bb78-6ecfa6b1ae51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:43.246912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:43.296452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591923e9-5ce2-4254-bb78-6ecfa6b1ae51 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:43.302357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b1516-d588-4610-93ff-025c35e0474b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:43.303636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b1516-d588-4610-93ff-025c35e0474b service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:43.303954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b1516-d588-4610-93ff-025c35e0474b service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:43.304538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b1516-d588-4610-93ff-025c35e0474b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:43.319064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b1516-d588-4610-93ff-025c35e0474b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:43.321347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b1516-d588-4610-93ff-025c35e0474b service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:43.339787 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2426/4888] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:17:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:17:44.960850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd547cc1-8f1c-45d4-bed1-9d7cc67b287e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:44.964345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fd547cc1-8f1c-45d4-bed1-9d7cc67b287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:45.006032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd547cc1-8f1c-45d4-bed1-9d7cc67b287e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:45.015672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48c2a8-e4db-4fb2-b0ce-7adaf84ecef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:45.018544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48c2a8-e4db-4fb2-b0ce-7adaf84ecef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:45.019046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48c2a8-e4db-4fb2-b0ce-7adaf84ecef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:45.021384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48c2a8-e4db-4fb2-b0ce-7adaf84ecef1 admin admin] PATH_INFO: `/v3/users/4157aea6b829422398f3f1fcf3abe116` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:45.107911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48c2a8-e4db-4fb2-b0ce-7adaf84ecef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4157aea6b829422398f3f1fcf3abe116)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:45.107911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48c2a8-e4db-4fb2-b0ce-7adaf84ecef1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:45.192460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0b48c2a8-e4db-4fb2-b0ce-7adaf84ecef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4157aea6b829422398f3f1fcf3abe116'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:45.220461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0b48c2a8-e4db-4fb2-b0ce-7adaf84ecef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4157aea6b829422398f3f1fcf3abe116'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:45.221770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0b48c2a8-e4db-4fb2-b0ce-7adaf84ecef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4157aea6b829422398f3f1fcf3abe116'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:45.222538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0b48c2a8-e4db-4fb2-b0ce-7adaf84ecef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4157aea6b829422398f3f1fcf3abe116'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:45.245518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0b48c2a8-e4db-4fb2-b0ce-7adaf84ecef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4157aea6b829422398f3f1fcf3abe116'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:45.301837 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2463/4889] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:17:44 2022] DELETE /identity/v3/users/4157aea6b829422398f3f1fcf3abe116 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:17:46.095489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b1516-d588-4610-93ff-025c35e0474b service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:46.125968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b1516-d588-4610-93ff-025c35e0474b service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:46.239742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cc6b0-3439-4c1a-8a76-aae1d6f7643d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:46.240928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cc6b0-3439-4c1a-8a76-aae1d6f7643d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:46.241345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cc6b0-3439-4c1a-8a76-aae1d6f7643d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:46.241816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cc6b0-3439-4c1a-8a76-aae1d6f7643d admin admin] PATH_INFO: `/v3/projects/6cc0bf706fb941f59a94a88a811468c7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:46.245607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50cc6b0-3439-4c1a-8a76-aae1d6f7643d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cc0bf706fb941f59a94a88a811468c7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:46.250789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50cc6b0-3439-4c1a-8a76-aae1d6f7643d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:46.330405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e50cc6b0-3439-4c1a-8a76-aae1d6f7643d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cc0bf706fb941f59a94a88a811468c7', 'request_id': 'req-e50cc6b0-3439-4c1a-8a76-aae1d6f7643d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:46.341872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e50cc6b0-3439-4c1a-8a76-aae1d6f7643d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cc0bf706fb941f59a94a88a811468c7', 'request_id': 'req-e50cc6b0-3439-4c1a-8a76-aae1d6f7643d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:46.355493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e50cc6b0-3439-4c1a-8a76-aae1d6f7643d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cc0bf706fb941f59a94a88a811468c7', 'request_id': 'req-e50cc6b0-3439-4c1a-8a76-aae1d6f7643d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:46.387013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e50cc6b0-3439-4c1a-8a76-aae1d6f7643d admin admin] The token cache is being invalidate because project 6cc0bf706fb941f59a94a88a811468c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:17:46.387621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e50cc6b0-3439-4c1a-8a76-aae1d6f7643d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:46.389112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e50cc6b0-3439-4c1a-8a76-aae1d6f7643d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:17:46.395313 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2427/4890] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:17:46 2022] DELETE /identity/v3/projects/6cc0bf706fb941f59a94a88a811468c7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:17:46.396760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32a662-ac6a-401a-92cb-84ca0ed53f92 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:46.397223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32a662-ac6a-401a-92cb-84ca0ed53f92 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:46.397315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32a662-ac6a-401a-92cb-84ca0ed53f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:46.424923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2e32a662-ac6a-401a-92cb-84ca0ed53f92 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:46.426725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2e32a662-ac6a-401a-92cb-84ca0ed53f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:46.525544 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2464/4891] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:46.533933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced43e1-546d-4343-ba6d-d7b41572c85a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:46.534303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced43e1-546d-4343-ba6d-d7b41572c85a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:46.534794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced43e1-546d-4343-ba6d-d7b41572c85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:46.556390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-7ced43e1-546d-4343-ba6d-d7b41572c85a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:46.557645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7ced43e1-546d-4343-ba6d-d7b41572c85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:46.576229 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2428/4892] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:46.576954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32a662-ac6a-401a-92cb-84ca0ed53f92 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:46.591488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32a662-ac6a-401a-92cb-84ca0ed53f92 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:46.600710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4666e3-c1ea-4917-a6b9-fd3527f6430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:46.601701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4666e3-c1ea-4917-a6b9-fd3527f6430d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:46.602141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4666e3-c1ea-4917-a6b9-fd3527f6430d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:46.602555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4666e3-c1ea-4917-a6b9-fd3527f6430d admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:46.603499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4666e3-c1ea-4917-a6b9-fd3527f6430d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:17:46.603970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4666e3-c1ea-4917-a6b9-fd3527f6430d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:46.605885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4666e3-c1ea-4917-a6b9-fd3527f6430d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:46.634528 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2465/4893] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:17:46.639407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced43e1-546d-4343-ba6d-d7b41572c85a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:46.656870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced43e1-546d-4343-ba6d-d7b41572c85a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:46.664380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88355c21-4327-4f17-a519-1ce316e5a6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:46.665039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88355c21-4327-4f17-a519-1ce316e5a6ce admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:46.665412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88355c21-4327-4f17-a519-1ce316e5a6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:46.666613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88355c21-4327-4f17-a519-1ce316e5a6ce admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:46.667403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88355c21-4327-4f17-a519-1ce316e5a6ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:46.669834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88355c21-4327-4f17-a519-1ce316e5a6ce admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:46.706693 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2429/4894] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:17:46 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:17:46.711649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4666e3-c1ea-4917-a6b9-fd3527f6430d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:46.726185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4666e3-c1ea-4917-a6b9-fd3527f6430d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:46.827942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:46.838405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50d335-1a87-4996-845f-50ff53a27d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:46.839467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50d335-1a87-4996-845f-50ff53a27d64 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:46.840994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50d335-1a87-4996-845f-50ff53a27d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:46.842233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50d335-1a87-4996-845f-50ff53a27d64 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:46.843982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50d335-1a87-4996-845f-50ff53a27d64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:46.846450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50d335-1a87-4996-845f-50ff53a27d64 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:46.897055 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2466/4895] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:17:46 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:17:46.901634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88355c21-4327-4f17-a519-1ce316e5a6ce admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:46.928489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88355c21-4327-4f17-a519-1ce316e5a6ce admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:46.936122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b20a7-7989-430e-8339-98e973d288c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:46.937081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b20a7-7989-430e-8339-98e973d288c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:46.937485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b20a7-7989-430e-8339-98e973d288c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:46.937932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b20a7-7989-430e-8339-98e973d288c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:46.939552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b20a7-7989-430e-8339-98e973d288c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:46.947810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b20a7-7989-430e-8339-98e973d288c9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:46.979522 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2430/4896] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:17:46.983904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50d335-1a87-4996-845f-50ff53a27d64 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:47.001054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50d335-1a87-4996-845f-50ff53a27d64 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:47.007524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107b639-c172-43f8-88cc-9fcb7d8440fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:47.008463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107b639-c172-43f8-88cc-9fcb7d8440fc admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:47.008892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107b639-c172-43f8-88cc-9fcb7d8440fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:47.009408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107b639-c172-43f8-88cc-9fcb7d8440fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:47.010634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107b639-c172-43f8-88cc-9fcb7d8440fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:47.012679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107b639-c172-43f8-88cc-9fcb7d8440fc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:47.046564 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2467/4897] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:17:47.048211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b20a7-7989-430e-8339-98e973d288c9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:47.065630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b20a7-7989-430e-8339-98e973d288c9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:47.095400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c5460-43d6-4a4b-ba2b-9abca4374e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:47.100226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c5460-43d6-4a4b-ba2b-9abca4374e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:47.101107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c5460-43d6-4a4b-ba2b-9abca4374e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:47.101601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c5460-43d6-4a4b-ba2b-9abca4374e18 admin admin] PATH_INFO: `/v3/projects/a2af6b3a0a814ce7afb1ae17717f006d/users/6fd3a7fe3e614b9f91c7905c1e2464a8/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:47.125422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c5460-43d6-4a4b-ba2b-9abca4374e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2af6b3a0a814ce7afb1ae17717f006d, user_id=6fd3a7fe3e614b9f91c7905c1e2464a8, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:47.135780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c5460-43d6-4a4b-ba2b-9abca4374e18 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:47.141269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:47.177923 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2431/4898] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:17:47 2022] PUT /identity/v3/projects/a2af6b3a0a814ce7afb1ae17717f006d/users/6fd3a7fe3e614b9f91c7905c1e2464a8/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:17:47.194259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c5876-deef-46a7-9259-dd1a74d8a547 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:47.194711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c5876-deef-46a7-9259-dd1a74d8a547 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:47.195198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c5876-deef-46a7-9259-dd1a74d8a547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:47.242935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-281c5876-deef-46a7-9259-dd1a74d8a547 None None] MFA Rules not processed for user `6fd3a7fe3e614b9f91c7905c1e2464a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:47.244532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-281c5876-deef-46a7-9259-dd1a74d8a547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:47.341773 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2468/4899] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:47.355412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610306a-c153-4021-865d-d8a8a7c3ed86 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:47.355412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610306a-c153-4021-865d-d8a8a7c3ed86 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:47.355412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610306a-c153-4021-865d-d8a8a7c3ed86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:47.382269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c610306a-c153-4021-865d-d8a8a7c3ed86 None None] MFA Rules not processed for user `6fd3a7fe3e614b9f91c7905c1e2464a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:47.383945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c610306a-c153-4021-865d-d8a8a7c3ed86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:47.393731 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2432/4900] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:17:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:47.818925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c5876-deef-46a7-9259-dd1a74d8a547 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:47.821200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-281c5876-deef-46a7-9259-dd1a74d8a547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:47.972639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c5876-deef-46a7-9259-dd1a74d8a547 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:47.985090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac945e-2d22-4c87-9ced-e55c7887a5b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:47.986041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac945e-2d22-4c87-9ced-e55c7887a5b4 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:47.986657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac945e-2d22-4c87-9ced-e55c7887a5b4 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:47.987071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac945e-2d22-4c87-9ced-e55c7887a5b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:48.000584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac945e-2d22-4c87-9ced-e55c7887a5b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:48.003047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac945e-2d22-4c87-9ced-e55c7887a5b4 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:48.016785 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2469/4901] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:17:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:17:53.280896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141a21d-35d5-4622-86ff-074f1012db50 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:53.281626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141a21d-35d5-4622-86ff-074f1012db50 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:53.281626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141a21d-35d5-4622-86ff-074f1012db50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:53.315767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f141a21d-35d5-4622-86ff-074f1012db50 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:17:53.319292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f141a21d-35d5-4622-86ff-074f1012db50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:53.484657 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2433/4902] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:17:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:17:53.653619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac945e-2d22-4c87-9ced-e55c7887a5b4 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:17:53.655122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a6ac945e-2d22-4c87-9ced-e55c7887a5b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:17:53.787497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:53.874684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac945e-2d22-4c87-9ced-e55c7887a5b4 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:17:53.892114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81a7e1-d96c-457e-ab46-731221995c4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:17:53.895341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81a7e1-d96c-457e-ab46-731221995c4d service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:17:53.901262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81a7e1-d96c-457e-ab46-731221995c4d service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:17:53.901703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81a7e1-d96c-457e-ab46-731221995c4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:17:53.925254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81a7e1-d96c-457e-ab46-731221995c4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:17:53.929133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81a7e1-d96c-457e-ab46-731221995c4d service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:17:53.950123 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2470/4903] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:17:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:18:00.559355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141a21d-35d5-4622-86ff-074f1012db50 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:00.747544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141a21d-35d5-4622-86ff-074f1012db50 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:00.756923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe6545-21d5-4697-a675-f130a091476c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:00.758186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe6545-21d5-4697-a675-f130a091476c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:00.758599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe6545-21d5-4697-a675-f130a091476c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:00.759296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe6545-21d5-4697-a675-f130a091476c admin admin] PATH_INFO: `/v3/users/6fd3a7fe3e614b9f91c7905c1e2464a8` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:00.762399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe6545-21d5-4697-a675-f130a091476c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd3a7fe3e614b9f91c7905c1e2464a8)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:00.764690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe6545-21d5-4697-a675-f130a091476c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:00.908421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-13fe6545-21d5-4697-a675-f130a091476c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd3a7fe3e614b9f91c7905c1e2464a8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:18:00.948959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-13fe6545-21d5-4697-a675-f130a091476c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd3a7fe3e614b9f91c7905c1e2464a8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:18:00.972845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-13fe6545-21d5-4697-a675-f130a091476c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd3a7fe3e614b9f91c7905c1e2464a8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:18:00.974153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-13fe6545-21d5-4697-a675-f130a091476c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd3a7fe3e614b9f91c7905c1e2464a8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:18:00.975400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-13fe6545-21d5-4697-a675-f130a091476c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd3a7fe3e614b9f91c7905c1e2464a8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:18:01.024207 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2434/4904] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:18:00 2022] DELETE /identity/v3/users/6fd3a7fe3e614b9f91c7905c1e2464a8 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:18:01.032277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cbd9f-2f19-45f2-853d-44eed13c8501 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:01.033003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cbd9f-2f19-45f2-853d-44eed13c8501 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:01.035044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cbd9f-2f19-45f2-853d-44eed13c8501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:01.113123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-381cbd9f-2f19-45f2-853d-44eed13c8501 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:18:01.114327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-381cbd9f-2f19-45f2-853d-44eed13c8501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:01.305295 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2471/4905] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:18:01.319113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe6545-21d5-4697-a675-f130a091476c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:01.320265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-13fe6545-21d5-4697-a675-f130a091476c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:01.335521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:01.484998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe6545-21d5-4697-a675-f130a091476c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:01.500018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bd7c4-0a78-402e-a6d5-a0b0e0089e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:01.500743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bd7c4-0a78-402e-a6d5-a0b0e0089e5e service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:01.501404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bd7c4-0a78-402e-a6d5-a0b0e0089e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:01.501692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bd7c4-0a78-402e-a6d5-a0b0e0089e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:01.522639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bd7c4-0a78-402e-a6d5-a0b0e0089e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:01.525433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bd7c4-0a78-402e-a6d5-a0b0e0089e5e service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:01.569831 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2435/4906] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:18:02.321496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cbd9f-2f19-45f2-853d-44eed13c8501 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:02.323668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-381cbd9f-2f19-45f2-853d-44eed13c8501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:02.345200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cbd9f-2f19-45f2-853d-44eed13c8501 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:02.360628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5a1f5-7b23-40ea-a96b-e54ee1e521b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:02.361799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5a1f5-7b23-40ea-a96b-e54ee1e521b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:02.362220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5a1f5-7b23-40ea-a96b-e54ee1e521b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:02.362635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5a1f5-7b23-40ea-a96b-e54ee1e521b7 admin admin] PATH_INFO: `/v3/projects/a2af6b3a0a814ce7afb1ae17717f006d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:02.364095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5a1f5-7b23-40ea-a96b-e54ee1e521b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2af6b3a0a814ce7afb1ae17717f006d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:02.366217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5a1f5-7b23-40ea-a96b-e54ee1e521b7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:02.504226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0fe5a1f5-7b23-40ea-a96b-e54ee1e521b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2af6b3a0a814ce7afb1ae17717f006d', 'request_id': 'req-0fe5a1f5-7b23-40ea-a96b-e54ee1e521b7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:18:02.529598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0fe5a1f5-7b23-40ea-a96b-e54ee1e521b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2af6b3a0a814ce7afb1ae17717f006d', 'request_id': 'req-0fe5a1f5-7b23-40ea-a96b-e54ee1e521b7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:18:02.545336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0fe5a1f5-7b23-40ea-a96b-e54ee1e521b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2af6b3a0a814ce7afb1ae17717f006d', 'request_id': 'req-0fe5a1f5-7b23-40ea-a96b-e54ee1e521b7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:18:02.558227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0fe5a1f5-7b23-40ea-a96b-e54ee1e521b7 admin admin] The token cache is being invalidate because project a2af6b3a0a814ce7afb1ae17717f006d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:18:02.558595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0fe5a1f5-7b23-40ea-a96b-e54ee1e521b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:18:02.559715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0fe5a1f5-7b23-40ea-a96b-e54ee1e521b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:18:02.565317 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2472/4907] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:18:02 2022] DELETE /identity/v3/projects/a2af6b3a0a814ce7afb1ae17717f006d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:18:02.566754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b25a42-3829-426b-a8b7-4cf528fdcc07 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:02.567051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b25a42-3829-426b-a8b7-4cf528fdcc07 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:02.567330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b25a42-3829-426b-a8b7-4cf528fdcc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:02.587053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-08b25a42-3829-426b-a8b7-4cf528fdcc07 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:18:02.588526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-08b25a42-3829-426b-a8b7-4cf528fdcc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:02.679102 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2436/4908] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:18:02.687614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660a21f-e39c-4f7b-a713-3c62dd7b34b5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:02.688275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660a21f-e39c-4f7b-a713-3c62dd7b34b5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:02.688772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660a21f-e39c-4f7b-a713-3c62dd7b34b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:02.725851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7660a21f-e39c-4f7b-a713-3c62dd7b34b5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:18:02.730947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7660a21f-e39c-4f7b-a713-3c62dd7b34b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:02.758439 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2473/4909] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:18:02.758729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b25a42-3829-426b-a8b7-4cf528fdcc07 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:02.774779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b25a42-3829-426b-a8b7-4cf528fdcc07 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:02.789401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352859d-ac0e-4d38-89b1-71fde34803cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:02.790420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352859d-ac0e-4d38-89b1-71fde34803cc admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:02.790851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352859d-ac0e-4d38-89b1-71fde34803cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:02.792375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352859d-ac0e-4d38-89b1-71fde34803cc admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:02.793354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352859d-ac0e-4d38-89b1-71fde34803cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:18:02.796136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352859d-ac0e-4d38-89b1-71fde34803cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:02.799198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352859d-ac0e-4d38-89b1-71fde34803cc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:02.828930 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2437/4910] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:18:02.832696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660a21f-e39c-4f7b-a713-3c62dd7b34b5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:02.857336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660a21f-e39c-4f7b-a713-3c62dd7b34b5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:02.875977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c880f-1e85-4b16-a4eb-3bcc7f918acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:02.876698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c880f-1e85-4b16-a4eb-3bcc7f918acf admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:02.876980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c880f-1e85-4b16-a4eb-3bcc7f918acf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:02.877415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c880f-1e85-4b16-a4eb-3bcc7f918acf admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:02.878141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c880f-1e85-4b16-a4eb-3bcc7f918acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:02.880108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c880f-1e85-4b16-a4eb-3bcc7f918acf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:02.955406 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2474/4911] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:18:02 2022] POST /identity/v3/projects => generated 397 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:18:02.965814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352859d-ac0e-4d38-89b1-71fde34803cc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:03.000303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352859d-ac0e-4d38-89b1-71fde34803cc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:03.179477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb126c-c26f-48d1-81cc-92ccda0ee983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:03.180091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb126c-c26f-48d1-81cc-92ccda0ee983 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:03.180478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb126c-c26f-48d1-81cc-92ccda0ee983 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:03.180760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb126c-c26f-48d1-81cc-92ccda0ee983 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:03.181943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb126c-c26f-48d1-81cc-92ccda0ee983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:03.191706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb126c-c26f-48d1-81cc-92ccda0ee983 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:03.223114 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2438/4912] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:18:02 2022] POST /identity/v3/users => generated 299 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:18:03.227068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c880f-1e85-4b16-a4eb-3bcc7f918acf admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:03.249365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c880f-1e85-4b16-a4eb-3bcc7f918acf admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:03.272107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef25b2-f08c-4f33-a840-07ebac644ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:03.272830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef25b2-f08c-4f33-a840-07ebac644ece admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:03.273139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef25b2-f08c-4f33-a840-07ebac644ece admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:03.273397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef25b2-f08c-4f33-a840-07ebac644ece admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:03.274866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef25b2-f08c-4f33-a840-07ebac644ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:03.276941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef25b2-f08c-4f33-a840-07ebac644ece admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:03.299120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb126c-c26f-48d1-81cc-92ccda0ee983 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:03.314734 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2475/4913] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:18:03.319048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb126c-c26f-48d1-81cc-92ccda0ee983 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:03.336908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c01d6d-c7b0-4028-9394-7b3c4218011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:03.338630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c01d6d-c7b0-4028-9394-7b3c4218011a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:03.339071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c01d6d-c7b0-4028-9394-7b3c4218011a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:03.339452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c01d6d-c7b0-4028-9394-7b3c4218011a admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:03.340919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c01d6d-c7b0-4028-9394-7b3c4218011a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:03.342828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c01d6d-c7b0-4028-9394-7b3c4218011a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:03.364829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef25b2-f08c-4f33-a840-07ebac644ece admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:03.380354 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2439/4914] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:18:03.385878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef25b2-f08c-4f33-a840-07ebac644ece admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:03.393246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54ef8e-775e-4c78-a47a-ca2385e3ac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:03.394348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54ef8e-775e-4c78-a47a-ca2385e3ac85 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:03.394768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54ef8e-775e-4c78-a47a-ca2385e3ac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:03.395152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54ef8e-775e-4c78-a47a-ca2385e3ac85 admin admin] PATH_INFO: `/v3/projects/a95706cb67b642f58f6c0bdf8e65d766/users/678fafac5b764cd18ed9f40c6ac09be6/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:03.426815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:03.438666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54ef8e-775e-4c78-a47a-ca2385e3ac85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a95706cb67b642f58f6c0bdf8e65d766, user_id=678fafac5b764cd18ed9f40c6ac09be6, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:03.446579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54ef8e-775e-4c78-a47a-ca2385e3ac85 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:03.480752 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2476/4915] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:18:03 2022] PUT /identity/v3/projects/a95706cb67b642f58f6c0bdf8e65d766/users/678fafac5b764cd18ed9f40c6ac09be6/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:18:03.486460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821455a1-2feb-4fcd-afe9-229212d6f9d7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:03.486928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821455a1-2feb-4fcd-afe9-229212d6f9d7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:03.487317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821455a1-2feb-4fcd-afe9-229212d6f9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:03.546406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-821455a1-2feb-4fcd-afe9-229212d6f9d7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:18:03.547969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-821455a1-2feb-4fcd-afe9-229212d6f9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:03.563396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:03.679047 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2440/4916] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:18:03.686553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54ef8e-775e-4c78-a47a-ca2385e3ac85 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:03.699694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7e54ef8e-775e-4c78-a47a-ca2385e3ac85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:03.801413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54ef8e-775e-4c78-a47a-ca2385e3ac85 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:03.814147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4395c4-d5b8-4c38-8e03-6a4be9ab2859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:03.814737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4395c4-d5b8-4c38-8e03-6a4be9ab2859 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:03.815021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4395c4-d5b8-4c38-8e03-6a4be9ab2859 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:03.815299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4395c4-d5b8-4c38-8e03-6a4be9ab2859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:03.840229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4395c4-d5b8-4c38-8e03-6a4be9ab2859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:03.841991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4395c4-d5b8-4c38-8e03-6a4be9ab2859 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:03.870670 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2477/4917] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:18:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:18:13.655511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=21 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:13.864183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:14.673156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02286ba1-679e-43c1-86f6-a574db2981a6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:14.674036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02286ba1-679e-43c1-86f6-a574db2981a6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:14.674464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02286ba1-679e-43c1-86f6-a574db2981a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:14.710700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-02286ba1-679e-43c1-86f6-a574db2981a6 None None] MFA Rules not processed for user `2016769bf3a34d22992b45f9974b99a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:18:14.713204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-02286ba1-679e-43c1-86f6-a574db2981a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:14.849732 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2441/4918] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:18:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:18:16.793677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6039ace-b2bd-4da0-8e67-4a4efde69feb None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:16.794210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6039ace-b2bd-4da0-8e67-4a4efde69feb None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:16.794459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6039ace-b2bd-4da0-8e67-4a4efde69feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:16.830842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a6039ace-b2bd-4da0-8e67-4a4efde69feb None None] MFA Rules not processed for user `678fafac5b764cd18ed9f40c6ac09be6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:18:16.848665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a6039ace-b2bd-4da0-8e67-4a4efde69feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:17.036648 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2478/4919] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:18:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:18:17.052284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5caf2b-fa7d-4a70-b403-c3a1631b432c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:17.053509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5caf2b-fa7d-4a70-b403-c3a1631b432c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:17.056548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5caf2b-fa7d-4a70-b403-c3a1631b432c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:17.079015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5f5caf2b-fa7d-4a70-b403-c3a1631b432c None None] MFA Rules not processed for user `678fafac5b764cd18ed9f40c6ac09be6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:18:17.081659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5f5caf2b-fa7d-4a70-b403-c3a1631b432c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:17.096199 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2442/4920] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:18:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:18:17.391857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6039ace-b2bd-4da0-8e67-4a4efde69feb None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:17.393313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a6039ace-b2bd-4da0-8e67-4a4efde69feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:17.425845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6039ace-b2bd-4da0-8e67-4a4efde69feb None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:17.433228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb1538-e595-4b8a-924d-d425737f394f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:17.434742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb1538-e595-4b8a-924d-d425737f394f service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:17.435026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb1538-e595-4b8a-924d-d425737f394f service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:17.435298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb1538-e595-4b8a-924d-d425737f394f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:17.440948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-35fb1538-e595-4b8a-924d-d425737f394f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:17.467638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb1538-e595-4b8a-924d-d425737f394f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:17.470782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb1538-e595-4b8a-924d-d425737f394f service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:17.489484 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2479/4921] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:18:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:18:19.837577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5caf2b-fa7d-4a70-b403-c3a1631b432c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:19.840528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5f5caf2b-fa7d-4a70-b403-c3a1631b432c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:19.938196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5caf2b-fa7d-4a70-b403-c3a1631b432c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:19.948467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3937ed-7dc8-4933-9f40-0fa2c84811bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:19.949383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3937ed-7dc8-4933-9f40-0fa2c84811bb service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:19.949817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3937ed-7dc8-4933-9f40-0fa2c84811bb service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:19.950234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3937ed-7dc8-4933-9f40-0fa2c84811bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:19.976216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3937ed-7dc8-4933-9f40-0fa2c84811bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:19.978934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3937ed-7dc8-4933-9f40-0fa2c84811bb service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:19.997763 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2443/4922] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:18:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:18:20.701109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b354da2-86e8-4cba-a293-11b864abc26f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:20.701642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b354da2-86e8-4cba-a293-11b864abc26f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:20.702274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b354da2-86e8-4cba-a293-11b864abc26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:20.725134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9b354da2-86e8-4cba-a293-11b864abc26f None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:18:20.727037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9b354da2-86e8-4cba-a293-11b864abc26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:20.796575 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2480/4923] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:18:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:18:20.815032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3937ed-7dc8-4933-9f40-0fa2c84811bb service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:20.816702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dd3937ed-7dc8-4933-9f40-0fa2c84811bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:20.910848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3937ed-7dc8-4933-9f40-0fa2c84811bb service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:20.918945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5776a4-92c3-4e3b-9106-9249dbcf2e4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:20.920328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5776a4-92c3-4e3b-9106-9249dbcf2e4c service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:20.920669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5776a4-92c3-4e3b-9106-9249dbcf2e4c service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:20.920947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5776a4-92c3-4e3b-9106-9249dbcf2e4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:20.933292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5776a4-92c3-4e3b-9106-9249dbcf2e4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:20.935131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5776a4-92c3-4e3b-9106-9249dbcf2e4c service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:20.946093 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2444/4924] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:18:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:18:24.455016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06a804-34e4-4b82-b9d5-42b3eae35dc4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:24.455494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06a804-34e4-4b82-b9d5-42b3eae35dc4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:24.455591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06a804-34e4-4b82-b9d5-42b3eae35dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:24.521263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1b06a804-34e4-4b82-b9d5-42b3eae35dc4 None None] MFA Rules not processed for user `4572a43d0b7e465eabd506fb52a502ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:18:24.532688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1b06a804-34e4-4b82-b9d5-42b3eae35dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:24.728156 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2481/4925] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:18:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:18:27.921762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5776a4-92c3-4e3b-9106-9249dbcf2e4c service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:27.938815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5776a4-92c3-4e3b-9106-9249dbcf2e4c service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:27.946195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a979a-2730-4b26-b867-bd59192a1722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:27.948226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a979a-2730-4b26-b867-bd59192a1722 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:27.948684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a979a-2730-4b26-b867-bd59192a1722 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:27.952325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a979a-2730-4b26-b867-bd59192a1722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:27.954918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f09a979a-2730-4b26-b867-bd59192a1722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:27.975210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a979a-2730-4b26-b867-bd59192a1722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:27.977468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a979a-2730-4b26-b867-bd59192a1722 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:27.983958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:27.990320 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2445/4926] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:18:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:18:34.711630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:40.714184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69588e2-532f-40f3-9e1c-ff5e22895f6d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:40.714893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69588e2-532f-40f3-9e1c-ff5e22895f6d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:40.714893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69588e2-532f-40f3-9e1c-ff5e22895f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:40.747158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e69588e2-532f-40f3-9e1c-ff5e22895f6d None None] MFA Rules not processed for user `678fafac5b764cd18ed9f40c6ac09be6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:18:40.750825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e69588e2-532f-40f3-9e1c-ff5e22895f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:40.766178 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2482/4927] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:18:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:18:42.785021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0e760-ebc2-4926-8b1e-0ab895bd4d75 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:42.785568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0e760-ebc2-4926-8b1e-0ab895bd4d75 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:42.785568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0e760-ebc2-4926-8b1e-0ab895bd4d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:42.817294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-72f0e760-ebc2-4926-8b1e-0ab895bd4d75 None None] MFA Rules not processed for user `678fafac5b764cd18ed9f40c6ac09be6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:18:42.818562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-72f0e760-ebc2-4926-8b1e-0ab895bd4d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:42.840198 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2446/4928] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:18:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:18:43.512814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3318f9-fa27-4655-8883-0cda7ea4d8c1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:43.513763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3318f9-fa27-4655-8883-0cda7ea4d8c1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:43.514282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3318f9-fa27-4655-8883-0cda7ea4d8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:43.547358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4e3318f9-fa27-4655-8883-0cda7ea4d8c1 None None] MFA Rules not processed for user `678fafac5b764cd18ed9f40c6ac09be6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:18:43.548969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4e3318f9-fa27-4655-8883-0cda7ea4d8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:43.563374 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2483/4929] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:18:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:18:43.990875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1040cd5-6847-4a93-8ebc-5e5d897d6ac6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:43.992023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1040cd5-6847-4a93-8ebc-5e5d897d6ac6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:43.992497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1040cd5-6847-4a93-8ebc-5e5d897d6ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:44.029503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a1040cd5-6847-4a93-8ebc-5e5d897d6ac6 None None] MFA Rules not processed for user `678fafac5b764cd18ed9f40c6ac09be6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:18:44.033071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a1040cd5-6847-4a93-8ebc-5e5d897d6ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:44.079056 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2447/4930] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:18:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:18:44.616529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b2641-3a4e-434e-94be-1ffcf6717928 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:44.617522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b2641-3a4e-434e-94be-1ffcf6717928 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:44.617991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b2641-3a4e-434e-94be-1ffcf6717928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:44.650250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-410b2641-3a4e-434e-94be-1ffcf6717928 None None] MFA Rules not processed for user `678fafac5b764cd18ed9f40c6ac09be6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:18:44.651536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-410b2641-3a4e-434e-94be-1ffcf6717928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:44.668148 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2484/4931] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:18:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:18:49.638675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1040cd5-6847-4a93-8ebc-5e5d897d6ac6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:49.640433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a1040cd5-6847-4a93-8ebc-5e5d897d6ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:49.793089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1040cd5-6847-4a93-8ebc-5e5d897d6ac6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:49.801663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8145661-c5bf-4578-82e5-89006d37cef2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:49.802597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8145661-c5bf-4578-82e5-89006d37cef2 service glance] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:49.802930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8145661-c5bf-4578-82e5-89006d37cef2 service glance] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:49.803416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8145661-c5bf-4578-82e5-89006d37cef2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:49.805665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b8145661-c5bf-4578-82e5-89006d37cef2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:49.840280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8145661-c5bf-4578-82e5-89006d37cef2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:49.842439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8145661-c5bf-4578-82e5-89006d37cef2 service glance] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:49.860963 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2448/4932] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:18:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:18:50.122593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b2641-3a4e-434e-94be-1ffcf6717928 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:50.154171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b2641-3a4e-434e-94be-1ffcf6717928 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:50.172025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bab44-062d-4f71-b04c-a31a2fec788b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:50.174425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bab44-062d-4f71-b04c-a31a2fec788b service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:50.175385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bab44-062d-4f71-b04c-a31a2fec788b service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:50.176143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bab44-062d-4f71-b04c-a31a2fec788b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:50.182393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-045bab44-062d-4f71-b04c-a31a2fec788b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:50.214211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bab44-062d-4f71-b04c-a31a2fec788b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:50.218506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bab44-062d-4f71-b04c-a31a2fec788b service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:50.246944 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2485/4933] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:18:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:18:50.493075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8145661-c5bf-4578-82e5-89006d37cef2 service glance] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:50.506752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8145661-c5bf-4578-82e5-89006d37cef2 service glance] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:50.523402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179c362-3fb4-49ce-b4af-877320e533ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:50.524088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179c362-3fb4-49ce-b4af-877320e533ea service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:50.524381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179c362-3fb4-49ce-b4af-877320e533ea service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:50.524654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179c362-3fb4-49ce-b4af-877320e533ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:50.526553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d179c362-3fb4-49ce-b4af-877320e533ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:50.555623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179c362-3fb4-49ce-b4af-877320e533ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:50.558215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179c362-3fb4-49ce-b4af-877320e533ea service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:50.582291 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2449/4934] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:18:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:18:51.614310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bab44-062d-4f71-b04c-a31a2fec788b service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:51.616082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-045bab44-062d-4f71-b04c-a31a2fec788b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:51.783276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bab44-062d-4f71-b04c-a31a2fec788b service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:51.790614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a1116-b59a-44fa-9022-da2d0ec17360 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:51.791733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a1116-b59a-44fa-9022-da2d0ec17360 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:51.792970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a1116-b59a-44fa-9022-da2d0ec17360 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:51.793479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a1116-b59a-44fa-9022-da2d0ec17360 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:51.795972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d91a1116-b59a-44fa-9022-da2d0ec17360 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:51.814235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a1116-b59a-44fa-9022-da2d0ec17360 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:51.817250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a1116-b59a-44fa-9022-da2d0ec17360 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:51.842758 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2486/4935] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:18:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:18:55.484623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77241e0a-9520-4755-8b8f-86fe7bc4a127 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:55.485090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77241e0a-9520-4755-8b8f-86fe7bc4a127 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:55.485374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77241e0a-9520-4755-8b8f-86fe7bc4a127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:55.507379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-77241e0a-9520-4755-8b8f-86fe7bc4a127 None None] MFA Rules not processed for user `4572a43d0b7e465eabd506fb52a502ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:18:55.508989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-77241e0a-9520-4755-8b8f-86fe7bc4a127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:55.517977 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2450/4936] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:18:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:18:56.289912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fc5dd-4ee3-4693-a558-4b1a89277a5e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:56.290896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fc5dd-4ee3-4693-a558-4b1a89277a5e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:56.291466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fc5dd-4ee3-4693-a558-4b1a89277a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:56.326114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0a0fc5dd-4ee3-4693-a558-4b1a89277a5e None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:18:56.327536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0a0fc5dd-4ee3-4693-a558-4b1a89277a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:18:56.338241 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2487/4937] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:18:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:18:56.371169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77241e0a-9520-4755-8b8f-86fe7bc4a127 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:18:56.395520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77241e0a-9520-4755-8b8f-86fe7bc4a127 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:18:56.423093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa893ac-981f-4643-ab79-5ef09fc6c607 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:18:56.423913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa893ac-981f-4643-ab79-5ef09fc6c607 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:18:56.424743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa893ac-981f-4643-ab79-5ef09fc6c607 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:18:56.425165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa893ac-981f-4643-ab79-5ef09fc6c607 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:18:56.454622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa893ac-981f-4643-ab79-5ef09fc6c607 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:18:56.456386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa893ac-981f-4643-ab79-5ef09fc6c607 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:18:56.473342 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2451/4938] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:18:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:19:00.392112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dd668-c088-4511-aebf-ed1243521668 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:00.392715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dd668-c088-4511-aebf-ed1243521668 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:00.392715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dd668-c088-4511-aebf-ed1243521668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:00.438327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f54dd668-c088-4511-aebf-ed1243521668 None None] MFA Rules not processed for user `2016769bf3a34d22992b45f9974b99a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:00.439451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f54dd668-c088-4511-aebf-ed1243521668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:00.469574 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2488/4939] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:04.912919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa893ac-981f-4643-ab79-5ef09fc6c607 service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:04.950150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa893ac-981f-4643-ab79-5ef09fc6c607 service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:04.972692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90620d4b-5aa7-461d-825e-22f7ca9c8dee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:04.974953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90620d4b-5aa7-461d-825e-22f7ca9c8dee service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:04.975415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90620d4b-5aa7-461d-825e-22f7ca9c8dee service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:04.979758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90620d4b-5aa7-461d-825e-22f7ca9c8dee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:04.992138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-90620d4b-5aa7-461d-825e-22f7ca9c8dee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:05.027062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90620d4b-5aa7-461d-825e-22f7ca9c8dee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:05.030113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90620d4b-5aa7-461d-825e-22f7ca9c8dee service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:05.044432 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2452/4940] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:19:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:19:05.394093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54dd668-c088-4511-aebf-ed1243521668 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:05.398732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=54 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:05.409557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54dd668-c088-4511-aebf-ed1243521668 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:05.423224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fdcf0-3ee9-4a15-ab2b-91428414a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:05.427591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fdcf0-3ee9-4a15-ab2b-91428414a06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:05.428217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fdcf0-3ee9-4a15-ab2b-91428414a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:05.428725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fdcf0-3ee9-4a15-ab2b-91428414a06f admin admin] PATH_INFO: `/v3/users/678fafac5b764cd18ed9f40c6ac09be6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:05.430873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116fdcf0-3ee9-4a15-ab2b-91428414a06f admin admin] RBAC: Authorizing `identity:delete_user(user_id=678fafac5b764cd18ed9f40c6ac09be6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:05.435162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116fdcf0-3ee9-4a15-ab2b-91428414a06f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:05.615649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-116fdcf0-3ee9-4a15-ab2b-91428414a06f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '678fafac5b764cd18ed9f40c6ac09be6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:05.641931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-116fdcf0-3ee9-4a15-ab2b-91428414a06f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '678fafac5b764cd18ed9f40c6ac09be6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:05.642881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-116fdcf0-3ee9-4a15-ab2b-91428414a06f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '678fafac5b764cd18ed9f40c6ac09be6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:05.643675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-116fdcf0-3ee9-4a15-ab2b-91428414a06f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '678fafac5b764cd18ed9f40c6ac09be6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:05.656499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-116fdcf0-3ee9-4a15-ab2b-91428414a06f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '678fafac5b764cd18ed9f40c6ac09be6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:05.739011 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2489/4941] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:19:05 2022] DELETE /identity/v3/users/678fafac5b764cd18ed9f40c6ac09be6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:08.322730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90620d4b-5aa7-461d-825e-22f7ca9c8dee service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:08.330134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=58 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:08.338650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90620d4b-5aa7-461d-825e-22f7ca9c8dee service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:08.557240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b828fe-1998-4f27-9120-749497a40a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:08.558593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b828fe-1998-4f27-9120-749497a40a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:08.560124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b828fe-1998-4f27-9120-749497a40a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:08.562919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b828fe-1998-4f27-9120-749497a40a19 admin admin] PATH_INFO: `/v3/projects/a95706cb67b642f58f6c0bdf8e65d766` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:08.568892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b828fe-1998-4f27-9120-749497a40a19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a95706cb67b642f58f6c0bdf8e65d766)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:08.580985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b828fe-1998-4f27-9120-749497a40a19 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:08.724671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-97b828fe-1998-4f27-9120-749497a40a19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a95706cb67b642f58f6c0bdf8e65d766', 'request_id': 'req-97b828fe-1998-4f27-9120-749497a40a19'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:08.752573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-97b828fe-1998-4f27-9120-749497a40a19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a95706cb67b642f58f6c0bdf8e65d766', 'request_id': 'req-97b828fe-1998-4f27-9120-749497a40a19'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:08.793586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-97b828fe-1998-4f27-9120-749497a40a19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a95706cb67b642f58f6c0bdf8e65d766', 'request_id': 'req-97b828fe-1998-4f27-9120-749497a40a19'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:08.818357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-97b828fe-1998-4f27-9120-749497a40a19 admin admin] The token cache is being invalidate because project a95706cb67b642f58f6c0bdf8e65d766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:08.818727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-97b828fe-1998-4f27-9120-749497a40a19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:08.820014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-97b828fe-1998-4f27-9120-749497a40a19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:08.841187 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2453/4942] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:08 2022] DELETE /identity/v3/projects/a95706cb67b642f58f6c0bdf8e65d766 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:08.849651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b798bd-071a-402c-b095-dc35cba3a596 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:08.850182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b798bd-071a-402c-b095-dc35cba3a596 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:08.850351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b798bd-071a-402c-b095-dc35cba3a596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:08.909822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b7b798bd-071a-402c-b095-dc35cba3a596 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:08.915235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b7b798bd-071a-402c-b095-dc35cba3a596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:09.109571 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2490/4943] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:19:09.118833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159d31a-0c51-479f-a7aa-17e7f2fbcac4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:09.119047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159d31a-0c51-479f-a7aa-17e7f2fbcac4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:09.119329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159d31a-0c51-479f-a7aa-17e7f2fbcac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:09.170466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0159d31a-0c51-479f-a7aa-17e7f2fbcac4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:09.172172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0159d31a-0c51-479f-a7aa-17e7f2fbcac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:09.199125 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2454/4944] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:09.203637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b798bd-071a-402c-b095-dc35cba3a596 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:09.221494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b798bd-071a-402c-b095-dc35cba3a596 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:09.258261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00575e5-86be-44bd-b2b4-c4aa3177bca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:09.259376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00575e5-86be-44bd-b2b4-c4aa3177bca6 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:09.259819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00575e5-86be-44bd-b2b4-c4aa3177bca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:09.260322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00575e5-86be-44bd-b2b4-c4aa3177bca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:09.261336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00575e5-86be-44bd-b2b4-c4aa3177bca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:19:09.261764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00575e5-86be-44bd-b2b4-c4aa3177bca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:09.263496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00575e5-86be-44bd-b2b4-c4aa3177bca6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:09.342846 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2491/4945] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:09.344409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159d31a-0c51-479f-a7aa-17e7f2fbcac4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:09.361503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159d31a-0c51-479f-a7aa-17e7f2fbcac4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:09.375731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3724a5-8026-4dff-bb4a-9037f3512f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:09.376816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3724a5-8026-4dff-bb4a-9037f3512f38 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:09.377221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3724a5-8026-4dff-bb4a-9037f3512f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:09.378032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3724a5-8026-4dff-bb4a-9037f3512f38 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:09.378958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3724a5-8026-4dff-bb4a-9037f3512f38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:09.388120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3724a5-8026-4dff-bb4a-9037f3512f38 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:09.450548 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2455/4946] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:09 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:09.452106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00575e5-86be-44bd-b2b4-c4aa3177bca6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:09.467041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00575e5-86be-44bd-b2b4-c4aa3177bca6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:09.661503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3724a5-8026-4dff-bb4a-9037f3512f38 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:09.663511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0b3724a5-8026-4dff-bb4a-9037f3512f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:09.693639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164660d-937a-4ac9-93e8-ce1fbb508115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:09.694456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164660d-937a-4ac9-93e8-ce1fbb508115 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:09.694621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164660d-937a-4ac9-93e8-ce1fbb508115 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:09.694880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164660d-937a-4ac9-93e8-ce1fbb508115 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:09.695578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164660d-937a-4ac9-93e8-ce1fbb508115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:09.700224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164660d-937a-4ac9-93e8-ce1fbb508115 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:09.735843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:09.769908 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2492/4947] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:19:09 2022] POST /identity/v3/users => generated 288 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:09.773663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164660d-937a-4ac9-93e8-ce1fbb508115 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:09.785829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164660d-937a-4ac9-93e8-ce1fbb508115 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:09.798764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b7fb7-4081-4938-9f1e-bd850ecd6f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:09.800312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b7fb7-4081-4938-9f1e-bd850ecd6f08 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:09.800869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b7fb7-4081-4938-9f1e-bd850ecd6f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:09.801357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b7fb7-4081-4938-9f1e-bd850ecd6f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:09.802443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b7fb7-4081-4938-9f1e-bd850ecd6f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:09.811122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b7fb7-4081-4938-9f1e-bd850ecd6f08 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:09.811784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3724a5-8026-4dff-bb4a-9037f3512f38 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:09.819164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2761fc2-8ebc-4286-a6d6-54d983c6612f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:09.821107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2761fc2-8ebc-4286-a6d6-54d983c6612f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:09.821388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2761fc2-8ebc-4286-a6d6-54d983c6612f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:09.821659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2761fc2-8ebc-4286-a6d6-54d983c6612f admin admin] PATH_INFO: `/v3/users/7e89c1afe4de42e68f65d0a700c63b4e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:09.824226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2761fc2-8ebc-4286-a6d6-54d983c6612f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e89c1afe4de42e68f65d0a700c63b4e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:09.828505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2761fc2-8ebc-4286-a6d6-54d983c6612f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:09.837067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:09.846480 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2493/4948] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:19:09.851359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b7fb7-4081-4938-9f1e-bd850ecd6f08 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:09.863897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b7fb7-4081-4938-9f1e-bd850ecd6f08 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:09.871321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b523228-8a48-4bc1-93ae-dd3b883fb5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:09.872016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b523228-8a48-4bc1-93ae-dd3b883fb5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:09.872362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b523228-8a48-4bc1-93ae-dd3b883fb5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:09.872625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b523228-8a48-4bc1-93ae-dd3b883fb5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:09.873511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b523228-8a48-4bc1-93ae-dd3b883fb5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:09.875167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b523228-8a48-4bc1-93ae-dd3b883fb5b9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:09.892998 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2494/4949] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:19:09.897631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b523228-8a48-4bc1-93ae-dd3b883fb5b9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:09.911804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b523228-8a48-4bc1-93ae-dd3b883fb5b9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:09.921784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2de01-8435-4740-96c3-32725bd14dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:09.923585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2de01-8435-4740-96c3-32725bd14dff admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:09.924532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2de01-8435-4740-96c3-32725bd14dff admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:09.924825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2de01-8435-4740-96c3-32725bd14dff admin admin] PATH_INFO: `/v3/projects/83ecde028f6e4d4fa723aa487c663eb8/users/8b9e2b05d0ad40f29e163e2e4ed084c2/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:09.938477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2761fc2-8ebc-4286-a6d6-54d983c6612f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e89c1afe4de42e68f65d0a700c63b4e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:09.951486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2de01-8435-4740-96c3-32725bd14dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ecde028f6e4d4fa723aa487c663eb8, user_id=8b9e2b05d0ad40f29e163e2e4ed084c2, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:09.962561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2de01-8435-4740-96c3-32725bd14dff admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:09.966367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2761fc2-8ebc-4286-a6d6-54d983c6612f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e89c1afe4de42e68f65d0a700c63b4e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:09.996166 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2495/4950] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:19:09 2022] PUT /identity/v3/projects/83ecde028f6e4d4fa723aa487c663eb8/users/8b9e2b05d0ad40f29e163e2e4ed084c2/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:09.996667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2761fc2-8ebc-4286-a6d6-54d983c6612f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e89c1afe4de42e68f65d0a700c63b4e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:09.998248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2761fc2-8ebc-4286-a6d6-54d983c6612f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e89c1afe4de42e68f65d0a700c63b4e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:09.999897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629714a-b981-4502-a89f-ce4ad838dca6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:10.000878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629714a-b981-4502-a89f-ce4ad838dca6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:10.001782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629714a-b981-4502-a89f-ce4ad838dca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:10.002495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2761fc2-8ebc-4286-a6d6-54d983c6612f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e89c1afe4de42e68f65d0a700c63b4e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:10.074098 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2456/4951] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:19:09 2022] DELETE /identity/v3/users/7e89c1afe4de42e68f65d0a700c63b4e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:10.082874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6629714a-b981-4502-a89f-ce4ad838dca6 None None] MFA Rules not processed for user `8b9e2b05d0ad40f29e163e2e4ed084c2`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:10.085099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6629714a-b981-4502-a89f-ce4ad838dca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:10.193337 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2496/4952] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:10.198231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2761fc2-8ebc-4286-a6d6-54d983c6612f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:10.199846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c2761fc2-8ebc-4286-a6d6-54d983c6612f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:10.294628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2761fc2-8ebc-4286-a6d6-54d983c6612f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:10.305918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f031e-788b-4d64-9f6b-7278dab7381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:10.306615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f031e-788b-4d64-9f6b-7278dab7381d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:10.306895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f031e-788b-4d64-9f6b-7278dab7381d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:10.307171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f031e-788b-4d64-9f6b-7278dab7381d admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:10.307922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f031e-788b-4d64-9f6b-7278dab7381d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:10.309974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f031e-788b-4d64-9f6b-7278dab7381d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:10.364678 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2457/4953] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:10 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:10.366551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629714a-b981-4502-a89f-ce4ad838dca6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:10.393566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629714a-b981-4502-a89f-ce4ad838dca6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:10.537060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404b9a9-2483-4bca-a20c-22aaaed090ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:10.548078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404b9a9-2483-4bca-a20c-22aaaed090ff admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:10.548078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404b9a9-2483-4bca-a20c-22aaaed090ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:10.548078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404b9a9-2483-4bca-a20c-22aaaed090ff admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:10.548078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404b9a9-2483-4bca-a20c-22aaaed090ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:10.552450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404b9a9-2483-4bca-a20c-22aaaed090ff admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:10.594840 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2497/4954] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:19:10 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:10.599479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f031e-788b-4d64-9f6b-7278dab7381d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:10.623640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f031e-788b-4d64-9f6b-7278dab7381d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:10.637620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9eb1b-d8cb-4a59-ad3a-e0ebbd2fd21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:10.638442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9eb1b-d8cb-4a59-ad3a-e0ebbd2fd21d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:10.638594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9eb1b-d8cb-4a59-ad3a-e0ebbd2fd21d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:10.638860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9eb1b-d8cb-4a59-ad3a-e0ebbd2fd21d admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:10.639603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9eb1b-d8cb-4a59-ad3a-e0ebbd2fd21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:10.641605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9eb1b-d8cb-4a59-ad3a-e0ebbd2fd21d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:10.667381 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2458/4955] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:19:10.671814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404b9a9-2483-4bca-a20c-22aaaed090ff admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:10.686236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404b9a9-2483-4bca-a20c-22aaaed090ff admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:10.699314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee45baa-021b-429a-b848-6fb2e2c127ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:10.700402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee45baa-021b-429a-b848-6fb2e2c127ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:10.700682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee45baa-021b-429a-b848-6fb2e2c127ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:10.700956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee45baa-021b-429a-b848-6fb2e2c127ec admin admin] PATH_INFO: `/v3/projects/3c4dbcea04524877a912f70b24d98633/users/fd0f3fad3e2140eeb9507589818a6a47/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:10.747731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee45baa-021b-429a-b848-6fb2e2c127ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4dbcea04524877a912f70b24d98633, user_id=fd0f3fad3e2140eeb9507589818a6a47, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:10.758967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee45baa-021b-429a-b848-6fb2e2c127ec admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:10.780021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:10.790647 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2498/4956] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:19:10 2022] PUT /identity/v3/projects/3c4dbcea04524877a912f70b24d98633/users/fd0f3fad3e2140eeb9507589818a6a47/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:10.794846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9eb1b-d8cb-4a59-ad3a-e0ebbd2fd21d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:10.814856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9eb1b-d8cb-4a59-ad3a-e0ebbd2fd21d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:11.000582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:11.005540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee45baa-021b-429a-b848-6fb2e2c127ec admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:11.009077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cee45baa-021b-429a-b848-6fb2e2c127ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:11.017332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3feec-888f-4a77-9383-243fa6df1548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:11.018499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3feec-888f-4a77-9383-243fa6df1548 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:11.019425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3feec-888f-4a77-9383-243fa6df1548 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:11.020528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3feec-888f-4a77-9383-243fa6df1548 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:11.022098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3feec-888f-4a77-9383-243fa6df1548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:11.026355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3feec-888f-4a77-9383-243fa6df1548 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:11.047155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee45baa-021b-429a-b848-6fb2e2c127ec admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:11.055164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027970b7-8778-424d-90ef-ce6978c24c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:11.056171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027970b7-8778-424d-90ef-ce6978c24c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:11.056441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027970b7-8778-424d-90ef-ce6978c24c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:11.056720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027970b7-8778-424d-90ef-ce6978c24c06 admin admin] PATH_INFO: `/v3/projects/6ec66c4ca37f47dcb3d18f89f3fe2a75` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:11.057585 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2459/4957] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:19:11.057979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027970b7-8778-424d-90ef-ce6978c24c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ec66c4ca37f47dcb3d18f89f3fe2a75)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:11.059924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027970b7-8778-424d-90ef-ce6978c24c06 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:11.062106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3feec-888f-4a77-9383-243fa6df1548 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:11.085854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3feec-888f-4a77-9383-243fa6df1548 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:11.101612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17052a0f-f731-45b8-befe-ad4e8917bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:11.103291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17052a0f-f731-45b8-befe-ad4e8917bc49 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:11.103964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17052a0f-f731-45b8-befe-ad4e8917bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:11.104765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17052a0f-f731-45b8-befe-ad4e8917bc49 admin admin] PATH_INFO: `/v3/projects/3c4dbcea04524877a912f70b24d98633/users/fd0f3fad3e2140eeb9507589818a6a47/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:11.108590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17052a0f-f731-45b8-befe-ad4e8917bc49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4dbcea04524877a912f70b24d98633, user_id=fd0f3fad3e2140eeb9507589818a6a47, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:11.111561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17052a0f-f731-45b8-befe-ad4e8917bc49 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:11.126163 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2460/4958] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:19:11 2022] PUT /identity/v3/projects/3c4dbcea04524877a912f70b24d98633/users/fd0f3fad3e2140eeb9507589818a6a47/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:19:11.138778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da3b69-4b2f-415d-8b3e-849a178d214a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:11.139068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da3b69-4b2f-415d-8b3e-849a178d214a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:11.139339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da3b69-4b2f-415d-8b3e-849a178d214a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:11.237891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-40da3b69-4b2f-415d-8b3e-849a178d214a None None] MFA Rules not processed for user `fd0f3fad3e2140eeb9507589818a6a47`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:11.239113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-40da3b69-4b2f-415d-8b3e-849a178d214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:11.240884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-027970b7-8778-424d-90ef-ce6978c24c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'request_id': 'req-027970b7-8778-424d-90ef-ce6978c24c06'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:11.256807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-027970b7-8778-424d-90ef-ce6978c24c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'request_id': 'req-027970b7-8778-424d-90ef-ce6978c24c06'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:11.274227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-027970b7-8778-424d-90ef-ce6978c24c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'request_id': 'req-027970b7-8778-424d-90ef-ce6978c24c06'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:11.293598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-027970b7-8778-424d-90ef-ce6978c24c06 admin admin] The token cache is being invalidate because project 6ec66c4ca37f47dcb3d18f89f3fe2a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:11.293598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-027970b7-8778-424d-90ef-ce6978c24c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:11.294414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-027970b7-8778-424d-90ef-ce6978c24c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:11.297001 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2499/4959] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:11 2022] DELETE /identity/v3/projects/6ec66c4ca37f47dcb3d18f89f3fe2a75 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:11.302989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147f487-778b-4bcc-ba1b-bab25f96977c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:11.303392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147f487-778b-4bcc-ba1b-bab25f96977c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:11.303997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147f487-778b-4bcc-ba1b-bab25f96977c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:11.339734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5147f487-778b-4bcc-ba1b-bab25f96977c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:11.341515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5147f487-778b-4bcc-ba1b-bab25f96977c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:11.410875 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2461/4960] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:11.411842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da3b69-4b2f-415d-8b3e-849a178d214a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:11.423086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da3b69-4b2f-415d-8b3e-849a178d214a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:11.433788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfc350-886f-4a6f-9af1-e7b996dd1326 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0f3fad3e2140eeb9507589818a6a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4dbcea04524877a912f70b24d98633', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:11.434470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfc350-886f-4a6f-9af1-e7b996dd1326 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:11.434757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfc350-886f-4a6f-9af1-e7b996dd1326 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:11.436437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfc350-886f-4a6f-9af1-e7b996dd1326 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:11.438003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfc350-886f-4a6f-9af1-e7b996dd1326 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:11.439088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfc350-886f-4a6f-9af1-e7b996dd1326 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:11.504434 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2462/4961] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:11 2022] POST /identity/v3/projects => generated 333 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:11.505844 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2500/4962] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:11.507353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1387c4c-125d-4e9b-89bc-810e6c632793 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:11.507641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1387c4c-125d-4e9b-89bc-810e6c632793 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:11.507912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1387c4c-125d-4e9b-89bc-810e6c632793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:11.508195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfc350-886f-4a6f-9af1-e7b996dd1326 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:11.532947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e1387c4c-125d-4e9b-89bc-810e6c632793 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:11.534165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e1387c4c-125d-4e9b-89bc-810e6c632793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:11.609642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfc350-886f-4a6f-9af1-e7b996dd1326 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:11.615879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f26f87-1ee8-4c8c-b15c-d535db2a860f tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0f3fad3e2140eeb9507589818a6a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4dbcea04524877a912f70b24d98633', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:11.617663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f26f87-1ee8-4c8c-b15c-d535db2a860f tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:11.617663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f26f87-1ee8-4c8c-b15c-d535db2a860f tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:11.617663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f26f87-1ee8-4c8c-b15c-d535db2a860f tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:11.618302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f26f87-1ee8-4c8c-b15c-d535db2a860f tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:11.621743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f26f87-1ee8-4c8c-b15c-d535db2a860f tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:11.642013 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2501/4963] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:11.646650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1387c4c-125d-4e9b-89bc-810e6c632793 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:11.675639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1387c4c-125d-4e9b-89bc-810e6c632793 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:11.692492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c12bf-4717-4f4c-bf0f-71b0610dcac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:11.693353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c12bf-4717-4f4c-bf0f-71b0610dcac6 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:11.693634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c12bf-4717-4f4c-bf0f-71b0610dcac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:11.696085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c12bf-4717-4f4c-bf0f-71b0610dcac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:11.696962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c12bf-4717-4f4c-bf0f-71b0610dcac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:19:11.701627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c12bf-4717-4f4c-bf0f-71b0610dcac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:11.701820 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2463/4964] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:19:11 2022] POST /identity/v3/projects => generated 332 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:19:11.701925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c12bf-4717-4f4c-bf0f-71b0610dcac6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:11.702993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f26f87-1ee8-4c8c-b15c-d535db2a860f tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:11.736529 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2502/4965] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:11.737553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c12bf-4717-4f4c-bf0f-71b0610dcac6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:11.785890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c12bf-4717-4f4c-bf0f-71b0610dcac6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:11.800155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:11.819523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:11.888819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f26f87-1ee8-4c8c-b15c-d535db2a860f tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:11.894406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648bd0e-1de9-467a-9dd5-db9291bade62 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0f3fad3e2140eeb9507589818a6a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4dbcea04524877a912f70b24d98633', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:11.895539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648bd0e-1de9-467a-9dd5-db9291bade62 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:11.896031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648bd0e-1de9-467a-9dd5-db9291bade62 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:11.896540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648bd0e-1de9-467a-9dd5-db9291bade62 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:11.897460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648bd0e-1de9-467a-9dd5-db9291bade62 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:11.899774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648bd0e-1de9-467a-9dd5-db9291bade62 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:11.955073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325634a-e879-4acc-bffa-2517bc8387be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:11.958179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325634a-e879-4acc-bffa-2517bc8387be admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:11.960046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325634a-e879-4acc-bffa-2517bc8387be admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:11.960784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325634a-e879-4acc-bffa-2517bc8387be admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:11.967052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325634a-e879-4acc-bffa-2517bc8387be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:11.969176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325634a-e879-4acc-bffa-2517bc8387be admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:11.969715 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2464/4966] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:11 2022] POST /identity/v3/projects => generated 357 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:11.972614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6218450-c069-4cbb-b0b2-1e7dcf7f12e2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:11.973486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6218450-c069-4cbb-b0b2-1e7dcf7f12e2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:11.975494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6218450-c069-4cbb-b0b2-1e7dcf7f12e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:11.997025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d6218450-c069-4cbb-b0b2-1e7dcf7f12e2 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:11.998979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d6218450-c069-4cbb-b0b2-1e7dcf7f12e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:12.023570 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2503/4967] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:11 2022] POST /identity/v3/projects => generated 385 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:12.026801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325634a-e879-4acc-bffa-2517bc8387be admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:12.087875 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2465/4968] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:19:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:12.090148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6218450-c069-4cbb-b0b2-1e7dcf7f12e2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:12.166160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325634a-e879-4acc-bffa-2517bc8387be admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:12.188142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9ff6f-2eb1-44bd-a3be-97f8f09ddced tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0f3fad3e2140eeb9507589818a6a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4dbcea04524877a912f70b24d98633', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:12.189325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9ff6f-2eb1-44bd-a3be-97f8f09ddced tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:12.189623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9ff6f-2eb1-44bd-a3be-97f8f09ddced tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:12.190565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9ff6f-2eb1-44bd-a3be-97f8f09ddced tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:12.191229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9ff6f-2eb1-44bd-a3be-97f8f09ddced tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:12.195255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9ff6f-2eb1-44bd-a3be-97f8f09ddced tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:12.219951 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2504/4969] 10.222.0.43 () {58 vars in 1130 bytes} [Sat Jul 2 21:19:12 2022] GET /identity/v3/projects => generated 7199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:19:12.220867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9ff6f-2eb1-44bd-a3be-97f8f09ddced tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:12.222764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3ad9ff6f-2eb1-44bd-a3be-97f8f09ddced tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:12.247592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6218450-c069-4cbb-b0b2-1e7dcf7f12e2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:12.372407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9ff6f-2eb1-44bd-a3be-97f8f09ddced tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:12.378358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02639d62-e137-41d4-9b7b-d644a281ae49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:12.379057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02639d62-e137-41d4-9b7b-d644a281ae49 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:12.379346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02639d62-e137-41d4-9b7b-d644a281ae49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:12.379622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02639d62-e137-41d4-9b7b-d644a281ae49 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:12.380358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02639d62-e137-41d4-9b7b-d644a281ae49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:12.382561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02639d62-e137-41d4-9b7b-d644a281ae49 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:12.383359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd5ee8-9759-4465-98c4-cd2bc7b83c4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:12.385098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd5ee8-9759-4465-98c4-cd2bc7b83c4a service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:12.385564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd5ee8-9759-4465-98c4-cd2bc7b83c4a service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:12.386132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd5ee8-9759-4465-98c4-cd2bc7b83c4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:12.397956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:12.418402 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2466/4970] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:19:12 2022] POST /identity/v3/users => generated 293 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:12.419328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02639d62-e137-41d4-9b7b-d644a281ae49 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:12.433020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02639d62-e137-41d4-9b7b-d644a281ae49 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:12.436260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:12.440355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2439c-9fc9-4e4d-b68e-71bd48763e3a tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0f3fad3e2140eeb9507589818a6a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4dbcea04524877a912f70b24d98633', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:12.441352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2439c-9fc9-4e4d-b68e-71bd48763e3a tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:12.441854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2439c-9fc9-4e4d-b68e-71bd48763e3a tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:12.442359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2439c-9fc9-4e4d-b68e-71bd48763e3a tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:12.443556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2439c-9fc9-4e4d-b68e-71bd48763e3a tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:19:12.444274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2439c-9fc9-4e4d-b68e-71bd48763e3a tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:12.445850 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-6ed2439c-9fc9-4e4d-b68e-71bd48763e3a tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:19:12.445850 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:19:12.445850 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:19:12.448194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2439c-9fc9-4e4d-b68e-71bd48763e3a tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:12.481145 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2467/4971] 10.222.0.43 () {58 vars in 1157 bytes} [Sat Jul 2 21:19:12 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:12.482300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2439c-9fc9-4e4d-b68e-71bd48763e3a tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:12.494607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd5ee8-9759-4465-98c4-cd2bc7b83c4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:12.500484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd5ee8-9759-4465-98c4-cd2bc7b83c4a service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:12.520292 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2505/4972] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:19:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:19:12.523095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd5ee8-9759-4465-98c4-cd2bc7b83c4a service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:12.530443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2439c-9fc9-4e4d-b68e-71bd48763e3a tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:12.555040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd5ee8-9759-4465-98c4-cd2bc7b83c4a service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:12.567245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969af5ee-c2d4-42b2-9f45-7d236eac3d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:12.572650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e401c-cf86-4f99-a014-6061a746467d tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0f3fad3e2140eeb9507589818a6a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4dbcea04524877a912f70b24d98633', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:12.573780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e401c-cf86-4f99-a014-6061a746467d tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:12.573780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e401c-cf86-4f99-a014-6061a746467d tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:12.574064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e401c-cf86-4f99-a014-6061a746467d tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:12.575067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e401c-cf86-4f99-a014-6061a746467d tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Adding query filter params (parent_id=0a891a68e621452da429edc2d21f0b6e) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:19:12.575389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e401c-cf86-4f99-a014-6061a746467d tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:12.577808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e401c-cf86-4f99-a014-6061a746467d tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:12.581111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969af5ee-c2d4-42b2-9f45-7d236eac3d67 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:12.581446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969af5ee-c2d4-42b2-9f45-7d236eac3d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:12.583590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969af5ee-c2d4-42b2-9f45-7d236eac3d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:12.584567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969af5ee-c2d4-42b2-9f45-7d236eac3d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:12.586215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969af5ee-c2d4-42b2-9f45-7d236eac3d67 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:12.602564 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2506/4973] 10.222.0.43 () {58 vars in 1215 bytes} [Sat Jul 2 21:19:12 2022] GET /identity/v3/projects?parent_id=0a891a68e621452da429edc2d21f0b6e => generated 497 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:12.606685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e401c-cf86-4f99-a014-6061a746467d tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:12.612568 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2468/4974] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:19:12.616091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969af5ee-c2d4-42b2-9f45-7d236eac3d67 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:12.620205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e401c-cf86-4f99-a014-6061a746467d tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:12.627049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e228f6a-3a5c-49df-9f30-7051d00773f8 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0f3fad3e2140eeb9507589818a6a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4dbcea04524877a912f70b24d98633', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:12.628896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e228f6a-3a5c-49df-9f30-7051d00773f8 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:12.629709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e228f6a-3a5c-49df-9f30-7051d00773f8 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:12.629709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e228f6a-3a5c-49df-9f30-7051d00773f8 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] PATH_INFO: `/v3/projects/42b11c3abde64116bd4fcd0305accb1f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:12.631292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e228f6a-3a5c-49df-9f30-7051d00773f8 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Authorizing `identity:delete_project(project_id=42b11c3abde64116bd4fcd0305accb1f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:12.636665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e228f6a-3a5c-49df-9f30-7051d00773f8 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:12.639344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969af5ee-c2d4-42b2-9f45-7d236eac3d67 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:12.649244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe89e6-5e8c-400e-8278-55fdab09354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:12.650875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe89e6-5e8c-400e-8278-55fdab09354c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:12.652637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe89e6-5e8c-400e-8278-55fdab09354c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:12.652927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe89e6-5e8c-400e-8278-55fdab09354c admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:12.653672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe89e6-5e8c-400e-8278-55fdab09354c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:12.659403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe89e6-5e8c-400e-8278-55fdab09354c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:12.696855 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2469/4975] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:19:12.697718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe89e6-5e8c-400e-8278-55fdab09354c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:12.721026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe89e6-5e8c-400e-8278-55fdab09354c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:12.736748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1e228f6a-3a5c-49df-9f30-7051d00773f8 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b11c3abde64116bd4fcd0305accb1f', 'request_id': 'req-1e228f6a-3a5c-49df-9f30-7051d00773f8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:12.753757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1e228f6a-3a5c-49df-9f30-7051d00773f8 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b11c3abde64116bd4fcd0305accb1f', 'request_id': 'req-1e228f6a-3a5c-49df-9f30-7051d00773f8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:12.765743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1e228f6a-3a5c-49df-9f30-7051d00773f8 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b11c3abde64116bd4fcd0305accb1f', 'request_id': 'req-1e228f6a-3a5c-49df-9f30-7051d00773f8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:12.783794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1e228f6a-3a5c-49df-9f30-7051d00773f8 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] The token cache is being invalidate because project 42b11c3abde64116bd4fcd0305accb1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:12.784766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1e228f6a-3a5c-49df-9f30-7051d00773f8 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:12.785792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1e228f6a-3a5c-49df-9f30-7051d00773f8 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:12.789222 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2507/4976] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:12 2022] DELETE /identity/v3/projects/42b11c3abde64116bd4fcd0305accb1f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:12.795820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e228f6a-3a5c-49df-9f30-7051d00773f8 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:12.798468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1e228f6a-3a5c-49df-9f30-7051d00773f8 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:12.909985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c62cca-4085-46df-bb5d-f9027362fe95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:12.911741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c62cca-4085-46df-bb5d-f9027362fe95 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:12.914568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c62cca-4085-46df-bb5d-f9027362fe95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:12.915015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c62cca-4085-46df-bb5d-f9027362fe95 admin admin] PATH_INFO: `/v3/projects/12e3dad452a046c293a8cbda0a33199b/users/35c15fdfaf5b4b67b0678e2e5c1d9aec/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:12.964091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c62cca-4085-46df-bb5d-f9027362fe95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e3dad452a046c293a8cbda0a33199b, user_id=35c15fdfaf5b4b67b0678e2e5c1d9aec, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:12.973186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c62cca-4085-46df-bb5d-f9027362fe95 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:12.987693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e228f6a-3a5c-49df-9f30-7051d00773f8 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:13.005102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15ca97-2c89-4935-acdd-2578b23e71e4 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0f3fad3e2140eeb9507589818a6a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4dbcea04524877a912f70b24d98633', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:13.005352 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2470/4977] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:19:12 2022] PUT /identity/v3/projects/12e3dad452a046c293a8cbda0a33199b/users/35c15fdfaf5b4b67b0678e2e5c1d9aec/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:13.008700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15ca97-2c89-4935-acdd-2578b23e71e4 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:13.009211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15ca97-2c89-4935-acdd-2578b23e71e4 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:13.009508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15ca97-2c89-4935-acdd-2578b23e71e4 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] PATH_INFO: `/v3/projects/0a891a68e621452da429edc2d21f0b6e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:13.010602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4418a-ac66-4c92-88fb-e4c4969d2d36 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:13.010931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4418a-ac66-4c92-88fb-e4c4969d2d36 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:13.011260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4418a-ac66-4c92-88fb-e4c4969d2d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:13.014076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15ca97-2c89-4935-acdd-2578b23e71e4 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0a891a68e621452da429edc2d21f0b6e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:13.018534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15ca97-2c89-4935-acdd-2578b23e71e4 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:13.051402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6fa4418a-ac66-4c92-88fb-e4c4969d2d36 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:13.056359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6fa4418a-ac66-4c92-88fb-e4c4969d2d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:13.122441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:13.130204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0f15ca97-2c89-4935-acdd-2578b23e71e4 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a891a68e621452da429edc2d21f0b6e', 'request_id': 'req-0f15ca97-2c89-4935-acdd-2578b23e71e4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:13.144709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0f15ca97-2c89-4935-acdd-2578b23e71e4 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a891a68e621452da429edc2d21f0b6e', 'request_id': 'req-0f15ca97-2c89-4935-acdd-2578b23e71e4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:13.151854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0f15ca97-2c89-4935-acdd-2578b23e71e4 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a891a68e621452da429edc2d21f0b6e', 'request_id': 'req-0f15ca97-2c89-4935-acdd-2578b23e71e4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:13.173765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0f15ca97-2c89-4935-acdd-2578b23e71e4 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] The token cache is being invalidate because project 0a891a68e621452da429edc2d21f0b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:13.175266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0f15ca97-2c89-4935-acdd-2578b23e71e4 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:13.176139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0f15ca97-2c89-4935-acdd-2578b23e71e4 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:13.189877 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2508/4978] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:12 2022] DELETE /identity/v3/projects/0a891a68e621452da429edc2d21f0b6e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:13.191586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15ca97-2c89-4935-acdd-2578b23e71e4 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:13.193791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0f15ca97-2c89-4935-acdd-2578b23e71e4 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:13.196643 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2471/4979] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:13.211662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4418a-ac66-4c92-88fb-e4c4969d2d36 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:13.214693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6fa4418a-ac66-4c92-88fb-e4c4969d2d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:13.266224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:13.275874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15ca97-2c89-4935-acdd-2578b23e71e4 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:13.281724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5248dc-b895-4516-add9-64975e524b28 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd0f3fad3e2140eeb9507589818a6a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c4dbcea04524877a912f70b24d98633', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:13.282863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5248dc-b895-4516-add9-64975e524b28 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:13.282989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5248dc-b895-4516-add9-64975e524b28 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:13.290462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5248dc-b895-4516-add9-64975e524b28 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] PATH_INFO: `/v3/projects/993561aba1354c99b68b893c23007a44` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:13.292766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4418a-ac66-4c92-88fb-e4c4969d2d36 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:13.295982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5248dc-b895-4516-add9-64975e524b28 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Authorizing `identity:delete_project(project_id=993561aba1354c99b68b893c23007a44)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:13.298235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5248dc-b895-4516-add9-64975e524b28 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:13.365986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074e984-cc34-48b6-ae02-2ce7a9a65bdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:13.366662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074e984-cc34-48b6-ae02-2ce7a9a65bdb service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:13.366949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074e984-cc34-48b6-ae02-2ce7a9a65bdb service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:13.367223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074e984-cc34-48b6-ae02-2ce7a9a65bdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:13.437618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5a5248dc-b895-4516-add9-64975e524b28 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '993561aba1354c99b68b893c23007a44', 'request_id': 'req-5a5248dc-b895-4516-add9-64975e524b28'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:13.448594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074e984-cc34-48b6-ae02-2ce7a9a65bdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:13.450883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074e984-cc34-48b6-ae02-2ce7a9a65bdb service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:13.461678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5a5248dc-b895-4516-add9-64975e524b28 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '993561aba1354c99b68b893c23007a44', 'request_id': 'req-5a5248dc-b895-4516-add9-64975e524b28'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:13.465298 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2472/4980] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:19:13.469013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5a5248dc-b895-4516-add9-64975e524b28 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '993561aba1354c99b68b893c23007a44', 'request_id': 'req-5a5248dc-b895-4516-add9-64975e524b28'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:13.493028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5a5248dc-b895-4516-add9-64975e524b28 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] The token cache is being invalidate because project 993561aba1354c99b68b893c23007a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:13.493453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5a5248dc-b895-4516-add9-64975e524b28 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:13.494210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5a5248dc-b895-4516-add9-64975e524b28 tempest-ListProjectsTestJSON-1603353233 tempest-ListProjectsTestJSON-1603353233-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:13.504120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074e984-cc34-48b6-ae02-2ce7a9a65bdb service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:13.505416 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2509/4981] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:13 2022] DELETE /identity/v3/projects/993561aba1354c99b68b893c23007a44 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:13.507245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e074e984-cc34-48b6-ae02-2ce7a9a65bdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:13.529534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074e984-cc34-48b6-ae02-2ce7a9a65bdb service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:13.620425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5a303-3c7e-411a-afbf-d6a04c14166f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:13.623071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5a303-3c7e-411a-afbf-d6a04c14166f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:13.623417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5a303-3c7e-411a-afbf-d6a04c14166f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:13.624320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5a303-3c7e-411a-afbf-d6a04c14166f admin admin] PATH_INFO: `/v3/users/8b9e2b05d0ad40f29e163e2e4ed084c2` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:13.626424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5a303-3c7e-411a-afbf-d6a04c14166f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b9e2b05d0ad40f29e163e2e4ed084c2)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:13.629187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5a303-3c7e-411a-afbf-d6a04c14166f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:13.771595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:13.773881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-caf5a303-3c7e-411a-afbf-d6a04c14166f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b9e2b05d0ad40f29e163e2e4ed084c2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:13.787060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-caf5a303-3c7e-411a-afbf-d6a04c14166f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b9e2b05d0ad40f29e163e2e4ed084c2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:13.800664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-caf5a303-3c7e-411a-afbf-d6a04c14166f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b9e2b05d0ad40f29e163e2e4ed084c2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:13.803438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-caf5a303-3c7e-411a-afbf-d6a04c14166f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b9e2b05d0ad40f29e163e2e4ed084c2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:13.804758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-caf5a303-3c7e-411a-afbf-d6a04c14166f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b9e2b05d0ad40f29e163e2e4ed084c2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:13.837057 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2473/4982] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:19:13 2022] DELETE /identity/v3/users/8b9e2b05d0ad40f29e163e2e4ed084c2 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:13.842132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b71ce-8ebd-4ceb-948f-4f027bbfcb9c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:13.842673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b71ce-8ebd-4ceb-948f-4f027bbfcb9c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:13.843150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b71ce-8ebd-4ceb-948f-4f027bbfcb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:13.866202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f21b71ce-8ebd-4ceb-948f-4f027bbfcb9c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:13.867843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f21b71ce-8ebd-4ceb-948f-4f027bbfcb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:13.965551 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2510/4983] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:19:14.016620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5a303-3c7e-411a-afbf-d6a04c14166f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:14.018733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-caf5a303-3c7e-411a-afbf-d6a04c14166f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:14.158443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5a303-3c7e-411a-afbf-d6a04c14166f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:14.164686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fff120-44b4-4571-9fa5-c8523bc674cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:14.165503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fff120-44b4-4571-9fa5-c8523bc674cb service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:14.165842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fff120-44b4-4571-9fa5-c8523bc674cb service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:14.166190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fff120-44b4-4571-9fa5-c8523bc674cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:14.180432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fff120-44b4-4571-9fa5-c8523bc674cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:14.186630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fff120-44b4-4571-9fa5-c8523bc674cb service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:14.220492 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2474/4984] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:19:14.353446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b71ce-8ebd-4ceb-948f-4f027bbfcb9c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:14.356285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f21b71ce-8ebd-4ceb-948f-4f027bbfcb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:14.366362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:14.556092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b71ce-8ebd-4ceb-948f-4f027bbfcb9c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:14.572613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6aaa0-6475-4932-b77e-463eb103c879 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:14.573582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6aaa0-6475-4932-b77e-463eb103c879 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:14.573582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6aaa0-6475-4932-b77e-463eb103c879 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:14.574345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6aaa0-6475-4932-b77e-463eb103c879 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:14.576913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-34b6aaa0-6475-4932-b77e-463eb103c879 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:14.613069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6aaa0-6475-4932-b77e-463eb103c879 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:14.614683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6aaa0-6475-4932-b77e-463eb103c879 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:14.630614 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2511/4985] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:19:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:19:16.208294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fff120-44b4-4571-9fa5-c8523bc674cb service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:16.209805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b9fff120-44b4-4571-9fa5-c8523bc674cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:16.227409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fff120-44b4-4571-9fa5-c8523bc674cb service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:16.233901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6938b7f-cd19-4ae1-8dbc-1a43e9802972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:16.236030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6938b7f-cd19-4ae1-8dbc-1a43e9802972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:16.237734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6938b7f-cd19-4ae1-8dbc-1a43e9802972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:16.248103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6938b7f-cd19-4ae1-8dbc-1a43e9802972 admin admin] PATH_INFO: `/v3/projects/83ecde028f6e4d4fa723aa487c663eb8` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:16.252967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6938b7f-cd19-4ae1-8dbc-1a43e9802972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ecde028f6e4d4fa723aa487c663eb8)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:16.265810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6938b7f-cd19-4ae1-8dbc-1a43e9802972 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:16.405391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f6938b7f-cd19-4ae1-8dbc-1a43e9802972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ecde028f6e4d4fa723aa487c663eb8', 'request_id': 'req-f6938b7f-cd19-4ae1-8dbc-1a43e9802972'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:16.415852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f6938b7f-cd19-4ae1-8dbc-1a43e9802972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ecde028f6e4d4fa723aa487c663eb8', 'request_id': 'req-f6938b7f-cd19-4ae1-8dbc-1a43e9802972'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:16.441186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f6938b7f-cd19-4ae1-8dbc-1a43e9802972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ecde028f6e4d4fa723aa487c663eb8', 'request_id': 'req-f6938b7f-cd19-4ae1-8dbc-1a43e9802972'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:16.473901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f6938b7f-cd19-4ae1-8dbc-1a43e9802972 admin admin] The token cache is being invalidate because project 83ecde028f6e4d4fa723aa487c663eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:16.474687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f6938b7f-cd19-4ae1-8dbc-1a43e9802972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:16.477081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f6938b7f-cd19-4ae1-8dbc-1a43e9802972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:16.481542 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2475/4986] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:16 2022] DELETE /identity/v3/projects/83ecde028f6e4d4fa723aa487c663eb8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:16.485902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6aaa0-6475-4932-b77e-463eb103c879 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:16.507987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6aaa0-6475-4932-b77e-463eb103c879 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:16.704743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46df442-2ab9-47bd-8a4b-32a12182e031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:16.705660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46df442-2ab9-47bd-8a4b-32a12182e031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:16.705970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46df442-2ab9-47bd-8a4b-32a12182e031 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:16.706228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46df442-2ab9-47bd-8a4b-32a12182e031 admin admin] PATH_INFO: `/v3/users/fd0f3fad3e2140eeb9507589818a6a47` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:16.708866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46df442-2ab9-47bd-8a4b-32a12182e031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0f3fad3e2140eeb9507589818a6a47)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:16.710884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46df442-2ab9-47bd-8a4b-32a12182e031 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:16.807340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d46df442-2ab9-47bd-8a4b-32a12182e031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0f3fad3e2140eeb9507589818a6a47'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:16.831962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d46df442-2ab9-47bd-8a4b-32a12182e031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0f3fad3e2140eeb9507589818a6a47'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:16.832623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d46df442-2ab9-47bd-8a4b-32a12182e031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0f3fad3e2140eeb9507589818a6a47'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:16.833386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d46df442-2ab9-47bd-8a4b-32a12182e031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0f3fad3e2140eeb9507589818a6a47'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:16.851461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d46df442-2ab9-47bd-8a4b-32a12182e031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0f3fad3e2140eeb9507589818a6a47'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:16.904132 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2512/4987] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:19:16 2022] DELETE /identity/v3/users/fd0f3fad3e2140eeb9507589818a6a47 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:19:18.135996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6938b7f-cd19-4ae1-8dbc-1a43e9802972 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:18.138063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f6938b7f-cd19-4ae1-8dbc-1a43e9802972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:18.167663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6938b7f-cd19-4ae1-8dbc-1a43e9802972 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:18.239829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:18.272727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a9e4e-14ec-4d52-8544-494804fcdda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:18.273709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a9e4e-14ec-4d52-8544-494804fcdda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:18.275238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a9e4e-14ec-4d52-8544-494804fcdda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:18.275546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a9e4e-14ec-4d52-8544-494804fcdda1 admin admin] PATH_INFO: `/v3/projects/3c4dbcea04524877a912f70b24d98633` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:18.276895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a9e4e-14ec-4d52-8544-494804fcdda1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c4dbcea04524877a912f70b24d98633)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:18.279013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a9e4e-14ec-4d52-8544-494804fcdda1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:18.369962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f66a9e4e-14ec-4d52-8544-494804fcdda1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c4dbcea04524877a912f70b24d98633', 'request_id': 'req-f66a9e4e-14ec-4d52-8544-494804fcdda1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:18.387983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f66a9e4e-14ec-4d52-8544-494804fcdda1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c4dbcea04524877a912f70b24d98633', 'request_id': 'req-f66a9e4e-14ec-4d52-8544-494804fcdda1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:18.398898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f66a9e4e-14ec-4d52-8544-494804fcdda1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c4dbcea04524877a912f70b24d98633', 'request_id': 'req-f66a9e4e-14ec-4d52-8544-494804fcdda1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:18.419037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f66a9e4e-14ec-4d52-8544-494804fcdda1 admin admin] The token cache is being invalidate because project 3c4dbcea04524877a912f70b24d98633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:18.419415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f66a9e4e-14ec-4d52-8544-494804fcdda1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:18.431101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f66a9e4e-14ec-4d52-8544-494804fcdda1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:18.444004 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2476/4988] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:18 2022] DELETE /identity/v3/projects/3c4dbcea04524877a912f70b24d98633 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:18.446637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe291dfe-1f3f-499a-a464-01d4d80ba1ca None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:18.448102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe291dfe-1f3f-499a-a464-01d4d80ba1ca None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:18.448376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe291dfe-1f3f-499a-a464-01d4d80ba1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:18.491202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fe291dfe-1f3f-499a-a464-01d4d80ba1ca None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:18.492953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fe291dfe-1f3f-499a-a464-01d4d80ba1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:18.507933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:18.597389 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2513/4989] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:18.599446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc360bc7-d7e1-4f0e-b178-a17a3fe79393 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:18.599840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc360bc7-d7e1-4f0e-b178-a17a3fe79393 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:18.600241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc360bc7-d7e1-4f0e-b178-a17a3fe79393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:18.652964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bc360bc7-d7e1-4f0e-b178-a17a3fe79393 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:18.654657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bc360bc7-d7e1-4f0e-b178-a17a3fe79393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:18.674727 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2477/4990] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:18.677351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe291dfe-1f3f-499a-a464-01d4d80ba1ca None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:18.690640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe291dfe-1f3f-499a-a464-01d4d80ba1ca None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:18.696291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77e644-df50-46af-8a77-40f05edf5a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:18.698433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77e644-df50-46af-8a77-40f05edf5a43 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:18.698941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77e644-df50-46af-8a77-40f05edf5a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:18.699510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77e644-df50-46af-8a77-40f05edf5a43 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:18.700508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77e644-df50-46af-8a77-40f05edf5a43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:19:18.701040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77e644-df50-46af-8a77-40f05edf5a43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:18.705775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77e644-df50-46af-8a77-40f05edf5a43 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:18.754158 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2514/4991] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:18.758765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc360bc7-d7e1-4f0e-b178-a17a3fe79393 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:18.780394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc360bc7-d7e1-4f0e-b178-a17a3fe79393 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:18.792827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31f264-d2fe-452e-b5eb-ae68533e783f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:18.793517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31f264-d2fe-452e-b5eb-ae68533e783f admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:18.793987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31f264-d2fe-452e-b5eb-ae68533e783f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:18.794482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31f264-d2fe-452e-b5eb-ae68533e783f admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:18.795761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31f264-d2fe-452e-b5eb-ae68533e783f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:18.798398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31f264-d2fe-452e-b5eb-ae68533e783f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:18.865393 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2478/4992] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:18 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:18.866476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77e644-df50-46af-8a77-40f05edf5a43 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:18.885795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77e644-df50-46af-8a77-40f05edf5a43 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:19.022211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce4f9a-3d8d-4226-b45c-c3470a764e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:19.022921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce4f9a-3d8d-4226-b45c-c3470a764e51 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:19.023319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce4f9a-3d8d-4226-b45c-c3470a764e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:19.023481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce4f9a-3d8d-4226-b45c-c3470a764e51 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:19.024325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce4f9a-3d8d-4226-b45c-c3470a764e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:19.026230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce4f9a-3d8d-4226-b45c-c3470a764e51 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:19.085370 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2515/4993] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:19:18 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:19.090043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31f264-d2fe-452e-b5eb-ae68533e783f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:19.117697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31f264-d2fe-452e-b5eb-ae68533e783f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:19.130021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df092f-5793-472b-876d-5fe960a6590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:19.130725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df092f-5793-472b-876d-5fe960a6590b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:19.131001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df092f-5793-472b-876d-5fe960a6590b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:19.131280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df092f-5793-472b-876d-5fe960a6590b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:19.132011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df092f-5793-472b-876d-5fe960a6590b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:19.133741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df092f-5793-472b-876d-5fe960a6590b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:19.157390 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2479/4994] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:19:19.161384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce4f9a-3d8d-4226-b45c-c3470a764e51 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:19.178398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce4f9a-3d8d-4226-b45c-c3470a764e51 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:19.192616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f725629-647d-4e78-9b0e-8f7f0f080e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:19.194912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f725629-647d-4e78-9b0e-8f7f0f080e1a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:19.195602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f725629-647d-4e78-9b0e-8f7f0f080e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:19.196214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f725629-647d-4e78-9b0e-8f7f0f080e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:19.197469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f725629-647d-4e78-9b0e-8f7f0f080e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:19.201091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f725629-647d-4e78-9b0e-8f7f0f080e1a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:19.221200 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2516/4995] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:19:19.234991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df092f-5793-472b-876d-5fe960a6590b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:19.239228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df092f-5793-472b-876d-5fe960a6590b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:19.246732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689d4e4-7117-451a-8368-40e860312b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:19.249002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689d4e4-7117-451a-8368-40e860312b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:19.249295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689d4e4-7117-451a-8368-40e860312b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:19.250294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689d4e4-7117-451a-8368-40e860312b8e admin admin] PATH_INFO: `/v3/projects/aa564fad6b9f41b3bbf3f221300a50cd/users/edd9c4ad804d49dc98bb3f50f6f88377/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:19.274154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689d4e4-7117-451a-8368-40e860312b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa564fad6b9f41b3bbf3f221300a50cd, user_id=edd9c4ad804d49dc98bb3f50f6f88377, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:19.278431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689d4e4-7117-451a-8368-40e860312b8e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:19.312276 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2480/4996] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:19:19 2022] PUT /identity/v3/projects/aa564fad6b9f41b3bbf3f221300a50cd/users/edd9c4ad804d49dc98bb3f50f6f88377/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:19:19.313714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf587955-28fd-4939-a551-d1d81e2735cf None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:19.313714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf587955-28fd-4939-a551-d1d81e2735cf None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:19.313996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf587955-28fd-4939-a551-d1d81e2735cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:19.353612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-cf587955-28fd-4939-a551-d1d81e2735cf None None] MFA Rules not processed for user `edd9c4ad804d49dc98bb3f50f6f88377`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:19.355275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cf587955-28fd-4939-a551-d1d81e2735cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:19.458662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689d4e4-7117-451a-8368-40e860312b8e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:19.465493 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2517/4997] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:19.556198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689d4e4-7117-451a-8368-40e860312b8e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:19.563678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6d5ad-fa6a-43be-b953-2ea2557a96c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:19.564593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6d5ad-fa6a-43be-b953-2ea2557a96c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:19.565015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6d5ad-fa6a-43be-b953-2ea2557a96c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:19.565394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6d5ad-fa6a-43be-b953-2ea2557a96c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:19.566355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6d5ad-fa6a-43be-b953-2ea2557a96c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:19.568902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6d5ad-fa6a-43be-b953-2ea2557a96c8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:19.604080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:19.622094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf587955-28fd-4939-a551-d1d81e2735cf None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:19.638239 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2481/4998] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:19 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:19:19.646355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf587955-28fd-4939-a551-d1d81e2735cf None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:19.655708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:19.772889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2e0bf-74b8-4088-b66d-d932c860977b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:19.773567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2e0bf-74b8-4088-b66d-d932c860977b admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:19.774009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2e0bf-74b8-4088-b66d-d932c860977b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:19.774743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2e0bf-74b8-4088-b66d-d932c860977b admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:19.776138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2e0bf-74b8-4088-b66d-d932c860977b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:19.791046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2e0bf-74b8-4088-b66d-d932c860977b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:19.848805 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2518/4999] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:19:19 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:19:19.853087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6d5ad-fa6a-43be-b953-2ea2557a96c8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:19.868365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6d5ad-fa6a-43be-b953-2ea2557a96c8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:19.875407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353c54e-b947-435b-9332-fd6e11ee06a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:19.876591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353c54e-b947-435b-9332-fd6e11ee06a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:19.877151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353c54e-b947-435b-9332-fd6e11ee06a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:19.877671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353c54e-b947-435b-9332-fd6e11ee06a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:19.879800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353c54e-b947-435b-9332-fd6e11ee06a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:19.882782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353c54e-b947-435b-9332-fd6e11ee06a7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:19.905020 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2482/5000] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:19:19.905239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2e0bf-74b8-4088-b66d-d932c860977b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:19.921147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2e0bf-74b8-4088-b66d-d932c860977b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:19.944926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec46db-da0b-4c3d-a9fc-65a3546dc582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:19.946566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec46db-da0b-4c3d-a9fc-65a3546dc582 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:19.947081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec46db-da0b-4c3d-a9fc-65a3546dc582 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:19.947773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec46db-da0b-4c3d-a9fc-65a3546dc582 admin admin] PATH_INFO: `/v3/projects/4825febfd8b6492299871e8c49ec27c6/users/ae284e5883ff46b5be84733d282e04d6/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:19.978674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec46db-da0b-4c3d-a9fc-65a3546dc582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4825febfd8b6492299871e8c49ec27c6, user_id=ae284e5883ff46b5be84733d282e04d6, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:19.983256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec46db-da0b-4c3d-a9fc-65a3546dc582 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:20.010013 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2519/5001] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:19:19 2022] PUT /identity/v3/projects/4825febfd8b6492299871e8c49ec27c6/users/ae284e5883ff46b5be84733d282e04d6/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:19:20.011430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353c54e-b947-435b-9332-fd6e11ee06a7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:20.028428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353c54e-b947-435b-9332-fd6e11ee06a7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:20.190899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3ed3f-7540-48bd-b048-29c96f3bb142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:20.190899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3ed3f-7540-48bd-b048-29c96f3bb142 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:20.190899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3ed3f-7540-48bd-b048-29c96f3bb142 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:20.190899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3ed3f-7540-48bd-b048-29c96f3bb142 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:20.191850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3ed3f-7540-48bd-b048-29c96f3bb142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:20.191850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3ed3f-7540-48bd-b048-29c96f3bb142 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:20.206871 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2483/5002] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:19:20.211218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec46db-da0b-4c3d-a9fc-65a3546dc582 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:20.254561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec46db-da0b-4c3d-a9fc-65a3546dc582 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:20.261480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810df5d0-1c2e-47f2-a246-52e6580456bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:20.262593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810df5d0-1c2e-47f2-a246-52e6580456bf admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:20.262876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810df5d0-1c2e-47f2-a246-52e6580456bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:20.263158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810df5d0-1c2e-47f2-a246-52e6580456bf admin admin] PATH_INFO: `/v3/projects/4825febfd8b6492299871e8c49ec27c6/users/ae284e5883ff46b5be84733d282e04d6/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:20.269684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810df5d0-1c2e-47f2-a246-52e6580456bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4825febfd8b6492299871e8c49ec27c6, user_id=ae284e5883ff46b5be84733d282e04d6, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:20.273140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810df5d0-1c2e-47f2-a246-52e6580456bf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:20.288871 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2520/5003] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:19:20 2022] PUT /identity/v3/projects/4825febfd8b6492299871e8c49ec27c6/users/ae284e5883ff46b5be84733d282e04d6/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:20.300460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb32f0f-ad0b-4a3d-8cf4-16b718f14954 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:20.301942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb32f0f-ad0b-4a3d-8cf4-16b718f14954 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:20.301942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb32f0f-ad0b-4a3d-8cf4-16b718f14954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:20.345034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6eb32f0f-ad0b-4a3d-8cf4-16b718f14954 None None] MFA Rules not processed for user `ae284e5883ff46b5be84733d282e04d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:20.346851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6eb32f0f-ad0b-4a3d-8cf4-16b718f14954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:20.480501 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2484/5004] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:20 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:20.488261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810df5d0-1c2e-47f2-a246-52e6580456bf admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:20.504148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810df5d0-1c2e-47f2-a246-52e6580456bf admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:20.519492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe43834-cc5c-4566-bb0e-52909d4ca3f6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:20.521099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe43834-cc5c-4566-bb0e-52909d4ca3f6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:20.521625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe43834-cc5c-4566-bb0e-52909d4ca3f6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:20.522109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe43834-cc5c-4566-bb0e-52909d4ca3f6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:20.523824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe43834-cc5c-4566-bb0e-52909d4ca3f6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:20.526945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe43834-cc5c-4566-bb0e-52909d4ca3f6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:20.594154 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2521/5005] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:20 2022] POST /identity/v3/projects => generated 358 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:20.595159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb32f0f-ad0b-4a3d-8cf4-16b718f14954 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:20.607701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb32f0f-ad0b-4a3d-8cf4-16b718f14954 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:20.747180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a312535-4c67-482a-8da3-a0f476a0db54 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:20.751849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a312535-4c67-482a-8da3-a0f476a0db54 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:20.752759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a312535-4c67-482a-8da3-a0f476a0db54 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:20.753098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a312535-4c67-482a-8da3-a0f476a0db54 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:20.754331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a312535-4c67-482a-8da3-a0f476a0db54 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:20.756517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a312535-4c67-482a-8da3-a0f476a0db54 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:20.803249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:20.841660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe43834-cc5c-4566-bb0e-52909d4ca3f6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:20.863898 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2485/5006] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:19:20 2022] POST /identity/v3/users => generated 413 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:19:20.873314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe43834-cc5c-4566-bb0e-52909d4ca3f6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:20.892913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73cb83-19e9-4f1c-892e-06be09630c49 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:20.896795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73cb83-19e9-4f1c-892e-06be09630c49 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:20.900661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73cb83-19e9-4f1c-892e-06be09630c49 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:20.901205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73cb83-19e9-4f1c-892e-06be09630c49 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/users/8cbca8103b0e408b9e9f5b46ea1fef01` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:20.943307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73cb83-19e9-4f1c-892e-06be09630c49 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:get_user(user_id=8cbca8103b0e408b9e9f5b46ea1fef01)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:20.947554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73cb83-19e9-4f1c-892e-06be09630c49 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:20.953581 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2522/5007] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:19:20 2022] GET /identity/v3/users/8cbca8103b0e408b9e9f5b46ea1fef01 => generated 413 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:20.955134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a312535-4c67-482a-8da3-a0f476a0db54 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:21.005774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a312535-4c67-482a-8da3-a0f476a0db54 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:21.022087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5773f09-d6e0-4f6d-a780-0e41b1c38e37 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:21.023077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5773f09-d6e0-4f6d-a780-0e41b1c38e37 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:21.023472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5773f09-d6e0-4f6d-a780-0e41b1c38e37 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:21.024786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5773f09-d6e0-4f6d-a780-0e41b1c38e37 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/users/8cbca8103b0e408b9e9f5b46ea1fef01` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:21.026434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5773f09-d6e0-4f6d-a780-0e41b1c38e37 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8cbca8103b0e408b9e9f5b46ea1fef01)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:21.030978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5773f09-d6e0-4f6d-a780-0e41b1c38e37 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:21.176517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b5773f09-d6e0-4f6d-a780-0e41b1c38e37 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cbca8103b0e408b9e9f5b46ea1fef01'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:21.194507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b5773f09-d6e0-4f6d-a780-0e41b1c38e37 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cbca8103b0e408b9e9f5b46ea1fef01'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:21.210047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b5773f09-d6e0-4f6d-a780-0e41b1c38e37 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cbca8103b0e408b9e9f5b46ea1fef01'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:21.211782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b5773f09-d6e0-4f6d-a780-0e41b1c38e37 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cbca8103b0e408b9e9f5b46ea1fef01'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:21.213710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b5773f09-d6e0-4f6d-a780-0e41b1c38e37 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cbca8103b0e408b9e9f5b46ea1fef01'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:21.263355 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2486/5008] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:19:20 2022] DELETE /identity/v3/users/8cbca8103b0e408b9e9f5b46ea1fef01 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:21.267484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73cb83-19e9-4f1c-892e-06be09630c49 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:21.269544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-da73cb83-19e9-4f1c-892e-06be09630c49 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:21.293339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73cb83-19e9-4f1c-892e-06be09630c49 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:21.373941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6943eb-6473-4dea-aede-3cc7e847c490 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:21.374229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6943eb-6473-4dea-aede-3cc7e847c490 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:21.374504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6943eb-6473-4dea-aede-3cc7e847c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:21.430484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b356ec2-9963-4cc9-a45b-8ba44f6e471a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:21.434696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b356ec2-9963-4cc9-a45b-8ba44f6e471a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:21.435643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b356ec2-9963-4cc9-a45b-8ba44f6e471a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:21.436581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b356ec2-9963-4cc9-a45b-8ba44f6e471a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/9064cd70e699449d9479bfdc424c345c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:21.441150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b356ec2-9963-4cc9-a45b-8ba44f6e471a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9064cd70e699449d9479bfdc424c345c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:21.442123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fc6943eb-6473-4dea-aede-3cc7e847c490 None None] MFA Rules not processed for user `35c15fdfaf5b4b67b0678e2e5c1d9aec`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:21.446635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fc6943eb-6473-4dea-aede-3cc7e847c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:21.447604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b356ec2-9963-4cc9-a45b-8ba44f6e471a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:21.540080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:21.607920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6b356ec2-9963-4cc9-a45b-8ba44f6e471a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9064cd70e699449d9479bfdc424c345c', 'request_id': 'req-6b356ec2-9963-4cc9-a45b-8ba44f6e471a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:21.624238 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2487/5009] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:21.633866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6b356ec2-9963-4cc9-a45b-8ba44f6e471a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9064cd70e699449d9479bfdc424c345c', 'request_id': 'req-6b356ec2-9963-4cc9-a45b-8ba44f6e471a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:21.634743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6943eb-6473-4dea-aede-3cc7e847c490 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:21.638269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fc6943eb-6473-4dea-aede-3cc7e847c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:21.645496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6b356ec2-9963-4cc9-a45b-8ba44f6e471a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9064cd70e699449d9479bfdc424c345c', 'request_id': 'req-6b356ec2-9963-4cc9-a45b-8ba44f6e471a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:21.658533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6b356ec2-9963-4cc9-a45b-8ba44f6e471a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] The token cache is being invalidate because project 9064cd70e699449d9479bfdc424c345c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:21.658835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6b356ec2-9963-4cc9-a45b-8ba44f6e471a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:21.659712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6b356ec2-9963-4cc9-a45b-8ba44f6e471a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:21.670393 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2523/5010] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:21 2022] DELETE /identity/v3/projects/9064cd70e699449d9479bfdc424c345c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:21.671579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b356ec2-9963-4cc9-a45b-8ba44f6e471a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:21.673061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6b356ec2-9963-4cc9-a45b-8ba44f6e471a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:21.756856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:21.760668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b356ec2-9963-4cc9-a45b-8ba44f6e471a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:21.765651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d815d-4503-470f-8207-33259b2ce261 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:21.766334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d815d-4503-470f-8207-33259b2ce261 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:21.766614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d815d-4503-470f-8207-33259b2ce261 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:21.766898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d815d-4503-470f-8207-33259b2ce261 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:21.768511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d815d-4503-470f-8207-33259b2ce261 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:21.769734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d815d-4503-470f-8207-33259b2ce261 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:21.794608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6943eb-6473-4dea-aede-3cc7e847c490 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:21.798578 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2524/5011] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:21 2022] POST /identity/v3/projects => generated 349 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:21.800183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d815d-4503-470f-8207-33259b2ce261 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:21.963463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d815d-4503-470f-8207-33259b2ce261 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:21.970055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0be024-e964-4669-ba54-39f73fb25bbd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:21.971041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0be024-e964-4669-ba54-39f73fb25bbd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:21.971247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0be024-e964-4669-ba54-39f73fb25bbd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:21.971979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0be024-e964-4669-ba54-39f73fb25bbd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:21.972563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0be024-e964-4669-ba54-39f73fb25bbd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:19:21.973005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0be024-e964-4669-ba54-39f73fb25bbd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:21.975476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0be024-e964-4669-ba54-39f73fb25bbd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:21.989129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b562a8c-a291-4b80-bc95-1fe3bbfa6c05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:21.991789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b562a8c-a291-4b80-bc95-1fe3bbfa6c05 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:21.992265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b562a8c-a291-4b80-bc95-1fe3bbfa6c05 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:21.993052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b562a8c-a291-4b80-bc95-1fe3bbfa6c05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:22.005427 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2525/5012] 10.222.0.43 () {58 vars in 1159 bytes} [Sat Jul 2 21:19:21 2022] GET /identity/v3/projects?is_domain=True => generated 1021 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:19:22.006926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0be024-e964-4669-ba54-39f73fb25bbd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:22.007985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6b562a8c-a291-4b80-bc95-1fe3bbfa6c05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:22.038580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0be024-e964-4669-ba54-39f73fb25bbd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:22.055795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f49bc5-7b1e-47d9-8169-2e0a583f27a8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:22.056750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f49bc5-7b1e-47d9-8169-2e0a583f27a8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:22.057797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f49bc5-7b1e-47d9-8169-2e0a583f27a8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:22.057797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f49bc5-7b1e-47d9-8169-2e0a583f27a8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:22.058578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f49bc5-7b1e-47d9-8169-2e0a583f27a8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:22.065635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f49bc5-7b1e-47d9-8169-2e0a583f27a8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:22.094242 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2526/5013] 10.222.0.43 () {58 vars in 1127 bytes} [Sat Jul 2 21:19:22 2022] GET /identity/v3/domains => generated 830 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:22.102132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f49bc5-7b1e-47d9-8169-2e0a583f27a8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:22.116830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f49bc5-7b1e-47d9-8169-2e0a583f27a8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:22.124670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598f8a1-b41b-4cda-b878-8b9b504ccdff tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:22.125673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598f8a1-b41b-4cda-b878-8b9b504ccdff tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:22.126056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598f8a1-b41b-4cda-b878-8b9b504ccdff tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:22.126493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598f8a1-b41b-4cda-b878-8b9b504ccdff tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/7bb125105c8949128b70c0490362b248` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:22.129276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598f8a1-b41b-4cda-b878-8b9b504ccdff tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:update_project(project_id=7bb125105c8949128b70c0490362b248)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:22.130669 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-3598f8a1-b41b-4cda-b878-8b9b504ccdff tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:19:22.130669 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:19:22.130669 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:19:22.130972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b562a8c-a291-4b80-bc95-1fe3bbfa6c05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:22.132109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598f8a1-b41b-4cda-b878-8b9b504ccdff tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:22.132862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b562a8c-a291-4b80-bc95-1fe3bbfa6c05 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:22.155811 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2488/5014] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:19:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:19:22.164154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3598f8a1-b41b-4cda-b878-8b9b504ccdff tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7bb125105c8949128b70c0490362b248'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:22.168500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3598f8a1-b41b-4cda-b878-8b9b504ccdff tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7bb125105c8949128b70c0490362b248'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:22.191125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:22.204945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3598f8a1-b41b-4cda-b878-8b9b504ccdff tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7bb125105c8949128b70c0490362b248'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:22.206073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3598f8a1-b41b-4cda-b878-8b9b504ccdff tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7bb125105c8949128b70c0490362b248'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:22.211061 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2527/5015] 10.222.0.43 () {60 vars in 1251 bytes} [Sat Jul 2 21:19:22 2022] PATCH /identity/v3/projects/7bb125105c8949128b70c0490362b248 => generated 363 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:22.215061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b562a8c-a291-4b80-bc95-1fe3bbfa6c05 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:22.229623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b562a8c-a291-4b80-bc95-1fe3bbfa6c05 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:22.303287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:22.304097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:22.304398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:22.304657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/7bb125105c8949128b70c0490362b248` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:22.319286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7bb125105c8949128b70c0490362b248)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:22.323120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:22.356162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7bb125105c8949128b70c0490362b248'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:22.371687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7bb125105c8949128b70c0490362b248'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:22.373356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:22.426876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bb125105c8949128b70c0490362b248', 'request_id': 'req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:22.435440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bb125105c8949128b70c0490362b248', 'request_id': 'req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:22.442359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bb125105c8949128b70c0490362b248', 'request_id': 'req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:22.463780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] The token cache is being invalidate because project 7bb125105c8949128b70c0490362b248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:22.464153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:22.465216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:22.475342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7bb125105c8949128b70c0490362b248', 'request_id': 'req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:22.475716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7bb125105c8949128b70c0490362b248', 'request_id': 'req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:22.476458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7bb125105c8949128b70c0490362b248', 'request_id': 'req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:22.488718 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2489/5016] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:22 2022] DELETE /identity/v3/projects/7bb125105c8949128b70c0490362b248 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:22.493560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598f8a1-b41b-4cda-b878-8b9b504ccdff tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:22.495035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3598f8a1-b41b-4cda-b878-8b9b504ccdff tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:22.519972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598f8a1-b41b-4cda-b878-8b9b504ccdff tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:22.632248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8acda-59d6-4552-b60e-b0bd7eecbbcd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:22.633080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8acda-59d6-4552-b60e-b0bd7eecbbcd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:22.633434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8acda-59d6-4552-b60e-b0bd7eecbbcd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:22.633783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8acda-59d6-4552-b60e-b0bd7eecbbcd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:22.634712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8acda-59d6-4552-b60e-b0bd7eecbbcd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:22.637094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8acda-59d6-4552-b60e-b0bd7eecbbcd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:22.692114 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2528/5017] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:22 2022] POST /identity/v3/projects => generated 360 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:22.692627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:22.694176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:22.708993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15f03f-9c0e-4f1a-a23c-cf3c60a34f27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:22.811069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bea8d-3a7f-441a-a14a-19b2ffd57fa9 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:22.812128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bea8d-3a7f-441a-a14a-19b2ffd57fa9 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:22.812563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bea8d-3a7f-441a-a14a-19b2ffd57fa9 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:22.812945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bea8d-3a7f-441a-a14a-19b2ffd57fa9 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/dec312e03a9745d79edf83abb1d531d3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:22.814370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bea8d-3a7f-441a-a14a-19b2ffd57fa9 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:get_project(project_id=dec312e03a9745d79edf83abb1d531d3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:22.816885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bea8d-3a7f-441a-a14a-19b2ffd57fa9 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:22.820087 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2490/5018] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:19:22 2022] GET /identity/v3/projects/dec312e03a9745d79edf83abb1d531d3 => generated 360 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:19:22.826026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8acda-59d6-4552-b60e-b0bd7eecbbcd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:22.845805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8acda-59d6-4552-b60e-b0bd7eecbbcd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:22.855121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecc803-56d4-4b94-bad1-b2aa7d007727 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:22.856700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecc803-56d4-4b94-bad1-b2aa7d007727 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:22.857153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecc803-56d4-4b94-bad1-b2aa7d007727 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:22.857545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecc803-56d4-4b94-bad1-b2aa7d007727 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/dec312e03a9745d79edf83abb1d531d3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:22.858918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecc803-56d4-4b94-bad1-b2aa7d007727 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dec312e03a9745d79edf83abb1d531d3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:22.861669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cecc803-56d4-4b94-bad1-b2aa7d007727 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:22.960557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4cecc803-56d4-4b94-bad1-b2aa7d007727 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec312e03a9745d79edf83abb1d531d3', 'request_id': 'req-4cecc803-56d4-4b94-bad1-b2aa7d007727'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:22.979257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4cecc803-56d4-4b94-bad1-b2aa7d007727 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec312e03a9745d79edf83abb1d531d3', 'request_id': 'req-4cecc803-56d4-4b94-bad1-b2aa7d007727'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:22.992197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4cecc803-56d4-4b94-bad1-b2aa7d007727 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec312e03a9745d79edf83abb1d531d3', 'request_id': 'req-4cecc803-56d4-4b94-bad1-b2aa7d007727'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:23.007804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4cecc803-56d4-4b94-bad1-b2aa7d007727 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] The token cache is being invalidate because project dec312e03a9745d79edf83abb1d531d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:23.008312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4cecc803-56d4-4b94-bad1-b2aa7d007727 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:23.009981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4cecc803-56d4-4b94-bad1-b2aa7d007727 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:23.017161 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2529/5019] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:22 2022] DELETE /identity/v3/projects/dec312e03a9745d79edf83abb1d531d3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:23.018549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bea8d-3a7f-441a-a14a-19b2ffd57fa9 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:23.021681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c34bea8d-3a7f-441a-a14a-19b2ffd57fa9 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:23.055225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bea8d-3a7f-441a-a14a-19b2ffd57fa9 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:23.226631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86c234-8527-49c4-aa13-394a913c0a47 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:23.238373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86c234-8527-49c4-aa13-394a913c0a47 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:23.239838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86c234-8527-49c4-aa13-394a913c0a47 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:23.240338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86c234-8527-49c4-aa13-394a913c0a47 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:23.241780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86c234-8527-49c4-aa13-394a913c0a47 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:23.244016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86c234-8527-49c4-aa13-394a913c0a47 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:23.306342 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2491/5020] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:23 2022] POST /identity/v3/projects => generated 361 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:23.311422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecc803-56d4-4b94-bad1-b2aa7d007727 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:23.337272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecc803-56d4-4b94-bad1-b2aa7d007727 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:23.495874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a90bd-0779-433d-a4bf-31e30eb5baa3 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:23.497286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a90bd-0779-433d-a4bf-31e30eb5baa3 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:23.497900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a90bd-0779-433d-a4bf-31e30eb5baa3 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:23.498352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a90bd-0779-433d-a4bf-31e30eb5baa3 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/754018e57bad4a2e89b23b1ef2a1a065` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:23.500523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a90bd-0779-433d-a4bf-31e30eb5baa3 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:get_project(project_id=754018e57bad4a2e89b23b1ef2a1a065)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:23.503531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a90bd-0779-433d-a4bf-31e30eb5baa3 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:23.512942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86c234-8527-49c4-aa13-394a913c0a47 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:23.523118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:23.527506 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2530/5021] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:19:23 2022] GET /identity/v3/projects/754018e57bad4a2e89b23b1ef2a1a065 => generated 361 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:19:23.532624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86c234-8527-49c4-aa13-394a913c0a47 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:23.539626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cde1f-5a79-43ff-9cef-5e8c7d036608 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:23.540648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cde1f-5a79-43ff-9cef-5e8c7d036608 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:23.540953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cde1f-5a79-43ff-9cef-5e8c7d036608 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:23.541512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cde1f-5a79-43ff-9cef-5e8c7d036608 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/754018e57bad4a2e89b23b1ef2a1a065` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:23.544206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0cde1f-5a79-43ff-9cef-5e8c7d036608 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:delete_project(project_id=754018e57bad4a2e89b23b1ef2a1a065)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:23.548681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0cde1f-5a79-43ff-9cef-5e8c7d036608 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:23.773108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6d0cde1f-5a79-43ff-9cef-5e8c7d036608 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '754018e57bad4a2e89b23b1ef2a1a065', 'request_id': 'req-6d0cde1f-5a79-43ff-9cef-5e8c7d036608'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:23.796242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6d0cde1f-5a79-43ff-9cef-5e8c7d036608 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '754018e57bad4a2e89b23b1ef2a1a065', 'request_id': 'req-6d0cde1f-5a79-43ff-9cef-5e8c7d036608'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:23.806542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6d0cde1f-5a79-43ff-9cef-5e8c7d036608 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '754018e57bad4a2e89b23b1ef2a1a065', 'request_id': 'req-6d0cde1f-5a79-43ff-9cef-5e8c7d036608'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:23.841315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6d0cde1f-5a79-43ff-9cef-5e8c7d036608 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] The token cache is being invalidate because project 754018e57bad4a2e89b23b1ef2a1a065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:23.841611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6d0cde1f-5a79-43ff-9cef-5e8c7d036608 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:23.842391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6d0cde1f-5a79-43ff-9cef-5e8c7d036608 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:23.848273 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2492/5022] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:23 2022] DELETE /identity/v3/projects/754018e57bad4a2e89b23b1ef2a1a065 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:23.849493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a90bd-0779-433d-a4bf-31e30eb5baa3 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:23.854111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a42a90bd-0779-433d-a4bf-31e30eb5baa3 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:23.872868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:23.900055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a90bd-0779-433d-a4bf-31e30eb5baa3 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:24.168085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe170d-a2c2-4fdb-bbbb-6db83f93dc3f tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:24.168788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe170d-a2c2-4fdb-bbbb-6db83f93dc3f tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:24.169963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe170d-a2c2-4fdb-bbbb-6db83f93dc3f tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:24.170774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe170d-a2c2-4fdb-bbbb-6db83f93dc3f tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:24.193070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe170d-a2c2-4fdb-bbbb-6db83f93dc3f tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:24.200808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe170d-a2c2-4fdb-bbbb-6db83f93dc3f tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:24.288930 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2531/5023] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:19:23 2022] POST /identity/v3/projects => generated 346 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:19:24.322287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cde1f-5a79-43ff-9cef-5e8c7d036608 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:24.350295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cde1f-5a79-43ff-9cef-5e8c7d036608 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:24.446191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86de46-afae-4c7f-a7e1-91a35c065614 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:24.447077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86de46-afae-4c7f-a7e1-91a35c065614 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:24.447365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86de46-afae-4c7f-a7e1-91a35c065614 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:24.447642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86de46-afae-4c7f-a7e1-91a35c065614 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/302f786424f341f6a9472f28dfd16f6d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:24.448960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86de46-afae-4c7f-a7e1-91a35c065614 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:get_project(project_id=302f786424f341f6a9472f28dfd16f6d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:24.451029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86de46-afae-4c7f-a7e1-91a35c065614 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:24.456130 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2493/5024] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:19:24 2022] GET /identity/v3/projects/302f786424f341f6a9472f28dfd16f6d => generated 346 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:24.457253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe170d-a2c2-4fdb-bbbb-6db83f93dc3f tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:24.475232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe170d-a2c2-4fdb-bbbb-6db83f93dc3f tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:24.486624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebf79d-81c5-48b7-a5c0-07d5a64414bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:24.487592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebf79d-81c5-48b7-a5c0-07d5a64414bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:24.489085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebf79d-81c5-48b7-a5c0-07d5a64414bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:24.489374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebf79d-81c5-48b7-a5c0-07d5a64414bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/302f786424f341f6a9472f28dfd16f6d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:24.491905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebf79d-81c5-48b7-a5c0-07d5a64414bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:delete_project(project_id=302f786424f341f6a9472f28dfd16f6d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:24.496336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebf79d-81c5-48b7-a5c0-07d5a64414bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:24.621668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b2ebf79d-81c5-48b7-a5c0-07d5a64414bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302f786424f341f6a9472f28dfd16f6d', 'request_id': 'req-b2ebf79d-81c5-48b7-a5c0-07d5a64414bd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:24.642432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b2ebf79d-81c5-48b7-a5c0-07d5a64414bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302f786424f341f6a9472f28dfd16f6d', 'request_id': 'req-b2ebf79d-81c5-48b7-a5c0-07d5a64414bd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:24.653788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b2ebf79d-81c5-48b7-a5c0-07d5a64414bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302f786424f341f6a9472f28dfd16f6d', 'request_id': 'req-b2ebf79d-81c5-48b7-a5c0-07d5a64414bd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:24.685356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b2ebf79d-81c5-48b7-a5c0-07d5a64414bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] The token cache is being invalidate because project 302f786424f341f6a9472f28dfd16f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:24.685356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b2ebf79d-81c5-48b7-a5c0-07d5a64414bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:24.688493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b2ebf79d-81c5-48b7-a5c0-07d5a64414bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:24.691520 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2532/5025] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:24 2022] DELETE /identity/v3/projects/302f786424f341f6a9472f28dfd16f6d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:19:24.696347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86de46-afae-4c7f-a7e1-91a35c065614 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:24.698736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0c86de46-afae-4c7f-a7e1-91a35c065614 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:24.708653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46099484-361d-445d-be66-a6bd801955f1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:24.709132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46099484-361d-445d-be66-a6bd801955f1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:24.709530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46099484-361d-445d-be66-a6bd801955f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:24.734740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86de46-afae-4c7f-a7e1-91a35c065614 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:24.759076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-46099484-361d-445d-be66-a6bd801955f1 None None] MFA Rules not processed for user `4572a43d0b7e465eabd506fb52a502ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:24.760655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-46099484-361d-445d-be66-a6bd801955f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:24.918486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622803a1-32a9-4a3b-8502-4cbfc981077a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:24.921631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622803a1-32a9-4a3b-8502-4cbfc981077a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:24.921945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622803a1-32a9-4a3b-8502-4cbfc981077a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:24.922224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622803a1-32a9-4a3b-8502-4cbfc981077a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:24.922982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622803a1-32a9-4a3b-8502-4cbfc981077a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:24.929341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622803a1-32a9-4a3b-8502-4cbfc981077a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:24.961547 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2533/5026] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:24.982471 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2494/5027] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:19:24 2022] POST /identity/v3/domains => generated 276 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:24.986069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46099484-361d-445d-be66-a6bd801955f1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:25.005157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46099484-361d-445d-be66-a6bd801955f1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:25.039146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:25.120846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86df5c8-c4c2-48b4-a95f-ed64eaf4cab1 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:25.121972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86df5c8-c4c2-48b4-a95f-ed64eaf4cab1 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:25.122712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86df5c8-c4c2-48b4-a95f-ed64eaf4cab1 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:25.123194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86df5c8-c4c2-48b4-a95f-ed64eaf4cab1 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:25.124160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86df5c8-c4c2-48b4-a95f-ed64eaf4cab1 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:25.126898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86df5c8-c4c2-48b4-a95f-ed64eaf4cab1 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:25.182038 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2534/5028] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:24 2022] POST /identity/v3/projects => generated 404 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:25.186023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622803a1-32a9-4a3b-8502-4cbfc981077a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:25.202083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622803a1-32a9-4a3b-8502-4cbfc981077a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:25.234169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:25.318740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b6d80-36bf-4030-84af-1e06fd2aed07 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:25.319685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b6d80-36bf-4030-84af-1e06fd2aed07 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:25.319924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b6d80-36bf-4030-84af-1e06fd2aed07 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:25.320237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b6d80-36bf-4030-84af-1e06fd2aed07 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/52c8be2c5ae347d8a2ed81f7e66b5bf5` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:25.321586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b6d80-36bf-4030-84af-1e06fd2aed07 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:get_project(project_id=52c8be2c5ae347d8a2ed81f7e66b5bf5)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:25.324063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b6d80-36bf-4030-84af-1e06fd2aed07 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:25.329454 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2495/5029] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:19:25 2022] GET /identity/v3/projects/52c8be2c5ae347d8a2ed81f7e66b5bf5 => generated 404 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:25.330441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86df5c8-c4c2-48b4-a95f-ed64eaf4cab1 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:25.344391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86df5c8-c4c2-48b4-a95f-ed64eaf4cab1 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:25.349661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf872f4-c931-4343-b90f-fd43f2ac2d0a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:25.350561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf872f4-c931-4343-b90f-fd43f2ac2d0a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:25.350931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf872f4-c931-4343-b90f-fd43f2ac2d0a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:25.351222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf872f4-c931-4343-b90f-fd43f2ac2d0a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/52c8be2c5ae347d8a2ed81f7e66b5bf5` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:25.352573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf872f4-c931-4343-b90f-fd43f2ac2d0a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:delete_project(project_id=52c8be2c5ae347d8a2ed81f7e66b5bf5)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:25.355246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf872f4-c931-4343-b90f-fd43f2ac2d0a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:25.438687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8cf872f4-c931-4343-b90f-fd43f2ac2d0a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c8be2c5ae347d8a2ed81f7e66b5bf5', 'request_id': 'req-8cf872f4-c931-4343-b90f-fd43f2ac2d0a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:25.454864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8cf872f4-c931-4343-b90f-fd43f2ac2d0a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c8be2c5ae347d8a2ed81f7e66b5bf5', 'request_id': 'req-8cf872f4-c931-4343-b90f-fd43f2ac2d0a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:25.466658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8cf872f4-c931-4343-b90f-fd43f2ac2d0a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c8be2c5ae347d8a2ed81f7e66b5bf5', 'request_id': 'req-8cf872f4-c931-4343-b90f-fd43f2ac2d0a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:25.481721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8cf872f4-c931-4343-b90f-fd43f2ac2d0a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] The token cache is being invalidate because project 52c8be2c5ae347d8a2ed81f7e66b5bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:25.482012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8cf872f4-c931-4343-b90f-fd43f2ac2d0a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:25.483458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8cf872f4-c931-4343-b90f-fd43f2ac2d0a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:25.485485 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2535/5030] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:25 2022] DELETE /identity/v3/projects/52c8be2c5ae347d8a2ed81f7e66b5bf5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:25.489537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b6d80-36bf-4030-84af-1e06fd2aed07 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:25.491325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3b0b6d80-36bf-4030-84af-1e06fd2aed07 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:25.504912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b6d80-36bf-4030-84af-1e06fd2aed07 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:25.625196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdf5dd-7925-4793-bb28-302a01192106 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:25.626212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdf5dd-7925-4793-bb28-302a01192106 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:25.626501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdf5dd-7925-4793-bb28-302a01192106 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:25.626912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdf5dd-7925-4793-bb28-302a01192106 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/domains/8b26380217ca4d758a9cd26fa322e06f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:25.628530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdf5dd-7925-4793-bb28-302a01192106 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8b26380217ca4d758a9cd26fa322e06f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:25.631249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdf5dd-7925-4793-bb28-302a01192106 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:25.688508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6dcdf5dd-7925-4793-bb28-302a01192106 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8b26380217ca4d758a9cd26fa322e06f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:25.690890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6dcdf5dd-7925-4793-bb28-302a01192106 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8b26380217ca4d758a9cd26fa322e06f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:25.744477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6dcdf5dd-7925-4793-bb28-302a01192106 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8b26380217ca4d758a9cd26fa322e06f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:25.748281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6dcdf5dd-7925-4793-bb28-302a01192106 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8b26380217ca4d758a9cd26fa322e06f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:25.754305 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2496/5031] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:19:25 2022] PATCH /identity/v3/domains/8b26380217ca4d758a9cd26fa322e06f => generated 277 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:25.759730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf872f4-c931-4343-b90f-fd43f2ac2d0a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:25.772393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf872f4-c931-4343-b90f-fd43f2ac2d0a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:25.911510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc250b58-6d1c-4197-a9f8-a28920ed90ce None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:25.911943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc250b58-6d1c-4197-a9f8-a28920ed90ce None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:25.912390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc250b58-6d1c-4197-a9f8-a28920ed90ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:25.933572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fc250b58-6d1c-4197-a9f8-a28920ed90ce None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:25.934811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fc250b58-6d1c-4197-a9f8-a28920ed90ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:25.941519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:25.942718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:25.942980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:25.943265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/domains/8b26380217ca4d758a9cd26fa322e06f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:25.973111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8b26380217ca4d758a9cd26fa322e06f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:25.975839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:26.008470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:26.043868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8b26380217ca4d758a9cd26fa322e06f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:26.047908 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2497/5032] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:19:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:26.057199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc250b58-6d1c-4197-a9f8-a28920ed90ce None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:26.058881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fc250b58-6d1c-4197-a9f8-a28920ed90ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:26.068729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8b26380217ca4d758a9cd26fa322e06f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:26.159107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:26.166435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b26380217ca4d758a9cd26fa322e06f', 'request_id': 'req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:26.184621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b26380217ca4d758a9cd26fa322e06f', 'request_id': 'req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:26.198148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b26380217ca4d758a9cd26fa322e06f', 'request_id': 'req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:26.215583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] The token cache is being invalidate because project 8b26380217ca4d758a9cd26fa322e06f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:26.216364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:26.217169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:26.225884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc250b58-6d1c-4197-a9f8-a28920ed90ce None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:26.229343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8b26380217ca4d758a9cd26fa322e06f', 'request_id': 'req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:26.230469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8b26380217ca4d758a9cd26fa322e06f', 'request_id': 'req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:26.232660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8b26380217ca4d758a9cd26fa322e06f', 'request_id': 'req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:26.251660 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2536/5033] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:19:25 2022] DELETE /identity/v3/domains/8b26380217ca4d758a9cd26fa322e06f => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:26.252772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:26.254869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:26.324609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf7b65-fd11-454d-bb70-c7da60524889 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:26.325990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf7b65-fd11-454d-bb70-c7da60524889 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:26.327003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf7b65-fd11-454d-bb70-c7da60524889 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:26.327436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf7b65-fd11-454d-bb70-c7da60524889 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:26.342740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7ecf7b65-fd11-454d-bb70-c7da60524889 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:26.350576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de38cc-fd8c-46a4-9c5a-85ac06b8f3ee tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:26.356898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6468f-40ac-49cc-8b6f-38cb62b2ba77 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:26.357863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6468f-40ac-49cc-8b6f-38cb62b2ba77 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:26.358661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6468f-40ac-49cc-8b6f-38cb62b2ba77 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:26.358661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6468f-40ac-49cc-8b6f-38cb62b2ba77 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:26.359404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6468f-40ac-49cc-8b6f-38cb62b2ba77 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:26.361388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6468f-40ac-49cc-8b6f-38cb62b2ba77 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:26.387087 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2537/5034] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:19:26 2022] POST /identity/v3/domains => generated 277 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:26.388316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6468f-40ac-49cc-8b6f-38cb62b2ba77 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:26.457868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf7b65-fd11-454d-bb70-c7da60524889 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:26.458907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:26.462656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf7b65-fd11-454d-bb70-c7da60524889 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:26.482982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6468f-40ac-49cc-8b6f-38cb62b2ba77 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:26.486869 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2498/5035] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:19:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:19:26.498349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7c311-70d4-4b9f-b39d-ba765b7d12fb tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:26.499263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7c311-70d4-4b9f-b39d-ba765b7d12fb tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:26.499557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7c311-70d4-4b9f-b39d-ba765b7d12fb tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:26.499840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7c311-70d4-4b9f-b39d-ba765b7d12fb tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:26.500946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7c311-70d4-4b9f-b39d-ba765b7d12fb tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:26.516009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7c311-70d4-4b9f-b39d-ba765b7d12fb tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:26.625236 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2538/5036] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:26 2022] POST /identity/v3/projects => generated 409 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:26.629373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf7b65-fd11-454d-bb70-c7da60524889 service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:26.654951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf7b65-fd11-454d-bb70-c7da60524889 service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:26.776238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bf16a-178a-4639-ad5d-190ec1009a6f tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:26.776927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bf16a-178a-4639-ad5d-190ec1009a6f tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:26.777215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bf16a-178a-4639-ad5d-190ec1009a6f tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:26.777483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bf16a-178a-4639-ad5d-190ec1009a6f tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:26.778189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bf16a-178a-4639-ad5d-190ec1009a6f tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:26.780139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bf16a-178a-4639-ad5d-190ec1009a6f tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:26.831761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:26.849624 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2499/5037] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:26 2022] POST /identity/v3/projects => generated 404 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:26.849824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7c311-70d4-4b9f-b39d-ba765b7d12fb tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:26.861168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7c311-70d4-4b9f-b39d-ba765b7d12fb tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:27.001789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7a233-5c87-4e90-b4d3-28ca042761e8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:27.004156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7a233-5c87-4e90-b4d3-28ca042761e8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:27.004337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7a233-5c87-4e90-b4d3-28ca042761e8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:27.004624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7a233-5c87-4e90-b4d3-28ca042761e8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/9d9a68d0dc9a4d6ea785d7cc113cb33c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:27.006063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7a233-5c87-4e90-b4d3-28ca042761e8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9d9a68d0dc9a4d6ea785d7cc113cb33c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:27.008957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7a233-5c87-4e90-b4d3-28ca042761e8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:27.144762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cdd7a233-5c87-4e90-b4d3-28ca042761e8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d9a68d0dc9a4d6ea785d7cc113cb33c', 'request_id': 'req-cdd7a233-5c87-4e90-b4d3-28ca042761e8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.163504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cdd7a233-5c87-4e90-b4d3-28ca042761e8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d9a68d0dc9a4d6ea785d7cc113cb33c', 'request_id': 'req-cdd7a233-5c87-4e90-b4d3-28ca042761e8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.174826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cdd7a233-5c87-4e90-b4d3-28ca042761e8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d9a68d0dc9a4d6ea785d7cc113cb33c', 'request_id': 'req-cdd7a233-5c87-4e90-b4d3-28ca042761e8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.197273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cdd7a233-5c87-4e90-b4d3-28ca042761e8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] The token cache is being invalidate because project 9d9a68d0dc9a4d6ea785d7cc113cb33c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:27.197764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cdd7a233-5c87-4e90-b4d3-28ca042761e8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.198582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cdd7a233-5c87-4e90-b4d3-28ca042761e8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.201413 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2539/5038] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:26 2022] DELETE /identity/v3/projects/9d9a68d0dc9a4d6ea785d7cc113cb33c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:27.206130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bf16a-178a-4639-ad5d-190ec1009a6f tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:27.207982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c37bf16a-178a-4639-ad5d-190ec1009a6f tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:27.225457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bf16a-178a-4639-ad5d-190ec1009a6f tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:27.378794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269060c-2a3e-47bc-80d9-54e00ebae79b tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:27.380694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269060c-2a3e-47bc-80d9-54e00ebae79b tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:27.381782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269060c-2a3e-47bc-80d9-54e00ebae79b tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:27.383265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269060c-2a3e-47bc-80d9-54e00ebae79b tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/b6c02505013942d1ba873269dc577528` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:27.384822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269060c-2a3e-47bc-80d9-54e00ebae79b tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b6c02505013942d1ba873269dc577528)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:27.393999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269060c-2a3e-47bc-80d9-54e00ebae79b tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:27.465305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2269060c-2a3e-47bc-80d9-54e00ebae79b tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c02505013942d1ba873269dc577528', 'request_id': 'req-2269060c-2a3e-47bc-80d9-54e00ebae79b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.473605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2269060c-2a3e-47bc-80d9-54e00ebae79b tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c02505013942d1ba873269dc577528', 'request_id': 'req-2269060c-2a3e-47bc-80d9-54e00ebae79b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.482956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2269060c-2a3e-47bc-80d9-54e00ebae79b tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c02505013942d1ba873269dc577528', 'request_id': 'req-2269060c-2a3e-47bc-80d9-54e00ebae79b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.504640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2269060c-2a3e-47bc-80d9-54e00ebae79b tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] The token cache is being invalidate because project b6c02505013942d1ba873269dc577528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:27.505170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2269060c-2a3e-47bc-80d9-54e00ebae79b tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.506610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2269060c-2a3e-47bc-80d9-54e00ebae79b tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.508970 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2500/5039] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:27 2022] DELETE /identity/v3/projects/b6c02505013942d1ba873269dc577528 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:27.513006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7a233-5c87-4e90-b4d3-28ca042761e8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:27.526247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7a233-5c87-4e90-b4d3-28ca042761e8 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:27.589638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:27.598243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc028a3-3666-49c9-9868-ad7bddf139bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:27.599161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc028a3-3666-49c9-9868-ad7bddf139bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:27.599492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc028a3-3666-49c9-9868-ad7bddf139bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:27.600661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc028a3-3666-49c9-9868-ad7bddf139bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/domains/1d43be16e86b421582f159c68798703b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:27.602561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc028a3-3666-49c9-9868-ad7bddf139bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1d43be16e86b421582f159c68798703b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:27.604640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc028a3-3666-49c9-9868-ad7bddf139bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:27.648953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fcc028a3-3666-49c9-9868-ad7bddf139bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1d43be16e86b421582f159c68798703b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.650280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fcc028a3-3666-49c9-9868-ad7bddf139bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1d43be16e86b421582f159c68798703b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.699343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fcc028a3-3666-49c9-9868-ad7bddf139bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1d43be16e86b421582f159c68798703b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.700776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fcc028a3-3666-49c9-9868-ad7bddf139bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1d43be16e86b421582f159c68798703b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.705008 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2540/5040] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:19:27 2022] PATCH /identity/v3/domains/1d43be16e86b421582f159c68798703b => generated 278 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:27.710382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269060c-2a3e-47bc-80d9-54e00ebae79b tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:27.713088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2269060c-2a3e-47bc-80d9-54e00ebae79b tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:27.734820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269060c-2a3e-47bc-80d9-54e00ebae79b tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:27.808075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:27.809080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:27.809373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:27.809632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/domains/1d43be16e86b421582f159c68798703b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:27.824931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1d43be16e86b421582f159c68798703b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:27.826583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:27.865303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1d43be16e86b421582f159c68798703b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.870088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:27.886068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1d43be16e86b421582f159c68798703b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.947235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d43be16e86b421582f159c68798703b', 'request_id': 'req-03db4ca1-b05d-42cf-a6bb-f9d803681010'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.954947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d43be16e86b421582f159c68798703b', 'request_id': 'req-03db4ca1-b05d-42cf-a6bb-f9d803681010'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.969031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d43be16e86b421582f159c68798703b', 'request_id': 'req-03db4ca1-b05d-42cf-a6bb-f9d803681010'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.986451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] The token cache is being invalidate because project 1d43be16e86b421582f159c68798703b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:27.986750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.987611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.997254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1d43be16e86b421582f159c68798703b', 'request_id': 'req-03db4ca1-b05d-42cf-a6bb-f9d803681010'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.998019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1d43be16e86b421582f159c68798703b', 'request_id': 'req-03db4ca1-b05d-42cf-a6bb-f9d803681010'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:27.998793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1d43be16e86b421582f159c68798703b', 'request_id': 'req-03db4ca1-b05d-42cf-a6bb-f9d803681010'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:28.010323 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2501/5041] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:19:27 2022] DELETE /identity/v3/domains/1d43be16e86b421582f159c68798703b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:28.017498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc028a3-3666-49c9-9868-ad7bddf139bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:28.019593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fcc028a3-3666-49c9-9868-ad7bddf139bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:28.043254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc028a3-3666-49c9-9868-ad7bddf139bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:28.171659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7691b-c0d4-4990-a728-87f96662ad34 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:28.172756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7691b-c0d4-4990-a728-87f96662ad34 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:28.173138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7691b-c0d4-4990-a728-87f96662ad34 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:28.173936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7691b-c0d4-4990-a728-87f96662ad34 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:28.177236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7691b-c0d4-4990-a728-87f96662ad34 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:28.179598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7691b-c0d4-4990-a728-87f96662ad34 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:28.287330 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2541/5042] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:28 2022] POST /identity/v3/projects => generated 378 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:28.291221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:28.293163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:28.332842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db4ca1-b05d-42cf-a6bb-f9d803681010 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:28.485929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0333ad-3b30-46dc-aa33-65672af1042e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:28.499563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0333ad-3b30-46dc-aa33-65672af1042e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:28.501059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7691b-c0d4-4990-a728-87f96662ad34 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:28.503555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e2f7691b-c0d4-4990-a728-87f96662ad34 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:28.512798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0333ad-3b30-46dc-aa33-65672af1042e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:28.514942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0333ad-3b30-46dc-aa33-65672af1042e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/7bbca92b9c0d451cb806471d54900fc3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:28.517742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0333ad-3b30-46dc-aa33-65672af1042e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:get_project(project_id=7bbca92b9c0d451cb806471d54900fc3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:28.526457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0333ad-3b30-46dc-aa33-65672af1042e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:28.536022 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2502/5043] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:19:28 2022] GET /identity/v3/projects/7bbca92b9c0d451cb806471d54900fc3 => generated 378 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:28.539862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0333ad-3b30-46dc-aa33-65672af1042e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:28.571192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0333ad-3b30-46dc-aa33-65672af1042e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:28.596096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055b2fc-a751-4fac-81aa-a590303ec214 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:28.596096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055b2fc-a751-4fac-81aa-a590303ec214 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:28.596096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055b2fc-a751-4fac-81aa-a590303ec214 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:28.596498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055b2fc-a751-4fac-81aa-a590303ec214 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:28.596498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055b2fc-a751-4fac-81aa-a590303ec214 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:28.596498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055b2fc-a751-4fac-81aa-a590303ec214 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:28.646737 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2503/5044] 10.222.0.43 () {58 vars in 1130 bytes} [Sat Jul 2 21:19:28 2022] GET /identity/v3/projects => generated 6565 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:19:28.648123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055b2fc-a751-4fac-81aa-a590303ec214 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:28.666334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055b2fc-a751-4fac-81aa-a590303ec214 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:28.682719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac403fb2-fa77-4653-bbff-caefede073d6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:28.684177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac403fb2-fa77-4653-bbff-caefede073d6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:28.684687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac403fb2-fa77-4653-bbff-caefede073d6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:28.685049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac403fb2-fa77-4653-bbff-caefede073d6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/7bbca92b9c0d451cb806471d54900fc3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:28.686980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac403fb2-fa77-4653-bbff-caefede073d6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7bbca92b9c0d451cb806471d54900fc3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:28.690493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac403fb2-fa77-4653-bbff-caefede073d6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:28.721568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7691b-c0d4-4990-a728-87f96662ad34 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:28.734708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804d77d-ec1c-429b-8c05-51d39376d795 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:28.735701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804d77d-ec1c-429b-8c05-51d39376d795 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:28.736281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804d77d-ec1c-429b-8c05-51d39376d795 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:28.736793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804d77d-ec1c-429b-8c05-51d39376d795 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:28.739518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d804d77d-ec1c-429b-8c05-51d39376d795 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:28.773902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804d77d-ec1c-429b-8c05-51d39376d795 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:28.778700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804d77d-ec1c-429b-8c05-51d39376d795 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:28.791004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:28.792408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ac403fb2-fa77-4653-bbff-caefede073d6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bbca92b9c0d451cb806471d54900fc3', 'request_id': 'req-ac403fb2-fa77-4653-bbff-caefede073d6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:28.794898 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2542/5045] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:19:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:19:28.804398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ac403fb2-fa77-4653-bbff-caefede073d6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bbca92b9c0d451cb806471d54900fc3', 'request_id': 'req-ac403fb2-fa77-4653-bbff-caefede073d6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:28.819887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ac403fb2-fa77-4653-bbff-caefede073d6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bbca92b9c0d451cb806471d54900fc3', 'request_id': 'req-ac403fb2-fa77-4653-bbff-caefede073d6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:28.845649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ac403fb2-fa77-4653-bbff-caefede073d6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] The token cache is being invalidate because project 7bbca92b9c0d451cb806471d54900fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:28.846173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ac403fb2-fa77-4653-bbff-caefede073d6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:28.846929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ac403fb2-fa77-4653-bbff-caefede073d6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:28.868139 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2504/5046] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:28 2022] DELETE /identity/v3/projects/7bbca92b9c0d451cb806471d54900fc3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:28.869441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804d77d-ec1c-429b-8c05-51d39376d795 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:28.900179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804d77d-ec1c-429b-8c05-51d39376d795 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:28.975454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:29.039744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187138f-c83b-4092-b6a0-fa30831f12e7 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:29.040435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187138f-c83b-4092-b6a0-fa30831f12e7 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:29.040947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187138f-c83b-4092-b6a0-fa30831f12e7 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:29.041234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187138f-c83b-4092-b6a0-fa30831f12e7 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:29.046045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187138f-c83b-4092-b6a0-fa30831f12e7 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:29.048173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187138f-c83b-4092-b6a0-fa30831f12e7 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:29.110547 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2543/5047] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:19:28 2022] POST /identity/v3/projects => generated 346 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:29.114866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac403fb2-fa77-4653-bbff-caefede073d6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:29.116743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ac403fb2-fa77-4653-bbff-caefede073d6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:29.136322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac403fb2-fa77-4653-bbff-caefede073d6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:29.271839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022232c0-a836-46aa-a62e-5f54da7a9b83 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:29.273620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022232c0-a836-46aa-a62e-5f54da7a9b83 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:29.299530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022232c0-a836-46aa-a62e-5f54da7a9b83 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:29.299823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022232c0-a836-46aa-a62e-5f54da7a9b83 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/000f5b36cf1945928d5cbc6efda4d823` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:29.303223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022232c0-a836-46aa-a62e-5f54da7a9b83 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:update_project(project_id=000f5b36cf1945928d5cbc6efda4d823)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:29.304407 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-022232c0-a836-46aa-a62e-5f54da7a9b83 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:19:29.304407 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:19:29.304407 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:19:29.305775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022232c0-a836-46aa-a62e-5f54da7a9b83 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:29.412512 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2505/5048] 10.222.0.43 () {60 vars in 1251 bytes} [Sat Jul 2 21:19:29 2022] PATCH /identity/v3/projects/000f5b36cf1945928d5cbc6efda4d823 => generated 361 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:29.414372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187138f-c83b-4092-b6a0-fa30831f12e7 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:29.438329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187138f-c83b-4092-b6a0-fa30831f12e7 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:29.457151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971773e-941e-48a0-8485-9a3afdac18a3 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:29.458153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971773e-941e-48a0-8485-9a3afdac18a3 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:29.458440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971773e-941e-48a0-8485-9a3afdac18a3 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:29.458725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971773e-941e-48a0-8485-9a3afdac18a3 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/000f5b36cf1945928d5cbc6efda4d823` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:29.498659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971773e-941e-48a0-8485-9a3afdac18a3 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:get_project(project_id=000f5b36cf1945928d5cbc6efda4d823)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:29.506954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971773e-941e-48a0-8485-9a3afdac18a3 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:29.519032 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2544/5049] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:19:29 2022] GET /identity/v3/projects/000f5b36cf1945928d5cbc6efda4d823 => generated 348 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:29.520973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022232c0-a836-46aa-a62e-5f54da7a9b83 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:29.545048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022232c0-a836-46aa-a62e-5f54da7a9b83 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:29.562887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63b043-65a4-4887-907e-0ed2d9651e8e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:29.563677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63b043-65a4-4887-907e-0ed2d9651e8e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:29.563961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63b043-65a4-4887-907e-0ed2d9651e8e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:29.564308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63b043-65a4-4887-907e-0ed2d9651e8e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/000f5b36cf1945928d5cbc6efda4d823` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:29.569444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63b043-65a4-4887-907e-0ed2d9651e8e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:delete_project(project_id=000f5b36cf1945928d5cbc6efda4d823)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:29.572186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63b043-65a4-4887-907e-0ed2d9651e8e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:29.737277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5d63b043-65a4-4887-907e-0ed2d9651e8e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000f5b36cf1945928d5cbc6efda4d823', 'request_id': 'req-5d63b043-65a4-4887-907e-0ed2d9651e8e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:29.755647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5d63b043-65a4-4887-907e-0ed2d9651e8e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000f5b36cf1945928d5cbc6efda4d823', 'request_id': 'req-5d63b043-65a4-4887-907e-0ed2d9651e8e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:29.773804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5d63b043-65a4-4887-907e-0ed2d9651e8e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000f5b36cf1945928d5cbc6efda4d823', 'request_id': 'req-5d63b043-65a4-4887-907e-0ed2d9651e8e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:29.808449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5d63b043-65a4-4887-907e-0ed2d9651e8e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] The token cache is being invalidate because project 000f5b36cf1945928d5cbc6efda4d823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:29.808754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5d63b043-65a4-4887-907e-0ed2d9651e8e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:29.809480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5d63b043-65a4-4887-907e-0ed2d9651e8e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:29.811981 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2506/5050] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:29 2022] DELETE /identity/v3/projects/000f5b36cf1945928d5cbc6efda4d823 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:29.818088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971773e-941e-48a0-8485-9a3afdac18a3 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:29.821387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1971773e-941e-48a0-8485-9a3afdac18a3 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:29.842945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971773e-941e-48a0-8485-9a3afdac18a3 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:29.980651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa5804-81f7-424e-a6b8-47d8ee7b4046 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:29.981794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa5804-81f7-424e-a6b8-47d8ee7b4046 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:29.983178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa5804-81f7-424e-a6b8-47d8ee7b4046 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:29.983843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa5804-81f7-424e-a6b8-47d8ee7b4046 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:29.984808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa5804-81f7-424e-a6b8-47d8ee7b4046 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:29.987053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa5804-81f7-424e-a6b8-47d8ee7b4046 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:30.044646 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2545/5051] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:29 2022] POST /identity/v3/projects => generated 360 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:30.046480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63b043-65a4-4887-907e-0ed2d9651e8e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:30.062681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63b043-65a4-4887-907e-0ed2d9651e8e tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:30.144308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:30.196092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4da8b-00d0-445f-a691-c4ed4e32560a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:30.197075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4da8b-00d0-445f-a691-c4ed4e32560a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:30.197509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4da8b-00d0-445f-a691-c4ed4e32560a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:30.197842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4da8b-00d0-445f-a691-c4ed4e32560a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/5b6e105c53714d6892d7f91def1964b2` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:30.200586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4da8b-00d0-445f-a691-c4ed4e32560a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:update_project(project_id=5b6e105c53714d6892d7f91def1964b2)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:30.202885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4da8b-00d0-445f-a691-c4ed4e32560a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:30.298103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa5804-81f7-424e-a6b8-47d8ee7b4046 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:30.309116 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2507/5052] 10.222.0.43 () {60 vars in 1251 bytes} [Sat Jul 2 21:19:30 2022] PATCH /identity/v3/projects/5b6e105c53714d6892d7f91def1964b2 => generated 372 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:19:30.314916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa5804-81f7-424e-a6b8-47d8ee7b4046 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:30.330089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae4c27-f07c-44fa-84f2-fdd5be39faac tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:30.331047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae4c27-f07c-44fa-84f2-fdd5be39faac tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:30.331354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae4c27-f07c-44fa-84f2-fdd5be39faac tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:30.331790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae4c27-f07c-44fa-84f2-fdd5be39faac tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/5b6e105c53714d6892d7f91def1964b2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:30.346024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae4c27-f07c-44fa-84f2-fdd5be39faac tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:get_project(project_id=5b6e105c53714d6892d7f91def1964b2)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:30.349020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae4c27-f07c-44fa-84f2-fdd5be39faac tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:30.352459 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2546/5053] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:19:30 2022] GET /identity/v3/projects/5b6e105c53714d6892d7f91def1964b2 => generated 359 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:19:30.356918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4da8b-00d0-445f-a691-c4ed4e32560a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:30.370893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4da8b-00d0-445f-a691-c4ed4e32560a tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:30.382984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429d0e3-ab01-4641-a59b-d411c9f4537c tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:30.384474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429d0e3-ab01-4641-a59b-d411c9f4537c tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:30.384923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429d0e3-ab01-4641-a59b-d411c9f4537c tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:30.385342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429d0e3-ab01-4641-a59b-d411c9f4537c tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/5b6e105c53714d6892d7f91def1964b2` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:30.386965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429d0e3-ab01-4641-a59b-d411c9f4537c tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5b6e105c53714d6892d7f91def1964b2)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:30.390302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429d0e3-ab01-4641-a59b-d411c9f4537c tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:30.503865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7429d0e3-ab01-4641-a59b-d411c9f4537c tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b6e105c53714d6892d7f91def1964b2', 'request_id': 'req-7429d0e3-ab01-4641-a59b-d411c9f4537c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:30.530468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7429d0e3-ab01-4641-a59b-d411c9f4537c tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b6e105c53714d6892d7f91def1964b2', 'request_id': 'req-7429d0e3-ab01-4641-a59b-d411c9f4537c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:30.551955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7429d0e3-ab01-4641-a59b-d411c9f4537c tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b6e105c53714d6892d7f91def1964b2', 'request_id': 'req-7429d0e3-ab01-4641-a59b-d411c9f4537c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:30.603238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7429d0e3-ab01-4641-a59b-d411c9f4537c tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] The token cache is being invalidate because project 5b6e105c53714d6892d7f91def1964b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:30.603238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7429d0e3-ab01-4641-a59b-d411c9f4537c tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:30.603238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7429d0e3-ab01-4641-a59b-d411c9f4537c tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:30.603238 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2508/5054] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:30 2022] DELETE /identity/v3/projects/5b6e105c53714d6892d7f91def1964b2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:30.604447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae4c27-f07c-44fa-84f2-fdd5be39faac tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:30.606484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e1ae4c27-f07c-44fa-84f2-fdd5be39faac tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:30.647656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae4c27-f07c-44fa-84f2-fdd5be39faac tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:30.857000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dbed0-d83a-44bf-824c-e9e46cf63c10 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:30.857845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dbed0-d83a-44bf-824c-e9e46cf63c10 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:30.858222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dbed0-d83a-44bf-824c-e9e46cf63c10 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:30.860660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dbed0-d83a-44bf-824c-e9e46cf63c10 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:30.863127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97dbed0-d83a-44bf-824c-e9e46cf63c10 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:30.867159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97dbed0-d83a-44bf-824c-e9e46cf63c10 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:30.922322 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2547/5055] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:30 2022] POST /identity/v3/projects => generated 354 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:30.923369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429d0e3-ab01-4641-a59b-d411c9f4537c tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:30.937321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429d0e3-ab01-4641-a59b-d411c9f4537c tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:31.029832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a4b91-1d1c-481b-9b4f-89e3bb81fb27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:31.031945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a4b91-1d1c-481b-9b4f-89e3bb81fb27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:31.032370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a4b91-1d1c-481b-9b4f-89e3bb81fb27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:31.032921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a4b91-1d1c-481b-9b4f-89e3bb81fb27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/3f8cf3b0334149569a2c25a50beafb8c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:31.034875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a4b91-1d1c-481b-9b4f-89e3bb81fb27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:update_project(project_id=3f8cf3b0334149569a2c25a50beafb8c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:31.038967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a4b91-1d1c-481b-9b4f-89e3bb81fb27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:31.150934 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2509/5056] 10.222.0.43 () {60 vars in 1251 bytes} [Sat Jul 2 21:19:30 2022] PATCH /identity/v3/projects/3f8cf3b0334149569a2c25a50beafb8c => generated 367 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:31.154400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dbed0-d83a-44bf-824c-e9e46cf63c10 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:31.161711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:31.172181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dbed0-d83a-44bf-824c-e9e46cf63c10 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:31.198090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f2496-3769-4003-b19c-869333457ad6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:31.199029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f2496-3769-4003-b19c-869333457ad6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:31.199307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f2496-3769-4003-b19c-869333457ad6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:31.199581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f2496-3769-4003-b19c-869333457ad6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/3f8cf3b0334149569a2c25a50beafb8c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:31.214184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f2496-3769-4003-b19c-869333457ad6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:get_project(project_id=3f8cf3b0334149569a2c25a50beafb8c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:31.216470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f2496-3769-4003-b19c-869333457ad6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:31.218363 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2548/5057] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:19:31 2022] GET /identity/v3/projects/3f8cf3b0334149569a2c25a50beafb8c => generated 354 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:31.222883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a4b91-1d1c-481b-9b4f-89e3bb81fb27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:31.229706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:31.249566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a4b91-1d1c-481b-9b4f-89e3bb81fb27 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:31.273664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e0f88-bd04-45aa-ba55-48ff6aa3c694 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:31.274577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e0f88-bd04-45aa-ba55-48ff6aa3c694 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:31.274862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e0f88-bd04-45aa-ba55-48ff6aa3c694 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:31.275143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e0f88-bd04-45aa-ba55-48ff6aa3c694 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/projects/3f8cf3b0334149569a2c25a50beafb8c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:31.280736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e0f88-bd04-45aa-ba55-48ff6aa3c694 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3f8cf3b0334149569a2c25a50beafb8c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:31.285682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e0f88-bd04-45aa-ba55-48ff6aa3c694 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:31.402619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-686e0f88-bd04-45aa-ba55-48ff6aa3c694 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f8cf3b0334149569a2c25a50beafb8c', 'request_id': 'req-686e0f88-bd04-45aa-ba55-48ff6aa3c694'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:31.416177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-686e0f88-bd04-45aa-ba55-48ff6aa3c694 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f8cf3b0334149569a2c25a50beafb8c', 'request_id': 'req-686e0f88-bd04-45aa-ba55-48ff6aa3c694'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:31.437342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-686e0f88-bd04-45aa-ba55-48ff6aa3c694 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f8cf3b0334149569a2c25a50beafb8c', 'request_id': 'req-686e0f88-bd04-45aa-ba55-48ff6aa3c694'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:31.461185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-686e0f88-bd04-45aa-ba55-48ff6aa3c694 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] The token cache is being invalidate because project 3f8cf3b0334149569a2c25a50beafb8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:31.461504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-686e0f88-bd04-45aa-ba55-48ff6aa3c694 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:31.462290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-686e0f88-bd04-45aa-ba55-48ff6aa3c694 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:31.468130 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2510/5058] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:31 2022] DELETE /identity/v3/projects/3f8cf3b0334149569a2c25a50beafb8c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:31.469354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f2496-3769-4003-b19c-869333457ad6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:31.471531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e82f2496-3769-4003-b19c-869333457ad6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:31.485882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f2496-3769-4003-b19c-869333457ad6 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:31.589944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e4023-a8a6-415e-84fe-d05f4b02c0bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:31.591368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e4023-a8a6-415e-84fe-d05f4b02c0bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:31.593246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e4023-a8a6-415e-84fe-d05f4b02c0bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:31.593594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e4023-a8a6-415e-84fe-d05f4b02c0bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/domains/1d43be16e86b421582f159c68798703b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:31.609981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e4023-a8a6-415e-84fe-d05f4b02c0bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 21:19:31.642074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-eb1e4023-a8a6-415e-84fe-d05f4b02c0bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Could not find domain: 1d43be16e86b421582f159c68798703b.: keystone.exception.DomainNotFound: Could not find domain: 1d43be16e86b421582f159c68798703b. Jul 02 21:19:31.642074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:19:31.642074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 21:19:31.642074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 21:19:31.642074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:19:31.642074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:19:31.642074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:19:31.642074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:19:31.642074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1d43be16e86b421582f159c68798703b. Jul 02 21:19:31.642074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:19:31.642074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:19:31.642074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:19:31.642074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:19:31.642074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:19:31.642074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:19:31.642074 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:19:31.643254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:19:31.643254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:19:31.643254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:19:31.643254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:19:31.643254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:19:31.643254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:19:31.643254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:19:31.643254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 02 21:19:31.643254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 02 21:19:31.643254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 21:19:31.643254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 21:19:31.643254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 21:19:31.643254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 21:19:31.643254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:19:31.643254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:19:31.643254 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:19:31.644325 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:19:31.644325 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:19:31.644325 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:19:31.644325 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:19:31.644325 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 21:19:31.644325 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:19:31.644325 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:19:31.644325 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:19:31.644325 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:19:31.644325 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:19:31.644325 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:19:31.644325 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:19:31.644325 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:19:31.644325 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 21:19:31.644325 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 21:19:31.644325 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1d43be16e86b421582f159c68798703b. Jul 02 21:19:31.644325 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:19:31.649832 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2549/5059] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:19:31 2022] PATCH /identity/v3/domains/1d43be16e86b421582f159c68798703b => generated 112 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:19:31.653627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e0f88-bd04-45aa-ba55-48ff6aa3c694 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:31.668119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e0f88-bd04-45aa-ba55-48ff6aa3c694 tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:31.677576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9f804-331c-43b6-843a-bf71dae8188d tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae284e5883ff46b5be84733d282e04d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4825febfd8b6492299871e8c49ec27c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:31.681121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9f804-331c-43b6-843a-bf71dae8188d tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:31.683194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9f804-331c-43b6-843a-bf71dae8188d tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:31.683591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9f804-331c-43b6-843a-bf71dae8188d tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] PATH_INFO: `/v3/domains/8b26380217ca4d758a9cd26fa322e06f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:31.694222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9f804-331c-43b6-843a-bf71dae8188d tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 21:19:31.706610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-a9d9f804-331c-43b6-843a-bf71dae8188d tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Could not find domain: 8b26380217ca4d758a9cd26fa322e06f.: keystone.exception.DomainNotFound: Could not find domain: 8b26380217ca4d758a9cd26fa322e06f. Jul 02 21:19:31.706610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:19:31.706610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 21:19:31.706610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 21:19:31.706610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:19:31.706610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:19:31.706610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:19:31.706610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:19:31.706610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8b26380217ca4d758a9cd26fa322e06f. Jul 02 21:19:31.706610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:19:31.706610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:19:31.706610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:19:31.706610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:19:31.706610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:19:31.706610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:19:31.706610 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:19:31.707607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:19:31.707607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:19:31.707607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:19:31.707607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:19:31.707607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:19:31.707607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:19:31.707607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:19:31.707607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 02 21:19:31.707607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 02 21:19:31.707607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 21:19:31.707607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 21:19:31.707607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 21:19:31.707607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 21:19:31.707607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:19:31.707607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:19:31.707607 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:19:31.708503 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:19:31.708503 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:19:31.708503 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:19:31.708503 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:19:31.708503 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 21:19:31.708503 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:19:31.708503 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:19:31.708503 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:19:31.708503 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:19:31.708503 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:19:31.708503 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:19:31.708503 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:19:31.708503 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:19:31.708503 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 21:19:31.708503 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 21:19:31.708503 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8b26380217ca4d758a9cd26fa322e06f. Jul 02 21:19:31.708503 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:19:31.711522 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2511/5060] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:19:31 2022] PATCH /identity/v3/domains/8b26380217ca4d758a9cd26fa322e06f => generated 112 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 02 21:19:31.715703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e4023-a8a6-415e-84fe-d05f4b02c0bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:31.717964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-eb1e4023-a8a6-415e-84fe-d05f4b02c0bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:31.831166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e4023-a8a6-415e-84fe-d05f4b02c0bd tempest-ProjectsTestJSON-1502139010 tempest-ProjectsTestJSON-1502139010-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:31.841760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3506e-09bf-4724-b7e3-9d72d443db2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:31.844497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3506e-09bf-4724-b7e3-9d72d443db2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:31.845195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3506e-09bf-4724-b7e3-9d72d443db2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:31.846628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3506e-09bf-4724-b7e3-9d72d443db2c admin admin] PATH_INFO: `/v3/users/edd9c4ad804d49dc98bb3f50f6f88377` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:31.848216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3506e-09bf-4724-b7e3-9d72d443db2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd9c4ad804d49dc98bb3f50f6f88377)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:31.854475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3506e-09bf-4724-b7e3-9d72d443db2c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:31.960272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-97f3506e-09bf-4724-b7e3-9d72d443db2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd9c4ad804d49dc98bb3f50f6f88377'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:31.977544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-97f3506e-09bf-4724-b7e3-9d72d443db2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd9c4ad804d49dc98bb3f50f6f88377'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:31.978392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-97f3506e-09bf-4724-b7e3-9d72d443db2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd9c4ad804d49dc98bb3f50f6f88377'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:31.979202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-97f3506e-09bf-4724-b7e3-9d72d443db2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd9c4ad804d49dc98bb3f50f6f88377'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:31.991393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-97f3506e-09bf-4724-b7e3-9d72d443db2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd9c4ad804d49dc98bb3f50f6f88377'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:32.019128 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2550/5061] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:19:31 2022] DELETE /identity/v3/users/edd9c4ad804d49dc98bb3f50f6f88377 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:32.023523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c2942-a57e-41c1-b096-cf4a3346a0e1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:32.024063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c2942-a57e-41c1-b096-cf4a3346a0e1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:32.024783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c2942-a57e-41c1-b096-cf4a3346a0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:32.066206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d46c2942-a57e-41c1-b096-cf4a3346a0e1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:32.068413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d46c2942-a57e-41c1-b096-cf4a3346a0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:32.185743 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2512/5062] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:32.205105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3506e-09bf-4724-b7e3-9d72d443db2c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:32.206744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-97f3506e-09bf-4724-b7e3-9d72d443db2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:32.219563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:32.291581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3506e-09bf-4724-b7e3-9d72d443db2c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:32.296970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed564a22-9b0a-4e87-8959-786bf87c1da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:32.298228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed564a22-9b0a-4e87-8959-786bf87c1da8 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:32.298876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed564a22-9b0a-4e87-8959-786bf87c1da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:32.299222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed564a22-9b0a-4e87-8959-786bf87c1da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:32.314353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed564a22-9b0a-4e87-8959-786bf87c1da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:32.316187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed564a22-9b0a-4e87-8959-786bf87c1da8 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:32.330071 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2551/5063] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:19:33.337499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c2942-a57e-41c1-b096-cf4a3346a0e1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:33.339098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d46c2942-a57e-41c1-b096-cf4a3346a0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:33.351636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c2942-a57e-41c1-b096-cf4a3346a0e1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:33.356421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c4784-a7fe-4032-bc9b-13dc1b214428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:33.357335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c4784-a7fe-4032-bc9b-13dc1b214428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:33.357663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c4784-a7fe-4032-bc9b-13dc1b214428 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:33.357882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c4784-a7fe-4032-bc9b-13dc1b214428 admin admin] PATH_INFO: `/v3/projects/aa564fad6b9f41b3bbf3f221300a50cd` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:33.359094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c4784-a7fe-4032-bc9b-13dc1b214428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa564fad6b9f41b3bbf3f221300a50cd)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:33.361040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c4784-a7fe-4032-bc9b-13dc1b214428 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:33.430256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9c8c4784-a7fe-4032-bc9b-13dc1b214428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa564fad6b9f41b3bbf3f221300a50cd', 'request_id': 'req-9c8c4784-a7fe-4032-bc9b-13dc1b214428'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:33.439383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9c8c4784-a7fe-4032-bc9b-13dc1b214428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa564fad6b9f41b3bbf3f221300a50cd', 'request_id': 'req-9c8c4784-a7fe-4032-bc9b-13dc1b214428'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:33.448933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9c8c4784-a7fe-4032-bc9b-13dc1b214428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa564fad6b9f41b3bbf3f221300a50cd', 'request_id': 'req-9c8c4784-a7fe-4032-bc9b-13dc1b214428'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:33.461263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:33.490949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9c8c4784-a7fe-4032-bc9b-13dc1b214428 admin admin] The token cache is being invalidate because project aa564fad6b9f41b3bbf3f221300a50cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:33.493331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9c8c4784-a7fe-4032-bc9b-13dc1b214428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:33.495246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9c8c4784-a7fe-4032-bc9b-13dc1b214428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:33.499725 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2513/5064] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:33 2022] DELETE /identity/v3/projects/aa564fad6b9f41b3bbf3f221300a50cd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:33.504308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed564a22-9b0a-4e87-8959-786bf87c1da8 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:33.521440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed564a22-9b0a-4e87-8959-786bf87c1da8 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:33.597174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28809d34-19f5-4732-8774-0238e902b134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:33.599111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28809d34-19f5-4732-8774-0238e902b134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:33.600768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28809d34-19f5-4732-8774-0238e902b134 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:33.601838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28809d34-19f5-4732-8774-0238e902b134 admin admin] PATH_INFO: `/v3/users/ae284e5883ff46b5be84733d282e04d6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:33.603536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28809d34-19f5-4732-8774-0238e902b134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae284e5883ff46b5be84733d282e04d6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:33.607670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28809d34-19f5-4732-8774-0238e902b134 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:33.749074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-28809d34-19f5-4732-8774-0238e902b134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae284e5883ff46b5be84733d282e04d6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:33.775963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-28809d34-19f5-4732-8774-0238e902b134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae284e5883ff46b5be84733d282e04d6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:33.776977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-28809d34-19f5-4732-8774-0238e902b134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae284e5883ff46b5be84733d282e04d6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:33.779068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-28809d34-19f5-4732-8774-0238e902b134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae284e5883ff46b5be84733d282e04d6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:33.827431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-28809d34-19f5-4732-8774-0238e902b134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae284e5883ff46b5be84733d282e04d6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:33.890320 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2552/5065] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:19:33 2022] DELETE /identity/v3/users/ae284e5883ff46b5be84733d282e04d6 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:35.402801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c4784-a7fe-4032-bc9b-13dc1b214428 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:35.406809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9c8c4784-a7fe-4032-bc9b-13dc1b214428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:35.427058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c4784-a7fe-4032-bc9b-13dc1b214428 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:35.557982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8a0ea-6e66-4ab8-858f-a01c03d501ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:35.559028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8a0ea-6e66-4ab8-858f-a01c03d501ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:35.559283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8a0ea-6e66-4ab8-858f-a01c03d501ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:35.559662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8a0ea-6e66-4ab8-858f-a01c03d501ff admin admin] PATH_INFO: `/v3/projects/4825febfd8b6492299871e8c49ec27c6` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:35.561231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8a0ea-6e66-4ab8-858f-a01c03d501ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4825febfd8b6492299871e8c49ec27c6)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:35.563593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8a0ea-6e66-4ab8-858f-a01c03d501ff admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:35.647061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-18a8a0ea-6e66-4ab8-858f-a01c03d501ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4825febfd8b6492299871e8c49ec27c6', 'request_id': 'req-18a8a0ea-6e66-4ab8-858f-a01c03d501ff'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:35.657309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-18a8a0ea-6e66-4ab8-858f-a01c03d501ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4825febfd8b6492299871e8c49ec27c6', 'request_id': 'req-18a8a0ea-6e66-4ab8-858f-a01c03d501ff'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:35.664779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-18a8a0ea-6e66-4ab8-858f-a01c03d501ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4825febfd8b6492299871e8c49ec27c6', 'request_id': 'req-18a8a0ea-6e66-4ab8-858f-a01c03d501ff'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:35.693046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-18a8a0ea-6e66-4ab8-858f-a01c03d501ff admin admin] The token cache is being invalidate because project 4825febfd8b6492299871e8c49ec27c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:35.693885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-18a8a0ea-6e66-4ab8-858f-a01c03d501ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:35.694762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-18a8a0ea-6e66-4ab8-858f-a01c03d501ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:35.698199 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2514/5066] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:35 2022] DELETE /identity/v3/projects/4825febfd8b6492299871e8c49ec27c6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:35.704997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b81bd0-5cd9-4a67-b764-b81b7643789e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:35.705602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b81bd0-5cd9-4a67-b764-b81b7643789e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:35.705602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b81bd0-5cd9-4a67-b764-b81b7643789e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:35.738028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-96b81bd0-5cd9-4a67-b764-b81b7643789e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:35.739559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-96b81bd0-5cd9-4a67-b764-b81b7643789e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:35.775512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:35.832060 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2553/5067] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:35.833636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bfa88-3e34-43d9-bb91-2b2cf9a99a94 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:35.834171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bfa88-3e34-43d9-bb91-2b2cf9a99a94 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:35.834327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bfa88-3e34-43d9-bb91-2b2cf9a99a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:35.861827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-dc0bfa88-3e34-43d9-bb91-2b2cf9a99a94 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:35.863288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dc0bfa88-3e34-43d9-bb91-2b2cf9a99a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:35.887625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b81bd0-5cd9-4a67-b764-b81b7643789e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:35.898848 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2515/5068] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:35.899809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b81bd0-5cd9-4a67-b764-b81b7643789e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:35.905286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69eee6-9fd5-4617-8711-b4ab1f3b8bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:35.905967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69eee6-9fd5-4617-8711-b4ab1f3b8bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:35.906245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69eee6-9fd5-4617-8711-b4ab1f3b8bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:35.906705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69eee6-9fd5-4617-8711-b4ab1f3b8bb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:35.907644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69eee6-9fd5-4617-8711-b4ab1f3b8bb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:19:35.907951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69eee6-9fd5-4617-8711-b4ab1f3b8bb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:35.910007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69eee6-9fd5-4617-8711-b4ab1f3b8bb4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:35.929149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bfa88-3e34-43d9-bb91-2b2cf9a99a94 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:35.935225 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2554/5069] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:35.942030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bfa88-3e34-43d9-bb91-2b2cf9a99a94 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:35.947688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1af728-7e92-468e-912d-3ce3dca8b720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:35.948691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1af728-7e92-468e-912d-3ce3dca8b720 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:35.948971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1af728-7e92-468e-912d-3ce3dca8b720 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:35.949246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1af728-7e92-468e-912d-3ce3dca8b720 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:35.949988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1af728-7e92-468e-912d-3ce3dca8b720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:35.951955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1af728-7e92-468e-912d-3ce3dca8b720 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:35.998862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69eee6-9fd5-4617-8711-b4ab1f3b8bb4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:36.009353 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2516/5070] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:35 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:36.010979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69eee6-9fd5-4617-8711-b4ab1f3b8bb4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:36.147070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de420c-d2ee-4db5-afa1-7a0b99ee4bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:36.147397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de420c-d2ee-4db5-afa1-7a0b99ee4bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:36.148274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de420c-d2ee-4db5-afa1-7a0b99ee4bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:36.148274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de420c-d2ee-4db5-afa1-7a0b99ee4bb8 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:36.148896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de420c-d2ee-4db5-afa1-7a0b99ee4bb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:36.150715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de420c-d2ee-4db5-afa1-7a0b99ee4bb8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:36.239711 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2555/5071] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:19:35 2022] POST /identity/v3/users => generated 284 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:19:36.244643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1af728-7e92-468e-912d-3ce3dca8b720 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:36.274670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1af728-7e92-468e-912d-3ce3dca8b720 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:36.301708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbf970-95c5-43e5-a583-91da1501d355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:36.304314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbf970-95c5-43e5-a583-91da1501d355 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:36.304981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbf970-95c5-43e5-a583-91da1501d355 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:36.305403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbf970-95c5-43e5-a583-91da1501d355 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:36.306595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbf970-95c5-43e5-a583-91da1501d355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:36.308918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbf970-95c5-43e5-a583-91da1501d355 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:36.328273 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2517/5072] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:19:36.332070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de420c-d2ee-4db5-afa1-7a0b99ee4bb8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:36.351060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de420c-d2ee-4db5-afa1-7a0b99ee4bb8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:36.365544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c1b91-23f3-41ea-b69f-714ff36955f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:36.365990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c1b91-23f3-41ea-b69f-714ff36955f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:36.366438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c1b91-23f3-41ea-b69f-714ff36955f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:36.366811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c1b91-23f3-41ea-b69f-714ff36955f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:36.367641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c1b91-23f3-41ea-b69f-714ff36955f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:36.370070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c1b91-23f3-41ea-b69f-714ff36955f5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:36.395628 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2556/5073] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:19:36.400079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbf970-95c5-43e5-a583-91da1501d355 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:36.447598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbf970-95c5-43e5-a583-91da1501d355 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:36.491971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4a0f2-1a13-4d6a-b5fe-5a05161a2b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:36.494724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4a0f2-1a13-4d6a-b5fe-5a05161a2b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:36.499818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4a0f2-1a13-4d6a-b5fe-5a05161a2b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:36.501374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4a0f2-1a13-4d6a-b5fe-5a05161a2b2f admin admin] PATH_INFO: `/v3/projects/15a7f1b89a5a42cea062242ae8eef3ca/users/852035241bce4525bc058b32dbaf16bf/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:36.536586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4a0f2-1a13-4d6a-b5fe-5a05161a2b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a7f1b89a5a42cea062242ae8eef3ca, user_id=852035241bce4525bc058b32dbaf16bf, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:36.541387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4a0f2-1a13-4d6a-b5fe-5a05161a2b2f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:36.593601 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2518/5074] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:19:36 2022] PUT /identity/v3/projects/15a7f1b89a5a42cea062242ae8eef3ca/users/852035241bce4525bc058b32dbaf16bf/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:36.605233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c7a93-a06d-4f01-9c2d-0c2ac976bce4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:36.605477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c7a93-a06d-4f01-9c2d-0c2ac976bce4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:36.605880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c7a93-a06d-4f01-9c2d-0c2ac976bce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:36.688859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-061c7a93-a06d-4f01-9c2d-0c2ac976bce4 None None] MFA Rules not processed for user `852035241bce4525bc058b32dbaf16bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:36.690737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-061c7a93-a06d-4f01-9c2d-0c2ac976bce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:36.920585 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2557/5075] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:36.922034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4a0f2-1a13-4d6a-b5fe-5a05161a2b2f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:36.940287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4a0f2-1a13-4d6a-b5fe-5a05161a2b2f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:36.949217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e8eb3-bb00-4cac-bfd7-761fdb550ff5 tempest-TestApiDiscovery-335522781 tempest-TestApiDiscovery-335522781-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '852035241bce4525bc058b32dbaf16bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a7f1b89a5a42cea062242ae8eef3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:36.950814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e8eb3-bb00-4cac-bfd7-761fdb550ff5 tempest-TestApiDiscovery-335522781 tempest-TestApiDiscovery-335522781-project] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:36.951376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e8eb3-bb00-4cac-bfd7-761fdb550ff5 tempest-TestApiDiscovery-335522781 tempest-TestApiDiscovery-335522781-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:36.951818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e8eb3-bb00-4cac-bfd7-761fdb550ff5 tempest-TestApiDiscovery-335522781 tempest-TestApiDiscovery-335522781-project] PATH_INFO: `/v3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:36.955089 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2519/5076] 10.222.0.43 () {58 vars in 1103 bytes} [Sat Jul 2 21:19:36 2022] GET /identity/v3 => generated 255 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:36.961091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c7a93-a06d-4f01-9c2d-0c2ac976bce4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:36.970297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c7a93-a06d-4f01-9c2d-0c2ac976bce4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:36.975374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45584e-16d0-4df1-811a-7f63c4f81f7a tempest-TestApiDiscovery-335522781 tempest-TestApiDiscovery-335522781-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '852035241bce4525bc058b32dbaf16bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a7f1b89a5a42cea062242ae8eef3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:36.976480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45584e-16d0-4df1-811a-7f63c4f81f7a tempest-TestApiDiscovery-335522781 tempest-TestApiDiscovery-335522781-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:36.976973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45584e-16d0-4df1-811a-7f63c4f81f7a tempest-TestApiDiscovery-335522781 tempest-TestApiDiscovery-335522781-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:36.977467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45584e-16d0-4df1-811a-7f63c4f81f7a tempest-TestApiDiscovery-335522781 tempest-TestApiDiscovery-335522781-project] PATH_INFO: `/v3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:36.985528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e8eb3-bb00-4cac-bfd7-761fdb550ff5 tempest-TestApiDiscovery-335522781 tempest-TestApiDiscovery-335522781-project] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:36.995654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e8eb3-bb00-4cac-bfd7-761fdb550ff5 tempest-TestApiDiscovery-335522781 tempest-TestApiDiscovery-335522781-project] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:36.996159 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2558/5077] 10.222.0.43 () {58 vars in 1103 bytes} [Sat Jul 2 21:19:36 2022] GET /identity/v3 => generated 255 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:37.002463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556edc05-dd55-436d-a7ab-52a7ca615238 tempest-TestApiDiscovery-335522781 tempest-TestApiDiscovery-335522781-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '852035241bce4525bc058b32dbaf16bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a7f1b89a5a42cea062242ae8eef3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:37.004096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556edc05-dd55-436d-a7ab-52a7ca615238 tempest-TestApiDiscovery-335522781 tempest-TestApiDiscovery-335522781-project] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:37.004599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556edc05-dd55-436d-a7ab-52a7ca615238 tempest-TestApiDiscovery-335522781 tempest-TestApiDiscovery-335522781-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:37.005104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556edc05-dd55-436d-a7ab-52a7ca615238 tempest-TestApiDiscovery-335522781 tempest-TestApiDiscovery-335522781-project] PATH_INFO: `/v3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:37.014191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee465a1-95b7-40b8-b72f-212f2aeb5088 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:37.014794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee465a1-95b7-40b8-b72f-212f2aeb5088 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:37.015308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee465a1-95b7-40b8-b72f-212f2aeb5088 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:37.024250 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2559/5079] 10.222.0.43 () {56 vars in 894 bytes} [Sat Jul 2 21:19:37 2022] GET /identity/ => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:19:37.025331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca7aac-6e28-4a65-bea5-533928fa0943 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:37.026385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca7aac-6e28-4a65-bea5-533928fa0943 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:37.026640 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2520/5079] 10.222.0.43 () {58 vars in 1103 bytes} [Sat Jul 2 21:19:36 2022] GET /identity/v3 => generated 255 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:37.027093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca7aac-6e28-4a65-bea5-533928fa0943 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:37.028996 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2560/5080] 10.222.0.43 () {56 vars in 894 bytes} [Sat Jul 2 21:19:37 2022] GET /identity/ => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:19:37.035361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556edc05-dd55-436d-a7ab-52a7ca615238 tempest-TestApiDiscovery-335522781 tempest-TestApiDiscovery-335522781-project] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:37.061775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:37.119810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556edc05-dd55-436d-a7ab-52a7ca615238 tempest-TestApiDiscovery-335522781 tempest-TestApiDiscovery-335522781-project] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:37.130434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382cdce-b918-4681-afe8-57e2cd0261bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:37.131761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382cdce-b918-4681-afe8-57e2cd0261bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:37.132867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382cdce-b918-4681-afe8-57e2cd0261bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:37.133384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382cdce-b918-4681-afe8-57e2cd0261bd admin admin] PATH_INFO: `/v3/users/852035241bce4525bc058b32dbaf16bf` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:37.135495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382cdce-b918-4681-afe8-57e2cd0261bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=852035241bce4525bc058b32dbaf16bf)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:37.138070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382cdce-b918-4681-afe8-57e2cd0261bd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:37.243583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca7aac-6e28-4a65-bea5-533928fa0943 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:37.245766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d9ca7aac-6e28-4a65-bea5-533928fa0943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:37.252887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7382cdce-b918-4681-afe8-57e2cd0261bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852035241bce4525bc058b32dbaf16bf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:37.268326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7382cdce-b918-4681-afe8-57e2cd0261bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852035241bce4525bc058b32dbaf16bf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:37.281405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7382cdce-b918-4681-afe8-57e2cd0261bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852035241bce4525bc058b32dbaf16bf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:37.282495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7382cdce-b918-4681-afe8-57e2cd0261bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852035241bce4525bc058b32dbaf16bf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:37.283924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7382cdce-b918-4681-afe8-57e2cd0261bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852035241bce4525bc058b32dbaf16bf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:37.301421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:37.313431 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2521/5081] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:19:37 2022] DELETE /identity/v3/users/852035241bce4525bc058b32dbaf16bf => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:37.318695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb1c73-b2f5-4415-8d97-75bc9bb95df2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:37.319097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb1c73-b2f5-4415-8d97-75bc9bb95df2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:37.320239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb1c73-b2f5-4415-8d97-75bc9bb95df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:37.360333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2dbb1c73-b2f5-4415-8d97-75bc9bb95df2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:37.363440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2dbb1c73-b2f5-4415-8d97-75bc9bb95df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:37.406272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca7aac-6e28-4a65-bea5-533928fa0943 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:37.497640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930dc9f-c2f2-434a-ba41-52d46d62d8a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:37.499092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930dc9f-c2f2-434a-ba41-52d46d62d8a1 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:37.499391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930dc9f-c2f2-434a-ba41-52d46d62d8a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:37.499670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930dc9f-c2f2-434a-ba41-52d46d62d8a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:37.506547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4930dc9f-c2f2-434a-ba41-52d46d62d8a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:37.541922 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2522/5082] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:37.562359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb1c73-b2f5-4415-8d97-75bc9bb95df2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:37.563751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2dbb1c73-b2f5-4415-8d97-75bc9bb95df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:37.595451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb1c73-b2f5-4415-8d97-75bc9bb95df2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:37.604798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930dc9f-c2f2-434a-ba41-52d46d62d8a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:37.608090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930dc9f-c2f2-434a-ba41-52d46d62d8a1 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:37.608690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4bf50-5a23-4524-93bc-81ba1598cc33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:37.610512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4bf50-5a23-4524-93bc-81ba1598cc33 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:37.612633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4bf50-5a23-4524-93bc-81ba1598cc33 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:37.613046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4bf50-5a23-4524-93bc-81ba1598cc33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:37.632720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4bf50-5a23-4524-93bc-81ba1598cc33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:37.636510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4bf50-5a23-4524-93bc-81ba1598cc33 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:37.648504 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2561/5083] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:19:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:19:37.651219 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2523/5084] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:19:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:19:38.246362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930dc9f-c2f2-434a-ba41-52d46d62d8a1 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:38.248019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4930dc9f-c2f2-434a-ba41-52d46d62d8a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:38.268161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930dc9f-c2f2-434a-ba41-52d46d62d8a1 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:38.276351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fabd5-0f34-4ded-8d38-8ce050a7e82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:38.277280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fabd5-0f34-4ded-8d38-8ce050a7e82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:38.277564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fabd5-0f34-4ded-8d38-8ce050a7e82c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:38.277843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fabd5-0f34-4ded-8d38-8ce050a7e82c admin admin] PATH_INFO: `/v3/projects/15a7f1b89a5a42cea062242ae8eef3ca` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:38.279115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fabd5-0f34-4ded-8d38-8ce050a7e82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a7f1b89a5a42cea062242ae8eef3ca)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:38.281115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fabd5-0f34-4ded-8d38-8ce050a7e82c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:38.343083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f41fabd5-0f34-4ded-8d38-8ce050a7e82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a7f1b89a5a42cea062242ae8eef3ca', 'request_id': 'req-f41fabd5-0f34-4ded-8d38-8ce050a7e82c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:38.356194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f41fabd5-0f34-4ded-8d38-8ce050a7e82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a7f1b89a5a42cea062242ae8eef3ca', 'request_id': 'req-f41fabd5-0f34-4ded-8d38-8ce050a7e82c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:38.364935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f41fabd5-0f34-4ded-8d38-8ce050a7e82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a7f1b89a5a42cea062242ae8eef3ca', 'request_id': 'req-f41fabd5-0f34-4ded-8d38-8ce050a7e82c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:38.380737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f41fabd5-0f34-4ded-8d38-8ce050a7e82c admin admin] The token cache is being invalidate because project 15a7f1b89a5a42cea062242ae8eef3ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:38.381101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f41fabd5-0f34-4ded-8d38-8ce050a7e82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:38.381833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f41fabd5-0f34-4ded-8d38-8ce050a7e82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:38.383911 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2562/5085] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:38 2022] DELETE /identity/v3/projects/15a7f1b89a5a42cea062242ae8eef3ca => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:38.391381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a363bef-b594-422c-a41a-8cb61f6f7f62 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:38.391758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a363bef-b594-422c-a41a-8cb61f6f7f62 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:38.392154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a363bef-b594-422c-a41a-8cb61f6f7f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:38.412657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5a363bef-b594-422c-a41a-8cb61f6f7f62 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:38.414018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5a363bef-b594-422c-a41a-8cb61f6f7f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:38.439973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:38.530881 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2524/5086] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:38.540748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7af672-a8be-4d8d-b59d-deb85b190e78 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:38.541155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7af672-a8be-4d8d-b59d-deb85b190e78 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:38.541758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7af672-a8be-4d8d-b59d-deb85b190e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:38.602525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ad7af672-a8be-4d8d-b59d-deb85b190e78 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:38.603994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ad7af672-a8be-4d8d-b59d-deb85b190e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:38.622504 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2563/5087] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:38.627088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a363bef-b594-422c-a41a-8cb61f6f7f62 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:38.640238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a363bef-b594-422c-a41a-8cb61f6f7f62 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:38.657339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a17fe0-da73-4322-810c-3b8f37afa041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:38.658349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a17fe0-da73-4322-810c-3b8f37afa041 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:38.658596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a17fe0-da73-4322-810c-3b8f37afa041 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:38.658938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a17fe0-da73-4322-810c-3b8f37afa041 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:38.659740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a17fe0-da73-4322-810c-3b8f37afa041 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:19:38.660163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a17fe0-da73-4322-810c-3b8f37afa041 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:38.661882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a17fe0-da73-4322-810c-3b8f37afa041 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:38.704330 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2525/5088] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:38.707314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7af672-a8be-4d8d-b59d-deb85b190e78 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:38.713261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:38.721175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7af672-a8be-4d8d-b59d-deb85b190e78 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:38.730568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc3795-5166-435d-b600-56ccf8f89df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:38.732981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc3795-5166-435d-b600-56ccf8f89df5 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:38.734097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc3795-5166-435d-b600-56ccf8f89df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:38.736421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc3795-5166-435d-b600-56ccf8f89df5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:38.737603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc3795-5166-435d-b600-56ccf8f89df5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:38.739725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc3795-5166-435d-b600-56ccf8f89df5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:38.807091 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2564/5089] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:38 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:38.808102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a17fe0-da73-4322-810c-3b8f37afa041 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:38.828154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a17fe0-da73-4322-810c-3b8f37afa041 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:38.909479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cc604-b9d2-411c-9dee-eb986de63bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:38.910455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cc604-b9d2-411c-9dee-eb986de63bef admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:38.910808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cc604-b9d2-411c-9dee-eb986de63bef admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:38.911150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cc604-b9d2-411c-9dee-eb986de63bef admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:38.912712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511cc604-b9d2-411c-9dee-eb986de63bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:38.915129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511cc604-b9d2-411c-9dee-eb986de63bef admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:38.964225 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2526/5090] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:19:38 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:19:38.964618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc3795-5166-435d-b600-56ccf8f89df5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:38.980312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc3795-5166-435d-b600-56ccf8f89df5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:38.987082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b398514-5cd1-44c9-85ec-3a1a9bc50ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:38.987918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b398514-5cd1-44c9-85ec-3a1a9bc50ccd admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:38.988246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b398514-5cd1-44c9-85ec-3a1a9bc50ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:38.988526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b398514-5cd1-44c9-85ec-3a1a9bc50ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:38.989796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b398514-5cd1-44c9-85ec-3a1a9bc50ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:38.993176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b398514-5cd1-44c9-85ec-3a1a9bc50ccd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:39.008551 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2565/5091] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:19:39.012858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cc604-b9d2-411c-9dee-eb986de63bef admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:39.024318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cc604-b9d2-411c-9dee-eb986de63bef admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:39.030161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171feff4-8d25-4b5c-9569-80b0038239f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:39.030936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171feff4-8d25-4b5c-9569-80b0038239f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:39.031284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171feff4-8d25-4b5c-9569-80b0038239f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:39.031632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171feff4-8d25-4b5c-9569-80b0038239f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:39.032611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171feff4-8d25-4b5c-9569-80b0038239f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:39.034311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171feff4-8d25-4b5c-9569-80b0038239f5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:39.049690 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2527/5092] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:19:39.054518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b398514-5cd1-44c9-85ec-3a1a9bc50ccd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:39.068493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b398514-5cd1-44c9-85ec-3a1a9bc50ccd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:39.073820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77481c6-dc51-4ba3-bb86-1c63ee18bdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:39.074788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77481c6-dc51-4ba3-bb86-1c63ee18bdfd admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:39.075077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77481c6-dc51-4ba3-bb86-1c63ee18bdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:39.075833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77481c6-dc51-4ba3-bb86-1c63ee18bdfd admin admin] PATH_INFO: `/v3/projects/66d034da984f4854aac7bfc91e5e4a11/users/a986bc9be3c64440a007ef9166950caf/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:39.116021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77481c6-dc51-4ba3-bb86-1c63ee18bdfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d034da984f4854aac7bfc91e5e4a11, user_id=a986bc9be3c64440a007ef9166950caf, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:39.119004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77481c6-dc51-4ba3-bb86-1c63ee18bdfd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:39.157027 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2566/5093] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:19:39 2022] PUT /identity/v3/projects/66d034da984f4854aac7bfc91e5e4a11/users/a986bc9be3c64440a007ef9166950caf/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:39.167306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9a21d-dd2e-4300-90f8-a6a6226bad5c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:39.167563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9a21d-dd2e-4300-90f8-a6a6226bad5c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:39.171936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9a21d-dd2e-4300-90f8-a6a6226bad5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:39.203335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9ed9a21d-dd2e-4300-90f8-a6a6226bad5c None None] MFA Rules not processed for user `a986bc9be3c64440a007ef9166950caf`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:39.207885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9ed9a21d-dd2e-4300-90f8-a6a6226bad5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:39.348172 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2528/5094] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:39.349598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77481c6-dc51-4ba3-bb86-1c63ee18bdfd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:39.447552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77481c6-dc51-4ba3-bb86-1c63ee18bdfd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:39.458841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59095c-e252-4693-9ae3-1809c92e6dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:39.459538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59095c-e252-4693-9ae3-1809c92e6dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:39.459827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59095c-e252-4693-9ae3-1809c92e6dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:39.460366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59095c-e252-4693-9ae3-1809c92e6dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:39.461075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59095c-e252-4693-9ae3-1809c92e6dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:39.464944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59095c-e252-4693-9ae3-1809c92e6dd5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:39.508129 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2567/5095] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:39 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:39.514360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9a21d-dd2e-4300-90f8-a6a6226bad5c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:39.541104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9a21d-dd2e-4300-90f8-a6a6226bad5c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:39.571185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:39.675426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4f579-386c-426b-b471-6762e6227199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:39.676863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4f579-386c-426b-b471-6762e6227199 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:39.677306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4f579-386c-426b-b471-6762e6227199 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:39.677743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4f579-386c-426b-b471-6762e6227199 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:39.678850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4f579-386c-426b-b471-6762e6227199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:39.681074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4f579-386c-426b-b471-6762e6227199 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:39.707570 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2529/5096] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:19:39 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:39.711394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59095c-e252-4693-9ae3-1809c92e6dd5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:39.728083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59095c-e252-4693-9ae3-1809c92e6dd5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:39.740000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e97e6-a1dd-4336-990a-39abae887d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:39.740899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e97e6-a1dd-4336-990a-39abae887d33 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:39.741279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e97e6-a1dd-4336-990a-39abae887d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:39.741796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e97e6-a1dd-4336-990a-39abae887d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:39.742999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e97e6-a1dd-4336-990a-39abae887d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:39.744524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e97e6-a1dd-4336-990a-39abae887d33 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:39.771406 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2568/5097] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:19:39.772569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4f579-386c-426b-b471-6762e6227199 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:39.805487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4f579-386c-426b-b471-6762e6227199 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:39.818598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf24b4-2cd7-4e58-a98a-af0df9945fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:39.819925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf24b4-2cd7-4e58-a98a-af0df9945fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:39.821046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf24b4-2cd7-4e58-a98a-af0df9945fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:39.822087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf24b4-2cd7-4e58-a98a-af0df9945fbc admin admin] PATH_INFO: `/v3/projects/e17b8aa32d2f468697f4810909946880/users/b2981cd14b2742ad8c42f900c52434b9/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:39.851158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf24b4-2cd7-4e58-a98a-af0df9945fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17b8aa32d2f468697f4810909946880, user_id=b2981cd14b2742ad8c42f900c52434b9, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:39.855920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf24b4-2cd7-4e58-a98a-af0df9945fbc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:39.876613 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2530/5098] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:19:39 2022] PUT /identity/v3/projects/e17b8aa32d2f468697f4810909946880/users/b2981cd14b2742ad8c42f900c52434b9/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:39.880567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e97e6-a1dd-4336-990a-39abae887d33 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:39.906701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e97e6-a1dd-4336-990a-39abae887d33 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:39.994038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc4ce7-281b-409b-9908-40c717ca4d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:39.994978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc4ce7-281b-409b-9908-40c717ca4d00 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:39.995371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc4ce7-281b-409b-9908-40c717ca4d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:39.995650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc4ce7-281b-409b-9908-40c717ca4d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:39.996591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc4ce7-281b-409b-9908-40c717ca4d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:40.002117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc4ce7-281b-409b-9908-40c717ca4d00 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:40.018223 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2569/5099] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:19:40.022652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf24b4-2cd7-4e58-a98a-af0df9945fbc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:40.040497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf24b4-2cd7-4e58-a98a-af0df9945fbc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:40.050527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce90d8-09a9-43e3-81f9-720e96627abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:40.052289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce90d8-09a9-43e3-81f9-720e96627abf admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:40.052956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce90d8-09a9-43e3-81f9-720e96627abf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:40.053439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce90d8-09a9-43e3-81f9-720e96627abf admin admin] PATH_INFO: `/v3/projects/e17b8aa32d2f468697f4810909946880/users/b2981cd14b2742ad8c42f900c52434b9/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:40.056188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce90d8-09a9-43e3-81f9-720e96627abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17b8aa32d2f468697f4810909946880, user_id=b2981cd14b2742ad8c42f900c52434b9, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:40.059253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce90d8-09a9-43e3-81f9-720e96627abf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:40.103369 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2531/5100] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:19:40 2022] PUT /identity/v3/projects/e17b8aa32d2f468697f4810909946880/users/b2981cd14b2742ad8c42f900c52434b9/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:40.106327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5146ed-90ad-4407-8332-203992334afb None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:40.106980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5146ed-90ad-4407-8332-203992334afb None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:40.107550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5146ed-90ad-4407-8332-203992334afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:40.169304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6b5146ed-90ad-4407-8332-203992334afb None None] MFA Rules not processed for user `b2981cd14b2742ad8c42f900c52434b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:40.171061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6b5146ed-90ad-4407-8332-203992334afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:40.180070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:40.330968 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2570/5101] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:40.348558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce90d8-09a9-43e3-81f9-720e96627abf admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:40.352302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-66ce90d8-09a9-43e3-81f9-720e96627abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:40.433938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce90d8-09a9-43e3-81f9-720e96627abf admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:40.439531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a43b7d-ee11-4115-b953-99e3589c2733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:40.440389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a43b7d-ee11-4115-b953-99e3589c2733 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:40.440670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a43b7d-ee11-4115-b953-99e3589c2733 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:40.440945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a43b7d-ee11-4115-b953-99e3589c2733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:40.593420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a43b7d-ee11-4115-b953-99e3589c2733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:40.599198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a43b7d-ee11-4115-b953-99e3589c2733 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:40.631141 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2532/5102] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:19:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:19:41.434976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5146ed-90ad-4407-8332-203992334afb None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:41.458704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5146ed-90ad-4407-8332-203992334afb None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:41.470581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446df14a-2e38-4692-ae64-95509bfdb00e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:41.471273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446df14a-2e38-4692-ae64-95509bfdb00e service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:41.471553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446df14a-2e38-4692-ae64-95509bfdb00e service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:41.471823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446df14a-2e38-4692-ae64-95509bfdb00e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:41.496656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446df14a-2e38-4692-ae64-95509bfdb00e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:41.498113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446df14a-2e38-4692-ae64-95509bfdb00e service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:41.521473 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2571/5103] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:19:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:19:42.750058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a43b7d-ee11-4115-b953-99e3589c2733 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:42.752015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-01a43b7d-ee11-4115-b953-99e3589c2733 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:42.796489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:42.869232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a43b7d-ee11-4115-b953-99e3589c2733 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:42.877777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bc576-3517-4551-97e4-d96858b72669 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:42.878890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bc576-3517-4551-97e4-d96858b72669 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:42.879397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bc576-3517-4551-97e4-d96858b72669 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:42.879871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bc576-3517-4551-97e4-d96858b72669 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:42.883031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-eb9bc576-3517-4551-97e4-d96858b72669 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:42.911989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9bc576-3517-4551-97e4-d96858b72669 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:42.914057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9bc576-3517-4551-97e4-d96858b72669 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:42.947245 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2533/5104] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:19:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:19:45.294408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446df14a-2e38-4692-ae64-95509bfdb00e service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:45.302824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-446df14a-2e38-4692-ae64-95509bfdb00e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:45.493445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bc576-3517-4551-97e4-d96858b72669 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:45.495747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-eb9bc576-3517-4551-97e4-d96858b72669 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:45.497455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446df14a-2e38-4692-ae64-95509bfdb00e service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:45.506753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42487a33-85f9-4611-843a-881d9869e26c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:45.508068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42487a33-85f9-4611-843a-881d9869e26c service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:45.508390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42487a33-85f9-4611-843a-881d9869e26c service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:45.509106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42487a33-85f9-4611-843a-881d9869e26c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:45.511014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-42487a33-85f9-4611-843a-881d9869e26c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:45.601063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42487a33-85f9-4611-843a-881d9869e26c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:45.603819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42487a33-85f9-4611-843a-881d9869e26c service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:45.651296 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2572/5105] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:19:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:19:45.652980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bc576-3517-4551-97e4-d96858b72669 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:45.663249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd440094-3e3d-4b9b-8e6c-775cde96dcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:45.664176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd440094-3e3d-4b9b-8e6c-775cde96dcd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:45.664453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd440094-3e3d-4b9b-8e6c-775cde96dcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:45.664721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd440094-3e3d-4b9b-8e6c-775cde96dcd3 admin admin] PATH_INFO: `/v3/users/419f3872408c4d8c9a2980d6397d0aea` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:45.668772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd440094-3e3d-4b9b-8e6c-775cde96dcd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=419f3872408c4d8c9a2980d6397d0aea)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:45.670650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd440094-3e3d-4b9b-8e6c-775cde96dcd3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:45.791262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fd440094-3e3d-4b9b-8e6c-775cde96dcd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419f3872408c4d8c9a2980d6397d0aea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:45.809050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fd440094-3e3d-4b9b-8e6c-775cde96dcd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419f3872408c4d8c9a2980d6397d0aea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:45.822928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fd440094-3e3d-4b9b-8e6c-775cde96dcd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419f3872408c4d8c9a2980d6397d0aea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:45.824210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fd440094-3e3d-4b9b-8e6c-775cde96dcd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419f3872408c4d8c9a2980d6397d0aea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:45.825127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fd440094-3e3d-4b9b-8e6c-775cde96dcd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419f3872408c4d8c9a2980d6397d0aea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:45.857084 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2534/5106] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:19:45 2022] DELETE /identity/v3/users/419f3872408c4d8c9a2980d6397d0aea => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:19:46.387327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42487a33-85f9-4611-843a-881d9869e26c service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:46.402372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42487a33-85f9-4611-843a-881d9869e26c service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:46.422254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:46.539762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3339f2-7c4b-4054-9e7b-de04a45a1a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:46.541096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3339f2-7c4b-4054-9e7b-de04a45a1a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:46.541383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3339f2-7c4b-4054-9e7b-de04a45a1a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:46.541808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3339f2-7c4b-4054-9e7b-de04a45a1a2a admin admin] PATH_INFO: `/v3/projects/756410b2ad7345779f62a9db9835456f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:46.543073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3339f2-7c4b-4054-9e7b-de04a45a1a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=756410b2ad7345779f62a9db9835456f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:46.545496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3339f2-7c4b-4054-9e7b-de04a45a1a2a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:46.622917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5b3339f2-7c4b-4054-9e7b-de04a45a1a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '756410b2ad7345779f62a9db9835456f', 'request_id': 'req-5b3339f2-7c4b-4054-9e7b-de04a45a1a2a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:46.637086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5b3339f2-7c4b-4054-9e7b-de04a45a1a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '756410b2ad7345779f62a9db9835456f', 'request_id': 'req-5b3339f2-7c4b-4054-9e7b-de04a45a1a2a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:46.649432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5b3339f2-7c4b-4054-9e7b-de04a45a1a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '756410b2ad7345779f62a9db9835456f', 'request_id': 'req-5b3339f2-7c4b-4054-9e7b-de04a45a1a2a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:46.678343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5b3339f2-7c4b-4054-9e7b-de04a45a1a2a admin admin] The token cache is being invalidate because project 756410b2ad7345779f62a9db9835456f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:19:46.678842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5b3339f2-7c4b-4054-9e7b-de04a45a1a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:46.679375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5b3339f2-7c4b-4054-9e7b-de04a45a1a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:46.686259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e689f-c22a-4db6-a0f4-b4528b700c4b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:46.686793 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2573/5107] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:19:46 2022] DELETE /identity/v3/projects/756410b2ad7345779f62a9db9835456f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:46.686887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e689f-c22a-4db6-a0f4-b4528b700c4b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:46.686887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e689f-c22a-4db6-a0f4-b4528b700c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:46.741291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8c4e689f-c22a-4db6-a0f4-b4528b700c4b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:46.748601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8c4e689f-c22a-4db6-a0f4-b4528b700c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:46.833779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:46.915405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822dd1b-e390-4299-baee-599699db6824 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:46.916073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822dd1b-e390-4299-baee-599699db6824 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:46.916479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822dd1b-e390-4299-baee-599699db6824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:46.925387 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2535/5108] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:46.939189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2822dd1b-e390-4299-baee-599699db6824 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:46.940908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2822dd1b-e390-4299-baee-599699db6824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:46.955683 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2574/5109] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:46.958238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e689f-c22a-4db6-a0f4-b4528b700c4b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:46.971797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e689f-c22a-4db6-a0f4-b4528b700c4b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:46.980143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e14ed-ca4a-4942-b9d7-10c548535b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:46.980836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e14ed-ca4a-4942-b9d7-10c548535b2c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:46.981118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e14ed-ca4a-4942-b9d7-10c548535b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:46.981394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e14ed-ca4a-4942-b9d7-10c548535b2c admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:46.982340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e14ed-ca4a-4942-b9d7-10c548535b2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:19:46.982648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e14ed-ca4a-4942-b9d7-10c548535b2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:46.984441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e14ed-ca4a-4942-b9d7-10c548535b2c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:47.008701 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2536/5110] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:19:47.009957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822dd1b-e390-4299-baee-599699db6824 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:47.020422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822dd1b-e390-4299-baee-599699db6824 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:47.025463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e66b9-d829-45a4-b71a-437a2c5b102f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:47.026157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e66b9-d829-45a4-b71a-437a2c5b102f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:47.026647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e66b9-d829-45a4-b71a-437a2c5b102f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:47.026932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e66b9-d829-45a4-b71a-437a2c5b102f admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:47.027798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e66b9-d829-45a4-b71a-437a2c5b102f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:47.029916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e66b9-d829-45a4-b71a-437a2c5b102f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:47.089004 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2575/5111] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:19:47 2022] POST /identity/v3/projects => generated 381 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:47.098999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e14ed-ca4a-4942-b9d7-10c548535b2c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:47.117381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e14ed-ca4a-4942-b9d7-10c548535b2c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:47.275850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a241e-5747-4a1f-81d5-e17247d20dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:47.278529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a241e-5747-4a1f-81d5-e17247d20dea admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:47.278821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a241e-5747-4a1f-81d5-e17247d20dea admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:47.279106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a241e-5747-4a1f-81d5-e17247d20dea admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:47.279829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a241e-5747-4a1f-81d5-e17247d20dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:47.291196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a241e-5747-4a1f-81d5-e17247d20dea admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:47.359948 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2537/5112] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:19:47 2022] POST /identity/v3/users => generated 291 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:19:47.361300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e66b9-d829-45a4-b71a-437a2c5b102f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:47.383400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e66b9-d829-45a4-b71a-437a2c5b102f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:47.391929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e21d8-f3b3-42f7-86d1-830fc0ca606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:47.393593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e21d8-f3b3-42f7-86d1-830fc0ca606f admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:47.393994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e21d8-f3b3-42f7-86d1-830fc0ca606f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:47.394457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e21d8-f3b3-42f7-86d1-830fc0ca606f admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:47.402869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e21d8-f3b3-42f7-86d1-830fc0ca606f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:47.404136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e21d8-f3b3-42f7-86d1-830fc0ca606f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:47.426196 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2576/5113] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:19:47.430659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a241e-5747-4a1f-81d5-e17247d20dea admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:47.444529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a241e-5747-4a1f-81d5-e17247d20dea admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:47.461852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833d579-4cff-444c-a57f-8bc5a24ae469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:47.463193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833d579-4cff-444c-a57f-8bc5a24ae469 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:47.463826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833d579-4cff-444c-a57f-8bc5a24ae469 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:47.464260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833d579-4cff-444c-a57f-8bc5a24ae469 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:47.465168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833d579-4cff-444c-a57f-8bc5a24ae469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:47.468213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833d579-4cff-444c-a57f-8bc5a24ae469 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:47.494522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e21d8-f3b3-42f7-86d1-830fc0ca606f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:47.497986 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2538/5114] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:19:47.509994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e21d8-f3b3-42f7-86d1-830fc0ca606f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:47.515517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04553253-52a3-4d98-b257-34868eb84aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:47.516362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04553253-52a3-4d98-b257-34868eb84aba admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:47.516643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04553253-52a3-4d98-b257-34868eb84aba admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:47.516973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04553253-52a3-4d98-b257-34868eb84aba admin admin] PATH_INFO: `/v3/projects/526d9ed0cb294ddcadf746f088e0fcbc/users/4e2f3260319f40858f1fec2d708d3c87/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:47.542829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04553253-52a3-4d98-b257-34868eb84aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=526d9ed0cb294ddcadf746f088e0fcbc, user_id=4e2f3260319f40858f1fec2d708d3c87, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:47.549041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04553253-52a3-4d98-b257-34868eb84aba admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:47.597953 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2577/5115] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:19:47 2022] PUT /identity/v3/projects/526d9ed0cb294ddcadf746f088e0fcbc/users/4e2f3260319f40858f1fec2d708d3c87/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:47.601248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3bf8b-42c5-4f32-8f80-48356ca13812 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:47.602752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3bf8b-42c5-4f32-8f80-48356ca13812 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:47.603753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3bf8b-42c5-4f32-8f80-48356ca13812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:47.630053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1ac3bf8b-42c5-4f32-8f80-48356ca13812 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:47.631640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1ac3bf8b-42c5-4f32-8f80-48356ca13812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:47.722316 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2539/5116] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:47.740269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04553253-52a3-4d98-b257-34868eb84aba admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:47.742542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-04553253-52a3-4d98-b257-34868eb84aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:47.802142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:47.816645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04553253-52a3-4d98-b257-34868eb84aba admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:47.823123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5787f-1b7b-4a32-9092-c67bbf80f2ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:47.824789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5787f-1b7b-4a32-9092-c67bbf80f2ac service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:47.825169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5787f-1b7b-4a32-9092-c67bbf80f2ac service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:47.825514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5787f-1b7b-4a32-9092-c67bbf80f2ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:47.837220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5787f-1b7b-4a32-9092-c67bbf80f2ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:47.839024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5787f-1b7b-4a32-9092-c67bbf80f2ac service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:47.851474 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2578/5117] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:19:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:19:57.706546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:57.847432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:58.549731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3bf8b-42c5-4f32-8f80-48356ca13812 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:58.551331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1ac3bf8b-42c5-4f32-8f80-48356ca13812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:58.578415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3bf8b-42c5-4f32-8f80-48356ca13812 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:58.594786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802ce8f-f0c2-4117-906d-4af7bbd6983c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:58.595884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802ce8f-f0c2-4117-906d-4af7bbd6983c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:58.596406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802ce8f-f0c2-4117-906d-4af7bbd6983c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:58.597027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802ce8f-f0c2-4117-906d-4af7bbd6983c admin admin] PATH_INFO: `/v3/users/a986bc9be3c64440a007ef9166950caf` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:58.598574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802ce8f-f0c2-4117-906d-4af7bbd6983c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a986bc9be3c64440a007ef9166950caf)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:58.601270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802ce8f-f0c2-4117-906d-4af7bbd6983c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:58.692583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2802ce8f-f0c2-4117-906d-4af7bbd6983c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a986bc9be3c64440a007ef9166950caf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:58.714976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2802ce8f-f0c2-4117-906d-4af7bbd6983c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a986bc9be3c64440a007ef9166950caf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:58.735295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2802ce8f-f0c2-4117-906d-4af7bbd6983c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a986bc9be3c64440a007ef9166950caf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:58.738989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2802ce8f-f0c2-4117-906d-4af7bbd6983c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a986bc9be3c64440a007ef9166950caf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:58.740384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2802ce8f-f0c2-4117-906d-4af7bbd6983c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a986bc9be3c64440a007ef9166950caf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:58.772916 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2540/5118] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:19:58 2022] DELETE /identity/v3/users/a986bc9be3c64440a007ef9166950caf => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:58.777528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e64f0a-5a39-4539-9b50-76f62d73557e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:58.777827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e64f0a-5a39-4539-9b50-76f62d73557e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:58.778771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e64f0a-5a39-4539-9b50-76f62d73557e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:58.797784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e8e64f0a-5a39-4539-9b50-76f62d73557e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:58.799784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e8e64f0a-5a39-4539-9b50-76f62d73557e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:58.895838 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2579/5119] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:19:58.934478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802ce8f-f0c2-4117-906d-4af7bbd6983c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:58.937753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2802ce8f-f0c2-4117-906d-4af7bbd6983c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:59.177608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802ce8f-f0c2-4117-906d-4af7bbd6983c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:59.181858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c87671-3dea-4a62-a7d5-6eb85b872c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:59.183977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c87671-3dea-4a62-a7d5-6eb85b872c3b service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:59.184401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c87671-3dea-4a62-a7d5-6eb85b872c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:59.185076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c87671-3dea-4a62-a7d5-6eb85b872c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:59.206029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c87671-3dea-4a62-a7d5-6eb85b872c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:59.209384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c87671-3dea-4a62-a7d5-6eb85b872c3b service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:59.248911 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2541/5120] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:19:59.383454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e64f0a-5a39-4539-9b50-76f62d73557e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:19:59.385805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e8e64f0a-5a39-4539-9b50-76f62d73557e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:59.426666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e64f0a-5a39-4539-9b50-76f62d73557e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:19:59.437872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17a167-2de8-424d-b306-fcdc6b09076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:19:59.438882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17a167-2de8-424d-b306-fcdc6b09076e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:59.439231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17a167-2de8-424d-b306-fcdc6b09076e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:59.439580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17a167-2de8-424d-b306-fcdc6b09076e admin admin] PATH_INFO: `/v3/users/35c15fdfaf5b4b67b0678e2e5c1d9aec` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:59.440961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17a167-2de8-424d-b306-fcdc6b09076e admin admin] RBAC: Authorizing `identity:delete_user(user_id=35c15fdfaf5b4b67b0678e2e5c1d9aec)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:19:59.444207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17a167-2de8-424d-b306-fcdc6b09076e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:19:59.549068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-db17a167-2de8-424d-b306-fcdc6b09076e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35c15fdfaf5b4b67b0678e2e5c1d9aec'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:59.577321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-db17a167-2de8-424d-b306-fcdc6b09076e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35c15fdfaf5b4b67b0678e2e5c1d9aec'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:59.577937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-db17a167-2de8-424d-b306-fcdc6b09076e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35c15fdfaf5b4b67b0678e2e5c1d9aec'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:59.578653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-db17a167-2de8-424d-b306-fcdc6b09076e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35c15fdfaf5b4b67b0678e2e5c1d9aec'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:59.600469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-db17a167-2de8-424d-b306-fcdc6b09076e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35c15fdfaf5b4b67b0678e2e5c1d9aec'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:19:59.639929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243a6d8-fc73-4f0f-afb8-f816c3d25001 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:19:59.640276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243a6d8-fc73-4f0f-afb8-f816c3d25001 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:19:59.640562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243a6d8-fc73-4f0f-afb8-f816c3d25001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:19:59.679741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8243a6d8-fc73-4f0f-afb8-f816c3d25001 None None] MFA Rules not processed for user `4572a43d0b7e465eabd506fb52a502ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:19:59.680948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8243a6d8-fc73-4f0f-afb8-f816c3d25001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:19:59.684839 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2580/5121] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:19:59 2022] DELETE /identity/v3/users/35c15fdfaf5b4b67b0678e2e5c1d9aec => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:19:59.809592 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2542/5122] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:19:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:00.750704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17a167-2de8-424d-b306-fcdc6b09076e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:00.753866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-db17a167-2de8-424d-b306-fcdc6b09076e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:00.902086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17a167-2de8-424d-b306-fcdc6b09076e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:00.908407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd65ee-4023-4357-bf6a-dd2f79f606a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:00.909532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd65ee-4023-4357-bf6a-dd2f79f606a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:00.909962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd65ee-4023-4357-bf6a-dd2f79f606a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:00.910417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd65ee-4023-4357-bf6a-dd2f79f606a0 admin admin] PATH_INFO: `/v3/projects/66d034da984f4854aac7bfc91e5e4a11` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:00.915301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd65ee-4023-4357-bf6a-dd2f79f606a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d034da984f4854aac7bfc91e5e4a11)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:00.918197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd65ee-4023-4357-bf6a-dd2f79f606a0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:00.946959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:01.004644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c2bd65ee-4023-4357-bf6a-dd2f79f606a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d034da984f4854aac7bfc91e5e4a11', 'request_id': 'req-c2bd65ee-4023-4357-bf6a-dd2f79f606a0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:01.030627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c2bd65ee-4023-4357-bf6a-dd2f79f606a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d034da984f4854aac7bfc91e5e4a11', 'request_id': 'req-c2bd65ee-4023-4357-bf6a-dd2f79f606a0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:01.042992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c2bd65ee-4023-4357-bf6a-dd2f79f606a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d034da984f4854aac7bfc91e5e4a11', 'request_id': 'req-c2bd65ee-4023-4357-bf6a-dd2f79f606a0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:01.048483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243a6d8-fc73-4f0f-afb8-f816c3d25001 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:01.050133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8243a6d8-fc73-4f0f-afb8-f816c3d25001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:01.074208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243a6d8-fc73-4f0f-afb8-f816c3d25001 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:01.083460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c2bd65ee-4023-4357-bf6a-dd2f79f606a0 admin admin] The token cache is being invalidate because project 66d034da984f4854aac7bfc91e5e4a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:20:01.084009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c2bd65ee-4023-4357-bf6a-dd2f79f606a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:01.085479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c2bd65ee-4023-4357-bf6a-dd2f79f606a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:01.092877 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2581/5123] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:20:00 2022] DELETE /identity/v3/projects/66d034da984f4854aac7bfc91e5e4a11 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:01.094612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd65ee-4023-4357-bf6a-dd2f79f606a0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:01.096971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c2bd65ee-4023-4357-bf6a-dd2f79f606a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:01.113194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:01.203496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff8507-cda3-4fac-bd36-c76787e1be0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:01.204801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff8507-cda3-4fac-bd36-c76787e1be0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:01.205275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff8507-cda3-4fac-bd36-c76787e1be0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:01.205735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff8507-cda3-4fac-bd36-c76787e1be0d admin admin] PATH_INFO: `/v3/projects/12e3dad452a046c293a8cbda0a33199b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:01.214203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff8507-cda3-4fac-bd36-c76787e1be0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=12e3dad452a046c293a8cbda0a33199b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:01.217245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff8507-cda3-4fac-bd36-c76787e1be0d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:01.342470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d1ff8507-cda3-4fac-bd36-c76787e1be0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e3dad452a046c293a8cbda0a33199b', 'request_id': 'req-d1ff8507-cda3-4fac-bd36-c76787e1be0d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:01.353133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d1ff8507-cda3-4fac-bd36-c76787e1be0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e3dad452a046c293a8cbda0a33199b', 'request_id': 'req-d1ff8507-cda3-4fac-bd36-c76787e1be0d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:01.370061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d1ff8507-cda3-4fac-bd36-c76787e1be0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e3dad452a046c293a8cbda0a33199b', 'request_id': 'req-d1ff8507-cda3-4fac-bd36-c76787e1be0d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:01.399909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d1ff8507-cda3-4fac-bd36-c76787e1be0d admin admin] The token cache is being invalidate because project 12e3dad452a046c293a8cbda0a33199b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:20:01.400234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d1ff8507-cda3-4fac-bd36-c76787e1be0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:01.401037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d1ff8507-cda3-4fac-bd36-c76787e1be0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:01.403238 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2543/5124] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:20:01 2022] DELETE /identity/v3/projects/12e3dad452a046c293a8cbda0a33199b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:01.409029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d3628-b6ea-47d7-9b44-f083b43d87d3 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:01.409644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d3628-b6ea-47d7-9b44-f083b43d87d3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:01.410395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d3628-b6ea-47d7-9b44-f083b43d87d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:01.418844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd65ee-4023-4357-bf6a-dd2f79f606a0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:01.476052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-806d3628-b6ea-47d7-9b44-f083b43d87d3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:01.482922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-806d3628-b6ea-47d7-9b44-f083b43d87d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:01.507846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bcd48-ff87-4244-b9a9-622d8feb3539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:01.510300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bcd48-ff87-4244-b9a9-622d8feb3539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:01.510612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bcd48-ff87-4244-b9a9-622d8feb3539 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:01.510886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bcd48-ff87-4244-b9a9-622d8feb3539 admin admin] PATH_INFO: `/v3/users/b2981cd14b2742ad8c42f900c52434b9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:01.522256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bcd48-ff87-4244-b9a9-622d8feb3539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2981cd14b2742ad8c42f900c52434b9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:01.525758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bcd48-ff87-4244-b9a9-622d8feb3539 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:01.625888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-173bcd48-ff87-4244-b9a9-622d8feb3539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2981cd14b2742ad8c42f900c52434b9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:01.648256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:01.663604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-173bcd48-ff87-4244-b9a9-622d8feb3539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2981cd14b2742ad8c42f900c52434b9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:01.666339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-173bcd48-ff87-4244-b9a9-622d8feb3539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2981cd14b2742ad8c42f900c52434b9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:01.667373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-173bcd48-ff87-4244-b9a9-622d8feb3539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2981cd14b2742ad8c42f900c52434b9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:01.677965 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2544/5125] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:01.685651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7e7a3-1303-4dc4-be7a-053cdb5f02ad None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:01.685949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7e7a3-1303-4dc4-be7a-053cdb5f02ad None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:01.686230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7e7a3-1303-4dc4-be7a-053cdb5f02ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:01.688297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-173bcd48-ff87-4244-b9a9-622d8feb3539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2981cd14b2742ad8c42f900c52434b9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:01.729337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fad7e7a3-1303-4dc4-be7a-053cdb5f02ad None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:01.730623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fad7e7a3-1303-4dc4-be7a-053cdb5f02ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:01.751811 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2582/5126] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:20:01 2022] DELETE /identity/v3/users/b2981cd14b2742ad8c42f900c52434b9 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:01.761776 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2545/5127] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:01.762270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bcd48-ff87-4244-b9a9-622d8feb3539 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:01.894938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bcd48-ff87-4244-b9a9-622d8feb3539 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:01.900402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ca393-17d4-47aa-bf4b-eb5025664b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:01.901100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca393-17d4-47aa-bf4b-eb5025664b29 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:01.901389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca393-17d4-47aa-bf4b-eb5025664b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:01.901660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca393-17d4-47aa-bf4b-eb5025664b29 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:01.902394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ca393-17d4-47aa-bf4b-eb5025664b29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:20:01.902705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ca393-17d4-47aa-bf4b-eb5025664b29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:01.904449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ca393-17d4-47aa-bf4b-eb5025664b29 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:01.946045 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2583/5128] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:20:01.947196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7e7a3-1303-4dc4-be7a-053cdb5f02ad None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:01.958672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7e7a3-1303-4dc4-be7a-053cdb5f02ad None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:01.972908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3ad9e-337a-4a3c-8c89-a907e0cbc7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:01.973953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3ad9e-337a-4a3c-8c89-a907e0cbc7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:01.974439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3ad9e-337a-4a3c-8c89-a907e0cbc7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:01.974983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3ad9e-337a-4a3c-8c89-a907e0cbc7d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:01.975941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3ad9e-337a-4a3c-8c89-a907e0cbc7d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:01.978207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3ad9e-337a-4a3c-8c89-a907e0cbc7d7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:02.055818 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2546/5129] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:20:01 2022] POST /identity/v3/projects => generated 401 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:20:02.059831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ca393-17d4-47aa-bf4b-eb5025664b29 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:02.085249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ca393-17d4-47aa-bf4b-eb5025664b29 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:02.266801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa350fdd-03e1-47b5-b4e2-e49ec7d36b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:02.267648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa350fdd-03e1-47b5-b4e2-e49ec7d36b46 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:02.268000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa350fdd-03e1-47b5-b4e2-e49ec7d36b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:02.268427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa350fdd-03e1-47b5-b4e2-e49ec7d36b46 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:02.269220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa350fdd-03e1-47b5-b4e2-e49ec7d36b46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:02.271511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa350fdd-03e1-47b5-b4e2-e49ec7d36b46 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:02.330982 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2584/5130] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:20:02 2022] POST /identity/v3/users => generated 301 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:20:02.335056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3ad9e-337a-4a3c-8c89-a907e0cbc7d7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:02.353641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3ad9e-337a-4a3c-8c89-a907e0cbc7d7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:02.380264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f97c4f-51cd-44c6-be75-33dcd4e5f17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:02.381129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f97c4f-51cd-44c6-be75-33dcd4e5f17e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:02.381506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f97c4f-51cd-44c6-be75-33dcd4e5f17e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:02.382465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f97c4f-51cd-44c6-be75-33dcd4e5f17e admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:02.383433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f97c4f-51cd-44c6-be75-33dcd4e5f17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:02.385498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f97c4f-51cd-44c6-be75-33dcd4e5f17e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:02.438090 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2547/5131] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:20:02.439399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa350fdd-03e1-47b5-b4e2-e49ec7d36b46 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:02.461182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa350fdd-03e1-47b5-b4e2-e49ec7d36b46 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:02.523439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837f2c9-d64b-402f-bb65-98a9a7530b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:02.524415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837f2c9-d64b-402f-bb65-98a9a7530b24 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:02.524967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837f2c9-d64b-402f-bb65-98a9a7530b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:02.525715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837f2c9-d64b-402f-bb65-98a9a7530b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:02.529788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837f2c9-d64b-402f-bb65-98a9a7530b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:02.539946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837f2c9-d64b-402f-bb65-98a9a7530b24 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:02.605377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f97c4f-51cd-44c6-be75-33dcd4e5f17e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:02.605941 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2585/5132] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:20:02.617605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f97c4f-51cd-44c6-be75-33dcd4e5f17e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:02.631464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113a44c-db9d-4064-a3a8-59cc70d9cfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:02.632502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113a44c-db9d-4064-a3a8-59cc70d9cfbc admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:02.632850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113a44c-db9d-4064-a3a8-59cc70d9cfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:02.633244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113a44c-db9d-4064-a3a8-59cc70d9cfbc admin admin] PATH_INFO: `/v3/projects/2285f4b2708d4e6b9199bf99155b3636/users/1ab5af7b863740afb627155828fa6a51/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:02.660323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:02.686563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113a44c-db9d-4064-a3a8-59cc70d9cfbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2285f4b2708d4e6b9199bf99155b3636, user_id=1ab5af7b863740afb627155828fa6a51, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:02.701671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113a44c-db9d-4064-a3a8-59cc70d9cfbc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:02.753267 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2548/5133] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:20:02 2022] PUT /identity/v3/projects/2285f4b2708d4e6b9199bf99155b3636/users/1ab5af7b863740afb627155828fa6a51/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:02.760671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc4637-2eaa-454e-872e-05e85411d9ab None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:02.761657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc4637-2eaa-454e-872e-05e85411d9ab None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:02.762296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc4637-2eaa-454e-872e-05e85411d9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:02.794049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-43fc4637-2eaa-454e-872e-05e85411d9ab None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:02.795842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-43fc4637-2eaa-454e-872e-05e85411d9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:02.926888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:03.030280 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2586/5134] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:03.082342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113a44c-db9d-4064-a3a8-59cc70d9cfbc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:03.084520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9113a44c-db9d-4064-a3a8-59cc70d9cfbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:03.111246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc4637-2eaa-454e-872e-05e85411d9ab None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:03.112446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-43fc4637-2eaa-454e-872e-05e85411d9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:03.157389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc4637-2eaa-454e-872e-05e85411d9ab None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:03.182083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39a95c-3fc7-49d6-8b2a-31ecf316b226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:03.198649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39a95c-3fc7-49d6-8b2a-31ecf316b226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:03.199010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39a95c-3fc7-49d6-8b2a-31ecf316b226 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:03.200651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39a95c-3fc7-49d6-8b2a-31ecf316b226 admin admin] PATH_INFO: `/v3/projects/e17b8aa32d2f468697f4810909946880` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:03.205012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39a95c-3fc7-49d6-8b2a-31ecf316b226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e17b8aa32d2f468697f4810909946880)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:03.211997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39a95c-3fc7-49d6-8b2a-31ecf316b226 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:03.296567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113a44c-db9d-4064-a3a8-59cc70d9cfbc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:03.308422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec7696-c9f6-4b99-a33f-db790c83d8f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:03.327942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec7696-c9f6-4b99-a33f-db790c83d8f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:03.328675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec7696-c9f6-4b99-a33f-db790c83d8f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:03.329160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec7696-c9f6-4b99-a33f-db790c83d8f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:03.353129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec7696-c9f6-4b99-a33f-db790c83d8f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:03.362944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec7696-c9f6-4b99-a33f-db790c83d8f3 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:03.410110 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2549/5135] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:20:03.420346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9f39a95c-3fc7-49d6-8b2a-31ecf316b226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e17b8aa32d2f468697f4810909946880', 'request_id': 'req-9f39a95c-3fc7-49d6-8b2a-31ecf316b226'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:03.440236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9f39a95c-3fc7-49d6-8b2a-31ecf316b226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e17b8aa32d2f468697f4810909946880', 'request_id': 'req-9f39a95c-3fc7-49d6-8b2a-31ecf316b226'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:03.461158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9f39a95c-3fc7-49d6-8b2a-31ecf316b226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e17b8aa32d2f468697f4810909946880', 'request_id': 'req-9f39a95c-3fc7-49d6-8b2a-31ecf316b226'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:03.492175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9f39a95c-3fc7-49d6-8b2a-31ecf316b226 admin admin] The token cache is being invalidate because project e17b8aa32d2f468697f4810909946880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:20:03.492545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9f39a95c-3fc7-49d6-8b2a-31ecf316b226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:03.495150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9f39a95c-3fc7-49d6-8b2a-31ecf316b226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:03.500579 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2587/5136] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:20:03 2022] DELETE /identity/v3/projects/e17b8aa32d2f468697f4810909946880 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:20:03.505519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2c54e-4272-4e35-bde0-2e629fee8f5c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:03.505811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2c54e-4272-4e35-bde0-2e629fee8f5c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:03.508013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2c54e-4272-4e35-bde0-2e629fee8f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:03.537560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c9c2c54e-4272-4e35-bde0-2e629fee8f5c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:03.538861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c9c2c54e-4272-4e35-bde0-2e629fee8f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:03.624508 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2550/5137] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:03.632108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1ebf4-4025-4868-acac-d3d9da87c40b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:03.632485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1ebf4-4025-4868-acac-d3d9da87c40b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:03.632832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1ebf4-4025-4868-acac-d3d9da87c40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:03.667990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4fb1ebf4-4025-4868-acac-d3d9da87c40b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:03.671512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4fb1ebf4-4025-4868-acac-d3d9da87c40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:03.693741 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2588/5138] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:03.698081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2c54e-4272-4e35-bde0-2e629fee8f5c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:03.718413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2c54e-4272-4e35-bde0-2e629fee8f5c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:03.738525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc4a4d-e5a9-4a90-aed0-fd44ac7093da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:03.739529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc4a4d-e5a9-4a90-aed0-fd44ac7093da admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:03.739823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc4a4d-e5a9-4a90-aed0-fd44ac7093da admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:03.740127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc4a4d-e5a9-4a90-aed0-fd44ac7093da admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:03.740959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc4a4d-e5a9-4a90-aed0-fd44ac7093da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:20:03.741329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc4a4d-e5a9-4a90-aed0-fd44ac7093da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:03.746970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc4a4d-e5a9-4a90-aed0-fd44ac7093da admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:03.783939 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2551/5139] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:20:03.788728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1ebf4-4025-4868-acac-d3d9da87c40b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:03.809232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1ebf4-4025-4868-acac-d3d9da87c40b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:03.826001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba99b2-2d4d-49e6-a37f-d3d619142cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:03.826702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba99b2-2d4d-49e6-a37f-d3d619142cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:03.826986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba99b2-2d4d-49e6-a37f-d3d619142cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:03.827266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba99b2-2d4d-49e6-a37f-d3d619142cf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:03.831506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba99b2-2d4d-49e6-a37f-d3d619142cf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:03.836316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba99b2-2d4d-49e6-a37f-d3d619142cf2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:03.897198 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2589/5140] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:20:03 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:20:03.901848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc4a4d-e5a9-4a90-aed0-fd44ac7093da admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:03.920015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc4a4d-e5a9-4a90-aed0-fd44ac7093da admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:04.081099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f159c54-fb14-4758-b2a6-a3d2e63dc0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:04.082096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f159c54-fb14-4758-b2a6-a3d2e63dc0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:04.082746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f159c54-fb14-4758-b2a6-a3d2e63dc0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:04.083594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f159c54-fb14-4758-b2a6-a3d2e63dc0d7 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:04.088105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f159c54-fb14-4758-b2a6-a3d2e63dc0d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:04.091474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f159c54-fb14-4758-b2a6-a3d2e63dc0d7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:04.137749 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2552/5141] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:20:03 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:20:04.138611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba99b2-2d4d-49e6-a37f-d3d619142cf2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:04.158226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba99b2-2d4d-49e6-a37f-d3d619142cf2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:04.167855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28096c-5b5a-4194-9ede-a95d3cc62960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:04.168585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28096c-5b5a-4194-9ede-a95d3cc62960 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:04.168872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28096c-5b5a-4194-9ede-a95d3cc62960 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:04.169153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28096c-5b5a-4194-9ede-a95d3cc62960 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:04.169886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28096c-5b5a-4194-9ede-a95d3cc62960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:04.171529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28096c-5b5a-4194-9ede-a95d3cc62960 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:04.198351 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2590/5142] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:20:04.204224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f159c54-fb14-4758-b2a6-a3d2e63dc0d7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:04.266807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f159c54-fb14-4758-b2a6-a3d2e63dc0d7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:04.274617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfad50-66b1-44ee-a6f2-11b537a9beee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:04.278101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfad50-66b1-44ee-a6f2-11b537a9beee admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:04.278718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfad50-66b1-44ee-a6f2-11b537a9beee admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:04.279253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfad50-66b1-44ee-a6f2-11b537a9beee admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:04.280847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfad50-66b1-44ee-a6f2-11b537a9beee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:04.291572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfad50-66b1-44ee-a6f2-11b537a9beee admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:04.294366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:04.321734 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2553/5143] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:20:04.322555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28096c-5b5a-4194-9ede-a95d3cc62960 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:04.337446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28096c-5b5a-4194-9ede-a95d3cc62960 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:04.344361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acda24-f71e-458b-8823-86c824a0aa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:04.345416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acda24-f71e-458b-8823-86c824a0aa14 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:04.346958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acda24-f71e-458b-8823-86c824a0aa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:04.347559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acda24-f71e-458b-8823-86c824a0aa14 admin admin] PATH_INFO: `/v3/projects/46b545c4258140f2a620e24f216d3c64/users/577cbf73e11d478191a100a6cdd104b6/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:04.369337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acda24-f71e-458b-8823-86c824a0aa14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b545c4258140f2a620e24f216d3c64, user_id=577cbf73e11d478191a100a6cdd104b6, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:04.377982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acda24-f71e-458b-8823-86c824a0aa14 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:04.419424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32baaf5-58d9-4952-b66a-9f9ad50d5bc4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:04.419424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32baaf5-58d9-4952-b66a-9f9ad50d5bc4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:04.419680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32baaf5-58d9-4952-b66a-9f9ad50d5bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:04.448461 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2591/5144] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:20:04 2022] PUT /identity/v3/projects/46b545c4258140f2a620e24f216d3c64/users/577cbf73e11d478191a100a6cdd104b6/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:20:04.480481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a32baaf5-58d9-4952-b66a-9f9ad50d5bc4 None None] MFA Rules not processed for user `577cbf73e11d478191a100a6cdd104b6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:04.486055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a32baaf5-58d9-4952-b66a-9f9ad50d5bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:04.708075 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2554/5145] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:04.713943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acda24-f71e-458b-8823-86c824a0aa14 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:04.921490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acda24-f71e-458b-8823-86c824a0aa14 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:04.926921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b00fb-5cd6-452a-b8f6-d824e97d73dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:04.932599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b00fb-5cd6-452a-b8f6-d824e97d73dc admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:04.934863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b00fb-5cd6-452a-b8f6-d824e97d73dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:04.935478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b00fb-5cd6-452a-b8f6-d824e97d73dc admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:04.940234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b00fb-5cd6-452a-b8f6-d824e97d73dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:04.944208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b00fb-5cd6-452a-b8f6-d824e97d73dc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:04.955091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:05.011541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32baaf5-58d9-4952-b66a-9f9ad50d5bc4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:05.017477 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2592/5146] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:20:04 2022] POST /identity/v3/projects => generated 381 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:20:05.032343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32baaf5-58d9-4952-b66a-9f9ad50d5bc4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:05.167142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a50e4-6785-4c32-be61-3e4ae9705403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:05.167826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a50e4-6785-4c32-be61-3e4ae9705403 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:05.168153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a50e4-6785-4c32-be61-3e4ae9705403 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:05.168436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a50e4-6785-4c32-be61-3e4ae9705403 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:05.169148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a50e4-6785-4c32-be61-3e4ae9705403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:05.171125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a50e4-6785-4c32-be61-3e4ae9705403 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:05.200648 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2555/5147] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:20:05 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:20:05.205773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b00fb-5cd6-452a-b8f6-d824e97d73dc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:05.233424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b00fb-5cd6-452a-b8f6-d824e97d73dc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:05.243154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26a23a-a66d-4377-8616-5036aedd569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:05.244098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26a23a-a66d-4377-8616-5036aedd569a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:05.244522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26a23a-a66d-4377-8616-5036aedd569a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:05.244888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26a23a-a66d-4377-8616-5036aedd569a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:05.246264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26a23a-a66d-4377-8616-5036aedd569a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:05.248455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26a23a-a66d-4377-8616-5036aedd569a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:05.291969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a50e4-6785-4c32-be61-3e4ae9705403 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:05.292401 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2593/5148] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:20:05.314342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a50e4-6785-4c32-be61-3e4ae9705403 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:05.337055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73243c-ad4a-46f7-a3ac-dc48123a69ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:05.347960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73243c-ad4a-46f7-a3ac-dc48123a69ac admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:05.348281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73243c-ad4a-46f7-a3ac-dc48123a69ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:05.348570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73243c-ad4a-46f7-a3ac-dc48123a69ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:05.349330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73243c-ad4a-46f7-a3ac-dc48123a69ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:05.351032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73243c-ad4a-46f7-a3ac-dc48123a69ac admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:05.389576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26a23a-a66d-4377-8616-5036aedd569a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:05.403261 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2556/5149] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:20:05.407448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26a23a-a66d-4377-8616-5036aedd569a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:05.416807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195358e6-cc7a-4efd-a27b-5bdcb58609b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:05.417735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195358e6-cc7a-4efd-a27b-5bdcb58609b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:05.418010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195358e6-cc7a-4efd-a27b-5bdcb58609b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:05.418604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195358e6-cc7a-4efd-a27b-5bdcb58609b3 admin admin] PATH_INFO: `/v3/projects/054e86890f7d4f879bf9e739a5287195/users/1ab7cfd433de42cb85864ee3e8aced84/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:05.465768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195358e6-cc7a-4efd-a27b-5bdcb58609b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=054e86890f7d4f879bf9e739a5287195, user_id=1ab7cfd433de42cb85864ee3e8aced84, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:05.469498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195358e6-cc7a-4efd-a27b-5bdcb58609b3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:05.500852 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2594/5150] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:20:05 2022] PUT /identity/v3/projects/054e86890f7d4f879bf9e739a5287195/users/1ab7cfd433de42cb85864ee3e8aced84/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:05.513116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86030bad-ee31-4795-8dc5-fae31353a17d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:05.513432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86030bad-ee31-4795-8dc5-fae31353a17d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:05.513686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86030bad-ee31-4795-8dc5-fae31353a17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:05.593215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-86030bad-ee31-4795-8dc5-fae31353a17d None None] MFA Rules not processed for user `1ab7cfd433de42cb85864ee3e8aced84`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:05.594535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-86030bad-ee31-4795-8dc5-fae31353a17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:05.678571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:05.696451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195358e6-cc7a-4efd-a27b-5bdcb58609b3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:05.697729 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2557/5151] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:05.788138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195358e6-cc7a-4efd-a27b-5bdcb58609b3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:05.794394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed3ced-6d2f-43cc-9857-c35bdb8ed228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:05.795143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed3ced-6d2f-43cc-9857-c35bdb8ed228 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:05.796163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed3ced-6d2f-43cc-9857-c35bdb8ed228 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:05.796515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed3ced-6d2f-43cc-9857-c35bdb8ed228 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:05.798283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed3ced-6d2f-43cc-9857-c35bdb8ed228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:05.800446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed3ced-6d2f-43cc-9857-c35bdb8ed228 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:05.874211 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2595/5152] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:20:05 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:20:05.877924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86030bad-ee31-4795-8dc5-fae31353a17d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:05.894010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b44297-0770-473c-b0d3-f7a96ceea652 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:05.894421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b44297-0770-473c-b0d3-f7a96ceea652 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:05.894604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b44297-0770-473c-b0d3-f7a96ceea652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:05.905545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86030bad-ee31-4795-8dc5-fae31353a17d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:05.955474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f4b44297-0770-473c-b0d3-f7a96ceea652 None None] MFA Rules not processed for user `4e2f3260319f40858f1fec2d708d3c87`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:05.957401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f4b44297-0770-473c-b0d3-f7a96ceea652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:06.037993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129850c-abec-4015-be57-e6ecf203fcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:06.040667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129850c-abec-4015-be57-e6ecf203fcce admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:06.042013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129850c-abec-4015-be57-e6ecf203fcce admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:06.042315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129850c-abec-4015-be57-e6ecf203fcce admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:06.049054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129850c-abec-4015-be57-e6ecf203fcce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:06.053110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129850c-abec-4015-be57-e6ecf203fcce admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:06.074173 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2596/5153] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:06.085675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe3aa8-f676-4902-9b96-c303c004f67e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:06.085976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe3aa8-f676-4902-9b96-c303c004f67e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:06.086260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe3aa8-f676-4902-9b96-c303c004f67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:06.123696 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2558/5154] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:20:05 2022] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:20:06.126973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129850c-abec-4015-be57-e6ecf203fcce admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:06.137444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4fbe3aa8-f676-4902-9b96-c303c004f67e None None] MFA Rules not processed for user `4e2f3260319f40858f1fec2d708d3c87`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:06.139384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4fbe3aa8-f676-4902-9b96-c303c004f67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:06.151767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129850c-abec-4015-be57-e6ecf203fcce admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:06.166542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf25482-488f-461b-95d9-667d738bc936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:06.167297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf25482-488f-461b-95d9-667d738bc936 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:06.167843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf25482-488f-461b-95d9-667d738bc936 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:06.167843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf25482-488f-461b-95d9-667d738bc936 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:06.168616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf25482-488f-461b-95d9-667d738bc936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:06.171515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf25482-488f-461b-95d9-667d738bc936 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:06.198868 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2597/5155] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:06.200939 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2559/5156] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:20:06.205095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe3aa8-f676-4902-9b96-c303c004f67e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:06.232682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe3aa8-f676-4902-9b96-c303c004f67e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:06.249133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef214f-823f-4a1f-8e04-2a48695af72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:06.250280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef214f-823f-4a1f-8e04-2a48695af72f admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:06.250280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef214f-823f-4a1f-8e04-2a48695af72f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:06.250570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef214f-823f-4a1f-8e04-2a48695af72f admin admin] PATH_INFO: `/v3/projects/9b3ed206d585464284fd8e6efc9d6199/users/37b5fca731c9410daea9891f6a3395d1/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:06.274934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef214f-823f-4a1f-8e04-2a48695af72f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3ed206d585464284fd8e6efc9d6199, user_id=37b5fca731c9410daea9891f6a3395d1, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:06.278143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef214f-823f-4a1f-8e04-2a48695af72f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:06.282673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:06.317256 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2598/5157] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:20:06 2022] PUT /identity/v3/projects/9b3ed206d585464284fd8e6efc9d6199/users/37b5fca731c9410daea9891f6a3395d1/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:06.321468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf25482-488f-461b-95d9-667d738bc936 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:06.327659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef214f-823f-4a1f-8e04-2a48695af72f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:06.329288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0cef214f-823f-4a1f-8e04-2a48695af72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:06.333944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf25482-488f-461b-95d9-667d738bc936 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:06.442900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc3f95-fde7-4b59-9b32-c84c6739f660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:06.443831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc3f95-fde7-4b59-9b32-c84c6739f660 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:06.444124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc3f95-fde7-4b59-9b32-c84c6739f660 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:06.444405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc3f95-fde7-4b59-9b32-c84c6739f660 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:06.445280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc3f95-fde7-4b59-9b32-c84c6739f660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:06.447134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc3f95-fde7-4b59-9b32-c84c6739f660 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:06.481252 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2560/5158] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:20:06.482203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc3f95-fde7-4b59-9b32-c84c6739f660 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:06.519713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc3f95-fde7-4b59-9b32-c84c6739f660 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:06.535144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b82b9-7ed9-4cc2-91c2-631af30247b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:06.536270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b82b9-7ed9-4cc2-91c2-631af30247b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:06.536550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b82b9-7ed9-4cc2-91c2-631af30247b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:06.536825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b82b9-7ed9-4cc2-91c2-631af30247b2 admin admin] PATH_INFO: `/v3/projects/9b3ed206d585464284fd8e6efc9d6199/users/37b5fca731c9410daea9891f6a3395d1/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:06.539371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef214f-823f-4a1f-8e04-2a48695af72f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:06.543214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b82b9-7ed9-4cc2-91c2-631af30247b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3ed206d585464284fd8e6efc9d6199, user_id=37b5fca731c9410daea9891f6a3395d1, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:06.546284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b82b9-7ed9-4cc2-91c2-631af30247b2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:06.554195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6159a90-a88b-4769-b43d-d287b8b3bf63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:06.555199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6159a90-a88b-4769-b43d-d287b8b3bf63 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:06.556279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6159a90-a88b-4769-b43d-d287b8b3bf63 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:06.556833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6159a90-a88b-4769-b43d-d287b8b3bf63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:06.572664 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2561/5159] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:20:06 2022] PUT /identity/v3/projects/9b3ed206d585464284fd8e6efc9d6199/users/37b5fca731c9410daea9891f6a3395d1/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:06.583002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61388bd8-32fe-487c-900b-fd63f0590d73 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:06.583318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61388bd8-32fe-487c-900b-fd63f0590d73 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:06.583560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61388bd8-32fe-487c-900b-fd63f0590d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:06.636201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-61388bd8-32fe-487c-900b-fd63f0590d73 None None] MFA Rules not processed for user `37b5fca731c9410daea9891f6a3395d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:06.641554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-61388bd8-32fe-487c-900b-fd63f0590d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:06.731905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:06.733219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6159a90-a88b-4769-b43d-d287b8b3bf63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:06.735310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6159a90-a88b-4769-b43d-d287b8b3bf63 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:06.761057 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2599/5160] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:20:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:20:06.778778 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2562/5161] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:20:06.826933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6159a90-a88b-4769-b43d-d287b8b3bf63 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:06.828916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d6159a90-a88b-4769-b43d-d287b8b3bf63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:07.045592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6159a90-a88b-4769-b43d-d287b8b3bf63 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:07.203019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:07.212718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469accbc-ad64-4601-8c78-77c2a16db261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:07.213447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469accbc-ad64-4601-8c78-77c2a16db261 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:07.213731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469accbc-ad64-4601-8c78-77c2a16db261 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:07.214008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469accbc-ad64-4601-8c78-77c2a16db261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:07.375657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469accbc-ad64-4601-8c78-77c2a16db261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:07.377426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469accbc-ad64-4601-8c78-77c2a16db261 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:07.402117 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2600/5162] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:20:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:20:16.772396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=9 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:17.391727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=26 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:17.966227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61388bd8-32fe-487c-900b-fd63f0590d73 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:17.989589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61388bd8-32fe-487c-900b-fd63f0590d73 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:17.997550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdf743-2a7d-494c-9ede-137b95115a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:17.998324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdf743-2a7d-494c-9ede-137b95115a4f service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:17.998813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdf743-2a7d-494c-9ede-137b95115a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:17.999787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdf743-2a7d-494c-9ede-137b95115a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:18.004924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-abbdf743-2a7d-494c-9ede-137b95115a4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:18.137627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdf743-2a7d-494c-9ede-137b95115a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:18.139979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdf743-2a7d-494c-9ede-137b95115a4f service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:18.163438 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2563/5163] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:20:22.183190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0db13-fa7c-4b47-aef3-4701db7b9971 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:22.183752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0db13-fa7c-4b47-aef3-4701db7b9971 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:22.183752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0db13-fa7c-4b47-aef3-4701db7b9971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:22.244243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6dd0db13-fa7c-4b47-aef3-4701db7b9971 None None] MFA Rules not processed for user `1ab5af7b863740afb627155828fa6a51`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:22.245492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6dd0db13-fa7c-4b47-aef3-4701db7b9971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:22.436904 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2601/5164] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:23.027358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdf743-2a7d-494c-9ede-137b95115a4f service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:23.177365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdf743-2a7d-494c-9ede-137b95115a4f service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:23.184357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0290e2-d5d6-4cdd-8a87-b85a83715a96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:23.185255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0290e2-d5d6-4cdd-8a87-b85a83715a96 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:23.185874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0290e2-d5d6-4cdd-8a87-b85a83715a96 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:23.186310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0290e2-d5d6-4cdd-8a87-b85a83715a96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:23.212705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0290e2-d5d6-4cdd-8a87-b85a83715a96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:23.221341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0290e2-d5d6-4cdd-8a87-b85a83715a96 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:23.250110 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2564/5165] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:20:23 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:20:27.854976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0db13-fa7c-4b47-aef3-4701db7b9971 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:27.868779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0db13-fa7c-4b47-aef3-4701db7b9971 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:27.872912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfbdad-1dcb-4a97-bfdc-226710dc5093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:27.873845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfbdad-1dcb-4a97-bfdc-226710dc5093 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:27.874223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfbdad-1dcb-4a97-bfdc-226710dc5093 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:27.874593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfbdad-1dcb-4a97-bfdc-226710dc5093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:27.876539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-27dfbdad-1dcb-4a97-bfdc-226710dc5093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:27.890504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfbdad-1dcb-4a97-bfdc-226710dc5093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:27.893426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfbdad-1dcb-4a97-bfdc-226710dc5093 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:27.911765 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2602/5166] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:20:29.450317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0290e2-d5d6-4cdd-8a87-b85a83715a96 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:29.451789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-eb0290e2-d5d6-4cdd-8a87-b85a83715a96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:29.473857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0290e2-d5d6-4cdd-8a87-b85a83715a96 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:29.499293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a5faf-43ef-4e0c-90da-fa882043d96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:29.500515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a5faf-43ef-4e0c-90da-fa882043d96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:29.500980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a5faf-43ef-4e0c-90da-fa882043d96e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:29.501406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a5faf-43ef-4e0c-90da-fa882043d96e admin admin] PATH_INFO: `/v3/users/427491532c5e411f890bb1293ab18131` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:29.503609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a5faf-43ef-4e0c-90da-fa882043d96e admin admin] RBAC: Authorizing `identity:delete_user(user_id=427491532c5e411f890bb1293ab18131)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:29.505867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a5faf-43ef-4e0c-90da-fa882043d96e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:29.626773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee7a5faf-43ef-4e0c-90da-fa882043d96e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '427491532c5e411f890bb1293ab18131'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:29.646954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee7a5faf-43ef-4e0c-90da-fa882043d96e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '427491532c5e411f890bb1293ab18131'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:29.667939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee7a5faf-43ef-4e0c-90da-fa882043d96e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '427491532c5e411f890bb1293ab18131'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:29.668884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee7a5faf-43ef-4e0c-90da-fa882043d96e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '427491532c5e411f890bb1293ab18131'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:29.669513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee7a5faf-43ef-4e0c-90da-fa882043d96e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '427491532c5e411f890bb1293ab18131'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:29.694970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:29.716071 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2565/5167] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:20:29 2022] DELETE /identity/v3/users/427491532c5e411f890bb1293ab18131 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:29.721404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe057e-6aae-4440-8a8e-4749567b6c72 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:29.722451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe057e-6aae-4440-8a8e-4749567b6c72 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:29.722873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe057e-6aae-4440-8a8e-4749567b6c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:29.794061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a5fe057e-6aae-4440-8a8e-4749567b6c72 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:29.798495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a5fe057e-6aae-4440-8a8e-4749567b6c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:29.952070 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2603/5168] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:29.978183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a5faf-43ef-4e0c-90da-fa882043d96e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:29.979661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ee7a5faf-43ef-4e0c-90da-fa882043d96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:30.160869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a5faf-43ef-4e0c-90da-fa882043d96e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:30.174314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c05381-43ce-4c36-ab5b-4df6b0d51fc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:30.175408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c05381-43ce-4c36-ab5b-4df6b0d51fc8 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:30.175923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c05381-43ce-4c36-ab5b-4df6b0d51fc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:30.177831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c05381-43ce-4c36-ab5b-4df6b0d51fc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:30.203470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c05381-43ce-4c36-ab5b-4df6b0d51fc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:30.204921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c05381-43ce-4c36-ab5b-4df6b0d51fc8 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:30.220548 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2566/5169] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:20:30.616579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe057e-6aae-4440-8a8e-4749567b6c72 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:30.617479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a5fe057e-6aae-4440-8a8e-4749567b6c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:30.640432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe057e-6aae-4440-8a8e-4749567b6c72 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:30.652359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cf3e8-535f-4dc8-b286-74c81a38ec6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:30.655726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cf3e8-535f-4dc8-b286-74c81a38ec6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:30.656011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cf3e8-535f-4dc8-b286-74c81a38ec6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:30.657584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cf3e8-535f-4dc8-b286-74c81a38ec6b admin admin] PATH_INFO: `/v3/projects/8a37f54cef1b4aef9275b5170a0b1f15` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:30.659224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cf3e8-535f-4dc8-b286-74c81a38ec6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a37f54cef1b4aef9275b5170a0b1f15)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:30.661263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cf3e8-535f-4dc8-b286-74c81a38ec6b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:30.764770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5c4cf3e8-535f-4dc8-b286-74c81a38ec6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a37f54cef1b4aef9275b5170a0b1f15', 'request_id': 'req-5c4cf3e8-535f-4dc8-b286-74c81a38ec6b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:30.778506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5c4cf3e8-535f-4dc8-b286-74c81a38ec6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a37f54cef1b4aef9275b5170a0b1f15', 'request_id': 'req-5c4cf3e8-535f-4dc8-b286-74c81a38ec6b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:30.797942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5c4cf3e8-535f-4dc8-b286-74c81a38ec6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a37f54cef1b4aef9275b5170a0b1f15', 'request_id': 'req-5c4cf3e8-535f-4dc8-b286-74c81a38ec6b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:30.817942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:30.838637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5c4cf3e8-535f-4dc8-b286-74c81a38ec6b admin admin] The token cache is being invalidate because project 8a37f54cef1b4aef9275b5170a0b1f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:20:30.839110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5c4cf3e8-535f-4dc8-b286-74c81a38ec6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:30.841809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5c4cf3e8-535f-4dc8-b286-74c81a38ec6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:30.850332 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2604/5170] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:20:30 2022] DELETE /identity/v3/projects/8a37f54cef1b4aef9275b5170a0b1f15 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:30.852133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94ad5c-4cf4-42d4-941f-b6668b957c22 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:30.852594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94ad5c-4cf4-42d4-941f-b6668b957c22 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:30.852689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94ad5c-4cf4-42d4-941f-b6668b957c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:30.894384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5a94ad5c-4cf4-42d4-941f-b6668b957c22 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:30.895773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5a94ad5c-4cf4-42d4-941f-b6668b957c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:31.007404 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2567/5171] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:20:31.015577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ad670-161d-4930-b743-088e1438c632 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:31.016201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ad670-161d-4930-b743-088e1438c632 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:31.016652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ad670-161d-4930-b743-088e1438c632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:31.036864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e98ad670-161d-4930-b743-088e1438c632 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:31.038290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e98ad670-161d-4930-b743-088e1438c632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:31.053809 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2605/5172] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:31.055011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94ad5c-4cf4-42d4-941f-b6668b957c22 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:31.069220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94ad5c-4cf4-42d4-941f-b6668b957c22 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:31.084745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e1f6e-278d-4958-9938-f0017356532a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:31.085542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e1f6e-278d-4958-9938-f0017356532a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:31.085876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e1f6e-278d-4958-9938-f0017356532a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:31.086233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e1f6e-278d-4958-9938-f0017356532a admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:31.087032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e1f6e-278d-4958-9938-f0017356532a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:20:31.087398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e1f6e-278d-4958-9938-f0017356532a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:31.095805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e1f6e-278d-4958-9938-f0017356532a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:31.115714 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2568/5173] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:20:31.117159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ad670-161d-4930-b743-088e1438c632 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:31.130571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ad670-161d-4930-b743-088e1438c632 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:31.136483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce6e22-885b-4d71-a90a-eac101358eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:31.137394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce6e22-885b-4d71-a90a-eac101358eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:31.137893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce6e22-885b-4d71-a90a-eac101358eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:31.138556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce6e22-885b-4d71-a90a-eac101358eb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:31.139420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce6e22-885b-4d71-a90a-eac101358eb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:31.141572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce6e22-885b-4d71-a90a-eac101358eb1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:31.189620 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2606/5174] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:20:31 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:20:31.191232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e1f6e-278d-4958-9938-f0017356532a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:31.212483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e1f6e-278d-4958-9938-f0017356532a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:31.264890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce6e22-885b-4d71-a90a-eac101358eb1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:31.267002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d5ce6e22-885b-4d71-a90a-eac101358eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:31.383802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fb504-a252-412d-b25f-0ebd5d717632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:31.385194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fb504-a252-412d-b25f-0ebd5d717632 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:31.385312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fb504-a252-412d-b25f-0ebd5d717632 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:31.385581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fb504-a252-412d-b25f-0ebd5d717632 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:31.386279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fb504-a252-412d-b25f-0ebd5d717632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:31.392494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fb504-a252-412d-b25f-0ebd5d717632 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:31.408360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce6e22-885b-4d71-a90a-eac101358eb1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:31.419574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36f2dd-1bf1-45e5-9564-5dbd0d08c80e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:31.420308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36f2dd-1bf1-45e5-9564-5dbd0d08c80e service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:31.420592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36f2dd-1bf1-45e5-9564-5dbd0d08c80e service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:31.421187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36f2dd-1bf1-45e5-9564-5dbd0d08c80e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:31.431800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1f36f2dd-1bf1-45e5-9564-5dbd0d08c80e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:31.444974 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2569/5175] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:20:31 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:20:31.448089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fb504-a252-412d-b25f-0ebd5d717632 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:31.478888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fb504-a252-412d-b25f-0ebd5d717632 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:31.503862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a4f11-3da6-4646-b352-a51ea04683ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:31.505030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a4f11-3da6-4646-b352-a51ea04683ed admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:31.505312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a4f11-3da6-4646-b352-a51ea04683ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:31.505589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a4f11-3da6-4646-b352-a51ea04683ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:31.506321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a4f11-3da6-4646-b352-a51ea04683ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:31.507974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a4f11-3da6-4646-b352-a51ea04683ed admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:31.520121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:31.544706 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2570/5176] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:20:31.549879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a4f11-3da6-4646-b352-a51ea04683ed admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:31.577743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a4f11-3da6-4646-b352-a51ea04683ed admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:31.600783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01082240-718f-457c-97de-cd54de3b351f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:31.602690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01082240-718f-457c-97de-cd54de3b351f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:31.602979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01082240-718f-457c-97de-cd54de3b351f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:31.606666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01082240-718f-457c-97de-cd54de3b351f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:31.607457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01082240-718f-457c-97de-cd54de3b351f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:31.612757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01082240-718f-457c-97de-cd54de3b351f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:31.644180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36f2dd-1bf1-45e5-9564-5dbd0d08c80e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:31.648279 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2571/5177] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:20:31.650223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36f2dd-1bf1-45e5-9564-5dbd0d08c80e service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:31.652808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32358bc-652f-4582-817d-360fd05f579f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:31.653165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32358bc-652f-4582-817d-360fd05f579f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:31.653517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32358bc-652f-4582-817d-360fd05f579f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:31.680511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b32358bc-652f-4582-817d-360fd05f579f None None] MFA Rules not processed for user `4572a43d0b7e465eabd506fb52a502ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:31.681919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b32358bc-652f-4582-817d-360fd05f579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:31.697184 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2607/5178] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:20:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:20:31.698172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36f2dd-1bf1-45e5-9564-5dbd0d08c80e service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:31.729977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36f2dd-1bf1-45e5-9564-5dbd0d08c80e service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:31.738346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fc882-5259-43fd-a5b4-39fb05616724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:31.739568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fc882-5259-43fd-a5b4-39fb05616724 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:31.740016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fc882-5259-43fd-a5b4-39fb05616724 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:31.740456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fc882-5259-43fd-a5b4-39fb05616724 admin admin] PATH_INFO: `/v3/projects/87d8757ccac34bbfb8fe89cef3a9b8f3/users/a5f990598f63461d92323d441e8bb5a5/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:31.753580 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2572/5179] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:31.778986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fc882-5259-43fd-a5b4-39fb05616724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d8757ccac34bbfb8fe89cef3a9b8f3, user_id=a5f990598f63461d92323d441e8bb5a5, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:31.784433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fc882-5259-43fd-a5b4-39fb05616724 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:31.818232 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2608/5180] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:20:31 2022] PUT /identity/v3/projects/87d8757ccac34bbfb8fe89cef3a9b8f3/users/a5f990598f63461d92323d441e8bb5a5/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:31.830271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca6867-8e12-40dd-8fcb-0acca136ee9e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:31.830673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca6867-8e12-40dd-8fcb-0acca136ee9e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:31.831157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca6867-8e12-40dd-8fcb-0acca136ee9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:31.886043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4dca6867-8e12-40dd-8fcb-0acca136ee9e None None] MFA Rules not processed for user `a5f990598f63461d92323d441e8bb5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:31.887417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4dca6867-8e12-40dd-8fcb-0acca136ee9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:32.001951 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2573/5181] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:32.048343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fc882-5259-43fd-a5b4-39fb05616724 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:32.166274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fc882-5259-43fd-a5b4-39fb05616724 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:32.170473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4b329-3d6b-4a6c-80ab-4e3328e14b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:32.171410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4b329-3d6b-4a6c-80ab-4e3328e14b34 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:32.171905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4b329-3d6b-4a6c-80ab-4e3328e14b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:32.173357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4b329-3d6b-4a6c-80ab-4e3328e14b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:32.183520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4b329-3d6b-4a6c-80ab-4e3328e14b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:32.186280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4b329-3d6b-4a6c-80ab-4e3328e14b34 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:32.192733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:32.202052 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2609/5182] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:20:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:20:32.778053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca6867-8e12-40dd-8fcb-0acca136ee9e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:32.780201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4dca6867-8e12-40dd-8fcb-0acca136ee9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:32.883639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca6867-8e12-40dd-8fcb-0acca136ee9e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:32.890674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fec6a-cbc5-41c1-8b31-63e5ebe98273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:32.892858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fec6a-cbc5-41c1-8b31-63e5ebe98273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:32.893791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fec6a-cbc5-41c1-8b31-63e5ebe98273 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:32.894077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fec6a-cbc5-41c1-8b31-63e5ebe98273 admin admin] PATH_INFO: `/v3/users/984631f5a77a48c5a9619e33e608dd59` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:32.895411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fec6a-cbc5-41c1-8b31-63e5ebe98273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=984631f5a77a48c5a9619e33e608dd59)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:32.897934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fec6a-cbc5-41c1-8b31-63e5ebe98273 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:32.940265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:32.972608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-517fec6a-cbc5-41c1-8b31-63e5ebe98273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '984631f5a77a48c5a9619e33e608dd59'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:32.983512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-517fec6a-cbc5-41c1-8b31-63e5ebe98273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '984631f5a77a48c5a9619e33e608dd59'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:32.993003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-517fec6a-cbc5-41c1-8b31-63e5ebe98273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '984631f5a77a48c5a9619e33e608dd59'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:32.994147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-517fec6a-cbc5-41c1-8b31-63e5ebe98273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '984631f5a77a48c5a9619e33e608dd59'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:32.994649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-517fec6a-cbc5-41c1-8b31-63e5ebe98273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '984631f5a77a48c5a9619e33e608dd59'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:33.021955 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2574/5183] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:20:32 2022] DELETE /identity/v3/users/984631f5a77a48c5a9619e33e608dd59 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:34.266819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4b329-3d6b-4a6c-80ab-4e3328e14b34 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:34.298386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4b329-3d6b-4a6c-80ab-4e3328e14b34 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:34.532895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157233ff-26e7-4aa6-a8a0-7a68e2781001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:34.534694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157233ff-26e7-4aa6-a8a0-7a68e2781001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:34.535436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157233ff-26e7-4aa6-a8a0-7a68e2781001 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:34.536400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157233ff-26e7-4aa6-a8a0-7a68e2781001 admin admin] PATH_INFO: `/v3/projects/f644f2d1c56c43cf851deb020af7161e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:34.538457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157233ff-26e7-4aa6-a8a0-7a68e2781001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f644f2d1c56c43cf851deb020af7161e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:34.544896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157233ff-26e7-4aa6-a8a0-7a68e2781001 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:34.689248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-157233ff-26e7-4aa6-a8a0-7a68e2781001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f644f2d1c56c43cf851deb020af7161e', 'request_id': 'req-157233ff-26e7-4aa6-a8a0-7a68e2781001'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:34.723669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-157233ff-26e7-4aa6-a8a0-7a68e2781001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f644f2d1c56c43cf851deb020af7161e', 'request_id': 'req-157233ff-26e7-4aa6-a8a0-7a68e2781001'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:34.732109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-157233ff-26e7-4aa6-a8a0-7a68e2781001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f644f2d1c56c43cf851deb020af7161e', 'request_id': 'req-157233ff-26e7-4aa6-a8a0-7a68e2781001'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:34.756868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-157233ff-26e7-4aa6-a8a0-7a68e2781001 admin admin] The token cache is being invalidate because project f644f2d1c56c43cf851deb020af7161e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:20:34.757519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-157233ff-26e7-4aa6-a8a0-7a68e2781001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:34.761451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-157233ff-26e7-4aa6-a8a0-7a68e2781001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:34.767180 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2610/5184] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:20:34 2022] DELETE /identity/v3/projects/f644f2d1c56c43cf851deb020af7161e => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:34.769171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18fdc4-12de-4481-bf6c-6a2fcd2a2954 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:34.769626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18fdc4-12de-4481-bf6c-6a2fcd2a2954 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:34.769804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18fdc4-12de-4481-bf6c-6a2fcd2a2954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:34.805899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-af18fdc4-12de-4481-bf6c-6a2fcd2a2954 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:34.807806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-af18fdc4-12de-4481-bf6c-6a2fcd2a2954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:34.984912 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2575/5185] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:34.989996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4135b3-c8e5-4f13-bf45-397234b29548 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:34.990898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4135b3-c8e5-4f13-bf45-397234b29548 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:34.991099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4135b3-c8e5-4f13-bf45-397234b29548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:35.055730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2a4135b3-c8e5-4f13-bf45-397234b29548 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:35.058784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2a4135b3-c8e5-4f13-bf45-397234b29548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:35.097111 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2611/5186] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:35.101607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18fdc4-12de-4481-bf6c-6a2fcd2a2954 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:35.127994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18fdc4-12de-4481-bf6c-6a2fcd2a2954 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:35.153830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b9961-34aa-4c39-b843-d5cd4e1fdeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:35.156902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b9961-34aa-4c39-b843-d5cd4e1fdeab admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:35.159616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b9961-34aa-4c39-b843-d5cd4e1fdeab admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:35.159978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b9961-34aa-4c39-b843-d5cd4e1fdeab admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:35.162047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b9961-34aa-4c39-b843-d5cd4e1fdeab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:20:35.164187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b9961-34aa-4c39-b843-d5cd4e1fdeab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:35.167886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b9961-34aa-4c39-b843-d5cd4e1fdeab admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:35.230162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4135b3-c8e5-4f13-bf45-397234b29548 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:35.237789 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2576/5187] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:20:35.254256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4135b3-c8e5-4f13-bf45-397234b29548 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:35.283372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859b4ac-ecb9-4df2-9ac0-cf9ff75be3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:35.287770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859b4ac-ecb9-4df2-9ac0-cf9ff75be3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:35.289216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859b4ac-ecb9-4df2-9ac0-cf9ff75be3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:35.292464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859b4ac-ecb9-4df2-9ac0-cf9ff75be3b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:35.294020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859b4ac-ecb9-4df2-9ac0-cf9ff75be3b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:35.303192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859b4ac-ecb9-4df2-9ac0-cf9ff75be3b5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:35.400997 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2612/5188] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:20:35 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:20:35.406082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b9961-34aa-4c39-b843-d5cd4e1fdeab admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:35.427994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b9961-34aa-4c39-b843-d5cd4e1fdeab admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:35.671440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff84a5-5796-4a7d-8a22-1238c7423eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:35.679473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff84a5-5796-4a7d-8a22-1238c7423eec admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:35.679473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff84a5-5796-4a7d-8a22-1238c7423eec admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:35.679473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff84a5-5796-4a7d-8a22-1238c7423eec admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:35.679473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff84a5-5796-4a7d-8a22-1238c7423eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:35.679473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff84a5-5796-4a7d-8a22-1238c7423eec admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:35.709223 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2577/5189] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:20:35 2022] POST /identity/v3/users => generated 288 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:20:35.710030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859b4ac-ecb9-4df2-9ac0-cf9ff75be3b5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:35.741950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859b4ac-ecb9-4df2-9ac0-cf9ff75be3b5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:35.758145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995708ac-8023-453d-a669-1ec3784a2afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:35.759093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995708ac-8023-453d-a669-1ec3784a2afe admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:35.760695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995708ac-8023-453d-a669-1ec3784a2afe admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:35.761181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995708ac-8023-453d-a669-1ec3784a2afe admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:35.762120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995708ac-8023-453d-a669-1ec3784a2afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:35.764006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995708ac-8023-453d-a669-1ec3784a2afe admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:35.779429 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2613/5190] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:20:35.783787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff84a5-5796-4a7d-8a22-1238c7423eec admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:35.812672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff84a5-5796-4a7d-8a22-1238c7423eec admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:35.854447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c55ca-62ac-4d26-9c69-32f85808f6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:35.858802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c55ca-62ac-4d26-9c69-32f85808f6ec admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:35.859291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c55ca-62ac-4d26-9c69-32f85808f6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:35.862608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c55ca-62ac-4d26-9c69-32f85808f6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:35.865121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c55ca-62ac-4d26-9c69-32f85808f6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:35.871580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c55ca-62ac-4d26-9c69-32f85808f6ec admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:35.901963 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2578/5191] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:20:35.903267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995708ac-8023-453d-a669-1ec3784a2afe admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:35.918594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995708ac-8023-453d-a669-1ec3784a2afe admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:35.932241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55e291-7de8-48ab-8af4-caafc0c4225d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:35.934103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55e291-7de8-48ab-8af4-caafc0c4225d admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:35.934103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55e291-7de8-48ab-8af4-caafc0c4225d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:35.934103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55e291-7de8-48ab-8af4-caafc0c4225d admin admin] PATH_INFO: `/v3/projects/44ceefe86e694dc8a2c9a478eeb1d1c5/users/a90caf8a110549e39bbaf7ec50a6207d/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:35.972441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55e291-7de8-48ab-8af4-caafc0c4225d admin admin] RBAC: Authorizing `identity:create_grant(project_id=44ceefe86e694dc8a2c9a478eeb1d1c5, user_id=a90caf8a110549e39bbaf7ec50a6207d, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:35.978865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55e291-7de8-48ab-8af4-caafc0c4225d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:36.007618 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2614/5192] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:20:35 2022] PUT /identity/v3/projects/44ceefe86e694dc8a2c9a478eeb1d1c5/users/a90caf8a110549e39bbaf7ec50a6207d/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:36.013452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d67b6a-5643-4d0a-8103-f088d9cd4756 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:36.017437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d67b6a-5643-4d0a-8103-f088d9cd4756 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:36.017729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d67b6a-5643-4d0a-8103-f088d9cd4756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:36.028622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55e291-7de8-48ab-8af4-caafc0c4225d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:36.032860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0f55e291-7de8-48ab-8af4-caafc0c4225d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:36.086421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-87d67b6a-5643-4d0a-8103-f088d9cd4756 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:36.087505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-87d67b6a-5643-4d0a-8103-f088d9cd4756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:36.111100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:36.135638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:36.221794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55e291-7de8-48ab-8af4-caafc0c4225d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:36.238415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db928e4-f1fc-4402-a9b1-5abd600e3948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:36.240967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db928e4-f1fc-4402-a9b1-5abd600e3948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:36.244693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db928e4-f1fc-4402-a9b1-5abd600e3948 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:36.246053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db928e4-f1fc-4402-a9b1-5abd600e3948 admin admin] PATH_INFO: `/v3/users/1ab5af7b863740afb627155828fa6a51` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:36.248116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db928e4-f1fc-4402-a9b1-5abd600e3948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab5af7b863740afb627155828fa6a51)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:36.253585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db928e4-f1fc-4402-a9b1-5abd600e3948 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:36.262949 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2579/5193] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:36.291271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d67b6a-5643-4d0a-8103-f088d9cd4756 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:36.293084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-87d67b6a-5643-4d0a-8103-f088d9cd4756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:36.387279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6db928e4-f1fc-4402-a9b1-5abd600e3948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab5af7b863740afb627155828fa6a51'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:36.411389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6db928e4-f1fc-4402-a9b1-5abd600e3948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab5af7b863740afb627155828fa6a51'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:36.412312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6db928e4-f1fc-4402-a9b1-5abd600e3948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab5af7b863740afb627155828fa6a51'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:36.413883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6db928e4-f1fc-4402-a9b1-5abd600e3948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab5af7b863740afb627155828fa6a51'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:36.447197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6db928e4-f1fc-4402-a9b1-5abd600e3948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab5af7b863740afb627155828fa6a51'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:36.470603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d67b6a-5643-4d0a-8103-f088d9cd4756 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:36.477918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8346253-f0b0-417f-b3fb-974f9cbdb79a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:36.478994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8346253-f0b0-417f-b3fb-974f9cbdb79a service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:36.479462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8346253-f0b0-417f-b3fb-974f9cbdb79a service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:36.479893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8346253-f0b0-417f-b3fb-974f9cbdb79a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:36.482294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e8346253-f0b0-417f-b3fb-974f9cbdb79a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:36.498768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8346253-f0b0-417f-b3fb-974f9cbdb79a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:36.500987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8346253-f0b0-417f-b3fb-974f9cbdb79a service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:36.512742 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2615/5194] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:20:36 2022] DELETE /identity/v3/users/1ab5af7b863740afb627155828fa6a51 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:36.520775 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2580/5195] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:20:37.916487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db928e4-f1fc-4402-a9b1-5abd600e3948 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:37.918755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6db928e4-f1fc-4402-a9b1-5abd600e3948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:38.001274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db928e4-f1fc-4402-a9b1-5abd600e3948 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:38.007374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbdfbf-7781-4a40-afae-1f5335443aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:38.008441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbdfbf-7781-4a40-afae-1f5335443aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:38.008784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbdfbf-7781-4a40-afae-1f5335443aef admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:38.009287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbdfbf-7781-4a40-afae-1f5335443aef admin admin] PATH_INFO: `/v3/projects/2285f4b2708d4e6b9199bf99155b3636` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:38.010747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbdfbf-7781-4a40-afae-1f5335443aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=2285f4b2708d4e6b9199bf99155b3636)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:38.012881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbdfbf-7781-4a40-afae-1f5335443aef admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:38.109262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:38.112139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-22bbdfbf-7781-4a40-afae-1f5335443aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2285f4b2708d4e6b9199bf99155b3636', 'request_id': 'req-22bbdfbf-7781-4a40-afae-1f5335443aef'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:38.127743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-22bbdfbf-7781-4a40-afae-1f5335443aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2285f4b2708d4e6b9199bf99155b3636', 'request_id': 'req-22bbdfbf-7781-4a40-afae-1f5335443aef'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:38.137219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-22bbdfbf-7781-4a40-afae-1f5335443aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2285f4b2708d4e6b9199bf99155b3636', 'request_id': 'req-22bbdfbf-7781-4a40-afae-1f5335443aef'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:38.151538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-22bbdfbf-7781-4a40-afae-1f5335443aef admin admin] The token cache is being invalidate because project 2285f4b2708d4e6b9199bf99155b3636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:20:38.152486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-22bbdfbf-7781-4a40-afae-1f5335443aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:38.152604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-22bbdfbf-7781-4a40-afae-1f5335443aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:38.158149 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2616/5196] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:20:37 2022] DELETE /identity/v3/projects/2285f4b2708d4e6b9199bf99155b3636 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:38.159709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3d16f-a4cb-4f3a-888a-1f7caf70de32 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:38.160241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3d16f-a4cb-4f3a-888a-1f7caf70de32 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:38.160241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3d16f-a4cb-4f3a-888a-1f7caf70de32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:38.196179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-92b3d16f-a4cb-4f3a-888a-1f7caf70de32 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:38.198212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-92b3d16f-a4cb-4f3a-888a-1f7caf70de32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:38.284810 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2581/5197] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:38.293499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a6eb5-43d4-44f0-9a01-b270a1711a45 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:38.293801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a6eb5-43d4-44f0-9a01-b270a1711a45 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:38.294060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a6eb5-43d4-44f0-9a01-b270a1711a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:38.314607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-512a6eb5-43d4-44f0-9a01-b270a1711a45 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:38.316094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-512a6eb5-43d4-44f0-9a01-b270a1711a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:38.328385 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2617/5198] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:38.329659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3d16f-a4cb-4f3a-888a-1f7caf70de32 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:38.345203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3d16f-a4cb-4f3a-888a-1f7caf70de32 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:38.353300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d29d8-7a14-415d-83bb-5b5a818652c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:38.354853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d29d8-7a14-415d-83bb-5b5a818652c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:38.355139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d29d8-7a14-415d-83bb-5b5a818652c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:38.355509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d29d8-7a14-415d-83bb-5b5a818652c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:38.356223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d29d8-7a14-415d-83bb-5b5a818652c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:20:38.356523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d29d8-7a14-415d-83bb-5b5a818652c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:38.358197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d29d8-7a14-415d-83bb-5b5a818652c8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:38.372079 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2582/5199] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:20:38.449515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a6eb5-43d4-44f0-9a01-b270a1711a45 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:38.460718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a6eb5-43d4-44f0-9a01-b270a1711a45 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:38.467521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf5b4a-d939-46b4-8e34-0fcf7eaa3abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:38.468880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf5b4a-d939-46b4-8e34-0fcf7eaa3abe admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:38.468880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf5b4a-d939-46b4-8e34-0fcf7eaa3abe admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:38.469105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf5b4a-d939-46b4-8e34-0fcf7eaa3abe admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:38.469879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf5b4a-d939-46b4-8e34-0fcf7eaa3abe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:38.472079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf5b4a-d939-46b4-8e34-0fcf7eaa3abe admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:38.507096 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2618/5200] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:20:38 2022] POST /identity/v3/projects => generated 363 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:20:38.511345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d29d8-7a14-415d-83bb-5b5a818652c8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:38.523641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d29d8-7a14-415d-83bb-5b5a818652c8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:38.571612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:38.606783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbe664-b31e-4a11-b673-f2690adcca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:38.607970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbe664-b31e-4a11-b673-f2690adcca0a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:38.608296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbe664-b31e-4a11-b673-f2690adcca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:38.608750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbe664-b31e-4a11-b673-f2690adcca0a admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:38.609527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbe664-b31e-4a11-b673-f2690adcca0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:38.611498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbe664-b31e-4a11-b673-f2690adcca0a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:38.645226 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2583/5201] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:20:38 2022] POST /identity/v3/users => generated 282 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:20:38.647449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf5b4a-d939-46b4-8e34-0fcf7eaa3abe admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:38.659859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf5b4a-d939-46b4-8e34-0fcf7eaa3abe admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:38.664732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa599a-c188-4a2c-af4d-6cf397f45017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:38.665410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa599a-c188-4a2c-af4d-6cf397f45017 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:38.665693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa599a-c188-4a2c-af4d-6cf397f45017 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:38.665971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa599a-c188-4a2c-af4d-6cf397f45017 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:38.666695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa599a-c188-4a2c-af4d-6cf397f45017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:38.668395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa599a-c188-4a2c-af4d-6cf397f45017 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:38.684631 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2619/5202] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:20:38.686052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbe664-b31e-4a11-b673-f2690adcca0a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:38.697115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbe664-b31e-4a11-b673-f2690adcca0a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:38.702075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55c21e-ad9b-4910-a6c5-75f33fffc60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:38.702687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55c21e-ad9b-4910-a6c5-75f33fffc60f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:38.702977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55c21e-ad9b-4910-a6c5-75f33fffc60f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:38.703939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55c21e-ad9b-4910-a6c5-75f33fffc60f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:38.706670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55c21e-ad9b-4910-a6c5-75f33fffc60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:38.706670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55c21e-ad9b-4910-a6c5-75f33fffc60f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:38.723329 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2584/5203] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:20:38.724709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa599a-c188-4a2c-af4d-6cf397f45017 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:38.737389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa599a-c188-4a2c-af4d-6cf397f45017 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:38.743605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799feab-abc4-4521-9cb7-0b27ea1d04e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:38.744799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799feab-abc4-4521-9cb7-0b27ea1d04e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:38.744799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799feab-abc4-4521-9cb7-0b27ea1d04e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:38.745164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799feab-abc4-4521-9cb7-0b27ea1d04e7 admin admin] PATH_INFO: `/v3/projects/ada57eeadbb9443c9f42dc99310ef8de/users/fa780176ae5f4a618e42a47531b0d4a5/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:38.764902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799feab-abc4-4521-9cb7-0b27ea1d04e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada57eeadbb9443c9f42dc99310ef8de, user_id=fa780176ae5f4a618e42a47531b0d4a5, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:38.768207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799feab-abc4-4521-9cb7-0b27ea1d04e7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:38.793309 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2620/5204] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:20:38 2022] PUT /identity/v3/projects/ada57eeadbb9443c9f42dc99310ef8de/users/fa780176ae5f4a618e42a47531b0d4a5/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:38.799123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4b8b7-6322-4b60-8206-5141d914e2bb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:38.799411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4b8b7-6322-4b60-8206-5141d914e2bb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:38.799729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4b8b7-6322-4b60-8206-5141d914e2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:38.830523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a5f4b8b7-6322-4b60-8206-5141d914e2bb None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:38.832944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a5f4b8b7-6322-4b60-8206-5141d914e2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:38.946995 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2585/5205] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:38.998272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799feab-abc4-4521-9cb7-0b27ea1d04e7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:39.001033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7799feab-abc4-4521-9cb7-0b27ea1d04e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:39.081872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799feab-abc4-4521-9cb7-0b27ea1d04e7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:39.081872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b014ea-0f4b-4156-a06a-337177890e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:39.081872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b014ea-0f4b-4156-a06a-337177890e32 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:39.081872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b014ea-0f4b-4156-a06a-337177890e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:39.082392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b014ea-0f4b-4156-a06a-337177890e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:39.093434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b014ea-0f4b-4156-a06a-337177890e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:39.095172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b014ea-0f4b-4156-a06a-337177890e32 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:39.108182 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2621/5206] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:20:43.322428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4b8b7-6322-4b60-8206-5141d914e2bb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:43.324798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a5f4b8b7-6322-4b60-8206-5141d914e2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:43.377114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4b8b7-6322-4b60-8206-5141d914e2bb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:43.395929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2582b13-fc48-4a72-95cd-c144f44ea00d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:43.396787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2582b13-fc48-4a72-95cd-c144f44ea00d service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:43.397139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2582b13-fc48-4a72-95cd-c144f44ea00d service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:43.397477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2582b13-fc48-4a72-95cd-c144f44ea00d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:43.403629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d2582b13-fc48-4a72-95cd-c144f44ea00d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:43.587789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2582b13-fc48-4a72-95cd-c144f44ea00d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:43.589292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2582b13-fc48-4a72-95cd-c144f44ea00d service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:43.615484 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2586/5207] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:20:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:20:49.102681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=60,keystone:INSERT=3,keystone:DELETE=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:52.267401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b014ea-0f4b-4156-a06a-337177890e32 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:52.270863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-07b014ea-0f4b-4156-a06a-337177890e32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:52.441153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b014ea-0f4b-4156-a06a-337177890e32 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:52.459932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a3ade-d664-41f1-8011-79038aabaa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:52.462525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a3ade-d664-41f1-8011-79038aabaa77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:52.463784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a3ade-d664-41f1-8011-79038aabaa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:52.464809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a3ade-d664-41f1-8011-79038aabaa77 admin admin] PATH_INFO: `/v3/users/4e2f3260319f40858f1fec2d708d3c87` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:52.470869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a3ade-d664-41f1-8011-79038aabaa77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e2f3260319f40858f1fec2d708d3c87)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:52.478786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a3ade-d664-41f1-8011-79038aabaa77 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:52.604617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-962a3ade-d664-41f1-8011-79038aabaa77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e2f3260319f40858f1fec2d708d3c87'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:52.629285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-962a3ade-d664-41f1-8011-79038aabaa77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e2f3260319f40858f1fec2d708d3c87'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:52.630588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-962a3ade-d664-41f1-8011-79038aabaa77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e2f3260319f40858f1fec2d708d3c87'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:52.631527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-962a3ade-d664-41f1-8011-79038aabaa77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e2f3260319f40858f1fec2d708d3c87'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:52.648692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-962a3ade-d664-41f1-8011-79038aabaa77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e2f3260319f40858f1fec2d708d3c87'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:52.723595 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2622/5208] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:20:52 2022] DELETE /identity/v3/users/4e2f3260319f40858f1fec2d708d3c87 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:53.150945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2582b13-fc48-4a72-95cd-c144f44ea00d service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:53.152900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d2582b13-fc48-4a72-95cd-c144f44ea00d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:53.224706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2582b13-fc48-4a72-95cd-c144f44ea00d service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:53.272374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:53.315659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f19b52-b130-4ab5-86ca-877241a1be49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:53.316958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f19b52-b130-4ab5-86ca-877241a1be49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:53.317697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f19b52-b130-4ab5-86ca-877241a1be49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:53.317838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f19b52-b130-4ab5-86ca-877241a1be49 admin admin] PATH_INFO: `/v3/users/0f5b2e7e4efe478abdc85fc51fa064de` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:53.319456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f19b52-b130-4ab5-86ca-877241a1be49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f5b2e7e4efe478abdc85fc51fa064de)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:53.322771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f19b52-b130-4ab5-86ca-877241a1be49 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:53.446648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-54f19b52-b130-4ab5-86ca-877241a1be49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f5b2e7e4efe478abdc85fc51fa064de'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:53.475994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-54f19b52-b130-4ab5-86ca-877241a1be49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f5b2e7e4efe478abdc85fc51fa064de'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:53.504270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-54f19b52-b130-4ab5-86ca-877241a1be49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f5b2e7e4efe478abdc85fc51fa064de'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:53.505890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-54f19b52-b130-4ab5-86ca-877241a1be49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f5b2e7e4efe478abdc85fc51fa064de'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:53.506922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-54f19b52-b130-4ab5-86ca-877241a1be49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f5b2e7e4efe478abdc85fc51fa064de'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:53.525834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a3ade-d664-41f1-8011-79038aabaa77 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:53.528260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-962a3ade-d664-41f1-8011-79038aabaa77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:53.556421 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2587/5209] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:20:53 2022] DELETE /identity/v3/users/0f5b2e7e4efe478abdc85fc51fa064de => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:53.559779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a3ade-d664-41f1-8011-79038aabaa77 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:53.642111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b6930-43b1-4744-a2a1-8dad74c6c3b0 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:53.643168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b6930-43b1-4744-a2a1-8dad74c6c3b0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:53.643168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b6930-43b1-4744-a2a1-8dad74c6c3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:53.738776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5d6b6930-43b1-4744-a2a1-8dad74c6c3b0 None None] MFA Rules not processed for user `fa780176ae5f4a618e42a47531b0d4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:53.742534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5d6b6930-43b1-4744-a2a1-8dad74c6c3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:53.790989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d67cc-0926-4871-bde2-28a4435dd768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:53.792347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d67cc-0926-4871-bde2-28a4435dd768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:53.792843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d67cc-0926-4871-bde2-28a4435dd768 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:53.793327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d67cc-0926-4871-bde2-28a4435dd768 admin admin] PATH_INFO: `/v3/projects/526d9ed0cb294ddcadf746f088e0fcbc` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:53.795601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d67cc-0926-4871-bde2-28a4435dd768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=526d9ed0cb294ddcadf746f088e0fcbc)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:53.800593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d67cc-0926-4871-bde2-28a4435dd768 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:53.839466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:53.905916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e9d67cc-0926-4871-bde2-28a4435dd768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526d9ed0cb294ddcadf746f088e0fcbc', 'request_id': 'req-9e9d67cc-0926-4871-bde2-28a4435dd768'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:53.934988 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2588/5210] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:53.935233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e9d67cc-0926-4871-bde2-28a4435dd768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526d9ed0cb294ddcadf746f088e0fcbc', 'request_id': 'req-9e9d67cc-0926-4871-bde2-28a4435dd768'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:53.943331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e9d67cc-0926-4871-bde2-28a4435dd768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526d9ed0cb294ddcadf746f088e0fcbc', 'request_id': 'req-9e9d67cc-0926-4871-bde2-28a4435dd768'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:53.947420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196233d-8931-4bed-83df-dcc58fd478bd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:53.947714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196233d-8931-4bed-83df-dcc58fd478bd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:53.947997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196233d-8931-4bed-83df-dcc58fd478bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:53.971937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e9d67cc-0926-4871-bde2-28a4435dd768 admin admin] The token cache is being invalidate because project 526d9ed0cb294ddcadf746f088e0fcbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:20:53.972764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e9d67cc-0926-4871-bde2-28a4435dd768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:53.974300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e9d67cc-0926-4871-bde2-28a4435dd768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:53.976659 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2623/5211] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:20:53 2022] DELETE /identity/v3/projects/526d9ed0cb294ddcadf746f088e0fcbc => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:53.984090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff787e-62a1-4189-8fab-4dbb7b4b1fbd None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:53.984649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff787e-62a1-4189-8fab-4dbb7b4b1fbd None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:53.985107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff787e-62a1-4189-8fab-4dbb7b4b1fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:53.988070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d196233d-8931-4bed-83df-dcc58fd478bd None None] MFA Rules not processed for user `fa780176ae5f4a618e42a47531b0d4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:53.989808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d196233d-8931-4bed-83df-dcc58fd478bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:54.065178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:54.128460 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2589/5212] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:54.129823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196233d-8931-4bed-83df-dcc58fd478bd None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:54.131585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-83ff787e-62a1-4189-8fab-4dbb7b4b1fbd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:54.132689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d196233d-8931-4bed-83df-dcc58fd478bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:54.132899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-83ff787e-62a1-4189-8fab-4dbb7b4b1fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:54.306857 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2624/5213] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:54.308920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988a227-28c9-4fde-8129-142fb8659fc3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:54.309933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988a227-28c9-4fde-8129-142fb8659fc3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:54.310220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988a227-28c9-4fde-8129-142fb8659fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:54.321319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196233d-8931-4bed-83df-dcc58fd478bd None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:54.333055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ba031-7946-40d9-aaed-df1902bba6f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:54.337387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ba031-7946-40d9-aaed-df1902bba6f9 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:54.338160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ba031-7946-40d9-aaed-df1902bba6f9 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:54.338606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ba031-7946-40d9-aaed-df1902bba6f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:54.342842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5d4ba031-7946-40d9-aaed-df1902bba6f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:54.358751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ba031-7946-40d9-aaed-df1902bba6f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:54.360837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ba031-7946-40d9-aaed-df1902bba6f9 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:54.365680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c988a227-28c9-4fde-8129-142fb8659fc3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:54.366929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c988a227-28c9-4fde-8129-142fb8659fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:54.389909 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2590/5214] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:20:54 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:20:54.393788 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2625/5215] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:54.399174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ba031-7946-40d9-aaed-df1902bba6f9 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:54.441500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ba031-7946-40d9-aaed-df1902bba6f9 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:54.458483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbed3fe-5122-44ee-aafd-7f453da9e921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:54.459173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbed3fe-5122-44ee-aafd-7f453da9e921 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:54.459458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbed3fe-5122-44ee-aafd-7f453da9e921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:54.459733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbed3fe-5122-44ee-aafd-7f453da9e921 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:54.460510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbed3fe-5122-44ee-aafd-7f453da9e921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:20:54.460818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbed3fe-5122-44ee-aafd-7f453da9e921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:54.463455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbed3fe-5122-44ee-aafd-7f453da9e921 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:54.547796 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2591/5216] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:20:54.552764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988a227-28c9-4fde-8129-142fb8659fc3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:54.563803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988a227-28c9-4fde-8129-142fb8659fc3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:54.592087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3bdef-00d1-48f9-86b1-9ea6617c58f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:54.592935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3bdef-00d1-48f9-86b1-9ea6617c58f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:54.593347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3bdef-00d1-48f9-86b1-9ea6617c58f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:54.593715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3bdef-00d1-48f9-86b1-9ea6617c58f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:54.594518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3bdef-00d1-48f9-86b1-9ea6617c58f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:54.598880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3bdef-00d1-48f9-86b1-9ea6617c58f3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:54.638822 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2626/5217] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:20:54 2022] POST /identity/v3/projects => generated 403 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:20:54.645069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbed3fe-5122-44ee-aafd-7f453da9e921 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:54.659919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbed3fe-5122-44ee-aafd-7f453da9e921 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:54.740222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88030d-4ea5-4b84-b776-43b6335e1851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:54.741336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88030d-4ea5-4b84-b776-43b6335e1851 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:54.741620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88030d-4ea5-4b84-b776-43b6335e1851 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:54.741969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88030d-4ea5-4b84-b776-43b6335e1851 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:54.743055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88030d-4ea5-4b84-b776-43b6335e1851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:54.746783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88030d-4ea5-4b84-b776-43b6335e1851 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:54.774130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3bdef-00d1-48f9-86b1-9ea6617c58f3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:54.776752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-73e3bdef-00d1-48f9-86b1-9ea6617c58f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:54.814068 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2592/5218] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:20:54 2022] POST /identity/v3/users => generated 302 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:20:54.816814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88030d-4ea5-4b84-b776-43b6335e1851 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:54.825706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3bdef-00d1-48f9-86b1-9ea6617c58f3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:54.842452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88030d-4ea5-4b84-b776-43b6335e1851 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:54.843935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921ab81-4645-4d11-8428-1a003fe6160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:54.845009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921ab81-4645-4d11-8428-1a003fe6160e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:54.845682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921ab81-4645-4d11-8428-1a003fe6160e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:54.846130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921ab81-4645-4d11-8428-1a003fe6160e admin admin] PATH_INFO: `/v3/projects/b7da173babe7403fa85f5aab929e3068` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:54.849534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921ab81-4645-4d11-8428-1a003fe6160e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7da173babe7403fa85f5aab929e3068)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:54.857713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921ab81-4645-4d11-8428-1a003fe6160e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:54.864729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275de7f7-3973-4338-a349-41453f46f8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:54.867102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275de7f7-3973-4338-a349-41453f46f8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:54.867633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275de7f7-3973-4338-a349-41453f46f8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:54.868936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275de7f7-3973-4338-a349-41453f46f8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:54.876428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275de7f7-3973-4338-a349-41453f46f8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:54.884497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275de7f7-3973-4338-a349-41453f46f8a6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:54.929825 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2593/5219] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:20:54.932959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275de7f7-3973-4338-a349-41453f46f8a6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:54.989230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275de7f7-3973-4338-a349-41453f46f8a6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:55.009283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25e832-02b5-4af4-bd7c-131b5bf3c7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:55.014644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:55.016827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25e832-02b5-4af4-bd7c-131b5bf3c7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:55.017209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25e832-02b5-4af4-bd7c-131b5bf3c7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:55.017503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25e832-02b5-4af4-bd7c-131b5bf3c7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:55.018212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f921ab81-4645-4d11-8428-1a003fe6160e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7da173babe7403fa85f5aab929e3068', 'request_id': 'req-f921ab81-4645-4d11-8428-1a003fe6160e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:55.018439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25e832-02b5-4af4-bd7c-131b5bf3c7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:55.023374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25e832-02b5-4af4-bd7c-131b5bf3c7a4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:55.033921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f921ab81-4645-4d11-8428-1a003fe6160e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7da173babe7403fa85f5aab929e3068', 'request_id': 'req-f921ab81-4645-4d11-8428-1a003fe6160e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:55.048755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f921ab81-4645-4d11-8428-1a003fe6160e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7da173babe7403fa85f5aab929e3068', 'request_id': 'req-f921ab81-4645-4d11-8428-1a003fe6160e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:55.067742 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2594/5220] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:20:55.072027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25e832-02b5-4af4-bd7c-131b5bf3c7a4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:55.092948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f921ab81-4645-4d11-8428-1a003fe6160e admin admin] The token cache is being invalidate because project b7da173babe7403fa85f5aab929e3068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:20:55.094683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f921ab81-4645-4d11-8428-1a003fe6160e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:55.095686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f921ab81-4645-4d11-8428-1a003fe6160e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:55.105428 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2627/5221] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:20:54 2022] DELETE /identity/v3/projects/b7da173babe7403fa85f5aab929e3068 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:55.107489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921ab81-4645-4d11-8428-1a003fe6160e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:55.109369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f921ab81-4645-4d11-8428-1a003fe6160e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:55.112860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25e832-02b5-4af4-bd7c-131b5bf3c7a4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:55.173794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:55.234863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921ab81-4645-4d11-8428-1a003fe6160e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:55.239989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc05419-0a84-4099-8cbb-899ead34a7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:55.240914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc05419-0a84-4099-8cbb-899ead34a7eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:55.241195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc05419-0a84-4099-8cbb-899ead34a7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:55.241475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc05419-0a84-4099-8cbb-899ead34a7eb admin admin] PATH_INFO: `/v3/users/7ba1811c5fc342fd931553bc3682d866` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:55.242715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc05419-0a84-4099-8cbb-899ead34a7eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ba1811c5fc342fd931553bc3682d866)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:55.244880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc05419-0a84-4099-8cbb-899ead34a7eb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:55.309204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4e0ef-ac0e-4497-ae34-0a2c1d1d9f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:55.311340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4e0ef-ac0e-4497-ae34-0a2c1d1d9f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:55.313018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4e0ef-ac0e-4497-ae34-0a2c1d1d9f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:55.313018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4e0ef-ac0e-4497-ae34-0a2c1d1d9f23 admin admin] PATH_INFO: `/v3/projects/ad1df6fda0134ce08a3e921d39b492a0/users/d9f8239340f54318b607562c61c19238/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:55.337886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4e0ef-ac0e-4497-ae34-0a2c1d1d9f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1df6fda0134ce08a3e921d39b492a0, user_id=d9f8239340f54318b607562c61c19238, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:55.342564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4e0ef-ac0e-4497-ae34-0a2c1d1d9f23 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:55.370149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4cc05419-0a84-4099-8cbb-899ead34a7eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ba1811c5fc342fd931553bc3682d866'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:55.380483 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2595/5222] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:20:55 2022] PUT /identity/v3/projects/ad1df6fda0134ce08a3e921d39b492a0/users/d9f8239340f54318b607562c61c19238/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:55.391361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4cc05419-0a84-4099-8cbb-899ead34a7eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ba1811c5fc342fd931553bc3682d866'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:55.391986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4cc05419-0a84-4099-8cbb-899ead34a7eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ba1811c5fc342fd931553bc3682d866'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:55.392779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4cc05419-0a84-4099-8cbb-899ead34a7eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ba1811c5fc342fd931553bc3682d866'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:55.406745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c07a3d-46f9-4bc4-a94c-2d4aca813251 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:55.407281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c07a3d-46f9-4bc4-a94c-2d4aca813251 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:55.407727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c07a3d-46f9-4bc4-a94c-2d4aca813251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:55.410494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4cc05419-0a84-4099-8cbb-899ead34a7eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ba1811c5fc342fd931553bc3682d866'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:55.451347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c5c07a3d-46f9-4bc4-a94c-2d4aca813251 None None] MFA Rules not processed for user `a90caf8a110549e39bbaf7ec50a6207d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:55.453112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c5c07a3d-46f9-4bc4-a94c-2d4aca813251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:55.465594 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2628/5223] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:20:55 2022] DELETE /identity/v3/users/7ba1811c5fc342fd931553bc3682d866 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:55.467554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac51776-33b7-439d-bb8a-4b2dcf38ff0c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:55.467703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac51776-33b7-439d-bb8a-4b2dcf38ff0c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:55.467987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac51776-33b7-439d-bb8a-4b2dcf38ff0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:55.577413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-aac51776-33b7-439d-bb8a-4b2dcf38ff0c None None] MFA Rules not processed for user `d9f8239340f54318b607562c61c19238`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:55.577413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-aac51776-33b7-439d-bb8a-4b2dcf38ff0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:55.708514 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2596/5224] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:55.723121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c07a3d-46f9-4bc4-a94c-2d4aca813251 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:55.724606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c5c07a3d-46f9-4bc4-a94c-2d4aca813251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:55.727179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:55.804267 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2629/5225] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:56.030223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:56.045839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c07a3d-46f9-4bc4-a94c-2d4aca813251 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:56.052669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9aded-1be1-49fd-9bb2-f9c1dbea13a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:56.053353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9aded-1be1-49fd-9bb2-f9c1dbea13a6 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:56.053637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9aded-1be1-49fd-9bb2-f9c1dbea13a6 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:56.054070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9aded-1be1-49fd-9bb2-f9c1dbea13a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:56.063470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9aded-1be1-49fd-9bb2-f9c1dbea13a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:56.065382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9aded-1be1-49fd-9bb2-f9c1dbea13a6 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:56.097305 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2597/5226] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:20:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:20:56.198744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac51776-33b7-439d-bb8a-4b2dcf38ff0c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:56.200993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-aac51776-33b7-439d-bb8a-4b2dcf38ff0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:56.427777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac51776-33b7-439d-bb8a-4b2dcf38ff0c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:56.433731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f32fee-f2c3-40c1-a4f1-8a25c874dc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:56.434847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f32fee-f2c3-40c1-a4f1-8a25c874dc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:56.435226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f32fee-f2c3-40c1-a4f1-8a25c874dc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:56.435603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f32fee-f2c3-40c1-a4f1-8a25c874dc27 admin admin] PATH_INFO: `/v3/users/d9f8239340f54318b607562c61c19238` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:56.437541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f32fee-f2c3-40c1-a4f1-8a25c874dc27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f8239340f54318b607562c61c19238)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:56.442441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f32fee-f2c3-40c1-a4f1-8a25c874dc27 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:56.568932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-26f32fee-f2c3-40c1-a4f1-8a25c874dc27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f8239340f54318b607562c61c19238'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:56.599446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-26f32fee-f2c3-40c1-a4f1-8a25c874dc27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f8239340f54318b607562c61c19238'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:56.600248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-26f32fee-f2c3-40c1-a4f1-8a25c874dc27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f8239340f54318b607562c61c19238'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:56.601019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-26f32fee-f2c3-40c1-a4f1-8a25c874dc27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f8239340f54318b607562c61c19238'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:56.614538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-26f32fee-f2c3-40c1-a4f1-8a25c874dc27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f8239340f54318b607562c61c19238'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:56.669797 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2630/5227] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:20:56 2022] DELETE /identity/v3/users/d9f8239340f54318b607562c61c19238 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:56.674550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbea0b6-2415-461c-83b7-54c9445c2c22 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:56.675102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbea0b6-2415-461c-83b7-54c9445c2c22 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:56.676171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbea0b6-2415-461c-83b7-54c9445c2c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:56.728296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-dfbea0b6-2415-461c-83b7-54c9445c2c22 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:56.729596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dfbea0b6-2415-461c-83b7-54c9445c2c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:56.917958 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2598/5228] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:20:56.953146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f32fee-f2c3-40c1-a4f1-8a25c874dc27 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:56.955885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-26f32fee-f2c3-40c1-a4f1-8a25c874dc27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:57.150480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f32fee-f2c3-40c1-a4f1-8a25c874dc27 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:57.155456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ecae0-6dba-4cec-96fd-8a6fdfe481e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:57.156536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ecae0-6dba-4cec-96fd-8a6fdfe481e3 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:57.156892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ecae0-6dba-4cec-96fd-8a6fdfe481e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:57.157395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ecae0-6dba-4cec-96fd-8a6fdfe481e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:57.168806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:57.176297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ecae0-6dba-4cec-96fd-8a6fdfe481e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:57.182702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ecae0-6dba-4cec-96fd-8a6fdfe481e3 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:57.201712 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2631/5229] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:20:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:20:57.464021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbea0b6-2415-461c-83b7-54c9445c2c22 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:57.465592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dfbea0b6-2415-461c-83b7-54c9445c2c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:57.488328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbea0b6-2415-461c-83b7-54c9445c2c22 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:57.504515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b336b5-1a94-4701-a3c0-51f02333c2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:57.507471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b336b5-1a94-4701-a3c0-51f02333c2e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:57.507764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b336b5-1a94-4701-a3c0-51f02333c2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:57.508105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b336b5-1a94-4701-a3c0-51f02333c2e3 admin admin] PATH_INFO: `/v3/projects/eda7085d60394c79b9efc8b998c7cba1` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:57.511760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b336b5-1a94-4701-a3c0-51f02333c2e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eda7085d60394c79b9efc8b998c7cba1)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:57.521614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b336b5-1a94-4701-a3c0-51f02333c2e3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:57.666883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-61b336b5-1a94-4701-a3c0-51f02333c2e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda7085d60394c79b9efc8b998c7cba1', 'request_id': 'req-61b336b5-1a94-4701-a3c0-51f02333c2e3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:57.676533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-61b336b5-1a94-4701-a3c0-51f02333c2e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda7085d60394c79b9efc8b998c7cba1', 'request_id': 'req-61b336b5-1a94-4701-a3c0-51f02333c2e3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:57.686822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-61b336b5-1a94-4701-a3c0-51f02333c2e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda7085d60394c79b9efc8b998c7cba1', 'request_id': 'req-61b336b5-1a94-4701-a3c0-51f02333c2e3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:57.711965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-61b336b5-1a94-4701-a3c0-51f02333c2e3 admin admin] The token cache is being invalidate because project eda7085d60394c79b9efc8b998c7cba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:20:57.712766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-61b336b5-1a94-4701-a3c0-51f02333c2e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:57.713661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-61b336b5-1a94-4701-a3c0-51f02333c2e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:57.728853 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2599/5230] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:20:57 2022] DELETE /identity/v3/projects/eda7085d60394c79b9efc8b998c7cba1 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:57.731088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5d9bb-563a-44d6-9fbb-6ebebd1b1104 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:57.731797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5d9bb-563a-44d6-9fbb-6ebebd1b1104 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:57.732187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5d9bb-563a-44d6-9fbb-6ebebd1b1104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:57.790318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9af5d9bb-563a-44d6-9fbb-6ebebd1b1104 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:57.796890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9af5d9bb-563a-44d6-9fbb-6ebebd1b1104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:57.984595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b336b5-1a94-4701-a3c0-51f02333c2e3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:57.986868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-61b336b5-1a94-4701-a3c0-51f02333c2e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:58.002441 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2632/5231] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:58.006139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efaa4a3-bde6-4145-a8b4-fb2e639538be None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:58.006139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efaa4a3-bde6-4145-a8b4-fb2e639538be None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:58.006364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efaa4a3-bde6-4145-a8b4-fb2e639538be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:58.038490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1efaa4a3-bde6-4145-a8b4-fb2e639538be None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:58.045362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1efaa4a3-bde6-4145-a8b4-fb2e639538be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:58.073378 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2633/5232] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:58.077585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efaa4a3-bde6-4145-a8b4-fb2e639538be None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:58.109165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efaa4a3-bde6-4145-a8b4-fb2e639538be None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:58.124876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909aa977-ab54-4f78-b3d1-4d9a837ff920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:58.125593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909aa977-ab54-4f78-b3d1-4d9a837ff920 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:58.126222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909aa977-ab54-4f78-b3d1-4d9a837ff920 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:58.126367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909aa977-ab54-4f78-b3d1-4d9a837ff920 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:58.127120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909aa977-ab54-4f78-b3d1-4d9a837ff920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:20:58.130588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909aa977-ab54-4f78-b3d1-4d9a837ff920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:58.132736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909aa977-ab54-4f78-b3d1-4d9a837ff920 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:58.178877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b336b5-1a94-4701-a3c0-51f02333c2e3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:58.184935 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2634/5233] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:20:58.186268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909aa977-ab54-4f78-b3d1-4d9a837ff920 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:58.193191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9f7ec-5ba7-4dba-88d4-3e3d8a4a3f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:58.193940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9f7ec-5ba7-4dba-88d4-3e3d8a4a3f68 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:58.194210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9f7ec-5ba7-4dba-88d4-3e3d8a4a3f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:58.194529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9f7ec-5ba7-4dba-88d4-3e3d8a4a3f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:58.198515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-aae9f7ec-5ba7-4dba-88d4-3e3d8a4a3f68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:58.231441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909aa977-ab54-4f78-b3d1-4d9a837ff920 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:58.239330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cff261-50dd-4d15-a12b-7f081522f74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:58.240408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cff261-50dd-4d15-a12b-7f081522f74a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:58.240914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cff261-50dd-4d15-a12b-7f081522f74a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:58.241391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cff261-50dd-4d15-a12b-7f081522f74a admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:58.242460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cff261-50dd-4d15-a12b-7f081522f74a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:58.245278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cff261-50dd-4d15-a12b-7f081522f74a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:58.270377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:58.314667 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2635/5234] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:20:58 2022] POST /identity/v3/projects => generated 391 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:20:58.318075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cff261-50dd-4d15-a12b-7f081522f74a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:58.438758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9f7ec-5ba7-4dba-88d4-3e3d8a4a3f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:58.441834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9f7ec-5ba7-4dba-88d4-3e3d8a4a3f68 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:58.476587 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2600/5235] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:20:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:20:58.478103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9f7ec-5ba7-4dba-88d4-3e3d8a4a3f68 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:58.482560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cff261-50dd-4d15-a12b-7f081522f74a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:58.487088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53337c8d-4d90-4821-890c-ebd5adde4aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:58.487938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53337c8d-4d90-4821-890c-ebd5adde4aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:58.488271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53337c8d-4d90-4821-890c-ebd5adde4aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:58.488527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53337c8d-4d90-4821-890c-ebd5adde4aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:58.490631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-53337c8d-4d90-4821-890c-ebd5adde4aa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:58.496512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9f7ec-5ba7-4dba-88d4-3e3d8a4a3f68 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:58.590494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44372461-b0d5-45fe-8834-9184e272c7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:58.590915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44372461-b0d5-45fe-8834-9184e272c7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:58.591280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44372461-b0d5-45fe-8834-9184e272c7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:58.591562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44372461-b0d5-45fe-8834-9184e272c7d9 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:58.592545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44372461-b0d5-45fe-8834-9184e272c7d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:58.595404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44372461-b0d5-45fe-8834-9184e272c7d9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:58.633734 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2601/5236] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:20:58 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:20:58.635523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44372461-b0d5-45fe-8834-9184e272c7d9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:58.638201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-44372461-b0d5-45fe-8834-9184e272c7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:58.650174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:58.656785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44372461-b0d5-45fe-8834-9184e272c7d9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:58.657412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53337c8d-4d90-4821-890c-ebd5adde4aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:58.661385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53337c8d-4d90-4821-890c-ebd5adde4aa4 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:58.662837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008eed8-755e-4b3b-ac23-0f36f620d74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:58.663934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008eed8-755e-4b3b-ac23-0f36f620d74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:58.664254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008eed8-755e-4b3b-ac23-0f36f620d74e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:58.664533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008eed8-755e-4b3b-ac23-0f36f620d74e admin admin] PATH_INFO: `/v3/projects/ad1df6fda0134ce08a3e921d39b492a0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:58.665819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008eed8-755e-4b3b-ac23-0f36f620d74e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1df6fda0134ce08a3e921d39b492a0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:58.668161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008eed8-755e-4b3b-ac23-0f36f620d74e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:58.696968 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2636/5237] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:20:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:20:58.699160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53337c8d-4d90-4821-890c-ebd5adde4aa4 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:58.719166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53337c8d-4d90-4821-890c-ebd5adde4aa4 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:58.740651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5298889-aa52-4c81-9550-9788afe0468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:58.742576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5298889-aa52-4c81-9550-9788afe0468c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:58.743091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5298889-aa52-4c81-9550-9788afe0468c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:58.743622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5298889-aa52-4c81-9550-9788afe0468c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:58.744703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5298889-aa52-4c81-9550-9788afe0468c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:58.748990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5298889-aa52-4c81-9550-9788afe0468c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:58.769685 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2637/5238] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:20:58.782801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5298889-aa52-4c81-9550-9788afe0468c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:58.797208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5298889-aa52-4c81-9550-9788afe0468c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:58.821806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6008eed8-755e-4b3b-ac23-0f36f620d74e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1df6fda0134ce08a3e921d39b492a0', 'request_id': 'req-6008eed8-755e-4b3b-ac23-0f36f620d74e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:58.832540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6008eed8-755e-4b3b-ac23-0f36f620d74e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1df6fda0134ce08a3e921d39b492a0', 'request_id': 'req-6008eed8-755e-4b3b-ac23-0f36f620d74e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:58.841662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6008eed8-755e-4b3b-ac23-0f36f620d74e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1df6fda0134ce08a3e921d39b492a0', 'request_id': 'req-6008eed8-755e-4b3b-ac23-0f36f620d74e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:58.878419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6008eed8-755e-4b3b-ac23-0f36f620d74e admin admin] The token cache is being invalidate because project ad1df6fda0134ce08a3e921d39b492a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:20:58.878867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6008eed8-755e-4b3b-ac23-0f36f620d74e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:58.879792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6008eed8-755e-4b3b-ac23-0f36f620d74e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:20:58.890522 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2602/5239] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:20:58 2022] DELETE /identity/v3/projects/ad1df6fda0134ce08a3e921d39b492a0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:58.900121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2203238-068f-41bf-a04f-baa92525a592 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:58.900836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2203238-068f-41bf-a04f-baa92525a592 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:58.901774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2203238-068f-41bf-a04f-baa92525a592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:58.956415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e2203238-068f-41bf-a04f-baa92525a592 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:58.958682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e2203238-068f-41bf-a04f-baa92525a592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:59.028511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f6952-f8ec-4969-8621-6e95526082ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:59.030012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f6952-f8ec-4969-8621-6e95526082ff admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:59.030474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f6952-f8ec-4969-8621-6e95526082ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:59.030898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f6952-f8ec-4969-8621-6e95526082ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:59.031792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f6952-f8ec-4969-8621-6e95526082ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:59.033835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f6952-f8ec-4969-8621-6e95526082ff admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:59.048799 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2638/5240] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:20:59.052103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:59.053264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f6952-f8ec-4969-8621-6e95526082ff admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:59.058330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-828f6952-f8ec-4969-8621-6e95526082ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:59.110629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f6952-f8ec-4969-8621-6e95526082ff admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:59.129601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a562549-83c2-43dd-9bdf-402d6e8ff85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:59.134680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a562549-83c2-43dd-9bdf-402d6e8ff85f admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:59.136386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a562549-83c2-43dd-9bdf-402d6e8ff85f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:59.136859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a562549-83c2-43dd-9bdf-402d6e8ff85f admin admin] PATH_INFO: `/v3/projects/e693f5f3d3df486696086ea98714bcbf/users/e1b7350d87a14f6dbd97ba52e3ed0a7d/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:59.183606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a562549-83c2-43dd-9bdf-402d6e8ff85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e693f5f3d3df486696086ea98714bcbf, user_id=e1b7350d87a14f6dbd97ba52e3ed0a7d, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:59.191005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a562549-83c2-43dd-9bdf-402d6e8ff85f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:59.194869 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2603/5241] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:59.208589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd36b50-095c-46b1-b105-7700e9c9c720 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:59.208589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd36b50-095c-46b1-b105-7700e9c9c720 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:59.208589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd36b50-095c-46b1-b105-7700e9c9c720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:59.229992 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2639/5242] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:20:59 2022] PUT /identity/v3/projects/e693f5f3d3df486696086ea98714bcbf/users/e1b7350d87a14f6dbd97ba52e3ed0a7d/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:20:59.246144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3edd2-f4f6-4773-a1b8-c25754835831 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:59.246476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3edd2-f4f6-4773-a1b8-c25754835831 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:59.246713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3edd2-f4f6-4773-a1b8-c25754835831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:59.266089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1fd36b50-095c-46b1-b105-7700e9c9c720 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:59.268154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1fd36b50-095c-46b1-b105-7700e9c9c720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:59.308781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a5a3edd2-f4f6-4773-a1b8-c25754835831 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:20:59.310099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a5a3edd2-f4f6-4773-a1b8-c25754835831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:59.460530 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2604/5243] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:20:59.465233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd36b50-095c-46b1-b105-7700e9c9c720 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:59.485952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd36b50-095c-46b1-b105-7700e9c9c720 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:59.493163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729ef2e-a2c8-4b6c-a568-8d352d0d4d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:59.494826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729ef2e-a2c8-4b6c-a568-8d352d0d4d5e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:59.495269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729ef2e-a2c8-4b6c-a568-8d352d0d4d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:59.495697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729ef2e-a2c8-4b6c-a568-8d352d0d4d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:59.496627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729ef2e-a2c8-4b6c-a568-8d352d0d4d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:20:59.497085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729ef2e-a2c8-4b6c-a568-8d352d0d4d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:59.499164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729ef2e-a2c8-4b6c-a568-8d352d0d4d5e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:59.523308 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2605/5244] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:20:59.527519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729ef2e-a2c8-4b6c-a568-8d352d0d4d5e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:59.536090 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2640/5245] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:20:59.541959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729ef2e-a2c8-4b6c-a568-8d352d0d4d5e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:59.549100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058c306-7cd5-469b-a09d-54c4128ad878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:59.561582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058c306-7cd5-469b-a09d-54c4128ad878 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:59.562317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058c306-7cd5-469b-a09d-54c4128ad878 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:59.565557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058c306-7cd5-469b-a09d-54c4128ad878 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:59.566605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058c306-7cd5-469b-a09d-54c4128ad878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:59.569775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058c306-7cd5-469b-a09d-54c4128ad878 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:59.581258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3edd2-f4f6-4773-a1b8-c25754835831 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:59.583841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a5a3edd2-f4f6-4773-a1b8-c25754835831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:20:59.622345 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2606/5246] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:20:59 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:20:59.626496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058c306-7cd5-469b-a09d-54c4128ad878 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:59.752674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3edd2-f4f6-4773-a1b8-c25754835831 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:59.770364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:59.823988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058c306-7cd5-469b-a09d-54c4128ad878 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:59.838031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c99500-6f4e-4576-87f9-08b84aab02c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:59.840855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c99500-6f4e-4576-87f9-08b84aab02c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:59.842600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c99500-6f4e-4576-87f9-08b84aab02c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:59.843633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c99500-6f4e-4576-87f9-08b84aab02c9 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:59.844669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c99500-6f4e-4576-87f9-08b84aab02c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:59.850838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c99500-6f4e-4576-87f9-08b84aab02c9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:59.853726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88d68e-43ff-49d4-b384-0ec953c973b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:59.855025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88d68e-43ff-49d4-b384-0ec953c973b1 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:59.855836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88d68e-43ff-49d4-b384-0ec953c973b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:59.856369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88d68e-43ff-49d4-b384-0ec953c973b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:59.884015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88d68e-43ff-49d4-b384-0ec953c973b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:20:59.885633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88d68e-43ff-49d4-b384-0ec953c973b1 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:20:59.915449 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2607/5247] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:20:59 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:20:59.922459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c99500-6f4e-4576-87f9-08b84aab02c9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:20:59.943228 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2641/5248] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:20:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:20:59.959100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c99500-6f4e-4576-87f9-08b84aab02c9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:20:59.989637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ddbb7-0614-4f8d-a09f-2426c8082273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:20:59.990849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ddbb7-0614-4f8d-a09f-2426c8082273 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:20:59.990849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ddbb7-0614-4f8d-a09f-2426c8082273 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:20:59.991126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ddbb7-0614-4f8d-a09f-2426c8082273 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:20:59.992945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ddbb7-0614-4f8d-a09f-2426c8082273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:00.001178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ddbb7-0614-4f8d-a09f-2426c8082273 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:00.034090 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2608/5249] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:00.038178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88d68e-43ff-49d4-b384-0ec953c973b1 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:00.056645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88d68e-43ff-49d4-b384-0ec953c973b1 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:00.071237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08ca3a-1c89-4ecd-9713-fbfa4361802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:00.085478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08ca3a-1c89-4ecd-9713-fbfa4361802a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:00.085780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08ca3a-1c89-4ecd-9713-fbfa4361802a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:00.086111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08ca3a-1c89-4ecd-9713-fbfa4361802a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:00.086932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08ca3a-1c89-4ecd-9713-fbfa4361802a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:00.089244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08ca3a-1c89-4ecd-9713-fbfa4361802a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:00.111190 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2642/5250] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:21:00.115528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ddbb7-0614-4f8d-a09f-2426c8082273 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:00.131188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ddbb7-0614-4f8d-a09f-2426c8082273 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:00.137311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f2db6-fa83-4599-9c0b-0345b9e5e267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:00.138838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f2db6-fa83-4599-9c0b-0345b9e5e267 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:00.139374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f2db6-fa83-4599-9c0b-0345b9e5e267 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:00.139806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f2db6-fa83-4599-9c0b-0345b9e5e267 admin admin] PATH_INFO: `/v3/projects/e0e36018113d4554813f4a6009840645/users/cfa647de6a8f46deb29fd8fc0803e52f/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:00.164496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:00.184936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f2db6-fa83-4599-9c0b-0345b9e5e267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e36018113d4554813f4a6009840645, user_id=cfa647de6a8f46deb29fd8fc0803e52f, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:00.189835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f2db6-fa83-4599-9c0b-0345b9e5e267 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:00.236600 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2609/5251] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:00 2022] PUT /identity/v3/projects/e0e36018113d4554813f4a6009840645/users/cfa647de6a8f46deb29fd8fc0803e52f/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:00.239249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99764575-2808-4559-9ca2-d1e8da15fd98 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:00.239610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99764575-2808-4559-9ca2-d1e8da15fd98 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:00.239896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99764575-2808-4559-9ca2-d1e8da15fd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:00.287280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-99764575-2808-4559-9ca2-d1e8da15fd98 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:00.289155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-99764575-2808-4559-9ca2-d1e8da15fd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:00.468986 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2643/5252] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:00.492899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f2db6-fa83-4599-9c0b-0345b9e5e267 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:00.632826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f2db6-fa83-4599-9c0b-0345b9e5e267 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:00.640568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cffa35-4093-4c41-8a2a-740f7f59919d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:00.641824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cffa35-4093-4c41-8a2a-740f7f59919d service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:00.642849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cffa35-4093-4c41-8a2a-740f7f59919d service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:00.642849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cffa35-4093-4c41-8a2a-740f7f59919d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:00.657446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cffa35-4093-4c41-8a2a-740f7f59919d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:00.659235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cffa35-4093-4c41-8a2a-740f7f59919d service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:00.674006 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2610/5253] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:01.782606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac36ae-9bc0-4fe4-8ce0-de8fe08170a7 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:01.783900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac36ae-9bc0-4fe4-8ce0-de8fe08170a7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:01.783900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac36ae-9bc0-4fe4-8ce0-de8fe08170a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:01.841553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-33ac36ae-9bc0-4fe4-8ce0-de8fe08170a7 None None] MFA Rules not processed for user `cfa647de6a8f46deb29fd8fc0803e52f`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:01.842808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-33ac36ae-9bc0-4fe4-8ce0-de8fe08170a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:01.984622 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2644/5254] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:21:01.995329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdad11-fa8a-463f-97be-c6a7e59628b2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:01.997000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdad11-fa8a-463f-97be-c6a7e59628b2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:01.997657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdad11-fa8a-463f-97be-c6a7e59628b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:02.049683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0ccdad11-fa8a-463f-97be-c6a7e59628b2 None None] MFA Rules not processed for user `cfa647de6a8f46deb29fd8fc0803e52f`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:02.057255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0ccdad11-fa8a-463f-97be-c6a7e59628b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:02.084033 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2611/5255] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:02.101307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac36ae-9bc0-4fe4-8ce0-de8fe08170a7 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:02.104012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-33ac36ae-9bc0-4fe4-8ce0-de8fe08170a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:02.183644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:02.242745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80aaba-6ae9-4b4c-8c2e-7dca4741146c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:02.242994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80aaba-6ae9-4b4c-8c2e-7dca4741146c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:02.243113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80aaba-6ae9-4b4c-8c2e-7dca4741146c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:02.283119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3c80aaba-6ae9-4b4c-8c2e-7dca4741146c None None] MFA Rules not processed for user `a90caf8a110549e39bbaf7ec50a6207d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:02.284561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3c80aaba-6ae9-4b4c-8c2e-7dca4741146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:02.290125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac36ae-9bc0-4fe4-8ce0-de8fe08170a7 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:02.303010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd1ae6-9fdd-46e5-a80f-83774d07f753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:02.303628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd1ae6-9fdd-46e5-a80f-83774d07f753 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:02.303906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd1ae6-9fdd-46e5-a80f-83774d07f753 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:02.304219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd1ae6-9fdd-46e5-a80f-83774d07f753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:02.327388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd1ae6-9fdd-46e5-a80f-83774d07f753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:02.329067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd1ae6-9fdd-46e5-a80f-83774d07f753 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:02.358752 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2645/5256] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:02.397099 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2612/5257] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:21:04.707287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd1ae6-9fdd-46e5-a80f-83774d07f753 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:04.729480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd1ae6-9fdd-46e5-a80f-83774d07f753 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:04.742829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24eb46-815b-43e7-9877-92f5c27ff430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:04.744020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24eb46-815b-43e7-9877-92f5c27ff430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:04.744489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24eb46-815b-43e7-9877-92f5c27ff430 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:04.744939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24eb46-815b-43e7-9877-92f5c27ff430 admin admin] PATH_INFO: `/v3/users/cfa647de6a8f46deb29fd8fc0803e52f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:04.751495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24eb46-815b-43e7-9877-92f5c27ff430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfa647de6a8f46deb29fd8fc0803e52f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:04.754510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24eb46-815b-43e7-9877-92f5c27ff430 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:04.869012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ef24eb46-815b-43e7-9877-92f5c27ff430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfa647de6a8f46deb29fd8fc0803e52f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:04.896154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ef24eb46-815b-43e7-9877-92f5c27ff430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfa647de6a8f46deb29fd8fc0803e52f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:04.896755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ef24eb46-815b-43e7-9877-92f5c27ff430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfa647de6a8f46deb29fd8fc0803e52f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:04.897384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ef24eb46-815b-43e7-9877-92f5c27ff430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfa647de6a8f46deb29fd8fc0803e52f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:04.910077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ef24eb46-815b-43e7-9877-92f5c27ff430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfa647de6a8f46deb29fd8fc0803e52f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:04.948886 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2646/5258] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:04 2022] DELETE /identity/v3/users/cfa647de6a8f46deb29fd8fc0803e52f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:06.529896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80aaba-6ae9-4b4c-8c2e-7dca4741146c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:06.558941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80aaba-6ae9-4b4c-8c2e-7dca4741146c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:06.716565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c677a14-d68d-4998-bd5d-8c34e0995f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:06.718582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c677a14-d68d-4998-bd5d-8c34e0995f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:06.719009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c677a14-d68d-4998-bd5d-8c34e0995f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:06.719447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c677a14-d68d-4998-bd5d-8c34e0995f8a admin admin] PATH_INFO: `/v3/projects/e0e36018113d4554813f4a6009840645` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:06.728966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c677a14-d68d-4998-bd5d-8c34e0995f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0e36018113d4554813f4a6009840645)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:06.731187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c677a14-d68d-4998-bd5d-8c34e0995f8a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:06.786055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:06.808798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c677a14-d68d-4998-bd5d-8c34e0995f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0e36018113d4554813f4a6009840645', 'request_id': 'req-2c677a14-d68d-4998-bd5d-8c34e0995f8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:06.816900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c677a14-d68d-4998-bd5d-8c34e0995f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0e36018113d4554813f4a6009840645', 'request_id': 'req-2c677a14-d68d-4998-bd5d-8c34e0995f8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:06.825964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c677a14-d68d-4998-bd5d-8c34e0995f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0e36018113d4554813f4a6009840645', 'request_id': 'req-2c677a14-d68d-4998-bd5d-8c34e0995f8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:06.853567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c677a14-d68d-4998-bd5d-8c34e0995f8a admin admin] The token cache is being invalidate because project e0e36018113d4554813f4a6009840645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:06.854154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c677a14-d68d-4998-bd5d-8c34e0995f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:06.855022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c677a14-d68d-4998-bd5d-8c34e0995f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:06.862629 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2613/5259] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:06 2022] DELETE /identity/v3/projects/e0e36018113d4554813f4a6009840645 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:06.867922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4be39-04d5-4e8d-bce4-f00abcb4f0e6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:06.868839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4be39-04d5-4e8d-bce4-f00abcb4f0e6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:06.869711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4be39-04d5-4e8d-bce4-f00abcb4f0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:06.918700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-cbc4be39-04d5-4e8d-bce4-f00abcb4f0e6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:06.919987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cbc4be39-04d5-4e8d-bce4-f00abcb4f0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:07.065260 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2647/5260] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:07.074529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f35a5-9fef-4baa-8a54-6e9398bb7076 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:07.074815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f35a5-9fef-4baa-8a54-6e9398bb7076 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:07.075123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f35a5-9fef-4baa-8a54-6e9398bb7076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:07.134008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f66f35a5-9fef-4baa-8a54-6e9398bb7076 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:07.135663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f66f35a5-9fef-4baa-8a54-6e9398bb7076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:07.160963 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2614/5261] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:07.162126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4be39-04d5-4e8d-bce4-f00abcb4f0e6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:07.179038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4be39-04d5-4e8d-bce4-f00abcb4f0e6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:07.187051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83150948-2f04-4ff4-88b9-4c6f2ae49648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:07.188718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83150948-2f04-4ff4-88b9-4c6f2ae49648 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:07.189683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83150948-2f04-4ff4-88b9-4c6f2ae49648 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:07.191990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83150948-2f04-4ff4-88b9-4c6f2ae49648 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:07.193207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83150948-2f04-4ff4-88b9-4c6f2ae49648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:21:07.195124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83150948-2f04-4ff4-88b9-4c6f2ae49648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:07.198467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83150948-2f04-4ff4-88b9-4c6f2ae49648 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:07.272652 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2648/5262] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:21:07.273907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f35a5-9fef-4baa-8a54-6e9398bb7076 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:07.294493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f35a5-9fef-4baa-8a54-6e9398bb7076 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:07.348568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e0f43-2ffb-47a1-b42c-d0df3698cbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:07.349614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e0f43-2ffb-47a1-b42c-d0df3698cbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:07.359950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e0f43-2ffb-47a1-b42c-d0df3698cbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:07.360299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e0f43-2ffb-47a1-b42c-d0df3698cbf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:07.361059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e0f43-2ffb-47a1-b42c-d0df3698cbf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:07.365957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e0f43-2ffb-47a1-b42c-d0df3698cbf1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:07.427194 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2615/5263] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:07 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:07.430355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83150948-2f04-4ff4-88b9-4c6f2ae49648 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:07.445952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83150948-2f04-4ff4-88b9-4c6f2ae49648 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:07.508938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:07.585475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfa6de-9c32-4e04-b8ee-f1fc4059fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:07.586262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfa6de-9c32-4e04-b8ee-f1fc4059fbe3 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:07.586621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfa6de-9c32-4e04-b8ee-f1fc4059fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:07.587652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfa6de-9c32-4e04-b8ee-f1fc4059fbe3 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:07.590055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbfa6de-9c32-4e04-b8ee-f1fc4059fbe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:07.595676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbfa6de-9c32-4e04-b8ee-f1fc4059fbe3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:07.633561 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2649/5264] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:07 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:21:07.634789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e0f43-2ffb-47a1-b42c-d0df3698cbf1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:07.647848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e0f43-2ffb-47a1-b42c-d0df3698cbf1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:07.653647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd191b0a-adb0-481a-bbf8-2dcf469c559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:07.654580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd191b0a-adb0-481a-bbf8-2dcf469c559b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:07.655015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd191b0a-adb0-481a-bbf8-2dcf469c559b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:07.655719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd191b0a-adb0-481a-bbf8-2dcf469c559b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:07.656837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd191b0a-adb0-481a-bbf8-2dcf469c559b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:07.659005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd191b0a-adb0-481a-bbf8-2dcf469c559b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:07.679648 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2616/5265] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:07.683344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfa6de-9c32-4e04-b8ee-f1fc4059fbe3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:07.697709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfa6de-9c32-4e04-b8ee-f1fc4059fbe3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:07.710386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aa041-43f9-4f3d-a7bc-05ae6a4b5938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:07.711230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aa041-43f9-4f3d-a7bc-05ae6a4b5938 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:07.711614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aa041-43f9-4f3d-a7bc-05ae6a4b5938 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:07.711989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aa041-43f9-4f3d-a7bc-05ae6a4b5938 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:07.715751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771aa041-43f9-4f3d-a7bc-05ae6a4b5938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:07.717562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771aa041-43f9-4f3d-a7bc-05ae6a4b5938 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:07.733986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd191b0a-adb0-481a-bbf8-2dcf469c559b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:07.741226 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2650/5266] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:07.745261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd191b0a-adb0-481a-bbf8-2dcf469c559b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:07.750945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553a4e5-d7bf-40c2-9ab2-632fd4d0352d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:07.752380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553a4e5-d7bf-40c2-9ab2-632fd4d0352d admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:07.753468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553a4e5-d7bf-40c2-9ab2-632fd4d0352d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:07.753967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553a4e5-d7bf-40c2-9ab2-632fd4d0352d admin admin] PATH_INFO: `/v3/projects/0e3d8ce95c454de9bea4c3a1beff5678/users/b89bdaabad8b49c789e5382df34c1cb2/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:07.783834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553a4e5-d7bf-40c2-9ab2-632fd4d0352d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3d8ce95c454de9bea4c3a1beff5678, user_id=b89bdaabad8b49c789e5382df34c1cb2, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:07.787254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553a4e5-d7bf-40c2-9ab2-632fd4d0352d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:07.821367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f128a72-47bd-4701-befa-4b3ba04d2700 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:07.822523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f128a72-47bd-4701-befa-4b3ba04d2700 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:07.822523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f128a72-47bd-4701-befa-4b3ba04d2700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:07.822871 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2617/5267] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:07 2022] PUT /identity/v3/projects/0e3d8ce95c454de9bea4c3a1beff5678/users/b89bdaabad8b49c789e5382df34c1cb2/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:21:07.861773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8f128a72-47bd-4701-befa-4b3ba04d2700 None None] MFA Rules not processed for user `b89bdaabad8b49c789e5382df34c1cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:07.865505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8f128a72-47bd-4701-befa-4b3ba04d2700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:07.990042 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2651/5268] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:07.994906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553a4e5-d7bf-40c2-9ab2-632fd4d0352d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:07.997574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b553a4e5-d7bf-40c2-9ab2-632fd4d0352d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:08.117022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553a4e5-d7bf-40c2-9ab2-632fd4d0352d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:08.127578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eea68-f0f3-48d4-bcce-a67dbefabd2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:08.129528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eea68-f0f3-48d4-bcce-a67dbefabd2e service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:08.130111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eea68-f0f3-48d4-bcce-a67dbefabd2e service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:08.130594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eea68-f0f3-48d4-bcce-a67dbefabd2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:08.147631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eea68-f0f3-48d4-bcce-a67dbefabd2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:08.149659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eea68-f0f3-48d4-bcce-a67dbefabd2e service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:08.163991 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2618/5269] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:09.588127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f128a72-47bd-4701-befa-4b3ba04d2700 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:09.589735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8f128a72-47bd-4701-befa-4b3ba04d2700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:09.754239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f128a72-47bd-4701-befa-4b3ba04d2700 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:09.761803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ee643-a39c-4e8d-997e-de4eaddcfb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:09.763812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ee643-a39c-4e8d-997e-de4eaddcfb71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:09.764529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ee643-a39c-4e8d-997e-de4eaddcfb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:09.765226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ee643-a39c-4e8d-997e-de4eaddcfb71 admin admin] PATH_INFO: `/v3/users/577cbf73e11d478191a100a6cdd104b6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:09.766661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ee643-a39c-4e8d-997e-de4eaddcfb71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=577cbf73e11d478191a100a6cdd104b6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:09.769025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ee643-a39c-4e8d-997e-de4eaddcfb71 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:09.884303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:09.930018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-740ee643-a39c-4e8d-997e-de4eaddcfb71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '577cbf73e11d478191a100a6cdd104b6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:09.954710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-740ee643-a39c-4e8d-997e-de4eaddcfb71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '577cbf73e11d478191a100a6cdd104b6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:09.959437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-740ee643-a39c-4e8d-997e-de4eaddcfb71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '577cbf73e11d478191a100a6cdd104b6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:09.961786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-740ee643-a39c-4e8d-997e-de4eaddcfb71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '577cbf73e11d478191a100a6cdd104b6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:09.974584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-740ee643-a39c-4e8d-997e-de4eaddcfb71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '577cbf73e11d478191a100a6cdd104b6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:10.023740 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2652/5270] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:09 2022] DELETE /identity/v3/users/577cbf73e11d478191a100a6cdd104b6 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:10.028537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c4cf7-6822-42c2-92a7-dbeb58a6e623 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:10.029098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c4cf7-6822-42c2-92a7-dbeb58a6e623 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:10.029253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c4cf7-6822-42c2-92a7-dbeb58a6e623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:10.089871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-656c4cf7-6822-42c2-92a7-dbeb58a6e623 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:10.091612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-656c4cf7-6822-42c2-92a7-dbeb58a6e623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:10.214840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:10.325806 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2619/5271] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:10.357447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ee643-a39c-4e8d-997e-de4eaddcfb71 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:10.359021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-740ee643-a39c-4e8d-997e-de4eaddcfb71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:10.424373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c4cf7-6822-42c2-92a7-dbeb58a6e623 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:10.426389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-656c4cf7-6822-42c2-92a7-dbeb58a6e623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:10.509802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ee643-a39c-4e8d-997e-de4eaddcfb71 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:10.525002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958117d4-611a-4492-a258-b8f1abe5177f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:10.531184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958117d4-611a-4492-a258-b8f1abe5177f service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:10.531490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958117d4-611a-4492-a258-b8f1abe5177f service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:10.531782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958117d4-611a-4492-a258-b8f1abe5177f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:10.541504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-958117d4-611a-4492-a258-b8f1abe5177f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:10.566803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958117d4-611a-4492-a258-b8f1abe5177f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:10.568336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958117d4-611a-4492-a258-b8f1abe5177f service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:10.581210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c4cf7-6822-42c2-92a7-dbeb58a6e623 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:10.594584 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2653/5272] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:10.598949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d6ce6-40ca-4507-93eb-6883759208b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:10.599868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d6ce6-40ca-4507-93eb-6883759208b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:10.600539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d6ce6-40ca-4507-93eb-6883759208b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:10.600972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d6ce6-40ca-4507-93eb-6883759208b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:10.633111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d6ce6-40ca-4507-93eb-6883759208b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:10.634848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d6ce6-40ca-4507-93eb-6883759208b9 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:10.649833 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2620/5273] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:11.592908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958117d4-611a-4492-a258-b8f1abe5177f service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:11.600008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-958117d4-611a-4492-a258-b8f1abe5177f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:11.646240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958117d4-611a-4492-a258-b8f1abe5177f service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:11.652319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ce633-522b-4bf4-ab41-6cbe2b414c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:11.657179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ce633-522b-4bf4-ab41-6cbe2b414c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:11.657765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ce633-522b-4bf4-ab41-6cbe2b414c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:11.659060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ce633-522b-4bf4-ab41-6cbe2b414c5c admin admin] PATH_INFO: `/v3/projects/46b545c4258140f2a620e24f216d3c64` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:11.661004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ce633-522b-4bf4-ab41-6cbe2b414c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=46b545c4258140f2a620e24f216d3c64)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:11.663769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ce633-522b-4bf4-ab41-6cbe2b414c5c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:11.790572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b53ce633-522b-4bf4-ab41-6cbe2b414c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46b545c4258140f2a620e24f216d3c64', 'request_id': 'req-b53ce633-522b-4bf4-ab41-6cbe2b414c5c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:11.805174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b53ce633-522b-4bf4-ab41-6cbe2b414c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46b545c4258140f2a620e24f216d3c64', 'request_id': 'req-b53ce633-522b-4bf4-ab41-6cbe2b414c5c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:11.813187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b53ce633-522b-4bf4-ab41-6cbe2b414c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46b545c4258140f2a620e24f216d3c64', 'request_id': 'req-b53ce633-522b-4bf4-ab41-6cbe2b414c5c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:11.828245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b53ce633-522b-4bf4-ab41-6cbe2b414c5c admin admin] The token cache is being invalidate because project 46b545c4258140f2a620e24f216d3c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:11.828878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b53ce633-522b-4bf4-ab41-6cbe2b414c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:11.830675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b53ce633-522b-4bf4-ab41-6cbe2b414c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:11.836278 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2654/5274] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:11 2022] DELETE /identity/v3/projects/46b545c4258140f2a620e24f216d3c64 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:11.837671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d6ce6-40ca-4507-93eb-6883759208b9 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:11.858832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ce633-522b-4bf4-ab41-6cbe2b414c5c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:11.862544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d6ce6-40ca-4507-93eb-6883759208b9 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:11.863859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b53ce633-522b-4bf4-ab41-6cbe2b414c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:11.945568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:12.001829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55f891-7cc7-4255-97d9-da60dacb7865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:12.003059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55f891-7cc7-4255-97d9-da60dacb7865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:12.003350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55f891-7cc7-4255-97d9-da60dacb7865 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:12.003623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55f891-7cc7-4255-97d9-da60dacb7865 admin admin] PATH_INFO: `/v3/users/1ab7cfd433de42cb85864ee3e8aced84` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:12.005449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ce633-522b-4bf4-ab41-6cbe2b414c5c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:12.007409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55f891-7cc7-4255-97d9-da60dacb7865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab7cfd433de42cb85864ee3e8aced84)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:12.009432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55f891-7cc7-4255-97d9-da60dacb7865 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:12.028620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c1dc4-4f82-4100-a8aa-b7a59c05cfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:12.029577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c1dc4-4f82-4100-a8aa-b7a59c05cfc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:12.029929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c1dc4-4f82-4100-a8aa-b7a59c05cfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:12.030158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c1dc4-4f82-4100-a8aa-b7a59c05cfc4 admin admin] PATH_INFO: `/v3/users/b89bdaabad8b49c789e5382df34c1cb2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:12.038287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c1dc4-4f82-4100-a8aa-b7a59c05cfc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b89bdaabad8b49c789e5382df34c1cb2)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:12.045355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c1dc4-4f82-4100-a8aa-b7a59c05cfc4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:12.180607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa55f891-7cc7-4255-97d9-da60dacb7865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab7cfd433de42cb85864ee3e8aced84'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:12.196753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa55f891-7cc7-4255-97d9-da60dacb7865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab7cfd433de42cb85864ee3e8aced84'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:12.215493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa55f891-7cc7-4255-97d9-da60dacb7865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab7cfd433de42cb85864ee3e8aced84'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:12.217815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-158c1dc4-4f82-4100-a8aa-b7a59c05cfc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b89bdaabad8b49c789e5382df34c1cb2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:12.218239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa55f891-7cc7-4255-97d9-da60dacb7865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab7cfd433de42cb85864ee3e8aced84'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:12.219807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa55f891-7cc7-4255-97d9-da60dacb7865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab7cfd433de42cb85864ee3e8aced84'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:12.239100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-158c1dc4-4f82-4100-a8aa-b7a59c05cfc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b89bdaabad8b49c789e5382df34c1cb2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:12.239871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-158c1dc4-4f82-4100-a8aa-b7a59c05cfc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b89bdaabad8b49c789e5382df34c1cb2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:12.240744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-158c1dc4-4f82-4100-a8aa-b7a59c05cfc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b89bdaabad8b49c789e5382df34c1cb2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:12.252561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-158c1dc4-4f82-4100-a8aa-b7a59c05cfc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b89bdaabad8b49c789e5382df34c1cb2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:12.279129 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2621/5275] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:11 2022] DELETE /identity/v3/users/1ab7cfd433de42cb85864ee3e8aced84 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:12.298964 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2655/5276] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:11 2022] DELETE /identity/v3/users/b89bdaabad8b49c789e5382df34c1cb2 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:12.301040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfc76e-7b03-485a-bf8c-6596be237a69 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:12.301320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfc76e-7b03-485a-bf8c-6596be237a69 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:12.301662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfc76e-7b03-485a-bf8c-6596be237a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:12.310009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:12.362678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8acfc76e-7b03-485a-bf8c-6596be237a69 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:12.365600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8acfc76e-7b03-485a-bf8c-6596be237a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:12.511646 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2622/5277] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:12.964906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c1dc4-4f82-4100-a8aa-b7a59c05cfc4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:12.968444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-158c1dc4-4f82-4100-a8aa-b7a59c05cfc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:13.119138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c1dc4-4f82-4100-a8aa-b7a59c05cfc4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:13.139299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5b501-c86c-459f-a9de-e6ee3d6273f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:13.140004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5b501-c86c-459f-a9de-e6ee3d6273f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:13.140298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5b501-c86c-459f-a9de-e6ee3d6273f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:13.141526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5b501-c86c-459f-a9de-e6ee3d6273f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:13.157953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5b501-c86c-459f-a9de-e6ee3d6273f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:13.159659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5b501-c86c-459f-a9de-e6ee3d6273f8 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:13.186975 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2656/5278] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:13.738694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfc76e-7b03-485a-bf8c-6596be237a69 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:13.740902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8acfc76e-7b03-485a-bf8c-6596be237a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:13.767213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfc76e-7b03-485a-bf8c-6596be237a69 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:13.774532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c042da-506d-4f55-b4ec-41cf78ed98a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:13.775426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c042da-506d-4f55-b4ec-41cf78ed98a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:13.776519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c042da-506d-4f55-b4ec-41cf78ed98a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:13.776796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c042da-506d-4f55-b4ec-41cf78ed98a5 admin admin] PATH_INFO: `/v3/projects/0e3d8ce95c454de9bea4c3a1beff5678` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:13.778028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c042da-506d-4f55-b4ec-41cf78ed98a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e3d8ce95c454de9bea4c3a1beff5678)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:13.780925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c042da-506d-4f55-b4ec-41cf78ed98a5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:13.857611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7c042da-506d-4f55-b4ec-41cf78ed98a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e3d8ce95c454de9bea4c3a1beff5678', 'request_id': 'req-e7c042da-506d-4f55-b4ec-41cf78ed98a5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:13.875578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7c042da-506d-4f55-b4ec-41cf78ed98a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e3d8ce95c454de9bea4c3a1beff5678', 'request_id': 'req-e7c042da-506d-4f55-b4ec-41cf78ed98a5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:13.883935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7c042da-506d-4f55-b4ec-41cf78ed98a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e3d8ce95c454de9bea4c3a1beff5678', 'request_id': 'req-e7c042da-506d-4f55-b4ec-41cf78ed98a5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:13.909203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7c042da-506d-4f55-b4ec-41cf78ed98a5 admin admin] The token cache is being invalidate because project 0e3d8ce95c454de9bea4c3a1beff5678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:13.909511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7c042da-506d-4f55-b4ec-41cf78ed98a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:13.910505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7c042da-506d-4f55-b4ec-41cf78ed98a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:13.913816 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2623/5279] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:13 2022] DELETE /identity/v3/projects/0e3d8ce95c454de9bea4c3a1beff5678 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:21:13.918643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac47cd-ca5a-4581-9c60-310ca24ab215 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:13.918929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac47cd-ca5a-4581-9c60-310ca24ab215 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:13.919171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac47cd-ca5a-4581-9c60-310ca24ab215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:13.955853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-12ac47cd-ca5a-4581-9c60-310ca24ab215 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:13.957843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-12ac47cd-ca5a-4581-9c60-310ca24ab215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:14.021942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:14.041058 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2657/5280] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:14.048935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33118a52-07d9-46a2-8802-3c3dab407213 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:14.049386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33118a52-07d9-46a2-8802-3c3dab407213 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:14.049728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33118a52-07d9-46a2-8802-3c3dab407213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:14.072310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-33118a52-07d9-46a2-8802-3c3dab407213 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:14.073801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-33118a52-07d9-46a2-8802-3c3dab407213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:14.093321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac47cd-ca5a-4581-9c60-310ca24ab215 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:14.094251 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2624/5281] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:21:14.106289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac47cd-ca5a-4581-9c60-310ca24ab215 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:14.112150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3f49c-16de-4dec-bc2d-e64d8c909df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:14.114881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3f49c-16de-4dec-bc2d-e64d8c909df4 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:14.114881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3f49c-16de-4dec-bc2d-e64d8c909df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:14.114881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3f49c-16de-4dec-bc2d-e64d8c909df4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:14.114881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3f49c-16de-4dec-bc2d-e64d8c909df4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:21:14.114881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3f49c-16de-4dec-bc2d-e64d8c909df4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:14.115973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3f49c-16de-4dec-bc2d-e64d8c909df4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:14.137949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33118a52-07d9-46a2-8802-3c3dab407213 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:14.144934 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2658/5282] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:14.151486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33118a52-07d9-46a2-8802-3c3dab407213 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:14.172590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e36414-c645-4486-a6d5-e2d88bd6aca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:14.175495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e36414-c645-4486-a6d5-e2d88bd6aca8 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:14.175974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e36414-c645-4486-a6d5-e2d88bd6aca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:14.176524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e36414-c645-4486-a6d5-e2d88bd6aca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:14.178063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e36414-c645-4486-a6d5-e2d88bd6aca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:14.182520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e36414-c645-4486-a6d5-e2d88bd6aca8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:14.245868 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2625/5283] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:14 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:14.249650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3f49c-16de-4dec-bc2d-e64d8c909df4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:14.265933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3f49c-16de-4dec-bc2d-e64d8c909df4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:14.366331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad57e9-45e8-4ae8-b0b8-e6345d1b03e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:14.368135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad57e9-45e8-4ae8-b0b8-e6345d1b03e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:14.368135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad57e9-45e8-4ae8-b0b8-e6345d1b03e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:14.368135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad57e9-45e8-4ae8-b0b8-e6345d1b03e4 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:14.369608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad57e9-45e8-4ae8-b0b8-e6345d1b03e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:14.370963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad57e9-45e8-4ae8-b0b8-e6345d1b03e4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:14.403693 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2659/5284] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:14 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:14.407495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e36414-c645-4486-a6d5-e2d88bd6aca8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:14.421286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e36414-c645-4486-a6d5-e2d88bd6aca8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:14.436742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782c9e4-e8f7-4a99-ac0a-a885c71140e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:14.438601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad57e9-45e8-4ae8-b0b8-e6345d1b03e4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:14.440926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8aad57e9-45e8-4ae8-b0b8-e6345d1b03e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:14.444719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782c9e4-e8f7-4a99-ac0a-a885c71140e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:14.445077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782c9e4-e8f7-4a99-ac0a-a885c71140e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:14.445261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782c9e4-e8f7-4a99-ac0a-a885c71140e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:14.446000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782c9e4-e8f7-4a99-ac0a-a885c71140e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:14.453097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782c9e4-e8f7-4a99-ac0a-a885c71140e9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:14.461679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad57e9-45e8-4ae8-b0b8-e6345d1b03e4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:14.472859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c50876-e797-49fe-9691-350e4ff8cc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:14.473768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c50876-e797-49fe-9691-350e4ff8cc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:14.474027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c50876-e797-49fe-9691-350e4ff8cc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:14.474320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c50876-e797-49fe-9691-350e4ff8cc74 admin admin] PATH_INFO: `/v3/projects/054e86890f7d4f879bf9e739a5287195` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:14.478730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c50876-e797-49fe-9691-350e4ff8cc74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=054e86890f7d4f879bf9e739a5287195)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:14.480709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c50876-e797-49fe-9691-350e4ff8cc74 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:14.486435 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2626/5285] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:14.487618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782c9e4-e8f7-4a99-ac0a-a885c71140e9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:14.527514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782c9e4-e8f7-4a99-ac0a-a885c71140e9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:14.541505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62cca8-10d6-4f27-ab15-c05fc8d48bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:14.544286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62cca8-10d6-4f27-ab15-c05fc8d48bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:14.545116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62cca8-10d6-4f27-ab15-c05fc8d48bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:14.546477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62cca8-10d6-4f27-ab15-c05fc8d48bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:14.547797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62cca8-10d6-4f27-ab15-c05fc8d48bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:14.550895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62cca8-10d6-4f27-ab15-c05fc8d48bc7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:14.583901 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2627/5286] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:14.585918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14185b-87c4-4021-a030-0d3b33e8f784 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:14.588026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14185b-87c4-4021-a030-0d3b33e8f784 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:14.588341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14185b-87c4-4021-a030-0d3b33e8f784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:14.660816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c9c50876-e797-49fe-9691-350e4ff8cc74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054e86890f7d4f879bf9e739a5287195', 'request_id': 'req-c9c50876-e797-49fe-9691-350e4ff8cc74'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:14.676734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c9c50876-e797-49fe-9691-350e4ff8cc74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054e86890f7d4f879bf9e739a5287195', 'request_id': 'req-c9c50876-e797-49fe-9691-350e4ff8cc74'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:14.679490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3e14185b-87c4-4021-a030-0d3b33e8f784 None None] MFA Rules not processed for user `e1b7350d87a14f6dbd97ba52e3ed0a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:14.680815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3e14185b-87c4-4021-a030-0d3b33e8f784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:14.688380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c9c50876-e797-49fe-9691-350e4ff8cc74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054e86890f7d4f879bf9e739a5287195', 'request_id': 'req-c9c50876-e797-49fe-9691-350e4ff8cc74'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:14.710563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c9c50876-e797-49fe-9691-350e4ff8cc74 admin admin] The token cache is being invalidate because project 054e86890f7d4f879bf9e739a5287195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:14.710896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c9c50876-e797-49fe-9691-350e4ff8cc74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:14.713498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c9c50876-e797-49fe-9691-350e4ff8cc74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:14.715172 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2660/5287] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:14 2022] DELETE /identity/v3/projects/054e86890f7d4f879bf9e739a5287195 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:14.718922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c50876-e797-49fe-9691-350e4ff8cc74 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:14.724361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c9c50876-e797-49fe-9691-350e4ff8cc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:14.726357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:14.828320 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2628/5288] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:14.829383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14185b-87c4-4021-a030-0d3b33e8f784 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:14.833116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3e14185b-87c4-4021-a030-0d3b33e8f784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:14.844469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:14.872378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c50876-e797-49fe-9691-350e4ff8cc74 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:14.884170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2273806-5694-492c-8693-499d329a5553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:14.885081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2273806-5694-492c-8693-499d329a5553 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:14.885361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2273806-5694-492c-8693-499d329a5553 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:14.885628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2273806-5694-492c-8693-499d329a5553 admin admin] PATH_INFO: `/v3/projects/25bbd43e7dcd4d58a70eaedd73280f2d/users/658cca224eff470b9670fe04d4c7d5dd/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:14.918550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2273806-5694-492c-8693-499d329a5553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25bbd43e7dcd4d58a70eaedd73280f2d, user_id=658cca224eff470b9670fe04d4c7d5dd, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:14.923832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2273806-5694-492c-8693-499d329a5553 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:14.960307 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2661/5289] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:14 2022] PUT /identity/v3/projects/25bbd43e7dcd4d58a70eaedd73280f2d/users/658cca224eff470b9670fe04d4c7d5dd/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:14.960307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ae001-bb97-43e1-89e9-74f647a53dca None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:14.960307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ae001-bb97-43e1-89e9-74f647a53dca None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:14.960307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ae001-bb97-43e1-89e9-74f647a53dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:14.981792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14185b-87c4-4021-a030-0d3b33e8f784 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:14.989239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c37ae001-bb97-43e1-89e9-74f647a53dca None None] MFA Rules not processed for user `e1b7350d87a14f6dbd97ba52e3ed0a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:14.992412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c37ae001-bb97-43e1-89e9-74f647a53dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:15.080629 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2662/5290] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:15.085970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a1328-6b26-4a5b-9aa9-22f6a2006610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:15.087076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a1328-6b26-4a5b-9aa9-22f6a2006610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:15.087521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a1328-6b26-4a5b-9aa9-22f6a2006610 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:15.088127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a1328-6b26-4a5b-9aa9-22f6a2006610 admin admin] PATH_INFO: `/v3/users/37b5fca731c9410daea9891f6a3395d1` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:15.088553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb9f6c-991b-4725-b0b6-a8527843d284 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:15.089331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb9f6c-991b-4725-b0b6-a8527843d284 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:15.089656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a1328-6b26-4a5b-9aa9-22f6a2006610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b5fca731c9410daea9891f6a3395d1)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:15.089780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb9f6c-991b-4725-b0b6-a8527843d284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:15.096372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a1328-6b26-4a5b-9aa9-22f6a2006610 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:15.130310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-42eb9f6c-991b-4725-b0b6-a8527843d284 None None] MFA Rules not processed for user `658cca224eff470b9670fe04d4c7d5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:15.131797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-42eb9f6c-991b-4725-b0b6-a8527843d284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:15.191192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-475a1328-6b26-4a5b-9aa9-22f6a2006610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b5fca731c9410daea9891f6a3395d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:15.214844 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2663/5291] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:15.216377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-475a1328-6b26-4a5b-9aa9-22f6a2006610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b5fca731c9410daea9891f6a3395d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:15.227535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-475a1328-6b26-4a5b-9aa9-22f6a2006610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b5fca731c9410daea9891f6a3395d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:15.229043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-475a1328-6b26-4a5b-9aa9-22f6a2006610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b5fca731c9410daea9891f6a3395d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:15.229866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-475a1328-6b26-4a5b-9aa9-22f6a2006610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b5fca731c9410daea9891f6a3395d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:15.240505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:15.257326 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2629/5292] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:14 2022] DELETE /identity/v3/users/37b5fca731c9410daea9891f6a3395d1 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:15.486707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb9f6c-991b-4725-b0b6-a8527843d284 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:15.488698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-42eb9f6c-991b-4725-b0b6-a8527843d284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:15.635627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a1328-6b26-4a5b-9aa9-22f6a2006610 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:15.637934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-475a1328-6b26-4a5b-9aa9-22f6a2006610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:15.676124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb9f6c-991b-4725-b0b6-a8527843d284 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:15.682441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:15.822772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd14a93-e7e0-41ac-a6eb-79e5cda25f98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:15.823463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd14a93-e7e0-41ac-a6eb-79e5cda25f98 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:15.823745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd14a93-e7e0-41ac-a6eb-79e5cda25f98 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:15.824023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd14a93-e7e0-41ac-a6eb-79e5cda25f98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:15.827250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dbd14a93-e7e0-41ac-a6eb-79e5cda25f98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:15.858341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a1328-6b26-4a5b-9aa9-22f6a2006610 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:15.878859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc516711-c4be-43c8-b938-eb88518a81c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:15.880871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc516711-c4be-43c8-b938-eb88518a81c8 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:15.880871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc516711-c4be-43c8-b938-eb88518a81c8 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:15.880871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc516711-c4be-43c8-b938-eb88518a81c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:15.888785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fc516711-c4be-43c8-b938-eb88518a81c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:15.910542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd14a93-e7e0-41ac-a6eb-79e5cda25f98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:15.912262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd14a93-e7e0-41ac-a6eb-79e5cda25f98 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:15.924737 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2664/5293] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:15.925624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd14a93-e7e0-41ac-a6eb-79e5cda25f98 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:15.926970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dbd14a93-e7e0-41ac-a6eb-79e5cda25f98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:16.004075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd14a93-e7e0-41ac-a6eb-79e5cda25f98 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:16.012704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96acd8-1688-4752-98a3-fdb966d379c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:16.013908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96acd8-1688-4752-98a3-fdb966d379c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:16.014349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96acd8-1688-4752-98a3-fdb966d379c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:16.014932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96acd8-1688-4752-98a3-fdb966d379c9 admin admin] PATH_INFO: `/v3/projects/9b3ed206d585464284fd8e6efc9d6199` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:16.021815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96acd8-1688-4752-98a3-fdb966d379c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b3ed206d585464284fd8e6efc9d6199)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:16.024553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96acd8-1688-4752-98a3-fdb966d379c9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:16.093090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc516711-c4be-43c8-b938-eb88518a81c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:16.098176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc516711-c4be-43c8-b938-eb88518a81c8 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:16.114615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:16.118108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c96acd8-1688-4752-98a3-fdb966d379c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b3ed206d585464284fd8e6efc9d6199', 'request_id': 'req-3c96acd8-1688-4752-98a3-fdb966d379c9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:16.131509 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2630/5294] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:21:16.164696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c96acd8-1688-4752-98a3-fdb966d379c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b3ed206d585464284fd8e6efc9d6199', 'request_id': 'req-3c96acd8-1688-4752-98a3-fdb966d379c9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:16.191174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c96acd8-1688-4752-98a3-fdb966d379c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b3ed206d585464284fd8e6efc9d6199', 'request_id': 'req-3c96acd8-1688-4752-98a3-fdb966d379c9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:16.225038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c96acd8-1688-4752-98a3-fdb966d379c9 admin admin] The token cache is being invalidate because project 9b3ed206d585464284fd8e6efc9d6199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:16.225332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c96acd8-1688-4752-98a3-fdb966d379c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:16.227835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c96acd8-1688-4752-98a3-fdb966d379c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:16.239358 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2665/5295] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:15 2022] DELETE /identity/v3/projects/9b3ed206d585464284fd8e6efc9d6199 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:16.245324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc6eae-bd1e-43d7-9e5b-3bcafcfb981b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:16.245525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc6eae-bd1e-43d7-9e5b-3bcafcfb981b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:16.245824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc6eae-bd1e-43d7-9e5b-3bcafcfb981b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:16.279396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6ecc6eae-bd1e-43d7-9e5b-3bcafcfb981b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:16.280697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6ecc6eae-bd1e-43d7-9e5b-3bcafcfb981b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:16.411175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9a10d-6e2e-429d-ba9a-ca8a74898e96 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:16.411342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9a10d-6e2e-429d-ba9a-ca8a74898e96 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:16.411493 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2631/5296] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:16.411600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9a10d-6e2e-429d-ba9a-ca8a74898e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:16.448746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-40e9a10d-6e2e-429d-ba9a-ca8a74898e96 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:16.449993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-40e9a10d-6e2e-429d-ba9a-ca8a74898e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:16.478429 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2666/5297] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:21:16.480481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc6eae-bd1e-43d7-9e5b-3bcafcfb981b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:16.493739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc6eae-bd1e-43d7-9e5b-3bcafcfb981b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:16.510187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cb00d-18b6-42b7-8af5-564638cdbf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:16.510900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cb00d-18b6-42b7-8af5-564638cdbf35 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:16.511182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cb00d-18b6-42b7-8af5-564638cdbf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:16.511458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cb00d-18b6-42b7-8af5-564638cdbf35 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:16.512238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cb00d-18b6-42b7-8af5-564638cdbf35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:21:16.512545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cb00d-18b6-42b7-8af5-564638cdbf35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:16.517191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cb00d-18b6-42b7-8af5-564638cdbf35 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:16.543336 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2632/5298] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:16.548264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9a10d-6e2e-429d-ba9a-ca8a74898e96 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:16.566546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9a10d-6e2e-429d-ba9a-ca8a74898e96 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:16.581219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc426ac5-1ba9-4ca6-9136-bb65ac040f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:16.582927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc426ac5-1ba9-4ca6-9136-bb65ac040f11 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:16.583524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc426ac5-1ba9-4ca6-9136-bb65ac040f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:16.584246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc426ac5-1ba9-4ca6-9136-bb65ac040f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:16.585750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc426ac5-1ba9-4ca6-9136-bb65ac040f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:16.588104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc426ac5-1ba9-4ca6-9136-bb65ac040f11 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:16.644067 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2667/5299] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:16 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:21:16.648156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cb00d-18b6-42b7-8af5-564638cdbf35 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:16.659103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cb00d-18b6-42b7-8af5-564638cdbf35 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:16.686757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:16.781994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92900d8c-46a7-4b65-8a83-1a4bf335a753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:16.782898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92900d8c-46a7-4b65-8a83-1a4bf335a753 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:16.783334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92900d8c-46a7-4b65-8a83-1a4bf335a753 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:16.783690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92900d8c-46a7-4b65-8a83-1a4bf335a753 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:16.784611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92900d8c-46a7-4b65-8a83-1a4bf335a753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:16.787133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92900d8c-46a7-4b65-8a83-1a4bf335a753 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:16.837450 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2633/5300] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:16 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:16.840071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc426ac5-1ba9-4ca6-9136-bb65ac040f11 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:16.861744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc426ac5-1ba9-4ca6-9136-bb65ac040f11 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:16.876350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc75912-ccb2-4cd7-aa31-6c581a43bbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:16.878569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc75912-ccb2-4cd7-aa31-6c581a43bbdc admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:16.878965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc75912-ccb2-4cd7-aa31-6c581a43bbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:16.879175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc75912-ccb2-4cd7-aa31-6c581a43bbdc admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:16.879861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc75912-ccb2-4cd7-aa31-6c581a43bbdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:16.881698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc75912-ccb2-4cd7-aa31-6c581a43bbdc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:16.904554 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2668/5301] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:16.906649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92900d8c-46a7-4b65-8a83-1a4bf335a753 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:16.926877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92900d8c-46a7-4b65-8a83-1a4bf335a753 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:16.933438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb551b12-6905-436e-874b-f6ec296ed3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:16.935211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb551b12-6905-436e-874b-f6ec296ed3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:16.935211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb551b12-6905-436e-874b-f6ec296ed3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:16.935640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb551b12-6905-436e-874b-f6ec296ed3b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:16.937329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb551b12-6905-436e-874b-f6ec296ed3b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:16.939321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb551b12-6905-436e-874b-f6ec296ed3b8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:16.966539 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2634/5302] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:16.970686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc75912-ccb2-4cd7-aa31-6c581a43bbdc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:16.981887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc75912-ccb2-4cd7-aa31-6c581a43bbdc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:16.988069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a7964-7bbb-443d-bf40-2b06f2e4c1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:16.989044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a7964-7bbb-443d-bf40-2b06f2e4c1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:16.989326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a7964-7bbb-443d-bf40-2b06f2e4c1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:16.989598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a7964-7bbb-443d-bf40-2b06f2e4c1e4 admin admin] PATH_INFO: `/v3/projects/c2e599cf997d46eab7c1f1f99eb809ba/users/838e41d1df5c4f298c10b1f2ed24e159/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:17.011570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a7964-7bbb-443d-bf40-2b06f2e4c1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2e599cf997d46eab7c1f1f99eb809ba, user_id=838e41d1df5c4f298c10b1f2ed24e159, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:17.014803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a7964-7bbb-443d-bf40-2b06f2e4c1e4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:17.050993 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2669/5303] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:16 2022] PUT /identity/v3/projects/c2e599cf997d46eab7c1f1f99eb809ba/users/838e41d1df5c4f298c10b1f2ed24e159/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:17.062835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe2003-ffb0-4a7c-97df-9a6c27866926 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:17.063974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe2003-ffb0-4a7c-97df-9a6c27866926 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:17.064606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe2003-ffb0-4a7c-97df-9a6c27866926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:17.136571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-76fe2003-ffb0-4a7c-97df-9a6c27866926 None None] MFA Rules not processed for user `838e41d1df5c4f298c10b1f2ed24e159`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:17.138414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-76fe2003-ffb0-4a7c-97df-9a6c27866926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:17.277476 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2635/5304] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:17.278461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a7964-7bbb-443d-bf40-2b06f2e4c1e4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:17.383264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a7964-7bbb-443d-bf40-2b06f2e4c1e4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:17.390879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ca657-e93e-411e-8b4b-bf78796ffed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:17.391824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ca657-e93e-411e-8b4b-bf78796ffed5 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:17.392327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ca657-e93e-411e-8b4b-bf78796ffed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:17.392829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ca657-e93e-411e-8b4b-bf78796ffed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:17.393799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ca657-e93e-411e-8b4b-bf78796ffed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:17.395942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ca657-e93e-411e-8b4b-bf78796ffed5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:17.456532 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2670/5305] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:17 2022] POST /identity/v3/projects => generated 369 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:17.461179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe2003-ffb0-4a7c-97df-9a6c27866926 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:17.483105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe2003-ffb0-4a7c-97df-9a6c27866926 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:17.588384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d158cc-76c4-4011-921c-5a6fe27bfa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:17.589191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d158cc-76c4-4011-921c-5a6fe27bfa38 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:17.589540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d158cc-76c4-4011-921c-5a6fe27bfa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:17.589883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d158cc-76c4-4011-921c-5a6fe27bfa38 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:17.590670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d158cc-76c4-4011-921c-5a6fe27bfa38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:17.592737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d158cc-76c4-4011-921c-5a6fe27bfa38 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:17.633658 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2636/5306] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:17 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:17.635737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ca657-e93e-411e-8b4b-bf78796ffed5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:17.649376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ca657-e93e-411e-8b4b-bf78796ffed5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:17.660851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2436fd-1d24-4088-b26c-8f89c072ad6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:17.661576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2436fd-1d24-4088-b26c-8f89c072ad6f admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:17.661576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2436fd-1d24-4088-b26c-8f89c072ad6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:17.661984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2436fd-1d24-4088-b26c-8f89c072ad6f admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:17.662684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2436fd-1d24-4088-b26c-8f89c072ad6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:17.664276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2436fd-1d24-4088-b26c-8f89c072ad6f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:17.676317 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2671/5307] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:17.680692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d158cc-76c4-4011-921c-5a6fe27bfa38 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:17.693709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d158cc-76c4-4011-921c-5a6fe27bfa38 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:17.700388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ec67a-a3f3-40ef-89e4-e479dcc09cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:17.701381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ec67a-a3f3-40ef-89e4-e479dcc09cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:17.701570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ec67a-a3f3-40ef-89e4-e479dcc09cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:17.701847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ec67a-a3f3-40ef-89e4-e479dcc09cd8 admin admin] PATH_INFO: `/v3/projects/4d080b32770a4d0ca3fb5c5c2ad1a76d/users/35039ce9576f46d5b1203a94b96c5831/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:17.734830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:17.744889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ec67a-a3f3-40ef-89e4-e479dcc09cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d080b32770a4d0ca3fb5c5c2ad1a76d, user_id=35039ce9576f46d5b1203a94b96c5831, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:17.750002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ec67a-a3f3-40ef-89e4-e479dcc09cd8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:17.779254 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2637/5308] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:17 2022] PUT /identity/v3/projects/4d080b32770a4d0ca3fb5c5c2ad1a76d/users/35039ce9576f46d5b1203a94b96c5831/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:17.783956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2436fd-1d24-4088-b26c-8f89c072ad6f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:17.798279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2436fd-1d24-4088-b26c-8f89c072ad6f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:17.918481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ec67a-a3f3-40ef-89e4-e479dcc09cd8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:17.921077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ec4ec67a-a3f3-40ef-89e4-e479dcc09cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:17.937011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:17.970824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e0369-8fd8-4411-a519-437faead6a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:17.974122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e0369-8fd8-4411-a519-437faead6a03 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:17.974698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e0369-8fd8-4411-a519-437faead6a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:17.975096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e0369-8fd8-4411-a519-437faead6a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:17.977643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e0369-8fd8-4411-a519-437faead6a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:17.980647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e0369-8fd8-4411-a519-437faead6a03 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:17.999617 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2672/5309] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:18.004529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e0369-8fd8-4411-a519-437faead6a03 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:18.033789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e0369-8fd8-4411-a519-437faead6a03 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:18.050105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303508fa-7f4f-43bb-83cb-ba9ebfa653bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:18.051229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303508fa-7f4f-43bb-83cb-ba9ebfa653bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:18.051512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303508fa-7f4f-43bb-83cb-ba9ebfa653bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:18.051905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303508fa-7f4f-43bb-83cb-ba9ebfa653bc admin admin] PATH_INFO: `/v3/projects/4d080b32770a4d0ca3fb5c5c2ad1a76d/users/35039ce9576f46d5b1203a94b96c5831/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:18.056272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303508fa-7f4f-43bb-83cb-ba9ebfa653bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d080b32770a4d0ca3fb5c5c2ad1a76d, user_id=35039ce9576f46d5b1203a94b96c5831, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:18.060936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303508fa-7f4f-43bb-83cb-ba9ebfa653bc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:18.077911 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2673/5310] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:18 2022] PUT /identity/v3/projects/4d080b32770a4d0ca3fb5c5c2ad1a76d/users/35039ce9576f46d5b1203a94b96c5831/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:18.090720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f566ea-5c18-42da-a964-0dbfa0c1c3e3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:18.091993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f566ea-5c18-42da-a964-0dbfa0c1c3e3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:18.092458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f566ea-5c18-42da-a964-0dbfa0c1c3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:18.128719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-37f566ea-5c18-42da-a964-0dbfa0c1c3e3 None None] MFA Rules not processed for user `35039ce9576f46d5b1203a94b96c5831`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:18.130724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-37f566ea-5c18-42da-a964-0dbfa0c1c3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:18.166872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ec67a-a3f3-40ef-89e4-e479dcc09cd8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:18.261877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a5779-4ed6-44fd-ac71-3b75d25fc4ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:18.262393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a5779-4ed6-44fd-ac71-3b75d25fc4ff service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:18.262675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a5779-4ed6-44fd-ac71-3b75d25fc4ff service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:18.272065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a5779-4ed6-44fd-ac71-3b75d25fc4ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:18.272065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0c9a5779-4ed6-44fd-ac71-3b75d25fc4ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:18.283787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a5779-4ed6-44fd-ac71-3b75d25fc4ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:18.285758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a5779-4ed6-44fd-ac71-3b75d25fc4ff service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:18.294390 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2674/5311] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:18 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:18.300629 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2638/5312] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:21:18.308443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f566ea-5c18-42da-a964-0dbfa0c1c3e3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:18.310834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-37f566ea-5c18-42da-a964-0dbfa0c1c3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:18.478021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f566ea-5c18-42da-a964-0dbfa0c1c3e3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:18.485611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed975aac-392f-4982-8eff-7402ac62002b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:18.486301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed975aac-392f-4982-8eff-7402ac62002b service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:18.486589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed975aac-392f-4982-8eff-7402ac62002b service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:18.487373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed975aac-392f-4982-8eff-7402ac62002b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:18.504823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed975aac-392f-4982-8eff-7402ac62002b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:18.506194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed975aac-392f-4982-8eff-7402ac62002b service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:18.521814 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2675/5313] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:18 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:18.582381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a5779-4ed6-44fd-ac71-3b75d25fc4ff service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:18.584134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0c9a5779-4ed6-44fd-ac71-3b75d25fc4ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:18.721308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a5779-4ed6-44fd-ac71-3b75d25fc4ff service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:18.728474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7e0b4-f70e-4415-9c11-6fcbfdbc8e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:18.729844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7e0b4-f70e-4415-9c11-6fcbfdbc8e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:18.730133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7e0b4-f70e-4415-9c11-6fcbfdbc8e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:18.730407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7e0b4-f70e-4415-9c11-6fcbfdbc8e63 admin admin] PATH_INFO: `/v3/users/658cca224eff470b9670fe04d4c7d5dd` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:18.732272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7e0b4-f70e-4415-9c11-6fcbfdbc8e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=658cca224eff470b9670fe04d4c7d5dd)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:18.734823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7e0b4-f70e-4415-9c11-6fcbfdbc8e63 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:18.782450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:18.858060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbf7e0b4-f70e-4415-9c11-6fcbfdbc8e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658cca224eff470b9670fe04d4c7d5dd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:18.907624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbf7e0b4-f70e-4415-9c11-6fcbfdbc8e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658cca224eff470b9670fe04d4c7d5dd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:18.942451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbf7e0b4-f70e-4415-9c11-6fcbfdbc8e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658cca224eff470b9670fe04d4c7d5dd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:18.944354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbf7e0b4-f70e-4415-9c11-6fcbfdbc8e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658cca224eff470b9670fe04d4c7d5dd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:18.946358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbf7e0b4-f70e-4415-9c11-6fcbfdbc8e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658cca224eff470b9670fe04d4c7d5dd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:18.985923 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2639/5314] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:18 2022] DELETE /identity/v3/users/658cca224eff470b9670fe04d4c7d5dd => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:18.990330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf490b7-e675-4936-a605-b475aa4419f1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:18.990627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf490b7-e675-4936-a605-b475aa4419f1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:18.990912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf490b7-e675-4936-a605-b475aa4419f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:19.041884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bcf490b7-e675-4936-a605-b475aa4419f1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:19.043439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bcf490b7-e675-4936-a605-b475aa4419f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:19.189052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:19.213957 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2676/5315] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:19.295618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7e0b4-f70e-4415-9c11-6fcbfdbc8e63 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:19.298313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fbf7e0b4-f70e-4415-9c11-6fcbfdbc8e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:19.496127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7e0b4-f70e-4415-9c11-6fcbfdbc8e63 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:19.505037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321d256-7a0f-488d-a891-7f516a1a63be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:19.508243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321d256-7a0f-488d-a891-7f516a1a63be service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:19.508561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321d256-7a0f-488d-a891-7f516a1a63be service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:19.508890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321d256-7a0f-488d-a891-7f516a1a63be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:19.532655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321d256-7a0f-488d-a891-7f516a1a63be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:19.534301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321d256-7a0f-488d-a891-7f516a1a63be service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:19.552929 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2640/5316] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:20.362693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf490b7-e675-4936-a605-b475aa4419f1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:20.364710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bcf490b7-e675-4936-a605-b475aa4419f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:20.390444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf490b7-e675-4936-a605-b475aa4419f1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:20.412691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e3eb7-7193-472e-adfa-07b670451973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:20.413754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e3eb7-7193-472e-adfa-07b670451973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:20.414039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e3eb7-7193-472e-adfa-07b670451973 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:20.414317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e3eb7-7193-472e-adfa-07b670451973 admin admin] PATH_INFO: `/v3/projects/25bbd43e7dcd4d58a70eaedd73280f2d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:20.423381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e3eb7-7193-472e-adfa-07b670451973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25bbd43e7dcd4d58a70eaedd73280f2d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:20.427894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e3eb7-7193-472e-adfa-07b670451973 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:20.528886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-455e3eb7-7193-472e-adfa-07b670451973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25bbd43e7dcd4d58a70eaedd73280f2d', 'request_id': 'req-455e3eb7-7193-472e-adfa-07b670451973'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:20.546584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-455e3eb7-7193-472e-adfa-07b670451973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25bbd43e7dcd4d58a70eaedd73280f2d', 'request_id': 'req-455e3eb7-7193-472e-adfa-07b670451973'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:20.564786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-455e3eb7-7193-472e-adfa-07b670451973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25bbd43e7dcd4d58a70eaedd73280f2d', 'request_id': 'req-455e3eb7-7193-472e-adfa-07b670451973'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:20.600764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-455e3eb7-7193-472e-adfa-07b670451973 admin admin] The token cache is being invalidate because project 25bbd43e7dcd4d58a70eaedd73280f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:20.601052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-455e3eb7-7193-472e-adfa-07b670451973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:20.602869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-455e3eb7-7193-472e-adfa-07b670451973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:20.605559 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2677/5317] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:20 2022] DELETE /identity/v3/projects/25bbd43e7dcd4d58a70eaedd73280f2d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:20.611826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539287e2-31e7-4514-9f37-fdd6bd299701 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:20.612330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539287e2-31e7-4514-9f37-fdd6bd299701 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:20.612425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539287e2-31e7-4514-9f37-fdd6bd299701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:20.663393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-539287e2-31e7-4514-9f37-fdd6bd299701 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:20.664716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-539287e2-31e7-4514-9f37-fdd6bd299701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:20.812951 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2641/5318] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:20.821960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2128ba-00c2-4de5-bed0-a6fb47ab0774 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:20.822476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2128ba-00c2-4de5-bed0-a6fb47ab0774 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:20.822822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2128ba-00c2-4de5-bed0-a6fb47ab0774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:20.859004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2b2128ba-00c2-4de5-bed0-a6fb47ab0774 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:20.860866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2b2128ba-00c2-4de5-bed0-a6fb47ab0774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:20.882875 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2678/5319] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:20.887157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539287e2-31e7-4514-9f37-fdd6bd299701 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:20.905335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539287e2-31e7-4514-9f37-fdd6bd299701 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:20.914435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d091f92-e196-48cd-bcaa-27d98acc9e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:20.914945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d091f92-e196-48cd-bcaa-27d98acc9e41 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:20.915228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d091f92-e196-48cd-bcaa-27d98acc9e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:20.915507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d091f92-e196-48cd-bcaa-27d98acc9e41 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:20.916615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d091f92-e196-48cd-bcaa-27d98acc9e41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:21:20.917369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d091f92-e196-48cd-bcaa-27d98acc9e41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:20.919625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d091f92-e196-48cd-bcaa-27d98acc9e41 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:20.939435 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2642/5320] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:20.943903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2128ba-00c2-4de5-bed0-a6fb47ab0774 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:20.958022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2128ba-00c2-4de5-bed0-a6fb47ab0774 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:20.963582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56decb-b693-479c-bf33-ddc3e183f244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:20.964614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56decb-b693-479c-bf33-ddc3e183f244 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:20.965116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56decb-b693-479c-bf33-ddc3e183f244 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:20.965609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56decb-b693-479c-bf33-ddc3e183f244 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:20.966519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56decb-b693-479c-bf33-ddc3e183f244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:20.968677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56decb-b693-479c-bf33-ddc3e183f244 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:21.007140 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2679/5321] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:20 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:21.011360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d091f92-e196-48cd-bcaa-27d98acc9e41 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:21.024888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d091f92-e196-48cd-bcaa-27d98acc9e41 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:21.053294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:21.124784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74201862-1637-4c14-9308-e7a7e79224fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:21.125692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74201862-1637-4c14-9308-e7a7e79224fc admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:21.126089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74201862-1637-4c14-9308-e7a7e79224fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:21.126439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74201862-1637-4c14-9308-e7a7e79224fc admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:21.127322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74201862-1637-4c14-9308-e7a7e79224fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:21.129755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74201862-1637-4c14-9308-e7a7e79224fc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:21.179279 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2643/5322] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:21 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:21.180601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56decb-b693-479c-bf33-ddc3e183f244 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:21.192093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56decb-b693-479c-bf33-ddc3e183f244 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:21.197599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5927bde-7652-4750-92a5-0663dc02e33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:21.198499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5927bde-7652-4750-92a5-0663dc02e33e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:21.198979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5927bde-7652-4750-92a5-0663dc02e33e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:21.199327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5927bde-7652-4750-92a5-0663dc02e33e admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:21.200148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5927bde-7652-4750-92a5-0663dc02e33e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:21.201999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5927bde-7652-4750-92a5-0663dc02e33e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:21.213616 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2680/5323] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:21.217379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74201862-1637-4c14-9308-e7a7e79224fc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:21.229519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74201862-1637-4c14-9308-e7a7e79224fc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:21.235310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868da94-5c86-4825-92c6-6899c0681836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:21.236334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868da94-5c86-4825-92c6-6899c0681836 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:21.236871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868da94-5c86-4825-92c6-6899c0681836 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:21.237386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868da94-5c86-4825-92c6-6899c0681836 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:21.238340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868da94-5c86-4825-92c6-6899c0681836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:21.240355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868da94-5c86-4825-92c6-6899c0681836 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:21.253603 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2644/5324] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:21:21.257562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5927bde-7652-4750-92a5-0663dc02e33e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:21.268235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5927bde-7652-4750-92a5-0663dc02e33e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:21.273562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae954f-73d5-4361-a2c3-3dedfd3f184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:21.274610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae954f-73d5-4361-a2c3-3dedfd3f184b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:21.274894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae954f-73d5-4361-a2c3-3dedfd3f184b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:21.275280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae954f-73d5-4361-a2c3-3dedfd3f184b admin admin] PATH_INFO: `/v3/projects/60c8d5110a9b40378d00692b8bc5642a/users/b953b0d0a48b4bab8b17abb0b3bbc284/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:21.295467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae954f-73d5-4361-a2c3-3dedfd3f184b admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c8d5110a9b40378d00692b8bc5642a, user_id=b953b0d0a48b4bab8b17abb0b3bbc284, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:21.298887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae954f-73d5-4361-a2c3-3dedfd3f184b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:21.319486 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2681/5325] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:21 2022] PUT /identity/v3/projects/60c8d5110a9b40378d00692b8bc5642a/users/b953b0d0a48b4bab8b17abb0b3bbc284/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:21:21.329670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80758e7-8f9e-4ce5-bb00-7622dd10ca8e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:21.330484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80758e7-8f9e-4ce5-bb00-7622dd10ca8e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:21.330484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80758e7-8f9e-4ce5-bb00-7622dd10ca8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:21.362905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b80758e7-8f9e-4ce5-bb00-7622dd10ca8e None None] MFA Rules not processed for user `b953b0d0a48b4bab8b17abb0b3bbc284`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:21.364271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b80758e7-8f9e-4ce5-bb00-7622dd10ca8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:21.453113 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2645/5326] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:21.458569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae954f-73d5-4361-a2c3-3dedfd3f184b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:21.535729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae954f-73d5-4361-a2c3-3dedfd3f184b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:21.541323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9b9da-d670-4121-bd0b-cc9b9ff912e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:21.542034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b9da-d670-4121-bd0b-cc9b9ff912e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:21.542323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b9da-d670-4121-bd0b-cc9b9ff912e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:21.542600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b9da-d670-4121-bd0b-cc9b9ff912e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:21.543342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9b9da-d670-4121-bd0b-cc9b9ff912e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:21.547201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9b9da-d670-4121-bd0b-cc9b9ff912e0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:21.576810 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2682/5327] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:21 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:21.581221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80758e7-8f9e-4ce5-bb00-7622dd10ca8e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:21.596347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80758e7-8f9e-4ce5-bb00-7622dd10ca8e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:21.697971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a38e78-5598-4213-a14f-d16afd2c8847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:21.698728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a38e78-5598-4213-a14f-d16afd2c8847 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:21.699031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a38e78-5598-4213-a14f-d16afd2c8847 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:21.699284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a38e78-5598-4213-a14f-d16afd2c8847 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:21.700410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a38e78-5598-4213-a14f-d16afd2c8847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:21.702354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a38e78-5598-4213-a14f-d16afd2c8847 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:21.735822 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2646/5328] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:21 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:21:21.736808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9b9da-d670-4121-bd0b-cc9b9ff912e0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:21.744879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:21.752019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9b9da-d670-4121-bd0b-cc9b9ff912e0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:21.761824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841eb7df-9fa4-4275-a3fc-bd23b0358c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:21.762720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841eb7df-9fa4-4275-a3fc-bd23b0358c8b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:21.763552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841eb7df-9fa4-4275-a3fc-bd23b0358c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:21.763939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841eb7df-9fa4-4275-a3fc-bd23b0358c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:21.764855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841eb7df-9fa4-4275-a3fc-bd23b0358c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:21.768548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841eb7df-9fa4-4275-a3fc-bd23b0358c8b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:21.796339 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2683/5329] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:21.801260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a38e78-5598-4213-a14f-d16afd2c8847 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:21.815306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a38e78-5598-4213-a14f-d16afd2c8847 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:21.820424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc028e3-16f9-4ea6-9bfb-a0ad16045c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:21.821525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc028e3-16f9-4ea6-9bfb-a0ad16045c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:21.821973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc028e3-16f9-4ea6-9bfb-a0ad16045c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:21.822394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc028e3-16f9-4ea6-9bfb-a0ad16045c23 admin admin] PATH_INFO: `/v3/projects/7a56a30336ee4acf9e22f51dfd63053a/users/af0f4351d16541f599432566ddbabb9b/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:21.839643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc028e3-16f9-4ea6-9bfb-a0ad16045c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a56a30336ee4acf9e22f51dfd63053a, user_id=af0f4351d16541f599432566ddbabb9b, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:21.843022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc028e3-16f9-4ea6-9bfb-a0ad16045c23 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:21.848436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:21.876894 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2647/5330] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:21 2022] PUT /identity/v3/projects/7a56a30336ee4acf9e22f51dfd63053a/users/af0f4351d16541f599432566ddbabb9b/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:21.877696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841eb7df-9fa4-4275-a3fc-bd23b0358c8b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:21.896833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841eb7df-9fa4-4275-a3fc-bd23b0358c8b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:21.983979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36581b7-0ae2-4c24-b4fe-0927b7c0aa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:21.984850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36581b7-0ae2-4c24-b4fe-0927b7c0aa51 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:21.985139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36581b7-0ae2-4c24-b4fe-0927b7c0aa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:21.985950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36581b7-0ae2-4c24-b4fe-0927b7c0aa51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:21.986607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36581b7-0ae2-4c24-b4fe-0927b7c0aa51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:21.988483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36581b7-0ae2-4c24-b4fe-0927b7c0aa51 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:22.004245 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2684/5331] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:21:22.005138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc028e3-16f9-4ea6-9bfb-a0ad16045c23 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:22.023602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc028e3-16f9-4ea6-9bfb-a0ad16045c23 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:22.040253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2de73-3d27-47ac-bef0-bf448612536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:22.042927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2de73-3d27-47ac-bef0-bf448612536c admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:22.043309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2de73-3d27-47ac-bef0-bf448612536c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:22.043687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2de73-3d27-47ac-bef0-bf448612536c admin admin] PATH_INFO: `/v3/projects/7a56a30336ee4acf9e22f51dfd63053a/users/af0f4351d16541f599432566ddbabb9b/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:22.046667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2de73-3d27-47ac-bef0-bf448612536c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a56a30336ee4acf9e22f51dfd63053a, user_id=af0f4351d16541f599432566ddbabb9b, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:22.058888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2de73-3d27-47ac-bef0-bf448612536c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:22.085951 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2648/5332] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:22 2022] PUT /identity/v3/projects/7a56a30336ee4acf9e22f51dfd63053a/users/af0f4351d16541f599432566ddbabb9b/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:21:22.186962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d0226-8fe0-463e-ad76-3fe1c57b5e2c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:22.187191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d0226-8fe0-463e-ad76-3fe1c57b5e2c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:22.187475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d0226-8fe0-463e-ad76-3fe1c57b5e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:22.218564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-091d0226-8fe0-463e-ad76-3fe1c57b5e2c None None] MFA Rules not processed for user `af0f4351d16541f599432566ddbabb9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:22.220427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-091d0226-8fe0-463e-ad76-3fe1c57b5e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:22.310656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2de73-3d27-47ac-bef0-bf448612536c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:22.316276 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2685/5333] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:22.322962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2de73-3d27-47ac-bef0-bf448612536c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:22.330650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3036b-33f6-4a96-ab89-eb8d4410469b tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0f4351d16541f599432566ddbabb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a56a30336ee4acf9e22f51dfd63053a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:22.331415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3036b-33f6-4a96-ab89-eb8d4410469b tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:22.331725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3036b-33f6-4a96-ab89-eb8d4410469b tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:22.331968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3036b-33f6-4a96-ab89-eb8d4410469b tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:22.332864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3036b-33f6-4a96-ab89-eb8d4410469b tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:22.341870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3036b-33f6-4a96-ab89-eb8d4410469b tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:22.382893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d0226-8fe0-463e-ad76-3fe1c57b5e2c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:22.392722 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2649/5334] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:21:22 2022] POST /identity/v3/domains => generated 245 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:22.405658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d0226-8fe0-463e-ad76-3fe1c57b5e2c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:22.488407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fae90-c36f-40b5-a5a3-b3254953437f tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0f4351d16541f599432566ddbabb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a56a30336ee4acf9e22f51dfd63053a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:22.489249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fae90-c36f-40b5-a5a3-b3254953437f tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:22.489586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fae90-c36f-40b5-a5a3-b3254953437f tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:22.489876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fae90-c36f-40b5-a5a3-b3254953437f tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:22.490587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fae90-c36f-40b5-a5a3-b3254953437f tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:22.492584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fae90-c36f-40b5-a5a3-b3254953437f tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:22.515276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:22.544640 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2686/5335] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:22 2022] POST /identity/v3/projects => generated 407 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:22.555187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3036b-33f6-4a96-ab89-eb8d4410469b tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:22.567529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3036b-33f6-4a96-ab89-eb8d4410469b tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:22.648081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a13972-7966-4fb9-8a8d-b8fa833067be tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0f4351d16541f599432566ddbabb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a56a30336ee4acf9e22f51dfd63053a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:22.649107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a13972-7966-4fb9-8a8d-b8fa833067be tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:22.650136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a13972-7966-4fb9-8a8d-b8fa833067be tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:22.650136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a13972-7966-4fb9-8a8d-b8fa833067be tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:22.650646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a13972-7966-4fb9-8a8d-b8fa833067be tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:22.653393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a13972-7966-4fb9-8a8d-b8fa833067be tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:22.697417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fae90-c36f-40b5-a5a3-b3254953437f tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:22.710754 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2650/5336] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:22 2022] POST /identity/v3/users => generated 347 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:22.711402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fae90-c36f-40b5-a5a3-b3254953437f tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:22.716693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e751ed-a6d5-4497-bf03-9414814084cb tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0f4351d16541f599432566ddbabb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a56a30336ee4acf9e22f51dfd63053a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:22.717385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e751ed-a6d5-4497-bf03-9414814084cb tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:22.717672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e751ed-a6d5-4497-bf03-9414814084cb tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:22.717952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e751ed-a6d5-4497-bf03-9414814084cb tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:22.719213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e751ed-a6d5-4497-bf03-9414814084cb tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:22.721782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e751ed-a6d5-4497-bf03-9414814084cb tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:22.740714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a13972-7966-4fb9-8a8d-b8fa833067be tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:22.741001 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2687/5337] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:22.753862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a13972-7966-4fb9-8a8d-b8fa833067be tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:22.760368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072fbd9-bc1d-478e-9fd5-92498494b1d6 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0f4351d16541f599432566ddbabb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a56a30336ee4acf9e22f51dfd63053a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:22.761560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072fbd9-bc1d-478e-9fd5-92498494b1d6 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:22.762695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072fbd9-bc1d-478e-9fd5-92498494b1d6 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:22.762695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072fbd9-bc1d-478e-9fd5-92498494b1d6 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] PATH_INFO: `/v3/projects/32da322e09d44562bba1d31386c27a49/users/c62af169a8da4460a7c1fd33aa83f34d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:22.785346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072fbd9-bc1d-478e-9fd5-92498494b1d6 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: Authorizing `identity:create_grant(project_id=32da322e09d44562bba1d31386c27a49, user_id=c62af169a8da4460a7c1fd33aa83f34d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:22.788063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072fbd9-bc1d-478e-9fd5-92498494b1d6 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:22.809661 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2651/5338] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:22 2022] PUT /identity/v3/projects/32da322e09d44562bba1d31386c27a49/users/c62af169a8da4460a7c1fd33aa83f34d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:22.814485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff67a73-2d08-4263-9e4b-94d99ee0709a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:22.814855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff67a73-2d08-4263-9e4b-94d99ee0709a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:22.815133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff67a73-2d08-4263-9e4b-94d99ee0709a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:22.974355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-aff67a73-2d08-4263-9e4b-94d99ee0709a None None] MFA Rules not processed for user `c62af169a8da4460a7c1fd33aa83f34d`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:22.975849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-aff67a73-2d08-4263-9e4b-94d99ee0709a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:23.011566 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2688/5339] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:22 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:23.021765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23f325-7b76-410c-a370-1ff1571e06e5 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:23.022035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23f325-7b76-410c-a370-1ff1571e06e5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:23.023094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23f325-7b76-410c-a370-1ff1571e06e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:23.048183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bb23f325-7b76-410c-a370-1ff1571e06e5 None None] MFA Rules not processed for user `c62af169a8da4460a7c1fd33aa83f34d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:23.050232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bb23f325-7b76-410c-a370-1ff1571e06e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:23.062454 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2652/5340] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:23 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:23.067102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff67a73-2d08-4263-9e4b-94d99ee0709a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:23.102072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff67a73-2d08-4263-9e4b-94d99ee0709a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:23.108545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e7a05-136b-4bd6-b6fb-ca4ea4bf4a34 tempest-test_project-521174510 tempest-user-892060822] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62af169a8da4460a7c1fd33aa83f34d', 'user_domain_id': '03e36b71d4384337ba5bc5008ef5fe56', 'system_scope': None, 'project_id': '32da322e09d44562bba1d31386c27a49', 'project_domain_id': '03e36b71d4384337ba5bc5008ef5fe56', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:23.109382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e7a05-136b-4bd6-b6fb-ca4ea4bf4a34 tempest-test_project-521174510 tempest-user-892060822] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:23.109816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e7a05-136b-4bd6-b6fb-ca4ea4bf4a34 tempest-test_project-521174510 tempest-user-892060822] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:23.110092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e7a05-136b-4bd6-b6fb-ca4ea4bf4a34 tempest-test_project-521174510 tempest-user-892060822] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:23.148835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e7a05-136b-4bd6-b6fb-ca4ea4bf4a34 tempest-test_project-521174510 tempest-user-892060822] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:23.150882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e7a05-136b-4bd6-b6fb-ca4ea4bf4a34 tempest-test_project-521174510 tempest-user-892060822] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:23.171514 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2689/5341] 10.222.0.43 () {56 vars in 1283 bytes} [Sat Jul 2 21:21:23 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:23.172235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23f325-7b76-410c-a370-1ff1571e06e5 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:23.285960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23f325-7b76-410c-a370-1ff1571e06e5 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:23.291380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19d092-e832-413d-a4c2-0fec661025b9 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0f4351d16541f599432566ddbabb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a56a30336ee4acf9e22f51dfd63053a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:23.292322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19d092-e832-413d-a4c2-0fec661025b9 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:23.292604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19d092-e832-413d-a4c2-0fec661025b9 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:23.292880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19d092-e832-413d-a4c2-0fec661025b9 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] PATH_INFO: `/v3/users/c62af169a8da4460a7c1fd33aa83f34d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:23.294136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19d092-e832-413d-a4c2-0fec661025b9 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c62af169a8da4460a7c1fd33aa83f34d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:23.296790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19d092-e832-413d-a4c2-0fec661025b9 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:23.344572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:INSERT=7,keystone:SELECT=88,keystone:DELETE=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:23.385906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ba19d092-e832-413d-a4c2-0fec661025b9 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62af169a8da4460a7c1fd33aa83f34d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:23.399572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ba19d092-e832-413d-a4c2-0fec661025b9 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62af169a8da4460a7c1fd33aa83f34d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:23.408066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ba19d092-e832-413d-a4c2-0fec661025b9 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62af169a8da4460a7c1fd33aa83f34d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:23.408898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ba19d092-e832-413d-a4c2-0fec661025b9 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62af169a8da4460a7c1fd33aa83f34d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:23.409545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ba19d092-e832-413d-a4c2-0fec661025b9 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62af169a8da4460a7c1fd33aa83f34d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:23.453245 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2653/5342] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:23 2022] DELETE /identity/v3/users/c62af169a8da4460a7c1fd33aa83f34d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:23.457205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e7a05-136b-4bd6-b6fb-ca4ea4bf4a34 tempest-test_project-521174510 tempest-user-892060822] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:23.486588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e7a05-136b-4bd6-b6fb-ca4ea4bf4a34 tempest-test_project-521174510 tempest-user-892060822] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:23.567723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d58690-86bc-4e73-88f1-d6fa70a58ffd tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0f4351d16541f599432566ddbabb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a56a30336ee4acf9e22f51dfd63053a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:23.568705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d58690-86bc-4e73-88f1-d6fa70a58ffd tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:23.569001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d58690-86bc-4e73-88f1-d6fa70a58ffd tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:23.569282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d58690-86bc-4e73-88f1-d6fa70a58ffd tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] PATH_INFO: `/v3/projects/32da322e09d44562bba1d31386c27a49` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:23.570678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d58690-86bc-4e73-88f1-d6fa70a58ffd tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: Authorizing `identity:delete_project(project_id=32da322e09d44562bba1d31386c27a49)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:23.572823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d58690-86bc-4e73-88f1-d6fa70a58ffd tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:23.636121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:23.653151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b4d58690-86bc-4e73-88f1-d6fa70a58ffd tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32da322e09d44562bba1d31386c27a49', 'request_id': 'req-b4d58690-86bc-4e73-88f1-d6fa70a58ffd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:23.662328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b4d58690-86bc-4e73-88f1-d6fa70a58ffd tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32da322e09d44562bba1d31386c27a49', 'request_id': 'req-b4d58690-86bc-4e73-88f1-d6fa70a58ffd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:23.671395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b4d58690-86bc-4e73-88f1-d6fa70a58ffd tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32da322e09d44562bba1d31386c27a49', 'request_id': 'req-b4d58690-86bc-4e73-88f1-d6fa70a58ffd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:23.682615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b4d58690-86bc-4e73-88f1-d6fa70a58ffd tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] The token cache is being invalidate because project 32da322e09d44562bba1d31386c27a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:23.682995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b4d58690-86bc-4e73-88f1-d6fa70a58ffd tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:23.683737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b4d58690-86bc-4e73-88f1-d6fa70a58ffd tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:23.685418 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2690/5343] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:23 2022] DELETE /identity/v3/projects/32da322e09d44562bba1d31386c27a49 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:23.689810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19d092-e832-413d-a4c2-0fec661025b9 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:23.691437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ba19d092-e832-413d-a4c2-0fec661025b9 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:23.709386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19d092-e832-413d-a4c2-0fec661025b9 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:23.780338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e2076-7ae5-4bd7-8c0e-15922c55f5d8 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0f4351d16541f599432566ddbabb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a56a30336ee4acf9e22f51dfd63053a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:23.781616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e2076-7ae5-4bd7-8c0e-15922c55f5d8 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:23.781616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e2076-7ae5-4bd7-8c0e-15922c55f5d8 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:23.781817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e2076-7ae5-4bd7-8c0e-15922c55f5d8 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] PATH_INFO: `/v3/domains/03e36b71d4384337ba5bc5008ef5fe56` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:23.783691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e2076-7ae5-4bd7-8c0e-15922c55f5d8 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=03e36b71d4384337ba5bc5008ef5fe56)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:23.785038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e2076-7ae5-4bd7-8c0e-15922c55f5d8 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:23.814963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a55e2076-7ae5-4bd7-8c0e-15922c55f5d8 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '03e36b71d4384337ba5bc5008ef5fe56'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:23.815883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a55e2076-7ae5-4bd7-8c0e-15922c55f5d8 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '03e36b71d4384337ba5bc5008ef5fe56'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:23.845952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a55e2076-7ae5-4bd7-8c0e-15922c55f5d8 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '03e36b71d4384337ba5bc5008ef5fe56'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:23.846668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a55e2076-7ae5-4bd7-8c0e-15922c55f5d8 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '03e36b71d4384337ba5bc5008ef5fe56'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:23.849551 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2654/5344] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:21:23 2022] PATCH /identity/v3/domains/03e36b71d4384337ba5bc5008ef5fe56 => generated 246 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:23.853661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d58690-86bc-4e73-88f1-d6fa70a58ffd tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:23.855340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b4d58690-86bc-4e73-88f1-d6fa70a58ffd tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:23.867981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d58690-86bc-4e73-88f1-d6fa70a58ffd tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:23.942814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81dba4-c6db-45a9-a356-1eb050b061ca tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af0f4351d16541f599432566ddbabb9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a56a30336ee4acf9e22f51dfd63053a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:23.943701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81dba4-c6db-45a9-a356-1eb050b061ca tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:23.943981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81dba4-c6db-45a9-a356-1eb050b061ca tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:23.944305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81dba4-c6db-45a9-a356-1eb050b061ca tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] PATH_INFO: `/v3/domains/03e36b71d4384337ba5bc5008ef5fe56` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:23.956821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81dba4-c6db-45a9-a356-1eb050b061ca tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=03e36b71d4384337ba5bc5008ef5fe56)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:23.958504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81dba4-c6db-45a9-a356-1eb050b061ca tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:23.984550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7f81dba4-c6db-45a9-a356-1eb050b061ca tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '03e36b71d4384337ba5bc5008ef5fe56'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:23.995369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7f81dba4-c6db-45a9-a356-1eb050b061ca tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '03e36b71d4384337ba5bc5008ef5fe56'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:24.072868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7f81dba4-c6db-45a9-a356-1eb050b061ca tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e36b71d4384337ba5bc5008ef5fe56', 'request_id': 'req-7f81dba4-c6db-45a9-a356-1eb050b061ca'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:24.088461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7f81dba4-c6db-45a9-a356-1eb050b061ca tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e36b71d4384337ba5bc5008ef5fe56', 'request_id': 'req-7f81dba4-c6db-45a9-a356-1eb050b061ca'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:24.098571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7f81dba4-c6db-45a9-a356-1eb050b061ca tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e36b71d4384337ba5bc5008ef5fe56', 'request_id': 'req-7f81dba4-c6db-45a9-a356-1eb050b061ca'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:24.114769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7f81dba4-c6db-45a9-a356-1eb050b061ca tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] The token cache is being invalidate because project 03e36b71d4384337ba5bc5008ef5fe56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:24.115020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7f81dba4-c6db-45a9-a356-1eb050b061ca tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:24.115811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7f81dba4-c6db-45a9-a356-1eb050b061ca tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:24.127355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7f81dba4-c6db-45a9-a356-1eb050b061ca tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '03e36b71d4384337ba5bc5008ef5fe56', 'request_id': 'req-7f81dba4-c6db-45a9-a356-1eb050b061ca'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:24.128145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7f81dba4-c6db-45a9-a356-1eb050b061ca tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '03e36b71d4384337ba5bc5008ef5fe56', 'request_id': 'req-7f81dba4-c6db-45a9-a356-1eb050b061ca'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:24.128741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7f81dba4-c6db-45a9-a356-1eb050b061ca tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '03e36b71d4384337ba5bc5008ef5fe56', 'request_id': 'req-7f81dba4-c6db-45a9-a356-1eb050b061ca'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:24.147364 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2691/5345] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:21:23 2022] DELETE /identity/v3/domains/03e36b71d4384337ba5bc5008ef5fe56 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:24.148913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e2076-7ae5-4bd7-8c0e-15922c55f5d8 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:24.150229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a55e2076-7ae5-4bd7-8c0e-15922c55f5d8 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:24.260351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e2076-7ae5-4bd7-8c0e-15922c55f5d8 tempest-TestDefaultProjectId-787674500 tempest-TestDefaultProjectId-787674500-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:24.294766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:24.385999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3322d0-097e-4e19-b0d9-50be336bf131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:24.386900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3322d0-097e-4e19-b0d9-50be336bf131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:24.387186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3322d0-097e-4e19-b0d9-50be336bf131 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:24.387465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3322d0-097e-4e19-b0d9-50be336bf131 admin admin] PATH_INFO: `/v3/users/b953b0d0a48b4bab8b17abb0b3bbc284` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:24.388856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3322d0-097e-4e19-b0d9-50be336bf131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b953b0d0a48b4bab8b17abb0b3bbc284)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:24.390885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3322d0-097e-4e19-b0d9-50be336bf131 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:24.478304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bf3322d0-097e-4e19-b0d9-50be336bf131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b953b0d0a48b4bab8b17abb0b3bbc284'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:24.492367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bf3322d0-097e-4e19-b0d9-50be336bf131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b953b0d0a48b4bab8b17abb0b3bbc284'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:24.503884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bf3322d0-097e-4e19-b0d9-50be336bf131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b953b0d0a48b4bab8b17abb0b3bbc284'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:24.504792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bf3322d0-097e-4e19-b0d9-50be336bf131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b953b0d0a48b4bab8b17abb0b3bbc284'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:24.506589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bf3322d0-097e-4e19-b0d9-50be336bf131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b953b0d0a48b4bab8b17abb0b3bbc284'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:24.540341 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2655/5346] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:24 2022] DELETE /identity/v3/users/b953b0d0a48b4bab8b17abb0b3bbc284 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:24.542006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40185451-94a5-4de3-b868-c626d644d9ac None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:24.542423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40185451-94a5-4de3-b868-c626d644d9ac None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:24.542803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40185451-94a5-4de3-b868-c626d644d9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:24.549869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:24.562916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-40185451-94a5-4de3-b868-c626d644d9ac None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:24.564178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-40185451-94a5-4de3-b868-c626d644d9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:24.633891 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2692/5347] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:24.676810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3322d0-097e-4e19-b0d9-50be336bf131 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:24.680527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bf3322d0-097e-4e19-b0d9-50be336bf131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:24.774005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3322d0-097e-4e19-b0d9-50be336bf131 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:24.779507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f90ca6-536a-4c2d-9b25-06569045a66d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:24.780373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f90ca6-536a-4c2d-9b25-06569045a66d service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:24.780950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f90ca6-536a-4c2d-9b25-06569045a66d service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:24.780950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f90ca6-536a-4c2d-9b25-06569045a66d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:24.792152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f90ca6-536a-4c2d-9b25-06569045a66d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:24.793695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f90ca6-536a-4c2d-9b25-06569045a66d service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:24.806503 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2656/5348] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:25.655887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40185451-94a5-4de3-b868-c626d644d9ac None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:25.659628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-40185451-94a5-4de3-b868-c626d644d9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:25.693735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40185451-94a5-4de3-b868-c626d644d9ac None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:25.711176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043f606-0432-4364-ad16-c83bdc5a8043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:25.713446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f606-0432-4364-ad16-c83bdc5a8043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:25.714156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f606-0432-4364-ad16-c83bdc5a8043 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:25.714947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f606-0432-4364-ad16-c83bdc5a8043 admin admin] PATH_INFO: `/v3/projects/60c8d5110a9b40378d00692b8bc5642a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:25.717004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043f606-0432-4364-ad16-c83bdc5a8043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60c8d5110a9b40378d00692b8bc5642a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:25.719859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043f606-0432-4364-ad16-c83bdc5a8043 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:25.870192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c043f606-0432-4364-ad16-c83bdc5a8043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60c8d5110a9b40378d00692b8bc5642a', 'request_id': 'req-c043f606-0432-4364-ad16-c83bdc5a8043'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:25.893182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c043f606-0432-4364-ad16-c83bdc5a8043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60c8d5110a9b40378d00692b8bc5642a', 'request_id': 'req-c043f606-0432-4364-ad16-c83bdc5a8043'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:25.903022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c043f606-0432-4364-ad16-c83bdc5a8043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60c8d5110a9b40378d00692b8bc5642a', 'request_id': 'req-c043f606-0432-4364-ad16-c83bdc5a8043'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:25.926088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c043f606-0432-4364-ad16-c83bdc5a8043 admin admin] The token cache is being invalidate because project 60c8d5110a9b40378d00692b8bc5642a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:25.926649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c043f606-0432-4364-ad16-c83bdc5a8043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:25.936565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c043f606-0432-4364-ad16-c83bdc5a8043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:25.941703 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2693/5349] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:25 2022] DELETE /identity/v3/projects/60c8d5110a9b40378d00692b8bc5642a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:25.942986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f90ca6-536a-4c2d-9b25-06569045a66d service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:25.965995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f90ca6-536a-4c2d-9b25-06569045a66d service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:26.070531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:26.098846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e2a65-bfbc-4e42-8280-b3559060d7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:26.099754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e2a65-bfbc-4e42-8280-b3559060d7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:26.100117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e2a65-bfbc-4e42-8280-b3559060d7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:26.100934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e2a65-bfbc-4e42-8280-b3559060d7a2 admin admin] PATH_INFO: `/v3/users/af0f4351d16541f599432566ddbabb9b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:26.101858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e2a65-bfbc-4e42-8280-b3559060d7a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af0f4351d16541f599432566ddbabb9b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:26.104569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e2a65-bfbc-4e42-8280-b3559060d7a2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:26.207456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-144e2a65-bfbc-4e42-8280-b3559060d7a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af0f4351d16541f599432566ddbabb9b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:26.228345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-144e2a65-bfbc-4e42-8280-b3559060d7a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af0f4351d16541f599432566ddbabb9b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:26.238372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-144e2a65-bfbc-4e42-8280-b3559060d7a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af0f4351d16541f599432566ddbabb9b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:26.239239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-144e2a65-bfbc-4e42-8280-b3559060d7a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af0f4351d16541f599432566ddbabb9b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:26.240724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-144e2a65-bfbc-4e42-8280-b3559060d7a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af0f4351d16541f599432566ddbabb9b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:26.277598 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2657/5350] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:25 2022] DELETE /identity/v3/users/af0f4351d16541f599432566ddbabb9b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:27.639456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043f606-0432-4364-ad16-c83bdc5a8043 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:27.640954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c043f606-0432-4364-ad16-c83bdc5a8043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:27.849012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043f606-0432-4364-ad16-c83bdc5a8043 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:27.906296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e2a65-bfbc-4e42-8280-b3559060d7a2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:27.907838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-144e2a65-bfbc-4e42-8280-b3559060d7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:27.943258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:28.035508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0124e-79ad-4bae-8bb3-4dae703f186b tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35039ce9576f46d5b1203a94b96c5831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d080b32770a4d0ca3fb5c5c2ad1a76d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:28.036468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0124e-79ad-4bae-8bb3-4dae703f186b tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:28.036851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0124e-79ad-4bae-8bb3-4dae703f186b tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:28.037421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0124e-79ad-4bae-8bb3-4dae703f186b tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:28.038278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0124e-79ad-4bae-8bb3-4dae703f186b tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:21:28.038692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0124e-79ad-4bae-8bb3-4dae703f186b tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:28.040949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0124e-79ad-4bae-8bb3-4dae703f186b tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:28.066023 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2694/5351] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:28.066455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e2a65-bfbc-4e42-8280-b3559060d7a2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:28.067388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0124e-79ad-4bae-8bb3-4dae703f186b tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:28.074690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a7e0124e-79ad-4bae-8bb3-4dae703f186b tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:28.085553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2452100-010e-4b85-b209-ce36977391b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:28.086471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2452100-010e-4b85-b209-ce36977391b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:28.086956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2452100-010e-4b85-b209-ce36977391b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:28.087387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2452100-010e-4b85-b209-ce36977391b1 admin admin] PATH_INFO: `/v3/users/a5f990598f63461d92323d441e8bb5a5` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:28.089151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2452100-010e-4b85-b209-ce36977391b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f990598f63461d92323d441e8bb5a5)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:28.091285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2452100-010e-4b85-b209-ce36977391b1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:28.093809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0124e-79ad-4bae-8bb3-4dae703f186b tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:28.100149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb772b-d790-4492-9959-8c4c3efc90c9 tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35039ce9576f46d5b1203a94b96c5831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d080b32770a4d0ca3fb5c5c2ad1a76d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:28.101609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb772b-d790-4492-9959-8c4c3efc90c9 tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:28.102267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb772b-d790-4492-9959-8c4c3efc90c9 tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:28.103344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb772b-d790-4492-9959-8c4c3efc90c9 tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:28.104554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb772b-d790-4492-9959-8c4c3efc90c9 tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:28.108014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb772b-d790-4492-9959-8c4c3efc90c9 tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:28.160170 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2695/5352] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:28 2022] POST /identity/v3/projects => generated 349 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:28.164166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb772b-d790-4492-9959-8c4c3efc90c9 tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:28.193832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f2452100-010e-4b85-b209-ce36977391b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f990598f63461d92323d441e8bb5a5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:28.209808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f2452100-010e-4b85-b209-ce36977391b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f990598f63461d92323d441e8bb5a5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:28.217076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:28.219286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f2452100-010e-4b85-b209-ce36977391b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f990598f63461d92323d441e8bb5a5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:28.220429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f2452100-010e-4b85-b209-ce36977391b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f990598f63461d92323d441e8bb5a5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:28.229997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f2452100-010e-4b85-b209-ce36977391b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f990598f63461d92323d441e8bb5a5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:28.249095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb772b-d790-4492-9959-8c4c3efc90c9 tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:28.258483 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2658/5353] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:27 2022] DELETE /identity/v3/users/a5f990598f63461d92323d441e8bb5a5 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:28.263214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99d258-5f97-43fa-849f-36b396d7ff53 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:28.263637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99d258-5f97-43fa-849f-36b396d7ff53 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:28.264018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99d258-5f97-43fa-849f-36b396d7ff53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:28.266953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c62193-6e69-477f-becb-e421e87aa366 tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35039ce9576f46d5b1203a94b96c5831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d080b32770a4d0ca3fb5c5c2ad1a76d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:28.268302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c62193-6e69-477f-becb-e421e87aa366 tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:28.268696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c62193-6e69-477f-becb-e421e87aa366 tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:28.269212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c62193-6e69-477f-becb-e421e87aa366 tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:28.270191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c62193-6e69-477f-becb-e421e87aa366 tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:21:28.270748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c62193-6e69-477f-becb-e421e87aa366 tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:28.273513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c62193-6e69-477f-becb-e421e87aa366 tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:28.293049 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2696/5354] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:28.313322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2b99d258-5f97-43fa-849f-36b396d7ff53 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:28.314915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2b99d258-5f97-43fa-849f-36b396d7ff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:28.346443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c62193-6e69-477f-becb-e421e87aa366 tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:28.348623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d7c62193-6e69-477f-becb-e421e87aa366 tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:28.489596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c62193-6e69-477f-becb-e421e87aa366 tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:28.516255 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2659/5355] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:21:28.527842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99d258-5f97-43fa-849f-36b396d7ff53 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:28.530301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2b99d258-5f97-43fa-849f-36b396d7ff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:28.575674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:28.593486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e37e5a-629d-44e7-9927-03cd7cc40123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:28.594836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e37e5a-629d-44e7-9927-03cd7cc40123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:28.595113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e37e5a-629d-44e7-9927-03cd7cc40123 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:28.595382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e37e5a-629d-44e7-9927-03cd7cc40123 admin admin] PATH_INFO: `/v3/projects/7a56a30336ee4acf9e22f51dfd63053a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:28.601531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e37e5a-629d-44e7-9927-03cd7cc40123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a56a30336ee4acf9e22f51dfd63053a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:28.603682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e37e5a-629d-44e7-9927-03cd7cc40123 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:28.610717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99d258-5f97-43fa-849f-36b396d7ff53 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:28.614563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e179b4-010f-49d7-9b01-13b57b1c545a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:28.615457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e179b4-010f-49d7-9b01-13b57b1c545a service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:28.615575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e179b4-010f-49d7-9b01-13b57b1c545a service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:28.615757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e179b4-010f-49d7-9b01-13b57b1c545a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:28.626076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e179b4-010f-49d7-9b01-13b57b1c545a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:28.627783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e179b4-010f-49d7-9b01-13b57b1c545a service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:28.640138 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2660/5356] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:28.672765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f7e37e5a-629d-44e7-9927-03cd7cc40123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a56a30336ee4acf9e22f51dfd63053a', 'request_id': 'req-f7e37e5a-629d-44e7-9927-03cd7cc40123'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:28.685029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f7e37e5a-629d-44e7-9927-03cd7cc40123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a56a30336ee4acf9e22f51dfd63053a', 'request_id': 'req-f7e37e5a-629d-44e7-9927-03cd7cc40123'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:28.702477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f7e37e5a-629d-44e7-9927-03cd7cc40123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a56a30336ee4acf9e22f51dfd63053a', 'request_id': 'req-f7e37e5a-629d-44e7-9927-03cd7cc40123'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:28.735499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f7e37e5a-629d-44e7-9927-03cd7cc40123 admin admin] The token cache is being invalidate because project 7a56a30336ee4acf9e22f51dfd63053a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:28.735794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f7e37e5a-629d-44e7-9927-03cd7cc40123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:28.736545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f7e37e5a-629d-44e7-9927-03cd7cc40123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:28.741606 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2697/5357] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:28 2022] DELETE /identity/v3/projects/7a56a30336ee4acf9e22f51dfd63053a => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:28.743127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54e8a6-36a4-4d3d-8a52-903350b6f2a6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:28.743409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54e8a6-36a4-4d3d-8a52-903350b6f2a6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:28.743682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54e8a6-36a4-4d3d-8a52-903350b6f2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:28.769408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0a54e8a6-36a4-4d3d-8a52-903350b6f2a6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:28.771241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0a54e8a6-36a4-4d3d-8a52-903350b6f2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:28.900217 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2661/5358] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:21:28.909528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b175474-16b6-4288-aac3-9d0719d597b4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:28.910263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b175474-16b6-4288-aac3-9d0719d597b4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:28.910681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b175474-16b6-4288-aac3-9d0719d597b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:28.953666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7b175474-16b6-4288-aac3-9d0719d597b4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:28.955024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7b175474-16b6-4288-aac3-9d0719d597b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:28.973878 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2698/5359] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:28.978279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54e8a6-36a4-4d3d-8a52-903350b6f2a6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:28.990169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b175474-16b6-4288-aac3-9d0719d597b4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:28.992981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7b175474-16b6-4288-aac3-9d0719d597b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:28.998473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54e8a6-36a4-4d3d-8a52-903350b6f2a6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:29.014229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b175474-16b6-4288-aac3-9d0719d597b4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:29.015221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bafeb7-a899-4cf0-8eba-437cd3429178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:29.017271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bafeb7-a899-4cf0-8eba-437cd3429178 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:29.017657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bafeb7-a899-4cf0-8eba-437cd3429178 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:29.018084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bafeb7-a899-4cf0-8eba-437cd3429178 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:29.019493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c69f0-ac1f-4dd0-ba1d-7ae758990228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:29.020614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c69f0-ac1f-4dd0-ba1d-7ae758990228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:29.020977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c69f0-ac1f-4dd0-ba1d-7ae758990228 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:29.021140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bafeb7-a899-4cf0-8eba-437cd3429178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:21:29.021533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bafeb7-a899-4cf0-8eba-437cd3429178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:29.021666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c69f0-ac1f-4dd0-ba1d-7ae758990228 admin admin] PATH_INFO: `/v3/projects/87d8757ccac34bbfb8fe89cef3a9b8f3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:29.024306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c69f0-ac1f-4dd0-ba1d-7ae758990228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87d8757ccac34bbfb8fe89cef3a9b8f3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:29.026290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c69f0-ac1f-4dd0-ba1d-7ae758990228 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:29.027635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bafeb7-a899-4cf0-8eba-437cd3429178 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:29.089568 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2662/5360] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:21:29.090871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bafeb7-a899-4cf0-8eba-437cd3429178 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:29.133264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bafeb7-a899-4cf0-8eba-437cd3429178 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:29.144966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:29.145536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5a7c69f0-ac1f-4dd0-ba1d-7ae758990228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87d8757ccac34bbfb8fe89cef3a9b8f3', 'request_id': 'req-5a7c69f0-ac1f-4dd0-ba1d-7ae758990228'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:29.171314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5a7c69f0-ac1f-4dd0-ba1d-7ae758990228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87d8757ccac34bbfb8fe89cef3a9b8f3', 'request_id': 'req-5a7c69f0-ac1f-4dd0-ba1d-7ae758990228'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:29.187807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5a7c69f0-ac1f-4dd0-ba1d-7ae758990228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87d8757ccac34bbfb8fe89cef3a9b8f3', 'request_id': 'req-5a7c69f0-ac1f-4dd0-ba1d-7ae758990228'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:29.227178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5a7c69f0-ac1f-4dd0-ba1d-7ae758990228 admin admin] The token cache is being invalidate because project 87d8757ccac34bbfb8fe89cef3a9b8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:29.227492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5a7c69f0-ac1f-4dd0-ba1d-7ae758990228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:29.232588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5a7c69f0-ac1f-4dd0-ba1d-7ae758990228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:29.239053 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2699/5361] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:28 2022] DELETE /identity/v3/projects/87d8757ccac34bbfb8fe89cef3a9b8f3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:29.246168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6973b-9ffb-43fd-b73c-efd8d176153d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:29.246457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6973b-9ffb-43fd-b73c-efd8d176153d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:29.246792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6973b-9ffb-43fd-b73c-efd8d176153d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:29.271175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fbc36-19b9-4b46-a636-48e6806de489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:29.272654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fbc36-19b9-4b46-a636-48e6806de489 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:29.273114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fbc36-19b9-4b46-a636-48e6806de489 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:29.273557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fbc36-19b9-4b46-a636-48e6806de489 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:29.274597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742fbc36-19b9-4b46-a636-48e6806de489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:29.276587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742fbc36-19b9-4b46-a636-48e6806de489 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:29.296072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e2b6973b-9ffb-43fd-b73c-efd8d176153d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:29.300858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e2b6973b-9ffb-43fd-b73c-efd8d176153d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:29.314312 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2663/5362] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:29 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:29.315659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fbc36-19b9-4b46-a636-48e6806de489 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:29.317899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-742fbc36-19b9-4b46-a636-48e6806de489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:29.327306 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2700/5363] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:29.328227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6973b-9ffb-43fd-b73c-efd8d176153d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:29.335242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e2b6973b-9ffb-43fd-b73c-efd8d176153d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:29.354334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6973b-9ffb-43fd-b73c-efd8d176153d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:29.395788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fbc36-19b9-4b46-a636-48e6806de489 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:29.406594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457c099-cba8-4748-9e02-1241255a525c tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35039ce9576f46d5b1203a94b96c5831', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d080b32770a4d0ca3fb5c5c2ad1a76d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:29.407494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457c099-cba8-4748-9e02-1241255a525c tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:29.407779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457c099-cba8-4748-9e02-1241255a525c tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:29.408140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457c099-cba8-4748-9e02-1241255a525c tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] PATH_INFO: `/v3/projects/15055a8133ab41258deec781b5e900c8` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:29.409778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457c099-cba8-4748-9e02-1241255a525c tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] RBAC: Authorizing `identity:delete_project(project_id=15055a8133ab41258deec781b5e900c8)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:29.415460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457c099-cba8-4748-9e02-1241255a525c tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:29.427606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:29.454094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a392c-3fc4-4cd6-8a3a-c092f2d722bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:29.455590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a392c-3fc4-4cd6-8a3a-c092f2d722bd admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:29.455970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a392c-3fc4-4cd6-8a3a-c092f2d722bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:29.456410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a392c-3fc4-4cd6-8a3a-c092f2d722bd admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:29.457414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a392c-3fc4-4cd6-8a3a-c092f2d722bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:29.461209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a392c-3fc4-4cd6-8a3a-c092f2d722bd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:29.514952 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2701/5364] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:29 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:29.514952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b326e88-b842-4b75-8a34-ec144a6a0d61 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:29.514952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b326e88-b842-4b75-8a34-ec144a6a0d61 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:29.514952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b326e88-b842-4b75-8a34-ec144a6a0d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:29.540215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b457c099-cba8-4748-9e02-1241255a525c tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15055a8133ab41258deec781b5e900c8', 'request_id': 'req-b457c099-cba8-4748-9e02-1241255a525c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:29.548826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0b326e88-b842-4b75-8a34-ec144a6a0d61 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:29.550120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0b326e88-b842-4b75-8a34-ec144a6a0d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:29.550818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b457c099-cba8-4748-9e02-1241255a525c tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15055a8133ab41258deec781b5e900c8', 'request_id': 'req-b457c099-cba8-4748-9e02-1241255a525c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:29.562763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b457c099-cba8-4748-9e02-1241255a525c tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15055a8133ab41258deec781b5e900c8', 'request_id': 'req-b457c099-cba8-4748-9e02-1241255a525c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:29.582584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b457c099-cba8-4748-9e02-1241255a525c tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] The token cache is being invalidate because project 15055a8133ab41258deec781b5e900c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:29.590996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b457c099-cba8-4748-9e02-1241255a525c tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:29.592712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b457c099-cba8-4748-9e02-1241255a525c tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:29.595560 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2664/5365] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:29 2022] DELETE /identity/v3/projects/15055a8133ab41258deec781b5e900c8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:29.599743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457c099-cba8-4748-9e02-1241255a525c tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:29.603312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b457c099-cba8-4748-9e02-1241255a525c tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:29.649221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:29.662722 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2702/5366] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:29.664246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b326e88-b842-4b75-8a34-ec144a6a0d61 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:29.665716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0b326e88-b842-4b75-8a34-ec144a6a0d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:29.705648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457c099-cba8-4748-9e02-1241255a525c tempest-RoutersAdminTest-1409604170 tempest-RoutersAdminTest-1409604170-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:29.710407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73ca79-594b-42bf-b953-4f558a536676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:29.711242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73ca79-594b-42bf-b953-4f558a536676 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:29.711648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73ca79-594b-42bf-b953-4f558a536676 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:29.712097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73ca79-594b-42bf-b953-4f558a536676 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:29.712909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73ca79-594b-42bf-b953-4f558a536676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:29.714663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73ca79-594b-42bf-b953-4f558a536676 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:29.728223 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2665/5367] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:29.728223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73ca79-594b-42bf-b953-4f558a536676 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:29.735526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b326e88-b842-4b75-8a34-ec144a6a0d61 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:29.738926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73ca79-594b-42bf-b953-4f558a536676 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:29.739259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf6216-ae39-43da-935e-894ba0061fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:29.739914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf6216-ae39-43da-935e-894ba0061fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:29.740222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf6216-ae39-43da-935e-894ba0061fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:29.740497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf6216-ae39-43da-935e-894ba0061fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:29.742281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d4bf6216-ae39-43da-935e-894ba0061fc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:29.744286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa683b8-07ce-452f-ba3d-28b9213e8787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:29.745072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa683b8-07ce-452f-ba3d-28b9213e8787 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:29.745485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa683b8-07ce-452f-ba3d-28b9213e8787 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:29.745871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa683b8-07ce-452f-ba3d-28b9213e8787 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:29.746705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa683b8-07ce-452f-ba3d-28b9213e8787 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:21:29.747112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa683b8-07ce-452f-ba3d-28b9213e8787 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:29.748993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa683b8-07ce-452f-ba3d-28b9213e8787 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:29.764664 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2666/5368] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:29.765728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa683b8-07ce-452f-ba3d-28b9213e8787 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:29.775754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa683b8-07ce-452f-ba3d-28b9213e8787 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:29.781013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97bbf7-3729-4065-a218-698b6b4338d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:29.781682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97bbf7-3729-4065-a218-698b6b4338d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:29.781961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97bbf7-3729-4065-a218-698b6b4338d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:29.782239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97bbf7-3729-4065-a218-698b6b4338d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:29.783023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97bbf7-3729-4065-a218-698b6b4338d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:29.784707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97bbf7-3729-4065-a218-698b6b4338d9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:29.796207 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2667/5369] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:29.796395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97bbf7-3729-4065-a218-698b6b4338d9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:29.808295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97bbf7-3729-4065-a218-698b6b4338d9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:29.808489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf6216-ae39-43da-935e-894ba0061fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:29.810002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf6216-ae39-43da-935e-894ba0061fc7 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:29.813920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a509c9-1923-4129-ac17-48075cf7457f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:29.814884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a509c9-1923-4129-ac17-48075cf7457f admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:29.815237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a509c9-1923-4129-ac17-48075cf7457f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:29.815570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a509c9-1923-4129-ac17-48075cf7457f admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:29.816384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a509c9-1923-4129-ac17-48075cf7457f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:29.818431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a509c9-1923-4129-ac17-48075cf7457f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:29.820640 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2703/5370] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:29.821510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf6216-ae39-43da-935e-894ba0061fc7 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:29.834429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf6216-ae39-43da-935e-894ba0061fc7 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:29.840516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7deaf-f7ec-486f-b0d5-4894adeff354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:29.841458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7deaf-f7ec-486f-b0d5-4894adeff354 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:29.841736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7deaf-f7ec-486f-b0d5-4894adeff354 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:29.842005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7deaf-f7ec-486f-b0d5-4894adeff354 admin admin] PATH_INFO: `/v3/projects/208a9aaf4ec543edb2148b73b1d01a57/users/5a91c8092f874cb8a617d5ed78337f9c/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:29.853713 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2668/5371] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:29 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:29.858022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a509c9-1923-4129-ac17-48075cf7457f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:29.860727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7deaf-f7ec-486f-b0d5-4894adeff354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=208a9aaf4ec543edb2148b73b1d01a57, user_id=5a91c8092f874cb8a617d5ed78337f9c, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:29.863880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7deaf-f7ec-486f-b0d5-4894adeff354 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:29.882165 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2704/5372] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:29 2022] PUT /identity/v3/projects/208a9aaf4ec543edb2148b73b1d01a57/users/5a91c8092f874cb8a617d5ed78337f9c/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:29.894852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc756c-513e-4b95-b4d5-677644944309 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:29.895410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc756c-513e-4b95-b4d5-677644944309 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:29.895833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc756c-513e-4b95-b4d5-677644944309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:29.909993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:29.926391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-14bc756c-513e-4b95-b4d5-677644944309 None None] MFA Rules not processed for user `5a91c8092f874cb8a617d5ed78337f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:29.927857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-14bc756c-513e-4b95-b4d5-677644944309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:29.941454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a509c9-1923-4129-ac17-48075cf7457f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:30.036219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892372c-e2a0-4e3c-aa79-5da76c679437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:30.036901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892372c-e2a0-4e3c-aa79-5da76c679437 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:30.037373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892372c-e2a0-4e3c-aa79-5da76c679437 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:30.037483 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2705/5373] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:21:30.037594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892372c-e2a0-4e3c-aa79-5da76c679437 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:30.038296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892372c-e2a0-4e3c-aa79-5da76c679437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:30.040327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892372c-e2a0-4e3c-aa79-5da76c679437 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:30.042141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc756c-513e-4b95-b4d5-677644944309 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:30.056881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc756c-513e-4b95-b4d5-677644944309 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:30.063020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8b984-1f27-48d1-909a-73f0d2505101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:30.063761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8b984-1f27-48d1-909a-73f0d2505101 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:30.064102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8b984-1f27-48d1-909a-73f0d2505101 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:30.064401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8b984-1f27-48d1-909a-73f0d2505101 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:30.065396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8b984-1f27-48d1-909a-73f0d2505101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:30.067605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8b984-1f27-48d1-909a-73f0d2505101 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:30.067809 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2669/5374] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:29 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:30.068775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892372c-e2a0-4e3c-aa79-5da76c679437 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:30.080897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892372c-e2a0-4e3c-aa79-5da76c679437 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:30.088638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa34de-c7a0-475b-a81b-7ec06bbd7160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:30.089804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa34de-c7a0-475b-a81b-7ec06bbd7160 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:30.090373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa34de-c7a0-475b-a81b-7ec06bbd7160 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:30.090891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa34de-c7a0-475b-a81b-7ec06bbd7160 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:30.091767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa34de-c7a0-475b-a81b-7ec06bbd7160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:30.093774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa34de-c7a0-475b-a81b-7ec06bbd7160 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:30.100681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:30.111330 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2670/5375] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:30.113603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa34de-c7a0-475b-a81b-7ec06bbd7160 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:30.127177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa34de-c7a0-475b-a81b-7ec06bbd7160 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:30.135996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1407a4-4246-48cd-bd24-13be7249c7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:30.136954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1407a4-4246-48cd-bd24-13be7249c7fd admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:30.137380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1407a4-4246-48cd-bd24-13be7249c7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:30.137748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1407a4-4246-48cd-bd24-13be7249c7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:30.142158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1407a4-4246-48cd-bd24-13be7249c7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:30.142158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1407a4-4246-48cd-bd24-13be7249c7fd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:30.149318 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2706/5376] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:30 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:21:30.153913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8b984-1f27-48d1-909a-73f0d2505101 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:30.161507 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2671/5377] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:30.166032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1407a4-4246-48cd-bd24-13be7249c7fd admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:30.195211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1407a4-4246-48cd-bd24-13be7249c7fd admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:30.291866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb8c0f-ac3d-453d-9179-aaf4c3a00365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:30.293516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb8c0f-ac3d-453d-9179-aaf4c3a00365 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:30.293516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb8c0f-ac3d-453d-9179-aaf4c3a00365 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:30.293516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb8c0f-ac3d-453d-9179-aaf4c3a00365 admin admin] PATH_INFO: `/v3/projects/520b14203b364258b249d5f349aa10d4/users/780d895863db4be2a19299b68b40e5f2/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:30.313993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb8c0f-ac3d-453d-9179-aaf4c3a00365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=520b14203b364258b249d5f349aa10d4, user_id=780d895863db4be2a19299b68b40e5f2, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:30.317820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb8c0f-ac3d-453d-9179-aaf4c3a00365 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:30.333083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8b984-1f27-48d1-909a-73f0d2505101 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:30.347488 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2672/5378] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:30 2022] PUT /identity/v3/projects/520b14203b364258b249d5f349aa10d4/users/780d895863db4be2a19299b68b40e5f2/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:30.349728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908db37-629a-4dc6-adda-90134723d4ed None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:30.350080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908db37-629a-4dc6-adda-90134723d4ed None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:30.350511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908db37-629a-4dc6-adda-90134723d4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:30.393579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e908db37-629a-4dc6-adda-90134723d4ed None None] MFA Rules not processed for user `780d895863db4be2a19299b68b40e5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:30.395236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e908db37-629a-4dc6-adda-90134723d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:30.447756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1455cde-bd53-4542-aa15-a682a9321a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:30.447756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1455cde-bd53-4542-aa15-a682a9321a9a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:30.447756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1455cde-bd53-4542-aa15-a682a9321a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:30.447756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1455cde-bd53-4542-aa15-a682a9321a9a admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:30.448785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1455cde-bd53-4542-aa15-a682a9321a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:30.448785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1455cde-bd53-4542-aa15-a682a9321a9a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:30.472497 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2707/5379] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:30 2022] POST /identity/v3/users => generated 300 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:30.476817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1455cde-bd53-4542-aa15-a682a9321a9a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:30.489014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1455cde-bd53-4542-aa15-a682a9321a9a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:30.490012 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2673/5380] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:30.495051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360c406-6dc8-4529-8d82-5cf9a9950bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:30.495829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360c406-6dc8-4529-8d82-5cf9a9950bde admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:30.496336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360c406-6dc8-4529-8d82-5cf9a9950bde admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:30.496657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360c406-6dc8-4529-8d82-5cf9a9950bde admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:30.497451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360c406-6dc8-4529-8d82-5cf9a9950bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:30.499129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360c406-6dc8-4529-8d82-5cf9a9950bde admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:30.502402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908db37-629a-4dc6-adda-90134723d4ed None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:30.504159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e908db37-629a-4dc6-adda-90134723d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:30.505567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:30.515317 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2708/5381] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:21:30.517533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360c406-6dc8-4529-8d82-5cf9a9950bde admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:30.528741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360c406-6dc8-4529-8d82-5cf9a9950bde admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:30.533835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23483f-e65d-47ac-9f9c-83f7fadf80da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:30.534953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23483f-e65d-47ac-9f9c-83f7fadf80da admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:30.535404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23483f-e65d-47ac-9f9c-83f7fadf80da admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:30.535787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23483f-e65d-47ac-9f9c-83f7fadf80da admin admin] PATH_INFO: `/v3/projects/06004d743d7a48d88e6a448eb8b7af9d/users/7e403c9de9a14e9594407a010f5ba89f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:30.553799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23483f-e65d-47ac-9f9c-83f7fadf80da admin admin] RBAC: Authorizing `identity:create_grant(project_id=06004d743d7a48d88e6a448eb8b7af9d, user_id=7e403c9de9a14e9594407a010f5ba89f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:30.557476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23483f-e65d-47ac-9f9c-83f7fadf80da admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:30.575766 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2709/5382] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:30 2022] PUT /identity/v3/projects/06004d743d7a48d88e6a448eb8b7af9d/users/7e403c9de9a14e9594407a010f5ba89f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:30.578642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908db37-629a-4dc6-adda-90134723d4ed None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:30.579683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23483f-e65d-47ac-9f9c-83f7fadf80da admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:30.598981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:30.643283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beae67-7dc3-4d71-8dee-ec2d4c84bf51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:30.643939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beae67-7dc3-4d71-8dee-ec2d4c84bf51 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:30.644254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beae67-7dc3-4d71-8dee-ec2d4c84bf51 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:30.644572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0beae67-7dc3-4d71-8dee-ec2d4c84bf51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:30.658622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23483f-e65d-47ac-9f9c-83f7fadf80da admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:30.665127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06775533-2f2a-4e10-a65d-aecd707d22d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:30.665882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06775533-2f2a-4e10-a65d-aecd707d22d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:30.666169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06775533-2f2a-4e10-a65d-aecd707d22d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:30.666518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06775533-2f2a-4e10-a65d-aecd707d22d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:30.667677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06775533-2f2a-4e10-a65d-aecd707d22d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:30.669709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06775533-2f2a-4e10-a65d-aecd707d22d2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:30.680961 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2710/5383] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:21:30.685244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06775533-2f2a-4e10-a65d-aecd707d22d2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:30.695111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06775533-2f2a-4e10-a65d-aecd707d22d2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:30.700007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51562c0d-272d-4e9a-b0ac-e0f866c714c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:30.701190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51562c0d-272d-4e9a-b0ac-e0f866c714c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:30.701480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51562c0d-272d-4e9a-b0ac-e0f866c714c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:30.701757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51562c0d-272d-4e9a-b0ac-e0f866c714c2 admin admin] PATH_INFO: `/v3/projects/06004d743d7a48d88e6a448eb8b7af9d/users/7e403c9de9a14e9594407a010f5ba89f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:30.704462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51562c0d-272d-4e9a-b0ac-e0f866c714c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06004d743d7a48d88e6a448eb8b7af9d, user_id=7e403c9de9a14e9594407a010f5ba89f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:30.707255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51562c0d-272d-4e9a-b0ac-e0f866c714c2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:30.712288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beae67-7dc3-4d71-8dee-ec2d4c84bf51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:30.713847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0beae67-7dc3-4d71-8dee-ec2d4c84bf51 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:30.719529 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2711/5384] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:30 2022] PUT /identity/v3/projects/06004d743d7a48d88e6a448eb8b7af9d/users/7e403c9de9a14e9594407a010f5ba89f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:21:30.726124 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2674/5385] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:21:30.729635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f42a2-de02-4d2d-a280-b3333e7d3920 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:30.729927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f42a2-de02-4d2d-a280-b3333e7d3920 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:30.730207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f42a2-de02-4d2d-a280-b3333e7d3920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:30.765604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3b9f42a2-de02-4d2d-a280-b3333e7d3920 None None] MFA Rules not processed for user `7e403c9de9a14e9594407a010f5ba89f`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:30.766758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3b9f42a2-de02-4d2d-a280-b3333e7d3920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:30.851991 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2712/5386] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:21:30.853285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beae67-7dc3-4d71-8dee-ec2d4c84bf51 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:30.984400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0beae67-7dc3-4d71-8dee-ec2d4c84bf51 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:30.992074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63110e89-6877-4d1f-ab38-f9055f13f03f tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e403c9de9a14e9594407a010f5ba89f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06004d743d7a48d88e6a448eb8b7af9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:30.992866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63110e89-6877-4d1f-ab38-f9055f13f03f tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:30.994796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63110e89-6877-4d1f-ab38-f9055f13f03f tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:30.995248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63110e89-6877-4d1f-ab38-f9055f13f03f tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:30.996263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63110e89-6877-4d1f-ab38-f9055f13f03f tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:30.999167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63110e89-6877-4d1f-ab38-f9055f13f03f tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:31.024807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f42a2-de02-4d2d-a280-b3333e7d3920 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:31.028265 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2675/5387] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:30 2022] POST /identity/v3/services => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:31.041740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f42a2-de02-4d2d-a280-b3333e7d3920 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:31.087332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2d76e-67d6-4b48-9f5e-44c9d995b242 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e403c9de9a14e9594407a010f5ba89f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06004d743d7a48d88e6a448eb8b7af9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:31.090280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2d76e-67d6-4b48-9f5e-44c9d995b242 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:31.091941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2d76e-67d6-4b48-9f5e-44c9d995b242 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:31.097671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2d76e-67d6-4b48-9f5e-44c9d995b242 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:31.098637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2d76e-67d6-4b48-9f5e-44c9d995b242 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:31.110161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2d76e-67d6-4b48-9f5e-44c9d995b242 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-0ca2d76e-67d6-4b48-9f5e-44c9d995b242 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: Failed validating 'type' in schema['properties']['enabled']: Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: {'enum': [True, False, None], 'type': 'boolean'} Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: On instance['enabled']: Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: Failed validating 'type' in schema['properties']['enabled']: Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: {'enum': [True, False, None], 'type': 'boolean'} Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: On instance['enabled']: Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: 'False' Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise error Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application On instance['enabled']: Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application 'False' Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:21:31.116982 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:21:31.123255 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:21:31.123255 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:21:31.123255 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:21:31.123255 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:21:31.123255 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:21:31.123255 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:21:31.123255 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:21:31.123255 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:21:31.123255 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:21:31.123255 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:21:31.123255 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:21:31.123255 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:21:31.123255 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jul 02 21:21:31.123255 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jul 02 21:21:31.123255 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 02 21:21:31.123255 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 02 21:21:31.123255 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 02 21:21:31.124763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 02 21:21:31.124763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 02 21:21:31.124763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:21:31.124763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 02 21:21:31.124763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 02 21:21:31.124763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:21:31.124763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application On instance['enabled']: Jul 02 21:21:31.124763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application 'False' Jul 02 21:21:31.124763 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:21:31.126629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63110e89-6877-4d1f-ab38-f9055f13f03f tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:31.128430 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2713/5388] 10.222.0.43 () {60 vars in 1155 bytes} [Sat Jul 2 21:21:31 2022] POST /identity/v3/endpoints => generated 283 bytes in 105 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 02 21:21:31.141494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63110e89-6877-4d1f-ab38-f9055f13f03f tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:31.154435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b7b87-01e2-446e-8cdb-46d0a48f6484 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e403c9de9a14e9594407a010f5ba89f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06004d743d7a48d88e6a448eb8b7af9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:31.154435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b7b87-01e2-446e-8cdb-46d0a48f6484 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:31.156153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b7b87-01e2-446e-8cdb-46d0a48f6484 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:31.156153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b7b87-01e2-446e-8cdb-46d0a48f6484 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:31.156153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b7b87-01e2-446e-8cdb-46d0a48f6484 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:31.160951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b7b87-01e2-446e-8cdb-46d0a48f6484 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-e95b7b87-01e2-446e-8cdb-46d0a48f6484 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: Failed validating 'type' in schema['properties']['enabled']: Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: {'enum': [True, False, None], 'type': 'boolean'} Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: On instance['enabled']: Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: Failed validating 'type' in schema['properties']['enabled']: Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: {'enum': [True, False, None], 'type': 'boolean'} Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: On instance['enabled']: Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: 'True' Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise error Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application On instance['enabled']: Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application 'True' Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:21:31.214660 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:21:31.216620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:21:31.216620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:21:31.216620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:21:31.216620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:21:31.216620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:21:31.216620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:21:31.216620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:21:31.216620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:21:31.216620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:21:31.216620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:21:31.216620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:21:31.216620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:21:31.216620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jul 02 21:21:31.216620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jul 02 21:21:31.216620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 02 21:21:31.216620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 02 21:21:31.216620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 02 21:21:31.217809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 02 21:21:31.217809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 02 21:21:31.217809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:21:31.217809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 02 21:21:31.217809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 02 21:21:31.217809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:21:31.217809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application On instance['enabled']: Jul 02 21:21:31.217809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application 'True' Jul 02 21:21:31.217809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:21:31.217809 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2676/5389] 10.222.0.43 () {60 vars in 1155 bytes} [Sat Jul 2 21:21:31 2022] POST /identity/v3/endpoints => generated 281 bytes in 93 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jul 02 21:21:31.225125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2d76e-67d6-4b48-9f5e-44c9d995b242 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:31.239598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2d76e-67d6-4b48-9f5e-44c9d995b242 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:31.246543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e2fe3-a94f-4e9e-aa8d-c35c74c5e806 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e403c9de9a14e9594407a010f5ba89f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06004d743d7a48d88e6a448eb8b7af9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:31.247502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e2fe3-a94f-4e9e-aa8d-c35c74c5e806 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:31.247883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e2fe3-a94f-4e9e-aa8d-c35c74c5e806 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:31.248892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e2fe3-a94f-4e9e-aa8d-c35c74c5e806 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:31.249771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e2fe3-a94f-4e9e-aa8d-c35c74c5e806 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:31.251491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e2fe3-a94f-4e9e-aa8d-c35c74c5e806 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:31.308148 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-c52e2fe3-a94f-4e9e-aa8d-c35c74c5e806 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-437343461. To ensure interoperability, identifiers should be a valid uuid. Jul 02 21:21:31.308148 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 02 21:21:31.308148 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:21:31.337585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:31.365042 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2714/5390] 10.222.0.43 () {60 vars in 1155 bytes} [Sat Jul 2 21:21:31 2022] POST /identity/v3/endpoints => generated 356 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:31.366254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b7b87-01e2-446e-8cdb-46d0a48f6484 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:31.384763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b7b87-01e2-446e-8cdb-46d0a48f6484 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:31.418840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e54f2-908e-4767-be54-87e02a832997 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e403c9de9a14e9594407a010f5ba89f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06004d743d7a48d88e6a448eb8b7af9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:31.419776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e54f2-908e-4767-be54-87e02a832997 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:31.420162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e54f2-908e-4767-be54-87e02a832997 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:31.420900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e54f2-908e-4767-be54-87e02a832997 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] PATH_INFO: `/v3/regions/tempest-region-437343461` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:31.422611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e54f2-908e-4767-be54-87e02a832997 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-437343461)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:31.423901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e54f2-908e-4767-be54-87e02a832997 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:31.426307 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2677/5391] 10.222.0.43 () {58 vars in 1202 bytes} [Sat Jul 2 21:21:31 2022] GET /identity/v3/regions/tempest-region-437343461 => generated 178 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:31.431044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e2fe3-a94f-4e9e-aa8d-c35c74c5e806 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:31.447745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e2fe3-a94f-4e9e-aa8d-c35c74c5e806 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:31.460199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f06bf9-25f8-445d-ac66-4eed107a984e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e403c9de9a14e9594407a010f5ba89f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06004d743d7a48d88e6a448eb8b7af9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:31.463434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f06bf9-25f8-445d-ac66-4eed107a984e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:31.464096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f06bf9-25f8-445d-ac66-4eed107a984e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:31.464096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f06bf9-25f8-445d-ac66-4eed107a984e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] PATH_INFO: `/v3/endpoints/8971862075b947a4a229d16ee5e2b113` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:31.481547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f06bf9-25f8-445d-ac66-4eed107a984e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=8971862075b947a4a229d16ee5e2b113)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:31.490610 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-c9f06bf9-25f8-445d-ac66-4eed107a984e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:21:31.490610 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:21:31.490610 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:21:31.492118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f06bf9-25f8-445d-ac66-4eed107a984e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-c9f06bf9-25f8-445d-ac66-4eed107a984e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: Failed validating 'type' in schema['properties']['enabled']: Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: {'enum': [True, False, None], 'type': 'boolean'} Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: On instance['enabled']: Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: Failed validating 'type' in schema['properties']['enabled']: Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: {'enum': [True, False, None], 'type': 'boolean'} Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: On instance['enabled']: Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: 'False' Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise error Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application On instance['enabled']: Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application 'False' Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:21:31.515156 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:21:31.517244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:21:31.517244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:21:31.517244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:21:31.517244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:21:31.517244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:21:31.517244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:21:31.517244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:21:31.517244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:21:31.517244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:21:31.517244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:21:31.517244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:21:31.517244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:21:31.517244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jul 02 21:21:31.517244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jul 02 21:21:31.517244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 02 21:21:31.517244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 02 21:21:31.517244 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 02 21:21:31.518312 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 02 21:21:31.518312 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 02 21:21:31.518312 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:21:31.518312 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 02 21:21:31.518312 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 02 21:21:31.518312 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:21:31.518312 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application On instance['enabled']: Jul 02 21:21:31.518312 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application 'False' Jul 02 21:21:31.518312 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:21:31.518312 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2715/5392] 10.222.0.43 () {60 vars in 1254 bytes} [Sat Jul 2 21:21:31 2022] PATCH /identity/v3/endpoints/8971862075b947a4a229d16ee5e2b113 => generated 283 bytes in 87 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 02 21:21:31.522110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e54f2-908e-4767-be54-87e02a832997 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:31.539414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e54f2-908e-4767-be54-87e02a832997 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:31.551239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b811e-2425-474e-a01f-cbd9d543c4d6 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e403c9de9a14e9594407a010f5ba89f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06004d743d7a48d88e6a448eb8b7af9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:31.552393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b811e-2425-474e-a01f-cbd9d543c4d6 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:31.552745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b811e-2425-474e-a01f-cbd9d543c4d6 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:31.553156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b811e-2425-474e-a01f-cbd9d543c4d6 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] PATH_INFO: `/v3/endpoints/8971862075b947a4a229d16ee5e2b113` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:31.556961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b811e-2425-474e-a01f-cbd9d543c4d6 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=8971862075b947a4a229d16ee5e2b113)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:31.560996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b811e-2425-474e-a01f-cbd9d543c4d6 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:31.583754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ae0b811e-2425-474e-a01f-cbd9d543c4d6 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '8971862075b947a4a229d16ee5e2b113', 'request_id': 'req-ae0b811e-2425-474e-a01f-cbd9d543c4d6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:31.611762 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2678/5393] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:31 2022] DELETE /identity/v3/endpoints/8971862075b947a4a229d16ee5e2b113 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:31.612989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f06bf9-25f8-445d-ac66-4eed107a984e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:31.627403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f06bf9-25f8-445d-ac66-4eed107a984e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:31.673706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf254e1-b9e4-49bc-9bb7-17c0afc3c9d9 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e403c9de9a14e9594407a010f5ba89f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06004d743d7a48d88e6a448eb8b7af9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:31.675416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf254e1-b9e4-49bc-9bb7-17c0afc3c9d9 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:31.675701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf254e1-b9e4-49bc-9bb7-17c0afc3c9d9 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:31.675989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf254e1-b9e4-49bc-9bb7-17c0afc3c9d9 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] PATH_INFO: `/v3/regions/tempest-region-437343461` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:31.676687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf254e1-b9e4-49bc-9bb7-17c0afc3c9d9 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-437343461)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:31.683016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf254e1-b9e4-49bc-9bb7-17c0afc3c9d9 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:31.683618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c7225-86dd-4e1d-954e-b3f2f9261b9d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:31.684180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c7225-86dd-4e1d-954e-b3f2f9261b9d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:31.684697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c7225-86dd-4e1d-954e-b3f2f9261b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:31.721026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-576c7225-86dd-4e1d-954e-b3f2f9261b9d None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:31.723397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-576c7225-86dd-4e1d-954e-b3f2f9261b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:31.728497 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2716/5394] 10.222.0.43 () {58 vars in 1205 bytes} [Sat Jul 2 21:21:31 2022] DELETE /identity/v3/regions/tempest-region-437343461 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:31.735200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf254e1-b9e4-49bc-9bb7-17c0afc3c9d9 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:31.779411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:31.814315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf254e1-b9e4-49bc-9bb7-17c0afc3c9d9 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:31.825600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e62840-8a0a-4cb8-9ecb-598c8fccc5d5 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e403c9de9a14e9594407a010f5ba89f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06004d743d7a48d88e6a448eb8b7af9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:31.826287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e62840-8a0a-4cb8-9ecb-598c8fccc5d5 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:31.826573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e62840-8a0a-4cb8-9ecb-598c8fccc5d5 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:31.826893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e62840-8a0a-4cb8-9ecb-598c8fccc5d5 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:31.838326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e62840-8a0a-4cb8-9ecb-598c8fccc5d5 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:31.840769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e62840-8a0a-4cb8-9ecb-598c8fccc5d5 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:31.866741 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-39e62840-8a0a-4cb8-9ecb-598c8fccc5d5 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1995730602. To ensure interoperability, identifiers should be a valid uuid. Jul 02 21:21:31.866741 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 02 21:21:31.866741 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:21:31.879067 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2679/5395] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:21:31 2022] POST /identity/v3/auth/tokens => generated 3318 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:21:31.917593 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2717/5396] 10.222.0.43 () {60 vars in 1155 bytes} [Sat Jul 2 21:21:31 2022] POST /identity/v3/endpoints => generated 361 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:31.922785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c7225-86dd-4e1d-954e-b3f2f9261b9d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:31.940662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e62840-8a0a-4cb8-9ecb-598c8fccc5d5 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:31.944870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-39e62840-8a0a-4cb8-9ecb-598c8fccc5d5 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:31.959847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c7225-86dd-4e1d-954e-b3f2f9261b9d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:31.995975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9930f-c2b2-4b48-bda5-c40d97145390 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e403c9de9a14e9594407a010f5ba89f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06004d743d7a48d88e6a448eb8b7af9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:31.997120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9930f-c2b2-4b48-bda5-c40d97145390 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:31.997554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9930f-c2b2-4b48-bda5-c40d97145390 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:31.997968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9930f-c2b2-4b48-bda5-c40d97145390 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] PATH_INFO: `/v3/regions/tempest-region-1995730602` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:31.998778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9930f-c2b2-4b48-bda5-c40d97145390 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1995730602)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:32.000065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9930f-c2b2-4b48-bda5-c40d97145390 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:32.003076 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2680/5397] 10.222.0.43 () {58 vars in 1205 bytes} [Sat Jul 2 21:21:31 2022] GET /identity/v3/regions/tempest-region-1995730602 => generated 180 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:32.007513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9930f-c2b2-4b48-bda5-c40d97145390 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:32.020342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9930f-c2b2-4b48-bda5-c40d97145390 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:32.028796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20348d0d-1a91-4d52-a4cb-2b3b3f476090 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e403c9de9a14e9594407a010f5ba89f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06004d743d7a48d88e6a448eb8b7af9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:32.029903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20348d0d-1a91-4d52-a4cb-2b3b3f476090 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:32.030630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20348d0d-1a91-4d52-a4cb-2b3b3f476090 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:32.031124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20348d0d-1a91-4d52-a4cb-2b3b3f476090 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] PATH_INFO: `/v3/endpoints/fd5e3ca0c0dc4deebca5b4a2939a71c7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:32.040506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20348d0d-1a91-4d52-a4cb-2b3b3f476090 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=fd5e3ca0c0dc4deebca5b4a2939a71c7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:32.044130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20348d0d-1a91-4d52-a4cb-2b3b3f476090 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-20348d0d-1a91-4d52-a4cb-2b3b3f476090 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: Failed validating 'type' in schema['properties']['enabled']: Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: {'enum': [True, False, None], 'type': 'boolean'} Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: On instance['enabled']: Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: Failed validating 'type' in schema['properties']['enabled']: Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: {'enum': [True, False, None], 'type': 'boolean'} Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: On instance['enabled']: Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: 'True' Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise error Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application On instance['enabled']: Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application 'True' Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:21:32.080629 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:21:32.082198 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:21:32.082198 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:21:32.082198 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:21:32.082198 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:21:32.082198 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:21:32.082198 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:21:32.082198 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:21:32.082198 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:21:32.082198 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:21:32.082198 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:21:32.082198 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:21:32.082198 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:21:32.082198 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jul 02 21:21:32.082198 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jul 02 21:21:32.082198 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 02 21:21:32.082198 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 02 21:21:32.082198 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 02 21:21:32.083281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 02 21:21:32.083281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 02 21:21:32.083281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:21:32.083281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 02 21:21:32.083281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 02 21:21:32.083281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:21:32.083281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application On instance['enabled']: Jul 02 21:21:32.083281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application 'True' Jul 02 21:21:32.083281 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:21:32.087226 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2681/5398] 10.222.0.43 () {60 vars in 1254 bytes} [Sat Jul 2 21:21:32 2022] PATCH /identity/v3/endpoints/fd5e3ca0c0dc4deebca5b4a2939a71c7 => generated 281 bytes in 79 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 02 21:21:32.092072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20348d0d-1a91-4d52-a4cb-2b3b3f476090 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:32.122034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20348d0d-1a91-4d52-a4cb-2b3b3f476090 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:32.137538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453d12e-3cdb-4e43-b8b4-1854f5c2b3e6 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e403c9de9a14e9594407a010f5ba89f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06004d743d7a48d88e6a448eb8b7af9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:32.138593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453d12e-3cdb-4e43-b8b4-1854f5c2b3e6 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:32.139054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453d12e-3cdb-4e43-b8b4-1854f5c2b3e6 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:32.139499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453d12e-3cdb-4e43-b8b4-1854f5c2b3e6 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] PATH_INFO: `/v3/endpoints/fd5e3ca0c0dc4deebca5b4a2939a71c7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:32.142421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453d12e-3cdb-4e43-b8b4-1854f5c2b3e6 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=fd5e3ca0c0dc4deebca5b4a2939a71c7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:32.151104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453d12e-3cdb-4e43-b8b4-1854f5c2b3e6 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:32.159926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e62840-8a0a-4cb8-9ecb-598c8fccc5d5 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:32.170167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de653dab-142b-4471-8f82-c2261711d54b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:32.171516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de653dab-142b-4471-8f82-c2261711d54b service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:32.171909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de653dab-142b-4471-8f82-c2261711d54b service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:32.172303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de653dab-142b-4471-8f82-c2261711d54b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:32.177167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a453d12e-3cdb-4e43-b8b4-1854f5c2b3e6 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'fd5e3ca0c0dc4deebca5b4a2939a71c7', 'request_id': 'req-a453d12e-3cdb-4e43-b8b4-1854f5c2b3e6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:32.191586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de653dab-142b-4471-8f82-c2261711d54b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:32.193421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de653dab-142b-4471-8f82-c2261711d54b service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:32.206148 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2682/5399] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:32 2022] DELETE /identity/v3/endpoints/fd5e3ca0c0dc4deebca5b4a2939a71c7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:32.209827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453d12e-3cdb-4e43-b8b4-1854f5c2b3e6 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:32.236406 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2718/5400] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:21:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 02 21:21:32.278583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453d12e-3cdb-4e43-b8b4-1854f5c2b3e6 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:32.314775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ecdca-9c83-4b71-9dfd-f8220173bc7e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e403c9de9a14e9594407a010f5ba89f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06004d743d7a48d88e6a448eb8b7af9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:32.321554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ecdca-9c83-4b71-9dfd-f8220173bc7e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:32.322093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ecdca-9c83-4b71-9dfd-f8220173bc7e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:32.322529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ecdca-9c83-4b71-9dfd-f8220173bc7e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] PATH_INFO: `/v3/regions/tempest-region-1995730602` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:32.323510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ecdca-9c83-4b71-9dfd-f8220173bc7e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1995730602)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:32.325650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ecdca-9c83-4b71-9dfd-f8220173bc7e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:32.366871 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-f90ecdca-9c83-4b71-9dfd-f8220173bc7e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1995730602. To ensure interoperability, identifiers should be a valid uuid. Jul 02 21:21:32.366871 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 02 21:21:32.366871 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:21:32.397577 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2683/5401] 10.222.0.43 () {58 vars in 1208 bytes} [Sat Jul 2 21:21:32 2022] DELETE /identity/v3/regions/tempest-region-1995730602 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:32.403983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de653dab-142b-4471-8f82-c2261711d54b service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:32.423591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de653dab-142b-4471-8f82-c2261711d54b service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:32.480185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a3368-5eb5-4128-930f-1f62b72453a0 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e403c9de9a14e9594407a010f5ba89f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06004d743d7a48d88e6a448eb8b7af9d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:32.484280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a3368-5eb5-4128-930f-1f62b72453a0 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:32.484728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a3368-5eb5-4128-930f-1f62b72453a0 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:32.487476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a3368-5eb5-4128-930f-1f62b72453a0 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] PATH_INFO: `/v3/services/af4e062706414bc99230c4bcee57ce41` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:32.491885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a3368-5eb5-4128-930f-1f62b72453a0 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorizing `identity:delete_service(service_id=af4e062706414bc99230c4bcee57ce41)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:32.498403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a3368-5eb5-4128-930f-1f62b72453a0 tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:32.571196 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2719/5402] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:32 2022] DELETE /identity/v3/services/af4e062706414bc99230c4bcee57ce41 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:32.575272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ecdca-9c83-4b71-9dfd-f8220173bc7e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:32.755517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ecdca-9c83-4b71-9dfd-f8220173bc7e tempest-EndpointsNegativeTestJSON-1495560660 tempest-EndpointsNegativeTestJSON-1495560660-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:32.779340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fbb17-36d3-4f73-8472-43201cde9bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:32.780940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fbb17-36d3-4f73-8472-43201cde9bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:32.781519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fbb17-36d3-4f73-8472-43201cde9bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:32.782483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fbb17-36d3-4f73-8472-43201cde9bfe admin admin] PATH_INFO: `/v3/users/5a91c8092f874cb8a617d5ed78337f9c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:32.784585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fbb17-36d3-4f73-8472-43201cde9bfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a91c8092f874cb8a617d5ed78337f9c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:32.787212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fbb17-36d3-4f73-8472-43201cde9bfe admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:32.922626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:32.944237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b53fbb17-36d3-4f73-8472-43201cde9bfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a91c8092f874cb8a617d5ed78337f9c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:32.966837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b53fbb17-36d3-4f73-8472-43201cde9bfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a91c8092f874cb8a617d5ed78337f9c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:32.979654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b53fbb17-36d3-4f73-8472-43201cde9bfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a91c8092f874cb8a617d5ed78337f9c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:32.992567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b53fbb17-36d3-4f73-8472-43201cde9bfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a91c8092f874cb8a617d5ed78337f9c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:32.994036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b53fbb17-36d3-4f73-8472-43201cde9bfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a91c8092f874cb8a617d5ed78337f9c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:33.075174 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2684/5403] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:32 2022] DELETE /identity/v3/users/5a91c8092f874cb8a617d5ed78337f9c => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:33.079551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c2148-7a55-4b71-a154-85d6a67fb3fd None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:33.080203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c2148-7a55-4b71-a154-85d6a67fb3fd None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:33.080203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c2148-7a55-4b71-a154-85d6a67fb3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:33.120085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6e9c2148-7a55-4b71-a154-85d6a67fb3fd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:33.121904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6e9c2148-7a55-4b71-a154-85d6a67fb3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:33.156711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:33.330401 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2720/5404] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:33.413438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fbb17-36d3-4f73-8472-43201cde9bfe admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:33.415129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b53fbb17-36d3-4f73-8472-43201cde9bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:33.675506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fbb17-36d3-4f73-8472-43201cde9bfe admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:33.681234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f3b05-97bf-47ae-8e9d-881b341011f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:33.681928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f3b05-97bf-47ae-8e9d-881b341011f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:33.682407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f3b05-97bf-47ae-8e9d-881b341011f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:33.682701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f3b05-97bf-47ae-8e9d-881b341011f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:33.699524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f3b05-97bf-47ae-8e9d-881b341011f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:33.701411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f3b05-97bf-47ae-8e9d-881b341011f6 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:33.723255 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2685/5405] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:35.717810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c2148-7a55-4b71-a154-85d6a67fb3fd None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:35.720333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6e9c2148-7a55-4b71-a154-85d6a67fb3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:35.745030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c2148-7a55-4b71-a154-85d6a67fb3fd None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:35.786362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980539df-4be4-452c-904b-88c1101905dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:35.793678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980539df-4be4-452c-904b-88c1101905dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:35.796229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980539df-4be4-452c-904b-88c1101905dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:35.796735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980539df-4be4-452c-904b-88c1101905dd admin admin] PATH_INFO: `/v3/projects/208a9aaf4ec543edb2148b73b1d01a57` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:35.801118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980539df-4be4-452c-904b-88c1101905dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=208a9aaf4ec543edb2148b73b1d01a57)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:35.804853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980539df-4be4-452c-904b-88c1101905dd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:35.910946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-980539df-4be4-452c-904b-88c1101905dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208a9aaf4ec543edb2148b73b1d01a57', 'request_id': 'req-980539df-4be4-452c-904b-88c1101905dd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:35.925309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-980539df-4be4-452c-904b-88c1101905dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208a9aaf4ec543edb2148b73b1d01a57', 'request_id': 'req-980539df-4be4-452c-904b-88c1101905dd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:35.934864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-980539df-4be4-452c-904b-88c1101905dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208a9aaf4ec543edb2148b73b1d01a57', 'request_id': 'req-980539df-4be4-452c-904b-88c1101905dd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:35.956896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-980539df-4be4-452c-904b-88c1101905dd admin admin] The token cache is being invalidate because project 208a9aaf4ec543edb2148b73b1d01a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:35.957217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-980539df-4be4-452c-904b-88c1101905dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:35.967997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-980539df-4be4-452c-904b-88c1101905dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:35.974319 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2721/5406] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:35 2022] DELETE /identity/v3/projects/208a9aaf4ec543edb2148b73b1d01a57 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:35.978997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f3b05-97bf-47ae-8e9d-881b341011f6 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:35.993454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f3b05-97bf-47ae-8e9d-881b341011f6 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:36.149000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c09037-7626-4c0f-8cda-de598d3141b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:36.150029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c09037-7626-4c0f-8cda-de598d3141b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:36.151160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c09037-7626-4c0f-8cda-de598d3141b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:36.151457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c09037-7626-4c0f-8cda-de598d3141b1 admin admin] PATH_INFO: `/v3/users/7e403c9de9a14e9594407a010f5ba89f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:36.152961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c09037-7626-4c0f-8cda-de598d3141b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e403c9de9a14e9594407a010f5ba89f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:36.155001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c09037-7626-4c0f-8cda-de598d3141b1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:36.272669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-54c09037-7626-4c0f-8cda-de598d3141b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e403c9de9a14e9594407a010f5ba89f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:36.288336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:36.309896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-54c09037-7626-4c0f-8cda-de598d3141b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e403c9de9a14e9594407a010f5ba89f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:36.336589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-54c09037-7626-4c0f-8cda-de598d3141b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e403c9de9a14e9594407a010f5ba89f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:36.337521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-54c09037-7626-4c0f-8cda-de598d3141b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e403c9de9a14e9594407a010f5ba89f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:36.338141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-54c09037-7626-4c0f-8cda-de598d3141b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e403c9de9a14e9594407a010f5ba89f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:36.382967 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2686/5407] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:35 2022] DELETE /identity/v3/users/7e403c9de9a14e9594407a010f5ba89f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:36.983937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980539df-4be4-452c-904b-88c1101905dd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:36.986214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-980539df-4be4-452c-904b-88c1101905dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:37.031439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980539df-4be4-452c-904b-88c1101905dd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:37.308361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3983cc6-b12d-405d-ad86-87e9bf4e527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:37.319178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3983cc6-b12d-405d-ad86-87e9bf4e527e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:37.320966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3983cc6-b12d-405d-ad86-87e9bf4e527e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:37.322286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3983cc6-b12d-405d-ad86-87e9bf4e527e admin admin] PATH_INFO: `/v3/projects/06004d743d7a48d88e6a448eb8b7af9d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:37.327954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3983cc6-b12d-405d-ad86-87e9bf4e527e admin admin] RBAC: Authorizing `identity:delete_project(project_id=06004d743d7a48d88e6a448eb8b7af9d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:37.338061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3983cc6-b12d-405d-ad86-87e9bf4e527e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:37.486016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:37.524728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c3983cc6-b12d-405d-ad86-87e9bf4e527e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06004d743d7a48d88e6a448eb8b7af9d', 'request_id': 'req-c3983cc6-b12d-405d-ad86-87e9bf4e527e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:37.540713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c3983cc6-b12d-405d-ad86-87e9bf4e527e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06004d743d7a48d88e6a448eb8b7af9d', 'request_id': 'req-c3983cc6-b12d-405d-ad86-87e9bf4e527e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:37.550686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c3983cc6-b12d-405d-ad86-87e9bf4e527e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06004d743d7a48d88e6a448eb8b7af9d', 'request_id': 'req-c3983cc6-b12d-405d-ad86-87e9bf4e527e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:37.565885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c3983cc6-b12d-405d-ad86-87e9bf4e527e admin admin] The token cache is being invalidate because project 06004d743d7a48d88e6a448eb8b7af9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:37.566959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c3983cc6-b12d-405d-ad86-87e9bf4e527e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:37.567761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c3983cc6-b12d-405d-ad86-87e9bf4e527e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:37.574245 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2722/5408] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:36 2022] DELETE /identity/v3/projects/06004d743d7a48d88e6a448eb8b7af9d => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:37.574875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b8122-8d57-4dfa-af6f-ae1d6a267c64 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:37.575331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b8122-8d57-4dfa-af6f-ae1d6a267c64 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:37.575449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b8122-8d57-4dfa-af6f-ae1d6a267c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:37.596786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-321b8122-8d57-4dfa-af6f-ae1d6a267c64 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:37.598533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-321b8122-8d57-4dfa-af6f-ae1d6a267c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:37.675062 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2687/5409] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:21:37.685343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b73156-ef3c-4b9e-87e4-41a72eb72a84 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:37.685608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b73156-ef3c-4b9e-87e4-41a72eb72a84 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:37.685950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b73156-ef3c-4b9e-87e4-41a72eb72a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:37.709029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b4b73156-ef3c-4b9e-87e4-41a72eb72a84 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:37.709029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b4b73156-ef3c-4b9e-87e4-41a72eb72a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:37.733743 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2723/5410] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:37.735098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b8122-8d57-4dfa-af6f-ae1d6a267c64 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:37.747137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b8122-8d57-4dfa-af6f-ae1d6a267c64 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:37.765515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad813dd8-5b74-4ebf-bb87-6ef4f50c30e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:37.766213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad813dd8-5b74-4ebf-bb87-6ef4f50c30e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:37.766548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad813dd8-5b74-4ebf-bb87-6ef4f50c30e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:37.766837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad813dd8-5b74-4ebf-bb87-6ef4f50c30e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:37.767709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad813dd8-5b74-4ebf-bb87-6ef4f50c30e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:21:37.768022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad813dd8-5b74-4ebf-bb87-6ef4f50c30e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:37.771168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad813dd8-5b74-4ebf-bb87-6ef4f50c30e3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:37.786749 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2688/5411] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:21:37.791421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b73156-ef3c-4b9e-87e4-41a72eb72a84 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:37.804626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b73156-ef3c-4b9e-87e4-41a72eb72a84 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:37.811394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34683701-4ade-4a00-b07c-09e0a511bcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:37.812252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34683701-4ade-4a00-b07c-09e0a511bcb0 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:37.812546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34683701-4ade-4a00-b07c-09e0a511bcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:37.812819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34683701-4ade-4a00-b07c-09e0a511bcb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:37.813550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34683701-4ade-4a00-b07c-09e0a511bcb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:37.815779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34683701-4ade-4a00-b07c-09e0a511bcb0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:37.902471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad813dd8-5b74-4ebf-bb87-6ef4f50c30e3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:37.912188 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2724/5412] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:37 2022] POST /identity/v3/projects => generated 389 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:37.917295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad813dd8-5b74-4ebf-bb87-6ef4f50c30e3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:38.011351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6c258-3e8a-4a4d-8b66-4d1b9aa3585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:38.012634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6c258-3e8a-4a4d-8b66-4d1b9aa3585f admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:38.013257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6c258-3e8a-4a4d-8b66-4d1b9aa3585f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:38.013988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6c258-3e8a-4a4d-8b66-4d1b9aa3585f admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:38.017235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6c258-3e8a-4a4d-8b66-4d1b9aa3585f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:38.019574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6c258-3e8a-4a4d-8b66-4d1b9aa3585f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:38.058188 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2689/5413] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:37 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:38.062312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34683701-4ade-4a00-b07c-09e0a511bcb0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:38.077400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34683701-4ade-4a00-b07c-09e0a511bcb0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:38.084418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cefddd-c94f-483e-b809-bbd894dbc693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:38.085648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cefddd-c94f-483e-b809-bbd894dbc693 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:38.086160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cefddd-c94f-483e-b809-bbd894dbc693 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:38.086787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cefddd-c94f-483e-b809-bbd894dbc693 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:38.087726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cefddd-c94f-483e-b809-bbd894dbc693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:38.090507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cefddd-c94f-483e-b809-bbd894dbc693 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:38.126744 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2725/5414] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:38.128020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6c258-3e8a-4a4d-8b66-4d1b9aa3585f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:38.145146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6c258-3e8a-4a4d-8b66-4d1b9aa3585f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:38.153583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181376f-c513-4a7a-aee0-73b4580d42da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:38.154567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181376f-c513-4a7a-aee0-73b4580d42da admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:38.155152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181376f-c513-4a7a-aee0-73b4580d42da admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:38.155614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181376f-c513-4a7a-aee0-73b4580d42da admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:38.156585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181376f-c513-4a7a-aee0-73b4580d42da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:38.158615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181376f-c513-4a7a-aee0-73b4580d42da admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:38.171305 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2690/5415] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:38.175673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cefddd-c94f-483e-b809-bbd894dbc693 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:38.196140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cefddd-c94f-483e-b809-bbd894dbc693 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:38.223528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dabab3-d6b6-4cf0-a0ba-2c634deca785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:38.225487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dabab3-d6b6-4cf0-a0ba-2c634deca785 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:38.225934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dabab3-d6b6-4cf0-a0ba-2c634deca785 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:38.226392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dabab3-d6b6-4cf0-a0ba-2c634deca785 admin admin] PATH_INFO: `/v3/projects/dabe4a16e72d4f1f9ed9ca0b2b951c09/users/7d74ea0be9a24c7b9a54f016edb376e6/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:38.261102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dabab3-d6b6-4cf0-a0ba-2c634deca785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dabe4a16e72d4f1f9ed9ca0b2b951c09, user_id=7d74ea0be9a24c7b9a54f016edb376e6, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:38.265195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dabab3-d6b6-4cf0-a0ba-2c634deca785 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:38.311164 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2726/5416] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:38 2022] PUT /identity/v3/projects/dabe4a16e72d4f1f9ed9ca0b2b951c09/users/7d74ea0be9a24c7b9a54f016edb376e6/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:21:38.312309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db94b5f-7e92-4b3e-b9db-accd63e02802 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:38.312691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db94b5f-7e92-4b3e-b9db-accd63e02802 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:38.313088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db94b5f-7e92-4b3e-b9db-accd63e02802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:38.394698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5db94b5f-7e92-4b3e-b9db-accd63e02802 None None] MFA Rules not processed for user `7d74ea0be9a24c7b9a54f016edb376e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:38.398957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5db94b5f-7e92-4b3e-b9db-accd63e02802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:38.477719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:38.623897 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2691/5417] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:38.629503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dabab3-d6b6-4cf0-a0ba-2c634deca785 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:38.775221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dabab3-d6b6-4cf0-a0ba-2c634deca785 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:38.781762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc183225-fdef-469c-b204-3a02fa96d428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:38.782880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc183225-fdef-469c-b204-3a02fa96d428 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:38.783368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc183225-fdef-469c-b204-3a02fa96d428 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:38.783766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc183225-fdef-469c-b204-3a02fa96d428 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:38.786532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc183225-fdef-469c-b204-3a02fa96d428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:38.788931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc183225-fdef-469c-b204-3a02fa96d428 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:38.850443 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2727/5418] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:38 2022] POST /identity/v3/projects => generated 389 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:38.850788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db94b5f-7e92-4b3e-b9db-accd63e02802 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:38.863206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db94b5f-7e92-4b3e-b9db-accd63e02802 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:38.956442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c16e2e-8296-494f-ad80-5ad00edac7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:38.961217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c16e2e-8296-494f-ad80-5ad00edac7ae admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:38.961527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c16e2e-8296-494f-ad80-5ad00edac7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:38.961853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c16e2e-8296-494f-ad80-5ad00edac7ae admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:38.962612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c16e2e-8296-494f-ad80-5ad00edac7ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:38.965787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c16e2e-8296-494f-ad80-5ad00edac7ae admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:38.997715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc183225-fdef-469c-b204-3a02fa96d428 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:39.000292 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2692/5419] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:38 2022] POST /identity/v3/users => generated 301 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:21:39.015194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc183225-fdef-469c-b204-3a02fa96d428 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:39.040795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6abf21-caff-4e98-873d-b912838436e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:39.043234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6abf21-caff-4e98-873d-b912838436e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:39.043526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6abf21-caff-4e98-873d-b912838436e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:39.050183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6abf21-caff-4e98-873d-b912838436e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:39.051422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6abf21-caff-4e98-873d-b912838436e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:39.054239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6abf21-caff-4e98-873d-b912838436e4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:39.101072 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2728/5420] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:39.101669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c16e2e-8296-494f-ad80-5ad00edac7ae admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:39.159329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c16e2e-8296-494f-ad80-5ad00edac7ae admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:39.203630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a549a85-1261-46e1-889b-cd79854a2151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:39.205155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a549a85-1261-46e1-889b-cd79854a2151 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:39.206285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a549a85-1261-46e1-889b-cd79854a2151 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:39.213606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a549a85-1261-46e1-889b-cd79854a2151 admin admin] PATH_INFO: `/v3/projects/4b09decc332043249a34c6fff7f6a112/users/4d34a408723b4a1f954c07dc3caba2b7/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:39.241536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a549a85-1261-46e1-889b-cd79854a2151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b09decc332043249a34c6fff7f6a112, user_id=4d34a408723b4a1f954c07dc3caba2b7, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:39.245487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a549a85-1261-46e1-889b-cd79854a2151 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:39.301375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6abf21-caff-4e98-873d-b912838436e4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:39.312195 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2693/5421] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:39 2022] PUT /identity/v3/projects/4b09decc332043249a34c6fff7f6a112/users/4d34a408723b4a1f954c07dc3caba2b7/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:39.316033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6abf21-caff-4e98-873d-b912838436e4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:39.433096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:39.480333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820279f4-3b2e-4155-86c8-4b720027d4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:39.481380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820279f4-3b2e-4155-86c8-4b720027d4ee admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:39.482218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820279f4-3b2e-4155-86c8-4b720027d4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:39.482656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820279f4-3b2e-4155-86c8-4b720027d4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:39.483626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820279f4-3b2e-4155-86c8-4b720027d4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:39.486795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820279f4-3b2e-4155-86c8-4b720027d4ee admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:39.505042 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2729/5422] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:39.509003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a549a85-1261-46e1-889b-cd79854a2151 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:39.526903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a549a85-1261-46e1-889b-cd79854a2151 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:39.544690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ecce6-c705-4a3a-84c8-b074e66b2312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:39.550814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ecce6-c705-4a3a-84c8-b074e66b2312 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:39.551233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ecce6-c705-4a3a-84c8-b074e66b2312 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:39.551764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ecce6-c705-4a3a-84c8-b074e66b2312 admin admin] PATH_INFO: `/v3/projects/4b09decc332043249a34c6fff7f6a112/users/4d34a408723b4a1f954c07dc3caba2b7/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:39.559239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ecce6-c705-4a3a-84c8-b074e66b2312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b09decc332043249a34c6fff7f6a112, user_id=4d34a408723b4a1f954c07dc3caba2b7, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:39.565482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ecce6-c705-4a3a-84c8-b074e66b2312 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:39.612146 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2694/5423] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:39 2022] PUT /identity/v3/projects/4b09decc332043249a34c6fff7f6a112/users/4d34a408723b4a1f954c07dc3caba2b7/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:39.615120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81202d-b194-43c6-a854-9bc1e7d7d8ee None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:39.615415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81202d-b194-43c6-a854-9bc1e7d7d8ee None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:39.615695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81202d-b194-43c6-a854-9bc1e7d7d8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:39.696374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9e81202d-b194-43c6-a854-9bc1e7d7d8ee None None] MFA Rules not processed for user `4d34a408723b4a1f954c07dc3caba2b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:39.698001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9e81202d-b194-43c6-a854-9bc1e7d7d8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:39.900930 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2730/5424] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:39.905261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ecce6-c705-4a3a-84c8-b074e66b2312 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:39.928232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ecce6-c705-4a3a-84c8-b074e66b2312 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:39.933126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fc4b8-d21e-4c8c-929c-19099af0ceda tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d34a408723b4a1f954c07dc3caba2b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b09decc332043249a34c6fff7f6a112', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:39.934014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fc4b8-d21e-4c8c-929c-19099af0ceda tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:39.934291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fc4b8-d21e-4c8c-929c-19099af0ceda tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:39.934565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fc4b8-d21e-4c8c-929c-19099af0ceda tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] PATH_INFO: `/v3/projects/dabe4a16e72d4f1f9ed9ca0b2b951c09` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:39.937258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fc4b8-d21e-4c8c-929c-19099af0ceda tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorizing `identity:get_project(project_id=dabe4a16e72d4f1f9ed9ca0b2b951c09)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:39.943357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fc4b8-d21e-4c8c-929c-19099af0ceda tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:39.946973 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2695/5425] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:21:39 2022] GET /identity/v3/projects/dabe4a16e72d4f1f9ed9ca0b2b951c09 => generated 389 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:21:39.949602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81202d-b194-43c6-a854-9bc1e7d7d8ee None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:39.976641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81202d-b194-43c6-a854-9bc1e7d7d8ee None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:39.988229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e2cf2-d6cb-48f8-b860-3ac2c404de85 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d34a408723b4a1f954c07dc3caba2b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b09decc332043249a34c6fff7f6a112', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:39.989745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e2cf2-d6cb-48f8-b860-3ac2c404de85 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:39.993495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e2cf2-d6cb-48f8-b860-3ac2c404de85 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:39.993918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e2cf2-d6cb-48f8-b860-3ac2c404de85 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:39.994939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e2cf2-d6cb-48f8-b860-3ac2c404de85 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:39.998510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e2cf2-d6cb-48f8-b860-3ac2c404de85 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:40.065492 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2731/5426] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:21:39 2022] POST /identity/v3/projects => generated 339 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:21:40.070057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fc4b8-d21e-4c8c-929c-19099af0ceda tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:40.096479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fc4b8-d21e-4c8c-929c-19099af0ceda tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:40.326221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44e191-4b26-41b7-a545-5d61b894e02f tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d34a408723b4a1f954c07dc3caba2b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b09decc332043249a34c6fff7f6a112', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:40.334881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44e191-4b26-41b7-a545-5d61b894e02f tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:40.335449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44e191-4b26-41b7-a545-5d61b894e02f tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:40.336739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44e191-4b26-41b7-a545-5d61b894e02f tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:40.338312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44e191-4b26-41b7-a545-5d61b894e02f tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:40.347332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44e191-4b26-41b7-a545-5d61b894e02f tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:40.388247 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2696/5427] 10.222.0.43 () {58 vars in 1130 bytes} [Sat Jul 2 21:21:40 2022] GET /identity/v3/projects => generated 6526 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:40.392430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e2cf2-d6cb-48f8-b860-3ac2c404de85 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:40.406632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e2cf2-d6cb-48f8-b860-3ac2c404de85 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:40.427302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c05fb7-04b4-4b1b-8812-8ed5c03f778c tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d34a408723b4a1f954c07dc3caba2b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b09decc332043249a34c6fff7f6a112', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:40.433780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c05fb7-04b4-4b1b-8812-8ed5c03f778c tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:40.435749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c05fb7-04b4-4b1b-8812-8ed5c03f778c tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:40.436720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c05fb7-04b4-4b1b-8812-8ed5c03f778c tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] PATH_INFO: `/v3/projects/dabe4a16e72d4f1f9ed9ca0b2b951c09` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:40.442264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c05fb7-04b4-4b1b-8812-8ed5c03f778c tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorizing `identity:get_project(project_id=dabe4a16e72d4f1f9ed9ca0b2b951c09)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:40.450774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c05fb7-04b4-4b1b-8812-8ed5c03f778c tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:40.458777 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2732/5428] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:21:40 2022] GET /identity/v3/projects/dabe4a16e72d4f1f9ed9ca0b2b951c09 => generated 389 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:40.462281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44e191-4b26-41b7-a545-5d61b894e02f tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:40.480280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:40.486796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44e191-4b26-41b7-a545-5d61b894e02f tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:40.500877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f19f82-95b5-4e0d-8eee-50b1886ed89a tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d34a408723b4a1f954c07dc3caba2b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b09decc332043249a34c6fff7f6a112', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:40.501508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f19f82-95b5-4e0d-8eee-50b1886ed89a tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:40.501798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f19f82-95b5-4e0d-8eee-50b1886ed89a tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:40.502116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f19f82-95b5-4e0d-8eee-50b1886ed89a tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] PATH_INFO: `/v3/projects/8cc82b32aa70410ea4bd8b96981ce731` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:40.515951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f19f82-95b5-4e0d-8eee-50b1886ed89a tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorizing `identity:get_project(project_id=8cc82b32aa70410ea4bd8b96981ce731)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:40.519422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f19f82-95b5-4e0d-8eee-50b1886ed89a tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:40.521016 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2697/5429] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:21:40 2022] GET /identity/v3/projects/8cc82b32aa70410ea4bd8b96981ce731 => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:40.527637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c05fb7-04b4-4b1b-8812-8ed5c03f778c tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:40.548110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c05fb7-04b4-4b1b-8812-8ed5c03f778c tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:40.558836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17497d08-57a2-435b-9306-6da9ddef394e tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d34a408723b4a1f954c07dc3caba2b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b09decc332043249a34c6fff7f6a112', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:40.559446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17497d08-57a2-435b-9306-6da9ddef394e tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:40.559738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17497d08-57a2-435b-9306-6da9ddef394e tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:40.560019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17497d08-57a2-435b-9306-6da9ddef394e tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:40.560876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17497d08-57a2-435b-9306-6da9ddef394e tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:40.562811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17497d08-57a2-435b-9306-6da9ddef394e tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:40.601554 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2733/5430] 10.222.0.43 () {58 vars in 1130 bytes} [Sat Jul 2 21:21:40 2022] GET /identity/v3/projects => generated 6526 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:40.602770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f19f82-95b5-4e0d-8eee-50b1886ed89a tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:40.626881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f19f82-95b5-4e0d-8eee-50b1886ed89a tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:40.643422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ea452-bef8-4d7b-b4b4-6f947e1fd50d tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d34a408723b4a1f954c07dc3caba2b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b09decc332043249a34c6fff7f6a112', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:40.644351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ea452-bef8-4d7b-b4b4-6f947e1fd50d tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:40.644644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ea452-bef8-4d7b-b4b4-6f947e1fd50d tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:40.644979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ea452-bef8-4d7b-b4b4-6f947e1fd50d tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:40.645921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ea452-bef8-4d7b-b4b4-6f947e1fd50d tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:21:40.646237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ea452-bef8-4d7b-b4b4-6f947e1fd50d tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:40.648135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ea452-bef8-4d7b-b4b4-6f947e1fd50d tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:40.693295 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2698/5431] 10.222.0.43 () {58 vars in 1165 bytes} [Sat Jul 2 21:21:40 2022] GET /identity/v3/projects?domain_id=default => generated 6195 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:21:40.697783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17497d08-57a2-435b-9306-6da9ddef394e tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:40.723121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17497d08-57a2-435b-9306-6da9ddef394e tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:40.738769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef46de1-f785-4f87-8981-971c5d119a74 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d34a408723b4a1f954c07dc3caba2b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b09decc332043249a34c6fff7f6a112', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:40.742494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef46de1-f785-4f87-8981-971c5d119a74 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:40.742800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef46de1-f785-4f87-8981-971c5d119a74 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:40.743383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef46de1-f785-4f87-8981-971c5d119a74 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:40.744392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef46de1-f785-4f87-8981-971c5d119a74 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:40.748386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef46de1-f785-4f87-8981-971c5d119a74 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:40.780682 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2734/5432] 10.222.0.43 () {58 vars in 1130 bytes} [Sat Jul 2 21:21:40 2022] GET /identity/v3/projects => generated 6526 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:40.784652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ea452-bef8-4d7b-b4b4-6f947e1fd50d tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:40.809760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ea452-bef8-4d7b-b4b4-6f947e1fd50d tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:40.833669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd5c37-7c64-4abc-92f7-b44d330430d6 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d34a408723b4a1f954c07dc3caba2b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b09decc332043249a34c6fff7f6a112', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:40.834388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd5c37-7c64-4abc-92f7-b44d330430d6 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:40.834646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd5c37-7c64-4abc-92f7-b44d330430d6 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:40.834982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd5c37-7c64-4abc-92f7-b44d330430d6 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:40.835738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd5c37-7c64-4abc-92f7-b44d330430d6 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:21:40.836232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd5c37-7c64-4abc-92f7-b44d330430d6 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:40.840396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd5c37-7c64-4abc-92f7-b44d330430d6 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:40.880389 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2699/5433] 10.222.0.43 () {58 vars in 1165 bytes} [Sat Jul 2 21:21:40 2022] GET /identity/v3/projects?domain_id=default => generated 6195 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:40.886141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef46de1-f785-4f87-8981-971c5d119a74 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:40.906354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef46de1-f785-4f87-8981-971c5d119a74 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:40.914683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852a394-7a68-493d-b4c4-07b766908b6c tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d34a408723b4a1f954c07dc3caba2b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b09decc332043249a34c6fff7f6a112', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:40.915664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852a394-7a68-493d-b4c4-07b766908b6c tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:40.915825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852a394-7a68-493d-b4c4-07b766908b6c tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:40.916173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852a394-7a68-493d-b4c4-07b766908b6c tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:40.917554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852a394-7a68-493d-b4c4-07b766908b6c tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:40.921159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852a394-7a68-493d-b4c4-07b766908b6c tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:40.967700 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2735/5434] 10.222.0.43 () {58 vars in 1130 bytes} [Sat Jul 2 21:21:40 2022] GET /identity/v3/projects => generated 6526 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:40.971606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd5c37-7c64-4abc-92f7-b44d330430d6 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:40.985114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd5c37-7c64-4abc-92f7-b44d330430d6 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:41.002594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c9ca4-277c-4e11-a64a-885e5f49ada5 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d34a408723b4a1f954c07dc3caba2b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b09decc332043249a34c6fff7f6a112', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:41.003510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c9ca4-277c-4e11-a64a-885e5f49ada5 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:41.003764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c9ca4-277c-4e11-a64a-885e5f49ada5 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:41.004257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c9ca4-277c-4e11-a64a-885e5f49ada5 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:41.005051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c9ca4-277c-4e11-a64a-885e5f49ada5 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1999701400) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:21:41.005350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c9ca4-277c-4e11-a64a-885e5f49ada5 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:41.007238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c9ca4-277c-4e11-a64a-885e5f49ada5 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:41.036032 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2700/5435] 10.222.0.43 () {58 vars in 1231 bytes} [Sat Jul 2 21:21:40 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1999701400 => generated 537 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:21:41.042175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852a394-7a68-493d-b4c4-07b766908b6c tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:41.063750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852a394-7a68-493d-b4c4-07b766908b6c tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:41.097476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07231233-63d2-4d8f-8470-a53e67cd96e1 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d34a408723b4a1f954c07dc3caba2b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b09decc332043249a34c6fff7f6a112', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:41.099047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07231233-63d2-4d8f-8470-a53e67cd96e1 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:41.099310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07231233-63d2-4d8f-8470-a53e67cd96e1 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:41.099909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07231233-63d2-4d8f-8470-a53e67cd96e1 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] PATH_INFO: `/v3/projects/8cc82b32aa70410ea4bd8b96981ce731` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:41.103599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07231233-63d2-4d8f-8470-a53e67cd96e1 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8cc82b32aa70410ea4bd8b96981ce731)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:41.106355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07231233-63d2-4d8f-8470-a53e67cd96e1 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:41.267285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-07231233-63d2-4d8f-8470-a53e67cd96e1 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc82b32aa70410ea4bd8b96981ce731', 'request_id': 'req-07231233-63d2-4d8f-8470-a53e67cd96e1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:41.270883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:41.297612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-07231233-63d2-4d8f-8470-a53e67cd96e1 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc82b32aa70410ea4bd8b96981ce731', 'request_id': 'req-07231233-63d2-4d8f-8470-a53e67cd96e1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:41.307469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-07231233-63d2-4d8f-8470-a53e67cd96e1 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc82b32aa70410ea4bd8b96981ce731', 'request_id': 'req-07231233-63d2-4d8f-8470-a53e67cd96e1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:41.328275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-07231233-63d2-4d8f-8470-a53e67cd96e1 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] The token cache is being invalidate because project 8cc82b32aa70410ea4bd8b96981ce731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:41.329127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-07231233-63d2-4d8f-8470-a53e67cd96e1 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:41.330158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-07231233-63d2-4d8f-8470-a53e67cd96e1 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:41.336494 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2736/5436] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:41 2022] DELETE /identity/v3/projects/8cc82b32aa70410ea4bd8b96981ce731 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:41.340663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c9ca4-277c-4e11-a64a-885e5f49ada5 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:41.342468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3c0c9ca4-277c-4e11-a64a-885e5f49ada5 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:41.461314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c9ca4-277c-4e11-a64a-885e5f49ada5 tempest-ListProjectsStaticTestJSON-1479546953 tempest-ListProjectsStaticTestJSON-1479546953-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:41.587614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0371f0b-f8e1-4856-8e7d-67e0faa2e874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:41.589188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371f0b-f8e1-4856-8e7d-67e0faa2e874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:41.590141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371f0b-f8e1-4856-8e7d-67e0faa2e874 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:41.590141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371f0b-f8e1-4856-8e7d-67e0faa2e874 admin admin] PATH_INFO: `/v3/users/7d74ea0be9a24c7b9a54f016edb376e6` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:41.592660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0371f0b-f8e1-4856-8e7d-67e0faa2e874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d74ea0be9a24c7b9a54f016edb376e6)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:41.593917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0371f0b-f8e1-4856-8e7d-67e0faa2e874 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:41.745254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e0371f0b-f8e1-4856-8e7d-67e0faa2e874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d74ea0be9a24c7b9a54f016edb376e6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:41.765953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e0371f0b-f8e1-4856-8e7d-67e0faa2e874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d74ea0be9a24c7b9a54f016edb376e6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:41.784390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e0371f0b-f8e1-4856-8e7d-67e0faa2e874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d74ea0be9a24c7b9a54f016edb376e6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:41.785251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e0371f0b-f8e1-4856-8e7d-67e0faa2e874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d74ea0be9a24c7b9a54f016edb376e6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:41.785895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e0371f0b-f8e1-4856-8e7d-67e0faa2e874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d74ea0be9a24c7b9a54f016edb376e6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:41.799531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:41.826240 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2701/5437] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:41 2022] DELETE /identity/v3/users/7d74ea0be9a24c7b9a54f016edb376e6 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:41.831177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a08692-e0f5-4daf-b03e-de2928af9b58 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:41.831726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a08692-e0f5-4daf-b03e-de2928af9b58 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:41.831726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a08692-e0f5-4daf-b03e-de2928af9b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:41.860169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d3a08692-e0f5-4daf-b03e-de2928af9b58 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:41.861530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d3a08692-e0f5-4daf-b03e-de2928af9b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:42.017671 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2737/5438] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:42.086824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0371f0b-f8e1-4856-8e7d-67e0faa2e874 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:42.095988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e0371f0b-f8e1-4856-8e7d-67e0faa2e874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:42.262297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0371f0b-f8e1-4856-8e7d-67e0faa2e874 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:42.281667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b59b85-6db4-4bd4-bdab-242339bd718f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:42.282626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b59b85-6db4-4bd4-bdab-242339bd718f service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:42.282909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b59b85-6db4-4bd4-bdab-242339bd718f service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:42.283186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b59b85-6db4-4bd4-bdab-242339bd718f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:42.318478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b59b85-6db4-4bd4-bdab-242339bd718f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:42.319955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b59b85-6db4-4bd4-bdab-242339bd718f service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:42.333135 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2702/5439] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:43.391275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a08692-e0f5-4daf-b03e-de2928af9b58 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:43.392911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d3a08692-e0f5-4daf-b03e-de2928af9b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:43.417449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a08692-e0f5-4daf-b03e-de2928af9b58 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:43.424745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a07028-87c4-4095-815a-7ea89b0c9577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:43.425964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a07028-87c4-4095-815a-7ea89b0c9577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:43.426251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a07028-87c4-4095-815a-7ea89b0c9577 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:43.426532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a07028-87c4-4095-815a-7ea89b0c9577 admin admin] PATH_INFO: `/v3/users/780d895863db4be2a19299b68b40e5f2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:43.428032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a07028-87c4-4095-815a-7ea89b0c9577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=780d895863db4be2a19299b68b40e5f2)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:43.430036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a07028-87c4-4095-815a-7ea89b0c9577 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:43.507550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-18a07028-87c4-4095-815a-7ea89b0c9577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '780d895863db4be2a19299b68b40e5f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:43.525110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-18a07028-87c4-4095-815a-7ea89b0c9577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '780d895863db4be2a19299b68b40e5f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:43.526229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-18a07028-87c4-4095-815a-7ea89b0c9577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '780d895863db4be2a19299b68b40e5f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:43.526905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-18a07028-87c4-4095-815a-7ea89b0c9577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '780d895863db4be2a19299b68b40e5f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:43.538150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-18a07028-87c4-4095-815a-7ea89b0c9577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '780d895863db4be2a19299b68b40e5f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:43.570345 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2738/5440] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:43 2022] DELETE /identity/v3/users/780d895863db4be2a19299b68b40e5f2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:43.575347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7690326-25f7-4677-a5d6-722199b29d2c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:43.575907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7690326-25f7-4677-a5d6-722199b29d2c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:43.576004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7690326-25f7-4677-a5d6-722199b29d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:43.622069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e7690326-25f7-4677-a5d6-722199b29d2c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:43.625447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e7690326-25f7-4677-a5d6-722199b29d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:43.728370 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2703/5441] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:21:43.740880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a07028-87c4-4095-815a-7ea89b0c9577 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:43.743007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-18a07028-87c4-4095-815a-7ea89b0c9577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:43.850594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a07028-87c4-4095-815a-7ea89b0c9577 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:43.856992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba12b3-7285-488e-9387-48678d98b468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:43.858287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba12b3-7285-488e-9387-48678d98b468 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:43.858815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba12b3-7285-488e-9387-48678d98b468 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:43.859315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba12b3-7285-488e-9387-48678d98b468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:43.871185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba12b3-7285-488e-9387-48678d98b468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:43.873362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba12b3-7285-488e-9387-48678d98b468 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:43.892322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:43.902912 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2739/5442] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:45.115749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7690326-25f7-4677-a5d6-722199b29d2c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:45.117253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e7690326-25f7-4677-a5d6-722199b29d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:45.144220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7690326-25f7-4677-a5d6-722199b29d2c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:45.153307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902beb-0040-4dbc-ae01-b62fea099b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:45.154425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902beb-0040-4dbc-ae01-b62fea099b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:45.154861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902beb-0040-4dbc-ae01-b62fea099b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:45.155277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50902beb-0040-4dbc-ae01-b62fea099b4a admin admin] PATH_INFO: `/v3/projects/dabe4a16e72d4f1f9ed9ca0b2b951c09` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:45.156731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50902beb-0040-4dbc-ae01-b62fea099b4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dabe4a16e72d4f1f9ed9ca0b2b951c09)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:45.159948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50902beb-0040-4dbc-ae01-b62fea099b4a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:45.273383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-50902beb-0040-4dbc-ae01-b62fea099b4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dabe4a16e72d4f1f9ed9ca0b2b951c09', 'request_id': 'req-50902beb-0040-4dbc-ae01-b62fea099b4a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:45.290889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-50902beb-0040-4dbc-ae01-b62fea099b4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dabe4a16e72d4f1f9ed9ca0b2b951c09', 'request_id': 'req-50902beb-0040-4dbc-ae01-b62fea099b4a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:45.318091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-50902beb-0040-4dbc-ae01-b62fea099b4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dabe4a16e72d4f1f9ed9ca0b2b951c09', 'request_id': 'req-50902beb-0040-4dbc-ae01-b62fea099b4a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:45.360100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-50902beb-0040-4dbc-ae01-b62fea099b4a admin admin] The token cache is being invalidate because project dabe4a16e72d4f1f9ed9ca0b2b951c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:45.360492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-50902beb-0040-4dbc-ae01-b62fea099b4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:45.361161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-50902beb-0040-4dbc-ae01-b62fea099b4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:45.363065 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2704/5443] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:45 2022] DELETE /identity/v3/projects/dabe4a16e72d4f1f9ed9ca0b2b951c09 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:45.371321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba12b3-7285-488e-9387-48678d98b468 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:45.404603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba12b3-7285-488e-9387-48678d98b468 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:45.414576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902beb-0040-4dbc-ae01-b62fea099b4a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:45.416160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-50902beb-0040-4dbc-ae01-b62fea099b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:45.445938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:45.603262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544db7c-c341-4138-8463-c453ed0bcca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:45.607893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544db7c-c341-4138-8463-c453ed0bcca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:45.609307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544db7c-c341-4138-8463-c453ed0bcca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:45.611082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544db7c-c341-4138-8463-c453ed0bcca4 admin admin] PATH_INFO: `/v3/users/4d34a408723b4a1f954c07dc3caba2b7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:45.613980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544db7c-c341-4138-8463-c453ed0bcca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d34a408723b4a1f954c07dc3caba2b7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:45.638245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544db7c-c341-4138-8463-c453ed0bcca4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:45.674508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50902beb-0040-4dbc-ae01-b62fea099b4a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:45.690033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b21962-d8f7-42d7-ad0e-63bf2458715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:45.690033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b21962-d8f7-42d7-ad0e-63bf2458715b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:45.690033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b21962-d8f7-42d7-ad0e-63bf2458715b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:45.690033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b21962-d8f7-42d7-ad0e-63bf2458715b admin admin] PATH_INFO: `/v3/projects/520b14203b364258b249d5f349aa10d4` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:45.698155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b21962-d8f7-42d7-ad0e-63bf2458715b admin admin] RBAC: Authorizing `identity:delete_project(project_id=520b14203b364258b249d5f349aa10d4)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:45.700302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b21962-d8f7-42d7-ad0e-63bf2458715b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:45.757102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d544db7c-c341-4138-8463-c453ed0bcca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d34a408723b4a1f954c07dc3caba2b7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:45.776555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d544db7c-c341-4138-8463-c453ed0bcca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d34a408723b4a1f954c07dc3caba2b7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:45.777392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d544db7c-c341-4138-8463-c453ed0bcca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d34a408723b4a1f954c07dc3caba2b7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:45.778100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d544db7c-c341-4138-8463-c453ed0bcca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d34a408723b4a1f954c07dc3caba2b7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:45.795392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d544db7c-c341-4138-8463-c453ed0bcca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d34a408723b4a1f954c07dc3caba2b7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:45.832674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e1b21962-d8f7-42d7-ad0e-63bf2458715b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '520b14203b364258b249d5f349aa10d4', 'request_id': 'req-e1b21962-d8f7-42d7-ad0e-63bf2458715b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:45.852130 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2740/5444] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:45 2022] DELETE /identity/v3/users/4d34a408723b4a1f954c07dc3caba2b7 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:45.852371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e1b21962-d8f7-42d7-ad0e-63bf2458715b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '520b14203b364258b249d5f349aa10d4', 'request_id': 'req-e1b21962-d8f7-42d7-ad0e-63bf2458715b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:45.852478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544db7c-c341-4138-8463-c453ed0bcca4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:45.863884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e1b21962-d8f7-42d7-ad0e-63bf2458715b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '520b14203b364258b249d5f349aa10d4', 'request_id': 'req-e1b21962-d8f7-42d7-ad0e-63bf2458715b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:45.865523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d544db7c-c341-4138-8463-c453ed0bcca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:45.894069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e1b21962-d8f7-42d7-ad0e-63bf2458715b admin admin] The token cache is being invalidate because project 520b14203b364258b249d5f349aa10d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:45.894366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e1b21962-d8f7-42d7-ad0e-63bf2458715b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:45.901064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e1b21962-d8f7-42d7-ad0e-63bf2458715b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:45.904639 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2705/5445] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:45 2022] DELETE /identity/v3/projects/520b14203b364258b249d5f349aa10d4 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:45.911423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3f507-6b45-459b-8a93-ca8dd0d81b92 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:45.911718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3f507-6b45-459b-8a93-ca8dd0d81b92 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:45.912000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3f507-6b45-459b-8a93-ca8dd0d81b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:45.954116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-09b3f507-6b45-459b-8a93-ca8dd0d81b92 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:45.955359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-09b3f507-6b45-459b-8a93-ca8dd0d81b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:46.118566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544db7c-c341-4138-8463-c453ed0bcca4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:46.127056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f23a40-88f8-4666-a7ed-082e977f74f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:46.127999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f23a40-88f8-4666-a7ed-082e977f74f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:46.128310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f23a40-88f8-4666-a7ed-082e977f74f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:46.128601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f23a40-88f8-4666-a7ed-082e977f74f7 admin admin] PATH_INFO: `/v3/users/2016769bf3a34d22992b45f9974b99a2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:46.137173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f23a40-88f8-4666-a7ed-082e977f74f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2016769bf3a34d22992b45f9974b99a2)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:46.139316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f23a40-88f8-4666-a7ed-082e977f74f7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:46.170365 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2706/5446] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:46.180323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adcf2e-4da6-47f5-9f7b-6bfbd2069c10 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:46.180898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adcf2e-4da6-47f5-9f7b-6bfbd2069c10 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:46.181411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adcf2e-4da6-47f5-9f7b-6bfbd2069c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:46.203071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:46.230085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-21adcf2e-4da6-47f5-9f7b-6bfbd2069c10 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:46.232867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-21adcf2e-4da6-47f5-9f7b-6bfbd2069c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:46.277439 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2707/5447] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:46.281774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adcf2e-4da6-47f5-9f7b-6bfbd2069c10 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:46.287654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-94f23a40-88f8-4666-a7ed-082e977f74f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2016769bf3a34d22992b45f9974b99a2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:46.304609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adcf2e-4da6-47f5-9f7b-6bfbd2069c10 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:46.313408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-94f23a40-88f8-4666-a7ed-082e977f74f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2016769bf3a34d22992b45f9974b99a2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:46.314562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-94f23a40-88f8-4666-a7ed-082e977f74f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2016769bf3a34d22992b45f9974b99a2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:46.315208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-94f23a40-88f8-4666-a7ed-082e977f74f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2016769bf3a34d22992b45f9974b99a2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:46.336559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-94f23a40-88f8-4666-a7ed-082e977f74f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2016769bf3a34d22992b45f9974b99a2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:46.338170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04e888-a644-4f80-8c98-26e083549a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:46.339241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04e888-a644-4f80-8c98-26e083549a10 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:46.340382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04e888-a644-4f80-8c98-26e083549a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:46.340882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04e888-a644-4f80-8c98-26e083549a10 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:46.341863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04e888-a644-4f80-8c98-26e083549a10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:21:46.342408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04e888-a644-4f80-8c98-26e083549a10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:46.345469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04e888-a644-4f80-8c98-26e083549a10 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:46.382493 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2708/5448] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:46.391690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04e888-a644-4f80-8c98-26e083549a10 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:46.395502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ab04e888-a644-4f80-8c98-26e083549a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:46.405472 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2741/5449] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:45 2022] DELETE /identity/v3/users/2016769bf3a34d22992b45f9974b99a2 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:46.422984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04e888-a644-4f80-8c98-26e083549a10 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:46.488811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:46.504060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f23a40-88f8-4666-a7ed-082e977f74f7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:46.505065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-94f23a40-88f8-4666-a7ed-082e977f74f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:46.630031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f801b7-101f-4a24-9582-1a1fd28a8ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:46.630878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f801b7-101f-4a24-9582-1a1fd28a8ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:46.631767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f801b7-101f-4a24-9582-1a1fd28a8ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:46.632077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f801b7-101f-4a24-9582-1a1fd28a8ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:46.632794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f801b7-101f-4a24-9582-1a1fd28a8ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:46.636568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f801b7-101f-4a24-9582-1a1fd28a8ce8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:46.681208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f23a40-88f8-4666-a7ed-082e977f74f7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:46.687926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ee7fd-c281-4826-94c0-5a15dd1b5926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:46.689010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ee7fd-c281-4826-94c0-5a15dd1b5926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:46.689535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ee7fd-c281-4826-94c0-5a15dd1b5926 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:46.697458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ee7fd-c281-4826-94c0-5a15dd1b5926 admin admin] PATH_INFO: `/v3/projects/4b09decc332043249a34c6fff7f6a112` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:46.703643 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2709/5450] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:46 2022] POST /identity/v3/projects => generated 381 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:46.704705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f801b7-101f-4a24-9582-1a1fd28a8ce8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:46.705903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ee7fd-c281-4826-94c0-5a15dd1b5926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b09decc332043249a34c6fff7f6a112)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:46.707972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ee7fd-c281-4826-94c0-5a15dd1b5926 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:46.827719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cd5ee7fd-c281-4826-94c0-5a15dd1b5926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b09decc332043249a34c6fff7f6a112', 'request_id': 'req-cd5ee7fd-c281-4826-94c0-5a15dd1b5926'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:46.850843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cd5ee7fd-c281-4826-94c0-5a15dd1b5926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b09decc332043249a34c6fff7f6a112', 'request_id': 'req-cd5ee7fd-c281-4826-94c0-5a15dd1b5926'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:46.860821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cd5ee7fd-c281-4826-94c0-5a15dd1b5926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b09decc332043249a34c6fff7f6a112', 'request_id': 'req-cd5ee7fd-c281-4826-94c0-5a15dd1b5926'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:46.866429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f801b7-101f-4a24-9582-1a1fd28a8ce8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:46.885678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cd5ee7fd-c281-4826-94c0-5a15dd1b5926 admin admin] The token cache is being invalidate because project 4b09decc332043249a34c6fff7f6a112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:46.889052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cd5ee7fd-c281-4826-94c0-5a15dd1b5926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:46.891447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cd5ee7fd-c281-4826-94c0-5a15dd1b5926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:46.894276 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2742/5451] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:46 2022] DELETE /identity/v3/projects/4b09decc332043249a34c6fff7f6a112 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:21:46.903459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2eacb-ff9b-4b9f-9a2b-fc3d24a9174c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:46.903797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2eacb-ff9b-4b9f-9a2b-fc3d24a9174c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:46.904016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2eacb-ff9b-4b9f-9a2b-fc3d24a9174c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:46.947676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-90c2eacb-ff9b-4b9f-9a2b-fc3d24a9174c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:46.950779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-90c2eacb-ff9b-4b9f-9a2b-fc3d24a9174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:47.005533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:47.022546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac271b4c-cbd9-440e-bf4a-af2b273bc899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:47.024985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac271b4c-cbd9-440e-bf4a-af2b273bc899 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:47.025532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac271b4c-cbd9-440e-bf4a-af2b273bc899 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:47.026949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac271b4c-cbd9-440e-bf4a-af2b273bc899 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:47.027946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac271b4c-cbd9-440e-bf4a-af2b273bc899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:47.035136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac271b4c-cbd9-440e-bf4a-af2b273bc899 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:47.106419 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2710/5452] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:46 2022] POST /identity/v3/users => generated 291 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:47.117619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac271b4c-cbd9-440e-bf4a-af2b273bc899 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:47.128340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ac271b4c-cbd9-440e-bf4a-af2b273bc899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:47.169016 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2743/5453] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:47.171235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada363c-501d-4262-b611-96dd8766c5ae None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:47.171666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada363c-501d-4262-b611-96dd8766c5ae None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:47.172060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada363c-501d-4262-b611-96dd8766c5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:47.174011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac271b4c-cbd9-440e-bf4a-af2b273bc899 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:47.180549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3d606-34ad-4663-a82a-ef4d50e3eaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:47.181422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3d606-34ad-4663-a82a-ef4d50e3eaaa admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:47.181882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3d606-34ad-4663-a82a-ef4d50e3eaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:47.182319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3d606-34ad-4663-a82a-ef4d50e3eaaa admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:47.183475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3d606-34ad-4663-a82a-ef4d50e3eaaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:47.185819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3d606-34ad-4663-a82a-ef4d50e3eaaa admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:47.219032 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2711/5454] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:47.220475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3d606-34ad-4663-a82a-ef4d50e3eaaa admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:47.237704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3d606-34ad-4663-a82a-ef4d50e3eaaa admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:47.246840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718cb71-c3ad-4733-9509-49a318ad5262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:47.248523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4ada363c-501d-4262-b611-96dd8766c5ae None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:47.251688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4ada363c-501d-4262-b611-96dd8766c5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:47.276574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718cb71-c3ad-4733-9509-49a318ad5262 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:47.277128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718cb71-c3ad-4733-9509-49a318ad5262 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:47.278147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718cb71-c3ad-4733-9509-49a318ad5262 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:47.279923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718cb71-c3ad-4733-9509-49a318ad5262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:47.282255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718cb71-c3ad-4733-9509-49a318ad5262 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:47.297052 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2744/5455] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:47.312506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada363c-501d-4262-b611-96dd8766c5ae None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:47.320424 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2712/5456] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:47.321741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718cb71-c3ad-4733-9509-49a318ad5262 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:47.347026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718cb71-c3ad-4733-9509-49a318ad5262 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:47.349799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada363c-501d-4262-b611-96dd8766c5ae None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:47.365275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dedeee8-f80f-4f19-bed4-0f7d0c4251a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:47.367522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedeee8-f80f-4f19-bed4-0f7d0c4251a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:47.367812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedeee8-f80f-4f19-bed4-0f7d0c4251a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:47.368775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dedeee8-f80f-4f19-bed4-0f7d0c4251a7 admin admin] PATH_INFO: `/v3/projects/af638865c2ee46429a491b67f694b5cb/users/66a44a1c3363425fae9cfc7148dc8052/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:47.374074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e48c74-992f-4936-93ed-7d9a43aef55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:47.374773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e48c74-992f-4936-93ed-7d9a43aef55f admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:47.375084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e48c74-992f-4936-93ed-7d9a43aef55f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:47.375366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e48c74-992f-4936-93ed-7d9a43aef55f admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:47.376179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e48c74-992f-4936-93ed-7d9a43aef55f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:21:47.376530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e48c74-992f-4936-93ed-7d9a43aef55f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:47.378233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e48c74-992f-4936-93ed-7d9a43aef55f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:47.410164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dedeee8-f80f-4f19-bed4-0f7d0c4251a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af638865c2ee46429a491b67f694b5cb, user_id=66a44a1c3363425fae9cfc7148dc8052, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:47.415684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dedeee8-f80f-4f19-bed4-0f7d0c4251a7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:47.428618 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2745/5457] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:47.433551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e48c74-992f-4936-93ed-7d9a43aef55f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:47.436477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:47.448549 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2713/5458] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:47 2022] PUT /identity/v3/projects/af638865c2ee46429a491b67f694b5cb/users/66a44a1c3363425fae9cfc7148dc8052/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:47.451590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e48c74-992f-4936-93ed-7d9a43aef55f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:47.561114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07f608-3db2-482a-b7ed-1ac0dd668316 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:47.561320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07f608-3db2-482a-b7ed-1ac0dd668316 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:47.561576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07f608-3db2-482a-b7ed-1ac0dd668316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:47.599455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24983a3-4552-4db3-a8da-ccb19e0a6a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:47.601809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24983a3-4552-4db3-a8da-ccb19e0a6a64 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:47.602108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24983a3-4552-4db3-a8da-ccb19e0a6a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:47.603899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24983a3-4552-4db3-a8da-ccb19e0a6a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:47.605044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24983a3-4552-4db3-a8da-ccb19e0a6a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:47.607940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24983a3-4552-4db3-a8da-ccb19e0a6a64 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:47.619067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fc07f608-3db2-482a-b7ed-1ac0dd668316 None None] MFA Rules not processed for user `66a44a1c3363425fae9cfc7148dc8052`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:47.620949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fc07f608-3db2-482a-b7ed-1ac0dd668316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:47.666746 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2746/5459] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:47 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:47.668011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24983a3-4552-4db3-a8da-ccb19e0a6a64 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:47.674082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c24983a3-4552-4db3-a8da-ccb19e0a6a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:47.791997 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2714/5460] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:21:47.794067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07f608-3db2-482a-b7ed-1ac0dd668316 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:47.841610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07f608-3db2-482a-b7ed-1ac0dd668316 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:47.855786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddeba73-e481-4379-8cd0-a6f45c5d999a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:47.856525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddeba73-e481-4379-8cd0-a6f45c5d999a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:47.856812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddeba73-e481-4379-8cd0-a6f45c5d999a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:47.857089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddeba73-e481-4379-8cd0-a6f45c5d999a admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:47.857793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddeba73-e481-4379-8cd0-a6f45c5d999a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:47.859746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddeba73-e481-4379-8cd0-a6f45c5d999a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:47.867228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24983a3-4552-4db3-a8da-ccb19e0a6a64 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:47.882309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4bb41-64a6-48b3-9f6d-4e9549ee7aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:47.882976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4bb41-64a6-48b3-9f6d-4e9549ee7aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:47.883266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4bb41-64a6-48b3-9f6d-4e9549ee7aae admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:47.883631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4bb41-64a6-48b3-9f6d-4e9549ee7aae admin admin] PATH_INFO: `/v3/projects/c7534889ba5b48338c27c0556be3c6f0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:47.884940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4bb41-64a6-48b3-9f6d-4e9549ee7aae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7534889ba5b48338c27c0556be3c6f0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:47.887950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4bb41-64a6-48b3-9f6d-4e9549ee7aae admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:47.905045 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2715/5461] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:47 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:47.905045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddeba73-e481-4379-8cd0-a6f45c5d999a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:47.925588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddeba73-e481-4379-8cd0-a6f45c5d999a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:47.940519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f7e23-e9ac-453f-9f69-66e4ffbe6b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:47.941437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f7e23-e9ac-453f-9f69-66e4ffbe6b7c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:47.941747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f7e23-e9ac-453f-9f69-66e4ffbe6b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:47.942128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f7e23-e9ac-453f-9f69-66e4ffbe6b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:47.942950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f7e23-e9ac-453f-9f69-66e4ffbe6b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:47.945012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f7e23-e9ac-453f-9f69-66e4ffbe6b7c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:47.976651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:48.015669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-45d4bb41-64a6-48b3-9f6d-4e9549ee7aae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7534889ba5b48338c27c0556be3c6f0', 'request_id': 'req-45d4bb41-64a6-48b3-9f6d-4e9549ee7aae'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:48.033934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-45d4bb41-64a6-48b3-9f6d-4e9549ee7aae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7534889ba5b48338c27c0556be3c6f0', 'request_id': 'req-45d4bb41-64a6-48b3-9f6d-4e9549ee7aae'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:48.044735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-45d4bb41-64a6-48b3-9f6d-4e9549ee7aae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7534889ba5b48338c27c0556be3c6f0', 'request_id': 'req-45d4bb41-64a6-48b3-9f6d-4e9549ee7aae'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:48.048593 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2716/5462] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:47 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:48.048593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f7e23-e9ac-453f-9f69-66e4ffbe6b7c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:48.071667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-45d4bb41-64a6-48b3-9f6d-4e9549ee7aae admin admin] The token cache is being invalidate because project c7534889ba5b48338c27c0556be3c6f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:48.072328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-45d4bb41-64a6-48b3-9f6d-4e9549ee7aae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:48.076504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-45d4bb41-64a6-48b3-9f6d-4e9549ee7aae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:48.078867 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2747/5463] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:47 2022] DELETE /identity/v3/projects/c7534889ba5b48338c27c0556be3c6f0 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:48.079991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4bb41-64a6-48b3-9f6d-4e9549ee7aae admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:48.084346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-45d4bb41-64a6-48b3-9f6d-4e9549ee7aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:48.199738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f7e23-e9ac-453f-9f69-66e4ffbe6b7c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:48.209818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5735368-683b-4bab-a20c-1cb6863d1513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:48.217092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4bb41-64a6-48b3-9f6d-4e9549ee7aae admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:48.222449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5735368-683b-4bab-a20c-1cb6863d1513 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:48.223257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5735368-683b-4bab-a20c-1cb6863d1513 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:48.224513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5735368-683b-4bab-a20c-1cb6863d1513 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:48.225989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5735368-683b-4bab-a20c-1cb6863d1513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:48.230852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5735368-683b-4bab-a20c-1cb6863d1513 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:48.232550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf448a1f-bd6b-4ec1-a7ec-4af23b76f211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:48.233378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf448a1f-bd6b-4ec1-a7ec-4af23b76f211 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:48.233769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf448a1f-bd6b-4ec1-a7ec-4af23b76f211 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:48.234149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf448a1f-bd6b-4ec1-a7ec-4af23b76f211 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:48.235182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf448a1f-bd6b-4ec1-a7ec-4af23b76f211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:48.237197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf448a1f-bd6b-4ec1-a7ec-4af23b76f211 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:48.250253 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2717/5464] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:48.253367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b7bd9-79dc-4b42-9758-ef59d33e5859 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:48.253889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b7bd9-79dc-4b42-9758-ef59d33e5859 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:48.254336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b7bd9-79dc-4b42-9758-ef59d33e5859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:48.280794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0a3b7bd9-79dc-4b42-9758-ef59d33e5859 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:48.282513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0a3b7bd9-79dc-4b42-9758-ef59d33e5859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:48.287469 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2748/5465] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:48 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:48.287956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf448a1f-bd6b-4ec1-a7ec-4af23b76f211 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:48.296797 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2718/5466] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:48.298600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bf448a1f-bd6b-4ec1-a7ec-4af23b76f211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:48.298840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b7bd9-79dc-4b42-9758-ef59d33e5859 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:48.314249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b7bd9-79dc-4b42-9758-ef59d33e5859 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:48.319170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf448a1f-bd6b-4ec1-a7ec-4af23b76f211 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:48.319560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9c059-b7c9-4ec7-b8e5-a79341b23662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:48.321092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9c059-b7c9-4ec7-b8e5-a79341b23662 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:48.321442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9c059-b7c9-4ec7-b8e5-a79341b23662 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:48.321852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9c059-b7c9-4ec7-b8e5-a79341b23662 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:48.322680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9c059-b7c9-4ec7-b8e5-a79341b23662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:48.324571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9c059-b7c9-4ec7-b8e5-a79341b23662 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:48.332906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a51de-0c96-4b68-8f32-27db30d61e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:48.333692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a51de-0c96-4b68-8f32-27db30d61e31 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:48.334097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a51de-0c96-4b68-8f32-27db30d61e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:48.334391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a51de-0c96-4b68-8f32-27db30d61e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:48.335194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a51de-0c96-4b68-8f32-27db30d61e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:48.339067 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2719/5467] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:48.340870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033761c1-fe14-465f-8ff8-6308204b3ec9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:48.341618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033761c1-fe14-465f-8ff8-6308204b3ec9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:48.342033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033761c1-fe14-465f-8ff8-6308204b3ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:48.344285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a51de-0c96-4b68-8f32-27db30d61e31 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:48.369694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-033761c1-fe14-465f-8ff8-6308204b3ec9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:48.371283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-033761c1-fe14-465f-8ff8-6308204b3ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:48.382260 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2749/5468] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:48.385504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a51de-0c96-4b68-8f32-27db30d61e31 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:48.402527 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2720/5469] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:48.403701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033761c1-fe14-465f-8ff8-6308204b3ec9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:48.406382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a51de-0c96-4b68-8f32-27db30d61e31 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:48.417258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033761c1-fe14-465f-8ff8-6308204b3ec9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:48.422570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a9f25-0f60-4b36-bd83-62671c5226d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:48.425962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a9f25-0f60-4b36-bd83-62671c5226d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:48.426553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a9f25-0f60-4b36-bd83-62671c5226d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:48.427054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a9f25-0f60-4b36-bd83-62671c5226d6 admin admin] PATH_INFO: `/v3/projects/f282b664714143b5baa94a831b2915b0/users/6682b33be9c9451d88dd643f0adcf496/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:48.430487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8224c-54d1-46a8-9290-b85c93f84c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:48.431877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8224c-54d1-46a8-9290-b85c93f84c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:48.432404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8224c-54d1-46a8-9290-b85c93f84c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:48.433134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8224c-54d1-46a8-9290-b85c93f84c23 admin admin] PATH_INFO: `/v3/projects/f89057aa9bf24ad199adf218c2580e86/users/77557ab59633447e930c07311b04f0ab/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:48.457322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8224c-54d1-46a8-9290-b85c93f84c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f89057aa9bf24ad199adf218c2580e86, user_id=77557ab59633447e930c07311b04f0ab, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:48.461222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8224c-54d1-46a8-9290-b85c93f84c23 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:48.464943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a9f25-0f60-4b36-bd83-62671c5226d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f282b664714143b5baa94a831b2915b0, user_id=6682b33be9c9451d88dd643f0adcf496, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:48.471961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a9f25-0f60-4b36-bd83-62671c5226d6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:48.473671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:48.487638 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2721/5470] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:48 2022] PUT /identity/v3/projects/f89057aa9bf24ad199adf218c2580e86/users/77557ab59633447e930c07311b04f0ab/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:48.505119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8224c-54d1-46a8-9290-b85c93f84c23 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:48.506393 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2750/5471] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:48 2022] PUT /identity/v3/projects/f282b664714143b5baa94a831b2915b0/users/6682b33be9c9451d88dd643f0adcf496/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:48.510657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e54e0-2e38-4acc-986d-6773edfc069c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:48.511353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e54e0-2e38-4acc-986d-6773edfc069c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:48.512662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e54e0-2e38-4acc-986d-6773edfc069c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:48.626168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-dd2e54e0-2e38-4acc-986d-6773edfc069c None None] MFA Rules not processed for user `77557ab59633447e930c07311b04f0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:48.628348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dd2e54e0-2e38-4acc-986d-6773edfc069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:48.662263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8224c-54d1-46a8-9290-b85c93f84c23 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:48.729720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ea787-9aee-4482-a0f6-f5243c0ffcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:48.730735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ea787-9aee-4482-a0f6-f5243c0ffcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:48.731235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ea787-9aee-4482-a0f6-f5243c0ffcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:48.731717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ea787-9aee-4482-a0f6-f5243c0ffcc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:48.732701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ea787-9aee-4482-a0f6-f5243c0ffcc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:21:48.733247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ea787-9aee-4482-a0f6-f5243c0ffcc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:48.735316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ea787-9aee-4482-a0f6-f5243c0ffcc4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:48.740478 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2751/5472] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:48.741576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e54e0-2e38-4acc-986d-6773edfc069c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:48.747478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:48.750839 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2722/5473] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:48.752016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ea787-9aee-4482-a0f6-f5243c0ffcc4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:48.754481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-660ea787-9aee-4482-a0f6-f5243c0ffcc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:48.755851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e54e0-2e38-4acc-986d-6773edfc069c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:48.762411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7dcb7-b786-4375-bbb7-d4b3a04a239a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:48.763416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7dcb7-b786-4375-bbb7-d4b3a04a239a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:48.763851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7dcb7-b786-4375-bbb7-d4b3a04a239a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:48.764338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7dcb7-b786-4375-bbb7-d4b3a04a239a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:48.765813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7dcb7-b786-4375-bbb7-d4b3a04a239a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:48.768379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7dcb7-b786-4375-bbb7-d4b3a04a239a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:48.787033 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2752/5474] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:48.789206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7dcb7-b786-4375-bbb7-d4b3a04a239a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:48.800590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7dcb7-b786-4375-bbb7-d4b3a04a239a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:48.805830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb42048-6c2e-4e30-af5f-1b0f9968afbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:48.806868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb42048-6c2e-4e30-af5f-1b0f9968afbc admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:48.807305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb42048-6c2e-4e30-af5f-1b0f9968afbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:48.807730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb42048-6c2e-4e30-af5f-1b0f9968afbc admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:48.808599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb42048-6c2e-4e30-af5f-1b0f9968afbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:48.810831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb42048-6c2e-4e30-af5f-1b0f9968afbc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:48.857075 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2753/5475] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:48 2022] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:48.858702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb42048-6c2e-4e30-af5f-1b0f9968afbc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:48.859790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ea787-9aee-4482-a0f6-f5243c0ffcc4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:48.956931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb42048-6c2e-4e30-af5f-1b0f9968afbc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:48.962943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39867d53-b80d-4e5d-8746-56c005c342f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:48.964232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39867d53-b80d-4e5d-8746-56c005c342f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:48.965633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39867d53-b80d-4e5d-8746-56c005c342f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:48.966139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39867d53-b80d-4e5d-8746-56c005c342f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:48.967506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39867d53-b80d-4e5d-8746-56c005c342f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:48.970252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39867d53-b80d-4e5d-8746-56c005c342f1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:48.978125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e991ec-247b-479e-8458-b00e30866103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:48.978848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e991ec-247b-479e-8458-b00e30866103 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:48.979130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e991ec-247b-479e-8458-b00e30866103 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:48.979403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e991ec-247b-479e-8458-b00e30866103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:48.987560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e6e991ec-247b-479e-8458-b00e30866103 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:49.016686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e991ec-247b-479e-8458-b00e30866103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:49.022937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e991ec-247b-479e-8458-b00e30866103 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:49.032886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:49.044077 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2754/5476] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:48 2022] POST /identity/v3/projects => generated 397 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:49.044077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39867d53-b80d-4e5d-8746-56c005c342f1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:49.072507 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2723/5477] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:49.073561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e991ec-247b-479e-8458-b00e30866103 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:49.098700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e991ec-247b-479e-8458-b00e30866103 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:49.224989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39867d53-b80d-4e5d-8746-56c005c342f1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:49.238562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec353f-12f7-4c68-9b24-329f7a5d2350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:49.240221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec353f-12f7-4c68-9b24-329f7a5d2350 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:49.240804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec353f-12f7-4c68-9b24-329f7a5d2350 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:49.241180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec353f-12f7-4c68-9b24-329f7a5d2350 admin admin] PATH_INFO: `/v3/projects/f282b664714143b5baa94a831b2915b0/users/6682b33be9c9451d88dd643f0adcf496/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:49.245264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec353f-12f7-4c68-9b24-329f7a5d2350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f282b664714143b5baa94a831b2915b0, user_id=6682b33be9c9451d88dd643f0adcf496, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:49.250323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec353f-12f7-4c68-9b24-329f7a5d2350 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:49.273947 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2755/5478] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:49 2022] PUT /identity/v3/projects/f282b664714143b5baa94a831b2915b0/users/6682b33be9c9451d88dd643f0adcf496/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:49.275755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec353f-12f7-4c68-9b24-329f7a5d2350 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:49.277820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eeb70c-cece-43ef-b787-38d139039bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:49.279574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeb70c-cece-43ef-b787-38d139039bef admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:49.280651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeb70c-cece-43ef-b787-38d139039bef admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:49.284863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eeb70c-cece-43ef-b787-38d139039bef admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:49.285787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eeb70c-cece-43ef-b787-38d139039bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:49.287916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eeb70c-cece-43ef-b787-38d139039bef admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:49.344145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:49.370086 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2724/5479] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:49 2022] POST /identity/v3/users => generated 300 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:49.371025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec353f-12f7-4c68-9b24-329f7a5d2350 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:49.372098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21071-e79a-4925-b442-0b0e5e27a5b2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:49.372539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21071-e79a-4925-b442-0b0e5e27a5b2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:49.373144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21071-e79a-4925-b442-0b0e5e27a5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:49.377982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622da295-04e9-4f5a-9a18-e3cc90eb9307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:49.378938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622da295-04e9-4f5a-9a18-e3cc90eb9307 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:49.379324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622da295-04e9-4f5a-9a18-e3cc90eb9307 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:49.379694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622da295-04e9-4f5a-9a18-e3cc90eb9307 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:49.380789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622da295-04e9-4f5a-9a18-e3cc90eb9307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:49.382870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622da295-04e9-4f5a-9a18-e3cc90eb9307 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:49.413131 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2756/5480] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:49 2022] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:49.414435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622da295-04e9-4f5a-9a18-e3cc90eb9307 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:49.429788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622da295-04e9-4f5a-9a18-e3cc90eb9307 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:49.433104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bcc21071-e79a-4925-b442-0b0e5e27a5b2 None None] MFA Rules not processed for user `6682b33be9c9451d88dd643f0adcf496`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:49.435592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bcc21071-e79a-4925-b442-0b0e5e27a5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:49.436244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2dbe5-1eb5-4d95-82c8-281adf4f650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:49.436711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2dbe5-1eb5-4d95-82c8-281adf4f650d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:49.437174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2dbe5-1eb5-4d95-82c8-281adf4f650d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:49.437546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2dbe5-1eb5-4d95-82c8-281adf4f650d admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:49.438695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2dbe5-1eb5-4d95-82c8-281adf4f650d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:49.441037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2dbe5-1eb5-4d95-82c8-281adf4f650d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:49.455728 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2757/5481] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:49.456794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2dbe5-1eb5-4d95-82c8-281adf4f650d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:49.471670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2dbe5-1eb5-4d95-82c8-281adf4f650d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:49.479780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbeb0f5-a86d-4e0e-acc8-eef525fbd9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:49.481494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbeb0f5-a86d-4e0e-acc8-eef525fbd9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:49.481494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbeb0f5-a86d-4e0e-acc8-eef525fbd9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:49.482043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbeb0f5-a86d-4e0e-acc8-eef525fbd9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:49.483802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbeb0f5-a86d-4e0e-acc8-eef525fbd9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:49.486496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbeb0f5-a86d-4e0e-acc8-eef525fbd9b9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:49.499399 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2758/5482] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:49.500658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbeb0f5-a86d-4e0e-acc8-eef525fbd9b9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:49.514311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbeb0f5-a86d-4e0e-acc8-eef525fbd9b9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:49.524444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba383840-9b17-4266-a604-34208f6157a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:49.526824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba383840-9b17-4266-a604-34208f6157a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:49.527274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba383840-9b17-4266-a604-34208f6157a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:49.527706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba383840-9b17-4266-a604-34208f6157a0 admin admin] PATH_INFO: `/v3/projects/a5e29e5c87004fada3bf9817ea571766/users/314a13c51a2d42b89c9a2893b992457a/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:49.551676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba383840-9b17-4266-a604-34208f6157a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e29e5c87004fada3bf9817ea571766, user_id=314a13c51a2d42b89c9a2893b992457a, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:49.555561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba383840-9b17-4266-a604-34208f6157a0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:49.576827 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2759/5483] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:49 2022] PUT /identity/v3/projects/a5e29e5c87004fada3bf9817ea571766/users/314a13c51a2d42b89c9a2893b992457a/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:49.577934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba383840-9b17-4266-a604-34208f6157a0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:49.606013 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2725/5484] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:49.607272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc21071-e79a-4925-b442-0b0e5e27a5b2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:49.628911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc21071-e79a-4925-b442-0b0e5e27a5b2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:49.733392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba383840-9b17-4266-a604-34208f6157a0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:49.743130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e34d12-d065-4d9d-ac6b-5a935c7c7d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:49.743977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e34d12-d065-4d9d-ac6b-5a935c7c7d74 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:49.744424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e34d12-d065-4d9d-ac6b-5a935c7c7d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:49.745303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e34d12-d065-4d9d-ac6b-5a935c7c7d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:49.746535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e34d12-d065-4d9d-ac6b-5a935c7c7d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:49.750546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e34d12-d065-4d9d-ac6b-5a935c7c7d74 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:49.760298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd866681-bb85-4ac3-9c4f-8f88bfef893e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:49.761022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd866681-bb85-4ac3-9c4f-8f88bfef893e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:49.761304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd866681-bb85-4ac3-9c4f-8f88bfef893e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:49.761581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd866681-bb85-4ac3-9c4f-8f88bfef893e admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:49.762316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd866681-bb85-4ac3-9c4f-8f88bfef893e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:49.764095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd866681-bb85-4ac3-9c4f-8f88bfef893e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:49.769283 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2726/5485] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:49.769283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e34d12-d065-4d9d-ac6b-5a935c7c7d74 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:49.769842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-62e34d12-d065-4d9d-ac6b-5a935c7c7d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:49.793189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:49.799785 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2760/5486] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:49.804423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd866681-bb85-4ac3-9c4f-8f88bfef893e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:49.829544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd866681-bb85-4ac3-9c4f-8f88bfef893e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:49.838208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce015b-629d-46ff-b1f8-fd2b916e7cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:49.839685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce015b-629d-46ff-b1f8-fd2b916e7cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:49.840385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce015b-629d-46ff-b1f8-fd2b916e7cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:49.840674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce015b-629d-46ff-b1f8-fd2b916e7cf0 admin admin] PATH_INFO: `/v3/projects/a5e29e5c87004fada3bf9817ea571766/users/314a13c51a2d42b89c9a2893b992457a/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:49.843385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce015b-629d-46ff-b1f8-fd2b916e7cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e29e5c87004fada3bf9817ea571766, user_id=314a13c51a2d42b89c9a2893b992457a, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:49.851988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce015b-629d-46ff-b1f8-fd2b916e7cf0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:49.888107 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2761/5487] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:49 2022] PUT /identity/v3/projects/a5e29e5c87004fada3bf9817ea571766/users/314a13c51a2d42b89c9a2893b992457a/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:49.888107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce015b-629d-46ff-b1f8-fd2b916e7cf0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:49.893121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e34d12-d065-4d9d-ac6b-5a935c7c7d74 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:49.992953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45b494-3f3a-41fc-a4c8-9449c20cb2a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:49.993511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b494-3f3a-41fc-a4c8-9449c20cb2a7 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:49.993800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b494-3f3a-41fc-a4c8-9449c20cb2a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:49.994073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b494-3f3a-41fc-a4c8-9449c20cb2a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:50.103616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45b494-3f3a-41fc-a4c8-9449c20cb2a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:50.105645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45b494-3f3a-41fc-a4c8-9449c20cb2a7 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:50.119710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce015b-629d-46ff-b1f8-fd2b916e7cf0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:50.121516 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2727/5488] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:50.123320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ffe8c-3af2-46bd-a168-5572316359da None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:50.124156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ffe8c-3af2-46bd-a168-5572316359da None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:50.124621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ffe8c-3af2-46bd-a168-5572316359da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:50.129217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce48756-c175-4e34-804a-32a2fee9390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:50.130150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce48756-c175-4e34-804a-32a2fee9390e admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:50.130430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce48756-c175-4e34-804a-32a2fee9390e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:50.130755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce48756-c175-4e34-804a-32a2fee9390e admin admin] PATH_INFO: `/v3/projects/e78773926d24460697194be02c372a33/users/d64dd6bef28d4da1a51dfed953b24e05/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:50.174559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce48756-c175-4e34-804a-32a2fee9390e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78773926d24460697194be02c372a33, user_id=d64dd6bef28d4da1a51dfed953b24e05, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:50.181709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-915ffe8c-3af2-46bd-a168-5572316359da None None] MFA Rules not processed for user `314a13c51a2d42b89c9a2893b992457a`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:50.182835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce48756-c175-4e34-804a-32a2fee9390e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:50.185627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-915ffe8c-3af2-46bd-a168-5572316359da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:50.214091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:50.234845 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2762/5489] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:49 2022] PUT /identity/v3/projects/e78773926d24460697194be02c372a33/users/d64dd6bef28d4da1a51dfed953b24e05/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:50.246930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7efda-9be6-47bb-b833-1b672427dc52 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:50.247222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7efda-9be6-47bb-b833-1b672427dc52 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:50.247803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7efda-9be6-47bb-b833-1b672427dc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:50.344807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-12a7efda-9be6-47bb-b833-1b672427dc52 None None] MFA Rules not processed for user `d64dd6bef28d4da1a51dfed953b24e05`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:50.346059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-12a7efda-9be6-47bb-b833-1b672427dc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:50.390479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:50.429362 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2728/5490] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:50.430569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ffe8c-3af2-46bd-a168-5572316359da None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:50.434356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-915ffe8c-3af2-46bd-a168-5572316359da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:50.478697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ffe8c-3af2-46bd-a168-5572316359da None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:50.497834 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2763/5491] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:50.498859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7efda-9be6-47bb-b833-1b672427dc52 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:50.640707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36a3e3-5049-4ff6-ab78-ee579e14ff4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:50.641527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36a3e3-5049-4ff6-ab78-ee579e14ff4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:50.641876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36a3e3-5049-4ff6-ab78-ee579e14ff4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:50.642109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36a3e3-5049-4ff6-ab78-ee579e14ff4d admin admin] PATH_INFO: `/v3/users/4572a43d0b7e465eabd506fb52a502ba` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:50.644678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36a3e3-5049-4ff6-ab78-ee579e14ff4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4572a43d0b7e465eabd506fb52a502ba)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:50.646647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36a3e3-5049-4ff6-ab78-ee579e14ff4d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:50.681817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7efda-9be6-47bb-b833-1b672427dc52 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:50.705384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ed4e9-65b1-413b-8bb2-1b8ece57c9bf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314a13c51a2d42b89c9a2893b992457a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5e29e5c87004fada3bf9817ea571766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:50.706088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ed4e9-65b1-413b-8bb2-1b8ece57c9bf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:50.706494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ed4e9-65b1-413b-8bb2-1b8ece57c9bf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:50.706780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ed4e9-65b1-413b-8bb2-1b8ece57c9bf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:50.707486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ed4e9-65b1-413b-8bb2-1b8ece57c9bf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:50.712252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ed4e9-65b1-413b-8bb2-1b8ece57c9bf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:50.798909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3d36a3e3-5049-4ff6-ab78-ee579e14ff4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4572a43d0b7e465eabd506fb52a502ba'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:50.801128 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2764/5492] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:50 2022] POST /identity/v3/projects => generated 357 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:50.804146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ed4e9-65b1-413b-8bb2-1b8ece57c9bf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:50.807404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-255ed4e9-65b1-413b-8bb2-1b8ece57c9bf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:50.818201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3d36a3e3-5049-4ff6-ab78-ee579e14ff4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4572a43d0b7e465eabd506fb52a502ba'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:50.830163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3d36a3e3-5049-4ff6-ab78-ee579e14ff4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4572a43d0b7e465eabd506fb52a502ba'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:50.831257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3d36a3e3-5049-4ff6-ab78-ee579e14ff4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4572a43d0b7e465eabd506fb52a502ba'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:50.832119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3d36a3e3-5049-4ff6-ab78-ee579e14ff4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4572a43d0b7e465eabd506fb52a502ba'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:50.858701 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2729/5493] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:50 2022] DELETE /identity/v3/users/4572a43d0b7e465eabd506fb52a502ba => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:50.860033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36a3e3-5049-4ff6-ab78-ee579e14ff4d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:50.861708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3d36a3e3-5049-4ff6-ab78-ee579e14ff4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:50.939867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ed4e9-65b1-413b-8bb2-1b8ece57c9bf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:50.983373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36a3e3-5049-4ff6-ab78-ee579e14ff4d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:50.995074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:50.995711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3c112-ceca-43e6-bbc1-817c4eb5f6cf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314a13c51a2d42b89c9a2893b992457a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5e29e5c87004fada3bf9817ea571766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:50.997003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3c112-ceca-43e6-bbc1-817c4eb5f6cf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:50.997449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3c112-ceca-43e6-bbc1-817c4eb5f6cf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:50.997885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3c112-ceca-43e6-bbc1-817c4eb5f6cf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] PATH_INFO: `/v3/projects/c41fb80fe43b4a7a8a961fc4d024708a/tags/tempest-tag-118210968` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:51.000107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3c112-ceca-43e6-bbc1-817c4eb5f6cf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=c41fb80fe43b4a7a8a961fc4d024708a, value=tempest-tag-118210968)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:51.002506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3c112-ceca-43e6-bbc1-817c4eb5f6cf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:51.020067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:51.056981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0c031-2b08-46d4-87b5-49351adfb4f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:51.057912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0c031-2b08-46d4-87b5-49351adfb4f3 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:51.058750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0c031-2b08-46d4-87b5-49351adfb4f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:51.059035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0c031-2b08-46d4-87b5-49351adfb4f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:51.061221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-30a0c031-2b08-46d4-87b5-49351adfb4f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:51.103292 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-75e3c112-ceca-43e6-bbc1-817c4eb5f6cf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-118210968. To ensure interoperability, identifiers should be a valid uuid. Jul 02 21:21:51.103292 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 02 21:21:51.103292 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:21:51.114965 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2730/5494] 10.222.0.43 () {60 vars in 1329 bytes} [Sat Jul 2 21:21:50 2022] PUT /identity/v3/projects/c41fb80fe43b4a7a8a961fc4d024708a/tags/tempest-tag-118210968 => generated 0 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 290 bytes (1 switches on core 0) Jul 02 21:21:51.114965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3c112-ceca-43e6-bbc1-817c4eb5f6cf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:51.115320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-75e3c112-ceca-43e6-bbc1-817c4eb5f6cf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:51.211643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0c031-2b08-46d4-87b5-49351adfb4f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:51.215123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0c031-2b08-46d4-87b5-49351adfb4f3 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:51.235665 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2765/5495] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:51.246012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3c112-ceca-43e6-bbc1-817c4eb5f6cf tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:51.248363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0c031-2b08-46d4-87b5-49351adfb4f3 service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:51.252145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20853773-224f-40c0-a6d2-3834d5a20f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:51.253055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20853773-224f-40c0-a6d2-3834d5a20f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:51.253321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20853773-224f-40c0-a6d2-3834d5a20f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:51.253768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20853773-224f-40c0-a6d2-3834d5a20f2e admin admin] PATH_INFO: `/v3/users/66a44a1c3363425fae9cfc7148dc8052` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:51.255116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20853773-224f-40c0-a6d2-3834d5a20f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a44a1c3363425fae9cfc7148dc8052)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:51.257215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20853773-224f-40c0-a6d2-3834d5a20f2e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:51.278799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0c031-2b08-46d4-87b5-49351adfb4f3 service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:51.285632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b621a56-6a0f-4126-8784-678635b0097a tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314a13c51a2d42b89c9a2893b992457a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5e29e5c87004fada3bf9817ea571766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:51.287355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b621a56-6a0f-4126-8784-678635b0097a tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:51.288213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b621a56-6a0f-4126-8784-678635b0097a tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:51.288779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b621a56-6a0f-4126-8784-678635b0097a tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] PATH_INFO: `/v3/projects/c41fb80fe43b4a7a8a961fc4d024708a/tags/tempest-tag-118210968` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:51.305857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b621a56-6a0f-4126-8784-678635b0097a tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=c41fb80fe43b4a7a8a961fc4d024708a, value=tempest-tag-118210968)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:51.309003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b621a56-6a0f-4126-8784-678635b0097a tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:51.326200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-20853773-224f-40c0-a6d2-3834d5a20f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a44a1c3363425fae9cfc7148dc8052'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:51.330912 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2766/5496] 10.222.0.43 () {58 vars in 1310 bytes} [Sat Jul 2 21:21:51 2022] GET /identity/v3/projects/c41fb80fe43b4a7a8a961fc4d024708a/tags/tempest-tag-118210968 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:51.330912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b621a56-6a0f-4126-8784-678635b0097a tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:51.331441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8b621a56-6a0f-4126-8784-678635b0097a tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:51.343795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-20853773-224f-40c0-a6d2-3834d5a20f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a44a1c3363425fae9cfc7148dc8052'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:51.354695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-20853773-224f-40c0-a6d2-3834d5a20f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a44a1c3363425fae9cfc7148dc8052'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:51.355786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-20853773-224f-40c0-a6d2-3834d5a20f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a44a1c3363425fae9cfc7148dc8052'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:51.356743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-20853773-224f-40c0-a6d2-3834d5a20f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a44a1c3363425fae9cfc7148dc8052'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:51.361260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b621a56-6a0f-4126-8784-678635b0097a tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:51.370584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79413b3-d71b-451d-83df-ac6f8363a45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:51.371760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79413b3-d71b-451d-83df-ac6f8363a45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:51.372126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79413b3-d71b-451d-83df-ac6f8363a45f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:51.372504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79413b3-d71b-451d-83df-ac6f8363a45f admin admin] PATH_INFO: `/v3/projects/f989b228325c4640957dcfe068f652d3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:51.374250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79413b3-d71b-451d-83df-ac6f8363a45f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f989b228325c4640957dcfe068f652d3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:51.381519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79413b3-d71b-451d-83df-ac6f8363a45f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:51.382341 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2731/5497] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:51 2022] DELETE /identity/v3/users/66a44a1c3363425fae9cfc7148dc8052 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:51.387284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20853773-224f-40c0-a6d2-3834d5a20f2e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:51.389773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-20853773-224f-40c0-a6d2-3834d5a20f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:51.478093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:51.506506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20853773-224f-40c0-a6d2-3834d5a20f2e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:51.526734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d79413b3-d71b-451d-83df-ac6f8363a45f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f989b228325c4640957dcfe068f652d3', 'request_id': 'req-d79413b3-d71b-451d-83df-ac6f8363a45f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:51.548053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d79413b3-d71b-451d-83df-ac6f8363a45f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f989b228325c4640957dcfe068f652d3', 'request_id': 'req-d79413b3-d71b-451d-83df-ac6f8363a45f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:51.566218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d79413b3-d71b-451d-83df-ac6f8363a45f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f989b228325c4640957dcfe068f652d3', 'request_id': 'req-d79413b3-d71b-451d-83df-ac6f8363a45f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:51.595486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d79413b3-d71b-451d-83df-ac6f8363a45f admin admin] The token cache is being invalidate because project f989b228325c4640957dcfe068f652d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:51.595803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d79413b3-d71b-451d-83df-ac6f8363a45f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:51.607406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d79413b3-d71b-451d-83df-ac6f8363a45f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:51.609432 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2767/5498] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:51 2022] DELETE /identity/v3/projects/f989b228325c4640957dcfe068f652d3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:51.614510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadbc11-4e83-4e46-81eb-ed38cca543b9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:51.614676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3b70d-38c7-40bc-8a28-14e75d486f9f tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314a13c51a2d42b89c9a2893b992457a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5e29e5c87004fada3bf9817ea571766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:51.614894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadbc11-4e83-4e46-81eb-ed38cca543b9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:51.615188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadbc11-4e83-4e46-81eb-ed38cca543b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:51.615740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3b70d-38c7-40bc-8a28-14e75d486f9f tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:51.616622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3b70d-38c7-40bc-8a28-14e75d486f9f tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:51.616965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3b70d-38c7-40bc-8a28-14e75d486f9f tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] PATH_INFO: `/v3/projects/c41fb80fe43b4a7a8a961fc4d024708a/tags` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:51.619031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3b70d-38c7-40bc-8a28-14e75d486f9f tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=c41fb80fe43b4a7a8a961fc4d024708a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:51.623415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3b70d-38c7-40bc-8a28-14e75d486f9f tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:51.643576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0cadbc11-4e83-4e46-81eb-ed38cca543b9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:51.654722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0cadbc11-4e83-4e46-81eb-ed38cca543b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:51.726764 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2732/5499] 10.222.0.43 () {60 vars in 1264 bytes} [Sat Jul 2 21:21:51 2022] PUT /identity/v3/projects/c41fb80fe43b4a7a8a961fc4d024708a/tags => generated 141 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:51.728332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c1c3b-9772-40f5-af94-cfbddb1b763b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:51.730355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:51.732613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c1c3b-9772-40f5-af94-cfbddb1b763b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:51.734832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c1c3b-9772-40f5-af94-cfbddb1b763b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:51.781263 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2768/5500] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:51.782566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadbc11-4e83-4e46-81eb-ed38cca543b9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:51.784949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-477c1c3b-9772-40f5-af94-cfbddb1b763b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:51.786925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0cadbc11-4e83-4e46-81eb-ed38cca543b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:51.788459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-477c1c3b-9772-40f5-af94-cfbddb1b763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:51.810432 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2733/5501] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:51.818124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c1c3b-9772-40f5-af94-cfbddb1b763b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:51.818781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-477c1c3b-9772-40f5-af94-cfbddb1b763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:51.823365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadbc11-4e83-4e46-81eb-ed38cca543b9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:51.832996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64939baa-bd0b-4d2a-a8bb-a760113ca1f6 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314a13c51a2d42b89c9a2893b992457a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5e29e5c87004fada3bf9817ea571766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:51.834038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64939baa-bd0b-4d2a-a8bb-a760113ca1f6 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:51.834699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64939baa-bd0b-4d2a-a8bb-a760113ca1f6 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:51.834985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64939baa-bd0b-4d2a-a8bb-a760113ca1f6 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] PATH_INFO: `/v3/projects/c41fb80fe43b4a7a8a961fc4d024708a/tags` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:51.864073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64939baa-bd0b-4d2a-a8bb-a760113ca1f6 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=c41fb80fe43b4a7a8a961fc4d024708a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:51.870586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64939baa-bd0b-4d2a-a8bb-a760113ca1f6 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:51.897761 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2769/5502] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:21:51 2022] GET /identity/v3/projects/c41fb80fe43b4a7a8a961fc4d024708a/tags => generated 141 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:51.897761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5df19-c71a-4b6e-8ba2-1a44d6ea65a0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:51.897761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5df19-c71a-4b6e-8ba2-1a44d6ea65a0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:51.898584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5df19-c71a-4b6e-8ba2-1a44d6ea65a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:51.974133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-36c5df19-c71a-4b6e-8ba2-1a44d6ea65a0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:51.979129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-36c5df19-c71a-4b6e-8ba2-1a44d6ea65a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:51.980703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c1c3b-9772-40f5-af94-cfbddb1b763b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:51.996988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b62209-345f-4ab2-85ba-0d24ed96730d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:51.997672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b62209-345f-4ab2-85ba-0d24ed96730d service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:51.997936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b62209-345f-4ab2-85ba-0d24ed96730d service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:51.998211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b62209-345f-4ab2-85ba-0d24ed96730d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:52.014847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b62209-345f-4ab2-85ba-0d24ed96730d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:52.017551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b62209-345f-4ab2-85ba-0d24ed96730d service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:52.020748 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2770/5503] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:52.021640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5df19-c71a-4b6e-8ba2-1a44d6ea65a0 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:52.048337 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2734/5504] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:52.049245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b62209-345f-4ab2-85ba-0d24ed96730d service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:52.070987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5df19-c71a-4b6e-8ba2-1a44d6ea65a0 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:52.097292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c628cf-a289-4102-be74-a6d12b36f864 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314a13c51a2d42b89c9a2893b992457a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5e29e5c87004fada3bf9817ea571766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:52.098092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b62209-345f-4ab2-85ba-0d24ed96730d service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:52.099447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c628cf-a289-4102-be74-a6d12b36f864 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:52.101347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c628cf-a289-4102-be74-a6d12b36f864 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:52.101875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c628cf-a289-4102-be74-a6d12b36f864 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] PATH_INFO: `/v3/projects/c41fb80fe43b4a7a8a961fc4d024708a/tags/tempest-tag-1945598534` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:52.105028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c628cf-a289-4102-be74-a6d12b36f864 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=c41fb80fe43b4a7a8a961fc4d024708a, value=tempest-tag-1945598534)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:52.108546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5cee7-5274-41b7-a75f-9a7d630f8db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:52.109232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5cee7-5274-41b7-a75f-9a7d630f8db5 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:52.109603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5cee7-5274-41b7-a75f-9a7d630f8db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:52.109909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5cee7-5274-41b7-a75f-9a7d630f8db5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:52.110801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5cee7-5274-41b7-a75f-9a7d630f8db5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:21:52.111510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5cee7-5274-41b7-a75f-9a7d630f8db5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:52.113415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5cee7-5274-41b7-a75f-9a7d630f8db5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:52.121279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c628cf-a289-4102-be74-a6d12b36f864 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:52.172159 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2735/5505] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:52.173408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5cee7-5274-41b7-a75f-9a7d630f8db5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:52.187201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5cee7-5274-41b7-a75f-9a7d630f8db5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:52.205839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c635fe-0764-4195-b3ff-19d58589cac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:52.206737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c635fe-0764-4195-b3ff-19d58589cac0 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:52.207178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c635fe-0764-4195-b3ff-19d58589cac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:52.207595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c635fe-0764-4195-b3ff-19d58589cac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:52.208586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c635fe-0764-4195-b3ff-19d58589cac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:52.210613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c635fe-0764-4195-b3ff-19d58589cac0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:52.285447 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-56c628cf-a289-4102-be74-a6d12b36f864 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1945598534. To ensure interoperability, identifiers should be a valid uuid. Jul 02 21:21:52.285447 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 02 21:21:52.285447 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:21:52.292682 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2736/5506] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:52 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:52.295968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c635fe-0764-4195-b3ff-19d58589cac0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:52.308025 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2771/5507] 10.222.0.43 () {58 vars in 1316 bytes} [Sat Jul 2 21:21:52 2022] DELETE /identity/v3/projects/c41fb80fe43b4a7a8a961fc4d024708a/tags/tempest-tag-1945598534 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:52.312274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c628cf-a289-4102-be74-a6d12b36f864 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:52.351681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c628cf-a289-4102-be74-a6d12b36f864 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:52.407577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:52.581746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33644ac5-a296-4611-ac6f-a91a5069249c tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314a13c51a2d42b89c9a2893b992457a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5e29e5c87004fada3bf9817ea571766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:52.583394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33644ac5-a296-4611-ac6f-a91a5069249c tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:52.583679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33644ac5-a296-4611-ac6f-a91a5069249c tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:52.583957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33644ac5-a296-4611-ac6f-a91a5069249c tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] PATH_INFO: `/v3/projects/c41fb80fe43b4a7a8a961fc4d024708a/tags/tempest-tag-1945598534` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:52.589713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c635fe-0764-4195-b3ff-19d58589cac0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:52.611982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555605fc-eceb-4ac9-8103-8d35ba7299c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:52.613320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555605fc-eceb-4ac9-8103-8d35ba7299c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:52.613600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555605fc-eceb-4ac9-8103-8d35ba7299c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:52.613873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555605fc-eceb-4ac9-8103-8d35ba7299c4 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:52.621653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555605fc-eceb-4ac9-8103-8d35ba7299c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:52.626225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555605fc-eceb-4ac9-8103-8d35ba7299c4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:52.634831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33644ac5-a296-4611-ac6f-a91a5069249c tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=c41fb80fe43b4a7a8a961fc4d024708a, value=tempest-tag-1945598534)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:52.644930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33644ac5-a296-4611-ac6f-a91a5069249c tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:52.703168 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2737/5508] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:52 2022] POST /identity/v3/users => generated 291 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:52.708561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555605fc-eceb-4ac9-8103-8d35ba7299c4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:52.729649 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-33644ac5-a296-4611-ac6f-a91a5069249c tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Could not find project tag: tempest-tag-1945598534.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1945598534. Jul 02 21:21:52.729649 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:21:52.729649 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:21:52.729649 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:21:52.729649 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:21:52.729649 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:21:52.729649 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:21:52.729649 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:21:52.729649 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:21:52.729649 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:21:52.729649 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:21:52.729649 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:21:52.729649 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Jul 02 21:21:52.729649 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Jul 02 21:21:52.730706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:21:52.730706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:21:52.730706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Jul 02 21:21:52.730706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Jul 02 21:21:52.730706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1945598534. Jul 02 21:21:52.730706 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:21:52.734546 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2772/5509] 10.222.0.43 () {58 vars in 1313 bytes} [Sat Jul 2 21:21:52 2022] GET /identity/v3/projects/c41fb80fe43b4a7a8a961fc4d024708a/tags/tempest-tag-1945598534 => generated 107 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:21:52.735608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33644ac5-a296-4611-ac6f-a91a5069249c tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:52.741927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555605fc-eceb-4ac9-8103-8d35ba7299c4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:52.772282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33644ac5-a296-4611-ac6f-a91a5069249c tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:52.772569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8c118-2b21-406b-a2d5-9a392c6d72aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:52.772569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8c118-2b21-406b-a2d5-9a392c6d72aa admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:52.772569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8c118-2b21-406b-a2d5-9a392c6d72aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:52.772569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8c118-2b21-406b-a2d5-9a392c6d72aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:52.772930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8c118-2b21-406b-a2d5-9a392c6d72aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:52.781492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8c118-2b21-406b-a2d5-9a392c6d72aa admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:52.784588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90672475-d65c-4621-8776-bd67621167d8 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314a13c51a2d42b89c9a2893b992457a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5e29e5c87004fada3bf9817ea571766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:52.785798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90672475-d65c-4621-8776-bd67621167d8 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:52.787297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90672475-d65c-4621-8776-bd67621167d8 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:52.787710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90672475-d65c-4621-8776-bd67621167d8 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] PATH_INFO: `/v3/projects/c41fb80fe43b4a7a8a961fc4d024708a/tags` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:52.792235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90672475-d65c-4621-8776-bd67621167d8 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=c41fb80fe43b4a7a8a961fc4d024708a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:52.794422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90672475-d65c-4621-8776-bd67621167d8 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:52.815555 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2738/5510] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:52.816563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8c118-2b21-406b-a2d5-9a392c6d72aa admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:52.844517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8c118-2b21-406b-a2d5-9a392c6d72aa admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:52.856435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b1729-fb9b-4efb-ad8a-3d79bfd4aab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:52.857185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b1729-fb9b-4efb-ad8a-3d79bfd4aab2 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:52.857464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b1729-fb9b-4efb-ad8a-3d79bfd4aab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:52.857743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b1729-fb9b-4efb-ad8a-3d79bfd4aab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:52.858569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b1729-fb9b-4efb-ad8a-3d79bfd4aab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:52.860218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b1729-fb9b-4efb-ad8a-3d79bfd4aab2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:52.898226 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2739/5511] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:52.911014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b1729-fb9b-4efb-ad8a-3d79bfd4aab2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:52.914462 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2773/5512] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:21:52 2022] DELETE /identity/v3/projects/c41fb80fe43b4a7a8a961fc4d024708a/tags => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:52.919542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90672475-d65c-4621-8776-bd67621167d8 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:52.934242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b1729-fb9b-4efb-ad8a-3d79bfd4aab2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:52.940695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75221f91-9544-401b-a4db-1f02c4663f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:52.941870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75221f91-9544-401b-a4db-1f02c4663f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:52.942405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75221f91-9544-401b-a4db-1f02c4663f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:52.942886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75221f91-9544-401b-a4db-1f02c4663f19 admin admin] PATH_INFO: `/v3/projects/76e7f008cdf342038f77463635293405/users/8fb8295b4af942d2be5d0cdb0a822868/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:52.966293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90672475-d65c-4621-8776-bd67621167d8 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:52.971381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75221f91-9544-401b-a4db-1f02c4663f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e7f008cdf342038f77463635293405, user_id=8fb8295b4af942d2be5d0cdb0a822868, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:52.975533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75221f91-9544-401b-a4db-1f02c4663f19 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:52.980582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06567c-06b4-4d72-9da0-3949953090a0 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314a13c51a2d42b89c9a2893b992457a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5e29e5c87004fada3bf9817ea571766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:52.981684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06567c-06b4-4d72-9da0-3949953090a0 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:52.982120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06567c-06b4-4d72-9da0-3949953090a0 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:52.982437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06567c-06b4-4d72-9da0-3949953090a0 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] PATH_INFO: `/v3/projects/c41fb80fe43b4a7a8a961fc4d024708a/tags` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:53.006459 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2740/5513] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:52 2022] PUT /identity/v3/projects/76e7f008cdf342038f77463635293405/users/8fb8295b4af942d2be5d0cdb0a822868/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:53.008721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c580b-35c4-468e-aa48-a3b90f405baa None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:53.009209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c580b-35c4-468e-aa48-a3b90f405baa None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:53.009871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c580b-35c4-468e-aa48-a3b90f405baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:53.010461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06567c-06b4-4d72-9da0-3949953090a0 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=c41fb80fe43b4a7a8a961fc4d024708a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:53.012846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06567c-06b4-4d72-9da0-3949953090a0 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:53.033876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:53.035661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-384c580b-35c4-468e-aa48-a3b90f405baa None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:53.037411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-384c580b-35c4-468e-aa48-a3b90f405baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:53.039328 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2774/5514] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:21:52 2022] GET /identity/v3/projects/c41fb80fe43b4a7a8a961fc4d024708a/tags => generated 66 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 02 21:21:53.043783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06567c-06b4-4d72-9da0-3949953090a0 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:53.062492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06567c-06b4-4d72-9da0-3949953090a0 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:53.185625 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2741/5515] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:53.201588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b19b4-1d9a-4204-a1fa-edce327844c2 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '314a13c51a2d42b89c9a2893b992457a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a5e29e5c87004fada3bf9817ea571766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:53.202372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b19b4-1d9a-4204-a1fa-edce327844c2 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:53.204409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b19b4-1d9a-4204-a1fa-edce327844c2 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:53.204409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b19b4-1d9a-4204-a1fa-edce327844c2 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] PATH_INFO: `/v3/projects/c41fb80fe43b4a7a8a961fc4d024708a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:53.205297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b19b4-1d9a-4204-a1fa-edce327844c2 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c41fb80fe43b4a7a8a961fc4d024708a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:53.207316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b19b4-1d9a-4204-a1fa-edce327844c2 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:53.252200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c580b-35c4-468e-aa48-a3b90f405baa None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:53.375512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c580b-35c4-468e-aa48-a3b90f405baa None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:53.445481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:53.457677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-385b19b4-1d9a-4204-a1fa-edce327844c2 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c41fb80fe43b4a7a8a961fc4d024708a', 'request_id': 'req-385b19b4-1d9a-4204-a1fa-edce327844c2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:53.496085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-385b19b4-1d9a-4204-a1fa-edce327844c2 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c41fb80fe43b4a7a8a961fc4d024708a', 'request_id': 'req-385b19b4-1d9a-4204-a1fa-edce327844c2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:53.514100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-385b19b4-1d9a-4204-a1fa-edce327844c2 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c41fb80fe43b4a7a8a961fc4d024708a', 'request_id': 'req-385b19b4-1d9a-4204-a1fa-edce327844c2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:53.542663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01459a36-1492-4688-a846-abdbedb03221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:53.543449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01459a36-1492-4688-a846-abdbedb03221 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:53.543827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01459a36-1492-4688-a846-abdbedb03221 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:53.544242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01459a36-1492-4688-a846-abdbedb03221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:53.558126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-385b19b4-1d9a-4204-a1fa-edce327844c2 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] The token cache is being invalidate because project c41fb80fe43b4a7a8a961fc4d024708a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:53.559904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-385b19b4-1d9a-4204-a1fa-edce327844c2 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:53.561497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-385b19b4-1d9a-4204-a1fa-edce327844c2 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:53.569040 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2775/5516] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:53 2022] DELETE /identity/v3/projects/c41fb80fe43b4a7a8a961fc4d024708a => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:21:53.574330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b19b4-1d9a-4204-a1fa-edce327844c2 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:53.582116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-385b19b4-1d9a-4204-a1fa-edce327844c2 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:53.711772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01459a36-1492-4688-a846-abdbedb03221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:53.716065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01459a36-1492-4688-a846-abdbedb03221 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:53.737708 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2742/5517] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:21:53.867205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b19b4-1d9a-4204-a1fa-edce327844c2 tempest-IdentityV3ProjectTagsTest-1638423026 tempest-IdentityV3ProjectTagsTest-1638423026-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:53.915975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a3b7b-228e-485f-82d0-77389697298b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:53.916928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a3b7b-228e-485f-82d0-77389697298b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:53.917212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a3b7b-228e-485f-82d0-77389697298b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:53.917488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a3b7b-228e-485f-82d0-77389697298b admin admin] PATH_INFO: `/v3/users/77557ab59633447e930c07311b04f0ab` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:53.918823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a3b7b-228e-485f-82d0-77389697298b admin admin] RBAC: Authorizing `identity:delete_user(user_id=77557ab59633447e930c07311b04f0ab)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:53.921226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a3b7b-228e-485f-82d0-77389697298b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:54.008808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:54.045967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f25a3b7b-228e-485f-82d0-77389697298b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77557ab59633447e930c07311b04f0ab'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:54.081375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01459a36-1492-4688-a846-abdbedb03221 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:54.081375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-01459a36-1492-4688-a846-abdbedb03221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:54.087754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f25a3b7b-228e-485f-82d0-77389697298b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77557ab59633447e930c07311b04f0ab'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:54.095490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f25a3b7b-228e-485f-82d0-77389697298b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77557ab59633447e930c07311b04f0ab'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:54.095490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f25a3b7b-228e-485f-82d0-77389697298b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77557ab59633447e930c07311b04f0ab'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:54.115295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01459a36-1492-4688-a846-abdbedb03221 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:54.126989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f25a3b7b-228e-485f-82d0-77389697298b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77557ab59633447e930c07311b04f0ab'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:54.137483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf6f92-ca92-488a-975b-3a1624f13113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:54.144255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf6f92-ca92-488a-975b-3a1624f13113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:54.146144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf6f92-ca92-488a-975b-3a1624f13113 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:54.149201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf6f92-ca92-488a-975b-3a1624f13113 admin admin] PATH_INFO: `/v3/projects/af638865c2ee46429a491b67f694b5cb` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:54.157226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf6f92-ca92-488a-975b-3a1624f13113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af638865c2ee46429a491b67f694b5cb)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:54.172472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf6f92-ca92-488a-975b-3a1624f13113 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:54.212090 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2776/5518] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:53 2022] DELETE /identity/v3/users/77557ab59633447e930c07311b04f0ab => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:54.213735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d31809-9c96-4777-bbbc-a0e1bb4f2f33 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:54.214090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d31809-9c96-4777-bbbc-a0e1bb4f2f33 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:54.216170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d31809-9c96-4777-bbbc-a0e1bb4f2f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:54.286626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-93d31809-9c96-4777-bbbc-a0e1bb4f2f33 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:54.290998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-93d31809-9c96-4777-bbbc-a0e1bb4f2f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:54.358017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbdf6f92-ca92-488a-975b-3a1624f13113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af638865c2ee46429a491b67f694b5cb', 'request_id': 'req-fbdf6f92-ca92-488a-975b-3a1624f13113'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:54.375737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbdf6f92-ca92-488a-975b-3a1624f13113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af638865c2ee46429a491b67f694b5cb', 'request_id': 'req-fbdf6f92-ca92-488a-975b-3a1624f13113'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:54.393291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbdf6f92-ca92-488a-975b-3a1624f13113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af638865c2ee46429a491b67f694b5cb', 'request_id': 'req-fbdf6f92-ca92-488a-975b-3a1624f13113'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:54.430915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbdf6f92-ca92-488a-975b-3a1624f13113 admin admin] The token cache is being invalidate because project af638865c2ee46429a491b67f694b5cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:54.431212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbdf6f92-ca92-488a-975b-3a1624f13113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:54.432975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbdf6f92-ca92-488a-975b-3a1624f13113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:54.438143 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2743/5519] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:54 2022] DELETE /identity/v3/projects/af638865c2ee46429a491b67f694b5cb => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:54.442979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf6f92-ca92-488a-975b-3a1624f13113 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:54.445260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fbdf6f92-ca92-488a-975b-3a1624f13113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:54.466849 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2777/5520] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:54.561827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d31809-9c96-4777-bbbc-a0e1bb4f2f33 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:54.563770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-93d31809-9c96-4777-bbbc-a0e1bb4f2f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:54.583369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:54.601515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf6f92-ca92-488a-975b-3a1624f13113 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:54.608984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337ca84-29a5-4a9a-88f2-9719073b2382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:54.610726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337ca84-29a5-4a9a-88f2-9719073b2382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:54.611172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337ca84-29a5-4a9a-88f2-9719073b2382 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:54.612215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337ca84-29a5-4a9a-88f2-9719073b2382 admin admin] PATH_INFO: `/v3/users/6682b33be9c9451d88dd643f0adcf496` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:54.615075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337ca84-29a5-4a9a-88f2-9719073b2382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6682b33be9c9451d88dd643f0adcf496)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:54.617754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337ca84-29a5-4a9a-88f2-9719073b2382 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:54.718697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a337ca84-29a5-4a9a-88f2-9719073b2382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6682b33be9c9451d88dd643f0adcf496'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:54.727998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d31809-9c96-4777-bbbc-a0e1bb4f2f33 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:54.738689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a337ca84-29a5-4a9a-88f2-9719073b2382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6682b33be9c9451d88dd643f0adcf496'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:54.749245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a337ca84-29a5-4a9a-88f2-9719073b2382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6682b33be9c9451d88dd643f0adcf496'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:54.751836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a337ca84-29a5-4a9a-88f2-9719073b2382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6682b33be9c9451d88dd643f0adcf496'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:54.752603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a337ca84-29a5-4a9a-88f2-9719073b2382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6682b33be9c9451d88dd643f0adcf496'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:54.799887 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2744/5521] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:54 2022] DELETE /identity/v3/users/6682b33be9c9451d88dd643f0adcf496 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:54.859821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67715fcc-0754-4b16-885f-80497d6bc8bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:54.860608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67715fcc-0754-4b16-885f-80497d6bc8bb service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:54.861886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67715fcc-0754-4b16-885f-80497d6bc8bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:54.862178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67715fcc-0754-4b16-885f-80497d6bc8bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:54.867441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-67715fcc-0754-4b16-885f-80497d6bc8bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:54.919160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67715fcc-0754-4b16-885f-80497d6bc8bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:54.936808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67715fcc-0754-4b16-885f-80497d6bc8bb service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:54.966396 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2778/5522] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:21:55.211831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d0ead-6414-44be-b7ba-4fec5fd664c5 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:55.212563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d0ead-6414-44be-b7ba-4fec5fd664c5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:55.212955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d0ead-6414-44be-b7ba-4fec5fd664c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:55.385127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-427d0ead-6414-44be-b7ba-4fec5fd664c5 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:55.386405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-427d0ead-6414-44be-b7ba-4fec5fd664c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:55.518903 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2745/5523] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:55.538264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67715fcc-0754-4b16-885f-80497d6bc8bb service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:55.541621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-67715fcc-0754-4b16-885f-80497d6bc8bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:55.558383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:55.703429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67715fcc-0754-4b16-885f-80497d6bc8bb service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:55.794910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d0ead-6414-44be-b7ba-4fec5fd664c5 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:55.796864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-427d0ead-6414-44be-b7ba-4fec5fd664c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:55.865538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:55.880683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0139f-3090-400e-ac0a-c64918cc2a58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:55.882387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0139f-3090-400e-ac0a-c64918cc2a58 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:55.883041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0139f-3090-400e-ac0a-c64918cc2a58 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:55.883443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0139f-3090-400e-ac0a-c64918cc2a58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:55.900348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0139f-3090-400e-ac0a-c64918cc2a58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:55.901706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0139f-3090-400e-ac0a-c64918cc2a58 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:55.903480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d0ead-6414-44be-b7ba-4fec5fd664c5 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:55.913338 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2779/5524] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:21:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:21:55.914197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ad343-dde1-475b-84b7-dcb5eded1942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:55.915852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ad343-dde1-475b-84b7-dcb5eded1942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:55.916258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ad343-dde1-475b-84b7-dcb5eded1942 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:55.916860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ad343-dde1-475b-84b7-dcb5eded1942 admin admin] PATH_INFO: `/v3/projects/f89057aa9bf24ad199adf218c2580e86` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:55.918799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ad343-dde1-475b-84b7-dcb5eded1942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f89057aa9bf24ad199adf218c2580e86)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:55.921360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ad343-dde1-475b-84b7-dcb5eded1942 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:55.990711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-db0ad343-dde1-475b-84b7-dcb5eded1942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f89057aa9bf24ad199adf218c2580e86', 'request_id': 'req-db0ad343-dde1-475b-84b7-dcb5eded1942'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:55.999357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-db0ad343-dde1-475b-84b7-dcb5eded1942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f89057aa9bf24ad199adf218c2580e86', 'request_id': 'req-db0ad343-dde1-475b-84b7-dcb5eded1942'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:56.007726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-db0ad343-dde1-475b-84b7-dcb5eded1942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f89057aa9bf24ad199adf218c2580e86', 'request_id': 'req-db0ad343-dde1-475b-84b7-dcb5eded1942'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:56.027919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-db0ad343-dde1-475b-84b7-dcb5eded1942 admin admin] The token cache is being invalidate because project f89057aa9bf24ad199adf218c2580e86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:56.028199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-db0ad343-dde1-475b-84b7-dcb5eded1942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:56.028966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-db0ad343-dde1-475b-84b7-dcb5eded1942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:56.035556 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2746/5525] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:55 2022] DELETE /identity/v3/projects/f89057aa9bf24ad199adf218c2580e86 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:56.035876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0139f-3090-400e-ac0a-c64918cc2a58 service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:56.050847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0139f-3090-400e-ac0a-c64918cc2a58 service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:56.135104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ad343-dde1-475b-84b7-dcb5eded1942 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:56.138050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-db0ad343-dde1-475b-84b7-dcb5eded1942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:56.203248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124aaae5-4a71-4a18-9d56-2689df24cf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:56.204693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124aaae5-4a71-4a18-9d56-2689df24cf89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:56.204921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124aaae5-4a71-4a18-9d56-2689df24cf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:56.205137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124aaae5-4a71-4a18-9d56-2689df24cf89 admin admin] PATH_INFO: `/v3/users/314a13c51a2d42b89c9a2893b992457a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:56.209669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124aaae5-4a71-4a18-9d56-2689df24cf89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=314a13c51a2d42b89c9a2893b992457a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:56.227864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124aaae5-4a71-4a18-9d56-2689df24cf89 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:56.312024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:56.323206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ad343-dde1-475b-84b7-dcb5eded1942 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:56.356585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21838225-b330-46bd-81fe-3238efdad3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:56.357493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21838225-b330-46bd-81fe-3238efdad3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:56.357779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21838225-b330-46bd-81fe-3238efdad3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:56.361886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21838225-b330-46bd-81fe-3238efdad3c7 admin admin] PATH_INFO: `/v3/projects/f282b664714143b5baa94a831b2915b0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:56.364423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21838225-b330-46bd-81fe-3238efdad3c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f282b664714143b5baa94a831b2915b0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:56.373662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21838225-b330-46bd-81fe-3238efdad3c7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:56.380439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-124aaae5-4a71-4a18-9d56-2689df24cf89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '314a13c51a2d42b89c9a2893b992457a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:56.401289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-124aaae5-4a71-4a18-9d56-2689df24cf89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '314a13c51a2d42b89c9a2893b992457a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:56.402139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-124aaae5-4a71-4a18-9d56-2689df24cf89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '314a13c51a2d42b89c9a2893b992457a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:56.403685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-124aaae5-4a71-4a18-9d56-2689df24cf89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '314a13c51a2d42b89c9a2893b992457a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:56.414537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-124aaae5-4a71-4a18-9d56-2689df24cf89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '314a13c51a2d42b89c9a2893b992457a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:56.490194 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2780/5526] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:56 2022] DELETE /identity/v3/users/314a13c51a2d42b89c9a2893b992457a => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:56.519401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21838225-b330-46bd-81fe-3238efdad3c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f282b664714143b5baa94a831b2915b0', 'request_id': 'req-21838225-b330-46bd-81fe-3238efdad3c7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:56.539530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21838225-b330-46bd-81fe-3238efdad3c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f282b664714143b5baa94a831b2915b0', 'request_id': 'req-21838225-b330-46bd-81fe-3238efdad3c7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:56.558771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21838225-b330-46bd-81fe-3238efdad3c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f282b664714143b5baa94a831b2915b0', 'request_id': 'req-21838225-b330-46bd-81fe-3238efdad3c7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:56.594497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:56.617481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21838225-b330-46bd-81fe-3238efdad3c7 admin admin] The token cache is being invalidate because project f282b664714143b5baa94a831b2915b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:56.617712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21838225-b330-46bd-81fe-3238efdad3c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:56.619862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-21838225-b330-46bd-81fe-3238efdad3c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:56.624543 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2747/5527] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:56 2022] DELETE /identity/v3/projects/f282b664714143b5baa94a831b2915b0 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:21:56.630280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404d48d-42a8-49f1-ba70-566621ad6c18 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:56.630769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404d48d-42a8-49f1-ba70-566621ad6c18 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:56.631232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404d48d-42a8-49f1-ba70-566621ad6c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:56.689366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7404d48d-42a8-49f1-ba70-566621ad6c18 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:56.689366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7404d48d-42a8-49f1-ba70-566621ad6c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:56.888685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbe92c-2c30-4728-8ca2-754d206b14f3 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:56.889265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbe92c-2c30-4728-8ca2-754d206b14f3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:56.889265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbe92c-2c30-4728-8ca2-754d206b14f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:56.913257 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2781/5528] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:56.919448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-effbe92c-2c30-4728-8ca2-754d206b14f3 None None] MFA Rules not processed for user `fa780176ae5f4a618e42a47531b0d4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:56.922279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f6a3e-943d-4ebb-a122-4b0e16ca7c24 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:56.923529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f6a3e-943d-4ebb-a122-4b0e16ca7c24 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:56.923529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f6a3e-943d-4ebb-a122-4b0e16ca7c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:56.926876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-effbe92c-2c30-4728-8ca2-754d206b14f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:56.963051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6a0f6a3e-943d-4ebb-a122-4b0e16ca7c24 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:56.965167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6a0f6a3e-943d-4ebb-a122-4b0e16ca7c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:56.981499 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2782/5529] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:56.982470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f6a3e-943d-4ebb-a122-4b0e16ca7c24 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:56.994807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f6a3e-943d-4ebb-a122-4b0e16ca7c24 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:57.002650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc9ad0-09cb-4d37-bb4b-057e9c54941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:57.003394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc9ad0-09cb-4d37-bb4b-057e9c54941c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:57.003727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc9ad0-09cb-4d37-bb4b-057e9c54941c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:57.004010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc9ad0-09cb-4d37-bb4b-057e9c54941c admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:57.005394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc9ad0-09cb-4d37-bb4b-057e9c54941c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:21:57.006563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc9ad0-09cb-4d37-bb4b-057e9c54941c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:57.008500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc9ad0-09cb-4d37-bb4b-057e9c54941c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:57.042408 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2783/5530] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:57.043724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc9ad0-09cb-4d37-bb4b-057e9c54941c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:57.059962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc9ad0-09cb-4d37-bb4b-057e9c54941c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:57.067322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30619fd3-1b12-485b-b6a3-0c1514443924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:57.069342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30619fd3-1b12-485b-b6a3-0c1514443924 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:57.069674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30619fd3-1b12-485b-b6a3-0c1514443924 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:57.071059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30619fd3-1b12-485b-b6a3-0c1514443924 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:57.071952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30619fd3-1b12-485b-b6a3-0c1514443924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:57.075067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30619fd3-1b12-485b-b6a3-0c1514443924 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:57.127766 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2748/5531] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:57.128831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbe92c-2c30-4728-8ca2-754d206b14f3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:57.136283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-effbe92c-2c30-4728-8ca2-754d206b14f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:57.197754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbe92c-2c30-4728-8ca2-754d206b14f3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:57.216278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04bd5a-7410-44a6-a3e2-aa332dcc6f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:57.216749 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2784/5532] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:57 2022] POST /identity/v3/projects => generated 369 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:57.217820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30619fd3-1b12-485b-b6a3-0c1514443924 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:57.219130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04bd5a-7410-44a6-a3e2-aa332dcc6f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:57.219404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04bd5a-7410-44a6-a3e2-aa332dcc6f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:57.219679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04bd5a-7410-44a6-a3e2-aa332dcc6f12 admin admin] PATH_INFO: `/v3/projects/a5e29e5c87004fada3bf9817ea571766` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:57.226795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04bd5a-7410-44a6-a3e2-aa332dcc6f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e29e5c87004fada3bf9817ea571766)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:57.228790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04bd5a-7410-44a6-a3e2-aa332dcc6f12 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:57.367772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ab04bd5a-7410-44a6-a3e2-aa332dcc6f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e29e5c87004fada3bf9817ea571766', 'request_id': 'req-ab04bd5a-7410-44a6-a3e2-aa332dcc6f12'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:57.372191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30619fd3-1b12-485b-b6a3-0c1514443924 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:57.377760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ab04bd5a-7410-44a6-a3e2-aa332dcc6f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e29e5c87004fada3bf9817ea571766', 'request_id': 'req-ab04bd5a-7410-44a6-a3e2-aa332dcc6f12'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:57.397102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:57.397272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ab04bd5a-7410-44a6-a3e2-aa332dcc6f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e29e5c87004fada3bf9817ea571766', 'request_id': 'req-ab04bd5a-7410-44a6-a3e2-aa332dcc6f12'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:57.431083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ab04bd5a-7410-44a6-a3e2-aa332dcc6f12 admin admin] The token cache is being invalidate because project a5e29e5c87004fada3bf9817ea571766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:21:57.431462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ab04bd5a-7410-44a6-a3e2-aa332dcc6f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:57.432263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ab04bd5a-7410-44a6-a3e2-aa332dcc6f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:57.434035 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2749/5533] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:57 2022] DELETE /identity/v3/projects/a5e29e5c87004fada3bf9817ea571766 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:57.439158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04bd5a-7410-44a6-a3e2-aa332dcc6f12 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:57.440703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ab04bd5a-7410-44a6-a3e2-aa332dcc6f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:57.503851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab61be-c877-4f7b-985d-180047139deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:57.505069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab61be-c877-4f7b-985d-180047139deb admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:57.505357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab61be-c877-4f7b-985d-180047139deb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:57.505635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab61be-c877-4f7b-985d-180047139deb admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:57.506402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab61be-c877-4f7b-985d-180047139deb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:57.508714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab61be-c877-4f7b-985d-180047139deb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:57.551941 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2785/5534] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:57 2022] POST /identity/v3/users => generated 285 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:57.553919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4ca5d-ee7b-4d17-b631-90d2e18fad11 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:57.554406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4ca5d-ee7b-4d17-b631-90d2e18fad11 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:57.554904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4ca5d-ee7b-4d17-b631-90d2e18fad11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:57.582538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04bd5a-7410-44a6-a3e2-aa332dcc6f12 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:57.584424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-11e4ca5d-ee7b-4d17-b631-90d2e18fad11 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:57.586594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-11e4ca5d-ee7b-4d17-b631-90d2e18fad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:57.596406 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2786/5535] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:57.598572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4ca5d-ee7b-4d17-b631-90d2e18fad11 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:57.605885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828aefd-bce7-4c0e-9bf7-11b4435588d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:57.607149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828aefd-bce7-4c0e-9bf7-11b4435588d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:57.607564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828aefd-bce7-4c0e-9bf7-11b4435588d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:57.607910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828aefd-bce7-4c0e-9bf7-11b4435588d2 admin admin] PATH_INFO: `/v3/users/d64dd6bef28d4da1a51dfed953b24e05` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:57.609130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-11e4ca5d-ee7b-4d17-b631-90d2e18fad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:57.609446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828aefd-bce7-4c0e-9bf7-11b4435588d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d64dd6bef28d4da1a51dfed953b24e05)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:57.614730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828aefd-bce7-4c0e-9bf7-11b4435588d2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:57.632075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4ca5d-ee7b-4d17-b631-90d2e18fad11 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:57.648971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d1789-867a-4c06-a76d-1f00ff0f8404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:57.650131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d1789-867a-4c06-a76d-1f00ff0f8404 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:57.652005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d1789-867a-4c06-a76d-1f00ff0f8404 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:57.653441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d1789-867a-4c06-a76d-1f00ff0f8404 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:57.655390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d1789-867a-4c06-a76d-1f00ff0f8404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:57.657514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d1789-867a-4c06-a76d-1f00ff0f8404 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:57.665228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:57.687893 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2787/5536] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:57.690415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d486239-5186-4701-be44-a1429671c9bf None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:57.693332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d486239-5186-4701-be44-a1429671c9bf None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:57.693797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d486239-5186-4701-be44-a1429671c9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:57.719096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7d486239-5186-4701-be44-a1429671c9bf None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:57.721487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7d486239-5186-4701-be44-a1429671c9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:57.738899 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2788/5537] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:57.739979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d486239-5186-4701-be44-a1429671c9bf None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:57.756640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d486239-5186-4701-be44-a1429671c9bf None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:57.763324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0828aefd-bce7-4c0e-9bf7-11b4435588d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd64dd6bef28d4da1a51dfed953b24e05'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:57.765453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62516b86-2a16-491a-a4ad-3be2b20c82fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:57.766227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62516b86-2a16-491a-a4ad-3be2b20c82fa admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:57.766514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62516b86-2a16-491a-a4ad-3be2b20c82fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:57.766867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62516b86-2a16-491a-a4ad-3be2b20c82fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:57.769180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62516b86-2a16-491a-a4ad-3be2b20c82fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:57.771996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62516b86-2a16-491a-a4ad-3be2b20c82fa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:57.784648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0828aefd-bce7-4c0e-9bf7-11b4435588d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd64dd6bef28d4da1a51dfed953b24e05'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:57.792972 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2789/5538] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:57.793919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62516b86-2a16-491a-a4ad-3be2b20c82fa admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:57.800360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0828aefd-bce7-4c0e-9bf7-11b4435588d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd64dd6bef28d4da1a51dfed953b24e05'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:57.801286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0828aefd-bce7-4c0e-9bf7-11b4435588d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd64dd6bef28d4da1a51dfed953b24e05'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:57.802020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0828aefd-bce7-4c0e-9bf7-11b4435588d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd64dd6bef28d4da1a51dfed953b24e05'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:57.813643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62516b86-2a16-491a-a4ad-3be2b20c82fa admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:57.821727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475116a6-4ea9-48d9-a851-8c659195d232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:57.822514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475116a6-4ea9-48d9-a851-8c659195d232 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:57.822848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475116a6-4ea9-48d9-a851-8c659195d232 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:57.823128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475116a6-4ea9-48d9-a851-8c659195d232 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:57.827209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475116a6-4ea9-48d9-a851-8c659195d232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:21:57.827613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475116a6-4ea9-48d9-a851-8c659195d232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:57.831869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475116a6-4ea9-48d9-a851-8c659195d232 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:57.839797 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2750/5539] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:57 2022] DELETE /identity/v3/users/d64dd6bef28d4da1a51dfed953b24e05 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:57.840888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828aefd-bce7-4c0e-9bf7-11b4435588d2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:57.843951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0828aefd-bce7-4c0e-9bf7-11b4435588d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:57.855849 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2790/5540] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:21:57.857610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bfbc9-342d-4db9-af7c-9296c1263fc5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:57.857907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bfbc9-342d-4db9-af7c-9296c1263fc5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:57.858471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bfbc9-342d-4db9-af7c-9296c1263fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:57.884197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3c3bfbc9-342d-4db9-af7c-9296c1263fc5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:57.886094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3c3bfbc9-342d-4db9-af7c-9296c1263fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:57.998379 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2791/5541] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:57.999260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828aefd-bce7-4c0e-9bf7-11b4435588d2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:57.999749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bfbc9-342d-4db9-af7c-9296c1263fc5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:58.004344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3c3bfbc9-342d-4db9-af7c-9296c1263fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:58.004490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebffb2-3eb9-4695-9b1a-83b00ff7d2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:58.005537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebffb2-3eb9-4695-9b1a-83b00ff7d2e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:58.005819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebffb2-3eb9-4695-9b1a-83b00ff7d2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:58.006099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebffb2-3eb9-4695-9b1a-83b00ff7d2e1 admin admin] PATH_INFO: `/v3/projects/9d551fd6c0ca463fb120f6a0bc6d7431/users/5a6e0a0f3a6e4856b0ab47fc81106454/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:58.024351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebffb2-3eb9-4695-9b1a-83b00ff7d2e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d551fd6c0ca463fb120f6a0bc6d7431, user_id=5a6e0a0f3a6e4856b0ab47fc81106454, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:58.027349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebffb2-3eb9-4695-9b1a-83b00ff7d2e1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:58.042988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bfbc9-342d-4db9-af7c-9296c1263fc5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:58.055310 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2751/5542] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:57 2022] PUT /identity/v3/projects/9d551fd6c0ca463fb120f6a0bc6d7431/users/5a6e0a0f3a6e4856b0ab47fc81106454/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:58.056375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebffb2-3eb9-4695-9b1a-83b00ff7d2e1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:58.059931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ccebffb2-3eb9-4695-9b1a-83b00ff7d2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:58.151637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:58.168698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6abd0a-9683-4c14-8503-26d606887590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:58.169619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6abd0a-9683-4c14-8503-26d606887590 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:58.170213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6abd0a-9683-4c14-8503-26d606887590 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:58.171093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6abd0a-9683-4c14-8503-26d606887590 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:58.171911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6abd0a-9683-4c14-8503-26d606887590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:58.175370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6abd0a-9683-4c14-8503-26d606887590 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:58.195667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebffb2-3eb9-4695-9b1a-83b00ff7d2e1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:58.206557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0d71e-30e9-4ad1-abe3-c07280d931ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:58.207235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0d71e-30e9-4ad1-abe3-c07280d931ce service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:58.207522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0d71e-30e9-4ad1-abe3-c07280d931ce service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:58.207798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0d71e-30e9-4ad1-abe3-c07280d931ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:58.215752 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2792/5543] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:57 2022] POST /identity/v3/projects => generated 395 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:58.221249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a613d6-ef6e-400e-9ec6-40a45116631d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:58.221640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a613d6-ef6e-400e-9ec6-40a45116631d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:58.222178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a613d6-ef6e-400e-9ec6-40a45116631d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:58.229058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0d71e-30e9-4ad1-abe3-c07280d931ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:58.230777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0d71e-30e9-4ad1-abe3-c07280d931ce service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:58.243041 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2752/5544] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:21:58.245031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0d71e-30e9-4ad1-abe3-c07280d931ce service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:58.259009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0d71e-30e9-4ad1-abe3-c07280d931ce service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:58.272254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a5a613d6-ef6e-400e-9ec6-40a45116631d None None] MFA Rules not processed for user `5a6e0a0f3a6e4856b0ab47fc81106454`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:58.272254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a5a613d6-ef6e-400e-9ec6-40a45116631d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:58.321782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:58.375185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d11fa-70f3-464c-a092-cc58d9324664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:58.376389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d11fa-70f3-464c-a092-cc58d9324664 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:58.376828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d11fa-70f3-464c-a092-cc58d9324664 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:58.377482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d11fa-70f3-464c-a092-cc58d9324664 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:58.378333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d11fa-70f3-464c-a092-cc58d9324664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:58.380585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d11fa-70f3-464c-a092-cc58d9324664 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:58.405291 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2793/5545] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:58.415244 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2753/5546] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:58 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:58.418921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a613d6-ef6e-400e-9ec6-40a45116631d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:58.432119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d11fa-70f3-464c-a092-cc58d9324664 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:58.434846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-579d11fa-70f3-464c-a092-cc58d9324664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:58.446761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a613d6-ef6e-400e-9ec6-40a45116631d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:58.458126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8508dfb-4328-4c2f-a2b8-6c165db7b082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:58.459297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8508dfb-4328-4c2f-a2b8-6c165db7b082 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:58.459297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8508dfb-4328-4c2f-a2b8-6c165db7b082 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:58.459591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8508dfb-4328-4c2f-a2b8-6c165db7b082 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:58.460360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8508dfb-4328-4c2f-a2b8-6c165db7b082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:58.462000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8508dfb-4328-4c2f-a2b8-6c165db7b082 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:58.486788 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2794/5547] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:21:58.491225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8508dfb-4328-4c2f-a2b8-6c165db7b082 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:58.518274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8508dfb-4328-4c2f-a2b8-6c165db7b082 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:58.527989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456df94-ffdb-4920-a255-c16478dcdb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:58.529363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456df94-ffdb-4920-a255-c16478dcdb53 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:58.530051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456df94-ffdb-4920-a255-c16478dcdb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:58.531749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456df94-ffdb-4920-a255-c16478dcdb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:58.533098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456df94-ffdb-4920-a255-c16478dcdb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:58.535661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456df94-ffdb-4920-a255-c16478dcdb53 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:58.573736 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2795/5548] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:58.574909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456df94-ffdb-4920-a255-c16478dcdb53 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:58.587037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456df94-ffdb-4920-a255-c16478dcdb53 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:58.593265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22b47d-d76d-44ec-85eb-e49696df107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:58.595014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22b47d-d76d-44ec-85eb-e49696df107e admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:58.595457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22b47d-d76d-44ec-85eb-e49696df107e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:58.595928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22b47d-d76d-44ec-85eb-e49696df107e admin admin] PATH_INFO: `/v3/projects/c54ea72aa57b4f47bd3edd787405847b/users/364f61ca9a7c4d5999721448d30ed976/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:58.598307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d11fa-70f3-464c-a092-cc58d9324664 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:58.608603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba732d-4d9c-4b54-aaa7-e80badb90dd7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:58.609820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba732d-4d9c-4b54-aaa7-e80badb90dd7 service glance] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:58.610174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba732d-4d9c-4b54-aaa7-e80badb90dd7 service glance] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:58.611672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba732d-4d9c-4b54-aaa7-e80badb90dd7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:58.618813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22b47d-d76d-44ec-85eb-e49696df107e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54ea72aa57b4f47bd3edd787405847b, user_id=364f61ca9a7c4d5999721448d30ed976, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:58.622232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22b47d-d76d-44ec-85eb-e49696df107e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:58.637224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba732d-4d9c-4b54-aaa7-e80badb90dd7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:58.638943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba732d-4d9c-4b54-aaa7-e80badb90dd7 service glance] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:58.642588 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2796/5549] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:58 2022] PUT /identity/v3/projects/c54ea72aa57b4f47bd3edd787405847b/users/364f61ca9a7c4d5999721448d30ed976/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:58.658338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718a897-a866-4fc5-9bcb-6caed2deac94 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:58.658805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718a897-a866-4fc5-9bcb-6caed2deac94 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:58.659231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718a897-a866-4fc5-9bcb-6caed2deac94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:58.671755 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2754/5550] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:21:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:21:58.672592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba732d-4d9c-4b54-aaa7-e80badb90dd7 service glance] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:58.684892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1bba732d-4d9c-4b54-aaa7-e80badb90dd7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:58.709908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4718a897-a866-4fc5-9bcb-6caed2deac94 None None] MFA Rules not processed for user `364f61ca9a7c4d5999721448d30ed976`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:21:58.711222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4718a897-a866-4fc5-9bcb-6caed2deac94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:58.711949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba732d-4d9c-4b54-aaa7-e80badb90dd7 service glance] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:58.853876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b9fe5-3767-4bb5-9fe6-30482aac3d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:58.856693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9fe5-3767-4bb5-9fe6-30482aac3d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:58.857131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9fe5-3767-4bb5-9fe6-30482aac3d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:58.857299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9fe5-3767-4bb5-9fe6-30482aac3d7b admin admin] PATH_INFO: `/v3/users/e1b7350d87a14f6dbd97ba52e3ed0a7d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:58.861841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b9fe5-3767-4bb5-9fe6-30482aac3d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1b7350d87a14f6dbd97ba52e3ed0a7d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:58.866894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b9fe5-3767-4bb5-9fe6-30482aac3d7b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:58.976311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b34b9fe5-3767-4bb5-9fe6-30482aac3d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1b7350d87a14f6dbd97ba52e3ed0a7d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:58.980557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:59.004650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b34b9fe5-3767-4bb5-9fe6-30482aac3d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1b7350d87a14f6dbd97ba52e3ed0a7d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:59.008795 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2797/5551] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:21:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:21:59.013626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718a897-a866-4fc5-9bcb-6caed2deac94 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:59.019185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b34b9fe5-3767-4bb5-9fe6-30482aac3d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1b7350d87a14f6dbd97ba52e3ed0a7d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:59.026191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b34b9fe5-3767-4bb5-9fe6-30482aac3d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1b7350d87a14f6dbd97ba52e3ed0a7d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:59.027116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b34b9fe5-3767-4bb5-9fe6-30482aac3d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1b7350d87a14f6dbd97ba52e3ed0a7d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:59.040518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718a897-a866-4fc5-9bcb-6caed2deac94 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:59.058709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc0ba8-3cd0-413b-ac91-6b129288e405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:59.062030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc0ba8-3cd0-413b-ac91-6b129288e405 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:59.062487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc0ba8-3cd0-413b-ac91-6b129288e405 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:59.062967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc0ba8-3cd0-413b-ac91-6b129288e405 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:59.064113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc0ba8-3cd0-413b-ac91-6b129288e405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:59.066631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc0ba8-3cd0-413b-ac91-6b129288e405 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:59.073746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:59.089467 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2755/5552] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:21:58 2022] DELETE /identity/v3/users/e1b7350d87a14f6dbd97ba52e3ed0a7d => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:59.163034 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2798/5553] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:21:59 2022] POST /identity/v3/projects => generated 397 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:59.166700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b9fe5-3767-4bb5-9fe6-30482aac3d7b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:59.169247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b34b9fe5-3767-4bb5-9fe6-30482aac3d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:59.343789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b9fe5-3767-4bb5-9fe6-30482aac3d7b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:59.454116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcce381-b816-4d35-9230-157f925666d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:59.454837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcce381-b816-4d35-9230-157f925666d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:59.455151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcce381-b816-4d35-9230-157f925666d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:59.455435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcce381-b816-4d35-9230-157f925666d2 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:59.456330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcce381-b816-4d35-9230-157f925666d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:59.458335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcce381-b816-4d35-9230-157f925666d2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:59.518644 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2756/5554] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:21:59 2022] POST /identity/v3/users => generated 305 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:21:59.522700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc0ba8-3cd0-413b-ac91-6b129288e405 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:59.543780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc0ba8-3cd0-413b-ac91-6b129288e405 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:59.562058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86de8d-a2cd-40c5-bc4f-2f07d1ddd807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:59.562883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86de8d-a2cd-40c5-bc4f-2f07d1ddd807 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:59.563317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86de8d-a2cd-40c5-bc4f-2f07d1ddd807 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:59.563845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86de8d-a2cd-40c5-bc4f-2f07d1ddd807 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:59.564923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86de8d-a2cd-40c5-bc4f-2f07d1ddd807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:59.566763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86de8d-a2cd-40c5-bc4f-2f07d1ddd807 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:59.590896 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2799/5555] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:59.593431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcce381-b816-4d35-9230-157f925666d2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:59.611731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcce381-b816-4d35-9230-157f925666d2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:59.644435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0f2cb-6066-4d66-972d-55948a5ab385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:59.651829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0f2cb-6066-4d66-972d-55948a5ab385 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:59.652198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0f2cb-6066-4d66-972d-55948a5ab385 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:59.652592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0f2cb-6066-4d66-972d-55948a5ab385 admin admin] PATH_INFO: `/v3/projects/f9b953d4d25145e5828a31b5ff0a262e/users/366ca0649b1642b88f940d18f1d08102/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:59.680422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0f2cb-6066-4d66-972d-55948a5ab385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b953d4d25145e5828a31b5ff0a262e, user_id=366ca0649b1642b88f940d18f1d08102, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:59.684901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0f2cb-6066-4d66-972d-55948a5ab385 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:59.692762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86de8d-a2cd-40c5-bc4f-2f07d1ddd807 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:59.696347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bb86de8d-a2cd-40c5-bc4f-2f07d1ddd807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:21:59.722978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86de8d-a2cd-40c5-bc4f-2f07d1ddd807 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:59.728685 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2757/5556] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:59 2022] PUT /identity/v3/projects/f9b953d4d25145e5828a31b5ff0a262e/users/366ca0649b1642b88f940d18f1d08102/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:21:59.729970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0f2cb-6066-4d66-972d-55948a5ab385 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:59.825358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:59.873671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ba6a7-c328-4b13-841c-3a7498d86171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:59.875817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ba6a7-c328-4b13-841c-3a7498d86171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:59.876584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ba6a7-c328-4b13-841c-3a7498d86171 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:59.877162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ba6a7-c328-4b13-841c-3a7498d86171 admin admin] PATH_INFO: `/v3/projects/e693f5f3d3df486696086ea98714bcbf` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:59.882642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ba6a7-c328-4b13-841c-3a7498d86171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e693f5f3d3df486696086ea98714bcbf)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:59.884885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ba6a7-c328-4b13-841c-3a7498d86171 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:59.887376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0f2cb-6066-4d66-972d-55948a5ab385 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:59.911904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edace8f-bf26-4c45-98c3-1d7ff3f59f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:21:59.912805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edace8f-bf26-4c45-98c3-1d7ff3f59f63 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:21:59.913179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edace8f-bf26-4c45-98c3-1d7ff3f59f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:21:59.913574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edace8f-bf26-4c45-98c3-1d7ff3f59f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:21:59.914745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edace8f-bf26-4c45-98c3-1d7ff3f59f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:21:59.917050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edace8f-bf26-4c45-98c3-1d7ff3f59f63 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:21:59.954618 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2758/5557] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:21:59.957795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edace8f-bf26-4c45-98c3-1d7ff3f59f63 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:21:59.973762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2c5ba6a7-c328-4b13-841c-3a7498d86171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e693f5f3d3df486696086ea98714bcbf', 'request_id': 'req-2c5ba6a7-c328-4b13-841c-3a7498d86171'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:21:59.977659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edace8f-bf26-4c45-98c3-1d7ff3f59f63 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:21:59.993061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2c5ba6a7-c328-4b13-841c-3a7498d86171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e693f5f3d3df486696086ea98714bcbf', 'request_id': 'req-2c5ba6a7-c328-4b13-841c-3a7498d86171'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:00.006451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2c5ba6a7-c328-4b13-841c-3a7498d86171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e693f5f3d3df486696086ea98714bcbf', 'request_id': 'req-2c5ba6a7-c328-4b13-841c-3a7498d86171'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:00.034133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2c5ba6a7-c328-4b13-841c-3a7498d86171 admin admin] The token cache is being invalidate because project e693f5f3d3df486696086ea98714bcbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:00.034638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2c5ba6a7-c328-4b13-841c-3a7498d86171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:00.036779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2c5ba6a7-c328-4b13-841c-3a7498d86171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:00.042709 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2800/5558] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:59 2022] DELETE /identity/v3/projects/e693f5f3d3df486696086ea98714bcbf => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:00.048491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8406193-81fc-4c34-b5c8-277c7f163e7a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:00.048857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8406193-81fc-4c34-b5c8-277c7f163e7a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:00.049157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8406193-81fc-4c34-b5c8-277c7f163e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:00.118749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b8406193-81fc-4c34-b5c8-277c7f163e7a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:00.120150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b8406193-81fc-4c34-b5c8-277c7f163e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:00.167242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850f9df-dabd-42f0-b03c-bf1c17191763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:00.168317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850f9df-dabd-42f0-b03c-bf1c17191763 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:00.169396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850f9df-dabd-42f0-b03c-bf1c17191763 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:00.174799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850f9df-dabd-42f0-b03c-bf1c17191763 admin admin] PATH_INFO: `/v3/projects/f9b953d4d25145e5828a31b5ff0a262e/users/366ca0649b1642b88f940d18f1d08102/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:00.177916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850f9df-dabd-42f0-b03c-bf1c17191763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b953d4d25145e5828a31b5ff0a262e, user_id=366ca0649b1642b88f940d18f1d08102, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:00.180903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850f9df-dabd-42f0-b03c-bf1c17191763 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:00.221993 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2759/5559] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:21:59 2022] PUT /identity/v3/projects/f9b953d4d25145e5828a31b5ff0a262e/users/366ca0649b1642b88f940d18f1d08102/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:22:00.229856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514cb91-adb1-46ae-81bb-7d5d12f8d697 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:00.231060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514cb91-adb1-46ae-81bb-7d5d12f8d697 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:00.231416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514cb91-adb1-46ae-81bb-7d5d12f8d697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:00.320621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0514cb91-adb1-46ae-81bb-7d5d12f8d697 None None] MFA Rules not processed for user `366ca0649b1642b88f940d18f1d08102`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:00.322573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0514cb91-adb1-46ae-81bb-7d5d12f8d697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:00.369280 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2801/5560] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:00.379817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b515389-6cf2-475e-a836-ba052eb9b399 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:00.380488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b515389-6cf2-475e-a836-ba052eb9b399 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:00.381002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b515389-6cf2-475e-a836-ba052eb9b399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:00.390786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:00.427678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6b515389-6cf2-475e-a836-ba052eb9b399 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:00.439555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6b515389-6cf2-475e-a836-ba052eb9b399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:00.523372 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2760/5561] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:00.528956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514cb91-adb1-46ae-81bb-7d5d12f8d697 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:00.531750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0514cb91-adb1-46ae-81bb-7d5d12f8d697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:00.621030 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2802/5562] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:00.625823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b515389-6cf2-475e-a836-ba052eb9b399 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:00.664627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b515389-6cf2-475e-a836-ba052eb9b399 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:00.673946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991f929-bf07-4e46-a108-8cb2b5ad51fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:00.675250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991f929-bf07-4e46-a108-8cb2b5ad51fb admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:00.675826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991f929-bf07-4e46-a108-8cb2b5ad51fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:00.676350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991f929-bf07-4e46-a108-8cb2b5ad51fb admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:00.678541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991f929-bf07-4e46-a108-8cb2b5ad51fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:22:00.679834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991f929-bf07-4e46-a108-8cb2b5ad51fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:00.689310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991f929-bf07-4e46-a108-8cb2b5ad51fb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:00.716562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:00.726266 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2803/5563] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:22:00.730892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991f929-bf07-4e46-a108-8cb2b5ad51fb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:00.764934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514cb91-adb1-46ae-81bb-7d5d12f8d697 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:00.771998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991f929-bf07-4e46-a108-8cb2b5ad51fb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:00.780869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f55733-dc1f-42e3-b7e2-0dbea9a11f28 tempest-ProjectsNegativeStaticTestJSON-211942007 tempest-ProjectsNegativeStaticTestJSON-211942007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364f61ca9a7c4d5999721448d30ed976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54ea72aa57b4f47bd3edd787405847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:00.783173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f55733-dc1f-42e3-b7e2-0dbea9a11f28 tempest-ProjectsNegativeStaticTestJSON-211942007 tempest-ProjectsNegativeStaticTestJSON-211942007-project] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:00.783521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f55733-dc1f-42e3-b7e2-0dbea9a11f28 tempest-ProjectsNegativeStaticTestJSON-211942007 tempest-ProjectsNegativeStaticTestJSON-211942007-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:00.783803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f55733-dc1f-42e3-b7e2-0dbea9a11f28 tempest-ProjectsNegativeStaticTestJSON-211942007 tempest-ProjectsNegativeStaticTestJSON-211942007-project] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:00.787575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f55733-dc1f-42e3-b7e2-0dbea9a11f28 tempest-ProjectsNegativeStaticTestJSON-211942007 tempest-ProjectsNegativeStaticTestJSON-211942007-project] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:00.807665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee9b52-5176-4ac7-a10c-69067ce994bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:00.808632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee9b52-5176-4ac7-a10c-69067ce994bb admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:00.808632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee9b52-5176-4ac7-a10c-69067ce994bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:00.808890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee9b52-5176-4ac7-a10c-69067ce994bb admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:00.809594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee9b52-5176-4ac7-a10c-69067ce994bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:00.821504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee9b52-5176-4ac7-a10c-69067ce994bb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:00.833533 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-e7f55733-dc1f-42e3-b7e2-0dbea9a11f28 tempest-ProjectsNegativeStaticTestJSON-211942007 tempest-ProjectsNegativeStaticTestJSON-211942007-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jul 02 21:22:00.833533 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:22:00.833533 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:22:00.833533 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:22:00.833533 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:22:00.833533 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:22:00.833533 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:22:00.833533 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:22:00.833533 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:22:00.833533 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:22:00.833533 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:22:00.833533 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:22:00.833533 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Jul 02 21:22:00.833533 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 02 21:22:00.834661 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 02 21:22:00.834661 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 02 21:22:00.834661 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 02 21:22:00.834661 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 02 21:22:00.834661 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:22:00.834661 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 02 21:22:00.834661 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jul 02 21:22:00.834661 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:22:00.840887 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2761/5564] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:22:00 2022] POST /identity/v3/projects => generated 136 bytes in 313 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:22:00.841862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f55733-dc1f-42e3-b7e2-0dbea9a11f28 tempest-ProjectsNegativeStaticTestJSON-211942007 tempest-ProjectsNegativeStaticTestJSON-211942007-project] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:00.849971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e7f55733-dc1f-42e3-b7e2-0dbea9a11f28 tempest-ProjectsNegativeStaticTestJSON-211942007 tempest-ProjectsNegativeStaticTestJSON-211942007-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:00.907826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f55733-dc1f-42e3-b7e2-0dbea9a11f28 tempest-ProjectsNegativeStaticTestJSON-211942007 tempest-ProjectsNegativeStaticTestJSON-211942007-project] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:00.916684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae1c19-bd7f-4442-96b3-9df799611715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:00.917537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae1c19-bd7f-4442-96b3-9df799611715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:00.917816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae1c19-bd7f-4442-96b3-9df799611715 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:00.918160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae1c19-bd7f-4442-96b3-9df799611715 admin admin] PATH_INFO: `/v3/projects/e78773926d24460697194be02c372a33` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:00.920449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae1c19-bd7f-4442-96b3-9df799611715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78773926d24460697194be02c372a33)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:00.928979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae1c19-bd7f-4442-96b3-9df799611715 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:00.941414 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2804/5565] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:00 2022] POST /identity/v3/projects => generated 399 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:00.945058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee9b52-5176-4ac7-a10c-69067ce994bb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:01.058333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8aae1c19-bd7f-4442-96b3-9df799611715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78773926d24460697194be02c372a33', 'request_id': 'req-8aae1c19-bd7f-4442-96b3-9df799611715'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:01.074305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8aae1c19-bd7f-4442-96b3-9df799611715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78773926d24460697194be02c372a33', 'request_id': 'req-8aae1c19-bd7f-4442-96b3-9df799611715'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:01.096179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8aae1c19-bd7f-4442-96b3-9df799611715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78773926d24460697194be02c372a33', 'request_id': 'req-8aae1c19-bd7f-4442-96b3-9df799611715'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:01.129985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8aae1c19-bd7f-4442-96b3-9df799611715 admin admin] The token cache is being invalidate because project e78773926d24460697194be02c372a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:01.130193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8aae1c19-bd7f-4442-96b3-9df799611715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:01.130845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8aae1c19-bd7f-4442-96b3-9df799611715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:01.134521 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2762/5566] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:00 2022] DELETE /identity/v3/projects/e78773926d24460697194be02c372a33 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:01.138795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae1c19-bd7f-4442-96b3-9df799611715 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:01.146242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8aae1c19-bd7f-4442-96b3-9df799611715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:01.239089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee9b52-5176-4ac7-a10c-69067ce994bb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:01.314878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae1c19-bd7f-4442-96b3-9df799611715 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:01.328013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750476d5-c2fd-47ed-9407-ce1c3890296d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:01.328745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750476d5-c2fd-47ed-9407-ce1c3890296d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:01.329028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750476d5-c2fd-47ed-9407-ce1c3890296d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:01.329373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750476d5-c2fd-47ed-9407-ce1c3890296d admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:01.330077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750476d5-c2fd-47ed-9407-ce1c3890296d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:01.344261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750476d5-c2fd-47ed-9407-ce1c3890296d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:01.383468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45c658-ed88-44cc-ad46-9720c4f8dc86 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '366ca0649b1642b88f940d18f1d08102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9b953d4d25145e5828a31b5ff0a262e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:01.384978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45c658-ed88-44cc-ad46-9720c4f8dc86 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:01.386095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45c658-ed88-44cc-ad46-9720c4f8dc86 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:01.386390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45c658-ed88-44cc-ad46-9720c4f8dc86 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:01.390561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45c658-ed88-44cc-ad46-9720c4f8dc86 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:01.394739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45c658-ed88-44cc-ad46-9720c4f8dc86 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-8f45c658-ed88-44cc-ad46-9720c4f8dc86 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Invalid input for field 'name': '' is too short Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: Failed validating 'minLength' in schema['properties']['name']: Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: On instance['name']: Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: Failed validating 'minLength' in schema['properties']['name']: Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: On instance['name']: Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: '' Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise error Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application On instance['name']: Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application '' Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:22:01.403472 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:22:01.405665 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:22:01.405665 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:22:01.405665 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:22:01.405665 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:22:01.405665 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:22:01.405665 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:22:01.405665 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:22:01.405665 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:22:01.405665 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:22:01.405665 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:22:01.405665 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:22:01.405665 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:22:01.405665 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jul 02 21:22:01.405665 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jul 02 21:22:01.405665 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 02 21:22:01.405665 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 02 21:22:01.405665 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 02 21:22:01.406748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 02 21:22:01.406748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 02 21:22:01.406748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:22:01.406748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 02 21:22:01.406748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 02 21:22:01.406748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:22:01.406748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application On instance['name']: Jul 02 21:22:01.406748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application '' Jul 02 21:22:01.406748 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:22:01.427735 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2763/5567] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:01 2022] POST /identity/v3/users => generated 300 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:01.429480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78143b-106c-4487-b74e-39a2bfd8927c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:01.436847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78143b-106c-4487-b74e-39a2bfd8927c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:01.437322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78143b-106c-4487-b74e-39a2bfd8927c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:01.446413 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2805/5568] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:22:00 2022] POST /identity/v3/projects => generated 283 bytes in 504 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 02 21:22:01.448462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45c658-ed88-44cc-ad46-9720c4f8dc86 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:01.492729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45c658-ed88-44cc-ad46-9720c4f8dc86 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:01.498403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-7b78143b-106c-4487-b74e-39a2bfd8927c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:01.499840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7b78143b-106c-4487-b74e-39a2bfd8927c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:01.528176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ea6ba-e776-4fe4-8199-ee9e8b7b6b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:01.529025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ea6ba-e776-4fe4-8199-ee9e8b7b6b54 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:01.529309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ea6ba-e776-4fe4-8199-ee9e8b7b6b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:01.529585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ea6ba-e776-4fe4-8199-ee9e8b7b6b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:01.530325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ea6ba-e776-4fe4-8199-ee9e8b7b6b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:01.536131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ea6ba-e776-4fe4-8199-ee9e8b7b6b54 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:01.536732 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2764/5569] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:01.538617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78143b-106c-4487-b74e-39a2bfd8927c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:01.543340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7b78143b-106c-4487-b74e-39a2bfd8927c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:01.572925 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2806/5570] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:01.574666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f0b7e-1662-4c16-9b9e-01d896e51fb8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:01.575173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f0b7e-1662-4c16-9b9e-01d896e51fb8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:01.575724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f0b7e-1662-4c16-9b9e-01d896e51fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:01.601177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78143b-106c-4487-b74e-39a2bfd8927c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:01.613502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc6cf5-2d25-4972-92a5-6d66205a7a83 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '366ca0649b1642b88f940d18f1d08102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9b953d4d25145e5828a31b5ff0a262e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:01.614517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc6cf5-2d25-4972-92a5-6d66205a7a83 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:01.614961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc6cf5-2d25-4972-92a5-6d66205a7a83 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:01.615599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc6cf5-2d25-4972-92a5-6d66205a7a83 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:01.616642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc6cf5-2d25-4972-92a5-6d66205a7a83 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:01.619001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc6cf5-2d25-4972-92a5-6d66205a7a83 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:01.636322 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-46fc6cf5-2d25-4972-92a5-6d66205a7a83 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:22:01.636322 ncdv-master-1 devstack@keystone.service[91077]: Failed validating 'maxLength' in schema['properties']['name']: Jul 02 21:22:01.636322 ncdv-master-1 devstack@keystone.service[91077]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 02 21:22:01.636322 ncdv-master-1 devstack@keystone.service[91077]: On instance['name']: Jul 02 21:22:01.636322 ncdv-master-1 devstack@keystone.service[91077]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:22:01.636322 ncdv-master-1 devstack@keystone.service[91077]: Failed validating 'maxLength' in schema['properties']['name']: Jul 02 21:22:01.636322 ncdv-master-1 devstack@keystone.service[91077]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 02 21:22:01.636322 ncdv-master-1 devstack@keystone.service[91077]: On instance['name']: Jul 02 21:22:01.636322 ncdv-master-1 devstack@keystone.service[91077]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 02 21:22:01.636322 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:22:01.636322 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 02 21:22:01.636322 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 02 21:22:01.636322 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:22:01.636322 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise error Jul 02 21:22:01.636322 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:22:01.636322 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:22:01.636322 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 02 21:22:01.636322 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 02 21:22:01.637694 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:22:01.637694 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application On instance['name']: Jul 02 21:22:01.637694 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 02 21:22:01.637694 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:22:01.637694 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:22:01.637694 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:22:01.637694 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:22:01.637694 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:22:01.637694 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:22:01.637694 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:22:01.637694 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:22:01.637694 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:22:01.637694 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:22:01.637694 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:22:01.637694 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:22:01.637694 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:22:01.637694 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:22:01.637694 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jul 02 21:22:01.639318 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jul 02 21:22:01.639318 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 02 21:22:01.639318 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 02 21:22:01.639318 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 02 21:22:01.639318 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 02 21:22:01.639318 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:22:01.639318 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:22:01.639318 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 02 21:22:01.639318 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 02 21:22:01.639318 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:22:01.639318 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application On instance['name']: Jul 02 21:22:01.639318 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 02 21:22:01.639318 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:22:01.644143 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2765/5571] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:22:01 2022] POST /identity/v3/projects => generated 412 bytes in 107 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 02 21:22:01.645605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc6cf5-2d25-4972-92a5-6d66205a7a83 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:01.650170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2e8f0b7e-1662-4c16-9b9e-01d896e51fb8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:01.653308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2e8f0b7e-1662-4c16-9b9e-01d896e51fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:01.663938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc6cf5-2d25-4972-92a5-6d66205a7a83 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:01.673783 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2807/5572] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:01.674358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae9aef-3197-4d12-bc69-0dd0b8282a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:01.675210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae9aef-3197-4d12-bc69-0dd0b8282a37 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:01.675460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f0b7e-1662-4c16-9b9e-01d896e51fb8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:01.675843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae9aef-3197-4d12-bc69-0dd0b8282a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:01.676353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae9aef-3197-4d12-bc69-0dd0b8282a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:01.677310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae9aef-3197-4d12-bc69-0dd0b8282a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:01.679282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae9aef-3197-4d12-bc69-0dd0b8282a37 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:01.681964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:01.691573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f0b7e-1662-4c16-9b9e-01d896e51fb8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:01.714308 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2766/5573] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:01.715263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae9aef-3197-4d12-bc69-0dd0b8282a37 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:01.724705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9d197-0396-4cf5-9dae-1a526c5671dc tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '366ca0649b1642b88f940d18f1d08102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9b953d4d25145e5828a31b5ff0a262e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:01.725975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9d197-0396-4cf5-9dae-1a526c5671dc tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:01.727092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9d197-0396-4cf5-9dae-1a526c5671dc tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:01.728480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9d197-0396-4cf5-9dae-1a526c5671dc tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] PATH_INFO: `/v3/projects/81ae6dab12fd4deaabdfe4be5b8f2dbc` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:01.740534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae9aef-3197-4d12-bc69-0dd0b8282a37 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:01.748022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9d197-0396-4cf5-9dae-1a526c5671dc tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] RBAC: Authorizing `identity:delete_project(project_id=81ae6dab12fd4deaabdfe4be5b8f2dbc)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:01.754752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9d197-0396-4cf5-9dae-1a526c5671dc tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:01.755761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219b2d9-f68e-4416-807d-c60cd9a5784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:01.757642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219b2d9-f68e-4416-807d-c60cd9a5784a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:01.759497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219b2d9-f68e-4416-807d-c60cd9a5784a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:01.761427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219b2d9-f68e-4416-807d-c60cd9a5784a admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:01.767643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219b2d9-f68e-4416-807d-c60cd9a5784a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:22:01.768987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219b2d9-f68e-4416-807d-c60cd9a5784a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:01.772674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219b2d9-f68e-4416-807d-c60cd9a5784a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:01.826307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-4ae9d197-0396-4cf5-9dae-1a526c5671dc tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Could not find project: 81ae6dab12fd4deaabdfe4be5b8f2dbc.: keystone.exception.ProjectNotFound: Could not find project: 81ae6dab12fd4deaabdfe4be5b8f2dbc. Jul 02 21:22:01.826307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:22:01.826307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:22:01.826307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:22:01.826307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:22:01.826307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:22:01.826307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:22:01.826307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:22:01.826307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:22:01.826307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:22:01.826307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:22:01.826307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:22:01.826307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 02 21:22:01.826307 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 02 21:22:01.827419 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:22:01.827419 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:22:01.827419 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 02 21:22:01.827419 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 02 21:22:01.827419 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:22:01.827419 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:22:01.827419 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:22:01.827419 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:22:01.827419 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 81ae6dab12fd4deaabdfe4be5b8f2dbc. Jul 02 21:22:01.827419 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:22:01.829361 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2808/5574] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:01 2022] DELETE /identity/v3/projects/81ae6dab12fd4deaabdfe4be5b8f2dbc => generated 113 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:22:01.835093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9d197-0396-4cf5-9dae-1a526c5671dc tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:01.839518 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2767/5575] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:22:01.846386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219b2d9-f68e-4416-807d-c60cd9a5784a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:01.850748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4219b2d9-f68e-4416-807d-c60cd9a5784a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:01.879815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9d197-0396-4cf5-9dae-1a526c5671dc tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:01.885482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e00e2-fd78-4278-989b-b1f54509b083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:01.887076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e00e2-fd78-4278-989b-b1f54509b083 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:01.887475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e00e2-fd78-4278-989b-b1f54509b083 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:01.888095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e00e2-fd78-4278-989b-b1f54509b083 admin admin] PATH_INFO: `/v3/projects/8a5bdceeafbb40a6be33371a3ad1b0aa/users/5261fd648c584842937fbd1c53fb53e0/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:01.930826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e00e2-fd78-4278-989b-b1f54509b083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5bdceeafbb40a6be33371a3ad1b0aa, user_id=5261fd648c584842937fbd1c53fb53e0, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:01.934794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e00e2-fd78-4278-989b-b1f54509b083 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:01.961811 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2809/5576] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:01 2022] PUT /identity/v3/projects/8a5bdceeafbb40a6be33371a3ad1b0aa/users/5261fd648c584842937fbd1c53fb53e0/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:01.963602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e00e2-fd78-4278-989b-b1f54509b083 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:01.971676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:02.019898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219b2d9-f68e-4416-807d-c60cd9a5784a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:02.121186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e00e2-fd78-4278-989b-b1f54509b083 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:02.139116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d9870-bef1-48de-8051-0419d3dd801f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:02.140413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d9870-bef1-48de-8051-0419d3dd801f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:02.140938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d9870-bef1-48de-8051-0419d3dd801f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:02.141430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d9870-bef1-48de-8051-0419d3dd801f admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:02.142474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d9870-bef1-48de-8051-0419d3dd801f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:02.150251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d9870-bef1-48de-8051-0419d3dd801f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:02.191720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02ccd1-080a-43c8-a801-525fc4369dec tempest-ProjectsNegativeStaticTestJSON-211942007 tempest-ProjectsNegativeStaticTestJSON-211942007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '364f61ca9a7c4d5999721448d30ed976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c54ea72aa57b4f47bd3edd787405847b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:02.193120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02ccd1-080a-43c8-a801-525fc4369dec tempest-ProjectsNegativeStaticTestJSON-211942007 tempest-ProjectsNegativeStaticTestJSON-211942007-project] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:02.193120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02ccd1-080a-43c8-a801-525fc4369dec tempest-ProjectsNegativeStaticTestJSON-211942007 tempest-ProjectsNegativeStaticTestJSON-211942007-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:02.193120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02ccd1-080a-43c8-a801-525fc4369dec tempest-ProjectsNegativeStaticTestJSON-211942007 tempest-ProjectsNegativeStaticTestJSON-211942007-project] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:02.193835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02ccd1-080a-43c8-a801-525fc4369dec tempest-ProjectsNegativeStaticTestJSON-211942007 tempest-ProjectsNegativeStaticTestJSON-211942007-project] RBAC: Authorizing `identity:list_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:02.201994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-dd02ccd1-080a-43c8-a801-525fc4369dec tempest-ProjectsNegativeStaticTestJSON-211942007 tempest-ProjectsNegativeStaticTestJSON-211942007-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jul 02 21:22:02.201994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:22:02.201994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:22:02.201994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:22:02.201994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:22:02.201994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:22:02.201994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:22:02.201994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:22:02.201994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:22:02.201994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:22:02.201994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:22:02.201994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:22:02.201994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Jul 02 21:22:02.201994 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._list_projects() Jul 02 21:22:02.203169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Jul 02 21:22:02.203169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Jul 02 21:22:02.203169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 02 21:22:02.203169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 02 21:22:02.203169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 02 21:22:02.203169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 02 21:22:02.203169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:22:02.203169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 02 21:22:02.203169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jul 02 21:22:02.203169 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:22:02.207747 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2768/5577] 10.222.0.43 () {58 vars in 1130 bytes} [Sat Jul 2 21:22:01 2022] GET /identity/v3/projects => generated 135 bytes in 364 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:22:02.209224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0ed42-7b7c-4a1f-b7e7-ca6ffd6eecde None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:02.209508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0ed42-7b7c-4a1f-b7e7-ca6ffd6eecde None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:02.209779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0ed42-7b7c-4a1f-b7e7-ca6ffd6eecde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:02.218758 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2810/5578] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:01 2022] POST /identity/v3/projects => generated 387 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:02.219399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d9870-bef1-48de-8051-0419d3dd801f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:02.254997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a0e0ed42-7b7c-4a1f-b7e7-ca6ffd6eecde None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:02.258154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a0e0ed42-7b7c-4a1f-b7e7-ca6ffd6eecde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:02.361161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d9870-bef1-48de-8051-0419d3dd801f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:02.373695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab969c9-592b-4c13-a082-0e8f7542b827 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '366ca0649b1642b88f940d18f1d08102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9b953d4d25145e5828a31b5ff0a262e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:02.374380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab969c9-592b-4c13-a082-0e8f7542b827 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:02.374717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab969c9-592b-4c13-a082-0e8f7542b827 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:02.374953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab969c9-592b-4c13-a082-0e8f7542b827 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:02.375690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab969c9-592b-4c13-a082-0e8f7542b827 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:02.377792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab969c9-592b-4c13-a082-0e8f7542b827 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:02.398797 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2769/5579] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:02.400759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0ed42-7b7c-4a1f-b7e7-ca6ffd6eecde None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:02.418750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0ed42-7b7c-4a1f-b7e7-ca6ffd6eecde None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:02.425595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9196522-71d7-445b-a5bf-9c965cbe2228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:02.426494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9196522-71d7-445b-a5bf-9c965cbe2228 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:02.426772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9196522-71d7-445b-a5bf-9c965cbe2228 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:02.427052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9196522-71d7-445b-a5bf-9c965cbe2228 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:02.427748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9196522-71d7-445b-a5bf-9c965cbe2228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:02.429893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9196522-71d7-445b-a5bf-9c965cbe2228 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:02.448142 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2811/5580] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:02 2022] POST /identity/v3/projects => generated 358 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:02.452850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab969c9-592b-4c13-a082-0e8f7542b827 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:02.456716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1ab969c9-592b-4c13-a082-0e8f7542b827 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:02.483592 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2770/5581] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:02 2022] POST /identity/v3/users => generated 294 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:02.491775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9196522-71d7-445b-a5bf-9c965cbe2228 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:02.518452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9196522-71d7-445b-a5bf-9c965cbe2228 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:02.590676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:02.637033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11c522-d8c2-4508-9b97-85e67d4cd7e1 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '366ca0649b1642b88f940d18f1d08102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9b953d4d25145e5828a31b5ff0a262e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:02.637819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11c522-d8c2-4508-9b97-85e67d4cd7e1 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:02.640281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11c522-d8c2-4508-9b97-85e67d4cd7e1 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:02.640757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11c522-d8c2-4508-9b97-85e67d4cd7e1 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:02.644181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11c522-d8c2-4508-9b97-85e67d4cd7e1 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:02.652359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11c522-d8c2-4508-9b97-85e67d4cd7e1 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:02.658757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab969c9-592b-4c13-a082-0e8f7542b827 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:02.688993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae2a84-3731-4ba9-8e85-46f26d1374a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:02.689685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae2a84-3731-4ba9-8e85-46f26d1374a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:02.689975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae2a84-3731-4ba9-8e85-46f26d1374a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:02.690243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae2a84-3731-4ba9-8e85-46f26d1374a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:02.691840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.sql.core [None req-ea11c522-d8c2-4508-9b97-85e67d4cd7e1 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-225903722' for key 'project.ixu_project_name_domain_id'") Jul 02 21:22:02.691840 ncdv-master-1 devstack@keystone.service[91077]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 02 21:22:02.691840 ncdv-master-1 devstack@keystone.service[91077]: [parameters: {'id': 'da2726a944fb4061bc0707134d8b2c08', 'name': 'tempest-project-dup-225903722', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 02 21:22:02.691840 ncdv-master-1 devstack@keystone.service[91077]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91077) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 02 21:22:02.727313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-ea11c522-d8c2-4508-9b97-85e67d4cd7e1 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-225903722, project id da2726a944fb4061bc0707134d8b2c08.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-225903722, project id da2726a944fb4061bc0707134d8b2c08. Jul 02 21:22:02.727313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:22:02.727313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 21:22:02.727313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 21:22:02.727313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 21:22:02.727313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 21:22:02.727313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 21:22:02.727313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 21:22:02.727313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 21:22:02.727313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application conn.query(q) Jul 02 21:22:02.727313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 21:22:02.727313 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 21:22:02.728314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 21:22:02.728314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application result.read() Jul 02 21:22:02.728314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 21:22:02.728314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 21:22:02.728314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 21:22:02.728314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 21:22:02.728314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 21:22:02.728314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 21:22:02.728314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 21:22:02.728314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 21:22:02.728314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-225903722' for key 'project.ixu_project_name_domain_id'") Jul 02 21:22:02.728314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:22:02.728314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 02 21:22:02.728314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:22:02.728314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:22:02.728314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 02 21:22:02.728314 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 02 21:22:02.729498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 02 21:22:02.729498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 02 21:22:02.729498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 21:22:02.729498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application next(self.gen) Jul 02 21:22:02.729498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 02 21:22:02.729498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application yield resource Jul 02 21:22:02.729498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 21:22:02.729498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application next(self.gen) Jul 02 21:22:02.729498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 02 21:22:02.729498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.session.rollback() Jul 02 21:22:02.729498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:22:02.729498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.force_reraise() Jul 02 21:22:02.729498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:22:02.729498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise self.value Jul 02 21:22:02.729498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 02 21:22:02.729498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 02 21:22:02.729498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 02 21:22:02.729498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application session.commit() Jul 02 21:22:02.730732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 02 21:22:02.730732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 02 21:22:02.730732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 02 21:22:02.730732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._prepare_impl() Jul 02 21:22:02.730732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 02 21:22:02.730732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.session.flush() Jul 02 21:22:02.730732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 02 21:22:02.730732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._flush(objects) Jul 02 21:22:02.730732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 02 21:22:02.730732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 02 21:22:02.730732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 02 21:22:02.730732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application compat.raise_( Jul 02 21:22:02.730732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 21:22:02.730732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception Jul 02 21:22:02.730732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 02 21:22:02.730732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application flush_context.execute() Jul 02 21:22:02.730732 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 02 21:22:02.731984 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rec.execute(self) Jul 02 21:22:02.731984 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 02 21:22:02.731984 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 02 21:22:02.731984 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 02 21:22:02.731984 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 02 21:22:02.731984 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 02 21:22:02.731984 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 02 21:22:02.731984 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 02 21:22:02.731984 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 02 21:22:02.731984 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 02 21:22:02.731984 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 02 21:22:02.731984 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 02 21:22:02.731984 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 02 21:22:02.731984 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 02 21:22:02.731984 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 02 21:22:02.731984 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 02 21:22:02.733246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 02 21:22:02.733246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 21:22:02.733246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception Jul 02 21:22:02.733246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 21:22:02.733246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 21:22:02.733246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 21:22:02.733246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 21:22:02.733246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 21:22:02.733246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 21:22:02.733246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 21:22:02.733246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application conn.query(q) Jul 02 21:22:02.733246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 21:22:02.733246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 21:22:02.733246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 21:22:02.733246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application result.read() Jul 02 21:22:02.733246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 21:22:02.733246 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 21:22:02.734476 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 21:22:02.734476 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 21:22:02.734476 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 21:22:02.734476 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 21:22:02.734476 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 21:22:02.734476 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 21:22:02.734476 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-225903722' for key 'project.ixu_project_name_domain_id'") Jul 02 21:22:02.734476 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 02 21:22:02.734476 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [parameters: {'id': 'da2726a944fb4061bc0707134d8b2c08', 'name': 'tempest-project-dup-225903722', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 02 21:22:02.734476 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 02 21:22:02.734476 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:22:02.734476 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:22:02.734476 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:22:02.734476 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:22:02.734476 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 02 21:22:02.735620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 02 21:22:02.735620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 02 21:22:02.735620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 02 21:22:02.735620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-225903722 at domain ID default. Jul 02 21:22:02.735620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:22:02.735620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:22:02.735620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:22:02.735620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:22:02.735620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:22:02.735620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:22:02.735620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:22:02.735620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:22:02.735620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:22:02.735620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:22:02.735620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:22:02.735620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:22:02.735620 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:22:02.739428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:22:02.739428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 02 21:22:02.739428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 02 21:22:02.739428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:22:02.739428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:22:02.739428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 02 21:22:02.739428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 02 21:22:02.739428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-225903722, project id da2726a944fb4061bc0707134d8b2c08. Jul 02 21:22:02.739428 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:22:02.740534 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2771/5582] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:22:02 2022] POST /identity/v3/projects => generated 284 bytes in 250 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 02 21:22:02.741727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11c522-d8c2-4508-9b97-85e67d4cd7e1 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:02.781279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:02.787431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae2a84-3731-4ba9-8e85-46f26d1374a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:02.789072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae2a84-3731-4ba9-8e85-46f26d1374a9 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:02.801303 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2812/5583] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:02.802237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae2a84-3731-4ba9-8e85-46f26d1374a9 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:02.813122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae2a84-3731-4ba9-8e85-46f26d1374a9 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:02.818991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc38c7-2b5b-4ba2-92b1-2bb6ae63d6ef tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '366ca0649b1642b88f940d18f1d08102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9b953d4d25145e5828a31b5ff0a262e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:02.820130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc38c7-2b5b-4ba2-92b1-2bb6ae63d6ef tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:02.820352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc38c7-2b5b-4ba2-92b1-2bb6ae63d6ef tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:02.820658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc38c7-2b5b-4ba2-92b1-2bb6ae63d6ef tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] PATH_INFO: `/v3/projects/c7a22410903c4c49b648741e02c379fe` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:02.821895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc38c7-2b5b-4ba2-92b1-2bb6ae63d6ef tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c7a22410903c4c49b648741e02c379fe)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:02.824130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc38c7-2b5b-4ba2-92b1-2bb6ae63d6ef tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:02.914853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b5fc38c7-2b5b-4ba2-92b1-2bb6ae63d6ef tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a22410903c4c49b648741e02c379fe', 'request_id': 'req-b5fc38c7-2b5b-4ba2-92b1-2bb6ae63d6ef'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:02.924862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11c522-d8c2-4508-9b97-85e67d4cd7e1 tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:02.932580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b5fc38c7-2b5b-4ba2-92b1-2bb6ae63d6ef tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a22410903c4c49b648741e02c379fe', 'request_id': 'req-b5fc38c7-2b5b-4ba2-92b1-2bb6ae63d6ef'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:02.941474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b5fc38c7-2b5b-4ba2-92b1-2bb6ae63d6ef tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a22410903c4c49b648741e02c379fe', 'request_id': 'req-b5fc38c7-2b5b-4ba2-92b1-2bb6ae63d6ef'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:02.971053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b5fc38c7-2b5b-4ba2-92b1-2bb6ae63d6ef tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] The token cache is being invalidate because project c7a22410903c4c49b648741e02c379fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:02.971361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b5fc38c7-2b5b-4ba2-92b1-2bb6ae63d6ef tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:02.979802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b5fc38c7-2b5b-4ba2-92b1-2bb6ae63d6ef tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:02.982241 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2813/5584] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:02 2022] DELETE /identity/v3/projects/c7a22410903c4c49b648741e02c379fe => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:02.987112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc38c7-2b5b-4ba2-92b1-2bb6ae63d6ef tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:02.988909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b5fc38c7-2b5b-4ba2-92b1-2bb6ae63d6ef tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:03.030821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5b9a5-6569-448c-b52b-399bfcbcbe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:03.031701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5b9a5-6569-448c-b52b-399bfcbcbe02 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:03.032121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5b9a5-6569-448c-b52b-399bfcbcbe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:03.032594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5b9a5-6569-448c-b52b-399bfcbcbe02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:03.033500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5b9a5-6569-448c-b52b-399bfcbcbe02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:03.036487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5b9a5-6569-448c-b52b-399bfcbcbe02 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:03.055367 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2772/5585] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:03.059258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5b9a5-6569-448c-b52b-399bfcbcbe02 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:03.064486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4da5b9a5-6569-448c-b52b-399bfcbcbe02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:03.081131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5b9a5-6569-448c-b52b-399bfcbcbe02 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:03.101436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49049227-ad24-4bec-b089-406a9024f6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:03.102227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49049227-ad24-4bec-b089-406a9024f6ab admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:03.102467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49049227-ad24-4bec-b089-406a9024f6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:03.102898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49049227-ad24-4bec-b089-406a9024f6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:03.103672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49049227-ad24-4bec-b089-406a9024f6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:03.105369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49049227-ad24-4bec-b089-406a9024f6ab admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:03.107499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc38c7-2b5b-4ba2-92b1-2bb6ae63d6ef tempest-ProjectsNegativeStaticTestJSON-1981715677 tempest-ProjectsNegativeStaticTestJSON-1981715677-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:03.117213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b751946-42be-4c38-ab18-d32acfaacc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:03.118172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b751946-42be-4c38-ab18-d32acfaacc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:03.118503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b751946-42be-4c38-ab18-d32acfaacc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:03.119118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b751946-42be-4c38-ab18-d32acfaacc48 admin admin] PATH_INFO: `/v3/users/364f61ca9a7c4d5999721448d30ed976` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:03.119515 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2773/5586] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:22:03.120965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b751946-42be-4c38-ab18-d32acfaacc48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=364f61ca9a7c4d5999721448d30ed976)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:03.123547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b751946-42be-4c38-ab18-d32acfaacc48 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:03.124101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49049227-ad24-4bec-b089-406a9024f6ab admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:03.138432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49049227-ad24-4bec-b089-406a9024f6ab admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:03.143598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:03.145858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd57ec7-b14a-4add-9984-5d5f02d57034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:03.147158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd57ec7-b14a-4add-9984-5d5f02d57034 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:03.147670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd57ec7-b14a-4add-9984-5d5f02d57034 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:03.148060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd57ec7-b14a-4add-9984-5d5f02d57034 admin admin] PATH_INFO: `/v3/projects/0864a7a288aa444e9ec351666b22f021/users/7ab4cb659e0946d8ae6e70f7d5094a43/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:03.173871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd57ec7-b14a-4add-9984-5d5f02d57034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0864a7a288aa444e9ec351666b22f021, user_id=7ab4cb659e0946d8ae6e70f7d5094a43, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:03.176731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd57ec7-b14a-4add-9984-5d5f02d57034 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:03.198084 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2774/5587] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:03 2022] PUT /identity/v3/projects/0864a7a288aa444e9ec351666b22f021/users/7ab4cb659e0946d8ae6e70f7d5094a43/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:22:03.203507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2b751946-42be-4c38-ab18-d32acfaacc48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '364f61ca9a7c4d5999721448d30ed976'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:03.209638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084893b-8a03-4160-a3d1-0a3778265388 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:03.210779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084893b-8a03-4160-a3d1-0a3778265388 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:03.211367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084893b-8a03-4160-a3d1-0a3778265388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:03.216595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2b751946-42be-4c38-ab18-d32acfaacc48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '364f61ca9a7c4d5999721448d30ed976'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:03.217518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2b751946-42be-4c38-ab18-d32acfaacc48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '364f61ca9a7c4d5999721448d30ed976'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:03.218389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2b751946-42be-4c38-ab18-d32acfaacc48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '364f61ca9a7c4d5999721448d30ed976'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:03.232933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2b751946-42be-4c38-ab18-d32acfaacc48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '364f61ca9a7c4d5999721448d30ed976'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:03.252849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0084893b-8a03-4160-a3d1-0a3778265388 None None] MFA Rules not processed for user `7ab4cb659e0946d8ae6e70f7d5094a43`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:03.254484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0084893b-8a03-4160-a3d1-0a3778265388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:03.264206 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2814/5588] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:02 2022] DELETE /identity/v3/users/364f61ca9a7c4d5999721448d30ed976 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:22:03.269222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d83d0-6726-4f1a-869b-defbf5343a30 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:03.269602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d83d0-6726-4f1a-869b-defbf5343a30 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:03.270400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d83d0-6726-4f1a-869b-defbf5343a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:03.305364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3c3d83d0-6726-4f1a-869b-defbf5343a30 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:03.306872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3c3d83d0-6726-4f1a-869b-defbf5343a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:03.390841 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2815/5589] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:03.397202 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2775/5590] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:22:03.402887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d83d0-6726-4f1a-869b-defbf5343a30 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:03.404752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3c3d83d0-6726-4f1a-869b-defbf5343a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:03.418305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d83d0-6726-4f1a-869b-defbf5343a30 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:03.424779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fe9a2-8b4f-4481-9460-fb9218e6fdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:03.425863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fe9a2-8b4f-4481-9460-fb9218e6fdad admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:03.426360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fe9a2-8b4f-4481-9460-fb9218e6fdad admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:03.426944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fe9a2-8b4f-4481-9460-fb9218e6fdad admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:03.427890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fe9a2-8b4f-4481-9460-fb9218e6fdad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:03.430295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fe9a2-8b4f-4481-9460-fb9218e6fdad admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:03.463130 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2816/5591] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:03 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:22:03.467507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084893b-8a03-4160-a3d1-0a3778265388 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:03.479611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:03.548991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084893b-8a03-4160-a3d1-0a3778265388 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:03.616003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042711e-a178-4289-a00a-5302d32c5845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:03.617086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042711e-a178-4289-a00a-5302d32c5845 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:03.617470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042711e-a178-4289-a00a-5302d32c5845 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:03.617876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042711e-a178-4289-a00a-5302d32c5845 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:03.618715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042711e-a178-4289-a00a-5302d32c5845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:03.620876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042711e-a178-4289-a00a-5302d32c5845 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:03.649577 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2776/5592] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:03 2022] POST /identity/v3/users => generated 300 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:22:03.650849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fe9a2-8b4f-4481-9460-fb9218e6fdad admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:03.662720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fe9a2-8b4f-4481-9460-fb9218e6fdad admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:03.668063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80cc59-ae75-4493-a838-05d795da2607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:03.668880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80cc59-ae75-4493-a838-05d795da2607 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:03.669256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80cc59-ae75-4493-a838-05d795da2607 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:03.669633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80cc59-ae75-4493-a838-05d795da2607 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:03.670474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80cc59-ae75-4493-a838-05d795da2607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:03.672619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80cc59-ae75-4493-a838-05d795da2607 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:03.685838 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2817/5593] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:03.689889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042711e-a178-4289-a00a-5302d32c5845 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:03.702277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042711e-a178-4289-a00a-5302d32c5845 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:03.708788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a3cff-e5d4-4ee2-8b82-6f8858f07c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:03.709740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a3cff-e5d4-4ee2-8b82-6f8858f07c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:03.710021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a3cff-e5d4-4ee2-8b82-6f8858f07c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:03.710295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a3cff-e5d4-4ee2-8b82-6f8858f07c2c admin admin] PATH_INFO: `/v3/projects/cf7cb7eb4aeb415c95135bb40c8b1039/users/2da47ef83867443daa2504ec432c493a/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:03.726992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a3cff-e5d4-4ee2-8b82-6f8858f07c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7cb7eb4aeb415c95135bb40c8b1039, user_id=2da47ef83867443daa2504ec432c493a, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:03.729892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a3cff-e5d4-4ee2-8b82-6f8858f07c2c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:03.745446 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2777/5594] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:03 2022] PUT /identity/v3/projects/cf7cb7eb4aeb415c95135bb40c8b1039/users/2da47ef83867443daa2504ec432c493a/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:03.757648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecf3c4-92a1-48b4-be5d-fdf3348517f3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:03.758363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecf3c4-92a1-48b4-be5d-fdf3348517f3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:03.758819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecf3c4-92a1-48b4-be5d-fdf3348517f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:03.779286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a3cff-e5d4-4ee2-8b82-6f8858f07c2c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:03.781385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-336a3cff-e5d4-4ee2-8b82-6f8858f07c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:03.792206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-55ecf3c4-92a1-48b4-be5d-fdf3348517f3 None None] MFA Rules not processed for user `2da47ef83867443daa2504ec432c493a`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:03.793491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-55ecf3c4-92a1-48b4-be5d-fdf3348517f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:03.882955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:03.889634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a3cff-e5d4-4ee2-8b82-6f8858f07c2c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:03.894205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2a3ae-6176-4437-8dab-19affcdbf458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:03.894909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2a3ae-6176-4437-8dab-19affcdbf458 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:03.895346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2a3ae-6176-4437-8dab-19affcdbf458 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:03.895640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2a3ae-6176-4437-8dab-19affcdbf458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:03.922730 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2818/5595] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:03 2022] POST /identity/v3/auth/tokens => generated 3259 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:03.953258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:03.966578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecf3c4-92a1-48b4-be5d-fdf3348517f3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:03.968700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-55ecf3c4-92a1-48b4-be5d-fdf3348517f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:03.999368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2a3ae-6176-4437-8dab-19affcdbf458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:04.001719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2a3ae-6176-4437-8dab-19affcdbf458 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:04.018280 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2778/5596] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:22:04.057812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecf3c4-92a1-48b4-be5d-fdf3348517f3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:04.066663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ea19f-d580-411b-9126-9425755cea27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:04.067641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ea19f-d580-411b-9126-9425755cea27 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:04.068147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ea19f-d580-411b-9126-9425755cea27 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:04.068705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ea19f-d580-411b-9126-9425755cea27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:04.105483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ea19f-d580-411b-9126-9425755cea27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:04.107165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ea19f-d580-411b-9126-9425755cea27 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:04.119829 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2819/5597] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:22:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 02 21:22:04.670110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2a3ae-6176-4437-8dab-19affcdbf458 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:04.671943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d4f2a3ae-6176-4437-8dab-19affcdbf458 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:04.694396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2a3ae-6176-4437-8dab-19affcdbf458 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:04.701616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefd14b-3f85-49f9-8acd-0bd1eb89d08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:04.702929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefd14b-3f85-49f9-8acd-0bd1eb89d08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:04.703459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefd14b-3f85-49f9-8acd-0bd1eb89d08f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:04.703830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefd14b-3f85-49f9-8acd-0bd1eb89d08f admin admin] PATH_INFO: `/v3/projects/c54ea72aa57b4f47bd3edd787405847b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:04.705350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefd14b-3f85-49f9-8acd-0bd1eb89d08f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54ea72aa57b4f47bd3edd787405847b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:04.725679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefd14b-3f85-49f9-8acd-0bd1eb89d08f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:04.841528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ceefd14b-3f85-49f9-8acd-0bd1eb89d08f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54ea72aa57b4f47bd3edd787405847b', 'request_id': 'req-ceefd14b-3f85-49f9-8acd-0bd1eb89d08f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:04.863945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ceefd14b-3f85-49f9-8acd-0bd1eb89d08f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54ea72aa57b4f47bd3edd787405847b', 'request_id': 'req-ceefd14b-3f85-49f9-8acd-0bd1eb89d08f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:04.882377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ceefd14b-3f85-49f9-8acd-0bd1eb89d08f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54ea72aa57b4f47bd3edd787405847b', 'request_id': 'req-ceefd14b-3f85-49f9-8acd-0bd1eb89d08f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:04.913630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ceefd14b-3f85-49f9-8acd-0bd1eb89d08f admin admin] The token cache is being invalidate because project c54ea72aa57b4f47bd3edd787405847b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:04.914033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ceefd14b-3f85-49f9-8acd-0bd1eb89d08f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:04.914988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ceefd14b-3f85-49f9-8acd-0bd1eb89d08f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:04.918449 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2779/5598] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:04 2022] DELETE /identity/v3/projects/c54ea72aa57b4f47bd3edd787405847b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:04.921738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ea19f-d580-411b-9126-9425755cea27 service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:04.935272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ea19f-d580-411b-9126-9425755cea27 service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:05.106659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88f051-6db7-456c-9e12-1553e83f29be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:05.108973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88f051-6db7-456c-9e12-1553e83f29be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:05.109649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88f051-6db7-456c-9e12-1553e83f29be admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:05.110224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88f051-6db7-456c-9e12-1553e83f29be admin admin] PATH_INFO: `/v3/users/366ca0649b1642b88f940d18f1d08102` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:05.124584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88f051-6db7-456c-9e12-1553e83f29be admin admin] RBAC: Authorizing `identity:delete_user(user_id=366ca0649b1642b88f940d18f1d08102)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:05.130106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88f051-6db7-456c-9e12-1553e83f29be admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:05.258682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefd14b-3f85-49f9-8acd-0bd1eb89d08f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:05.261892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ceefd14b-3f85-49f9-8acd-0bd1eb89d08f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:05.273874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6d88f051-6db7-456c-9e12-1553e83f29be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366ca0649b1642b88f940d18f1d08102'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:05.293376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6d88f051-6db7-456c-9e12-1553e83f29be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366ca0649b1642b88f940d18f1d08102'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:05.294419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6d88f051-6db7-456c-9e12-1553e83f29be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366ca0649b1642b88f940d18f1d08102'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:05.295390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6d88f051-6db7-456c-9e12-1553e83f29be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366ca0649b1642b88f940d18f1d08102'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:05.301824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefd14b-3f85-49f9-8acd-0bd1eb89d08f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:05.319183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6d88f051-6db7-456c-9e12-1553e83f29be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366ca0649b1642b88f940d18f1d08102'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:05.321019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42692f5b-0299-40e6-954b-96b901708f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:05.323096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42692f5b-0299-40e6-954b-96b901708f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:05.325451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42692f5b-0299-40e6-954b-96b901708f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:05.326002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42692f5b-0299-40e6-954b-96b901708f1b admin admin] PATH_INFO: `/v3/users/7ab4cb659e0946d8ae6e70f7d5094a43` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:05.332494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42692f5b-0299-40e6-954b-96b901708f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab4cb659e0946d8ae6e70f7d5094a43)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:05.337815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42692f5b-0299-40e6-954b-96b901708f1b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:05.352030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:05.376839 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2820/5599] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:04 2022] DELETE /identity/v3/users/366ca0649b1642b88f940d18f1d08102 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:05.426855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-42692f5b-0299-40e6-954b-96b901708f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab4cb659e0946d8ae6e70f7d5094a43'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:05.476407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-42692f5b-0299-40e6-954b-96b901708f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab4cb659e0946d8ae6e70f7d5094a43'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:05.500084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-42692f5b-0299-40e6-954b-96b901708f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab4cb659e0946d8ae6e70f7d5094a43'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:05.500836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-42692f5b-0299-40e6-954b-96b901708f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab4cb659e0946d8ae6e70f7d5094a43'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:05.501856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-42692f5b-0299-40e6-954b-96b901708f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab4cb659e0946d8ae6e70f7d5094a43'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:05.529424 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2780/5600] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:05 2022] DELETE /identity/v3/users/7ab4cb659e0946d8ae6e70f7d5094a43 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:05.534490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b12a65-4b3e-4816-ab90-0822f2fc8d58 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:05.535118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b12a65-4b3e-4816-ab90-0822f2fc8d58 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:05.535614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b12a65-4b3e-4816-ab90-0822f2fc8d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:05.555804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-28b12a65-4b3e-4816-ab90-0822f2fc8d58 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:05.557646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-28b12a65-4b3e-4816-ab90-0822f2fc8d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:05.666655 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2821/5601] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:05.698293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42692f5b-0299-40e6-954b-96b901708f1b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:05.700785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-42692f5b-0299-40e6-954b-96b901708f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:05.833446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:05.913406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42692f5b-0299-40e6-954b-96b901708f1b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:05.925894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bedcaa-0e59-48e5-a7b1-0207f948f8af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:05.926578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bedcaa-0e59-48e5-a7b1-0207f948f8af service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:05.926955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bedcaa-0e59-48e5-a7b1-0207f948f8af service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:05.927254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bedcaa-0e59-48e5-a7b1-0207f948f8af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:05.952544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bedcaa-0e59-48e5-a7b1-0207f948f8af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:05.956084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bedcaa-0e59-48e5-a7b1-0207f948f8af service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:05.974810 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2781/5602] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:07.290412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b12a65-4b3e-4816-ab90-0822f2fc8d58 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:07.291903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-28b12a65-4b3e-4816-ab90-0822f2fc8d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:07.314354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b12a65-4b3e-4816-ab90-0822f2fc8d58 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:07.320747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54d6cc-ae9d-4ada-9b23-8ba8f6424556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:07.322492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54d6cc-ae9d-4ada-9b23-8ba8f6424556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:07.322937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54d6cc-ae9d-4ada-9b23-8ba8f6424556 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:07.324991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54d6cc-ae9d-4ada-9b23-8ba8f6424556 admin admin] PATH_INFO: `/v3/projects/f9b953d4d25145e5828a31b5ff0a262e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:07.327876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54d6cc-ae9d-4ada-9b23-8ba8f6424556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9b953d4d25145e5828a31b5ff0a262e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:07.332164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54d6cc-ae9d-4ada-9b23-8ba8f6424556 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:07.442246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5b54d6cc-ae9d-4ada-9b23-8ba8f6424556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9b953d4d25145e5828a31b5ff0a262e', 'request_id': 'req-5b54d6cc-ae9d-4ada-9b23-8ba8f6424556'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:07.463290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5b54d6cc-ae9d-4ada-9b23-8ba8f6424556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9b953d4d25145e5828a31b5ff0a262e', 'request_id': 'req-5b54d6cc-ae9d-4ada-9b23-8ba8f6424556'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:07.473088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5b54d6cc-ae9d-4ada-9b23-8ba8f6424556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9b953d4d25145e5828a31b5ff0a262e', 'request_id': 'req-5b54d6cc-ae9d-4ada-9b23-8ba8f6424556'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:07.492858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5b54d6cc-ae9d-4ada-9b23-8ba8f6424556 admin admin] The token cache is being invalidate because project f9b953d4d25145e5828a31b5ff0a262e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:07.493192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5b54d6cc-ae9d-4ada-9b23-8ba8f6424556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:07.494606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5b54d6cc-ae9d-4ada-9b23-8ba8f6424556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:07.498637 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2822/5603] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:07 2022] DELETE /identity/v3/projects/f9b953d4d25145e5828a31b5ff0a262e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:07.507257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6147783-4f98-43f1-93d0-8671520553e7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:07.512516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6147783-4f98-43f1-93d0-8671520553e7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:07.514112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6147783-4f98-43f1-93d0-8671520553e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:07.559597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b6147783-4f98-43f1-93d0-8671520553e7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:07.560889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b6147783-4f98-43f1-93d0-8671520553e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:07.681720 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2782/5604] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:07.689250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff42cc9-2bc4-47ea-b408-9ad50e9ab647 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:07.689886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff42cc9-2bc4-47ea-b408-9ad50e9ab647 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:07.690451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff42cc9-2bc4-47ea-b408-9ad50e9ab647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:07.721134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-aff42cc9-2bc4-47ea-b408-9ad50e9ab647 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:07.725983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-aff42cc9-2bc4-47ea-b408-9ad50e9ab647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:07.739604 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2823/5605] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:07.746502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6147783-4f98-43f1-93d0-8671520553e7 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:07.763081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6147783-4f98-43f1-93d0-8671520553e7 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:07.770471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20190007-3a09-4a99-9dc3-57a40e5cf60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:07.771576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20190007-3a09-4a99-9dc3-57a40e5cf60b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:07.771931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20190007-3a09-4a99-9dc3-57a40e5cf60b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:07.772450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20190007-3a09-4a99-9dc3-57a40e5cf60b admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:07.774636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20190007-3a09-4a99-9dc3-57a40e5cf60b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:22:07.775217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20190007-3a09-4a99-9dc3-57a40e5cf60b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:07.777819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20190007-3a09-4a99-9dc3-57a40e5cf60b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:07.822371 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2783/5606] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:22:07.825641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff42cc9-2bc4-47ea-b408-9ad50e9ab647 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:07.842594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff42cc9-2bc4-47ea-b408-9ad50e9ab647 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:07.851427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be2b68-9415-44d1-b550-5a83ff33ba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:07.852199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be2b68-9415-44d1-b550-5a83ff33ba54 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:07.852488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be2b68-9415-44d1-b550-5a83ff33ba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:07.852770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be2b68-9415-44d1-b550-5a83ff33ba54 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:07.853482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be2b68-9415-44d1-b550-5a83ff33ba54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:07.855445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be2b68-9415-44d1-b550-5a83ff33ba54 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:07.916269 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2824/5607] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:07 2022] POST /identity/v3/projects => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:07.925413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20190007-3a09-4a99-9dc3-57a40e5cf60b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:07.946600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20190007-3a09-4a99-9dc3-57a40e5cf60b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:08.159242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f6d3e-122e-41b5-95d2-c845dafe1d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:08.161547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f6d3e-122e-41b5-95d2-c845dafe1d20 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:08.164403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f6d3e-122e-41b5-95d2-c845dafe1d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:08.165882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f6d3e-122e-41b5-95d2-c845dafe1d20 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:08.166764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f6d3e-122e-41b5-95d2-c845dafe1d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:08.170300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f6d3e-122e-41b5-95d2-c845dafe1d20 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:08.221628 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2784/5608] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:07 2022] POST /identity/v3/users => generated 284 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:08.225839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be2b68-9415-44d1-b550-5a83ff33ba54 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:08.242673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be2b68-9415-44d1-b550-5a83ff33ba54 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:08.248166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fdba1-45a3-42c0-a861-19a17093f635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:08.248891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fdba1-45a3-42c0-a861-19a17093f635 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:08.249324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fdba1-45a3-42c0-a861-19a17093f635 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:08.249610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fdba1-45a3-42c0-a861-19a17093f635 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:08.250369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fdba1-45a3-42c0-a861-19a17093f635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:08.252139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fdba1-45a3-42c0-a861-19a17093f635 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:08.279844 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2825/5609] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:08.290932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f6d3e-122e-41b5-95d2-c845dafe1d20 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:08.310669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f6d3e-122e-41b5-95d2-c845dafe1d20 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:08.325835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5e9d2-ca7a-4a37-b779-380179099dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:08.326636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5e9d2-ca7a-4a37-b779-380179099dcc admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:08.326990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5e9d2-ca7a-4a37-b779-380179099dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:08.327334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5e9d2-ca7a-4a37-b779-380179099dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:08.328190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5e9d2-ca7a-4a37-b779-380179099dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:08.330670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5e9d2-ca7a-4a37-b779-380179099dcc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:08.356643 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2785/5610] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:22:08.360795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fdba1-45a3-42c0-a861-19a17093f635 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:08.376809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fdba1-45a3-42c0-a861-19a17093f635 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:08.383625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46e39a-d7a4-4acf-8611-eadbaff746fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:08.385030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46e39a-d7a4-4acf-8611-eadbaff746fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:08.386665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46e39a-d7a4-4acf-8611-eadbaff746fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:08.387204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46e39a-d7a4-4acf-8611-eadbaff746fc admin admin] PATH_INFO: `/v3/projects/7f6f92c7f681492f99b42e064515f34c/users/e5a263f491d24635bf8ff145d8631448/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:08.410341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46e39a-d7a4-4acf-8611-eadbaff746fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f6f92c7f681492f99b42e064515f34c, user_id=e5a263f491d24635bf8ff145d8631448, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:08.415443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46e39a-d7a4-4acf-8611-eadbaff746fc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:08.436993 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2826/5611] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:08 2022] PUT /identity/v3/projects/7f6f92c7f681492f99b42e064515f34c/users/e5a263f491d24635bf8ff145d8631448/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:22:08.447983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c18f2b-8ca5-40dd-9453-675e29f245fb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:08.448404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c18f2b-8ca5-40dd-9453-675e29f245fb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:08.448688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c18f2b-8ca5-40dd-9453-675e29f245fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:08.487201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46e39a-d7a4-4acf-8611-eadbaff746fc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:08.488183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-06c18f2b-8ca5-40dd-9453-675e29f245fb None None] MFA Rules not processed for user `e5a263f491d24635bf8ff145d8631448`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:08.489422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ab46e39a-d7a4-4acf-8611-eadbaff746fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:08.490228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-06c18f2b-8ca5-40dd-9453-675e29f245fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:08.512798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:08.521646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:08.653120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46e39a-d7a4-4acf-8611-eadbaff746fc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:08.657222 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2786/5612] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:08.661558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c18f2b-8ca5-40dd-9453-675e29f245fb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:08.666155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc922762-ec66-4a30-9830-2fd6654753ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:08.667311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc922762-ec66-4a30-9830-2fd6654753ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:08.667652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc922762-ec66-4a30-9830-2fd6654753ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:08.667996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc922762-ec66-4a30-9830-2fd6654753ca admin admin] PATH_INFO: `/v3/projects/0864a7a288aa444e9ec351666b22f021` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:08.672085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc922762-ec66-4a30-9830-2fd6654753ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0864a7a288aa444e9ec351666b22f021)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:08.676491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc922762-ec66-4a30-9830-2fd6654753ca admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:08.677763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c18f2b-8ca5-40dd-9453-675e29f245fb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:08.684375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e892e-9f93-4221-a10e-cdb54880670d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:08.693482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e892e-9f93-4221-a10e-cdb54880670d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:08.694480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e892e-9f93-4221-a10e-cdb54880670d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:08.694950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e892e-9f93-4221-a10e-cdb54880670d admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:08.696071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e892e-9f93-4221-a10e-cdb54880670d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:08.698595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e892e-9f93-4221-a10e-cdb54880670d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:08.760462 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2787/5613] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:08 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:22:08.765767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e892e-9f93-4221-a10e-cdb54880670d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:08.779792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bc922762-ec66-4a30-9830-2fd6654753ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0864a7a288aa444e9ec351666b22f021', 'request_id': 'req-bc922762-ec66-4a30-9830-2fd6654753ca'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:08.801170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bc922762-ec66-4a30-9830-2fd6654753ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0864a7a288aa444e9ec351666b22f021', 'request_id': 'req-bc922762-ec66-4a30-9830-2fd6654753ca'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:08.813200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bc922762-ec66-4a30-9830-2fd6654753ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0864a7a288aa444e9ec351666b22f021', 'request_id': 'req-bc922762-ec66-4a30-9830-2fd6654753ca'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:08.832291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bc922762-ec66-4a30-9830-2fd6654753ca admin admin] The token cache is being invalidate because project 0864a7a288aa444e9ec351666b22f021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:08.832684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bc922762-ec66-4a30-9830-2fd6654753ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:08.833705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bc922762-ec66-4a30-9830-2fd6654753ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:08.839427 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2827/5614] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:08 2022] DELETE /identity/v3/projects/0864a7a288aa444e9ec351666b22f021 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:08.840331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc922762-ec66-4a30-9830-2fd6654753ca admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:08.841870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bc922762-ec66-4a30-9830-2fd6654753ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:08.886091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e892e-9f93-4221-a10e-cdb54880670d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:08.892163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5f027-c90e-4a0f-a5c2-9ff08fbbec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:08.893023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5f027-c90e-4a0f-a5c2-9ff08fbbec29 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:08.893311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5f027-c90e-4a0f-a5c2-9ff08fbbec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:08.893587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5f027-c90e-4a0f-a5c2-9ff08fbbec29 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:08.894440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5f027-c90e-4a0f-a5c2-9ff08fbbec29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:08.896842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5f027-c90e-4a0f-a5c2-9ff08fbbec29 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:08.939745 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2788/5615] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:08 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:08.941750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5f027-c90e-4a0f-a5c2-9ff08fbbec29 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:08.945234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-66f5f027-c90e-4a0f-a5c2-9ff08fbbec29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:08.988471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5f027-c90e-4a0f-a5c2-9ff08fbbec29 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:08.994856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1a716-555f-4653-b765-834760728df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:08.995777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1a716-555f-4653-b765-834760728df3 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:08.996321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1a716-555f-4653-b765-834760728df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:08.996784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1a716-555f-4653-b765-834760728df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:08.997667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1a716-555f-4653-b765-834760728df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:08.999643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1a716-555f-4653-b765-834760728df3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:09.008645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc922762-ec66-4a30-9830-2fd6654753ca admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:09.017774 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2789/5616] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:09.020935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6aaba-32ee-4b18-ba74-db4bdd5b25db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:09.023534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6aaba-32ee-4b18-ba74-db4bdd5b25db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:09.023997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6aaba-32ee-4b18-ba74-db4bdd5b25db admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:09.024361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1a716-555f-4653-b765-834760728df3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:09.025357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6aaba-32ee-4b18-ba74-db4bdd5b25db admin admin] PATH_INFO: `/v3/users/2da47ef83867443daa2504ec432c493a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:09.027302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6aaba-32ee-4b18-ba74-db4bdd5b25db admin admin] RBAC: Authorizing `identity:delete_user(user_id=2da47ef83867443daa2504ec432c493a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:09.034328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6aaba-32ee-4b18-ba74-db4bdd5b25db admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:09.048338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1a716-555f-4653-b765-834760728df3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:09.060499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114b71e-8441-4c30-a025-ed1bf6bcda86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:09.063465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114b71e-8441-4c30-a025-ed1bf6bcda86 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:09.065144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114b71e-8441-4c30-a025-ed1bf6bcda86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:09.066021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114b71e-8441-4c30-a025-ed1bf6bcda86 admin admin] PATH_INFO: `/v3/projects/6c779d1441ce4cd7b0c8e16e80cfa655/users/240e55220fb84a38beb218d79b68c8e2/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:09.106253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114b71e-8441-4c30-a025-ed1bf6bcda86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c779d1441ce4cd7b0c8e16e80cfa655, user_id=240e55220fb84a38beb218d79b68c8e2, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:09.115440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114b71e-8441-4c30-a025-ed1bf6bcda86 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:09.169790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:09.177032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88c6aaba-32ee-4b18-ba74-db4bdd5b25db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2da47ef83867443daa2504ec432c493a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:09.191358 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2790/5617] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:09 2022] PUT /identity/v3/projects/6c779d1441ce4cd7b0c8e16e80cfa655/users/240e55220fb84a38beb218d79b68c8e2/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:09.197038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114b71e-8441-4c30-a025-ed1bf6bcda86 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:09.213332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88c6aaba-32ee-4b18-ba74-db4bdd5b25db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2da47ef83867443daa2504ec432c493a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:09.214585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88c6aaba-32ee-4b18-ba74-db4bdd5b25db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2da47ef83867443daa2504ec432c493a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:09.216656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88c6aaba-32ee-4b18-ba74-db4bdd5b25db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2da47ef83867443daa2504ec432c493a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:09.258963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88c6aaba-32ee-4b18-ba74-db4bdd5b25db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2da47ef83867443daa2504ec432c493a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:09.302003 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2828/5618] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:08 2022] DELETE /identity/v3/users/2da47ef83867443daa2504ec432c493a => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:09.351962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:09.358117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114b71e-8441-4c30-a025-ed1bf6bcda86 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:09.481638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec7162-8d73-413f-a2b5-8edd43761169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:09.483241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec7162-8d73-413f-a2b5-8edd43761169 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:09.483832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec7162-8d73-413f-a2b5-8edd43761169 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:09.484219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec7162-8d73-413f-a2b5-8edd43761169 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:09.485960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec7162-8d73-413f-a2b5-8edd43761169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:09.488687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec7162-8d73-413f-a2b5-8edd43761169 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:09.506684 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2791/5619] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:09.512207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6aaba-32ee-4b18-ba74-db4bdd5b25db admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:09.514235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-88c6aaba-32ee-4b18-ba74-db4bdd5b25db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:09.531372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6aaba-32ee-4b18-ba74-db4bdd5b25db admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:09.539615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d5677-50b4-410d-9a14-926e63feac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:09.541052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d5677-50b4-410d-9a14-926e63feac99 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:09.542025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d5677-50b4-410d-9a14-926e63feac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:09.542499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d5677-50b4-410d-9a14-926e63feac99 admin admin] PATH_INFO: `/v3/projects/6c779d1441ce4cd7b0c8e16e80cfa655/users/240e55220fb84a38beb218d79b68c8e2/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:09.547219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d5677-50b4-410d-9a14-926e63feac99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c779d1441ce4cd7b0c8e16e80cfa655, user_id=240e55220fb84a38beb218d79b68c8e2, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:09.553306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d5677-50b4-410d-9a14-926e63feac99 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:09.570013 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2829/5620] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:09 2022] PUT /identity/v3/projects/6c779d1441ce4cd7b0c8e16e80cfa655/users/240e55220fb84a38beb218d79b68c8e2/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:09.582400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c2972-3b0b-48e3-a80a-91948f33f343 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:09.583013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c2972-3b0b-48e3-a80a-91948f33f343 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:09.583115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c2972-3b0b-48e3-a80a-91948f33f343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:09.616927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-791c2972-3b0b-48e3-a80a-91948f33f343 None None] MFA Rules not processed for user `240e55220fb84a38beb218d79b68c8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:09.618758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-791c2972-3b0b-48e3-a80a-91948f33f343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:09.711327 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2792/5621] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:22:09.717212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d5677-50b4-410d-9a14-926e63feac99 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:09.736684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d5677-50b4-410d-9a14-926e63feac99 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:09.753422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47048acd-7114-48a9-b167-ea025676f23f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240e55220fb84a38beb218d79b68c8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c779d1441ce4cd7b0c8e16e80cfa655', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:09.754123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47048acd-7114-48a9-b167-ea025676f23f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:09.754414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47048acd-7114-48a9-b167-ea025676f23f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:09.754695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47048acd-7114-48a9-b167-ea025676f23f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:09.760779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47048acd-7114-48a9-b167-ea025676f23f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:09.763002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47048acd-7114-48a9-b167-ea025676f23f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:09.793570 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2830/5622] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:22:09 2022] POST /identity/v3/services => generated 240 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:09.797746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c2972-3b0b-48e3-a80a-91948f33f343 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:09.808582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c2972-3b0b-48e3-a80a-91948f33f343 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:09.830337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f8c04-6307-4114-91bb-4402bfe2e40b tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240e55220fb84a38beb218d79b68c8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c779d1441ce4cd7b0c8e16e80cfa655', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:09.831992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f8c04-6307-4114-91bb-4402bfe2e40b tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:09.836201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f8c04-6307-4114-91bb-4402bfe2e40b tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:09.836719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f8c04-6307-4114-91bb-4402bfe2e40b tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] PATH_INFO: `/v3/services/be8c3b68010540d1b5e980dd0e93e199` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:09.837560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f8c04-6307-4114-91bb-4402bfe2e40b tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorizing `identity:delete_service(service_id=be8c3b68010540d1b5e980dd0e93e199)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:09.839794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f8c04-6307-4114-91bb-4402bfe2e40b tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:09.898602 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2793/5623] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:09 2022] DELETE /identity/v3/services/be8c3b68010540d1b5e980dd0e93e199 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:09.899881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47048acd-7114-48a9-b167-ea025676f23f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:09.912136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47048acd-7114-48a9-b167-ea025676f23f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:09.948238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fab2d-ecdf-45ec-9623-ccbdee7920c5 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240e55220fb84a38beb218d79b68c8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c779d1441ce4cd7b0c8e16e80cfa655', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:09.949091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fab2d-ecdf-45ec-9623-ccbdee7920c5 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:09.949380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fab2d-ecdf-45ec-9623-ccbdee7920c5 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:09.949663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fab2d-ecdf-45ec-9623-ccbdee7920c5 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:09.950763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fab2d-ecdf-45ec-9623-ccbdee7920c5 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:09.953395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fab2d-ecdf-45ec-9623-ccbdee7920c5 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:09.989613 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2831/5624] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:09 2022] POST /identity/v3/services => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:09.991676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f8c04-6307-4114-91bb-4402bfe2e40b tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:10.007612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f8c04-6307-4114-91bb-4402bfe2e40b tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:10.030671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8872a6-edee-4a54-a965-aa07be6e1df4 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240e55220fb84a38beb218d79b68c8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c779d1441ce4cd7b0c8e16e80cfa655', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:10.031917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8872a6-edee-4a54-a965-aa07be6e1df4 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:10.032455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8872a6-edee-4a54-a965-aa07be6e1df4 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:10.032948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8872a6-edee-4a54-a965-aa07be6e1df4 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] PATH_INFO: `/v3/services/861558ac88c34805abe4d6c894557b19` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:10.034813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8872a6-edee-4a54-a965-aa07be6e1df4 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorizing `identity:update_service(service_id=861558ac88c34805abe4d6c894557b19)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:10.039250 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-3d8872a6-edee-4a54-a965-aa07be6e1df4 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:22:10.039250 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:22:10.039250 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:22:10.041079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8872a6-edee-4a54-a965-aa07be6e1df4 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:10.078812 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2794/5625] 10.222.0.43 () {60 vars in 1251 bytes} [Sat Jul 2 21:22:09 2022] PATCH /identity/v3/services/861558ac88c34805abe4d6c894557b19 => generated 282 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:22:10.082100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fab2d-ecdf-45ec-9623-ccbdee7920c5 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:10.105539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fab2d-ecdf-45ec-9623-ccbdee7920c5 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:10.129849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda3002-8b90-4787-bda7-8a885db72401 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240e55220fb84a38beb218d79b68c8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c779d1441ce4cd7b0c8e16e80cfa655', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:10.131018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda3002-8b90-4787-bda7-8a885db72401 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:10.131344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda3002-8b90-4787-bda7-8a885db72401 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:10.131678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda3002-8b90-4787-bda7-8a885db72401 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] PATH_INFO: `/v3/services/861558ac88c34805abe4d6c894557b19` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:10.132402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda3002-8b90-4787-bda7-8a885db72401 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorizing `identity:get_service(service_id=861558ac88c34805abe4d6c894557b19)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:10.134361 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-0bda3002-8b90-4787-bda7-8a885db72401 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:22:10.134361 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:22:10.134361 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:22:10.135508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda3002-8b90-4787-bda7-8a885db72401 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:10.153707 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2832/5626] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:22:10 2022] GET /identity/v3/services/861558ac88c34805abe4d6c894557b19 => generated 282 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:22:10.157981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8872a6-edee-4a54-a965-aa07be6e1df4 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:10.173216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8872a6-edee-4a54-a965-aa07be6e1df4 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:10.180861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e69bb8-b955-476f-abad-d7119ce03255 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240e55220fb84a38beb218d79b68c8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c779d1441ce4cd7b0c8e16e80cfa655', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:10.181901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e69bb8-b955-476f-abad-d7119ce03255 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:10.182730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e69bb8-b955-476f-abad-d7119ce03255 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:10.183133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e69bb8-b955-476f-abad-d7119ce03255 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] PATH_INFO: `/v3/services/861558ac88c34805abe4d6c894557b19` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:10.184804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e69bb8-b955-476f-abad-d7119ce03255 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorizing `identity:delete_service(service_id=861558ac88c34805abe4d6c894557b19)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:10.187205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e69bb8-b955-476f-abad-d7119ce03255 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:10.225189 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2795/5627] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:10 2022] DELETE /identity/v3/services/861558ac88c34805abe4d6c894557b19 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:10.226635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda3002-8b90-4787-bda7-8a885db72401 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:10.238868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda3002-8b90-4787-bda7-8a885db72401 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:10.263869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b38c92-3f26-470b-961a-dd6978b1f477 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240e55220fb84a38beb218d79b68c8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c779d1441ce4cd7b0c8e16e80cfa655', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:10.266290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b38c92-3f26-470b-961a-dd6978b1f477 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:10.266939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b38c92-3f26-470b-961a-dd6978b1f477 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:10.267449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b38c92-3f26-470b-961a-dd6978b1f477 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] PATH_INFO: `/v3/services/861558ac88c34805abe4d6c894557b19` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:10.268413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b38c92-3f26-470b-961a-dd6978b1f477 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorizing `identity:get_service(service_id=861558ac88c34805abe4d6c894557b19)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:10.270858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b38c92-3f26-470b-961a-dd6978b1f477 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:10.291187 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-c0b38c92-3f26-470b-961a-dd6978b1f477 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Could not find service: 861558ac88c34805abe4d6c894557b19.: keystone.exception.ServiceNotFound: Could not find service: 861558ac88c34805abe4d6c894557b19. Jul 02 21:22:10.291187 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:22:10.291187 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 21:22:10.291187 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 21:22:10.291187 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 21:22:10.291187 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 21:22:10.291187 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 21:22:10.291187 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 21:22:10.291187 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 861558ac88c34805abe4d6c894557b19. Jul 02 21:22:10.291187 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:22:10.291187 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:22:10.291187 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:22:10.291187 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:22:10.291187 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:22:10.291187 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:22:10.292562 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:22:10.292562 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:22:10.292562 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:22:10.292562 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:22:10.292562 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:22:10.292562 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:22:10.292562 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:22:10.292562 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:22:10.292562 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 21:22:10.292562 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 21:22:10.292562 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 21:22:10.292562 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 21:22:10.292562 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:22:10.292562 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:22:10.292562 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:22:10.292562 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:22:10.293688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:22:10.293688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:22:10.293688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:22:10.293688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 21:22:10.293688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:22:10.293688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:22:10.293688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:22:10.293688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:22:10.293688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:22:10.293688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:22:10.293688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:22:10.293688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:22:10.293688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 21:22:10.293688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 21:22:10.293688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 861558ac88c34805abe4d6c894557b19. Jul 02 21:22:10.293688 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:22:10.302449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e69bb8-b955-476f-abad-d7119ce03255 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:10.309817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:10.313047 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2833/5628] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:22:10 2022] GET /identity/v3/services/861558ac88c34805abe4d6c894557b19 => generated 113 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:22:10.326455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e69bb8-b955-476f-abad-d7119ce03255 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:10.337023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b38c92-3f26-470b-961a-dd6978b1f477 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:10.341224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c0b38c92-3f26-470b-961a-dd6978b1f477 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:10.355817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123e6a9-2b3b-446a-a0dd-dd3227348acb tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240e55220fb84a38beb218d79b68c8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c779d1441ce4cd7b0c8e16e80cfa655', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:10.364470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123e6a9-2b3b-446a-a0dd-dd3227348acb tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:10.367629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123e6a9-2b3b-446a-a0dd-dd3227348acb tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:10.368128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123e6a9-2b3b-446a-a0dd-dd3227348acb tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:10.370860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123e6a9-2b3b-446a-a0dd-dd3227348acb tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:10.374563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123e6a9-2b3b-446a-a0dd-dd3227348acb tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:10.430128 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2796/5629] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:10 2022] POST /identity/v3/services => generated 273 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:10.434445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123e6a9-2b3b-446a-a0dd-dd3227348acb tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:10.514787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123e6a9-2b3b-446a-a0dd-dd3227348acb tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:10.528572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51544bf7-05a7-4480-98eb-27407a6df4c2 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240e55220fb84a38beb218d79b68c8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c779d1441ce4cd7b0c8e16e80cfa655', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:10.529389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51544bf7-05a7-4480-98eb-27407a6df4c2 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:10.529818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51544bf7-05a7-4480-98eb-27407a6df4c2 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:10.530233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51544bf7-05a7-4480-98eb-27407a6df4c2 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:10.531738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51544bf7-05a7-4480-98eb-27407a6df4c2 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:10.547224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51544bf7-05a7-4480-98eb-27407a6df4c2 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:10.584610 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2797/5630] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:10 2022] POST /identity/v3/services => generated 275 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:10.586664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b38c92-3f26-470b-961a-dd6978b1f477 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:10.591935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51544bf7-05a7-4480-98eb-27407a6df4c2 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:10.622922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129c278-9401-4b93-be1e-e4409e47b0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:10.623831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129c278-9401-4b93-be1e-e4409e47b0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:10.624151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129c278-9401-4b93-be1e-e4409e47b0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:10.624422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129c278-9401-4b93-be1e-e4409e47b0f6 admin admin] PATH_INFO: `/v3/projects/cf7cb7eb4aeb415c95135bb40c8b1039` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:10.630296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129c278-9401-4b93-be1e-e4409e47b0f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf7cb7eb4aeb415c95135bb40c8b1039)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:10.632313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129c278-9401-4b93-be1e-e4409e47b0f6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:10.641052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51544bf7-05a7-4480-98eb-27407a6df4c2 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:10.646817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bde09e-853e-4de4-8f89-1eaf9c7a0ff8 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240e55220fb84a38beb218d79b68c8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c779d1441ce4cd7b0c8e16e80cfa655', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:10.647723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bde09e-853e-4de4-8f89-1eaf9c7a0ff8 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:10.648338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bde09e-853e-4de4-8f89-1eaf9c7a0ff8 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:10.648778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bde09e-853e-4de4-8f89-1eaf9c7a0ff8 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:10.649667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bde09e-853e-4de4-8f89-1eaf9c7a0ff8 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:10.651662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bde09e-853e-4de4-8f89-1eaf9c7a0ff8 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:10.679722 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2798/5631] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:10 2022] POST /identity/v3/services => generated 274 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:10.681283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bde09e-853e-4de4-8f89-1eaf9c7a0ff8 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:10.708972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:10.729562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bde09e-853e-4de4-8f89-1eaf9c7a0ff8 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:10.744658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac003f-7403-4abe-81cb-523e321929a6 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240e55220fb84a38beb218d79b68c8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c779d1441ce4cd7b0c8e16e80cfa655', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:10.745840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac003f-7403-4abe-81cb-523e321929a6 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:10.748169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac003f-7403-4abe-81cb-523e321929a6 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:10.749007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac003f-7403-4abe-81cb-523e321929a6 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:10.749941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac003f-7403-4abe-81cb-523e321929a6 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:10.751614 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-36ac003f-7403-4abe-81cb-523e321929a6 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:22:10.751614 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:22:10.751614 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:22:10.755238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac003f-7403-4abe-81cb-523e321929a6 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:10.767458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a129c278-9401-4b93-be1e-e4409e47b0f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf7cb7eb4aeb415c95135bb40c8b1039', 'request_id': 'req-a129c278-9401-4b93-be1e-e4409e47b0f6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:10.790289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a129c278-9401-4b93-be1e-e4409e47b0f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf7cb7eb4aeb415c95135bb40c8b1039', 'request_id': 'req-a129c278-9401-4b93-be1e-e4409e47b0f6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:10.804331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a129c278-9401-4b93-be1e-e4409e47b0f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf7cb7eb4aeb415c95135bb40c8b1039', 'request_id': 'req-a129c278-9401-4b93-be1e-e4409e47b0f6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:10.810535 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2799/5632] 10.222.0.43 () {58 vars in 1130 bytes} [Sat Jul 2 21:22:10 2022] GET /identity/v3/services => generated 2977 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:10.814477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac003f-7403-4abe-81cb-523e321929a6 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:10.826746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a129c278-9401-4b93-be1e-e4409e47b0f6 admin admin] The token cache is being invalidate because project cf7cb7eb4aeb415c95135bb40c8b1039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:10.827325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a129c278-9401-4b93-be1e-e4409e47b0f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:10.829745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a129c278-9401-4b93-be1e-e4409e47b0f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:10.833953 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2834/5633] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:10 2022] DELETE /identity/v3/projects/cf7cb7eb4aeb415c95135bb40c8b1039 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:10.838483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97d06f-21be-4c42-9c37-38e173732ecc None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:10.839006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97d06f-21be-4c42-9c37-38e173732ecc None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:10.839673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97d06f-21be-4c42-9c37-38e173732ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:10.866357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac003f-7403-4abe-81cb-523e321929a6 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:10.881514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bf97d06f-21be-4c42-9c37-38e173732ecc None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:10.883268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bf97d06f-21be-4c42-9c37-38e173732ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:10.970359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1663895-9de3-4783-b414-ac10a8272560 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240e55220fb84a38beb218d79b68c8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c779d1441ce4cd7b0c8e16e80cfa655', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:10.971967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1663895-9de3-4783-b414-ac10a8272560 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:10.972478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1663895-9de3-4783-b414-ac10a8272560 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:10.972963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1663895-9de3-4783-b414-ac10a8272560 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:10.974176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1663895-9de3-4783-b414-ac10a8272560 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-975445932) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:22:10.974829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1663895-9de3-4783-b414-ac10a8272560 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:10.977756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1663895-9de3-4783-b414-ac10a8272560 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:10.985567 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2800/5634] 10.222.0.43 () {58 vars in 1219 bytes} [Sat Jul 2 21:22:10 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-975445932 => generated 415 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:22:10.998590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1663895-9de3-4783-b414-ac10a8272560 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:11.003956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c1663895-9de3-4783-b414-ac10a8272560 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:11.039969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1663895-9de3-4783-b414-ac10a8272560 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:11.056356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad5790-ad3e-4240-ad3c-3cc699343c56 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240e55220fb84a38beb218d79b68c8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c779d1441ce4cd7b0c8e16e80cfa655', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:11.057196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad5790-ad3e-4240-ad3c-3cc699343c56 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:11.057341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad5790-ad3e-4240-ad3c-3cc699343c56 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:11.057608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad5790-ad3e-4240-ad3c-3cc699343c56 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:11.058508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad5790-ad3e-4240-ad3c-3cc699343c56 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1776231208) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:22:11.059240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad5790-ad3e-4240-ad3c-3cc699343c56 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:11.060662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad5790-ad3e-4240-ad3c-3cc699343c56 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:11.074088 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2835/5635] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:10 2022] POST /identity/v3/auth/tokens => generated 3730 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:22:11.079497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57d16c-a90c-4dfa-b128-667f3e47b07a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:11.079497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57d16c-a90c-4dfa-b128-667f3e47b07a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:11.079497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57d16c-a90c-4dfa-b128-667f3e47b07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:11.081771 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2801/5636] 10.222.0.43 () {58 vars in 1221 bytes} [Sat Jul 2 21:22:10 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1776231208 => generated 418 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:22:11.083269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7c603-afa4-4291-815a-9a0575d38f11 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:11.083561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7c603-afa4-4291-815a-9a0575d38f11 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:11.083827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7c603-afa4-4291-815a-9a0575d38f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:11.119900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d2c7c603-afa4-4291-815a-9a0575d38f11 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:11.121259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d2c7c603-afa4-4291-815a-9a0575d38f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:11.140637 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2802/5637] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:11 2022] POST /identity/v3/auth/tokens => generated 3730 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:11.144031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7c603-afa4-4291-815a-9a0575d38f11 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:11.156903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5a57d16c-a90c-4dfa-b128-667f3e47b07a None None] MFA Rules not processed for user `8fb8295b4af942d2be5d0cdb0a822868`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:11.158805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5a57d16c-a90c-4dfa-b128-667f3e47b07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:11.180098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7c603-afa4-4291-815a-9a0575d38f11 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:11.201280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad958b-2463-4e8e-8c6b-91aef623c660 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240e55220fb84a38beb218d79b68c8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c779d1441ce4cd7b0c8e16e80cfa655', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:11.201978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad958b-2463-4e8e-8c6b-91aef623c660 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:11.202263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad958b-2463-4e8e-8c6b-91aef623c660 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:11.202538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad958b-2463-4e8e-8c6b-91aef623c660 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:11.203264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad958b-2463-4e8e-8c6b-91aef623c660 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-2047061734) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:22:11.203568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad958b-2463-4e8e-8c6b-91aef623c660 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:11.205334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad958b-2463-4e8e-8c6b-91aef623c660 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:11.223340 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2803/5638] 10.222.0.43 () {58 vars in 1221 bytes} [Sat Jul 2 21:22:11 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-2047061734 => generated 417 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:22:11.224284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad958b-2463-4e8e-8c6b-91aef623c660 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:11.246777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad958b-2463-4e8e-8c6b-91aef623c660 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:11.262477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecae32c-6647-4a12-a3a1-c87e1842c293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:11.263162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecae32c-6647-4a12-a3a1-c87e1842c293 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:11.263447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecae32c-6647-4a12-a3a1-c87e1842c293 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:11.263723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecae32c-6647-4a12-a3a1-c87e1842c293 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:11.264677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecae32c-6647-4a12-a3a1-c87e1842c293 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:22:11.265364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecae32c-6647-4a12-a3a1-c87e1842c293 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:11.267850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecae32c-6647-4a12-a3a1-c87e1842c293 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:11.272274 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2836/5639] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:11 2022] POST /identity/v3/auth/tokens => generated 3749 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:11.280381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57d16c-a90c-4dfa-b128-667f3e47b07a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:11.295632 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2804/5640] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:22:11.297018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57d16c-a90c-4dfa-b128-667f3e47b07a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:11.297427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783df4a8-2d85-444f-883a-5c519ecc06dc None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:11.297721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783df4a8-2d85-444f-883a-5c519ecc06dc None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:11.298001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783df4a8-2d85-444f-883a-5c519ecc06dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:11.310867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843de2fa-f347-408a-8196-32bed0d3446f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240e55220fb84a38beb218d79b68c8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c779d1441ce4cd7b0c8e16e80cfa655', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:11.313384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843de2fa-f347-408a-8196-32bed0d3446f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:11.314117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843de2fa-f347-408a-8196-32bed0d3446f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:11.314600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843de2fa-f347-408a-8196-32bed0d3446f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] PATH_INFO: `/v3/services/dab9984ea171440696e00bf62814f1c9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:11.315504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843de2fa-f347-408a-8196-32bed0d3446f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorizing `identity:delete_service(service_id=dab9984ea171440696e00bf62814f1c9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:11.319423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843de2fa-f347-408a-8196-32bed0d3446f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:11.336687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-783df4a8-2d85-444f-883a-5c519ecc06dc None None] MFA Rules not processed for user `8fb8295b4af942d2be5d0cdb0a822868`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:11.337791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-783df4a8-2d85-444f-883a-5c519ecc06dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:11.350846 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2805/5641] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:11 2022] POST /identity/v3/auth/tokens => generated 3749 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:11.351889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783df4a8-2d85-444f-883a-5c519ecc06dc None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:11.369934 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2837/5642] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:11 2022] DELETE /identity/v3/services/dab9984ea171440696e00bf62814f1c9 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:11.369934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843de2fa-f347-408a-8196-32bed0d3446f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:11.370567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-843de2fa-f347-408a-8196-32bed0d3446f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:11.371286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783df4a8-2d85-444f-883a-5c519ecc06dc None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:11.384158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:11.408868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd8da7-fa1c-4cd4-b0b4-23dc031ecd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:11.411301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd8da7-fa1c-4cd4-b0b4-23dc031ecd99 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:11.411680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd8da7-fa1c-4cd4-b0b4-23dc031ecd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:11.412178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd8da7-fa1c-4cd4-b0b4-23dc031ecd99 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:11.413272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd8da7-fa1c-4cd4-b0b4-23dc031ecd99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:11.414966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd8da7-fa1c-4cd4-b0b4-23dc031ecd99 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:11.468634 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2806/5643] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:11 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:11.469739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd8da7-fa1c-4cd4-b0b4-23dc031ecd99 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:11.496450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:11.531427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843de2fa-f347-408a-8196-32bed0d3446f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:11.633334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd8da7-fa1c-4cd4-b0b4-23dc031ecd99 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:11.661340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475b584-9a6f-4600-94a3-8528bc00c698 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:11.661965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21294c-52d0-4197-a0fe-a20f876b871f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240e55220fb84a38beb218d79b68c8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c779d1441ce4cd7b0c8e16e80cfa655', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:11.662382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21294c-52d0-4197-a0fe-a20f876b871f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:11.662666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21294c-52d0-4197-a0fe-a20f876b871f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:11.662831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475b584-9a6f-4600-94a3-8528bc00c698 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:11.662949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21294c-52d0-4197-a0fe-a20f876b871f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] PATH_INFO: `/v3/services/02beabc5d21b4bef928f6f29d4112902` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:11.663308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475b584-9a6f-4600-94a3-8528bc00c698 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:11.663585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21294c-52d0-4197-a0fe-a20f876b871f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorizing `identity:delete_service(service_id=02beabc5d21b4bef928f6f29d4112902)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:11.663800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475b584-9a6f-4600-94a3-8528bc00c698 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:11.665236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21294c-52d0-4197-a0fe-a20f876b871f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:11.713996 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2807/5644] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:11 2022] DELETE /identity/v3/services/02beabc5d21b4bef928f6f29d4112902 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:11.717073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21294c-52d0-4197-a0fe-a20f876b871f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:11.799952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475b584-9a6f-4600-94a3-8528bc00c698 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:11.802263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475b584-9a6f-4600-94a3-8528bc00c698 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:11.802637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21294c-52d0-4197-a0fe-a20f876b871f tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:11.813232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42c147-441a-4410-bdd0-34a71983270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:11.814269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42c147-441a-4410-bdd0-34a71983270d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:11.814716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42c147-441a-4410-bdd0-34a71983270d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:11.815155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42c147-441a-4410-bdd0-34a71983270d admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:11.816810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42c147-441a-4410-bdd0-34a71983270d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:11.819117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42c147-441a-4410-bdd0-34a71983270d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:11.835571 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2838/5645] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:11 2022] GET /identity/v3/auth/tokens => generated 3414 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:11.836734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475b584-9a6f-4600-94a3-8528bc00c698 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:11.850944 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2808/5646] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:11 2022] POST /identity/v3/users => generated 286 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:11.851801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475b584-9a6f-4600-94a3-8528bc00c698 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:11.855406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42c147-441a-4410-bdd0-34a71983270d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:11.879204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42c147-441a-4410-bdd0-34a71983270d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:11.891309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125d01a-0f50-41f0-9f2b-337633af3ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:11.892119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125d01a-0f50-41f0-9f2b-337633af3ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:11.894858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125d01a-0f50-41f0-9f2b-337633af3ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:11.895783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125d01a-0f50-41f0-9f2b-337633af3ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:11.895955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125d01a-0f50-41f0-9f2b-337633af3ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:11.903271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125d01a-0f50-41f0-9f2b-337633af3ad1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:11.916671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d9efc-60ed-4879-9950-a1869079ea67 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240e55220fb84a38beb218d79b68c8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c779d1441ce4cd7b0c8e16e80cfa655', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:11.917827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d9efc-60ed-4879-9950-a1869079ea67 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:11.919019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d9efc-60ed-4879-9950-a1869079ea67 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:11.919375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d9efc-60ed-4879-9950-a1869079ea67 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] PATH_INFO: `/v3/services/345f0fd6e97f46e2b270a279265ac3d9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:11.921338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d9efc-60ed-4879-9950-a1869079ea67 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorizing `identity:delete_service(service_id=345f0fd6e97f46e2b270a279265ac3d9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:11.925728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d9efc-60ed-4879-9950-a1869079ea67 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:11.927908 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2809/5647] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:11.932204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125d01a-0f50-41f0-9f2b-337633af3ad1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:11.956946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125d01a-0f50-41f0-9f2b-337633af3ad1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:11.961392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:11.969181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd88233-174c-49fa-825e-39aa936a37c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:11.969886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd88233-174c-49fa-825e-39aa936a37c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:11.970271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd88233-174c-49fa-825e-39aa936a37c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:11.970560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd88233-174c-49fa-825e-39aa936a37c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:11.973606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd88233-174c-49fa-825e-39aa936a37c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:11.977291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd88233-174c-49fa-825e-39aa936a37c8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:11.996602 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2810/5648] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:11.996827 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2839/5649] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:11 2022] DELETE /identity/v3/services/345f0fd6e97f46e2b270a279265ac3d9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:12.004179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd88233-174c-49fa-825e-39aa936a37c8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:12.004392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d9efc-60ed-4879-9950-a1869079ea67 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:12.006315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cbd88233-174c-49fa-825e-39aa936a37c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:12.022013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd88233-174c-49fa-825e-39aa936a37c8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:12.036021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d9efc-60ed-4879-9950-a1869079ea67 tempest-ServicesTestJSON-1883205987 tempest-ServicesTestJSON-1883205987-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:12.041204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989591b-9a7f-4de2-966e-8c1d0c3665ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:12.041461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b666ee6-1b58-4aa7-b5fe-5710b3c9039d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:12.042367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b666ee6-1b58-4aa7-b5fe-5710b3c9039d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:12.042755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b666ee6-1b58-4aa7-b5fe-5710b3c9039d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:12.043038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b666ee6-1b58-4aa7-b5fe-5710b3c9039d admin admin] PATH_INFO: `/v3/users/e5a263f491d24635bf8ff145d8631448` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:12.044284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989591b-9a7f-4de2-966e-8c1d0c3665ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:12.044572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989591b-9a7f-4de2-966e-8c1d0c3665ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:12.044946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b666ee6-1b58-4aa7-b5fe-5710b3c9039d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a263f491d24635bf8ff145d8631448)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:12.045133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989591b-9a7f-4de2-966e-8c1d0c3665ae admin admin] PATH_INFO: `/v3/projects/04e1d850f7e34fc7997bbea3a4a4777f/users/8659f358b57b4574a0703b39e4cb0004/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:12.047272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b666ee6-1b58-4aa7-b5fe-5710b3c9039d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:12.067162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989591b-9a7f-4de2-966e-8c1d0c3665ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=04e1d850f7e34fc7997bbea3a4a4777f, user_id=8659f358b57b4574a0703b39e4cb0004, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:12.084337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989591b-9a7f-4de2-966e-8c1d0c3665ae admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:12.101498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:12.132098 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2840/5650] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:12 2022] PUT /identity/v3/projects/04e1d850f7e34fc7997bbea3a4a4777f/users/8659f358b57b4574a0703b39e4cb0004/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:12.137550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e1e1a-3e4a-418d-8b24-63bf9ac02bcc None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:12.137910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e1e1a-3e4a-418d-8b24-63bf9ac02bcc None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:12.138255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e1e1a-3e4a-418d-8b24-63bf9ac02bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:12.142528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5b666ee6-1b58-4aa7-b5fe-5710b3c9039d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a263f491d24635bf8ff145d8631448'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:12.168002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5b666ee6-1b58-4aa7-b5fe-5710b3c9039d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a263f491d24635bf8ff145d8631448'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:12.184904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5b666ee6-1b58-4aa7-b5fe-5710b3c9039d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a263f491d24635bf8ff145d8631448'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:12.186950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5b666ee6-1b58-4aa7-b5fe-5710b3c9039d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a263f491d24635bf8ff145d8631448'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:12.188160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5b666ee6-1b58-4aa7-b5fe-5710b3c9039d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a263f491d24635bf8ff145d8631448'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:12.191277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f31e1e1a-3e4a-418d-8b24-63bf9ac02bcc None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:12.193983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f31e1e1a-3e4a-418d-8b24-63bf9ac02bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:12.223087 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2811/5651] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:12 2022] DELETE /identity/v3/users/e5a263f491d24635bf8ff145d8631448 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:12.228396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db185680-2608-4ec6-8849-06ccd2ca13d5 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:12.230741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db185680-2608-4ec6-8849-06ccd2ca13d5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:12.231267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db185680-2608-4ec6-8849-06ccd2ca13d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:12.255307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-db185680-2608-4ec6-8849-06ccd2ca13d5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:12.257165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-db185680-2608-4ec6-8849-06ccd2ca13d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:12.326464 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2841/5652] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:12.375209 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2812/5653] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:12.416739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e1e1a-3e4a-418d-8b24-63bf9ac02bcc None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:12.418302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f31e1e1a-3e4a-418d-8b24-63bf9ac02bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:12.443884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db185680-2608-4ec6-8849-06ccd2ca13d5 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:12.446211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-db185680-2608-4ec6-8849-06ccd2ca13d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:12.570695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e1e1a-3e4a-418d-8b24-63bf9ac02bcc None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:12.600174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db185680-2608-4ec6-8849-06ccd2ca13d5 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:12.607367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c4777-3c3f-40f3-839b-bf21d8a387eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:12.609246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c4777-3c3f-40f3-839b-bf21d8a387eb service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:12.611566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c4777-3c3f-40f3-839b-bf21d8a387eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:12.611566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c4777-3c3f-40f3-839b-bf21d8a387eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:12.627855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c4777-3c3f-40f3-839b-bf21d8a387eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:12.628096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c4777-3c3f-40f3-839b-bf21d8a387eb service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:12.652203 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2813/5654] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:12.732449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814436c-1ffe-4edd-9194-ccd04bb7f686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:12.733128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814436c-1ffe-4edd-9194-ccd04bb7f686 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:12.733410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814436c-1ffe-4edd-9194-ccd04bb7f686 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:12.733687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814436c-1ffe-4edd-9194-ccd04bb7f686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:12.766283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814436c-1ffe-4edd-9194-ccd04bb7f686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:12.767916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814436c-1ffe-4edd-9194-ccd04bb7f686 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:12.782003 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2842/5655] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:14.950923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c4777-3c3f-40f3-839b-bf21d8a387eb service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:14.955271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ae0c4777-3c3f-40f3-839b-bf21d8a387eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:14.977997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c4777-3c3f-40f3-839b-bf21d8a387eb service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:14.992178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71e669-362a-4219-97be-b8aba965654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:14.993240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e669-362a-4219-97be-b8aba965654b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:14.993594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e669-362a-4219-97be-b8aba965654b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:14.993944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e669-362a-4219-97be-b8aba965654b admin admin] PATH_INFO: `/v3/projects/7f6f92c7f681492f99b42e064515f34c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:14.995294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71e669-362a-4219-97be-b8aba965654b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f6f92c7f681492f99b42e064515f34c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:15.003609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71e669-362a-4219-97be-b8aba965654b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:15.145155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:15.154847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1c71e669-362a-4219-97be-b8aba965654b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f6f92c7f681492f99b42e064515f34c', 'request_id': 'req-1c71e669-362a-4219-97be-b8aba965654b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:15.171858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1c71e669-362a-4219-97be-b8aba965654b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f6f92c7f681492f99b42e064515f34c', 'request_id': 'req-1c71e669-362a-4219-97be-b8aba965654b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:15.185136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1c71e669-362a-4219-97be-b8aba965654b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f6f92c7f681492f99b42e064515f34c', 'request_id': 'req-1c71e669-362a-4219-97be-b8aba965654b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:15.222806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1c71e669-362a-4219-97be-b8aba965654b admin admin] The token cache is being invalidate because project 7f6f92c7f681492f99b42e064515f34c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:15.222991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1c71e669-362a-4219-97be-b8aba965654b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:15.223642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1c71e669-362a-4219-97be-b8aba965654b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:15.228191 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2814/5656] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:14 2022] DELETE /identity/v3/projects/7f6f92c7f681492f99b42e064515f34c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:15.229394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814436c-1ffe-4edd-9194-ccd04bb7f686 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:15.244010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814436c-1ffe-4edd-9194-ccd04bb7f686 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:15.261839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:15.372424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d09ad-2b1d-4c94-b49a-d91942aa0e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:15.374649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d09ad-2b1d-4c94-b49a-d91942aa0e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:15.375265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d09ad-2b1d-4c94-b49a-d91942aa0e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:15.375821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d09ad-2b1d-4c94-b49a-d91942aa0e32 admin admin] PATH_INFO: `/v3/users/240e55220fb84a38beb218d79b68c8e2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:15.377646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d09ad-2b1d-4c94-b49a-d91942aa0e32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=240e55220fb84a38beb218d79b68c8e2)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:15.380659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d09ad-2b1d-4c94-b49a-d91942aa0e32 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:15.562551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-687d09ad-2b1d-4c94-b49a-d91942aa0e32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '240e55220fb84a38beb218d79b68c8e2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:15.610530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-687d09ad-2b1d-4c94-b49a-d91942aa0e32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '240e55220fb84a38beb218d79b68c8e2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:15.611317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-687d09ad-2b1d-4c94-b49a-d91942aa0e32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '240e55220fb84a38beb218d79b68c8e2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:15.612076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-687d09ad-2b1d-4c94-b49a-d91942aa0e32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '240e55220fb84a38beb218d79b68c8e2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:15.633908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-687d09ad-2b1d-4c94-b49a-d91942aa0e32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '240e55220fb84a38beb218d79b68c8e2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:15.719109 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2843/5657] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:15 2022] DELETE /identity/v3/users/240e55220fb84a38beb218d79b68c8e2 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:15.920780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8adf61-27e5-467f-987f-b401bf4a5b49 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:15.921410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8adf61-27e5-467f-987f-b401bf4a5b49 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:15.921713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8adf61-27e5-467f-987f-b401bf4a5b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:15.981921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3f8adf61-27e5-467f-987f-b401bf4a5b49 None None] MFA Rules not processed for user `5261fd648c584842937fbd1c53fb53e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:15.983174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3f8adf61-27e5-467f-987f-b401bf4a5b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:16.217096 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2815/5658] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:16.226914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbc358-c870-4e4d-8add-1478f2cfc371 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:16.227221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbc358-c870-4e4d-8add-1478f2cfc371 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:16.227464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbc358-c870-4e4d-8add-1478f2cfc371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:16.253019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c4cbc358-c870-4e4d-8add-1478f2cfc371 None None] MFA Rules not processed for user `5261fd648c584842937fbd1c53fb53e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:16.257452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c4cbc358-c870-4e4d-8add-1478f2cfc371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:16.295420 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2844/5659] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:16.308852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8adf61-27e5-467f-987f-b401bf4a5b49 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:16.310472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3f8adf61-27e5-467f-987f-b401bf4a5b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:16.448832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbc358-c870-4e4d-8add-1478f2cfc371 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:16.450396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c4cbc358-c870-4e4d-8add-1478f2cfc371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:16.490886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8adf61-27e5-467f-987f-b401bf4a5b49 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:16.497506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8fa44-6f3f-458c-9343-17b77dd11122 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:16.498760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8fa44-6f3f-458c-9343-17b77dd11122 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:16.499218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8fa44-6f3f-458c-9343-17b77dd11122 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:16.499967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8fa44-6f3f-458c-9343-17b77dd11122 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:16.506235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbc358-c870-4e4d-8add-1478f2cfc371 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:16.514406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e90bb-15ab-4349-a3cf-1ef5eb816b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:16.516213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e90bb-15ab-4349-a3cf-1ef5eb816b5e service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:16.516735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e90bb-15ab-4349-a3cf-1ef5eb816b5e service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:16.517347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e90bb-15ab-4349-a3cf-1ef5eb816b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:16.519527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c06e90bb-15ab-4349-a3cf-1ef5eb816b5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:16.522207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8fa44-6f3f-458c-9343-17b77dd11122 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:16.523856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8fa44-6f3f-458c-9343-17b77dd11122 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:16.536823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e90bb-15ab-4349-a3cf-1ef5eb816b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:16.540743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e90bb-15ab-4349-a3cf-1ef5eb816b5e service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:16.551869 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2816/5660] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:16.570912 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2845/5661] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:22:17.108924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8fa44-6f3f-458c-9343-17b77dd11122 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:17.111197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b3d8fa44-6f3f-458c-9343-17b77dd11122 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:17.221212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:17.334484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8fa44-6f3f-458c-9343-17b77dd11122 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:17.349223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60a497-a727-4e00-ba89-db607d88fbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:17.352826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60a497-a727-4e00-ba89-db607d88fbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:17.353610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60a497-a727-4e00-ba89-db607d88fbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:17.356391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60a497-a727-4e00-ba89-db607d88fbd8 admin admin] PATH_INFO: `/v3/projects/6c779d1441ce4cd7b0c8e16e80cfa655` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:17.359384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60a497-a727-4e00-ba89-db607d88fbd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c779d1441ce4cd7b0c8e16e80cfa655)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:17.367008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60a497-a727-4e00-ba89-db607d88fbd8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:17.480067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee60a497-a727-4e00-ba89-db607d88fbd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c779d1441ce4cd7b0c8e16e80cfa655', 'request_id': 'req-ee60a497-a727-4e00-ba89-db607d88fbd8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:17.490429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee60a497-a727-4e00-ba89-db607d88fbd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c779d1441ce4cd7b0c8e16e80cfa655', 'request_id': 'req-ee60a497-a727-4e00-ba89-db607d88fbd8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:17.510761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee60a497-a727-4e00-ba89-db607d88fbd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c779d1441ce4cd7b0c8e16e80cfa655', 'request_id': 'req-ee60a497-a727-4e00-ba89-db607d88fbd8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:17.547819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee60a497-a727-4e00-ba89-db607d88fbd8 admin admin] The token cache is being invalidate because project 6c779d1441ce4cd7b0c8e16e80cfa655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:17.549485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee60a497-a727-4e00-ba89-db607d88fbd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:17.551042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee60a497-a727-4e00-ba89-db607d88fbd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:17.560545 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2817/5662] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:17 2022] DELETE /identity/v3/projects/6c779d1441ce4cd7b0c8e16e80cfa655 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:17.561372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046a731-c49f-4389-a763-e220fc3351f8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:17.562025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046a731-c49f-4389-a763-e220fc3351f8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:17.562025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046a731-c49f-4389-a763-e220fc3351f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:17.586645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3046a731-c49f-4389-a763-e220fc3351f8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:17.588989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3046a731-c49f-4389-a763-e220fc3351f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:17.703414 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2846/5663] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:22:17.711480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd815e-5f31-41ab-8895-8eef22fc7639 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:17.712063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd815e-5f31-41ab-8895-8eef22fc7639 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:17.712496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd815e-5f31-41ab-8895-8eef22fc7639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:17.733225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-45bd815e-5f31-41ab-8895-8eef22fc7639 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:17.734761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-45bd815e-5f31-41ab-8895-8eef22fc7639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:17.747189 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2818/5664] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:17.748432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046a731-c49f-4389-a763-e220fc3351f8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:17.760354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:17.769113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046a731-c49f-4389-a763-e220fc3351f8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:17.777718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64978d5-d029-4c94-88d0-1b5197ab65ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:17.779104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64978d5-d029-4c94-88d0-1b5197ab65ce admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:17.779738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64978d5-d029-4c94-88d0-1b5197ab65ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:17.780277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64978d5-d029-4c94-88d0-1b5197ab65ce admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:17.781296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64978d5-d029-4c94-88d0-1b5197ab65ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:22:17.782347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64978d5-d029-4c94-88d0-1b5197ab65ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:17.786426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64978d5-d029-4c94-88d0-1b5197ab65ce admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:17.810714 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2847/5665] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:22:17.815618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd815e-5f31-41ab-8895-8eef22fc7639 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:17.830461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd815e-5f31-41ab-8895-8eef22fc7639 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:17.841067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7ae78-1e8c-440c-9563-29b2c53b0bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:17.842635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7ae78-1e8c-440c-9563-29b2c53b0bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:17.843573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7ae78-1e8c-440c-9563-29b2c53b0bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:17.844558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7ae78-1e8c-440c-9563-29b2c53b0bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:17.848935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7ae78-1e8c-440c-9563-29b2c53b0bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:17.852642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7ae78-1e8c-440c-9563-29b2c53b0bc8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:17.917512 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2819/5666] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:17 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:17.918250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64978d5-d029-4c94-88d0-1b5197ab65ce admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:17.944635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64978d5-d029-4c94-88d0-1b5197ab65ce admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:18.047253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde06d51-4430-4a48-8995-1c4ea76506fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:18.048016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde06d51-4430-4a48-8995-1c4ea76506fc admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:18.048460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde06d51-4430-4a48-8995-1c4ea76506fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:18.048741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde06d51-4430-4a48-8995-1c4ea76506fc admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:18.049462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde06d51-4430-4a48-8995-1c4ea76506fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:18.051474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde06d51-4430-4a48-8995-1c4ea76506fc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:18.083997 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2848/5667] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:17 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:18.088121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7ae78-1e8c-440c-9563-29b2c53b0bc8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:18.104985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7ae78-1e8c-440c-9563-29b2c53b0bc8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:18.119968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed951c-0c0a-4e3a-ab79-37e47549b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:18.120943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed951c-0c0a-4e3a-ab79-37e47549b584 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:18.121427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed951c-0c0a-4e3a-ab79-37e47549b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:18.121964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed951c-0c0a-4e3a-ab79-37e47549b584 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:18.122911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed951c-0c0a-4e3a-ab79-37e47549b584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:18.127611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed951c-0c0a-4e3a-ab79-37e47549b584 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:18.176600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde06d51-4430-4a48-8995-1c4ea76506fc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:18.177259 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2820/5668] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:18.207299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde06d51-4430-4a48-8995-1c4ea76506fc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:18.257843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffa715-48a0-42b3-9356-49fbf804079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:18.260281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffa715-48a0-42b3-9356-49fbf804079b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:18.260578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffa715-48a0-42b3-9356-49fbf804079b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:18.268670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffa715-48a0-42b3-9356-49fbf804079b admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:18.269552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffa715-48a0-42b3-9356-49fbf804079b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:18.271223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffa715-48a0-42b3-9356-49fbf804079b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:18.379594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed951c-0c0a-4e3a-ab79-37e47549b584 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:18.388750 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2849/5669] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:18.406886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed951c-0c0a-4e3a-ab79-37e47549b584 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:18.432759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b303c6-a18a-4085-9821-4001e75469ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:18.433948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b303c6-a18a-4085-9821-4001e75469ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:18.434406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b303c6-a18a-4085-9821-4001e75469ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:18.434849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b303c6-a18a-4085-9821-4001e75469ff admin admin] PATH_INFO: `/v3/projects/f27ba06281fb44e3a83835ff747c68b6/users/0cbd8a2c800e4b62b156eefc704ec4e9/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:18.488937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b303c6-a18a-4085-9821-4001e75469ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27ba06281fb44e3a83835ff747c68b6, user_id=0cbd8a2c800e4b62b156eefc704ec4e9, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:18.496577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b303c6-a18a-4085-9821-4001e75469ff admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:18.544196 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2821/5670] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:18 2022] PUT /identity/v3/projects/f27ba06281fb44e3a83835ff747c68b6/users/0cbd8a2c800e4b62b156eefc704ec4e9/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:18.545121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8b4d6-49d5-43c4-87d8-2a71764e06b2 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:18.545409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8b4d6-49d5-43c4-87d8-2a71764e06b2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:18.545685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8b4d6-49d5-43c4-87d8-2a71764e06b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:18.606933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b303c6-a18a-4085-9821-4001e75469ff admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:18.608581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-72d8b4d6-49d5-43c4-87d8-2a71764e06b2 None None] MFA Rules not processed for user `0cbd8a2c800e4b62b156eefc704ec4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:18.609077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-15b303c6-a18a-4085-9821-4001e75469ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:18.611020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-72d8b4d6-49d5-43c4-87d8-2a71764e06b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:18.803546 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2850/5671] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:18.807901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8b4d6-49d5-43c4-87d8-2a71764e06b2 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:18.808869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b303c6-a18a-4085-9821-4001e75469ff admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:18.819783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2905cc-3e9a-4961-9ebd-de9b66da451a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:18.822551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2905cc-3e9a-4961-9ebd-de9b66da451a service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:18.824352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2905cc-3e9a-4961-9ebd-de9b66da451a service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:18.825023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2905cc-3e9a-4961-9ebd-de9b66da451a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:18.838767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6f2905cc-3e9a-4961-9ebd-de9b66da451a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:18.868718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2905cc-3e9a-4961-9ebd-de9b66da451a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:18.871492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2905cc-3e9a-4961-9ebd-de9b66da451a service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:18.908722 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2822/5672] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:18.966559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:18.983587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8b4d6-49d5-43c4-87d8-2a71764e06b2 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:18.999088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f55b0-f4ba-4920-88fe-92b0cc12f947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:19.000122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f55b0-f4ba-4920-88fe-92b0cc12f947 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:19.002383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f55b0-f4ba-4920-88fe-92b0cc12f947 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:19.002900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f55b0-f4ba-4920-88fe-92b0cc12f947 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:19.003686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f55b0-f4ba-4920-88fe-92b0cc12f947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:19.005844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f55b0-f4ba-4920-88fe-92b0cc12f947 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:19.114501 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2851/5673] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:18 2022] POST /identity/v3/projects => generated 381 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:19.118895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2905cc-3e9a-4961-9ebd-de9b66da451a service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:19.163738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2905cc-3e9a-4961-9ebd-de9b66da451a service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:19.181365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:19.314286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d20841-82bb-4b94-a298-0e31b66da68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:19.316439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d20841-82bb-4b94-a298-0e31b66da68f admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:19.317164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d20841-82bb-4b94-a298-0e31b66da68f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:19.318871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d20841-82bb-4b94-a298-0e31b66da68f admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:19.319775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d20841-82bb-4b94-a298-0e31b66da68f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:19.322457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d20841-82bb-4b94-a298-0e31b66da68f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:19.367056 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2823/5674] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:19 2022] POST /identity/v3/users => generated 291 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:22:19.371518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f55b0-f4ba-4920-88fe-92b0cc12f947 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:19.388283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f55b0-f4ba-4920-88fe-92b0cc12f947 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:19.402887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2c3fe-0f5f-4a95-8687-9cc345aaa1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:19.403725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2c3fe-0f5f-4a95-8687-9cc345aaa1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:19.404020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2c3fe-0f5f-4a95-8687-9cc345aaa1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:19.404436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2c3fe-0f5f-4a95-8687-9cc345aaa1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:19.408837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2c3fe-0f5f-4a95-8687-9cc345aaa1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:19.412904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2c3fe-0f5f-4a95-8687-9cc345aaa1e8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:19.457822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d20841-82bb-4b94-a298-0e31b66da68f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:19.473880 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2852/5675] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:22:19.476900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d20841-82bb-4b94-a298-0e31b66da68f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:19.486674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e8925-1f44-432b-9841-68de1b32d8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:19.487381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e8925-1f44-432b-9841-68de1b32d8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:19.487669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e8925-1f44-432b-9841-68de1b32d8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:19.487947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e8925-1f44-432b-9841-68de1b32d8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:19.488909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e8925-1f44-432b-9841-68de1b32d8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:19.490553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e8925-1f44-432b-9841-68de1b32d8c9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:19.530781 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2824/5676] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:19.534177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2c3fe-0f5f-4a95-8687-9cc345aaa1e8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:19.554537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2c3fe-0f5f-4a95-8687-9cc345aaa1e8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:19.562278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bcc19-33c7-417e-b79f-c0521ded0d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:19.563714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bcc19-33c7-417e-b79f-c0521ded0d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:19.564450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bcc19-33c7-417e-b79f-c0521ded0d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:19.580992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bcc19-33c7-417e-b79f-c0521ded0d5d admin admin] PATH_INFO: `/v3/projects/2d2e1fc95454408a9e2db1e44f873094/users/3208e546a3074cd19ab81430a6b4a9f4/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:19.636072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bcc19-33c7-417e-b79f-c0521ded0d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2e1fc95454408a9e2db1e44f873094, user_id=3208e546a3074cd19ab81430a6b4a9f4, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:19.646930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bcc19-33c7-417e-b79f-c0521ded0d5d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:19.676535 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2853/5677] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:19 2022] PUT /identity/v3/projects/2d2e1fc95454408a9e2db1e44f873094/users/3208e546a3074cd19ab81430a6b4a9f4/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:19.688301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e295a-6aa9-43f4-a93b-5740eeabd078 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:19.688546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e295a-6aa9-43f4-a93b-5740eeabd078 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:19.688809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e295a-6aa9-43f4-a93b-5740eeabd078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:19.739961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f35e295a-6aa9-43f4-a93b-5740eeabd078 None None] MFA Rules not processed for user `3208e546a3074cd19ab81430a6b4a9f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:19.740942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f35e295a-6aa9-43f4-a93b-5740eeabd078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:19.824439 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2825/5678] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:19.826551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bcc19-33c7-417e-b79f-c0521ded0d5d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:20.033844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bcc19-33c7-417e-b79f-c0521ded0d5d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:20.052371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccec23-13a7-46d9-ac66-3189f2a41a4b tempest-IdentityV3ProjectsTest-1813392038 tempest-IdentityV3ProjectsTest-1813392038-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbd8a2c800e4b62b156eefc704ec4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f27ba06281fb44e3a83835ff747c68b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:20.054905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccec23-13a7-46d9-ac66-3189f2a41a4b tempest-IdentityV3ProjectsTest-1813392038 tempest-IdentityV3ProjectsTest-1813392038-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:20.055190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccec23-13a7-46d9-ac66-3189f2a41a4b tempest-IdentityV3ProjectsTest-1813392038 tempest-IdentityV3ProjectsTest-1813392038-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:20.056603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccec23-13a7-46d9-ac66-3189f2a41a4b tempest-IdentityV3ProjectsTest-1813392038 tempest-IdentityV3ProjectsTest-1813392038-project] PATH_INFO: `/v3/users/0cbd8a2c800e4b62b156eefc704ec4e9/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:20.058180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccec23-13a7-46d9-ac66-3189f2a41a4b tempest-IdentityV3ProjectsTest-1813392038 tempest-IdentityV3ProjectsTest-1813392038-project] RBAC: Authorizing `identity:list_user_projects(user_id=0cbd8a2c800e4b62b156eefc704ec4e9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:20.062703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccec23-13a7-46d9-ac66-3189f2a41a4b tempest-IdentityV3ProjectsTest-1813392038 tempest-IdentityV3ProjectsTest-1813392038-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:20.182008 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2854/5679] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:22:19 2022] GET /identity/v3/users/0cbd8a2c800e4b62b156eefc704ec4e9/projects => generated 517 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:22:20.187630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08908f30-823b-428c-ac7d-c394f3dc5584 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:20.188203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08908f30-823b-428c-ac7d-c394f3dc5584 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:20.188694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08908f30-823b-428c-ac7d-c394f3dc5584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:20.233381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-08908f30-823b-428c-ac7d-c394f3dc5584 None None] MFA Rules not processed for user `0cbd8a2c800e4b62b156eefc704ec4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:20.235400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-08908f30-823b-428c-ac7d-c394f3dc5584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:20.289118 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2826/5680] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:22:20.297515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0decdd-a4b9-4a5d-9ce7-aa1215d9f75a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:20.297809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0decdd-a4b9-4a5d-9ce7-aa1215d9f75a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:20.300434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0decdd-a4b9-4a5d-9ce7-aa1215d9f75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:20.332609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bb0decdd-a4b9-4a5d-9ce7-aa1215d9f75a None None] MFA Rules not processed for user `0cbd8a2c800e4b62b156eefc704ec4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:20.333994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bb0decdd-a4b9-4a5d-9ce7-aa1215d9f75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:20.465916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.models.token_model [None req-bb0decdd-a4b9-4a5d-9ce7-aa1215d9f75a None None] User 0cbd8a2c800e4b62b156eefc704ec4e9 has no access to project 2d2e1fc95454408a9e2db1e44f873094 {{(pid=91078) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Jul 02 21:22:20.486698 ncdv-master-1 devstack@keystone.service[91078]: WARNING keystone.server.flask.application [None req-bb0decdd-a4b9-4a5d-9ce7-aa1215d9f75a None None] Authorization failed. The request you have made requires authentication. from 10.222.0.43: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 02 21:22:20.490706 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2855/5681] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:20 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 197 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 02 21:22:20.495841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08908f30-823b-428c-ac7d-c394f3dc5584 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:20.699901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08908f30-823b-428c-ac7d-c394f3dc5584 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:20.720307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb13c2-fefc-49b8-a802-040ad6691e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:20.721174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb13c2-fefc-49b8-a802-040ad6691e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:20.721471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb13c2-fefc-49b8-a802-040ad6691e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:20.721732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb13c2-fefc-49b8-a802-040ad6691e67 admin admin] PATH_INFO: `/v3/users/0cbd8a2c800e4b62b156eefc704ec4e9` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:20.724287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb13c2-fefc-49b8-a802-040ad6691e67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cbd8a2c800e4b62b156eefc704ec4e9)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:20.726247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb13c2-fefc-49b8-a802-040ad6691e67 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:20.748947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:20.844075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ffb13c2-fefc-49b8-a802-040ad6691e67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cbd8a2c800e4b62b156eefc704ec4e9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:20.859704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ffb13c2-fefc-49b8-a802-040ad6691e67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cbd8a2c800e4b62b156eefc704ec4e9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:20.875419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ffb13c2-fefc-49b8-a802-040ad6691e67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cbd8a2c800e4b62b156eefc704ec4e9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:20.876311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ffb13c2-fefc-49b8-a802-040ad6691e67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cbd8a2c800e4b62b156eefc704ec4e9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:20.877169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ffb13c2-fefc-49b8-a802-040ad6691e67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cbd8a2c800e4b62b156eefc704ec4e9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:20.904603 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2827/5682] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:20 2022] DELETE /identity/v3/users/0cbd8a2c800e4b62b156eefc704ec4e9 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:20.909900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d886b-7cd1-4457-b3f6-ce48d631331d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:20.910423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d886b-7cd1-4457-b3f6-ce48d631331d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:20.910560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d886b-7cd1-4457-b3f6-ce48d631331d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:20.934602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-006d886b-7cd1-4457-b3f6-ce48d631331d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:20.936278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-006d886b-7cd1-4457-b3f6-ce48d631331d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:20.992198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:21.100789 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2856/5683] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:21.162400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb13c2-fefc-49b8-a802-040ad6691e67 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:21.164710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7ffb13c2-fefc-49b8-a802-040ad6691e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:21.330146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb13c2-fefc-49b8-a802-040ad6691e67 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:21.334061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4f843-150b-4852-b27c-0f68675158be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:21.334703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4f843-150b-4852-b27c-0f68675158be service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:21.335103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4f843-150b-4852-b27c-0f68675158be service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:21.335449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4f843-150b-4852-b27c-0f68675158be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:21.375071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4f843-150b-4852-b27c-0f68675158be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:21.377054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4f843-150b-4852-b27c-0f68675158be service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:21.394465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d886b-7cd1-4457-b3f6-ce48d631331d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:21.395936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-006d886b-7cd1-4457-b3f6-ce48d631331d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:21.449667 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2828/5684] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:21.639385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d886b-7cd1-4457-b3f6-ce48d631331d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:21.655050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97d89b-1183-4770-8e6e-ff44731bda01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:21.655917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97d89b-1183-4770-8e6e-ff44731bda01 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:21.656288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97d89b-1183-4770-8e6e-ff44731bda01 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:21.656577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97d89b-1183-4770-8e6e-ff44731bda01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:21.658657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0d97d89b-1183-4770-8e6e-ff44731bda01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:21.701486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97d89b-1183-4770-8e6e-ff44731bda01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:21.703210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97d89b-1183-4770-8e6e-ff44731bda01 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:21.752697 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2857/5685] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:22:24.585646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4f843-150b-4852-b27c-0f68675158be service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:24.587417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b3d4f843-150b-4852-b27c-0f68675158be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:24.616316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4f843-150b-4852-b27c-0f68675158be service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:24.624376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f027e67-552b-46f5-a1bb-35d793760e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:24.625269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f027e67-552b-46f5-a1bb-35d793760e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:24.626151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f027e67-552b-46f5-a1bb-35d793760e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:24.626431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f027e67-552b-46f5-a1bb-35d793760e00 admin admin] PATH_INFO: `/v3/projects/f27ba06281fb44e3a83835ff747c68b6` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:24.627725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f027e67-552b-46f5-a1bb-35d793760e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27ba06281fb44e3a83835ff747c68b6)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:24.630242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f027e67-552b-46f5-a1bb-35d793760e00 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:24.734107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9f027e67-552b-46f5-a1bb-35d793760e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27ba06281fb44e3a83835ff747c68b6', 'request_id': 'req-9f027e67-552b-46f5-a1bb-35d793760e00'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:24.743798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9f027e67-552b-46f5-a1bb-35d793760e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27ba06281fb44e3a83835ff747c68b6', 'request_id': 'req-9f027e67-552b-46f5-a1bb-35d793760e00'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:24.750933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9f027e67-552b-46f5-a1bb-35d793760e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27ba06281fb44e3a83835ff747c68b6', 'request_id': 'req-9f027e67-552b-46f5-a1bb-35d793760e00'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:24.769446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9f027e67-552b-46f5-a1bb-35d793760e00 admin admin] The token cache is being invalidate because project f27ba06281fb44e3a83835ff747c68b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:24.769807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9f027e67-552b-46f5-a1bb-35d793760e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:24.771105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9f027e67-552b-46f5-a1bb-35d793760e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:24.774311 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2829/5686] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:24 2022] DELETE /identity/v3/projects/f27ba06281fb44e3a83835ff747c68b6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:24.778884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97d89b-1183-4770-8e6e-ff44731bda01 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:24.790298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97d89b-1183-4770-8e6e-ff44731bda01 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:24.862313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bbfef-1b5e-4c3e-97b4-489bcaddd7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:24.864111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bbfef-1b5e-4c3e-97b4-489bcaddd7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:24.864477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bbfef-1b5e-4c3e-97b4-489bcaddd7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:24.864831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bbfef-1b5e-4c3e-97b4-489bcaddd7d3 admin admin] PATH_INFO: `/v3/users/3208e546a3074cd19ab81430a6b4a9f4` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:24.866756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bbfef-1b5e-4c3e-97b4-489bcaddd7d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3208e546a3074cd19ab81430a6b4a9f4)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:24.869885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bbfef-1b5e-4c3e-97b4-489bcaddd7d3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:24.957675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8b4bbfef-1b5e-4c3e-97b4-489bcaddd7d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3208e546a3074cd19ab81430a6b4a9f4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:24.981823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8b4bbfef-1b5e-4c3e-97b4-489bcaddd7d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3208e546a3074cd19ab81430a6b4a9f4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:24.983184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8b4bbfef-1b5e-4c3e-97b4-489bcaddd7d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3208e546a3074cd19ab81430a6b4a9f4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:24.983808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8b4bbfef-1b5e-4c3e-97b4-489bcaddd7d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3208e546a3074cd19ab81430a6b4a9f4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:24.992180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:25.009351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8b4bbfef-1b5e-4c3e-97b4-489bcaddd7d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3208e546a3074cd19ab81430a6b4a9f4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:25.036659 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2858/5687] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:24 2022] DELETE /identity/v3/users/3208e546a3074cd19ab81430a6b4a9f4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:26.222394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055201d4-7fcb-413d-b1df-f1dc1fa4b4f8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:26.228997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055201d4-7fcb-413d-b1df-f1dc1fa4b4f8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:26.229488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055201d4-7fcb-413d-b1df-f1dc1fa4b4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:26.279029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:26.284965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bbfef-1b5e-4c3e-97b4-489bcaddd7d3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:26.286734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8b4bbfef-1b5e-4c3e-97b4-489bcaddd7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:26.294507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-055201d4-7fcb-413d-b1df-f1dc1fa4b4f8 None None] MFA Rules not processed for user `8659f358b57b4574a0703b39e4cb0004`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:26.296841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-055201d4-7fcb-413d-b1df-f1dc1fa4b4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:26.399907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bbfef-1b5e-4c3e-97b4-489bcaddd7d3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:26.406797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235ad80-d699-40ef-be70-56e3a755bab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:26.407840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235ad80-d699-40ef-be70-56e3a755bab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:26.408284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235ad80-d699-40ef-be70-56e3a755bab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:26.408563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235ad80-d699-40ef-be70-56e3a755bab3 admin admin] PATH_INFO: `/v3/projects/2d2e1fc95454408a9e2db1e44f873094` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:26.409982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235ad80-d699-40ef-be70-56e3a755bab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d2e1fc95454408a9e2db1e44f873094)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:26.412135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235ad80-d699-40ef-be70-56e3a755bab3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:26.415183 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2830/5688] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:26.422207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055201d4-7fcb-413d-b1df-f1dc1fa4b4f8 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:26.423827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-055201d4-7fcb-413d-b1df-f1dc1fa4b4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:26.442309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055201d4-7fcb-413d-b1df-f1dc1fa4b4f8 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:26.448518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f57728-bb31-4f62-8c69-d5a2d697de1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:26.449947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f57728-bb31-4f62-8c69-d5a2d697de1c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:26.450226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f57728-bb31-4f62-8c69-d5a2d697de1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:26.450504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f57728-bb31-4f62-8c69-d5a2d697de1c admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:26.451723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f57728-bb31-4f62-8c69-d5a2d697de1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:26.454534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f57728-bb31-4f62-8c69-d5a2d697de1c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:26.502869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3235ad80-d699-40ef-be70-56e3a755bab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d2e1fc95454408a9e2db1e44f873094', 'request_id': 'req-3235ad80-d699-40ef-be70-56e3a755bab3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:26.511903 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2831/5689] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:26 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:26.514113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f57728-bb31-4f62-8c69-d5a2d697de1c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:26.525912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3235ad80-d699-40ef-be70-56e3a755bab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d2e1fc95454408a9e2db1e44f873094', 'request_id': 'req-3235ad80-d699-40ef-be70-56e3a755bab3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:26.535618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3235ad80-d699-40ef-be70-56e3a755bab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d2e1fc95454408a9e2db1e44f873094', 'request_id': 'req-3235ad80-d699-40ef-be70-56e3a755bab3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:26.548652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3235ad80-d699-40ef-be70-56e3a755bab3 admin admin] The token cache is being invalidate because project 2d2e1fc95454408a9e2db1e44f873094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:26.549008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3235ad80-d699-40ef-be70-56e3a755bab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:26.550936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3235ad80-d699-40ef-be70-56e3a755bab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:26.552540 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2859/5690] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:26 2022] DELETE /identity/v3/projects/2d2e1fc95454408a9e2db1e44f873094 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:26.559634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eedbd5-25ca-4c6d-b161-1cfdb6632041 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:26.559845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eedbd5-25ca-4c6d-b161-1cfdb6632041 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:26.560331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eedbd5-25ca-4c6d-b161-1cfdb6632041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:26.585570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-19eedbd5-25ca-4c6d-b161-1cfdb6632041 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:26.586955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-19eedbd5-25ca-4c6d-b161-1cfdb6632041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:26.647140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f57728-bb31-4f62-8c69-d5a2d697de1c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:26.661567 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2860/5691] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:26.670052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713c7bd-4f6f-43e8-a878-5b0472283104 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:26.670494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713c7bd-4f6f-43e8-a878-5b0472283104 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:26.671061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713c7bd-4f6f-43e8-a878-5b0472283104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:26.677615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3548fd5-9b4c-458a-8e6a-4e1098f6368d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:26.678544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3548fd5-9b4c-458a-8e6a-4e1098f6368d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:26.678832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3548fd5-9b4c-458a-8e6a-4e1098f6368d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:26.679112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3548fd5-9b4c-458a-8e6a-4e1098f6368d admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:26.679820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3548fd5-9b4c-458a-8e6a-4e1098f6368d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:26.686900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3548fd5-9b4c-458a-8e6a-4e1098f6368d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:26.689009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:26.702184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c713c7bd-4f6f-43e8-a878-5b0472283104 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:26.704664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c713c7bd-4f6f-43e8-a878-5b0472283104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:26.716764 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2832/5692] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:26 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:26.718249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3548fd5-9b4c-458a-8e6a-4e1098f6368d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:26.720439 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2861/5693] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:26.722362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713c7bd-4f6f-43e8-a878-5b0472283104 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:26.723041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e3548fd5-9b4c-458a-8e6a-4e1098f6368d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:26.738155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713c7bd-4f6f-43e8-a878-5b0472283104 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:26.738427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3548fd5-9b4c-458a-8e6a-4e1098f6368d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:26.744220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2073c35-3349-4aa9-b7fc-08a4ff7b2d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:26.744904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f338fd-5588-4cc6-80cc-d407eb39ad51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:26.745163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2073c35-3349-4aa9-b7fc-08a4ff7b2d35 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:26.745637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2073c35-3349-4aa9-b7fc-08a4ff7b2d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:26.746082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2073c35-3349-4aa9-b7fc-08a4ff7b2d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:26.746554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f338fd-5588-4cc6-80cc-d407eb39ad51 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:26.747061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2073c35-3349-4aa9-b7fc-08a4ff7b2d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:26.747370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f338fd-5588-4cc6-80cc-d407eb39ad51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:26.747795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f338fd-5588-4cc6-80cc-d407eb39ad51 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:26.748693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f338fd-5588-4cc6-80cc-d407eb39ad51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:22:26.749166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f338fd-5588-4cc6-80cc-d407eb39ad51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:26.749381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2073c35-3349-4aa9-b7fc-08a4ff7b2d35 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:26.751443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f338fd-5588-4cc6-80cc-d407eb39ad51 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:26.766675 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2833/5694] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:26.767805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2073c35-3349-4aa9-b7fc-08a4ff7b2d35 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:26.769221 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2862/5695] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:22:26.774182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f338fd-5588-4cc6-80cc-d407eb39ad51 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:26.784247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2073c35-3349-4aa9-b7fc-08a4ff7b2d35 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:26.790119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f338fd-5588-4cc6-80cc-d407eb39ad51 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:26.790296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46b329-619b-418f-b105-39fcaa2c13aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:26.791039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46b329-619b-418f-b105-39fcaa2c13aa admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:26.791337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46b329-619b-418f-b105-39fcaa2c13aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:26.791608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46b329-619b-418f-b105-39fcaa2c13aa admin admin] PATH_INFO: `/v3/projects/61d2158b3b2a4ea994db3541c9d6699c/users/33ac4a69ea634e1384e67250fe0c0722/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:26.797488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df10b8-2f74-4696-8256-a061d3a617d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:26.798410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df10b8-2f74-4696-8256-a061d3a617d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:26.798873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df10b8-2f74-4696-8256-a061d3a617d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:26.799303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df10b8-2f74-4696-8256-a061d3a617d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:26.800179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df10b8-2f74-4696-8256-a061d3a617d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:26.803058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df10b8-2f74-4696-8256-a061d3a617d1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:26.814657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46b329-619b-418f-b105-39fcaa2c13aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d2158b3b2a4ea994db3541c9d6699c, user_id=33ac4a69ea634e1384e67250fe0c0722, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:26.817998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46b329-619b-418f-b105-39fcaa2c13aa admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:26.842065 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2863/5697] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:26 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:26.842280 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2834/5697] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:26 2022] PUT /identity/v3/projects/61d2158b3b2a4ea994db3541c9d6699c/users/33ac4a69ea634e1384e67250fe0c0722/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:26.843061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46b329-619b-418f-b105-39fcaa2c13aa admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:26.843671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df10b8-2f74-4696-8256-a061d3a617d1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:26.896220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:26.934493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df10b8-2f74-4696-8256-a061d3a617d1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:26.941244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe89e3-f96f-4686-8b4f-2713d996bf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:26.941466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46b329-619b-418f-b105-39fcaa2c13aa admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:26.942408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe89e3-f96f-4686-8b4f-2713d996bf77 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:26.942829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe89e3-f96f-4686-8b4f-2713d996bf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:26.943236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe89e3-f96f-4686-8b4f-2713d996bf77 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:26.944300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe89e3-f96f-4686-8b4f-2713d996bf77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:26.947710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe89e3-f96f-4686-8b4f-2713d996bf77 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:26.947885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168700c8-25f9-4c09-ab8a-4cf10bdad454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:26.949281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168700c8-25f9-4c09-ab8a-4cf10bdad454 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:26.949281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168700c8-25f9-4c09-ab8a-4cf10bdad454 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:26.949281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168700c8-25f9-4c09-ab8a-4cf10bdad454 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:26.949865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168700c8-25f9-4c09-ab8a-4cf10bdad454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:26.951496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168700c8-25f9-4c09-ab8a-4cf10bdad454 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:26.969691 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2835/5698] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:26.970650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168700c8-25f9-4c09-ab8a-4cf10bdad454 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:26.981995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168700c8-25f9-4c09-ab8a-4cf10bdad454 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:26.984206 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2864/5699] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:26 2022] POST /identity/v3/users => generated 297 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:26.985114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe89e3-f96f-4686-8b4f-2713d996bf77 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:26.995599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c04a3-afc1-427e-aee1-59cc4889ed1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:26.997246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c04a3-afc1-427e-aee1-59cc4889ed1c admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:26.997717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c04a3-afc1-427e-aee1-59cc4889ed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:26.998465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c04a3-afc1-427e-aee1-59cc4889ed1c admin admin] PATH_INFO: `/v3/projects/61d2158b3b2a4ea994db3541c9d6699c/users/33ac4a69ea634e1384e67250fe0c0722/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:26.998757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe89e3-f96f-4686-8b4f-2713d996bf77 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:27.001938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c04a3-afc1-427e-aee1-59cc4889ed1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d2158b3b2a4ea994db3541c9d6699c, user_id=33ac4a69ea634e1384e67250fe0c0722, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:27.006327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c04a3-afc1-427e-aee1-59cc4889ed1c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:27.006447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa5dc7-58d4-4087-bcd2-e4cc1923956c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:27.007073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa5dc7-58d4-4087-bcd2-e4cc1923956c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:27.007362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa5dc7-58d4-4087-bcd2-e4cc1923956c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:27.007639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa5dc7-58d4-4087-bcd2-e4cc1923956c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:27.008478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa5dc7-58d4-4087-bcd2-e4cc1923956c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:27.010977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa5dc7-58d4-4087-bcd2-e4cc1923956c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:27.023960 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2836/5700] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:26 2022] PUT /identity/v3/projects/61d2158b3b2a4ea994db3541c9d6699c/users/33ac4a69ea634e1384e67250fe0c0722/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:27.033011 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2865/5701] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:27.037287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c04a3-afc1-427e-aee1-59cc4889ed1c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:27.114799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c04a3-afc1-427e-aee1-59cc4889ed1c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:27.122429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88673562-daa6-42a8-bfbc-f8c098f92703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:27.123984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88673562-daa6-42a8-bfbc-f8c098f92703 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:27.124497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88673562-daa6-42a8-bfbc-f8c098f92703 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:27.125376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88673562-daa6-42a8-bfbc-f8c098f92703 admin admin] PATH_INFO: `/v3/projects/d08b3269cfd24124918c4d71bbf20d93/users/e169349f669e4858beaaa55e553ad69f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:27.151353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88673562-daa6-42a8-bfbc-f8c098f92703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08b3269cfd24124918c4d71bbf20d93, user_id=e169349f669e4858beaaa55e553ad69f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:27.157300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88673562-daa6-42a8-bfbc-f8c098f92703 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:27.199008 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2837/5702] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:27 2022] PUT /identity/v3/projects/d08b3269cfd24124918c4d71bbf20d93/users/e169349f669e4858beaaa55e553ad69f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:27.205666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa5dc7-58d4-4087-bcd2-e4cc1923956c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:27.229036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa5dc7-58d4-4087-bcd2-e4cc1923956c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:27.349793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5362440-3ca2-4a2d-be30-71e3367d60bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:27.350755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5362440-3ca2-4a2d-be30-71e3367d60bc admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:27.351030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5362440-3ca2-4a2d-be30-71e3367d60bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:27.351412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5362440-3ca2-4a2d-be30-71e3367d60bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:27.352196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5362440-3ca2-4a2d-be30-71e3367d60bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:27.353985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5362440-3ca2-4a2d-be30-71e3367d60bc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:27.377753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88673562-daa6-42a8-bfbc-f8c098f92703 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:27.396328 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2866/5703] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:27.401437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88673562-daa6-42a8-bfbc-f8c098f92703 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:27.419664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5a5ac-3955-4a15-999b-3f8cbda62e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:27.423033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5a5ac-3955-4a15-999b-3f8cbda62e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:27.424221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5a5ac-3955-4a15-999b-3f8cbda62e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:27.426562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5a5ac-3955-4a15-999b-3f8cbda62e6b admin admin] PATH_INFO: `/v3/projects/d08b3269cfd24124918c4d71bbf20d93/users/e169349f669e4858beaaa55e553ad69f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:27.433046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5a5ac-3955-4a15-999b-3f8cbda62e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08b3269cfd24124918c4d71bbf20d93, user_id=e169349f669e4858beaaa55e553ad69f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:27.443455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5a5ac-3955-4a15-999b-3f8cbda62e6b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:27.460084 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2838/5704] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:27 2022] PUT /identity/v3/projects/d08b3269cfd24124918c4d71bbf20d93/users/e169349f669e4858beaaa55e553ad69f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:27.471382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1773505-25ec-471e-a8cd-573134061149 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:27.471574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1773505-25ec-471e-a8cd-573134061149 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:27.471825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1773505-25ec-471e-a8cd-573134061149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:27.527194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d1773505-25ec-471e-a8cd-573134061149 None None] MFA Rules not processed for user `e169349f669e4858beaaa55e553ad69f`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:27.531637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d1773505-25ec-471e-a8cd-573134061149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:27.597558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:27.677766 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2867/5705] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:27.683531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5a5ac-3955-4a15-999b-3f8cbda62e6b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:27.859639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5a5ac-3955-4a15-999b-3f8cbda62e6b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:27.867599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa958178-d113-45cc-9d65-21445a944e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:27.868359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa958178-d113-45cc-9d65-21445a944e29 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:27.868645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa958178-d113-45cc-9d65-21445a944e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:27.868916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa958178-d113-45cc-9d65-21445a944e29 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:27.869622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa958178-d113-45cc-9d65-21445a944e29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:27.871603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa958178-d113-45cc-9d65-21445a944e29 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:27.918165 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2839/5706] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:27 2022] POST /identity/v3/projects => generated 381 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:27.918869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1773505-25ec-471e-a8cd-573134061149 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:27.938263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1773505-25ec-471e-a8cd-573134061149 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:28.107916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631a3a4-c05f-4924-9c3c-a1929ea77183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:28.109113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631a3a4-c05f-4924-9c3c-a1929ea77183 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:28.109395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631a3a4-c05f-4924-9c3c-a1929ea77183 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:28.109671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631a3a4-c05f-4924-9c3c-a1929ea77183 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:28.110582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631a3a4-c05f-4924-9c3c-a1929ea77183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:28.112962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631a3a4-c05f-4924-9c3c-a1929ea77183 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:28.149211 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2868/5707] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:27 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:22:28.153481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa958178-d113-45cc-9d65-21445a944e29 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:28.179486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa958178-d113-45cc-9d65-21445a944e29 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:28.188317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2962e9-b85a-4330-b568-3003eccf4a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:28.189038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2962e9-b85a-4330-b568-3003eccf4a5f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:28.189464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2962e9-b85a-4330-b568-3003eccf4a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:28.189745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2962e9-b85a-4330-b568-3003eccf4a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:28.190493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2962e9-b85a-4330-b568-3003eccf4a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:28.213417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2962e9-b85a-4330-b568-3003eccf4a5f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:28.219810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:28.248699 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2840/5708] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:28.252304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631a3a4-c05f-4924-9c3c-a1929ea77183 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:28.269161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631a3a4-c05f-4924-9c3c-a1929ea77183 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:28.277896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224e83b-5b60-4bc7-818a-84b0453e7e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:28.279174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224e83b-5b60-4bc7-818a-84b0453e7e62 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:28.280860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224e83b-5b60-4bc7-818a-84b0453e7e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:28.280860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224e83b-5b60-4bc7-818a-84b0453e7e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:28.282322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224e83b-5b60-4bc7-818a-84b0453e7e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:28.284547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224e83b-5b60-4bc7-818a-84b0453e7e62 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:28.301769 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2869/5709] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:28.306114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2962e9-b85a-4330-b568-3003eccf4a5f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:28.325092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2962e9-b85a-4330-b568-3003eccf4a5f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:28.345978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc77a7-9549-47ee-9f30-86aac14c5a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:28.346911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc77a7-9549-47ee-9f30-86aac14c5a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:28.347192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc77a7-9549-47ee-9f30-86aac14c5a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:28.347467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc77a7-9549-47ee-9f30-86aac14c5a96 admin admin] PATH_INFO: `/v3/projects/17301b9162c64692b99223cf57afd2f9/users/d91c9ac1832748cd835ba3c6e43204dd/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:28.389963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc77a7-9549-47ee-9f30-86aac14c5a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17301b9162c64692b99223cf57afd2f9, user_id=d91c9ac1832748cd835ba3c6e43204dd, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:28.394809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc77a7-9549-47ee-9f30-86aac14c5a96 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:28.455990 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2841/5710] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:28 2022] PUT /identity/v3/projects/17301b9162c64692b99223cf57afd2f9/users/d91c9ac1832748cd835ba3c6e43204dd/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:28.471789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef030d-c88d-4f60-b4f5-86b8d75205ea None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:28.472269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef030d-c88d-4f60-b4f5-86b8d75205ea None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:28.472453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef030d-c88d-4f60-b4f5-86b8d75205ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:28.581459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-93ef030d-c88d-4f60-b4f5-86b8d75205ea None None] MFA Rules not processed for user `d91c9ac1832748cd835ba3c6e43204dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:28.583555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-93ef030d-c88d-4f60-b4f5-86b8d75205ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:28.704839 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2870/5711] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:28.717431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc77a7-9549-47ee-9f30-86aac14c5a96 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:28.719317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c9dc77a7-9549-47ee-9f30-86aac14c5a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:28.847311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc77a7-9549-47ee-9f30-86aac14c5a96 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:28.852290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf9ac1-08f4-41cc-b371-58c9a150446b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:28.852958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf9ac1-08f4-41cc-b371-58c9a150446b service glance] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:28.853236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf9ac1-08f4-41cc-b371-58c9a150446b service glance] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:28.853504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf9ac1-08f4-41cc-b371-58c9a150446b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:28.962666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf9ac1-08f4-41cc-b371-58c9a150446b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:28.964602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf9ac1-08f4-41cc-b371-58c9a150446b service glance] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:28.994302 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2842/5712] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:30.155710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef030d-c88d-4f60-b4f5-86b8d75205ea None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:30.233348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:30.317212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef030d-c88d-4f60-b4f5-86b8d75205ea None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:30.323606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25fc20-916d-4037-afaa-7b9169339b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:30.325927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25fc20-916d-4037-afaa-7b9169339b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:30.325927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25fc20-916d-4037-afaa-7b9169339b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:30.325927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25fc20-916d-4037-afaa-7b9169339b6b admin admin] PATH_INFO: `/v3/users/e169349f669e4858beaaa55e553ad69f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:30.327769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25fc20-916d-4037-afaa-7b9169339b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e169349f669e4858beaaa55e553ad69f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:30.330429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25fc20-916d-4037-afaa-7b9169339b6b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:30.429053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6e25fc20-916d-4037-afaa-7b9169339b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e169349f669e4858beaaa55e553ad69f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:30.457704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6e25fc20-916d-4037-afaa-7b9169339b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e169349f669e4858beaaa55e553ad69f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:30.458412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6e25fc20-916d-4037-afaa-7b9169339b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e169349f669e4858beaaa55e553ad69f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:30.459692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6e25fc20-916d-4037-afaa-7b9169339b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e169349f669e4858beaaa55e553ad69f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:30.489510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6e25fc20-916d-4037-afaa-7b9169339b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e169349f669e4858beaaa55e553ad69f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:30.527394 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2871/5713] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:30 2022] DELETE /identity/v3/users/e169349f669e4858beaaa55e553ad69f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:30.531672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c2dcd-51b7-48cd-8899-2e50e8182bae None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:30.532228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c2dcd-51b7-48cd-8899-2e50e8182bae None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:30.532582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c2dcd-51b7-48cd-8899-2e50e8182bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:30.569984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a69c2dcd-51b7-48cd-8899-2e50e8182bae None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:30.573238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a69c2dcd-51b7-48cd-8899-2e50e8182bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:30.701889 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2843/5714] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:30.752624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25fc20-916d-4037-afaa-7b9169339b6b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:30.754159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6e25fc20-916d-4037-afaa-7b9169339b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:30.837438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25fc20-916d-4037-afaa-7b9169339b6b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:30.841595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43e377-dfc4-4caa-847d-308b4d2d9958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:30.842256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43e377-dfc4-4caa-847d-308b4d2d9958 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:30.842820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43e377-dfc4-4caa-847d-308b4d2d9958 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:30.842820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43e377-dfc4-4caa-847d-308b4d2d9958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:30.855284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43e377-dfc4-4caa-847d-308b4d2d9958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:30.856704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43e377-dfc4-4caa-847d-308b4d2d9958 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:30.875492 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2872/5715] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:32.065280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c2dcd-51b7-48cd-8899-2e50e8182bae None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:32.068003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a69c2dcd-51b7-48cd-8899-2e50e8182bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:32.098960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c2dcd-51b7-48cd-8899-2e50e8182bae None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:32.116444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbdc85-4403-4656-93fb-bf8c4a37e556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:32.118222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbdc85-4403-4656-93fb-bf8c4a37e556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:32.118733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbdc85-4403-4656-93fb-bf8c4a37e556 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:32.119222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbdc85-4403-4656-93fb-bf8c4a37e556 admin admin] PATH_INFO: `/v3/projects/d08b3269cfd24124918c4d71bbf20d93` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:32.121551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbdc85-4403-4656-93fb-bf8c4a37e556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d08b3269cfd24124918c4d71bbf20d93)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:32.124878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbdc85-4403-4656-93fb-bf8c4a37e556 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:32.145493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:32.217208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-edcbdc85-4403-4656-93fb-bf8c4a37e556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd08b3269cfd24124918c4d71bbf20d93', 'request_id': 'req-edcbdc85-4403-4656-93fb-bf8c4a37e556'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:32.227432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-edcbdc85-4403-4656-93fb-bf8c4a37e556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd08b3269cfd24124918c4d71bbf20d93', 'request_id': 'req-edcbdc85-4403-4656-93fb-bf8c4a37e556'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:32.238780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-edcbdc85-4403-4656-93fb-bf8c4a37e556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd08b3269cfd24124918c4d71bbf20d93', 'request_id': 'req-edcbdc85-4403-4656-93fb-bf8c4a37e556'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:32.271326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-edcbdc85-4403-4656-93fb-bf8c4a37e556 admin admin] The token cache is being invalidate because project d08b3269cfd24124918c4d71bbf20d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:32.271807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-edcbdc85-4403-4656-93fb-bf8c4a37e556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:32.272466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-edcbdc85-4403-4656-93fb-bf8c4a37e556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:32.278264 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2844/5716] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:32 2022] DELETE /identity/v3/projects/d08b3269cfd24124918c4d71bbf20d93 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:32.279461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43e377-dfc4-4caa-847d-308b4d2d9958 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:32.292494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43e377-dfc4-4caa-847d-308b4d2d9958 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:32.401254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:32.433186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847f7c8-30d7-4ba0-a8d7-b7d388a8d0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:32.436578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847f7c8-30d7-4ba0-a8d7-b7d388a8d0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:32.437061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847f7c8-30d7-4ba0-a8d7-b7d388a8d0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:32.438228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847f7c8-30d7-4ba0-a8d7-b7d388a8d0c3 admin admin] PATH_INFO: `/v3/users/d91c9ac1832748cd835ba3c6e43204dd` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:32.439560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847f7c8-30d7-4ba0-a8d7-b7d388a8d0c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d91c9ac1832748cd835ba3c6e43204dd)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:32.444422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847f7c8-30d7-4ba0-a8d7-b7d388a8d0c3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:32.518202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3847f7c8-30d7-4ba0-a8d7-b7d388a8d0c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd91c9ac1832748cd835ba3c6e43204dd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:32.540444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3847f7c8-30d7-4ba0-a8d7-b7d388a8d0c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd91c9ac1832748cd835ba3c6e43204dd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:32.541990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3847f7c8-30d7-4ba0-a8d7-b7d388a8d0c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd91c9ac1832748cd835ba3c6e43204dd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:32.543252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3847f7c8-30d7-4ba0-a8d7-b7d388a8d0c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd91c9ac1832748cd835ba3c6e43204dd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:32.583954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3847f7c8-30d7-4ba0-a8d7-b7d388a8d0c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd91c9ac1832748cd835ba3c6e43204dd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:32.616849 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2873/5717] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:32 2022] DELETE /identity/v3/users/d91c9ac1832748cd835ba3c6e43204dd => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:33.922494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37297abb-fc08-43ae-984a-bf95bae874d1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:33.923029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37297abb-fc08-43ae-984a-bf95bae874d1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:33.923029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37297abb-fc08-43ae-984a-bf95bae874d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:33.955400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-37297abb-fc08-43ae-984a-bf95bae874d1 None None] MFA Rules not processed for user `33ac4a69ea634e1384e67250fe0c0722`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:33.958311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-37297abb-fc08-43ae-984a-bf95bae874d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:34.046573 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2845/5718] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:34.095303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847f7c8-30d7-4ba0-a8d7-b7d388a8d0c3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:34.096934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3847f7c8-30d7-4ba0-a8d7-b7d388a8d0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:34.183997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847f7c8-30d7-4ba0-a8d7-b7d388a8d0c3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:34.189035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2844fd4-ca86-4920-82ea-20d87fc4bd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:34.190216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2844fd4-ca86-4920-82ea-20d87fc4bd2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:34.190584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2844fd4-ca86-4920-82ea-20d87fc4bd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:34.190916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2844fd4-ca86-4920-82ea-20d87fc4bd2e admin admin] PATH_INFO: `/v3/projects/17301b9162c64692b99223cf57afd2f9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:34.192481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2844fd4-ca86-4920-82ea-20d87fc4bd2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=17301b9162c64692b99223cf57afd2f9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:34.195625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2844fd4-ca86-4920-82ea-20d87fc4bd2e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:34.234427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37297abb-fc08-43ae-984a-bf95bae874d1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:34.236555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-37297abb-fc08-43ae-984a-bf95bae874d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:34.265977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e2844fd4-ca86-4920-82ea-20d87fc4bd2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17301b9162c64692b99223cf57afd2f9', 'request_id': 'req-e2844fd4-ca86-4920-82ea-20d87fc4bd2e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:34.280708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e2844fd4-ca86-4920-82ea-20d87fc4bd2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17301b9162c64692b99223cf57afd2f9', 'request_id': 'req-e2844fd4-ca86-4920-82ea-20d87fc4bd2e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:34.289530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e2844fd4-ca86-4920-82ea-20d87fc4bd2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17301b9162c64692b99223cf57afd2f9', 'request_id': 'req-e2844fd4-ca86-4920-82ea-20d87fc4bd2e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:34.313601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e2844fd4-ca86-4920-82ea-20d87fc4bd2e admin admin] The token cache is being invalidate because project 17301b9162c64692b99223cf57afd2f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:34.313938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e2844fd4-ca86-4920-82ea-20d87fc4bd2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:34.315664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e2844fd4-ca86-4920-82ea-20d87fc4bd2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:34.320551 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2874/5719] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:34 2022] DELETE /identity/v3/projects/17301b9162c64692b99223cf57afd2f9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:34.327662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5e99c-8a3a-440f-9ae8-c8117a6b0278 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:34.328306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5e99c-8a3a-440f-9ae8-c8117a6b0278 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:34.328797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5e99c-8a3a-440f-9ae8-c8117a6b0278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:34.347869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:34.366090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-16a5e99c-8a3a-440f-9ae8-c8117a6b0278 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:34.371279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-16a5e99c-8a3a-440f-9ae8-c8117a6b0278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:34.412004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37297abb-fc08-43ae-984a-bf95bae874d1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:34.452028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:34.517031 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2875/5720] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:34.518815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facf62d-c9d0-40f1-9207-3a43cdc672d4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:34.519117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facf62d-c9d0-40f1-9207-3a43cdc672d4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:34.519448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facf62d-c9d0-40f1-9207-3a43cdc672d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:34.551109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb77a58-7da7-434b-ad91-992be61f104a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:34.552872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb77a58-7da7-434b-ad91-992be61f104a service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:34.553463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb77a58-7da7-434b-ad91-992be61f104a service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:34.553995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb77a58-7da7-434b-ad91-992be61f104a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:34.556365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9eb77a58-7da7-434b-ad91-992be61f104a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:34.574411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5facf62d-c9d0-40f1-9207-3a43cdc672d4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:34.576456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5facf62d-c9d0-40f1-9207-3a43cdc672d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:34.587471 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2876/5721] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:34.592194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facf62d-c9d0-40f1-9207-3a43cdc672d4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:34.613363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facf62d-c9d0-40f1-9207-3a43cdc672d4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:34.623191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bb03a-961e-498f-b201-4f3d78fb8231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:34.624133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bb03a-961e-498f-b201-4f3d78fb8231 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:34.624419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bb03a-961e-498f-b201-4f3d78fb8231 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:34.624793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bb03a-961e-498f-b201-4f3d78fb8231 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:34.625657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bb03a-961e-498f-b201-4f3d78fb8231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:22:34.626154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bb03a-961e-498f-b201-4f3d78fb8231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:34.628672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bb03a-961e-498f-b201-4f3d78fb8231 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:34.657957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb77a58-7da7-434b-ad91-992be61f104a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:34.660217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb77a58-7da7-434b-ad91-992be61f104a service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:34.666003 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2877/5722] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:22:34.668303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bb03a-961e-498f-b201-4f3d78fb8231 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:34.688630 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2846/5723] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:22:34.714594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bb03a-961e-498f-b201-4f3d78fb8231 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:34.722676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371550c-3d00-4776-87b1-5c58097f1925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:34.723494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371550c-3d00-4776-87b1-5c58097f1925 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:34.723876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371550c-3d00-4776-87b1-5c58097f1925 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:34.724291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371550c-3d00-4776-87b1-5c58097f1925 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:34.725239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371550c-3d00-4776-87b1-5c58097f1925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:34.727399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371550c-3d00-4776-87b1-5c58097f1925 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:34.777712 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2878/5724] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:34 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:34.782228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb77a58-7da7-434b-ad91-992be61f104a service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:34.795347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb77a58-7da7-434b-ad91-992be61f104a service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:34.874953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde61b2-e18b-4f66-8b66-fae46290b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:34.875647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde61b2-e18b-4f66-8b66-fae46290b26d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:34.875973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde61b2-e18b-4f66-8b66-fae46290b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:34.876254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde61b2-e18b-4f66-8b66-fae46290b26d admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:34.877006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde61b2-e18b-4f66-8b66-fae46290b26d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:34.882250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde61b2-e18b-4f66-8b66-fae46290b26d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:34.929972 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2847/5725] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:34 2022] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:34.933145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371550c-3d00-4776-87b1-5c58097f1925 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:34.956303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371550c-3d00-4776-87b1-5c58097f1925 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:34.962048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887c4a8-e1c5-42a0-bdbf-be66df238289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:34.962048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887c4a8-e1c5-42a0-bdbf-be66df238289 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:34.962048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887c4a8-e1c5-42a0-bdbf-be66df238289 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:34.962048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887c4a8-e1c5-42a0-bdbf-be66df238289 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:34.962704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887c4a8-e1c5-42a0-bdbf-be66df238289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:34.964257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887c4a8-e1c5-42a0-bdbf-be66df238289 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:34.977806 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2879/5726] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:22:34.981840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde61b2-e18b-4f66-8b66-fae46290b26d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:34.993513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde61b2-e18b-4f66-8b66-fae46290b26d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:34.999393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072e723-ad11-4034-9f5f-678bb77b2070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:35.000567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072e723-ad11-4034-9f5f-678bb77b2070 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:35.001086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072e723-ad11-4034-9f5f-678bb77b2070 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:35.001766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072e723-ad11-4034-9f5f-678bb77b2070 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:35.003049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072e723-ad11-4034-9f5f-678bb77b2070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:35.005824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072e723-ad11-4034-9f5f-678bb77b2070 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:35.019339 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2848/5727] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:35.027979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887c4a8-e1c5-42a0-bdbf-be66df238289 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:35.042734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887c4a8-e1c5-42a0-bdbf-be66df238289 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:35.050865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe01c7-bc2e-4428-872a-611677f7d382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:35.051789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe01c7-bc2e-4428-872a-611677f7d382 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:35.052098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe01c7-bc2e-4428-872a-611677f7d382 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:35.052507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe01c7-bc2e-4428-872a-611677f7d382 admin admin] PATH_INFO: `/v3/projects/dfacc53add254a3d91caafd39da31697/users/c3c8a44cd4964499ae07dcad9891a3a9/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:35.096586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe01c7-bc2e-4428-872a-611677f7d382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfacc53add254a3d91caafd39da31697, user_id=c3c8a44cd4964499ae07dcad9891a3a9, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:35.099336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe01c7-bc2e-4428-872a-611677f7d382 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:35.122007 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2880/5728] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:35 2022] PUT /identity/v3/projects/dfacc53add254a3d91caafd39da31697/users/c3c8a44cd4964499ae07dcad9891a3a9/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:35.134117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d50b1-6c7b-4392-a8a9-e7a084fc4dda None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:35.134493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d50b1-6c7b-4392-a8a9-e7a084fc4dda None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:35.134806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d50b1-6c7b-4392-a8a9-e7a084fc4dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:35.194662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-743d50b1-6c7b-4392-a8a9-e7a084fc4dda None None] MFA Rules not processed for user `c3c8a44cd4964499ae07dcad9891a3a9`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:35.198357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-743d50b1-6c7b-4392-a8a9-e7a084fc4dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:35.288113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:35.376685 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2849/5729] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:35.381464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe01c7-bc2e-4428-872a-611677f7d382 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:35.470048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe01c7-bc2e-4428-872a-611677f7d382 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:35.475526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71146d89-599a-4c81-9317-aff161dd00b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:35.476410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71146d89-599a-4c81-9317-aff161dd00b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:35.476822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71146d89-599a-4c81-9317-aff161dd00b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:35.477190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71146d89-599a-4c81-9317-aff161dd00b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:35.478081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71146d89-599a-4c81-9317-aff161dd00b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:35.485137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71146d89-599a-4c81-9317-aff161dd00b6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:35.554945 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2881/5730] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:35 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:35.556713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d50b1-6c7b-4392-a8a9-e7a084fc4dda None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:35.579517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d50b1-6c7b-4392-a8a9-e7a084fc4dda None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:35.709136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee85e8-f4bf-4883-966b-628b7b3ca3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:35.709985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee85e8-f4bf-4883-966b-628b7b3ca3aa admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:35.710364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee85e8-f4bf-4883-966b-628b7b3ca3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:35.710755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee85e8-f4bf-4883-966b-628b7b3ca3aa admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:35.711554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee85e8-f4bf-4883-966b-628b7b3ca3aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:35.715189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee85e8-f4bf-4883-966b-628b7b3ca3aa admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:35.748103 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2850/5731] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:35 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:35.750242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71146d89-599a-4c81-9317-aff161dd00b6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:35.770260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71146d89-599a-4c81-9317-aff161dd00b6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:35.777761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32273a-ec23-4792-8612-c388e92a41fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:35.778659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32273a-ec23-4792-8612-c388e92a41fe admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:35.779112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32273a-ec23-4792-8612-c388e92a41fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:35.779545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32273a-ec23-4792-8612-c388e92a41fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:35.780509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32273a-ec23-4792-8612-c388e92a41fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:35.782344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32273a-ec23-4792-8612-c388e92a41fe admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:35.812811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee85e8-f4bf-4883-966b-628b7b3ca3aa admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:35.813850 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2882/5732] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:35.835774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee85e8-f4bf-4883-966b-628b7b3ca3aa admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:35.843637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9afd3-7944-490b-9bd6-146a71375af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:35.844420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9afd3-7944-490b-9bd6-146a71375af2 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:35.845047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9afd3-7944-490b-9bd6-146a71375af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:35.845047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9afd3-7944-490b-9bd6-146a71375af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:35.846037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9afd3-7944-490b-9bd6-146a71375af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:35.848529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9afd3-7944-490b-9bd6-146a71375af2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:35.872811 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2851/5733] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:22:35.874542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32273a-ec23-4792-8612-c388e92a41fe admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:35.880004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:35.890434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32273a-ec23-4792-8612-c388e92a41fe admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:35.903551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82536a3-d91f-4fa4-b38e-207df396d912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:35.906404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82536a3-d91f-4fa4-b38e-207df396d912 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:35.907069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82536a3-d91f-4fa4-b38e-207df396d912 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:35.908493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82536a3-d91f-4fa4-b38e-207df396d912 admin admin] PATH_INFO: `/v3/projects/936a1925c6ae4b90becfd5506cdd2982/users/9ae166a81edb4c30ada1aa6f08114cf8/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:35.956824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82536a3-d91f-4fa4-b38e-207df396d912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936a1925c6ae4b90becfd5506cdd2982, user_id=9ae166a81edb4c30ada1aa6f08114cf8, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:35.966658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82536a3-d91f-4fa4-b38e-207df396d912 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:36.007045 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2883/5734] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:35 2022] PUT /identity/v3/projects/936a1925c6ae4b90becfd5506cdd2982/users/9ae166a81edb4c30ada1aa6f08114cf8/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:36.009110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d251ee-9d76-43e5-b81a-4b892151f349 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:36.009583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d251ee-9d76-43e5-b81a-4b892151f349 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:36.010476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d251ee-9d76-43e5-b81a-4b892151f349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:36.096336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-64d251ee-9d76-43e5-b81a-4b892151f349 None None] MFA Rules not processed for user `9ae166a81edb4c30ada1aa6f08114cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:36.127806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932eca36-2977-4c87-b67a-f358b075ba94 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:36.129729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932eca36-2977-4c87-b67a-f358b075ba94 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:36.130226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932eca36-2977-4c87-b67a-f358b075ba94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:36.131669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-64d251ee-9d76-43e5-b81a-4b892151f349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:36.153806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-932eca36-2977-4c87-b67a-f358b075ba94 None None] MFA Rules not processed for user `8fb8295b4af942d2be5d0cdb0a822868`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:36.155930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-932eca36-2977-4c87-b67a-f358b075ba94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:36.260607 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2852/5735] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:36.270904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d251ee-9d76-43e5-b81a-4b892151f349 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:36.273575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-64d251ee-9d76-43e5-b81a-4b892151f349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:36.302448 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2884/5736] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:36.373236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:36.411381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d251ee-9d76-43e5-b81a-4b892151f349 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:36.418013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e64888-ea4e-48de-bafa-7c74468a4be8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:36.418682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e64888-ea4e-48de-bafa-7c74468a4be8 service glance] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:36.418959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e64888-ea4e-48de-bafa-7c74468a4be8 service glance] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:36.419238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e64888-ea4e-48de-bafa-7c74468a4be8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:36.511578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40449d-c1c0-481f-b424-d313f51e55af None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:36.511873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40449d-c1c0-481f-b424-d313f51e55af None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:36.512178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40449d-c1c0-481f-b424-d313f51e55af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:36.533408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e64888-ea4e-48de-bafa-7c74468a4be8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:36.536342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e64888-ea4e-48de-bafa-7c74468a4be8 service glance] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:36.539426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4e40449d-c1c0-481f-b424-d313f51e55af None None] MFA Rules not processed for user `8659f358b57b4574a0703b39e4cb0004`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:36.541038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4e40449d-c1c0-481f-b424-d313f51e55af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:36.567962 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2853/5737] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:36.639220 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2885/5738] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:36.794925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e64888-ea4e-48de-bafa-7c74468a4be8 service glance] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:36.805903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e64888-ea4e-48de-bafa-7c74468a4be8 service glance] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:36.810410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd4aa1-97d0-4452-8eab-2d1335f75f78 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:36.811418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd4aa1-97d0-4452-8eab-2d1335f75f78 service glance] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:36.811418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd4aa1-97d0-4452-8eab-2d1335f75f78 service glance] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:36.811656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd4aa1-97d0-4452-8eab-2d1335f75f78 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:36.820872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd4aa1-97d0-4452-8eab-2d1335f75f78 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:36.822317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd4aa1-97d0-4452-8eab-2d1335f75f78 service glance] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:36.832712 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2854/5739] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:38.358253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40449d-c1c0-481f-b424-d313f51e55af None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:38.465336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40449d-c1c0-481f-b424-d313f51e55af None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:38.478982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b0d19-62a1-40de-a5e8-be72b0fe1f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:38.482061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b0d19-62a1-40de-a5e8-be72b0fe1f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:38.482359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b0d19-62a1-40de-a5e8-be72b0fe1f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:38.482846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b0d19-62a1-40de-a5e8-be72b0fe1f76 admin admin] PATH_INFO: `/v3/users/c3c8a44cd4964499ae07dcad9891a3a9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:38.484725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b0d19-62a1-40de-a5e8-be72b0fe1f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c8a44cd4964499ae07dcad9891a3a9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:38.486951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b0d19-62a1-40de-a5e8-be72b0fe1f76 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:38.540814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:38.605217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c5b0d19-62a1-40de-a5e8-be72b0fe1f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c8a44cd4964499ae07dcad9891a3a9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:38.629790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c5b0d19-62a1-40de-a5e8-be72b0fe1f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c8a44cd4964499ae07dcad9891a3a9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:38.630305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c5b0d19-62a1-40de-a5e8-be72b0fe1f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c8a44cd4964499ae07dcad9891a3a9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:38.631446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c5b0d19-62a1-40de-a5e8-be72b0fe1f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c8a44cd4964499ae07dcad9891a3a9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:38.645254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c5b0d19-62a1-40de-a5e8-be72b0fe1f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c8a44cd4964499ae07dcad9891a3a9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:38.688265 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2886/5740] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:38 2022] DELETE /identity/v3/users/c3c8a44cd4964499ae07dcad9891a3a9 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:38.689786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c312bb-544e-48cc-89c7-525b2d6e57bd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:38.690262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c312bb-544e-48cc-89c7-525b2d6e57bd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:38.690360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c312bb-544e-48cc-89c7-525b2d6e57bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:38.719120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-17c312bb-544e-48cc-89c7-525b2d6e57bd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:38.722098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-17c312bb-544e-48cc-89c7-525b2d6e57bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:38.907061 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2855/5741] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:22:38.927296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b0d19-62a1-40de-a5e8-be72b0fe1f76 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:38.929006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3c5b0d19-62a1-40de-a5e8-be72b0fe1f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:39.044546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b0d19-62a1-40de-a5e8-be72b0fe1f76 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:39.055472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936a328-a894-4380-a87c-d4a05ef3c668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:39.056272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936a328-a894-4380-a87c-d4a05ef3c668 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:39.056780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936a328-a894-4380-a87c-d4a05ef3c668 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:39.057145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936a328-a894-4380-a87c-d4a05ef3c668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:39.086004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936a328-a894-4380-a87c-d4a05ef3c668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:39.087994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936a328-a894-4380-a87c-d4a05ef3c668 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:39.109272 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2887/5742] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:40.126674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c312bb-544e-48cc-89c7-525b2d6e57bd None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:40.128256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-17c312bb-544e-48cc-89c7-525b2d6e57bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:40.162367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c312bb-544e-48cc-89c7-525b2d6e57bd None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:40.184794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf6dcf-d07e-4712-87c0-a65b243af308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:40.185984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf6dcf-d07e-4712-87c0-a65b243af308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:40.186274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf6dcf-d07e-4712-87c0-a65b243af308 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:40.186551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf6dcf-d07e-4712-87c0-a65b243af308 admin admin] PATH_INFO: `/v3/projects/dfacc53add254a3d91caafd39da31697` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:40.192243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf6dcf-d07e-4712-87c0-a65b243af308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfacc53add254a3d91caafd39da31697)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:40.194265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf6dcf-d07e-4712-87c0-a65b243af308 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:40.311505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dcbf6dcf-d07e-4712-87c0-a65b243af308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfacc53add254a3d91caafd39da31697', 'request_id': 'req-dcbf6dcf-d07e-4712-87c0-a65b243af308'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:40.321252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dcbf6dcf-d07e-4712-87c0-a65b243af308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfacc53add254a3d91caafd39da31697', 'request_id': 'req-dcbf6dcf-d07e-4712-87c0-a65b243af308'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:40.341289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:40.344661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dcbf6dcf-d07e-4712-87c0-a65b243af308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfacc53add254a3d91caafd39da31697', 'request_id': 'req-dcbf6dcf-d07e-4712-87c0-a65b243af308'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:40.365664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dcbf6dcf-d07e-4712-87c0-a65b243af308 admin admin] The token cache is being invalidate because project dfacc53add254a3d91caafd39da31697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:40.366372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dcbf6dcf-d07e-4712-87c0-a65b243af308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:40.367658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dcbf6dcf-d07e-4712-87c0-a65b243af308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:40.373328 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2856/5743] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:40 2022] DELETE /identity/v3/projects/dfacc53add254a3d91caafd39da31697 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:40.374372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936a328-a894-4380-a87c-d4a05ef3c668 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:40.385902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936a328-a894-4380-a87c-d4a05ef3c668 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:40.516263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3159c1-706c-41f3-ac40-76d8b28a45f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:40.517171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3159c1-706c-41f3-ac40-76d8b28a45f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:40.517594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3159c1-706c-41f3-ac40-76d8b28a45f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:40.517870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3159c1-706c-41f3-ac40-76d8b28a45f0 admin admin] PATH_INFO: `/v3/users/9ae166a81edb4c30ada1aa6f08114cf8` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:40.529024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3159c1-706c-41f3-ac40-76d8b28a45f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae166a81edb4c30ada1aa6f08114cf8)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:40.531017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3159c1-706c-41f3-ac40-76d8b28a45f0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:40.868506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:40.871027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7c3159c1-706c-41f3-ac40-76d8b28a45f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae166a81edb4c30ada1aa6f08114cf8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:40.884769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7c3159c1-706c-41f3-ac40-76d8b28a45f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae166a81edb4c30ada1aa6f08114cf8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:40.885724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7c3159c1-706c-41f3-ac40-76d8b28a45f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae166a81edb4c30ada1aa6f08114cf8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:40.886425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7c3159c1-706c-41f3-ac40-76d8b28a45f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae166a81edb4c30ada1aa6f08114cf8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:40.903149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7c3159c1-706c-41f3-ac40-76d8b28a45f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae166a81edb4c30ada1aa6f08114cf8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:40.944022 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2888/5744] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:40 2022] DELETE /identity/v3/users/9ae166a81edb4c30ada1aa6f08114cf8 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:41.410427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf6dcf-d07e-4712-87c0-a65b243af308 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:41.412005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dcbf6dcf-d07e-4712-87c0-a65b243af308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:41.443133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf6dcf-d07e-4712-87c0-a65b243af308 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:41.532641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd408db-8516-4793-9e46-7fe0a94de228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:41.533998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd408db-8516-4793-9e46-7fe0a94de228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:41.536424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd408db-8516-4793-9e46-7fe0a94de228 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:41.536939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd408db-8516-4793-9e46-7fe0a94de228 admin admin] PATH_INFO: `/v3/projects/936a1925c6ae4b90becfd5506cdd2982` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:41.543546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd408db-8516-4793-9e46-7fe0a94de228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=936a1925c6ae4b90becfd5506cdd2982)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:41.545823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd408db-8516-4793-9e46-7fe0a94de228 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:41.664944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6cd408db-8516-4793-9e46-7fe0a94de228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936a1925c6ae4b90becfd5506cdd2982', 'request_id': 'req-6cd408db-8516-4793-9e46-7fe0a94de228'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:41.692947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6cd408db-8516-4793-9e46-7fe0a94de228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936a1925c6ae4b90becfd5506cdd2982', 'request_id': 'req-6cd408db-8516-4793-9e46-7fe0a94de228'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:41.707999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6cd408db-8516-4793-9e46-7fe0a94de228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936a1925c6ae4b90becfd5506cdd2982', 'request_id': 'req-6cd408db-8516-4793-9e46-7fe0a94de228'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:41.741346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6cd408db-8516-4793-9e46-7fe0a94de228 admin admin] The token cache is being invalidate because project 936a1925c6ae4b90becfd5506cdd2982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:41.741779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6cd408db-8516-4793-9e46-7fe0a94de228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:41.742811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6cd408db-8516-4793-9e46-7fe0a94de228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:41.745221 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2857/5745] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:41 2022] DELETE /identity/v3/projects/936a1925c6ae4b90becfd5506cdd2982 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:41.751231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7681ee7-7683-4a2e-aff3-8772ff91fb4e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:41.751843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7681ee7-7683-4a2e-aff3-8772ff91fb4e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:41.751969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7681ee7-7683-4a2e-aff3-8772ff91fb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:41.774788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f7681ee7-7683-4a2e-aff3-8772ff91fb4e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:41.776331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f7681ee7-7683-4a2e-aff3-8772ff91fb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:41.880493 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2889/5746] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:41.882231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c70b3-0576-4a85-b06d-4d41527fe125 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:41.882522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c70b3-0576-4a85-b06d-4d41527fe125 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:41.882806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c70b3-0576-4a85-b06d-4d41527fe125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:41.908899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a56c70b3-0576-4a85-b06d-4d41527fe125 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:41.910552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a56c70b3-0576-4a85-b06d-4d41527fe125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:41.925636 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2858/5747] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:41.928139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7681ee7-7683-4a2e-aff3-8772ff91fb4e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:41.942959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7681ee7-7683-4a2e-aff3-8772ff91fb4e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:41.953037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206e7fd-2b00-4487-a983-d0ba18d8a0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:41.953727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206e7fd-2b00-4487-a983-d0ba18d8a0da admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:41.954013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206e7fd-2b00-4487-a983-d0ba18d8a0da admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:41.954570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206e7fd-2b00-4487-a983-d0ba18d8a0da admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:41.955384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206e7fd-2b00-4487-a983-d0ba18d8a0da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:22:41.955705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206e7fd-2b00-4487-a983-d0ba18d8a0da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:41.957496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206e7fd-2b00-4487-a983-d0ba18d8a0da admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:41.971690 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2890/5748] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:22:41.976314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c70b3-0576-4a85-b06d-4d41527fe125 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:41.992719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c70b3-0576-4a85-b06d-4d41527fe125 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:41.998284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e31d2-af8a-45d8-abb5-96f5f7c8a90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:41.999623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e31d2-af8a-45d8-abb5-96f5f7c8a90f admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:42.000366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e31d2-af8a-45d8-abb5-96f5f7c8a90f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:42.000978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e31d2-af8a-45d8-abb5-96f5f7c8a90f admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:42.001975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e31d2-af8a-45d8-abb5-96f5f7c8a90f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:42.004485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e31d2-af8a-45d8-abb5-96f5f7c8a90f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:42.035034 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2859/5749] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:41 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:42.039190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206e7fd-2b00-4487-a983-d0ba18d8a0da admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:42.051352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206e7fd-2b00-4487-a983-d0ba18d8a0da admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:42.115410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d93f3c-638f-4220-89f0-21577fc6ecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:42.116192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d93f3c-638f-4220-89f0-21577fc6ecc6 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:42.116477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d93f3c-638f-4220-89f0-21577fc6ecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:42.116843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d93f3c-638f-4220-89f0-21577fc6ecc6 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:42.117534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d93f3c-638f-4220-89f0-21577fc6ecc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:42.120603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d93f3c-638f-4220-89f0-21577fc6ecc6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:42.152787 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2891/5750] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:42 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:22:42.166230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e31d2-af8a-45d8-abb5-96f5f7c8a90f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:42.182227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e31d2-af8a-45d8-abb5-96f5f7c8a90f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:42.191934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889776c-0c80-4401-a9b5-3707e2c88a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:42.192915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889776c-0c80-4401-a9b5-3707e2c88a48 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:42.193438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889776c-0c80-4401-a9b5-3707e2c88a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:42.193895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889776c-0c80-4401-a9b5-3707e2c88a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:42.194809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889776c-0c80-4401-a9b5-3707e2c88a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:42.196918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889776c-0c80-4401-a9b5-3707e2c88a48 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:42.212360 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2860/5751] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:42.216429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d93f3c-638f-4220-89f0-21577fc6ecc6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:42.228007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d93f3c-638f-4220-89f0-21577fc6ecc6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:42.234462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2c1dd-c636-489f-b795-1acb3d1f954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:42.235262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2c1dd-c636-489f-b795-1acb3d1f954e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:42.235779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2c1dd-c636-489f-b795-1acb3d1f954e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:42.236223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2c1dd-c636-489f-b795-1acb3d1f954e admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:42.237098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2c1dd-c636-489f-b795-1acb3d1f954e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:42.238889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2c1dd-c636-489f-b795-1acb3d1f954e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:42.251023 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2892/5752] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:42.255862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889776c-0c80-4401-a9b5-3707e2c88a48 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:42.270038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889776c-0c80-4401-a9b5-3707e2c88a48 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:42.275373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe62b9-9bac-489b-8551-643fe7344e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:42.276313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe62b9-9bac-489b-8551-643fe7344e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:42.276588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe62b9-9bac-489b-8551-643fe7344e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:42.276858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe62b9-9bac-489b-8551-643fe7344e36 admin admin] PATH_INFO: `/v3/projects/0057bd885ece4c4f97d026cf0a7ebd82/users/b01083e9351e4d4abf92c3d73bb4aa67/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:42.295819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe62b9-9bac-489b-8551-643fe7344e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0057bd885ece4c4f97d026cf0a7ebd82, user_id=b01083e9351e4d4abf92c3d73bb4aa67, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:42.299041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe62b9-9bac-489b-8551-643fe7344e36 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:42.320094 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2861/5753] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:42 2022] PUT /identity/v3/projects/0057bd885ece4c4f97d026cf0a7ebd82/users/b01083e9351e4d4abf92c3d73bb4aa67/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:22:42.331221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fef7d4-a9df-49f2-92c6-66d216ca958e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:42.331586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fef7d4-a9df-49f2-92c6-66d216ca958e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:42.331928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fef7d4-a9df-49f2-92c6-66d216ca958e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:42.379875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c4fef7d4-a9df-49f2-92c6-66d216ca958e None None] MFA Rules not processed for user `b01083e9351e4d4abf92c3d73bb4aa67`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:42.381314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c4fef7d4-a9df-49f2-92c6-66d216ca958e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:42.398597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:42.478825 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2893/5754] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:42.491069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe62b9-9bac-489b-8551-643fe7344e36 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:42.495344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2abe62b9-9bac-489b-8551-643fe7344e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:42.518371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:42.623328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe62b9-9bac-489b-8551-643fe7344e36 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:42.634088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa1510-407b-4048-836b-d14cda7562ac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:42.635138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa1510-407b-4048-836b-d14cda7562ac service glance] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:42.637115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa1510-407b-4048-836b-d14cda7562ac service glance] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:42.637504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa1510-407b-4048-836b-d14cda7562ac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:42.654722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fef7d4-a9df-49f2-92c6-66d216ca958e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:42.658155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c4fef7d4-a9df-49f2-92c6-66d216ca958e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:42.659316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa1510-407b-4048-836b-d14cda7562ac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:42.664939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa1510-407b-4048-836b-d14cda7562ac service glance] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:42.679142 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2862/5755] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:42.758822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fef7d4-a9df-49f2-92c6-66d216ca958e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:42.765604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a8924-a834-43bd-b80c-b2e99d5e2fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:42.766797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a8924-a834-43bd-b80c-b2e99d5e2fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:42.767179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a8924-a834-43bd-b80c-b2e99d5e2fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:42.767408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a8924-a834-43bd-b80c-b2e99d5e2fb0 admin admin] PATH_INFO: `/v3/users/838e41d1df5c4f298c10b1f2ed24e159` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:42.768871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a8924-a834-43bd-b80c-b2e99d5e2fb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=838e41d1df5c4f298c10b1f2ed24e159)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:42.770946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a8924-a834-43bd-b80c-b2e99d5e2fb0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:42.836729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f22a8924-a834-43bd-b80c-b2e99d5e2fb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '838e41d1df5c4f298c10b1f2ed24e159'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:42.861431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f22a8924-a834-43bd-b80c-b2e99d5e2fb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '838e41d1df5c4f298c10b1f2ed24e159'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:42.862394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f22a8924-a834-43bd-b80c-b2e99d5e2fb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '838e41d1df5c4f298c10b1f2ed24e159'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:42.863677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f22a8924-a834-43bd-b80c-b2e99d5e2fb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '838e41d1df5c4f298c10b1f2ed24e159'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:42.883136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f22a8924-a834-43bd-b80c-b2e99d5e2fb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '838e41d1df5c4f298c10b1f2ed24e159'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:42.889701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa1510-407b-4048-836b-d14cda7562ac service glance] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:42.901808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa1510-407b-4048-836b-d14cda7562ac service glance] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:42.903810 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2894/5756] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:42 2022] DELETE /identity/v3/users/838e41d1df5c4f298c10b1f2ed24e159 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:22:42.908224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c53b2-6891-406d-8858-500ecd43c5bc None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:42.908513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c53b2-6891-406d-8858-500ecd43c5bc None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:42.908791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c53b2-6891-406d-8858-500ecd43c5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:42.928464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-283c53b2-6891-406d-8858-500ecd43c5bc None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:42.929693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-283c53b2-6891-406d-8858-500ecd43c5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:42.965390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:42.974765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0028f-7bc2-462a-a09e-07ef203d42fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:42.976273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0028f-7bc2-462a-a09e-07ef203d42fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:42.976652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0028f-7bc2-462a-a09e-07ef203d42fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:42.977287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0028f-7bc2-462a-a09e-07ef203d42fb admin admin] PATH_INFO: `/v3/users/b01083e9351e4d4abf92c3d73bb4aa67` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:42.979820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0028f-7bc2-462a-a09e-07ef203d42fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b01083e9351e4d4abf92c3d73bb4aa67)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:42.982131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0028f-7bc2-462a-a09e-07ef203d42fb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:43.018826 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2895/5757] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:22:43.030821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c53b2-6891-406d-8858-500ecd43c5bc None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:43.032537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-283c53b2-6891-406d-8858-500ecd43c5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:43.069093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23b0028f-7bc2-462a-a09e-07ef203d42fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b01083e9351e4d4abf92c3d73bb4aa67'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:43.082312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23b0028f-7bc2-462a-a09e-07ef203d42fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b01083e9351e4d4abf92c3d73bb4aa67'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:43.105072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23b0028f-7bc2-462a-a09e-07ef203d42fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b01083e9351e4d4abf92c3d73bb4aa67'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:43.106142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23b0028f-7bc2-462a-a09e-07ef203d42fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b01083e9351e4d4abf92c3d73bb4aa67'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:43.107795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23b0028f-7bc2-462a-a09e-07ef203d42fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b01083e9351e4d4abf92c3d73bb4aa67'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:43.119499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c53b2-6891-406d-8858-500ecd43c5bc None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:43.123429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915217d0-8296-404f-b331-8a520a5b12c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:43.125138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915217d0-8296-404f-b331-8a520a5b12c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:43.125435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915217d0-8296-404f-b331-8a520a5b12c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:43.125714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915217d0-8296-404f-b331-8a520a5b12c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:43.127806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-915217d0-8296-404f-b331-8a520a5b12c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:43.154352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915217d0-8296-404f-b331-8a520a5b12c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:43.156301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915217d0-8296-404f-b331-8a520a5b12c9 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:43.156442 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2863/5758] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:42 2022] DELETE /identity/v3/users/b01083e9351e4d4abf92c3d73bb4aa67 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:22:43.158179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8362e3f-5fd8-4152-ab5f-dcf59c1f42ca None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:43.158556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8362e3f-5fd8-4152-ab5f-dcf59c1f42ca None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:43.158842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8362e3f-5fd8-4152-ab5f-dcf59c1f42ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:43.186251 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2896/5759] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:22:43.189566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a8362e3f-5fd8-4152-ab5f-dcf59c1f42ca None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:43.191281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a8362e3f-5fd8-4152-ab5f-dcf59c1f42ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:43.238868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:43.284789 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2864/5760] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:43.299350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915217d0-8296-404f-b331-8a520a5b12c9 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:43.301119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-915217d0-8296-404f-b331-8a520a5b12c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:43.315922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915217d0-8296-404f-b331-8a520a5b12c9 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:43.412693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffeb92a-5af9-4dc6-8fac-6023c8b62601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:43.413427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffeb92a-5af9-4dc6-8fac-6023c8b62601 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:43.413567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffeb92a-5af9-4dc6-8fac-6023c8b62601 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:43.413915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffeb92a-5af9-4dc6-8fac-6023c8b62601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:43.435595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffeb92a-5af9-4dc6-8fac-6023c8b62601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:43.438908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffeb92a-5af9-4dc6-8fac-6023c8b62601 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:43.456011 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2897/5761] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:43.620113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8362e3f-5fd8-4152-ab5f-dcf59c1f42ca None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:43.622466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a8362e3f-5fd8-4152-ab5f-dcf59c1f42ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:43.677016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8362e3f-5fd8-4152-ab5f-dcf59c1f42ca None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:43.707917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b6468-102f-460b-a09d-eb840db85379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:43.709906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b6468-102f-460b-a09d-eb840db85379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:43.711343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b6468-102f-460b-a09d-eb840db85379 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:43.713238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b6468-102f-460b-a09d-eb840db85379 admin admin] PATH_INFO: `/v3/projects/c2e599cf997d46eab7c1f1f99eb809ba` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:43.731498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b6468-102f-460b-a09d-eb840db85379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2e599cf997d46eab7c1f1f99eb809ba)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:43.740330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b6468-102f-460b-a09d-eb840db85379 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:43.840735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-be9b6468-102f-460b-a09d-eb840db85379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2e599cf997d46eab7c1f1f99eb809ba', 'request_id': 'req-be9b6468-102f-460b-a09d-eb840db85379'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:43.854214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-be9b6468-102f-460b-a09d-eb840db85379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2e599cf997d46eab7c1f1f99eb809ba', 'request_id': 'req-be9b6468-102f-460b-a09d-eb840db85379'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:43.861099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-be9b6468-102f-460b-a09d-eb840db85379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2e599cf997d46eab7c1f1f99eb809ba', 'request_id': 'req-be9b6468-102f-460b-a09d-eb840db85379'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:43.882813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-be9b6468-102f-460b-a09d-eb840db85379 admin admin] The token cache is being invalidate because project c2e599cf997d46eab7c1f1f99eb809ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:43.883117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-be9b6468-102f-460b-a09d-eb840db85379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:43.883834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-be9b6468-102f-460b-a09d-eb840db85379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:43.885843 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2865/5762] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:43 2022] DELETE /identity/v3/projects/c2e599cf997d46eab7c1f1f99eb809ba => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:43.889894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffeb92a-5af9-4dc6-8fac-6023c8b62601 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:43.905820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffeb92a-5af9-4dc6-8fac-6023c8b62601 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:43.919318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b6468-102f-460b-a09d-eb840db85379 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:43.920950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-be9b6468-102f-460b-a09d-eb840db85379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:44.006931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa980994-59a6-48e5-a630-77859bd8a1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:44.007829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa980994-59a6-48e5-a630-77859bd8a1bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:44.008158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa980994-59a6-48e5-a630-77859bd8a1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:44.008444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa980994-59a6-48e5-a630-77859bd8a1bd admin admin] PATH_INFO: `/v3/users/35039ce9576f46d5b1203a94b96c5831` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:44.009769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa980994-59a6-48e5-a630-77859bd8a1bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=35039ce9576f46d5b1203a94b96c5831)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:44.012430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa980994-59a6-48e5-a630-77859bd8a1bd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:44.019473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b6468-102f-460b-a09d-eb840db85379 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:44.025753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f9784-aae2-48a5-96c2-b1b9744849db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:44.026984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f9784-aae2-48a5-96c2-b1b9744849db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:44.027269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f9784-aae2-48a5-96c2-b1b9744849db admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:44.027543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f9784-aae2-48a5-96c2-b1b9744849db admin admin] PATH_INFO: `/v3/projects/0057bd885ece4c4f97d026cf0a7ebd82` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:44.028771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f9784-aae2-48a5-96c2-b1b9744849db admin admin] RBAC: Authorizing `identity:delete_project(project_id=0057bd885ece4c4f97d026cf0a7ebd82)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:44.030880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f9784-aae2-48a5-96c2-b1b9744849db admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:44.044189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:44.074725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-aa980994-59a6-48e5-a630-77859bd8a1bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35039ce9576f46d5b1203a94b96c5831'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:44.086229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-782f9784-aae2-48a5-96c2-b1b9744849db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0057bd885ece4c4f97d026cf0a7ebd82', 'request_id': 'req-782f9784-aae2-48a5-96c2-b1b9744849db'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:44.097411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-782f9784-aae2-48a5-96c2-b1b9744849db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0057bd885ece4c4f97d026cf0a7ebd82', 'request_id': 'req-782f9784-aae2-48a5-96c2-b1b9744849db'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:44.104785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-aa980994-59a6-48e5-a630-77859bd8a1bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35039ce9576f46d5b1203a94b96c5831'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:44.105615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-aa980994-59a6-48e5-a630-77859bd8a1bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35039ce9576f46d5b1203a94b96c5831'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:44.106694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-aa980994-59a6-48e5-a630-77859bd8a1bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35039ce9576f46d5b1203a94b96c5831'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:44.108724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-782f9784-aae2-48a5-96c2-b1b9744849db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0057bd885ece4c4f97d026cf0a7ebd82', 'request_id': 'req-782f9784-aae2-48a5-96c2-b1b9744849db'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:44.112433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:44.119427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-aa980994-59a6-48e5-a630-77859bd8a1bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35039ce9576f46d5b1203a94b96c5831'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:44.131968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-782f9784-aae2-48a5-96c2-b1b9744849db admin admin] The token cache is being invalidate because project 0057bd885ece4c4f97d026cf0a7ebd82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:44.132722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-782f9784-aae2-48a5-96c2-b1b9744849db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:44.133796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-782f9784-aae2-48a5-96c2-b1b9744849db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:44.136022 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2866/5763] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:43 2022] DELETE /identity/v3/projects/0057bd885ece4c4f97d026cf0a7ebd82 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:22:44.141779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457c5fa-a75b-4762-aafd-91e0b76d152a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:44.142256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457c5fa-a75b-4762-aafd-91e0b76d152a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:44.143033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457c5fa-a75b-4762-aafd-91e0b76d152a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:44.152723 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2898/5764] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:43 2022] DELETE /identity/v3/users/35039ce9576f46d5b1203a94b96c5831 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:44.167655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9457c5fa-a75b-4762-aafd-91e0b76d152a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:44.168822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9457c5fa-a75b-4762-aafd-91e0b76d152a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:44.263071 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2867/5765] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:22:44.272417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b40d4-a66d-42ec-8e8d-9832f7640971 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:44.272705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b40d4-a66d-42ec-8e8d-9832f7640971 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:44.272968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b40d4-a66d-42ec-8e8d-9832f7640971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:44.298450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-167b40d4-a66d-42ec-8e8d-9832f7640971 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:44.299870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-167b40d4-a66d-42ec-8e8d-9832f7640971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:44.310440 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2899/5766] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:44.316229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457c5fa-a75b-4762-aafd-91e0b76d152a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:44.329770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457c5fa-a75b-4762-aafd-91e0b76d152a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:44.335695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669c502-d6b1-46be-8619-9d49bce7bb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:44.336861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669c502-d6b1-46be-8619-9d49bce7bb49 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:44.337229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669c502-d6b1-46be-8619-9d49bce7bb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:44.337936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669c502-d6b1-46be-8619-9d49bce7bb49 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:44.338752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669c502-d6b1-46be-8619-9d49bce7bb49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:22:44.341423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669c502-d6b1-46be-8619-9d49bce7bb49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:44.341423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669c502-d6b1-46be-8619-9d49bce7bb49 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:44.362033 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2868/5767] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:22:44.363670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b40d4-a66d-42ec-8e8d-9832f7640971 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:44.379201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b40d4-a66d-42ec-8e8d-9832f7640971 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:44.387473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab84386-60ad-4fef-9db9-f93b9d859d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:44.387473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab84386-60ad-4fef-9db9-f93b9d859d4e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:44.387473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab84386-60ad-4fef-9db9-f93b9d859d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:44.387473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab84386-60ad-4fef-9db9-f93b9d859d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:44.387925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab84386-60ad-4fef-9db9-f93b9d859d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:44.389432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab84386-60ad-4fef-9db9-f93b9d859d4e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:44.402083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669c502-d6b1-46be-8619-9d49bce7bb49 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:44.403896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8669c502-d6b1-46be-8619-9d49bce7bb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:44.419797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669c502-d6b1-46be-8619-9d49bce7bb49 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:44.434821 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2900/5768] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:44 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:44.450906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab84386-60ad-4fef-9db9-f93b9d859d4e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:44.454035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81192ebc-5238-4c02-bfac-526f3f098b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:44.455854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81192ebc-5238-4c02-bfac-526f3f098b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:44.456227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81192ebc-5238-4c02-bfac-526f3f098b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:44.456476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81192ebc-5238-4c02-bfac-526f3f098b9a admin admin] PATH_INFO: `/v3/projects/4d080b32770a4d0ca3fb5c5c2ad1a76d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:44.459512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81192ebc-5238-4c02-bfac-526f3f098b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d080b32770a4d0ca3fb5c5c2ad1a76d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:44.465265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81192ebc-5238-4c02-bfac-526f3f098b9a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:44.540717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-81192ebc-5238-4c02-bfac-526f3f098b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d080b32770a4d0ca3fb5c5c2ad1a76d', 'request_id': 'req-81192ebc-5238-4c02-bfac-526f3f098b9a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:44.550972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-81192ebc-5238-4c02-bfac-526f3f098b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d080b32770a4d0ca3fb5c5c2ad1a76d', 'request_id': 'req-81192ebc-5238-4c02-bfac-526f3f098b9a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:44.551849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab84386-60ad-4fef-9db9-f93b9d859d4e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:44.557936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-81192ebc-5238-4c02-bfac-526f3f098b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d080b32770a4d0ca3fb5c5c2ad1a76d', 'request_id': 'req-81192ebc-5238-4c02-bfac-526f3f098b9a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:44.578730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-81192ebc-5238-4c02-bfac-526f3f098b9a admin admin] The token cache is being invalidate because project 4d080b32770a4d0ca3fb5c5c2ad1a76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:44.579138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-81192ebc-5238-4c02-bfac-526f3f098b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:44.579865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-81192ebc-5238-4c02-bfac-526f3f098b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:44.581672 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2869/5769] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:44 2022] DELETE /identity/v3/projects/4d080b32770a4d0ca3fb5c5c2ad1a76d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:44.587479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da579b17-c7ae-407c-8e00-ba5c7d256b9a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:44.587810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da579b17-c7ae-407c-8e00-ba5c7d256b9a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:44.588077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da579b17-c7ae-407c-8e00-ba5c7d256b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:44.623237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-da579b17-c7ae-407c-8e00-ba5c7d256b9a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:44.624807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-da579b17-c7ae-407c-8e00-ba5c7d256b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:44.714532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569951b2-ba29-4782-afd4-af0df7ab090b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:44.714896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569951b2-ba29-4782-afd4-af0df7ab090b admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:44.715317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569951b2-ba29-4782-afd4-af0df7ab090b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:44.715595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569951b2-ba29-4782-afd4-af0df7ab090b admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:44.719141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569951b2-ba29-4782-afd4-af0df7ab090b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:44.723398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569951b2-ba29-4782-afd4-af0df7ab090b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:44.784398 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2870/5770] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:44.793370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded530b-9db1-4428-a98e-90e320f3960c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:44.793954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded530b-9db1-4428-a98e-90e320f3960c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:44.794514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded530b-9db1-4428-a98e-90e320f3960c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:44.810154 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2901/5771] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:44 2022] POST /identity/v3/users => generated 287 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:44.812857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:44.815958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569951b2-ba29-4782-afd4-af0df7ab090b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:44.831381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-569951b2-ba29-4782-afd4-af0df7ab090b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:44.876733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2ded530b-9db1-4428-a98e-90e320f3960c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:44.879940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2ded530b-9db1-4428-a98e-90e320f3960c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:44.894133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569951b2-ba29-4782-afd4-af0df7ab090b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:44.896515 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2871/5772] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:22:44.899773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a47d45-a3e0-42c5-b0ad-1f2d5face1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:44.900569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a47d45-a3e0-42c5-b0ad-1f2d5face1df admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:44.901070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a47d45-a3e0-42c5-b0ad-1f2d5face1df admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:44.901588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a47d45-a3e0-42c5-b0ad-1f2d5face1df admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:44.901947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded530b-9db1-4428-a98e-90e320f3960c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:44.902731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a47d45-a3e0-42c5-b0ad-1f2d5face1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:44.904650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a47d45-a3e0-42c5-b0ad-1f2d5face1df admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:44.912189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:44.914586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded530b-9db1-4428-a98e-90e320f3960c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:44.926640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303a88c-298d-4497-85ac-41aa13da4ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:44.927924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303a88c-298d-4497-85ac-41aa13da4ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:44.928570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303a88c-298d-4497-85ac-41aa13da4ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:44.929016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303a88c-298d-4497-85ac-41aa13da4ee0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:44.930348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303a88c-298d-4497-85ac-41aa13da4ee0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:22:44.932439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303a88c-298d-4497-85ac-41aa13da4ee0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:44.934425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303a88c-298d-4497-85ac-41aa13da4ee0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:44.937454 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2902/5773] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:44.940346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a47d45-a3e0-42c5-b0ad-1f2d5face1df admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:44.952324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a47d45-a3e0-42c5-b0ad-1f2d5face1df admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:44.956124 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2872/5774] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:22:44.960877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303a88c-298d-4497-85ac-41aa13da4ee0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:44.963450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c112f-6a5b-4bb6-a99b-cbe059d2e80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:44.964188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c112f-6a5b-4bb6-a99b-cbe059d2e80d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:44.964477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c112f-6a5b-4bb6-a99b-cbe059d2e80d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:44.964756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c112f-6a5b-4bb6-a99b-cbe059d2e80d admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:44.967911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c112f-6a5b-4bb6-a99b-cbe059d2e80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:44.970266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c112f-6a5b-4bb6-a99b-cbe059d2e80d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:44.977381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303a88c-298d-4497-85ac-41aa13da4ee0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:44.983430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ef02f-b4d1-40df-b781-68f55417c613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:44.984402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ef02f-b4d1-40df-b781-68f55417c613 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:44.984867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ef02f-b4d1-40df-b781-68f55417c613 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:44.985394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ef02f-b4d1-40df-b781-68f55417c613 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:44.986506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ef02f-b4d1-40df-b781-68f55417c613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:44.989232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ef02f-b4d1-40df-b781-68f55417c613 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:44.991634 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2903/5775] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:44.995018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c112f-6a5b-4bb6-a99b-cbe059d2e80d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:45.006905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c112f-6a5b-4bb6-a99b-cbe059d2e80d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:45.012376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46598f86-2f8c-4708-882a-2b21210b259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:45.013026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46598f86-2f8c-4708-882a-2b21210b259b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:45.013474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46598f86-2f8c-4708-882a-2b21210b259b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:45.013729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46598f86-2f8c-4708-882a-2b21210b259b admin admin] PATH_INFO: `/v3/projects/97b69125db1f4138afbff48ec4824cc6/users/9645ef8fd0b54bae869e961f6baea0d3/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:45.030919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46598f86-2f8c-4708-882a-2b21210b259b admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b69125db1f4138afbff48ec4824cc6, user_id=9645ef8fd0b54bae869e961f6baea0d3, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:45.033883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46598f86-2f8c-4708-882a-2b21210b259b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:45.042293 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2873/5776] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:44 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:22:45.046857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ef02f-b4d1-40df-b781-68f55417c613 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:45.058239 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2904/5777] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:44 2022] PUT /identity/v3/projects/97b69125db1f4138afbff48ec4824cc6/users/9645ef8fd0b54bae869e961f6baea0d3/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:45.068971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3391aa-0442-4a86-be18-fa6ccf5dc10e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:45.069334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3391aa-0442-4a86-be18-fa6ccf5dc10e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:45.069681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3391aa-0442-4a86-be18-fa6ccf5dc10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:45.115134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ed3391aa-0442-4a86-be18-fa6ccf5dc10e None None] MFA Rules not processed for user `9645ef8fd0b54bae869e961f6baea0d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:45.116686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ed3391aa-0442-4a86-be18-fa6ccf5dc10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:45.179796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ef02f-b4d1-40df-b781-68f55417c613 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:45.232515 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2905/5778] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:22:45.237293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3391aa-0442-4a86-be18-fa6ccf5dc10e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:45.311430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0920901-f236-46d0-8d21-b626c728ab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:45.313061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0920901-f236-46d0-8d21-b626c728ab31 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:45.315313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0920901-f236-46d0-8d21-b626c728ab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:45.315760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0920901-f236-46d0-8d21-b626c728ab31 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:45.318663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0920901-f236-46d0-8d21-b626c728ab31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:45.324387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0920901-f236-46d0-8d21-b626c728ab31 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:45.366889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3391aa-0442-4a86-be18-fa6ccf5dc10e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:45.367325 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2874/5779] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:45 2022] POST /identity/v3/users => generated 292 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:45.369445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0920901-f236-46d0-8d21-b626c728ab31 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:45.372659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d908bc4-7b33-4dda-9369-f05214f0e1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:45.373479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d908bc4-7b33-4dda-9369-f05214f0e1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:45.374287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d908bc4-7b33-4dda-9369-f05214f0e1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:45.374576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d908bc4-7b33-4dda-9369-f05214f0e1a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:45.375832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d908bc4-7b33-4dda-9369-f05214f0e1a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:45.379266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d908bc4-7b33-4dda-9369-f05214f0e1a5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:45.384511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0920901-f236-46d0-8d21-b626c728ab31 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:45.392691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7b231-8c09-4ad2-8fa5-e832b9976a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:45.393750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7b231-8c09-4ad2-8fa5-e832b9976a81 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:45.394318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7b231-8c09-4ad2-8fa5-e832b9976a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:45.394734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7b231-8c09-4ad2-8fa5-e832b9976a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:45.395717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7b231-8c09-4ad2-8fa5-e832b9976a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:45.398030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7b231-8c09-4ad2-8fa5-e832b9976a81 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:45.413977 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2875/5780] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:45.418464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7b231-8c09-4ad2-8fa5-e832b9976a81 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:45.421177 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2906/5781] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:45 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:45.425371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d908bc4-7b33-4dda-9369-f05214f0e1a5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:45.436960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7b231-8c09-4ad2-8fa5-e832b9976a81 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:45.473888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:45.495540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:45.501567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d908bc4-7b33-4dda-9369-f05214f0e1a5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:45.508687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6cc78-86bc-4ad2-8a1e-5ba64e9a0024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:45.509374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6cc78-86bc-4ad2-8a1e-5ba64e9a0024 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:45.509657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6cc78-86bc-4ad2-8a1e-5ba64e9a0024 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:45.510030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6cc78-86bc-4ad2-8a1e-5ba64e9a0024 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:45.510633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6cc78-86bc-4ad2-8a1e-5ba64e9a0024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:45.512858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6cc78-86bc-4ad2-8a1e-5ba64e9a0024 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:45.515904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aee37d-596a-4aca-b4b7-648293058f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:45.516270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aee37d-596a-4aca-b4b7-648293058f99 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:45.516618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aee37d-596a-4aca-b4b7-648293058f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:45.516957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aee37d-596a-4aca-b4b7-648293058f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:45.517832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aee37d-596a-4aca-b4b7-648293058f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:45.519484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aee37d-596a-4aca-b4b7-648293058f99 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:45.535942 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2876/5782] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:45.539571 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2907/5783] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:45 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:22:45.539724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aee37d-596a-4aca-b4b7-648293058f99 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:45.540754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6cc78-86bc-4ad2-8a1e-5ba64e9a0024 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:45.550366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aee37d-596a-4aca-b4b7-648293058f99 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:45.556549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3baee5b-e2a0-4eda-aede-6a637f14c6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:45.557519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3baee5b-e2a0-4eda-aede-6a637f14c6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:45.557806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3baee5b-e2a0-4eda-aede-6a637f14c6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:45.558149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3baee5b-e2a0-4eda-aede-6a637f14c6f6 admin admin] PATH_INFO: `/v3/projects/809ce42bc72045fda1d6cacaf7dc3ee1/users/5c71996409f64ba38ba0dfbe9ef57150/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:45.569419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6cc78-86bc-4ad2-8a1e-5ba64e9a0024 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:45.576997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88a287-85f4-45a6-837c-749b31529948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:45.577980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3baee5b-e2a0-4eda-aede-6a637f14c6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809ce42bc72045fda1d6cacaf7dc3ee1, user_id=5c71996409f64ba38ba0dfbe9ef57150, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:45.578130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88a287-85f4-45a6-837c-749b31529948 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:45.578552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88a287-85f4-45a6-837c-749b31529948 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:45.578825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88a287-85f4-45a6-837c-749b31529948 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:45.579549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88a287-85f4-45a6-837c-749b31529948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:45.581289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3baee5b-e2a0-4eda-aede-6a637f14c6f6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:45.581443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88a287-85f4-45a6-837c-749b31529948 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:45.595963 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2908/5784] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:45.599923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88a287-85f4-45a6-837c-749b31529948 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:45.601424 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2877/5785] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:45 2022] PUT /identity/v3/projects/809ce42bc72045fda1d6cacaf7dc3ee1/users/5c71996409f64ba38ba0dfbe9ef57150/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:45.611540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b7b77-c2d6-4f7f-825c-db13ae9e8d68 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:45.612233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b7b77-c2d6-4f7f-825c-db13ae9e8d68 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:45.612527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b7b77-c2d6-4f7f-825c-db13ae9e8d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:45.613955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88a287-85f4-45a6-837c-749b31529948 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:45.642716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0a7b7b77-c2d6-4f7f-825c-db13ae9e8d68 None None] MFA Rules not processed for user `5c71996409f64ba38ba0dfbe9ef57150`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:45.643729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0a7b7b77-c2d6-4f7f-825c-db13ae9e8d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:45.698918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77d40a-78a6-4ff6-ba07-1e01eb38907c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:45.699869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77d40a-78a6-4ff6-ba07-1e01eb38907c admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:45.700189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77d40a-78a6-4ff6-ba07-1e01eb38907c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:45.700466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77d40a-78a6-4ff6-ba07-1e01eb38907c admin admin] PATH_INFO: `/v3/projects/624d85e4d9724a1f8911573d0b677c87/users/ac00c05ebeea46c397215faf36dd9c4d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:45.721006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77d40a-78a6-4ff6-ba07-1e01eb38907c admin admin] RBAC: Authorizing `identity:create_grant(project_id=624d85e4d9724a1f8911573d0b677c87, user_id=ac00c05ebeea46c397215faf36dd9c4d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:45.724437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77d40a-78a6-4ff6-ba07-1e01eb38907c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:45.745471 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2909/5786] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:45 2022] PUT /identity/v3/projects/624d85e4d9724a1f8911573d0b677c87/users/ac00c05ebeea46c397215faf36dd9c4d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:22:45.749326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77d40a-78a6-4ff6-ba07-1e01eb38907c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:45.791993 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2878/5787] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:22:45.797544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b7b77-c2d6-4f7f-825c-db13ae9e8d68 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:45.811068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b7b77-c2d6-4f7f-825c-db13ae9e8d68 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:45.839743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77d40a-78a6-4ff6-ba07-1e01eb38907c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:45.864094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598cf46-d22e-4cf6-b32c-54777b1617de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:45.864842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598cf46-d22e-4cf6-b32c-54777b1617de admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:45.865218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598cf46-d22e-4cf6-b32c-54777b1617de admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:45.865563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598cf46-d22e-4cf6-b32c-54777b1617de admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:45.866372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598cf46-d22e-4cf6-b32c-54777b1617de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:45.868729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598cf46-d22e-4cf6-b32c-54777b1617de admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:45.909784 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2910/5788] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:45.913803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598cf46-d22e-4cf6-b32c-54777b1617de admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:45.919106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064e1bb-cb2e-46ba-a9f8-381a789da4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:45.919793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064e1bb-cb2e-46ba-a9f8-381a789da4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:45.921321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064e1bb-cb2e-46ba-a9f8-381a789da4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:45.922971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064e1bb-cb2e-46ba-a9f8-381a789da4c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:45.923843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064e1bb-cb2e-46ba-a9f8-381a789da4c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:45.928196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064e1bb-cb2e-46ba-a9f8-381a789da4c5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:45.929521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598cf46-d22e-4cf6-b32c-54777b1617de admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:45.935932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685477a2-e859-4afe-9f22-a244e19b7176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:45.936917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685477a2-e859-4afe-9f22-a244e19b7176 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:45.937202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685477a2-e859-4afe-9f22-a244e19b7176 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:45.937482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685477a2-e859-4afe-9f22-a244e19b7176 admin admin] PATH_INFO: `/v3/projects/624d85e4d9724a1f8911573d0b677c87/users/ac00c05ebeea46c397215faf36dd9c4d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:45.939856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685477a2-e859-4afe-9f22-a244e19b7176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=624d85e4d9724a1f8911573d0b677c87, user_id=ac00c05ebeea46c397215faf36dd9c4d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:45.943014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685477a2-e859-4afe-9f22-a244e19b7176 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:45.968068 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2911/5789] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:45 2022] PUT /identity/v3/projects/624d85e4d9724a1f8911573d0b677c87/users/ac00c05ebeea46c397215faf36dd9c4d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:22:46.028466 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2879/5790] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:45 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:22:46.032739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685477a2-e859-4afe-9f22-a244e19b7176 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:46.071881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d26b4-5a8f-4206-af20-2255de4c951a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:46.072023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d26b4-5a8f-4206-af20-2255de4c951a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:46.072269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d26b4-5a8f-4206-af20-2255de4c951a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:46.090959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:46.121025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-af3d26b4-5a8f-4206-af20-2255de4c951a None None] MFA Rules not processed for user `ac00c05ebeea46c397215faf36dd9c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:46.123108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-af3d26b4-5a8f-4206-af20-2255de4c951a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:46.162182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685477a2-e859-4afe-9f22-a244e19b7176 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:46.172020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:46.266548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9074ea6-1fe8-4633-91a2-fd5ae15f8f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:46.267393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9074ea6-1fe8-4633-91a2-fd5ae15f8f7b admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:46.267683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9074ea6-1fe8-4633-91a2-fd5ae15f8f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:46.267970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9074ea6-1fe8-4633-91a2-fd5ae15f8f7b admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:46.269870 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2880/5791] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:46.272401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9074ea6-1fe8-4633-91a2-fd5ae15f8f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:46.274498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9074ea6-1fe8-4633-91a2-fd5ae15f8f7b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:46.277659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d26b4-5a8f-4206-af20-2255de4c951a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:46.295026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d26b4-5a8f-4206-af20-2255de4c951a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:46.306932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6a6d2-ba56-4094-8a70-7a20f721df8d tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac00c05ebeea46c397215faf36dd9c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624d85e4d9724a1f8911573d0b677c87', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:46.307902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6a6d2-ba56-4094-8a70-7a20f721df8d tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:46.308347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6a6d2-ba56-4094-8a70-7a20f721df8d tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:46.308628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6a6d2-ba56-4094-8a70-7a20f721df8d tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:46.309540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6a6d2-ba56-4094-8a70-7a20f721df8d tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:22:46.309955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6a6d2-ba56-4094-8a70-7a20f721df8d tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:46.318303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6a6d2-ba56-4094-8a70-7a20f721df8d tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:46.325123 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2912/5792] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:46 2022] POST /identity/v3/users => generated 299 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:46.326313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9074ea6-1fe8-4633-91a2-fd5ae15f8f7b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:46.338876 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2881/5793] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:22:46.345410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6a6d2-ba56-4094-8a70-7a20f721df8d tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:46.353451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9074ea6-1fe8-4633-91a2-fd5ae15f8f7b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:46.366678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6a6d2-ba56-4094-8a70-7a20f721df8d tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:46.368958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23dd6f-77dc-47d7-aa13-9d1c43616298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:46.369903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23dd6f-77dc-47d7-aa13-9d1c43616298 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:46.370114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23dd6f-77dc-47d7-aa13-9d1c43616298 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:46.370390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23dd6f-77dc-47d7-aa13-9d1c43616298 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:46.372231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23dd6f-77dc-47d7-aa13-9d1c43616298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:46.374192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23dd6f-77dc-47d7-aa13-9d1c43616298 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:46.384023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17aa2c-9a02-4890-baaf-5c76eedf8850 tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac00c05ebeea46c397215faf36dd9c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624d85e4d9724a1f8911573d0b677c87', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:46.385037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17aa2c-9a02-4890-baaf-5c76eedf8850 tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:46.385037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17aa2c-9a02-4890-baaf-5c76eedf8850 tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:46.386755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17aa2c-9a02-4890-baaf-5c76eedf8850 tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:46.386755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17aa2c-9a02-4890-baaf-5c76eedf8850 tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:46.388088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17aa2c-9a02-4890-baaf-5c76eedf8850 tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:46.399273 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2913/5794] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:22:46.404447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23dd6f-77dc-47d7-aa13-9d1c43616298 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:46.428783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23dd6f-77dc-47d7-aa13-9d1c43616298 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:46.434924 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2882/5795] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:46 2022] POST /identity/v3/projects => generated 347 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:46.435920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17aa2c-9a02-4890-baaf-5c76eedf8850 tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:46.546066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17aa2c-9a02-4890-baaf-5c76eedf8850 tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:46.553369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfc30b-26a4-46cb-a95f-f16ecdfed90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:46.554345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfc30b-26a4-46cb-a95f-f16ecdfed90c admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:46.554635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfc30b-26a4-46cb-a95f-f16ecdfed90c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:46.555232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfc30b-26a4-46cb-a95f-f16ecdfed90c admin admin] PATH_INFO: `/v3/projects/0654d3c30aec4a2db3c7ac9f8a84dd6f/users/7f67eab0e5b948f08b6b1ae4f60bb684/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:46.564760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6d257-58af-43bf-bbf8-cf0f8888ec71 tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac00c05ebeea46c397215faf36dd9c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624d85e4d9724a1f8911573d0b677c87', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:46.566830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6d257-58af-43bf-bbf8-cf0f8888ec71 tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:46.569150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6d257-58af-43bf-bbf8-cf0f8888ec71 tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:46.569650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6d257-58af-43bf-bbf8-cf0f8888ec71 tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:46.572815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6d257-58af-43bf-bbf8-cf0f8888ec71 tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:22:46.574171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6d257-58af-43bf-bbf8-cf0f8888ec71 tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:46.577322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6d257-58af-43bf-bbf8-cf0f8888ec71 tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:46.579392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfc30b-26a4-46cb-a95f-f16ecdfed90c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0654d3c30aec4a2db3c7ac9f8a84dd6f, user_id=7f67eab0e5b948f08b6b1ae4f60bb684, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:46.582330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfc30b-26a4-46cb-a95f-f16ecdfed90c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:46.605103 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2914/5796] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:46 2022] PUT /identity/v3/projects/0654d3c30aec4a2db3c7ac9f8a84dd6f/users/7f67eab0e5b948f08b6b1ae4f60bb684/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:46.606424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfc30b-26a4-46cb-a95f-f16ecdfed90c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:46.612283 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2883/5797] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:22:46.627548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6d257-58af-43bf-bbf8-cf0f8888ec71 tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:46.630956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f5f6d257-58af-43bf-bbf8-cf0f8888ec71 tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:46.651199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:46.715426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfc30b-26a4-46cb-a95f-f16ecdfed90c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:46.729104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ce621-2c6e-4dea-9169-0f09529b4ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:46.733988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ce621-2c6e-4dea-9169-0f09529b4ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:46.735348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ce621-2c6e-4dea-9169-0f09529b4ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:46.735728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ce621-2c6e-4dea-9169-0f09529b4ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:46.736735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ce621-2c6e-4dea-9169-0f09529b4ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:46.738862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ce621-2c6e-4dea-9169-0f09529b4ed6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:46.754931 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2915/5798] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:46.757050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ce621-2c6e-4dea-9169-0f09529b4ed6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:46.771472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ce621-2c6e-4dea-9169-0f09529b4ed6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:46.780207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6d257-58af-43bf-bbf8-cf0f8888ec71 tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:46.786321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d99cdc-0b62-47a7-b4d0-05a5e226b029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:46.788670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d99cdc-0b62-47a7-b4d0-05a5e226b029 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:46.788985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d99cdc-0b62-47a7-b4d0-05a5e226b029 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:46.789263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d99cdc-0b62-47a7-b4d0-05a5e226b029 admin admin] PATH_INFO: `/v3/projects/0654d3c30aec4a2db3c7ac9f8a84dd6f/users/7f67eab0e5b948f08b6b1ae4f60bb684/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:46.795173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d99cdc-0b62-47a7-b4d0-05a5e226b029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0654d3c30aec4a2db3c7ac9f8a84dd6f, user_id=7f67eab0e5b948f08b6b1ae4f60bb684, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:46.800486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d99cdc-0b62-47a7-b4d0-05a5e226b029 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:46.825694 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2916/5799] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:46 2022] PUT /identity/v3/projects/0654d3c30aec4a2db3c7ac9f8a84dd6f/users/7f67eab0e5b948f08b6b1ae4f60bb684/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:46.836456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205a09a-4be3-4a89-8dcd-3987fc4f5f29 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:46.836748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205a09a-4be3-4a89-8dcd-3987fc4f5f29 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:46.837030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205a09a-4be3-4a89-8dcd-3987fc4f5f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:46.851550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:46.877738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2205a09a-4be3-4a89-8dcd-3987fc4f5f29 None None] MFA Rules not processed for user `7f67eab0e5b948f08b6b1ae4f60bb684`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:46.877993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7a5ea-254c-45be-9615-a58789a57994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:46.878550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7a5ea-254c-45be-9615-a58789a57994 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:46.879085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7a5ea-254c-45be-9615-a58789a57994 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:46.879294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2205a09a-4be3-4a89-8dcd-3987fc4f5f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:46.879414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7a5ea-254c-45be-9615-a58789a57994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:47.008238 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2917/5800] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:22:47.019471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7a5ea-254c-45be-9615-a58789a57994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:47.020783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205a09a-4be3-4a89-8dcd-3987fc4f5f29 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:47.022481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7a5ea-254c-45be-9615-a58789a57994 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:47.049547 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2884/5801] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:47.113536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205a09a-4be3-4a89-8dcd-3987fc4f5f29 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:47.122266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8beff4-467a-4015-a680-7fa7a8461598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:47.123846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8beff4-467a-4015-a680-7fa7a8461598 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:47.124822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8beff4-467a-4015-a680-7fa7a8461598 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:47.125350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8beff4-467a-4015-a680-7fa7a8461598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:47.140652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8beff4-467a-4015-a680-7fa7a8461598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:47.142147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8beff4-467a-4015-a680-7fa7a8461598 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:47.154253 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2918/5802] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:50.911440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7a5ea-254c-45be-9615-a58789a57994 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:50.923905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7a5ea-254c-45be-9615-a58789a57994 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:50.966679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8beff4-467a-4015-a680-7fa7a8461598 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:50.968710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4f8beff4-467a-4015-a680-7fa7a8461598 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:51.055205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:51.055600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0512f1c-3b78-403e-95dc-7c53557d0b2a tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac00c05ebeea46c397215faf36dd9c4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624d85e4d9724a1f8911573d0b677c87', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:51.058241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0512f1c-3b78-403e-95dc-7c53557d0b2a tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:51.058724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0512f1c-3b78-403e-95dc-7c53557d0b2a tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:51.059211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0512f1c-3b78-403e-95dc-7c53557d0b2a tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] PATH_INFO: `/v3/projects/2172f5f77fd8429da687d123ebce3303` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:51.061511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0512f1c-3b78-403e-95dc-7c53557d0b2a tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2172f5f77fd8429da687d123ebce3303)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:51.064404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0512f1c-3b78-403e-95dc-7c53557d0b2a tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:51.081590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8beff4-467a-4015-a680-7fa7a8461598 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:51.093489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9304081-ca6f-4f98-925a-cc234a8e0ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:51.096089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9304081-ca6f-4f98-925a-cc234a8e0ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:51.096356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9304081-ca6f-4f98-925a-cc234a8e0ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:51.096630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9304081-ca6f-4f98-925a-cc234a8e0ec8 admin admin] PATH_INFO: `/v3/users/5261fd648c584842937fbd1c53fb53e0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:51.099965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9304081-ca6f-4f98-925a-cc234a8e0ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5261fd648c584842937fbd1c53fb53e0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:51.102390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9304081-ca6f-4f98-925a-cc234a8e0ec8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:51.135879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a0512f1c-3b78-403e-95dc-7c53557d0b2a tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2172f5f77fd8429da687d123ebce3303', 'request_id': 'req-a0512f1c-3b78-403e-95dc-7c53557d0b2a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.154267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a0512f1c-3b78-403e-95dc-7c53557d0b2a tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2172f5f77fd8429da687d123ebce3303', 'request_id': 'req-a0512f1c-3b78-403e-95dc-7c53557d0b2a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.168523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a0512f1c-3b78-403e-95dc-7c53557d0b2a tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2172f5f77fd8429da687d123ebce3303', 'request_id': 'req-a0512f1c-3b78-403e-95dc-7c53557d0b2a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.183623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c9304081-ca6f-4f98-925a-cc234a8e0ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5261fd648c584842937fbd1c53fb53e0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.197651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a0512f1c-3b78-403e-95dc-7c53557d0b2a tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] The token cache is being invalidate because project 2172f5f77fd8429da687d123ebce3303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:51.197991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a0512f1c-3b78-403e-95dc-7c53557d0b2a tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.199663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c9304081-ca6f-4f98-925a-cc234a8e0ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5261fd648c584842937fbd1c53fb53e0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.200602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a0512f1c-3b78-403e-95dc-7c53557d0b2a tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.200797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c9304081-ca6f-4f98-925a-cc234a8e0ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5261fd648c584842937fbd1c53fb53e0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.201261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c9304081-ca6f-4f98-925a-cc234a8e0ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5261fd648c584842937fbd1c53fb53e0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.205090 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2885/5803] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:50 2022] DELETE /identity/v3/projects/2172f5f77fd8429da687d123ebce3303 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:51.210660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0512f1c-3b78-403e-95dc-7c53557d0b2a tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:51.212010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a0512f1c-3b78-403e-95dc-7c53557d0b2a tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:51.215817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c9304081-ca6f-4f98-925a-cc234a8e0ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5261fd648c584842937fbd1c53fb53e0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.230976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:51.250408 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2919/5804] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:50 2022] DELETE /identity/v3/users/5261fd648c584842937fbd1c53fb53e0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:51.347729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0512f1c-3b78-403e-95dc-7c53557d0b2a tempest-QuotasNegativeTest-337644822 tempest-QuotasNegativeTest-337644822-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:51.508887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25670ca-bbd2-4e34-b104-0567c7417a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:51.510197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25670ca-bbd2-4e34-b104-0567c7417a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:51.510197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25670ca-bbd2-4e34-b104-0567c7417a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:51.510436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25670ca-bbd2-4e34-b104-0567c7417a21 admin admin] PATH_INFO: `/v3/users/9645ef8fd0b54bae869e961f6baea0d3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:51.512199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25670ca-bbd2-4e34-b104-0567c7417a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9645ef8fd0b54bae869e961f6baea0d3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:51.513996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25670ca-bbd2-4e34-b104-0567c7417a21 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:51.588269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a25670ca-bbd2-4e34-b104-0567c7417a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9645ef8fd0b54bae869e961f6baea0d3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.599891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a25670ca-bbd2-4e34-b104-0567c7417a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9645ef8fd0b54bae869e961f6baea0d3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.623736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a25670ca-bbd2-4e34-b104-0567c7417a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9645ef8fd0b54bae869e961f6baea0d3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.626574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a25670ca-bbd2-4e34-b104-0567c7417a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9645ef8fd0b54bae869e961f6baea0d3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.627241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a25670ca-bbd2-4e34-b104-0567c7417a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9645ef8fd0b54bae869e961f6baea0d3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.664843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9304081-ca6f-4f98-925a-cc234a8e0ec8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:51.667664 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2886/5805] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:51 2022] DELETE /identity/v3/users/9645ef8fd0b54bae869e961f6baea0d3 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:51.669362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c9304081-ca6f-4f98-925a-cc234a8e0ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:51.673324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130765d5-26c9-422e-b618-e683c8084a5f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:51.675141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130765d5-26c9-422e-b618-e683c8084a5f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:51.676821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130765d5-26c9-422e-b618-e683c8084a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:51.701365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9304081-ca6f-4f98-925a-cc234a8e0ec8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:51.703436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-130765d5-26c9-422e-b618-e683c8084a5f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:51.705007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-130765d5-26c9-422e-b618-e683c8084a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:51.762348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:51.793643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0525f4-80d1-4dd5-96d9-269a41d83143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:51.794701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0525f4-80d1-4dd5-96d9-269a41d83143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:51.795266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0525f4-80d1-4dd5-96d9-269a41d83143 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:51.795706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0525f4-80d1-4dd5-96d9-269a41d83143 admin admin] PATH_INFO: `/v3/projects/8a5bdceeafbb40a6be33371a3ad1b0aa` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:51.797270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0525f4-80d1-4dd5-96d9-269a41d83143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5bdceeafbb40a6be33371a3ad1b0aa)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:51.799801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0525f4-80d1-4dd5-96d9-269a41d83143 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:51.805755 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2887/5806] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:51.817522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130765d5-26c9-422e-b618-e683c8084a5f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:51.819174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-130765d5-26c9-422e-b618-e683c8084a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:51.858924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4b0525f4-80d1-4dd5-96d9-269a41d83143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'request_id': 'req-4b0525f4-80d1-4dd5-96d9-269a41d83143'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.869811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4b0525f4-80d1-4dd5-96d9-269a41d83143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'request_id': 'req-4b0525f4-80d1-4dd5-96d9-269a41d83143'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.877334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4b0525f4-80d1-4dd5-96d9-269a41d83143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'request_id': 'req-4b0525f4-80d1-4dd5-96d9-269a41d83143'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.880152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:51.895778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4b0525f4-80d1-4dd5-96d9-269a41d83143 admin admin] The token cache is being invalidate because project 8a5bdceeafbb40a6be33371a3ad1b0aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:51.896141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4b0525f4-80d1-4dd5-96d9-269a41d83143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.896823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4b0525f4-80d1-4dd5-96d9-269a41d83143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:51.898088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130765d5-26c9-422e-b618-e683c8084a5f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:51.898488 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2920/5807] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:51 2022] DELETE /identity/v3/projects/8a5bdceeafbb40a6be33371a3ad1b0aa => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:51.903812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423662ae-41a8-4ef4-b666-97b92275ebf7 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:51.904297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423662ae-41a8-4ef4-b666-97b92275ebf7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:51.904645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423662ae-41a8-4ef4-b666-97b92275ebf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:51.947859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-423662ae-41a8-4ef4-b666-97b92275ebf7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:51.949122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-423662ae-41a8-4ef4-b666-97b92275ebf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:51.977421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319f935-e5c7-4289-adf2-0cac94b1e79d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:51.978085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319f935-e5c7-4289-adf2-0cac94b1e79d service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:51.978424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319f935-e5c7-4289-adf2-0cac94b1e79d service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:51.978943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319f935-e5c7-4289-adf2-0cac94b1e79d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:51.981623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9319f935-e5c7-4289-adf2-0cac94b1e79d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:52.016276 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2921/5808] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:22:52.024684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef209b3-863f-423d-afbb-042e336c1171 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:52.025571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef209b3-863f-423d-afbb-042e336c1171 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:52.027235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef209b3-863f-423d-afbb-042e336c1171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:52.069437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-eef209b3-863f-423d-afbb-042e336c1171 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:52.072333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319f935-e5c7-4289-adf2-0cac94b1e79d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:52.073622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-eef209b3-863f-423d-afbb-042e336c1171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:52.073781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319f935-e5c7-4289-adf2-0cac94b1e79d service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:52.085162 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2888/5809] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:22:52.109852 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2922/5810] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:52.111083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319f935-e5c7-4289-adf2-0cac94b1e79d service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:52.123315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319f935-e5c7-4289-adf2-0cac94b1e79d service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:52.129588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccad88b-5c91-43bf-9573-269673c65e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:52.130262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccad88b-5c91-43bf-9573-269673c65e46 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:52.130539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccad88b-5c91-43bf-9573-269673c65e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:52.130811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccad88b-5c91-43bf-9573-269673c65e46 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:52.131630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccad88b-5c91-43bf-9573-269673c65e46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:22:52.132337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccad88b-5c91-43bf-9573-269673c65e46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:52.133957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccad88b-5c91-43bf-9573-269673c65e46 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:52.149857 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2889/5811] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:22:52.153746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef209b3-863f-423d-afbb-042e336c1171 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:52.164883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef209b3-863f-423d-afbb-042e336c1171 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:52.171282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e159304-47fd-41ff-bbb8-486db890bc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:52.172187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e159304-47fd-41ff-bbb8-486db890bc84 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:52.172846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e159304-47fd-41ff-bbb8-486db890bc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:52.173483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e159304-47fd-41ff-bbb8-486db890bc84 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:52.173867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e159304-47fd-41ff-bbb8-486db890bc84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:52.176213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e159304-47fd-41ff-bbb8-486db890bc84 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:52.224921 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2923/5812] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:52 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:52.226764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccad88b-5c91-43bf-9573-269673c65e46 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:52.248172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccad88b-5c91-43bf-9573-269673c65e46 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:52.301014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:52.357060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95dfb1e-3b0e-49b2-bc61-bad93aef3878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:52.357833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95dfb1e-3b0e-49b2-bc61-bad93aef3878 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:52.358231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95dfb1e-3b0e-49b2-bc61-bad93aef3878 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:52.358587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95dfb1e-3b0e-49b2-bc61-bad93aef3878 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:52.359439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95dfb1e-3b0e-49b2-bc61-bad93aef3878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:52.363569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95dfb1e-3b0e-49b2-bc61-bad93aef3878 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:52.407596 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2890/5813] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:52 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:52.409527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e159304-47fd-41ff-bbb8-486db890bc84 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:52.423875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e159304-47fd-41ff-bbb8-486db890bc84 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:52.436453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075eebf-ec70-4bec-b1da-569cda07c2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:52.438244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075eebf-ec70-4bec-b1da-569cda07c2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:52.438940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075eebf-ec70-4bec-b1da-569cda07c2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:52.456982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075eebf-ec70-4bec-b1da-569cda07c2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:52.459783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075eebf-ec70-4bec-b1da-569cda07c2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:52.461706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075eebf-ec70-4bec-b1da-569cda07c2f5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:52.525305 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2924/5814] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:52.529470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95dfb1e-3b0e-49b2-bc61-bad93aef3878 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:52.562334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95dfb1e-3b0e-49b2-bc61-bad93aef3878 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:52.574008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8640d10-0e50-4a39-80ef-6083c878bb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:52.574753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8640d10-0e50-4a39-80ef-6083c878bb5b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:52.575673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8640d10-0e50-4a39-80ef-6083c878bb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:52.576176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8640d10-0e50-4a39-80ef-6083c878bb5b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:52.578834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8640d10-0e50-4a39-80ef-6083c878bb5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:52.582917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8640d10-0e50-4a39-80ef-6083c878bb5b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:52.620918 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2891/5815] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:52.623151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075eebf-ec70-4bec-b1da-569cda07c2f5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:52.638097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075eebf-ec70-4bec-b1da-569cda07c2f5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:52.645613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77fd66-4059-4d1b-b339-09f5820f83db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:52.647956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77fd66-4059-4d1b-b339-09f5820f83db admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:52.648440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77fd66-4059-4d1b-b339-09f5820f83db admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:52.648872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77fd66-4059-4d1b-b339-09f5820f83db admin admin] PATH_INFO: `/v3/projects/a0c14d320e154cedb7b37f38873f241e/users/23d7253b721f409ab148368d84b87963/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:52.653796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8640d10-0e50-4a39-80ef-6083c878bb5b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:52.657909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d8640d10-0e50-4a39-80ef-6083c878bb5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:52.694191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8640d10-0e50-4a39-80ef-6083c878bb5b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:52.709202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe30ed-ebeb-48c2-8ad7-0b3ab905390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:52.710680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe30ed-ebeb-48c2-8ad7-0b3ab905390e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:52.712840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77fd66-4059-4d1b-b339-09f5820f83db admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c14d320e154cedb7b37f38873f241e, user_id=23d7253b721f409ab148368d84b87963, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:52.713268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe30ed-ebeb-48c2-8ad7-0b3ab905390e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:52.713738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe30ed-ebeb-48c2-8ad7-0b3ab905390e admin admin] PATH_INFO: `/v3/users/5c71996409f64ba38ba0dfbe9ef57150` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:52.715773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe30ed-ebeb-48c2-8ad7-0b3ab905390e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c71996409f64ba38ba0dfbe9ef57150)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:52.717604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77fd66-4059-4d1b-b339-09f5820f83db admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:52.719799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe30ed-ebeb-48c2-8ad7-0b3ab905390e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:52.742182 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2925/5816] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:52 2022] PUT /identity/v3/projects/a0c14d320e154cedb7b37f38873f241e/users/23d7253b721f409ab148368d84b87963/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:52.746323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77fd66-4059-4d1b-b339-09f5820f83db admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:52.748364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ec77fd66-4059-4d1b-b339-09f5820f83db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:52.811072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-42fe30ed-ebeb-48c2-8ad7-0b3ab905390e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c71996409f64ba38ba0dfbe9ef57150'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:52.820164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-42fe30ed-ebeb-48c2-8ad7-0b3ab905390e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c71996409f64ba38ba0dfbe9ef57150'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:52.828062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-42fe30ed-ebeb-48c2-8ad7-0b3ab905390e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c71996409f64ba38ba0dfbe9ef57150'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:52.828720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-42fe30ed-ebeb-48c2-8ad7-0b3ab905390e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c71996409f64ba38ba0dfbe9ef57150'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:52.829328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-42fe30ed-ebeb-48c2-8ad7-0b3ab905390e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c71996409f64ba38ba0dfbe9ef57150'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:52.839944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77fd66-4059-4d1b-b339-09f5820f83db admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:52.844927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20feb87-6f0b-485a-97df-561cc49495d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:52.845861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20feb87-6f0b-485a-97df-561cc49495d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:52.846142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20feb87-6f0b-485a-97df-561cc49495d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:52.846415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20feb87-6f0b-485a-97df-561cc49495d0 admin admin] PATH_INFO: `/v3/projects/97b69125db1f4138afbff48ec4824cc6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:52.847609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20feb87-6f0b-485a-97df-561cc49495d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b69125db1f4138afbff48ec4824cc6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:52.849568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20feb87-6f0b-485a-97df-561cc49495d0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:52.849704 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2892/5817] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:52 2022] DELETE /identity/v3/users/5c71996409f64ba38ba0dfbe9ef57150 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:52.850996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413977c-310e-4e46-af0a-bb19e8c730bb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:52.851506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413977c-310e-4e46-af0a-bb19e8c730bb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:52.851830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413977c-310e-4e46-af0a-bb19e8c730bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:52.873155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5413977c-310e-4e46-af0a-bb19e8c730bb None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:52.874363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5413977c-310e-4e46-af0a-bb19e8c730bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:52.886863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:52.903008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a20feb87-6f0b-485a-97df-561cc49495d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b69125db1f4138afbff48ec4824cc6', 'request_id': 'req-a20feb87-6f0b-485a-97df-561cc49495d0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:52.911456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a20feb87-6f0b-485a-97df-561cc49495d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b69125db1f4138afbff48ec4824cc6', 'request_id': 'req-a20feb87-6f0b-485a-97df-561cc49495d0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:52.918044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a20feb87-6f0b-485a-97df-561cc49495d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b69125db1f4138afbff48ec4824cc6', 'request_id': 'req-a20feb87-6f0b-485a-97df-561cc49495d0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:52.929139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a20feb87-6f0b-485a-97df-561cc49495d0 admin admin] The token cache is being invalidate because project 97b69125db1f4138afbff48ec4824cc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:52.929579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a20feb87-6f0b-485a-97df-561cc49495d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:52.930234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a20feb87-6f0b-485a-97df-561cc49495d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:52.931850 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2926/5818] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:52 2022] DELETE /identity/v3/projects/97b69125db1f4138afbff48ec4824cc6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:52.936184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368c5c6-95b6-4f68-95aa-2c502ba8a2c5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:52.936469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368c5c6-95b6-4f68-95aa-2c502ba8a2c5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:52.936744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368c5c6-95b6-4f68-95aa-2c502ba8a2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:52.941242 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2893/5819] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:52.942245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413977c-310e-4e46-af0a-bb19e8c730bb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:52.943495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5413977c-310e-4e46-af0a-bb19e8c730bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:52.957325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413977c-310e-4e46-af0a-bb19e8c730bb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:52.958562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f368c5c6-95b6-4f68-95aa-2c502ba8a2c5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:52.959769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f368c5c6-95b6-4f68-95aa-2c502ba8a2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:52.983456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:53.024790 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2927/5820] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:53.025760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368c5c6-95b6-4f68-95aa-2c502ba8a2c5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:53.027117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f368c5c6-95b6-4f68-95aa-2c502ba8a2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:53.044829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770be3c-ffff-42c7-b17c-58d03e8f1b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:53.045880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770be3c-ffff-42c7-b17c-58d03e8f1b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:53.047251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770be3c-ffff-42c7-b17c-58d03e8f1b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:53.048091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770be3c-ffff-42c7-b17c-58d03e8f1b0d admin admin] PATH_INFO: `/v3/users/ac00c05ebeea46c397215faf36dd9c4d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:53.051468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770be3c-ffff-42c7-b17c-58d03e8f1b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac00c05ebeea46c397215faf36dd9c4d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:53.054767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770be3c-ffff-42c7-b17c-58d03e8f1b0d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:53.096587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368c5c6-95b6-4f68-95aa-2c502ba8a2c5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:53.100645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bf7f8-c25d-4b15-9128-92776614d994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:53.101481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bf7f8-c25d-4b15-9128-92776614d994 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:53.101733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bf7f8-c25d-4b15-9128-92776614d994 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:53.102035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bf7f8-c25d-4b15-9128-92776614d994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:53.113811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bf7f8-c25d-4b15-9128-92776614d994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:53.115296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bf7f8-c25d-4b15-9128-92776614d994 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:53.126279 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2928/5821] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:53.137598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bf7f8-c25d-4b15-9128-92776614d994 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:53.138581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2770be3c-ffff-42c7-b17c-58d03e8f1b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac00c05ebeea46c397215faf36dd9c4d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:53.153609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2770be3c-ffff-42c7-b17c-58d03e8f1b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac00c05ebeea46c397215faf36dd9c4d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:53.161119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bf7f8-c25d-4b15-9128-92776614d994 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:53.171295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe2959-002c-4b91-b8bc-a104fbb2e3eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:53.171953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe2959-002c-4b91-b8bc-a104fbb2e3eb service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:53.172280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe2959-002c-4b91-b8bc-a104fbb2e3eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:53.172989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe2959-002c-4b91-b8bc-a104fbb2e3eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:53.174242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2770be3c-ffff-42c7-b17c-58d03e8f1b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac00c05ebeea46c397215faf36dd9c4d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:53.176696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2770be3c-ffff-42c7-b17c-58d03e8f1b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac00c05ebeea46c397215faf36dd9c4d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:53.177560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2770be3c-ffff-42c7-b17c-58d03e8f1b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac00c05ebeea46c397215faf36dd9c4d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:53.190602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe2959-002c-4b91-b8bc-a104fbb2e3eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:53.194174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe2959-002c-4b91-b8bc-a104fbb2e3eb service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:53.204057 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2894/5822] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:52 2022] DELETE /identity/v3/users/ac00c05ebeea46c397215faf36dd9c4d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:53.211365 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2929/5823] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:53.986992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770be3c-ffff-42c7-b17c-58d03e8f1b0d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:53.988758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2770be3c-ffff-42c7-b17c-58d03e8f1b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:54.117539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770be3c-ffff-42c7-b17c-58d03e8f1b0d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:54.141091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f83cbc-c66a-4950-b543-4915341f05bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:54.142059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f83cbc-c66a-4950-b543-4915341f05bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:54.142550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f83cbc-c66a-4950-b543-4915341f05bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:54.142906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f83cbc-c66a-4950-b543-4915341f05bf admin admin] PATH_INFO: `/v3/projects/624d85e4d9724a1f8911573d0b677c87` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:54.144717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f83cbc-c66a-4950-b543-4915341f05bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=624d85e4d9724a1f8911573d0b677c87)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:54.147017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f83cbc-c66a-4950-b543-4915341f05bf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:54.213802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:54.214709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe2959-002c-4b91-b8bc-a104fbb2e3eb service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:54.216820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7abe2959-002c-4b91-b8bc-a104fbb2e3eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:54.226646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-57f83cbc-c66a-4950-b543-4915341f05bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '624d85e4d9724a1f8911573d0b677c87', 'request_id': 'req-57f83cbc-c66a-4950-b543-4915341f05bf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:54.235410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-57f83cbc-c66a-4950-b543-4915341f05bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '624d85e4d9724a1f8911573d0b677c87', 'request_id': 'req-57f83cbc-c66a-4950-b543-4915341f05bf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:54.237049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe2959-002c-4b91-b8bc-a104fbb2e3eb service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:54.247299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-57f83cbc-c66a-4950-b543-4915341f05bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '624d85e4d9724a1f8911573d0b677c87', 'request_id': 'req-57f83cbc-c66a-4950-b543-4915341f05bf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:54.287694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-57f83cbc-c66a-4950-b543-4915341f05bf admin admin] The token cache is being invalidate because project 624d85e4d9724a1f8911573d0b677c87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:54.288502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-57f83cbc-c66a-4950-b543-4915341f05bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:54.289335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-57f83cbc-c66a-4950-b543-4915341f05bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:54.292096 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2895/5824] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:53 2022] DELETE /identity/v3/projects/624d85e4d9724a1f8911573d0b677c87 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:54.297183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd9568-61f1-4b64-8e44-e4dc9dca6f53 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:54.298368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd9568-61f1-4b64-8e44-e4dc9dca6f53 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:54.298798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd9568-61f1-4b64-8e44-e4dc9dca6f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:54.299699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:54.322168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af588a-214b-4aa2-8424-b0ecc61f8e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:54.323145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af588a-214b-4aa2-8424-b0ecc61f8e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:54.323432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af588a-214b-4aa2-8424-b0ecc61f8e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:54.323710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af588a-214b-4aa2-8424-b0ecc61f8e54 admin admin] PATH_INFO: `/v3/projects/809ce42bc72045fda1d6cacaf7dc3ee1` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:54.325062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af588a-214b-4aa2-8424-b0ecc61f8e54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=809ce42bc72045fda1d6cacaf7dc3ee1)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:54.328579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-babd9568-61f1-4b64-8e44-e4dc9dca6f53 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:54.329978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-babd9568-61f1-4b64-8e44-e4dc9dca6f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:54.332321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af588a-214b-4aa2-8424-b0ecc61f8e54 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:54.339703 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2896/5825] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:22:54.348197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b2a0d-123c-4869-bb06-7ea38d9e402e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:54.348623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b2a0d-123c-4869-bb06-7ea38d9e402e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:54.349024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b2a0d-123c-4869-bb06-7ea38d9e402e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:54.373984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d92b2a0d-123c-4869-bb06-7ea38d9e402e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:54.376733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d92b2a0d-123c-4869-bb06-7ea38d9e402e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:54.388436 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2897/5826] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:22:54.392850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b2a0d-123c-4869-bb06-7ea38d9e402e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:54.403401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b2a0d-123c-4869-bb06-7ea38d9e402e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:54.405988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e2af588a-214b-4aa2-8424-b0ecc61f8e54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809ce42bc72045fda1d6cacaf7dc3ee1', 'request_id': 'req-e2af588a-214b-4aa2-8424-b0ecc61f8e54'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:54.416077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e2af588a-214b-4aa2-8424-b0ecc61f8e54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809ce42bc72045fda1d6cacaf7dc3ee1', 'request_id': 'req-e2af588a-214b-4aa2-8424-b0ecc61f8e54'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:54.424649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e2af588a-214b-4aa2-8424-b0ecc61f8e54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809ce42bc72045fda1d6cacaf7dc3ee1', 'request_id': 'req-e2af588a-214b-4aa2-8424-b0ecc61f8e54'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:54.437042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e2af588a-214b-4aa2-8424-b0ecc61f8e54 admin admin] The token cache is being invalidate because project 809ce42bc72045fda1d6cacaf7dc3ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:54.437330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e2af588a-214b-4aa2-8424-b0ecc61f8e54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:54.438104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e2af588a-214b-4aa2-8424-b0ecc61f8e54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:54.443284 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2930/5827] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:54 2022] DELETE /identity/v3/projects/809ce42bc72045fda1d6cacaf7dc3ee1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:22:54.444375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af588a-214b-4aa2-8424-b0ecc61f8e54 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:54.445788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e2af588a-214b-4aa2-8424-b0ecc61f8e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:54.491371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cab7a-4166-4a72-84f6-476f4a81356e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:54.492870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cab7a-4166-4a72-84f6-476f4a81356e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:54.493241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cab7a-4166-4a72-84f6-476f4a81356e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:54.493654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cab7a-4166-4a72-84f6-476f4a81356e admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:54.494595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cab7a-4166-4a72-84f6-476f4a81356e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:22:54.495001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cab7a-4166-4a72-84f6-476f4a81356e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:54.497736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cab7a-4166-4a72-84f6-476f4a81356e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:54.511931 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2898/5828] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:22:54.515985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cab7a-4166-4a72-84f6-476f4a81356e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:54.517883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-958cab7a-4166-4a72-84f6-476f4a81356e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:54.531349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cab7a-4166-4a72-84f6-476f4a81356e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:54.536368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b6baa-9aa7-4353-8df3-c7f63296c4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:54.537042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b6baa-9aa7-4353-8df3-c7f63296c4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:54.537399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b6baa-9aa7-4353-8df3-c7f63296c4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:54.537590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b6baa-9aa7-4353-8df3-c7f63296c4b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:54.538303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b6baa-9aa7-4353-8df3-c7f63296c4b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:54.540247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b6baa-9aa7-4353-8df3-c7f63296c4b1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:54.556256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af588a-214b-4aa2-8424-b0ecc61f8e54 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:54.562167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7eb1f-15a8-4ae8-b183-d0ac95d604b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:54.563038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7eb1f-15a8-4ae8-b183-d0ac95d604b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:54.563966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7eb1f-15a8-4ae8-b183-d0ac95d604b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:54.564356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7eb1f-15a8-4ae8-b183-d0ac95d604b5 admin admin] PATH_INFO: `/v3/users/7f67eab0e5b948f08b6b1ae4f60bb684` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:54.566231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7eb1f-15a8-4ae8-b183-d0ac95d604b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f67eab0e5b948f08b6b1ae4f60bb684)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:54.568201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7eb1f-15a8-4ae8-b183-d0ac95d604b5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:54.575573 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2899/5829] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:54 2022] POST /identity/v3/projects => generated 397 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:22:54.576675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b6baa-9aa7-4353-8df3-c7f63296c4b1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:54.632623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a7f7eb1f-15a8-4ae8-b183-d0ac95d604b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f67eab0e5b948f08b6b1ae4f60bb684'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:54.646689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a7f7eb1f-15a8-4ae8-b183-d0ac95d604b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f67eab0e5b948f08b6b1ae4f60bb684'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:54.647518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a7f7eb1f-15a8-4ae8-b183-d0ac95d604b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f67eab0e5b948f08b6b1ae4f60bb684'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:54.648415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a7f7eb1f-15a8-4ae8-b183-d0ac95d604b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f67eab0e5b948f08b6b1ae4f60bb684'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:54.649330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b6baa-9aa7-4353-8df3-c7f63296c4b1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:54.656410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35592c51-6cf7-4635-8627-297d22b4da17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:54.657221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35592c51-6cf7-4635-8627-297d22b4da17 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:54.657510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35592c51-6cf7-4635-8627-297d22b4da17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:54.657797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35592c51-6cf7-4635-8627-297d22b4da17 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:54.658042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a7f7eb1f-15a8-4ae8-b183-d0ac95d604b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f67eab0e5b948f08b6b1ae4f60bb684'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:54.658628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35592c51-6cf7-4635-8627-297d22b4da17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:54.661411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35592c51-6cf7-4635-8627-297d22b4da17 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:54.674870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:54.680347 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2931/5830] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:22:54 2022] DELETE /identity/v3/users/7f67eab0e5b948f08b6b1ae4f60bb684 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:54.693883 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2900/5831] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:54 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:22:54.699411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7eb1f-15a8-4ae8-b183-d0ac95d604b5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:54.700967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a7f7eb1f-15a8-4ae8-b183-d0ac95d604b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:54.780340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7eb1f-15a8-4ae8-b183-d0ac95d604b5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:54.785078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000720f9-5a5b-4785-8308-4a4eee349258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:54.785780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000720f9-5a5b-4785-8308-4a4eee349258 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:54.786061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000720f9-5a5b-4785-8308-4a4eee349258 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:54.786331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000720f9-5a5b-4785-8308-4a4eee349258 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:54.787047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000720f9-5a5b-4785-8308-4a4eee349258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:54.788685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000720f9-5a5b-4785-8308-4a4eee349258 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:54.800410 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2932/5832] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:22:54.804572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35592c51-6cf7-4635-8627-297d22b4da17 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:54.817800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35592c51-6cf7-4635-8627-297d22b4da17 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:54.823133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24669182-cb64-4115-b577-73889d56d735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:54.823836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24669182-cb64-4115-b577-73889d56d735 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:54.824243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24669182-cb64-4115-b577-73889d56d735 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:54.824577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24669182-cb64-4115-b577-73889d56d735 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:54.825303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24669182-cb64-4115-b577-73889d56d735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:54.826909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24669182-cb64-4115-b577-73889d56d735 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:54.842885 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2901/5833] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:54.844656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000720f9-5a5b-4785-8308-4a4eee349258 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:54.856213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000720f9-5a5b-4785-8308-4a4eee349258 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:54.861956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63ac98-0236-4bdf-a534-08726e107a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:54.862962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63ac98-0236-4bdf-a534-08726e107a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:54.863343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63ac98-0236-4bdf-a534-08726e107a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:54.863763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63ac98-0236-4bdf-a534-08726e107a29 admin admin] PATH_INFO: `/v3/projects/3930dc57b0d54bcd899f0878648df48f/users/391ed3d894394b47b115f6d9394e3f3d/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:54.882012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63ac98-0236-4bdf-a534-08726e107a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3930dc57b0d54bcd899f0878648df48f, user_id=391ed3d894394b47b115f6d9394e3f3d, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:54.885116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63ac98-0236-4bdf-a534-08726e107a29 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:54.900231 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2933/5834] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:54 2022] PUT /identity/v3/projects/3930dc57b0d54bcd899f0878648df48f/users/391ed3d894394b47b115f6d9394e3f3d/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:54.911008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5f877-d22c-4e6d-9371-1c9c70421367 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:54.911298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5f877-d22c-4e6d-9371-1c9c70421367 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:54.911568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5f877-d22c-4e6d-9371-1c9c70421367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:54.936380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:54.946976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-eea5f877-d22c-4e6d-9371-1c9c70421367 None None] MFA Rules not processed for user `391ed3d894394b47b115f6d9394e3f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:54.948597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-eea5f877-d22c-4e6d-9371-1c9c70421367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:55.031437 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2902/5835] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:55.037829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63ac98-0236-4bdf-a534-08726e107a29 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:55.067670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5f877-d22c-4e6d-9371-1c9c70421367 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:55.069483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-eea5f877-d22c-4e6d-9371-1c9c70421367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:55.170626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63ac98-0236-4bdf-a534-08726e107a29 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:55.181225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729bd21-5476-4038-b3ef-2be1dc6e7de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:55.182214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729bd21-5476-4038-b3ef-2be1dc6e7de8 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:55.182622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729bd21-5476-4038-b3ef-2be1dc6e7de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:55.183006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729bd21-5476-4038-b3ef-2be1dc6e7de8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:55.183798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729bd21-5476-4038-b3ef-2be1dc6e7de8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:55.186439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729bd21-5476-4038-b3ef-2be1dc6e7de8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:55.215568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5f877-d22c-4e6d-9371-1c9c70421367 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:55.222747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec90a75-c66f-4bd6-9c7e-7a9eb643730f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:55.223963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec90a75-c66f-4bd6-9c7e-7a9eb643730f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:55.224509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec90a75-c66f-4bd6-9c7e-7a9eb643730f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:55.225029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec90a75-c66f-4bd6-9c7e-7a9eb643730f admin admin] PATH_INFO: `/v3/projects/0654d3c30aec4a2db3c7ac9f8a84dd6f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:55.226605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec90a75-c66f-4bd6-9c7e-7a9eb643730f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0654d3c30aec4a2db3c7ac9f8a84dd6f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:55.230533 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2934/5836] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:55 2022] POST /identity/v3/projects => generated 397 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:55.233049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729bd21-5476-4038-b3ef-2be1dc6e7de8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:55.234052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec90a75-c66f-4bd6-9c7e-7a9eb643730f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:55.298809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eec90a75-c66f-4bd6-9c7e-7a9eb643730f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0654d3c30aec4a2db3c7ac9f8a84dd6f', 'request_id': 'req-eec90a75-c66f-4bd6-9c7e-7a9eb643730f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:55.309152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eec90a75-c66f-4bd6-9c7e-7a9eb643730f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0654d3c30aec4a2db3c7ac9f8a84dd6f', 'request_id': 'req-eec90a75-c66f-4bd6-9c7e-7a9eb643730f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:55.326888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:55.328652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eec90a75-c66f-4bd6-9c7e-7a9eb643730f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0654d3c30aec4a2db3c7ac9f8a84dd6f', 'request_id': 'req-eec90a75-c66f-4bd6-9c7e-7a9eb643730f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:55.340968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729bd21-5476-4038-b3ef-2be1dc6e7de8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:55.356616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eec90a75-c66f-4bd6-9c7e-7a9eb643730f admin admin] The token cache is being invalidate because project 0654d3c30aec4a2db3c7ac9f8a84dd6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:22:55.356994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eec90a75-c66f-4bd6-9c7e-7a9eb643730f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:55.357724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eec90a75-c66f-4bd6-9c7e-7a9eb643730f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:22:55.363828 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2903/5837] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:55 2022] DELETE /identity/v3/projects/0654d3c30aec4a2db3c7ac9f8a84dd6f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:55.365551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06226c7-f7ca-4d3e-9fdb-c91437403733 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:55.366098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06226c7-f7ca-4d3e-9fdb-c91437403733 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:55.366427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06226c7-f7ca-4d3e-9fdb-c91437403733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:55.393651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f06226c7-f7ca-4d3e-9fdb-c91437403733 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:55.408585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f06226c7-f7ca-4d3e-9fdb-c91437403733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:55.458217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:55.495772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc1cd6-ee6e-4f9d-9462-5b4510a89c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:55.496509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc1cd6-ee6e-4f9d-9462-5b4510a89c3b admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:55.496790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc1cd6-ee6e-4f9d-9462-5b4510a89c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:55.497066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc1cd6-ee6e-4f9d-9462-5b4510a89c3b admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:55.501326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc1cd6-ee6e-4f9d-9462-5b4510a89c3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:55.503655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc1cd6-ee6e-4f9d-9462-5b4510a89c3b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:55.541335 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2904/5838] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:55.541590 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2935/5839] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:55 2022] POST /identity/v3/users => generated 305 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:22:55.546036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bd936-d141-49b8-a433-6023b48ebfe6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:55.546036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bd936-d141-49b8-a433-6023b48ebfe6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:55.546036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bd936-d141-49b8-a433-6023b48ebfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:55.554831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc1cd6-ee6e-4f9d-9462-5b4510a89c3b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:55.559028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-14bc1cd6-ee6e-4f9d-9462-5b4510a89c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:55.584679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc1cd6-ee6e-4f9d-9462-5b4510a89c3b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:55.587360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d49bd936-d141-49b8-a433-6023b48ebfe6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:55.588639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d49bd936-d141-49b8-a433-6023b48ebfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:55.591673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf424a-be0e-4733-9961-002e80cdd34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:55.592635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf424a-be0e-4733-9961-002e80cdd34c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:55.592919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf424a-be0e-4733-9961-002e80cdd34c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:55.593408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf424a-be0e-4733-9961-002e80cdd34c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:55.594187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf424a-be0e-4733-9961-002e80cdd34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:55.595939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf424a-be0e-4733-9961-002e80cdd34c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:55.608438 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2936/5840] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:55.617978 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2905/5841] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:55.618089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf424a-be0e-4733-9961-002e80cdd34c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:55.619389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bd936-d141-49b8-a433-6023b48ebfe6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:55.637592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bd936-d141-49b8-a433-6023b48ebfe6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:55.643043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf424a-be0e-4733-9961-002e80cdd34c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:55.648427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4ff17-a8e4-429f-b918-f803e591780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:55.658828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4ff17-a8e4-429f-b918-f803e591780a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:55.659234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4ff17-a8e4-429f-b918-f803e591780a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:55.660460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4ff17-a8e4-429f-b918-f803e591780a admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:55.661260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4ff17-a8e4-429f-b918-f803e591780a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:22:55.661582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4ff17-a8e4-429f-b918-f803e591780a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:55.663228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4ff17-a8e4-429f-b918-f803e591780a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:55.668140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67799e-3fe2-44e6-b3fa-117830056dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:55.671694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67799e-3fe2-44e6-b3fa-117830056dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:55.674703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67799e-3fe2-44e6-b3fa-117830056dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:55.675013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67799e-3fe2-44e6-b3fa-117830056dc3 admin admin] PATH_INFO: `/v3/projects/842c77e4258245d28d75217840412a34/users/a3f223a52e224c55b19bfeec496a2cb8/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:55.713028 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2906/5842] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:22:55.720609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4ff17-a8e4-429f-b918-f803e591780a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:55.721056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67799e-3fe2-44e6-b3fa-117830056dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=842c77e4258245d28d75217840412a34, user_id=a3f223a52e224c55b19bfeec496a2cb8, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:55.721710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67799e-3fe2-44e6-b3fa-117830056dc3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:55.748136 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2937/5843] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:55 2022] PUT /identity/v3/projects/842c77e4258245d28d75217840412a34/users/a3f223a52e224c55b19bfeec496a2cb8/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:55.749245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67799e-3fe2-44e6-b3fa-117830056dc3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:55.775243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4ff17-a8e4-429f-b918-f803e591780a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:55.890551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb18617-e95f-40f0-8f5f-039482a99d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:55.891627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb18617-e95f-40f0-8f5f-039482a99d4a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:55.892160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb18617-e95f-40f0-8f5f-039482a99d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:55.892669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb18617-e95f-40f0-8f5f-039482a99d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:55.893662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb18617-e95f-40f0-8f5f-039482a99d4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:55.896337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb18617-e95f-40f0-8f5f-039482a99d4a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:55.897368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67799e-3fe2-44e6-b3fa-117830056dc3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:55.903321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187e3a8-032e-4844-89db-dbf17a9c1343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:55.904493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187e3a8-032e-4844-89db-dbf17a9c1343 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:55.904902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187e3a8-032e-4844-89db-dbf17a9c1343 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:55.905189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187e3a8-032e-4844-89db-dbf17a9c1343 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:55.906360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187e3a8-032e-4844-89db-dbf17a9c1343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:55.908019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187e3a8-032e-4844-89db-dbf17a9c1343 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:55.925536 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2938/5844] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:55.929667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187e3a8-032e-4844-89db-dbf17a9c1343 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:55.945335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187e3a8-032e-4844-89db-dbf17a9c1343 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:55.951822 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2907/5845] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:22:55 2022] POST /identity/v3/projects => generated 373 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:55.953133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb18617-e95f-40f0-8f5f-039482a99d4a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:56.000460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:56.013918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da64c3-e4ef-43e5-a38c-bb9cf2e62257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:56.015113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da64c3-e4ef-43e5-a38c-bb9cf2e62257 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:56.015776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da64c3-e4ef-43e5-a38c-bb9cf2e62257 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:56.016087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da64c3-e4ef-43e5-a38c-bb9cf2e62257 admin admin] PATH_INFO: `/v3/projects/842c77e4258245d28d75217840412a34/users/a3f223a52e224c55b19bfeec496a2cb8/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:56.018997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da64c3-e4ef-43e5-a38c-bb9cf2e62257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=842c77e4258245d28d75217840412a34, user_id=a3f223a52e224c55b19bfeec496a2cb8, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:56.021737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da64c3-e4ef-43e5-a38c-bb9cf2e62257 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:56.030621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb18617-e95f-40f0-8f5f-039482a99d4a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:56.035360 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2939/5846] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:55 2022] PUT /identity/v3/projects/842c77e4258245d28d75217840412a34/users/a3f223a52e224c55b19bfeec496a2cb8/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:22:56.036551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c2e86-f2c6-4723-92f0-7c2f4f12863f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:56.036842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c2e86-f2c6-4723-92f0-7c2f4f12863f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:56.039249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c2e86-f2c6-4723-92f0-7c2f4f12863f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:56.058937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6e4c2e86-f2c6-4723-92f0-7c2f4f12863f None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:56.060148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6e4c2e86-f2c6-4723-92f0-7c2f4f12863f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:56.154408 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2940/5847] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:56.155958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab19846-44b1-462a-943f-b8ca07e9eea2 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:56.156366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab19846-44b1-462a-943f-b8ca07e9eea2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:56.156650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab19846-44b1-462a-943f-b8ca07e9eea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:56.194273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-eab19846-44b1-462a-943f-b8ca07e9eea2 None None] MFA Rules not processed for user `a3f223a52e224c55b19bfeec496a2cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:56.195401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-eab19846-44b1-462a-943f-b8ca07e9eea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:56.256801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:56.278802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3896df-6cf1-4871-b996-1736a0d35540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:56.279880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3896df-6cf1-4871-b996-1736a0d35540 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:56.280584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3896df-6cf1-4871-b996-1736a0d35540 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:56.281021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3896df-6cf1-4871-b996-1736a0d35540 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:56.281873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3896df-6cf1-4871-b996-1736a0d35540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:56.285834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3896df-6cf1-4871-b996-1736a0d35540 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:56.314004 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2941/5848] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:56.314004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab19846-44b1-462a-943f-b8ca07e9eea2 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:56.314004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-eab19846-44b1-462a-943f-b8ca07e9eea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:56.327805 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2908/5849] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:22:55 2022] POST /identity/v3/users => generated 287 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:22:56.332826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3896df-6cf1-4871-b996-1736a0d35540 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:56.336375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4a3896df-6cf1-4871-b996-1736a0d35540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:56.428549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3896df-6cf1-4871-b996-1736a0d35540 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:56.432870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d09270-1dda-4773-a60a-569e0b5f8973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:56.433678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d09270-1dda-4773-a60a-569e0b5f8973 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:56.433854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d09270-1dda-4773-a60a-569e0b5f8973 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:56.434303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d09270-1dda-4773-a60a-569e0b5f8973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:56.437065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-21d09270-1dda-4773-a60a-569e0b5f8973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:56.489895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:56.501363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab19846-44b1-462a-943f-b8ca07e9eea2 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:56.514331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c5acc-ef65-435b-adaa-f5aeaa01fd3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:56.515014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c5acc-ef65-435b-adaa-f5aeaa01fd3f service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:56.515815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c5acc-ef65-435b-adaa-f5aeaa01fd3f service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:56.515815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c5acc-ef65-435b-adaa-f5aeaa01fd3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:56.534489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c5acc-ef65-435b-adaa-f5aeaa01fd3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:56.536252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c5acc-ef65-435b-adaa-f5aeaa01fd3f service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:56.547453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d09270-1dda-4773-a60a-569e0b5f8973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:56.550449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d09270-1dda-4773-a60a-569e0b5f8973 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:56.573611 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2942/5850] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:22:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:22:56.574671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c5acc-ef65-435b-adaa-f5aeaa01fd3f service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:56.577622 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2909/5851] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:56.627543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c5acc-ef65-435b-adaa-f5aeaa01fd3f service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:56.640855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557a368-c18c-4891-8c58-ca22a75933d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:56.641525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557a368-c18c-4891-8c58-ca22a75933d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:56.641815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557a368-c18c-4891-8c58-ca22a75933d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:56.642095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557a368-c18c-4891-8c58-ca22a75933d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:56.642883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557a368-c18c-4891-8c58-ca22a75933d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:56.651565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557a368-c18c-4891-8c58-ca22a75933d6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:56.687006 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2943/5852] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:56.691725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d09270-1dda-4773-a60a-569e0b5f8973 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:56.707934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d09270-1dda-4773-a60a-569e0b5f8973 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:56.722895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bc4c1-346b-41a1-a070-24cc987bba89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:56.724930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bc4c1-346b-41a1-a070-24cc987bba89 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:56.725261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bc4c1-346b-41a1-a070-24cc987bba89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:56.728488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bc4c1-346b-41a1-a070-24cc987bba89 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:56.730431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bc4c1-346b-41a1-a070-24cc987bba89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:56.734654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bc4c1-346b-41a1-a070-24cc987bba89 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:56.763151 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2910/5853] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:22:56.767733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557a368-c18c-4891-8c58-ca22a75933d6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:56.784310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557a368-c18c-4891-8c58-ca22a75933d6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:56.796954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed291cf-9085-4b4f-a538-43f3a817d50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:56.801199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed291cf-9085-4b4f-a538-43f3a817d50d admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:56.802011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed291cf-9085-4b4f-a538-43f3a817d50d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:56.802381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed291cf-9085-4b4f-a538-43f3a817d50d admin admin] PATH_INFO: `/v3/projects/1c134c2a0d744cd6a02a1fed3c6ab478/users/f575ac3b48794bcfb661d664c44950ea/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:56.835944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed291cf-9085-4b4f-a538-43f3a817d50d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c134c2a0d744cd6a02a1fed3c6ab478, user_id=f575ac3b48794bcfb661d664c44950ea, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:56.839025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed291cf-9085-4b4f-a538-43f3a817d50d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:56.864151 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2944/5854] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:22:56 2022] PUT /identity/v3/projects/1c134c2a0d744cd6a02a1fed3c6ab478/users/f575ac3b48794bcfb661d664c44950ea/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:22:56.873666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49019b-2def-47e3-b106-aa5ba0b8783e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:56.873929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49019b-2def-47e3-b106-aa5ba0b8783e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:56.874589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49019b-2def-47e3-b106-aa5ba0b8783e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:56.965226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4e49019b-2def-47e3-b106-aa5ba0b8783e None None] MFA Rules not processed for user `f575ac3b48794bcfb661d664c44950ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:56.972448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4e49019b-2def-47e3-b106-aa5ba0b8783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:57.195033 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2911/5855] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:22:57.260082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed291cf-9085-4b4f-a538-43f3a817d50d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:57.262808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8ed291cf-9085-4b4f-a538-43f3a817d50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:57.305509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49019b-2def-47e3-b106-aa5ba0b8783e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:57.307243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4e49019b-2def-47e3-b106-aa5ba0b8783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:57.322875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:57.449878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed291cf-9085-4b4f-a538-43f3a817d50d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:57.456677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c23111-8875-484e-b8b5-e5ed4bad1df6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:57.458511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c23111-8875-484e-b8b5-e5ed4bad1df6 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:57.459022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c23111-8875-484e-b8b5-e5ed4bad1df6 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:57.459451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c23111-8875-484e-b8b5-e5ed4bad1df6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:57.480859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49019b-2def-47e3-b106-aa5ba0b8783e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:57.496709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb33159-cde4-4c7f-b5b3-46e128c28915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:57.497697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb33159-cde4-4c7f-b5b3-46e128c28915 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:57.498155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb33159-cde4-4c7f-b5b3-46e128c28915 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:57.498588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb33159-cde4-4c7f-b5b3-46e128c28915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:57.514971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb33159-cde4-4c7f-b5b3-46e128c28915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:57.519517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb33159-cde4-4c7f-b5b3-46e128c28915 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:57.537630 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2912/5856] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:22:57.618174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c23111-8875-484e-b8b5-e5ed4bad1df6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:57.622764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c23111-8875-484e-b8b5-e5ed4bad1df6 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:57.657079 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2945/5857] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:58.666351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb33159-cde4-4c7f-b5b3-46e128c28915 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:22:58.683664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb33159-cde4-4c7f-b5b3-46e128c28915 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:22:58.700439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6014148-08e7-45bf-8665-64b1cef1c7d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:22:58.701126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6014148-08e7-45bf-8665-64b1cef1c7d0 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:58.701410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6014148-08e7-45bf-8665-64b1cef1c7d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:58.701693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6014148-08e7-45bf-8665-64b1cef1c7d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:58.703652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d6014148-08e7-45bf-8665-64b1cef1c7d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:58.828685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf93bf2-9808-419e-b509-7693cd8788b9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:22:58.829166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf93bf2-9808-419e-b509-7693cd8788b9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:22:58.829428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf93bf2-9808-419e-b509-7693cd8788b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:22:58.853856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6014148-08e7-45bf-8665-64b1cef1c7d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:22:58.855793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6014148-08e7-45bf-8665-64b1cef1c7d0 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:22:58.868992 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2913/5858] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:22:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:22:58.879868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ecf93bf2-9808-419e-b509-7693cd8788b9 None None] MFA Rules not processed for user `8fb8295b4af942d2be5d0cdb0a822868`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:22:58.881193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ecf93bf2-9808-419e-b509-7693cd8788b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:22:58.976259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:59.022299 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2946/5859] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:22:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:03.291242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13fccb-6d2e-48ce-84d8-f12e054a7455 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:03.292190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13fccb-6d2e-48ce-84d8-f12e054a7455 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:03.292656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13fccb-6d2e-48ce-84d8-f12e054a7455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:03.360388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6c13fccb-6d2e-48ce-84d8-f12e054a7455 None None] MFA Rules not processed for user `23d7253b721f409ab148368d84b87963`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:03.363968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6c13fccb-6d2e-48ce-84d8-f12e054a7455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:03.542407 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2914/5860] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:03.545567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97665c-ee65-4788-a482-6aab32e8a30b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:03.546399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97665c-ee65-4788-a482-6aab32e8a30b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:03.546896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97665c-ee65-4788-a482-6aab32e8a30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:03.630676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fa97665c-ee65-4788-a482-6aab32e8a30b None None] MFA Rules not processed for user `23d7253b721f409ab148368d84b87963`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:03.632645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fa97665c-ee65-4788-a482-6aab32e8a30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:03.670329 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2947/5861] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:03.683521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13fccb-6d2e-48ce-84d8-f12e054a7455 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:03.713172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13fccb-6d2e-48ce-84d8-f12e054a7455 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:03.741830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fc956-ec6d-4fa1-9982-993b9bca4c03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:03.742564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fc956-ec6d-4fa1-9982-993b9bca4c03 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:03.744395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fc956-ec6d-4fa1-9982-993b9bca4c03 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:03.744691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fc956-ec6d-4fa1-9982-993b9bca4c03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:03.766670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fc956-ec6d-4fa1-9982-993b9bca4c03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:03.768702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fc956-ec6d-4fa1-9982-993b9bca4c03 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:03.810343 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2915/5862] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:23:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:23:04.551243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97665c-ee65-4788-a482-6aab32e8a30b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:04.553355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fa97665c-ee65-4788-a482-6aab32e8a30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:04.595402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97665c-ee65-4788-a482-6aab32e8a30b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:04.613821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0ff74-0dde-40c6-858d-27c8f79a43f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:04.614756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0ff74-0dde-40c6-858d-27c8f79a43f7 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:04.615220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0ff74-0dde-40c6-858d-27c8f79a43f7 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:04.615656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0ff74-0dde-40c6-858d-27c8f79a43f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:04.618935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c0e0ff74-0dde-40c6-858d-27c8f79a43f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:04.658943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0ff74-0dde-40c6-858d-27c8f79a43f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:04.663460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0ff74-0dde-40c6-858d-27c8f79a43f7 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:04.714783 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2948/5863] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:23:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:23:06.632077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3c892-e2ec-4048-b2f9-79a76c83ebfd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:06.632567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3c892-e2ec-4048-b2f9-79a76c83ebfd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:06.632654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3c892-e2ec-4048-b2f9-79a76c83ebfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:06.680345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-94b3c892-e2ec-4048-b2f9-79a76c83ebfd None None] MFA Rules not processed for user `8fb8295b4af942d2be5d0cdb0a822868`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:06.681911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-94b3c892-e2ec-4048-b2f9-79a76c83ebfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:06.703043 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2916/5864] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:07.931649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2deaa-93b5-4128-a811-d798c403b9e6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:07.932343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2deaa-93b5-4128-a811-d798c403b9e6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:07.932343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2deaa-93b5-4128-a811-d798c403b9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:07.965249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bea2deaa-93b5-4128-a811-d798c403b9e6 None None] MFA Rules not processed for user `8fb8295b4af942d2be5d0cdb0a822868`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:07.968754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bea2deaa-93b5-4128-a811-d798c403b9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:07.993001 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2949/5865] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:09.317857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7a2fb-82d9-426a-8eed-1ae9d9809e37 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:09.319265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7a2fb-82d9-426a-8eed-1ae9d9809e37 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:09.319703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7a2fb-82d9-426a-8eed-1ae9d9809e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:09.388722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-93d7a2fb-82d9-426a-8eed-1ae9d9809e37 None None] MFA Rules not processed for user `8fb8295b4af942d2be5d0cdb0a822868`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:09.392312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-93d7a2fb-82d9-426a-8eed-1ae9d9809e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:09.426562 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2917/5866] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:10.796486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3c127-48cd-4f3a-a904-a229cef2ec01 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:10.797136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3c127-48cd-4f3a-a904-a229cef2ec01 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:10.797237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3c127-48cd-4f3a-a904-a229cef2ec01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:10.818816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-19c3c127-48cd-4f3a-a904-a229cef2ec01 None None] MFA Rules not processed for user `8fb8295b4af942d2be5d0cdb0a822868`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:10.821256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-19c3c127-48cd-4f3a-a904-a229cef2ec01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:10.835956 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2950/5867] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:11.748903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c8ce0-4e01-406b-aa96-f4a3c7edfe93 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:11.749460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c8ce0-4e01-406b-aa96-f4a3c7edfe93 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:11.749460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c8ce0-4e01-406b-aa96-f4a3c7edfe93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:11.786029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:11.798419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-630c8ce0-4e01-406b-aa96-f4a3c7edfe93 None None] MFA Rules not processed for user `8fb8295b4af942d2be5d0cdb0a822868`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:11.806568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-630c8ce0-4e01-406b-aa96-f4a3c7edfe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:11.819252 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2918/5868] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:13.277254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd8ad7-43bc-45c7-adbe-b789a7bfec1f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:13.277861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd8ad7-43bc-45c7-adbe-b789a7bfec1f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:13.278079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd8ad7-43bc-45c7-adbe-b789a7bfec1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:13.311131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d8fd8ad7-43bc-45c7-adbe-b789a7bfec1f None None] MFA Rules not processed for user `8fb8295b4af942d2be5d0cdb0a822868`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:13.314656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d8fd8ad7-43bc-45c7-adbe-b789a7bfec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:13.337462 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2951/5869] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:15.154826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d7556-7b79-4570-ada5-54034f125b35 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:15.155327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d7556-7b79-4570-ada5-54034f125b35 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:15.155520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d7556-7b79-4570-ada5-54034f125b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:15.186596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-732d7556-7b79-4570-ada5-54034f125b35 None None] MFA Rules not processed for user `8fb8295b4af942d2be5d0cdb0a822868`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:15.188578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-732d7556-7b79-4570-ada5-54034f125b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:15.206764 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2919/5870] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:16.498832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd8ad7-43bc-45c7-adbe-b789a7bfec1f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:16.571012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd8ad7-43bc-45c7-adbe-b789a7bfec1f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:16.576289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dcfa3-9261-4ea8-9d12-9e3055f48b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:16.577273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dcfa3-9261-4ea8-9d12-9e3055f48b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:16.577624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dcfa3-9261-4ea8-9d12-9e3055f48b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:16.577964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dcfa3-9261-4ea8-9d12-9e3055f48b21 admin admin] PATH_INFO: `/v3/users/f575ac3b48794bcfb661d664c44950ea` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:16.579657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4dcfa3-9261-4ea8-9d12-9e3055f48b21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f575ac3b48794bcfb661d664c44950ea)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:16.581717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4dcfa3-9261-4ea8-9d12-9e3055f48b21 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:16.655471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-be4dcfa3-9261-4ea8-9d12-9e3055f48b21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f575ac3b48794bcfb661d664c44950ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:16.671710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-be4dcfa3-9261-4ea8-9d12-9e3055f48b21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f575ac3b48794bcfb661d664c44950ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:16.673503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-be4dcfa3-9261-4ea8-9d12-9e3055f48b21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f575ac3b48794bcfb661d664c44950ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:16.674573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-be4dcfa3-9261-4ea8-9d12-9e3055f48b21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f575ac3b48794bcfb661d664c44950ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:16.686983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-be4dcfa3-9261-4ea8-9d12-9e3055f48b21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f575ac3b48794bcfb661d664c44950ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:16.716944 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2952/5871] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:23:16 2022] DELETE /identity/v3/users/f575ac3b48794bcfb661d664c44950ea => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:23:16.721200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f507e-a951-4b90-8e89-6abc545073a9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:16.722084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f507e-a951-4b90-8e89-6abc545073a9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:16.722539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f507e-a951-4b90-8e89-6abc545073a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:16.742411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-748f507e-a951-4b90-8e89-6abc545073a9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:16.743619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-748f507e-a951-4b90-8e89-6abc545073a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:16.821971 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2920/5872] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:16.848978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dcfa3-9261-4ea8-9d12-9e3055f48b21 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:16.850654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-be4dcfa3-9261-4ea8-9d12-9e3055f48b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:16.900407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:16.944828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dcfa3-9261-4ea8-9d12-9e3055f48b21 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:16.952971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe9773-85bc-489a-934d-3f684f92af2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:16.953700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9773-85bc-489a-934d-3f684f92af2b service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:16.953993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9773-85bc-489a-934d-3f684f92af2b service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:16.954439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9773-85bc-489a-934d-3f684f92af2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:16.975933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe9773-85bc-489a-934d-3f684f92af2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:16.977466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe9773-85bc-489a-934d-3f684f92af2b service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:16.998342 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2953/5873] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:23:17.003280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455276d6-3b03-44ee-a21a-e4f6e0213936 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:17.003457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455276d6-3b03-44ee-a21a-e4f6e0213936 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:17.003832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455276d6-3b03-44ee-a21a-e4f6e0213936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:17.033139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-455276d6-3b03-44ee-a21a-e4f6e0213936 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:17.034746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-455276d6-3b03-44ee-a21a-e4f6e0213936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:17.105420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe9773-85bc-489a-934d-3f684f92af2b service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:17.107230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8efe9773-85bc-489a-934d-3f684f92af2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:17.146010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe9773-85bc-489a-934d-3f684f92af2b service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:17.161334 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2921/5874] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:23:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:17.168744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea3713-6bfa-4f87-aea8-7b6768a464ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:17.169847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea3713-6bfa-4f87-aea8-7b6768a464ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:17.170381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea3713-6bfa-4f87-aea8-7b6768a464ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:17.171588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea3713-6bfa-4f87-aea8-7b6768a464ca admin admin] PATH_INFO: `/v3/users/391ed3d894394b47b115f6d9394e3f3d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:17.179859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455276d6-3b03-44ee-a21a-e4f6e0213936 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:17.182534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea3713-6bfa-4f87-aea8-7b6768a464ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=391ed3d894394b47b115f6d9394e3f3d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:17.183725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-455276d6-3b03-44ee-a21a-e4f6e0213936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:17.186692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea3713-6bfa-4f87-aea8-7b6768a464ca admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:17.288645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-66ea3713-6bfa-4f87-aea8-7b6768a464ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '391ed3d894394b47b115f6d9394e3f3d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:17.289166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455276d6-3b03-44ee-a21a-e4f6e0213936 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:17.296625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfad90-e615-4cde-b655-c2636ddf11e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:17.297437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfad90-e615-4cde-b655-c2636ddf11e6 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:17.297751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfad90-e615-4cde-b655-c2636ddf11e6 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:17.298029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfad90-e615-4cde-b655-c2636ddf11e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:17.300270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-66ea3713-6bfa-4f87-aea8-7b6768a464ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '391ed3d894394b47b115f6d9394e3f3d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:17.301313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-66ea3713-6bfa-4f87-aea8-7b6768a464ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '391ed3d894394b47b115f6d9394e3f3d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:17.302274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-66ea3713-6bfa-4f87-aea8-7b6768a464ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '391ed3d894394b47b115f6d9394e3f3d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:17.311733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfad90-e615-4cde-b655-c2636ddf11e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:17.313855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfad90-e615-4cde-b655-c2636ddf11e6 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:17.314206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-66ea3713-6bfa-4f87-aea8-7b6768a464ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '391ed3d894394b47b115f6d9394e3f3d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:17.328749 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2922/5875] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:23:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:23:17.337923 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2954/5876] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:23:17 2022] DELETE /identity/v3/users/391ed3d894394b47b115f6d9394e3f3d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:23:17.366686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24aace-b9d1-4d2e-9a3b-0aef036230b9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:17.367010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24aace-b9d1-4d2e-9a3b-0aef036230b9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:17.367294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24aace-b9d1-4d2e-9a3b-0aef036230b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:17.395708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-df24aace-b9d1-4d2e-9a3b-0aef036230b9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:17.397224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-df24aace-b9d1-4d2e-9a3b-0aef036230b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:17.443348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:17.444206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea3713-6bfa-4f87-aea8-7b6768a464ca admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:17.446649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-66ea3713-6bfa-4f87-aea8-7b6768a464ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:17.547738 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2923/5877] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:17.558350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea3713-6bfa-4f87-aea8-7b6768a464ca admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:17.562281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24aace-b9d1-4d2e-9a3b-0aef036230b9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:17.564970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-df24aace-b9d1-4d2e-9a3b-0aef036230b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:17.565714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dc0eb-3749-47eb-966d-051c50f281ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:17.567529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dc0eb-3749-47eb-966d-051c50f281ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:17.568240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dc0eb-3749-47eb-966d-051c50f281ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:17.568867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dc0eb-3749-47eb-966d-051c50f281ea admin admin] PATH_INFO: `/v3/projects/1c134c2a0d744cd6a02a1fed3c6ab478` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:17.576299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dc0eb-3749-47eb-966d-051c50f281ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c134c2a0d744cd6a02a1fed3c6ab478)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:17.582626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dc0eb-3749-47eb-966d-051c50f281ea admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:17.649325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24aace-b9d1-4d2e-9a3b-0aef036230b9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:17.653737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18487b41-0d5c-4c39-8e43-a049a5bce653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:17.654980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18487b41-0d5c-4c39-8e43-a049a5bce653 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:17.655179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18487b41-0d5c-4c39-8e43-a049a5bce653 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:17.655460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18487b41-0d5c-4c39-8e43-a049a5bce653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:17.667805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18487b41-0d5c-4c39-8e43-a049a5bce653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:17.669204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:17.669452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18487b41-0d5c-4c39-8e43-a049a5bce653 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:17.679190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-265dc0eb-3749-47eb-966d-051c50f281ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c134c2a0d744cd6a02a1fed3c6ab478', 'request_id': 'req-265dc0eb-3749-47eb-966d-051c50f281ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:17.685667 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2924/5878] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:23:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:23:17.703100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-265dc0eb-3749-47eb-966d-051c50f281ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c134c2a0d744cd6a02a1fed3c6ab478', 'request_id': 'req-265dc0eb-3749-47eb-966d-051c50f281ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:17.713349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-265dc0eb-3749-47eb-966d-051c50f281ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c134c2a0d744cd6a02a1fed3c6ab478', 'request_id': 'req-265dc0eb-3749-47eb-966d-051c50f281ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:17.748370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-265dc0eb-3749-47eb-966d-051c50f281ea admin admin] The token cache is being invalidate because project 1c134c2a0d744cd6a02a1fed3c6ab478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:23:17.748743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-265dc0eb-3749-47eb-966d-051c50f281ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:17.751407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-265dc0eb-3749-47eb-966d-051c50f281ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:17.758520 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2955/5879] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:17 2022] DELETE /identity/v3/projects/1c134c2a0d744cd6a02a1fed3c6ab478 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:23:17.760990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142e504-ed7e-44ef-9702-1e547ab2a99d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:17.761461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142e504-ed7e-44ef-9702-1e547ab2a99d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:17.761579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142e504-ed7e-44ef-9702-1e547ab2a99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:17.788384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0142e504-ed7e-44ef-9702-1e547ab2a99d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:17.789723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0142e504-ed7e-44ef-9702-1e547ab2a99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:17.868753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28498e2b-bb1a-4fbc-96e2-2a6376099f4a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:17.868985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28498e2b-bb1a-4fbc-96e2-2a6376099f4a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:17.869211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28498e2b-bb1a-4fbc-96e2-2a6376099f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:17.873221 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2925/5880] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:23:17.888299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-28498e2b-bb1a-4fbc-96e2-2a6376099f4a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:17.889542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-28498e2b-bb1a-4fbc-96e2-2a6376099f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:17.900450 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2956/5881] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:17.902967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142e504-ed7e-44ef-9702-1e547ab2a99d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:17.913967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142e504-ed7e-44ef-9702-1e547ab2a99d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:17.919153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fa352-786e-4301-a87e-aad4e3773761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:17.919828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fa352-786e-4301-a87e-aad4e3773761 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:17.920276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fa352-786e-4301-a87e-aad4e3773761 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:17.920553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fa352-786e-4301-a87e-aad4e3773761 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:17.921345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fa352-786e-4301-a87e-aad4e3773761 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:23:17.921689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fa352-786e-4301-a87e-aad4e3773761 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:17.923860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fa352-786e-4301-a87e-aad4e3773761 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:17.937175 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2926/5882] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:23:17.942069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28498e2b-bb1a-4fbc-96e2-2a6376099f4a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:17.952226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28498e2b-bb1a-4fbc-96e2-2a6376099f4a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:17.967148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d8bd5-3a40-46ed-bd62-64bd41293ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:17.968093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d8bd5-3a40-46ed-bd62-64bd41293ded admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:17.968370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d8bd5-3a40-46ed-bd62-64bd41293ded admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:17.968604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d8bd5-3a40-46ed-bd62-64bd41293ded admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:17.969370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d8bd5-3a40-46ed-bd62-64bd41293ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:17.971600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d8bd5-3a40-46ed-bd62-64bd41293ded admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:17.989819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e99e4-78bb-4eef-9a94-b3247f38455c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:17.990639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e99e4-78bb-4eef-9a94-b3247f38455c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:17.990639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e99e4-78bb-4eef-9a94-b3247f38455c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:18.024297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fc7e99e4-78bb-4eef-9a94-b3247f38455c None None] MFA Rules not processed for user `fa780176ae5f4a618e42a47531b0d4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:18.025563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fc7e99e4-78bb-4eef-9a94-b3247f38455c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:18.035576 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2957/5883] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:23:17 2022] POST /identity/v3/projects => generated 363 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:23:18.035576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d8bd5-3a40-46ed-bd62-64bd41293ded admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:18.037271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-141d8bd5-3a40-46ed-bd62-64bd41293ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:18.112087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:18.148439 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2927/5884] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:17 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:23:18.148439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e99e4-78bb-4eef-9a94-b3247f38455c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:18.153123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d8bd5-3a40-46ed-bd62-64bd41293ded admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:18.158810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e99e4-78bb-4eef-9a94-b3247f38455c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:18.161177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c5e01-effa-4254-87b7-2d1ebf14f1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:18.162482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c5e01-effa-4254-87b7-2d1ebf14f1b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:18.162761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c5e01-effa-4254-87b7-2d1ebf14f1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:18.163145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c5e01-effa-4254-87b7-2d1ebf14f1b1 admin admin] PATH_INFO: `/v3/projects/3930dc57b0d54bcd899f0878648df48f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:18.163489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f7eb9-fcec-4f97-8dd9-822f0baaeadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:18.164185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f7eb9-fcec-4f97-8dd9-822f0baaeadc admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:18.164644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c5e01-effa-4254-87b7-2d1ebf14f1b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3930dc57b0d54bcd899f0878648df48f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:18.164778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f7eb9-fcec-4f97-8dd9-822f0baaeadc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:18.164908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f7eb9-fcec-4f97-8dd9-822f0baaeadc admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:18.165558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f7eb9-fcec-4f97-8dd9-822f0baaeadc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:18.166516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c5e01-effa-4254-87b7-2d1ebf14f1b1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:18.167584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f7eb9-fcec-4f97-8dd9-822f0baaeadc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:18.195039 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2928/5885] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:23:18 2022] POST /identity/v3/users => generated 282 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:23:18.199338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f7eb9-fcec-4f97-8dd9-822f0baaeadc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:18.214124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f7eb9-fcec-4f97-8dd9-822f0baaeadc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:18.219045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e278a1-d759-4469-962e-09383348a9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:18.219815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e278a1-d759-4469-962e-09383348a9df admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:18.220209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e278a1-d759-4469-962e-09383348a9df admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:18.220597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e278a1-d759-4469-962e-09383348a9df admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:18.221414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e278a1-d759-4469-962e-09383348a9df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:18.223283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e278a1-d759-4469-962e-09383348a9df admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:18.234424 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2929/5886] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:23:18.238248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e278a1-d759-4469-962e-09383348a9df admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:18.239191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-421c5e01-effa-4254-87b7-2d1ebf14f1b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3930dc57b0d54bcd899f0878648df48f', 'request_id': 'req-421c5e01-effa-4254-87b7-2d1ebf14f1b1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:18.249088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e278a1-d759-4469-962e-09383348a9df admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:18.250237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-421c5e01-effa-4254-87b7-2d1ebf14f1b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3930dc57b0d54bcd899f0878648df48f', 'request_id': 'req-421c5e01-effa-4254-87b7-2d1ebf14f1b1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:18.264366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-421c5e01-effa-4254-87b7-2d1ebf14f1b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3930dc57b0d54bcd899f0878648df48f', 'request_id': 'req-421c5e01-effa-4254-87b7-2d1ebf14f1b1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:18.280081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-421c5e01-effa-4254-87b7-2d1ebf14f1b1 admin admin] The token cache is being invalidate because project 3930dc57b0d54bcd899f0878648df48f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:23:18.280324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-421c5e01-effa-4254-87b7-2d1ebf14f1b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:18.280950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-421c5e01-effa-4254-87b7-2d1ebf14f1b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:18.283206 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2958/5887] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:18 2022] DELETE /identity/v3/projects/3930dc57b0d54bcd899f0878648df48f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:23:18.287060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c5e01-effa-4254-87b7-2d1ebf14f1b1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:18.289045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-421c5e01-effa-4254-87b7-2d1ebf14f1b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:18.337360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905e33d-517f-451b-8bef-a5976a7eed76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:18.337360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905e33d-517f-451b-8bef-a5976a7eed76 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:18.337360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905e33d-517f-451b-8bef-a5976a7eed76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:18.337360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905e33d-517f-451b-8bef-a5976a7eed76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:18.337718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905e33d-517f-451b-8bef-a5976a7eed76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:18.337718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905e33d-517f-451b-8bef-a5976a7eed76 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:18.351676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:18.352775 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2930/5888] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:23:18.356885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905e33d-517f-451b-8bef-a5976a7eed76 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:18.359210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7905e33d-517f-451b-8bef-a5976a7eed76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:18.382599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c5e01-effa-4254-87b7-2d1ebf14f1b1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:18.384850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905e33d-517f-451b-8bef-a5976a7eed76 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:18.395215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbc802-e87d-4add-84e6-255c4498412f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:18.396361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbc802-e87d-4add-84e6-255c4498412f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:18.397131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbc802-e87d-4add-84e6-255c4498412f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:18.397302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbc802-e87d-4add-84e6-255c4498412f admin admin] PATH_INFO: `/v3/users/a3f223a52e224c55b19bfeec496a2cb8` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:18.398503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d736b1-37d8-42c4-b899-b93782bc9943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:18.399425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d736b1-37d8-42c4-b899-b93782bc9943 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:18.399684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d736b1-37d8-42c4-b899-b93782bc9943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:18.399961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d736b1-37d8-42c4-b899-b93782bc9943 admin admin] PATH_INFO: `/v3/projects/b94bbe82dcff439abf6005558f354a81/users/4ea193cd32cd4e0ea576e211a4c91311/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:18.400935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbc802-e87d-4add-84e6-255c4498412f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3f223a52e224c55b19bfeec496a2cb8)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:18.412384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbc802-e87d-4add-84e6-255c4498412f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:18.425983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d736b1-37d8-42c4-b899-b93782bc9943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b94bbe82dcff439abf6005558f354a81, user_id=4ea193cd32cd4e0ea576e211a4c91311, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:18.428822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d736b1-37d8-42c4-b899-b93782bc9943 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:18.456195 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2931/5889] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:23:18 2022] PUT /identity/v3/projects/b94bbe82dcff439abf6005558f354a81/users/4ea193cd32cd4e0ea576e211a4c91311/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:23:18.462391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad5c75-f0ff-44a0-b3f9-23945e13397d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:18.463635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad5c75-f0ff-44a0-b3f9-23945e13397d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:18.463970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad5c75-f0ff-44a0-b3f9-23945e13397d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:18.500199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-25dbc802-e87d-4add-84e6-255c4498412f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3f223a52e224c55b19bfeec496a2cb8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:18.502507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-87ad5c75-f0ff-44a0-b3f9-23945e13397d None None] MFA Rules not processed for user `4ea193cd32cd4e0ea576e211a4c91311`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:18.504127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-87ad5c75-f0ff-44a0-b3f9-23945e13397d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:18.511543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-25dbc802-e87d-4add-84e6-255c4498412f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3f223a52e224c55b19bfeec496a2cb8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:18.512418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-25dbc802-e87d-4add-84e6-255c4498412f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3f223a52e224c55b19bfeec496a2cb8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:18.513033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-25dbc802-e87d-4add-84e6-255c4498412f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3f223a52e224c55b19bfeec496a2cb8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:18.521502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-25dbc802-e87d-4add-84e6-255c4498412f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3f223a52e224c55b19bfeec496a2cb8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:18.543180 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2959/5890] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:23:18 2022] DELETE /identity/v3/users/a3f223a52e224c55b19bfeec496a2cb8 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:23:18.599234 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2932/5891] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:18.618680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbc802-e87d-4add-84e6-255c4498412f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:18.620415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-25dbc802-e87d-4add-84e6-255c4498412f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:18.691033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbc802-e87d-4add-84e6-255c4498412f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:18.695229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e4b9c-54db-4979-8e70-a00bf96918fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:18.695755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e4b9c-54db-4979-8e70-a00bf96918fc service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:18.696054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e4b9c-54db-4979-8e70-a00bf96918fc service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:18.696339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e4b9c-54db-4979-8e70-a00bf96918fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:18.754947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad5c75-f0ff-44a0-b3f9-23945e13397d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:18.756914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-87ad5c75-f0ff-44a0-b3f9-23945e13397d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:18.803479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e4b9c-54db-4979-8e70-a00bf96918fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:18.805853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e4b9c-54db-4979-8e70-a00bf96918fc service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:18.815135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:18.817319 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2960/5892] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:23:18 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:23:18.875021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad5c75-f0ff-44a0-b3f9-23945e13397d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:18.954402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb778029-e372-4da5-9579-75a54771173b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:18.955296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb778029-e372-4da5-9579-75a54771173b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:18.955558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb778029-e372-4da5-9579-75a54771173b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:18.955830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb778029-e372-4da5-9579-75a54771173b admin admin] PATH_INFO: `/v3/projects/842c77e4258245d28d75217840412a34` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:18.957709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb778029-e372-4da5-9579-75a54771173b admin admin] RBAC: Authorizing `identity:delete_project(project_id=842c77e4258245d28d75217840412a34)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:18.960231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb778029-e372-4da5-9579-75a54771173b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:19.018615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eb778029-e372-4da5-9579-75a54771173b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '842c77e4258245d28d75217840412a34', 'request_id': 'req-eb778029-e372-4da5-9579-75a54771173b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:19.026728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eb778029-e372-4da5-9579-75a54771173b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '842c77e4258245d28d75217840412a34', 'request_id': 'req-eb778029-e372-4da5-9579-75a54771173b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:19.035467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eb778029-e372-4da5-9579-75a54771173b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '842c77e4258245d28d75217840412a34', 'request_id': 'req-eb778029-e372-4da5-9579-75a54771173b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:19.061624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eb778029-e372-4da5-9579-75a54771173b admin admin] The token cache is being invalidate because project 842c77e4258245d28d75217840412a34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:23:19.062490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eb778029-e372-4da5-9579-75a54771173b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:19.063565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eb778029-e372-4da5-9579-75a54771173b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:23:19.069939 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2933/5893] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:18 2022] DELETE /identity/v3/projects/842c77e4258245d28d75217840412a34 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:23:19.071859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8aa02-cda1-4fc8-b8df-fa2c27cdd27e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:19.072509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8aa02-cda1-4fc8-b8df-fa2c27cdd27e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:19.073003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8aa02-cda1-4fc8-b8df-fa2c27cdd27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:19.097911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fad8aa02-cda1-4fc8-b8df-fa2c27cdd27e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:19.099661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fad8aa02-cda1-4fc8-b8df-fa2c27cdd27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:19.110158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:19.180743 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2961/5894] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:19.191677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fbc7a-c3ac-4981-8dc9-324c44c1e640 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:19.192088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fbc7a-c3ac-4981-8dc9-324c44c1e640 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:19.192294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fbc7a-c3ac-4981-8dc9-324c44c1e640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:19.222874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-169fbc7a-c3ac-4981-8dc9-324c44c1e640 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:19.225883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-169fbc7a-c3ac-4981-8dc9-324c44c1e640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:19.245000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8aa02-cda1-4fc8-b8df-fa2c27cdd27e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:19.255129 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2934/5895] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:19.257395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8aa02-cda1-4fc8-b8df-fa2c27cdd27e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:19.276287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b52bf-f042-4855-bb04-8797a4ce052c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:19.277674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b52bf-f042-4855-bb04-8797a4ce052c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:19.278406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b52bf-f042-4855-bb04-8797a4ce052c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:19.279186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b52bf-f042-4855-bb04-8797a4ce052c admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:19.280275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b52bf-f042-4855-bb04-8797a4ce052c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:23:19.280798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b52bf-f042-4855-bb04-8797a4ce052c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:19.282668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b52bf-f042-4855-bb04-8797a4ce052c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:19.297063 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2962/5896] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:23:19.301737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fbc7a-c3ac-4981-8dc9-324c44c1e640 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:19.321711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fbc7a-c3ac-4981-8dc9-324c44c1e640 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:19.332487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c27e2-cdae-42ba-bced-3be0ae64e931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:19.333362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c27e2-cdae-42ba-bced-3be0ae64e931 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:19.333652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c27e2-cdae-42ba-bced-3be0ae64e931 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:19.333926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c27e2-cdae-42ba-bced-3be0ae64e931 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:19.334740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c27e2-cdae-42ba-bced-3be0ae64e931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:19.336947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c27e2-cdae-42ba-bced-3be0ae64e931 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:19.389751 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2935/5897] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:23:19 2022] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:23:19.393520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b52bf-f042-4855-bb04-8797a4ce052c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:19.407050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b52bf-f042-4855-bb04-8797a4ce052c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:19.505268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97b95e-01b8-46e8-ada3-bbdf97b8686a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:19.506097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97b95e-01b8-46e8-ada3-bbdf97b8686a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:19.506303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97b95e-01b8-46e8-ada3-bbdf97b8686a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:19.506581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97b95e-01b8-46e8-ada3-bbdf97b8686a admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:19.509374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97b95e-01b8-46e8-ada3-bbdf97b8686a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:19.511693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97b95e-01b8-46e8-ada3-bbdf97b8686a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:19.550356 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2963/5898] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:23:19 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:23:19.553942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c27e2-cdae-42ba-bced-3be0ae64e931 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:19.579981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c27e2-cdae-42ba-bced-3be0ae64e931 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:19.592175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99386c-c687-4a8e-9c97-6631ab47d737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:19.595391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99386c-c687-4a8e-9c97-6631ab47d737 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:19.611591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99386c-c687-4a8e-9c97-6631ab47d737 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:19.618025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99386c-c687-4a8e-9c97-6631ab47d737 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:19.618923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99386c-c687-4a8e-9c97-6631ab47d737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:19.620689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99386c-c687-4a8e-9c97-6631ab47d737 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:19.648691 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2936/5899] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:23:19.652545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97b95e-01b8-46e8-ada3-bbdf97b8686a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:19.681505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97b95e-01b8-46e8-ada3-bbdf97b8686a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:19.695327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fede4-d1e3-4f69-9b5f-ab6c5d4e7fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:19.696256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fede4-d1e3-4f69-9b5f-ab6c5d4e7fbe admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:19.696617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fede4-d1e3-4f69-9b5f-ab6c5d4e7fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:19.701034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fede4-d1e3-4f69-9b5f-ab6c5d4e7fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:19.701902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fede4-d1e3-4f69-9b5f-ab6c5d4e7fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:19.703942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fede4-d1e3-4f69-9b5f-ab6c5d4e7fbe admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:19.729968 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2964/5900] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:23:19.734308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99386c-c687-4a8e-9c97-6631ab47d737 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:19.765299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99386c-c687-4a8e-9c97-6631ab47d737 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:19.770900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e35a8-f4d8-4d18-8153-3ff2c42b1a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:19.772003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e35a8-f4d8-4d18-8153-3ff2c42b1a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:19.772474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e35a8-f4d8-4d18-8153-3ff2c42b1a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:19.772757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e35a8-f4d8-4d18-8153-3ff2c42b1a3a admin admin] PATH_INFO: `/v3/projects/1692635e0f2e4fca961fc2926db5ab92/users/8f2aa529dd674c5ca0e8bd9c33b09306/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:19.814747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e35a8-f4d8-4d18-8153-3ff2c42b1a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1692635e0f2e4fca961fc2926db5ab92, user_id=8f2aa529dd674c5ca0e8bd9c33b09306, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:19.828158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e35a8-f4d8-4d18-8153-3ff2c42b1a3a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:19.863175 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2937/5901] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:23:19 2022] PUT /identity/v3/projects/1692635e0f2e4fca961fc2926db5ab92/users/8f2aa529dd674c5ca0e8bd9c33b09306/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:23:19.876268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ec616-87d5-42fd-8058-56765428c748 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:19.877108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ec616-87d5-42fd-8058-56765428c748 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:19.877542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ec616-87d5-42fd-8058-56765428c748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:19.927730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b52ec616-87d5-42fd-8058-56765428c748 None None] MFA Rules not processed for user `8f2aa529dd674c5ca0e8bd9c33b09306`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:19.929344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b52ec616-87d5-42fd-8058-56765428c748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:20.030866 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2965/5902] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:20.041489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e35a8-f4d8-4d18-8153-3ff2c42b1a3a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:20.043647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8a8e35a8-f4d8-4d18-8153-3ff2c42b1a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:20.049253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:20.166198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e35a8-f4d8-4d18-8153-3ff2c42b1a3a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:20.170417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf10707-e73c-43e9-9d4e-81b6ff0e197a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:20.171091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf10707-e73c-43e9-9d4e-81b6ff0e197a service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:20.171374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf10707-e73c-43e9-9d4e-81b6ff0e197a service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:20.171647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf10707-e73c-43e9-9d4e-81b6ff0e197a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:20.183112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf10707-e73c-43e9-9d4e-81b6ff0e197a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:20.184988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf10707-e73c-43e9-9d4e-81b6ff0e197a service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:20.196293 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2938/5903] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:23:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:23:21.263495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbd1e9-3986-41a0-afac-2fc4f689a31f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:21.264186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbd1e9-3986-41a0-afac-2fc4f689a31f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:21.264186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbd1e9-3986-41a0-afac-2fc4f689a31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:21.285559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:21.296205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bfdbd1e9-3986-41a0-afac-2fc4f689a31f None None] MFA Rules not processed for user `8fb8295b4af942d2be5d0cdb0a822868`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:21.297886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bfdbd1e9-3986-41a0-afac-2fc4f689a31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:21.384379 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2966/5904] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:23:22.244555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21579dea-28eb-4cf4-ace2-92c0cc0eca82 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:22.247522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21579dea-28eb-4cf4-ace2-92c0cc0eca82 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:22.248020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21579dea-28eb-4cf4-ace2-92c0cc0eca82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:22.270186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-21579dea-28eb-4cf4-ace2-92c0cc0eca82 None None] MFA Rules not processed for user `8fb8295b4af942d2be5d0cdb0a822868`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:22.272558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-21579dea-28eb-4cf4-ace2-92c0cc0eca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:22.289933 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2939/5905] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:31.368894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=22 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:32.263098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=28 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:35.819136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc88d3-baa7-4142-8145-dcc62d96d0a9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:35.820084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc88d3-baa7-4142-8145-dcc62d96d0a9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:35.820538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc88d3-baa7-4142-8145-dcc62d96d0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:35.839573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a0dc88d3-baa7-4142-8145-dcc62d96d0a9 None None] MFA Rules not processed for user `8fb8295b4af942d2be5d0cdb0a822868`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:35.841609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a0dc88d3-baa7-4142-8145-dcc62d96d0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:35.854642 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2967/5906] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:45.286348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aa080-6d2e-4cdf-b24a-05eca1c8c668 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:45.287221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aa080-6d2e-4cdf-b24a-05eca1c8c668 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:45.287682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aa080-6d2e-4cdf-b24a-05eca1c8c668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:45.329637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bb1aa080-6d2e-4cdf-b24a-05eca1c8c668 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:45.330603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bb1aa080-6d2e-4cdf-b24a-05eca1c8c668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:45.429792 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2940/5907] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:23:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:23:45.446748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc88d3-baa7-4142-8145-dcc62d96d0a9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:45.448425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a0dc88d3-baa7-4142-8145-dcc62d96d0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:45.602719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc88d3-baa7-4142-8145-dcc62d96d0a9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:45.608387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba7b69-da48-4812-92df-3da59621bb3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:45.610054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba7b69-da48-4812-92df-3da59621bb3a service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:45.610522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba7b69-da48-4812-92df-3da59621bb3a service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:45.611105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba7b69-da48-4812-92df-3da59621bb3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:45.628308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba7b69-da48-4812-92df-3da59621bb3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:45.630616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba7b69-da48-4812-92df-3da59621bb3a service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:45.652879 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2968/5908] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:23:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:23:53.086491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f7c53-c482-4b1c-9788-d364484548ea None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:53.087073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f7c53-c482-4b1c-9788-d364484548ea None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:53.087073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f7c53-c482-4b1c-9788-d364484548ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:53.116436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-cb2f7c53-c482-4b1c-9788-d364484548ea None None] MFA Rules not processed for user `23d7253b721f409ab148368d84b87963`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:23:53.118005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cb2f7c53-c482-4b1c-9788-d364484548ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:53.278350 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2941/5909] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:23:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:23:53.978170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba7b69-da48-4812-92df-3da59621bb3a service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:53.991468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba7b69-da48-4812-92df-3da59621bb3a service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:53.999839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cc33a-b5a5-43a5-9bbe-a7865b0b913a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:54.001189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cc33a-b5a5-43a5-9bbe-a7865b0b913a service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:54.002450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cc33a-b5a5-43a5-9bbe-a7865b0b913a service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:54.003331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cc33a-b5a5-43a5-9bbe-a7865b0b913a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:54.009605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1a3cc33a-b5a5-43a5-9bbe-a7865b0b913a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:54.032951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cc33a-b5a5-43a5-9bbe-a7865b0b913a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:54.041151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cc33a-b5a5-43a5-9bbe-a7865b0b913a service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:54.107424 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2969/5910] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:23:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:23:54.994835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f7c53-c482-4b1c-9788-d364484548ea None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:23:54.996383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cb2f7c53-c482-4b1c-9788-d364484548ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:55.306395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f7c53-c482-4b1c-9788-d364484548ea None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:23:55.326366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c8252-73d8-40fc-b9e8-49c529d51b04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:23:55.328910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c8252-73d8-40fc-b9e8-49c529d51b04 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:23:55.335386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c8252-73d8-40fc-b9e8-49c529d51b04 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:23:55.336180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c8252-73d8-40fc-b9e8-49c529d51b04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:23:55.338420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-da6c8252-73d8-40fc-b9e8-49c529d51b04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:23:55.417163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c8252-73d8-40fc-b9e8-49c529d51b04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:23:55.418832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c8252-73d8-40fc-b9e8-49c529d51b04 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:23:55.463223 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2942/5911] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:23:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:24:01.164532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b5927-b1b0-401c-8062-12fc98327f0a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:01.165164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b5927-b1b0-401c-8062-12fc98327f0a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:01.165164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b5927-b1b0-401c-8062-12fc98327f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:01.201887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-743b5927-b1b0-401c-8062-12fc98327f0a None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:01.205580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-743b5927-b1b0-401c-8062-12fc98327f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:01.221684 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2970/5912] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:24:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:24:01.241633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c8252-73d8-40fc-b9e8-49c529d51b04 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:01.256131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c8252-73d8-40fc-b9e8-49c529d51b04 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:01.264839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c02d4-4008-431e-bb39-4c51672c412d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:01.266052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c02d4-4008-431e-bb39-4c51672c412d service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:01.266581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c02d4-4008-431e-bb39-4c51672c412d service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:01.267059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c02d4-4008-431e-bb39-4c51672c412d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:01.280146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c02d4-4008-431e-bb39-4c51672c412d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:01.282901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c02d4-4008-431e-bb39-4c51672c412d service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:01.298341 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2943/5913] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:24:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:24:07.095174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431e132-03b9-4855-97b8-4122025d8139 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:07.095697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431e132-03b9-4855-97b8-4122025d8139 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:07.095919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431e132-03b9-4855-97b8-4122025d8139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:07.103065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=45 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:07.137342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8431e132-03b9-4855-97b8-4122025d8139 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:07.138778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8431e132-03b9-4855-97b8-4122025d8139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:07.149461 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2971/5914] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:24:07.163691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c02d4-4008-431e-bb39-4c51672c412d service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:07.187168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c02d4-4008-431e-bb39-4c51672c412d service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:07.196582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7684b-8b82-412d-a19c-b4bd8f45d499 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:07.200536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7684b-8b82-412d-a19c-b4bd8f45d499 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:07.201968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7684b-8b82-412d-a19c-b4bd8f45d499 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:07.202948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7684b-8b82-412d-a19c-b4bd8f45d499 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:07.232191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7684b-8b82-412d-a19c-b4bd8f45d499 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:07.235656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7684b-8b82-412d-a19c-b4bd8f45d499 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:07.264952 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2944/5915] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:24:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:24:08.544897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a773c2-1e63-49cc-8027-ac76d90bcf48 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:08.545910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a773c2-1e63-49cc-8027-ac76d90bcf48 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:08.546433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a773c2-1e63-49cc-8027-ac76d90bcf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:08.592554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c6a773c2-1e63-49cc-8027-ac76d90bcf48 None None] MFA Rules not processed for user `fa780176ae5f4a618e42a47531b0d4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:08.598014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c6a773c2-1e63-49cc-8027-ac76d90bcf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:08.774822 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2972/5916] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:24:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:24:09.186561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7684b-8b82-412d-a19c-b4bd8f45d499 service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:09.203982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:09.212445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7684b-8b82-412d-a19c-b4bd8f45d499 service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:09.230236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fc8fd-fcbe-4e92-bbc4-c7e7ea9656cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:09.230861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fc8fd-fcbe-4e92-bbc4-c7e7ea9656cf service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:09.231151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fc8fd-fcbe-4e92-bbc4-c7e7ea9656cf service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:09.231456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fc8fd-fcbe-4e92-bbc4-c7e7ea9656cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:09.245770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-132fc8fd-fcbe-4e92-bbc4-c7e7ea9656cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:09.280998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fc8fd-fcbe-4e92-bbc4-c7e7ea9656cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:09.283774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fc8fd-fcbe-4e92-bbc4-c7e7ea9656cf service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:09.301572 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2945/5917] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:24:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:24:09.518830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a773c2-1e63-49cc-8027-ac76d90bcf48 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:09.532440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a773c2-1e63-49cc-8027-ac76d90bcf48 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:09.545193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cb5d4-b730-467e-863f-3493a371ab80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:09.546945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cb5d4-b730-467e-863f-3493a371ab80 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:09.547538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cb5d4-b730-467e-863f-3493a371ab80 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:09.548359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cb5d4-b730-467e-863f-3493a371ab80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:09.552007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8f1cb5d4-b730-467e-863f-3493a371ab80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:09.589129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cb5d4-b730-467e-863f-3493a371ab80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:09.645343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cb5d4-b730-467e-863f-3493a371ab80 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:09.709763 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2973/5918] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:24:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:24:18.567692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fc8fd-fcbe-4e92-bbc4-c7e7ea9656cf service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:18.586389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fc8fd-fcbe-4e92-bbc4-c7e7ea9656cf service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:18.594236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6d518-c91b-4fe6-9b16-2d27e9c2584b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:18.594907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6d518-c91b-4fe6-9b16-2d27e9c2584b service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:18.595193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6d518-c91b-4fe6-9b16-2d27e9c2584b service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:18.595467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6d518-c91b-4fe6-9b16-2d27e9c2584b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:18.602412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-03a6d518-c91b-4fe6-9b16-2d27e9c2584b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:18.629437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6d518-c91b-4fe6-9b16-2d27e9c2584b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:18.630877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6d518-c91b-4fe6-9b16-2d27e9c2584b service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:18.646843 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2946/5919] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:24:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:24:19.685970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=33 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:27.639759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cb5d4-b730-467e-863f-3493a371ab80 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:27.642228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8f1cb5d4-b730-467e-863f-3493a371ab80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:27.808970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cb5d4-b730-467e-863f-3493a371ab80 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:27.814184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e359e1d-c932-446c-8dc7-becae0fa0124 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:27.816298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e359e1d-c932-446c-8dc7-becae0fa0124 service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:27.816824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e359e1d-c932-446c-8dc7-becae0fa0124 service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:27.817341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e359e1d-c932-446c-8dc7-becae0fa0124 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:27.820484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8e359e1d-c932-446c-8dc7-becae0fa0124 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:27.947739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e359e1d-c932-446c-8dc7-becae0fa0124 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:27.949299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e359e1d-c932-446c-8dc7-becae0fa0124 service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:27.967562 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2974/5920] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:24:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:24:28.099815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6d518-c91b-4fe6-9b16-2d27e9c2584b service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:28.101783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-03a6d518-c91b-4fe6-9b16-2d27e9c2584b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:28.122826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6d518-c91b-4fe6-9b16-2d27e9c2584b service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:28.131284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc16a2e-894b-4226-8575-33bad8c97c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:28.132291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc16a2e-894b-4226-8575-33bad8c97c8a service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:28.132756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc16a2e-894b-4226-8575-33bad8c97c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:28.133191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc16a2e-894b-4226-8575-33bad8c97c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:28.141252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1bc16a2e-894b-4226-8575-33bad8c97c8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:28.171587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc16a2e-894b-4226-8575-33bad8c97c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:28.173089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc16a2e-894b-4226-8575-33bad8c97c8a service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:28.189391 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2947/5921] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:24:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:24:28.351452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e359e1d-c932-446c-8dc7-becae0fa0124 service glance] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:28.364648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e359e1d-c932-446c-8dc7-becae0fa0124 service glance] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:28.382230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b93d8-a767-4606-9f56-6e60693d4edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:28.382912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b93d8-a767-4606-9f56-6e60693d4edc service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:28.383174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b93d8-a767-4606-9f56-6e60693d4edc service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:28.383449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b93d8-a767-4606-9f56-6e60693d4edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:28.385936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-494b93d8-a767-4606-9f56-6e60693d4edc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:28.406243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b93d8-a767-4606-9f56-6e60693d4edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:28.407809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b93d8-a767-4606-9f56-6e60693d4edc service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:28.422310 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2975/5922] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:24:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:24:29.158037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc16a2e-894b-4226-8575-33bad8c97c8a service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:29.175451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc16a2e-894b-4226-8575-33bad8c97c8a service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:29.182269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfdbb3-a8d4-4f84-ab8e-e9738d2b1983 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:29.183020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfdbb3-a8d4-4f84-ab8e-e9738d2b1983 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:29.183351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfdbb3-a8d4-4f84-ab8e-e9738d2b1983 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:29.183711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfdbb3-a8d4-4f84-ab8e-e9738d2b1983 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:29.185936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-25cfdbb3-a8d4-4f84-ab8e-e9738d2b1983 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:29.201011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfdbb3-a8d4-4f84-ab8e-e9738d2b1983 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:29.202636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfdbb3-a8d4-4f84-ab8e-e9738d2b1983 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:29.215056 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2948/5923] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:24:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:24:32.032567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0d8e2-10d7-4608-97ee-987c634db6c3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:32.034597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0d8e2-10d7-4608-97ee-987c634db6c3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:32.035079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0d8e2-10d7-4608-97ee-987c634db6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:32.058227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9ae0d8e2-10d7-4608-97ee-987c634db6c3 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:32.060205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9ae0d8e2-10d7-4608-97ee-987c634db6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:32.112697 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2976/5924] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:24:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:24:32.114252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfdbb3-a8d4-4f84-ab8e-e9738d2b1983 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:32.140588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfdbb3-a8d4-4f84-ab8e-e9738d2b1983 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:32.157582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f9060-f1f0-4199-8f3f-c2b023d7adf1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:32.158739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f9060-f1f0-4199-8f3f-c2b023d7adf1 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:32.159106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f9060-f1f0-4199-8f3f-c2b023d7adf1 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:32.159694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f9060-f1f0-4199-8f3f-c2b023d7adf1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:32.218269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f9060-f1f0-4199-8f3f-c2b023d7adf1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:32.228383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f9060-f1f0-4199-8f3f-c2b023d7adf1 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:32.255113 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2949/5925] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:24:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:24:42.051610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=63 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:42.251394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=28 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:50.977162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0d8e2-10d7-4608-97ee-987c634db6c3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:50.979264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9ae0d8e2-10d7-4608-97ee-987c634db6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:51.123942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0d8e2-10d7-4608-97ee-987c634db6c3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:51.130183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ae44b-e151-48b1-b3ee-529a165a1071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:51.131386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ae44b-e151-48b1-b3ee-529a165a1071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:51.131947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ae44b-e151-48b1-b3ee-529a165a1071 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:51.132454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ae44b-e151-48b1-b3ee-529a165a1071 admin admin] PATH_INFO: `/v3/users/4ea193cd32cd4e0ea576e211a4c91311` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:51.134025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ae44b-e151-48b1-b3ee-529a165a1071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea193cd32cd4e0ea576e211a4c91311)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:51.137439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ae44b-e151-48b1-b3ee-529a165a1071 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:51.221820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-353ae44b-e151-48b1-b3ee-529a165a1071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea193cd32cd4e0ea576e211a4c91311'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:51.236339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-353ae44b-e151-48b1-b3ee-529a165a1071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea193cd32cd4e0ea576e211a4c91311'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:51.239534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-353ae44b-e151-48b1-b3ee-529a165a1071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea193cd32cd4e0ea576e211a4c91311'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:51.240518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-353ae44b-e151-48b1-b3ee-529a165a1071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea193cd32cd4e0ea576e211a4c91311'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:51.263654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-353ae44b-e151-48b1-b3ee-529a165a1071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea193cd32cd4e0ea576e211a4c91311'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:51.293559 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2977/5926] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:24:50 2022] DELETE /identity/v3/users/4ea193cd32cd4e0ea576e211a4c91311 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:24:51.298467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c2140-687f-4bbb-bdf0-c8ab7aa440b2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:51.299002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c2140-687f-4bbb-bdf0-c8ab7aa440b2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:51.299002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c2140-687f-4bbb-bdf0-c8ab7aa440b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:51.322414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1f6c2140-687f-4bbb-bdf0-c8ab7aa440b2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:51.323738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1f6c2140-687f-4bbb-bdf0-c8ab7aa440b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:51.426656 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2950/5927] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:24:51.456421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ae44b-e151-48b1-b3ee-529a165a1071 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:51.458794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-353ae44b-e151-48b1-b3ee-529a165a1071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:51.596133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ae44b-e151-48b1-b3ee-529a165a1071 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:51.602868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94fee4-c94a-4c94-bf7e-24230067f58a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:51.604999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94fee4-c94a-4c94-bf7e-24230067f58a service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:51.606399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94fee4-c94a-4c94-bf7e-24230067f58a service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:51.606782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94fee4-c94a-4c94-bf7e-24230067f58a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:51.628873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94fee4-c94a-4c94-bf7e-24230067f58a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:51.632192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94fee4-c94a-4c94-bf7e-24230067f58a service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:51.688466 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2978/5928] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:24:52.480767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c2140-687f-4bbb-bdf0-c8ab7aa440b2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:52.483054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1f6c2140-687f-4bbb-bdf0-c8ab7aa440b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:52.504683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c2140-687f-4bbb-bdf0-c8ab7aa440b2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:52.509849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318aa45-baca-4ea2-b7ff-70341d5eb630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:52.511217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318aa45-baca-4ea2-b7ff-70341d5eb630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:52.511678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318aa45-baca-4ea2-b7ff-70341d5eb630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:52.512184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318aa45-baca-4ea2-b7ff-70341d5eb630 admin admin] PATH_INFO: `/v3/projects/b94bbe82dcff439abf6005558f354a81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:52.516123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318aa45-baca-4ea2-b7ff-70341d5eb630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b94bbe82dcff439abf6005558f354a81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:52.518496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318aa45-baca-4ea2-b7ff-70341d5eb630 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:52.596666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7318aa45-baca-4ea2-b7ff-70341d5eb630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b94bbe82dcff439abf6005558f354a81', 'request_id': 'req-7318aa45-baca-4ea2-b7ff-70341d5eb630'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:52.613057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7318aa45-baca-4ea2-b7ff-70341d5eb630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b94bbe82dcff439abf6005558f354a81', 'request_id': 'req-7318aa45-baca-4ea2-b7ff-70341d5eb630'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:52.639084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7318aa45-baca-4ea2-b7ff-70341d5eb630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b94bbe82dcff439abf6005558f354a81', 'request_id': 'req-7318aa45-baca-4ea2-b7ff-70341d5eb630'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:52.674913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7318aa45-baca-4ea2-b7ff-70341d5eb630 admin admin] The token cache is being invalidate because project b94bbe82dcff439abf6005558f354a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:24:52.675169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7318aa45-baca-4ea2-b7ff-70341d5eb630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:52.678815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7318aa45-baca-4ea2-b7ff-70341d5eb630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:52.682709 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2951/5929] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:24:52 2022] DELETE /identity/v3/projects/b94bbe82dcff439abf6005558f354a81 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:24:52.688432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae8616-f675-48d3-a0ca-b7cc5df674c6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:52.688973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae8616-f675-48d3-a0ca-b7cc5df674c6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:52.695488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae8616-f675-48d3-a0ca-b7cc5df674c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:52.741792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-87ae8616-f675-48d3-a0ca-b7cc5df674c6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:52.743658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-87ae8616-f675-48d3-a0ca-b7cc5df674c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:52.766063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:52.845099 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2979/5930] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:24:52.852926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5add97a-c91b-48c1-86b9-13f45cea4197 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:52.853892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5add97a-c91b-48c1-86b9-13f45cea4197 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:52.854373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5add97a-c91b-48c1-86b9-13f45cea4197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:52.883787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e5add97a-c91b-48c1-86b9-13f45cea4197 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:52.887545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e5add97a-c91b-48c1-86b9-13f45cea4197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:52.900790 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2952/5931] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:24:52.905225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae8616-f675-48d3-a0ca-b7cc5df674c6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:52.925277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae8616-f675-48d3-a0ca-b7cc5df674c6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:52.933455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ed3f1-283d-431d-aa0f-b875ce4342d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:52.934158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ed3f1-283d-431d-aa0f-b875ce4342d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:52.935084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ed3f1-283d-431d-aa0f-b875ce4342d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:52.935576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ed3f1-283d-431d-aa0f-b875ce4342d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:52.937546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ed3f1-283d-431d-aa0f-b875ce4342d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:24:52.937872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ed3f1-283d-431d-aa0f-b875ce4342d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:52.941725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ed3f1-283d-431d-aa0f-b875ce4342d5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:52.973230 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2980/5932] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:24:52.977765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5add97a-c91b-48c1-86b9-13f45cea4197 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:52.998859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5add97a-c91b-48c1-86b9-13f45cea4197 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:53.006234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c526e-ff46-4948-a5c1-1020fdce7fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:53.007090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c526e-ff46-4948-a5c1-1020fdce7fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:53.008948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c526e-ff46-4948-a5c1-1020fdce7fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:53.012698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c526e-ff46-4948-a5c1-1020fdce7fe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:53.013518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c526e-ff46-4948-a5c1-1020fdce7fe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:53.015563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c526e-ff46-4948-a5c1-1020fdce7fe0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:53.063185 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2953/5933] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:24:52 2022] POST /identity/v3/projects => generated 361 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:24:53.067732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ed3f1-283d-431d-aa0f-b875ce4342d5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:53.105689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ed3f1-283d-431d-aa0f-b875ce4342d5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:53.211843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627825b-f81a-4d65-a793-86f0481ff55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:53.213413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627825b-f81a-4d65-a793-86f0481ff55e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:53.213920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627825b-f81a-4d65-a793-86f0481ff55e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:53.214474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627825b-f81a-4d65-a793-86f0481ff55e admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:53.215313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627825b-f81a-4d65-a793-86f0481ff55e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:53.217495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627825b-f81a-4d65-a793-86f0481ff55e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:53.279298 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2981/5934] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:24:53 2022] POST /identity/v3/users => generated 281 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:24:53.283444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c526e-ff46-4948-a5c1-1020fdce7fe0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:53.299783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c526e-ff46-4948-a5c1-1020fdce7fe0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:53.311783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc047a9-27fb-4c7d-a3f0-c29d72a409cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:53.312837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc047a9-27fb-4c7d-a3f0-c29d72a409cb admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:53.313122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc047a9-27fb-4c7d-a3f0-c29d72a409cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:53.313400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc047a9-27fb-4c7d-a3f0-c29d72a409cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:53.314139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc047a9-27fb-4c7d-a3f0-c29d72a409cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:53.317788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc047a9-27fb-4c7d-a3f0-c29d72a409cb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:53.335472 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2954/5935] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:24:53.339373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627825b-f81a-4d65-a793-86f0481ff55e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:53.351921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627825b-f81a-4d65-a793-86f0481ff55e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:53.359855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43f842-2be8-4ab6-ad19-7201ff267235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:53.360924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43f842-2be8-4ab6-ad19-7201ff267235 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:53.362173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43f842-2be8-4ab6-ad19-7201ff267235 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:53.362661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43f842-2be8-4ab6-ad19-7201ff267235 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:53.363605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43f842-2be8-4ab6-ad19-7201ff267235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:53.367421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43f842-2be8-4ab6-ad19-7201ff267235 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:53.381021 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2982/5936] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:24:53.385311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc047a9-27fb-4c7d-a3f0-c29d72a409cb admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:53.400003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc047a9-27fb-4c7d-a3f0-c29d72a409cb admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:53.406052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bd8fd-fe85-4f5e-9290-18a42d091149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:53.408450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bd8fd-fe85-4f5e-9290-18a42d091149 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:53.408966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bd8fd-fe85-4f5e-9290-18a42d091149 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:53.409558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bd8fd-fe85-4f5e-9290-18a42d091149 admin admin] PATH_INFO: `/v3/projects/beab4740a1d14bba8f1eab2ca375c4c3/users/be7377b7e7244606a72cd1e556810a9e/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:53.429971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bd8fd-fe85-4f5e-9290-18a42d091149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beab4740a1d14bba8f1eab2ca375c4c3, user_id=be7377b7e7244606a72cd1e556810a9e, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:53.433100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bd8fd-fe85-4f5e-9290-18a42d091149 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:53.450848 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2955/5937] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:24:53 2022] PUT /identity/v3/projects/beab4740a1d14bba8f1eab2ca375c4c3/users/be7377b7e7244606a72cd1e556810a9e/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:24:53.461821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dbdcf-89c6-4603-8f4f-19941fd2dfb6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:53.462564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dbdcf-89c6-4603-8f4f-19941fd2dfb6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:53.463053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dbdcf-89c6-4603-8f4f-19941fd2dfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:53.510926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-333dbdcf-89c6-4603-8f4f-19941fd2dfb6 None None] MFA Rules not processed for user `be7377b7e7244606a72cd1e556810a9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:53.512361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-333dbdcf-89c6-4603-8f4f-19941fd2dfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:53.624797 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2983/5938] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:24:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:24:53.641970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bd8fd-fe85-4f5e-9290-18a42d091149 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:53.644777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f49bd8fd-fe85-4f5e-9290-18a42d091149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:53.704612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:53.763923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bd8fd-fe85-4f5e-9290-18a42d091149 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:53.771015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bf1fc-de3f-4fa5-893c-c2fd60a835cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:53.773135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bf1fc-de3f-4fa5-893c-c2fd60a835cc service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:53.773514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bf1fc-de3f-4fa5-893c-c2fd60a835cc service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:53.775377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bf1fc-de3f-4fa5-893c-c2fd60a835cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:53.786095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bf1fc-de3f-4fa5-893c-c2fd60a835cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:53.787890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bf1fc-de3f-4fa5-893c-c2fd60a835cc service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:53.811489 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2956/5939] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:24:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:24:54.006625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dbdcf-89c6-4603-8f4f-19941fd2dfb6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:54.008304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-333dbdcf-89c6-4603-8f4f-19941fd2dfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:54.086749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:54.129678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bf1fc-de3f-4fa5-893c-c2fd60a835cc service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:54.131118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-508bf1fc-de3f-4fa5-893c-c2fd60a835cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:54.235743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dbdcf-89c6-4603-8f4f-19941fd2dfb6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:54.246824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e1b88-a520-446e-8662-268b7f211893 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:54.249271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e1b88-a520-446e-8662-268b7f211893 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:54.250708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e1b88-a520-446e-8662-268b7f211893 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:54.251132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e1b88-a520-446e-8662-268b7f211893 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:54.259704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ca6e1b88-a520-446e-8662-268b7f211893 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:54.281749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e1b88-a520-446e-8662-268b7f211893 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:54.283504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e1b88-a520-446e-8662-268b7f211893 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:54.295806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bf1fc-de3f-4fa5-893c-c2fd60a835cc service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:54.304938 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2984/5940] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:24:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:24:54.307574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661d4bc-f154-4c01-a458-bb87ddb0f7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:54.308024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661d4bc-f154-4c01-a458-bb87ddb0f7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:54.308383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661d4bc-f154-4c01-a458-bb87ddb0f7de admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:54.308669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661d4bc-f154-4c01-a458-bb87ddb0f7de admin admin] PATH_INFO: `/v3/users/8f2aa529dd674c5ca0e8bd9c33b09306` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:54.309934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661d4bc-f154-4c01-a458-bb87ddb0f7de admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f2aa529dd674c5ca0e8bd9c33b09306)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:54.311885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661d4bc-f154-4c01-a458-bb87ddb0f7de admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:54.380480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4661d4bc-f154-4c01-a458-bb87ddb0f7de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f2aa529dd674c5ca0e8bd9c33b09306'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:54.389159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4661d4bc-f154-4c01-a458-bb87ddb0f7de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f2aa529dd674c5ca0e8bd9c33b09306'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:54.398630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4661d4bc-f154-4c01-a458-bb87ddb0f7de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f2aa529dd674c5ca0e8bd9c33b09306'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:54.399431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4661d4bc-f154-4c01-a458-bb87ddb0f7de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f2aa529dd674c5ca0e8bd9c33b09306'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:54.401023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4661d4bc-f154-4c01-a458-bb87ddb0f7de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f2aa529dd674c5ca0e8bd9c33b09306'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:54.425221 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2957/5941] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:24:54 2022] DELETE /identity/v3/users/8f2aa529dd674c5ca0e8bd9c33b09306 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:24:54.430372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac576a-45c6-42d2-aad3-881f2190d01e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:54.430689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac576a-45c6-42d2-aad3-881f2190d01e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:54.431273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac576a-45c6-42d2-aad3-881f2190d01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:54.450223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-64ac576a-45c6-42d2-aad3-881f2190d01e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:54.451461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-64ac576a-45c6-42d2-aad3-881f2190d01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:54.546059 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2985/5942] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:24:54.564495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661d4bc-f154-4c01-a458-bb87ddb0f7de admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:54.565973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4661d4bc-f154-4c01-a458-bb87ddb0f7de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:54.668633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:54.702565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661d4bc-f154-4c01-a458-bb87ddb0f7de admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:54.710787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e69339-5671-443c-b2ae-2a28d10fcdc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:54.711665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e69339-5671-443c-b2ae-2a28d10fcdc1 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:54.711947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e69339-5671-443c-b2ae-2a28d10fcdc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:54.712254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e69339-5671-443c-b2ae-2a28d10fcdc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:54.732311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e69339-5671-443c-b2ae-2a28d10fcdc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:54.734083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e69339-5671-443c-b2ae-2a28d10fcdc1 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:54.747411 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2958/5943] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:24:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:24:55.602606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac576a-45c6-42d2-aad3-881f2190d01e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:55.604221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-64ac576a-45c6-42d2-aad3-881f2190d01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:55.619196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac576a-45c6-42d2-aad3-881f2190d01e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:55.637861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dde940-97a1-44e6-a413-19b38f840e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:55.639380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dde940-97a1-44e6-a413-19b38f840e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:55.640258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dde940-97a1-44e6-a413-19b38f840e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:55.640763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dde940-97a1-44e6-a413-19b38f840e00 admin admin] PATH_INFO: `/v3/projects/1692635e0f2e4fca961fc2926db5ab92` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:55.645535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dde940-97a1-44e6-a413-19b38f840e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1692635e0f2e4fca961fc2926db5ab92)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:55.651169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e69339-5671-443c-b2ae-2a28d10fcdc1 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:55.654327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dde940-97a1-44e6-a413-19b38f840e00 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:55.655174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-99e69339-5671-443c-b2ae-2a28d10fcdc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:55.691276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e69339-5671-443c-b2ae-2a28d10fcdc1 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:55.706753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13377d7f-baae-46a0-a1d3-c59d2559489f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:55.707935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13377d7f-baae-46a0-a1d3-c59d2559489f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:55.708547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13377d7f-baae-46a0-a1d3-c59d2559489f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:55.709011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13377d7f-baae-46a0-a1d3-c59d2559489f admin admin] PATH_INFO: `/v3/users/fa780176ae5f4a618e42a47531b0d4a5` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:55.712793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13377d7f-baae-46a0-a1d3-c59d2559489f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa780176ae5f4a618e42a47531b0d4a5)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:55.717070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13377d7f-baae-46a0-a1d3-c59d2559489f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:55.744694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c5dde940-97a1-44e6-a413-19b38f840e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1692635e0f2e4fca961fc2926db5ab92', 'request_id': 'req-c5dde940-97a1-44e6-a413-19b38f840e00'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:55.758949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c5dde940-97a1-44e6-a413-19b38f840e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1692635e0f2e4fca961fc2926db5ab92', 'request_id': 'req-c5dde940-97a1-44e6-a413-19b38f840e00'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:55.767779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c5dde940-97a1-44e6-a413-19b38f840e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1692635e0f2e4fca961fc2926db5ab92', 'request_id': 'req-c5dde940-97a1-44e6-a413-19b38f840e00'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:55.785308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c5dde940-97a1-44e6-a413-19b38f840e00 admin admin] The token cache is being invalidate because project 1692635e0f2e4fca961fc2926db5ab92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:24:55.785658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c5dde940-97a1-44e6-a413-19b38f840e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:55.786871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c5dde940-97a1-44e6-a413-19b38f840e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:55.789224 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2986/5944] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:24:55 2022] DELETE /identity/v3/projects/1692635e0f2e4fca961fc2926db5ab92 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:24:55.796857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09538a-e606-4939-990d-709b090bd480 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:55.797824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09538a-e606-4939-990d-709b090bd480 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:55.798975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09538a-e606-4939-990d-709b090bd480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:55.833715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-13377d7f-baae-46a0-a1d3-c59d2559489f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa780176ae5f4a618e42a47531b0d4a5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:55.841806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8b09538a-e606-4939-990d-709b090bd480 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:55.843281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8b09538a-e606-4939-990d-709b090bd480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:55.854362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-13377d7f-baae-46a0-a1d3-c59d2559489f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa780176ae5f4a618e42a47531b0d4a5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:55.868224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-13377d7f-baae-46a0-a1d3-c59d2559489f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa780176ae5f4a618e42a47531b0d4a5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:55.869531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-13377d7f-baae-46a0-a1d3-c59d2559489f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa780176ae5f4a618e42a47531b0d4a5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:55.870305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-13377d7f-baae-46a0-a1d3-c59d2559489f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa780176ae5f4a618e42a47531b0d4a5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:55.886680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:55.915364 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2959/5945] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:24:55 2022] DELETE /identity/v3/users/fa780176ae5f4a618e42a47531b0d4a5 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:24:55.953805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103699c-d7c7-40e7-b8e2-7e111ba518f6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:55.954097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103699c-d7c7-40e7-b8e2-7e111ba518f6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:55.954377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103699c-d7c7-40e7-b8e2-7e111ba518f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:55.992790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c103699c-d7c7-40e7-b8e2-7e111ba518f6 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:55.993456 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2987/5946] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:24:55.995109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c103699c-d7c7-40e7-b8e2-7e111ba518f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:56.001965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70db37-30aa-404f-8a53-05ee5d9c4c0a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:56.002454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70db37-30aa-404f-8a53-05ee5d9c4c0a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:56.002567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70db37-30aa-404f-8a53-05ee5d9c4c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:56.040259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ac70db37-30aa-404f-8a53-05ee5d9c4c0a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:56.041801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ac70db37-30aa-404f-8a53-05ee5d9c4c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:56.107971 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2960/5947] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:24:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:24:56.118431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103699c-d7c7-40e7-b8e2-7e111ba518f6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:56.120064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c103699c-d7c7-40e7-b8e2-7e111ba518f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:56.147100 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2988/5948] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:24:56.151162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70db37-30aa-404f-8a53-05ee5d9c4c0a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:56.169548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70db37-30aa-404f-8a53-05ee5d9c4c0a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:56.177268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6d420-d8ae-42ef-984b-c50c6f88c6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:56.178202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6d420-d8ae-42ef-984b-c50c6f88c6ad admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:56.178579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6d420-d8ae-42ef-984b-c50c6f88c6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:56.178948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6d420-d8ae-42ef-984b-c50c6f88c6ad admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:56.179800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6d420-d8ae-42ef-984b-c50c6f88c6ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:24:56.180223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6d420-d8ae-42ef-984b-c50c6f88c6ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:56.182404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6d420-d8ae-42ef-984b-c50c6f88c6ad admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:56.208671 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2989/5949] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:24:56.210030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6d420-d8ae-42ef-984b-c50c6f88c6ad admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:56.238330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6d420-d8ae-42ef-984b-c50c6f88c6ad admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:56.240484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:56.248934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b88d61-dcfe-4d65-9c14-e66901b6665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:56.249653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b88d61-dcfe-4d65-9c14-e66901b6665f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:56.249937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b88d61-dcfe-4d65-9c14-e66901b6665f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:56.250212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b88d61-dcfe-4d65-9c14-e66901b6665f admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:56.252991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b88d61-dcfe-4d65-9c14-e66901b6665f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:56.256150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103699c-d7c7-40e7-b8e2-7e111ba518f6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:56.256990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b88d61-dcfe-4d65-9c14-e66901b6665f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:56.271886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a69c1-78a3-4f1f-b483-19359f7f7924 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:56.272579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a69c1-78a3-4f1f-b483-19359f7f7924 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:56.272888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a69c1-78a3-4f1f-b483-19359f7f7924 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:56.273114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a69c1-78a3-4f1f-b483-19359f7f7924 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:56.287174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a69c1-78a3-4f1f-b483-19359f7f7924 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:56.290326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a69c1-78a3-4f1f-b483-19359f7f7924 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:56.308286 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2961/5950] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:24:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 02 21:24:56.312378 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2990/5951] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:24:56 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:24:56.313281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a69c1-78a3-4f1f-b483-19359f7f7924 service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:56.313281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9f6a69c1-78a3-4f1f-b483-19359f7f7924 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:56.313703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b88d61-dcfe-4d65-9c14-e66901b6665f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:56.339185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a69c1-78a3-4f1f-b483-19359f7f7924 service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:56.404616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b88d61-dcfe-4d65-9c14-e66901b6665f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:56.410772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652297e0-cff7-44d8-b64e-92ebff7f0b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:56.412128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652297e0-cff7-44d8-b64e-92ebff7f0b2a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:56.412524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652297e0-cff7-44d8-b64e-92ebff7f0b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:56.412898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652297e0-cff7-44d8-b64e-92ebff7f0b2a admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:56.414306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652297e0-cff7-44d8-b64e-92ebff7f0b2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:56.416811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652297e0-cff7-44d8-b64e-92ebff7f0b2a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:56.426949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79215ff9-7856-45b8-8fbc-23c071cb70f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:56.428112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79215ff9-7856-45b8-8fbc-23c071cb70f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:56.428577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79215ff9-7856-45b8-8fbc-23c071cb70f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:56.429007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79215ff9-7856-45b8-8fbc-23c071cb70f3 admin admin] PATH_INFO: `/v3/projects/ada57eeadbb9443c9f42dc99310ef8de` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:56.430787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79215ff9-7856-45b8-8fbc-23c071cb70f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada57eeadbb9443c9f42dc99310ef8de)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:56.434299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79215ff9-7856-45b8-8fbc-23c071cb70f3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:56.480713 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2991/5952] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:24:56 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:24:56.484551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652297e0-cff7-44d8-b64e-92ebff7f0b2a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:56.505681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652297e0-cff7-44d8-b64e-92ebff7f0b2a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:56.522000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-79215ff9-7856-45b8-8fbc-23c071cb70f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada57eeadbb9443c9f42dc99310ef8de', 'request_id': 'req-79215ff9-7856-45b8-8fbc-23c071cb70f3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:56.531608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-79215ff9-7856-45b8-8fbc-23c071cb70f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada57eeadbb9443c9f42dc99310ef8de', 'request_id': 'req-79215ff9-7856-45b8-8fbc-23c071cb70f3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:56.540907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-79215ff9-7856-45b8-8fbc-23c071cb70f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada57eeadbb9443c9f42dc99310ef8de', 'request_id': 'req-79215ff9-7856-45b8-8fbc-23c071cb70f3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:56.555510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:56.564125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-79215ff9-7856-45b8-8fbc-23c071cb70f3 admin admin] The token cache is being invalidate because project ada57eeadbb9443c9f42dc99310ef8de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:24:56.564470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-79215ff9-7856-45b8-8fbc-23c071cb70f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:56.565201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-79215ff9-7856-45b8-8fbc-23c071cb70f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:56.567809 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2962/5953] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:24:56 2022] DELETE /identity/v3/projects/ada57eeadbb9443c9f42dc99310ef8de => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:24:56.573913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e8313-b8e1-4deb-8e24-2889f1beb03f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:56.573913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e8313-b8e1-4deb-8e24-2889f1beb03f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:56.573913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e8313-b8e1-4deb-8e24-2889f1beb03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:56.606710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a64e8313-b8e1-4deb-8e24-2889f1beb03f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:56.607784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d88ef-d1ec-4e46-9446-3af89a427fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:56.609041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a64e8313-b8e1-4deb-8e24-2889f1beb03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:56.609370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d88ef-d1ec-4e46-9446-3af89a427fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:56.609370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d88ef-d1ec-4e46-9446-3af89a427fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:56.609370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d88ef-d1ec-4e46-9446-3af89a427fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:56.609750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d88ef-d1ec-4e46-9446-3af89a427fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:56.611782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d88ef-d1ec-4e46-9446-3af89a427fb2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:56.621208 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2963/5954] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:24:56.631749 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2992/5955] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:24:56.633628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ac1ef-0e16-408f-b310-723141448e83 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:56.634852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d88ef-d1ec-4e46-9446-3af89a427fb2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:56.635939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ac1ef-0e16-408f-b310-723141448e83 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:56.636659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ac1ef-0e16-408f-b310-723141448e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:56.638546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c99d88ef-d1ec-4e46-9446-3af89a427fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:56.659019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d88ef-d1ec-4e46-9446-3af89a427fb2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:56.667977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-458ac1ef-0e16-408f-b310-723141448e83 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:56.669557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-458ac1ef-0e16-408f-b310-723141448e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:56.671502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f6dde-706d-4d38-8871-ee2006a1f06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:56.672309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f6dde-706d-4d38-8871-ee2006a1f06a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:56.672770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f6dde-706d-4d38-8871-ee2006a1f06a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:56.673253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f6dde-706d-4d38-8871-ee2006a1f06a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:56.674065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f6dde-706d-4d38-8871-ee2006a1f06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:56.676972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f6dde-706d-4d38-8871-ee2006a1f06a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:56.686897 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2964/5956] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:24:56.688920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ac1ef-0e16-408f-b310-723141448e83 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:56.697885 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2993/5957] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:24:56.699835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f6dde-706d-4d38-8871-ee2006a1f06a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:56.702872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ac1ef-0e16-408f-b310-723141448e83 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:56.710751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6e83-585a-45e7-94a0-998d7deb75b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:56.711712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6e83-585a-45e7-94a0-998d7deb75b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:56.711992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f6dde-706d-4d38-8871-ee2006a1f06a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:56.712283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6e83-585a-45e7-94a0-998d7deb75b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:56.715359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6e83-585a-45e7-94a0-998d7deb75b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:56.715359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6e83-585a-45e7-94a0-998d7deb75b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:24:56.715359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6e83-585a-45e7-94a0-998d7deb75b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:56.716315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6e83-585a-45e7-94a0-998d7deb75b3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:56.740471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95c842-c9be-4ea2-8f5d-69f81b7cdbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:56.741499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95c842-c9be-4ea2-8f5d-69f81b7cdbe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:56.741793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95c842-c9be-4ea2-8f5d-69f81b7cdbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:56.742077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95c842-c9be-4ea2-8f5d-69f81b7cdbe9 admin admin] PATH_INFO: `/v3/projects/f198daf13d62460cb611688761fcddac/users/dcaaf44ac2cb486195ceadd8cd802f82/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:56.743601 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2965/5958] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:24:56.748078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6e83-585a-45e7-94a0-998d7deb75b3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:56.760886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95c842-c9be-4ea2-8f5d-69f81b7cdbe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f198daf13d62460cb611688761fcddac, user_id=dcaaf44ac2cb486195ceadd8cd802f82, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:56.763550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95c842-c9be-4ea2-8f5d-69f81b7cdbe9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:56.767508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6e83-585a-45e7-94a0-998d7deb75b3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:56.775120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea35f4-4812-40db-8d31-c4bce24433ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:56.776726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea35f4-4812-40db-8d31-c4bce24433ab admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:56.777376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea35f4-4812-40db-8d31-c4bce24433ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:56.778101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea35f4-4812-40db-8d31-c4bce24433ab admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:56.778901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea35f4-4812-40db-8d31-c4bce24433ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:56.782809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea35f4-4812-40db-8d31-c4bce24433ab admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:56.784851 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2994/5959] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:24:56 2022] PUT /identity/v3/projects/f198daf13d62460cb611688761fcddac/users/dcaaf44ac2cb486195ceadd8cd802f82/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:24:56.796440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98625d98-ab98-4df3-8833-0b3db09f53d4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:56.796725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98625d98-ab98-4df3-8833-0b3db09f53d4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:56.797082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98625d98-ab98-4df3-8833-0b3db09f53d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:56.828777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-98625d98-ab98-4df3-8833-0b3db09f53d4 None None] MFA Rules not processed for user `dcaaf44ac2cb486195ceadd8cd802f82`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:56.828777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-98625d98-ab98-4df3-8833-0b3db09f53d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:56.829884 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2966/5960] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:24:56 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:24:56.831029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea35f4-4812-40db-8d31-c4bce24433ab admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:56.869360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:56.900283 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2995/5961] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:24:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:24:56.901203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98625d98-ab98-4df3-8833-0b3db09f53d4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:56.903400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea35f4-4812-40db-8d31-c4bce24433ab admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:56.912162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e30b8-87aa-4b0e-a4da-90e0e5cda2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:56.913099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98625d98-ab98-4df3-8833-0b3db09f53d4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:56.913507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e30b8-87aa-4b0e-a4da-90e0e5cda2ce admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:56.913952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e30b8-87aa-4b0e-a4da-90e0e5cda2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:56.914248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e30b8-87aa-4b0e-a4da-90e0e5cda2ce admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:56.914945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e30b8-87aa-4b0e-a4da-90e0e5cda2ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:56.917111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e30b8-87aa-4b0e-a4da-90e0e5cda2ce admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:56.919529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1446a-7bff-4055-9d86-d7d7baaf834d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:56.920646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1446a-7bff-4055-9d86-d7d7baaf834d admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:56.921106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1446a-7bff-4055-9d86-d7d7baaf834d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:56.921587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1446a-7bff-4055-9d86-d7d7baaf834d admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:56.922716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1446a-7bff-4055-9d86-d7d7baaf834d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:56.925082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1446a-7bff-4055-9d86-d7d7baaf834d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:56.952569 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2967/5962] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:24:56 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:24:56.953644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e30b8-87aa-4b0e-a4da-90e0e5cda2ce admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:56.963782 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2996/5963] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:24:56 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:24:56.968816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1446a-7bff-4055-9d86-d7d7baaf834d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:56.974482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e30b8-87aa-4b0e-a4da-90e0e5cda2ce admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:57.045236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644a74c-a319-4e0d-89d5-20270de26e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:57.046576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644a74c-a319-4e0d-89d5-20270de26e09 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:57.046576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644a74c-a319-4e0d-89d5-20270de26e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:57.047084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644a74c-a319-4e0d-89d5-20270de26e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:57.047744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644a74c-a319-4e0d-89d5-20270de26e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:57.049678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644a74c-a319-4e0d-89d5-20270de26e09 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:57.063749 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2968/5964] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:24:57.065308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:57.069089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644a74c-a319-4e0d-89d5-20270de26e09 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:57.073045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1446a-7bff-4055-9d86-d7d7baaf834d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:57.079146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b555def-aa61-486a-8f29-c27a8796e7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:57.080074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b555def-aa61-486a-8f29-c27a8796e7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:57.080492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b555def-aa61-486a-8f29-c27a8796e7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:57.080837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b555def-aa61-486a-8f29-c27a8796e7d2 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:57.081607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b555def-aa61-486a-8f29-c27a8796e7d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:57.082658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644a74c-a319-4e0d-89d5-20270de26e09 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:57.083916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b555def-aa61-486a-8f29-c27a8796e7d2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:57.087625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424626c-e92d-4513-b7f0-b553e6bb1ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:57.088384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424626c-e92d-4513-b7f0-b553e6bb1ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:57.093443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424626c-e92d-4513-b7f0-b553e6bb1ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:57.093443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424626c-e92d-4513-b7f0-b553e6bb1ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:57.093443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424626c-e92d-4513-b7f0-b553e6bb1ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:57.093835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424626c-e92d-4513-b7f0-b553e6bb1ee6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:57.110239 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2969/5965] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:24:57.114578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424626c-e92d-4513-b7f0-b553e6bb1ee6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:57.132496 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2997/5966] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:24:56 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:24:57.137332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b555def-aa61-486a-8f29-c27a8796e7d2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:57.147976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424626c-e92d-4513-b7f0-b553e6bb1ee6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:57.155542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f4d89-b379-418b-8238-3a32b73980dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:57.158142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f4d89-b379-418b-8238-3a32b73980dd admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:57.158431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f4d89-b379-418b-8238-3a32b73980dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:57.158732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f4d89-b379-418b-8238-3a32b73980dd admin admin] PATH_INFO: `/v3/projects/af5057879953477fa6557bbd78b77763/users/8be0d1bce21149af900fccfc92b64f29/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:57.162533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b555def-aa61-486a-8f29-c27a8796e7d2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:57.180664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b4eb7-2b55-42d6-aaf6-030dbc4adfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:57.181327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b4eb7-2b55-42d6-aaf6-030dbc4adfaa admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:57.181885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b4eb7-2b55-42d6-aaf6-030dbc4adfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:57.182166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b4eb7-2b55-42d6-aaf6-030dbc4adfaa admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:57.182893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b4eb7-2b55-42d6-aaf6-030dbc4adfaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:57.184566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b4eb7-2b55-42d6-aaf6-030dbc4adfaa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:57.197784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f4d89-b379-418b-8238-3a32b73980dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=af5057879953477fa6557bbd78b77763, user_id=8be0d1bce21149af900fccfc92b64f29, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:57.200843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f4d89-b379-418b-8238-3a32b73980dd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:57.212459 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2998/5967] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:24:57.214736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b4eb7-2b55-42d6-aaf6-030dbc4adfaa admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:57.238946 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2970/5968] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:24:57 2022] PUT /identity/v3/projects/af5057879953477fa6557bbd78b77763/users/8be0d1bce21149af900fccfc92b64f29/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:24:57.239224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b4eb7-2b55-42d6-aaf6-030dbc4adfaa admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:57.240564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232143a-e14c-43fb-85da-89071eae7578 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:57.240900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232143a-e14c-43fb-85da-89071eae7578 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:57.241110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232143a-e14c-43fb-85da-89071eae7578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:57.304552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8232143a-e14c-43fb-85da-89071eae7578 None None] MFA Rules not processed for user `8be0d1bce21149af900fccfc92b64f29`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:57.306576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8232143a-e14c-43fb-85da-89071eae7578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:57.325340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781728b1-f624-40a2-b5ae-6f6205111921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:57.326456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781728b1-f624-40a2-b5ae-6f6205111921 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:57.326780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781728b1-f624-40a2-b5ae-6f6205111921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:57.327190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781728b1-f624-40a2-b5ae-6f6205111921 admin admin] PATH_INFO: `/v3/projects/6e05a2e4eb1447d08ef495a3b35bcaa3/users/5e8469eb25704036830b3f2a71029c57/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:57.345390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781728b1-f624-40a2-b5ae-6f6205111921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e05a2e4eb1447d08ef495a3b35bcaa3, user_id=5e8469eb25704036830b3f2a71029c57, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:57.348419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781728b1-f624-40a2-b5ae-6f6205111921 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:57.366222 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 2999/5969] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:24:57 2022] PUT /identity/v3/projects/6e05a2e4eb1447d08ef495a3b35bcaa3/users/5e8469eb25704036830b3f2a71029c57/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:24:57.369882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781728b1-f624-40a2-b5ae-6f6205111921 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:57.435617 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2971/5970] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:24:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:24:57.445926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16b7ca-caa5-49e4-bc8f-ac836f5d0fde None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:57.446197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16b7ca-caa5-49e4-bc8f-ac836f5d0fde None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:57.446544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16b7ca-caa5-49e4-bc8f-ac836f5d0fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:57.460292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781728b1-f624-40a2-b5ae-6f6205111921 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:57.467520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fc16b7ca-caa5-49e4-bc8f-ac836f5d0fde None None] MFA Rules not processed for user `8be0d1bce21149af900fccfc92b64f29`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:57.468820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fc16b7ca-caa5-49e4-bc8f-ac836f5d0fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:57.470886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d790f-b9df-404c-a618-c563b48a51c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:57.472564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d790f-b9df-404c-a618-c563b48a51c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:57.473257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d790f-b9df-404c-a618-c563b48a51c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:57.473769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d790f-b9df-404c-a618-c563b48a51c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:57.475291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d790f-b9df-404c-a618-c563b48a51c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:57.478125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d790f-b9df-404c-a618-c563b48a51c6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:57.487356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:57.492619 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3000/5971] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:24:57.497577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d790f-b9df-404c-a618-c563b48a51c6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:57.510952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d790f-b9df-404c-a618-c563b48a51c6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:57.517539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd00e6f-d02b-4bd2-a98a-d04679e374e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:57.521134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd00e6f-d02b-4bd2-a98a-d04679e374e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:57.521479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd00e6f-d02b-4bd2-a98a-d04679e374e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:57.521769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd00e6f-d02b-4bd2-a98a-d04679e374e4 admin admin] PATH_INFO: `/v3/projects/6e05a2e4eb1447d08ef495a3b35bcaa3/users/5e8469eb25704036830b3f2a71029c57/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:57.532855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd00e6f-d02b-4bd2-a98a-d04679e374e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e05a2e4eb1447d08ef495a3b35bcaa3, user_id=5e8469eb25704036830b3f2a71029c57, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:57.545761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd00e6f-d02b-4bd2-a98a-d04679e374e4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:57.560647 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2972/5972] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:24:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:24:57.567899 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3001/5973] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:24:57 2022] PUT /identity/v3/projects/6e05a2e4eb1447d08ef495a3b35bcaa3/users/5e8469eb25704036830b3f2a71029c57/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:24:57.579685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cb475-e6a2-4957-b8f0-596ae984b8a7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:57.579975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cb475-e6a2-4957-b8f0-596ae984b8a7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:57.580297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cb475-e6a2-4957-b8f0-596ae984b8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:57.602577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd00e6f-d02b-4bd2-a98a-d04679e374e4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:57.604532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5fd00e6f-d02b-4bd2-a98a-d04679e374e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:57.645272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d87cb475-e6a2-4957-b8f0-596ae984b8a7 None None] MFA Rules not processed for user `5e8469eb25704036830b3f2a71029c57`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:57.647875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d87cb475-e6a2-4957-b8f0-596ae984b8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:57.704014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:57.749853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd00e6f-d02b-4bd2-a98a-d04679e374e4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:57.751624 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2973/5974] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:24:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:24:57.760816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1ff9a-1b06-4c24-8204-8e1d95c87569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:57.761884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1ff9a-1b06-4c24-8204-8e1d95c87569 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:57.762177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1ff9a-1b06-4c24-8204-8e1d95c87569 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:57.762496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1ff9a-1b06-4c24-8204-8e1d95c87569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:57.764267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cb475-e6a2-4957-b8f0-596ae984b8a7 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:57.766821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d87cb475-e6a2-4957-b8f0-596ae984b8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:57.846868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1ff9a-1b06-4c24-8204-8e1d95c87569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:57.848824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1ff9a-1b06-4c24-8204-8e1d95c87569 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:57.862657 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3002/5975] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:24:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:24:57.893004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cb475-e6a2-4957-b8f0-596ae984b8a7 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:57.896943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052e0c0-b57a-459c-b40b-be519bafd7bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:57.897627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052e0c0-b57a-459c-b40b-be519bafd7bd service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:57.897913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052e0c0-b57a-459c-b40b-be519bafd7bd service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:57.898193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052e0c0-b57a-459c-b40b-be519bafd7bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:57.909224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052e0c0-b57a-459c-b40b-be519bafd7bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:57.910638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052e0c0-b57a-459c-b40b-be519bafd7bd service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:57.922382 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2974/5976] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:24:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:24:58.127450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1ff9a-1b06-4c24-8204-8e1d95c87569 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:58.205533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1ff9a-1b06-4c24-8204-8e1d95c87569 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:58.212482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d5c45-a3fe-47fc-9e0b-2db3a06bf286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:58.213604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d5c45-a3fe-47fc-9e0b-2db3a06bf286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:58.213895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d5c45-a3fe-47fc-9e0b-2db3a06bf286 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:58.214232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d5c45-a3fe-47fc-9e0b-2db3a06bf286 admin admin] PATH_INFO: `/v3/users/dcaaf44ac2cb486195ceadd8cd802f82` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:58.215560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d5c45-a3fe-47fc-9e0b-2db3a06bf286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcaaf44ac2cb486195ceadd8cd802f82)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:58.217791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d5c45-a3fe-47fc-9e0b-2db3a06bf286 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:58.276839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ae5d5c45-a3fe-47fc-9e0b-2db3a06bf286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcaaf44ac2cb486195ceadd8cd802f82'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:58.286203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ae5d5c45-a3fe-47fc-9e0b-2db3a06bf286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcaaf44ac2cb486195ceadd8cd802f82'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:58.286895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ae5d5c45-a3fe-47fc-9e0b-2db3a06bf286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcaaf44ac2cb486195ceadd8cd802f82'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:58.287664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ae5d5c45-a3fe-47fc-9e0b-2db3a06bf286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcaaf44ac2cb486195ceadd8cd802f82'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:58.296028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ae5d5c45-a3fe-47fc-9e0b-2db3a06bf286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcaaf44ac2cb486195ceadd8cd802f82'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:58.310967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:58.334607 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3003/5977] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:24:58 2022] DELETE /identity/v3/users/dcaaf44ac2cb486195ceadd8cd802f82 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:24:58.339474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfb33c-c0af-424a-96ae-45b0af4fc05e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:58.340030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfb33c-c0af-424a-96ae-45b0af4fc05e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:58.340797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfb33c-c0af-424a-96ae-45b0af4fc05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:58.368825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-13bfb33c-c0af-424a-96ae-45b0af4fc05e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:24:58.371093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-13bfb33c-c0af-424a-96ae-45b0af4fc05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:58.394469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:58.440813 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2975/5978] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:24:58.451735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d5c45-a3fe-47fc-9e0b-2db3a06bf286 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:58.453522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ae5d5c45-a3fe-47fc-9e0b-2db3a06bf286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:58.572875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d5c45-a3fe-47fc-9e0b-2db3a06bf286 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:58.579576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b3f3a-b00f-404d-ba6b-4353f80886bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:58.580630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b3f3a-b00f-404d-ba6b-4353f80886bb service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:58.581779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b3f3a-b00f-404d-ba6b-4353f80886bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:58.582722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b3f3a-b00f-404d-ba6b-4353f80886bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:58.610956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b3f3a-b00f-404d-ba6b-4353f80886bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:58.612706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b3f3a-b00f-404d-ba6b-4353f80886bb service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:58.642573 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3004/5979] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:24:59.213792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfb33c-c0af-424a-96ae-45b0af4fc05e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:59.215518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-13bfb33c-c0af-424a-96ae-45b0af4fc05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:24:59.230424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfb33c-c0af-424a-96ae-45b0af4fc05e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:59.236523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae35398-dffe-4e59-8d59-4c60d3d5f355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:59.237730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae35398-dffe-4e59-8d59-4c60d3d5f355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:59.238225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae35398-dffe-4e59-8d59-4c60d3d5f355 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:59.238764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae35398-dffe-4e59-8d59-4c60d3d5f355 admin admin] PATH_INFO: `/v3/projects/f198daf13d62460cb611688761fcddac` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:59.240255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae35398-dffe-4e59-8d59-4c60d3d5f355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f198daf13d62460cb611688761fcddac)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:59.242475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae35398-dffe-4e59-8d59-4c60d3d5f355 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:59.318892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ae35398-dffe-4e59-8d59-4c60d3d5f355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f198daf13d62460cb611688761fcddac', 'request_id': 'req-7ae35398-dffe-4e59-8d59-4c60d3d5f355'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:59.326642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ae35398-dffe-4e59-8d59-4c60d3d5f355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f198daf13d62460cb611688761fcddac', 'request_id': 'req-7ae35398-dffe-4e59-8d59-4c60d3d5f355'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:59.337184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ae35398-dffe-4e59-8d59-4c60d3d5f355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f198daf13d62460cb611688761fcddac', 'request_id': 'req-7ae35398-dffe-4e59-8d59-4c60d3d5f355'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:59.355100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ae35398-dffe-4e59-8d59-4c60d3d5f355 admin admin] The token cache is being invalidate because project f198daf13d62460cb611688761fcddac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:24:59.355393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ae35398-dffe-4e59-8d59-4c60d3d5f355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:59.356123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ae35398-dffe-4e59-8d59-4c60d3d5f355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:59.357980 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2976/5980] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:24:59 2022] DELETE /identity/v3/projects/f198daf13d62460cb611688761fcddac => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:24:59.361909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b3f3a-b00f-404d-ba6b-4353f80886bb service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:24:59.374752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b3f3a-b00f-404d-ba6b-4353f80886bb service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:24:59.475961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cc0c9-de94-4fd4-9f97-3008587dbf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:24:59.478584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cc0c9-de94-4fd4-9f97-3008587dbf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:24:59.479104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cc0c9-de94-4fd4-9f97-3008587dbf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:24:59.479586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cc0c9-de94-4fd4-9f97-3008587dbf99 admin admin] PATH_INFO: `/v3/users/5e8469eb25704036830b3f2a71029c57` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:24:59.481797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1cc0c9-de94-4fd4-9f97-3008587dbf99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e8469eb25704036830b3f2a71029c57)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:24:59.484498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1cc0c9-de94-4fd4-9f97-3008587dbf99 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:24:59.547697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9d1cc0c9-de94-4fd4-9f97-3008587dbf99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e8469eb25704036830b3f2a71029c57'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:59.558900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9d1cc0c9-de94-4fd4-9f97-3008587dbf99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e8469eb25704036830b3f2a71029c57'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:59.559551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9d1cc0c9-de94-4fd4-9f97-3008587dbf99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e8469eb25704036830b3f2a71029c57'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:59.560652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9d1cc0c9-de94-4fd4-9f97-3008587dbf99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e8469eb25704036830b3f2a71029c57'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:59.570080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9d1cc0c9-de94-4fd4-9f97-3008587dbf99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e8469eb25704036830b3f2a71029c57'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:24:59.597721 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3005/5981] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:24:59 2022] DELETE /identity/v3/users/5e8469eb25704036830b3f2a71029c57 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:00.148748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae35398-dffe-4e59-8d59-4c60d3d5f355 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:00.150780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7ae35398-dffe-4e59-8d59-4c60d3d5f355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:00.178623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae35398-dffe-4e59-8d59-4c60d3d5f355 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:00.246681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b900c3-6795-488d-976a-9897aa5b7ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:00.247378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b900c3-6795-488d-976a-9897aa5b7ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:00.247378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b900c3-6795-488d-976a-9897aa5b7ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:00.247639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b900c3-6795-488d-976a-9897aa5b7ad8 admin admin] PATH_INFO: `/v3/projects/6e05a2e4eb1447d08ef495a3b35bcaa3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:00.249087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b900c3-6795-488d-976a-9897aa5b7ad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e05a2e4eb1447d08ef495a3b35bcaa3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:00.251367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b900c3-6795-488d-976a-9897aa5b7ad8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:00.305549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-89b900c3-6795-488d-976a-9897aa5b7ad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e05a2e4eb1447d08ef495a3b35bcaa3', 'request_id': 'req-89b900c3-6795-488d-976a-9897aa5b7ad8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:00.307434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:00.312925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-89b900c3-6795-488d-976a-9897aa5b7ad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e05a2e4eb1447d08ef495a3b35bcaa3', 'request_id': 'req-89b900c3-6795-488d-976a-9897aa5b7ad8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:00.321017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-89b900c3-6795-488d-976a-9897aa5b7ad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e05a2e4eb1447d08ef495a3b35bcaa3', 'request_id': 'req-89b900c3-6795-488d-976a-9897aa5b7ad8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:00.334406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-89b900c3-6795-488d-976a-9897aa5b7ad8 admin admin] The token cache is being invalidate because project 6e05a2e4eb1447d08ef495a3b35bcaa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:00.334687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-89b900c3-6795-488d-976a-9897aa5b7ad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:00.335352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-89b900c3-6795-488d-976a-9897aa5b7ad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:00.337020 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2977/5982] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:00 2022] DELETE /identity/v3/projects/6e05a2e4eb1447d08ef495a3b35bcaa3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:00.342319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d441237-eab8-47b5-ad8f-75082d0d7922 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:00.342603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d441237-eab8-47b5-ad8f-75082d0d7922 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:00.342879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d441237-eab8-47b5-ad8f-75082d0d7922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:00.362626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8d441237-eab8-47b5-ad8f-75082d0d7922 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:00.364297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8d441237-eab8-47b5-ad8f-75082d0d7922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:00.379169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:00.433527 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3006/5983] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:00.441698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd75fb-f283-437e-a1c3-c6cda6a449bd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:00.442011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd75fb-f283-437e-a1c3-c6cda6a449bd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:00.442295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd75fb-f283-437e-a1c3-c6cda6a449bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:00.462503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b6dd75fb-f283-437e-a1c3-c6cda6a449bd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:00.463785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b6dd75fb-f283-437e-a1c3-c6cda6a449bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:00.473201 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2978/5984] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:00.477900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d441237-eab8-47b5-ad8f-75082d0d7922 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:00.488832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d441237-eab8-47b5-ad8f-75082d0d7922 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:00.494711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc8f8d-4972-476a-81f9-991213370260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:00.495404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc8f8d-4972-476a-81f9-991213370260 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:00.495694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc8f8d-4972-476a-81f9-991213370260 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:00.495967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc8f8d-4972-476a-81f9-991213370260 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:00.496739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc8f8d-4972-476a-81f9-991213370260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:00.497049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc8f8d-4972-476a-81f9-991213370260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:00.498667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc8f8d-4972-476a-81f9-991213370260 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:00.512405 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3007/5985] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:00.517202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd75fb-f283-437e-a1c3-c6cda6a449bd None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:00.527212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd75fb-f283-437e-a1c3-c6cda6a449bd None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:00.537906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390729b-65d5-426e-a6c8-841304fd22db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:00.538618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390729b-65d5-426e-a6c8-841304fd22db admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:00.538869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390729b-65d5-426e-a6c8-841304fd22db admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:00.539156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390729b-65d5-426e-a6c8-841304fd22db admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:00.539828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390729b-65d5-426e-a6c8-841304fd22db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:00.541928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390729b-65d5-426e-a6c8-841304fd22db admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:00.584080 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2979/5986] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:00 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:00.586736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc8f8d-4972-476a-81f9-991213370260 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:00.598891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc8f8d-4972-476a-81f9-991213370260 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:00.660197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afba08-e080-4136-ba4d-77fb6d961725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:00.660889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afba08-e080-4136-ba4d-77fb6d961725 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:00.661173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afba08-e080-4136-ba4d-77fb6d961725 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:00.661450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afba08-e080-4136-ba4d-77fb6d961725 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:00.662146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afba08-e080-4136-ba4d-77fb6d961725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:00.664145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afba08-e080-4136-ba4d-77fb6d961725 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:00.689396 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3008/5987] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:00 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:00.693463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390729b-65d5-426e-a6c8-841304fd22db admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:00.703993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390729b-65d5-426e-a6c8-841304fd22db admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:00.709386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a405ff-d948-41e8-96c1-55d4337197d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:00.710196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a405ff-d948-41e8-96c1-55d4337197d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:00.710477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a405ff-d948-41e8-96c1-55d4337197d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:00.710750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a405ff-d948-41e8-96c1-55d4337197d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:00.711467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a405ff-d948-41e8-96c1-55d4337197d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:00.713106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a405ff-d948-41e8-96c1-55d4337197d2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:00.726170 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2980/5988] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:00.730290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afba08-e080-4136-ba4d-77fb6d961725 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:00.741489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afba08-e080-4136-ba4d-77fb6d961725 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:00.747193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104f53f-bfee-4c6a-93c7-d81b0e50bf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:00.747979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104f53f-bfee-4c6a-93c7-d81b0e50bf5f admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:00.748292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104f53f-bfee-4c6a-93c7-d81b0e50bf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:00.748572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104f53f-bfee-4c6a-93c7-d81b0e50bf5f admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:00.749320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104f53f-bfee-4c6a-93c7-d81b0e50bf5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:00.751486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104f53f-bfee-4c6a-93c7-d81b0e50bf5f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:00.765583 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3009/5989] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:25:00.773068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a405ff-d948-41e8-96c1-55d4337197d2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:00.784841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a405ff-d948-41e8-96c1-55d4337197d2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:00.790006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34239915-ae21-4125-9a29-895d5edecd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:00.791400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34239915-ae21-4125-9a29-895d5edecd3d admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:00.791512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34239915-ae21-4125-9a29-895d5edecd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:00.791807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34239915-ae21-4125-9a29-895d5edecd3d admin admin] PATH_INFO: `/v3/projects/a1a0e7eb20504330a527992372a1b698/users/c0680ead092d4dad880fef11bbd3b2b9/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:00.822675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34239915-ae21-4125-9a29-895d5edecd3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a0e7eb20504330a527992372a1b698, user_id=c0680ead092d4dad880fef11bbd3b2b9, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:00.826723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34239915-ae21-4125-9a29-895d5edecd3d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:00.856981 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2981/5990] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:00 2022] PUT /identity/v3/projects/a1a0e7eb20504330a527992372a1b698/users/c0680ead092d4dad880fef11bbd3b2b9/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:00.859508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d7a65-1990-453f-91a0-3c01b8c6886b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:00.860380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d7a65-1990-453f-91a0-3c01b8c6886b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:00.861140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d7a65-1990-453f-91a0-3c01b8c6886b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:00.912695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b03d7a65-1990-453f-91a0-3c01b8c6886b None None] MFA Rules not processed for user `c0680ead092d4dad880fef11bbd3b2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:00.914030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b03d7a65-1990-453f-91a0-3c01b8c6886b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:01.002867 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3010/5991] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:01.005803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34239915-ae21-4125-9a29-895d5edecd3d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:01.120359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34239915-ae21-4125-9a29-895d5edecd3d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:01.132138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a0290-1d80-4579-a526-08d7a9a3e923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:01.133798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a0290-1d80-4579-a526-08d7a9a3e923 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:01.134436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a0290-1d80-4579-a526-08d7a9a3e923 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:01.134732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a0290-1d80-4579-a526-08d7a9a3e923 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:01.136861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a0290-1d80-4579-a526-08d7a9a3e923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:01.140433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a0290-1d80-4579-a526-08d7a9a3e923 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:01.178438 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2982/5992] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:01 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:01.182955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d7a65-1990-453f-91a0-3c01b8c6886b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:01.221318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d7a65-1990-453f-91a0-3c01b8c6886b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:01.243226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:01.309714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb4e71-ed79-46ad-8b88-70b0c576af29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:01.310844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb4e71-ed79-46ad-8b88-70b0c576af29 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:01.311361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb4e71-ed79-46ad-8b88-70b0c576af29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:01.311860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb4e71-ed79-46ad-8b88-70b0c576af29 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:01.312828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb4e71-ed79-46ad-8b88-70b0c576af29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:01.315160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb4e71-ed79-46ad-8b88-70b0c576af29 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:01.357138 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3011/5993] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:01 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:01.362442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a0290-1d80-4579-a526-08d7a9a3e923 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:01.380199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a0290-1d80-4579-a526-08d7a9a3e923 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:01.386305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af4ed6-80a1-42a0-bb0d-cb1c5a5784a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:01.387908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af4ed6-80a1-42a0-bb0d-cb1c5a5784a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:01.388251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af4ed6-80a1-42a0-bb0d-cb1c5a5784a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:01.388690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af4ed6-80a1-42a0-bb0d-cb1c5a5784a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:01.389980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af4ed6-80a1-42a0-bb0d-cb1c5a5784a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:01.391840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af4ed6-80a1-42a0-bb0d-cb1c5a5784a1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:01.423525 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2983/5994] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:01.427679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb4e71-ed79-46ad-8b88-70b0c576af29 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:01.438570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb4e71-ed79-46ad-8b88-70b0c576af29 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:01.453375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44123cf8-1bd7-4586-af9a-afd234b46ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:01.454057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44123cf8-1bd7-4586-af9a-afd234b46ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:01.454402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44123cf8-1bd7-4586-af9a-afd234b46ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:01.454686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44123cf8-1bd7-4586-af9a-afd234b46ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:01.455482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44123cf8-1bd7-4586-af9a-afd234b46ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:01.457171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44123cf8-1bd7-4586-af9a-afd234b46ec1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:01.478081 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3012/5995] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:25:01.482638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af4ed6-80a1-42a0-bb0d-cb1c5a5784a1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:01.507655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af4ed6-80a1-42a0-bb0d-cb1c5a5784a1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:01.516210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529ca0b-7402-43e3-b32a-3a7f177144b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:01.517229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529ca0b-7402-43e3-b32a-3a7f177144b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:01.517579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529ca0b-7402-43e3-b32a-3a7f177144b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:01.518176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529ca0b-7402-43e3-b32a-3a7f177144b2 admin admin] PATH_INFO: `/v3/projects/118d92e31b9a4c5eb2e90826507e1086/users/d4bb25dbdc3146e98c8b7b7b531c118d/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:01.540710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529ca0b-7402-43e3-b32a-3a7f177144b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118d92e31b9a4c5eb2e90826507e1086, user_id=d4bb25dbdc3146e98c8b7b7b531c118d, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:01.543587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529ca0b-7402-43e3-b32a-3a7f177144b2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:01.561031 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2984/5996] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:01 2022] PUT /identity/v3/projects/118d92e31b9a4c5eb2e90826507e1086/users/d4bb25dbdc3146e98c8b7b7b531c118d/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:01.571316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c7322-36fa-436a-a5d6-1ea8db6bba18 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:01.571688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c7322-36fa-436a-a5d6-1ea8db6bba18 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:01.572067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c7322-36fa-436a-a5d6-1ea8db6bba18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:01.626263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3e3c7322-36fa-436a-a5d6-1ea8db6bba18 None None] MFA Rules not processed for user `d4bb25dbdc3146e98c8b7b7b531c118d`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:01.627280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3e3c7322-36fa-436a-a5d6-1ea8db6bba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:01.753988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529ca0b-7402-43e3-b32a-3a7f177144b2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:01.754295 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3013/5997] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:01.796370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:01.874421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529ca0b-7402-43e3-b32a-3a7f177144b2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:01.882297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753b0d1-8e7b-4c47-a885-253fa8310d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:01.883112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753b0d1-8e7b-4c47-a885-253fa8310d4f admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:01.883387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753b0d1-8e7b-4c47-a885-253fa8310d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:01.883762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753b0d1-8e7b-4c47-a885-253fa8310d4f admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:01.884414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753b0d1-8e7b-4c47-a885-253fa8310d4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:01.886351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753b0d1-8e7b-4c47-a885-253fa8310d4f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:01.936506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c7322-36fa-436a-a5d6-1ea8db6bba18 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:01.948087 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2985/5998] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:01 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:01.957374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c7322-36fa-436a-a5d6-1ea8db6bba18 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:02.114742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc074ebb-eeb0-4083-89f5-28a6b986e47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:02.115704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc074ebb-eeb0-4083-89f5-28a6b986e47f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:02.116084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc074ebb-eeb0-4083-89f5-28a6b986e47f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:02.116482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc074ebb-eeb0-4083-89f5-28a6b986e47f admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:02.117250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc074ebb-eeb0-4083-89f5-28a6b986e47f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:02.119283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc074ebb-eeb0-4083-89f5-28a6b986e47f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:02.149726 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3014/5999] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:01 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:02.150966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753b0d1-8e7b-4c47-a885-253fa8310d4f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:02.166875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753b0d1-8e7b-4c47-a885-253fa8310d4f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:02.171695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40592d49-174a-4f66-8db4-68579a8e30b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:02.172473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40592d49-174a-4f66-8db4-68579a8e30b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:02.172908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40592d49-174a-4f66-8db4-68579a8e30b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:02.173351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40592d49-174a-4f66-8db4-68579a8e30b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:02.174331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40592d49-174a-4f66-8db4-68579a8e30b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:02.176412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40592d49-174a-4f66-8db4-68579a8e30b5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:02.193752 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2986/6000] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:02.197992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc074ebb-eeb0-4083-89f5-28a6b986e47f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:02.209671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc074ebb-eeb0-4083-89f5-28a6b986e47f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:02.215975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5671190-4e7d-433f-a92d-18f57f6b86db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:02.216923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5671190-4e7d-433f-a92d-18f57f6b86db admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:02.218418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5671190-4e7d-433f-a92d-18f57f6b86db admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:02.219029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5671190-4e7d-433f-a92d-18f57f6b86db admin admin] PATH_INFO: `/v3/projects/8dda582ad81148b18780fe33f1efda70/users/bd697646b95e45a28c7ed2f73991f15c/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:02.231787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:02.241481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5671190-4e7d-433f-a92d-18f57f6b86db admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dda582ad81148b18780fe33f1efda70, user_id=bd697646b95e45a28c7ed2f73991f15c, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:02.248261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5671190-4e7d-433f-a92d-18f57f6b86db admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:02.274732 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3015/6001] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:02 2022] PUT /identity/v3/projects/8dda582ad81148b18780fe33f1efda70/users/bd697646b95e45a28c7ed2f73991f15c/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:02.276027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40592d49-174a-4f66-8db4-68579a8e30b5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:02.288740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40592d49-174a-4f66-8db4-68579a8e30b5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:02.356375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd9187-0351-4496-92d4-bce7ed5af3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:02.357165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd9187-0351-4496-92d4-bce7ed5af3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:02.357385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd9187-0351-4496-92d4-bce7ed5af3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:02.358108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd9187-0351-4496-92d4-bce7ed5af3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:02.358383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd9187-0351-4496-92d4-bce7ed5af3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:02.360822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd9187-0351-4496-92d4-bce7ed5af3e8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:02.375554 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2987/6002] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:02.379931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5671190-4e7d-433f-a92d-18f57f6b86db admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:02.394052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5671190-4e7d-433f-a92d-18f57f6b86db admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:02.413008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99d7b0-3ba3-4944-93fb-fc81dbeb4e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:02.416387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99d7b0-3ba3-4944-93fb-fc81dbeb4e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:02.417323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99d7b0-3ba3-4944-93fb-fc81dbeb4e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:02.417708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99d7b0-3ba3-4944-93fb-fc81dbeb4e26 admin admin] PATH_INFO: `/v3/projects/8dda582ad81148b18780fe33f1efda70/users/bd697646b95e45a28c7ed2f73991f15c/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:02.421290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99d7b0-3ba3-4944-93fb-fc81dbeb4e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dda582ad81148b18780fe33f1efda70, user_id=bd697646b95e45a28c7ed2f73991f15c, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:02.424961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99d7b0-3ba3-4944-93fb-fc81dbeb4e26 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:02.453560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d9de2-3d3d-4577-9c08-6cd3a206fc04 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:02.453852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d9de2-3d3d-4577-9c08-6cd3a206fc04 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:02.454135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d9de2-3d3d-4577-9c08-6cd3a206fc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:02.475163 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3016/6003] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:02 2022] PUT /identity/v3/projects/8dda582ad81148b18780fe33f1efda70/users/bd697646b95e45a28c7ed2f73991f15c/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:02.507736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-699d9de2-3d3d-4577-9c08-6cd3a206fc04 None None] MFA Rules not processed for user `bd697646b95e45a28c7ed2f73991f15c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:02.509323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-699d9de2-3d3d-4577-9c08-6cd3a206fc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:02.603684 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2988/6004] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:02.615435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99d7b0-3ba3-4944-93fb-fc81dbeb4e26 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:02.617322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cc99d7b0-3ba3-4944-93fb-fc81dbeb4e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:02.757971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99d7b0-3ba3-4944-93fb-fc81dbeb4e26 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:02.773643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4526ae4-1956-4c3d-adfb-823306863834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:02.774241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4526ae4-1956-4c3d-adfb-823306863834 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:02.774533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4526ae4-1956-4c3d-adfb-823306863834 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:02.774814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4526ae4-1956-4c3d-adfb-823306863834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:02.800642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4526ae4-1956-4c3d-adfb-823306863834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:02.802464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4526ae4-1956-4c3d-adfb-823306863834 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:02.813903 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3017/6005] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:03.422499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d9de2-3d3d-4577-9c08-6cd3a206fc04 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:03.424137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-699d9de2-3d3d-4577-9c08-6cd3a206fc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:03.438807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d9de2-3d3d-4577-9c08-6cd3a206fc04 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:03.442887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db2106-5e9b-48b6-97ee-195d5843c833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:03.443543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db2106-5e9b-48b6-97ee-195d5843c833 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:03.443824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db2106-5e9b-48b6-97ee-195d5843c833 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:03.444132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db2106-5e9b-48b6-97ee-195d5843c833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:03.470555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:03.542356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db2106-5e9b-48b6-97ee-195d5843c833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:03.544187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db2106-5e9b-48b6-97ee-195d5843c833 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:03.557867 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2989/6006] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:07.582159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4526ae4-1956-4c3d-adfb-823306863834 service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:07.670149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4526ae4-1956-4c3d-adfb-823306863834 service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:07.675642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c645b9-11c8-4aae-bf76-b3d2eec8d6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:07.676947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c645b9-11c8-4aae-bf76-b3d2eec8d6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:07.677493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c645b9-11c8-4aae-bf76-b3d2eec8d6be admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:07.677493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c645b9-11c8-4aae-bf76-b3d2eec8d6be admin admin] PATH_INFO: `/v3/users/c0680ead092d4dad880fef11bbd3b2b9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:07.678774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c645b9-11c8-4aae-bf76-b3d2eec8d6be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0680ead092d4dad880fef11bbd3b2b9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:07.680810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c645b9-11c8-4aae-bf76-b3d2eec8d6be admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:07.753772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a8c645b9-11c8-4aae-bf76-b3d2eec8d6be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0680ead092d4dad880fef11bbd3b2b9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:07.771136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a8c645b9-11c8-4aae-bf76-b3d2eec8d6be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0680ead092d4dad880fef11bbd3b2b9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:07.772249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a8c645b9-11c8-4aae-bf76-b3d2eec8d6be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0680ead092d4dad880fef11bbd3b2b9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:07.774373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a8c645b9-11c8-4aae-bf76-b3d2eec8d6be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0680ead092d4dad880fef11bbd3b2b9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:07.796944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a8c645b9-11c8-4aae-bf76-b3d2eec8d6be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0680ead092d4dad880fef11bbd3b2b9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:07.816169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:07.830495 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3018/6007] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:07 2022] DELETE /identity/v3/users/c0680ead092d4dad880fef11bbd3b2b9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:07.835095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33c504-e855-46a7-b115-3f14f8a41042 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:07.835595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33c504-e855-46a7-b115-3f14f8a41042 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:07.835689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33c504-e855-46a7-b115-3f14f8a41042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:07.865581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-cd33c504-e855-46a7-b115-3f14f8a41042 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:07.882181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cd33c504-e855-46a7-b115-3f14f8a41042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:07.983599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c645b9-11c8-4aae-bf76-b3d2eec8d6be admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:07.985776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a8c645b9-11c8-4aae-bf76-b3d2eec8d6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:08.000078 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2990/6008] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:08.019295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c645b9-11c8-4aae-bf76-b3d2eec8d6be admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:08.020554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33c504-e855-46a7-b115-3f14f8a41042 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:08.022304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cd33c504-e855-46a7-b115-3f14f8a41042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:08.031111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa7df6-85c8-4a4e-bc8b-531bb768c8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:08.032266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa7df6-85c8-4a4e-bc8b-531bb768c8f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:08.033905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa7df6-85c8-4a4e-bc8b-531bb768c8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:08.034277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa7df6-85c8-4a4e-bc8b-531bb768c8f6 admin admin] PATH_INFO: `/v3/users/23d7253b721f409ab148368d84b87963` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:08.035579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa7df6-85c8-4a4e-bc8b-531bb768c8f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23d7253b721f409ab148368d84b87963)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:08.038827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa7df6-85c8-4a4e-bc8b-531bb768c8f6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:08.193985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d8aa7df6-85c8-4a4e-bc8b-531bb768c8f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23d7253b721f409ab148368d84b87963'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:08.208910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33c504-e855-46a7-b115-3f14f8a41042 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:08.210376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d8aa7df6-85c8-4a4e-bc8b-531bb768c8f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23d7253b721f409ab148368d84b87963'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:08.216199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d8aa7df6-85c8-4a4e-bc8b-531bb768c8f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23d7253b721f409ab148368d84b87963'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:08.219274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d8aa7df6-85c8-4a4e-bc8b-531bb768c8f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23d7253b721f409ab148368d84b87963'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:08.229060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4f79d-ec3d-4adb-a0e6-3e707759c991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:08.230053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4f79d-ec3d-4adb-a0e6-3e707759c991 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:08.230507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4f79d-ec3d-4adb-a0e6-3e707759c991 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:08.230936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4f79d-ec3d-4adb-a0e6-3e707759c991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:08.238838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-34a4f79d-ec3d-4adb-a0e6-3e707759c991 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:08.248897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d8aa7df6-85c8-4a4e-bc8b-531bb768c8f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23d7253b721f409ab148368d84b87963'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:08.264349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4f79d-ec3d-4adb-a0e6-3e707759c991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:08.267380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4f79d-ec3d-4adb-a0e6-3e707759c991 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:08.282173 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3019/6009] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:07 2022] DELETE /identity/v3/users/23d7253b721f409ab148368d84b87963 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:08.287682 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2991/6010] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:25:08.602911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa7df6-85c8-4a4e-bc8b-531bb768c8f6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:08.605653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d8aa7df6-85c8-4a4e-bc8b-531bb768c8f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:08.711965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4f79d-ec3d-4adb-a0e6-3e707759c991 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:08.713661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-34a4f79d-ec3d-4adb-a0e6-3e707759c991 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:08.730696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4f79d-ec3d-4adb-a0e6-3e707759c991 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:08.735594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa7df6-85c8-4a4e-bc8b-531bb768c8f6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:08.738609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa8a8b-af08-48d7-bfa9-4331e7ff3d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:08.739648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa8a8b-af08-48d7-bfa9-4331e7ff3d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:08.740143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa8a8b-af08-48d7-bfa9-4331e7ff3d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:08.740565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa8a8b-af08-48d7-bfa9-4331e7ff3d03 admin admin] PATH_INFO: `/v3/projects/a0c14d320e154cedb7b37f38873f241e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:08.742221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa8a8b-af08-48d7-bfa9-4331e7ff3d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0c14d320e154cedb7b37f38873f241e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:08.750408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa8a8b-af08-48d7-bfa9-4331e7ff3d03 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:08.760473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e174cd9-5e6e-4c35-a8f0-08cc755bf3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:08.761320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e174cd9-5e6e-4c35-a8f0-08cc755bf3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:08.761600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e174cd9-5e6e-4c35-a8f0-08cc755bf3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:08.761925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e174cd9-5e6e-4c35-a8f0-08cc755bf3ea admin admin] PATH_INFO: `/v3/projects/a1a0e7eb20504330a527992372a1b698` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:08.763832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e174cd9-5e6e-4c35-a8f0-08cc755bf3ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a0e7eb20504330a527992372a1b698)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:08.766491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e174cd9-5e6e-4c35-a8f0-08cc755bf3ea admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:08.831825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cdaa8a8b-af08-48d7-bfa9-4331e7ff3d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0c14d320e154cedb7b37f38873f241e', 'request_id': 'req-cdaa8a8b-af08-48d7-bfa9-4331e7ff3d03'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:08.848882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cdaa8a8b-af08-48d7-bfa9-4331e7ff3d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0c14d320e154cedb7b37f38873f241e', 'request_id': 'req-cdaa8a8b-af08-48d7-bfa9-4331e7ff3d03'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:08.855229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0e174cd9-5e6e-4c35-a8f0-08cc755bf3ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a0e7eb20504330a527992372a1b698', 'request_id': 'req-0e174cd9-5e6e-4c35-a8f0-08cc755bf3ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:08.857326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:08.861390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cdaa8a8b-af08-48d7-bfa9-4331e7ff3d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0c14d320e154cedb7b37f38873f241e', 'request_id': 'req-cdaa8a8b-af08-48d7-bfa9-4331e7ff3d03'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:08.882309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0e174cd9-5e6e-4c35-a8f0-08cc755bf3ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a0e7eb20504330a527992372a1b698', 'request_id': 'req-0e174cd9-5e6e-4c35-a8f0-08cc755bf3ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:08.892626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0e174cd9-5e6e-4c35-a8f0-08cc755bf3ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a0e7eb20504330a527992372a1b698', 'request_id': 'req-0e174cd9-5e6e-4c35-a8f0-08cc755bf3ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:08.897476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cdaa8a8b-af08-48d7-bfa9-4331e7ff3d03 admin admin] The token cache is being invalidate because project a0c14d320e154cedb7b37f38873f241e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:08.897848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cdaa8a8b-af08-48d7-bfa9-4331e7ff3d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:08.898820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cdaa8a8b-af08-48d7-bfa9-4331e7ff3d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:08.902337 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2992/6011] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:08 2022] DELETE /identity/v3/projects/a0c14d320e154cedb7b37f38873f241e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:08.907388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a24a8-7024-4a6c-b373-eb1ec1e4aba6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:08.907641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:08.907791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a24a8-7024-4a6c-b373-eb1ec1e4aba6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:08.908174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a24a8-7024-4a6c-b373-eb1ec1e4aba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:08.918918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0e174cd9-5e6e-4c35-a8f0-08cc755bf3ea admin admin] The token cache is being invalidate because project a1a0e7eb20504330a527992372a1b698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:08.919489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0e174cd9-5e6e-4c35-a8f0-08cc755bf3ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:08.921028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0e174cd9-5e6e-4c35-a8f0-08cc755bf3ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:08.923290 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3020/6012] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:08 2022] DELETE /identity/v3/projects/a1a0e7eb20504330a527992372a1b698 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:08.928918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e174cd9-5e6e-4c35-a8f0-08cc755bf3ea admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:08.931982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0e174cd9-5e6e-4c35-a8f0-08cc755bf3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:08.932341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a04a24a8-7024-4a6c-b373-eb1ec1e4aba6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:08.933716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a04a24a8-7024-4a6c-b373-eb1ec1e4aba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:09.011623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e174cd9-5e6e-4c35-a8f0-08cc755bf3ea admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:09.018288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf0644-772b-408d-b044-939b330f8d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:09.019310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf0644-772b-408d-b044-939b330f8d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:09.019682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf0644-772b-408d-b044-939b330f8d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:09.020078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf0644-772b-408d-b044-939b330f8d08 admin admin] PATH_INFO: `/v3/users/d4bb25dbdc3146e98c8b7b7b531c118d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:09.021468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf0644-772b-408d-b044-939b330f8d08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4bb25dbdc3146e98c8b7b7b531c118d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:09.023447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf0644-772b-408d-b044-939b330f8d08 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:09.028542 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2993/6013] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:09.040811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cca42d-7200-4e34-a0d3-0cba14249907 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:09.041103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cca42d-7200-4e34-a0d3-0cba14249907 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:09.041625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cca42d-7200-4e34-a0d3-0cba14249907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:09.084146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e6cca42d-7200-4e34-a0d3-0cba14249907 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:09.085679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e6cca42d-7200-4e34-a0d3-0cba14249907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:09.105711 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2994/6014] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:09.110658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cca42d-7200-4e34-a0d3-0cba14249907 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:09.133051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cca42d-7200-4e34-a0d3-0cba14249907 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:09.146870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d1717-c4ac-4625-a682-e45e26ae6e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:09.148095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d1717-c4ac-4625-a682-e45e26ae6e23 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:09.148508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d1717-c4ac-4625-a682-e45e26ae6e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:09.148981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d1717-c4ac-4625-a682-e45e26ae6e23 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:09.151326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d1717-c4ac-4625-a682-e45e26ae6e23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:09.152207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d1717-c4ac-4625-a682-e45e26ae6e23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:09.157123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d1717-c4ac-4625-a682-e45e26ae6e23 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:09.174214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a7cf0644-772b-408d-b044-939b330f8d08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4bb25dbdc3146e98c8b7b7b531c118d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:09.194952 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2995/6015] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:25:09.199326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d1717-c4ac-4625-a682-e45e26ae6e23 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:09.213051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d1717-c4ac-4625-a682-e45e26ae6e23 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:09.221698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a7cf0644-772b-408d-b044-939b330f8d08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4bb25dbdc3146e98c8b7b7b531c118d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:09.221950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7abb6-98d8-4e7b-8913-bc3abb217bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:09.222775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7abb6-98d8-4e7b-8913-bc3abb217bac admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:09.223288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7abb6-98d8-4e7b-8913-bc3abb217bac admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:09.223555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7abb6-98d8-4e7b-8913-bc3abb217bac admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:09.224279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7abb6-98d8-4e7b-8913-bc3abb217bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:09.224425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a7cf0644-772b-408d-b044-939b330f8d08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4bb25dbdc3146e98c8b7b7b531c118d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:09.225615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a7cf0644-772b-408d-b044-939b330f8d08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4bb25dbdc3146e98c8b7b7b531c118d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:09.226472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7abb6-98d8-4e7b-8913-bc3abb217bac admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:09.247990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a7cf0644-772b-408d-b044-939b330f8d08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4bb25dbdc3146e98c8b7b7b531c118d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:09.267850 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2996/6016] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:09 2022] POST /identity/v3/projects => generated 391 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:09.272122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7abb6-98d8-4e7b-8913-bc3abb217bac admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:09.282102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-baf7abb6-98d8-4e7b-8913-bc3abb217bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:09.295117 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3021/6017] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:08 2022] DELETE /identity/v3/users/d4bb25dbdc3146e98c8b7b7b531c118d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:09.383830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7abb6-98d8-4e7b-8913-bc3abb217bac admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:09.473864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:09.500944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da018f49-9d29-467a-9aac-9eb0ddbfc9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:09.502050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da018f49-9d29-467a-9aac-9eb0ddbfc9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:09.502783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da018f49-9d29-467a-9aac-9eb0ddbfc9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:09.503260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da018f49-9d29-467a-9aac-9eb0ddbfc9a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:09.504172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da018f49-9d29-467a-9aac-9eb0ddbfc9a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:09.507716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da018f49-9d29-467a-9aac-9eb0ddbfc9a0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:09.559903 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2997/6018] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:09 2022] POST /identity/v3/users => generated 296 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:09.560842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf0644-772b-408d-b044-939b330f8d08 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:09.576781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf0644-772b-408d-b044-939b330f8d08 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:09.589471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7b137-d022-4f3c-9bc4-eb3d35979b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:09.590532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7b137-d022-4f3c-9bc4-eb3d35979b18 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:09.590998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7b137-d022-4f3c-9bc4-eb3d35979b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:09.591443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7b137-d022-4f3c-9bc4-eb3d35979b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:09.592473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7b137-d022-4f3c-9bc4-eb3d35979b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:09.594370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7b137-d022-4f3c-9bc4-eb3d35979b18 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:09.624577 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3022/6019] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:09.628556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da018f49-9d29-467a-9aac-9eb0ddbfc9a0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:09.649811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da018f49-9d29-467a-9aac-9eb0ddbfc9a0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:09.679156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28056e91-d3a1-469f-85f8-4fda06f29d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:09.680812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28056e91-d3a1-469f-85f8-4fda06f29d3f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:09.681195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28056e91-d3a1-469f-85f8-4fda06f29d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:09.683043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28056e91-d3a1-469f-85f8-4fda06f29d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:09.691792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28056e91-d3a1-469f-85f8-4fda06f29d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:09.702707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28056e91-d3a1-469f-85f8-4fda06f29d3f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:09.724455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7b137-d022-4f3c-9bc4-eb3d35979b18 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:09.726382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-30f7b137-d022-4f3c-9bc4-eb3d35979b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:09.750625 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2998/6020] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:09.750869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7b137-d022-4f3c-9bc4-eb3d35979b18 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:09.752260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28056e91-d3a1-469f-85f8-4fda06f29d3f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:09.769732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db515c2-e35f-4d6d-b172-2f723ecc186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:09.770537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db515c2-e35f-4d6d-b172-2f723ecc186e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:09.770825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db515c2-e35f-4d6d-b172-2f723ecc186e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:09.771103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db515c2-e35f-4d6d-b172-2f723ecc186e admin admin] PATH_INFO: `/v3/projects/118d92e31b9a4c5eb2e90826507e1086` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:09.772682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db515c2-e35f-4d6d-b172-2f723ecc186e admin admin] RBAC: Authorizing `identity:delete_project(project_id=118d92e31b9a4c5eb2e90826507e1086)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:09.775571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db515c2-e35f-4d6d-b172-2f723ecc186e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:09.779723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28056e91-d3a1-469f-85f8-4fda06f29d3f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:09.798116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1d81f-c2ec-4dcc-8786-dcaad749ab24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:09.800015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1d81f-c2ec-4dcc-8786-dcaad749ab24 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:09.800665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1d81f-c2ec-4dcc-8786-dcaad749ab24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:09.801943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1d81f-c2ec-4dcc-8786-dcaad749ab24 admin admin] PATH_INFO: `/v3/projects/481f91eba9c14f728a473c0b03f1709f/users/e594a743b6424809abe3d22f930afd8b/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:09.828145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1d81f-c2ec-4dcc-8786-dcaad749ab24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=481f91eba9c14f728a473c0b03f1709f, user_id=e594a743b6424809abe3d22f930afd8b, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:09.832023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1d81f-c2ec-4dcc-8786-dcaad749ab24 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:09.856326 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 2999/6021] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:09 2022] PUT /identity/v3/projects/481f91eba9c14f728a473c0b03f1709f/users/e594a743b6424809abe3d22f930afd8b/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:09.857928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd32b0-9f1b-4a9b-a1fe-355b2f033bb4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:09.858221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd32b0-9f1b-4a9b-a1fe-355b2f033bb4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:09.858649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd32b0-9f1b-4a9b-a1fe-355b2f033bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:09.865537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0db515c2-e35f-4d6d-b172-2f723ecc186e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118d92e31b9a4c5eb2e90826507e1086', 'request_id': 'req-0db515c2-e35f-4d6d-b172-2f723ecc186e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:09.881323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0db515c2-e35f-4d6d-b172-2f723ecc186e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118d92e31b9a4c5eb2e90826507e1086', 'request_id': 'req-0db515c2-e35f-4d6d-b172-2f723ecc186e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:09.881847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0bbd32b0-9f1b-4a9b-a1fe-355b2f033bb4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:09.883285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0bbd32b0-9f1b-4a9b-a1fe-355b2f033bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:09.895384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0db515c2-e35f-4d6d-b172-2f723ecc186e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118d92e31b9a4c5eb2e90826507e1086', 'request_id': 'req-0db515c2-e35f-4d6d-b172-2f723ecc186e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:09.898539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:09.913912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0db515c2-e35f-4d6d-b172-2f723ecc186e admin admin] The token cache is being invalidate because project 118d92e31b9a4c5eb2e90826507e1086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:09.914218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0db515c2-e35f-4d6d-b172-2f723ecc186e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:09.915007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0db515c2-e35f-4d6d-b172-2f723ecc186e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:09.918007 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3023/6022] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:09 2022] DELETE /identity/v3/projects/118d92e31b9a4c5eb2e90826507e1086 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:09.918804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db515c2-e35f-4d6d-b172-2f723ecc186e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:09.921082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0db515c2-e35f-4d6d-b172-2f723ecc186e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:09.969105 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3000/6023] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:09.973713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd32b0-9f1b-4a9b-a1fe-355b2f033bb4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:09.975193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0bbd32b0-9f1b-4a9b-a1fe-355b2f033bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:09.998663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd32b0-9f1b-4a9b-a1fe-355b2f033bb4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:10.004736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127c160-4087-44f3-ae0e-10f37c23a047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:10.005665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127c160-4087-44f3-ae0e-10f37c23a047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:10.005959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127c160-4087-44f3-ae0e-10f37c23a047 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:10.006200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127c160-4087-44f3-ae0e-10f37c23a047 admin admin] PATH_INFO: `/v3/users/bd697646b95e45a28c7ed2f73991f15c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:10.007555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127c160-4087-44f3-ae0e-10f37c23a047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd697646b95e45a28c7ed2f73991f15c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:10.009676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127c160-4087-44f3-ae0e-10f37c23a047 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:10.010551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db515c2-e35f-4d6d-b172-2f723ecc186e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:10.016104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b6cd7-cc97-4aba-8697-6fd8207700ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:10.017087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b6cd7-cc97-4aba-8697-6fd8207700ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:10.017393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b6cd7-cc97-4aba-8697-6fd8207700ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:10.017745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b6cd7-cc97-4aba-8697-6fd8207700ff admin admin] PATH_INFO: `/v3/users/be7377b7e7244606a72cd1e556810a9e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:10.019145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b6cd7-cc97-4aba-8697-6fd8207700ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=be7377b7e7244606a72cd1e556810a9e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:10.021111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b6cd7-cc97-4aba-8697-6fd8207700ff admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:10.073721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5127c160-4087-44f3-ae0e-10f37c23a047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd697646b95e45a28c7ed2f73991f15c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.088333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c1b6cd7-cc97-4aba-8697-6fd8207700ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be7377b7e7244606a72cd1e556810a9e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.094373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5127c160-4087-44f3-ae0e-10f37c23a047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd697646b95e45a28c7ed2f73991f15c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.096473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c1b6cd7-cc97-4aba-8697-6fd8207700ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be7377b7e7244606a72cd1e556810a9e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.097714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c1b6cd7-cc97-4aba-8697-6fd8207700ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be7377b7e7244606a72cd1e556810a9e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.098614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c1b6cd7-cc97-4aba-8697-6fd8207700ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be7377b7e7244606a72cd1e556810a9e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.102698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5127c160-4087-44f3-ae0e-10f37c23a047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd697646b95e45a28c7ed2f73991f15c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.103445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5127c160-4087-44f3-ae0e-10f37c23a047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd697646b95e45a28c7ed2f73991f15c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.104239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5127c160-4087-44f3-ae0e-10f37c23a047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd697646b95e45a28c7ed2f73991f15c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.109370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3c1b6cd7-cc97-4aba-8697-6fd8207700ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be7377b7e7244606a72cd1e556810a9e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.126295 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3001/6024] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:09 2022] DELETE /identity/v3/users/bd697646b95e45a28c7ed2f73991f15c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:10.126295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127c160-4087-44f3-ae0e-10f37c23a047 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:10.126634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5127c160-4087-44f3-ae0e-10f37c23a047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:10.156033 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3024/6025] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:09 2022] DELETE /identity/v3/users/be7377b7e7244606a72cd1e556810a9e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:10.159293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:10.162595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed834d3-dd8d-4bed-81c3-cbe5820b2050 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:10.162595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed834d3-dd8d-4bed-81c3-cbe5820b2050 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:10.162595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed834d3-dd8d-4bed-81c3-cbe5820b2050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:10.202604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-aed834d3-dd8d-4bed-81c3-cbe5820b2050 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:10.206380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-aed834d3-dd8d-4bed-81c3-cbe5820b2050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:10.210690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127c160-4087-44f3-ae0e-10f37c23a047 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:10.287964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19972e-e2cf-4887-b4fe-57f722e56670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:10.288687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19972e-e2cf-4887-b4fe-57f722e56670 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:10.288969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19972e-e2cf-4887-b4fe-57f722e56670 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:10.290581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19972e-e2cf-4887-b4fe-57f722e56670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:10.294472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6a19972e-e2cf-4887-b4fe-57f722e56670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:10.312192 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3025/6026] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:10.325415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed834d3-dd8d-4bed-81c3-cbe5820b2050 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:10.369907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed834d3-dd8d-4bed-81c3-cbe5820b2050 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:10.376435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66df14-70a6-4cbb-b27c-294de65f1cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:10.377873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66df14-70a6-4cbb-b27c-294de65f1cfb service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:10.378033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66df14-70a6-4cbb-b27c-294de65f1cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:10.378455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66df14-70a6-4cbb-b27c-294de65f1cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:10.389569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:10.396524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66df14-70a6-4cbb-b27c-294de65f1cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:10.398160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66df14-70a6-4cbb-b27c-294de65f1cfb service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:10.415667 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3026/6027] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:10.431189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19972e-e2cf-4887-b4fe-57f722e56670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:10.432959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19972e-e2cf-4887-b4fe-57f722e56670 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:10.444246 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3002/6028] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:10.673193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66df14-70a6-4cbb-b27c-294de65f1cfb service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:10.674887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ea66df14-70a6-4cbb-b27c-294de65f1cfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:10.714745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66df14-70a6-4cbb-b27c-294de65f1cfb service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:10.721958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad90db-6df6-4e7e-a80c-bd0ba9452aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:10.722871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad90db-6df6-4e7e-a80c-bd0ba9452aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:10.723110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad90db-6df6-4e7e-a80c-bd0ba9452aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:10.723386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad90db-6df6-4e7e-a80c-bd0ba9452aa0 admin admin] PATH_INFO: `/v3/projects/8dda582ad81148b18780fe33f1efda70` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:10.724607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad90db-6df6-4e7e-a80c-bd0ba9452aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dda582ad81148b18780fe33f1efda70)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:10.726549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad90db-6df6-4e7e-a80c-bd0ba9452aa0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:10.733038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19972e-e2cf-4887-b4fe-57f722e56670 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:10.734801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6a19972e-e2cf-4887-b4fe-57f722e56670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:10.754151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19972e-e2cf-4887-b4fe-57f722e56670 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:10.761388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484da66f-c5ba-428d-896b-9e9e47d86353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:10.763327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484da66f-c5ba-428d-896b-9e9e47d86353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:10.765102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484da66f-c5ba-428d-896b-9e9e47d86353 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:10.765971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484da66f-c5ba-428d-896b-9e9e47d86353 admin admin] PATH_INFO: `/v3/projects/beab4740a1d14bba8f1eab2ca375c4c3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:10.768948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484da66f-c5ba-428d-896b-9e9e47d86353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beab4740a1d14bba8f1eab2ca375c4c3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:10.771566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484da66f-c5ba-428d-896b-9e9e47d86353 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:10.799020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7bad90db-6df6-4e7e-a80c-bd0ba9452aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dda582ad81148b18780fe33f1efda70', 'request_id': 'req-7bad90db-6df6-4e7e-a80c-bd0ba9452aa0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.810584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7bad90db-6df6-4e7e-a80c-bd0ba9452aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dda582ad81148b18780fe33f1efda70', 'request_id': 'req-7bad90db-6df6-4e7e-a80c-bd0ba9452aa0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.818154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7bad90db-6df6-4e7e-a80c-bd0ba9452aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dda582ad81148b18780fe33f1efda70', 'request_id': 'req-7bad90db-6df6-4e7e-a80c-bd0ba9452aa0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.830543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7bad90db-6df6-4e7e-a80c-bd0ba9452aa0 admin admin] The token cache is being invalidate because project 8dda582ad81148b18780fe33f1efda70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:10.831037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7bad90db-6df6-4e7e-a80c-bd0ba9452aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.831599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7bad90db-6df6-4e7e-a80c-bd0ba9452aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.833530 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3027/6029] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:10 2022] DELETE /identity/v3/projects/8dda582ad81148b18780fe33f1efda70 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:10.838381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8629766-a5d8-4348-ac5d-897ae51001c3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:10.838662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8629766-a5d8-4348-ac5d-897ae51001c3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:10.838934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8629766-a5d8-4348-ac5d-897ae51001c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:10.849946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-484da66f-c5ba-428d-896b-9e9e47d86353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beab4740a1d14bba8f1eab2ca375c4c3', 'request_id': 'req-484da66f-c5ba-428d-896b-9e9e47d86353'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.861258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b8629766-a5d8-4348-ac5d-897ae51001c3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:10.862554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b8629766-a5d8-4348-ac5d-897ae51001c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:10.862806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-484da66f-c5ba-428d-896b-9e9e47d86353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beab4740a1d14bba8f1eab2ca375c4c3', 'request_id': 'req-484da66f-c5ba-428d-896b-9e9e47d86353'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.872648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-484da66f-c5ba-428d-896b-9e9e47d86353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beab4740a1d14bba8f1eab2ca375c4c3', 'request_id': 'req-484da66f-c5ba-428d-896b-9e9e47d86353'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.902277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-484da66f-c5ba-428d-896b-9e9e47d86353 admin admin] The token cache is being invalidate because project beab4740a1d14bba8f1eab2ca375c4c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:10.902568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-484da66f-c5ba-428d-896b-9e9e47d86353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.903248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-484da66f-c5ba-428d-896b-9e9e47d86353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:10.905276 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3003/6030] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:10 2022] DELETE /identity/v3/projects/beab4740a1d14bba8f1eab2ca375c4c3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:10.918940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0968b-3ebb-4e7e-b46c-5cd1c9fb7c53 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:10.919302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0968b-3ebb-4e7e-b46c-5cd1c9fb7c53 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:10.919807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0968b-3ebb-4e7e-b46c-5cd1c9fb7c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:10.948318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-30c0968b-3ebb-4e7e-b46c-5cd1c9fb7c53 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:10.949890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-30c0968b-3ebb-4e7e-b46c-5cd1c9fb7c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:10.960068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:10.979836 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3028/6031] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:10.989427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b60e2-1096-4819-a425-fbcc51f87ab3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:10.989712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b60e2-1096-4819-a425-fbcc51f87ab3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:10.990104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b60e2-1096-4819-a425-fbcc51f87ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:11.023000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-516b60e2-1096-4819-a425-fbcc51f87ab3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:11.024481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-516b60e2-1096-4819-a425-fbcc51f87ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:11.032959 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3029/6032] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:11.037076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b60e2-1096-4819-a425-fbcc51f87ab3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:11.043801 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3004/6033] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:11.047788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b60e2-1096-4819-a425-fbcc51f87ab3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:11.052345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4682bd-0a22-425e-9990-d284e566a98b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:11.052639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4682bd-0a22-425e-9990-d284e566a98b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:11.052917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4682bd-0a22-425e-9990-d284e566a98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:11.053420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0f382-6834-4d5c-8b7b-5837ad84ba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:11.054091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0f382-6834-4d5c-8b7b-5837ad84ba20 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:11.054373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0f382-6834-4d5c-8b7b-5837ad84ba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:11.054677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0f382-6834-4d5c-8b7b-5837ad84ba20 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:11.055374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0f382-6834-4d5c-8b7b-5837ad84ba20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:11.055718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0f382-6834-4d5c-8b7b-5837ad84ba20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:11.057336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0f382-6834-4d5c-8b7b-5837ad84ba20 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:11.073692 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3030/6034] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:25:11.078034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0f382-6834-4d5c-8b7b-5837ad84ba20 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:11.081313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ba4682bd-0a22-425e-9990-d284e566a98b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:11.083029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ba4682bd-0a22-425e-9990-d284e566a98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:11.091631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0f382-6834-4d5c-8b7b-5837ad84ba20 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:11.096706 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3005/6035] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:11.100893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4682bd-0a22-425e-9990-d284e566a98b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:11.102750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc97fa8-89f9-48e7-adb4-9365918b0008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:11.103644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc97fa8-89f9-48e7-adb4-9365918b0008 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:11.103929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc97fa8-89f9-48e7-adb4-9365918b0008 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:11.104260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc97fa8-89f9-48e7-adb4-9365918b0008 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:11.104957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc97fa8-89f9-48e7-adb4-9365918b0008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:11.107784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc97fa8-89f9-48e7-adb4-9365918b0008 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:11.111229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4682bd-0a22-425e-9990-d284e566a98b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:11.116116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78323c-e3a4-47d2-8d7a-ec2b897e14ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:11.116888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78323c-e3a4-47d2-8d7a-ec2b897e14ec admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:11.117246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78323c-e3a4-47d2-8d7a-ec2b897e14ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:11.117961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78323c-e3a4-47d2-8d7a-ec2b897e14ec admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:11.118372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78323c-e3a4-47d2-8d7a-ec2b897e14ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:11.118764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78323c-e3a4-47d2-8d7a-ec2b897e14ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:11.120531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78323c-e3a4-47d2-8d7a-ec2b897e14ec admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:11.135891 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3006/6036] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:25:11.140409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78323c-e3a4-47d2-8d7a-ec2b897e14ec admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:11.147626 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3031/6037] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:11 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:11.151743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc97fa8-89f9-48e7-adb4-9365918b0008 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:11.153365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78323c-e3a4-47d2-8d7a-ec2b897e14ec admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:11.209535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:11.220786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bae9a7-20d4-4157-90c7-bbbbbb7ac46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:11.221642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bae9a7-20d4-4157-90c7-bbbbbb7ac46b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:11.222021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bae9a7-20d4-4157-90c7-bbbbbb7ac46b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:11.222281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bae9a7-20d4-4157-90c7-bbbbbb7ac46b admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:11.222982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bae9a7-20d4-4157-90c7-bbbbbb7ac46b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:11.225023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bae9a7-20d4-4157-90c7-bbbbbb7ac46b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:11.240732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc97fa8-89f9-48e7-adb4-9365918b0008 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:11.247006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c061b-1110-48ba-9122-ca7e105ff9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:11.247957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c061b-1110-48ba-9122-ca7e105ff9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:11.248370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c061b-1110-48ba-9122-ca7e105ff9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:11.248562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c061b-1110-48ba-9122-ca7e105ff9e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:11.249736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c061b-1110-48ba-9122-ca7e105ff9e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:11.251807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c061b-1110-48ba-9122-ca7e105ff9e9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:11.260127 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3007/6038] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:11 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:11.261182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bae9a7-20d4-4157-90c7-bbbbbb7ac46b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:11.282037 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3032/6039] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:11 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:11.283980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c061b-1110-48ba-9122-ca7e105ff9e9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:11.297584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c061b-1110-48ba-9122-ca7e105ff9e9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:11.346978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bae9a7-20d4-4157-90c7-bbbbbb7ac46b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:11.356267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30b8f1-0ba0-40d4-8ab3-b9a149ba670b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:11.356960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30b8f1-0ba0-40d4-8ab3-b9a149ba670b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:11.357241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30b8f1-0ba0-40d4-8ab3-b9a149ba670b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:11.357514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30b8f1-0ba0-40d4-8ab3-b9a149ba670b admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:11.358486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30b8f1-0ba0-40d4-8ab3-b9a149ba670b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:11.360714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30b8f1-0ba0-40d4-8ab3-b9a149ba670b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:11.395848 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3008/6040] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:11 2022] POST /identity/v3/users => generated 285 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:11.400849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30b8f1-0ba0-40d4-8ab3-b9a149ba670b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:11.414717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:11.416357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eeb546-86a7-4a13-912f-895577813d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:11.417046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eeb546-86a7-4a13-912f-895577813d32 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:11.417468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eeb546-86a7-4a13-912f-895577813d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:11.417709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eeb546-86a7-4a13-912f-895577813d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:11.417830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30b8f1-0ba0-40d4-8ab3-b9a149ba670b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:11.418555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eeb546-86a7-4a13-912f-895577813d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:11.420961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eeb546-86a7-4a13-912f-895577813d32 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:11.425161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b02b3-a02e-45c1-afe6-678ac35073ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:11.426262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b02b3-a02e-45c1-afe6-678ac35073ab admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:11.426616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b02b3-a02e-45c1-afe6-678ac35073ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:11.427056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b02b3-a02e-45c1-afe6-678ac35073ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:11.428181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b02b3-a02e-45c1-afe6-678ac35073ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:11.435901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b02b3-a02e-45c1-afe6-678ac35073ab admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:11.451210 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3009/6041] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:11.456597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b02b3-a02e-45c1-afe6-678ac35073ab admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:11.467829 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3033/6042] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:11.468514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b02b3-a02e-45c1-afe6-678ac35073ab admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:11.469932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eeb546-86a7-4a13-912f-895577813d32 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:11.474640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3923c78-c85d-44a3-9df7-9af88cb7b1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:11.475662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3923c78-c85d-44a3-9df7-9af88cb7b1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:11.476233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3923c78-c85d-44a3-9df7-9af88cb7b1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:11.477037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3923c78-c85d-44a3-9df7-9af88cb7b1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:11.478763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3923c78-c85d-44a3-9df7-9af88cb7b1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:11.481210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3923c78-c85d-44a3-9df7-9af88cb7b1d8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:11.482790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eeb546-86a7-4a13-912f-895577813d32 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:11.492955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be98d16-1d57-47c5-b382-810c03955b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:11.496652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be98d16-1d57-47c5-b382-810c03955b64 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:11.497204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be98d16-1d57-47c5-b382-810c03955b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:11.497586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be98d16-1d57-47c5-b382-810c03955b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:11.498423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be98d16-1d57-47c5-b382-810c03955b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:11.498972 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3010/6043] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:11.502973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3923c78-c85d-44a3-9df7-9af88cb7b1d8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:11.504204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be98d16-1d57-47c5-b382-810c03955b64 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:11.518442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3923c78-c85d-44a3-9df7-9af88cb7b1d8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:11.519395 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3034/6044] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:11.523638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be98d16-1d57-47c5-b382-810c03955b64 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:11.525788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b21d3-9e59-4ca7-9309-ac6e675b0ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:11.526820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b21d3-9e59-4ca7-9309-ac6e675b0ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:11.527099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b21d3-9e59-4ca7-9309-ac6e675b0ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:11.527376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b21d3-9e59-4ca7-9309-ac6e675b0ef0 admin admin] PATH_INFO: `/v3/projects/e86a02c521614a29b2310b124d497e06/users/2bea9921cd684a7bbec5994cfc1d5874/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:11.541287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be98d16-1d57-47c5-b382-810c03955b64 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:11.545810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b21d3-9e59-4ca7-9309-ac6e675b0ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86a02c521614a29b2310b124d497e06, user_id=2bea9921cd684a7bbec5994cfc1d5874, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:11.548513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b21d3-9e59-4ca7-9309-ac6e675b0ef0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:11.557573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91d8c4-82d2-4943-9f9d-65c695430de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:11.558597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91d8c4-82d2-4943-9f9d-65c695430de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:11.558876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91d8c4-82d2-4943-9f9d-65c695430de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:11.559265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91d8c4-82d2-4943-9f9d-65c695430de6 admin admin] PATH_INFO: `/v3/projects/d924f1dd199749e1b8677dc1942d4a11/users/8899f2134b41429d8d84c758c65c750e/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:11.575955 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3011/6045] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:11 2022] PUT /identity/v3/projects/e86a02c521614a29b2310b124d497e06/users/2bea9921cd684a7bbec5994cfc1d5874/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:11.601258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91d8c4-82d2-4943-9f9d-65c695430de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d924f1dd199749e1b8677dc1942d4a11, user_id=8899f2134b41429d8d84c758c65c750e, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:11.604506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91d8c4-82d2-4943-9f9d-65c695430de6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:11.654498 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3035/6046] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:11 2022] PUT /identity/v3/projects/d924f1dd199749e1b8677dc1942d4a11/users/8899f2134b41429d8d84c758c65c750e/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:11.663651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d72eb4-1837-44b0-a2c2-6830fc6ad1af None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:11.663939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d72eb4-1837-44b0-a2c2-6830fc6ad1af None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:11.664227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d72eb4-1837-44b0-a2c2-6830fc6ad1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:11.701219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae0307-44eb-46ba-9062-4a5104a60c7c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:11.701806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae0307-44eb-46ba-9062-4a5104a60c7c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:11.702016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae0307-44eb-46ba-9062-4a5104a60c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:11.741090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e5d72eb4-1837-44b0-a2c2-6830fc6ad1af None None] MFA Rules not processed for user `8899f2134b41429d8d84c758c65c750e`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:11.742386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e5d72eb4-1837-44b0-a2c2-6830fc6ad1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:11.763046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-dbae0307-44eb-46ba-9062-4a5104a60c7c None None] MFA Rules not processed for user `2bea9921cd684a7bbec5994cfc1d5874`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:11.764697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dbae0307-44eb-46ba-9062-4a5104a60c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:11.825279 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3012/6047] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:11.831764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d72eb4-1837-44b0-a2c2-6830fc6ad1af None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:11.874530 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3036/6048] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:11.880094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae0307-44eb-46ba-9062-4a5104a60c7c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:11.912138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:11.923720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d72eb4-1837-44b0-a2c2-6830fc6ad1af None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:11.930521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f7d21-86a8-4896-a84f-c9dc8c674961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:11.931412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f7d21-86a8-4896-a84f-c9dc8c674961 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:11.931692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f7d21-86a8-4896-a84f-c9dc8c674961 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:11.931970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f7d21-86a8-4896-a84f-c9dc8c674961 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:11.932907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f7d21-86a8-4896-a84f-c9dc8c674961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:11.935934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f7d21-86a8-4896-a84f-c9dc8c674961 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:11.974969 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3013/6049] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:11 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:11.979112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f7d21-86a8-4896-a84f-c9dc8c674961 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:11.980579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae0307-44eb-46ba-9062-4a5104a60c7c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:12.022493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:12.057515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f7d21-86a8-4896-a84f-c9dc8c674961 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:12.063104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbbaa3-398e-4b47-b35a-eff921fd4faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:12.064542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbbaa3-398e-4b47-b35a-eff921fd4faf admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:12.065048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbbaa3-398e-4b47-b35a-eff921fd4faf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:12.065481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbbaa3-398e-4b47-b35a-eff921fd4faf admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:12.066382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbbaa3-398e-4b47-b35a-eff921fd4faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:12.069501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbbaa3-398e-4b47-b35a-eff921fd4faf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:12.115061 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3014/6050] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:11 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:12.118513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca230b3a-6b7f-4c1d-bfec-94f2327157d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:12.119016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbbaa3-398e-4b47-b35a-eff921fd4faf admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:12.119223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca230b3a-6b7f-4c1d-bfec-94f2327157d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:12.119502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca230b3a-6b7f-4c1d-bfec-94f2327157d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:12.119779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca230b3a-6b7f-4c1d-bfec-94f2327157d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:12.120977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca230b3a-6b7f-4c1d-bfec-94f2327157d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:12.123203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca230b3a-6b7f-4c1d-bfec-94f2327157d1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:12.132936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbbaa3-398e-4b47-b35a-eff921fd4faf admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:12.138846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854f546-564b-4a62-b0e1-784d20727eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:12.139753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854f546-564b-4a62-b0e1-784d20727eae admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:12.141038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854f546-564b-4a62-b0e1-784d20727eae admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:12.141244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854f546-564b-4a62-b0e1-784d20727eae admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:12.141971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854f546-564b-4a62-b0e1-784d20727eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:12.143656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854f546-564b-4a62-b0e1-784d20727eae admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:12.159498 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3037/6051] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:11 2022] POST /identity/v3/projects => generated 369 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:12.163251 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3015/6052] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:25:12.164616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854f546-564b-4a62-b0e1-784d20727eae admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:12.164756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca230b3a-6b7f-4c1d-bfec-94f2327157d1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:12.177548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854f546-564b-4a62-b0e1-784d20727eae admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:12.255038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c41a25-8431-43ec-9ec9-eeb4c56afd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:12.256198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c41a25-8431-43ec-9ec9-eeb4c56afd9b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:12.256543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c41a25-8431-43ec-9ec9-eeb4c56afd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:12.256838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c41a25-8431-43ec-9ec9-eeb4c56afd9b admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:12.258483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c41a25-8431-43ec-9ec9-eeb4c56afd9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:12.261864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c41a25-8431-43ec-9ec9-eeb4c56afd9b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:12.263449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca230b3a-6b7f-4c1d-bfec-94f2327157d1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:12.273985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fb45b-98e4-4d57-ba4e-645f78b2ad80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:12.275087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fb45b-98e4-4d57-ba4e-645f78b2ad80 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:12.275437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fb45b-98e4-4d57-ba4e-645f78b2ad80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:12.275836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fb45b-98e4-4d57-ba4e-645f78b2ad80 admin admin] PATH_INFO: `/v3/projects/25fea3f8b3964d87a5bbcba8104d77e1/users/9167065d5d1b4496a8af7b605c439fd1/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:12.298854 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3016/6053] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:12 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:12.302869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fb45b-98e4-4d57-ba4e-645f78b2ad80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25fea3f8b3964d87a5bbcba8104d77e1, user_id=9167065d5d1b4496a8af7b605c439fd1, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:12.304500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c41a25-8431-43ec-9ec9-eeb4c56afd9b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:12.305848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fb45b-98e4-4d57-ba4e-645f78b2ad80 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:12.320760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c41a25-8431-43ec-9ec9-eeb4c56afd9b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:12.323987 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3038/6054] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:12 2022] PUT /identity/v3/projects/25fea3f8b3964d87a5bbcba8104d77e1/users/9167065d5d1b4496a8af7b605c439fd1/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:12.327934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fb45b-98e4-4d57-ba4e-645f78b2ad80 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:12.367387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:12.406448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0ac6c-59b3-4994-b4ce-7cb4ace9f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:12.407158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0ac6c-59b3-4994-b4ce-7cb4ace9f039 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:12.407435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0ac6c-59b3-4994-b4ce-7cb4ace9f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:12.408894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0ac6c-59b3-4994-b4ce-7cb4ace9f039 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:12.408894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0ac6c-59b3-4994-b4ce-7cb4ace9f039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:12.410248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0ac6c-59b3-4994-b4ce-7cb4ace9f039 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:12.418831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fb45b-98e4-4d57-ba4e-645f78b2ad80 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:12.422127 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3017/6055] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:12.426572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0ac6c-59b3-4994-b4ce-7cb4ace9f039 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:12.427506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed4194-eceb-4b2d-9d1d-499cea91c98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:12.428224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed4194-eceb-4b2d-9d1d-499cea91c98d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:12.428513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed4194-eceb-4b2d-9d1d-499cea91c98d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:12.428789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed4194-eceb-4b2d-9d1d-499cea91c98d admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:12.429694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed4194-eceb-4b2d-9d1d-499cea91c98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:12.431269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed4194-eceb-4b2d-9d1d-499cea91c98d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:12.439002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0ac6c-59b3-4994-b4ce-7cb4ace9f039 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:12.442752 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3039/6056] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:12.444756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b5239-b969-4b5a-8651-32b29da19fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:12.445809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b5239-b969-4b5a-8651-32b29da19fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:12.446158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b5239-b969-4b5a-8651-32b29da19fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:12.446492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b5239-b969-4b5a-8651-32b29da19fb6 admin admin] PATH_INFO: `/v3/projects/a5fdaf14125641b3a5fe0d68bb33b56f/users/d49fd4bc2241473c947b115a38fc1d0d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:12.446894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed4194-eceb-4b2d-9d1d-499cea91c98d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:12.459289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed4194-eceb-4b2d-9d1d-499cea91c98d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:12.465775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d92632-ac0e-4ab4-b547-89912577fee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:12.465960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d92632-ac0e-4ab4-b547-89912577fee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:12.466255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d92632-ac0e-4ab4-b547-89912577fee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:12.466602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d92632-ac0e-4ab4-b547-89912577fee6 admin admin] PATH_INFO: `/v3/projects/25fea3f8b3964d87a5bbcba8104d77e1/users/9167065d5d1b4496a8af7b605c439fd1/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:12.471232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d92632-ac0e-4ab4-b547-89912577fee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25fea3f8b3964d87a5bbcba8104d77e1, user_id=9167065d5d1b4496a8af7b605c439fd1, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:12.474388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d92632-ac0e-4ab4-b547-89912577fee6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:12.494921 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3040/6057] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:12 2022] PUT /identity/v3/projects/25fea3f8b3964d87a5bbcba8104d77e1/users/9167065d5d1b4496a8af7b605c439fd1/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:12.496167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b5239-b969-4b5a-8651-32b29da19fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5fdaf14125641b3a5fe0d68bb33b56f, user_id=d49fd4bc2241473c947b115a38fc1d0d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:12.506381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243631b-38f2-47db-b755-183c7f411dea None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:12.506799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243631b-38f2-47db-b755-183c7f411dea None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:12.507145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243631b-38f2-47db-b755-183c7f411dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:12.521893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b5239-b969-4b5a-8651-32b29da19fb6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:12.546015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4243631b-38f2-47db-b755-183c7f411dea None None] MFA Rules not processed for user `9167065d5d1b4496a8af7b605c439fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:12.547519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4243631b-38f2-47db-b755-183c7f411dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:12.556983 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3018/6058] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:12 2022] PUT /identity/v3/projects/a5fdaf14125641b3a5fe0d68bb33b56f/users/d49fd4bc2241473c947b115a38fc1d0d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:12.560739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b5239-b969-4b5a-8651-32b29da19fb6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:12.596388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:12.677422 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3041/6059] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:12.692257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243631b-38f2-47db-b755-183c7f411dea None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:12.694460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4243631b-38f2-47db-b755-183c7f411dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:12.698627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b5239-b969-4b5a-8651-32b29da19fb6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:12.704724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70904eed-402a-4ebf-9091-e33c07118155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:12.705644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70904eed-402a-4ebf-9091-e33c07118155 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:12.705927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70904eed-402a-4ebf-9091-e33c07118155 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:12.706202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70904eed-402a-4ebf-9091-e33c07118155 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:12.707119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70904eed-402a-4ebf-9091-e33c07118155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:12.713485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70904eed-402a-4ebf-9091-e33c07118155 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:12.731768 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3019/6060] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:25:12.735992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70904eed-402a-4ebf-9091-e33c07118155 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:12.746914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70904eed-402a-4ebf-9091-e33c07118155 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:12.753042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57f938-945f-40c6-b61c-d5789a3b8a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:12.753959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57f938-945f-40c6-b61c-d5789a3b8a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:12.754240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57f938-945f-40c6-b61c-d5789a3b8a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:12.754515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57f938-945f-40c6-b61c-d5789a3b8a59 admin admin] PATH_INFO: `/v3/projects/a5fdaf14125641b3a5fe0d68bb33b56f/users/d49fd4bc2241473c947b115a38fc1d0d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:12.756883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57f938-945f-40c6-b61c-d5789a3b8a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5fdaf14125641b3a5fe0d68bb33b56f, user_id=d49fd4bc2241473c947b115a38fc1d0d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:12.759572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57f938-945f-40c6-b61c-d5789a3b8a59 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:12.772928 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3020/6061] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:12 2022] PUT /identity/v3/projects/a5fdaf14125641b3a5fe0d68bb33b56f/users/d49fd4bc2241473c947b115a38fc1d0d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:12.783786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241f506-d4ea-40ed-b5dd-4edbb8e1ed01 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:12.784535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241f506-d4ea-40ed-b5dd-4edbb8e1ed01 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:12.784943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241f506-d4ea-40ed-b5dd-4edbb8e1ed01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:12.804769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243631b-38f2-47db-b755-183c7f411dea None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:12.839496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-7241f506-d4ea-40ed-b5dd-4edbb8e1ed01 None None] MFA Rules not processed for user `d49fd4bc2241473c947b115a38fc1d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:12.840808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7241f506-d4ea-40ed-b5dd-4edbb8e1ed01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:12.874551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e83f4-07b3-43f4-9f9c-fd97b171cf5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:12.875385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e83f4-07b3-43f4-9f9c-fd97b171cf5e service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:12.876445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e83f4-07b3-43f4-9f9c-fd97b171cf5e service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:12.876994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e83f4-07b3-43f4-9f9c-fd97b171cf5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:12.888586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:12.929954 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3021/6062] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:12 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:12.943975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241f506-d4ea-40ed-b5dd-4edbb8e1ed01 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:12.946814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7241f506-d4ea-40ed-b5dd-4edbb8e1ed01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:12.986757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241f506-d4ea-40ed-b5dd-4edbb8e1ed01 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:12.991398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189da0c-8720-499f-9f77-34df5a21725b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:12.992099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189da0c-8720-499f-9f77-34df5a21725b service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:12.992433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189da0c-8720-499f-9f77-34df5a21725b service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:12.992663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189da0c-8720-499f-9f77-34df5a21725b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:13.015306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189da0c-8720-499f-9f77-34df5a21725b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:13.018074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189da0c-8720-499f-9f77-34df5a21725b service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:13.031918 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3022/6063] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:12 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:13.050428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e83f4-07b3-43f4-9f9c-fd97b171cf5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:13.056993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e83f4-07b3-43f4-9f9c-fd97b171cf5e service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:13.094786 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3042/6064] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:13.209227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189da0c-8720-499f-9f77-34df5a21725b service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:13.223515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189da0c-8720-499f-9f77-34df5a21725b service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:13.258492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdf80c-a90a-4524-af10-80ecafdff22e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:13.259299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdf80c-a90a-4524-af10-80ecafdff22e service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:13.259583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdf80c-a90a-4524-af10-80ecafdff22e service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:13.259852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdf80c-a90a-4524-af10-80ecafdff22e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:13.279666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e83f4-07b3-43f4-9f9c-fd97b171cf5e service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:13.295346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e83f4-07b3-43f4-9f9c-fd97b171cf5e service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:13.322733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3db76e-d1cc-4132-9f53-0e206e5491c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:13.323411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3db76e-d1cc-4132-9f53-0e206e5491c3 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:13.324369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3db76e-d1cc-4132-9f53-0e206e5491c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:13.324650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3db76e-d1cc-4132-9f53-0e206e5491c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:13.416882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fdf80c-a90a-4524-af10-80ecafdff22e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:13.426611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fdf80c-a90a-4524-af10-80ecafdff22e service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:13.459150 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3023/6065] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:25:13.467480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3db76e-d1cc-4132-9f53-0e206e5491c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:13.469220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3db76e-d1cc-4132-9f53-0e206e5491c3 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:13.481770 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3043/6066] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:25:15.486774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdf80c-a90a-4524-af10-80ecafdff22e service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:15.498083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:15.578140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdf80c-a90a-4524-af10-80ecafdff22e service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:15.584272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9976c56-d680-49c2-ae51-ce6eddd578ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:15.586045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9976c56-d680-49c2-ae51-ce6eddd578ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:15.586447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9976c56-d680-49c2-ae51-ce6eddd578ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:15.586821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9976c56-d680-49c2-ae51-ce6eddd578ab admin admin] PATH_INFO: `/v3/users/8899f2134b41429d8d84c758c65c750e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:15.588609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9976c56-d680-49c2-ae51-ce6eddd578ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=8899f2134b41429d8d84c758c65c750e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:15.591583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9976c56-d680-49c2-ae51-ce6eddd578ab admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:15.675303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e9976c56-d680-49c2-ae51-ce6eddd578ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8899f2134b41429d8d84c758c65c750e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:15.701218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e9976c56-d680-49c2-ae51-ce6eddd578ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8899f2134b41429d8d84c758c65c750e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:15.713920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e9976c56-d680-49c2-ae51-ce6eddd578ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8899f2134b41429d8d84c758c65c750e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:15.715211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e9976c56-d680-49c2-ae51-ce6eddd578ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8899f2134b41429d8d84c758c65c750e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:15.715850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e9976c56-d680-49c2-ae51-ce6eddd578ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8899f2134b41429d8d84c758c65c750e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:15.756750 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3024/6067] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:15 2022] DELETE /identity/v3/users/8899f2134b41429d8d84c758c65c750e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:15.761612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0560ee-2749-42d6-9a1d-db7e9ec43156 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:15.762109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0560ee-2749-42d6-9a1d-db7e9ec43156 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:15.762109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0560ee-2749-42d6-9a1d-db7e9ec43156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:15.800886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0e0560ee-2749-42d6-9a1d-db7e9ec43156 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:15.812957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0e0560ee-2749-42d6-9a1d-db7e9ec43156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:16.074558 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3044/6068] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:16.085550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9976c56-d680-49c2-ae51-ce6eddd578ab admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:16.087161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e9976c56-d680-49c2-ae51-ce6eddd578ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:16.204423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9976c56-d680-49c2-ae51-ce6eddd578ab admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:16.210039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70724e50-3f95-4193-ae26-10a854753421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:16.210947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70724e50-3f95-4193-ae26-10a854753421 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:16.211992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70724e50-3f95-4193-ae26-10a854753421 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:16.212499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70724e50-3f95-4193-ae26-10a854753421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:16.226692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70724e50-3f95-4193-ae26-10a854753421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:16.228740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70724e50-3f95-4193-ae26-10a854753421 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:16.240991 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3025/6069] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:16.723785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0560ee-2749-42d6-9a1d-db7e9ec43156 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:16.725366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0e0560ee-2749-42d6-9a1d-db7e9ec43156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:16.744679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0560ee-2749-42d6-9a1d-db7e9ec43156 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:16.765081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115ec5e-ad35-48cd-916f-af824588cfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:16.766210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115ec5e-ad35-48cd-916f-af824588cfa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:16.766639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115ec5e-ad35-48cd-916f-af824588cfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:16.766933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115ec5e-ad35-48cd-916f-af824588cfa5 admin admin] PATH_INFO: `/v3/projects/d924f1dd199749e1b8677dc1942d4a11` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:16.768903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115ec5e-ad35-48cd-916f-af824588cfa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d924f1dd199749e1b8677dc1942d4a11)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:16.771602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115ec5e-ad35-48cd-916f-af824588cfa5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:16.859134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:16.870260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0115ec5e-ad35-48cd-916f-af824588cfa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd924f1dd199749e1b8677dc1942d4a11', 'request_id': 'req-0115ec5e-ad35-48cd-916f-af824588cfa5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:16.897631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0115ec5e-ad35-48cd-916f-af824588cfa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd924f1dd199749e1b8677dc1942d4a11', 'request_id': 'req-0115ec5e-ad35-48cd-916f-af824588cfa5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:16.913683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0115ec5e-ad35-48cd-916f-af824588cfa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd924f1dd199749e1b8677dc1942d4a11', 'request_id': 'req-0115ec5e-ad35-48cd-916f-af824588cfa5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:16.926882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb70cb-c40b-4845-9dcf-927a95553df8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:16.927368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb70cb-c40b-4845-9dcf-927a95553df8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:16.927368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb70cb-c40b-4845-9dcf-927a95553df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:16.961294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0115ec5e-ad35-48cd-916f-af824588cfa5 admin admin] The token cache is being invalidate because project d924f1dd199749e1b8677dc1942d4a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:16.961600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0115ec5e-ad35-48cd-916f-af824588cfa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:16.963289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0115ec5e-ad35-48cd-916f-af824588cfa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:16.967981 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3045/6070] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:16 2022] DELETE /identity/v3/projects/d924f1dd199749e1b8677dc1942d4a11 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:16.972819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115ec5e-ad35-48cd-916f-af824588cfa5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:16.975453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3ceb70cb-c40b-4845-9dcf-927a95553df8 None None] MFA Rules not processed for user `e594a743b6424809abe3d22f930afd8b`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:16.976339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0115ec5e-ad35-48cd-916f-af824588cfa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:16.976512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3ceb70cb-c40b-4845-9dcf-927a95553df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:16.997357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:17.071805 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3026/6071] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:17.083346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a66987-8cd7-499e-9cc8-090b4995846c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:17.083692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a66987-8cd7-499e-9cc8-090b4995846c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:17.084032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a66987-8cd7-499e-9cc8-090b4995846c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:17.102342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115ec5e-ad35-48cd-916f-af824588cfa5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:17.105289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-10a66987-8cd7-499e-9cc8-090b4995846c None None] MFA Rules not processed for user `e594a743b6424809abe3d22f930afd8b`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:17.107064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-10a66987-8cd7-499e-9cc8-090b4995846c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:17.114623 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3027/6072] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:17.114956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499c499-08b3-481f-a859-a8172166a66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:17.116324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499c499-08b3-481f-a859-a8172166a66f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:17.116609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499c499-08b3-481f-a859-a8172166a66f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:17.116885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499c499-08b3-481f-a859-a8172166a66f admin admin] PATH_INFO: `/v3/users/9167065d5d1b4496a8af7b605c439fd1` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:17.118138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499c499-08b3-481f-a859-a8172166a66f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9167065d5d1b4496a8af7b605c439fd1)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:17.120561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499c499-08b3-481f-a859-a8172166a66f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:17.126835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a66987-8cd7-499e-9cc8-090b4995846c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:17.135084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-10a66987-8cd7-499e-9cc8-090b4995846c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:17.243574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2499c499-08b3-481f-a859-a8172166a66f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9167065d5d1b4496a8af7b605c439fd1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:17.264490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2499c499-08b3-481f-a859-a8172166a66f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9167065d5d1b4496a8af7b605c439fd1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:17.264490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2499c499-08b3-481f-a859-a8172166a66f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9167065d5d1b4496a8af7b605c439fd1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:17.265086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2499c499-08b3-481f-a859-a8172166a66f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9167065d5d1b4496a8af7b605c439fd1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:17.279502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2499c499-08b3-481f-a859-a8172166a66f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9167065d5d1b4496a8af7b605c439fd1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:17.303883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a66987-8cd7-499e-9cc8-090b4995846c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:17.313951 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3046/6073] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:16 2022] DELETE /identity/v3/users/9167065d5d1b4496a8af7b605c439fd1 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:17.319314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffa617-3631-47d7-aa81-3687a66f4c3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:17.320234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffa617-3631-47d7-aa81-3687a66f4c3c service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:17.320526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffa617-3631-47d7-aa81-3687a66f4c3c service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:17.320806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffa617-3631-47d7-aa81-3687a66f4c3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:17.323128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5dffa617-3631-47d7-aa81-3687a66f4c3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:17.355082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffa617-3631-47d7-aa81-3687a66f4c3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:17.357005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffa617-3631-47d7-aa81-3687a66f4c3c service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:17.374492 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3028/6074] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:17.749011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499c499-08b3-481f-a859-a8172166a66f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:17.750626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2499c499-08b3-481f-a859-a8172166a66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:17.867594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:17.905782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499c499-08b3-481f-a859-a8172166a66f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:17.915017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d860bf-6450-44e2-8d28-8d115d478c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:17.917473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d860bf-6450-44e2-8d28-8d115d478c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:17.939749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d860bf-6450-44e2-8d28-8d115d478c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:17.940502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d860bf-6450-44e2-8d28-8d115d478c3b admin admin] PATH_INFO: `/v3/projects/25fea3f8b3964d87a5bbcba8104d77e1` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:17.942943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d860bf-6450-44e2-8d28-8d115d478c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=25fea3f8b3964d87a5bbcba8104d77e1)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:17.945409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d860bf-6450-44e2-8d28-8d115d478c3b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:17.980603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffa617-3631-47d7-aa81-3687a66f4c3c service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:17.982290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5dffa617-3631-47d7-aa81-3687a66f4c3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:18.005925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffa617-3631-47d7-aa81-3687a66f4c3c service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:18.037442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-10d860bf-6450-44e2-8d28-8d115d478c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25fea3f8b3964d87a5bbcba8104d77e1', 'request_id': 'req-10d860bf-6450-44e2-8d28-8d115d478c3b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:18.056626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-10d860bf-6450-44e2-8d28-8d115d478c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25fea3f8b3964d87a5bbcba8104d77e1', 'request_id': 'req-10d860bf-6450-44e2-8d28-8d115d478c3b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:18.069657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-10d860bf-6450-44e2-8d28-8d115d478c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25fea3f8b3964d87a5bbcba8104d77e1', 'request_id': 'req-10d860bf-6450-44e2-8d28-8d115d478c3b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:18.094840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-10d860bf-6450-44e2-8d28-8d115d478c3b admin admin] The token cache is being invalidate because project 25fea3f8b3964d87a5bbcba8104d77e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:18.095141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-10d860bf-6450-44e2-8d28-8d115d478c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:18.099236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-10d860bf-6450-44e2-8d28-8d115d478c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:18.101286 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3047/6075] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:17 2022] DELETE /identity/v3/projects/25fea3f8b3964d87a5bbcba8104d77e1 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:18.107718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d29c69-6eca-49b4-85b0-69f7c92244ca None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:18.108314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d29c69-6eca-49b4-85b0-69f7c92244ca None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:18.108595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d29c69-6eca-49b4-85b0-69f7c92244ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:18.110465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66df07-ea94-45a3-9061-b5d88f366af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:18.111658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66df07-ea94-45a3-9061-b5d88f366af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:18.112183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66df07-ea94-45a3-9061-b5d88f366af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:18.112706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66df07-ea94-45a3-9061-b5d88f366af9 admin admin] PATH_INFO: `/v3/users/2bea9921cd684a7bbec5994cfc1d5874` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:18.114273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66df07-ea94-45a3-9061-b5d88f366af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bea9921cd684a7bbec5994cfc1d5874)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:18.116525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66df07-ea94-45a3-9061-b5d88f366af9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:18.132350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-30d29c69-6eca-49b4-85b0-69f7c92244ca None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:18.133605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-30d29c69-6eca-49b4-85b0-69f7c92244ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:18.153097 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3048/6076] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:18.154982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d5ba0-81dc-407d-9560-d78189dc53a0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:18.155619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d5ba0-81dc-407d-9560-d78189dc53a0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:18.155913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d5ba0-81dc-407d-9560-d78189dc53a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:18.189222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-573d5ba0-81dc-407d-9560-d78189dc53a0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:18.191195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-573d5ba0-81dc-407d-9560-d78189dc53a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:18.202162 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3049/6077] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:18.205748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:18.210731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c66df07-ea94-45a3-9061-b5d88f366af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bea9921cd684a7bbec5994cfc1d5874'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:18.216099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d5ba0-81dc-407d-9560-d78189dc53a0 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:18.223192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c66df07-ea94-45a3-9061-b5d88f366af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bea9921cd684a7bbec5994cfc1d5874'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:18.233868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d5ba0-81dc-407d-9560-d78189dc53a0 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:18.236199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c66df07-ea94-45a3-9061-b5d88f366af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bea9921cd684a7bbec5994cfc1d5874'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:18.237091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c66df07-ea94-45a3-9061-b5d88f366af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bea9921cd684a7bbec5994cfc1d5874'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:18.237718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c66df07-ea94-45a3-9061-b5d88f366af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bea9921cd684a7bbec5994cfc1d5874'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:18.241886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112aa48-1298-44a1-8d7e-9cb6fd96c765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:18.242661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112aa48-1298-44a1-8d7e-9cb6fd96c765 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:18.243079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112aa48-1298-44a1-8d7e-9cb6fd96c765 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:18.243418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112aa48-1298-44a1-8d7e-9cb6fd96c765 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:18.244467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112aa48-1298-44a1-8d7e-9cb6fd96c765 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:18.244858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112aa48-1298-44a1-8d7e-9cb6fd96c765 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:18.246596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112aa48-1298-44a1-8d7e-9cb6fd96c765 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:18.264870 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3029/6078] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:17 2022] DELETE /identity/v3/users/2bea9921cd684a7bbec5994cfc1d5874 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:18.266114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66df07-ea94-45a3-9061-b5d88f366af9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:18.267805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2c66df07-ea94-45a3-9061-b5d88f366af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:18.268373 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3050/6079] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:18.270179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d8c3a-9fad-493b-a325-42797210364f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:18.270511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d8c3a-9fad-493b-a325-42797210364f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:18.270794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d8c3a-9fad-493b-a325-42797210364f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:18.311543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4f0d8c3a-9fad-493b-a325-42797210364f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:18.312843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4f0d8c3a-9fad-493b-a325-42797210364f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:18.362687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66df07-ea94-45a3-9061-b5d88f366af9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:18.378992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c5222-ae2a-499d-a8d2-99f76317f609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:18.379690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c5222-ae2a-499d-a8d2-99f76317f609 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:18.379967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c5222-ae2a-499d-a8d2-99f76317f609 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:18.380490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c5222-ae2a-499d-a8d2-99f76317f609 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:18.381226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c5222-ae2a-499d-a8d2-99f76317f609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:18.385261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c5222-ae2a-499d-a8d2-99f76317f609 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:18.426486 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3030/6080] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:18 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:18.427106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c5222-ae2a-499d-a8d2-99f76317f609 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:18.442755 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3051/6081] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:18.456268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d8c3a-9fad-493b-a325-42797210364f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:18.457538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4f0d8c3a-9fad-493b-a325-42797210364f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:18.514707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c5222-ae2a-499d-a8d2-99f76317f609 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:18.534057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d8c3a-9fad-493b-a325-42797210364f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:18.535458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe653f80-a2ac-40e2-9972-02826bdef55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:18.536208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe653f80-a2ac-40e2-9972-02826bdef55a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:18.536759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe653f80-a2ac-40e2-9972-02826bdef55a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:18.537043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe653f80-a2ac-40e2-9972-02826bdef55a admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:18.537741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe653f80-a2ac-40e2-9972-02826bdef55a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:18.540006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe653f80-a2ac-40e2-9972-02826bdef55a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:18.541786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:18.578798 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3031/6082] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:18 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:18.583158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe653f80-a2ac-40e2-9972-02826bdef55a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:18.607298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe653f80-a2ac-40e2-9972-02826bdef55a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:18.614776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230ec2c-b7c5-463b-8b4e-f99907ccf88b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:18.615599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230ec2c-b7c5-463b-8b4e-f99907ccf88b service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:18.615890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230ec2c-b7c5-463b-8b4e-f99907ccf88b service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:18.616202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230ec2c-b7c5-463b-8b4e-f99907ccf88b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:18.622300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4d60a-03ca-458a-9d15-ceb931041f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:18.631126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4d60a-03ca-458a-9d15-ceb931041f02 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:18.631126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4d60a-03ca-458a-9d15-ceb931041f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:18.631126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4d60a-03ca-458a-9d15-ceb931041f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:18.631126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4d60a-03ca-458a-9d15-ceb931041f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:18.631126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4d60a-03ca-458a-9d15-ceb931041f02 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:18.634739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230ec2c-b7c5-463b-8b4e-f99907ccf88b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:18.639203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230ec2c-b7c5-463b-8b4e-f99907ccf88b service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:18.648465 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3032/6083] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:18.650256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4d60a-03ca-458a-9d15-ceb931041f02 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:18.655549 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3052/6084] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:18.664052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4d60a-03ca-458a-9d15-ceb931041f02 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:18.671036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2728a-4cea-443b-94dc-5e86d104da6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:18.671713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2728a-4cea-443b-94dc-5e86d104da6f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:18.671994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2728a-4cea-443b-94dc-5e86d104da6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:18.672342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2728a-4cea-443b-94dc-5e86d104da6f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:18.673177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2728a-4cea-443b-94dc-5e86d104da6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:18.675260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2728a-4cea-443b-94dc-5e86d104da6f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:18.700087 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3033/6085] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:18.702367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230ec2c-b7c5-463b-8b4e-f99907ccf88b service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:18.715117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230ec2c-b7c5-463b-8b4e-f99907ccf88b service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:18.726398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fac04-818e-4818-a83c-9ffa3fc67b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:18.727481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fac04-818e-4818-a83c-9ffa3fc67b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:18.727882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fac04-818e-4818-a83c-9ffa3fc67b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:18.728619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fac04-818e-4818-a83c-9ffa3fc67b6e admin admin] PATH_INFO: `/v3/projects/c9e5436faf904b3a87b044c14c41eb83/users/a0560fe15ebe478b880f09292e54433c/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:18.765537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fac04-818e-4818-a83c-9ffa3fc67b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e5436faf904b3a87b044c14c41eb83, user_id=a0560fe15ebe478b880f09292e54433c, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:18.770911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fac04-818e-4818-a83c-9ffa3fc67b6e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:18.804269 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3053/6086] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:18 2022] PUT /identity/v3/projects/c9e5436faf904b3a87b044c14c41eb83/users/a0560fe15ebe478b880f09292e54433c/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:18.818224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad7418-e65d-4b21-99ee-0ccb9e3455f5 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:18.818500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad7418-e65d-4b21-99ee-0ccb9e3455f5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:18.818788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad7418-e65d-4b21-99ee-0ccb9e3455f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:18.843554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c45db-ec10-40fb-9efb-e85857fb32d5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:18.844260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c45db-ec10-40fb-9efb-e85857fb32d5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:18.844584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c45db-ec10-40fb-9efb-e85857fb32d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:18.867024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:18.919572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a5ad7418-e65d-4b21-99ee-0ccb9e3455f5 None None] MFA Rules not processed for user `a0560fe15ebe478b880f09292e54433c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:18.921488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a5ad7418-e65d-4b21-99ee-0ccb9e3455f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:18.923862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a21c45db-ec10-40fb-9efb-e85857fb32d5 None None] MFA Rules not processed for user `e594a743b6424809abe3d22f930afd8b`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:18.925276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a21c45db-ec10-40fb-9efb-e85857fb32d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:19.073973 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3054/6087] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:19.086330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c45db-ec10-40fb-9efb-e85857fb32d5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:19.088525 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3034/6088] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:19.217008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad7418-e65d-4b21-99ee-0ccb9e3455f5 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:19.219592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a5ad7418-e65d-4b21-99ee-0ccb9e3455f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:19.247353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c45db-ec10-40fb-9efb-e85857fb32d5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:19.276905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f88027-fc51-42a1-9f7a-15b732d06fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:19.281987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f88027-fc51-42a1-9f7a-15b732d06fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:19.282663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f88027-fc51-42a1-9f7a-15b732d06fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:19.284764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f88027-fc51-42a1-9f7a-15b732d06fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:19.287308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f88027-fc51-42a1-9f7a-15b732d06fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:19.293706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f88027-fc51-42a1-9f7a-15b732d06fa8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:19.350316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad7418-e65d-4b21-99ee-0ccb9e3455f5 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:19.372551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020a127-3aad-410a-acab-867c2c0d0be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:19.373605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020a127-3aad-410a-acab-867c2c0d0be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:19.373903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020a127-3aad-410a-acab-867c2c0d0be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:19.374225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020a127-3aad-410a-acab-867c2c0d0be9 admin admin] PATH_INFO: `/v3/projects/e86a02c521614a29b2310b124d497e06` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:19.380017 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3055/6089] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:19 2022] POST /identity/v3/projects => generated 383 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:19.384502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f88027-fc51-42a1-9f7a-15b732d06fa8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:19.391710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020a127-3aad-410a-acab-867c2c0d0be9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e86a02c521614a29b2310b124d497e06)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:19.398947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020a127-3aad-410a-acab-867c2c0d0be9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:19.431419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:19.505908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f88027-fc51-42a1-9f7a-15b732d06fa8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:19.528225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8020a127-3aad-410a-acab-867c2c0d0be9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e86a02c521614a29b2310b124d497e06', 'request_id': 'req-8020a127-3aad-410a-acab-867c2c0d0be9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:19.538113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8020a127-3aad-410a-acab-867c2c0d0be9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e86a02c521614a29b2310b124d497e06', 'request_id': 'req-8020a127-3aad-410a-acab-867c2c0d0be9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:19.551514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8020a127-3aad-410a-acab-867c2c0d0be9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e86a02c521614a29b2310b124d497e06', 'request_id': 'req-8020a127-3aad-410a-acab-867c2c0d0be9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:19.571941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8020a127-3aad-410a-acab-867c2c0d0be9 admin admin] The token cache is being invalidate because project e86a02c521614a29b2310b124d497e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:19.573024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8020a127-3aad-410a-acab-867c2c0d0be9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:19.574206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8020a127-3aad-410a-acab-867c2c0d0be9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:19.580567 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3035/6090] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:19 2022] DELETE /identity/v3/projects/e86a02c521614a29b2310b124d497e06 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:19.584187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020a127-3aad-410a-acab-867c2c0d0be9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:19.588249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8020a127-3aad-410a-acab-867c2c0d0be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:19.597434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c46dc-b9a6-48bd-8a6f-c7502ff15a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:19.598278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c46dc-b9a6-48bd-8a6f-c7502ff15a23 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:19.601422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c46dc-b9a6-48bd-8a6f-c7502ff15a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:19.601720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c46dc-b9a6-48bd-8a6f-c7502ff15a23 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:19.602461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c46dc-b9a6-48bd-8a6f-c7502ff15a23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:19.607759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c46dc-b9a6-48bd-8a6f-c7502ff15a23 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:19.608731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020a127-3aad-410a-acab-867c2c0d0be9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:19.618177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae72fdd-67c5-47e2-810e-dba4062e5cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:19.619103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae72fdd-67c5-47e2-810e-dba4062e5cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:19.619350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae72fdd-67c5-47e2-810e-dba4062e5cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:19.619848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae72fdd-67c5-47e2-810e-dba4062e5cc0 admin admin] PATH_INFO: `/v3/users/d49fd4bc2241473c947b115a38fc1d0d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:19.621650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae72fdd-67c5-47e2-810e-dba4062e5cc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d49fd4bc2241473c947b115a38fc1d0d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:19.623682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae72fdd-67c5-47e2-810e-dba4062e5cc0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:19.654883 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3056/6091] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:19 2022] POST /identity/v3/users => generated 298 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:19.656485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c46dc-b9a6-48bd-8a6f-c7502ff15a23 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:19.660748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e96c46dc-b9a6-48bd-8a6f-c7502ff15a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:19.673045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:19.688701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c46dc-b9a6-48bd-8a6f-c7502ff15a23 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:19.707120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d6253-1771-443d-a922-fab7a328e1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:19.708070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6253-1771-443d-a922-fab7a328e1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:19.710548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6253-1771-443d-a922-fab7a328e1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:19.713093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6253-1771-443d-a922-fab7a328e1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:19.713906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d6253-1771-443d-a922-fab7a328e1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:19.715575 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d6253-1771-443d-a922-fab7a328e1b2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:19.728864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bae72fdd-67c5-47e2-810e-dba4062e5cc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd49fd4bc2241473c947b115a38fc1d0d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:19.751926 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3057/6092] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:19.753159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d6253-1771-443d-a922-fab7a328e1b2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:19.761262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bae72fdd-67c5-47e2-810e-dba4062e5cc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd49fd4bc2241473c947b115a38fc1d0d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:19.773100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d6253-1771-443d-a922-fab7a328e1b2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:19.773355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bae72fdd-67c5-47e2-810e-dba4062e5cc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd49fd4bc2241473c947b115a38fc1d0d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:19.774311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bae72fdd-67c5-47e2-810e-dba4062e5cc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd49fd4bc2241473c947b115a38fc1d0d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:19.775386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bae72fdd-67c5-47e2-810e-dba4062e5cc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd49fd4bc2241473c947b115a38fc1d0d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:19.788552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa9a2f-b46e-4afa-a23f-d5415d39c274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:19.789476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa9a2f-b46e-4afa-a23f-d5415d39c274 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:19.789751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa9a2f-b46e-4afa-a23f-d5415d39c274 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:19.790022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa9a2f-b46e-4afa-a23f-d5415d39c274 admin admin] PATH_INFO: `/v3/projects/c7016d4ee1b44145aa227ca684bfe1bf/users/381bec631f104d15ba0575e5058baa48/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:19.808171 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3036/6093] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:19 2022] DELETE /identity/v3/users/d49fd4bc2241473c947b115a38fc1d0d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:19.823324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa9a2f-b46e-4afa-a23f-d5415d39c274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7016d4ee1b44145aa227ca684bfe1bf, user_id=381bec631f104d15ba0575e5058baa48, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:19.826920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa9a2f-b46e-4afa-a23f-d5415d39c274 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:19.861735 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3058/6094] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:19 2022] PUT /identity/v3/projects/c7016d4ee1b44145aa227ca684bfe1bf/users/381bec631f104d15ba0575e5058baa48/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:19.865981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae72fdd-67c5-47e2-810e-dba4062e5cc0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:19.867613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bae72fdd-67c5-47e2-810e-dba4062e5cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:20.049658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae72fdd-67c5-47e2-810e-dba4062e5cc0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:20.179185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915dc95-6d10-48e1-9f97-f625aa1e138e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:20.179928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915dc95-6d10-48e1-9f97-f625aa1e138e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:20.180321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915dc95-6d10-48e1-9f97-f625aa1e138e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:20.181127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915dc95-6d10-48e1-9f97-f625aa1e138e admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:20.181716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915dc95-6d10-48e1-9f97-f625aa1e138e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:20.184535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915dc95-6d10-48e1-9f97-f625aa1e138e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:20.201861 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3037/6095] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:20.206079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa9a2f-b46e-4afa-a23f-d5415d39c274 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:20.235555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa9a2f-b46e-4afa-a23f-d5415d39c274 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:20.264927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4f279-108f-482b-b343-f4fd872666cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:20.266044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4f279-108f-482b-b343-f4fd872666cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:20.266422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4f279-108f-482b-b343-f4fd872666cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:20.266801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4f279-108f-482b-b343-f4fd872666cc admin admin] PATH_INFO: `/v3/projects/c7016d4ee1b44145aa227ca684bfe1bf/users/381bec631f104d15ba0575e5058baa48/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:20.271460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4f279-108f-482b-b343-f4fd872666cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7016d4ee1b44145aa227ca684bfe1bf, user_id=381bec631f104d15ba0575e5058baa48, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:20.274462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4f279-108f-482b-b343-f4fd872666cc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:20.340383 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3059/6096] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:20 2022] PUT /identity/v3/projects/c7016d4ee1b44145aa227ca684bfe1bf/users/381bec631f104d15ba0575e5058baa48/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:20.343385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f16bd-7443-44d5-a544-e087dd78d7ad None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:20.343599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f16bd-7443-44d5-a544-e087dd78d7ad None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:20.343882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f16bd-7443-44d5-a544-e087dd78d7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:20.407641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-741f16bd-7443-44d5-a544-e087dd78d7ad None None] MFA Rules not processed for user `381bec631f104d15ba0575e5058baa48`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:20.412380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-741f16bd-7443-44d5-a544-e087dd78d7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:20.548958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:20.657577 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3038/6097] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:20.679263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4f279-108f-482b-b343-f4fd872666cc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:20.685590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-40a4f279-108f-482b-b343-f4fd872666cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:20.912709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4f279-108f-482b-b343-f4fd872666cc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:20.918017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7e6e7-fd72-4758-815d-f0c7dbf04e82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:20.919048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7e6e7-fd72-4758-815d-f0c7dbf04e82 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:20.919570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7e6e7-fd72-4758-815d-f0c7dbf04e82 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:20.920231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7e6e7-fd72-4758-815d-f0c7dbf04e82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:20.922968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f5e7e6e7-fd72-4758-815d-f0c7dbf04e82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:20.978767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:21.012996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f16bd-7443-44d5-a544-e087dd78d7ad None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:21.015887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-741f16bd-7443-44d5-a544-e087dd78d7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:21.115992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7e6e7-fd72-4758-815d-f0c7dbf04e82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:21.118584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7e6e7-fd72-4758-815d-f0c7dbf04e82 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:21.131233 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3060/6098] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:21.208277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f16bd-7443-44d5-a544-e087dd78d7ad None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:21.213951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c98602-c614-4cc3-a70e-62a0f7fc2826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:21.214969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c98602-c614-4cc3-a70e-62a0f7fc2826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:21.215359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c98602-c614-4cc3-a70e-62a0f7fc2826 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:21.215893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c98602-c614-4cc3-a70e-62a0f7fc2826 admin admin] PATH_INFO: `/v3/projects/a5fdaf14125641b3a5fe0d68bb33b56f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:21.219380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c98602-c614-4cc3-a70e-62a0f7fc2826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5fdaf14125641b3a5fe0d68bb33b56f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:21.222892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c98602-c614-4cc3-a70e-62a0f7fc2826 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:21.364202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-54c98602-c614-4cc3-a70e-62a0f7fc2826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5fdaf14125641b3a5fe0d68bb33b56f', 'request_id': 'req-54c98602-c614-4cc3-a70e-62a0f7fc2826'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:21.384779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-54c98602-c614-4cc3-a70e-62a0f7fc2826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5fdaf14125641b3a5fe0d68bb33b56f', 'request_id': 'req-54c98602-c614-4cc3-a70e-62a0f7fc2826'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:21.417332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-54c98602-c614-4cc3-a70e-62a0f7fc2826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5fdaf14125641b3a5fe0d68bb33b56f', 'request_id': 'req-54c98602-c614-4cc3-a70e-62a0f7fc2826'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:21.431199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbd022-969b-46e9-a0cd-eecccfa88344 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:21.431750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbd022-969b-46e9-a0cd-eecccfa88344 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:21.431750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbd022-969b-46e9-a0cd-eecccfa88344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:21.446984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-54c98602-c614-4cc3-a70e-62a0f7fc2826 admin admin] The token cache is being invalidate because project a5fdaf14125641b3a5fe0d68bb33b56f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:21.447481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-54c98602-c614-4cc3-a70e-62a0f7fc2826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:21.449563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-54c98602-c614-4cc3-a70e-62a0f7fc2826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:21.456341 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3039/6099] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:21 2022] DELETE /identity/v3/projects/a5fdaf14125641b3a5fe0d68bb33b56f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:21.463004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32ebf5-e3a2-45bc-b7ea-36429d19fdc9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:21.463264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32ebf5-e3a2-45bc-b7ea-36429d19fdc9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:21.463536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32ebf5-e3a2-45bc-b7ea-36429d19fdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:21.473957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d6dbd022-969b-46e9-a0cd-eecccfa88344 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:21.475911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d6dbd022-969b-46e9-a0cd-eecccfa88344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:21.518981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2a32ebf5-e3a2-45bc-b7ea-36429d19fdc9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:21.520441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2a32ebf5-e3a2-45bc-b7ea-36429d19fdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:21.665030 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3061/6100] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:25:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:21.702918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbd022-969b-46e9-a0cd-eecccfa88344 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:21.704955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d6dbd022-969b-46e9-a0cd-eecccfa88344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:21.708336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:21.744364 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3040/6101] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:21.749446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb85d3-d5a7-4e2c-91b1-171b4ef4240f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:21.749702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb85d3-d5a7-4e2c-91b1-171b4ef4240f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:21.749882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb85d3-d5a7-4e2c-91b1-171b4ef4240f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:21.808866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-71eb85d3-d5a7-4e2c-91b1-171b4ef4240f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:21.810434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-71eb85d3-d5a7-4e2c-91b1-171b4ef4240f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:21.831353 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3041/6102] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:21.835972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb85d3-d5a7-4e2c-91b1-171b4ef4240f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:21.856127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb85d3-d5a7-4e2c-91b1-171b4ef4240f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:21.869760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6baf2-c2e3-4011-aa8c-0dcb72d285d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:21.870642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6baf2-c2e3-4011-aa8c-0dcb72d285d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:21.871089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6baf2-c2e3-4011-aa8c-0dcb72d285d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:21.871542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6baf2-c2e3-4011-aa8c-0dcb72d285d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:21.872763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6baf2-c2e3-4011-aa8c-0dcb72d285d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:21.875402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6baf2-c2e3-4011-aa8c-0dcb72d285d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:21.877851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6baf2-c2e3-4011-aa8c-0dcb72d285d7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:21.882471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbd022-969b-46e9-a0cd-eecccfa88344 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:21.898871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230bd67-b534-4747-a26b-1c7687cfe4fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:21.899548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230bd67-b534-4747-a26b-1c7687cfe4fc service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:21.899776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230bd67-b534-4747-a26b-1c7687cfe4fc service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:21.900068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230bd67-b534-4747-a26b-1c7687cfe4fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:21.924176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230bd67-b534-4747-a26b-1c7687cfe4fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:21.925727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230bd67-b534-4747-a26b-1c7687cfe4fc service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:21.948631 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3042/6103] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:21.962232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6baf2-c2e3-4011-aa8c-0dcb72d285d7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:21.968626 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3062/6104] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:25:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 02 21:25:22.012379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6baf2-c2e3-4011-aa8c-0dcb72d285d7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:22.065262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68a95b-ad10-4602-96b9-37afca5ec20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:22.068432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68a95b-ad10-4602-96b9-37afca5ec20e admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:22.072243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68a95b-ad10-4602-96b9-37afca5ec20e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:22.074224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68a95b-ad10-4602-96b9-37afca5ec20e admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:22.085261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68a95b-ad10-4602-96b9-37afca5ec20e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:22.107806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68a95b-ad10-4602-96b9-37afca5ec20e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:22.242396 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3043/6105] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:21 2022] POST /identity/v3/projects => generated 399 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:22.247298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230bd67-b534-4747-a26b-1c7687cfe4fc service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:22.268186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230bd67-b534-4747-a26b-1c7687cfe4fc service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:22.499296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:22.536033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f189c-788f-4ea1-a6fe-c86f29ee3ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:22.536767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f189c-788f-4ea1-a6fe-c86f29ee3ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:22.537038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f189c-788f-4ea1-a6fe-c86f29ee3ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:22.537317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f189c-788f-4ea1-a6fe-c86f29ee3ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:22.543356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f189c-788f-4ea1-a6fe-c86f29ee3ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:22.545422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f189c-788f-4ea1-a6fe-c86f29ee3ef7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:22.610253 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3063/6106] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:22 2022] POST /identity/v3/users => generated 300 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:22.614310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68a95b-ad10-4602-96b9-37afca5ec20e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:22.641624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68a95b-ad10-4602-96b9-37afca5ec20e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:22.662195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e3135-2fef-4c0b-b0a9-153fd4a1ed09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:22.666214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e3135-2fef-4c0b-b0a9-153fd4a1ed09 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:22.666752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e3135-2fef-4c0b-b0a9-153fd4a1ed09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:22.667373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e3135-2fef-4c0b-b0a9-153fd4a1ed09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:22.668871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e3135-2fef-4c0b-b0a9-153fd4a1ed09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:22.671775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e3135-2fef-4c0b-b0a9-153fd4a1ed09 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:22.702584 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3044/6107] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:22.705493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f189c-788f-4ea1-a6fe-c86f29ee3ef7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:22.721927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f189c-788f-4ea1-a6fe-c86f29ee3ef7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:22.728968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e933be-1a6f-4289-923c-277841f7bcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:22.729688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e933be-1a6f-4289-923c-277841f7bcac admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:22.729957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e933be-1a6f-4289-923c-277841f7bcac admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:22.731272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e933be-1a6f-4289-923c-277841f7bcac admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:22.732180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e933be-1a6f-4289-923c-277841f7bcac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:22.734859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e933be-1a6f-4289-923c-277841f7bcac admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:22.759742 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3064/6108] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:22.763894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e3135-2fef-4c0b-b0a9-153fd4a1ed09 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:22.784974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e3135-2fef-4c0b-b0a9-153fd4a1ed09 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:22.803904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc088d00-23a0-44d4-8e88-749e510c9a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:22.803904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc088d00-23a0-44d4-8e88-749e510c9a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:22.803904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc088d00-23a0-44d4-8e88-749e510c9a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:22.804451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc088d00-23a0-44d4-8e88-749e510c9a1a admin admin] PATH_INFO: `/v3/projects/71a364f769f9465281e4bdec775d7cb7/users/b54c0455f81d49db8c796802ecff3c7a/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:22.881605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc088d00-23a0-44d4-8e88-749e510c9a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a364f769f9465281e4bdec775d7cb7, user_id=b54c0455f81d49db8c796802ecff3c7a, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:22.884394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc088d00-23a0-44d4-8e88-749e510c9a1a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:22.936895 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3045/6109] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:22 2022] PUT /identity/v3/projects/71a364f769f9465281e4bdec775d7cb7/users/b54c0455f81d49db8c796802ecff3c7a/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:22.951715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c985c11-7f14-450a-b29e-912e9cf37d8e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:22.952709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c985c11-7f14-450a-b29e-912e9cf37d8e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:22.953364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c985c11-7f14-450a-b29e-912e9cf37d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:22.997474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6c985c11-7f14-450a-b29e-912e9cf37d8e None None] MFA Rules not processed for user `b54c0455f81d49db8c796802ecff3c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:23.000832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6c985c11-7f14-450a-b29e-912e9cf37d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:23.294676 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3065/6110] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:23.296993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc088d00-23a0-44d4-8e88-749e510c9a1a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:23.537035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc088d00-23a0-44d4-8e88-749e510c9a1a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:23.565749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a4ec5-8084-41d1-bad6-77b9794e13a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:23.566557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a4ec5-8084-41d1-bad6-77b9794e13a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:23.566716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a4ec5-8084-41d1-bad6-77b9794e13a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:23.566997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a4ec5-8084-41d1-bad6-77b9794e13a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:23.572664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a4ec5-8084-41d1-bad6-77b9794e13a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:23.580955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a4ec5-8084-41d1-bad6-77b9794e13a5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:23.701588 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3046/6111] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:23 2022] POST /identity/v3/projects => generated 399 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:23.706086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c985c11-7f14-450a-b29e-912e9cf37d8e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:23.744183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c985c11-7f14-450a-b29e-912e9cf37d8e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:23.998476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b8ea9-0228-4a7e-a519-1794891b5489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:24.000065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b8ea9-0228-4a7e-a519-1794891b5489 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:24.001154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b8ea9-0228-4a7e-a519-1794891b5489 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:24.001672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b8ea9-0228-4a7e-a519-1794891b5489 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:24.002705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b8ea9-0228-4a7e-a519-1794891b5489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:24.005511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b8ea9-0228-4a7e-a519-1794891b5489 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:24.061349 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3066/6112] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:23 2022] POST /identity/v3/users => generated 306 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:24.066431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a4ec5-8084-41d1-bad6-77b9794e13a5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:24.108184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a4ec5-8084-41d1-bad6-77b9794e13a5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:24.123209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef93cb9-8a32-4d38-ae1a-8aeb470ec556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:24.133183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef93cb9-8a32-4d38-ae1a-8aeb470ec556 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:24.134366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef93cb9-8a32-4d38-ae1a-8aeb470ec556 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:24.136862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef93cb9-8a32-4d38-ae1a-8aeb470ec556 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:24.138126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef93cb9-8a32-4d38-ae1a-8aeb470ec556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:24.139955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef93cb9-8a32-4d38-ae1a-8aeb470ec556 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:24.198540 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3047/6113] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:24.203108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b8ea9-0228-4a7e-a519-1794891b5489 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:24.214230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b8ea9-0228-4a7e-a519-1794891b5489 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:24.235404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef6bdd-1544-4462-a10f-b24b525d71e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:24.236352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef6bdd-1544-4462-a10f-b24b525d71e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:24.251883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef6bdd-1544-4462-a10f-b24b525d71e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:24.252268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef6bdd-1544-4462-a10f-b24b525d71e0 admin admin] PATH_INFO: `/v3/projects/d1218fdcad734e61b3a66cabf8ace2ab/users/e5352ddc52cf4beeba6f06ab091e8330/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:24.317424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef6bdd-1544-4462-a10f-b24b525d71e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1218fdcad734e61b3a66cabf8ace2ab, user_id=e5352ddc52cf4beeba6f06ab091e8330, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:24.321670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef6bdd-1544-4462-a10f-b24b525d71e0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:24.367717 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3067/6114] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:24 2022] PUT /identity/v3/projects/d1218fdcad734e61b3a66cabf8ace2ab/users/e5352ddc52cf4beeba6f06ab091e8330/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:24.372194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef93cb9-8a32-4d38-ae1a-8aeb470ec556 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:24.404428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef93cb9-8a32-4d38-ae1a-8aeb470ec556 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:24.575497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:24.590863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15df9c4-f705-48a1-9af9-90e6e19be85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:24.593451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15df9c4-f705-48a1-9af9-90e6e19be85c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:24.594763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15df9c4-f705-48a1-9af9-90e6e19be85c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:24.595209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15df9c4-f705-48a1-9af9-90e6e19be85c admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:24.597910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15df9c4-f705-48a1-9af9-90e6e19be85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:24.599755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15df9c4-f705-48a1-9af9-90e6e19be85c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:24.657786 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3048/6115] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:24.659296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef6bdd-1544-4462-a10f-b24b525d71e0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:24.700579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef6bdd-1544-4462-a10f-b24b525d71e0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:24.715398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b014b28-aced-4b8f-ad33-37fdc20fe620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:24.716476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014b28-aced-4b8f-ad33-37fdc20fe620 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:24.717113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014b28-aced-4b8f-ad33-37fdc20fe620 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:24.717481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b014b28-aced-4b8f-ad33-37fdc20fe620 admin admin] PATH_INFO: `/v3/projects/d1218fdcad734e61b3a66cabf8ace2ab/users/e5352ddc52cf4beeba6f06ab091e8330/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:24.724754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b014b28-aced-4b8f-ad33-37fdc20fe620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1218fdcad734e61b3a66cabf8ace2ab, user_id=e5352ddc52cf4beeba6f06ab091e8330, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:24.727611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b014b28-aced-4b8f-ad33-37fdc20fe620 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:24.761038 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3068/6116] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:24 2022] PUT /identity/v3/projects/d1218fdcad734e61b3a66cabf8ace2ab/users/e5352ddc52cf4beeba6f06ab091e8330/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:24.777556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b9c80-f0e3-4fdf-9550-fcb8c96a7aea None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:24.777912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b9c80-f0e3-4fdf-9550-fcb8c96a7aea None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:24.778255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b9c80-f0e3-4fdf-9550-fcb8c96a7aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:24.845134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-7c3b9c80-f0e3-4fdf-9550-fcb8c96a7aea None None] MFA Rules not processed for user `e5352ddc52cf4beeba6f06ab091e8330`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:24.858497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7c3b9c80-f0e3-4fdf-9550-fcb8c96a7aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:25.031436 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3049/6117] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:24 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:25.040364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b014b28-aced-4b8f-ad33-37fdc20fe620 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:25.042285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7b014b28-aced-4b8f-ad33-37fdc20fe620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:25.098448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:25.202569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b014b28-aced-4b8f-ad33-37fdc20fe620 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:25.217457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d74a45-f061-4ae5-9015-1127c5067e3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:25.218280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d74a45-f061-4ae5-9015-1127c5067e3b service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:25.218570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d74a45-f061-4ae5-9015-1127c5067e3b service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:25.219199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d74a45-f061-4ae5-9015-1127c5067e3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:25.253521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d74a45-f061-4ae5-9015-1127c5067e3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:25.254941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d74a45-f061-4ae5-9015-1127c5067e3b service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:25.278695 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3069/6118] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:25 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:25.765574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b9c80-f0e3-4fdf-9550-fcb8c96a7aea None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:25.767200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7c3b9c80-f0e3-4fdf-9550-fcb8c96a7aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:25.821178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b9c80-f0e3-4fdf-9550-fcb8c96a7aea None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:25.838270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb3cf1-3135-4547-ac05-7e4e48e67cc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:25.840547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb3cf1-3135-4547-ac05-7e4e48e67cc2 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:25.841035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb3cf1-3135-4547-ac05-7e4e48e67cc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:25.841635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb3cf1-3135-4547-ac05-7e4e48e67cc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:26.020623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb3cf1-3135-4547-ac05-7e4e48e67cc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:26.022098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb3cf1-3135-4547-ac05-7e4e48e67cc2 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:26.042166 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3050/6119] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:26.283295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d74a45-f061-4ae5-9015-1127c5067e3b service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:26.286007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-67d74a45-f061-4ae5-9015-1127c5067e3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:26.441788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d74a45-f061-4ae5-9015-1127c5067e3b service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:26.452336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6eb054-7287-4ec2-9183-1136d7c0ae31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:26.453663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6eb054-7287-4ec2-9183-1136d7c0ae31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:26.454642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6eb054-7287-4ec2-9183-1136d7c0ae31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:26.456112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6eb054-7287-4ec2-9183-1136d7c0ae31 admin admin] PATH_INFO: `/v3/users/a0560fe15ebe478b880f09292e54433c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:26.461478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6eb054-7287-4ec2-9183-1136d7c0ae31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0560fe15ebe478b880f09292e54433c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:26.464133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6eb054-7287-4ec2-9183-1136d7c0ae31 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:26.625731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1f6eb054-7287-4ec2-9183-1136d7c0ae31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0560fe15ebe478b880f09292e54433c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:26.657178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1f6eb054-7287-4ec2-9183-1136d7c0ae31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0560fe15ebe478b880f09292e54433c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:26.658802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1f6eb054-7287-4ec2-9183-1136d7c0ae31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0560fe15ebe478b880f09292e54433c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:26.660216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1f6eb054-7287-4ec2-9183-1136d7c0ae31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0560fe15ebe478b880f09292e54433c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:26.683027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1f6eb054-7287-4ec2-9183-1136d7c0ae31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0560fe15ebe478b880f09292e54433c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:26.755209 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3070/6120] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:26 2022] DELETE /identity/v3/users/a0560fe15ebe478b880f09292e54433c => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:26.763193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4281373-5a58-49d1-9313-c80eeda1ccca None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:26.768402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4281373-5a58-49d1-9313-c80eeda1ccca None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:26.769161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4281373-5a58-49d1-9313-c80eeda1ccca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:26.807252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b4281373-5a58-49d1-9313-c80eeda1ccca None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:26.808624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b4281373-5a58-49d1-9313-c80eeda1ccca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:26.901063 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3051/6121] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:26.911056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6eb054-7287-4ec2-9183-1136d7c0ae31 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:26.913383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1f6eb054-7287-4ec2-9183-1136d7c0ae31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:27.015307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:27.032713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4281373-5a58-49d1-9313-c80eeda1ccca None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:27.034249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b4281373-5a58-49d1-9313-c80eeda1ccca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:27.053700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4281373-5a58-49d1-9313-c80eeda1ccca None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:27.058451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556ff7a-c4b8-497b-b0e8-c81f28c1d2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:27.059345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556ff7a-c4b8-497b-b0e8-c81f28c1d2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:27.059635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556ff7a-c4b8-497b-b0e8-c81f28c1d2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:27.059930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556ff7a-c4b8-497b-b0e8-c81f28c1d2fc admin admin] PATH_INFO: `/v3/users/8fb8295b4af942d2be5d0cdb0a822868` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:27.061725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556ff7a-c4b8-497b-b0e8-c81f28c1d2fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fb8295b4af942d2be5d0cdb0a822868)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:27.063940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556ff7a-c4b8-497b-b0e8-c81f28c1d2fc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:27.067497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6eb054-7287-4ec2-9183-1136d7c0ae31 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:27.082312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03808add-6eaf-4a72-91b4-904dae470fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:27.083555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03808add-6eaf-4a72-91b4-904dae470fde service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:27.084114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03808add-6eaf-4a72-91b4-904dae470fde service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:27.084631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03808add-6eaf-4a72-91b4-904dae470fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:27.089955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:27.109929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03808add-6eaf-4a72-91b4-904dae470fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:27.113376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03808add-6eaf-4a72-91b4-904dae470fde service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:27.139987 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3071/6122] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:27.166036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2556ff7a-c4b8-497b-b0e8-c81f28c1d2fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fb8295b4af942d2be5d0cdb0a822868'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:27.194949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2556ff7a-c4b8-497b-b0e8-c81f28c1d2fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fb8295b4af942d2be5d0cdb0a822868'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:27.229003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2556ff7a-c4b8-497b-b0e8-c81f28c1d2fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fb8295b4af942d2be5d0cdb0a822868'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:27.235198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2556ff7a-c4b8-497b-b0e8-c81f28c1d2fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fb8295b4af942d2be5d0cdb0a822868'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:27.238066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2556ff7a-c4b8-497b-b0e8-c81f28c1d2fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fb8295b4af942d2be5d0cdb0a822868'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:27.274248 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3052/6123] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:27 2022] DELETE /identity/v3/users/8fb8295b4af942d2be5d0cdb0a822868 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:27.579456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03808add-6eaf-4a72-91b4-904dae470fde service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:27.606402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03808add-6eaf-4a72-91b4-904dae470fde service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:27.665897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556ff7a-c4b8-497b-b0e8-c81f28c1d2fc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:27.667775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2556ff7a-c4b8-497b-b0e8-c81f28c1d2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:27.758802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a1064-23f9-483d-b0e4-0a911c9690c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:27.759698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a1064-23f9-483d-b0e4-0a911c9690c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:27.759982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a1064-23f9-483d-b0e4-0a911c9690c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:27.760306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a1064-23f9-483d-b0e4-0a911c9690c4 admin admin] PATH_INFO: `/v3/projects/76e7f008cdf342038f77463635293405` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:27.761682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a1064-23f9-483d-b0e4-0a911c9690c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e7f008cdf342038f77463635293405)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:27.764122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a1064-23f9-483d-b0e4-0a911c9690c4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:27.861484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-777a1064-23f9-483d-b0e4-0a911c9690c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e7f008cdf342038f77463635293405', 'request_id': 'req-777a1064-23f9-483d-b0e4-0a911c9690c4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:27.878527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-777a1064-23f9-483d-b0e4-0a911c9690c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e7f008cdf342038f77463635293405', 'request_id': 'req-777a1064-23f9-483d-b0e4-0a911c9690c4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:27.889790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-777a1064-23f9-483d-b0e4-0a911c9690c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e7f008cdf342038f77463635293405', 'request_id': 'req-777a1064-23f9-483d-b0e4-0a911c9690c4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:27.912552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-777a1064-23f9-483d-b0e4-0a911c9690c4 admin admin] The token cache is being invalidate because project 76e7f008cdf342038f77463635293405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:27.913044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-777a1064-23f9-483d-b0e4-0a911c9690c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:27.914037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-777a1064-23f9-483d-b0e4-0a911c9690c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:27.919068 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3072/6124] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:27 2022] DELETE /identity/v3/projects/76e7f008cdf342038f77463635293405 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:27.929775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22c4a4-103b-43fa-bd50-eb0b02420b1d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:27.930232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22c4a4-103b-43fa-bd50-eb0b02420b1d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:27.930670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22c4a4-103b-43fa-bd50-eb0b02420b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:27.974340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556ff7a-c4b8-497b-b0e8-c81f28c1d2fc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:27.977615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6e22c4a4-103b-43fa-bd50-eb0b02420b1d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:27.980182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6e22c4a4-103b-43fa-bd50-eb0b02420b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:28.180591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67caeaf-8040-40f3-b487-450c8144092c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:28.184003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67caeaf-8040-40f3-b487-450c8144092c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:28.188086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67caeaf-8040-40f3-b487-450c8144092c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:28.188355 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3073/6125] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:28.194932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67caeaf-8040-40f3-b487-450c8144092c admin admin] PATH_INFO: `/v3/projects/c9e5436faf904b3a87b044c14c41eb83` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:28.195185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627c0e6-cf0f-4274-acd0-9fa3a786a27d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:28.195185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627c0e6-cf0f-4274-acd0-9fa3a786a27d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:28.195621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627c0e6-cf0f-4274-acd0-9fa3a786a27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:28.201248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67caeaf-8040-40f3-b487-450c8144092c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e5436faf904b3a87b044c14c41eb83)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:28.208725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67caeaf-8040-40f3-b487-450c8144092c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:28.268070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3627c0e6-cf0f-4274-acd0-9fa3a786a27d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:28.269413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3627c0e6-cf0f-4274-acd0-9fa3a786a27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:28.295409 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3074/6126] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:28.301175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627c0e6-cf0f-4274-acd0-9fa3a786a27d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:28.302378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:28.310975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:28.316191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b67caeaf-8040-40f3-b487-450c8144092c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e5436faf904b3a87b044c14c41eb83', 'request_id': 'req-b67caeaf-8040-40f3-b487-450c8144092c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:28.321508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627c0e6-cf0f-4274-acd0-9fa3a786a27d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:28.331175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b67caeaf-8040-40f3-b487-450c8144092c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e5436faf904b3a87b044c14c41eb83', 'request_id': 'req-b67caeaf-8040-40f3-b487-450c8144092c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:28.362527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b67caeaf-8040-40f3-b487-450c8144092c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e5436faf904b3a87b044c14c41eb83', 'request_id': 'req-b67caeaf-8040-40f3-b487-450c8144092c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:28.409532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b67caeaf-8040-40f3-b487-450c8144092c admin admin] The token cache is being invalidate because project c9e5436faf904b3a87b044c14c41eb83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:28.409821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b67caeaf-8040-40f3-b487-450c8144092c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:28.412662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b67caeaf-8040-40f3-b487-450c8144092c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:28.415948 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3053/6127] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:27 2022] DELETE /identity/v3/projects/c9e5436faf904b3a87b044c14c41eb83 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:28.423332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67caeaf-8040-40f3-b487-450c8144092c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:28.431493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b67caeaf-8040-40f3-b487-450c8144092c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:28.515909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d136a09-0763-4d07-919f-31b8e6a02a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:28.516679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d136a09-0763-4d07-919f-31b8e6a02a16 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:28.516962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d136a09-0763-4d07-919f-31b8e6a02a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:28.517240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d136a09-0763-4d07-919f-31b8e6a02a16 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:28.520094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d136a09-0763-4d07-919f-31b8e6a02a16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:28.520435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d136a09-0763-4d07-919f-31b8e6a02a16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:28.522093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d136a09-0763-4d07-919f-31b8e6a02a16 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:28.556186 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3075/6128] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:28.557674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d136a09-0763-4d07-919f-31b8e6a02a16 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:28.559421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3d136a09-0763-4d07-919f-31b8e6a02a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:28.592593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d136a09-0763-4d07-919f-31b8e6a02a16 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:28.607157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e9480-2d8a-4733-86fb-4b98ed018d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:28.611736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e9480-2d8a-4733-86fb-4b98ed018d1d admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:28.612016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e9480-2d8a-4733-86fb-4b98ed018d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:28.612321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e9480-2d8a-4733-86fb-4b98ed018d1d admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:28.613077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e9480-2d8a-4733-86fb-4b98ed018d1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:28.619217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67caeaf-8040-40f3-b487-450c8144092c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:28.631834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e9480-2d8a-4733-86fb-4b98ed018d1d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:28.647653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1803b2-a957-43da-8408-28a7404dc20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:28.648877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1803b2-a957-43da-8408-28a7404dc20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:28.649239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1803b2-a957-43da-8408-28a7404dc20d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:28.649612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1803b2-a957-43da-8408-28a7404dc20d admin admin] PATH_INFO: `/v3/users/381bec631f104d15ba0575e5058baa48` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:28.652564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1803b2-a957-43da-8408-28a7404dc20d admin admin] RBAC: Authorizing `identity:delete_user(user_id=381bec631f104d15ba0575e5058baa48)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:28.654756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1803b2-a957-43da-8408-28a7404dc20d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:28.679707 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3076/6129] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:28 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:28.680426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e9480-2d8a-4733-86fb-4b98ed018d1d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:28.682569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e56e9480-2d8a-4733-86fb-4b98ed018d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:28.745172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8b1803b2-a957-43da-8408-28a7404dc20d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381bec631f104d15ba0575e5058baa48'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:28.758160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8b1803b2-a957-43da-8408-28a7404dc20d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381bec631f104d15ba0575e5058baa48'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:28.768237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8b1803b2-a957-43da-8408-28a7404dc20d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381bec631f104d15ba0575e5058baa48'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:28.769095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8b1803b2-a957-43da-8408-28a7404dc20d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381bec631f104d15ba0575e5058baa48'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:28.770239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8b1803b2-a957-43da-8408-28a7404dc20d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381bec631f104d15ba0575e5058baa48'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:28.796867 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3054/6130] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:28 2022] DELETE /identity/v3/users/381bec631f104d15ba0575e5058baa48 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:28.796867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1803b2-a957-43da-8408-28a7404dc20d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:28.798414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8b1803b2-a957-43da-8408-28a7404dc20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:28.830616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e9480-2d8a-4733-86fb-4b98ed018d1d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:28.898865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:28.951828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1803b2-a957-43da-8408-28a7404dc20d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:28.964256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b10ef-fe16-4769-91f6-8195134bc492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:28.965099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd392bbf-a29c-4352-a3b3-2bbbc5adbd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:28.965805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd392bbf-a29c-4352-a3b3-2bbbc5adbd5b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:28.966089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd392bbf-a29c-4352-a3b3-2bbbc5adbd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:28.966367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd392bbf-a29c-4352-a3b3-2bbbc5adbd5b admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:28.966551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b10ef-fe16-4769-91f6-8195134bc492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:28.967178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b10ef-fe16-4769-91f6-8195134bc492 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:28.967615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b10ef-fe16-4769-91f6-8195134bc492 admin admin] PATH_INFO: `/v3/users/b54c0455f81d49db8c796802ecff3c7a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:28.969379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b10ef-fe16-4769-91f6-8195134bc492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b54c0455f81d49db8c796802ecff3c7a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:28.969715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd392bbf-a29c-4352-a3b3-2bbbc5adbd5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:28.972665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b10ef-fe16-4769-91f6-8195134bc492 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:28.984103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd392bbf-a29c-4352-a3b3-2bbbc5adbd5b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:29.034713 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3055/6131] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:28 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:29.041605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd392bbf-a29c-4352-a3b3-2bbbc5adbd5b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:29.063402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:29.068898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd392bbf-a29c-4352-a3b3-2bbbc5adbd5b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:29.094081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e69229-fc1b-4cef-82c7-92013af0dbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:29.104378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e69229-fc1b-4cef-82c7-92013af0dbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:29.104927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e69229-fc1b-4cef-82c7-92013af0dbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:29.106341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e69229-fc1b-4cef-82c7-92013af0dbf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:29.108426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e69229-fc1b-4cef-82c7-92013af0dbf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:29.114942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e69229-fc1b-4cef-82c7-92013af0dbf9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:29.128339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f43b10ef-fe16-4769-91f6-8195134bc492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b54c0455f81d49db8c796802ecff3c7a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:29.150677 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3056/6132] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:29.154744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e69229-fc1b-4cef-82c7-92013af0dbf9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:29.159385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f43b10ef-fe16-4769-91f6-8195134bc492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b54c0455f81d49db8c796802ecff3c7a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:29.160333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f43b10ef-fe16-4769-91f6-8195134bc492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b54c0455f81d49db8c796802ecff3c7a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:29.161190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f43b10ef-fe16-4769-91f6-8195134bc492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b54c0455f81d49db8c796802ecff3c7a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:29.172790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f43b10ef-fe16-4769-91f6-8195134bc492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b54c0455f81d49db8c796802ecff3c7a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:29.196718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e69229-fc1b-4cef-82c7-92013af0dbf9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:29.209454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb49b9-147b-4ac7-9ff5-31ac0decb983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:29.210154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb49b9-147b-4ac7-9ff5-31ac0decb983 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:29.212668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb49b9-147b-4ac7-9ff5-31ac0decb983 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:29.212955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb49b9-147b-4ac7-9ff5-31ac0decb983 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:29.213704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb49b9-147b-4ac7-9ff5-31ac0decb983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:29.217749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb49b9-147b-4ac7-9ff5-31ac0decb983 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:29.267586 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3057/6133] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:29.270870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb49b9-147b-4ac7-9ff5-31ac0decb983 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:29.271370 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3077/6134] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:28 2022] DELETE /identity/v3/users/b54c0455f81d49db8c796802ecff3c7a => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:29.276602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8ebb49b9-147b-4ac7-9ff5-31ac0decb983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:29.279014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0237c1c-b3e9-4d0b-bad8-f514407475b5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:29.279306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0237c1c-b3e9-4d0b-bad8-f514407475b5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:29.279582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0237c1c-b3e9-4d0b-bad8-f514407475b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:29.323128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb49b9-147b-4ac7-9ff5-31ac0decb983 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:29.337001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e0237c1c-b3e9-4d0b-bad8-f514407475b5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:29.338247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e0237c1c-b3e9-4d0b-bad8-f514407475b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:29.508079 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3078/6135] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:29.533561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0237c1c-b3e9-4d0b-bad8-f514407475b5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:29.534997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e0237c1c-b3e9-4d0b-bad8-f514407475b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:29.565745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17745c80-1722-48ab-8176-dbe087c58935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:29.567015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17745c80-1722-48ab-8176-dbe087c58935 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:29.567293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17745c80-1722-48ab-8176-dbe087c58935 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:29.567620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17745c80-1722-48ab-8176-dbe087c58935 admin admin] PATH_INFO: `/v3/projects/94013e658bc04f0e89f33ef60411a4d8/users/d77b8d81f1ab4519bdb7008e169cc409/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:29.593358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17745c80-1722-48ab-8176-dbe087c58935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94013e658bc04f0e89f33ef60411a4d8, user_id=d77b8d81f1ab4519bdb7008e169cc409, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:29.597503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17745c80-1722-48ab-8176-dbe087c58935 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:29.626090 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3058/6136] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:29 2022] PUT /identity/v3/projects/94013e658bc04f0e89f33ef60411a4d8/users/d77b8d81f1ab4519bdb7008e169cc409/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:29.653245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e1190-7c27-46d9-b52b-3fdb6b11bf35 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:29.654418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e1190-7c27-46d9-b52b-3fdb6b11bf35 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:29.654859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e1190-7c27-46d9-b52b-3fdb6b11bf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:29.682419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0237c1c-b3e9-4d0b-bad8-f514407475b5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:29.796899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8f8e1190-7c27-46d9-b52b-3fdb6b11bf35 None None] MFA Rules not processed for user `d77b8d81f1ab4519bdb7008e169cc409`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:29.798219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8f8e1190-7c27-46d9-b52b-3fdb6b11bf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:29.858939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8b714-3c17-4ece-8f23-f1dbd01eabb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:29.859504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8b714-3c17-4ece-8f23-f1dbd01eabb9 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:29.859783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8b714-3c17-4ece-8f23-f1dbd01eabb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:29.860524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8b714-3c17-4ece-8f23-f1dbd01eabb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:29.891067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:29.963209 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3059/6137] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:29.963209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e1190-7c27-46d9-b52b-3fdb6b11bf35 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:29.967472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8f8e1190-7c27-46d9-b52b-3fdb6b11bf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:30.019224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8b714-3c17-4ece-8f23-f1dbd01eabb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:30.023754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8b714-3c17-4ece-8f23-f1dbd01eabb9 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:30.036160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:30.056920 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3079/6138] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:25:30.060161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8b714-3c17-4ece-8f23-f1dbd01eabb9 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:30.103434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8b714-3c17-4ece-8f23-f1dbd01eabb9 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:30.118715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42196bd4-4223-461b-ad9b-f65ec1a054ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:30.119593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42196bd4-4223-461b-ad9b-f65ec1a054ef admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:30.122594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42196bd4-4223-461b-ad9b-f65ec1a054ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:30.122877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e1190-7c27-46d9-b52b-3fdb6b11bf35 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:30.123118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42196bd4-4223-461b-ad9b-f65ec1a054ef admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:30.124888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42196bd4-4223-461b-ad9b-f65ec1a054ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:30.144621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42196bd4-4223-461b-ad9b-f65ec1a054ef admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:30.147242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd354e6-6d19-4a7a-bcd3-741b4d98c0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:30.148695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd354e6-6d19-4a7a-bcd3-741b4d98c0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:30.148984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd354e6-6d19-4a7a-bcd3-741b4d98c0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:30.149256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd354e6-6d19-4a7a-bcd3-741b4d98c0bb admin admin] PATH_INFO: `/v3/projects/c7016d4ee1b44145aa227ca684bfe1bf` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:30.150879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd354e6-6d19-4a7a-bcd3-741b4d98c0bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7016d4ee1b44145aa227ca684bfe1bf)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:30.155447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd354e6-6d19-4a7a-bcd3-741b4d98c0bb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:30.255040 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3080/6139] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:30 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:30.257452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42196bd4-4223-461b-ad9b-f65ec1a054ef admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:30.262128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-edd354e6-6d19-4a7a-bcd3-741b4d98c0bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7016d4ee1b44145aa227ca684bfe1bf', 'request_id': 'req-edd354e6-6d19-4a7a-bcd3-741b4d98c0bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:30.275481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-edd354e6-6d19-4a7a-bcd3-741b4d98c0bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7016d4ee1b44145aa227ca684bfe1bf', 'request_id': 'req-edd354e6-6d19-4a7a-bcd3-741b4d98c0bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:30.290914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-edd354e6-6d19-4a7a-bcd3-741b4d98c0bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7016d4ee1b44145aa227ca684bfe1bf', 'request_id': 'req-edd354e6-6d19-4a7a-bcd3-741b4d98c0bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:30.321590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-edd354e6-6d19-4a7a-bcd3-741b4d98c0bb admin admin] The token cache is being invalidate because project c7016d4ee1b44145aa227ca684bfe1bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:30.322343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-edd354e6-6d19-4a7a-bcd3-741b4d98c0bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:30.325559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-edd354e6-6d19-4a7a-bcd3-741b4d98c0bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:30.328604 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3060/6140] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:29 2022] DELETE /identity/v3/projects/c7016d4ee1b44145aa227ca684bfe1bf => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:30.337367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27966422-a973-4af7-9616-1ab705000980 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:30.338216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27966422-a973-4af7-9616-1ab705000980 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:30.339294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27966422-a973-4af7-9616-1ab705000980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:30.376202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42196bd4-4223-461b-ad9b-f65ec1a054ef admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:30.384734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94964c0c-1fde-460f-a71d-cf0cb8630d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:30.385271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94964c0c-1fde-460f-a71d-cf0cb8630d05 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:30.385409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-27966422-a973-4af7-9616-1ab705000980 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:30.385540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94964c0c-1fde-460f-a71d-cf0cb8630d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:30.385810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94964c0c-1fde-460f-a71d-cf0cb8630d05 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:30.386501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94964c0c-1fde-460f-a71d-cf0cb8630d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:30.387127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-27966422-a973-4af7-9616-1ab705000980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:30.392011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94964c0c-1fde-460f-a71d-cf0cb8630d05 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:30.402255 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3061/6141] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:30.411020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2cbdb-9d90-4332-91d6-04c1942a2ae6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:30.411363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2cbdb-9d90-4332-91d6-04c1942a2ae6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:30.411640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2cbdb-9d90-4332-91d6-04c1942a2ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:30.456891 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3081/6142] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:30 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:30.462357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94964c0c-1fde-460f-a71d-cf0cb8630d05 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:30.470631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-94964c0c-1fde-460f-a71d-cf0cb8630d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:30.506058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94964c0c-1fde-460f-a71d-cf0cb8630d05 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:30.516581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45d51c-d2da-4946-8188-fe2291d0d9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:30.517029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b9f2cbdb-9d90-4332-91d6-04c1942a2ae6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:30.517278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45d51c-d2da-4946-8188-fe2291d0d9ee admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:30.517560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45d51c-d2da-4946-8188-fe2291d0d9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:30.518516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45d51c-d2da-4946-8188-fe2291d0d9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:30.519109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b9f2cbdb-9d90-4332-91d6-04c1942a2ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:30.520699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45d51c-d2da-4946-8188-fe2291d0d9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:30.524687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45d51c-d2da-4946-8188-fe2291d0d9ee admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:30.552124 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3082/6143] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:30.554983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45d51c-d2da-4946-8188-fe2291d0d9ee admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:30.570090 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3062/6144] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:30.573965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2cbdb-9d90-4332-91d6-04c1942a2ae6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:30.576775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45d51c-d2da-4946-8188-fe2291d0d9ee admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:30.594339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a4890-1267-4436-b3b6-2159ad68dc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:30.595184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a4890-1267-4436-b3b6-2159ad68dc62 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:30.595536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a4890-1267-4436-b3b6-2159ad68dc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:30.595932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a4890-1267-4436-b3b6-2159ad68dc62 admin admin] PATH_INFO: `/v3/projects/51a6d04c20724de498652ab8747b82d3/users/d4fc9be729b842d9b79b2a4110e93220/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:30.601505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2cbdb-9d90-4332-91d6-04c1942a2ae6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:30.616019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c331fc-8f66-45c2-8c70-a38603953821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:30.617683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c331fc-8f66-45c2-8c70-a38603953821 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:30.617969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c331fc-8f66-45c2-8c70-a38603953821 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:30.621018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c331fc-8f66-45c2-8c70-a38603953821 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:30.622579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c331fc-8f66-45c2-8c70-a38603953821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:30.622902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c331fc-8f66-45c2-8c70-a38603953821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:30.629560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a4890-1267-4436-b3b6-2159ad68dc62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a6d04c20724de498652ab8747b82d3, user_id=d4fc9be729b842d9b79b2a4110e93220, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:30.630438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c331fc-8f66-45c2-8c70-a38603953821 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:30.632461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a4890-1267-4436-b3b6-2159ad68dc62 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:30.661464 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3083/6145] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:30 2022] PUT /identity/v3/projects/51a6d04c20724de498652ab8747b82d3/users/d4fc9be729b842d9b79b2a4110e93220/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:30.665276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a4890-1267-4436-b3b6-2159ad68dc62 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:30.666832 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3063/6146] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:30.672733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c331fc-8f66-45c2-8c70-a38603953821 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:30.706793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c331fc-8f66-45c2-8c70-a38603953821 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:30.775509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:30.819276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a4890-1267-4436-b3b6-2159ad68dc62 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:30.832204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d3bd5-704d-4961-a826-2f935d75d011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:30.832898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d3bd5-704d-4961-a826-2f935d75d011 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:30.833182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d3bd5-704d-4961-a826-2f935d75d011 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:30.833443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d3bd5-704d-4961-a826-2f935d75d011 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:30.834177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d3bd5-704d-4961-a826-2f935d75d011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:30.835819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d3bd5-704d-4961-a826-2f935d75d011 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:30.849780 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3084/6147] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:30.849780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d3bd5-704d-4961-a826-2f935d75d011 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:30.855400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522007d-e919-483e-a4b1-1185ef2eeafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:30.856653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522007d-e919-483e-a4b1-1185ef2eeafe admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:30.857116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2f7d3bd5-704d-4961-a826-2f935d75d011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:30.857382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522007d-e919-483e-a4b1-1185ef2eeafe admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:30.857882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522007d-e919-483e-a4b1-1185ef2eeafe admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:30.858798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522007d-e919-483e-a4b1-1185ef2eeafe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:30.861141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522007d-e919-483e-a4b1-1185ef2eeafe admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:30.872578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d3bd5-704d-4961-a826-2f935d75d011 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:30.879514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7eccf7-a45c-4f3f-9465-13dc1e5723dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:30.880592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eccf7-a45c-4f3f-9465-13dc1e5723dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:30.880931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eccf7-a45c-4f3f-9465-13dc1e5723dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:30.881271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7eccf7-a45c-4f3f-9465-13dc1e5723dc admin admin] PATH_INFO: `/v3/projects/71a364f769f9465281e4bdec775d7cb7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:30.882606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7eccf7-a45c-4f3f-9465-13dc1e5723dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=71a364f769f9465281e4bdec775d7cb7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:30.884900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7eccf7-a45c-4f3f-9465-13dc1e5723dc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:30.912609 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3064/6148] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:30 2022] POST /identity/v3/projects => generated 383 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:30.918699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522007d-e919-483e-a4b1-1185ef2eeafe admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:30.943574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:30.952980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a7eccf7-a45c-4f3f-9465-13dc1e5723dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71a364f769f9465281e4bdec775d7cb7', 'request_id': 'req-4a7eccf7-a45c-4f3f-9465-13dc1e5723dc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:30.971849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a7eccf7-a45c-4f3f-9465-13dc1e5723dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71a364f769f9465281e4bdec775d7cb7', 'request_id': 'req-4a7eccf7-a45c-4f3f-9465-13dc1e5723dc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:30.984071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a7eccf7-a45c-4f3f-9465-13dc1e5723dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71a364f769f9465281e4bdec775d7cb7', 'request_id': 'req-4a7eccf7-a45c-4f3f-9465-13dc1e5723dc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:31.005570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a7eccf7-a45c-4f3f-9465-13dc1e5723dc admin admin] The token cache is being invalidate because project 71a364f769f9465281e4bdec775d7cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:31.005852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a7eccf7-a45c-4f3f-9465-13dc1e5723dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:31.006523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a7eccf7-a45c-4f3f-9465-13dc1e5723dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:31.006877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522007d-e919-483e-a4b1-1185ef2eeafe admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:31.008346 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3085/6149] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:30 2022] DELETE /identity/v3/projects/71a364f769f9465281e4bdec775d7cb7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:31.012350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7eccf7-a45c-4f3f-9465-13dc1e5723dc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:31.013715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4a7eccf7-a45c-4f3f-9465-13dc1e5723dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:31.096498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ee79f-5936-4913-8e3d-95fcd4743a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:31.097641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ee79f-5936-4913-8e3d-95fcd4743a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:31.097980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ee79f-5936-4913-8e3d-95fcd4743a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:31.098260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ee79f-5936-4913-8e3d-95fcd4743a46 admin admin] PATH_INFO: `/v3/projects/51a6d04c20724de498652ab8747b82d3/users/d4fc9be729b842d9b79b2a4110e93220/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:31.100502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ee79f-5936-4913-8e3d-95fcd4743a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a6d04c20724de498652ab8747b82d3, user_id=d4fc9be729b842d9b79b2a4110e93220, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:31.103550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ee79f-5936-4913-8e3d-95fcd4743a46 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:31.112677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7eccf7-a45c-4f3f-9465-13dc1e5723dc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:31.115987 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3065/6150] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:30 2022] PUT /identity/v3/projects/51a6d04c20724de498652ab8747b82d3/users/d4fc9be729b842d9b79b2a4110e93220/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:31.116894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ee79f-5936-4913-8e3d-95fcd4743a46 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:31.125625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1c3ee79f-5936-4913-8e3d-95fcd4743a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:31.206930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e7600-96d1-4977-92d8-aec4c95328c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:31.207614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e7600-96d1-4977-92d8-aec4c95328c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:31.207906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e7600-96d1-4977-92d8-aec4c95328c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:31.208226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e7600-96d1-4977-92d8-aec4c95328c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:31.208913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e7600-96d1-4977-92d8-aec4c95328c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:31.209500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ee79f-5936-4913-8e3d-95fcd4743a46 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:31.211006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e7600-96d1-4977-92d8-aec4c95328c1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:31.214922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87d63c-9192-4edc-b16b-b4b8ebd93971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:31.215974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87d63c-9192-4edc-b16b-b4b8ebd93971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:31.216368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87d63c-9192-4edc-b16b-b4b8ebd93971 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:31.216705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87d63c-9192-4edc-b16b-b4b8ebd93971 admin admin] PATH_INFO: `/v3/users/e5352ddc52cf4beeba6f06ab091e8330` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:31.218021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87d63c-9192-4edc-b16b-b4b8ebd93971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5352ddc52cf4beeba6f06ab091e8330)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:31.220003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87d63c-9192-4edc-b16b-b4b8ebd93971 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:31.231881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:31.246081 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3086/6151] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:31 2022] POST /identity/v3/users => generated 292 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:31.248180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b65db-ad30-480b-a8d8-137543347e9d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:31.248469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b65db-ad30-480b-a8d8-137543347e9d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:31.248750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b65db-ad30-480b-a8d8-137543347e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:31.286894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8f87d63c-9192-4edc-b16b-b4b8ebd93971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5352ddc52cf4beeba6f06ab091e8330'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:31.287446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c78b65db-ad30-480b-a8d8-137543347e9d None None] MFA Rules not processed for user `d4fc9be729b842d9b79b2a4110e93220`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:31.289365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c78b65db-ad30-480b-a8d8-137543347e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:31.296768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8f87d63c-9192-4edc-b16b-b4b8ebd93971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5352ddc52cf4beeba6f06ab091e8330'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:31.306761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:31.325241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8f87d63c-9192-4edc-b16b-b4b8ebd93971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5352ddc52cf4beeba6f06ab091e8330'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:31.331661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8f87d63c-9192-4edc-b16b-b4b8ebd93971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5352ddc52cf4beeba6f06ab091e8330'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:31.333454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8f87d63c-9192-4edc-b16b-b4b8ebd93971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5352ddc52cf4beeba6f06ab091e8330'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:31.361925 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3066/6152] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:31 2022] DELETE /identity/v3/users/e5352ddc52cf4beeba6f06ab091e8330 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:31.362889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87d63c-9192-4edc-b16b-b4b8ebd93971 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:31.364291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8f87d63c-9192-4edc-b16b-b4b8ebd93971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:31.405194 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3087/6153] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:31.412179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b65db-ad30-480b-a8d8-137543347e9d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:31.444342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b65db-ad30-480b-a8d8-137543347e9d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:31.532659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87d63c-9192-4edc-b16b-b4b8ebd93971 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:31.539545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119e29a-4738-4805-beae-de702615d0dc tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:31.540337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010be43-6a64-44b3-b748-c4aa6ae283a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:31.540766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010be43-6a64-44b3-b748-c4aa6ae283a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:31.541046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010be43-6a64-44b3-b748-c4aa6ae283a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:31.541414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010be43-6a64-44b3-b748-c4aa6ae283a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:31.542308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010be43-6a64-44b3-b748-c4aa6ae283a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:31.542828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119e29a-4738-4805-beae-de702615d0dc tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:31.543841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119e29a-4738-4805-beae-de702615d0dc tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:31.543976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010be43-6a64-44b3-b748-c4aa6ae283a2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:31.544340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119e29a-4738-4805-beae-de702615d0dc tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:31.545831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119e29a-4738-4805-beae-de702615d0dc tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:31.548126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119e29a-4738-4805-beae-de702615d0dc tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:31.561307 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3067/6154] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:31.562328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010be43-6a64-44b3-b748-c4aa6ae283a2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:31.574607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010be43-6a64-44b3-b748-c4aa6ae283a2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:31.584686 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3088/6155] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:31 2022] POST /identity/v3/services => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:31.588639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119e29a-4738-4805-beae-de702615d0dc tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:31.599237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f567d0e-ae3a-495a-a87e-b64c948fc4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:31.599918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f567d0e-ae3a-495a-a87e-b64c948fc4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:31.600233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f567d0e-ae3a-495a-a87e-b64c948fc4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:31.600507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f567d0e-ae3a-495a-a87e-b64c948fc4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:31.601287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f567d0e-ae3a-495a-a87e-b64c948fc4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:31.602887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f567d0e-ae3a-495a-a87e-b64c948fc4e6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:31.619695 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3068/6156] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:31.620554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119e29a-4738-4805-beae-de702615d0dc tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:31.624096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f567d0e-ae3a-495a-a87e-b64c948fc4e6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:31.630346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442595fc-d965-48aa-ba49-ef9ff8cd1bc8 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:31.630955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442595fc-d965-48aa-ba49-ef9ff8cd1bc8 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:31.631316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442595fc-d965-48aa-ba49-ef9ff8cd1bc8 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:31.631754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442595fc-d965-48aa-ba49-ef9ff8cd1bc8 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:31.632755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442595fc-d965-48aa-ba49-ef9ff8cd1bc8 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:31.634077 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-442595fc-d965-48aa-ba49-ef9ff8cd1bc8 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:25:31.634077 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:25:31.634077 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:25:31.635609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442595fc-d965-48aa-ba49-ef9ff8cd1bc8 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:31.648665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f567d0e-ae3a-495a-a87e-b64c948fc4e6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:31.651673 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3089/6157] 10.222.0.43 () {60 vars in 1212 bytes} [Sat Jul 2 21:25:31 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:31.656029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442595fc-d965-48aa-ba49-ef9ff8cd1bc8 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:31.659394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd3ce9-5c01-47eb-a72c-b04d1e701b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:31.660472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd3ce9-5c01-47eb-a72c-b04d1e701b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:31.660816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd3ce9-5c01-47eb-a72c-b04d1e701b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:31.661149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd3ce9-5c01-47eb-a72c-b04d1e701b05 admin admin] PATH_INFO: `/v3/projects/4e593bc76e9c4d3bac7522fc5883796b/users/75450ebd919c4b6f8bcebe34b2531e91/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:31.669066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442595fc-d965-48aa-ba49-ef9ff8cd1bc8 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:31.675937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160e722-74b9-44e8-9b56-96d2e5acd73e tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:31.677126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160e722-74b9-44e8-9b56-96d2e5acd73e tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:31.677741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160e722-74b9-44e8-9b56-96d2e5acd73e tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:31.678169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160e722-74b9-44e8-9b56-96d2e5acd73e tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:31.679276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160e722-74b9-44e8-9b56-96d2e5acd73e tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:31.680768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160e722-74b9-44e8-9b56-96d2e5acd73e tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:31.712157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd3ce9-5c01-47eb-a72c-b04d1e701b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e593bc76e9c4d3bac7522fc5883796b, user_id=75450ebd919c4b6f8bcebe34b2531e91, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:31.717940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd3ce9-5c01-47eb-a72c-b04d1e701b05 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:31.732172 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3090/6158] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:31 2022] POST /identity/v3/services => generated 289 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:31.733635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160e722-74b9-44e8-9b56-96d2e5acd73e tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:31.763841 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3069/6159] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:31 2022] PUT /identity/v3/projects/4e593bc76e9c4d3bac7522fc5883796b/users/75450ebd919c4b6f8bcebe34b2531e91/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:31.769559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1714db-cf0b-41cc-9ac3-9fabb0fd804f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:31.770093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1714db-cf0b-41cc-9ac3-9fabb0fd804f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:31.770560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1714db-cf0b-41cc-9ac3-9fabb0fd804f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:31.775170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160e722-74b9-44e8-9b56-96d2e5acd73e tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:31.828029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ab1714db-cf0b-41cc-9ac3-9fabb0fd804f None None] MFA Rules not processed for user `75450ebd919c4b6f8bcebe34b2531e91`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:31.829702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ab1714db-cf0b-41cc-9ac3-9fabb0fd804f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:31.854736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:31.925063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97713a15-b79f-42b8-811f-903e327d2808 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:31.925663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97713a15-b79f-42b8-811f-903e327d2808 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:31.925945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97713a15-b79f-42b8-811f-903e327d2808 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:31.926229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97713a15-b79f-42b8-811f-903e327d2808 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:31.927390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97713a15-b79f-42b8-811f-903e327d2808 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:31.929134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97713a15-b79f-42b8-811f-903e327d2808 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:31.946003 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3091/6160] 10.222.0.43 () {60 vars in 1212 bytes} [Sat Jul 2 21:25:31 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:31.947470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97713a15-b79f-42b8-811f-903e327d2808 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:31.951569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-97713a15-b79f-42b8-811f-903e327d2808 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:32.015035 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3070/6161] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:31 2022] POST /identity/v3/auth/tokens => generated 3516 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:32.020086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1714db-cf0b-41cc-9ac3-9fabb0fd804f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:32.031487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1714db-cf0b-41cc-9ac3-9fabb0fd804f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:32.037481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f58e50-c9bc-46bd-80be-8d5c4186c9a1 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:32.038246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f58e50-c9bc-46bd-80be-8d5c4186c9a1 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:32.038639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f58e50-c9bc-46bd-80be-8d5c4186c9a1 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:32.039003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f58e50-c9bc-46bd-80be-8d5c4186c9a1 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:32.039855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f58e50-c9bc-46bd-80be-8d5c4186c9a1 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:32.041000 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-40f58e50-c9bc-46bd-80be-8d5c4186c9a1 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:25:32.041000 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:25:32.041000 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:25:32.042130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f58e50-c9bc-46bd-80be-8d5c4186c9a1 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:32.050612 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3071/6162] 10.222.0.43 () {58 vars in 1190 bytes} [Sat Jul 2 21:25:32 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 765 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:32.055497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f58e50-c9bc-46bd-80be-8d5c4186c9a1 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:32.076487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:32.109274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f58e50-c9bc-46bd-80be-8d5c4186c9a1 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:32.115278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97713a15-b79f-42b8-811f-903e327d2808 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:32.122396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4299f7-3491-4aab-bc36-aa2dd676844c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:32.123219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4299f7-3491-4aab-bc36-aa2dd676844c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:32.123939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4299f7-3491-4aab-bc36-aa2dd676844c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:32.124822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4299f7-3491-4aab-bc36-aa2dd676844c admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:32.125640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4299f7-3491-4aab-bc36-aa2dd676844c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:32.131402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4299f7-3491-4aab-bc36-aa2dd676844c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:32.132277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388ca6f-bccd-4c53-afd6-09c81a68a550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:32.134739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388ca6f-bccd-4c53-afd6-09c81a68a550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:32.135877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388ca6f-bccd-4c53-afd6-09c81a68a550 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:32.136543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388ca6f-bccd-4c53-afd6-09c81a68a550 admin admin] PATH_INFO: `/v3/projects/d1218fdcad734e61b3a66cabf8ace2ab` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:32.139376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388ca6f-bccd-4c53-afd6-09c81a68a550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1218fdcad734e61b3a66cabf8ace2ab)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:32.143262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388ca6f-bccd-4c53-afd6-09c81a68a550 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:32.191371 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3072/6163] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:32 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:32.196128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4299f7-3491-4aab-bc36-aa2dd676844c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:32.262466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5388ca6f-bccd-4c53-afd6-09c81a68a550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1218fdcad734e61b3a66cabf8ace2ab', 'request_id': 'req-5388ca6f-bccd-4c53-afd6-09c81a68a550'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:32.284068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5388ca6f-bccd-4c53-afd6-09c81a68a550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1218fdcad734e61b3a66cabf8ace2ab', 'request_id': 'req-5388ca6f-bccd-4c53-afd6-09c81a68a550'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:32.293094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5388ca6f-bccd-4c53-afd6-09c81a68a550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1218fdcad734e61b3a66cabf8ace2ab', 'request_id': 'req-5388ca6f-bccd-4c53-afd6-09c81a68a550'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:32.326607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4299f7-3491-4aab-bc36-aa2dd676844c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:32.340590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5388ca6f-bccd-4c53-afd6-09c81a68a550 admin admin] The token cache is being invalidate because project d1218fdcad734e61b3a66cabf8ace2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:32.341067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5388ca6f-bccd-4c53-afd6-09c81a68a550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:32.342120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5388ca6f-bccd-4c53-afd6-09c81a68a550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:32.348790 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3092/6164] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:31 2022] DELETE /identity/v3/projects/d1218fdcad734e61b3a66cabf8ace2ab => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:32.349716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388ca6f-bccd-4c53-afd6-09c81a68a550 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:32.353576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5388ca6f-bccd-4c53-afd6-09c81a68a550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:32.423788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9819b-3374-4bb7-86b5-22cbeb4ed343 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:32.428711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9819b-3374-4bb7-86b5-22cbeb4ed343 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:32.431574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9819b-3374-4bb7-86b5-22cbeb4ed343 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:32.432053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9819b-3374-4bb7-86b5-22cbeb4ed343 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/cc563af0053744f0ac4171023fdac8cc` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:32.432903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9819b-3374-4bb7-86b5-22cbeb4ed343 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=cc563af0053744f0ac4171023fdac8cc)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:32.435843 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-4eb9819b-3374-4bb7-86b5-22cbeb4ed343 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:25:32.435843 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:25:32.435843 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:25:32.438945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9819b-3374-4bb7-86b5-22cbeb4ed343 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:32.449427 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3073/6165] 10.222.0.43 () {58 vars in 1289 bytes} [Sat Jul 2 21:25:32 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/cc563af0053744f0ac4171023fdac8cc => generated 333 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:32.450875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636b496-ebb1-41cd-baea-cd8686641a64 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:32.451354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636b496-ebb1-41cd-baea-cd8686641a64 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:32.451478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636b496-ebb1-41cd-baea-cd8686641a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:32.463313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:32.481592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2636b496-ebb1-41cd-baea-cd8686641a64 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:32.481834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388ca6f-bccd-4c53-afd6-09c81a68a550 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:32.482813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2636b496-ebb1-41cd-baea-cd8686641a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:32.489181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fec9c-ea52-433e-9798-72040b74ff7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:32.490116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fec9c-ea52-433e-9798-72040b74ff7e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:32.490702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fec9c-ea52-433e-9798-72040b74ff7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:32.491711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fec9c-ea52-433e-9798-72040b74ff7e admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:32.492305 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3074/6166] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:32 2022] POST /identity/v3/auth/tokens => generated 3495 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:32.493214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636b496-ebb1-41cd-baea-cd8686641a64 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:32.496457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fec9c-ea52-433e-9798-72040b74ff7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:32.498503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fec9c-ea52-433e-9798-72040b74ff7e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:32.500516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2636b496-ebb1-41cd-baea-cd8686641a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:32.516947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636b496-ebb1-41cd-baea-cd8686641a64 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:32.524592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8244d-3cf7-49ee-9aad-ff10684afc51 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:32.525638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8244d-3cf7-49ee-9aad-ff10684afc51 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:32.526114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8244d-3cf7-49ee-9aad-ff10684afc51 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:32.526396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8244d-3cf7-49ee-9aad-ff10684afc51 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/cc563af0053744f0ac4171023fdac8cc` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:32.530083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8244d-3cf7-49ee-9aad-ff10684afc51 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=cc563af0053744f0ac4171023fdac8cc)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:32.530083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8244d-3cf7-49ee-9aad-ff10684afc51 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:32.530741 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3093/6167] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:32 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:32.532496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcee3a-5c7c-4705-9446-8f6378ae3e5d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:32.533067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcee3a-5c7c-4705-9446-8f6378ae3e5d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:32.533558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcee3a-5c7c-4705-9446-8f6378ae3e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:32.541059 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3075/6168] 10.222.0.43 () {58 vars in 1290 bytes} [Sat Jul 2 21:25:32 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/cc563af0053744f0ac4171023fdac8cc => generated 0 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 02 21:25:32.542232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8244d-3cf7-49ee-9aad-ff10684afc51 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:32.557698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-eafcee3a-5c7c-4705-9446-8f6378ae3e5d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:32.558917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-eafcee3a-5c7c-4705-9446-8f6378ae3e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:32.563564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8244d-3cf7-49ee-9aad-ff10684afc51 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:32.568085 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3094/6169] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:32 2022] POST /identity/v3/auth/tokens => generated 3495 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:32.569073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcee3a-5c7c-4705-9446-8f6378ae3e5d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:32.577447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3481fc-090c-47d4-a0f4-953ecedafb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:32.578774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3481fc-090c-47d4-a0f4-953ecedafb07 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:32.579520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3481fc-090c-47d4-a0f4-953ecedafb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:32.580019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3481fc-090c-47d4-a0f4-953ecedafb07 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:32.581287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcee3a-5c7c-4705-9446-8f6378ae3e5d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:32.586161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3481fc-090c-47d4-a0f4-953ecedafb07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:32.586724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482550c-4e3e-4214-983e-246345363329 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:32.587810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482550c-4e3e-4214-983e-246345363329 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:32.588007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482550c-4e3e-4214-983e-246345363329 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:32.588237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3481fc-090c-47d4-a0f4-953ecedafb07 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:32.588354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482550c-4e3e-4214-983e-246345363329 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/cc563af0053744f0ac4171023fdac8cc` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:32.588990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482550c-4e3e-4214-983e-246345363329 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=cc563af0053744f0ac4171023fdac8cc)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:32.590000 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-7482550c-4e3e-4214-983e-246345363329 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:25:32.590000 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:25:32.590000 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:25:32.590935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482550c-4e3e-4214-983e-246345363329 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:32.610880 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3076/6170] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:32.610880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3481fc-090c-47d4-a0f4-953ecedafb07 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:32.622137 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3095/6171] 10.222.0.43 () {58 vars in 1292 bytes} [Sat Jul 2 21:25:32 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/cc563af0053744f0ac4171023fdac8cc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:32.623198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482550c-4e3e-4214-983e-246345363329 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:32.626183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3481fc-090c-47d4-a0f4-953ecedafb07 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:32.632558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff885b5f-dbb2-4d8f-9383-2ad7ff29ac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:32.633818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff885b5f-dbb2-4d8f-9383-2ad7ff29ac73 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:32.635248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff885b5f-dbb2-4d8f-9383-2ad7ff29ac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:32.635896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff885b5f-dbb2-4d8f-9383-2ad7ff29ac73 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:32.637213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff885b5f-dbb2-4d8f-9383-2ad7ff29ac73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:32.637793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff885b5f-dbb2-4d8f-9383-2ad7ff29ac73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:32.639652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482550c-4e3e-4214-983e-246345363329 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:32.639941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff885b5f-dbb2-4d8f-9383-2ad7ff29ac73 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:32.645478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236d284-2dcc-4b12-a8e5-1a3655cd2d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:32.646163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236d284-2dcc-4b12-a8e5-1a3655cd2d84 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:32.646446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236d284-2dcc-4b12-a8e5-1a3655cd2d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:32.648660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236d284-2dcc-4b12-a8e5-1a3655cd2d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:32.649900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236d284-2dcc-4b12-a8e5-1a3655cd2d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:32.651737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236d284-2dcc-4b12-a8e5-1a3655cd2d84 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:32.664399 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3077/6172] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:32.669384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff885b5f-dbb2-4d8f-9383-2ad7ff29ac73 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:32.674732 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3096/6173] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:32.676130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236d284-2dcc-4b12-a8e5-1a3655cd2d84 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:32.682813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff885b5f-dbb2-4d8f-9383-2ad7ff29ac73 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:32.687896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f935de-10f8-408c-a572-8e52444413cb tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:32.688848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f935de-10f8-408c-a572-8e52444413cb tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:32.689285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f935de-10f8-408c-a572-8e52444413cb tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:32.689758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f935de-10f8-408c-a572-8e52444413cb tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:32.690440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f935de-10f8-408c-a572-8e52444413cb tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:32.692171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f935de-10f8-408c-a572-8e52444413cb tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:32.692557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236d284-2dcc-4b12-a8e5-1a3655cd2d84 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:32.701323 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3078/6174] 10.222.0.43 () {58 vars in 1190 bytes} [Sat Jul 2 21:25:32 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 451 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:32.701323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f935de-10f8-408c-a572-8e52444413cb tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:32.702182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ce9d6-c930-4a07-92be-596562c665b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:32.703365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ce9d6-c930-4a07-92be-596562c665b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:32.706773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ce9d6-c930-4a07-92be-596562c665b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:32.707244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ce9d6-c930-4a07-92be-596562c665b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:32.708107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ce9d6-c930-4a07-92be-596562c665b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:32.710155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ce9d6-c930-4a07-92be-596562c665b0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:32.710887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f935de-10f8-408c-a572-8e52444413cb tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:32.716980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852449d-7aa8-461c-8ff7-d6018ff1f4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:32.718026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852449d-7aa8-461c-8ff7-d6018ff1f4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:32.718313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852449d-7aa8-461c-8ff7-d6018ff1f4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:32.718590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852449d-7aa8-461c-8ff7-d6018ff1f4cf admin admin] PATH_INFO: `/v3/projects/6dc6f85805db45598466cca40f82b411/users/26fa870fad3d45daa5f62d96804bad06/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:32.742960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852449d-7aa8-461c-8ff7-d6018ff1f4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc6f85805db45598466cca40f82b411, user_id=26fa870fad3d45daa5f62d96804bad06, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:32.744342 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3097/6175] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:32 2022] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:32.745348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ce9d6-c930-4a07-92be-596562c665b0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:32.750381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852449d-7aa8-461c-8ff7-d6018ff1f4cf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:32.781216 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3079/6176] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:32 2022] PUT /identity/v3/projects/6dc6f85805db45598466cca40f82b411/users/26fa870fad3d45daa5f62d96804bad06/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:32.782422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852449d-7aa8-461c-8ff7-d6018ff1f4cf admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:32.798234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:32.861554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ce9d6-c930-4a07-92be-596562c665b0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:32.882563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852449d-7aa8-461c-8ff7-d6018ff1f4cf admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:32.888445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c451bba-bc70-42b3-b5c4-5d579739dd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:32.890906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c451bba-bc70-42b3-b5c4-5d579739dd42 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:32.890906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c451bba-bc70-42b3-b5c4-5d579739dd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:32.890906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c451bba-bc70-42b3-b5c4-5d579739dd42 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:32.891640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c451bba-bc70-42b3-b5c4-5d579739dd42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:32.894443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c451bba-bc70-42b3-b5c4-5d579739dd42 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:32.923761 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3080/6177] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:32 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:32.923761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310e7a5-a52c-498f-8b2b-406992609b52 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:32.923761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310e7a5-a52c-498f-8b2b-406992609b52 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:32.923761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310e7a5-a52c-498f-8b2b-406992609b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:32.948734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae708c-d3e2-4b43-943a-16094653ff75 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:32.950047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae708c-d3e2-4b43-943a-16094653ff75 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:32.950553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae708c-d3e2-4b43-943a-16094653ff75 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:32.950816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae708c-d3e2-4b43-943a-16094653ff75 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/cc563af0053744f0ac4171023fdac8cc` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:32.951497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae708c-d3e2-4b43-943a-16094653ff75 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=cc563af0053744f0ac4171023fdac8cc)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:32.953252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae708c-d3e2-4b43-943a-16094653ff75 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:32.956391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2310e7a5-a52c-498f-8b2b-406992609b52 None None] MFA Rules not processed for user `26fa870fad3d45daa5f62d96804bad06`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:32.957612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2310e7a5-a52c-498f-8b2b-406992609b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:32.978626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-edae708c-d3e2-4b43-943a-16094653ff75 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Could not find Endpoint Group: cc563af0053744f0ac4171023fdac8cc.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: cc563af0053744f0ac4171023fdac8cc. Jul 02 21:25:32.978626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:25:32.978626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:25:32.978626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:25:32.978626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:25:32.978626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:25:32.978626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:25:32.978626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:25:32.978626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:25:32.978626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:25:32.978626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:25:32.978626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:25:32.978626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Jul 02 21:25:32.978626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Jul 02 21:25:32.979882 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Jul 02 21:25:32.979882 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Jul 02 21:25:32.979882 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Jul 02 21:25:32.979882 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Jul 02 21:25:32.979882 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: cc563af0053744f0ac4171023fdac8cc. Jul 02 21:25:32.979882 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:25:32.981606 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3098/6178] 10.222.0.43 () {58 vars in 1292 bytes} [Sat Jul 2 21:25:32 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/cc563af0053744f0ac4171023fdac8cc => generated 120 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:25:32.982443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae708c-d3e2-4b43-943a-16094653ff75 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:32.999078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae708c-d3e2-4b43-943a-16094653ff75 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:33.005342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6ddbd-45a7-4426-a4b4-f74c3ba2ad10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:33.006067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6ddbd-45a7-4426-a4b4-f74c3ba2ad10 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:33.006361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6ddbd-45a7-4426-a4b4-f74c3ba2ad10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:33.006628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6ddbd-45a7-4426-a4b4-f74c3ba2ad10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:33.007358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6ddbd-45a7-4426-a4b4-f74c3ba2ad10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:33.009028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6ddbd-45a7-4426-a4b4-f74c3ba2ad10 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:33.022752 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3099/6179] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:33.028370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6ddbd-45a7-4426-a4b4-f74c3ba2ad10 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:33.040841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6ddbd-45a7-4426-a4b4-f74c3ba2ad10 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:33.045675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b003bc-8631-455e-a040-30b055122c90 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:33.046667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b003bc-8631-455e-a040-30b055122c90 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:33.046976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b003bc-8631-455e-a040-30b055122c90 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:33.047263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b003bc-8631-455e-a040-30b055122c90 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/services/486c588e8c824dc99b194cf70fa775f4` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:33.048101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b003bc-8631-455e-a040-30b055122c90 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:delete_service(service_id=486c588e8c824dc99b194cf70fa775f4)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:33.049871 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3081/6180] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:32 2022] POST /identity/v3/auth/tokens => generated 3518 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:33.050013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b003bc-8631-455e-a040-30b055122c90 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:33.051027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310e7a5-a52c-498f-8b2b-406992609b52 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:33.065678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310e7a5-a52c-498f-8b2b-406992609b52 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:33.071271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761addbe-d64b-4d56-9c61-9dd0975b2bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:33.072126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761addbe-d64b-4d56-9c61-9dd0975b2bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:33.072617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761addbe-d64b-4d56-9c61-9dd0975b2bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:33.072972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761addbe-d64b-4d56-9c61-9dd0975b2bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:33.073941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761addbe-d64b-4d56-9c61-9dd0975b2bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:33.076137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761addbe-d64b-4d56-9c61-9dd0975b2bc3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:33.081371 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3100/6181] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:33 2022] DELETE /identity/v3/services/486c588e8c824dc99b194cf70fa775f4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:33.084928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b003bc-8631-455e-a040-30b055122c90 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:33.091046 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3082/6182] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:33.092026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761addbe-d64b-4d56-9c61-9dd0975b2bc3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:33.094380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:33.107566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761addbe-d64b-4d56-9c61-9dd0975b2bc3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:33.117083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b003bc-8631-455e-a040-30b055122c90 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:33.126222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9a9f3-d7b7-4ad5-a21c-1fef8a6838c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:33.126996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9a9f3-d7b7-4ad5-a21c-1fef8a6838c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:33.127320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9a9f3-d7b7-4ad5-a21c-1fef8a6838c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:33.127596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9a9f3-d7b7-4ad5-a21c-1fef8a6838c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:33.128507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9a9f3-d7b7-4ad5-a21c-1fef8a6838c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:33.130463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9a9f3-d7b7-4ad5-a21c-1fef8a6838c5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:33.133265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfd750-18c9-4718-bca6-33838e50f94c tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:33.134471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfd750-18c9-4718-bca6-33838e50f94c tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:33.134934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfd750-18c9-4718-bca6-33838e50f94c tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:33.135993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfd750-18c9-4718-bca6-33838e50f94c tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:33.137091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfd750-18c9-4718-bca6-33838e50f94c tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:33.139022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfd750-18c9-4718-bca6-33838e50f94c tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:33.168571 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3083/6183] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:33 2022] POST /identity/v3/services => generated 289 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:33.170776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfd750-18c9-4718-bca6-33838e50f94c tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:33.182103 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3101/6184] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:33 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:33.183086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9a9f3-d7b7-4ad5-a21c-1fef8a6838c5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:33.231019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfd750-18c9-4718-bca6-33838e50f94c tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:33.303654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9a9f3-d7b7-4ad5-a21c-1fef8a6838c5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:33.309586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:33.322234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10305ec5-f979-48e6-b5ca-49342179f64c tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:33.322904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10305ec5-f979-48e6-b5ca-49342179f64c tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:33.323194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10305ec5-f979-48e6-b5ca-49342179f64c tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:33.323477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10305ec5-f979-48e6-b5ca-49342179f64c tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:33.324430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10305ec5-f979-48e6-b5ca-49342179f64c tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:33.326522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10305ec5-f979-48e6-b5ca-49342179f64c tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:33.329730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770af83-3284-4f16-8121-b062906fd327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:33.329730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770af83-3284-4f16-8121-b062906fd327 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:33.329730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770af83-3284-4f16-8121-b062906fd327 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:33.330249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770af83-3284-4f16-8121-b062906fd327 admin admin] PATH_INFO: `/v3/projects/85b632fe440f4ac4a7417dc3b303ab95/users/8ce13d9c15b948e1a652f0588e870435/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:33.341642 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3102/6185] 10.222.0.43 () {60 vars in 1212 bytes} [Sat Jul 2 21:25:33 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:33.341642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10305ec5-f979-48e6-b5ca-49342179f64c tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:33.351442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770af83-3284-4f16-8121-b062906fd327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b632fe440f4ac4a7417dc3b303ab95, user_id=8ce13d9c15b948e1a652f0588e870435, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:33.354359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770af83-3284-4f16-8121-b062906fd327 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:33.356634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10305ec5-f979-48e6-b5ca-49342179f64c tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:33.365260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5f8f0-922f-427d-b91b-a452438accdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:33.366463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5f8f0-922f-427d-b91b-a452438accdb admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:33.367328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5f8f0-922f-427d-b91b-a452438accdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:33.368022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5f8f0-922f-427d-b91b-a452438accdb admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:33.369070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5f8f0-922f-427d-b91b-a452438accdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:33.372338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5f8f0-922f-427d-b91b-a452438accdb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:33.384750 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3084/6186] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:33 2022] PUT /identity/v3/projects/85b632fe440f4ac4a7417dc3b303ab95/users/8ce13d9c15b948e1a652f0588e870435/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:33.385831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770af83-3284-4f16-8121-b062906fd327 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:33.412977 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3103/6187] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:33 2022] POST /identity/v3/users => generated 299 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:33.414823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310becc-6b02-4a75-8e03-3a2c1ac30af7 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:33.415424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310becc-6b02-4a75-8e03-3a2c1ac30af7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:33.415977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310becc-6b02-4a75-8e03-3a2c1ac30af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:33.474575 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3310becc-6b02-4a75-8e03-3a2c1ac30af7 None None] MFA Rules not processed for user `8ce13d9c15b948e1a652f0588e870435`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:33.477796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3310becc-6b02-4a75-8e03-3a2c1ac30af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:33.505491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770af83-3284-4f16-8121-b062906fd327 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:33.518743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287dcf9-ede6-49e0-a391-a985f1752c0b tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:33.519626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287dcf9-ede6-49e0-a391-a985f1752c0b tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:33.519908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287dcf9-ede6-49e0-a391-a985f1752c0b tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:33.520209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287dcf9-ede6-49e0-a391-a985f1752c0b tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/services` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:33.520932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287dcf9-ede6-49e0-a391-a985f1752c0b tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:33.525486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287dcf9-ede6-49e0-a391-a985f1752c0b tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:33.581606 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3085/6188] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:33 2022] POST /identity/v3/services => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:33.582469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287dcf9-ede6-49e0-a391-a985f1752c0b tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:33.730267 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3104/6189] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:33 2022] POST /identity/v3/auth/tokens => generated 3652 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:33.732695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310becc-6b02-4a75-8e03-3a2c1ac30af7 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:33.778348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287dcf9-ede6-49e0-a391-a985f1752c0b tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:33.785209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6717eae-b8c4-49ed-a299-72f990d42276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:33.786251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6717eae-b8c4-49ed-a299-72f990d42276 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:33.786251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6717eae-b8c4-49ed-a299-72f990d42276 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:33.786584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6717eae-b8c4-49ed-a299-72f990d42276 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:33.787596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6717eae-b8c4-49ed-a299-72f990d42276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:33.789325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6717eae-b8c4-49ed-a299-72f990d42276 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:33.795856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310becc-6b02-4a75-8e03-3a2c1ac30af7 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:33.802381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b9c62-2549-4610-a491-63c9e85b137b tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:33.803706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b9c62-2549-4610-a491-63c9e85b137b tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:33.803999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b9c62-2549-4610-a491-63c9e85b137b tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:33.804320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b9c62-2549-4610-a491-63c9e85b137b tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/74ca95fe612a48b888306300fff6332a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:33.805787 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3086/6190] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:33.806813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6717eae-b8c4-49ed-a299-72f990d42276 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:33.809288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b9c62-2549-4610-a491-63c9e85b137b tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=74ca95fe612a48b888306300fff6332a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:33.812228 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-a14b9c62-2549-4610-a491-63c9e85b137b tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:25:33.812228 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:25:33.812228 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:25:33.813433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b9c62-2549-4610-a491-63c9e85b137b tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:33.832562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6717eae-b8c4-49ed-a299-72f990d42276 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:33.838346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741efa5a-37bd-44fb-8470-f4f6fcffd795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:33.839435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741efa5a-37bd-44fb-8470-f4f6fcffd795 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:33.839813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741efa5a-37bd-44fb-8470-f4f6fcffd795 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:33.840245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741efa5a-37bd-44fb-8470-f4f6fcffd795 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:33.841364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741efa5a-37bd-44fb-8470-f4f6fcffd795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:33.842643 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3105/6191] 10.222.0.43 () {60 vars in 1312 bytes} [Sat Jul 2 21:25:33 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/74ca95fe612a48b888306300fff6332a => generated 336 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:33.843559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741efa5a-37bd-44fb-8470-f4f6fcffd795 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:33.844383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b9c62-2549-4610-a491-63c9e85b137b tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:33.869129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b9c62-2549-4610-a491-63c9e85b137b tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:33.878007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38321521-849e-4068-a733-ccc1904dcc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:33.879124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38321521-849e-4068-a733-ccc1904dcc66 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:33.879484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38321521-849e-4068-a733-ccc1904dcc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:33.880296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38321521-849e-4068-a733-ccc1904dcc66 admin admin] PATH_INFO: `/v3/projects/b3ad0fc96fc547a8a90438e2ef6fe31c/users/b56dea7fd5f848e498035be609d72aa0/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:33.903578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:33.908554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38321521-849e-4068-a733-ccc1904dcc66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ad0fc96fc547a8a90438e2ef6fe31c, user_id=b56dea7fd5f848e498035be609d72aa0, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:33.922927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38321521-849e-4068-a733-ccc1904dcc66 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:33.925714 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3087/6192] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:33 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:33.930385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741efa5a-37bd-44fb-8470-f4f6fcffd795 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:33.962865 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3106/6193] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:33 2022] PUT /identity/v3/projects/b3ad0fc96fc547a8a90438e2ef6fe31c/users/b56dea7fd5f848e498035be609d72aa0/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:33.963801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38321521-849e-4068-a733-ccc1904dcc66 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:34.023295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:34.082415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741efa5a-37bd-44fb-8470-f4f6fcffd795 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:34.105148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38321521-849e-4068-a733-ccc1904dcc66 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:34.114697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83527b36-7af4-44a6-b378-dd16782e2e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:34.115393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83527b36-7af4-44a6-b378-dd16782e2e9e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:34.115677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83527b36-7af4-44a6-b378-dd16782e2e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:34.115959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83527b36-7af4-44a6-b378-dd16782e2e9e admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:34.116702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83527b36-7af4-44a6-b378-dd16782e2e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:34.118654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83527b36-7af4-44a6-b378-dd16782e2e9e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:34.147836 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3107/6194] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:33 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:34.147836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83527b36-7af4-44a6-b378-dd16782e2e9e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:34.162535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83527b36-7af4-44a6-b378-dd16782e2e9e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:34.169499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1d7a2-9780-4835-996a-bfef2a7dad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:34.170782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1d7a2-9780-4835-996a-bfef2a7dad98 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:34.171128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9a04d-61bd-4e94-8ace-5fb5cbdfaf43 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:34.171685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1d7a2-9780-4835-996a-bfef2a7dad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:34.171861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1d7a2-9780-4835-996a-bfef2a7dad98 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:34.172501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9a04d-61bd-4e94-8ace-5fb5cbdfaf43 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:34.172753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9a04d-61bd-4e94-8ace-5fb5cbdfaf43 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:34.172989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1d7a2-9780-4835-996a-bfef2a7dad98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:34.173112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9a04d-61bd-4e94-8ace-5fb5cbdfaf43 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/services/ab7aa68b31d0470c8ddcb1822abb2f3f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:34.173683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9a04d-61bd-4e94-8ace-5fb5cbdfaf43 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ab7aa68b31d0470c8ddcb1822abb2f3f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:34.175365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1d7a2-9780-4835-996a-bfef2a7dad98 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:34.175503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9a04d-61bd-4e94-8ace-5fb5cbdfaf43 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:34.193992 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3108/6195] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:34.193992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1d7a2-9780-4835-996a-bfef2a7dad98 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:34.207797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1d7a2-9780-4835-996a-bfef2a7dad98 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:34.214907 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3088/6196] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:33 2022] DELETE /identity/v3/services/ab7aa68b31d0470c8ddcb1822abb2f3f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:34.215944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9a04d-61bd-4e94-8ace-5fb5cbdfaf43 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:34.239966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc8acd-0c08-433d-b2e9-40068f2e0d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:34.240810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc8acd-0c08-433d-b2e9-40068f2e0d02 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:34.241188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc8acd-0c08-433d-b2e9-40068f2e0d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:34.241624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc8acd-0c08-433d-b2e9-40068f2e0d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:34.242465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc8acd-0c08-433d-b2e9-40068f2e0d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:34.244567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc8acd-0c08-433d-b2e9-40068f2e0d02 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:34.256340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9a04d-61bd-4e94-8ace-5fb5cbdfaf43 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:34.261474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debac173-ff19-49e7-aa19-8aa4f67dc800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:34.262568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debac173-ff19-49e7-aa19-8aa4f67dc800 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:34.263111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debac173-ff19-49e7-aa19-8aa4f67dc800 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:34.263394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debac173-ff19-49e7-aa19-8aa4f67dc800 admin admin] PATH_INFO: `/v3/projects/b3ad0fc96fc547a8a90438e2ef6fe31c/users/b56dea7fd5f848e498035be609d72aa0/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:34.266092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debac173-ff19-49e7-aa19-8aa4f67dc800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ad0fc96fc547a8a90438e2ef6fe31c, user_id=b56dea7fd5f848e498035be609d72aa0, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:34.269556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debac173-ff19-49e7-aa19-8aa4f67dc800 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:34.273526 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3109/6197] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:34.273526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc8acd-0c08-433d-b2e9-40068f2e0d02 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:34.283816 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3089/6198] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:34 2022] PUT /identity/v3/projects/b3ad0fc96fc547a8a90438e2ef6fe31c/users/b56dea7fd5f848e498035be609d72aa0/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:34.285364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debac173-ff19-49e7-aa19-8aa4f67dc800 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:34.320422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc8acd-0c08-433d-b2e9-40068f2e0d02 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:34.381326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debac173-ff19-49e7-aa19-8aa4f67dc800 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:34.391744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cce300-05eb-423f-ab33-c98d0fc77cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:34.395643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cce300-05eb-423f-ab33-c98d0fc77cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:34.396159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cce300-05eb-423f-ab33-c98d0fc77cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:34.396514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cce300-05eb-423f-ab33-c98d0fc77cb3 admin admin] PATH_INFO: `/v3/projects/481ceccb448f41ccab292d071bcb1ca7/users/9606a4d2490e4494a6f6104a2c11687b/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:34.431179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9c747-1729-4983-a2b9-efacdef6f934 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:34.432233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9c747-1729-4983-a2b9-efacdef6f934 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:34.432615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9c747-1729-4983-a2b9-efacdef6f934 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:34.432995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9c747-1729-4983-a2b9-efacdef6f934 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/74ca95fe612a48b888306300fff6332a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:34.433771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9c747-1729-4983-a2b9-efacdef6f934 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=74ca95fe612a48b888306300fff6332a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:34.435910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9c747-1729-4983-a2b9-efacdef6f934 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:34.437959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cce300-05eb-423f-ab33-c98d0fc77cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=481ceccb448f41ccab292d071bcb1ca7, user_id=9606a4d2490e4494a6f6104a2c11687b, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:34.441192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cce300-05eb-423f-ab33-c98d0fc77cb3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:34.447934 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3110/6199] 10.222.0.43 () {58 vars in 1292 bytes} [Sat Jul 2 21:25:34 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/74ca95fe612a48b888306300fff6332a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:34.453517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85160d78-a2aa-4033-b79a-4dd3ce55eea8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:34.453999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85160d78-a2aa-4033-b79a-4dd3ce55eea8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:34.454424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85160d78-a2aa-4033-b79a-4dd3ce55eea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:34.464199 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3090/6200] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:34 2022] PUT /identity/v3/projects/481ceccb448f41ccab292d071bcb1ca7/users/9606a4d2490e4494a6f6104a2c11687b/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:34.464199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cce300-05eb-423f-ab33-c98d0fc77cb3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:34.493700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-85160d78-a2aa-4033-b79a-4dd3ce55eea8 None None] MFA Rules not processed for user `b56dea7fd5f848e498035be609d72aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:34.495138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-85160d78-a2aa-4033-b79a-4dd3ce55eea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:34.506746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:34.529727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:34.562019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cce300-05eb-423f-ab33-c98d0fc77cb3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:34.573587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a3da1-9394-41fb-8d16-edda15034348 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:34.574560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a3da1-9394-41fb-8d16-edda15034348 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:34.575733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a3da1-9394-41fb-8d16-edda15034348 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:34.577031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a3da1-9394-41fb-8d16-edda15034348 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/services/fd4d6206b1e64bc89e9c41581bfd3f0c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:34.577708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a3da1-9394-41fb-8d16-edda15034348 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:delete_service(service_id=fd4d6206b1e64bc89e9c41581bfd3f0c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:34.579373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a3da1-9394-41fb-8d16-edda15034348 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:34.622751 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3091/6201] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:34 2022] DELETE /identity/v3/services/fd4d6206b1e64bc89e9c41581bfd3f0c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:34.622751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a3da1-9394-41fb-8d16-edda15034348 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:34.636134 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3111/6202] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:34 2022] POST /identity/v3/auth/tokens => generated 3584 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:34.640209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85160d78-a2aa-4033-b79a-4dd3ce55eea8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:34.652813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85160d78-a2aa-4033-b79a-4dd3ce55eea8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:34.682649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd450438-f4b7-429b-916a-cc381e316d07 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:34.683727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd450438-f4b7-429b-916a-cc381e316d07 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:34.684013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd450438-f4b7-429b-916a-cc381e316d07 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:34.685476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd450438-f4b7-429b-916a-cc381e316d07 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/94f836ec334446779a9ae0e381b8de20` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:34.685922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd450438-f4b7-429b-916a-cc381e316d07 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=94f836ec334446779a9ae0e381b8de20)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:34.687599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd450438-f4b7-429b-916a-cc381e316d07 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:34.709841 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3112/6203] 10.222.0.43 () {58 vars in 1292 bytes} [Sat Jul 2 21:25:34 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/94f836ec334446779a9ae0e381b8de20 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:34.711058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd450438-f4b7-429b-916a-cc381e316d07 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:34.717282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fd450438-f4b7-429b-916a-cc381e316d07 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:34.735901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a3da1-9394-41fb-8d16-edda15034348 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:34.778647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e391e-a129-4839-a7b2-f511b1e84ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:34.780660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e391e-a129-4839-a7b2-f511b1e84ddd admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:34.791552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e391e-a129-4839-a7b2-f511b1e84ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:34.791552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e391e-a129-4839-a7b2-f511b1e84ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:34.791552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e391e-a129-4839-a7b2-f511b1e84ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:34.791552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e391e-a129-4839-a7b2-f511b1e84ddd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:34.818782 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3092/6204] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:34.818782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e391e-a129-4839-a7b2-f511b1e84ddd admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:34.836299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e391e-a129-4839-a7b2-f511b1e84ddd admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:34.851885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2295d4-cd0e-40da-b948-006a969d2249 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fc9be729b842d9b79b2a4110e93220', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51a6d04c20724de498652ab8747b82d3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:34.855492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2295d4-cd0e-40da-b948-006a969d2249 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:34.856227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2295d4-cd0e-40da-b948-006a969d2249 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:34.857209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2295d4-cd0e-40da-b948-006a969d2249 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] PATH_INFO: `/v3/services/c8a8b9d4820f4a74923042a11394aa42` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:34.858250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2295d4-cd0e-40da-b948-006a969d2249 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c8a8b9d4820f4a74923042a11394aa42)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:34.862437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2295d4-cd0e-40da-b948-006a969d2249 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:34.889955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd450438-f4b7-429b-916a-cc381e316d07 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:34.900233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43205e42-8118-4f7c-a54d-c988645af1d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:34.901471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43205e42-8118-4f7c-a54d-c988645af1d4 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:34.905173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43205e42-8118-4f7c-a54d-c988645af1d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:34.905173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43205e42-8118-4f7c-a54d-c988645af1d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:34.911075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-43205e42-8118-4f7c-a54d-c988645af1d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:34.922504 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3093/6205] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:34 2022] DELETE /identity/v3/services/c8a8b9d4820f4a74923042a11394aa42 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:34.923183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2295d4-cd0e-40da-b948-006a969d2249 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:34.953482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2295d4-cd0e-40da-b948-006a969d2249 tempest-EndPointGroupsTest-1051994680 tempest-EndPointGroupsTest-1051994680-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:34.958715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c0f00-92aa-4584-b92f-d596353f43ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:34.959794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c0f00-92aa-4584-b92f-d596353f43ed admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:34.960116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c0f00-92aa-4584-b92f-d596353f43ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:34.960396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c0f00-92aa-4584-b92f-d596353f43ed admin admin] PATH_INFO: `/v3/projects/481ceccb448f41ccab292d071bcb1ca7/users/9606a4d2490e4494a6f6104a2c11687b/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:34.963195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c0f00-92aa-4584-b92f-d596353f43ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=481ceccb448f41ccab292d071bcb1ca7, user_id=9606a4d2490e4494a6f6104a2c11687b, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:34.968706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c0f00-92aa-4584-b92f-d596353f43ed admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:34.983108 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3094/6206] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:34 2022] PUT /identity/v3/projects/481ceccb448f41ccab292d071bcb1ca7/users/9606a4d2490e4494a6f6104a2c11687b/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:34.983816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c0f00-92aa-4584-b92f-d596353f43ed admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:34.996261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-344c0f00-92aa-4584-b92f-d596353f43ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:34.997523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43205e42-8118-4f7c-a54d-c988645af1d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:34.999040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43205e42-8118-4f7c-a54d-c988645af1d4 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:35.026460 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3113/6207] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:35.027870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddb61a-ee3a-4882-aeff-023bf93ed12e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:35.028463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddb61a-ee3a-4882-aeff-023bf93ed12e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:35.028754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddb61a-ee3a-4882-aeff-023bf93ed12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:35.061449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-17ddb61a-ee3a-4882-aeff-023bf93ed12e None None] MFA Rules not processed for user `9606a4d2490e4494a6f6104a2c11687b`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:35.062907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-17ddb61a-ee3a-4882-aeff-023bf93ed12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:35.082035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:35.108619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c0f00-92aa-4584-b92f-d596353f43ed admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:35.110187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:35.115350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39bef6-956b-4ca2-8a5b-ffc223c42651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:35.116794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39bef6-956b-4ca2-8a5b-ffc223c42651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:35.117116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39bef6-956b-4ca2-8a5b-ffc223c42651 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:35.117677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39bef6-956b-4ca2-8a5b-ffc223c42651 admin admin] PATH_INFO: `/v3/users/d77b8d81f1ab4519bdb7008e169cc409` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:35.119173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39bef6-956b-4ca2-8a5b-ffc223c42651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77b8d81f1ab4519bdb7008e169cc409)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:35.121462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39bef6-956b-4ca2-8a5b-ffc223c42651 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:35.194096 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3114/6208] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:35.205934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddb61a-ee3a-4882-aeff-023bf93ed12e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:35.209045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-17ddb61a-ee3a-4882-aeff-023bf93ed12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:35.219235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e39bef6-956b-4ca2-8a5b-ffc223c42651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77b8d81f1ab4519bdb7008e169cc409'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:35.230532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e39bef6-956b-4ca2-8a5b-ffc223c42651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77b8d81f1ab4519bdb7008e169cc409'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:35.240087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e39bef6-956b-4ca2-8a5b-ffc223c42651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77b8d81f1ab4519bdb7008e169cc409'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:35.241258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e39bef6-956b-4ca2-8a5b-ffc223c42651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77b8d81f1ab4519bdb7008e169cc409'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:35.241879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e39bef6-956b-4ca2-8a5b-ffc223c42651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77b8d81f1ab4519bdb7008e169cc409'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:35.277815 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3095/6209] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:34 2022] DELETE /identity/v3/users/d77b8d81f1ab4519bdb7008e169cc409 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:35.283980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00319e1-6017-46c0-8915-4d484154211d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:35.284289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00319e1-6017-46c0-8915-4d484154211d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:35.284784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00319e1-6017-46c0-8915-4d484154211d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:35.306762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c00319e1-6017-46c0-8915-4d484154211d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:35.308166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c00319e1-6017-46c0-8915-4d484154211d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:35.325803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddb61a-ee3a-4882-aeff-023bf93ed12e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:35.388751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce95a98-47a7-4952-bb95-2d14f88fc010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:35.389413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce95a98-47a7-4952-bb95-2d14f88fc010 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:35.389702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce95a98-47a7-4952-bb95-2d14f88fc010 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:35.389983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce95a98-47a7-4952-bb95-2d14f88fc010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:35.391984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5ce95a98-47a7-4952-bb95-2d14f88fc010 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:35.398979 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3096/6210] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:35.408693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00319e1-6017-46c0-8915-4d484154211d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:35.411309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c00319e1-6017-46c0-8915-4d484154211d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:35.487896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce95a98-47a7-4952-bb95-2d14f88fc010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:35.489596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce95a98-47a7-4952-bb95-2d14f88fc010 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:35.520712 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3115/6211] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:25:35.566874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00319e1-6017-46c0-8915-4d484154211d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:35.576695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f10ac8-da12-45ce-96e5-120c2273e7dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:35.579372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f10ac8-da12-45ce-96e5-120c2273e7dc service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:35.579372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f10ac8-da12-45ce-96e5-120c2273e7dc service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:35.579647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f10ac8-da12-45ce-96e5-120c2273e7dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:35.611121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f10ac8-da12-45ce-96e5-120c2273e7dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:35.618961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f10ac8-da12-45ce-96e5-120c2273e7dc service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:35.635273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:35.654638 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3097/6212] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:36.329013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce95a98-47a7-4952-bb95-2d14f88fc010 service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:36.330982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5ce95a98-47a7-4952-bb95-2d14f88fc010 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:36.381863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce95a98-47a7-4952-bb95-2d14f88fc010 service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:36.391022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bacca-2e00-4405-97dc-d1c5b1d52a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:36.393239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bacca-2e00-4405-97dc-d1c5b1d52a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:36.393824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bacca-2e00-4405-97dc-d1c5b1d52a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:36.394342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bacca-2e00-4405-97dc-d1c5b1d52a37 admin admin] PATH_INFO: `/v3/projects/94013e658bc04f0e89f33ef60411a4d8` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:36.396157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bacca-2e00-4405-97dc-d1c5b1d52a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94013e658bc04f0e89f33ef60411a4d8)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:36.399084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bacca-2e00-4405-97dc-d1c5b1d52a37 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:36.415027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:36.473414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-256bacca-2e00-4405-97dc-d1c5b1d52a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94013e658bc04f0e89f33ef60411a4d8', 'request_id': 'req-256bacca-2e00-4405-97dc-d1c5b1d52a37'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:36.485710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-256bacca-2e00-4405-97dc-d1c5b1d52a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94013e658bc04f0e89f33ef60411a4d8', 'request_id': 'req-256bacca-2e00-4405-97dc-d1c5b1d52a37'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:36.498786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-256bacca-2e00-4405-97dc-d1c5b1d52a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94013e658bc04f0e89f33ef60411a4d8', 'request_id': 'req-256bacca-2e00-4405-97dc-d1c5b1d52a37'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:36.521137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-256bacca-2e00-4405-97dc-d1c5b1d52a37 admin admin] The token cache is being invalidate because project 94013e658bc04f0e89f33ef60411a4d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:36.521652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-256bacca-2e00-4405-97dc-d1c5b1d52a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:36.522407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-256bacca-2e00-4405-97dc-d1c5b1d52a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:36.524001 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3116/6213] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:36 2022] DELETE /identity/v3/projects/94013e658bc04f0e89f33ef60411a4d8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:36.528193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f10ac8-da12-45ce-96e5-120c2273e7dc service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:36.544715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f10ac8-da12-45ce-96e5-120c2273e7dc service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:36.562494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bacca-2e00-4405-97dc-d1c5b1d52a37 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:36.563864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-256bacca-2e00-4405-97dc-d1c5b1d52a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:36.643031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0526a2-bc4d-4a89-ba61-1ce585b2d401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:36.644525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0526a2-bc4d-4a89-ba61-1ce585b2d401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:36.645035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0526a2-bc4d-4a89-ba61-1ce585b2d401 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:36.645669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0526a2-bc4d-4a89-ba61-1ce585b2d401 admin admin] PATH_INFO: `/v3/users/d4fc9be729b842d9b79b2a4110e93220` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:36.648671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bacca-2e00-4405-97dc-d1c5b1d52a37 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:36.648845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0526a2-bc4d-4a89-ba61-1ce585b2d401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4fc9be729b842d9b79b2a4110e93220)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:36.651991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0526a2-bc4d-4a89-ba61-1ce585b2d401 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:36.653907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050bb52-af34-4d8c-9484-7dabc9ec945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:36.654899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050bb52-af34-4d8c-9484-7dabc9ec945d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:36.655573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050bb52-af34-4d8c-9484-7dabc9ec945d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:36.655879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050bb52-af34-4d8c-9484-7dabc9ec945d admin admin] PATH_INFO: `/v3/users/8ce13d9c15b948e1a652f0588e870435` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:36.657182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050bb52-af34-4d8c-9484-7dabc9ec945d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ce13d9c15b948e1a652f0588e870435)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:36.661370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050bb52-af34-4d8c-9484-7dabc9ec945d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:36.779949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2f0526a2-bc4d-4a89-ba61-1ce585b2d401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4fc9be729b842d9b79b2a4110e93220'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:36.783334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8050bb52-af34-4d8c-9484-7dabc9ec945d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ce13d9c15b948e1a652f0588e870435'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:36.795024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2f0526a2-bc4d-4a89-ba61-1ce585b2d401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4fc9be729b842d9b79b2a4110e93220'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:36.800277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8050bb52-af34-4d8c-9484-7dabc9ec945d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ce13d9c15b948e1a652f0588e870435'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:36.801144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8050bb52-af34-4d8c-9484-7dabc9ec945d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ce13d9c15b948e1a652f0588e870435'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:36.802150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8050bb52-af34-4d8c-9484-7dabc9ec945d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ce13d9c15b948e1a652f0588e870435'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:36.806123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2f0526a2-bc4d-4a89-ba61-1ce585b2d401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4fc9be729b842d9b79b2a4110e93220'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:36.806826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2f0526a2-bc4d-4a89-ba61-1ce585b2d401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4fc9be729b842d9b79b2a4110e93220'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:36.807439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2f0526a2-bc4d-4a89-ba61-1ce585b2d401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4fc9be729b842d9b79b2a4110e93220'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:36.820450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8050bb52-af34-4d8c-9484-7dabc9ec945d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ce13d9c15b948e1a652f0588e870435'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:36.833719 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3098/6214] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:36 2022] DELETE /identity/v3/users/d4fc9be729b842d9b79b2a4110e93220 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:36.850753 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3117/6215] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:36 2022] DELETE /identity/v3/users/8ce13d9c15b948e1a652f0588e870435 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:36.852666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b7cc7-f368-472a-84ad-adb26988c616 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:36.852955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b7cc7-f368-472a-84ad-adb26988c616 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:36.853249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b7cc7-f368-472a-84ad-adb26988c616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:36.872605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-193b7cc7-f368-472a-84ad-adb26988c616 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:36.874011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-193b7cc7-f368-472a-84ad-adb26988c616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:37.026711 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3099/6216] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:37.038401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050bb52-af34-4d8c-9484-7dabc9ec945d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:37.040301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8050bb52-af34-4d8c-9484-7dabc9ec945d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:37.096090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:37.146549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050bb52-af34-4d8c-9484-7dabc9ec945d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:37.150284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7509a2-6722-4375-89b0-f7dc2efb0ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:37.150972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7509a2-6722-4375-89b0-f7dc2efb0ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:37.151252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7509a2-6722-4375-89b0-f7dc2efb0ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:37.151526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7509a2-6722-4375-89b0-f7dc2efb0ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:37.169423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7509a2-6722-4375-89b0-f7dc2efb0ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:37.171319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7509a2-6722-4375-89b0-f7dc2efb0ea4 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:37.185022 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3118/6217] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:25:37.520332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b7cc7-f368-472a-84ad-adb26988c616 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:37.521990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-193b7cc7-f368-472a-84ad-adb26988c616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:37.562267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b7cc7-f368-472a-84ad-adb26988c616 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:37.596501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46ba28-78e3-4efc-9e2c-01c2e2552e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:37.597500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46ba28-78e3-4efc-9e2c-01c2e2552e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:37.597787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46ba28-78e3-4efc-9e2c-01c2e2552e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:37.598172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46ba28-78e3-4efc-9e2c-01c2e2552e33 admin admin] PATH_INFO: `/v3/projects/51a6d04c20724de498652ab8747b82d3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:37.599832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46ba28-78e3-4efc-9e2c-01c2e2552e33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51a6d04c20724de498652ab8747b82d3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:37.603312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46ba28-78e3-4efc-9e2c-01c2e2552e33 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:37.669286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:37.754868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc46ba28-78e3-4efc-9e2c-01c2e2552e33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51a6d04c20724de498652ab8747b82d3', 'request_id': 'req-fc46ba28-78e3-4efc-9e2c-01c2e2552e33'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:37.764731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc46ba28-78e3-4efc-9e2c-01c2e2552e33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51a6d04c20724de498652ab8747b82d3', 'request_id': 'req-fc46ba28-78e3-4efc-9e2c-01c2e2552e33'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:37.779531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc46ba28-78e3-4efc-9e2c-01c2e2552e33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51a6d04c20724de498652ab8747b82d3', 'request_id': 'req-fc46ba28-78e3-4efc-9e2c-01c2e2552e33'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:37.807027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc46ba28-78e3-4efc-9e2c-01c2e2552e33 admin admin] The token cache is being invalidate because project 51a6d04c20724de498652ab8747b82d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:37.807491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc46ba28-78e3-4efc-9e2c-01c2e2552e33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:37.808255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc46ba28-78e3-4efc-9e2c-01c2e2552e33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:37.810244 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3100/6218] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:37 2022] DELETE /identity/v3/projects/51a6d04c20724de498652ab8747b82d3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:37.815657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c6a87-0ec1-46d5-8657-bfa889ba358f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:37.816236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c6a87-0ec1-46d5-8657-bfa889ba358f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:37.816438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c6a87-0ec1-46d5-8657-bfa889ba358f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:37.837366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2b3c6a87-0ec1-46d5-8657-bfa889ba358f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:37.838703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2b3c6a87-0ec1-46d5-8657-bfa889ba358f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:37.839942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46ba28-78e3-4efc-9e2c-01c2e2552e33 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:37.841467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fc46ba28-78e3-4efc-9e2c-01c2e2552e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:37.944295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46ba28-78e3-4efc-9e2c-01c2e2552e33 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:37.950922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5123fb-29f3-4883-9d28-3bac3bf33e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:37.951964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5123fb-29f3-4883-9d28-3bac3bf33e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:37.952388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5123fb-29f3-4883-9d28-3bac3bf33e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:37.952751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5123fb-29f3-4883-9d28-3bac3bf33e76 admin admin] PATH_INFO: `/v3/projects/85b632fe440f4ac4a7417dc3b303ab95` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:37.954295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5123fb-29f3-4883-9d28-3bac3bf33e76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b632fe440f4ac4a7417dc3b303ab95)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:37.956434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5123fb-29f3-4883-9d28-3bac3bf33e76 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:37.957197 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3119/6219] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:37.970407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908ed8-f896-4ecf-9b4c-384b43f4f77d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:37.970407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908ed8-f896-4ecf-9b4c-384b43f4f77d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:37.970407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908ed8-f896-4ecf-9b4c-384b43f4f77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:37.994185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-da908ed8-f896-4ecf-9b4c-384b43f4f77d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:37.995515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-da908ed8-f896-4ecf-9b4c-384b43f4f77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:38.007701 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3120/6220] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:38.008668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da908ed8-f896-4ecf-9b4c-384b43f4f77d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:38.019582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da908ed8-f896-4ecf-9b4c-384b43f4f77d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:38.023162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cf5123fb-29f3-4883-9d28-3bac3bf33e76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b632fe440f4ac4a7417dc3b303ab95', 'request_id': 'req-cf5123fb-29f3-4883-9d28-3bac3bf33e76'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:38.031007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cf5123fb-29f3-4883-9d28-3bac3bf33e76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b632fe440f4ac4a7417dc3b303ab95', 'request_id': 'req-cf5123fb-29f3-4883-9d28-3bac3bf33e76'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:38.038022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cf5123fb-29f3-4883-9d28-3bac3bf33e76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b632fe440f4ac4a7417dc3b303ab95', 'request_id': 'req-cf5123fb-29f3-4883-9d28-3bac3bf33e76'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:38.055555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cf5123fb-29f3-4883-9d28-3bac3bf33e76 admin admin] The token cache is being invalidate because project 85b632fe440f4ac4a7417dc3b303ab95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:38.055856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cf5123fb-29f3-4883-9d28-3bac3bf33e76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:38.056726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cf5123fb-29f3-4883-9d28-3bac3bf33e76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:38.059122 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3101/6221] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:37 2022] DELETE /identity/v3/projects/85b632fe440f4ac4a7417dc3b303ab95 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:38.062630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5123fb-29f3-4883-9d28-3bac3bf33e76 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:38.064446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cf5123fb-29f3-4883-9d28-3bac3bf33e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:38.118128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f7fb5-2e79-42f8-9110-0cdda20bb870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:38.119674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f7fb5-2e79-42f8-9110-0cdda20bb870 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:38.119956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f7fb5-2e79-42f8-9110-0cdda20bb870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:38.120536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f7fb5-2e79-42f8-9110-0cdda20bb870 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:38.121416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f7fb5-2e79-42f8-9110-0cdda20bb870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:38.121792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f7fb5-2e79-42f8-9110-0cdda20bb870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:38.123927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f7fb5-2e79-42f8-9110-0cdda20bb870 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:38.125202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:38.145750 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3121/6222] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:25:38.151847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f7fb5-2e79-42f8-9110-0cdda20bb870 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:38.154207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bd9f7fb5-2e79-42f8-9110-0cdda20bb870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:38.181175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f7fb5-2e79-42f8-9110-0cdda20bb870 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:38.187654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72420931-b440-44e4-b186-f4a4adb270aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:38.188404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72420931-b440-44e4-b186-f4a4adb270aa admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:38.188561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5123fb-29f3-4883-9d28-3bac3bf33e76 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:38.188681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72420931-b440-44e4-b186-f4a4adb270aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:38.188957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72420931-b440-44e4-b186-f4a4adb270aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:38.189672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72420931-b440-44e4-b186-f4a4adb270aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:38.191796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72420931-b440-44e4-b186-f4a4adb270aa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:38.193716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bfd6d-4b75-49f0-8abc-c80b23977429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:38.195922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bfd6d-4b75-49f0-8abc-c80b23977429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:38.195922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bfd6d-4b75-49f0-8abc-c80b23977429 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:38.195922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bfd6d-4b75-49f0-8abc-c80b23977429 admin admin] PATH_INFO: `/v3/users/9606a4d2490e4494a6f6104a2c11687b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:38.197249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bfd6d-4b75-49f0-8abc-c80b23977429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9606a4d2490e4494a6f6104a2c11687b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:38.199251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bfd6d-4b75-49f0-8abc-c80b23977429 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:38.231155 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3122/6223] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:38 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:38.234917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72420931-b440-44e4-b186-f4a4adb270aa admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:38.276897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:38.311816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-492bfd6d-4b75-49f0-8abc-c80b23977429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9606a4d2490e4494a6f6104a2c11687b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:38.324555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-492bfd6d-4b75-49f0-8abc-c80b23977429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9606a4d2490e4494a6f6104a2c11687b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:38.328887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72420931-b440-44e4-b186-f4a4adb270aa admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:38.334209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-492bfd6d-4b75-49f0-8abc-c80b23977429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9606a4d2490e4494a6f6104a2c11687b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:38.334914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-492bfd6d-4b75-49f0-8abc-c80b23977429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9606a4d2490e4494a6f6104a2c11687b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:38.336073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-492bfd6d-4b75-49f0-8abc-c80b23977429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9606a4d2490e4494a6f6104a2c11687b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:38.343325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc773826-69ef-4c79-a6c6-c0eb52336da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:38.344379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc773826-69ef-4c79-a6c6-c0eb52336da2 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:38.344748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc773826-69ef-4c79-a6c6-c0eb52336da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:38.345114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc773826-69ef-4c79-a6c6-c0eb52336da2 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:38.346291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc773826-69ef-4c79-a6c6-c0eb52336da2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:38.348573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc773826-69ef-4c79-a6c6-c0eb52336da2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:38.382256 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3123/6224] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:38 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:38.388620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc773826-69ef-4c79-a6c6-c0eb52336da2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:38.392265 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3102/6225] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:38 2022] DELETE /identity/v3/users/9606a4d2490e4494a6f6104a2c11687b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:38.395359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fc773826-69ef-4c79-a6c6-c0eb52336da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:38.411959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc773826-69ef-4c79-a6c6-c0eb52336da2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:38.500530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cefef3-5bbf-4fcd-b31f-0e28fb776398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:38.501967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cefef3-5bbf-4fcd-b31f-0e28fb776398 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:38.502636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cefef3-5bbf-4fcd-b31f-0e28fb776398 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:38.503257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cefef3-5bbf-4fcd-b31f-0e28fb776398 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:38.504342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cefef3-5bbf-4fcd-b31f-0e28fb776398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:38.506725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cefef3-5bbf-4fcd-b31f-0e28fb776398 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:38.522442 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3124/6226] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:38.526503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bfd6d-4b75-49f0-8abc-c80b23977429 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:38.543103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bfd6d-4b75-49f0-8abc-c80b23977429 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:38.548969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2f339-38f6-4388-b8ca-f73ed2d5fd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:38.549681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2f339-38f6-4388-b8ca-f73ed2d5fd63 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:38.549984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2f339-38f6-4388-b8ca-f73ed2d5fd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:38.550234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2f339-38f6-4388-b8ca-f73ed2d5fd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:38.550965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2f339-38f6-4388-b8ca-f73ed2d5fd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:38.553672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2f339-38f6-4388-b8ca-f73ed2d5fd63 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:38.574089 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3103/6227] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:38.574755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cefef3-5bbf-4fcd-b31f-0e28fb776398 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:38.586044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cefef3-5bbf-4fcd-b31f-0e28fb776398 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:38.598244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9146a-e732-4ee6-8339-7530fbe5359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:38.599340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9146a-e732-4ee6-8339-7530fbe5359c admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:38.599697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9146a-e732-4ee6-8339-7530fbe5359c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:38.600117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9146a-e732-4ee6-8339-7530fbe5359c admin admin] PATH_INFO: `/v3/projects/73e8a4798cd24c0086af113ca4cd14cb/users/fefdb267175244c280c9a966ec929dab/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:38.621885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9146a-e732-4ee6-8339-7530fbe5359c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73e8a4798cd24c0086af113ca4cd14cb, user_id=fefdb267175244c280c9a966ec929dab, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:38.626737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9146a-e732-4ee6-8339-7530fbe5359c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:38.657991 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3125/6228] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:38 2022] PUT /identity/v3/projects/73e8a4798cd24c0086af113ca4cd14cb/users/fefdb267175244c280c9a966ec929dab/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:38.662930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba10d2-c40a-4868-b6e8-56b1273c8349 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:38.663478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba10d2-c40a-4868-b6e8-56b1273c8349 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:38.663969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba10d2-c40a-4868-b6e8-56b1273c8349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:38.712652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9146a-e732-4ee6-8339-7530fbe5359c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:38.714751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-35a9146a-e732-4ee6-8339-7530fbe5359c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:38.724093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a4ba10d2-c40a-4868-b6e8-56b1273c8349 None None] MFA Rules not processed for user `fefdb267175244c280c9a966ec929dab`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:38.725595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a4ba10d2-c40a-4868-b6e8-56b1273c8349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:38.849731 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3104/6229] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:38.855945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba10d2-c40a-4868-b6e8-56b1273c8349 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:38.886273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba10d2-c40a-4868-b6e8-56b1273c8349 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:38.887339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9146a-e732-4ee6-8339-7530fbe5359c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:38.898849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06384d80-311e-4c6c-a59c-f9206a36d402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:38.899353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06384d80-311e-4c6c-a59c-f9206a36d402 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:38.899353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06384d80-311e-4c6c-a59c-f9206a36d402 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:38.899827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06384d80-311e-4c6c-a59c-f9206a36d402 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:38.902603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06384d80-311e-4c6c-a59c-f9206a36d402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:38.904736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f11908-2a60-4410-8854-0f0ad2fdd36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:38.905451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f11908-2a60-4410-8854-0f0ad2fdd36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:38.905726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f11908-2a60-4410-8854-0f0ad2fdd36a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:38.907738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f11908-2a60-4410-8854-0f0ad2fdd36a admin admin] PATH_INFO: `/v3/users/75450ebd919c4b6f8bcebe34b2531e91` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:38.909463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f11908-2a60-4410-8854-0f0ad2fdd36a admin admin] RBAC: Authorizing `identity:delete_user(user_id=75450ebd919c4b6f8bcebe34b2531e91)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:38.912019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06384d80-311e-4c6c-a59c-f9206a36d402 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:38.912913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f11908-2a60-4410-8854-0f0ad2fdd36a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:39.035738 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3105/6230] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:38 2022] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:39.040145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:39.041502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06384d80-311e-4c6c-a59c-f9206a36d402 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:39.047787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-06384d80-311e-4c6c-a59c-f9206a36d402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:39.068963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-74f11908-2a60-4410-8854-0f0ad2fdd36a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75450ebd919c4b6f8bcebe34b2531e91'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:39.073245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:39.132300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-74f11908-2a60-4410-8854-0f0ad2fdd36a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75450ebd919c4b6f8bcebe34b2531e91'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:39.134908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-74f11908-2a60-4410-8854-0f0ad2fdd36a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75450ebd919c4b6f8bcebe34b2531e91'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:39.136473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-74f11908-2a60-4410-8854-0f0ad2fdd36a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75450ebd919c4b6f8bcebe34b2531e91'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:39.155064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-74f11908-2a60-4410-8854-0f0ad2fdd36a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75450ebd919c4b6f8bcebe34b2531e91'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:39.201103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06384d80-311e-4c6c-a59c-f9206a36d402 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:39.208728 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3126/6231] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:38 2022] DELETE /identity/v3/users/75450ebd919c4b6f8bcebe34b2531e91 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:39.209671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f11908-2a60-4410-8854-0f0ad2fdd36a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:39.211779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-74f11908-2a60-4410-8854-0f0ad2fdd36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:39.216971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5555219-a2e9-4612-bd50-86ca216ff06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:39.218688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5555219-a2e9-4612-bd50-86ca216ff06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:39.218973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5555219-a2e9-4612-bd50-86ca216ff06b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:39.219249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5555219-a2e9-4612-bd50-86ca216ff06b admin admin] PATH_INFO: `/v3/projects/481ceccb448f41ccab292d071bcb1ca7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:39.229097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5555219-a2e9-4612-bd50-86ca216ff06b admin admin] RBAC: Authorizing `identity:delete_project(project_id=481ceccb448f41ccab292d071bcb1ca7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:39.231050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5555219-a2e9-4612-bd50-86ca216ff06b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:39.328585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a5555219-a2e9-4612-bd50-86ca216ff06b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '481ceccb448f41ccab292d071bcb1ca7', 'request_id': 'req-a5555219-a2e9-4612-bd50-86ca216ff06b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:39.337411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a5555219-a2e9-4612-bd50-86ca216ff06b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '481ceccb448f41ccab292d071bcb1ca7', 'request_id': 'req-a5555219-a2e9-4612-bd50-86ca216ff06b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:39.357539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a5555219-a2e9-4612-bd50-86ca216ff06b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '481ceccb448f41ccab292d071bcb1ca7', 'request_id': 'req-a5555219-a2e9-4612-bd50-86ca216ff06b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:39.387607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a5555219-a2e9-4612-bd50-86ca216ff06b admin admin] The token cache is being invalidate because project 481ceccb448f41ccab292d071bcb1ca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:39.387957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a5555219-a2e9-4612-bd50-86ca216ff06b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:39.389616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a5555219-a2e9-4612-bd50-86ca216ff06b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:39.397245 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3106/6232] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:39 2022] DELETE /identity/v3/projects/481ceccb448f41ccab292d071bcb1ca7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:39.399252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f11908-2a60-4410-8854-0f0ad2fdd36a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:39.399407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edfde0-96a6-4d93-96e2-7e0ae8f58d7e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:39.399644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edfde0-96a6-4d93-96e2-7e0ae8f58d7e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:39.399968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edfde0-96a6-4d93-96e2-7e0ae8f58d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:39.430222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-04edfde0-96a6-4d93-96e2-7e0ae8f58d7e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:39.432242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-04edfde0-96a6-4d93-96e2-7e0ae8f58d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:39.519615 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3107/6233] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:39.521468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df461b67-bab8-4fd9-8c32-a85586792dfe None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:39.521982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df461b67-bab8-4fd9-8c32-a85586792dfe None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:39.522452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df461b67-bab8-4fd9-8c32-a85586792dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:39.544277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-df461b67-bab8-4fd9-8c32-a85586792dfe None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:39.545617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-df461b67-bab8-4fd9-8c32-a85586792dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:39.553350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794d242-3d0e-4390-bc10-0633ba11b305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:39.554365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794d242-3d0e-4390-bc10-0633ba11b305 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:39.555012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794d242-3d0e-4390-bc10-0633ba11b305 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:39.555548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794d242-3d0e-4390-bc10-0633ba11b305 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:39.556546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794d242-3d0e-4390-bc10-0633ba11b305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:39.560516 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3108/6234] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:39.561580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df461b67-bab8-4fd9-8c32-a85586792dfe None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:39.561809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794d242-3d0e-4390-bc10-0633ba11b305 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:39.562985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-df461b67-bab8-4fd9-8c32-a85586792dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:39.595209 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3127/6235] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:39 2022] POST /identity/v3/users => generated 292 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:39.596867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b66c7-072b-4d86-8fb4-23868ae828f0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:39.597269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b66c7-072b-4d86-8fb4-23868ae828f0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:39.597874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b66c7-072b-4d86-8fb4-23868ae828f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:39.611137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:39.622398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-713b66c7-072b-4d86-8fb4-23868ae828f0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:39.623926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-713b66c7-072b-4d86-8fb4-23868ae828f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:39.638927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df461b67-bab8-4fd9-8c32-a85586792dfe None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:39.644861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1a96d-fdf9-4464-85a6-465cc8d51259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:39.645681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1a96d-fdf9-4464-85a6-465cc8d51259 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:39.645965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1a96d-fdf9-4464-85a6-465cc8d51259 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:39.646414 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3128/6236] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:39.646559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1a96d-fdf9-4464-85a6-465cc8d51259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:39.650485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b66c7-072b-4d86-8fb4-23868ae828f0 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:39.652239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-713b66c7-072b-4d86-8fb4-23868ae828f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:39.658195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1a96d-fdf9-4464-85a6-465cc8d51259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:39.660160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1a96d-fdf9-4464-85a6-465cc8d51259 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:39.665908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b66c7-072b-4d86-8fb4-23868ae828f0 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:39.671334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f8bfc-1281-43ab-a0de-11e1b6643236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:39.672018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f8bfc-1281-43ab-a0de-11e1b6643236 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:39.672202 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3109/6237] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:39.672784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f8bfc-1281-43ab-a0de-11e1b6643236 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:39.673066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f8bfc-1281-43ab-a0de-11e1b6643236 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:39.673234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1a96d-fdf9-4464-85a6-465cc8d51259 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:39.673983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f8bfc-1281-43ab-a0de-11e1b6643236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:39.675915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f8bfc-1281-43ab-a0de-11e1b6643236 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:39.684440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1a96d-fdf9-4464-85a6-465cc8d51259 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:39.690688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c12393-056c-41ff-8ed8-401987ac4eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:39.691007 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3129/6238] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:39.691868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c12393-056c-41ff-8ed8-401987ac4eaa admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:39.692186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c12393-056c-41ff-8ed8-401987ac4eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:39.692462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c12393-056c-41ff-8ed8-401987ac4eaa admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:39.693194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c12393-056c-41ff-8ed8-401987ac4eaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:39.693495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c12393-056c-41ff-8ed8-401987ac4eaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:39.695670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f8bfc-1281-43ab-a0de-11e1b6643236 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:39.695821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c12393-056c-41ff-8ed8-401987ac4eaa admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:39.707498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f8bfc-1281-43ab-a0de-11e1b6643236 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:39.711827 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3110/6239] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:39.713939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2342a-a5ee-4658-ab29-126085d5908f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:39.716707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2342a-a5ee-4658-ab29-126085d5908f admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:39.716707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2342a-a5ee-4658-ab29-126085d5908f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:39.716707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2342a-a5ee-4658-ab29-126085d5908f admin admin] PATH_INFO: `/v3/projects/046a9a5b347b4075af7a0f9459794496/users/1fe731f9621f4a108638f2a411275cf6/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:39.718519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c12393-056c-41ff-8ed8-401987ac4eaa admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:39.732910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c12393-056c-41ff-8ed8-401987ac4eaa admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:39.737028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2342a-a5ee-4658-ab29-126085d5908f admin admin] RBAC: Authorizing `identity:create_grant(project_id=046a9a5b347b4075af7a0f9459794496, user_id=1fe731f9621f4a108638f2a411275cf6, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:39.740000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac7cb7-3133-4dd9-b924-b691067cb5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:39.740203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2342a-a5ee-4658-ab29-126085d5908f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:39.741477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac7cb7-3133-4dd9-b924-b691067cb5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:39.742015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac7cb7-3133-4dd9-b924-b691067cb5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:39.742489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac7cb7-3133-4dd9-b924-b691067cb5f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:39.743383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac7cb7-3133-4dd9-b924-b691067cb5f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:39.746144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac7cb7-3133-4dd9-b924-b691067cb5f2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:39.766832 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3130/6240] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:39 2022] PUT /identity/v3/projects/046a9a5b347b4075af7a0f9459794496/users/1fe731f9621f4a108638f2a411275cf6/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:39.771819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2342a-a5ee-4658-ab29-126085d5908f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:39.780280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:39.811427 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3111/6241] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:39 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:39.815712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac7cb7-3133-4dd9-b924-b691067cb5f2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:39.894248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2342a-a5ee-4658-ab29-126085d5908f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:39.950214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac7cb7-3133-4dd9-b924-b691067cb5f2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:39.956832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ace78-d4af-4312-a945-84f3ac0c241e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:39.968580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ace78-d4af-4312-a945-84f3ac0c241e admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:39.968912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ace78-d4af-4312-a945-84f3ac0c241e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:39.969299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ace78-d4af-4312-a945-84f3ac0c241e admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:39.970129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ace78-d4af-4312-a945-84f3ac0c241e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:39.988721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ace78-d4af-4312-a945-84f3ac0c241e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:40.039547 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3112/6242] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:39 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:40.043832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ace78-d4af-4312-a945-84f3ac0c241e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:40.071185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ace78-d4af-4312-a945-84f3ac0c241e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:40.072343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49613a82-ab3b-48ac-ab16-796aa4896ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:40.073358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49613a82-ab3b-48ac-ab16-796aa4896ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:40.073870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49613a82-ab3b-48ac-ab16-796aa4896ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:40.074571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49613a82-ab3b-48ac-ab16-796aa4896ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:40.075543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49613a82-ab3b-48ac-ab16-796aa4896ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:40.077515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49613a82-ab3b-48ac-ab16-796aa4896ea4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:40.092772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ae2fe-3c82-45b8-a77f-da4ab5bb406f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:40.093560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ae2fe-3c82-45b8-a77f-da4ab5bb406f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:40.093907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ae2fe-3c82-45b8-a77f-da4ab5bb406f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:40.094189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ae2fe-3c82-45b8-a77f-da4ab5bb406f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:40.096601 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3131/6243] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:40.096750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ae2fe-3c82-45b8-a77f-da4ab5bb406f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:40.098834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ae2fe-3c82-45b8-a77f-da4ab5bb406f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:40.101314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49613a82-ab3b-48ac-ab16-796aa4896ea4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:40.118966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49613a82-ab3b-48ac-ab16-796aa4896ea4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:40.123354 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3113/6244] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:40.128779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ae2fe-3c82-45b8-a77f-da4ab5bb406f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:40.136861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676da6c-26bb-48d1-a74e-bd25758b2808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:40.143557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676da6c-26bb-48d1-a74e-bd25758b2808 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:40.143969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676da6c-26bb-48d1-a74e-bd25758b2808 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:40.144757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676da6c-26bb-48d1-a74e-bd25758b2808 admin admin] PATH_INFO: `/v3/projects/046a9a5b347b4075af7a0f9459794496/users/1fe731f9621f4a108638f2a411275cf6/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:40.164133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676da6c-26bb-48d1-a74e-bd25758b2808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=046a9a5b347b4075af7a0f9459794496, user_id=1fe731f9621f4a108638f2a411275cf6, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:40.164133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676da6c-26bb-48d1-a74e-bd25758b2808 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:40.170283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ae2fe-3c82-45b8-a77f-da4ab5bb406f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:40.181946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa48a89-37d1-4f8e-9386-2ff116a758ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:40.182982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa48a89-37d1-4f8e-9386-2ff116a758ac admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:40.183436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa48a89-37d1-4f8e-9386-2ff116a758ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:40.183814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa48a89-37d1-4f8e-9386-2ff116a758ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:40.186275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa48a89-37d1-4f8e-9386-2ff116a758ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:40.188236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa48a89-37d1-4f8e-9386-2ff116a758ac admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:40.188916 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3132/6245] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:40 2022] PUT /identity/v3/projects/046a9a5b347b4075af7a0f9459794496/users/1fe731f9621f4a108638f2a411275cf6/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:40.215187 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3114/6246] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:40.217052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676da6c-26bb-48d1-a74e-bd25758b2808 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:40.232514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa48a89-37d1-4f8e-9386-2ff116a758ac admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:40.237320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8fa48a89-37d1-4f8e-9386-2ff116a758ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:40.265599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa48a89-37d1-4f8e-9386-2ff116a758ac admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:40.397836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676da6c-26bb-48d1-a74e-bd25758b2808 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:40.405341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10999439-683e-4fa3-8177-766ac63aa57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:40.406622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10999439-683e-4fa3-8177-766ac63aa57b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:40.406913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10999439-683e-4fa3-8177-766ac63aa57b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:40.407195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10999439-683e-4fa3-8177-766ac63aa57b admin admin] PATH_INFO: `/v3/projects/3b085ae2fc89474b8e97442845641e02/users/d4a9fd58a33a4894890896f5b5a2c76b/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:40.416099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939a787-bed7-4025-9339-2e239f00fe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:40.417264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939a787-bed7-4025-9339-2e239f00fe41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:40.417556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939a787-bed7-4025-9339-2e239f00fe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:40.417835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939a787-bed7-4025-9339-2e239f00fe41 admin admin] PATH_INFO: `/v3/projects/4e593bc76e9c4d3bac7522fc5883796b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:40.419129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939a787-bed7-4025-9339-2e239f00fe41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e593bc76e9c4d3bac7522fc5883796b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:40.421152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939a787-bed7-4025-9339-2e239f00fe41 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:40.434834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:40.456073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10999439-683e-4fa3-8177-766ac63aa57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b085ae2fc89474b8e97442845641e02, user_id=d4a9fd58a33a4894890896f5b5a2c76b, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:40.461960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10999439-683e-4fa3-8177-766ac63aa57b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:40.490180 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3133/6247] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:40 2022] PUT /identity/v3/projects/3b085ae2fc89474b8e97442845641e02/users/d4a9fd58a33a4894890896f5b5a2c76b/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:40.491721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4128d-b11d-4f1d-9eed-4ef484d20fc8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:40.491871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4128d-b11d-4f1d-9eed-4ef484d20fc8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:40.492183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4128d-b11d-4f1d-9eed-4ef484d20fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:40.505813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d939a787-bed7-4025-9339-2e239f00fe41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e593bc76e9c4d3bac7522fc5883796b', 'request_id': 'req-d939a787-bed7-4025-9339-2e239f00fe41'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:40.517118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d939a787-bed7-4025-9339-2e239f00fe41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e593bc76e9c4d3bac7522fc5883796b', 'request_id': 'req-d939a787-bed7-4025-9339-2e239f00fe41'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:40.525436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d939a787-bed7-4025-9339-2e239f00fe41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e593bc76e9c4d3bac7522fc5883796b', 'request_id': 'req-d939a787-bed7-4025-9339-2e239f00fe41'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:40.530763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bdc4128d-b11d-4f1d-9eed-4ef484d20fc8 None None] MFA Rules not processed for user `1fe731f9621f4a108638f2a411275cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:40.532186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bdc4128d-b11d-4f1d-9eed-4ef484d20fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:40.538726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:40.547153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d939a787-bed7-4025-9339-2e239f00fe41 admin admin] The token cache is being invalidate because project 4e593bc76e9c4d3bac7522fc5883796b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:40.547533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d939a787-bed7-4025-9339-2e239f00fe41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:40.548341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d939a787-bed7-4025-9339-2e239f00fe41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:40.550247 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3115/6248] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:40 2022] DELETE /identity/v3/projects/4e593bc76e9c4d3bac7522fc5883796b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:40.552107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba89996-3490-49ec-ad8e-fd3995c04e41 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:40.552387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba89996-3490-49ec-ad8e-fd3995c04e41 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:40.552656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba89996-3490-49ec-ad8e-fd3995c04e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:40.583520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3ba89996-3490-49ec-ad8e-fd3995c04e41 None None] MFA Rules not processed for user `d4a9fd58a33a4894890896f5b5a2c76b`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:40.584771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3ba89996-3490-49ec-ad8e-fd3995c04e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:40.629407 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3134/6249] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:40 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:40.630437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4128d-b11d-4f1d-9eed-4ef484d20fc8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:40.631832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bdc4128d-b11d-4f1d-9eed-4ef484d20fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:40.660504 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3116/6250] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:40.661288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba89996-3490-49ec-ad8e-fd3995c04e41 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:40.671894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba89996-3490-49ec-ad8e-fd3995c04e41 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:40.677784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daef98-aecc-404c-93ae-1c3359cd0c6c tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:40.678495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daef98-aecc-404c-93ae-1c3359cd0c6c tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:40.678799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daef98-aecc-404c-93ae-1c3359cd0c6c tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:40.679075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daef98-aecc-404c-93ae-1c3359cd0c6c tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:40.679962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3daef98-aecc-404c-93ae-1c3359cd0c6c tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:40.681630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3daef98-aecc-404c-93ae-1c3359cd0c6c tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:40.699969 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3117/6251] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:25:40 2022] POST /identity/v3/domains => generated 276 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:40.699969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daef98-aecc-404c-93ae-1c3359cd0c6c tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:40.699969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c3daef98-aecc-404c-93ae-1c3359cd0c6c tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:40.703319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4128d-b11d-4f1d-9eed-4ef484d20fc8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:40.763539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daef98-aecc-404c-93ae-1c3359cd0c6c tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:40.765231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02268e58-4d4e-41e1-a0e2-88455dfee546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:40.766125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02268e58-4d4e-41e1-a0e2-88455dfee546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:40.766411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02268e58-4d4e-41e1-a0e2-88455dfee546 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:40.766692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02268e58-4d4e-41e1-a0e2-88455dfee546 admin admin] PATH_INFO: `/v3/users/26fa870fad3d45daa5f62d96804bad06` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:40.767149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b5b0d-8211-4343-bb8c-58f8bf76a37b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:40.767842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b5b0d-8211-4343-bb8c-58f8bf76a37b service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:40.767962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02268e58-4d4e-41e1-a0e2-88455dfee546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26fa870fad3d45daa5f62d96804bad06)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:40.768153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b5b0d-8211-4343-bb8c-58f8bf76a37b service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:40.768436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b5b0d-8211-4343-bb8c-58f8bf76a37b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:40.769878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02268e58-4d4e-41e1-a0e2-88455dfee546 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:40.803441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:40.824492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-02268e58-4d4e-41e1-a0e2-88455dfee546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26fa870fad3d45daa5f62d96804bad06'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:40.828289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:40.833223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-02268e58-4d4e-41e1-a0e2-88455dfee546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26fa870fad3d45daa5f62d96804bad06'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:40.834412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-02268e58-4d4e-41e1-a0e2-88455dfee546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26fa870fad3d45daa5f62d96804bad06'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:40.835565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-02268e58-4d4e-41e1-a0e2-88455dfee546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26fa870fad3d45daa5f62d96804bad06'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:40.837415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b5b0d-8211-4343-bb8c-58f8bf76a37b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:40.838925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b5b0d-8211-4343-bb8c-58f8bf76a37b service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:40.843682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-02268e58-4d4e-41e1-a0e2-88455dfee546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26fa870fad3d45daa5f62d96804bad06'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:40.848441 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3118/6252] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:40.849223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b5b0d-8211-4343-bb8c-58f8bf76a37b service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:40.863879 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3135/6253] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:40 2022] DELETE /identity/v3/users/26fa870fad3d45daa5f62d96804bad06 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:40.916192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b5b0d-8211-4343-bb8c-58f8bf76a37b service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:40.987807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b36b2-805e-46d4-9d2a-e81b73aeb9de tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:40.988542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b36b2-805e-46d4-9d2a-e81b73aeb9de tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:40.988822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b36b2-805e-46d4-9d2a-e81b73aeb9de tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:40.989132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b36b2-805e-46d4-9d2a-e81b73aeb9de tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:40.989884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b36b2-805e-46d4-9d2a-e81b73aeb9de tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:40.991861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b36b2-805e-46d4-9d2a-e81b73aeb9de tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:41.049164 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3119/6254] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:40 2022] POST /identity/v3/projects => generated 402 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:41.050743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02268e58-4d4e-41e1-a0e2-88455dfee546 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:41.052595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-02268e58-4d4e-41e1-a0e2-88455dfee546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:41.071482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02268e58-4d4e-41e1-a0e2-88455dfee546 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:41.192904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af580d2b-79ab-4bc0-a774-034b8b5fc6c7 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:41.193618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af580d2b-79ab-4bc0-a774-034b8b5fc6c7 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:41.193989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af580d2b-79ab-4bc0-a774-034b8b5fc6c7 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:41.194180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af580d2b-79ab-4bc0-a774-034b8b5fc6c7 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/groups` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:41.194896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af580d2b-79ab-4bc0-a774-034b8b5fc6c7 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:41.196135 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-af580d2b-79ab-4bc0-a774-034b8b5fc6c7 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:25:41.196135 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:25:41.196135 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:25:41.198326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af580d2b-79ab-4bc0-a774-034b8b5fc6c7 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:41.217840 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3136/6255] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:25:41 2022] POST /identity/v3/groups => generated 302 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:41.218037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b36b2-805e-46d4-9d2a-e81b73aeb9de tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:41.220901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-879b36b2-805e-46d4-9d2a-e81b73aeb9de tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:41.222312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af580d2b-79ab-4bc0-a774-034b8b5fc6c7 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:41.239885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af580d2b-79ab-4bc0-a774-034b8b5fc6c7 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:41.245438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cad6fd-c3bb-4969-a671-aaacaed88771 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:41.246139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cad6fd-c3bb-4969-a671-aaacaed88771 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:41.246422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cad6fd-c3bb-4969-a671-aaacaed88771 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:41.246696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cad6fd-c3bb-4969-a671-aaacaed88771 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:41.247473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cad6fd-c3bb-4969-a671-aaacaed88771 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:41.249635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cad6fd-c3bb-4969-a671-aaacaed88771 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:41.280214 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3137/6256] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:41 2022] POST /identity/v3/users => generated 442 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:41.281218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cad6fd-c3bb-4969-a671-aaacaed88771 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:41.302273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cad6fd-c3bb-4969-a671-aaacaed88771 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:41.307516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d3273-16db-47b0-8680-1e5451bf3f1b tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:41.308379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d3273-16db-47b0-8680-1e5451bf3f1b tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:41.308658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d3273-16db-47b0-8680-1e5451bf3f1b tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:41.309024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d3273-16db-47b0-8680-1e5451bf3f1b tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:41.309776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d3273-16db-47b0-8680-1e5451bf3f1b tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:41.311504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d3273-16db-47b0-8680-1e5451bf3f1b tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:41.323161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:41.332395 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3138/6257] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:25:41 2022] POST /identity/v3/roles => generated 240 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:41.341198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d3273-16db-47b0-8680-1e5451bf3f1b tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:41.354690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b36b2-805e-46d4-9d2a-e81b73aeb9de tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:41.358050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d3273-16db-47b0-8680-1e5451bf3f1b tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:41.361785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f705b-0734-401b-b20b-50be6af5c717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:41.363083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f705b-0734-401b-b20b-50be6af5c717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:41.363452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f705b-0734-401b-b20b-50be6af5c717 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:41.364439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f705b-0734-401b-b20b-50be6af5c717 admin admin] PATH_INFO: `/v3/projects/6dc6f85805db45598466cca40f82b411` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:41.365426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69cf67-5958-4531-9fdc-089506ea40cd tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:41.366281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f705b-0734-401b-b20b-50be6af5c717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc6f85805db45598466cca40f82b411)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:41.366475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69cf67-5958-4531-9fdc-089506ea40cd tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:41.366825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69cf67-5958-4531-9fdc-089506ea40cd tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:41.367182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69cf67-5958-4531-9fdc-089506ea40cd tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/de4c4d80093b4243a09eff282e488858/groups/d880ba6ceccd4a0fb6979236c2bd0cdc/roles/94bcebd629504bbd921dcc5d083da375/inherited_to_projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:41.369383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f705b-0734-401b-b20b-50be6af5c717 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:41.377858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69cf67-5958-4531-9fdc-089506ea40cd tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:create_grant(project_id=de4c4d80093b4243a09eff282e488858, group_id=d880ba6ceccd4a0fb6979236c2bd0cdc, role_id=94bcebd629504bbd921dcc5d083da375)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:41.381343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69cf67-5958-4531-9fdc-089506ea40cd tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:41.396988 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3139/6258] 10.222.0.43 () {60 vars in 1584 bytes} [Sat Jul 2 21:25:41 2022] PUT /identity/v3/OS-INHERIT/projects/de4c4d80093b4243a09eff282e488858/groups/d880ba6ceccd4a0fb6979236c2bd0cdc/roles/94bcebd629504bbd921dcc5d083da375/inherited_to_projects => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:41.401887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69cf67-5958-4531-9fdc-089506ea40cd tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:41.444132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b14f705b-0734-401b-b20b-50be6af5c717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc6f85805db45598466cca40f82b411', 'request_id': 'req-b14f705b-0734-401b-b20b-50be6af5c717'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:41.450870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b14f705b-0734-401b-b20b-50be6af5c717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc6f85805db45598466cca40f82b411', 'request_id': 'req-b14f705b-0734-401b-b20b-50be6af5c717'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:41.462465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b14f705b-0734-401b-b20b-50be6af5c717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc6f85805db45598466cca40f82b411', 'request_id': 'req-b14f705b-0734-401b-b20b-50be6af5c717'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:41.477119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b14f705b-0734-401b-b20b-50be6af5c717 admin admin] The token cache is being invalidate because project 6dc6f85805db45598466cca40f82b411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:41.477407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b14f705b-0734-401b-b20b-50be6af5c717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:41.477887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69cf67-5958-4531-9fdc-089506ea40cd tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:41.478036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b14f705b-0734-401b-b20b-50be6af5c717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:41.480136 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3120/6259] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:41 2022] DELETE /identity/v3/projects/6dc6f85805db45598466cca40f82b411 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:41.485495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f705b-0734-401b-b20b-50be6af5c717 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:41.487008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b14f705b-0734-401b-b20b-50be6af5c717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:41.501114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:41.547249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8877a-38c2-4f5d-9202-1c8e1ae69b94 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:41.548222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8877a-38c2-4f5d-9202-1c8e1ae69b94 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:41.548510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8877a-38c2-4f5d-9202-1c8e1ae69b94 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:41.549586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8877a-38c2-4f5d-9202-1c8e1ae69b94 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/de4c4d80093b4243a09eff282e488858/groups/d880ba6ceccd4a0fb6979236c2bd0cdc/roles/94bcebd629504bbd921dcc5d083da375/inherited_to_projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:41.551229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8877a-38c2-4f5d-9202-1c8e1ae69b94 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:check_grant(project_id=de4c4d80093b4243a09eff282e488858, group_id=d880ba6ceccd4a0fb6979236c2bd0cdc, role_id=94bcebd629504bbd921dcc5d083da375)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:41.552639 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-d0b8877a-38c2-4f5d-9202-1c8e1ae69b94 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:25:41.552639 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:25:41.552639 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:25:41.554584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8877a-38c2-4f5d-9202-1c8e1ae69b94 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:41.562211 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3140/6260] 10.222.0.43 () {58 vars in 1566 bytes} [Sat Jul 2 21:25:41 2022] HEAD /identity/v3/OS-INHERIT/projects/de4c4d80093b4243a09eff282e488858/groups/d880ba6ceccd4a0fb6979236c2bd0cdc/roles/94bcebd629504bbd921dcc5d083da375/inherited_to_projects => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:41.566506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8877a-38c2-4f5d-9202-1c8e1ae69b94 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:41.568210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d0b8877a-38c2-4f5d-9202-1c8e1ae69b94 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:41.570357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f705b-0734-401b-b20b-50be6af5c717 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:41.575105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fdd1e-ce6c-4723-a233-057208c24da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:41.576067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fdd1e-ce6c-4723-a233-057208c24da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:41.576355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fdd1e-ce6c-4723-a233-057208c24da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:41.576632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fdd1e-ce6c-4723-a233-057208c24da4 admin admin] PATH_INFO: `/v3/users/b56dea7fd5f848e498035be609d72aa0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:41.577931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fdd1e-ce6c-4723-a233-057208c24da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b56dea7fd5f848e498035be609d72aa0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:41.579880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fdd1e-ce6c-4723-a233-057208c24da4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:41.581178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8877a-38c2-4f5d-9202-1c8e1ae69b94 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:41.587589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ca5cf-76d4-4afd-b1fa-bd61b7328800 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:41.590176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ca5cf-76d4-4afd-b1fa-bd61b7328800 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:41.590355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ca5cf-76d4-4afd-b1fa-bd61b7328800 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:41.590628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ca5cf-76d4-4afd-b1fa-bd61b7328800 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/de4c4d80093b4243a09eff282e488858/groups/d880ba6ceccd4a0fb6979236c2bd0cdc/roles/94bcebd629504bbd921dcc5d083da375/inherited_to_projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:41.593093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ca5cf-76d4-4afd-b1fa-bd61b7328800 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=de4c4d80093b4243a09eff282e488858, group_id=d880ba6ceccd4a0fb6979236c2bd0cdc, role_id=94bcebd629504bbd921dcc5d083da375)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:41.594156 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-a85ca5cf-76d4-4afd-b1fa-bd61b7328800 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:25:41.594156 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:25:41.594156 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:25:41.596278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ca5cf-76d4-4afd-b1fa-bd61b7328800 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:41.605154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a85ca5cf-76d4-4afd-b1fa-bd61b7328800 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invalidating the token cache because role 94bcebd629504bbd921dcc5d083da375 was removed from group d880ba6ceccd4a0fb6979236c2bd0cdc on project de4c4d80093b4243a09eff282e488858. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:41.605474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a85ca5cf-76d4-4afd-b1fa-bd61b7328800 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:41.606169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a85ca5cf-76d4-4afd-b1fa-bd61b7328800 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:41.626724 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3141/6261] 10.222.0.43 () {58 vars in 1568 bytes} [Sat Jul 2 21:25:41 2022] DELETE /identity/v3/OS-INHERIT/projects/de4c4d80093b4243a09eff282e488858/groups/d880ba6ceccd4a0fb6979236c2bd0cdc/roles/94bcebd629504bbd921dcc5d083da375/inherited_to_projects => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:41.631128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ca5cf-76d4-4afd-b1fa-bd61b7328800 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:41.633241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a85ca5cf-76d4-4afd-b1fa-bd61b7328800 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:41.676255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fd2fdd1e-ce6c-4723-a233-057208c24da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b56dea7fd5f848e498035be609d72aa0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:41.687203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fd2fdd1e-ce6c-4723-a233-057208c24da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b56dea7fd5f848e498035be609d72aa0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:41.696737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fd2fdd1e-ce6c-4723-a233-057208c24da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b56dea7fd5f848e498035be609d72aa0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:41.697547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fd2fdd1e-ce6c-4723-a233-057208c24da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b56dea7fd5f848e498035be609d72aa0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:41.698177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fd2fdd1e-ce6c-4723-a233-057208c24da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b56dea7fd5f848e498035be609d72aa0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:41.716838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ca5cf-76d4-4afd-b1fa-bd61b7328800 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:41.718161 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3121/6262] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:41 2022] DELETE /identity/v3/users/b56dea7fd5f848e498035be609d72aa0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:41.781972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8a333-bf70-4416-a275-8e29cfe6e62b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:41.782536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8a333-bf70-4416-a275-8e29cfe6e62b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:41.782685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8a333-bf70-4416-a275-8e29cfe6e62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:41.789528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:41.794638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67ceef-0d3b-4e18-9aec-3fa1057be985 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:41.795814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67ceef-0d3b-4e18-9aec-3fa1057be985 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:41.796248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67ceef-0d3b-4e18-9aec-3fa1057be985 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:41.796787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67ceef-0d3b-4e18-9aec-3fa1057be985 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/roles/94bcebd629504bbd921dcc5d083da375` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:41.799350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67ceef-0d3b-4e18-9aec-3fa1057be985 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:delete_role(role_id=94bcebd629504bbd921dcc5d083da375)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:41.803194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67ceef-0d3b-4e18-9aec-3fa1057be985 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:41.804158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-cfd8a333-bf70-4416-a275-8e29cfe6e62b None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:41.806842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cfd8a333-bf70-4416-a275-8e29cfe6e62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:41.858679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bf67ceef-0d3b-4e18-9aec-3fa1057be985 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invalidating the token cache because role 94bcebd629504bbd921dcc5d083da375 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:41.859111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bf67ceef-0d3b-4e18-9aec-3fa1057be985 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:41.860449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bf67ceef-0d3b-4e18-9aec-3fa1057be985 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:41.863064 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3142/6263] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:41 2022] DELETE /identity/v3/roles/94bcebd629504bbd921dcc5d083da375 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:41.868272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67ceef-0d3b-4e18-9aec-3fa1057be985 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:41.869953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bf67ceef-0d3b-4e18-9aec-3fa1057be985 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:41.890208 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3122/6264] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:25:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:41.897788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:41.904595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8a333-bf70-4416-a275-8e29cfe6e62b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:41.906182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cfd8a333-bf70-4416-a275-8e29cfe6e62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:41.948684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67ceef-0d3b-4e18-9aec-3fa1057be985 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:41.958957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750fa79-9ed7-4594-9254-0956b4ff38e0 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:41.960950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750fa79-9ed7-4594-9254-0956b4ff38e0 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:41.961245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750fa79-9ed7-4594-9254-0956b4ff38e0 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:41.961528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750fa79-9ed7-4594-9254-0956b4ff38e0 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:41.963012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750fa79-9ed7-4594-9254-0956b4ff38e0 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:41.964730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750fa79-9ed7-4594-9254-0956b4ff38e0 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:41.983010 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3143/6265] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:25:41 2022] POST /identity/v3/roles => generated 240 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:41.987361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750fa79-9ed7-4594-9254-0956b4ff38e0 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:41.998572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750fa79-9ed7-4594-9254-0956b4ff38e0 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:42.005222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d433ba-fda0-4136-9fdb-30584af00755 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:42.005649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8a333-bf70-4416-a275-8e29cfe6e62b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:42.006375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d433ba-fda0-4136-9fdb-30584af00755 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:42.006638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d433ba-fda0-4136-9fdb-30584af00755 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:42.007026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d433ba-fda0-4136-9fdb-30584af00755 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/de4c4d80093b4243a09eff282e488858/users/816968d3d59f49189f1c0afd88692725/roles/e0d91ca19d204c9bb0613c39f10f5313/inherited_to_projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:42.032142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d433ba-fda0-4136-9fdb-30584af00755 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:create_grant(project_id=de4c4d80093b4243a09eff282e488858, user_id=816968d3d59f49189f1c0afd88692725, role_id=e0d91ca19d204c9bb0613c39f10f5313)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:42.032636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d433ba-fda0-4136-9fdb-30584af00755 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:42.050640 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3144/6266] 10.222.0.43 () {60 vars in 1581 bytes} [Sat Jul 2 21:25:41 2022] PUT /identity/v3/OS-INHERIT/projects/de4c4d80093b4243a09eff282e488858/users/816968d3d59f49189f1c0afd88692725/roles/e0d91ca19d204c9bb0613c39f10f5313/inherited_to_projects => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:42.055069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d433ba-fda0-4136-9fdb-30584af00755 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:42.055069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-48d433ba-fda0-4136-9fdb-30584af00755 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:42.084302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bbc444-73fb-400a-8c11-d2b3e63ef55d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:42.084979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbc444-73fb-400a-8c11-d2b3e63ef55d service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:42.085307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbc444-73fb-400a-8c11-d2b3e63ef55d service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:42.085582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbc444-73fb-400a-8c11-d2b3e63ef55d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:42.119322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:42.134299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d433ba-fda0-4136-9fdb-30584af00755 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:42.139039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfecf8-445e-4732-91f0-c8fa2015f11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:42.139920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfecf8-445e-4732-91f0-c8fa2015f11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:42.140241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfecf8-445e-4732-91f0-c8fa2015f11d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:42.140560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfecf8-445e-4732-91f0-c8fa2015f11d admin admin] PATH_INFO: `/v3/projects/b3ad0fc96fc547a8a90438e2ef6fe31c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:42.141804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfecf8-445e-4732-91f0-c8fa2015f11d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ad0fc96fc547a8a90438e2ef6fe31c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:42.144010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfecf8-445e-4732-91f0-c8fa2015f11d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:42.145287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bbc444-73fb-400a-8c11-d2b3e63ef55d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:42.146931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bbc444-73fb-400a-8c11-d2b3e63ef55d service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:42.155493 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3123/6267] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:25:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:25:42.156318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bbc444-73fb-400a-8c11-d2b3e63ef55d service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:42.176809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bbc444-73fb-400a-8c11-d2b3e63ef55d service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:42.199461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eccfecf8-445e-4732-91f0-c8fa2015f11d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ad0fc96fc547a8a90438e2ef6fe31c', 'request_id': 'req-eccfecf8-445e-4732-91f0-c8fa2015f11d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:42.211370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eccfecf8-445e-4732-91f0-c8fa2015f11d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ad0fc96fc547a8a90438e2ef6fe31c', 'request_id': 'req-eccfecf8-445e-4732-91f0-c8fa2015f11d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:42.221752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eccfecf8-445e-4732-91f0-c8fa2015f11d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ad0fc96fc547a8a90438e2ef6fe31c', 'request_id': 'req-eccfecf8-445e-4732-91f0-c8fa2015f11d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:42.240616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eccfecf8-445e-4732-91f0-c8fa2015f11d admin admin] The token cache is being invalidate because project b3ad0fc96fc547a8a90438e2ef6fe31c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:42.240951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eccfecf8-445e-4732-91f0-c8fa2015f11d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:42.243588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-eccfecf8-445e-4732-91f0-c8fa2015f11d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:42.245838 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3145/6268] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:42 2022] DELETE /identity/v3/projects/b3ad0fc96fc547a8a90438e2ef6fe31c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:42.251104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20771d-e0a4-453c-ad9a-eb52051b3478 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:42.251743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20771d-e0a4-453c-ad9a-eb52051b3478 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:42.252509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20771d-e0a4-453c-ad9a-eb52051b3478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:42.268820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f383537-98a3-4587-814b-3ad0d98b7330 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:42.269751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f383537-98a3-4587-814b-3ad0d98b7330 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:42.270194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f383537-98a3-4587-814b-3ad0d98b7330 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:42.270595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f383537-98a3-4587-814b-3ad0d98b7330 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/de4c4d80093b4243a09eff282e488858/users/816968d3d59f49189f1c0afd88692725/roles/e0d91ca19d204c9bb0613c39f10f5313/inherited_to_projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:42.274532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f383537-98a3-4587-814b-3ad0d98b7330 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:check_grant(project_id=de4c4d80093b4243a09eff282e488858, user_id=816968d3d59f49189f1c0afd88692725, role_id=e0d91ca19d204c9bb0613c39f10f5313)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:42.276899 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-7f383537-98a3-4587-814b-3ad0d98b7330 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:25:42.276899 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:25:42.276899 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:25:42.279277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-eb20771d-e0a4-453c-ad9a-eb52051b3478 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:42.279869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f383537-98a3-4587-814b-3ad0d98b7330 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:42.286047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-eb20771d-e0a4-453c-ad9a-eb52051b3478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:42.299323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:42.304881 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3124/6269] 10.222.0.43 () {58 vars in 1563 bytes} [Sat Jul 2 21:25:42 2022] HEAD /identity/v3/OS-INHERIT/projects/de4c4d80093b4243a09eff282e488858/users/816968d3d59f49189f1c0afd88692725/roles/e0d91ca19d204c9bb0613c39f10f5313/inherited_to_projects => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:42.309275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f383537-98a3-4587-814b-3ad0d98b7330 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:42.312364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7f383537-98a3-4587-814b-3ad0d98b7330 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:42.328492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f383537-98a3-4587-814b-3ad0d98b7330 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:42.389590 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3146/6270] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:42.402120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffd3b3-0de3-4a30-be66-06a504546873 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:42.402442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffd3b3-0de3-4a30-be66-06a504546873 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:42.402771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffd3b3-0de3-4a30-be66-06a504546873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:42.414715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6655e-1d81-4ad2-8dc7-eae156a91264 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:42.416308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6655e-1d81-4ad2-8dc7-eae156a91264 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:42.416690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6655e-1d81-4ad2-8dc7-eae156a91264 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:42.417296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6655e-1d81-4ad2-8dc7-eae156a91264 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/de4c4d80093b4243a09eff282e488858/users/816968d3d59f49189f1c0afd88692725/roles/e0d91ca19d204c9bb0613c39f10f5313/inherited_to_projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:42.420316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6655e-1d81-4ad2-8dc7-eae156a91264 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=de4c4d80093b4243a09eff282e488858, user_id=816968d3d59f49189f1c0afd88692725, role_id=e0d91ca19d204c9bb0613c39f10f5313)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:42.421508 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-e7d6655e-1d81-4ad2-8dc7-eae156a91264 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:25:42.421508 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:25:42.421508 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:25:42.424721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6655e-1d81-4ad2-8dc7-eae156a91264 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:42.431366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7d6655e-1d81-4ad2-8dc7-eae156a91264 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invalidating the token cache because role e0d91ca19d204c9bb0613c39f10f5313 was removed from user 816968d3d59f49189f1c0afd88692725 on project de4c4d80093b4243a09eff282e488858. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:42.431726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7d6655e-1d81-4ad2-8dc7-eae156a91264 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:42.432011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e4ffd3b3-0de3-4a30-be66-06a504546873 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:42.432758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7d6655e-1d81-4ad2-8dc7-eae156a91264 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:42.433201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e4ffd3b3-0de3-4a30-be66-06a504546873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:42.442595 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3147/6271] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:42.448597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffd3b3-0de3-4a30-be66-06a504546873 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:42.453518 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3125/6272] 10.222.0.43 () {58 vars in 1565 bytes} [Sat Jul 2 21:25:42 2022] DELETE /identity/v3/OS-INHERIT/projects/de4c4d80093b4243a09eff282e488858/users/816968d3d59f49189f1c0afd88692725/roles/e0d91ca19d204c9bb0613c39f10f5313/inherited_to_projects => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:42.458019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6655e-1d81-4ad2-8dc7-eae156a91264 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:42.460681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e7d6655e-1d81-4ad2-8dc7-eae156a91264 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:42.463905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffd3b3-0de3-4a30-be66-06a504546873 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:42.537646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098f34c-58ea-438b-b7a6-7040901c32ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:42.538292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098f34c-58ea-438b-b7a6-7040901c32ef admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:42.538578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098f34c-58ea-438b-b7a6-7040901c32ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:42.538887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098f34c-58ea-438b-b7a6-7040901c32ef admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:42.539635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098f34c-58ea-438b-b7a6-7040901c32ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:42.539944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098f34c-58ea-438b-b7a6-7040901c32ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:42.541762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098f34c-58ea-438b-b7a6-7040901c32ef admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:42.543248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6655e-1d81-4ad2-8dc7-eae156a91264 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:42.549167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16914bc1-7c8c-4089-be2f-37ab63306407 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:42.550460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16914bc1-7c8c-4089-be2f-37ab63306407 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:42.551013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16914bc1-7c8c-4089-be2f-37ab63306407 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:42.551795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16914bc1-7c8c-4089-be2f-37ab63306407 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/roles/e0d91ca19d204c9bb0613c39f10f5313` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:42.553790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16914bc1-7c8c-4089-be2f-37ab63306407 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e0d91ca19d204c9bb0613c39f10f5313)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:42.555958 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3148/6273] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:25:42.556148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16914bc1-7c8c-4089-be2f-37ab63306407 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:42.558930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:42.560813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098f34c-58ea-438b-b7a6-7040901c32ef admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:42.573060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098f34c-58ea-438b-b7a6-7040901c32ef admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:42.579273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd48eaa-fe9c-4f43-936e-46566271f116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:42.580270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd48eaa-fe9c-4f43-936e-46566271f116 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:42.580656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd48eaa-fe9c-4f43-936e-46566271f116 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:42.581019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd48eaa-fe9c-4f43-936e-46566271f116 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:42.581931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd48eaa-fe9c-4f43-936e-46566271f116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:42.584190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd48eaa-fe9c-4f43-936e-46566271f116 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:42.615736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-16914bc1-7c8c-4089-be2f-37ab63306407 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invalidating the token cache because role e0d91ca19d204c9bb0613c39f10f5313 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:42.615736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-16914bc1-7c8c-4089-be2f-37ab63306407 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:42.615736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-16914bc1-7c8c-4089-be2f-37ab63306407 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:42.618576 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3126/6274] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:42 2022] DELETE /identity/v3/roles/e0d91ca19d204c9bb0613c39f10f5313 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:42.622489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16914bc1-7c8c-4089-be2f-37ab63306407 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:42.622673 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3149/6275] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:42 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:42.622790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-16914bc1-7c8c-4089-be2f-37ab63306407 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:42.623760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd48eaa-fe9c-4f43-936e-46566271f116 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:42.626644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-abd48eaa-fe9c-4f43-936e-46566271f116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:42.709529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16914bc1-7c8c-4089-be2f-37ab63306407 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:42.713065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd48eaa-fe9c-4f43-936e-46566271f116 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:42.718127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1d8e5-aba9-48b2-84f3-bcdc1d29d816 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:42.718926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1d8e5-aba9-48b2-84f3-bcdc1d29d816 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:42.719304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1d8e5-aba9-48b2-84f3-bcdc1d29d816 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:42.719674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1d8e5-aba9-48b2-84f3-bcdc1d29d816 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:42.721507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1d8e5-aba9-48b2-84f3-bcdc1d29d816 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:42.722471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1d8e5-aba9-48b2-84f3-bcdc1d29d816 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:42.744409 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3150/6276] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:25:42 2022] POST /identity/v3/roles => generated 240 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:42.744409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1d8e5-aba9-48b2-84f3-bcdc1d29d816 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:42.749745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f1b1d8e5-aba9-48b2-84f3-bcdc1d29d816 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:42.769958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:42.777043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9d52e-ddae-49bb-b69e-7e69f295ec0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:42.777935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9d52e-ddae-49bb-b69e-7e69f295ec0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:42.778214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9d52e-ddae-49bb-b69e-7e69f295ec0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:42.778485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9d52e-ddae-49bb-b69e-7e69f295ec0c admin admin] PATH_INFO: `/v3/users/d4a9fd58a33a4894890896f5b5a2c76b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:42.779692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9d52e-ddae-49bb-b69e-7e69f295ec0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a9fd58a33a4894890896f5b5a2c76b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:42.781967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9d52e-ddae-49bb-b69e-7e69f295ec0c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:42.826738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1d8e5-aba9-48b2-84f3-bcdc1d29d816 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:42.831736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1936a-b100-43e3-8d7b-218ce06240e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:42.832452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1936a-b100-43e3-8d7b-218ce06240e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:42.832734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1936a-b100-43e3-8d7b-218ce06240e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:42.833008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1936a-b100-43e3-8d7b-218ce06240e6 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:42.833847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1936a-b100-43e3-8d7b-218ce06240e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:42.835794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1936a-b100-43e3-8d7b-218ce06240e6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:42.838222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c0c9d52e-ddae-49bb-b69e-7e69f295ec0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a9fd58a33a4894890896f5b5a2c76b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:42.848331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c0c9d52e-ddae-49bb-b69e-7e69f295ec0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a9fd58a33a4894890896f5b5a2c76b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:42.856097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c0c9d52e-ddae-49bb-b69e-7e69f295ec0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a9fd58a33a4894890896f5b5a2c76b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:42.856854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c0c9d52e-ddae-49bb-b69e-7e69f295ec0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a9fd58a33a4894890896f5b5a2c76b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:42.857746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c0c9d52e-ddae-49bb-b69e-7e69f295ec0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a9fd58a33a4894890896f5b5a2c76b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:42.857881 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3151/6277] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:42 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:42.858523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1936a-b100-43e3-8d7b-218ce06240e6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:42.860093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d4a1936a-b100-43e3-8d7b-218ce06240e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:42.874056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1936a-b100-43e3-8d7b-218ce06240e6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:42.874226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:42.879259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e6a53-da51-4a7b-af01-42e18e94fa4e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:42.880214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e6a53-da51-4a7b-af01-42e18e94fa4e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:42.880505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e6a53-da51-4a7b-af01-42e18e94fa4e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:42.880789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e6a53-da51-4a7b-af01-42e18e94fa4e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/groups/d880ba6ceccd4a0fb6979236c2bd0cdc/roles/3ef612f20dd0484f879868b8d42d1c29/inherited_to_projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:42.881370 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3127/6278] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:42 2022] DELETE /identity/v3/users/d4a9fd58a33a4894890896f5b5a2c76b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:42.882432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9d52e-ddae-49bb-b69e-7e69f295ec0c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:42.883632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e6a53-da51-4a7b-af01-42e18e94fa4e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=08677c7982ba445f92bc41342307ca52, group_id=d880ba6ceccd4a0fb6979236c2bd0cdc, role_id=3ef612f20dd0484f879868b8d42d1c29)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:42.885556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c0c9d52e-ddae-49bb-b69e-7e69f295ec0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:42.886654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e6a53-da51-4a7b-af01-42e18e94fa4e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:42.904122 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3152/6279] 10.222.0.43 () {60 vars in 1581 bytes} [Sat Jul 2 21:25:42 2022] PUT /identity/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/groups/d880ba6ceccd4a0fb6979236c2bd0cdc/roles/3ef612f20dd0484f879868b8d42d1c29/inherited_to_projects => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:42.906692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2fe63-2af0-44ba-b39d-965a7d8db2ab None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:42.907358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2fe63-2af0-44ba-b39d-965a7d8db2ab None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:42.907774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2fe63-2af0-44ba-b39d-965a7d8db2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:42.928868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-78c2fe63-2af0-44ba-b39d-965a7d8db2ab None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:42.932489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-78c2fe63-2af0-44ba-b39d-965a7d8db2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:42.965515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9d52e-ddae-49bb-b69e-7e69f295ec0c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:43.000495 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3153/6280] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:43.001517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2fe63-2af0-44ba-b39d-965a7d8db2ab None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:43.041430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a1485-8158-4b63-b3b5-88e4e92362e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:43.042118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a1485-8158-4b63-b3b5-88e4e92362e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:43.042404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a1485-8158-4b63-b3b5-88e4e92362e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:43.042687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a1485-8158-4b63-b3b5-88e4e92362e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:43.043556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a1485-8158-4b63-b3b5-88e4e92362e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:43.045482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a1485-8158-4b63-b3b5-88e4e92362e1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:43.057526 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3128/6281] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:42 2022] GET /identity/v3/roles => generated 1651 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:43.061436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a1485-8158-4b63-b3b5-88e4e92362e1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:43.063188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9f7a1485-8158-4b63-b3b5-88e4e92362e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:43.100619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2fe63-2af0-44ba-b39d-965a7d8db2ab None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:43.105346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6be574-76df-4d32-93ff-8023a75552f5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:43.106344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6be574-76df-4d32-93ff-8023a75552f5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:43.106627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6be574-76df-4d32-93ff-8023a75552f5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:43.106907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6be574-76df-4d32-93ff-8023a75552f5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/groups/d880ba6ceccd4a0fb6979236c2bd0cdc/roles/inherited_to_projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:43.108693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6be574-76df-4d32-93ff-8023a75552f5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=08677c7982ba445f92bc41342307ca52, group_id=d880ba6ceccd4a0fb6979236c2bd0cdc)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:43.109864 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-2c6be574-76df-4d32-93ff-8023a75552f5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:25:43.109864 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:25:43.109864 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:25:43.111753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6be574-76df-4d32-93ff-8023a75552f5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:43.124585 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3154/6282] 10.222.0.43 () {58 vars in 1463 bytes} [Sat Jul 2 21:25:43 2022] GET /identity/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/groups/d880ba6ceccd4a0fb6979236c2bd0cdc/roles/inherited_to_projects => generated 448 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:43.125402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6be574-76df-4d32-93ff-8023a75552f5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:43.138294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6be574-76df-4d32-93ff-8023a75552f5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:43.138475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a1485-8158-4b63-b3b5-88e4e92362e1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:43.142155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71d04d-3497-4e9f-ae84-2560791269e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:43.142844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71d04d-3497-4e9f-ae84-2560791269e7 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:43.143003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1987e-312b-4c84-b2d6-dc4054b7f13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:43.143126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71d04d-3497-4e9f-ae84-2560791269e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:43.143427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71d04d-3497-4e9f-ae84-2560791269e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:43.143550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1987e-312b-4c84-b2d6-dc4054b7f13a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:43.143816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1987e-312b-4c84-b2d6-dc4054b7f13a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:43.144125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1987e-312b-4c84-b2d6-dc4054b7f13a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:43.144843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1987e-312b-4c84-b2d6-dc4054b7f13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:43.146439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1987e-312b-4c84-b2d6-dc4054b7f13a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:43.152829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71d04d-3497-4e9f-ae84-2560791269e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:43.154395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71d04d-3497-4e9f-ae84-2560791269e7 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:43.157660 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3155/6283] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:43 2022] GET /identity/v3/roles => generated 1651 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:43.158578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1987e-312b-4c84-b2d6-dc4054b7f13a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:43.165560 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3129/6284] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:43.166356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71d04d-3497-4e9f-ae84-2560791269e7 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:43.178922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1987e-312b-4c84-b2d6-dc4054b7f13a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:43.179294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71d04d-3497-4e9f-ae84-2560791269e7 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:43.186961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80881f6c-6ba4-45f1-9c90-62a801f885b0 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:43.187694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80881f6c-6ba4-45f1-9c90-62a801f885b0 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:43.188129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80881f6c-6ba4-45f1-9c90-62a801f885b0 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:43.188421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80881f6c-6ba4-45f1-9c90-62a801f885b0 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/groups/d880ba6ceccd4a0fb6979236c2bd0cdc/roles/3ef612f20dd0484f879868b8d42d1c29/inherited_to_projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:43.188553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a327e-0095-4c50-8cd7-73985b5a6cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:43.189435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a327e-0095-4c50-8cd7-73985b5a6cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:43.189978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a327e-0095-4c50-8cd7-73985b5a6cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:43.190246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a327e-0095-4c50-8cd7-73985b5a6cc3 admin admin] PATH_INFO: `/v3/projects/a9f130b860ce459491ddbf57ddf9e926/users/db0af998d6da410a925c96e01cac2d04/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:43.191431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80881f6c-6ba4-45f1-9c90-62a801f885b0 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=08677c7982ba445f92bc41342307ca52, group_id=d880ba6ceccd4a0fb6979236c2bd0cdc, role_id=3ef612f20dd0484f879868b8d42d1c29)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:43.196529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80881f6c-6ba4-45f1-9c90-62a801f885b0 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:43.205729 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3156/6285] 10.222.0.43 () {58 vars in 1563 bytes} [Sat Jul 2 21:25:43 2022] HEAD /identity/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/groups/d880ba6ceccd4a0fb6979236c2bd0cdc/roles/3ef612f20dd0484f879868b8d42d1c29/inherited_to_projects => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:43.211330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80881f6c-6ba4-45f1-9c90-62a801f885b0 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:43.212226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a327e-0095-4c50-8cd7-73985b5a6cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9f130b860ce459491ddbf57ddf9e926, user_id=db0af998d6da410a925c96e01cac2d04, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:43.215307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a327e-0095-4c50-8cd7-73985b5a6cc3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:43.219343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:43.225068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80881f6c-6ba4-45f1-9c90-62a801f885b0 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:43.233268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ef586-e8bf-48c6-bd96-347834ee60e8 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:43.234136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ef586-e8bf-48c6-bd96-347834ee60e8 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:43.234423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ef586-e8bf-48c6-bd96-347834ee60e8 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:43.234548 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3130/6286] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:43 2022] PUT /identity/v3/projects/a9f130b860ce459491ddbf57ddf9e926/users/db0af998d6da410a925c96e01cac2d04/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:43.234829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ef586-e8bf-48c6-bd96-347834ee60e8 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/groups/d880ba6ceccd4a0fb6979236c2bd0cdc/roles/3ef612f20dd0484f879868b8d42d1c29/inherited_to_projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:43.237633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ef586-e8bf-48c6-bd96-347834ee60e8 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=08677c7982ba445f92bc41342307ca52, group_id=d880ba6ceccd4a0fb6979236c2bd0cdc, role_id=3ef612f20dd0484f879868b8d42d1c29)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:43.240416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ef586-e8bf-48c6-bd96-347834ee60e8 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:43.246005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81cdc2-6ebc-4487-948a-3dcf161de6ff None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:43.246287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81cdc2-6ebc-4487-948a-3dcf161de6ff None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:43.246569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81cdc2-6ebc-4487-948a-3dcf161de6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:43.247853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-191ef586-e8bf-48c6-bd96-347834ee60e8 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invalidating the token cache because role 3ef612f20dd0484f879868b8d42d1c29 was removed from group d880ba6ceccd4a0fb6979236c2bd0cdc on domain 08677c7982ba445f92bc41342307ca52. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:43.248198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-191ef586-e8bf-48c6-bd96-347834ee60e8 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:43.248983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-191ef586-e8bf-48c6-bd96-347834ee60e8 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:43.266409 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3157/6287] 10.222.0.43 () {58 vars in 1565 bytes} [Sat Jul 2 21:25:43 2022] DELETE /identity/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/groups/d880ba6ceccd4a0fb6979236c2bd0cdc/roles/3ef612f20dd0484f879868b8d42d1c29/inherited_to_projects => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:43.270265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ef586-e8bf-48c6-bd96-347834ee60e8 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:43.271992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-191ef586-e8bf-48c6-bd96-347834ee60e8 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:43.275783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fe81cdc2-6ebc-4487-948a-3dcf161de6ff None None] MFA Rules not processed for user `db0af998d6da410a925c96e01cac2d04`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:43.277245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fe81cdc2-6ebc-4487-948a-3dcf161de6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:43.281750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:43.358819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ef586-e8bf-48c6-bd96-347834ee60e8 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:43.365275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efc9bc-7080-4d57-b124-e8ce9e589d3a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:43.366073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efc9bc-7080-4d57-b124-e8ce9e589d3a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:43.366456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efc9bc-7080-4d57-b124-e8ce9e589d3a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:43.366892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efc9bc-7080-4d57-b124-e8ce9e589d3a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/roles/3ef612f20dd0484f879868b8d42d1c29` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:43.368787 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3131/6288] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:43.372296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efc9bc-7080-4d57-b124-e8ce9e589d3a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3ef612f20dd0484f879868b8d42d1c29)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:43.374098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efc9bc-7080-4d57-b124-e8ce9e589d3a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:43.388865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81cdc2-6ebc-4487-948a-3dcf161de6ff None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:43.390317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fe81cdc2-6ebc-4487-948a-3dcf161de6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:43.434005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-41efc9bc-7080-4d57-b124-e8ce9e589d3a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invalidating the token cache because role 3ef612f20dd0484f879868b8d42d1c29 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:43.434658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-41efc9bc-7080-4d57-b124-e8ce9e589d3a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:43.435741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-41efc9bc-7080-4d57-b124-e8ce9e589d3a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:43.439872 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3158/6289] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:43 2022] DELETE /identity/v3/roles/3ef612f20dd0484f879868b8d42d1c29 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:43.445090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efc9bc-7080-4d57-b124-e8ce9e589d3a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:43.447426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-41efc9bc-7080-4d57-b124-e8ce9e589d3a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:43.470661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81cdc2-6ebc-4487-948a-3dcf161de6ff None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:43.540796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d26430-f53a-42a1-b828-e23cc026bc7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:43.542268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d26430-f53a-42a1-b828-e23cc026bc7e service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:43.542720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d26430-f53a-42a1-b828-e23cc026bc7e service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:43.544255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d26430-f53a-42a1-b828-e23cc026bc7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:43.548577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efc9bc-7080-4d57-b124-e8ce9e589d3a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:43.552382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a6d26430-f53a-42a1-b828-e23cc026bc7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:43.562805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03999f6c-d01b-4564-bdf2-07e89391a33a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:43.565085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03999f6c-d01b-4564-bdf2-07e89391a33a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:43.565667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03999f6c-d01b-4564-bdf2-07e89391a33a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:43.566168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03999f6c-d01b-4564-bdf2-07e89391a33a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:43.567675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03999f6c-d01b-4564-bdf2-07e89391a33a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:43.570083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03999f6c-d01b-4564-bdf2-07e89391a33a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:43.600383 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3159/6290] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:25:43 2022] POST /identity/v3/roles => generated 240 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:43.601454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03999f6c-d01b-4564-bdf2-07e89391a33a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:43.603754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-03999f6c-d01b-4564-bdf2-07e89391a33a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:43.637022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d26430-f53a-42a1-b828-e23cc026bc7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:43.640614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d26430-f53a-42a1-b828-e23cc026bc7e service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:43.653528 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3132/6291] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:43.654402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d26430-f53a-42a1-b828-e23cc026bc7e service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:43.664561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:43.667820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d26430-f53a-42a1-b828-e23cc026bc7e service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:43.682454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e29277-5079-4f3e-a927-b90510b99db6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:43.682454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e29277-5079-4f3e-a927-b90510b99db6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:43.682454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e29277-5079-4f3e-a927-b90510b99db6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:43.682907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e29277-5079-4f3e-a927-b90510b99db6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/users/816968d3d59f49189f1c0afd88692725/roles/c5a06c5ae03c46049b693e30c0e15a1f/inherited_to_projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:43.682907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e29277-5079-4f3e-a927-b90510b99db6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=08677c7982ba445f92bc41342307ca52, user_id=816968d3d59f49189f1c0afd88692725, role_id=c5a06c5ae03c46049b693e30c0e15a1f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:43.682907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e29277-5079-4f3e-a927-b90510b99db6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:43.684778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03999f6c-d01b-4564-bdf2-07e89391a33a tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:43.693925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f437-8c73-4d81-8c88-870ca40bf903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:43.694676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f437-8c73-4d81-8c88-870ca40bf903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:43.695099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f437-8c73-4d81-8c88-870ca40bf903 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:43.696451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f437-8c73-4d81-8c88-870ca40bf903 admin admin] PATH_INFO: `/v3/projects/3b085ae2fc89474b8e97442845641e02` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:43.700391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1f437-8c73-4d81-8c88-870ca40bf903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b085ae2fc89474b8e97442845641e02)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:43.704778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1f437-8c73-4d81-8c88-870ca40bf903 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:43.707059 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3133/6292] 10.222.0.43 () {60 vars in 1578 bytes} [Sat Jul 2 21:25:43 2022] PUT /identity/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/users/816968d3d59f49189f1c0afd88692725/roles/c5a06c5ae03c46049b693e30c0e15a1f/inherited_to_projects => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:43.710376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e29277-5079-4f3e-a927-b90510b99db6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:43.729918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:43.803388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-91d1f437-8c73-4d81-8c88-870ca40bf903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b085ae2fc89474b8e97442845641e02', 'request_id': 'req-91d1f437-8c73-4d81-8c88-870ca40bf903'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:43.815579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-91d1f437-8c73-4d81-8c88-870ca40bf903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b085ae2fc89474b8e97442845641e02', 'request_id': 'req-91d1f437-8c73-4d81-8c88-870ca40bf903'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:43.822895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e29277-5079-4f3e-a927-b90510b99db6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:43.825398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-91d1f437-8c73-4d81-8c88-870ca40bf903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b085ae2fc89474b8e97442845641e02', 'request_id': 'req-91d1f437-8c73-4d81-8c88-870ca40bf903'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:43.837410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-91d1f437-8c73-4d81-8c88-870ca40bf903 admin admin] The token cache is being invalidate because project 3b085ae2fc89474b8e97442845641e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:43.837736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-91d1f437-8c73-4d81-8c88-870ca40bf903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:43.838401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-91d1f437-8c73-4d81-8c88-870ca40bf903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:43.840017 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3160/6293] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:43 2022] DELETE /identity/v3/projects/3b085ae2fc89474b8e97442845641e02 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:43.853219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc33f3-de97-4a8c-b940-04dc322b0941 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:43.853740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc33f3-de97-4a8c-b940-04dc322b0941 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:43.854001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc33f3-de97-4a8c-b940-04dc322b0941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:43.874109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6bdc33f3-de97-4a8c-b940-04dc322b0941 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:43.875658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6bdc33f3-de97-4a8c-b940-04dc322b0941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:43.900067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ff000-b688-42a8-a3d2-3f3a6592d175 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:43.901412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ff000-b688-42a8-a3d2-3f3a6592d175 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:43.901933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ff000-b688-42a8-a3d2-3f3a6592d175 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:43.902385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ff000-b688-42a8-a3d2-3f3a6592d175 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/users/816968d3d59f49189f1c0afd88692725/roles/inherited_to_projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:43.904960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ff000-b688-42a8-a3d2-3f3a6592d175 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=08677c7982ba445f92bc41342307ca52, user_id=816968d3d59f49189f1c0afd88692725)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:43.906319 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-345ff000-b688-42a8-a3d2-3f3a6592d175 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:25:43.906319 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:25:43.906319 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:25:43.908305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ff000-b688-42a8-a3d2-3f3a6592d175 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:43.923686 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3134/6294] 10.222.0.43 () {58 vars in 1460 bytes} [Sat Jul 2 21:25:43 2022] GET /identity/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/users/816968d3d59f49189f1c0afd88692725/roles/inherited_to_projects => generated 447 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:43.927614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ff000-b688-42a8-a3d2-3f3a6592d175 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:43.929468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-345ff000-b688-42a8-a3d2-3f3a6592d175 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:43.943083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ff000-b688-42a8-a3d2-3f3a6592d175 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:43.949634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdffba-81e0-48dc-83f6-b25302894c0e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:43.950456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdffba-81e0-48dc-83f6-b25302894c0e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:43.950743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdffba-81e0-48dc-83f6-b25302894c0e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:43.951019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdffba-81e0-48dc-83f6-b25302894c0e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/users/816968d3d59f49189f1c0afd88692725/roles/c5a06c5ae03c46049b693e30c0e15a1f/inherited_to_projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:43.953905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdffba-81e0-48dc-83f6-b25302894c0e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=08677c7982ba445f92bc41342307ca52, user_id=816968d3d59f49189f1c0afd88692725, role_id=c5a06c5ae03c46049b693e30c0e15a1f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:43.956641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdffba-81e0-48dc-83f6-b25302894c0e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:43.959340 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3161/6295] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:43.964956 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3135/6296] 10.222.0.43 () {58 vars in 1560 bytes} [Sat Jul 2 21:25:43 2022] HEAD /identity/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/users/816968d3d59f49189f1c0afd88692725/roles/c5a06c5ae03c46049b693e30c0e15a1f/inherited_to_projects => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:43.976959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc33f3-de97-4a8c-b940-04dc322b0941 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:43.978767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad0ae6-65fd-412d-a644-1ff9e2afcffd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:43.979066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad0ae6-65fd-412d-a644-1ff9e2afcffd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:43.979348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad0ae6-65fd-412d-a644-1ff9e2afcffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:43.990566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc33f3-de97-4a8c-b940-04dc322b0941 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:43.996907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37812eed-22da-49b8-a031-00dd1e5029ad tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:43.997869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37812eed-22da-49b8-a031-00dd1e5029ad tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:43.998322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37812eed-22da-49b8-a031-00dd1e5029ad tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:43.998614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37812eed-22da-49b8-a031-00dd1e5029ad tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/users/816968d3d59f49189f1c0afd88692725/roles/c5a06c5ae03c46049b693e30c0e15a1f/inherited_to_projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:44.001305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37812eed-22da-49b8-a031-00dd1e5029ad tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=08677c7982ba445f92bc41342307ca52, user_id=816968d3d59f49189f1c0afd88692725, role_id=c5a06c5ae03c46049b693e30c0e15a1f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:44.003859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-85ad0ae6-65fd-412d-a644-1ff9e2afcffd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:44.004563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37812eed-22da-49b8-a031-00dd1e5029ad tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:44.005716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-85ad0ae6-65fd-412d-a644-1ff9e2afcffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:44.010908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-37812eed-22da-49b8-a031-00dd1e5029ad tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invalidating the token cache because role c5a06c5ae03c46049b693e30c0e15a1f was removed from user 816968d3d59f49189f1c0afd88692725 on domain 08677c7982ba445f92bc41342307ca52. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:44.011931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-37812eed-22da-49b8-a031-00dd1e5029ad tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:44.012691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-37812eed-22da-49b8-a031-00dd1e5029ad tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:44.026486 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3136/6297] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:44.032198 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3162/6298] 10.222.0.43 () {58 vars in 1562 bytes} [Sat Jul 2 21:25:43 2022] DELETE /identity/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/users/816968d3d59f49189f1c0afd88692725/roles/c5a06c5ae03c46049b693e30c0e15a1f/inherited_to_projects => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:44.033108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad0ae6-65fd-412d-a644-1ff9e2afcffd None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:44.036391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37812eed-22da-49b8-a031-00dd1e5029ad tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:44.038432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-37812eed-22da-49b8-a031-00dd1e5029ad tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:44.042740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad0ae6-65fd-412d-a644-1ff9e2afcffd None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:44.123976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37812eed-22da-49b8-a031-00dd1e5029ad tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:44.124498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dfe5d-0538-4f50-96df-109bb87a6398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:44.125487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dfe5d-0538-4f50-96df-109bb87a6398 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:44.126129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dfe5d-0538-4f50-96df-109bb87a6398 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:44.126129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dfe5d-0538-4f50-96df-109bb87a6398 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:44.126776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681dfe5d-0538-4f50-96df-109bb87a6398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:44.127049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681dfe5d-0538-4f50-96df-109bb87a6398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:44.128759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681dfe5d-0538-4f50-96df-109bb87a6398 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:44.129868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6c2c0-e7a1-4420-bbaa-b01298525f89 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:44.131079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6c2c0-e7a1-4420-bbaa-b01298525f89 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:44.131771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6c2c0-e7a1-4420-bbaa-b01298525f89 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:44.131935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6c2c0-e7a1-4420-bbaa-b01298525f89 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/roles/c5a06c5ae03c46049b693e30c0e15a1f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:44.133499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6c2c0-e7a1-4420-bbaa-b01298525f89 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c5a06c5ae03c46049b693e30c0e15a1f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:44.135574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6c2c0-e7a1-4420-bbaa-b01298525f89 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:44.137944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:44.141926 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3137/6299] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:44.147238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dfe5d-0538-4f50-96df-109bb87a6398 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:44.149565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-681dfe5d-0538-4f50-96df-109bb87a6398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:44.171469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dfe5d-0538-4f50-96df-109bb87a6398 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:44.179620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c39fd4-27af-4e66-bd40-ebd4ee817fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:44.180754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c39fd4-27af-4e66-bd40-ebd4ee817fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:44.181203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c39fd4-27af-4e66-bd40-ebd4ee817fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:44.181586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c39fd4-27af-4e66-bd40-ebd4ee817fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:44.182623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c39fd4-27af-4e66-bd40-ebd4ee817fa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:44.184068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-27b6c2c0-e7a1-4420-bbaa-b01298525f89 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invalidating the token cache because role c5a06c5ae03c46049b693e30c0e15a1f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:44.184435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-27b6c2c0-e7a1-4420-bbaa-b01298525f89 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:44.184749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c39fd4-27af-4e66-bd40-ebd4ee817fa0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:44.185208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-27b6c2c0-e7a1-4420-bbaa-b01298525f89 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:44.187249 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3163/6300] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:44 2022] DELETE /identity/v3/roles/c5a06c5ae03c46049b693e30c0e15a1f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:44.192425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6c2c0-e7a1-4420-bbaa-b01298525f89 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:44.194360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-27b6c2c0-e7a1-4420-bbaa-b01298525f89 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:44.205166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:44.216746 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3138/6301] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:44 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:44.218000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c39fd4-27af-4e66-bd40-ebd4ee817fa0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:44.219633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-64c39fd4-27af-4e66-bd40-ebd4ee817fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:44.260563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6c2c0-e7a1-4420-bbaa-b01298525f89 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:44.283518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c39fd4-27af-4e66-bd40-ebd4ee817fa0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:44.288253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b819bb7-4265-4c33-a305-593e15d00646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:44.288929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b819bb7-4265-4c33-a305-593e15d00646 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:44.289187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b819bb7-4265-4c33-a305-593e15d00646 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:44.289448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b819bb7-4265-4c33-a305-593e15d00646 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:44.290240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b819bb7-4265-4c33-a305-593e15d00646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:44.292170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b819bb7-4265-4c33-a305-593e15d00646 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:44.314559 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3139/6302] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:44 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:44.318494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fe8a8-0423-44c0-8352-16db17ec17f1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:44.318698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b819bb7-4265-4c33-a305-593e15d00646 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:44.319177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fe8a8-0423-44c0-8352-16db17ec17f1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:44.319463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fe8a8-0423-44c0-8352-16db17ec17f1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:44.319742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fe8a8-0423-44c0-8352-16db17ec17f1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:44.320609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fe8a8-0423-44c0-8352-16db17ec17f1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:44.322237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fe8a8-0423-44c0-8352-16db17ec17f1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:44.329754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b819bb7-4265-4c33-a305-593e15d00646 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:44.336153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c31fb-becf-4743-8795-4b1c82138b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:44.336827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c31fb-becf-4743-8795-4b1c82138b32 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:44.337112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c31fb-becf-4743-8795-4b1c82138b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:44.337395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c31fb-becf-4743-8795-4b1c82138b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:44.338114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c31fb-becf-4743-8795-4b1c82138b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:44.338735 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3164/6303] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:25:44 2022] POST /identity/v3/roles => generated 239 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:44.339762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c31fb-becf-4743-8795-4b1c82138b32 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:44.342926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fe8a8-0423-44c0-8352-16db17ec17f1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:44.351838 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3140/6304] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:44 2022] GET /identity/v3/roles => generated 1650 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:25:44.353172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fe8a8-0423-44c0-8352-16db17ec17f1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:44.355614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c31fb-becf-4743-8795-4b1c82138b32 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:44.358049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548b267-aa3e-46cf-86ab-37e2fc3549cc tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:44.358707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548b267-aa3e-46cf-86ab-37e2fc3549cc tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:44.359001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548b267-aa3e-46cf-86ab-37e2fc3549cc tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:44.359280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548b267-aa3e-46cf-86ab-37e2fc3549cc tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:44.360012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548b267-aa3e-46cf-86ab-37e2fc3549cc tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:44.362042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548b267-aa3e-46cf-86ab-37e2fc3549cc tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:44.366098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c31fb-becf-4743-8795-4b1c82138b32 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:44.371045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64955948-bce3-43e9-b6fa-68afaf7a7694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:44.371688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64955948-bce3-43e9-b6fa-68afaf7a7694 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:44.371949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64955948-bce3-43e9-b6fa-68afaf7a7694 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:44.372252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64955948-bce3-43e9-b6fa-68afaf7a7694 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:44.372967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64955948-bce3-43e9-b6fa-68afaf7a7694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:44.374553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64955948-bce3-43e9-b6fa-68afaf7a7694 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:44.390269 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3141/6305] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:44 2022] GET /identity/v3/roles => generated 1650 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:25:44.394686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64955948-bce3-43e9-b6fa-68afaf7a7694 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:44.398645 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3165/6306] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:44 2022] POST /identity/v3/projects => generated 409 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:44.402620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548b267-aa3e-46cf-86ab-37e2fc3549cc tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:44.405470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64955948-bce3-43e9-b6fa-68afaf7a7694 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:44.447291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:44.469722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548b267-aa3e-46cf-86ab-37e2fc3549cc tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:44.474590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe75ba7-40d9-4502-b0ba-6606e16d6709 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:44.475456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe75ba7-40d9-4502-b0ba-6606e16d6709 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:44.475739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe75ba7-40d9-4502-b0ba-6606e16d6709 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:44.476019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe75ba7-40d9-4502-b0ba-6606e16d6709 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/users/816968d3d59f49189f1c0afd88692725/roles/36f5cfcfddf54c8db3cabef64b16092a/inherited_to_projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:44.476591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea1829-d3e8-49fb-93f5-70bfedca84d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:44.477499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea1829-d3e8-49fb-93f5-70bfedca84d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:44.477793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea1829-d3e8-49fb-93f5-70bfedca84d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:44.478070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea1829-d3e8-49fb-93f5-70bfedca84d3 admin admin] PATH_INFO: `/v3/projects/3b23abf292ab4eada0124fc2b5cea63c/users/d671a106a6a2477c8b9193a93d163306/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:44.478700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe75ba7-40d9-4502-b0ba-6606e16d6709 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=08677c7982ba445f92bc41342307ca52, user_id=816968d3d59f49189f1c0afd88692725, role_id=36f5cfcfddf54c8db3cabef64b16092a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:44.481411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe75ba7-40d9-4502-b0ba-6606e16d6709 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:44.494083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea1829-d3e8-49fb-93f5-70bfedca84d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b23abf292ab4eada0124fc2b5cea63c, user_id=d671a106a6a2477c8b9193a93d163306, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:44.494517 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3166/6307] 10.222.0.43 () {60 vars in 1578 bytes} [Sat Jul 2 21:25:44 2022] PUT /identity/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/users/816968d3d59f49189f1c0afd88692725/roles/36f5cfcfddf54c8db3cabef64b16092a/inherited_to_projects => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:44.496841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea1829-d3e8-49fb-93f5-70bfedca84d3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:44.498774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe75ba7-40d9-4502-b0ba-6606e16d6709 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:44.513584 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3142/6308] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:44 2022] PUT /identity/v3/projects/3b23abf292ab4eada0124fc2b5cea63c/users/d671a106a6a2477c8b9193a93d163306/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:44.523897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0befc-4abe-46d4-941e-ae2538fe8bd7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:44.524240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0befc-4abe-46d4-941e-ae2538fe8bd7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:44.524519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0befc-4abe-46d4-941e-ae2538fe8bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:44.553062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f2d0befc-4abe-46d4-941e-ae2538fe8bd7 None None] MFA Rules not processed for user `d671a106a6a2477c8b9193a93d163306`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:44.554474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f2d0befc-4abe-46d4-941e-ae2538fe8bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:44.566544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe75ba7-40d9-4502-b0ba-6606e16d6709 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:44.592905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:44.623167 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3143/6309] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:44.623392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b341c-ef5f-4541-adc3-1064b4695d78 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:44.623956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b341c-ef5f-4541-adc3-1064b4695d78 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:44.624279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b341c-ef5f-4541-adc3-1064b4695d78 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:44.624587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b341c-ef5f-4541-adc3-1064b4695d78 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:44.625452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b341c-ef5f-4541-adc3-1064b4695d78 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Adding query filter params (scope.project.id=de4c4d80093b4243a09eff282e488858, user.id=816968d3d59f49189f1c0afd88692725) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:44.625872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b341c-ef5f-4541-adc3-1064b4695d78 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:44.626910 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-a21b341c-ef5f-4541-adc3-1064b4695d78 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:25:44.626910 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:25:44.626910 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:25:44.628198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b341c-ef5f-4541-adc3-1064b4695d78 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:44.634600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0befc-4abe-46d4-941e-ae2538fe8bd7 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:44.636140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f2d0befc-4abe-46d4-941e-ae2538fe8bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:44.674877 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3167/6310] 10.222.0.43 () {58 vars in 1355 bytes} [Sat Jul 2 21:25:44 2022] GET /identity/v3/role_assignments?scope.project.id=de4c4d80093b4243a09eff282e488858&user.id=816968d3d59f49189f1c0afd88692725&effective => generated 648 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:25:44.679475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b341c-ef5f-4541-adc3-1064b4695d78 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:44.690474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b341c-ef5f-4541-adc3-1064b4695d78 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:44.695349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4596b0b-a221-450e-9489-1fa0080ed488 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:44.696009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4596b0b-a221-450e-9489-1fa0080ed488 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:44.696328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4596b0b-a221-450e-9489-1fa0080ed488 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:44.696608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4596b0b-a221-450e-9489-1fa0080ed488 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:44.697432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4596b0b-a221-450e-9489-1fa0080ed488 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Adding query filter params (scope.project.id=4180e5df7dc24200b1999972996299ed, user.id=816968d3d59f49189f1c0afd88692725) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:44.697741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4596b0b-a221-450e-9489-1fa0080ed488 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:44.698819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0befc-4abe-46d4-941e-ae2538fe8bd7 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:44.699617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4596b0b-a221-450e-9489-1fa0080ed488 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:44.703302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c1b37-41c8-4e08-b733-935883a77cc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:44.703950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c1b37-41c8-4e08-b733-935883a77cc5 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:44.704270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c1b37-41c8-4e08-b733-935883a77cc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:44.704521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c1b37-41c8-4e08-b733-935883a77cc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:44.714203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c1b37-41c8-4e08-b733-935883a77cc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:44.715705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c1b37-41c8-4e08-b733-935883a77cc5 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:44.726848 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3144/6311] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:25:44.736819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:44.764849 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3168/6312] 10.222.0.43 () {58 vars in 1355 bytes} [Sat Jul 2 21:25:44 2022] GET /identity/v3/role_assignments?scope.project.id=4180e5df7dc24200b1999972996299ed&user.id=816968d3d59f49189f1c0afd88692725&effective => generated 648 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:25:44.768963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c1b37-41c8-4e08-b733-935883a77cc5 service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:44.782791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c1b37-41c8-4e08-b733-935883a77cc5 service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:44.787907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10ecc5-7f87-49b1-9625-a037db8a88a1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:44.788785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10ecc5-7f87-49b1-9625-a037db8a88a1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:44.789114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10ecc5-7f87-49b1-9625-a037db8a88a1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:44.789392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10ecc5-7f87-49b1-9625-a037db8a88a1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/users/816968d3d59f49189f1c0afd88692725/roles/36f5cfcfddf54c8db3cabef64b16092a/inherited_to_projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:44.791701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10ecc5-7f87-49b1-9625-a037db8a88a1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=08677c7982ba445f92bc41342307ca52, user_id=816968d3d59f49189f1c0afd88692725, role_id=36f5cfcfddf54c8db3cabef64b16092a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:44.794534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10ecc5-7f87-49b1-9625-a037db8a88a1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:44.800566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dd10ecc5-7f87-49b1-9625-a037db8a88a1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invalidating the token cache because role 36f5cfcfddf54c8db3cabef64b16092a was removed from user 816968d3d59f49189f1c0afd88692725 on domain 08677c7982ba445f92bc41342307ca52. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:44.801071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dd10ecc5-7f87-49b1-9625-a037db8a88a1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:44.802170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dd10ecc5-7f87-49b1-9625-a037db8a88a1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:44.817713 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3145/6313] 10.222.0.43 () {58 vars in 1562 bytes} [Sat Jul 2 21:25:44 2022] DELETE /identity/v3/OS-INHERIT/domains/08677c7982ba445f92bc41342307ca52/users/816968d3d59f49189f1c0afd88692725/roles/36f5cfcfddf54c8db3cabef64b16092a/inherited_to_projects => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:44.821920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4596b0b-a221-450e-9489-1fa0080ed488 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:44.823861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b4596b0b-a221-450e-9489-1fa0080ed488 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:44.841966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4596b0b-a221-450e-9489-1fa0080ed488 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:44.918054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3e2b9-0366-4405-a8d6-2b74611cd26e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:44.918774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3e2b9-0366-4405-a8d6-2b74611cd26e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:44.919065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3e2b9-0366-4405-a8d6-2b74611cd26e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:44.919369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3e2b9-0366-4405-a8d6-2b74611cd26e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:44.920185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3e2b9-0366-4405-a8d6-2b74611cd26e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Adding query filter params (scope.project.id=de4c4d80093b4243a09eff282e488858, user.id=816968d3d59f49189f1c0afd88692725) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:44.920493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3e2b9-0366-4405-a8d6-2b74611cd26e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:44.922382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3e2b9-0366-4405-a8d6-2b74611cd26e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:44.974311 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3169/6314] 10.222.0.43 () {58 vars in 1355 bytes} [Sat Jul 2 21:25:44 2022] GET /identity/v3/role_assignments?scope.project.id=de4c4d80093b4243a09eff282e488858&user.id=816968d3d59f49189f1c0afd88692725&effective => generated 228 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:44.976191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10ecc5-7f87-49b1-9625-a037db8a88a1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:44.986801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10ecc5-7f87-49b1-9625-a037db8a88a1 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:44.991591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a85fcf-6f00-49e6-b9e7-c32f291aed27 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:44.992298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a85fcf-6f00-49e6-b9e7-c32f291aed27 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:44.992570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a85fcf-6f00-49e6-b9e7-c32f291aed27 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:44.992846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a85fcf-6f00-49e6-b9e7-c32f291aed27 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:44.993668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a85fcf-6f00-49e6-b9e7-c32f291aed27 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Adding query filter params (scope.project.id=4180e5df7dc24200b1999972996299ed, user.id=816968d3d59f49189f1c0afd88692725) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:44.993974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a85fcf-6f00-49e6-b9e7-c32f291aed27 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:44.994993 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-50a85fcf-6f00-49e6-b9e7-c32f291aed27 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:25:44.994993 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:25:44.994993 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:25:44.996150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a85fcf-6f00-49e6-b9e7-c32f291aed27 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:45.080167 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3146/6315] 10.222.0.43 () {58 vars in 1355 bytes} [Sat Jul 2 21:25:44 2022] GET /identity/v3/role_assignments?scope.project.id=4180e5df7dc24200b1999972996299ed&user.id=816968d3d59f49189f1c0afd88692725&effective => generated 228 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:45.085819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3e2b9-0366-4405-a8d6-2b74611cd26e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:45.099608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3e2b9-0366-4405-a8d6-2b74611cd26e tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:45.105304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c3be3-d4d3-4273-b7d0-72387ad013ed tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:45.106351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c3be3-d4d3-4273-b7d0-72387ad013ed tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:45.106700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c3be3-d4d3-4273-b7d0-72387ad013ed tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:45.107047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c3be3-d4d3-4273-b7d0-72387ad013ed tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/projects/4180e5df7dc24200b1999972996299ed` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:45.108390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c3be3-d4d3-4273-b7d0-72387ad013ed tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4180e5df7dc24200b1999972996299ed)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:45.110393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c3be3-d4d3-4273-b7d0-72387ad013ed tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:45.163234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-710c3be3-d4d3-4273-b7d0-72387ad013ed tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4180e5df7dc24200b1999972996299ed', 'request_id': 'req-710c3be3-d4d3-4273-b7d0-72387ad013ed'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:45.175589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-710c3be3-d4d3-4273-b7d0-72387ad013ed tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4180e5df7dc24200b1999972996299ed', 'request_id': 'req-710c3be3-d4d3-4273-b7d0-72387ad013ed'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:45.184737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-710c3be3-d4d3-4273-b7d0-72387ad013ed tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4180e5df7dc24200b1999972996299ed', 'request_id': 'req-710c3be3-d4d3-4273-b7d0-72387ad013ed'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:45.196275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-710c3be3-d4d3-4273-b7d0-72387ad013ed tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] The token cache is being invalidate because project 4180e5df7dc24200b1999972996299ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:45.196727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-710c3be3-d4d3-4273-b7d0-72387ad013ed tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:45.197523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-710c3be3-d4d3-4273-b7d0-72387ad013ed tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:45.199302 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3170/6316] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:45 2022] DELETE /identity/v3/projects/4180e5df7dc24200b1999972996299ed => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:45.203796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a85fcf-6f00-49e6-b9e7-c32f291aed27 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:45.206013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-50a85fcf-6f00-49e6-b9e7-c32f291aed27 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:45.221010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a85fcf-6f00-49e6-b9e7-c32f291aed27 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:45.279219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b65b2-5a71-4148-9f32-3c6157b4bb54 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:45.280166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b65b2-5a71-4148-9f32-3c6157b4bb54 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:45.280445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b65b2-5a71-4148-9f32-3c6157b4bb54 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:45.280837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b65b2-5a71-4148-9f32-3c6157b4bb54 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/roles/36f5cfcfddf54c8db3cabef64b16092a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:45.282421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b65b2-5a71-4148-9f32-3c6157b4bb54 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:delete_role(role_id=36f5cfcfddf54c8db3cabef64b16092a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:45.284645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b65b2-5a71-4148-9f32-3c6157b4bb54 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:45.297297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:45.324995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-313b65b2-5a71-4148-9f32-3c6157b4bb54 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invalidating the token cache because role 36f5cfcfddf54c8db3cabef64b16092a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:45.325912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-313b65b2-5a71-4148-9f32-3c6157b4bb54 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:45.326704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-313b65b2-5a71-4148-9f32-3c6157b4bb54 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:45.328643 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3147/6317] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:45 2022] DELETE /identity/v3/roles/36f5cfcfddf54c8db3cabef64b16092a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:45.334279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c3be3-d4d3-4273-b7d0-72387ad013ed tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:45.345375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c3be3-d4d3-4273-b7d0-72387ad013ed tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:45.373221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:45.407376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723aa90-fcee-4bae-83ae-342ca7d0cdf4 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:45.408481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723aa90-fcee-4bae-83ae-342ca7d0cdf4 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:45.408756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723aa90-fcee-4bae-83ae-342ca7d0cdf4 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:45.409067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723aa90-fcee-4bae-83ae-342ca7d0cdf4 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:45.409810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723aa90-fcee-4bae-83ae-342ca7d0cdf4 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:45.411434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723aa90-fcee-4bae-83ae-342ca7d0cdf4 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:45.425156 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3171/6318] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:25:45 2022] POST /identity/v3/roles => generated 240 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:45.429944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b65b2-5a71-4148-9f32-3c6157b4bb54 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:45.431615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-313b65b2-5a71-4148-9f32-3c6157b4bb54 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:45.446964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b65b2-5a71-4148-9f32-3c6157b4bb54 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:45.452658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c991c-93a9-438f-a8ca-f52d6c677dc6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:45.453328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c991c-93a9-438f-a8ca-f52d6c677dc6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:45.453622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c991c-93a9-438f-a8ca-f52d6c677dc6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:45.453904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c991c-93a9-438f-a8ca-f52d6c677dc6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:45.454598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c991c-93a9-438f-a8ca-f52d6c677dc6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:45.456592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c991c-93a9-438f-a8ca-f52d6c677dc6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:45.511629 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3148/6319] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:45 2022] POST /identity/v3/projects => generated 410 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:45.512908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723aa90-fcee-4bae-83ae-342ca7d0cdf4 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:45.529941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723aa90-fcee-4bae-83ae-342ca7d0cdf4 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:45.594786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af652309-aa58-4427-bb57-659580c6050f tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:45.595640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af652309-aa58-4427-bb57-659580c6050f tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:45.595953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af652309-aa58-4427-bb57-659580c6050f tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:45.596265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af652309-aa58-4427-bb57-659580c6050f tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/de4c4d80093b4243a09eff282e488858/users/816968d3d59f49189f1c0afd88692725/roles/27a83c08097a430181dc18476cd93b5c/inherited_to_projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:45.598690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af652309-aa58-4427-bb57-659580c6050f tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:create_grant(project_id=de4c4d80093b4243a09eff282e488858, user_id=816968d3d59f49189f1c0afd88692725, role_id=27a83c08097a430181dc18476cd93b5c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:45.601448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af652309-aa58-4427-bb57-659580c6050f tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:45.613964 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3172/6320] 10.222.0.43 () {60 vars in 1581 bytes} [Sat Jul 2 21:25:45 2022] PUT /identity/v3/OS-INHERIT/projects/de4c4d80093b4243a09eff282e488858/users/816968d3d59f49189f1c0afd88692725/roles/27a83c08097a430181dc18476cd93b5c/inherited_to_projects => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:45.618327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c991c-93a9-438f-a8ca-f52d6c677dc6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:45.629593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c991c-93a9-438f-a8ca-f52d6c677dc6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:45.689725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b986fc-b14b-4645-8bcf-3927711845b2 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:45.690380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b986fc-b14b-4645-8bcf-3927711845b2 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:45.690675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b986fc-b14b-4645-8bcf-3927711845b2 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:45.690945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b986fc-b14b-4645-8bcf-3927711845b2 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:45.691763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b986fc-b14b-4645-8bcf-3927711845b2 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Adding query filter params (scope.project.id=51683b8b518c45e4ba728214861c8e1c, user.id=816968d3d59f49189f1c0afd88692725) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:45.692105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b986fc-b14b-4645-8bcf-3927711845b2 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:45.693962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b986fc-b14b-4645-8bcf-3927711845b2 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:45.749965 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3149/6321] 10.222.0.43 () {58 vars in 1355 bytes} [Sat Jul 2 21:25:45 2022] GET /identity/v3/role_assignments?scope.project.id=51683b8b518c45e4ba728214861c8e1c&user.id=816968d3d59f49189f1c0afd88692725&effective => generated 649 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:25:45.754427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af652309-aa58-4427-bb57-659580c6050f tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:45.770109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af652309-aa58-4427-bb57-659580c6050f tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:45.775547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd3254-4186-4ac2-a8f8-dd6c749131db tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:45.776436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3254-4186-4ac2-a8f8-dd6c749131db tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:45.776726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3254-4186-4ac2-a8f8-dd6c749131db tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:45.777009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3254-4186-4ac2-a8f8-dd6c749131db tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/de4c4d80093b4243a09eff282e488858/users/816968d3d59f49189f1c0afd88692725/roles/27a83c08097a430181dc18476cd93b5c/inherited_to_projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:45.779385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd3254-4186-4ac2-a8f8-dd6c749131db tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=de4c4d80093b4243a09eff282e488858, user_id=816968d3d59f49189f1c0afd88692725, role_id=27a83c08097a430181dc18476cd93b5c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:45.782478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd3254-4186-4ac2-a8f8-dd6c749131db tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:45.787675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2dbd3254-4186-4ac2-a8f8-dd6c749131db tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invalidating the token cache because role 27a83c08097a430181dc18476cd93b5c was removed from user 816968d3d59f49189f1c0afd88692725 on project de4c4d80093b4243a09eff282e488858. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:45.787973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2dbd3254-4186-4ac2-a8f8-dd6c749131db tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:45.788749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2dbd3254-4186-4ac2-a8f8-dd6c749131db tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:45.803900 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3173/6322] 10.222.0.43 () {58 vars in 1565 bytes} [Sat Jul 2 21:25:45 2022] DELETE /identity/v3/OS-INHERIT/projects/de4c4d80093b4243a09eff282e488858/users/816968d3d59f49189f1c0afd88692725/roles/27a83c08097a430181dc18476cd93b5c/inherited_to_projects => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:45.808157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b986fc-b14b-4645-8bcf-3927711845b2 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:45.809940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c2b986fc-b14b-4645-8bcf-3927711845b2 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:45.824895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b986fc-b14b-4645-8bcf-3927711845b2 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:45.887302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fe012-82aa-4248-abf2-cb3d46b6d059 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:45.888011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fe012-82aa-4248-abf2-cb3d46b6d059 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:45.888341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fe012-82aa-4248-abf2-cb3d46b6d059 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:45.888576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fe012-82aa-4248-abf2-cb3d46b6d059 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:45.889390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fe012-82aa-4248-abf2-cb3d46b6d059 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Adding query filter params (scope.project.id=51683b8b518c45e4ba728214861c8e1c, user.id=816968d3d59f49189f1c0afd88692725) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:45.889711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fe012-82aa-4248-abf2-cb3d46b6d059 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:45.891580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fe012-82aa-4248-abf2-cb3d46b6d059 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:45.895473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:45.952370 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3150/6323] 10.222.0.43 () {58 vars in 1355 bytes} [Sat Jul 2 21:25:45 2022] GET /identity/v3/role_assignments?scope.project.id=51683b8b518c45e4ba728214861c8e1c&user.id=816968d3d59f49189f1c0afd88692725&effective => generated 228 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:25:45.958281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd3254-4186-4ac2-a8f8-dd6c749131db tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:45.968849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd3254-4186-4ac2-a8f8-dd6c749131db tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:45.974221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde3481-b6f4-4882-b308-83db06e714b5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:45.975190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde3481-b6f4-4882-b308-83db06e714b5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:45.975542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde3481-b6f4-4882-b308-83db06e714b5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:45.975820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde3481-b6f4-4882-b308-83db06e714b5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/projects/51683b8b518c45e4ba728214861c8e1c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:45.977065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde3481-b6f4-4882-b308-83db06e714b5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:delete_project(project_id=51683b8b518c45e4ba728214861c8e1c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:45.979035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde3481-b6f4-4882-b308-83db06e714b5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:46.029129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7bde3481-b6f4-4882-b308-83db06e714b5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51683b8b518c45e4ba728214861c8e1c', 'request_id': 'req-7bde3481-b6f4-4882-b308-83db06e714b5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.037624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7bde3481-b6f4-4882-b308-83db06e714b5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51683b8b518c45e4ba728214861c8e1c', 'request_id': 'req-7bde3481-b6f4-4882-b308-83db06e714b5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.045092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7bde3481-b6f4-4882-b308-83db06e714b5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51683b8b518c45e4ba728214861c8e1c', 'request_id': 'req-7bde3481-b6f4-4882-b308-83db06e714b5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.057120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7bde3481-b6f4-4882-b308-83db06e714b5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] The token cache is being invalidate because project 51683b8b518c45e4ba728214861c8e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:46.057396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7bde3481-b6f4-4882-b308-83db06e714b5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.058072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7bde3481-b6f4-4882-b308-83db06e714b5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.059671 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3174/6324] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:45 2022] DELETE /identity/v3/projects/51683b8b518c45e4ba728214861c8e1c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:46.063970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fe012-82aa-4248-abf2-cb3d46b6d059 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:46.066623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-967fe012-82aa-4248-abf2-cb3d46b6d059 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:46.083577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fe012-82aa-4248-abf2-cb3d46b6d059 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:46.149970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c52aa-ed11-4ee6-a18a-8f9043867ecf tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:46.150914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c52aa-ed11-4ee6-a18a-8f9043867ecf tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:46.151271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c52aa-ed11-4ee6-a18a-8f9043867ecf tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:46.151617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c52aa-ed11-4ee6-a18a-8f9043867ecf tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/roles/27a83c08097a430181dc18476cd93b5c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:46.153198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c52aa-ed11-4ee6-a18a-8f9043867ecf tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:delete_role(role_id=27a83c08097a430181dc18476cd93b5c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:46.154916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c52aa-ed11-4ee6-a18a-8f9043867ecf tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:46.193772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e61c52aa-ed11-4ee6-a18a-8f9043867ecf tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invalidating the token cache because role 27a83c08097a430181dc18476cd93b5c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:46.194140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e61c52aa-ed11-4ee6-a18a-8f9043867ecf tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.194873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e61c52aa-ed11-4ee6-a18a-8f9043867ecf tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.196783 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3151/6325] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:46 2022] DELETE /identity/v3/roles/27a83c08097a430181dc18476cd93b5c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:46.202105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde3481-b6f4-4882-b308-83db06e714b5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:46.212428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde3481-b6f4-4882-b308-83db06e714b5 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:46.238730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:46.256465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c52aa-ed11-4ee6-a18a-8f9043867ecf tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:46.258105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e61c52aa-ed11-4ee6-a18a-8f9043867ecf tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:46.279954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdd303-790f-4a3b-96ff-e9b7d7b764c6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:46.281251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdd303-790f-4a3b-96ff-e9b7d7b764c6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:46.281635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdd303-790f-4a3b-96ff-e9b7d7b764c6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:46.282009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdd303-790f-4a3b-96ff-e9b7d7b764c6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/users/816968d3d59f49189f1c0afd88692725` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:46.284101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdd303-790f-4a3b-96ff-e9b7d7b764c6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:delete_user(user_id=816968d3d59f49189f1c0afd88692725)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:46.286859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdd303-790f-4a3b-96ff-e9b7d7b764c6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:46.331114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c52aa-ed11-4ee6-a18a-8f9043867ecf tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:46.334632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-13cdd303-790f-4a3b-96ff-e9b7d7b764c6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816968d3d59f49189f1c0afd88692725'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.336119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340908f-204a-4651-aa9e-105bd48b5709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:46.337043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340908f-204a-4651-aa9e-105bd48b5709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:46.337322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340908f-204a-4651-aa9e-105bd48b5709 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:46.337595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340908f-204a-4651-aa9e-105bd48b5709 admin admin] PATH_INFO: `/v3/users/d671a106a6a2477c8b9193a93d163306` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:46.338804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340908f-204a-4651-aa9e-105bd48b5709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d671a106a6a2477c8b9193a93d163306)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:46.340845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340908f-204a-4651-aa9e-105bd48b5709 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:46.342594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-13cdd303-790f-4a3b-96ff-e9b7d7b764c6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816968d3d59f49189f1c0afd88692725'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.343244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-13cdd303-790f-4a3b-96ff-e9b7d7b764c6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816968d3d59f49189f1c0afd88692725'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.343861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-13cdd303-790f-4a3b-96ff-e9b7d7b764c6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816968d3d59f49189f1c0afd88692725'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.351411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-13cdd303-790f-4a3b-96ff-e9b7d7b764c6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816968d3d59f49189f1c0afd88692725'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.370019 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3175/6326] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:46 2022] DELETE /identity/v3/users/816968d3d59f49189f1c0afd88692725 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:46.371573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:46.374576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdd303-790f-4a3b-96ff-e9b7d7b764c6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:46.376297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-13cdd303-790f-4a3b-96ff-e9b7d7b764c6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:46.391805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0340908f-204a-4651-aa9e-105bd48b5709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd671a106a6a2477c8b9193a93d163306'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.399700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0340908f-204a-4651-aa9e-105bd48b5709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd671a106a6a2477c8b9193a93d163306'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.407332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0340908f-204a-4651-aa9e-105bd48b5709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd671a106a6a2477c8b9193a93d163306'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.408149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0340908f-204a-4651-aa9e-105bd48b5709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd671a106a6a2477c8b9193a93d163306'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.408975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0340908f-204a-4651-aa9e-105bd48b5709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd671a106a6a2477c8b9193a93d163306'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.429881 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3152/6327] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:46 2022] DELETE /identity/v3/users/d671a106a6a2477c8b9193a93d163306 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:46.434393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733074b-dd07-4e32-81c6-7084db344393 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:46.434681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733074b-dd07-4e32-81c6-7084db344393 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:46.434945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733074b-dd07-4e32-81c6-7084db344393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:46.443128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdd303-790f-4a3b-96ff-e9b7d7b764c6 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:46.453742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-7733074b-dd07-4e32-81c6-7084db344393 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:46.454952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7733074b-dd07-4e32-81c6-7084db344393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:46.486594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:46.503187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cb2e2-4056-488b-8228-3d1920993fff tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:46.504317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cb2e2-4056-488b-8228-3d1920993fff tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:46.504610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cb2e2-4056-488b-8228-3d1920993fff tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:46.504887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cb2e2-4056-488b-8228-3d1920993fff tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/groups/d880ba6ceccd4a0fb6979236c2bd0cdc` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:46.506298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364cb2e2-4056-488b-8228-3d1920993fff tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d880ba6ceccd4a0fb6979236c2bd0cdc)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:46.507342 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-364cb2e2-4056-488b-8228-3d1920993fff tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:25:46.507342 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:25:46.507342 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:25:46.508595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364cb2e2-4056-488b-8228-3d1920993fff tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:46.519510 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3153/6328] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:46.531379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733074b-dd07-4e32-81c6-7084db344393 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:46.533206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7733074b-dd07-4e32-81c6-7084db344393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:46.579648 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3176/6329] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:25:46 2022] DELETE /identity/v3/groups/d880ba6ceccd4a0fb6979236c2bd0cdc => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:46.583829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cb2e2-4056-488b-8228-3d1920993fff tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:46.585589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-364cb2e2-4056-488b-8228-3d1920993fff tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:46.603929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733074b-dd07-4e32-81c6-7084db344393 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:46.655908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ada546-441c-4005-b24a-eded67ef4778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:46.656209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cb2e2-4056-488b-8228-3d1920993fff tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:46.657139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ada546-441c-4005-b24a-eded67ef4778 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:46.657589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ada546-441c-4005-b24a-eded67ef4778 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:46.658063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ada546-441c-4005-b24a-eded67ef4778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:46.661151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ad7f5-c5b7-48ad-911e-03c8175eb605 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:46.662105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ad7f5-c5b7-48ad-911e-03c8175eb605 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:46.662572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ad7f5-c5b7-48ad-911e-03c8175eb605 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:46.662932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ad7f5-c5b7-48ad-911e-03c8175eb605 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/projects/de4c4d80093b4243a09eff282e488858` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:46.664825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ad7f5-c5b7-48ad-911e-03c8175eb605 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:delete_project(project_id=de4c4d80093b4243a09eff282e488858)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:46.666856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ad7f5-c5b7-48ad-911e-03c8175eb605 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:46.673101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:46.721178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5f1ad7f5-c5b7-48ad-911e-03c8175eb605 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de4c4d80093b4243a09eff282e488858', 'request_id': 'req-5f1ad7f5-c5b7-48ad-911e-03c8175eb605'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.730311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ada546-441c-4005-b24a-eded67ef4778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:46.730530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5f1ad7f5-c5b7-48ad-911e-03c8175eb605 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de4c4d80093b4243a09eff282e488858', 'request_id': 'req-5f1ad7f5-c5b7-48ad-911e-03c8175eb605'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.731978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ada546-441c-4005-b24a-eded67ef4778 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:46.738942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5f1ad7f5-c5b7-48ad-911e-03c8175eb605 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de4c4d80093b4243a09eff282e488858', 'request_id': 'req-5f1ad7f5-c5b7-48ad-911e-03c8175eb605'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.745352 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3154/6330] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:46.756289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5f1ad7f5-c5b7-48ad-911e-03c8175eb605 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] The token cache is being invalidate because project de4c4d80093b4243a09eff282e488858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:46.756698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5f1ad7f5-c5b7-48ad-911e-03c8175eb605 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.757533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5f1ad7f5-c5b7-48ad-911e-03c8175eb605 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.759451 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3177/6331] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:46 2022] DELETE /identity/v3/projects/de4c4d80093b4243a09eff282e488858 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:46.765121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ada546-441c-4005-b24a-eded67ef4778 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:46.776503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ada546-441c-4005-b24a-eded67ef4778 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:46.838833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db1b9d-d0fc-4009-b444-58300041a409 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:46.839872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db1b9d-d0fc-4009-b444-58300041a409 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:46.840201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db1b9d-d0fc-4009-b444-58300041a409 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:46.840480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db1b9d-d0fc-4009-b444-58300041a409 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/domains/08677c7982ba445f92bc41342307ca52` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:46.841820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db1b9d-d0fc-4009-b444-58300041a409 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=08677c7982ba445f92bc41342307ca52)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:46.843560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db1b9d-d0fc-4009-b444-58300041a409 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:46.869545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-35db1b9d-d0fc-4009-b444-58300041a409 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '08677c7982ba445f92bc41342307ca52'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.870319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-35db1b9d-d0fc-4009-b444-58300041a409 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '08677c7982ba445f92bc41342307ca52'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.921555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-35db1b9d-d0fc-4009-b444-58300041a409 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '08677c7982ba445f92bc41342307ca52'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.921706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ad7f5-c5b7-48ad-911e-03c8175eb605 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:46.922873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-35db1b9d-d0fc-4009-b444-58300041a409 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '08677c7982ba445f92bc41342307ca52'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:46.923088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5f1ad7f5-c5b7-48ad-911e-03c8175eb605 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:46.926441 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3155/6332] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:25:46 2022] PATCH /identity/v3/domains/08677c7982ba445f92bc41342307ca52 => generated 277 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:46.930460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db1b9d-d0fc-4009-b444-58300041a409 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:46.932564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-35db1b9d-d0fc-4009-b444-58300041a409 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:46.979522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:47.005627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ad7f5-c5b7-48ad-911e-03c8175eb605 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:47.020397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db1b9d-d0fc-4009-b444-58300041a409 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:47.025780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe731f9621f4a108638f2a411275cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '046a9a5b347b4075af7a0f9459794496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:47.027130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:47.027130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:47.027555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] PATH_INFO: `/v3/domains/08677c7982ba445f92bc41342307ca52` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:47.040509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=08677c7982ba445f92bc41342307ca52)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:47.042188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:47.056217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:47.067982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66e1a4-5351-43f4-b297-bdeae46f511c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:47.068943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66e1a4-5351-43f4-b297-bdeae46f511c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:47.069238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66e1a4-5351-43f4-b297-bdeae46f511c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:47.069553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66e1a4-5351-43f4-b297-bdeae46f511c admin admin] PATH_INFO: `/v3/users/db0af998d6da410a925c96e01cac2d04` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:47.071245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66e1a4-5351-43f4-b297-bdeae46f511c admin admin] RBAC: Authorizing `identity:delete_user(user_id=db0af998d6da410a925c96e01cac2d04)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:47.073199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66e1a4-5351-43f4-b297-bdeae46f511c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:47.084728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '08677c7982ba445f92bc41342307ca52'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.108375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '08677c7982ba445f92bc41342307ca52'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.151598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cb66e1a4-5351-43f4-b297-bdeae46f511c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db0af998d6da410a925c96e01cac2d04'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.162299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08677c7982ba445f92bc41342307ca52', 'request_id': 'req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.162874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cb66e1a4-5351-43f4-b297-bdeae46f511c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db0af998d6da410a925c96e01cac2d04'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.163645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cb66e1a4-5351-43f4-b297-bdeae46f511c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db0af998d6da410a925c96e01cac2d04'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.164809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cb66e1a4-5351-43f4-b297-bdeae46f511c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db0af998d6da410a925c96e01cac2d04'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.188746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08677c7982ba445f92bc41342307ca52', 'request_id': 'req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.198678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cb66e1a4-5351-43f4-b297-bdeae46f511c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db0af998d6da410a925c96e01cac2d04'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.208847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08677c7982ba445f92bc41342307ca52', 'request_id': 'req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.223943 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3178/6333] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:46 2022] DELETE /identity/v3/users/db0af998d6da410a925c96e01cac2d04 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:47.228120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66e1a4-5351-43f4-b297-bdeae46f511c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:47.230041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cb66e1a4-5351-43f4-b297-bdeae46f511c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:47.234115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] The token cache is being invalidate because project 08677c7982ba445f92bc41342307ca52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:47.234483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.235208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.250087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '08677c7982ba445f92bc41342307ca52', 'request_id': 'req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.251305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '08677c7982ba445f92bc41342307ca52', 'request_id': 'req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.252453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35 tempest-InheritsV3TestJSON-183362828 tempest-InheritsV3TestJSON-183362828-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '08677c7982ba445f92bc41342307ca52', 'request_id': 'req-5acc12c7-14ee-4d07-b9ba-d4a3ee84fc35'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.263410 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3156/6334] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:25:46 2022] DELETE /identity/v3/domains/08677c7982ba445f92bc41342307ca52 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:47.265291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799db0b7-9265-46d4-a085-8618870d4953 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:47.265575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799db0b7-9265-46d4-a085-8618870d4953 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:47.265945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799db0b7-9265-46d4-a085-8618870d4953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:47.284297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-799db0b7-9265-46d4-a085-8618870d4953 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:47.285503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-799db0b7-9265-46d4-a085-8618870d4953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:47.304070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66e1a4-5351-43f4-b297-bdeae46f511c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:47.312245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0365f93-287a-4527-8b39-cd674f87df21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:47.313236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0365f93-287a-4527-8b39-cd674f87df21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:47.313619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0365f93-287a-4527-8b39-cd674f87df21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:47.314076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0365f93-287a-4527-8b39-cd674f87df21 admin admin] PATH_INFO: `/v3/projects/3b23abf292ab4eada0124fc2b5cea63c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:47.315318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0365f93-287a-4527-8b39-cd674f87df21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b23abf292ab4eada0124fc2b5cea63c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:47.317360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0365f93-287a-4527-8b39-cd674f87df21 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:47.324648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:47.354841 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3157/6335] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:47.355776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799db0b7-9265-46d4-a085-8618870d4953 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:47.357212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-799db0b7-9265-46d4-a085-8618870d4953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:47.369559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799db0b7-9265-46d4-a085-8618870d4953 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:47.377119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b0365f93-287a-4527-8b39-cd674f87df21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b23abf292ab4eada0124fc2b5cea63c', 'request_id': 'req-b0365f93-287a-4527-8b39-cd674f87df21'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.385342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b0365f93-287a-4527-8b39-cd674f87df21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b23abf292ab4eada0124fc2b5cea63c', 'request_id': 'req-b0365f93-287a-4527-8b39-cd674f87df21'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.391968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b0365f93-287a-4527-8b39-cd674f87df21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b23abf292ab4eada0124fc2b5cea63c', 'request_id': 'req-b0365f93-287a-4527-8b39-cd674f87df21'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.403857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b0365f93-287a-4527-8b39-cd674f87df21 admin admin] The token cache is being invalidate because project 3b23abf292ab4eada0124fc2b5cea63c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:47.404304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b0365f93-287a-4527-8b39-cd674f87df21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.405045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b0365f93-287a-4527-8b39-cd674f87df21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.407018 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3179/6336] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:47 2022] DELETE /identity/v3/projects/3b23abf292ab4eada0124fc2b5cea63c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:47.407798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0365f93-287a-4527-8b39-cd674f87df21 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:47.409173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b0365f93-287a-4527-8b39-cd674f87df21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:47.422607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:47.434224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e7b3f-aa60-456b-99ab-dc532a06c97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:47.435153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e7b3f-aa60-456b-99ab-dc532a06c97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:47.435556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e7b3f-aa60-456b-99ab-dc532a06c97d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:47.435716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e7b3f-aa60-456b-99ab-dc532a06c97d admin admin] PATH_INFO: `/v3/users/fefdb267175244c280c9a966ec929dab` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:47.437132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e7b3f-aa60-456b-99ab-dc532a06c97d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fefdb267175244c280c9a966ec929dab)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:47.439638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e7b3f-aa60-456b-99ab-dc532a06c97d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:47.469419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0365f93-287a-4527-8b39-cd674f87df21 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:47.473743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878225c4-8b39-48f1-b8b7-368b91fe7294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:47.474499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878225c4-8b39-48f1-b8b7-368b91fe7294 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:47.474928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878225c4-8b39-48f1-b8b7-368b91fe7294 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:47.475203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878225c4-8b39-48f1-b8b7-368b91fe7294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:47.477930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-878225c4-8b39-48f1-b8b7-368b91fe7294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:47.487668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3a4e7b3f-aa60-456b-99ab-dc532a06c97d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fefdb267175244c280c9a966ec929dab'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.491765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878225c4-8b39-48f1-b8b7-368b91fe7294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:47.493323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878225c4-8b39-48f1-b8b7-368b91fe7294 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:47.496889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3a4e7b3f-aa60-456b-99ab-dc532a06c97d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fefdb267175244c280c9a966ec929dab'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.504103 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3180/6337] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:47.505074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3a4e7b3f-aa60-456b-99ab-dc532a06c97d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fefdb267175244c280c9a966ec929dab'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.505445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4959e1a-0660-41f3-9b25-b843971e2e5c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:47.505771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4959e1a-0660-41f3-9b25-b843971e2e5c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:47.506035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4959e1a-0660-41f3-9b25-b843971e2e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:47.506321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3a4e7b3f-aa60-456b-99ab-dc532a06c97d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fefdb267175244c280c9a966ec929dab'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.507016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3a4e7b3f-aa60-456b-99ab-dc532a06c97d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fefdb267175244c280c9a966ec929dab'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.529324 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3158/6338] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:47 2022] DELETE /identity/v3/users/fefdb267175244c280c9a966ec929dab => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:47.529544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e4959e1a-0660-41f3-9b25-b843971e2e5c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:47.529544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e4959e1a-0660-41f3-9b25-b843971e2e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:47.531750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e75b19-5440-47f5-9704-510d127ea779 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:47.532204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e75b19-5440-47f5-9704-510d127ea779 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:47.532659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e75b19-5440-47f5-9704-510d127ea779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:47.555556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c3e75b19-5440-47f5-9704-510d127ea779 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:47.557114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c3e75b19-5440-47f5-9704-510d127ea779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:47.594200 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3181/6339] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:47.602207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7788e-bb1b-427e-92a2-439b3f74c01e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:47.602441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7788e-bb1b-427e-92a2-439b3f74c01e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:47.602714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7788e-bb1b-427e-92a2-439b3f74c01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:47.626482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-73d7788e-bb1b-427e-92a2-439b3f74c01e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:47.627885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-73d7788e-bb1b-427e-92a2-439b3f74c01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:47.637199 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3182/6340] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:47.641526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7788e-bb1b-427e-92a2-439b3f74c01e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:47.651338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7788e-bb1b-427e-92a2-439b3f74c01e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:47.656474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b94fbd-7971-4309-b2d0-27d7f874e047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:47.657340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b94fbd-7971-4309-b2d0-27d7f874e047 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:47.657630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b94fbd-7971-4309-b2d0-27d7f874e047 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:47.657911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b94fbd-7971-4309-b2d0-27d7f874e047 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:47.658041 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3159/6341] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:47.659005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b94fbd-7971-4309-b2d0-27d7f874e047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:47.659662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b94fbd-7971-4309-b2d0-27d7f874e047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:47.661100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b94fbd-7971-4309-b2d0-27d7f874e047 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:47.669784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e75b19-5440-47f5-9704-510d127ea779 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:47.671204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c3e75b19-5440-47f5-9704-510d127ea779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:47.675893 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3183/6342] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:25:47.682858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b94fbd-7971-4309-b2d0-27d7f874e047 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:47.699082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b94fbd-7971-4309-b2d0-27d7f874e047 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:47.705614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753a459-fbfc-42b4-a2da-3830e67a4d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:47.706632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753a459-fbfc-42b4-a2da-3830e67a4d55 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:47.706975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753a459-fbfc-42b4-a2da-3830e67a4d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:47.707334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753a459-fbfc-42b4-a2da-3830e67a4d55 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:47.708123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753a459-fbfc-42b4-a2da-3830e67a4d55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:47.710183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753a459-fbfc-42b4-a2da-3830e67a4d55 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:47.726724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:47.755998 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3184/6343] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:47 2022] POST /identity/v3/projects => generated 391 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:47.757123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753a459-fbfc-42b4-a2da-3830e67a4d55 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:47.767103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e75b19-5440-47f5-9704-510d127ea779 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:47.794252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:47.824315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec46d58-5939-4b62-8b2f-97c9075f35b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:47.824894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec46d58-5939-4b62-8b2f-97c9075f35b6 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:47.825182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec46d58-5939-4b62-8b2f-97c9075f35b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:47.825495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec46d58-5939-4b62-8b2f-97c9075f35b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:47.840863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753a459-fbfc-42b4-a2da-3830e67a4d55 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:47.846205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fff6c-7f2a-4567-b9cd-dd98d374ed05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:47.847399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fff6c-7f2a-4567-b9cd-dd98d374ed05 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:47.847890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fff6c-7f2a-4567-b9cd-dd98d374ed05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:47.849372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fff6c-7f2a-4567-b9cd-dd98d374ed05 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:47.850465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fff6c-7f2a-4567-b9cd-dd98d374ed05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:47.852762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fff6c-7f2a-4567-b9cd-dd98d374ed05 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:47.878496 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3185/6344] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:47 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:47.879343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fff6c-7f2a-4567-b9cd-dd98d374ed05 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:47.881104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b73fff6c-7f2a-4567-b9cd-dd98d374ed05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:47.893386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fff6c-7f2a-4567-b9cd-dd98d374ed05 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:47.898283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496680c-4f29-4ed5-9e39-3ace2e144d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:47.899212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496680c-4f29-4ed5-9e39-3ace2e144d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:47.899495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496680c-4f29-4ed5-9e39-3ace2e144d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:47.899765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496680c-4f29-4ed5-9e39-3ace2e144d66 admin admin] PATH_INFO: `/v3/projects/a9f130b860ce459491ddbf57ddf9e926` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:47.900627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec46d58-5939-4b62-8b2f-97c9075f35b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:47.901120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496680c-4f29-4ed5-9e39-3ace2e144d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9f130b860ce459491ddbf57ddf9e926)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:47.902082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec46d58-5939-4b62-8b2f-97c9075f35b6 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:47.903032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496680c-4f29-4ed5-9e39-3ace2e144d66 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:47.911719 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3160/6345] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:25:47.912575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec46d58-5939-4b62-8b2f-97c9075f35b6 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:47.922308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec46d58-5939-4b62-8b2f-97c9075f35b6 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:47.930014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe125949-f818-40b0-a146-3989a136402d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:47.930672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe125949-f818-40b0-a146-3989a136402d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:47.930948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe125949-f818-40b0-a146-3989a136402d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:47.931220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe125949-f818-40b0-a146-3989a136402d admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:47.931934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe125949-f818-40b0-a146-3989a136402d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:47.933772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe125949-f818-40b0-a146-3989a136402d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:47.946238 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3161/6346] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:47.950178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe125949-f818-40b0-a146-3989a136402d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:47.960348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3496680c-4f29-4ed5-9e39-3ace2e144d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9f130b860ce459491ddbf57ddf9e926', 'request_id': 'req-3496680c-4f29-4ed5-9e39-3ace2e144d66'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.962431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe125949-f818-40b0-a146-3989a136402d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:47.970206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3496680c-4f29-4ed5-9e39-3ace2e144d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9f130b860ce459491ddbf57ddf9e926', 'request_id': 'req-3496680c-4f29-4ed5-9e39-3ace2e144d66'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.980602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3496680c-4f29-4ed5-9e39-3ace2e144d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9f130b860ce459491ddbf57ddf9e926', 'request_id': 'req-3496680c-4f29-4ed5-9e39-3ace2e144d66'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.992529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3496680c-4f29-4ed5-9e39-3ace2e144d66 admin admin] The token cache is being invalidate because project a9f130b860ce459491ddbf57ddf9e926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:47.992865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3496680c-4f29-4ed5-9e39-3ace2e144d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.993664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3496680c-4f29-4ed5-9e39-3ace2e144d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:47.999195 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3186/6347] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:47 2022] DELETE /identity/v3/projects/a9f130b860ce459491ddbf57ddf9e926 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:48.002008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bf9df-c06c-4d19-9fec-a64ce558f238 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:48.002306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bf9df-c06c-4d19-9fec-a64ce558f238 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:48.002654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bf9df-c06c-4d19-9fec-a64ce558f238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:48.025367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6e7bf9df-c06c-4d19-9fec-a64ce558f238 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:48.027168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6e7bf9df-c06c-4d19-9fec-a64ce558f238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:48.047944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d3383-7bdc-4537-a3b3-c0e22007b4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:48.048701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d3383-7bdc-4537-a3b3-c0e22007b4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:48.049196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d3383-7bdc-4537-a3b3-c0e22007b4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:48.049476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d3383-7bdc-4537-a3b3-c0e22007b4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:48.050666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d3383-7bdc-4537-a3b3-c0e22007b4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:48.052704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d3383-7bdc-4537-a3b3-c0e22007b4b3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:48.064350 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3162/6348] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:25:48.069252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d3383-7bdc-4537-a3b3-c0e22007b4b3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:48.071174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-711d3383-7bdc-4537-a3b3-c0e22007b4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:48.084886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d3383-7bdc-4537-a3b3-c0e22007b4b3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:48.093096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92153807-d564-4f21-871e-d4207ec87499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:48.094126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92153807-d564-4f21-871e-d4207ec87499 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:48.094682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92153807-d564-4f21-871e-d4207ec87499 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:48.095051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92153807-d564-4f21-871e-d4207ec87499 admin admin] PATH_INFO: `/v3/projects/f54498cb60624135be89177d102f5d08/users/cc35b32c95534f24811a62700f01261b/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:48.099067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:48.114048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92153807-d564-4f21-871e-d4207ec87499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54498cb60624135be89177d102f5d08, user_id=cc35b32c95534f24811a62700f01261b, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:48.116812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92153807-d564-4f21-871e-d4207ec87499 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:48.119211 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3187/6349] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:48.121315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e1828-356d-491a-afb4-73500a3e76bf None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:48.121633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e1828-356d-491a-afb4-73500a3e76bf None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:48.121885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e1828-356d-491a-afb4-73500a3e76bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:48.132151 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3163/6350] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:48 2022] PUT /identity/v3/projects/f54498cb60624135be89177d102f5d08/users/cc35b32c95534f24811a62700f01261b/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:48.142728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4b0e1828-356d-491a-afb4-73500a3e76bf None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:48.144077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4b0e1828-356d-491a-afb4-73500a3e76bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:48.146515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2af3a-1cf4-4bc2-8f7a-98a9e244fbb7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:48.146815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2af3a-1cf4-4bc2-8f7a-98a9e244fbb7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:48.147747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2af3a-1cf4-4bc2-8f7a-98a9e244fbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:48.178260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c2c2af3a-1cf4-4bc2-8f7a-98a9e244fbb7 None None] MFA Rules not processed for user `cc35b32c95534f24811a62700f01261b`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:48.179772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c2c2af3a-1cf4-4bc2-8f7a-98a9e244fbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:48.215649 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3188/6351] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:48.217067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:48.220814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e1828-356d-491a-afb4-73500a3e76bf None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:48.230431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e1828-356d-491a-afb4-73500a3e76bf None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:48.237867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081d8e9-0392-43a5-8084-2f1ac72e5b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:48.238661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081d8e9-0392-43a5-8084-2f1ac72e5b55 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:48.238941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081d8e9-0392-43a5-8084-2f1ac72e5b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:48.239214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081d8e9-0392-43a5-8084-2f1ac72e5b55 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:48.239988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081d8e9-0392-43a5-8084-2f1ac72e5b55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:48.240332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081d8e9-0392-43a5-8084-2f1ac72e5b55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:48.241934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081d8e9-0392-43a5-8084-2f1ac72e5b55 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:48.258674 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3189/6352] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:48.259647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081d8e9-0392-43a5-8084-2f1ac72e5b55 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:48.261452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f081d8e9-0392-43a5-8084-2f1ac72e5b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:48.275958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081d8e9-0392-43a5-8084-2f1ac72e5b55 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:48.281040 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3164/6353] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:48.281040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2af3a-1cf4-4bc2-8f7a-98a9e244fbb7 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:48.291124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23851e-6978-464c-8764-2405a15be9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:48.292014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23851e-6978-464c-8764-2405a15be9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:48.292317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23851e-6978-464c-8764-2405a15be9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:48.292644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23851e-6978-464c-8764-2405a15be9cc admin admin] PATH_INFO: `/v3/projects/73e8a4798cd24c0086af113ca4cd14cb` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:48.293793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23851e-6978-464c-8764-2405a15be9cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=73e8a4798cd24c0086af113ca4cd14cb)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:48.294782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2af3a-1cf4-4bc2-8f7a-98a9e244fbb7 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:48.295726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23851e-6978-464c-8764-2405a15be9cc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:48.300257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c5c49-2de7-4f23-9f7c-aa92398dd234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:48.301035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c5c49-2de7-4f23-9f7c-aa92398dd234 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:48.301387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c5c49-2de7-4f23-9f7c-aa92398dd234 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:48.303339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c5c49-2de7-4f23-9f7c-aa92398dd234 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:48.303339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c5c49-2de7-4f23-9f7c-aa92398dd234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:48.304933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c5c49-2de7-4f23-9f7c-aa92398dd234 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:48.334229 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3165/6354] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:48 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:48.334229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c5c49-2de7-4f23-9f7c-aa92398dd234 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:48.338965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9a0c5c49-2de7-4f23-9f7c-aa92398dd234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:48.352786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2b23851e-6978-464c-8764-2405a15be9cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73e8a4798cd24c0086af113ca4cd14cb', 'request_id': 'req-2b23851e-6978-464c-8764-2405a15be9cc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:48.362270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2b23851e-6978-464c-8764-2405a15be9cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73e8a4798cd24c0086af113ca4cd14cb', 'request_id': 'req-2b23851e-6978-464c-8764-2405a15be9cc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:48.373902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2b23851e-6978-464c-8764-2405a15be9cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73e8a4798cd24c0086af113ca4cd14cb', 'request_id': 'req-2b23851e-6978-464c-8764-2405a15be9cc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:48.399800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2b23851e-6978-464c-8764-2405a15be9cc admin admin] The token cache is being invalidate because project 73e8a4798cd24c0086af113ca4cd14cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:48.400134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2b23851e-6978-464c-8764-2405a15be9cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:48.400996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2b23851e-6978-464c-8764-2405a15be9cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:48.406260 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3190/6355] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:48 2022] DELETE /identity/v3/projects/73e8a4798cd24c0086af113ca4cd14cb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:48.406260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23851e-6978-464c-8764-2405a15be9cc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:48.409573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2b23851e-6978-464c-8764-2405a15be9cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:48.437958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c5c49-2de7-4f23-9f7c-aa92398dd234 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:48.490291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23851e-6978-464c-8764-2405a15be9cc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:48.494001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34ddaa-d278-4a13-9eab-60c2b2a04d3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:48.494724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34ddaa-d278-4a13-9eab-60c2b2a04d3f service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:48.494938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb228b-f842-48d7-abd2-787e711bc26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:48.495075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34ddaa-d278-4a13-9eab-60c2b2a04d3f service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:48.495312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34ddaa-d278-4a13-9eab-60c2b2a04d3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:48.495608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb228b-f842-48d7-abd2-787e711bc26c admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:48.495888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb228b-f842-48d7-abd2-787e711bc26c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:48.496187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb228b-f842-48d7-abd2-787e711bc26c admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:48.496880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb228b-f842-48d7-abd2-787e711bc26c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:48.497373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1b34ddaa-d278-4a13-9eab-60c2b2a04d3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:48.498846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb228b-f842-48d7-abd2-787e711bc26c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:48.515151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:48.520648 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3191/6356] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:48 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:48.522112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb228b-f842-48d7-abd2-787e711bc26c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:48.525219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6cfb228b-f842-48d7-abd2-787e711bc26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:48.539374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb228b-f842-48d7-abd2-787e711bc26c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:48.544576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f8d32-7de8-497c-9708-c0e20f65ccb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:48.545493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f8d32-7de8-497c-9708-c0e20f65ccb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:48.545769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f8d32-7de8-497c-9708-c0e20f65ccb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:48.546040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f8d32-7de8-497c-9708-c0e20f65ccb1 admin admin] PATH_INFO: `/v3/users/1fe731f9621f4a108638f2a411275cf6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:48.547312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f8d32-7de8-497c-9708-c0e20f65ccb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe731f9621f4a108638f2a411275cf6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:48.549413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f8d32-7de8-497c-9708-c0e20f65ccb1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:48.563766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34ddaa-d278-4a13-9eab-60c2b2a04d3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:48.565439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34ddaa-d278-4a13-9eab-60c2b2a04d3f service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:48.574592 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3166/6357] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:48.575406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34ddaa-d278-4a13-9eab-60c2b2a04d3f service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:48.586636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34ddaa-d278-4a13-9eab-60c2b2a04d3f service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:48.593506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96fc64-ef1b-4f32-899a-8fb40700e0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:48.594179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96fc64-ef1b-4f32-899a-8fb40700e0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:48.594461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96fc64-ef1b-4f32-899a-8fb40700e0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:48.594736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96fc64-ef1b-4f32-899a-8fb40700e0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:48.595495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96fc64-ef1b-4f32-899a-8fb40700e0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:48.597272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96fc64-ef1b-4f32-899a-8fb40700e0a5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:48.602179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f49f8d32-7de8-497c-9708-c0e20f65ccb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe731f9621f4a108638f2a411275cf6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:48.611315 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3167/6358] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:48.611796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f49f8d32-7de8-497c-9708-c0e20f65ccb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe731f9621f4a108638f2a411275cf6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:48.612540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f49f8d32-7de8-497c-9708-c0e20f65ccb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe731f9621f4a108638f2a411275cf6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:48.613392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96fc64-ef1b-4f32-899a-8fb40700e0a5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:48.613955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f49f8d32-7de8-497c-9708-c0e20f65ccb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe731f9621f4a108638f2a411275cf6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:48.624183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96fc64-ef1b-4f32-899a-8fb40700e0a5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:48.626074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f49f8d32-7de8-497c-9708-c0e20f65ccb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe731f9621f4a108638f2a411275cf6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:48.629727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8978d1-cd85-4e8e-b52b-11229226890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:48.631216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8978d1-cd85-4e8e-b52b-11229226890e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:48.631509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8978d1-cd85-4e8e-b52b-11229226890e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:48.631788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8978d1-cd85-4e8e-b52b-11229226890e admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:48.632554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8978d1-cd85-4e8e-b52b-11229226890e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:48.634252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8978d1-cd85-4e8e-b52b-11229226890e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:48.635856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:48.649839 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3168/6359] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:48.650934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8978d1-cd85-4e8e-b52b-11229226890e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:48.653960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ab8978d1-cd85-4e8e-b52b-11229226890e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:48.657729 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3192/6360] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:48 2022] DELETE /identity/v3/users/1fe731f9621f4a108638f2a411275cf6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:48.670097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8978d1-cd85-4e8e-b52b-11229226890e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:48.732349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c2849-16cf-43f8-86b4-4ff5aff2944c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:48.733255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c2849-16cf-43f8-86b4-4ff5aff2944c admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:48.733536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c2849-16cf-43f8-86b4-4ff5aff2944c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:48.734077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c2849-16cf-43f8-86b4-4ff5aff2944c admin admin] PATH_INFO: `/v3/projects/17aa5e2365bd44d0a30d3054b8f77f9c/users/c7599c488c2447c89538088e2cfc8d1c/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:48.752083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c2849-16cf-43f8-86b4-4ff5aff2944c admin admin] RBAC: Authorizing `identity:create_grant(project_id=17aa5e2365bd44d0a30d3054b8f77f9c, user_id=c7599c488c2447c89538088e2cfc8d1c, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:48.754833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c2849-16cf-43f8-86b4-4ff5aff2944c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:48.774580 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3169/6361] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:48 2022] PUT /identity/v3/projects/17aa5e2365bd44d0a30d3054b8f77f9c/users/c7599c488c2447c89538088e2cfc8d1c/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:48.786808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8dda9-13ea-488d-b916-0952696d6242 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:48.787368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8dda9-13ea-488d-b916-0952696d6242 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:48.787769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8dda9-13ea-488d-b916-0952696d6242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:48.821579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-36e8dda9-13ea-488d-b916-0952696d6242 None None] MFA Rules not processed for user `c7599c488c2447c89538088e2cfc8d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:48.822770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-36e8dda9-13ea-488d-b916-0952696d6242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:48.923111 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3193/6362] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:48.935257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c2849-16cf-43f8-86b4-4ff5aff2944c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:48.937317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0c8c2849-16cf-43f8-86b4-4ff5aff2944c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:48.978660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8dda9-13ea-488d-b916-0952696d6242 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:48.980477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-36e8dda9-13ea-488d-b916-0952696d6242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:49.014872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c2849-16cf-43f8-86b4-4ff5aff2944c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:49.018585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e478a-7d4b-4a4f-adc4-680137c01724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:49.019233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e478a-7d4b-4a4f-adc4-680137c01724 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:49.019514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e478a-7d4b-4a4f-adc4-680137c01724 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:49.019785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e478a-7d4b-4a4f-adc4-680137c01724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:49.028703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e478a-7d4b-4a4f-adc4-680137c01724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:49.030177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e478a-7d4b-4a4f-adc4-680137c01724 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:49.039693 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3170/6363] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:49.064192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8dda9-13ea-488d-b916-0952696d6242 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:49.069222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be496d-3204-4216-b4c2-2ae007460cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:49.070188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be496d-3204-4216-b4c2-2ae007460cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:49.070561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be496d-3204-4216-b4c2-2ae007460cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:49.070955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be496d-3204-4216-b4c2-2ae007460cb5 admin admin] PATH_INFO: `/v3/projects/046a9a5b347b4075af7a0f9459794496` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:49.072384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be496d-3204-4216-b4c2-2ae007460cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=046a9a5b347b4075af7a0f9459794496)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:49.074403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be496d-3204-4216-b4c2-2ae007460cb5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:49.085803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:49.129615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-54be496d-3204-4216-b4c2-2ae007460cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046a9a5b347b4075af7a0f9459794496', 'request_id': 'req-54be496d-3204-4216-b4c2-2ae007460cb5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:49.137996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-54be496d-3204-4216-b4c2-2ae007460cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046a9a5b347b4075af7a0f9459794496', 'request_id': 'req-54be496d-3204-4216-b4c2-2ae007460cb5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:49.144795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-54be496d-3204-4216-b4c2-2ae007460cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046a9a5b347b4075af7a0f9459794496', 'request_id': 'req-54be496d-3204-4216-b4c2-2ae007460cb5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:49.155399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-54be496d-3204-4216-b4c2-2ae007460cb5 admin admin] The token cache is being invalidate because project 046a9a5b347b4075af7a0f9459794496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:49.155689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-54be496d-3204-4216-b4c2-2ae007460cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:49.156415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-54be496d-3204-4216-b4c2-2ae007460cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:49.158303 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3194/6364] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:48 2022] DELETE /identity/v3/projects/046a9a5b347b4075af7a0f9459794496 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:49.163659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960f52e-2a2d-457f-9cff-82400b44e36f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:49.163950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960f52e-2a2d-457f-9cff-82400b44e36f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:49.164283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960f52e-2a2d-457f-9cff-82400b44e36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:49.183824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c960f52e-2a2d-457f-9cff-82400b44e36f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:49.185215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c960f52e-2a2d-457f-9cff-82400b44e36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:49.246840 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3171/6365] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:49.254470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e38eb7-ddad-4b82-babf-454695ab14ff None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:49.255024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e38eb7-ddad-4b82-babf-454695ab14ff None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:49.255024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e38eb7-ddad-4b82-babf-454695ab14ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:49.275329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f3e38eb7-ddad-4b82-babf-454695ab14ff None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:49.276906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f3e38eb7-ddad-4b82-babf-454695ab14ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:49.285272 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3195/6366] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:49.289763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960f52e-2a2d-457f-9cff-82400b44e36f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:49.300003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960f52e-2a2d-457f-9cff-82400b44e36f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:49.305460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbc158-75dc-4aa9-b4b4-fe69b783cfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:49.306098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbc158-75dc-4aa9-b4b4-fe69b783cfdc admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:49.306462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbc158-75dc-4aa9-b4b4-fe69b783cfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:49.306731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbc158-75dc-4aa9-b4b4-fe69b783cfdc admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:49.307460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbc158-75dc-4aa9-b4b4-fe69b783cfdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:49.307767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbc158-75dc-4aa9-b4b4-fe69b783cfdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:49.309562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbc158-75dc-4aa9-b4b4-fe69b783cfdc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:49.324097 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3172/6367] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:25:49.327076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e38eb7-ddad-4b82-babf-454695ab14ff None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:49.337648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e38eb7-ddad-4b82-babf-454695ab14ff None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:49.342478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7aeb5-fc68-40b6-9dbd-e40bd43aa203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:49.343140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7aeb5-fc68-40b6-9dbd-e40bd43aa203 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:49.343433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7aeb5-fc68-40b6-9dbd-e40bd43aa203 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:49.343711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7aeb5-fc68-40b6-9dbd-e40bd43aa203 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:49.344536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7aeb5-fc68-40b6-9dbd-e40bd43aa203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:49.346551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7aeb5-fc68-40b6-9dbd-e40bd43aa203 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:49.383041 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3196/6368] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:49 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:49.384314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbc158-75dc-4aa9-b4b4-fe69b783cfdc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:49.394760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbc158-75dc-4aa9-b4b4-fe69b783cfdc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:49.400144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:49.461138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ba9a0-9dc5-4fb4-8130-c2897144cd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:49.462008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ba9a0-9dc5-4fb4-8130-c2897144cd93 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:49.462211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ba9a0-9dc5-4fb4-8130-c2897144cd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:49.462487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ba9a0-9dc5-4fb4-8130-c2897144cd93 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:49.463213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ba9a0-9dc5-4fb4-8130-c2897144cd93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:49.465345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ba9a0-9dc5-4fb4-8130-c2897144cd93 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:49.495472 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3173/6369] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:49 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:49.500213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7aeb5-fc68-40b6-9dbd-e40bd43aa203 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:49.514821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7aeb5-fc68-40b6-9dbd-e40bd43aa203 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:49.519817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466f190-e50b-4522-a5c4-0a671fa99a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:49.520524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466f190-e50b-4522-a5c4-0a671fa99a78 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:49.520809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466f190-e50b-4522-a5c4-0a671fa99a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:49.521087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466f190-e50b-4522-a5c4-0a671fa99a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:49.521940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466f190-e50b-4522-a5c4-0a671fa99a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:49.523564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466f190-e50b-4522-a5c4-0a671fa99a78 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:49.535282 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3197/6370] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:49.540333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ba9a0-9dc5-4fb4-8130-c2897144cd93 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:49.551021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ba9a0-9dc5-4fb4-8130-c2897144cd93 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:49.556878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b8aff-2608-490c-8513-a3a09c596f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:49.558239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b8aff-2608-490c-8513-a3a09c596f8b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:49.558521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b8aff-2608-490c-8513-a3a09c596f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:49.558927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b8aff-2608-490c-8513-a3a09c596f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:49.559816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b8aff-2608-490c-8513-a3a09c596f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:49.561648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b8aff-2608-490c-8513-a3a09c596f8b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:49.573298 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3174/6371] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:49.577607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466f190-e50b-4522-a5c4-0a671fa99a78 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:49.587925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466f190-e50b-4522-a5c4-0a671fa99a78 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:49.592614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845792d-e559-4704-888b-4b3aac047f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:49.593529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845792d-e559-4704-888b-4b3aac047f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:49.593971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845792d-e559-4704-888b-4b3aac047f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:49.594260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845792d-e559-4704-888b-4b3aac047f5b admin admin] PATH_INFO: `/v3/projects/9784e6efcd2a4d649dc6a7be7f782fa5/users/42305f6c5df84c609ee6a9c94edb63d4/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:49.611482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845792d-e559-4704-888b-4b3aac047f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9784e6efcd2a4d649dc6a7be7f782fa5, user_id=42305f6c5df84c609ee6a9c94edb63d4, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:49.614326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845792d-e559-4704-888b-4b3aac047f5b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:49.631445 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3198/6372] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:49 2022] PUT /identity/v3/projects/9784e6efcd2a4d649dc6a7be7f782fa5/users/42305f6c5df84c609ee6a9c94edb63d4/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:49.644481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b161b4f-16ab-44cc-92a0-a07d1efabf0e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:49.645261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b161b4f-16ab-44cc-92a0-a07d1efabf0e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:49.645567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b161b4f-16ab-44cc-92a0-a07d1efabf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:49.673547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9b161b4f-16ab-44cc-92a0-a07d1efabf0e None None] MFA Rules not processed for user `42305f6c5df84c609ee6a9c94edb63d4`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:49.674910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9b161b4f-16ab-44cc-92a0-a07d1efabf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:49.756452 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3175/6373] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:49.761159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845792d-e559-4704-888b-4b3aac047f5b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:49.827811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845792d-e559-4704-888b-4b3aac047f5b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:49.833205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36191cc-a6cb-41aa-b436-76e4f8d14584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:49.834215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36191cc-a6cb-41aa-b436-76e4f8d14584 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:49.834560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36191cc-a6cb-41aa-b436-76e4f8d14584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:49.834901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36191cc-a6cb-41aa-b436-76e4f8d14584 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:49.835686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36191cc-a6cb-41aa-b436-76e4f8d14584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:49.837772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36191cc-a6cb-41aa-b436-76e4f8d14584 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:49.864685 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3199/6374] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:49 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:49.869005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b161b4f-16ab-44cc-92a0-a07d1efabf0e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:49.881262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b161b4f-16ab-44cc-92a0-a07d1efabf0e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:49.943902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef67afd-4439-4c78-b212-b4a250fb29aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:49.944650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef67afd-4439-4c78-b212-b4a250fb29aa admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:49.944920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef67afd-4439-4c78-b212-b4a250fb29aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:49.945390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef67afd-4439-4c78-b212-b4a250fb29aa admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:49.946183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef67afd-4439-4c78-b212-b4a250fb29aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:49.948154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef67afd-4439-4c78-b212-b4a250fb29aa admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:49.973185 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3176/6375] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:49 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:49.977272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36191cc-a6cb-41aa-b436-76e4f8d14584 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:49.989465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36191cc-a6cb-41aa-b436-76e4f8d14584 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:49.995622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f76ad-2af3-4b7c-b372-b4f9a4e3e9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:49.996765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f76ad-2af3-4b7c-b372-b4f9a4e3e9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:49.997309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f76ad-2af3-4b7c-b372-b4f9a4e3e9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:49.997825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f76ad-2af3-4b7c-b372-b4f9a4e3e9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:49.998725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f76ad-2af3-4b7c-b372-b4f9a4e3e9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:50.000745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f76ad-2af3-4b7c-b372-b4f9a4e3e9e0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:50.016304 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3200/6376] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:50.022406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef67afd-4439-4c78-b212-b4a250fb29aa admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:50.035350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef67afd-4439-4c78-b212-b4a250fb29aa admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:50.041178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfdbd8-b90a-4a7f-b521-2321f6d5dab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:50.042087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfdbd8-b90a-4a7f-b521-2321f6d5dab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:50.042419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfdbd8-b90a-4a7f-b521-2321f6d5dab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:50.042697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfdbd8-b90a-4a7f-b521-2321f6d5dab9 admin admin] PATH_INFO: `/v3/projects/effbac7399534359955f1e6bd3a2d4fc/users/06f7d76f0bab494bba54e9e8d6c56f3d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:50.045378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:50.060984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bfdbd8-b90a-4a7f-b521-2321f6d5dab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=effbac7399534359955f1e6bd3a2d4fc, user_id=06f7d76f0bab494bba54e9e8d6c56f3d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:50.063672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bfdbd8-b90a-4a7f-b521-2321f6d5dab9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:50.084706 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3177/6377] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:50 2022] PUT /identity/v3/projects/effbac7399534359955f1e6bd3a2d4fc/users/06f7d76f0bab494bba54e9e8d6c56f3d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:50.089257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f76ad-2af3-4b7c-b372-b4f9a4e3e9e0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:50.096427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:50.103565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f76ad-2af3-4b7c-b372-b4f9a4e3e9e0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:50.176987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfdbd8-b90a-4a7f-b521-2321f6d5dab9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:50.179004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e5bfdbd8-b90a-4a7f-b521-2321f6d5dab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:50.186161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f0677-b345-4b66-95ef-35a0c0be7314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:50.186934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f0677-b345-4b66-95ef-35a0c0be7314 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:50.187287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f0677-b345-4b66-95ef-35a0c0be7314 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:50.187629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f0677-b345-4b66-95ef-35a0c0be7314 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:50.188459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f0677-b345-4b66-95ef-35a0c0be7314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:50.190181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f0677-b345-4b66-95ef-35a0c0be7314 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:50.200309 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3201/6378] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:25:50.204380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f0677-b345-4b66-95ef-35a0c0be7314 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:50.214161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f0677-b345-4b66-95ef-35a0c0be7314 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:50.218849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997b3bf-ffd4-4a0e-b211-4e4cdde28dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:50.219748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997b3bf-ffd4-4a0e-b211-4e4cdde28dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:50.220031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997b3bf-ffd4-4a0e-b211-4e4cdde28dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:50.220335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997b3bf-ffd4-4a0e-b211-4e4cdde28dbb admin admin] PATH_INFO: `/v3/projects/effbac7399534359955f1e6bd3a2d4fc/users/06f7d76f0bab494bba54e9e8d6c56f3d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:50.222377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997b3bf-ffd4-4a0e-b211-4e4cdde28dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=effbac7399534359955f1e6bd3a2d4fc, user_id=06f7d76f0bab494bba54e9e8d6c56f3d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:50.225065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997b3bf-ffd4-4a0e-b211-4e4cdde28dbb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:50.235221 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3202/6379] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:50 2022] PUT /identity/v3/projects/effbac7399534359955f1e6bd3a2d4fc/users/06f7d76f0bab494bba54e9e8d6c56f3d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:50.246705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efe967-b888-4b1b-b4b7-08e09bb19268 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:50.247087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efe967-b888-4b1b-b4b7-08e09bb19268 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:50.247480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efe967-b888-4b1b-b4b7-08e09bb19268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:50.247949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfdbd8-b90a-4a7f-b521-2321f6d5dab9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:50.273980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-01efe967-b888-4b1b-b4b7-08e09bb19268 None None] MFA Rules not processed for user `06f7d76f0bab494bba54e9e8d6c56f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:50.275200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-01efe967-b888-4b1b-b4b7-08e09bb19268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:50.305297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3056e9b-6c33-4097-9eb9-2402e3563dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:50.306503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3056e9b-6c33-4097-9eb9-2402e3563dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:50.306820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3056e9b-6c33-4097-9eb9-2402e3563dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:50.307100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3056e9b-6c33-4097-9eb9-2402e3563dbb admin admin] PATH_INFO: `/v3/users/cc35b32c95534f24811a62700f01261b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:50.308436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3056e9b-6c33-4097-9eb9-2402e3563dbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc35b32c95534f24811a62700f01261b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:50.310365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3056e9b-6c33-4097-9eb9-2402e3563dbb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:50.346347 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3203/6380] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:50.351374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efe967-b888-4b1b-b4b7-08e09bb19268 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:50.361637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f3056e9b-6c33-4097-9eb9-2402e3563dbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc35b32c95534f24811a62700f01261b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.361872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efe967-b888-4b1b-b4b7-08e09bb19268 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:50.367314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260e2f1-d4be-45fe-8dbd-23403e75073b tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f7d76f0bab494bba54e9e8d6c56f3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'effbac7399534359955f1e6bd3a2d4fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:50.367979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260e2f1-d4be-45fe-8dbd-23403e75073b tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:50.368300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260e2f1-d4be-45fe-8dbd-23403e75073b tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:50.368586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260e2f1-d4be-45fe-8dbd-23403e75073b tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:50.369324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260e2f1-d4be-45fe-8dbd-23403e75073b tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:50.370377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f3056e9b-6c33-4097-9eb9-2402e3563dbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc35b32c95534f24811a62700f01261b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.371191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260e2f1-d4be-45fe-8dbd-23403e75073b tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:50.378232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f3056e9b-6c33-4097-9eb9-2402e3563dbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc35b32c95534f24811a62700f01261b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.379088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f3056e9b-6c33-4097-9eb9-2402e3563dbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc35b32c95534f24811a62700f01261b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.379801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f3056e9b-6c33-4097-9eb9-2402e3563dbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc35b32c95534f24811a62700f01261b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.398711 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3178/6381] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:50 2022] DELETE /identity/v3/users/cc35b32c95534f24811a62700f01261b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:50.403354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673b0ac-18cc-49ba-80b1-bb9f002d3d34 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:50.403640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673b0ac-18cc-49ba-80b1-bb9f002d3d34 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:50.407109 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3204/6382] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:50 2022] POST /identity/v3/projects => generated 357 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:50.407269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673b0ac-18cc-49ba-80b1-bb9f002d3d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:50.408259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260e2f1-d4be-45fe-8dbd-23403e75073b tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:50.410561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4260e2f1-d4be-45fe-8dbd-23403e75073b tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:50.421039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1673b0ac-18cc-49ba-80b1-bb9f002d3d34 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:50.422212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1673b0ac-18cc-49ba-80b1-bb9f002d3d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:50.427092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:50.468650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:50.482110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260e2f1-d4be-45fe-8dbd-23403e75073b tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:50.487282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed0b04-4e0b-4f47-95d7-5e0f4c054960 tempest-ProjectsNegativeTestJSON-1474508445 tempest-ProjectsNegativeTestJSON-1474508445-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42305f6c5df84c609ee6a9c94edb63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9784e6efcd2a4d649dc6a7be7f782fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:50.488342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed0b04-4e0b-4f47-95d7-5e0f4c054960 tempest-ProjectsNegativeTestJSON-1474508445 tempest-ProjectsNegativeTestJSON-1474508445-project] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:50.488706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed0b04-4e0b-4f47-95d7-5e0f4c054960 tempest-ProjectsNegativeTestJSON-1474508445 tempest-ProjectsNegativeTestJSON-1474508445-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:50.489030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed0b04-4e0b-4f47-95d7-5e0f4c054960 tempest-ProjectsNegativeTestJSON-1474508445 tempest-ProjectsNegativeTestJSON-1474508445-project] PATH_INFO: `/v3/projects/181425bc681e4057a04eb2748b1d8b22` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:50.490272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed0b04-4e0b-4f47-95d7-5e0f4c054960 tempest-ProjectsNegativeTestJSON-1474508445 tempest-ProjectsNegativeTestJSON-1474508445-project] RBAC: Authorizing `identity:delete_project(project_id=181425bc681e4057a04eb2748b1d8b22)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:50.491891 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3179/6383] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:50.502429 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-a7ed0b04-4e0b-4f47-95d7-5e0f4c054960 tempest-ProjectsNegativeTestJSON-1474508445 tempest-ProjectsNegativeTestJSON-1474508445-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jul 02 21:25:50.502429 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:25:50.502429 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:25:50.502429 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:25:50.502429 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:25:50.502429 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:25:50.502429 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:25:50.502429 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:25:50.502429 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:25:50.502429 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:25:50.502429 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:25:50.502429 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:25:50.502429 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Jul 02 21:25:50.502429 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 02 21:25:50.503817 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 02 21:25:50.503817 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 02 21:25:50.503817 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 02 21:25:50.503817 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 02 21:25:50.503817 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:25:50.503817 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 02 21:25:50.503817 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jul 02 21:25:50.503817 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:25:50.505052 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3205/6384] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:50 2022] DELETE /identity/v3/projects/181425bc681e4057a04eb2748b1d8b22 => generated 136 bytes in 97 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Jul 02 21:25:50.507730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673b0ac-18cc-49ba-80b1-bb9f002d3d34 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:50.509302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed0b04-4e0b-4f47-95d7-5e0f4c054960 tempest-ProjectsNegativeTestJSON-1474508445 tempest-ProjectsNegativeTestJSON-1474508445-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:50.509680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1673b0ac-18cc-49ba-80b1-bb9f002d3d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:50.512195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a7ed0b04-4e0b-4f47-95d7-5e0f4c054960 tempest-ProjectsNegativeTestJSON-1474508445 tempest-ProjectsNegativeTestJSON-1474508445-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:50.592652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed0b04-4e0b-4f47-95d7-5e0f4c054960 tempest-ProjectsNegativeTestJSON-1474508445 tempest-ProjectsNegativeTestJSON-1474508445-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:50.598099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673b0ac-18cc-49ba-80b1-bb9f002d3d34 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:50.598971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4505e8-28e6-41f3-9028-ba1a46c0f2a9 tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f7d76f0bab494bba54e9e8d6c56f3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'effbac7399534359955f1e6bd3a2d4fc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:50.599879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4505e8-28e6-41f3-9028-ba1a46c0f2a9 tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:50.600179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4505e8-28e6-41f3-9028-ba1a46c0f2a9 tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:50.601938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4505e8-28e6-41f3-9028-ba1a46c0f2a9 tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] PATH_INFO: `/v3/projects/181425bc681e4057a04eb2748b1d8b22` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:50.602858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebb2e7-b457-4bf5-922f-132ec5929026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:50.603017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4505e8-28e6-41f3-9028-ba1a46c0f2a9 tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] RBAC: Authorizing `identity:delete_project(project_id=181425bc681e4057a04eb2748b1d8b22)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:50.603471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebb2e7-b457-4bf5-922f-132ec5929026 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:50.603743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebb2e7-b457-4bf5-922f-132ec5929026 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:50.604148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebb2e7-b457-4bf5-922f-132ec5929026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:50.605090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4505e8-28e6-41f3-9028-ba1a46c0f2a9 tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:50.616028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebb2e7-b457-4bf5-922f-132ec5929026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:50.617564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebb2e7-b457-4bf5-922f-132ec5929026 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:50.628474 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3180/6385] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:50.669422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1b4505e8-28e6-41f3-9028-ba1a46c0f2a9 tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '181425bc681e4057a04eb2748b1d8b22', 'request_id': 'req-1b4505e8-28e6-41f3-9028-ba1a46c0f2a9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.669618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebb2e7-b457-4bf5-922f-132ec5929026 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:50.671466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a6ebb2e7-b457-4bf5-922f-132ec5929026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:50.680600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1b4505e8-28e6-41f3-9028-ba1a46c0f2a9 tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '181425bc681e4057a04eb2748b1d8b22', 'request_id': 'req-1b4505e8-28e6-41f3-9028-ba1a46c0f2a9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.688901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebb2e7-b457-4bf5-922f-132ec5929026 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:50.699252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1b4505e8-28e6-41f3-9028-ba1a46c0f2a9 tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '181425bc681e4057a04eb2748b1d8b22', 'request_id': 'req-1b4505e8-28e6-41f3-9028-ba1a46c0f2a9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.722662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1b4505e8-28e6-41f3-9028-ba1a46c0f2a9 tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] The token cache is being invalidate because project 181425bc681e4057a04eb2748b1d8b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:50.723260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1b4505e8-28e6-41f3-9028-ba1a46c0f2a9 tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.728640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1b4505e8-28e6-41f3-9028-ba1a46c0f2a9 tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.731191 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3206/6386] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:50 2022] DELETE /identity/v3/projects/181425bc681e4057a04eb2748b1d8b22 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:50.736499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4505e8-28e6-41f3-9028-ba1a46c0f2a9 tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:50.738100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1b4505e8-28e6-41f3-9028-ba1a46c0f2a9 tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:50.762858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f04d8-b044-4511-a0e6-5d91156798d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:50.764255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f04d8-b044-4511-a0e6-5d91156798d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:50.764536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f04d8-b044-4511-a0e6-5d91156798d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:50.764815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f04d8-b044-4511-a0e6-5d91156798d9 admin admin] PATH_INFO: `/v3/users/c7599c488c2447c89538088e2cfc8d1c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:50.766555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f04d8-b044-4511-a0e6-5d91156798d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7599c488c2447c89538088e2cfc8d1c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:50.768720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f04d8-b044-4511-a0e6-5d91156798d9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:50.833314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e4f04d8-b044-4511-a0e6-5d91156798d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7599c488c2447c89538088e2cfc8d1c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.845363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e4f04d8-b044-4511-a0e6-5d91156798d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7599c488c2447c89538088e2cfc8d1c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.847297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:50.855897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e4f04d8-b044-4511-a0e6-5d91156798d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7599c488c2447c89538088e2cfc8d1c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.857202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e4f04d8-b044-4511-a0e6-5d91156798d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7599c488c2447c89538088e2cfc8d1c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.857923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e4f04d8-b044-4511-a0e6-5d91156798d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7599c488c2447c89538088e2cfc8d1c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.881209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4505e8-28e6-41f3-9028-ba1a46c0f2a9 tempest-ProjectsNegativeTestJSON-1608380051 tempest-ProjectsNegativeTestJSON-1608380051-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:50.886103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fe36d-9fcb-4407-99e2-7838d7feee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:50.886955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fe36d-9fcb-4407-99e2-7838d7feee8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:50.887228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fe36d-9fcb-4407-99e2-7838d7feee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:50.887503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fe36d-9fcb-4407-99e2-7838d7feee8f admin admin] PATH_INFO: `/v3/users/42305f6c5df84c609ee6a9c94edb63d4` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:50.888769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fe36d-9fcb-4407-99e2-7838d7feee8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=42305f6c5df84c609ee6a9c94edb63d4)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:50.890735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fe36d-9fcb-4407-99e2-7838d7feee8f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:50.891266 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3181/6387] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:50 2022] DELETE /identity/v3/users/c7599c488c2447c89538088e2cfc8d1c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:50.896741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cf43d-2e8b-48ee-891e-10e9b7fed9b3 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:50.897033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cf43d-2e8b-48ee-891e-10e9b7fed9b3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:50.897317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cf43d-2e8b-48ee-891e-10e9b7fed9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:50.918758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a95cf43d-2e8b-48ee-891e-10e9b7fed9b3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:50.920417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a95cf43d-2e8b-48ee-891e-10e9b7fed9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:50.937898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:50.965587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-250fe36d-9fcb-4407-99e2-7838d7feee8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42305f6c5df84c609ee6a9c94edb63d4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.975127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-250fe36d-9fcb-4407-99e2-7838d7feee8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42305f6c5df84c609ee6a9c94edb63d4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.975926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-250fe36d-9fcb-4407-99e2-7838d7feee8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42305f6c5df84c609ee6a9c94edb63d4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.977152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-250fe36d-9fcb-4407-99e2-7838d7feee8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42305f6c5df84c609ee6a9c94edb63d4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.987038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-250fe36d-9fcb-4407-99e2-7838d7feee8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42305f6c5df84c609ee6a9c94edb63d4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:50.996745 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3182/6388] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:51.006250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cf43d-2e8b-48ee-891e-10e9b7fed9b3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:51.007211 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3207/6389] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:50 2022] DELETE /identity/v3/users/42305f6c5df84c609ee6a9c94edb63d4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:51.007688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a95cf43d-2e8b-48ee-891e-10e9b7fed9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:51.011954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47789ad-8819-4e8f-8960-b5c4b03bf810 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:51.011954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47789ad-8819-4e8f-8960-b5c4b03bf810 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:51.012267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47789ad-8819-4e8f-8960-b5c4b03bf810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:51.032223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b47789ad-8819-4e8f-8960-b5c4b03bf810 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:51.033897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b47789ad-8819-4e8f-8960-b5c4b03bf810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:51.076707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cf43d-2e8b-48ee-891e-10e9b7fed9b3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:51.108497 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3208/6390] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:51.109374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47789ad-8819-4e8f-8960-b5c4b03bf810 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:51.110832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b47789ad-8819-4e8f-8960-b5c4b03bf810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:51.123216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47789ad-8819-4e8f-8960-b5c4b03bf810 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:51.128134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cfeef-5886-42dc-bf92-ad6ce8ae5dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:51.129004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cfeef-5886-42dc-bf92-ad6ce8ae5dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:51.129286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cfeef-5886-42dc-bf92-ad6ce8ae5dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:51.129563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cfeef-5886-42dc-bf92-ad6ce8ae5dc8 admin admin] PATH_INFO: `/v3/projects/f54498cb60624135be89177d102f5d08` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:51.130748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cfeef-5886-42dc-bf92-ad6ce8ae5dc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f54498cb60624135be89177d102f5d08)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:51.132722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cfeef-5886-42dc-bf92-ad6ce8ae5dc8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:51.133060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0251bc-9792-49aa-b7f2-f334280123c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:51.133746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0251bc-9792-49aa-b7f2-f334280123c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:51.134090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0251bc-9792-49aa-b7f2-f334280123c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:51.134371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0251bc-9792-49aa-b7f2-f334280123c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:51.144107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0251bc-9792-49aa-b7f2-f334280123c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:51.145494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0251bc-9792-49aa-b7f2-f334280123c6 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:51.156389 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3183/6391] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:51.157290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0251bc-9792-49aa-b7f2-f334280123c6 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:51.158723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1d0251bc-9792-49aa-b7f2-f334280123c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:51.177901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0251bc-9792-49aa-b7f2-f334280123c6 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:51.201474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-376cfeef-5886-42dc-bf92-ad6ce8ae5dc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f54498cb60624135be89177d102f5d08', 'request_id': 'req-376cfeef-5886-42dc-bf92-ad6ce8ae5dc8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:51.214625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-376cfeef-5886-42dc-bf92-ad6ce8ae5dc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f54498cb60624135be89177d102f5d08', 'request_id': 'req-376cfeef-5886-42dc-bf92-ad6ce8ae5dc8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:51.218470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:51.222234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-376cfeef-5886-42dc-bf92-ad6ce8ae5dc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f54498cb60624135be89177d102f5d08', 'request_id': 'req-376cfeef-5886-42dc-bf92-ad6ce8ae5dc8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:51.238002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-376cfeef-5886-42dc-bf92-ad6ce8ae5dc8 admin admin] The token cache is being invalidate because project f54498cb60624135be89177d102f5d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:51.238421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-376cfeef-5886-42dc-bf92-ad6ce8ae5dc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:51.239277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-376cfeef-5886-42dc-bf92-ad6ce8ae5dc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:51.241054 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3209/6392] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:51 2022] DELETE /identity/v3/projects/f54498cb60624135be89177d102f5d08 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:51.246952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8479b1-12e7-43b6-a654-e9ffab860dc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:51.247693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8479b1-12e7-43b6-a654-e9ffab860dc2 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:51.248164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8479b1-12e7-43b6-a654-e9ffab860dc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:51.248466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8479b1-12e7-43b6-a654-e9ffab860dc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:51.254000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8f8479b1-12e7-43b6-a654-e9ffab860dc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:51.254197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2e27f-2ea3-4f12-97cc-c8cf8d6e8bae None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:51.254574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2e27f-2ea3-4f12-97cc-c8cf8d6e8bae None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:51.254925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2e27f-2ea3-4f12-97cc-c8cf8d6e8bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:51.275635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f9d2e27f-2ea3-4f12-97cc-c8cf8d6e8bae None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:51.276894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f9d2e27f-2ea3-4f12-97cc-c8cf8d6e8bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:51.315797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:51.334704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8479b1-12e7-43b6-a654-e9ffab860dc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:51.336315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8479b1-12e7-43b6-a654-e9ffab860dc2 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:51.349405 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3184/6393] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:51.363606 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3210/6394] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:51.371333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f983d1-302f-4d42-b500-bb5512614adb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:51.371706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f983d1-302f-4d42-b500-bb5512614adb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:51.371870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f983d1-302f-4d42-b500-bb5512614adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:51.390519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-37f983d1-302f-4d42-b500-bb5512614adb None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:51.391722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-37f983d1-302f-4d42-b500-bb5512614adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:51.401292 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3185/6395] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:51.405388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2e27f-2ea3-4f12-97cc-c8cf8d6e8bae None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:51.416660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2e27f-2ea3-4f12-97cc-c8cf8d6e8bae None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:51.421536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6bc6d-8928-464d-85d8-98e1712d74b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:51.422226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6bc6d-8928-464d-85d8-98e1712d74b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:51.422493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6bc6d-8928-464d-85d8-98e1712d74b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:51.422828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6bc6d-8928-464d-85d8-98e1712d74b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:51.423506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6bc6d-8928-464d-85d8-98e1712d74b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:51.423814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6bc6d-8928-464d-85d8-98e1712d74b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:51.425893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6bc6d-8928-464d-85d8-98e1712d74b4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:51.440898 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3211/6396] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:51.445085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f983d1-302f-4d42-b500-bb5512614adb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:51.455100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f983d1-302f-4d42-b500-bb5512614adb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:51.459888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f7034-0cb4-4ebd-8376-8b3d75a3ed61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:51.460609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f7034-0cb4-4ebd-8376-8b3d75a3ed61 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:51.460887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f7034-0cb4-4ebd-8376-8b3d75a3ed61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:51.461160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f7034-0cb4-4ebd-8376-8b3d75a3ed61 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:51.461857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f7034-0cb4-4ebd-8376-8b3d75a3ed61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:51.463758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f7034-0cb4-4ebd-8376-8b3d75a3ed61 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:51.494467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6bc6d-8928-464d-85d8-98e1712d74b4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:51.496588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-48a6bc6d-8928-464d-85d8-98e1712d74b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:51.502538 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3186/6397] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:51 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:51.509110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f7034-0cb4-4ebd-8376-8b3d75a3ed61 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:51.519801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6bc6d-8928-464d-85d8-98e1712d74b4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:51.594318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f7034-0cb4-4ebd-8376-8b3d75a3ed61 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:51.602370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4705bf8-62ba-4a2d-8cd8-517180ced524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:51.604276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4705bf8-62ba-4a2d-8cd8-517180ced524 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:51.604851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4705bf8-62ba-4a2d-8cd8-517180ced524 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:51.605384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4705bf8-62ba-4a2d-8cd8-517180ced524 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:51.606305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4705bf8-62ba-4a2d-8cd8-517180ced524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:51.609256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4705bf8-62ba-4a2d-8cd8-517180ced524 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:51.654874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f20fa-cecc-42a8-8205-1338b3487064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:51.655773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f20fa-cecc-42a8-8205-1338b3487064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:51.656080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f20fa-cecc-42a8-8205-1338b3487064 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:51.656366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f20fa-cecc-42a8-8205-1338b3487064 admin admin] PATH_INFO: `/v3/projects/17aa5e2365bd44d0a30d3054b8f77f9c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:51.657653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f20fa-cecc-42a8-8205-1338b3487064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17aa5e2365bd44d0a30d3054b8f77f9c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:51.659851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f20fa-cecc-42a8-8205-1338b3487064 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:51.665935 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3187/6398] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:51 2022] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:51.667692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4705bf8-62ba-4a2d-8cd8-517180ced524 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:51.680505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4705bf8-62ba-4a2d-8cd8-517180ced524 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:51.694840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871730c4-b4c0-49ef-861c-624ac41b2d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:51.695804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871730c4-b4c0-49ef-861c-624ac41b2d53 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:51.696328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871730c4-b4c0-49ef-861c-624ac41b2d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:51.696762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871730c4-b4c0-49ef-861c-624ac41b2d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:51.697861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871730c4-b4c0-49ef-861c-624ac41b2d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:51.699716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871730c4-b4c0-49ef-861c-624ac41b2d53 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:51.718495 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3188/6399] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:51.719745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871730c4-b4c0-49ef-861c-624ac41b2d53 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:51.722702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-871730c4-b4c0-49ef-861c-624ac41b2d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:51.729310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-495f20fa-cecc-42a8-8205-1338b3487064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17aa5e2365bd44d0a30d3054b8f77f9c', 'request_id': 'req-495f20fa-cecc-42a8-8205-1338b3487064'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:51.739774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871730c4-b4c0-49ef-861c-624ac41b2d53 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:51.742237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-495f20fa-cecc-42a8-8205-1338b3487064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17aa5e2365bd44d0a30d3054b8f77f9c', 'request_id': 'req-495f20fa-cecc-42a8-8205-1338b3487064'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:51.751138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-495f20fa-cecc-42a8-8205-1338b3487064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17aa5e2365bd44d0a30d3054b8f77f9c', 'request_id': 'req-495f20fa-cecc-42a8-8205-1338b3487064'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:51.776214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:51.777423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-495f20fa-cecc-42a8-8205-1338b3487064 admin admin] The token cache is being invalidate because project 17aa5e2365bd44d0a30d3054b8f77f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:51.779380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-495f20fa-cecc-42a8-8205-1338b3487064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:51.780559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-495f20fa-cecc-42a8-8205-1338b3487064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:51.783228 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3212/6400] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:51 2022] DELETE /identity/v3/projects/17aa5e2365bd44d0a30d3054b8f77f9c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:51.784533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f20fa-cecc-42a8-8205-1338b3487064 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:51.786978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-495f20fa-cecc-42a8-8205-1338b3487064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:51.831529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a157445-4eb4-41ea-89c4-3a803e02fe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:51.832968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a157445-4eb4-41ea-89c4-3a803e02fe70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:51.833251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a157445-4eb4-41ea-89c4-3a803e02fe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:51.833529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a157445-4eb4-41ea-89c4-3a803e02fe70 admin admin] PATH_INFO: `/v3/projects/9784e6efcd2a4d649dc6a7be7f782fa5` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:51.835282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a157445-4eb4-41ea-89c4-3a803e02fe70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9784e6efcd2a4d649dc6a7be7f782fa5)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:51.837231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a157445-4eb4-41ea-89c4-3a803e02fe70 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:51.869296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:51.889557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f20fa-cecc-42a8-8205-1338b3487064 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:51.894309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5a157445-4eb4-41ea-89c4-3a803e02fe70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9784e6efcd2a4d649dc6a7be7f782fa5', 'request_id': 'req-5a157445-4eb4-41ea-89c4-3a803e02fe70'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:51.900953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5a157445-4eb4-41ea-89c4-3a803e02fe70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9784e6efcd2a4d649dc6a7be7f782fa5', 'request_id': 'req-5a157445-4eb4-41ea-89c4-3a803e02fe70'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:51.906573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5a157445-4eb4-41ea-89c4-3a803e02fe70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9784e6efcd2a4d649dc6a7be7f782fa5', 'request_id': 'req-5a157445-4eb4-41ea-89c4-3a803e02fe70'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:51.920687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5a157445-4eb4-41ea-89c4-3a803e02fe70 admin admin] The token cache is being invalidate because project 9784e6efcd2a4d649dc6a7be7f782fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:51.920971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5a157445-4eb4-41ea-89c4-3a803e02fe70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:51.921600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5a157445-4eb4-41ea-89c4-3a803e02fe70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:51.923196 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3189/6401] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:51 2022] DELETE /identity/v3/projects/9784e6efcd2a4d649dc6a7be7f782fa5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:51.926448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79966a-649c-4148-a11e-14bd070cd79f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:51.926448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79966a-649c-4148-a11e-14bd070cd79f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:51.926448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79966a-649c-4148-a11e-14bd070cd79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:51.952112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9e4ec-caf7-4f22-8266-25dafc4f6eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:51.953288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9e4ec-caf7-4f22-8266-25dafc4f6eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:51.953828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9e4ec-caf7-4f22-8266-25dafc4f6eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:51.954284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9e4ec-caf7-4f22-8266-25dafc4f6eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:51.955697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9e4ec-caf7-4f22-8266-25dafc4f6eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:51.957555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9e4ec-caf7-4f22-8266-25dafc4f6eb4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:51.957816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-dd79966a-649c-4148-a11e-14bd070cd79f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:51.959129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dd79966a-649c-4148-a11e-14bd070cd79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:51.968439 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3190/6402] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:51.969344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79966a-649c-4148-a11e-14bd070cd79f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:51.970715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dd79966a-649c-4148-a11e-14bd070cd79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:51.973254 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3213/6403] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:51.977313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01247f0-898a-4db0-be00-2ced91b270aa None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:51.977606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01247f0-898a-4db0-be00-2ced91b270aa None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:51.977883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01247f0-898a-4db0-be00-2ced91b270aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:51.983637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79966a-649c-4148-a11e-14bd070cd79f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:51.988872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e47ceb-e821-4acc-8052-8675bde34b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:51.989834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e47ceb-e821-4acc-8052-8675bde34b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:51.990185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e47ceb-e821-4acc-8052-8675bde34b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:51.990531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e47ceb-e821-4acc-8052-8675bde34b66 admin admin] PATH_INFO: `/v3/users/06f7d76f0bab494bba54e9e8d6c56f3d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:51.991856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e47ceb-e821-4acc-8052-8675bde34b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f7d76f0bab494bba54e9e8d6c56f3d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:51.994565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e47ceb-e821-4acc-8052-8675bde34b66 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:51.998562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c01247f0-898a-4db0-be00-2ced91b270aa None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:51.999845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c01247f0-898a-4db0-be00-2ced91b270aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:52.008553 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3214/6404] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:52.009511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01247f0-898a-4db0-be00-2ced91b270aa None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:52.010774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c01247f0-898a-4db0-be00-2ced91b270aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:52.025741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01247f0-898a-4db0-be00-2ced91b270aa None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:52.031534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6b06c-25b3-4c4f-9cc7-3b7ad580ace0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:52.031939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6b06c-25b3-4c4f-9cc7-3b7ad580ace0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:52.032305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6b06c-25b3-4c4f-9cc7-3b7ad580ace0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:52.032574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6b06c-25b3-4c4f-9cc7-3b7ad580ace0 admin admin] PATH_INFO: `/v3/projects/a6fe1e9fbfcb4faa9e89b1b2ea4e1021/users/b38c7b1a0c2a47bd82d40efb9f2c42d6/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:52.049021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6b06c-25b3-4c4f-9cc7-3b7ad580ace0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6fe1e9fbfcb4faa9e89b1b2ea4e1021, user_id=b38c7b1a0c2a47bd82d40efb9f2c42d6, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:52.051083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f9e47ceb-e821-4acc-8052-8675bde34b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f7d76f0bab494bba54e9e8d6c56f3d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:52.052080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6b06c-25b3-4c4f-9cc7-3b7ad580ace0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:52.062193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f9e47ceb-e821-4acc-8052-8675bde34b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f7d76f0bab494bba54e9e8d6c56f3d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:52.067094 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3215/6405] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:52 2022] PUT /identity/v3/projects/a6fe1e9fbfcb4faa9e89b1b2ea4e1021/users/b38c7b1a0c2a47bd82d40efb9f2c42d6/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:52.068376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6b06c-25b3-4c4f-9cc7-3b7ad580ace0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:52.074916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f9e47ceb-e821-4acc-8052-8675bde34b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f7d76f0bab494bba54e9e8d6c56f3d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:52.082859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f9e47ceb-e821-4acc-8052-8675bde34b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f7d76f0bab494bba54e9e8d6c56f3d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:52.083548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f9e47ceb-e821-4acc-8052-8675bde34b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f7d76f0bab494bba54e9e8d6c56f3d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:52.109286 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3191/6406] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:51 2022] DELETE /identity/v3/users/06f7d76f0bab494bba54e9e8d6c56f3d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:52.112426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda0c90-ccfa-4f1c-9568-2c6e89c03b1a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:52.112426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda0c90-ccfa-4f1c-9568-2c6e89c03b1a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:52.112426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda0c90-ccfa-4f1c-9568-2c6e89c03b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:52.129987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1bda0c90-ccfa-4f1c-9568-2c6e89c03b1a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:52.131460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1bda0c90-ccfa-4f1c-9568-2c6e89c03b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:52.136489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6b06c-25b3-4c4f-9cc7-3b7ad580ace0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:52.155267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:52.207683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6f3be-55f3-4f92-a13d-b13d60847549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:52.208294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6f3be-55f3-4f92-a13d-b13d60847549 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:52.208576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6f3be-55f3-4f92-a13d-b13d60847549 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:52.208854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6f3be-55f3-4f92-a13d-b13d60847549 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:52.209982 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3192/6407] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:52.212326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6f3be-55f3-4f92-a13d-b13d60847549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:52.212675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6f3be-55f3-4f92-a13d-b13d60847549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:52.214336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6f3be-55f3-4f92-a13d-b13d60847549 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:52.216410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda0c90-ccfa-4f1c-9568-2c6e89c03b1a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:52.217853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1bda0c90-ccfa-4f1c-9568-2c6e89c03b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:52.225736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:52.235031 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3216/6408] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:52.238990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6f3be-55f3-4f92-a13d-b13d60847549 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:52.241967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-70d6f3be-55f3-4f92-a13d-b13d60847549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:52.256687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6f3be-55f3-4f92-a13d-b13d60847549 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:52.262313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a59ee-7352-4476-bacf-2a1337c74511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:52.263356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a59ee-7352-4476-bacf-2a1337c74511 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:52.263736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a59ee-7352-4476-bacf-2a1337c74511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:52.264149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a59ee-7352-4476-bacf-2a1337c74511 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:52.265080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a59ee-7352-4476-bacf-2a1337c74511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:52.267899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a59ee-7352-4476-bacf-2a1337c74511 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:52.307300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda0c90-ccfa-4f1c-9568-2c6e89c03b1a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:52.310691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838fc55-abdf-45a6-9eaf-76bc5aeed5a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:52.311337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838fc55-abdf-45a6-9eaf-76bc5aeed5a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:52.311623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838fc55-abdf-45a6-9eaf-76bc5aeed5a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:52.311890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838fc55-abdf-45a6-9eaf-76bc5aeed5a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:52.315675 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3217/6409] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:52 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:52.316464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a59ee-7352-4476-bacf-2a1337c74511 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:52.325531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838fc55-abdf-45a6-9eaf-76bc5aeed5a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:52.327102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838fc55-abdf-45a6-9eaf-76bc5aeed5a8 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:52.340329 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3193/6410] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:52.389845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a59ee-7352-4476-bacf-2a1337c74511 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:52.394976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f10c8-c326-455f-9ce1-5ded5f4b22a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:52.395759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f10c8-c326-455f-9ce1-5ded5f4b22a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:52.396078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f10c8-c326-455f-9ce1-5ded5f4b22a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:52.396430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f10c8-c326-455f-9ce1-5ded5f4b22a2 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:52.397639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f10c8-c326-455f-9ce1-5ded5f4b22a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:52.400844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f10c8-c326-455f-9ce1-5ded5f4b22a2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:52.432805 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3218/6411] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:52 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:52.437012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838fc55-abdf-45a6-9eaf-76bc5aeed5a8 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:52.440149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f10c8-c326-455f-9ce1-5ded5f4b22a2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:52.442299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-879f10c8-c326-455f-9ce1-5ded5f4b22a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:52.450302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838fc55-abdf-45a6-9eaf-76bc5aeed5a8 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:52.455496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f10c8-c326-455f-9ce1-5ded5f4b22a2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:52.460738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab736a-d991-4742-ae47-b0c68711a850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:52.461136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab736a-d991-4742-ae47-b0c68711a850 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:52.461279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da99b4-c1a4-4430-95f7-4e54c9dee95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:52.461414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab736a-d991-4742-ae47-b0c68711a850 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:52.461675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab736a-d991-4742-ae47-b0c68711a850 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:52.462088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da99b4-c1a4-4430-95f7-4e54c9dee95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:52.462419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab736a-d991-4742-ae47-b0c68711a850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:52.462556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da99b4-c1a4-4430-95f7-4e54c9dee95e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:52.462674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da99b4-c1a4-4430-95f7-4e54c9dee95e admin admin] PATH_INFO: `/v3/projects/effbac7399534359955f1e6bd3a2d4fc` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:52.464060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da99b4-c1a4-4430-95f7-4e54c9dee95e admin admin] RBAC: Authorizing `identity:delete_project(project_id=effbac7399534359955f1e6bd3a2d4fc)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:52.464183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab736a-d991-4742-ae47-b0c68711a850 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:52.466253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da99b4-c1a4-4430-95f7-4e54c9dee95e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:52.479462 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3194/6412] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:52.481009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab736a-d991-4742-ae47-b0c68711a850 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:52.491774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab736a-d991-4742-ae47-b0c68711a850 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:52.496597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409dd88-8eec-41bb-af40-e31822fdaa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:52.497259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409dd88-8eec-41bb-af40-e31822fdaa53 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:52.497538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409dd88-8eec-41bb-af40-e31822fdaa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:52.497928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409dd88-8eec-41bb-af40-e31822fdaa53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:52.498631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409dd88-8eec-41bb-af40-e31822fdaa53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:52.500123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409dd88-8eec-41bb-af40-e31822fdaa53 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:52.514258 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3195/6413] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:52.515445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409dd88-8eec-41bb-af40-e31822fdaa53 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:52.526132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409dd88-8eec-41bb-af40-e31822fdaa53 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:52.543768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-80da99b4-c1a4-4430-95f7-4e54c9dee95e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'effbac7399534359955f1e6bd3a2d4fc', 'request_id': 'req-80da99b4-c1a4-4430-95f7-4e54c9dee95e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:52.553852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-80da99b4-c1a4-4430-95f7-4e54c9dee95e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'effbac7399534359955f1e6bd3a2d4fc', 'request_id': 'req-80da99b4-c1a4-4430-95f7-4e54c9dee95e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:52.581841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-80da99b4-c1a4-4430-95f7-4e54c9dee95e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'effbac7399534359955f1e6bd3a2d4fc', 'request_id': 'req-80da99b4-c1a4-4430-95f7-4e54c9dee95e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:52.593346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-80da99b4-c1a4-4430-95f7-4e54c9dee95e admin admin] The token cache is being invalidate because project effbac7399534359955f1e6bd3a2d4fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:52.593868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-80da99b4-c1a4-4430-95f7-4e54c9dee95e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:52.594650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-80da99b4-c1a4-4430-95f7-4e54c9dee95e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:52.599875 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3219/6414] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:52 2022] DELETE /identity/v3/projects/effbac7399534359955f1e6bd3a2d4fc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:52.601644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c24cc-369b-4386-99f3-e702aaef5982 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:52.602001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c24cc-369b-4386-99f3-e702aaef5982 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:52.602355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c24cc-369b-4386-99f3-e702aaef5982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:52.604260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70018ead-6bed-4788-aa73-80a304c27cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:52.605359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70018ead-6bed-4788-aa73-80a304c27cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:52.605726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70018ead-6bed-4788-aa73-80a304c27cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:52.606250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70018ead-6bed-4788-aa73-80a304c27cc8 admin admin] PATH_INFO: `/v3/projects/1ec97bb2587c47ee92178f11ebfe38ee/users/febc15754e334471801f764a87195779/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:52.621887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d53c24cc-369b-4386-99f3-e702aaef5982 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:52.623112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d53c24cc-369b-4386-99f3-e702aaef5982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:52.633085 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3220/6415] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:52.635632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70018ead-6bed-4788-aa73-80a304c27cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec97bb2587c47ee92178f11ebfe38ee, user_id=febc15754e334471801f764a87195779, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:52.640337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70018ead-6bed-4788-aa73-80a304c27cc8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:52.640728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d26e7c-540a-473e-854a-775ae42e9a81 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:52.641123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d26e7c-540a-473e-854a-775ae42e9a81 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:52.641501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d26e7c-540a-473e-854a-775ae42e9a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:52.660353 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3196/6416] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:52 2022] PUT /identity/v3/projects/1ec97bb2587c47ee92178f11ebfe38ee/users/febc15754e334471801f764a87195779/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:52.670724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4eb58-b955-4ae2-ab68-dda189787888 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:52.671017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4eb58-b955-4ae2-ab68-dda189787888 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:52.671285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4eb58-b955-4ae2-ab68-dda189787888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:52.673286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a9d26e7c-540a-473e-854a-775ae42e9a81 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:52.675213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a9d26e7c-540a-473e-854a-775ae42e9a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:52.701293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1cf4eb58-b955-4ae2-ab68-dda189787888 None None] MFA Rules not processed for user `febc15754e334471801f764a87195779`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:52.702521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1cf4eb58-b955-4ae2-ab68-dda189787888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:52.723644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:52.752513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:52.799430 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3197/6417] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:52.803730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4eb58-b955-4ae2-ab68-dda189787888 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:52.809620 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3221/6418] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:52.810638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d26e7c-540a-473e-854a-775ae42e9a81 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:52.816343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4eb58-b955-4ae2-ab68-dda189787888 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:52.818200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a9d26e7c-540a-473e-854a-775ae42e9a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:52.823749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65763a-b95e-4c56-9484-4dbf57422e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:52.824485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65763a-b95e-4c56-9484-4dbf57422e97 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:52.824786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65763a-b95e-4c56-9484-4dbf57422e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:52.825035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65763a-b95e-4c56-9484-4dbf57422e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:52.826208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65763a-b95e-4c56-9484-4dbf57422e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:52.826518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65763a-b95e-4c56-9484-4dbf57422e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:52.828192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65763a-b95e-4c56-9484-4dbf57422e97 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:52.841005 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3198/6419] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:52.845417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65763a-b95e-4c56-9484-4dbf57422e97 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:52.856408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65763a-b95e-4c56-9484-4dbf57422e97 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:52.862404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509f360-6908-431f-8e9e-5b7c66e68866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:52.863078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509f360-6908-431f-8e9e-5b7c66e68866 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:52.863380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509f360-6908-431f-8e9e-5b7c66e68866 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:52.863619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509f360-6908-431f-8e9e-5b7c66e68866 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:52.864493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509f360-6908-431f-8e9e-5b7c66e68866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:52.866419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509f360-6908-431f-8e9e-5b7c66e68866 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:52.907991 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3199/6420] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:52 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:52.913062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509f360-6908-431f-8e9e-5b7c66e68866 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:52.941999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d26e7c-540a-473e-854a-775ae42e9a81 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:53.004618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52e9df-dbbb-4452-b1e1-ece76f630546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:53.006020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52e9df-dbbb-4452-b1e1-ece76f630546 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:53.006292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509f360-6908-431f-8e9e-5b7c66e68866 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:53.006429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52e9df-dbbb-4452-b1e1-ece76f630546 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:53.006750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52e9df-dbbb-4452-b1e1-ece76f630546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:53.015371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12e5f9-9378-42f3-a28c-a1416fa4f744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:53.016687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12e5f9-9378-42f3-a28c-a1416fa4f744 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:53.016983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12e5f9-9378-42f3-a28c-a1416fa4f744 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:53.017263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12e5f9-9378-42f3-a28c-a1416fa4f744 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:53.018598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12e5f9-9378-42f3-a28c-a1416fa4f744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:53.021685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12e5f9-9378-42f3-a28c-a1416fa4f744 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:53.046679 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3200/6421] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:52 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:53.048300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d5925-fbaa-492a-9735-a20da362a0d4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:53.048686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d5925-fbaa-492a-9735-a20da362a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:53.049082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d5925-fbaa-492a-9735-a20da362a0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:53.070086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-413d5925-fbaa-492a-9735-a20da362a0d4 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:53.071442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-413d5925-fbaa-492a-9735-a20da362a0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:53.084720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52e9df-dbbb-4452-b1e1-ece76f630546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:53.086831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52e9df-dbbb-4452-b1e1-ece76f630546 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:53.105508 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3222/6422] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:53.109120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52e9df-dbbb-4452-b1e1-ece76f630546 service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:53.128967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52e9df-dbbb-4452-b1e1-ece76f630546 service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:53.137702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38db7d-d688-4caf-9f29-6b6d564311f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:53.138802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38db7d-d688-4caf-9f29-6b6d564311f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:53.139062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38db7d-d688-4caf-9f29-6b6d564311f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:53.139348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38db7d-d688-4caf-9f29-6b6d564311f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:53.140099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38db7d-d688-4caf-9f29-6b6d564311f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:53.141816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38db7d-d688-4caf-9f29-6b6d564311f2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:53.164909 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3223/6423] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:53.169881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38db7d-d688-4caf-9f29-6b6d564311f2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:53.185036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38db7d-d688-4caf-9f29-6b6d564311f2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:53.186129 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3201/6424] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:25:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:53.193714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815a6be-f06c-4de3-a683-848f8212fab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:53.194552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815a6be-f06c-4de3-a683-848f8212fab5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:53.194739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815a6be-f06c-4de3-a683-848f8212fab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:53.195025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815a6be-f06c-4de3-a683-848f8212fab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:53.196030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815a6be-f06c-4de3-a683-848f8212fab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:53.199318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815a6be-f06c-4de3-a683-848f8212fab5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:53.205353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d5925-fbaa-492a-9735-a20da362a0d4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:53.206902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-413d5925-fbaa-492a-9735-a20da362a0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:53.235729 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3224/6425] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:53.237238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815a6be-f06c-4de3-a683-848f8212fab5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:53.246063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:53.269246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815a6be-f06c-4de3-a683-848f8212fab5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:53.285565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4641f-fc33-49b2-814d-b98127065bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:53.286857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4641f-fc33-49b2-814d-b98127065bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:53.287154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4641f-fc33-49b2-814d-b98127065bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:53.287431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4641f-fc33-49b2-814d-b98127065bfd admin admin] PATH_INFO: `/v3/projects/0646073662a4465a83718c56d7b1921e/users/52dc2829462a472ab000fd97a30d4e78/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:53.323150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4641f-fc33-49b2-814d-b98127065bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0646073662a4465a83718c56d7b1921e, user_id=52dc2829462a472ab000fd97a30d4e78, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:53.326522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4641f-fc33-49b2-814d-b98127065bfd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:53.357612 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3225/6426] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:53 2022] PUT /identity/v3/projects/0646073662a4465a83718c56d7b1921e/users/52dc2829462a472ab000fd97a30d4e78/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:53.369237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346de993-4b0f-498d-aed4-038a66589b20 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:53.369769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346de993-4b0f-498d-aed4-038a66589b20 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:53.370310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346de993-4b0f-498d-aed4-038a66589b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:53.374571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d5925-fbaa-492a-9735-a20da362a0d4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:53.397774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:53.420799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-346de993-4b0f-498d-aed4-038a66589b20 None None] MFA Rules not processed for user `52dc2829462a472ab000fd97a30d4e78`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:53.423628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-346de993-4b0f-498d-aed4-038a66589b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:53.521342 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3226/6427] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:53.524765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b676746-21d1-4a82-b908-9a935bfc4783 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:53.525308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346de993-4b0f-498d-aed4-038a66589b20 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:53.525978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b676746-21d1-4a82-b908-9a935bfc4783 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:53.526447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b676746-21d1-4a82-b908-9a935bfc4783 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:53.526886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b676746-21d1-4a82-b908-9a935bfc4783 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:53.545560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346de993-4b0f-498d-aed4-038a66589b20 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:53.557160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4987601-6fcc-4841-8ff8-d7c8e97e48b4 tempest-IdentityCatalogTest-675921631 tempest-IdentityCatalogTest-675921631-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52dc2829462a472ab000fd97a30d4e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0646073662a4465a83718c56d7b1921e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:53.557590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987601-6fcc-4841-8ff8-d7c8e97e48b4 tempest-IdentityCatalogTest-675921631 tempest-IdentityCatalogTest-675921631-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:53.557878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987601-6fcc-4841-8ff8-d7c8e97e48b4 tempest-IdentityCatalogTest-675921631 tempest-IdentityCatalogTest-675921631-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:53.558159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4987601-6fcc-4841-8ff8-d7c8e97e48b4 tempest-IdentityCatalogTest-675921631 tempest-IdentityCatalogTest-675921631-project] PATH_INFO: `/v3/auth/catalog` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:53.558808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4987601-6fcc-4841-8ff8-d7c8e97e48b4 tempest-IdentityCatalogTest-675921631 tempest-IdentityCatalogTest-675921631-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:53.560102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4987601-6fcc-4841-8ff8-d7c8e97e48b4 tempest-IdentityCatalogTest-675921631 tempest-IdentityCatalogTest-675921631-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:53.562877 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3227/6428] 10.222.0.43 () {58 vars in 1142 bytes} [Sat Jul 2 21:25:53 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:25:53.568015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4987601-6fcc-4841-8ff8-d7c8e97e48b4 tempest-IdentityCatalogTest-675921631 tempest-IdentityCatalogTest-675921631-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:53.687150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b676746-21d1-4a82-b908-9a935bfc4783 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:53.691259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b676746-21d1-4a82-b908-9a935bfc4783 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:53.705901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4987601-6fcc-4841-8ff8-d7c8e97e48b4 tempest-IdentityCatalogTest-675921631 tempest-IdentityCatalogTest-675921631-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:53.718278 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3202/6429] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:25:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:25:53.720164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21fdb4-41ee-438d-8971-6bc66f0c8aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:53.721422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21fdb4-41ee-438d-8971-6bc66f0c8aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:53.721697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21fdb4-41ee-438d-8971-6bc66f0c8aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:53.722697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21fdb4-41ee-438d-8971-6bc66f0c8aaf admin admin] PATH_INFO: `/v3/users/52dc2829462a472ab000fd97a30d4e78` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:53.724821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21fdb4-41ee-438d-8971-6bc66f0c8aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=52dc2829462a472ab000fd97a30d4e78)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:53.727669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21fdb4-41ee-438d-8971-6bc66f0c8aaf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:53.841091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2d21fdb4-41ee-438d-8971-6bc66f0c8aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52dc2829462a472ab000fd97a30d4e78'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:53.853814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2d21fdb4-41ee-438d-8971-6bc66f0c8aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52dc2829462a472ab000fd97a30d4e78'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:53.854392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2d21fdb4-41ee-438d-8971-6bc66f0c8aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52dc2829462a472ab000fd97a30d4e78'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:53.855378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2d21fdb4-41ee-438d-8971-6bc66f0c8aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52dc2829462a472ab000fd97a30d4e78'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:53.872671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2d21fdb4-41ee-438d-8971-6bc66f0c8aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52dc2829462a472ab000fd97a30d4e78'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:53.912851 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3228/6430] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:53 2022] DELETE /identity/v3/users/52dc2829462a472ab000fd97a30d4e78 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:53.919242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835b39a-b4d9-40be-a379-fa8489c300f7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:53.920364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835b39a-b4d9-40be-a379-fa8489c300f7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:53.920812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835b39a-b4d9-40be-a379-fa8489c300f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:53.953201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1835b39a-b4d9-40be-a379-fa8489c300f7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:53.954732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1835b39a-b4d9-40be-a379-fa8489c300f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:54.060577 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3203/6431] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:54.071035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21fdb4-41ee-438d-8971-6bc66f0c8aaf admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:54.072618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2d21fdb4-41ee-438d-8971-6bc66f0c8aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:54.091850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:54.184781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21fdb4-41ee-438d-8971-6bc66f0c8aaf admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:54.190295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdaf1d4-cc16-468c-917e-e6822d269247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:54.191168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaf1d4-cc16-468c-917e-e6822d269247 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:54.192492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaf1d4-cc16-468c-917e-e6822d269247 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:54.192831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaf1d4-cc16-468c-917e-e6822d269247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:54.211010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdaf1d4-cc16-468c-917e-e6822d269247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:54.215973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdaf1d4-cc16-468c-917e-e6822d269247 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:54.229046 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3229/6432] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:54.863510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835b39a-b4d9-40be-a379-fa8489c300f7 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:54.865365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1835b39a-b4d9-40be-a379-fa8489c300f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:54.877073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:54.893236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835b39a-b4d9-40be-a379-fa8489c300f7 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:54.910562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719972df-d3fe-46ea-8bb8-f43c3706a62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:54.911662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719972df-d3fe-46ea-8bb8-f43c3706a62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:54.912178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719972df-d3fe-46ea-8bb8-f43c3706a62a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:54.912783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719972df-d3fe-46ea-8bb8-f43c3706a62a admin admin] PATH_INFO: `/v3/projects/0646073662a4465a83718c56d7b1921e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:54.915586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719972df-d3fe-46ea-8bb8-f43c3706a62a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0646073662a4465a83718c56d7b1921e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:54.920969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719972df-d3fe-46ea-8bb8-f43c3706a62a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:55.049592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-719972df-d3fe-46ea-8bb8-f43c3706a62a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0646073662a4465a83718c56d7b1921e', 'request_id': 'req-719972df-d3fe-46ea-8bb8-f43c3706a62a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:55.065851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-719972df-d3fe-46ea-8bb8-f43c3706a62a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0646073662a4465a83718c56d7b1921e', 'request_id': 'req-719972df-d3fe-46ea-8bb8-f43c3706a62a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:55.085731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-719972df-d3fe-46ea-8bb8-f43c3706a62a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0646073662a4465a83718c56d7b1921e', 'request_id': 'req-719972df-d3fe-46ea-8bb8-f43c3706a62a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:55.130924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-719972df-d3fe-46ea-8bb8-f43c3706a62a admin admin] The token cache is being invalidate because project 0646073662a4465a83718c56d7b1921e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:55.131220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-719972df-d3fe-46ea-8bb8-f43c3706a62a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:55.134153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-719972df-d3fe-46ea-8bb8-f43c3706a62a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:55.136031 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3204/6433] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:54 2022] DELETE /identity/v3/projects/0646073662a4465a83718c56d7b1921e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:55.142183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081d3a6-eefc-4fad-bbaf-5e68fe4e8d1c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:55.143242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081d3a6-eefc-4fad-bbaf-5e68fe4e8d1c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:55.145343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081d3a6-eefc-4fad-bbaf-5e68fe4e8d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:55.152093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719972df-d3fe-46ea-8bb8-f43c3706a62a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:55.153739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-719972df-d3fe-46ea-8bb8-f43c3706a62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:55.168937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4081d3a6-eefc-4fad-bbaf-5e68fe4e8d1c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:55.171999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4081d3a6-eefc-4fad-bbaf-5e68fe4e8d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:55.260694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719972df-d3fe-46ea-8bb8-f43c3706a62a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:55.272392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6585e-760d-4a75-9eb1-8944c0548e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:55.273587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6585e-760d-4a75-9eb1-8944c0548e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:55.274181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6585e-760d-4a75-9eb1-8944c0548e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:55.274624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6585e-760d-4a75-9eb1-8944c0548e81 admin admin] PATH_INFO: `/v3/users/febc15754e334471801f764a87195779` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:55.278984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6585e-760d-4a75-9eb1-8944c0548e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=febc15754e334471801f764a87195779)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:55.279312 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3230/6434] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:55.280935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec17b4-0cdb-42a4-9a37-e9edb428a3a4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:55.281312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec17b4-0cdb-42a4-9a37-e9edb428a3a4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:55.281695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec17b4-0cdb-42a4-9a37-e9edb428a3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:55.282134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6585e-760d-4a75-9eb1-8944c0548e81 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:55.305463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f4ec17b4-0cdb-42a4-9a37-e9edb428a3a4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:55.307119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f4ec17b4-0cdb-42a4-9a37-e9edb428a3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:55.328315 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3231/6435] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:55.329352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec17b4-0cdb-42a4-9a37-e9edb428a3a4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:55.343136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec17b4-0cdb-42a4-9a37-e9edb428a3a4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:55.354365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638474d1-7f1f-462d-b834-aecf3f0b21eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:55.355300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638474d1-7f1f-462d-b834-aecf3f0b21eb admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:55.355673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638474d1-7f1f-462d-b834-aecf3f0b21eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:55.356089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638474d1-7f1f-462d-b834-aecf3f0b21eb admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:55.357491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638474d1-7f1f-462d-b834-aecf3f0b21eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:55.358184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638474d1-7f1f-462d-b834-aecf3f0b21eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:55.360697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638474d1-7f1f-462d-b834-aecf3f0b21eb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:55.394525 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3232/6436] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:55.395899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638474d1-7f1f-462d-b834-aecf3f0b21eb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:55.408128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638474d1-7f1f-462d-b834-aecf3f0b21eb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:55.413874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877667eb-c3ae-49a9-91e6-c4d3ade67546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:55.415639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877667eb-c3ae-49a9-91e6-c4d3ade67546 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:55.416025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877667eb-c3ae-49a9-91e6-c4d3ade67546 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:55.416584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877667eb-c3ae-49a9-91e6-c4d3ade67546 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:55.419813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877667eb-c3ae-49a9-91e6-c4d3ade67546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:55.420482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cbb6585e-760d-4a75-9eb1-8944c0548e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'febc15754e334471801f764a87195779'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:55.423361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877667eb-c3ae-49a9-91e6-c4d3ade67546 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:55.443237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cbb6585e-760d-4a75-9eb1-8944c0548e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'febc15754e334471801f764a87195779'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:55.472929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cbb6585e-760d-4a75-9eb1-8944c0548e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'febc15754e334471801f764a87195779'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:55.475323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cbb6585e-760d-4a75-9eb1-8944c0548e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'febc15754e334471801f764a87195779'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:55.480517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cbb6585e-760d-4a75-9eb1-8944c0548e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'febc15754e334471801f764a87195779'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:55.481024 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3233/6437] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:55 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:55.484173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877667eb-c3ae-49a9-91e6-c4d3ade67546 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:55.488429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-877667eb-c3ae-49a9-91e6-c4d3ade67546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:55.531257 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3205/6438] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:55 2022] DELETE /identity/v3/users/febc15754e334471801f764a87195779 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:55.536625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c6a8c-8682-4a7c-a727-2c821ef2c18a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:55.537028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c6a8c-8682-4a7c-a727-2c821ef2c18a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:55.537994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c6a8c-8682-4a7c-a727-2c821ef2c18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:55.572226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:55.587489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c01c6a8c-8682-4a7c-a727-2c821ef2c18a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:55.591234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c01c6a8c-8682-4a7c-a727-2c821ef2c18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:55.648685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877667eb-c3ae-49a9-91e6-c4d3ade67546 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:55.693956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:55.700267 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3206/6439] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:55.707886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c6a8c-8682-4a7c-a727-2c821ef2c18a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:55.709603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c01c6a8c-8682-4a7c-a727-2c821ef2c18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:55.815008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d09d2e-1ac0-48e5-a677-10f4da374f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:55.815708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d09d2e-1ac0-48e5-a677-10f4da374f80 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:55.815991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d09d2e-1ac0-48e5-a677-10f4da374f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:55.816286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d09d2e-1ac0-48e5-a677-10f4da374f80 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:55.816987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d09d2e-1ac0-48e5-a677-10f4da374f80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:55.818967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d09d2e-1ac0-48e5-a677-10f4da374f80 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:55.844612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c6a8c-8682-4a7c-a727-2c821ef2c18a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:55.856085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b9a50-827b-4dec-918f-9084961b0e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:55.856774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b9a50-827b-4dec-918f-9084961b0e41 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:55.857261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b9a50-827b-4dec-918f-9084961b0e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:55.857831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b9a50-827b-4dec-918f-9084961b0e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:55.876492 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3234/6440] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:55 2022] POST /identity/v3/users => generated 287 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:55.878475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d09d2e-1ac0-48e5-a677-10f4da374f80 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:55.896897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b9a50-827b-4dec-918f-9084961b0e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:55.899875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b9a50-827b-4dec-918f-9084961b0e41 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:55.908646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d09d2e-1ac0-48e5-a677-10f4da374f80 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:55.927404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd9d30-0958-4e09-b34c-d5bde2cda46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:55.928121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd9d30-0958-4e09-b34c-d5bde2cda46c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:55.930669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd9d30-0958-4e09-b34c-d5bde2cda46c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:55.930981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd9d30-0958-4e09-b34c-d5bde2cda46c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:55.931731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd9d30-0958-4e09-b34c-d5bde2cda46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:55.932597 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3207/6441] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:25:55.933893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd9d30-0958-4e09-b34c-d5bde2cda46c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:55.952206 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3235/6442] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:55.956082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b9a50-827b-4dec-918f-9084961b0e41 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:55.987457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b9a50-827b-4dec-918f-9084961b0e41 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:56.001628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0f76c-2f8c-4b6b-8e00-f11ffd461265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:56.002570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0f76c-2f8c-4b6b-8e00-f11ffd461265 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:56.003861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0f76c-2f8c-4b6b-8e00-f11ffd461265 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:56.003861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0f76c-2f8c-4b6b-8e00-f11ffd461265 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:56.005272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0f76c-2f8c-4b6b-8e00-f11ffd461265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:56.008378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0f76c-2f8c-4b6b-8e00-f11ffd461265 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:56.059015 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3208/6443] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:56.063960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd9d30-0958-4e09-b34c-d5bde2cda46c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:56.079415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd9d30-0958-4e09-b34c-d5bde2cda46c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:56.091086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee39050-fe74-4b72-bbf2-ae7ccc155948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:56.092615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee39050-fe74-4b72-bbf2-ae7ccc155948 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:56.093115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee39050-fe74-4b72-bbf2-ae7ccc155948 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:56.093617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee39050-fe74-4b72-bbf2-ae7ccc155948 admin admin] PATH_INFO: `/v3/projects/0b1b34575e2347469559e8f8027d6dbf/users/181d4dcf0dc54238a2d9dc3633e6c728/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:56.117252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee39050-fe74-4b72-bbf2-ae7ccc155948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1b34575e2347469559e8f8027d6dbf, user_id=181d4dcf0dc54238a2d9dc3633e6c728, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:56.120614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee39050-fe74-4b72-bbf2-ae7ccc155948 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:56.132328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0f76c-2f8c-4b6b-8e00-f11ffd461265 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:56.134887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1ba0f76c-2f8c-4b6b-8e00-f11ffd461265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:56.168335 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3236/6444] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:56 2022] PUT /identity/v3/projects/0b1b34575e2347469559e8f8027d6dbf/users/181d4dcf0dc54238a2d9dc3633e6c728/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:56.187337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003557e-aa73-4e6c-b610-b1b5d0c15b0e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:56.187673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003557e-aa73-4e6c-b610-b1b5d0c15b0e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:56.187994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003557e-aa73-4e6c-b610-b1b5d0c15b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:56.257632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c003557e-aa73-4e6c-b610-b1b5d0c15b0e None None] MFA Rules not processed for user `181d4dcf0dc54238a2d9dc3633e6c728`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:56.258597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c003557e-aa73-4e6c-b610-b1b5d0c15b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:56.272778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0f76c-2f8c-4b6b-8e00-f11ffd461265 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:56.350020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa36ae-9a30-4516-b3b6-f286eef674d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:56.354877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa36ae-9a30-4516-b3b6-f286eef674d2 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:56.356102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa36ae-9a30-4516-b3b6-f286eef674d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:56.359200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa36ae-9a30-4516-b3b6-f286eef674d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:56.365058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2eaa36ae-9a30-4516-b3b6-f286eef674d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:56.377055 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3237/6445] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:56.382068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003557e-aa73-4e6c-b610-b1b5d0c15b0e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:56.385980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:56.391925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003557e-aa73-4e6c-b610-b1b5d0c15b0e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:56.398009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f436816-88a3-41b4-ad9f-213658c4c246 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181d4dcf0dc54238a2d9dc3633e6c728', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b1b34575e2347469559e8f8027d6dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:56.398777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f436816-88a3-41b4-ad9f-213658c4c246 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:56.399041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f436816-88a3-41b4-ad9f-213658c4c246 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:56.399358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f436816-88a3-41b4-ad9f-213658c4c246 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] PATH_INFO: `/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:56.400153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f436816-88a3-41b4-ad9f-213658c4c246 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=181d4dcf0dc54238a2d9dc3633e6c728)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:56.401974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f436816-88a3-41b4-ad9f-213658c4c246 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:56.451359 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3238/6446] 10.222.0.43 () {60 vars in 1298 bytes} [Sat Jul 2 21:25:56 2022] POST /identity/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2 => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:56.452592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f436816-88a3-41b4-ad9f-213658c4c246 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:56.465725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f436816-88a3-41b4-ad9f-213658c4c246 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:56.474588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c1cf1-9626-4d0e-a5bb-be57428c0ba1 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181d4dcf0dc54238a2d9dc3633e6c728', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b1b34575e2347469559e8f8027d6dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:56.475489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c1cf1-9626-4d0e-a5bb-be57428c0ba1 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:56.475857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c1cf1-9626-4d0e-a5bb-be57428c0ba1 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:56.478487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c1cf1-9626-4d0e-a5bb-be57428c0ba1 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] PATH_INFO: `/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2/c1a58c44963b4c70aaaf9aff9d8fe0cf` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:56.486755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c1cf1-9626-4d0e-a5bb-be57428c0ba1 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=181d4dcf0dc54238a2d9dc3633e6c728, credential_id=c1a58c44963b4c70aaaf9aff9d8fe0cf)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:56.488273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c1cf1-9626-4d0e-a5bb-be57428c0ba1 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:56.502311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa36ae-9a30-4516-b3b6-f286eef674d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:56.507326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa36ae-9a30-4516-b3b6-f286eef674d2 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:56.522106 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3239/6447] 10.222.0.43 () {58 vars in 1379 bytes} [Sat Jul 2 21:25:56 2022] DELETE /identity/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2/c1a58c44963b4c70aaaf9aff9d8fe0cf => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:56.527901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c1cf1-9626-4d0e-a5bb-be57428c0ba1 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:56.544845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c1cf1-9626-4d0e-a5bb-be57428c0ba1 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:56.551621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa81928-65e7-4e94-b337-924e2271b15f tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181d4dcf0dc54238a2d9dc3633e6c728', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b1b34575e2347469559e8f8027d6dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:56.553220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa81928-65e7-4e94-b337-924e2271b15f tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:56.553611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa81928-65e7-4e94-b337-924e2271b15f tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:56.553900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa81928-65e7-4e94-b337-924e2271b15f tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] PATH_INFO: `/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:56.554641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa81928-65e7-4e94-b337-924e2271b15f tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=181d4dcf0dc54238a2d9dc3633e6c728)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:56.556396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa81928-65e7-4e94-b337-924e2271b15f tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:56.585807 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3240/6448] 10.222.0.43 () {60 vars in 1298 bytes} [Sat Jul 2 21:25:56 2022] POST /identity/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2 => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:56.588196 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3209/6449] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:56.590587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa81928-65e7-4e94-b337-924e2271b15f tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:56.603245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa81928-65e7-4e94-b337-924e2271b15f tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:56.618678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815c5dc-5733-4089-922c-f66328b0a07d tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181d4dcf0dc54238a2d9dc3633e6c728', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b1b34575e2347469559e8f8027d6dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:56.620455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815c5dc-5733-4089-922c-f66328b0a07d tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:56.620739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815c5dc-5733-4089-922c-f66328b0a07d tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:56.621024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815c5dc-5733-4089-922c-f66328b0a07d tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] PATH_INFO: `/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2/a9d2f359a0eb46f5ae3779741eea10a5` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:56.629363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815c5dc-5733-4089-922c-f66328b0a07d tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=181d4dcf0dc54238a2d9dc3633e6c728, credential_id=a9d2f359a0eb46f5ae3779741eea10a5)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:56.631686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815c5dc-5733-4089-922c-f66328b0a07d tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:56.665650 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3241/6450] 10.222.0.43 () {58 vars in 1379 bytes} [Sat Jul 2 21:25:56 2022] DELETE /identity/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2/a9d2f359a0eb46f5ae3779741eea10a5 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:56.670649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa36ae-9a30-4516-b3b6-f286eef674d2 service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:56.703134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa36ae-9a30-4516-b3b6-f286eef674d2 service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:56.718284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7ea95-a39a-4650-b739-b287aab814fc tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181d4dcf0dc54238a2d9dc3633e6c728', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b1b34575e2347469559e8f8027d6dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:56.721359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7ea95-a39a-4650-b739-b287aab814fc tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:56.724916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7ea95-a39a-4650-b739-b287aab814fc tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:56.725913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7ea95-a39a-4650-b739-b287aab814fc tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] PATH_INFO: `/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2/a9d2f359a0eb46f5ae3779741eea10a5` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:56.781872 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-c6f7ea95-a39a-4650-b739-b287aab814fc tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Could not find credential: 244f26a4761bef8829f34530fa9ce8b65d83fbfcd56adb97a978d331955d4d97.: keystone.exception.CredentialNotFound: Could not find credential: 244f26a4761bef8829f34530fa9ce8b65d83fbfcd56adb97a978d331955d4d97. Jul 02 21:25:56.781872 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:25:56.781872 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:25:56.781872 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:25:56.781872 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:25:56.781872 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:25:56.781872 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:25:56.781872 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:25:56.781872 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:25:56.781872 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:25:56.781872 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:25:56.781872 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:25:56.781872 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Jul 02 21:25:56.781872 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 02 21:25:56.783200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 02 21:25:56.783200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 02 21:25:56.783200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Jul 02 21:25:56.783200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Jul 02 21:25:56.783200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:25:56.783200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:25:56.783200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Jul 02 21:25:56.783200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Jul 02 21:25:56.783200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:25:56.783200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:25:56.783200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:25:56.783200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:25:56.783200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:25:56.783200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 21:25:56.783200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:25:56.783200 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:25:56.789642 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:25:56.789642 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:25:56.789642 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:25:56.789642 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:25:56.789642 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:25:56.789642 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:25:56.789642 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Jul 02 21:25:56.789642 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Jul 02 21:25:56.789642 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Jul 02 21:25:56.789642 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Jul 02 21:25:56.789642 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Jul 02 21:25:56.789642 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Jul 02 21:25:56.789642 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 244f26a4761bef8829f34530fa9ce8b65d83fbfcd56adb97a978d331955d4d97. Jul 02 21:25:56.789642 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:25:56.789642 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3210/6451] 10.222.0.43 () {58 vars in 1376 bytes} [Sat Jul 2 21:25:56 2022] GET /identity/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2/a9d2f359a0eb46f5ae3779741eea10a5 => generated 148 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:25:56.793037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815c5dc-5733-4089-922c-f66328b0a07d tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:56.808279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815c5dc-5733-4089-922c-f66328b0a07d tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:56.817401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96faa28-55b9-46c4-8a6f-fe641a7b75cd tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181d4dcf0dc54238a2d9dc3633e6c728', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b1b34575e2347469559e8f8027d6dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:56.818663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96faa28-55b9-46c4-8a6f-fe641a7b75cd tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:56.820667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96faa28-55b9-46c4-8a6f-fe641a7b75cd tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:56.821274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96faa28-55b9-46c4-8a6f-fe641a7b75cd tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] PATH_INFO: `/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:56.825389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96faa28-55b9-46c4-8a6f-fe641a7b75cd tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=181d4dcf0dc54238a2d9dc3633e6c728)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:56.831237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96faa28-55b9-46c4-8a6f-fe641a7b75cd tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:56.844563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:56.874497 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3242/6452] 10.222.0.43 () {60 vars in 1298 bytes} [Sat Jul 2 21:25:56 2022] POST /identity/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2 => generated 367 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:56.875364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7ea95-a39a-4650-b739-b287aab814fc tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:56.903716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7ea95-a39a-4650-b739-b287aab814fc tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:56.917808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a074a-ffc2-4358-a3c3-5f680af8cd67 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181d4dcf0dc54238a2d9dc3633e6c728', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b1b34575e2347469559e8f8027d6dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:56.919028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a074a-ffc2-4358-a3c3-5f680af8cd67 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:56.919480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a074a-ffc2-4358-a3c3-5f680af8cd67 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:56.919977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a074a-ffc2-4358-a3c3-5f680af8cd67 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] PATH_INFO: `/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:56.923978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a074a-ffc2-4358-a3c3-5f680af8cd67 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=181d4dcf0dc54238a2d9dc3633e6c728)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:56.929819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a074a-ffc2-4358-a3c3-5f680af8cd67 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:56.997671 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3211/6453] 10.222.0.43 () {60 vars in 1298 bytes} [Sat Jul 2 21:25:56 2022] POST /identity/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2 => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:57.004011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96faa28-55b9-46c4-8a6f-fe641a7b75cd tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:57.020899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a074a-ffc2-4358-a3c3-5f680af8cd67 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:57.022838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96faa28-55b9-46c4-8a6f-fe641a7b75cd tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:57.022974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7e4a074a-ffc2-4358-a3c3-5f680af8cd67 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:57.033581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d169b-731c-4f56-a1e4-ea790bd72dd4 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181d4dcf0dc54238a2d9dc3633e6c728', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b1b34575e2347469559e8f8027d6dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:57.037309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d169b-731c-4f56-a1e4-ea790bd72dd4 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:57.038124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d169b-731c-4f56-a1e4-ea790bd72dd4 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:57.038764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d169b-731c-4f56-a1e4-ea790bd72dd4 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] PATH_INFO: `/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:57.039934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d169b-731c-4f56-a1e4-ea790bd72dd4 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=181d4dcf0dc54238a2d9dc3633e6c728)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:57.046329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d169b-731c-4f56-a1e4-ea790bd72dd4 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:57.065066 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3243/6454] 10.222.0.43 () {58 vars in 1277 bytes} [Sat Jul 2 21:25:57 2022] GET /identity/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2 => generated 865 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:57.066767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d169b-731c-4f56-a1e4-ea790bd72dd4 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:57.097823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d169b-731c-4f56-a1e4-ea790bd72dd4 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:57.110527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a065b8f-9b3a-4eb0-9167-ac46633e320c tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181d4dcf0dc54238a2d9dc3633e6c728', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b1b34575e2347469559e8f8027d6dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:57.111817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a065b8f-9b3a-4eb0-9167-ac46633e320c tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:57.112340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a065b8f-9b3a-4eb0-9167-ac46633e320c tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:57.112833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a065b8f-9b3a-4eb0-9167-ac46633e320c tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] PATH_INFO: `/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2/3847cc170632423e977e588358a73d46` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:57.134708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a065b8f-9b3a-4eb0-9167-ac46633e320c tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=181d4dcf0dc54238a2d9dc3633e6c728, credential_id=3847cc170632423e977e588358a73d46)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:57.142290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a065b8f-9b3a-4eb0-9167-ac46633e320c tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:57.201583 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3244/6455] 10.222.0.43 () {58 vars in 1379 bytes} [Sat Jul 2 21:25:57 2022] DELETE /identity/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2/3847cc170632423e977e588358a73d46 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:57.203359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a065b8f-9b3a-4eb0-9167-ac46633e320c tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:57.225363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a074a-ffc2-4358-a3c3-5f680af8cd67 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:57.239969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a065b8f-9b3a-4eb0-9167-ac46633e320c tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:57.243280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca6093-83cb-4afe-8cab-44811dba6b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:57.244805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca6093-83cb-4afe-8cab-44811dba6b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:57.245289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca6093-83cb-4afe-8cab-44811dba6b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:57.245628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca6093-83cb-4afe-8cab-44811dba6b16 admin admin] PATH_INFO: `/v3/projects/1ec97bb2587c47ee92178f11ebfe38ee` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:57.248795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca6093-83cb-4afe-8cab-44811dba6b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec97bb2587c47ee92178f11ebfe38ee)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:57.251520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca6093-83cb-4afe-8cab-44811dba6b16 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:57.254789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94a4c7-3fe3-4e6f-807d-e048035749f2 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181d4dcf0dc54238a2d9dc3633e6c728', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b1b34575e2347469559e8f8027d6dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:57.256240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94a4c7-3fe3-4e6f-807d-e048035749f2 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:57.256527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94a4c7-3fe3-4e6f-807d-e048035749f2 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:57.256811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94a4c7-3fe3-4e6f-807d-e048035749f2 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] PATH_INFO: `/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2/5245d8084af14ced95300ea0be269292` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:57.269780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94a4c7-3fe3-4e6f-807d-e048035749f2 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=181d4dcf0dc54238a2d9dc3633e6c728, credential_id=5245d8084af14ced95300ea0be269292)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:57.271271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94a4c7-3fe3-4e6f-807d-e048035749f2 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:57.302693 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3245/6456] 10.222.0.43 () {58 vars in 1379 bytes} [Sat Jul 2 21:25:57 2022] DELETE /identity/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2/5245d8084af14ced95300ea0be269292 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:57.307462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94a4c7-3fe3-4e6f-807d-e048035749f2 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:57.327842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94a4c7-3fe3-4e6f-807d-e048035749f2 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:57.337618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821b5db-2c7f-490b-8012-9e20ec41794d tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181d4dcf0dc54238a2d9dc3633e6c728', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b1b34575e2347469559e8f8027d6dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:57.338455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821b5db-2c7f-490b-8012-9e20ec41794d tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:57.338738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821b5db-2c7f-490b-8012-9e20ec41794d tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:57.339013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821b5db-2c7f-490b-8012-9e20ec41794d tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] PATH_INFO: `/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:57.339695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821b5db-2c7f-490b-8012-9e20ec41794d tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=181d4dcf0dc54238a2d9dc3633e6c728)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:57.341395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821b5db-2c7f-490b-8012-9e20ec41794d tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:57.363484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9fca6093-83cb-4afe-8cab-44811dba6b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec97bb2587c47ee92178f11ebfe38ee', 'request_id': 'req-9fca6093-83cb-4afe-8cab-44811dba6b16'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:57.380711 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3246/6457] 10.222.0.43 () {60 vars in 1298 bytes} [Sat Jul 2 21:25:57 2022] POST /identity/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2 => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:25:57.384606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821b5db-2c7f-490b-8012-9e20ec41794d tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:57.388214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9fca6093-83cb-4afe-8cab-44811dba6b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec97bb2587c47ee92178f11ebfe38ee', 'request_id': 'req-9fca6093-83cb-4afe-8cab-44811dba6b16'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:57.403837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821b5db-2c7f-490b-8012-9e20ec41794d tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:57.404750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9fca6093-83cb-4afe-8cab-44811dba6b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec97bb2587c47ee92178f11ebfe38ee', 'request_id': 'req-9fca6093-83cb-4afe-8cab-44811dba6b16'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:57.439455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9fca6093-83cb-4afe-8cab-44811dba6b16 admin admin] The token cache is being invalidate because project 1ec97bb2587c47ee92178f11ebfe38ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:57.440636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9fca6093-83cb-4afe-8cab-44811dba6b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:57.441974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9fca6093-83cb-4afe-8cab-44811dba6b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:57.444376 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3212/6458] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:57 2022] DELETE /identity/v3/projects/1ec97bb2587c47ee92178f11ebfe38ee => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:57.454917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cb8f8-6d08-458c-bf82-893bdff498ea None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:57.455610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cb8f8-6d08-458c-bf82-893bdff498ea None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:57.456075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cb8f8-6d08-458c-bf82-893bdff498ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:57.501302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d23cb8f8-6d08-458c-bf82-893bdff498ea None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:57.502524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d23cb8f8-6d08-458c-bf82-893bdff498ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:57.508434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:57.565502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87a4ea-ce47-4e7d-a2a5-f55ba67f97bc tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181d4dcf0dc54238a2d9dc3633e6c728', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b1b34575e2347469559e8f8027d6dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:57.567288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87a4ea-ce47-4e7d-a2a5-f55ba67f97bc tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:57.567723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87a4ea-ce47-4e7d-a2a5-f55ba67f97bc tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:57.568010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87a4ea-ce47-4e7d-a2a5-f55ba67f97bc tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] PATH_INFO: `/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2/100dfba788ab43b2b4aa40ec29bd5fb4` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:57.574394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87a4ea-ce47-4e7d-a2a5-f55ba67f97bc tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=181d4dcf0dc54238a2d9dc3633e6c728, credential_id=100dfba788ab43b2b4aa40ec29bd5fb4)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:57.576795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87a4ea-ce47-4e7d-a2a5-f55ba67f97bc tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:57.582471 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3247/6459] 10.222.0.43 () {58 vars in 1376 bytes} [Sat Jul 2 21:25:57 2022] GET /identity/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2/100dfba788ab43b2b4aa40ec29bd5fb4 => generated 367 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:25:57.588715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87a4ea-ce47-4e7d-a2a5-f55ba67f97bc tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:57.594003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8a87a4ea-ce47-4e7d-a2a5-f55ba67f97bc tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:57.604147 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3213/6460] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:57.605697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e7605-6c9f-4b55-9461-b962102d638b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:57.605994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e7605-6c9f-4b55-9461-b962102d638b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:57.606274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e7605-6c9f-4b55-9461-b962102d638b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:57.616911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87a4ea-ce47-4e7d-a2a5-f55ba67f97bc tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:57.629960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-841e7605-6c9f-4b55-9461-b962102d638b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:57.631005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-841e7605-6c9f-4b55-9461-b962102d638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:57.632201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa86a66-7e79-46ef-8728-bb2b0279d469 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181d4dcf0dc54238a2d9dc3633e6c728', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b1b34575e2347469559e8f8027d6dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:57.633257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa86a66-7e79-46ef-8728-bb2b0279d469 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:57.633545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa86a66-7e79-46ef-8728-bb2b0279d469 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:57.633833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa86a66-7e79-46ef-8728-bb2b0279d469 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] PATH_INFO: `/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2/100dfba788ab43b2b4aa40ec29bd5fb4` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:57.639783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa86a66-7e79-46ef-8728-bb2b0279d469 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=181d4dcf0dc54238a2d9dc3633e6c728, credential_id=100dfba788ab43b2b4aa40ec29bd5fb4)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:57.641229 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3214/6461] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:57.641440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa86a66-7e79-46ef-8728-bb2b0279d469 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:57.646687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e7605-6c9f-4b55-9461-b962102d638b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:57.646687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-841e7605-6c9f-4b55-9461-b962102d638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:57.692140 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3248/6462] 10.222.0.43 () {58 vars in 1379 bytes} [Sat Jul 2 21:25:57 2022] DELETE /identity/v3/users/181d4dcf0dc54238a2d9dc3633e6c728/credentials/OS-EC2/100dfba788ab43b2b4aa40ec29bd5fb4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:57.693140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa86a66-7e79-46ef-8728-bb2b0279d469 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:57.732097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa86a66-7e79-46ef-8728-bb2b0279d469 tempest-EC2CredentialsTest-1678252289 tempest-EC2CredentialsTest-1678252289-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:57.745739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853e197-b329-48ea-b049-2cac4bb3e304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:57.746095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853e197-b329-48ea-b049-2cac4bb3e304 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:57.746379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853e197-b329-48ea-b049-2cac4bb3e304 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:57.746655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853e197-b329-48ea-b049-2cac4bb3e304 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:57.748183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853e197-b329-48ea-b049-2cac4bb3e304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:57.748510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853e197-b329-48ea-b049-2cac4bb3e304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:57.752387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853e197-b329-48ea-b049-2cac4bb3e304 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:57.758618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e7605-6c9f-4b55-9461-b962102d638b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:57.772770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b70c6f-99f6-450c-903e-d7fe536657de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:57.773449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b70c6f-99f6-450c-903e-d7fe536657de service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:57.773734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b70c6f-99f6-450c-903e-d7fe536657de service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:57.774021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b70c6f-99f6-450c-903e-d7fe536657de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:57.782999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-47b70c6f-99f6-450c-903e-d7fe536657de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:57.792136 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3249/6463] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:25:57.792136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853e197-b329-48ea-b049-2cac4bb3e304 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:57.794500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3853e197-b329-48ea-b049-2cac4bb3e304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:57.835079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853e197-b329-48ea-b049-2cac4bb3e304 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:57.860333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728d37b-4f21-4a4e-819d-00b05af93c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:57.861252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728d37b-4f21-4a4e-819d-00b05af93c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:57.864078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728d37b-4f21-4a4e-819d-00b05af93c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:57.864240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728d37b-4f21-4a4e-819d-00b05af93c80 admin admin] PATH_INFO: `/v3/users/181d4dcf0dc54238a2d9dc3633e6c728` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:57.868932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728d37b-4f21-4a4e-819d-00b05af93c80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=181d4dcf0dc54238a2d9dc3633e6c728)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:57.878580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728d37b-4f21-4a4e-819d-00b05af93c80 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:57.950726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b70c6f-99f6-450c-903e-d7fe536657de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:57.953993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b70c6f-99f6-450c-903e-d7fe536657de service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:58.027002 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3215/6464] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:58.028361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b70c6f-99f6-450c-903e-d7fe536657de service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:58.030580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4728d37b-4f21-4a4e-819d-00b05af93c80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181d4dcf0dc54238a2d9dc3633e6c728'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:58.065387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b70c6f-99f6-450c-903e-d7fe536657de service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:58.069481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4728d37b-4f21-4a4e-819d-00b05af93c80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181d4dcf0dc54238a2d9dc3633e6c728'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:58.070455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4728d37b-4f21-4a4e-819d-00b05af93c80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181d4dcf0dc54238a2d9dc3633e6c728'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:58.071318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4728d37b-4f21-4a4e-819d-00b05af93c80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181d4dcf0dc54238a2d9dc3633e6c728'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:58.085166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4110860-466b-4990-86c4-e3d24b16c9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:58.088513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4110860-466b-4990-86c4-e3d24b16c9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:58.088983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4110860-466b-4990-86c4-e3d24b16c9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:58.089265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4110860-466b-4990-86c4-e3d24b16c9d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:58.090006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4110860-466b-4990-86c4-e3d24b16c9d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:58.091668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4728d37b-4f21-4a4e-819d-00b05af93c80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181d4dcf0dc54238a2d9dc3633e6c728'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:58.099553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4110860-466b-4990-86c4-e3d24b16c9d6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:58.112411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:58.120424 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3250/6465] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:25:57 2022] DELETE /identity/v3/users/181d4dcf0dc54238a2d9dc3633e6c728 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:58.125727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16d188-2498-4ea8-939c-8573460572c5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:58.126139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16d188-2498-4ea8-939c-8573460572c5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:58.126498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16d188-2498-4ea8-939c-8573460572c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:58.149332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6c16d188-2498-4ea8-939c-8573460572c5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:58.150952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6c16d188-2498-4ea8-939c-8573460572c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:58.179693 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3216/6466] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:25:58 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:58.181279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4110860-466b-4990-86c4-e3d24b16c9d6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:58.184548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b4110860-466b-4990-86c4-e3d24b16c9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:58.225479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:58.320667 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3251/6467] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:58.325344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16d188-2498-4ea8-939c-8573460572c5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:58.329360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6c16d188-2498-4ea8-939c-8573460572c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:58.345720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4110860-466b-4990-86c4-e3d24b16c9d6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:58.359445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41a0a5-987f-4336-b2dd-8bc1dcaea944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:58.360650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41a0a5-987f-4336-b2dd-8bc1dcaea944 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:58.361162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41a0a5-987f-4336-b2dd-8bc1dcaea944 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:58.361749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41a0a5-987f-4336-b2dd-8bc1dcaea944 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:58.362745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41a0a5-987f-4336-b2dd-8bc1dcaea944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:58.364976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41a0a5-987f-4336-b2dd-8bc1dcaea944 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:58.409045 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3217/6468] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:25:58 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:25:58.410140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41a0a5-987f-4336-b2dd-8bc1dcaea944 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:58.419247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ec41a0a5-987f-4336-b2dd-8bc1dcaea944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:58.425131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16d188-2498-4ea8-939c-8573460572c5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:58.563610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41a0a5-987f-4336-b2dd-8bc1dcaea944 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:58.574370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7964ce-3023-4407-80a3-23574581dcea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:58.575055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7964ce-3023-4407-80a3-23574581dcea service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:58.575342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7964ce-3023-4407-80a3-23574581dcea service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:58.575622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7964ce-3023-4407-80a3-23574581dcea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:58.599420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7964ce-3023-4407-80a3-23574581dcea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:58.600788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7964ce-3023-4407-80a3-23574581dcea service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:58.618861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24026d9d-7f8e-4501-a4fa-b0a99f69a382 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:58.621438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24026d9d-7f8e-4501-a4fa-b0a99f69a382 service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:58.622161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24026d9d-7f8e-4501-a4fa-b0a99f69a382 service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:58.622778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24026d9d-7f8e-4501-a4fa-b0a99f69a382 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:58.626148 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3218/6469] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:58.626331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-24026d9d-7f8e-4501-a4fa-b0a99f69a382 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:58.627002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7964ce-3023-4407-80a3-23574581dcea service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:58.674848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7964ce-3023-4407-80a3-23574581dcea service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:58.687110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d5b82-6fbf-44e1-9497-c593bd3dd8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:58.687803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d5b82-6fbf-44e1-9497-c593bd3dd8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:58.688130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d5b82-6fbf-44e1-9497-c593bd3dd8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:58.688424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d5b82-6fbf-44e1-9497-c593bd3dd8e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:58.689165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d5b82-6fbf-44e1-9497-c593bd3dd8e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:58.692855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d5b82-6fbf-44e1-9497-c593bd3dd8e5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:58.735685 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3219/6470] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:58.738061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d5b82-6fbf-44e1-9497-c593bd3dd8e5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:58.766291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d5b82-6fbf-44e1-9497-c593bd3dd8e5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:58.781842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f6a57-f75c-41fa-9d76-be3db47c2ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:58.782579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f6a57-f75c-41fa-9d76-be3db47c2ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:58.782865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f6a57-f75c-41fa-9d76-be3db47c2ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:58.783273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f6a57-f75c-41fa-9d76-be3db47c2ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:58.784021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f6a57-f75c-41fa-9d76-be3db47c2ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:58.788357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f6a57-f75c-41fa-9d76-be3db47c2ef4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:58.833989 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3220/6471] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:25:58.838116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:58.847564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f6a57-f75c-41fa-9d76-be3db47c2ef4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:58.896941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f6a57-f75c-41fa-9d76-be3db47c2ef4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:58.914569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24026d9d-7f8e-4501-a4fa-b0a99f69a382 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:58.915001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fb82e-9033-4563-91f4-3e18924e1b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:58.915928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fb82e-9033-4563-91f4-3e18924e1b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:58.916306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fb82e-9033-4563-91f4-3e18924e1b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:58.916591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fb82e-9033-4563-91f4-3e18924e1b52 admin admin] PATH_INFO: `/v3/projects/b5e51914b1c3407281b54e1f83717b95/users/c5cd190cf88a4a50bf5e06dbba6c97ed/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:58.917352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24026d9d-7f8e-4501-a4fa-b0a99f69a382 service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:58.968984 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3252/6472] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:58.971473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fb82e-9033-4563-91f4-3e18924e1b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e51914b1c3407281b54e1f83717b95, user_id=c5cd190cf88a4a50bf5e06dbba6c97ed, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:58.983881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fb82e-9033-4563-91f4-3e18924e1b52 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:59.020864 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3221/6473] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:25:58 2022] PUT /identity/v3/projects/b5e51914b1c3407281b54e1f83717b95/users/c5cd190cf88a4a50bf5e06dbba6c97ed/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:25:59.022031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71294ad6-86e4-468c-ae21-0ee902306d6c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:59.022378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71294ad6-86e4-468c-ae21-0ee902306d6c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:59.022711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71294ad6-86e4-468c-ae21-0ee902306d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:59.060558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-71294ad6-86e4-468c-ae21-0ee902306d6c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:59.064068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-71294ad6-86e4-468c-ae21-0ee902306d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:59.197368 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3253/6474] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:59.228668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fb82e-9033-4563-91f4-3e18924e1b52 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:59.315045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fb82e-9033-4563-91f4-3e18924e1b52 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:59.331255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cef458-19ee-47fd-8f39-efb60aef47d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:59.331942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cef458-19ee-47fd-8f39-efb60aef47d9 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:59.332272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cef458-19ee-47fd-8f39-efb60aef47d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:59.332557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cef458-19ee-47fd-8f39-efb60aef47d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:59.352944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cef458-19ee-47fd-8f39-efb60aef47d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:59.361516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cef458-19ee-47fd-8f39-efb60aef47d9 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:59.367425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71294ad6-86e4-468c-ae21-0ee902306d6c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:59.368924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-71294ad6-86e4-468c-ae21-0ee902306d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:59.382766 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3222/6475] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:25:59.399396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71294ad6-86e4-468c-ae21-0ee902306d6c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:59.415737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98079846-e0ca-4aed-98aa-275798da1378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:59.417446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98079846-e0ca-4aed-98aa-275798da1378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:59.417736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98079846-e0ca-4aed-98aa-275798da1378 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:59.418017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98079846-e0ca-4aed-98aa-275798da1378 admin admin] PATH_INFO: `/v3/projects/0b1b34575e2347469559e8f8027d6dbf` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:59.419585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98079846-e0ca-4aed-98aa-275798da1378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1b34575e2347469559e8f8027d6dbf)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:59.424017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98079846-e0ca-4aed-98aa-275798da1378 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:25:59.530706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-98079846-e0ca-4aed-98aa-275798da1378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1b34575e2347469559e8f8027d6dbf', 'request_id': 'req-98079846-e0ca-4aed-98aa-275798da1378'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:59.568747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-98079846-e0ca-4aed-98aa-275798da1378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1b34575e2347469559e8f8027d6dbf', 'request_id': 'req-98079846-e0ca-4aed-98aa-275798da1378'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:59.582205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-98079846-e0ca-4aed-98aa-275798da1378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1b34575e2347469559e8f8027d6dbf', 'request_id': 'req-98079846-e0ca-4aed-98aa-275798da1378'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:59.596549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-98079846-e0ca-4aed-98aa-275798da1378 admin admin] The token cache is being invalidate because project 0b1b34575e2347469559e8f8027d6dbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:25:59.597015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-98079846-e0ca-4aed-98aa-275798da1378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:59.598885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-98079846-e0ca-4aed-98aa-275798da1378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:25:59.611993 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3254/6476] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:59 2022] DELETE /identity/v3/projects/0b1b34575e2347469559e8f8027d6dbf => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:25:59.613879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08461a9e-27c1-44d9-8abe-0d7c322a8a44 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:59.614178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08461a9e-27c1-44d9-8abe-0d7c322a8a44 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:59.614455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08461a9e-27c1-44d9-8abe-0d7c322a8a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:59.626747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:59.652325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-08461a9e-27c1-44d9-8abe-0d7c322a8a44 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:59.655774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-08461a9e-27c1-44d9-8abe-0d7c322a8a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:59.831825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1b0de-660f-4f4f-8cec-431afbf69f42 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:59.832252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1b0de-660f-4f4f-8cec-431afbf69f42 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:59.832461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1b0de-660f-4f4f-8cec-431afbf69f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:59.836645 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3223/6477] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:25:59.858035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-27e1b0de-660f-4f4f-8cec-431afbf69f42 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:25:59.859390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-27e1b0de-660f-4f4f-8cec-431afbf69f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:25:59.875700 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3255/6478] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:25:59.881907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08461a9e-27c1-44d9-8abe-0d7c322a8a44 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:25:59.916708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08461a9e-27c1-44d9-8abe-0d7c322a8a44 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:25:59.944692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf79d3f-661c-43bb-bab2-be15667d01c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:25:59.945470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf79d3f-661c-43bb-bab2-be15667d01c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:25:59.946444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf79d3f-661c-43bb-bab2-be15667d01c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:25:59.946444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf79d3f-661c-43bb-bab2-be15667d01c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:25:59.947234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf79d3f-661c-43bb-bab2-be15667d01c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:25:59.947438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf79d3f-661c-43bb-bab2-be15667d01c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:25:59.949316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf79d3f-661c-43bb-bab2-be15667d01c3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:00.011507 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3224/6479] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:26:00.024618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1b0de-660f-4f4f-8cec-431afbf69f42 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:00.043069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1b0de-660f-4f4f-8cec-431afbf69f42 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:00.069897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3498a-caad-4efa-b575-325486d2fc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:00.070917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3498a-caad-4efa-b575-325486d2fc13 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:00.071403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3498a-caad-4efa-b575-325486d2fc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:00.071892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3498a-caad-4efa-b575-325486d2fc13 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:00.072900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3498a-caad-4efa-b575-325486d2fc13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:00.079784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3498a-caad-4efa-b575-325486d2fc13 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:00.167778 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3256/6480] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:26:00 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:26:00.171811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf79d3f-661c-43bb-bab2-be15667d01c3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:00.190155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf79d3f-661c-43bb-bab2-be15667d01c3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:00.317786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76a331-73be-4742-886b-9b398ee5e772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:00.319271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76a331-73be-4742-886b-9b398ee5e772 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:00.319915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76a331-73be-4742-886b-9b398ee5e772 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:00.320377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76a331-73be-4742-886b-9b398ee5e772 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:00.321368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76a331-73be-4742-886b-9b398ee5e772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:00.325462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76a331-73be-4742-886b-9b398ee5e772 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:00.376346 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3225/6481] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:26:00 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:00.377275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3498a-caad-4efa-b575-325486d2fc13 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:00.394000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3498a-caad-4efa-b575-325486d2fc13 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:00.407468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dd9c8-b5c4-491b-b582-495f405de756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:00.408386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dd9c8-b5c4-491b-b582-495f405de756 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:00.408772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dd9c8-b5c4-491b-b582-495f405de756 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:00.409030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dd9c8-b5c4-491b-b582-495f405de756 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:00.409770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dd9c8-b5c4-491b-b582-495f405de756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:00.411423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dd9c8-b5c4-491b-b582-495f405de756 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:00.437922 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3257/6482] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:26:00.445170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76a331-73be-4742-886b-9b398ee5e772 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:00.460996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76a331-73be-4742-886b-9b398ee5e772 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:00.466897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6c833-fb80-405e-a6cf-f5d1388c531e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:00.467569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6c833-fb80-405e-a6cf-f5d1388c531e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:00.468013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6c833-fb80-405e-a6cf-f5d1388c531e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:00.468344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6c833-fb80-405e-a6cf-f5d1388c531e admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:00.469126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6c833-fb80-405e-a6cf-f5d1388c531e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:00.470819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6c833-fb80-405e-a6cf-f5d1388c531e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:00.488227 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3226/6483] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:00.492369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dd9c8-b5c4-491b-b582-495f405de756 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:00.503380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dd9c8-b5c4-491b-b582-495f405de756 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:00.508506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04091644-6be7-4faf-a585-19482db4465a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:00.509465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04091644-6be7-4faf-a585-19482db4465a admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:00.509741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04091644-6be7-4faf-a585-19482db4465a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:00.510020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04091644-6be7-4faf-a585-19482db4465a admin admin] PATH_INFO: `/v3/projects/5fa224e9b9f3451e87e910efb99fc6a3/users/0958509ef5574637a83c37d49cc8dffe/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:00.539781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04091644-6be7-4faf-a585-19482db4465a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa224e9b9f3451e87e910efb99fc6a3, user_id=0958509ef5574637a83c37d49cc8dffe, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:00.544083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04091644-6be7-4faf-a585-19482db4465a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:00.574975 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3258/6484] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:00 2022] PUT /identity/v3/projects/5fa224e9b9f3451e87e910efb99fc6a3/users/0958509ef5574637a83c37d49cc8dffe/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:00.583949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf1da9-5c54-456a-ba2c-2a457cf3b3a9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:00.584810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf1da9-5c54-456a-ba2c-2a457cf3b3a9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:00.584810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf1da9-5c54-456a-ba2c-2a457cf3b3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:00.701752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3bbf1da9-5c54-456a-ba2c-2a457cf3b3a9 None None] MFA Rules not processed for user `0958509ef5574637a83c37d49cc8dffe`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:00.703703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3bbf1da9-5c54-456a-ba2c-2a457cf3b3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:00.808506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:00.814475 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3227/6485] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:26:00.831051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04091644-6be7-4faf-a585-19482db4465a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:00.832995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-04091644-6be7-4faf-a585-19482db4465a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:00.838976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:00.912830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce230a4-f696-4786-b3d0-ea2bec095377 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:00.913736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce230a4-f696-4786-b3d0-ea2bec095377 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:00.914099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce230a4-f696-4786-b3d0-ea2bec095377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:00.968567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04091644-6be7-4faf-a585-19482db4465a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:00.973849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-7ce230a4-f696-4786-b3d0-ea2bec095377 None None] MFA Rules not processed for user `b38c7b1a0c2a47bd82d40efb9f2c42d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:00.975096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7202dda-bd08-49b9-a3e2-ab8a1580d497 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:00.975259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7ce230a4-f696-4786-b3d0-ea2bec095377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:00.976589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7202dda-bd08-49b9-a3e2-ab8a1580d497 service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:00.976973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7202dda-bd08-49b9-a3e2-ab8a1580d497 service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:00.977916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7202dda-bd08-49b9-a3e2-ab8a1580d497 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:00.996957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7202dda-bd08-49b9-a3e2-ab8a1580d497 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:00.999703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7202dda-bd08-49b9-a3e2-ab8a1580d497 service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:01.020747 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3259/6486] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:26:01.123782 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3228/6487] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:26:01.124598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7202dda-bd08-49b9-a3e2-ab8a1580d497 service glance] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:01.126835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e7202dda-bd08-49b9-a3e2-ab8a1580d497 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:01.264718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7202dda-bd08-49b9-a3e2-ab8a1580d497 service glance] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:01.271066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4e2d1-243c-4947-a92f-93e44fa549e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:01.283984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ecbfd-ae57-441f-854b-412109c4c75f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:01.284428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ecbfd-ae57-441f-854b-412109c4c75f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:01.284952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ecbfd-ae57-441f-854b-412109c4c75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:01.290834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4e2d1-243c-4947-a92f-93e44fa549e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:01.291422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4e2d1-243c-4947-a92f-93e44fa549e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:01.291867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4e2d1-243c-4947-a92f-93e44fa549e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:01.292813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4e2d1-243c-4947-a92f-93e44fa549e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:01.299663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4e2d1-243c-4947-a92f-93e44fa549e8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:01.340744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-542ecbfd-ae57-441f-854b-412109c4c75f None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:01.343379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-542ecbfd-ae57-441f-854b-412109c4c75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:01.355657 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3260/6488] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:26:01 2022] POST /identity/v3/projects => generated 381 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:26:01.359459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4e2d1-243c-4947-a92f-93e44fa549e8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:01.456852 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3229/6489] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:26:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:01.507790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4e2d1-243c-4947-a92f-93e44fa549e8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:01.517022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb6019-31a4-4fed-ae08-5785ac32796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:01.518035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6019-31a4-4fed-ae08-5785ac32796a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:01.518364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6019-31a4-4fed-ae08-5785ac32796a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:01.518719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6019-31a4-4fed-ae08-5785ac32796a admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:01.519487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb6019-31a4-4fed-ae08-5785ac32796a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:01.521553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb6019-31a4-4fed-ae08-5785ac32796a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:01.549360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ecbfd-ae57-441f-854b-412109c4c75f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:01.551321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-542ecbfd-ae57-441f-854b-412109c4c75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:01.567754 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3261/6490] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:26:01 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:01.569207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb6019-31a4-4fed-ae08-5785ac32796a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:01.589780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb6019-31a4-4fed-ae08-5785ac32796a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:01.601526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdd4ba-deee-4bef-8935-6c9368427a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:01.602373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdd4ba-deee-4bef-8935-6c9368427a02 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:01.602858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdd4ba-deee-4bef-8935-6c9368427a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:01.603231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdd4ba-deee-4bef-8935-6c9368427a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:01.604231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdd4ba-deee-4bef-8935-6c9368427a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:01.606289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdd4ba-deee-4bef-8935-6c9368427a02 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:01.638181 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3262/6491] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:01.639476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdd4ba-deee-4bef-8935-6c9368427a02 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:01.658675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdd4ba-deee-4bef-8935-6c9368427a02 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:01.670492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba06fba-4c8a-4bce-9e3b-16688aff2391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:01.671635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba06fba-4c8a-4bce-9e3b-16688aff2391 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:01.672028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba06fba-4c8a-4bce-9e3b-16688aff2391 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:01.672421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba06fba-4c8a-4bce-9e3b-16688aff2391 admin admin] PATH_INFO: `/v3/projects/a7c292a96f974795958c54bec85ccc61/users/a1ea0e5cdcdf486783a4b6416c04f20a/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:01.680515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:01.703153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba06fba-4c8a-4bce-9e3b-16688aff2391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c292a96f974795958c54bec85ccc61, user_id=a1ea0e5cdcdf486783a4b6416c04f20a, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:01.715293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba06fba-4c8a-4bce-9e3b-16688aff2391 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:01.746355 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3263/6492] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:01 2022] PUT /identity/v3/projects/a7c292a96f974795958c54bec85ccc61/users/a1ea0e5cdcdf486783a4b6416c04f20a/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:01.747674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba06fba-4c8a-4bce-9e3b-16688aff2391 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:01.752305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ecbfd-ae57-441f-854b-412109c4c75f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:01.813412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:01.862077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e1d2e-f28a-44fc-8ae1-6234fecf1114 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:01.863090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e1d2e-f28a-44fc-8ae1-6234fecf1114 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:01.865550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e1d2e-f28a-44fc-8ae1-6234fecf1114 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:01.865845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e1d2e-f28a-44fc-8ae1-6234fecf1114 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:01.899687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba06fba-4c8a-4bce-9e3b-16688aff2391 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:01.931491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f34176-2e4b-4d40-b6be-2f1bafc616b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:01.932368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f34176-2e4b-4d40-b6be-2f1bafc616b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:01.932757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f34176-2e4b-4d40-b6be-2f1bafc616b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:01.933124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f34176-2e4b-4d40-b6be-2f1bafc616b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:01.937327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f34176-2e4b-4d40-b6be-2f1bafc616b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:01.942577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f34176-2e4b-4d40-b6be-2f1bafc616b8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:01.969698 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3264/6493] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:01.975974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f34176-2e4b-4d40-b6be-2f1bafc616b8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:01.998483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f34176-2e4b-4d40-b6be-2f1bafc616b8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:02.007500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e1d2e-f28a-44fc-8ae1-6234fecf1114 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:02.009512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e1d2e-f28a-44fc-8ae1-6234fecf1114 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:02.013359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce292d-4484-4278-ae28-4c64bf3d4585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:02.014346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce292d-4484-4278-ae28-4c64bf3d4585 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:02.014702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce292d-4484-4278-ae28-4c64bf3d4585 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:02.015045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce292d-4484-4278-ae28-4c64bf3d4585 admin admin] PATH_INFO: `/v3/projects/a7c292a96f974795958c54bec85ccc61/users/a1ea0e5cdcdf486783a4b6416c04f20a/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:02.020310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce292d-4484-4278-ae28-4c64bf3d4585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c292a96f974795958c54bec85ccc61, user_id=a1ea0e5cdcdf486783a4b6416c04f20a, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:02.026804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce292d-4484-4278-ae28-4c64bf3d4585 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:02.027557 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3230/6494] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:26:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:26:02.061402 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3265/6495] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:01 2022] PUT /identity/v3/projects/a7c292a96f974795958c54bec85ccc61/users/a1ea0e5cdcdf486783a4b6416c04f20a/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:03.029510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deadc8c-e3a9-4a9e-8a06-2291ddf4c373 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:03.029997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deadc8c-e3a9-4a9e-8a06-2291ddf4c373 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:03.030106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deadc8c-e3a9-4a9e-8a06-2291ddf4c373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:03.057073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6deadc8c-e3a9-4a9e-8a06-2291ddf4c373 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:03.059972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6deadc8c-e3a9-4a9e-8a06-2291ddf4c373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:03.149996 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3231/6496] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:26:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:03.192684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce292d-4484-4278-ae28-4c64bf3d4585 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:03.308015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce292d-4484-4278-ae28-4c64bf3d4585 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:03.320799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be3562-6df0-4d60-9379-a40b91c4815a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:03.321490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be3562-6df0-4d60-9379-a40b91c4815a service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:03.321776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be3562-6df0-4d60-9379-a40b91c4815a service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:03.322056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be3562-6df0-4d60-9379-a40b91c4815a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:03.334597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be3562-6df0-4d60-9379-a40b91c4815a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:03.336504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be3562-6df0-4d60-9379-a40b91c4815a service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:03.349769 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3266/6497] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:26:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 02 21:26:04.158771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2291c7-2be1-4012-ac6f-a675f26de59a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:04.159634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2291c7-2be1-4012-ac6f-a675f26de59a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:04.160181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2291c7-2be1-4012-ac6f-a675f26de59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:04.189199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-de2291c7-2be1-4012-ac6f-a675f26de59a None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:04.194164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-de2291c7-2be1-4012-ac6f-a675f26de59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:04.224409 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3232/6498] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:26:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:04.231031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be3562-6df0-4d60-9379-a40b91c4815a service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:04.248657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be3562-6df0-4d60-9379-a40b91c4815a service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:04.260595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2771d-124f-4e50-981a-9b01dca2a93f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:04.261737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2771d-124f-4e50-981a-9b01dca2a93f service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:04.262327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2771d-124f-4e50-981a-9b01dca2a93f service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:04.263022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2771d-124f-4e50-981a-9b01dca2a93f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:04.279677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2771d-124f-4e50-981a-9b01dca2a93f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:04.281925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2771d-124f-4e50-981a-9b01dca2a93f service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:04.293190 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3267/6499] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:26:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:26:04.896062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cde1f-b3a4-40c4-8458-0de387c3bd0c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:04.896608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cde1f-b3a4-40c4-8458-0de387c3bd0c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:04.897036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cde1f-b3a4-40c4-8458-0de387c3bd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:04.927605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-116cde1f-b3a4-40c4-8458-0de387c3bd0c None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:04.929228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-116cde1f-b3a4-40c4-8458-0de387c3bd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:04.954676 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3233/6500] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:26:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:05.028090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2771d-124f-4e50-981a-9b01dca2a93f service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:05.054849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2771d-124f-4e50-981a-9b01dca2a93f service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:05.077466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f1eff-441d-45ca-bb52-8fbc4312534e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:05.078472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f1eff-441d-45ca-bb52-8fbc4312534e service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:05.078938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f1eff-441d-45ca-bb52-8fbc4312534e service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:05.079387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f1eff-441d-45ca-bb52-8fbc4312534e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:05.102492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f1eff-441d-45ca-bb52-8fbc4312534e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:05.104474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f1eff-441d-45ca-bb52-8fbc4312534e service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:05.127820 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3268/6501] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:26:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:26:05.776830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08458196-7f07-4011-a1be-b916229b47db None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:05.777425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08458196-7f07-4011-a1be-b916229b47db None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:05.777628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08458196-7f07-4011-a1be-b916229b47db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:05.825195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-08458196-7f07-4011-a1be-b916229b47db None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:05.827464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-08458196-7f07-4011-a1be-b916229b47db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:05.854061 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3234/6502] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:26:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:05.881723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f1eff-441d-45ca-bb52-8fbc4312534e service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:05.910955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f1eff-441d-45ca-bb52-8fbc4312534e service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:05.952838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde1312-7264-4a75-bcb2-c1a1e585ca23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:05.953972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde1312-7264-4a75-bcb2-c1a1e585ca23 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:05.960202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde1312-7264-4a75-bcb2-c1a1e585ca23 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:05.960817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde1312-7264-4a75-bcb2-c1a1e585ca23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:05.983666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde1312-7264-4a75-bcb2-c1a1e585ca23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:05.985780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde1312-7264-4a75-bcb2-c1a1e585ca23 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:06.012434 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3269/6503] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:26:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:26:06.541063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d04af-32c2-4448-82f7-c690f65cdb71 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:06.541625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d04af-32c2-4448-82f7-c690f65cdb71 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:06.542015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d04af-32c2-4448-82f7-c690f65cdb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:06.577776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-260d04af-32c2-4448-82f7-c690f65cdb71 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:06.579323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-260d04af-32c2-4448-82f7-c690f65cdb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:06.605622 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3235/6504] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:26:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:06.617327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde1312-7264-4a75-bcb2-c1a1e585ca23 service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:06.637500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde1312-7264-4a75-bcb2-c1a1e585ca23 service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:06.644485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602eab4-c0bb-4e36-80c0-23c2a08a09c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:06.645761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602eab4-c0bb-4e36-80c0-23c2a08a09c0 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:06.646288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602eab4-c0bb-4e36-80c0-23c2a08a09c0 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:06.646838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602eab4-c0bb-4e36-80c0-23c2a08a09c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:06.658369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602eab4-c0bb-4e36-80c0-23c2a08a09c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:06.660671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602eab4-c0bb-4e36-80c0-23c2a08a09c0 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:06.672937 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3270/6505] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:26:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:26:07.040757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d04af-32c2-4448-82f7-c690f65cdb71 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:07.241588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:07.257346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d04af-32c2-4448-82f7-c690f65cdb71 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:07.285845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc358fd-6094-442b-901d-0c599ad155f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:07.292799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc358fd-6094-442b-901d-0c599ad155f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:07.293166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc358fd-6094-442b-901d-0c599ad155f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:07.293444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc358fd-6094-442b-901d-0c599ad155f8 admin admin] PATH_INFO: `/v3/users/0958509ef5574637a83c37d49cc8dffe` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:07.294918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc358fd-6094-442b-901d-0c599ad155f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0958509ef5574637a83c37d49cc8dffe)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:07.300017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc358fd-6094-442b-901d-0c599ad155f8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:07.512503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2cc358fd-6094-442b-901d-0c599ad155f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0958509ef5574637a83c37d49cc8dffe'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:07.544162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2cc358fd-6094-442b-901d-0c599ad155f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0958509ef5574637a83c37d49cc8dffe'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:07.561270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2cc358fd-6094-442b-901d-0c599ad155f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0958509ef5574637a83c37d49cc8dffe'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:07.564584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2cc358fd-6094-442b-901d-0c599ad155f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0958509ef5574637a83c37d49cc8dffe'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:07.565525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2cc358fd-6094-442b-901d-0c599ad155f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0958509ef5574637a83c37d49cc8dffe'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:07.628725 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3236/6506] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:26:07 2022] DELETE /identity/v3/users/0958509ef5574637a83c37d49cc8dffe => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:07.633101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec2220-d9ae-469e-8836-d03448935171 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:07.633611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec2220-d9ae-469e-8836-d03448935171 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:07.633979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec2220-d9ae-469e-8836-d03448935171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:07.650208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:07.695226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-34ec2220-d9ae-469e-8836-d03448935171 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:07.696843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-34ec2220-d9ae-469e-8836-d03448935171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:07.911632 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3271/6507] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:07.993942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc358fd-6094-442b-901d-0c599ad155f8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:07.995432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2cc358fd-6094-442b-901d-0c599ad155f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:08.232469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc358fd-6094-442b-901d-0c599ad155f8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:08.275124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539dc81-ff15-494c-8a2f-b88155d3669b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:08.280666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539dc81-ff15-494c-8a2f-b88155d3669b service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:08.285616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539dc81-ff15-494c-8a2f-b88155d3669b service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:08.289749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539dc81-ff15-494c-8a2f-b88155d3669b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:08.320603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539dc81-ff15-494c-8a2f-b88155d3669b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:08.322276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539dc81-ff15-494c-8a2f-b88155d3669b service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:08.357619 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3237/6508] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:26:09.643461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec2220-d9ae-469e-8836-d03448935171 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:09.645634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-34ec2220-d9ae-469e-8836-d03448935171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:09.667057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec2220-d9ae-469e-8836-d03448935171 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:09.681351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8407273-4c37-48d4-b6bd-899358dba0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:09.682271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8407273-4c37-48d4-b6bd-899358dba0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:09.682553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8407273-4c37-48d4-b6bd-899358dba0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:09.682831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8407273-4c37-48d4-b6bd-899358dba0c4 admin admin] PATH_INFO: `/v3/projects/5fa224e9b9f3451e87e910efb99fc6a3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:09.684074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8407273-4c37-48d4-b6bd-899358dba0c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa224e9b9f3451e87e910efb99fc6a3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:09.700786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8407273-4c37-48d4-b6bd-899358dba0c4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:09.831559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b8407273-4c37-48d4-b6bd-899358dba0c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa224e9b9f3451e87e910efb99fc6a3', 'request_id': 'req-b8407273-4c37-48d4-b6bd-899358dba0c4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:09.862165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b8407273-4c37-48d4-b6bd-899358dba0c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa224e9b9f3451e87e910efb99fc6a3', 'request_id': 'req-b8407273-4c37-48d4-b6bd-899358dba0c4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:09.886978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b8407273-4c37-48d4-b6bd-899358dba0c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa224e9b9f3451e87e910efb99fc6a3', 'request_id': 'req-b8407273-4c37-48d4-b6bd-899358dba0c4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:09.913230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b8407273-4c37-48d4-b6bd-899358dba0c4 admin admin] The token cache is being invalidate because project 5fa224e9b9f3451e87e910efb99fc6a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:26:09.913620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b8407273-4c37-48d4-b6bd-899358dba0c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:09.916666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b8407273-4c37-48d4-b6bd-899358dba0c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:09.925948 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3272/6509] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:09 2022] DELETE /identity/v3/projects/5fa224e9b9f3451e87e910efb99fc6a3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:09.928191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fbcba-a6d3-4e15-9856-da1b91d19e46 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:09.928677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fbcba-a6d3-4e15-9856-da1b91d19e46 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:09.928772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fbcba-a6d3-4e15-9856-da1b91d19e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:09.972980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a67fbcba-a6d3-4e15-9856-da1b91d19e46 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:09.975017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a67fbcba-a6d3-4e15-9856-da1b91d19e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:10.060164 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3238/6510] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:10.068187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64302188-6f45-4611-90ed-4df80a3c180d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:10.068851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64302188-6f45-4611-90ed-4df80a3c180d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:10.069321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64302188-6f45-4611-90ed-4df80a3c180d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:10.124084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-64302188-6f45-4611-90ed-4df80a3c180d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:10.126292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-64302188-6f45-4611-90ed-4df80a3c180d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:10.168720 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3273/6511] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:10.173421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fbcba-a6d3-4e15-9856-da1b91d19e46 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:10.198936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fbcba-a6d3-4e15-9856-da1b91d19e46 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:10.236994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221aee0-0fa3-4d54-9461-236650ea9720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:10.241410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221aee0-0fa3-4d54-9461-236650ea9720 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:10.241715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221aee0-0fa3-4d54-9461-236650ea9720 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:10.242008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221aee0-0fa3-4d54-9461-236650ea9720 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:10.242776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221aee0-0fa3-4d54-9461-236650ea9720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:26:10.243087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221aee0-0fa3-4d54-9461-236650ea9720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:10.249642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221aee0-0fa3-4d54-9461-236650ea9720 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:10.309084 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3239/6512] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:26:10.312135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64302188-6f45-4611-90ed-4df80a3c180d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:10.328777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64302188-6f45-4611-90ed-4df80a3c180d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:10.348306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726a6b5-4053-478b-abc0-e6998d9b0112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:10.349002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726a6b5-4053-478b-abc0-e6998d9b0112 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:10.350713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726a6b5-4053-478b-abc0-e6998d9b0112 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:10.351173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726a6b5-4053-478b-abc0-e6998d9b0112 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:10.351904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726a6b5-4053-478b-abc0-e6998d9b0112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:10.367055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726a6b5-4053-478b-abc0-e6998d9b0112 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:10.434488 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3274/6513] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:26:10 2022] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:10.438718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221aee0-0fa3-4d54-9461-236650ea9720 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:10.447639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:10.455152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221aee0-0fa3-4d54-9461-236650ea9720 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:10.653558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076df345-e295-4c70-af73-0f6ee0ba8872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:10.654079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076df345-e295-4c70-af73-0f6ee0ba8872 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:10.654380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076df345-e295-4c70-af73-0f6ee0ba8872 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:10.654706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076df345-e295-4c70-af73-0f6ee0ba8872 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:10.655437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076df345-e295-4c70-af73-0f6ee0ba8872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:10.663952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076df345-e295-4c70-af73-0f6ee0ba8872 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:10.731268 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3240/6514] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:26:10 2022] POST /identity/v3/users => generated 282 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:10.734908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726a6b5-4053-478b-abc0-e6998d9b0112 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:10.755361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726a6b5-4053-478b-abc0-e6998d9b0112 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:10.780192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a631be1-82fa-4466-adae-662c1cf262a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:10.780905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a631be1-82fa-4466-adae-662c1cf262a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:10.787245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a631be1-82fa-4466-adae-662c1cf262a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:10.787440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a631be1-82fa-4466-adae-662c1cf262a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:10.802431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a631be1-82fa-4466-adae-662c1cf262a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:10.815139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a631be1-82fa-4466-adae-662c1cf262a0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:10.866620 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3275/6515] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:10.871499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076df345-e295-4c70-af73-0f6ee0ba8872 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:10.886891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076df345-e295-4c70-af73-0f6ee0ba8872 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:10.931199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470d9dc-b817-4530-afbc-c7844ef693c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:10.932013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470d9dc-b817-4530-afbc-c7844ef693c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:10.935594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470d9dc-b817-4530-afbc-c7844ef693c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:10.937245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470d9dc-b817-4530-afbc-c7844ef693c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:10.939819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470d9dc-b817-4530-afbc-c7844ef693c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:10.943142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470d9dc-b817-4530-afbc-c7844ef693c1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:10.969604 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3241/6516] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:10.973439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a631be1-82fa-4466-adae-662c1cf262a0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:10.993997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a631be1-82fa-4466-adae-662c1cf262a0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:11.024586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459b294-961c-4aac-85ed-f4289cb5c44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:11.025599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459b294-961c-4aac-85ed-f4289cb5c44e admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:11.025900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459b294-961c-4aac-85ed-f4289cb5c44e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:11.026166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459b294-961c-4aac-85ed-f4289cb5c44e admin admin] PATH_INFO: `/v3/projects/e5151d953b0148e1b34280ab675692a7/users/0d734a3c2ef64c64b06aa43cf325b697/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:11.086264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459b294-961c-4aac-85ed-f4289cb5c44e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5151d953b0148e1b34280ab675692a7, user_id=0d734a3c2ef64c64b06aa43cf325b697, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:11.106071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459b294-961c-4aac-85ed-f4289cb5c44e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:11.179113 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3276/6517] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:10 2022] PUT /identity/v3/projects/e5151d953b0148e1b34280ab675692a7/users/0d734a3c2ef64c64b06aa43cf325b697/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:11.191771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862dc6-4022-41a7-98d0-570ebf8dc0de None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:11.192280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862dc6-4022-41a7-98d0-570ebf8dc0de None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:11.192541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862dc6-4022-41a7-98d0-570ebf8dc0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:11.310065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-34862dc6-4022-41a7-98d0-570ebf8dc0de None None] MFA Rules not processed for user `0d734a3c2ef64c64b06aa43cf325b697`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:11.316648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-34862dc6-4022-41a7-98d0-570ebf8dc0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:11.613367 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3242/6518] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:11.622855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459b294-961c-4aac-85ed-f4289cb5c44e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:11.625276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8459b294-961c-4aac-85ed-f4289cb5c44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:11.702266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:11.797765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459b294-961c-4aac-85ed-f4289cb5c44e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:11.803555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34feea-f1fc-4119-82d7-cb12fb7e33a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:11.804654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34feea-f1fc-4119-82d7-cb12fb7e33a0 service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:11.805130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34feea-f1fc-4119-82d7-cb12fb7e33a0 service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:11.805639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34feea-f1fc-4119-82d7-cb12fb7e33a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:11.819739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34feea-f1fc-4119-82d7-cb12fb7e33a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:11.822795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34feea-f1fc-4119-82d7-cb12fb7e33a0 service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:11.851838 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3277/6519] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:11 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:26:12.554724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34862dc6-4022-41a7-98d0-570ebf8dc0de None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:12.769750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34862dc6-4022-41a7-98d0-570ebf8dc0de None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:12.779575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183b307-933c-4597-93e7-355e578ccfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:12.780614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183b307-933c-4597-93e7-355e578ccfbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:12.780892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183b307-933c-4597-93e7-355e578ccfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:12.781167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183b307-933c-4597-93e7-355e578ccfbd admin admin] PATH_INFO: `/v3/users/0d734a3c2ef64c64b06aa43cf325b697` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:12.784081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183b307-933c-4597-93e7-355e578ccfbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d734a3c2ef64c64b06aa43cf325b697)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:12.787900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183b307-933c-4597-93e7-355e578ccfbd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:12.834686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:12.914794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0183b307-933c-4597-93e7-355e578ccfbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d734a3c2ef64c64b06aa43cf325b697'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:12.935589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0183b307-933c-4597-93e7-355e578ccfbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d734a3c2ef64c64b06aa43cf325b697'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:12.951661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0183b307-933c-4597-93e7-355e578ccfbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d734a3c2ef64c64b06aa43cf325b697'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:12.952445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0183b307-933c-4597-93e7-355e578ccfbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d734a3c2ef64c64b06aa43cf325b697'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:12.956250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0183b307-933c-4597-93e7-355e578ccfbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d734a3c2ef64c64b06aa43cf325b697'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:12.988652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08721bb8-4929-4f52-bfdd-8c6f7dbf9f7e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:12.989889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08721bb8-4929-4f52-bfdd-8c6f7dbf9f7e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:12.990332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08721bb8-4929-4f52-bfdd-8c6f7dbf9f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:13.003379 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3243/6520] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:26:12 2022] DELETE /identity/v3/users/0d734a3c2ef64c64b06aa43cf325b697 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:13.009340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856243d7-4086-4782-a441-916493b76a42 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:13.013003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856243d7-4086-4782-a441-916493b76a42 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:13.013446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856243d7-4086-4782-a441-916493b76a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:13.035239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-856243d7-4086-4782-a441-916493b76a42 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:13.037009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-856243d7-4086-4782-a441-916493b76a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:13.099009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-08721bb8-4929-4f52-bfdd-8c6f7dbf9f7e None None] MFA Rules not processed for user `c5cd190cf88a4a50bf5e06dbba6c97ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:13.102783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-08721bb8-4929-4f52-bfdd-8c6f7dbf9f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:13.199439 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3244/6521] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:26:13.211367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856243d7-4086-4782-a441-916493b76a42 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:13.212920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-856243d7-4086-4782-a441-916493b76a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:13.358477 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3278/6522] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:26:13.360184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08721bb8-4929-4f52-bfdd-8c6f7dbf9f7e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:13.364691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-08721bb8-4929-4f52-bfdd-8c6f7dbf9f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:13.380508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856243d7-4086-4782-a441-916493b76a42 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:13.393235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fa3a0-c1f8-465b-9033-a5727d753fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:13.393912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fa3a0-c1f8-465b-9033-a5727d753fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:13.394198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fa3a0-c1f8-465b-9033-a5727d753fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:13.394473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fa3a0-c1f8-465b-9033-a5727d753fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:13.419756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08721bb8-4929-4f52-bfdd-8c6f7dbf9f7e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:13.429849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fa3a0-c1f8-465b-9033-a5727d753fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:13.431494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fa3a0-c1f8-465b-9033-a5727d753fa5 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:13.445875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d928f1-439e-49b9-b1e9-65a48b35a50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:13.446690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d928f1-439e-49b9-b1e9-65a48b35a50d admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:13.447086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d928f1-439e-49b9-b1e9-65a48b35a50d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:13.447450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d928f1-439e-49b9-b1e9-65a48b35a50d admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:13.448302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d928f1-439e-49b9-b1e9-65a48b35a50d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:13.450605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d928f1-439e-49b9-b1e9-65a48b35a50d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:13.467231 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3245/6523] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:26:13.513059 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3279/6524] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:26:13 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:13.513654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fa3a0-c1f8-465b-9033-a5727d753fa5 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:13.530448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fa3a0-c1f8-465b-9033-a5727d753fa5 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:13.612832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:13.650387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0d60d-7df8-4da1-884e-b13cc20f3f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:13.652315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0d60d-7df8-4da1-884e-b13cc20f3f1e admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:13.652600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0d60d-7df8-4da1-884e-b13cc20f3f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:13.653962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0d60d-7df8-4da1-884e-b13cc20f3f1e admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:13.664150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0d60d-7df8-4da1-884e-b13cc20f3f1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:13.669373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0d60d-7df8-4da1-884e-b13cc20f3f1e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:13.741151 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3246/6525] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:26:13 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:26:13.745699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d928f1-439e-49b9-b1e9-65a48b35a50d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:13.764904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d928f1-439e-49b9-b1e9-65a48b35a50d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:13.780621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e6d74-fcc2-4a47-9d85-2176f0123610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:13.781501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e6d74-fcc2-4a47-9d85-2176f0123610 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:13.781894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e6d74-fcc2-4a47-9d85-2176f0123610 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:13.782293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e6d74-fcc2-4a47-9d85-2176f0123610 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:13.785392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e6d74-fcc2-4a47-9d85-2176f0123610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:13.797475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e6d74-fcc2-4a47-9d85-2176f0123610 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:13.831578 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3280/6526] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:13.838498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0d60d-7df8-4da1-884e-b13cc20f3f1e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:13.838878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a95a2-5fd1-4e63-a5ad-e4d01bb05a9f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:13.839231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a95a2-5fd1-4e63-a5ad-e4d01bb05a9f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:13.839707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a95a2-5fd1-4e63-a5ad-e4d01bb05a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:13.860268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0d60d-7df8-4da1-884e-b13cc20f3f1e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:13.876566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77190c-cdc6-40a8-be68-92f745dbdb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:13.881097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77190c-cdc6-40a8-be68-92f745dbdb64 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:13.881388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77190c-cdc6-40a8-be68-92f745dbdb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:13.882244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77190c-cdc6-40a8-be68-92f745dbdb64 admin admin] PATH_INFO: `/v3/projects/bd287eaf14654f86aaba0b98ebb2e612/users/03f48b1e51b24b97acc169f4672af157/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:13.905761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2a5a95a2-5fd1-4e63-a5ad-e4d01bb05a9f None None] MFA Rules not processed for user `a1ea0e5cdcdf486783a4b6416c04f20a`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:13.907177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2a5a95a2-5fd1-4e63-a5ad-e4d01bb05a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:13.929774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77190c-cdc6-40a8-be68-92f745dbdb64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd287eaf14654f86aaba0b98ebb2e612, user_id=03f48b1e51b24b97acc169f4672af157, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:13.940181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77190c-cdc6-40a8-be68-92f745dbdb64 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:13.980633 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3247/6527] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:13 2022] PUT /identity/v3/projects/bd287eaf14654f86aaba0b98ebb2e612/users/03f48b1e51b24b97acc169f4672af157/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:13.985966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77190c-cdc6-40a8-be68-92f745dbdb64 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:14.076641 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3281/6528] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:14.091256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a95a2-5fd1-4e63-a5ad-e4d01bb05a9f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:14.093265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2a5a95a2-5fd1-4e63-a5ad-e4d01bb05a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:14.116607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:14.188902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77190c-cdc6-40a8-be68-92f745dbdb64 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:14.210438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae002e8-534e-4e13-a60d-ae487d7a6d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:14.212678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae002e8-534e-4e13-a60d-ae487d7a6d5a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:14.213034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae002e8-534e-4e13-a60d-ae487d7a6d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:14.213227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae002e8-534e-4e13-a60d-ae487d7a6d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:14.213970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae002e8-534e-4e13-a60d-ae487d7a6d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:14.226622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae002e8-534e-4e13-a60d-ae487d7a6d5a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:14.276926 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3248/6529] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:14.280199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae002e8-534e-4e13-a60d-ae487d7a6d5a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:14.281573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a95a2-5fd1-4e63-a5ad-e4d01bb05a9f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:14.320804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae002e8-534e-4e13-a60d-ae487d7a6d5a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:14.353158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efaa56-3c7c-4331-afba-b9e9e9095197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:14.356130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efaa56-3c7c-4331-afba-b9e9e9095197 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:14.356600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efaa56-3c7c-4331-afba-b9e9e9095197 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:14.357812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efaa56-3c7c-4331-afba-b9e9e9095197 admin admin] PATH_INFO: `/v3/projects/bd287eaf14654f86aaba0b98ebb2e612/users/03f48b1e51b24b97acc169f4672af157/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:14.364613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efaa56-3c7c-4331-afba-b9e9e9095197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd287eaf14654f86aaba0b98ebb2e612, user_id=03f48b1e51b24b97acc169f4672af157, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:14.372814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43efaa56-3c7c-4331-afba-b9e9e9095197 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:14.410792 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3249/6530] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:14 2022] PUT /identity/v3/projects/bd287eaf14654f86aaba0b98ebb2e612/users/03f48b1e51b24b97acc169f4672af157/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:14.579961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de364924-bfae-4b96-bedd-6381a6969096 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:14.581736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de364924-bfae-4b96-bedd-6381a6969096 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:14.582779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de364924-bfae-4b96-bedd-6381a6969096 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:14.583914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de364924-bfae-4b96-bedd-6381a6969096 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:14.765675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efaa56-3c7c-4331-afba-b9e9e9095197 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:14.767748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-43efaa56-3c7c-4331-afba-b9e9e9095197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:14.905416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de364924-bfae-4b96-bedd-6381a6969096 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:14.909157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de364924-bfae-4b96-bedd-6381a6969096 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:14.951352 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3282/6531] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 860 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:26:15.137560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efaa56-3c7c-4331-afba-b9e9e9095197 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:15.172892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee673cf-b296-47d0-9df9-bfe2800fdc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:15.173927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee673cf-b296-47d0-9df9-bfe2800fdc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:15.174266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee673cf-b296-47d0-9df9-bfe2800fdc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:15.174545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee673cf-b296-47d0-9df9-bfe2800fdc18 admin admin] PATH_INFO: `/v3/projects/e5151d953b0148e1b34280ab675692a7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:15.176533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee673cf-b296-47d0-9df9-bfe2800fdc18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5151d953b0148e1b34280ab675692a7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:15.178981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee673cf-b296-47d0-9df9-bfe2800fdc18 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:15.313207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:15.424126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ee673cf-b296-47d0-9df9-bfe2800fdc18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5151d953b0148e1b34280ab675692a7', 'request_id': 'req-7ee673cf-b296-47d0-9df9-bfe2800fdc18'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:15.451655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ee673cf-b296-47d0-9df9-bfe2800fdc18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5151d953b0148e1b34280ab675692a7', 'request_id': 'req-7ee673cf-b296-47d0-9df9-bfe2800fdc18'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:15.465799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ee673cf-b296-47d0-9df9-bfe2800fdc18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5151d953b0148e1b34280ab675692a7', 'request_id': 'req-7ee673cf-b296-47d0-9df9-bfe2800fdc18'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:15.489205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ee673cf-b296-47d0-9df9-bfe2800fdc18 admin admin] The token cache is being invalidate because project e5151d953b0148e1b34280ab675692a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:26:15.489513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ee673cf-b296-47d0-9df9-bfe2800fdc18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:15.490452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7ee673cf-b296-47d0-9df9-bfe2800fdc18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:15.496191 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3250/6532] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:14 2022] DELETE /identity/v3/projects/e5151d953b0148e1b34280ab675692a7 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:15.497665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171b06e-45b3-4566-85f4-a3c0fbc57d1a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:15.498155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171b06e-45b3-4566-85f4-a3c0fbc57d1a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:15.498281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171b06e-45b3-4566-85f4-a3c0fbc57d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:15.563764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d171b06e-45b3-4566-85f4-a3c0fbc57d1a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:15.576290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d171b06e-45b3-4566-85f4-a3c0fbc57d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:15.656344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee673cf-b296-47d0-9df9-bfe2800fdc18 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:15.660899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7ee673cf-b296-47d0-9df9-bfe2800fdc18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:15.766073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:15.905535 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3283/6533] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:26:15.910941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654122e-d1a3-4a01-a953-c98547cc7d52 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:15.911225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654122e-d1a3-4a01-a953-c98547cc7d52 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:15.914060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654122e-d1a3-4a01-a953-c98547cc7d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:15.995863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee673cf-b296-47d0-9df9-bfe2800fdc18 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:15.997623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7654122e-d1a3-4a01-a953-c98547cc7d52 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:15.998653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7654122e-d1a3-4a01-a953-c98547cc7d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:16.041224 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3284/6534] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:16.045707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654122e-d1a3-4a01-a953-c98547cc7d52 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:16.048961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6cf50-a7fc-4080-9c0e-536e7accdbcb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:16.049661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6cf50-a7fc-4080-9c0e-536e7accdbcb service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:16.049945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6cf50-a7fc-4080-9c0e-536e7accdbcb service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:16.050224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6cf50-a7fc-4080-9c0e-536e7accdbcb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:16.060649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-94c6cf50-a7fc-4080-9c0e-536e7accdbcb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:16.074428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654122e-d1a3-4a01-a953-c98547cc7d52 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:16.107606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a53d0-e046-4823-9fd8-48ef56769854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:16.109301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a53d0-e046-4823-9fd8-48ef56769854 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:16.109806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a53d0-e046-4823-9fd8-48ef56769854 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:16.110427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a53d0-e046-4823-9fd8-48ef56769854 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:16.111449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a53d0-e046-4823-9fd8-48ef56769854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:26:16.111917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a53d0-e046-4823-9fd8-48ef56769854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:16.113813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a53d0-e046-4823-9fd8-48ef56769854 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:16.129443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6cf50-a7fc-4080-9c0e-536e7accdbcb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:16.138460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6cf50-a7fc-4080-9c0e-536e7accdbcb service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:16.140633 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3285/6535] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:26:16.148571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a53d0-e046-4823-9fd8-48ef56769854 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:16.162787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a53d0-e046-4823-9fd8-48ef56769854 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:16.179036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d13ae3-3cab-42ec-97ab-96d21a4f539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:16.183107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d13ae3-3cab-42ec-97ab-96d21a4f539a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:16.183227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d13ae3-3cab-42ec-97ab-96d21a4f539a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:16.183495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d13ae3-3cab-42ec-97ab-96d21a4f539a admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:16.184599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d13ae3-3cab-42ec-97ab-96d21a4f539a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:16.186973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d13ae3-3cab-42ec-97ab-96d21a4f539a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:16.200394 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3251/6536] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:26:16.247964 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3286/6537] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:26:16 2022] POST /identity/v3/projects => generated 359 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:16.251849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6cf50-a7fc-4080-9c0e-536e7accdbcb service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:16.270841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6cf50-a7fc-4080-9c0e-536e7accdbcb service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:16.430136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687db42c-f1fe-4a48-96cc-a9916dede7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:16.430828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687db42c-f1fe-4a48-96cc-a9916dede7cd admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:16.431112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687db42c-f1fe-4a48-96cc-a9916dede7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:16.431391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687db42c-f1fe-4a48-96cc-a9916dede7cd admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:16.437701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687db42c-f1fe-4a48-96cc-a9916dede7cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:16.444171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687db42c-f1fe-4a48-96cc-a9916dede7cd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:16.509606 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3252/6538] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:26:16 2022] POST /identity/v3/users => generated 280 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:16.513174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d13ae3-3cab-42ec-97ab-96d21a4f539a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:16.573049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d13ae3-3cab-42ec-97ab-96d21a4f539a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:16.578096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56603e-02b9-4da7-84d0-961e624f9bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:16.578651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56603e-02b9-4da7-84d0-961e624f9bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:16.579109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56603e-02b9-4da7-84d0-961e624f9bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:16.580228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56603e-02b9-4da7-84d0-961e624f9bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:16.580819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56603e-02b9-4da7-84d0-961e624f9bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:16.582612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56603e-02b9-4da7-84d0-961e624f9bb5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:16.594361 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3287/6539] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:16.600758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687db42c-f1fe-4a48-96cc-a9916dede7cd admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:16.649158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687db42c-f1fe-4a48-96cc-a9916dede7cd admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:16.677365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b961713-9af6-4834-a6a3-740e49c347af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:16.678122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b961713-9af6-4834-a6a3-740e49c347af admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:16.678412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b961713-9af6-4834-a6a3-740e49c347af admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:16.678692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b961713-9af6-4834-a6a3-740e49c347af admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:16.681832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b961713-9af6-4834-a6a3-740e49c347af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:16.683911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b961713-9af6-4834-a6a3-740e49c347af admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:16.733018 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3253/6540] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:16.737704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56603e-02b9-4da7-84d0-961e624f9bb5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:16.769869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56603e-02b9-4da7-84d0-961e624f9bb5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:16.822788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74025a8-c85d-4566-b234-fc7caa424a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:16.823711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74025a8-c85d-4566-b234-fc7caa424a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:16.823992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74025a8-c85d-4566-b234-fc7caa424a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:16.824301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74025a8-c85d-4566-b234-fc7caa424a80 admin admin] PATH_INFO: `/v3/projects/cd96690ee835478f8b16e1134542307f/users/d6656e2e27e2498e9c63f7c9158110cd/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:16.894215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b961713-9af6-4834-a6a3-740e49c347af admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:16.897628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7b961713-9af6-4834-a6a3-740e49c347af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:16.920927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:16.927344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74025a8-c85d-4566-b234-fc7caa424a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd96690ee835478f8b16e1134542307f, user_id=d6656e2e27e2498e9c63f7c9158110cd, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:16.931535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74025a8-c85d-4566-b234-fc7caa424a80 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:16.989057 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3288/6541] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:16 2022] PUT /identity/v3/projects/cd96690ee835478f8b16e1134542307f/users/d6656e2e27e2498e9c63f7c9158110cd/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:17.007606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768febb5-cb9d-45f0-a44e-66b4b5c1dcaf None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:17.016408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768febb5-cb9d-45f0-a44e-66b4b5c1dcaf None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:17.016792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768febb5-cb9d-45f0-a44e-66b4b5c1dcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:17.062143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b961713-9af6-4834-a6a3-740e49c347af admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:17.104723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-768febb5-cb9d-45f0-a44e-66b4b5c1dcaf None None] MFA Rules not processed for user `d6656e2e27e2498e9c63f7c9158110cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:17.108673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-768febb5-cb9d-45f0-a44e-66b4b5c1dcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:17.205193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d78831-51cf-4fcb-b24e-0c12b6e723d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:17.206585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d78831-51cf-4fcb-b24e-0c12b6e723d4 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:17.207212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d78831-51cf-4fcb-b24e-0c12b6e723d4 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:17.209481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d78831-51cf-4fcb-b24e-0c12b6e723d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:17.233170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b3d78831-51cf-4fcb-b24e-0c12b6e723d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:17.280430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d78831-51cf-4fcb-b24e-0c12b6e723d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:17.282223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d78831-51cf-4fcb-b24e-0c12b6e723d4 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:17.346578 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3254/6542] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:26:17.429586 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3289/6543] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:17 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:17.443421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d78831-51cf-4fcb-b24e-0c12b6e723d4 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:17.621630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d78831-51cf-4fcb-b24e-0c12b6e723d4 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:17.641739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606ffe2-ea0d-4150-af36-b43388183e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:17.643149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606ffe2-ea0d-4150-af36-b43388183e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:17.643541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606ffe2-ea0d-4150-af36-b43388183e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:17.643930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606ffe2-ea0d-4150-af36-b43388183e4c admin admin] PATH_INFO: `/v3/users/d6656e2e27e2498e9c63f7c9158110cd` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:17.646624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606ffe2-ea0d-4150-af36-b43388183e4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6656e2e27e2498e9c63f7c9158110cd)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:17.649143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606ffe2-ea0d-4150-af36-b43388183e4c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:17.818625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0606ffe2-ea0d-4150-af36-b43388183e4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6656e2e27e2498e9c63f7c9158110cd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:17.821677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:17.852021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0606ffe2-ea0d-4150-af36-b43388183e4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6656e2e27e2498e9c63f7c9158110cd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:17.879230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0606ffe2-ea0d-4150-af36-b43388183e4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6656e2e27e2498e9c63f7c9158110cd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:17.882865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0606ffe2-ea0d-4150-af36-b43388183e4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6656e2e27e2498e9c63f7c9158110cd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:17.886024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0606ffe2-ea0d-4150-af36-b43388183e4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6656e2e27e2498e9c63f7c9158110cd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:17.944629 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3255/6544] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:26:17 2022] DELETE /identity/v3/users/d6656e2e27e2498e9c63f7c9158110cd => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:17.948567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72956d-42f8-4257-b6c4-365652ed894a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:17.949102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72956d-42f8-4257-b6c4-365652ed894a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:17.949321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72956d-42f8-4257-b6c4-365652ed894a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:17.998234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-cb72956d-42f8-4257-b6c4-365652ed894a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:17.999872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cb72956d-42f8-4257-b6c4-365652ed894a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:18.215327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:18.255284 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3290/6545] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:18.278155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606ffe2-ea0d-4150-af36-b43388183e4c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:18.279849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0606ffe2-ea0d-4150-af36-b43388183e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:18.524757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606ffe2-ea0d-4150-af36-b43388183e4c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:18.546056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4048f2-ff37-427a-903a-d55c3b512526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:18.548767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4048f2-ff37-427a-903a-d55c3b512526 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:18.549207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4048f2-ff37-427a-903a-d55c3b512526 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:18.549487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4048f2-ff37-427a-903a-d55c3b512526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:18.575976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4048f2-ff37-427a-903a-d55c3b512526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:18.578131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4048f2-ff37-427a-903a-d55c3b512526 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:18.590921 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3256/6546] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:26:19.934839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72956d-42f8-4257-b6c4-365652ed894a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:19.937700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cb72956d-42f8-4257-b6c4-365652ed894a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:19.989141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72956d-42f8-4257-b6c4-365652ed894a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:20.024725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed8415-52aa-4aca-bf86-4111aad44c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:20.041185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed8415-52aa-4aca-bf86-4111aad44c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:20.041771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed8415-52aa-4aca-bf86-4111aad44c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:20.042218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed8415-52aa-4aca-bf86-4111aad44c7c admin admin] PATH_INFO: `/v3/projects/cd96690ee835478f8b16e1134542307f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:20.045348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed8415-52aa-4aca-bf86-4111aad44c7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd96690ee835478f8b16e1134542307f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:20.055540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed8415-52aa-4aca-bf86-4111aad44c7c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:20.248440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bfed8415-52aa-4aca-bf86-4111aad44c7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd96690ee835478f8b16e1134542307f', 'request_id': 'req-bfed8415-52aa-4aca-bf86-4111aad44c7c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:20.268939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bfed8415-52aa-4aca-bf86-4111aad44c7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd96690ee835478f8b16e1134542307f', 'request_id': 'req-bfed8415-52aa-4aca-bf86-4111aad44c7c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:20.276573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bfed8415-52aa-4aca-bf86-4111aad44c7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd96690ee835478f8b16e1134542307f', 'request_id': 'req-bfed8415-52aa-4aca-bf86-4111aad44c7c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:20.308475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bfed8415-52aa-4aca-bf86-4111aad44c7c admin admin] The token cache is being invalidate because project cd96690ee835478f8b16e1134542307f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:26:20.308922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bfed8415-52aa-4aca-bf86-4111aad44c7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:20.311033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bfed8415-52aa-4aca-bf86-4111aad44c7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:20.315533 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3291/6547] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:19 2022] DELETE /identity/v3/projects/cd96690ee835478f8b16e1134542307f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:20.320770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce97ef-7a29-49ba-ae25-1175dea9b294 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:20.321395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce97ef-7a29-49ba-ae25-1175dea9b294 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:20.321395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce97ef-7a29-49ba-ae25-1175dea9b294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:20.366444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-34ce97ef-7a29-49ba-ae25-1175dea9b294 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:20.368351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-34ce97ef-7a29-49ba-ae25-1175dea9b294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:20.526214 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3257/6548] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:20.535151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d9eb9-ed73-4e18-803c-6b7460c5e033 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:20.535446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d9eb9-ed73-4e18-803c-6b7460c5e033 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:20.535699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d9eb9-ed73-4e18-803c-6b7460c5e033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:20.570167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-914d9eb9-ed73-4e18-803c-6b7460c5e033 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:20.571518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-914d9eb9-ed73-4e18-803c-6b7460c5e033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:20.607599 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3292/6549] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:20.612270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce97ef-7a29-49ba-ae25-1175dea9b294 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:20.626330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce97ef-7a29-49ba-ae25-1175dea9b294 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:20.636724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8b7a2-880f-48c7-956d-3c5f7b95aac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:20.637478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8b7a2-880f-48c7-956d-3c5f7b95aac4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:20.638024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8b7a2-880f-48c7-956d-3c5f7b95aac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:20.638155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8b7a2-880f-48c7-956d-3c5f7b95aac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:20.638886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8b7a2-880f-48c7-956d-3c5f7b95aac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:26:20.639193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8b7a2-880f-48c7-956d-3c5f7b95aac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:20.641248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8b7a2-880f-48c7-956d-3c5f7b95aac4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:20.658912 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3258/6550] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:26:20.663254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d9eb9-ed73-4e18-803c-6b7460c5e033 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:20.675641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d9eb9-ed73-4e18-803c-6b7460c5e033 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:20.687660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db08fdd-f625-4c72-be4e-077ab6bbd615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:20.688746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db08fdd-f625-4c72-be4e-077ab6bbd615 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:20.689402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db08fdd-f625-4c72-be4e-077ab6bbd615 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:20.690339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db08fdd-f625-4c72-be4e-077ab6bbd615 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:20.691591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db08fdd-f625-4c72-be4e-077ab6bbd615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:20.694653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db08fdd-f625-4c72-be4e-077ab6bbd615 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:20.737857 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3293/6551] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:26:20 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:20.741796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8b7a2-880f-48c7-956d-3c5f7b95aac4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:20.752985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8b7a2-880f-48c7-956d-3c5f7b95aac4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:20.871388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:20.883254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8618d-03c8-4bce-86c2-e6f46a473360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:20.884920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8618d-03c8-4bce-86c2-e6f46a473360 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:20.884920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8618d-03c8-4bce-86c2-e6f46a473360 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:20.884920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8618d-03c8-4bce-86c2-e6f46a473360 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:20.886121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8618d-03c8-4bce-86c2-e6f46a473360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:20.888879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8618d-03c8-4bce-86c2-e6f46a473360 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:20.938646 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3259/6552] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:26:20 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:26:20.944408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db08fdd-f625-4c72-be4e-077ab6bbd615 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:20.982680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db08fdd-f625-4c72-be4e-077ab6bbd615 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:20.994494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123bd77-5f8e-4c9e-828f-facfae27dee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:20.995789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123bd77-5f8e-4c9e-828f-facfae27dee5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:20.996300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123bd77-5f8e-4c9e-828f-facfae27dee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:20.997832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123bd77-5f8e-4c9e-828f-facfae27dee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:21.000019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123bd77-5f8e-4c9e-828f-facfae27dee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:21.004368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123bd77-5f8e-4c9e-828f-facfae27dee5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:21.074692 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3294/6553] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:21.084955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8618d-03c8-4bce-86c2-e6f46a473360 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:21.102662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8618d-03c8-4bce-86c2-e6f46a473360 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:21.113838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233adcd-a0a8-4c16-915f-d77be454f43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:21.114940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233adcd-a0a8-4c16-915f-d77be454f43b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:21.115601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233adcd-a0a8-4c16-915f-d77be454f43b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:21.116183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233adcd-a0a8-4c16-915f-d77be454f43b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:21.117747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233adcd-a0a8-4c16-915f-d77be454f43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:21.119819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233adcd-a0a8-4c16-915f-d77be454f43b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:21.139456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123bd77-5f8e-4c9e-828f-facfae27dee5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:21.147662 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3260/6554] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:21.153518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123bd77-5f8e-4c9e-828f-facfae27dee5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:21.165084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3582e7e-3e50-428e-9f8d-fa86a9de0b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:21.166646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3582e7e-3e50-428e-9f8d-fa86a9de0b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:21.167209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3582e7e-3e50-428e-9f8d-fa86a9de0b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:21.167903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3582e7e-3e50-428e-9f8d-fa86a9de0b91 admin admin] PATH_INFO: `/v3/projects/b2033a3589794541b038777e22b2f6cd/users/ff24e5a21abe43ea8ad8a6f6f23b9b3f/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:21.209282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3582e7e-3e50-428e-9f8d-fa86a9de0b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2033a3589794541b038777e22b2f6cd, user_id=ff24e5a21abe43ea8ad8a6f6f23b9b3f, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:21.213488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3582e7e-3e50-428e-9f8d-fa86a9de0b91 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:21.247703 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3295/6555] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:21 2022] PUT /identity/v3/projects/b2033a3589794541b038777e22b2f6cd/users/ff24e5a21abe43ea8ad8a6f6f23b9b3f/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:21.256675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafda84-3fea-4656-8b59-a1bd081c62fd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:21.257062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafda84-3fea-4656-8b59-a1bd081c62fd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:21.257437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafda84-3fea-4656-8b59-a1bd081c62fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:21.318720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3cafda84-3fea-4656-8b59-a1bd081c62fd None None] MFA Rules not processed for user `ff24e5a21abe43ea8ad8a6f6f23b9b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:21.323642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3cafda84-3fea-4656-8b59-a1bd081c62fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:21.493380 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3261/6556] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:21.544497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3582e7e-3e50-428e-9f8d-fa86a9de0b91 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:21.546548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b3582e7e-3e50-428e-9f8d-fa86a9de0b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:21.706901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3582e7e-3e50-428e-9f8d-fa86a9de0b91 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:21.719851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9375d5-a461-4ff4-8702-bf80d0239d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:21.721783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9375d5-a461-4ff4-8702-bf80d0239d95 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:21.722069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9375d5-a461-4ff4-8702-bf80d0239d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:21.722467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9375d5-a461-4ff4-8702-bf80d0239d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:21.756918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9375d5-a461-4ff4-8702-bf80d0239d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:21.765860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9375d5-a461-4ff4-8702-bf80d0239d95 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:21.817517 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3296/6557] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:26:21.819919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9ecd0-c503-4cc5-a413-28e6a34e8eef None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:21.820412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9ecd0-c503-4cc5-a413-28e6a34e8eef None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:21.821044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9ecd0-c503-4cc5-a413-28e6a34e8eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:21.851821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2af9ecd0-c503-4cc5-a413-28e6a34e8eef None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:21.857545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2af9ecd0-c503-4cc5-a413-28e6a34e8eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:21.995463 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3262/6558] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:26:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:22.091722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9375d5-a461-4ff4-8702-bf80d0239d95 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:22.091722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1b9375d5-a461-4ff4-8702-bf80d0239d95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:22.110254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:22.293236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9375d5-a461-4ff4-8702-bf80d0239d95 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:22.312399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137428c-8158-440d-8608-8a16dda773ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:22.312399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137428c-8158-440d-8608-8a16dda773ef service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:22.312399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137428c-8158-440d-8608-8a16dda773ef service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:22.312399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137428c-8158-440d-8608-8a16dda773ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:22.335081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137428c-8158-440d-8608-8a16dda773ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:22.336784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137428c-8158-440d-8608-8a16dda773ef service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:22.372433 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3297/6559] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:26:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:26:24.154762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9ecd0-c503-4cc5-a413-28e6a34e8eef None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:24.295306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9ecd0-c503-4cc5-a413-28e6a34e8eef None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:24.302726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c2668-43c5-461c-9f06-f8ee2b4baaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:24.304446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c2668-43c5-461c-9f06-f8ee2b4baaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:24.304871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c2668-43c5-461c-9f06-f8ee2b4baaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:24.305473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c2668-43c5-461c-9f06-f8ee2b4baaaa admin admin] PATH_INFO: `/v3/users/ff24e5a21abe43ea8ad8a6f6f23b9b3f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:24.307890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c2668-43c5-461c-9f06-f8ee2b4baaaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff24e5a21abe43ea8ad8a6f6f23b9b3f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:24.310119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c2668-43c5-461c-9f06-f8ee2b4baaaa admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:24.333526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:24.411193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-db8c2668-43c5-461c-9f06-f8ee2b4baaaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff24e5a21abe43ea8ad8a6f6f23b9b3f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:24.423283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-db8c2668-43c5-461c-9f06-f8ee2b4baaaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff24e5a21abe43ea8ad8a6f6f23b9b3f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:24.438747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-db8c2668-43c5-461c-9f06-f8ee2b4baaaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff24e5a21abe43ea8ad8a6f6f23b9b3f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:24.440301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-db8c2668-43c5-461c-9f06-f8ee2b4baaaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff24e5a21abe43ea8ad8a6f6f23b9b3f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:24.441212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-db8c2668-43c5-461c-9f06-f8ee2b4baaaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff24e5a21abe43ea8ad8a6f6f23b9b3f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:24.498429 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3263/6560] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:26:24 2022] DELETE /identity/v3/users/ff24e5a21abe43ea8ad8a6f6f23b9b3f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:24.504594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d10915-69f3-44c1-80ac-6b03f27456b8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:24.505475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d10915-69f3-44c1-80ac-6b03f27456b8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:24.505915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d10915-69f3-44c1-80ac-6b03f27456b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:24.526939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-95d10915-69f3-44c1-80ac-6b03f27456b8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:24.528324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-95d10915-69f3-44c1-80ac-6b03f27456b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:24.626261 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3298/6561] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:24.638102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c2668-43c5-461c-9f06-f8ee2b4baaaa admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:24.639847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-db8c2668-43c5-461c-9f06-f8ee2b4baaaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:24.824479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c2668-43c5-461c-9f06-f8ee2b4baaaa admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:24.843371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a9f40-aaf9-4188-bf97-ece2af7573f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:24.844902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a9f40-aaf9-4188-bf97-ece2af7573f9 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:24.846910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a9f40-aaf9-4188-bf97-ece2af7573f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:24.848140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a9f40-aaf9-4188-bf97-ece2af7573f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:24.880646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a9f40-aaf9-4188-bf97-ece2af7573f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:24.883238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a9f40-aaf9-4188-bf97-ece2af7573f9 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:24.898437 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3264/6562] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:26:26.737849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d10915-69f3-44c1-80ac-6b03f27456b8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:26.739315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-95d10915-69f3-44c1-80ac-6b03f27456b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:26.761581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d10915-69f3-44c1-80ac-6b03f27456b8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:26.775046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1bede-d3fc-4261-9f41-c46a3811b80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:26.775968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1bede-d3fc-4261-9f41-c46a3811b80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:26.776302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1bede-d3fc-4261-9f41-c46a3811b80d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:26.776586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1bede-d3fc-4261-9f41-c46a3811b80d admin admin] PATH_INFO: `/v3/projects/b2033a3589794541b038777e22b2f6cd` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:26.778388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1bede-d3fc-4261-9f41-c46a3811b80d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2033a3589794541b038777e22b2f6cd)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:26.780473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1bede-d3fc-4261-9f41-c46a3811b80d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:26.901707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-36c1bede-d3fc-4261-9f41-c46a3811b80d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2033a3589794541b038777e22b2f6cd', 'request_id': 'req-36c1bede-d3fc-4261-9f41-c46a3811b80d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:26.915922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-36c1bede-d3fc-4261-9f41-c46a3811b80d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2033a3589794541b038777e22b2f6cd', 'request_id': 'req-36c1bede-d3fc-4261-9f41-c46a3811b80d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:26.931675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-36c1bede-d3fc-4261-9f41-c46a3811b80d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2033a3589794541b038777e22b2f6cd', 'request_id': 'req-36c1bede-d3fc-4261-9f41-c46a3811b80d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:26.932593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab176258-097b-40d8-abb0-f2a8ac76b9bd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:26.933047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab176258-097b-40d8-abb0-f2a8ac76b9bd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:26.933436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab176258-097b-40d8-abb0-f2a8ac76b9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:26.948939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-36c1bede-d3fc-4261-9f41-c46a3811b80d admin admin] The token cache is being invalidate because project b2033a3589794541b038777e22b2f6cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:26:26.949237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-36c1bede-d3fc-4261-9f41-c46a3811b80d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:26.949929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-36c1bede-d3fc-4261-9f41-c46a3811b80d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:26.955737 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3299/6563] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:26 2022] DELETE /identity/v3/projects/b2033a3589794541b038777e22b2f6cd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:26.957823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffaed8-615d-4d5c-b85f-44e256a2e0ae None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:26.958404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffaed8-615d-4d5c-b85f-44e256a2e0ae None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:26.958802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffaed8-615d-4d5c-b85f-44e256a2e0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:26.993136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-40ffaed8-615d-4d5c-b85f-44e256a2e0ae None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:26.994392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-40ffaed8-615d-4d5c-b85f-44e256a2e0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:27.004181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ab176258-097b-40d8-abb0-f2a8ac76b9bd None None] MFA Rules not processed for user `03f48b1e51b24b97acc169f4672af157`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:27.006412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ab176258-097b-40d8-abb0-f2a8ac76b9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:27.041389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:27.118644 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3300/6564] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:27.126598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e692b8a-0b3e-434c-85d4-bcdc38a69f3e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:27.126917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e692b8a-0b3e-434c-85d4-bcdc38a69f3e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:27.127429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e692b8a-0b3e-434c-85d4-bcdc38a69f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:27.147641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7e692b8a-0b3e-434c-85d4-bcdc38a69f3e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:27.149174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7e692b8a-0b3e-434c-85d4-bcdc38a69f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:27.166938 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3301/6565] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:26:27.168080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e692b8a-0b3e-434c-85d4-bcdc38a69f3e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:27.168418 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3265/6566] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:27.183103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab176258-097b-40d8-abb0-f2a8ac76b9bd None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:27.184651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ab176258-097b-40d8-abb0-f2a8ac76b9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:27.193372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e692b8a-0b3e-434c-85d4-bcdc38a69f3e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:27.198546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecb715-abaa-4458-9251-1a8b1405d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:27.199250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecb715-abaa-4458-9251-1a8b1405d317 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:27.199691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecb715-abaa-4458-9251-1a8b1405d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:27.199975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecb715-abaa-4458-9251-1a8b1405d317 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:27.200809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecb715-abaa-4458-9251-1a8b1405d317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:26:27.201134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecb715-abaa-4458-9251-1a8b1405d317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:27.203103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecb715-abaa-4458-9251-1a8b1405d317 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:27.223111 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3302/6567] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:26:27.224130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecb715-abaa-4458-9251-1a8b1405d317 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:27.233773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:27.236146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecb715-abaa-4458-9251-1a8b1405d317 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:27.241602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bd55f-967a-4c02-8eb6-d805b5cd6fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:27.242386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bd55f-967a-4c02-8eb6-d805b5cd6fce admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:27.242737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bd55f-967a-4c02-8eb6-d805b5cd6fce admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:27.243509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bd55f-967a-4c02-8eb6-d805b5cd6fce admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:27.244298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bd55f-967a-4c02-8eb6-d805b5cd6fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:27.246319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bd55f-967a-4c02-8eb6-d805b5cd6fce admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:27.295935 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3303/6568] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:26:27 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:27.296937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bd55f-967a-4c02-8eb6-d805b5cd6fce admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:27.401165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab176258-097b-40d8-abb0-f2a8ac76b9bd None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:27.484358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bd55f-967a-4c02-8eb6-d805b5cd6fce admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:27.504388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e442448-0278-495b-a358-7ab68ccbea85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:27.505098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e442448-0278-495b-a358-7ab68ccbea85 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:27.505379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e442448-0278-495b-a358-7ab68ccbea85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:27.505663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e442448-0278-495b-a358-7ab68ccbea85 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:27.506408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e442448-0278-495b-a358-7ab68ccbea85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:27.508370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e442448-0278-495b-a358-7ab68ccbea85 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:27.546776 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3304/6569] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:26:27 2022] POST /identity/v3/users => generated 287 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:27.551219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e442448-0278-495b-a358-7ab68ccbea85 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:27.573515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a97a0-08b2-4c7b-a8f1-c10df569ed99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:27.574201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a97a0-08b2-4c7b-a8f1-c10df569ed99 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:27.574491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a97a0-08b2-4c7b-a8f1-c10df569ed99 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:27.574754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a97a0-08b2-4c7b-a8f1-c10df569ed99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:27.577742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e442448-0278-495b-a358-7ab68ccbea85 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:27.589014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24defa-47c6-40ad-a8cd-7e6cc7887e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:27.589707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24defa-47c6-40ad-a8cd-7e6cc7887e65 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:27.589994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24defa-47c6-40ad-a8cd-7e6cc7887e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:27.590484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24defa-47c6-40ad-a8cd-7e6cc7887e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:27.591083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24defa-47c6-40ad-a8cd-7e6cc7887e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:27.592812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24defa-47c6-40ad-a8cd-7e6cc7887e65 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:27.614615 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3305/6570] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:27.615635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24defa-47c6-40ad-a8cd-7e6cc7887e65 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:27.638493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24defa-47c6-40ad-a8cd-7e6cc7887e65 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:27.657353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93364fa-23b9-4e53-a750-32136e11e88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:27.659236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93364fa-23b9-4e53-a750-32136e11e88b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:27.659686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93364fa-23b9-4e53-a750-32136e11e88b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:27.659971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93364fa-23b9-4e53-a750-32136e11e88b admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:27.665733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93364fa-23b9-4e53-a750-32136e11e88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:27.667577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93364fa-23b9-4e53-a750-32136e11e88b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:27.691927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a97a0-08b2-4c7b-a8f1-c10df569ed99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:27.693954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a97a0-08b2-4c7b-a8f1-c10df569ed99 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:27.728548 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3266/6571] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:26:27.743139 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3306/6572] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:27.747600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a97a0-08b2-4c7b-a8f1-c10df569ed99 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:27.764436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a97a0-08b2-4c7b-a8f1-c10df569ed99 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:27.781079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629338f7-1370-4063-8146-6aa404d53374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:27.785402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629338f7-1370-4063-8146-6aa404d53374 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:27.785883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629338f7-1370-4063-8146-6aa404d53374 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:27.787077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629338f7-1370-4063-8146-6aa404d53374 admin admin] PATH_INFO: `/v3/projects/6ff9b201a7404244a5ee0fc9912d11a3/users/9d5a44cc22364250a4eb17a765b91a1e/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:27.807059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e5a56-2836-47c9-bbb6-7610a7405853 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:27.807305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e5a56-2836-47c9-bbb6-7610a7405853 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:27.807674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e5a56-2836-47c9-bbb6-7610a7405853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:27.837574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ac7e5a56-2836-47c9-bbb6-7610a7405853 None None] MFA Rules not processed for user `c5cd190cf88a4a50bf5e06dbba6c97ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:27.841196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ac7e5a56-2836-47c9-bbb6-7610a7405853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:27.851597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629338f7-1370-4063-8146-6aa404d53374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff9b201a7404244a5ee0fc9912d11a3, user_id=9d5a44cc22364250a4eb17a765b91a1e, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:27.859727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629338f7-1370-4063-8146-6aa404d53374 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:27.906279 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3267/6573] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:27 2022] PUT /identity/v3/projects/6ff9b201a7404244a5ee0fc9912d11a3/users/9d5a44cc22364250a4eb17a765b91a1e/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:27.908402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e176f2-4739-460e-ac8b-c590a8bb5aa1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:27.909925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e176f2-4739-460e-ac8b-c590a8bb5aa1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:27.910329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e176f2-4739-460e-ac8b-c590a8bb5aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:27.972451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:27.999088 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3307/6574] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:26:28.003190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-66e176f2-4739-460e-ac8b-c590a8bb5aa1 None None] MFA Rules not processed for user `9d5a44cc22364250a4eb17a765b91a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:28.005273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-66e176f2-4739-460e-ac8b-c590a8bb5aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:28.019965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:28.144086 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3268/6575] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:28.150524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e5a56-2836-47c9-bbb6-7610a7405853 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:28.152446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ac7e5a56-2836-47c9-bbb6-7610a7405853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:28.195268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e176f2-4739-460e-ac8b-c590a8bb5aa1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:28.197168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-66e176f2-4739-460e-ac8b-c590a8bb5aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:28.280475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e5a56-2836-47c9-bbb6-7610a7405853 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:28.296647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e176f2-4739-460e-ac8b-c590a8bb5aa1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:28.316009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44162d28-39ef-4786-bf6d-894c40bae5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:28.316958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44162d28-39ef-4786-bf6d-894c40bae5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:28.317242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44162d28-39ef-4786-bf6d-894c40bae5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:28.317521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44162d28-39ef-4786-bf6d-894c40bae5c2 admin admin] PATH_INFO: `/v3/users/8be0d1bce21149af900fccfc92b64f29` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:28.321488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44162d28-39ef-4786-bf6d-894c40bae5c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8be0d1bce21149af900fccfc92b64f29)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:28.323493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44162d28-39ef-4786-bf6d-894c40bae5c2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:28.383564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993a8dd-326b-4202-885d-f465d010d92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:28.394164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993a8dd-326b-4202-885d-f465d010d92a service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:28.394469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993a8dd-326b-4202-885d-f465d010d92a service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:28.396298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993a8dd-326b-4202-885d-f465d010d92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:28.422536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993a8dd-326b-4202-885d-f465d010d92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:28.425250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993a8dd-326b-4202-885d-f465d010d92a service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:28.450371 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3308/6576] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:26:28.453524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-44162d28-39ef-4786-bf6d-894c40bae5c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8be0d1bce21149af900fccfc92b64f29'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:28.480292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-44162d28-39ef-4786-bf6d-894c40bae5c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8be0d1bce21149af900fccfc92b64f29'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:28.491908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-44162d28-39ef-4786-bf6d-894c40bae5c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8be0d1bce21149af900fccfc92b64f29'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:28.496452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-44162d28-39ef-4786-bf6d-894c40bae5c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8be0d1bce21149af900fccfc92b64f29'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:28.497896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-44162d28-39ef-4786-bf6d-894c40bae5c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8be0d1bce21149af900fccfc92b64f29'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:28.560776 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3269/6577] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:26:28 2022] DELETE /identity/v3/users/8be0d1bce21149af900fccfc92b64f29 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:28.565756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164023b8-1c78-40e5-9947-8f2f003c46df None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:28.566074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164023b8-1c78-40e5-9947-8f2f003c46df None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:28.566380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164023b8-1c78-40e5-9947-8f2f003c46df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:28.603171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-164023b8-1c78-40e5-9947-8f2f003c46df None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:28.605167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-164023b8-1c78-40e5-9947-8f2f003c46df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:28.790255 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3309/6578] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:28.804920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44162d28-39ef-4786-bf6d-894c40bae5c2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:28.806691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-44162d28-39ef-4786-bf6d-894c40bae5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:28.873980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:28.922496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44162d28-39ef-4786-bf6d-894c40bae5c2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:28.926667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2956d7-48d1-4c09-afa7-01ebbcf742f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:28.927891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2956d7-48d1-4c09-afa7-01ebbcf742f2 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:28.928300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2956d7-48d1-4c09-afa7-01ebbcf742f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:28.928524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2956d7-48d1-4c09-afa7-01ebbcf742f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:28.944447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2956d7-48d1-4c09-afa7-01ebbcf742f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:28.946335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2956d7-48d1-4c09-afa7-01ebbcf742f2 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:28.962136 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3270/6579] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:26:29.251543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164023b8-1c78-40e5-9947-8f2f003c46df None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:29.253384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-164023b8-1c78-40e5-9947-8f2f003c46df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:29.293240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164023b8-1c78-40e5-9947-8f2f003c46df None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:29.310105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fc599-5cbd-4a5f-a017-5ee37d587f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:29.311024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fc599-5cbd-4a5f-a017-5ee37d587f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:29.311307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fc599-5cbd-4a5f-a017-5ee37d587f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:29.311583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fc599-5cbd-4a5f-a017-5ee37d587f3d admin admin] PATH_INFO: `/v3/projects/af5057879953477fa6557bbd78b77763` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:29.313735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fc599-5cbd-4a5f-a017-5ee37d587f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=af5057879953477fa6557bbd78b77763)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:29.316002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fc599-5cbd-4a5f-a017-5ee37d587f3d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:29.419571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba8fc599-5cbd-4a5f-a017-5ee37d587f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af5057879953477fa6557bbd78b77763', 'request_id': 'req-ba8fc599-5cbd-4a5f-a017-5ee37d587f3d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:29.426568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:29.433865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba8fc599-5cbd-4a5f-a017-5ee37d587f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af5057879953477fa6557bbd78b77763', 'request_id': 'req-ba8fc599-5cbd-4a5f-a017-5ee37d587f3d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:29.445769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba8fc599-5cbd-4a5f-a017-5ee37d587f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af5057879953477fa6557bbd78b77763', 'request_id': 'req-ba8fc599-5cbd-4a5f-a017-5ee37d587f3d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:29.471145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba8fc599-5cbd-4a5f-a017-5ee37d587f3d admin admin] The token cache is being invalidate because project af5057879953477fa6557bbd78b77763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:26:29.471145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba8fc599-5cbd-4a5f-a017-5ee37d587f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:29.471992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba8fc599-5cbd-4a5f-a017-5ee37d587f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:29.478746 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3310/6580] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:29 2022] DELETE /identity/v3/projects/af5057879953477fa6557bbd78b77763 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:29.479800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc5b91-3183-4784-9236-52f656dbf6a1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:29.482031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc5b91-3183-4784-9236-52f656dbf6a1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:29.482031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc5b91-3183-4784-9236-52f656dbf6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:29.511385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-babc5b91-3183-4784-9236-52f656dbf6a1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:29.512673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-babc5b91-3183-4784-9236-52f656dbf6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:29.657657 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3271/6581] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:26:29.666007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cd5f9-ef0e-4e26-84c1-f9a1116d8242 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:29.668556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cd5f9-ef0e-4e26-84c1-f9a1116d8242 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:29.668862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cd5f9-ef0e-4e26-84c1-f9a1116d8242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:29.698245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4d6cd5f9-ef0e-4e26-84c1-f9a1116d8242 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:29.700525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4d6cd5f9-ef0e-4e26-84c1-f9a1116d8242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:29.715303 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3311/6582] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:29.716361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc5b91-3183-4784-9236-52f656dbf6a1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:29.756454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc5b91-3183-4784-9236-52f656dbf6a1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:29.781299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfcbc3-f4c2-4f83-8267-69885f4f4234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:29.785796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfcbc3-f4c2-4f83-8267-69885f4f4234 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:29.786168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfcbc3-f4c2-4f83-8267-69885f4f4234 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:29.786456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfcbc3-f4c2-4f83-8267-69885f4f4234 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:29.792765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfcbc3-f4c2-4f83-8267-69885f4f4234 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:26:29.793096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfcbc3-f4c2-4f83-8267-69885f4f4234 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:29.795765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfcbc3-f4c2-4f83-8267-69885f4f4234 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:29.815557 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3272/6583] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:26:29.820161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cd5f9-ef0e-4e26-84c1-f9a1116d8242 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:29.838272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cd5f9-ef0e-4e26-84c1-f9a1116d8242 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:29.865520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d56669-ba5c-40d6-aec5-9a6fb8f234e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:29.866247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d56669-ba5c-40d6-aec5-9a6fb8f234e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:29.866564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d56669-ba5c-40d6-aec5-9a6fb8f234e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:29.866848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d56669-ba5c-40d6-aec5-9a6fb8f234e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:29.867563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d56669-ba5c-40d6-aec5-9a6fb8f234e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:29.872327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d56669-ba5c-40d6-aec5-9a6fb8f234e3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:29.900478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfcbc3-f4c2-4f83-8267-69885f4f4234 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:29.902676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dbcfcbc3-f4c2-4f83-8267-69885f4f4234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:29.937510 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3312/6584] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:26:29 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:29.942267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d56669-ba5c-40d6-aec5-9a6fb8f234e3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:30.056890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfcbc3-f4c2-4f83-8267-69885f4f4234 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:30.085158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d56669-ba5c-40d6-aec5-9a6fb8f234e3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:30.091511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677bdbe-d4de-4e16-900b-c53efebcf29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:30.092884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677bdbe-d4de-4e16-900b-c53efebcf29a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:30.093366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677bdbe-d4de-4e16-900b-c53efebcf29a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:30.093819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677bdbe-d4de-4e16-900b-c53efebcf29a admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:30.094745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677bdbe-d4de-4e16-900b-c53efebcf29a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:30.097246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677bdbe-d4de-4e16-900b-c53efebcf29a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:30.164232 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3313/6585] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:26:29 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:30.165522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677bdbe-d4de-4e16-900b-c53efebcf29a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:30.197136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677bdbe-d4de-4e16-900b-c53efebcf29a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:30.204378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ebc46-c9ad-4794-a28e-f83d09a39c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:30.206148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ebc46-c9ad-4794-a28e-f83d09a39c9a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:30.207046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ebc46-c9ad-4794-a28e-f83d09a39c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:30.207507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ebc46-c9ad-4794-a28e-f83d09a39c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:30.208732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ebc46-c9ad-4794-a28e-f83d09a39c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:30.213094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ebc46-c9ad-4794-a28e-f83d09a39c9a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:30.235222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccce3f4-3652-4f6a-bdcd-77c2e36f5636 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:30.235892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccce3f4-3652-4f6a-bdcd-77c2e36f5636 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:30.236263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccce3f4-3652-4f6a-bdcd-77c2e36f5636 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:30.236542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccce3f4-3652-4f6a-bdcd-77c2e36f5636 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:30.238550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4ccce3f4-3652-4f6a-bdcd-77c2e36f5636 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:30.242970 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3314/6586] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:30.246306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ebc46-c9ad-4794-a28e-f83d09a39c9a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:30.247951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:30.254350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccce3f4-3652-4f6a-bdcd-77c2e36f5636 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:30.256597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccce3f4-3652-4f6a-bdcd-77c2e36f5636 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:30.273381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ebc46-c9ad-4794-a28e-f83d09a39c9a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:30.278797 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3273/6587] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:26:30.281832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa93ad-03ec-484b-85c7-71dbafcb7df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:30.282723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa93ad-03ec-484b-85c7-71dbafcb7df5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:30.284666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa93ad-03ec-484b-85c7-71dbafcb7df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:30.285112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa93ad-03ec-484b-85c7-71dbafcb7df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:30.288202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa93ad-03ec-484b-85c7-71dbafcb7df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:30.293445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa93ad-03ec-484b-85c7-71dbafcb7df5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:30.319905 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3315/6588] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:30.331497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccce3f4-3652-4f6a-bdcd-77c2e36f5636 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:30.347898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccce3f4-3652-4f6a-bdcd-77c2e36f5636 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:30.361215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506699fb-3bda-46f5-9b14-861c94b37598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:30.362755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506699fb-3bda-46f5-9b14-861c94b37598 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:30.363041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506699fb-3bda-46f5-9b14-861c94b37598 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:30.363322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506699fb-3bda-46f5-9b14-861c94b37598 admin admin] PATH_INFO: `/v3/projects/282d207988644c02869aec5ae667a2d3/users/dbf79689e3074d2589296c97b0b16924/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:30.401163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506699fb-3bda-46f5-9b14-861c94b37598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=282d207988644c02869aec5ae667a2d3, user_id=dbf79689e3074d2589296c97b0b16924, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:30.404242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506699fb-3bda-46f5-9b14-861c94b37598 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:30.435891 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3274/6589] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:30 2022] PUT /identity/v3/projects/282d207988644c02869aec5ae667a2d3/users/dbf79689e3074d2589296c97b0b16924/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:30.442163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ad55c-fa75-4c43-b06b-bd9916247a60 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:30.442544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ad55c-fa75-4c43-b06b-bd9916247a60 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:30.442829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ad55c-fa75-4c43-b06b-bd9916247a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:30.496817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2b8ad55c-fa75-4c43-b06b-bd9916247a60 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:30.498515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2b8ad55c-fa75-4c43-b06b-bd9916247a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:30.666852 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3316/6590] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:30.678409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506699fb-3bda-46f5-9b14-861c94b37598 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:30.680784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-506699fb-3bda-46f5-9b14-861c94b37598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:30.773236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506699fb-3bda-46f5-9b14-861c94b37598 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:30.778685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8b388-b020-4a9c-8682-c5a465724aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:30.779890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8b388-b020-4a9c-8682-c5a465724aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:30.780412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8b388-b020-4a9c-8682-c5a465724aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:30.780875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8b388-b020-4a9c-8682-c5a465724aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:30.796905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8b388-b020-4a9c-8682-c5a465724aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:30.799340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8b388-b020-4a9c-8682-c5a465724aa0 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:30.816277 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3275/6591] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:26:34.330384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ad55c-fa75-4c43-b06b-bd9916247a60 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:34.331882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2b8ad55c-fa75-4c43-b06b-bd9916247a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:34.358352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ad55c-fa75-4c43-b06b-bd9916247a60 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:34.365360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae1f0b-b1e0-4ba5-9fb1-52628119bdc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:34.366247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae1f0b-b1e0-4ba5-9fb1-52628119bdc1 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:34.366703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae1f0b-b1e0-4ba5-9fb1-52628119bdc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:34.367150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae1f0b-b1e0-4ba5-9fb1-52628119bdc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:34.372856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5dae1f0b-b1e0-4ba5-9fb1-52628119bdc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:34.400924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae1f0b-b1e0-4ba5-9fb1-52628119bdc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:34.402672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae1f0b-b1e0-4ba5-9fb1-52628119bdc1 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:34.428568 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3317/6592] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:26:35.124390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8b388-b020-4a9c-8682-c5a465724aa0 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:35.125802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5ea8b388-b020-4a9c-8682-c5a465724aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:35.169485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8b388-b020-4a9c-8682-c5a465724aa0 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:35.198375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190e7b8-deb1-42e9-bc03-951feaa80909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:35.199298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190e7b8-deb1-42e9-bc03-951feaa80909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:35.199579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190e7b8-deb1-42e9-bc03-951feaa80909 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:35.199851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190e7b8-deb1-42e9-bc03-951feaa80909 admin admin] PATH_INFO: `/v3/users/b38c7b1a0c2a47bd82d40efb9f2c42d6` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:35.212125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190e7b8-deb1-42e9-bc03-951feaa80909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38c7b1a0c2a47bd82d40efb9f2c42d6)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:35.218501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190e7b8-deb1-42e9-bc03-951feaa80909 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:35.352549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8190e7b8-deb1-42e9-bc03-951feaa80909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38c7b1a0c2a47bd82d40efb9f2c42d6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:35.372535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8190e7b8-deb1-42e9-bc03-951feaa80909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38c7b1a0c2a47bd82d40efb9f2c42d6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:35.386166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8190e7b8-deb1-42e9-bc03-951feaa80909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38c7b1a0c2a47bd82d40efb9f2c42d6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:35.387532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8190e7b8-deb1-42e9-bc03-951feaa80909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38c7b1a0c2a47bd82d40efb9f2c42d6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:35.388360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8190e7b8-deb1-42e9-bc03-951feaa80909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38c7b1a0c2a47bd82d40efb9f2c42d6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:35.438403 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3276/6593] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:26:35 2022] DELETE /identity/v3/users/b38c7b1a0c2a47bd82d40efb9f2c42d6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:35.982381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae1f0b-b1e0-4ba5-9fb1-52628119bdc1 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:36.008256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae1f0b-b1e0-4ba5-9fb1-52628119bdc1 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:36.017670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:36.139817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83577b59-acb7-447e-9856-72d4a33aadbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:36.141224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83577b59-acb7-447e-9856-72d4a33aadbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:36.142053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83577b59-acb7-447e-9856-72d4a33aadbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:36.142672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83577b59-acb7-447e-9856-72d4a33aadbb admin admin] PATH_INFO: `/v3/projects/a6fe1e9fbfcb4faa9e89b1b2ea4e1021` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:36.144271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83577b59-acb7-447e-9856-72d4a33aadbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6fe1e9fbfcb4faa9e89b1b2ea4e1021)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:36.146477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83577b59-acb7-447e-9856-72d4a33aadbb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:36.220562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-83577b59-acb7-447e-9856-72d4a33aadbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6fe1e9fbfcb4faa9e89b1b2ea4e1021', 'request_id': 'req-83577b59-acb7-447e-9856-72d4a33aadbb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:36.244001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-83577b59-acb7-447e-9856-72d4a33aadbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6fe1e9fbfcb4faa9e89b1b2ea4e1021', 'request_id': 'req-83577b59-acb7-447e-9856-72d4a33aadbb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:36.271532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-83577b59-acb7-447e-9856-72d4a33aadbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6fe1e9fbfcb4faa9e89b1b2ea4e1021', 'request_id': 'req-83577b59-acb7-447e-9856-72d4a33aadbb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:36.292912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-83577b59-acb7-447e-9856-72d4a33aadbb admin admin] The token cache is being invalidate because project a6fe1e9fbfcb4faa9e89b1b2ea4e1021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:26:36.293220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-83577b59-acb7-447e-9856-72d4a33aadbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:36.293956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-83577b59-acb7-447e-9856-72d4a33aadbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:36.296340 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3318/6594] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:35 2022] DELETE /identity/v3/projects/a6fe1e9fbfcb4faa9e89b1b2ea4e1021 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:36.300699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190e7b8-deb1-42e9-bc03-951feaa80909 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:36.302765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8190e7b8-deb1-42e9-bc03-951feaa80909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:36.321794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190e7b8-deb1-42e9-bc03-951feaa80909 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:36.380596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:36.401805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98b250-33f0-49a5-8cea-dc6027f12ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:36.403047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98b250-33f0-49a5-8cea-dc6027f12ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:36.403666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98b250-33f0-49a5-8cea-dc6027f12ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:36.404128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98b250-33f0-49a5-8cea-dc6027f12ba0 admin admin] PATH_INFO: `/v3/users/a1ea0e5cdcdf486783a4b6416c04f20a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:36.406888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98b250-33f0-49a5-8cea-dc6027f12ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ea0e5cdcdf486783a4b6416c04f20a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:36.410474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98b250-33f0-49a5-8cea-dc6027f12ba0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:36.480251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cd98b250-33f0-49a5-8cea-dc6027f12ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ea0e5cdcdf486783a4b6416c04f20a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:36.494118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cd98b250-33f0-49a5-8cea-dc6027f12ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ea0e5cdcdf486783a4b6416c04f20a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:36.504507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cd98b250-33f0-49a5-8cea-dc6027f12ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ea0e5cdcdf486783a4b6416c04f20a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:36.508913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cd98b250-33f0-49a5-8cea-dc6027f12ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ea0e5cdcdf486783a4b6416c04f20a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:36.509615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cd98b250-33f0-49a5-8cea-dc6027f12ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ea0e5cdcdf486783a4b6416c04f20a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:36.540280 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3277/6595] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:26:36 2022] DELETE /identity/v3/users/a1ea0e5cdcdf486783a4b6416c04f20a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:36.751625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83577b59-acb7-447e-9856-72d4a33aadbb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:36.753207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-83577b59-acb7-447e-9856-72d4a33aadbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:36.766986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83577b59-acb7-447e-9856-72d4a33aadbb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:36.876091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b1fe4-6884-4a01-8a00-7f3510916250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:36.877263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b1fe4-6884-4a01-8a00-7f3510916250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:36.877491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b1fe4-6884-4a01-8a00-7f3510916250 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:36.877865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b1fe4-6884-4a01-8a00-7f3510916250 admin admin] PATH_INFO: `/v3/projects/a7c292a96f974795958c54bec85ccc61` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:36.880519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b1fe4-6884-4a01-8a00-7f3510916250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7c292a96f974795958c54bec85ccc61)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:36.883775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b1fe4-6884-4a01-8a00-7f3510916250 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:37.051292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:37.075249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f43b1fe4-6884-4a01-8a00-7f3510916250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7c292a96f974795958c54bec85ccc61', 'request_id': 'req-f43b1fe4-6884-4a01-8a00-7f3510916250'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:37.093911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f43b1fe4-6884-4a01-8a00-7f3510916250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7c292a96f974795958c54bec85ccc61', 'request_id': 'req-f43b1fe4-6884-4a01-8a00-7f3510916250'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:37.099276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f43b1fe4-6884-4a01-8a00-7f3510916250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7c292a96f974795958c54bec85ccc61', 'request_id': 'req-f43b1fe4-6884-4a01-8a00-7f3510916250'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:37.120985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f43b1fe4-6884-4a01-8a00-7f3510916250 admin admin] The token cache is being invalidate because project a7c292a96f974795958c54bec85ccc61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:26:37.121420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f43b1fe4-6884-4a01-8a00-7f3510916250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:37.122154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f43b1fe4-6884-4a01-8a00-7f3510916250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:37.124083 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3319/6596] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:36 2022] DELETE /identity/v3/projects/a7c292a96f974795958c54bec85ccc61 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:41.261701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98b250-33f0-49a5-8cea-dc6027f12ba0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:41.263166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cd98b250-33f0-49a5-8cea-dc6027f12ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:41.293394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98b250-33f0-49a5-8cea-dc6027f12ba0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:41.400413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7525d-0f7b-4eef-89eb-70560db8471a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:41.401480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7525d-0f7b-4eef-89eb-70560db8471a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:41.401818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7525d-0f7b-4eef-89eb-70560db8471a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:41.402247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7525d-0f7b-4eef-89eb-70560db8471a admin admin] PATH_INFO: `/v3/users/e594a743b6424809abe3d22f930afd8b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:41.403938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7525d-0f7b-4eef-89eb-70560db8471a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e594a743b6424809abe3d22f930afd8b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:41.406142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7525d-0f7b-4eef-89eb-70560db8471a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:41.499756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e2c7525d-0f7b-4eef-89eb-70560db8471a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e594a743b6424809abe3d22f930afd8b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:41.522330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e2c7525d-0f7b-4eef-89eb-70560db8471a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e594a743b6424809abe3d22f930afd8b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:41.540962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e2c7525d-0f7b-4eef-89eb-70560db8471a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e594a743b6424809abe3d22f930afd8b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:41.544221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e2c7525d-0f7b-4eef-89eb-70560db8471a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e594a743b6424809abe3d22f930afd8b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:41.545305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e2c7525d-0f7b-4eef-89eb-70560db8471a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e594a743b6424809abe3d22f930afd8b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:41.548639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:41.604132 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3278/6597] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:26:41 2022] DELETE /identity/v3/users/e594a743b6424809abe3d22f930afd8b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:42.118499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b1fe4-6884-4a01-8a00-7f3510916250 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:42.121931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f43b1fe4-6884-4a01-8a00-7f3510916250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:42.139114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b1fe4-6884-4a01-8a00-7f3510916250 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:42.256202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc97e9-8e67-4a6a-af47-bb454e6c9595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:42.257110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc97e9-8e67-4a6a-af47-bb454e6c9595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:42.257400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc97e9-8e67-4a6a-af47-bb454e6c9595 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:42.257669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc97e9-8e67-4a6a-af47-bb454e6c9595 admin admin] PATH_INFO: `/v3/projects/481f91eba9c14f728a473c0b03f1709f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:42.259142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc97e9-8e67-4a6a-af47-bb454e6c9595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=481f91eba9c14f728a473c0b03f1709f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:42.261307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc97e9-8e67-4a6a-af47-bb454e6c9595 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:42.292398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8049e0e-effe-44a8-89a3-4ebcbb755445 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:42.292976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8049e0e-effe-44a8-89a3-4ebcbb755445 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:42.293105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8049e0e-effe-44a8-89a3-4ebcbb755445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:42.330847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c8049e0e-effe-44a8-89a3-4ebcbb755445 None None] MFA Rules not processed for user `dbf79689e3074d2589296c97b0b16924`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:42.332537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c8049e0e-effe-44a8-89a3-4ebcbb755445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:42.338878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-36dc97e9-8e67-4a6a-af47-bb454e6c9595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '481f91eba9c14f728a473c0b03f1709f', 'request_id': 'req-36dc97e9-8e67-4a6a-af47-bb454e6c9595'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:42.353286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-36dc97e9-8e67-4a6a-af47-bb454e6c9595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '481f91eba9c14f728a473c0b03f1709f', 'request_id': 'req-36dc97e9-8e67-4a6a-af47-bb454e6c9595'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:42.363820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-36dc97e9-8e67-4a6a-af47-bb454e6c9595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '481f91eba9c14f728a473c0b03f1709f', 'request_id': 'req-36dc97e9-8e67-4a6a-af47-bb454e6c9595'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:42.379947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-36dc97e9-8e67-4a6a-af47-bb454e6c9595 admin admin] The token cache is being invalidate because project 481f91eba9c14f728a473c0b03f1709f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:26:42.380250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-36dc97e9-8e67-4a6a-af47-bb454e6c9595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:42.381916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-36dc97e9-8e67-4a6a-af47-bb454e6c9595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:42.383678 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3320/6598] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:42 2022] DELETE /identity/v3/projects/481f91eba9c14f728a473c0b03f1709f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:42.392149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fafdfa-158a-4438-bc93-449670fcb212 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:42.392640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fafdfa-158a-4438-bc93-449670fcb212 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:42.392925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fafdfa-158a-4438-bc93-449670fcb212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:42.406464 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3279/6599] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:42.413057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-36fafdfa-158a-4438-bc93-449670fcb212 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:42.414662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-36fafdfa-158a-4438-bc93-449670fcb212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:42.422253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8049e0e-effe-44a8-89a3-4ebcbb755445 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:42.423891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c8049e0e-effe-44a8-89a3-4ebcbb755445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:42.472452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:42.483665 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3321/6600] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:42.492994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17ed34-e9e0-481e-a707-8517697538f1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:42.493282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17ed34-e9e0-481e-a707-8517697538f1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:42.493567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17ed34-e9e0-481e-a707-8517697538f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:42.513360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4f17ed34-e9e0-481e-a707-8517697538f1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:42.514623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4f17ed34-e9e0-481e-a707-8517697538f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:42.521872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8049e0e-effe-44a8-89a3-4ebcbb755445 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:42.530936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086fd69-fac8-4ab3-99e5-ba7068a02fc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:42.531894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086fd69-fac8-4ab3-99e5-ba7068a02fc0 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:42.532456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086fd69-fac8-4ab3-99e5-ba7068a02fc0 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:42.533076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086fd69-fac8-4ab3-99e5-ba7068a02fc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:42.539609 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3322/6601] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:42.541642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17ed34-e9e0-481e-a707-8517697538f1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:42.542397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086fd69-fac8-4ab3-99e5-ba7068a02fc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:42.544405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086fd69-fac8-4ab3-99e5-ba7068a02fc0 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:42.554800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17ed34-e9e0-481e-a707-8517697538f1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:42.562092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e67af-55cb-4508-a24b-0873cc48e7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:42.562724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e67af-55cb-4508-a24b-0873cc48e7dc admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:42.563392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e67af-55cb-4508-a24b-0873cc48e7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:42.563730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e67af-55cb-4508-a24b-0873cc48e7dc admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:42.564665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e67af-55cb-4508-a24b-0873cc48e7dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:26:42.564983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e67af-55cb-4508-a24b-0873cc48e7dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:42.567132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e67af-55cb-4508-a24b-0873cc48e7dc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:42.567702 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3280/6602] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:26:42.582955 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3323/6603] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:26:42.587688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086fd69-fac8-4ab3-99e5-ba7068a02fc0 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:42.605022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086fd69-fac8-4ab3-99e5-ba7068a02fc0 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:42.616671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7967bcf-790f-464d-ac7c-d2fa0e5c02f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:42.617346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7967bcf-790f-464d-ac7c-d2fa0e5c02f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:42.617621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7967bcf-790f-464d-ac7c-d2fa0e5c02f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:42.620929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7967bcf-790f-464d-ac7c-d2fa0e5c02f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:42.622040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7967bcf-790f-464d-ac7c-d2fa0e5c02f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:42.623858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7967bcf-790f-464d-ac7c-d2fa0e5c02f7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:42.684453 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3281/6604] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:26:42 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:26:42.688728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e67af-55cb-4508-a24b-0873cc48e7dc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:42.706253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e67af-55cb-4508-a24b-0873cc48e7dc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:42.799864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ab06f-f2db-4252-a2d2-6033ee3d336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:42.800808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ab06f-f2db-4252-a2d2-6033ee3d336e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:42.801093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ab06f-f2db-4252-a2d2-6033ee3d336e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:42.801373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ab06f-f2db-4252-a2d2-6033ee3d336e admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:42.802077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ab06f-f2db-4252-a2d2-6033ee3d336e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:42.804447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ab06f-f2db-4252-a2d2-6033ee3d336e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:42.831425 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3324/6605] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:26:42 2022] POST /identity/v3/users => generated 284 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:42.836780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7967bcf-790f-464d-ac7c-d2fa0e5c02f7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:42.866283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7967bcf-790f-464d-ac7c-d2fa0e5c02f7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:42.872950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dcb64-ad34-4097-9d37-2b0b41e68d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:42.874384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dcb64-ad34-4097-9d37-2b0b41e68d66 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:42.875681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dcb64-ad34-4097-9d37-2b0b41e68d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:42.877477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dcb64-ad34-4097-9d37-2b0b41e68d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:42.878523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dcb64-ad34-4097-9d37-2b0b41e68d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:42.881997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dcb64-ad34-4097-9d37-2b0b41e68d66 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:42.899205 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3282/6606] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:42.899992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ab06f-f2db-4252-a2d2-6033ee3d336e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:42.911326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ab06f-f2db-4252-a2d2-6033ee3d336e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:42.918916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4b4de-aa42-4cfd-a4e8-9d003b307acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:42.919581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4b4de-aa42-4cfd-a4e8-9d003b307acc admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:42.920263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4b4de-aa42-4cfd-a4e8-9d003b307acc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:42.920465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4b4de-aa42-4cfd-a4e8-9d003b307acc admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:42.921727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4b4de-aa42-4cfd-a4e8-9d003b307acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:42.925771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4b4de-aa42-4cfd-a4e8-9d003b307acc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:42.945967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dcb64-ad34-4097-9d37-2b0b41e68d66 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:42.946313 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3325/6607] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:26:42.960560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dcb64-ad34-4097-9d37-2b0b41e68d66 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:42.974815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75c4a5-6f20-45a9-990e-eeac8af451ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:42.975779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75c4a5-6f20-45a9-990e-eeac8af451ed admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:42.976193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75c4a5-6f20-45a9-990e-eeac8af451ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:42.976533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75c4a5-6f20-45a9-990e-eeac8af451ed admin admin] PATH_INFO: `/v3/projects/50c00272b49a474ba9953e28e7704d44/users/6da4d0663add4988a39a70b9876a49f9/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:42.994646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75c4a5-6f20-45a9-990e-eeac8af451ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c00272b49a474ba9953e28e7704d44, user_id=6da4d0663add4988a39a70b9876a49f9, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:43.001338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75c4a5-6f20-45a9-990e-eeac8af451ed admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:43.015523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:43.028955 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3283/6608] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:42 2022] PUT /identity/v3/projects/50c00272b49a474ba9953e28e7704d44/users/6da4d0663add4988a39a70b9876a49f9/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:26:43.032595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0f7c9-b862-498e-a282-e8f3130a7acf None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:43.033215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0f7c9-b862-498e-a282-e8f3130a7acf None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:43.033854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0f7c9-b862-498e-a282-e8f3130a7acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:43.100934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-efa0f7c9-b862-498e-a282-e8f3130a7acf None None] MFA Rules not processed for user `6da4d0663add4988a39a70b9876a49f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:43.102404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-efa0f7c9-b862-498e-a282-e8f3130a7acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:43.192907 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3326/6609] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:43.197817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75c4a5-6f20-45a9-990e-eeac8af451ed admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:43.301127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75c4a5-6f20-45a9-990e-eeac8af451ed admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:43.315817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6c072-4113-4fbf-9607-7eedab3f88b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:43.316801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6c072-4113-4fbf-9607-7eedab3f88b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:43.317350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6c072-4113-4fbf-9607-7eedab3f88b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:43.318864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6c072-4113-4fbf-9607-7eedab3f88b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:43.319809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6c072-4113-4fbf-9607-7eedab3f88b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:43.325388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6c072-4113-4fbf-9607-7eedab3f88b4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:43.414937 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3284/6610] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:26:43 2022] POST /identity/v3/projects => generated 367 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:43.420282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0f7c9-b862-498e-a282-e8f3130a7acf None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:43.440078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0f7c9-b862-498e-a282-e8f3130a7acf None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:43.552681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:43.578238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45955780-bfca-4883-a488-c9ef799d4c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:43.579357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45955780-bfca-4883-a488-c9ef799d4c5c admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:43.579836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45955780-bfca-4883-a488-c9ef799d4c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:43.580326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45955780-bfca-4883-a488-c9ef799d4c5c admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:43.584964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45955780-bfca-4883-a488-c9ef799d4c5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:43.592925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45955780-bfca-4883-a488-c9ef799d4c5c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:43.640511 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3327/6611] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:26:43 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:43.645459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6c072-4113-4fbf-9607-7eedab3f88b4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:43.676318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6c072-4113-4fbf-9607-7eedab3f88b4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:43.693287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c700862-a6b3-4b15-aad2-f39ae959e9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:43.693980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c700862-a6b3-4b15-aad2-f39ae959e9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:43.694264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c700862-a6b3-4b15-aad2-f39ae959e9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:43.694541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c700862-a6b3-4b15-aad2-f39ae959e9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:43.695272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c700862-a6b3-4b15-aad2-f39ae959e9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:43.696918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c700862-a6b3-4b15-aad2-f39ae959e9f1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:43.720741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45955780-bfca-4883-a488-c9ef799d4c5c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:43.722641 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3285/6612] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:43.735333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45955780-bfca-4883-a488-c9ef799d4c5c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:43.756485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d8b44-3a00-4d53-9f2b-04c807c38a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:43.757408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d8b44-3a00-4d53-9f2b-04c807c38a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:43.757702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d8b44-3a00-4d53-9f2b-04c807c38a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:43.757968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d8b44-3a00-4d53-9f2b-04c807c38a2b admin admin] PATH_INFO: `/v3/projects/abdbd8ce92574269af79c0f50c2a16a7/users/aa5fcd5b02e6457385c99d1bc14fb445/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:43.796672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d8b44-3a00-4d53-9f2b-04c807c38a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=abdbd8ce92574269af79c0f50c2a16a7, user_id=aa5fcd5b02e6457385c99d1bc14fb445, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:43.799805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d8b44-3a00-4d53-9f2b-04c807c38a2b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:43.823409 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3328/6613] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:43 2022] PUT /identity/v3/projects/abdbd8ce92574269af79c0f50c2a16a7/users/aa5fcd5b02e6457385c99d1bc14fb445/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:43.828865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c700862-a6b3-4b15-aad2-f39ae959e9f1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:43.854138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c700862-a6b3-4b15-aad2-f39ae959e9f1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:43.931290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9afee-ef71-4c41-b385-55ee9856875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:43.932185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9afee-ef71-4c41-b385-55ee9856875e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:43.932541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9afee-ef71-4c41-b385-55ee9856875e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:43.932890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9afee-ef71-4c41-b385-55ee9856875e admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:43.933689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9afee-ef71-4c41-b385-55ee9856875e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:43.935371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9afee-ef71-4c41-b385-55ee9856875e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:43.949251 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3286/6614] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:43.950550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d8b44-3a00-4d53-9f2b-04c807c38a2b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:43.967380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d8b44-3a00-4d53-9f2b-04c807c38a2b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:43.988900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd646f7-2ad5-499e-aef8-61c89798262a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:43.989628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd646f7-2ad5-499e-aef8-61c89798262a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:43.990112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd646f7-2ad5-499e-aef8-61c89798262a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:43.995952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ab88f-9702-4413-b589-0a5e8cea047d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:43.996904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ab88f-9702-4413-b589-0a5e8cea047d admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:43.997181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ab88f-9702-4413-b589-0a5e8cea047d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:43.997577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ab88f-9702-4413-b589-0a5e8cea047d admin admin] PATH_INFO: `/v3/projects/abdbd8ce92574269af79c0f50c2a16a7/users/aa5fcd5b02e6457385c99d1bc14fb445/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:44.000864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ab88f-9702-4413-b589-0a5e8cea047d admin admin] RBAC: Authorizing `identity:create_grant(project_id=abdbd8ce92574269af79c0f50c2a16a7, user_id=aa5fcd5b02e6457385c99d1bc14fb445, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:44.003678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ab88f-9702-4413-b589-0a5e8cea047d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:44.014871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-dcd646f7-2ad5-499e-aef8-61c89798262a None None] MFA Rules not processed for user `c5cd190cf88a4a50bf5e06dbba6c97ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:44.017035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dcd646f7-2ad5-499e-aef8-61c89798262a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:44.035861 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3329/6615] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:43 2022] PUT /identity/v3/projects/abdbd8ce92574269af79c0f50c2a16a7/users/aa5fcd5b02e6457385c99d1bc14fb445/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:44.046035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa404c1-a0d9-4e65-9e3f-d30c3d209f92 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:44.046319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa404c1-a0d9-4e65-9e3f-d30c3d209f92 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:44.046598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa404c1-a0d9-4e65-9e3f-d30c3d209f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:44.102269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-daa404c1-a0d9-4e65-9e3f-d30c3d209f92 None None] MFA Rules not processed for user `aa5fcd5b02e6457385c99d1bc14fb445`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:44.103491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-daa404c1-a0d9-4e65-9e3f-d30c3d209f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:44.112095 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3287/6616] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:44.239378 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3330/6617] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:44 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:26:44.241402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd646f7-2ad5-499e-aef8-61c89798262a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:44.270032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:44.353328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd646f7-2ad5-499e-aef8-61c89798262a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:44.359666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886edba0-da89-40c4-94b7-97fb4610e7f4 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5fcd5b02e6457385c99d1bc14fb445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abdbd8ce92574269af79c0f50c2a16a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:44.360393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886edba0-da89-40c4-94b7-97fb4610e7f4 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:44.360676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886edba0-da89-40c4-94b7-97fb4610e7f4 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:44.361115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886edba0-da89-40c4-94b7-97fb4610e7f4 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] PATH_INFO: `/v3/policies` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:44.362214 ncdv-master-1 devstack@keystone.service[91077]: WARNING oslo_log.versionutils [None req-886edba0-da89-40c4-94b7-97fb4610e7f4 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 02 21:26:44.363738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886edba0-da89-40c4-94b7-97fb4610e7f4 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:44.365207 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-886edba0-da89-40c4-94b7-97fb4610e7f4 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:44.365207 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:26:44.365207 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:26:44.366301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886edba0-da89-40c4-94b7-97fb4610e7f4 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:44.403810 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3288/6618] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:26:44 2022] POST /identity/v3/policies => generated 228 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:44.408225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa404c1-a0d9-4e65-9e3f-d30c3d209f92 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:44.423895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa404c1-a0d9-4e65-9e3f-d30c3d209f92 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:44.438840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4f963-10ca-41bf-9049-1fffd8d8f249 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5fcd5b02e6457385c99d1bc14fb445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abdbd8ce92574269af79c0f50c2a16a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:44.440844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4f963-10ca-41bf-9049-1fffd8d8f249 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:44.441130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4f963-10ca-41bf-9049-1fffd8d8f249 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:44.441558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4f963-10ca-41bf-9049-1fffd8d8f249 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] PATH_INFO: `/v3/policies/871bfad6614747ec85b2c1763305cbee` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:44.442709 ncdv-master-1 devstack@keystone.service[91078]: WARNING oslo_log.versionutils [None req-b7b4f963-10ca-41bf-9049-1fffd8d8f249 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 02 21:26:44.443213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4f963-10ca-41bf-9049-1fffd8d8f249 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=871bfad6614747ec85b2c1763305cbee)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:44.444504 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-b7b4f963-10ca-41bf-9049-1fffd8d8f249 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:44.444504 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:26:44.444504 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:26:44.445400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4f963-10ca-41bf-9049-1fffd8d8f249 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:44.496234 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3331/6619] 10.222.0.43 () {60 vars in 1251 bytes} [Sat Jul 2 21:26:44 2022] PATCH /identity/v3/policies/871bfad6614747ec85b2c1763305cbee => generated 236 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:26:44.497973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886edba0-da89-40c4-94b7-97fb4610e7f4 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:44.516837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886edba0-da89-40c4-94b7-97fb4610e7f4 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:44.533237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b1ad4-521f-4359-be31-36ae662e09f2 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5fcd5b02e6457385c99d1bc14fb445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abdbd8ce92574269af79c0f50c2a16a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:44.534143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b1ad4-521f-4359-be31-36ae662e09f2 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:44.534428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b1ad4-521f-4359-be31-36ae662e09f2 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:44.534709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b1ad4-521f-4359-be31-36ae662e09f2 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] PATH_INFO: `/v3/policies/871bfad6614747ec85b2c1763305cbee` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:44.535717 ncdv-master-1 devstack@keystone.service[91077]: WARNING oslo_log.versionutils [None req-3a8b1ad4-521f-4359-be31-36ae662e09f2 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 02 21:26:44.536371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b1ad4-521f-4359-be31-36ae662e09f2 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=871bfad6614747ec85b2c1763305cbee)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:44.537635 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-3a8b1ad4-521f-4359-be31-36ae662e09f2 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:44.537635 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:26:44.537635 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:26:44.538529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b1ad4-521f-4359-be31-36ae662e09f2 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:44.564653 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3289/6620] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:26:44 2022] GET /identity/v3/policies/871bfad6614747ec85b2c1763305cbee => generated 236 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:26:44.565454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4f963-10ca-41bf-9049-1fffd8d8f249 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:44.583302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4f963-10ca-41bf-9049-1fffd8d8f249 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:44.589123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bbbc4-3248-400a-b7eb-d34f4c26dcf6 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5fcd5b02e6457385c99d1bc14fb445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abdbd8ce92574269af79c0f50c2a16a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:44.590922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bbbc4-3248-400a-b7eb-d34f4c26dcf6 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:44.591184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bbbc4-3248-400a-b7eb-d34f4c26dcf6 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:44.591465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bbbc4-3248-400a-b7eb-d34f4c26dcf6 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] PATH_INFO: `/v3/policies/871bfad6614747ec85b2c1763305cbee` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:44.592600 ncdv-master-1 devstack@keystone.service[91078]: WARNING oslo_log.versionutils [None req-594bbbc4-3248-400a-b7eb-d34f4c26dcf6 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 02 21:26:44.593322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bbbc4-3248-400a-b7eb-d34f4c26dcf6 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=871bfad6614747ec85b2c1763305cbee)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:44.594803 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-594bbbc4-3248-400a-b7eb-d34f4c26dcf6 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:44.594803 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:26:44.594803 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:26:44.595792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bbbc4-3248-400a-b7eb-d34f4c26dcf6 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:44.627189 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3332/6621] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:44 2022] DELETE /identity/v3/policies/871bfad6614747ec85b2c1763305cbee => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:44.631828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b1ad4-521f-4359-be31-36ae662e09f2 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:44.648806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b1ad4-521f-4359-be31-36ae662e09f2 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:44.682287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22c8e6-ab2e-47da-91bf-b926812c37dc tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5fcd5b02e6457385c99d1bc14fb445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abdbd8ce92574269af79c0f50c2a16a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:44.683968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22c8e6-ab2e-47da-91bf-b926812c37dc tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:44.684497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22c8e6-ab2e-47da-91bf-b926812c37dc tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:44.685304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22c8e6-ab2e-47da-91bf-b926812c37dc tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] PATH_INFO: `/v3/policies` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:44.688881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22c8e6-ab2e-47da-91bf-b926812c37dc tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:44.694892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22c8e6-ab2e-47da-91bf-b926812c37dc tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:44.742214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bbbc4-3248-400a-b7eb-d34f4c26dcf6 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:44.755121 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3290/6622] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:26:44 2022] POST /identity/v3/policies => generated 229 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:44.757562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bbbc4-3248-400a-b7eb-d34f4c26dcf6 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:44.772663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa69261-9e4c-41e1-a00b-c9cc9ccfc3ea tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5fcd5b02e6457385c99d1bc14fb445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abdbd8ce92574269af79c0f50c2a16a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:44.774245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa69261-9e4c-41e1-a00b-c9cc9ccfc3ea tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:44.775050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa69261-9e4c-41e1-a00b-c9cc9ccfc3ea tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:44.776965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa69261-9e4c-41e1-a00b-c9cc9ccfc3ea tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] PATH_INFO: `/v3/policies` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:44.778158 ncdv-master-1 devstack@keystone.service[91078]: WARNING oslo_log.versionutils [None req-0fa69261-9e4c-41e1-a00b-c9cc9ccfc3ea tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 02 21:26:44.779378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa69261-9e4c-41e1-a00b-c9cc9ccfc3ea tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:44.782038 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-0fa69261-9e4c-41e1-a00b-c9cc9ccfc3ea tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:44.782038 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:26:44.782038 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:26:44.785592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa69261-9e4c-41e1-a00b-c9cc9ccfc3ea tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:44.833727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22c8e6-ab2e-47da-91bf-b926812c37dc tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:44.843868 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3333/6623] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:26:44 2022] POST /identity/v3/policies => generated 229 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:26:44.852278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22c8e6-ab2e-47da-91bf-b926812c37dc tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:44.864405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e793b-81d5-4ace-b943-c8883ccb104c tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5fcd5b02e6457385c99d1bc14fb445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abdbd8ce92574269af79c0f50c2a16a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:44.866341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e793b-81d5-4ace-b943-c8883ccb104c tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:44.866650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e793b-81d5-4ace-b943-c8883ccb104c tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:44.866937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e793b-81d5-4ace-b943-c8883ccb104c tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] PATH_INFO: `/v3/policies` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:44.868526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e793b-81d5-4ace-b943-c8883ccb104c tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:44.871940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e793b-81d5-4ace-b943-c8883ccb104c tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:44.911245 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3291/6624] 10.222.0.43 () {60 vars in 1151 bytes} [Sat Jul 2 21:26:44 2022] POST /identity/v3/policies => generated 229 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:26:44.915889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa69261-9e4c-41e1-a00b-c9cc9ccfc3ea tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:44.932652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa69261-9e4c-41e1-a00b-c9cc9ccfc3ea tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:44.944980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ce678-aa06-4235-b080-e41be58543dc tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5fcd5b02e6457385c99d1bc14fb445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abdbd8ce92574269af79c0f50c2a16a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:44.945674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ce678-aa06-4235-b080-e41be58543dc tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:44.945962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ce678-aa06-4235-b080-e41be58543dc tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:44.946244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ce678-aa06-4235-b080-e41be58543dc tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] PATH_INFO: `/v3/policies` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:44.947073 ncdv-master-1 devstack@keystone.service[91078]: WARNING oslo_log.versionutils [None req-f36ce678-aa06-4235-b080-e41be58543dc tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 02 21:26:44.948506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ce678-aa06-4235-b080-e41be58543dc tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:44.949796 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-f36ce678-aa06-4235-b080-e41be58543dc tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:44.949796 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:26:44.949796 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:26:44.952584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ce678-aa06-4235-b080-e41be58543dc tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:44.997821 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3334/6625] 10.222.0.43 () {58 vars in 1130 bytes} [Sat Jul 2 21:26:44 2022] GET /identity/v3/policies => generated 763 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:26:45.000738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e793b-81d5-4ace-b943-c8883ccb104c tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:45.030842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e793b-81d5-4ace-b943-c8883ccb104c tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:45.044730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ca43a-93a6-4032-ac48-4bcf4315e174 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5fcd5b02e6457385c99d1bc14fb445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abdbd8ce92574269af79c0f50c2a16a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:45.045771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ca43a-93a6-4032-ac48-4bcf4315e174 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:45.046059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ca43a-93a6-4032-ac48-4bcf4315e174 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:45.046334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ca43a-93a6-4032-ac48-4bcf4315e174 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] PATH_INFO: `/v3/policies/a358bdfae4dd4906a5d10fd969fd03b0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:45.048254 ncdv-master-1 devstack@keystone.service[91077]: WARNING oslo_log.versionutils [None req-859ca43a-93a6-4032-ac48-4bcf4315e174 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 02 21:26:45.049317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ca43a-93a6-4032-ac48-4bcf4315e174 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=a358bdfae4dd4906a5d10fd969fd03b0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:45.050924 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-859ca43a-93a6-4032-ac48-4bcf4315e174 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:45.050924 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:26:45.050924 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:26:45.053031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ca43a-93a6-4032-ac48-4bcf4315e174 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:45.074920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b43ea-ffa9-4283-b45e-d89380e9c538 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:45.075222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b43ea-ffa9-4283-b45e-d89380e9c538 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:45.075502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b43ea-ffa9-4283-b45e-d89380e9c538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:45.078964 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3292/6626] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:44 2022] DELETE /identity/v3/policies/a358bdfae4dd4906a5d10fd969fd03b0 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:45.080272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ca43a-93a6-4032-ac48-4bcf4315e174 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:45.094368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ca43a-93a6-4032-ac48-4bcf4315e174 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:45.107333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4a8b43ea-ffa9-4283-b45e-d89380e9c538 None None] MFA Rules not processed for user `dbf79689e3074d2589296c97b0b16924`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:45.108742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726ae19-f4f6-46d1-ac63-0b95d5c942c2 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5fcd5b02e6457385c99d1bc14fb445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abdbd8ce92574269af79c0f50c2a16a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:45.109631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726ae19-f4f6-46d1-ac63-0b95d5c942c2 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:45.109918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726ae19-f4f6-46d1-ac63-0b95d5c942c2 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:45.110197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726ae19-f4f6-46d1-ac63-0b95d5c942c2 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] PATH_INFO: `/v3/policies/ddb99742a4f548918648117731dcc464` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:45.114037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726ae19-f4f6-46d1-ac63-0b95d5c942c2 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=ddb99742a4f548918648117731dcc464)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:45.116297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4a8b43ea-ffa9-4283-b45e-d89380e9c538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:45.118427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726ae19-f4f6-46d1-ac63-0b95d5c942c2 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:45.143598 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3293/6627] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:45 2022] DELETE /identity/v3/policies/ddb99742a4f548918648117731dcc464 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:45.148487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726ae19-f4f6-46d1-ac63-0b95d5c942c2 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:45.163917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726ae19-f4f6-46d1-ac63-0b95d5c942c2 tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:45.169626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b43d6-623d-45ce-8344-65cb2c07197e tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5fcd5b02e6457385c99d1bc14fb445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abdbd8ce92574269af79c0f50c2a16a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:45.170673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b43d6-623d-45ce-8344-65cb2c07197e tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:45.170997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b43d6-623d-45ce-8344-65cb2c07197e tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:45.171311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b43d6-623d-45ce-8344-65cb2c07197e tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] PATH_INFO: `/v3/policies/abacc1f7379d4077a8b13b46a6e0a386` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:45.172854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b43d6-623d-45ce-8344-65cb2c07197e tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=abacc1f7379d4077a8b13b46a6e0a386)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:45.175245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b43d6-623d-45ce-8344-65cb2c07197e tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:45.193530 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3294/6628] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:45 2022] DELETE /identity/v3/policies/abacc1f7379d4077a8b13b46a6e0a386 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:45.199992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b43d6-623d-45ce-8344-65cb2c07197e tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:45.201276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:45.298041 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3335/6629] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:45.365349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b43d6-623d-45ce-8344-65cb2c07197e tempest-PoliciesTestJSON-431802234 tempest-PoliciesTestJSON-431802234-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:45.385772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09118fe0-66c0-4897-bf35-f6113505757c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:45.386691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09118fe0-66c0-4897-bf35-f6113505757c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:45.387029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09118fe0-66c0-4897-bf35-f6113505757c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:45.387222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09118fe0-66c0-4897-bf35-f6113505757c admin admin] PATH_INFO: `/v3/users/6da4d0663add4988a39a70b9876a49f9` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:45.400269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09118fe0-66c0-4897-bf35-f6113505757c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da4d0663add4988a39a70b9876a49f9)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:45.402886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09118fe0-66c0-4897-bf35-f6113505757c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:45.457378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:45.484450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-09118fe0-66c0-4897-bf35-f6113505757c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da4d0663add4988a39a70b9876a49f9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:45.497243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-09118fe0-66c0-4897-bf35-f6113505757c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da4d0663add4988a39a70b9876a49f9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:45.509933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-09118fe0-66c0-4897-bf35-f6113505757c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da4d0663add4988a39a70b9876a49f9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:45.510935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-09118fe0-66c0-4897-bf35-f6113505757c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da4d0663add4988a39a70b9876a49f9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:45.511701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-09118fe0-66c0-4897-bf35-f6113505757c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da4d0663add4988a39a70b9876a49f9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:45.562281 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3295/6630] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:26:45 2022] DELETE /identity/v3/users/6da4d0663add4988a39a70b9876a49f9 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:45.566912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda5fa4-570c-48a8-beba-4e5bdac20b35 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:45.567204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda5fa4-570c-48a8-beba-4e5bdac20b35 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:45.567481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda5fa4-570c-48a8-beba-4e5bdac20b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:45.601028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fbda5fa4-570c-48a8-beba-4e5bdac20b35 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:45.602620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fbda5fa4-570c-48a8-beba-4e5bdac20b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:45.714403 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3336/6631] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:45.728558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09118fe0-66c0-4897-bf35-f6113505757c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:45.729993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-09118fe0-66c0-4897-bf35-f6113505757c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:45.826101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09118fe0-66c0-4897-bf35-f6113505757c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:45.832251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab52e1d-11f8-43f9-8324-5d9959870d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:45.833523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab52e1d-11f8-43f9-8324-5d9959870d94 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:45.833899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab52e1d-11f8-43f9-8324-5d9959870d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:45.834324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab52e1d-11f8-43f9-8324-5d9959870d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:45.855939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab52e1d-11f8-43f9-8324-5d9959870d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:45.861108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab52e1d-11f8-43f9-8324-5d9959870d94 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:45.888682 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3296/6632] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:26:46.411781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda5fa4-570c-48a8-beba-4e5bdac20b35 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:46.413941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fbda5fa4-570c-48a8-beba-4e5bdac20b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:46.427996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda5fa4-570c-48a8-beba-4e5bdac20b35 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:46.434675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87acdb-d932-4dc3-968a-39ff6de58ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:46.435698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87acdb-d932-4dc3-968a-39ff6de58ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:46.436293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87acdb-d932-4dc3-968a-39ff6de58ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:46.436739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87acdb-d932-4dc3-968a-39ff6de58ef8 admin admin] PATH_INFO: `/v3/projects/50c00272b49a474ba9953e28e7704d44` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:46.438145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87acdb-d932-4dc3-968a-39ff6de58ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c00272b49a474ba9953e28e7704d44)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:46.440822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87acdb-d932-4dc3-968a-39ff6de58ef8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:46.516078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fd87acdb-d932-4dc3-968a-39ff6de58ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c00272b49a474ba9953e28e7704d44', 'request_id': 'req-fd87acdb-d932-4dc3-968a-39ff6de58ef8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:46.527921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fd87acdb-d932-4dc3-968a-39ff6de58ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c00272b49a474ba9953e28e7704d44', 'request_id': 'req-fd87acdb-d932-4dc3-968a-39ff6de58ef8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:46.538068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fd87acdb-d932-4dc3-968a-39ff6de58ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c00272b49a474ba9953e28e7704d44', 'request_id': 'req-fd87acdb-d932-4dc3-968a-39ff6de58ef8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:46.553120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fd87acdb-d932-4dc3-968a-39ff6de58ef8 admin admin] The token cache is being invalidate because project 50c00272b49a474ba9953e28e7704d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:26:46.553605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fd87acdb-d932-4dc3-968a-39ff6de58ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:46.554389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fd87acdb-d932-4dc3-968a-39ff6de58ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:46.560851 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3337/6633] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:46 2022] DELETE /identity/v3/projects/50c00272b49a474ba9953e28e7704d44 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:46.561297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab52e1d-11f8-43f9-8324-5d9959870d94 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:46.578358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab52e1d-11f8-43f9-8324-5d9959870d94 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:46.653441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7997e0-c7ad-4644-a388-6c78c389b22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:46.654281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7997e0-c7ad-4644-a388-6c78c389b22e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:46.654615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7997e0-c7ad-4644-a388-6c78c389b22e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:46.654998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7997e0-c7ad-4644-a388-6c78c389b22e admin admin] PATH_INFO: `/v3/users/aa5fcd5b02e6457385c99d1bc14fb445` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:46.656632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7997e0-c7ad-4644-a388-6c78c389b22e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa5fcd5b02e6457385c99d1bc14fb445)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:46.659062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7997e0-c7ad-4644-a388-6c78c389b22e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:46.718664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-da7997e0-c7ad-4644-a388-6c78c389b22e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa5fcd5b02e6457385c99d1bc14fb445'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:46.724305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:46.730055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-da7997e0-c7ad-4644-a388-6c78c389b22e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa5fcd5b02e6457385c99d1bc14fb445'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:46.740185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-da7997e0-c7ad-4644-a388-6c78c389b22e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa5fcd5b02e6457385c99d1bc14fb445'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:46.741312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-da7997e0-c7ad-4644-a388-6c78c389b22e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa5fcd5b02e6457385c99d1bc14fb445'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:46.742223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-da7997e0-c7ad-4644-a388-6c78c389b22e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa5fcd5b02e6457385c99d1bc14fb445'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:46.763159 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3297/6634] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:26:46 2022] DELETE /identity/v3/users/aa5fcd5b02e6457385c99d1bc14fb445 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:47.333157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87acdb-d932-4dc3-968a-39ff6de58ef8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:47.335086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fd87acdb-d932-4dc3-968a-39ff6de58ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:47.355396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87acdb-d932-4dc3-968a-39ff6de58ef8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:47.479417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aa7e8-7a51-4775-9e47-ef12257bb727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:47.482294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aa7e8-7a51-4775-9e47-ef12257bb727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:47.483202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aa7e8-7a51-4775-9e47-ef12257bb727 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:47.483626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aa7e8-7a51-4775-9e47-ef12257bb727 admin admin] PATH_INFO: `/v3/projects/abdbd8ce92574269af79c0f50c2a16a7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:47.485657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3aa7e8-7a51-4775-9e47-ef12257bb727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abdbd8ce92574269af79c0f50c2a16a7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:47.488282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3aa7e8-7a51-4775-9e47-ef12257bb727 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:47.493082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:47.582663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2b3aa7e8-7a51-4775-9e47-ef12257bb727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abdbd8ce92574269af79c0f50c2a16a7', 'request_id': 'req-2b3aa7e8-7a51-4775-9e47-ef12257bb727'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:47.597237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2b3aa7e8-7a51-4775-9e47-ef12257bb727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abdbd8ce92574269af79c0f50c2a16a7', 'request_id': 'req-2b3aa7e8-7a51-4775-9e47-ef12257bb727'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:47.604856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2b3aa7e8-7a51-4775-9e47-ef12257bb727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abdbd8ce92574269af79c0f50c2a16a7', 'request_id': 'req-2b3aa7e8-7a51-4775-9e47-ef12257bb727'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:47.616444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2b3aa7e8-7a51-4775-9e47-ef12257bb727 admin admin] The token cache is being invalidate because project abdbd8ce92574269af79c0f50c2a16a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:26:47.616856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2b3aa7e8-7a51-4775-9e47-ef12257bb727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:47.617745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2b3aa7e8-7a51-4775-9e47-ef12257bb727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:47.619425 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3338/6635] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:47 2022] DELETE /identity/v3/projects/abdbd8ce92574269af79c0f50c2a16a7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:47.624571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ecaa1-f7ac-4e9f-985d-5aa3b960ba89 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:47.625056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ecaa1-f7ac-4e9f-985d-5aa3b960ba89 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:47.625250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ecaa1-f7ac-4e9f-985d-5aa3b960ba89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:47.650602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-593ecaa1-f7ac-4e9f-985d-5aa3b960ba89 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:47.652117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-593ecaa1-f7ac-4e9f-985d-5aa3b960ba89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:47.720611 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3298/6636] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:26:47.731181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c7c3b-8d25-4f5d-afdb-9ac6fb5c1f27 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:47.732270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c7c3b-8d25-4f5d-afdb-9ac6fb5c1f27 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:47.732673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c7c3b-8d25-4f5d-afdb-9ac6fb5c1f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:47.758313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b27c7c3b-8d25-4f5d-afdb-9ac6fb5c1f27 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:47.760401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b27c7c3b-8d25-4f5d-afdb-9ac6fb5c1f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:47.769336 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3339/6637] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:47.774329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ecaa1-f7ac-4e9f-985d-5aa3b960ba89 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:47.786554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ecaa1-f7ac-4e9f-985d-5aa3b960ba89 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:47.791761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044ed3c-4eae-43f6-9b6f-812df01118e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:47.793279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044ed3c-4eae-43f6-9b6f-812df01118e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:47.793279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044ed3c-4eae-43f6-9b6f-812df01118e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:47.793279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044ed3c-4eae-43f6-9b6f-812df01118e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:47.794338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044ed3c-4eae-43f6-9b6f-812df01118e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:26:47.794651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044ed3c-4eae-43f6-9b6f-812df01118e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:47.796325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044ed3c-4eae-43f6-9b6f-812df01118e8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:47.819155 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3299/6638] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:26:47.820887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c7c3b-8d25-4f5d-afdb-9ac6fb5c1f27 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:47.838687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c7c3b-8d25-4f5d-afdb-9ac6fb5c1f27 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:47.843973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c90a2-0d95-43cb-8da9-aa1f61f1dbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:47.845059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c90a2-0d95-43cb-8da9-aa1f61f1dbc3 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:47.845691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c90a2-0d95-43cb-8da9-aa1f61f1dbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:47.845691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c90a2-0d95-43cb-8da9-aa1f61f1dbc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:47.846481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c90a2-0d95-43cb-8da9-aa1f61f1dbc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:47.848540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c90a2-0d95-43cb-8da9-aa1f61f1dbc3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:47.883234 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3340/6639] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:26:47 2022] POST /identity/v3/projects => generated 365 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:47.884357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044ed3c-4eae-43f6-9b6f-812df01118e8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:47.895095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044ed3c-4eae-43f6-9b6f-812df01118e8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:47.981271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbad3f5-81ac-4ded-a3b8-0d8acdf9a8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:47.982047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbad3f5-81ac-4ded-a3b8-0d8acdf9a8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:47.982331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbad3f5-81ac-4ded-a3b8-0d8acdf9a8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:47.982602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbad3f5-81ac-4ded-a3b8-0d8acdf9a8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:47.983847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbad3f5-81ac-4ded-a3b8-0d8acdf9a8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:47.986176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbad3f5-81ac-4ded-a3b8-0d8acdf9a8a1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:48.016672 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3300/6640] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:26:47 2022] POST /identity/v3/users => generated 283 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:26:48.022526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c90a2-0d95-43cb-8da9-aa1f61f1dbc3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:48.041173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c90a2-0d95-43cb-8da9-aa1f61f1dbc3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:48.053583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80b004-8a1b-47d0-b898-f523482ab3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:48.055206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80b004-8a1b-47d0-b898-f523482ab3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:48.055495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80b004-8a1b-47d0-b898-f523482ab3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:48.055768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80b004-8a1b-47d0-b898-f523482ab3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:48.059863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80b004-8a1b-47d0-b898-f523482ab3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:48.062653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80b004-8a1b-47d0-b898-f523482ab3a1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:48.090674 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3341/6641] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:48.092292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbad3f5-81ac-4ded-a3b8-0d8acdf9a8a1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:48.113724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbad3f5-81ac-4ded-a3b8-0d8acdf9a8a1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:48.119816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d7e27-fedb-42d5-b8b2-23271e9b75b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:48.121628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d7e27-fedb-42d5-b8b2-23271e9b75b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:48.122254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d7e27-fedb-42d5-b8b2-23271e9b75b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:48.122846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d7e27-fedb-42d5-b8b2-23271e9b75b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:48.125825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d7e27-fedb-42d5-b8b2-23271e9b75b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:48.127562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d7e27-fedb-42d5-b8b2-23271e9b75b3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:48.169184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80b004-8a1b-47d0-b898-f523482ab3a1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:48.170349 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3301/6642] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:48.194473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80b004-8a1b-47d0-b898-f523482ab3a1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:48.213257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01897e-f482-4a8c-a5c8-213659ba6e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:48.214392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01897e-f482-4a8c-a5c8-213659ba6e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:48.214678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01897e-f482-4a8c-a5c8-213659ba6e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:48.215506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01897e-f482-4a8c-a5c8-213659ba6e8d admin admin] PATH_INFO: `/v3/projects/ca942fcd00a140db99e5f0be775988d3/users/1fd865805a294afead479ed50da12049/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:48.257764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01897e-f482-4a8c-a5c8-213659ba6e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca942fcd00a140db99e5f0be775988d3, user_id=1fd865805a294afead479ed50da12049, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:48.264795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01897e-f482-4a8c-a5c8-213659ba6e8d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:48.283308 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3342/6643] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:48 2022] PUT /identity/v3/projects/ca942fcd00a140db99e5f0be775988d3/users/1fd865805a294afead479ed50da12049/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:48.294929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae5b13-b622-4dbb-8fcb-9601620d2fb4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:48.295166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae5b13-b622-4dbb-8fcb-9601620d2fb4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:48.295426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae5b13-b622-4dbb-8fcb-9601620d2fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:48.357685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-28ae5b13-b622-4dbb-8fcb-9601620d2fb4 None None] MFA Rules not processed for user `1fd865805a294afead479ed50da12049`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:48.359022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-28ae5b13-b622-4dbb-8fcb-9601620d2fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:48.407869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:48.509596 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3302/6644] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:48.511071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01897e-f482-4a8c-a5c8-213659ba6e8d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:48.630235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01897e-f482-4a8c-a5c8-213659ba6e8d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:48.637459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e336f5-8a2a-4fd9-ab82-8c5bee2bd2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:48.638243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e336f5-8a2a-4fd9-ab82-8c5bee2bd2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:48.638594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e336f5-8a2a-4fd9-ab82-8c5bee2bd2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:48.640356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e336f5-8a2a-4fd9-ab82-8c5bee2bd2e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:48.641308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e336f5-8a2a-4fd9-ab82-8c5bee2bd2e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:48.643558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e336f5-8a2a-4fd9-ab82-8c5bee2bd2e9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:48.695541 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3343/6645] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:26:48 2022] POST /identity/v3/projects => generated 367 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:48.700357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae5b13-b622-4dbb-8fcb-9601620d2fb4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:48.712022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae5b13-b622-4dbb-8fcb-9601620d2fb4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:48.780294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cac08e-56fe-4913-ab6d-0b1635c53525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:48.781301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cac08e-56fe-4913-ab6d-0b1635c53525 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:48.781746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cac08e-56fe-4913-ab6d-0b1635c53525 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:48.782196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cac08e-56fe-4913-ab6d-0b1635c53525 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:48.783120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cac08e-56fe-4913-ab6d-0b1635c53525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:48.786254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cac08e-56fe-4913-ab6d-0b1635c53525 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:48.818286 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3303/6646] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:26:48 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:26:48.821464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e336f5-8a2a-4fd9-ab82-8c5bee2bd2e9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:48.836540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e336f5-8a2a-4fd9-ab82-8c5bee2bd2e9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:48.842569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9669d8-b3e1-43f4-946f-19551f2855ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:48.843454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9669d8-b3e1-43f4-946f-19551f2855ca admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:48.843873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9669d8-b3e1-43f4-946f-19551f2855ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:48.844352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9669d8-b3e1-43f4-946f-19551f2855ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:48.846461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9669d8-b3e1-43f4-946f-19551f2855ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:48.848372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9669d8-b3e1-43f4-946f-19551f2855ca admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:48.868866 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3344/6647] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:48.870596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cac08e-56fe-4913-ab6d-0b1635c53525 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:48.885398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cac08e-56fe-4913-ab6d-0b1635c53525 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:48.890533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a360edd-4a5d-46b7-9af4-abfe3708a8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:48.891699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a360edd-4a5d-46b7-9af4-abfe3708a8ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:48.892302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a360edd-4a5d-46b7-9af4-abfe3708a8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:48.892779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a360edd-4a5d-46b7-9af4-abfe3708a8ff admin admin] PATH_INFO: `/v3/projects/4479e7e629314d509931dbb33888b369/users/00a980c8e3454a339a3dd7d5ae0fb8d1/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:48.909511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a360edd-4a5d-46b7-9af4-abfe3708a8ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4479e7e629314d509931dbb33888b369, user_id=00a980c8e3454a339a3dd7d5ae0fb8d1, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:48.912579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a360edd-4a5d-46b7-9af4-abfe3708a8ff admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:48.935928 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3304/6648] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:48 2022] PUT /identity/v3/projects/4479e7e629314d509931dbb33888b369/users/00a980c8e3454a339a3dd7d5ae0fb8d1/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:26:48.940652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9669d8-b3e1-43f4-946f-19551f2855ca admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:48.946625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:48.952719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9669d8-b3e1-43f4-946f-19551f2855ca admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:49.045049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05151024-36d8-480a-90e9-ff369790b2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:49.045857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05151024-36d8-480a-90e9-ff369790b2cc admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:49.046208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05151024-36d8-480a-90e9-ff369790b2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:49.046559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05151024-36d8-480a-90e9-ff369790b2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:49.047364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05151024-36d8-480a-90e9-ff369790b2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:49.049823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05151024-36d8-480a-90e9-ff369790b2cc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:49.064709 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3345/6649] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:49.070958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a360edd-4a5d-46b7-9af4-abfe3708a8ff admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:49.108544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a360edd-4a5d-46b7-9af4-abfe3708a8ff admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:49.122417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08adf6a-61a6-4cc8-aa36-72e52dfb9690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:49.123246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08adf6a-61a6-4cc8-aa36-72e52dfb9690 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:49.123535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08adf6a-61a6-4cc8-aa36-72e52dfb9690 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:49.123815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08adf6a-61a6-4cc8-aa36-72e52dfb9690 admin admin] PATH_INFO: `/v3/projects/4479e7e629314d509931dbb33888b369/users/00a980c8e3454a339a3dd7d5ae0fb8d1/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:49.132447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08adf6a-61a6-4cc8-aa36-72e52dfb9690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4479e7e629314d509931dbb33888b369, user_id=00a980c8e3454a339a3dd7d5ae0fb8d1, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:49.137022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08adf6a-61a6-4cc8-aa36-72e52dfb9690 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:49.172995 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3305/6650] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:49 2022] PUT /identity/v3/projects/4479e7e629314d509931dbb33888b369/users/00a980c8e3454a339a3dd7d5ae0fb8d1/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:49.183820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f8300-0369-4c27-a11e-9f4df9b9ee74 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:49.184532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f8300-0369-4c27-a11e-9f4df9b9ee74 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:49.185911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f8300-0369-4c27-a11e-9f4df9b9ee74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:49.225457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-038f8300-0369-4c27-a11e-9f4df9b9ee74 None None] MFA Rules not processed for user `00a980c8e3454a339a3dd7d5ae0fb8d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:49.227222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-038f8300-0369-4c27-a11e-9f4df9b9ee74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:49.321476 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3346/6651] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:49 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:49.326930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08adf6a-61a6-4cc8-aa36-72e52dfb9690 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:49.341156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08adf6a-61a6-4cc8-aa36-72e52dfb9690 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:49.346928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb5c64-3dac-4a9c-9bd4-91971c05be9f tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00a980c8e3454a339a3dd7d5ae0fb8d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4479e7e629314d509931dbb33888b369', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:49.347854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb5c64-3dac-4a9c-9bd4-91971c05be9f tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:49.348134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb5c64-3dac-4a9c-9bd4-91971c05be9f tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:49.348521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb5c64-3dac-4a9c-9bd4-91971c05be9f tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] PATH_INFO: `/v3/regions` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:49.349117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb5c64-3dac-4a9c-9bd4-91971c05be9f tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:49.350150 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-4bfb5c64-3dac-4a9c-9bd4-91971c05be9f tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:49.350150 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:26:49.350150 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:26:49.351061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb5c64-3dac-4a9c-9bd4-91971c05be9f tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:49.372676 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3306/6652] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:26:49 2022] POST /identity/v3/regions => generated 224 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:49.376907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f8300-0369-4c27-a11e-9f4df9b9ee74 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:49.388812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f8300-0369-4c27-a11e-9f4df9b9ee74 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:49.406207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f208c2-91bb-446e-ab56-a4db622e64bd tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00a980c8e3454a339a3dd7d5ae0fb8d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4479e7e629314d509931dbb33888b369', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:49.406980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f208c2-91bb-446e-ab56-a4db622e64bd tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:49.407336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f208c2-91bb-446e-ab56-a4db622e64bd tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:49.407731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f208c2-91bb-446e-ab56-a4db622e64bd tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] PATH_INFO: `/v3/regions` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:49.408992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f208c2-91bb-446e-ab56-a4db622e64bd tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:49.409880 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-a6f208c2-91bb-446e-ab56-a4db622e64bd tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:49.409880 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:26:49.409880 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:26:49.410893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f208c2-91bb-446e-ab56-a4db622e64bd tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:49.446106 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3347/6653] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:26:49 2022] POST /identity/v3/regions => generated 224 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:26:49.451954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb5c64-3dac-4a9c-9bd4-91971c05be9f tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:49.469134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb5c64-3dac-4a9c-9bd4-91971c05be9f tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:49.495013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea02db5-985a-47d5-a3ba-b689c0096ec4 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00a980c8e3454a339a3dd7d5ae0fb8d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4479e7e629314d509931dbb33888b369', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:49.496000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea02db5-985a-47d5-a3ba-b689c0096ec4 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:49.496527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea02db5-985a-47d5-a3ba-b689c0096ec4 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:49.496821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea02db5-985a-47d5-a3ba-b689c0096ec4 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] PATH_INFO: `/v3/regions/f86f89ce-ad56-48ed-b6e6-d88773241e8b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:49.497718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea02db5-985a-47d5-a3ba-b689c0096ec4 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorizing `identity:create_region(region_id=f86f89ce-ad56-48ed-b6e6-d88773241e8b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:49.499694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea02db5-985a-47d5-a3ba-b689c0096ec4 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:49.534577 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3307/6654] 10.222.0.43 () {60 vars in 1258 bytes} [Sat Jul 2 21:26:49 2022] PUT /identity/v3/regions/f86f89ce-ad56-48ed-b6e6-d88773241e8b => generated 232 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:49.539196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f208c2-91bb-446e-ab56-a4db622e64bd tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:49.551790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f208c2-91bb-446e-ab56-a4db622e64bd tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:49.577885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5fc67-9c95-4f88-a5c3-94f52d68e2ed tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00a980c8e3454a339a3dd7d5ae0fb8d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4479e7e629314d509931dbb33888b369', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:49.579580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5fc67-9c95-4f88-a5c3-94f52d68e2ed tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:49.580209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5fc67-9c95-4f88-a5c3-94f52d68e2ed tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:49.580853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5fc67-9c95-4f88-a5c3-94f52d68e2ed tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] PATH_INFO: `/v3/regions/f86f89ce-ad56-48ed-b6e6-d88773241e8b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:49.581733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5fc67-9c95-4f88-a5c3-94f52d68e2ed tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorizing `identity:delete_region(region_id=f86f89ce-ad56-48ed-b6e6-d88773241e8b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:49.583624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5fc67-9c95-4f88-a5c3-94f52d68e2ed tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:49.612561 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3348/6655] 10.222.0.43 () {58 vars in 1241 bytes} [Sat Jul 2 21:26:49 2022] DELETE /identity/v3/regions/f86f89ce-ad56-48ed-b6e6-d88773241e8b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:49.617805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea02db5-985a-47d5-a3ba-b689c0096ec4 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:49.632268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea02db5-985a-47d5-a3ba-b689c0096ec4 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:49.649847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8208b4-6287-45fe-b775-82a3e76f513a tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00a980c8e3454a339a3dd7d5ae0fb8d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4479e7e629314d509931dbb33888b369', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:49.650642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8208b4-6287-45fe-b775-82a3e76f513a tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:49.650878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8208b4-6287-45fe-b775-82a3e76f513a tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:49.651159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8208b4-6287-45fe-b775-82a3e76f513a tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] PATH_INFO: `/v3/regions` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:49.651881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8208b4-6287-45fe-b775-82a3e76f513a tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:49.653531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8208b4-6287-45fe-b775-82a3e76f513a tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:49.694544 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3308/6656] 10.222.0.43 () {60 vars in 1149 bytes} [Sat Jul 2 21:26:49 2022] POST /identity/v3/regions => generated 254 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:49.695031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5fc67-9c95-4f88-a5c3-94f52d68e2ed tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:49.714058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5fc67-9c95-4f88-a5c3-94f52d68e2ed tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:49.743414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bdfae-1249-4b06-a534-e11b832e273b tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00a980c8e3454a339a3dd7d5ae0fb8d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4479e7e629314d509931dbb33888b369', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:49.744417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bdfae-1249-4b06-a534-e11b832e273b tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:49.744711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bdfae-1249-4b06-a534-e11b832e273b tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:49.745114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bdfae-1249-4b06-a534-e11b832e273b tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] PATH_INFO: `/v3/regions/ce2332870cb7495b823a21632e2c0214` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:49.745891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bdfae-1249-4b06-a534-e11b832e273b tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorizing `identity:update_region(region_id=ce2332870cb7495b823a21632e2c0214)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:49.746938 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-367bdfae-1249-4b06-a534-e11b832e273b tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:49.746938 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:26:49.746938 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:26:49.756199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bdfae-1249-4b06-a534-e11b832e273b tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:49.781647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:49.806157 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3349/6657] 10.222.0.43 () {60 vars in 1249 bytes} [Sat Jul 2 21:26:49 2022] PATCH /identity/v3/regions/ce2332870cb7495b823a21632e2c0214 => generated 253 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:26:49.808495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8208b4-6287-45fe-b775-82a3e76f513a tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:49.817134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:49.825141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8208b4-6287-45fe-b775-82a3e76f513a tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:49.845642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869ccc0-3dcc-4f22-be42-aba7a612081f tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00a980c8e3454a339a3dd7d5ae0fb8d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4479e7e629314d509931dbb33888b369', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:49.846428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869ccc0-3dcc-4f22-be42-aba7a612081f tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:49.847062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869ccc0-3dcc-4f22-be42-aba7a612081f tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:49.847062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869ccc0-3dcc-4f22-be42-aba7a612081f tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] PATH_INFO: `/v3/regions/ce2332870cb7495b823a21632e2c0214` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:49.847623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869ccc0-3dcc-4f22-be42-aba7a612081f tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorizing `identity:get_region(region_id=ce2332870cb7495b823a21632e2c0214)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:49.848763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869ccc0-3dcc-4f22-be42-aba7a612081f tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:49.856191 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3309/6658] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:26:49 2022] GET /identity/v3/regions/ce2332870cb7495b823a21632e2c0214 => generated 253 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:26:49.860527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bdfae-1249-4b06-a534-e11b832e273b tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:49.878008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bdfae-1249-4b06-a534-e11b832e273b tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:49.885397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ef8c9-cc54-4038-bb17-f03c0b6ed46a tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00a980c8e3454a339a3dd7d5ae0fb8d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4479e7e629314d509931dbb33888b369', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:49.887207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ef8c9-cc54-4038-bb17-f03c0b6ed46a tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:49.887672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ef8c9-cc54-4038-bb17-f03c0b6ed46a tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:49.888276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ef8c9-cc54-4038-bb17-f03c0b6ed46a tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] PATH_INFO: `/v3/regions/ce2332870cb7495b823a21632e2c0214` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:49.889140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ef8c9-cc54-4038-bb17-f03c0b6ed46a tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorizing `identity:delete_region(region_id=ce2332870cb7495b823a21632e2c0214)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:49.892580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ef8c9-cc54-4038-bb17-f03c0b6ed46a tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:49.928461 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3350/6659] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:26:49 2022] DELETE /identity/v3/regions/ce2332870cb7495b823a21632e2c0214 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:49.932519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869ccc0-3dcc-4f22-be42-aba7a612081f tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:49.947741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869ccc0-3dcc-4f22-be42-aba7a612081f tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:49.986692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedff7ac-deca-41d5-ac12-d1f717a1f2b2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00a980c8e3454a339a3dd7d5ae0fb8d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4479e7e629314d509931dbb33888b369', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:49.987379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedff7ac-deca-41d5-ac12-d1f717a1f2b2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:49.987680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedff7ac-deca-41d5-ac12-d1f717a1f2b2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:49.987937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedff7ac-deca-41d5-ac12-d1f717a1f2b2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] PATH_INFO: `/v3/regions` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:49.988651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedff7ac-deca-41d5-ac12-d1f717a1f2b2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:49.989838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedff7ac-deca-41d5-ac12-d1f717a1f2b2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:50.006851 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3310/6660] 10.222.0.43 () {58 vars in 1127 bytes} [Sat Jul 2 21:26:49 2022] GET /identity/v3/regions => generated 670 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:26:50.011004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ef8c9-cc54-4038-bb17-f03c0b6ed46a tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:50.027203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ef8c9-cc54-4038-bb17-f03c0b6ed46a tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:50.032385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd85f55-8b11-4ba1-ba08-282f89579ec2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00a980c8e3454a339a3dd7d5ae0fb8d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4479e7e629314d509931dbb33888b369', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:50.033526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd85f55-8b11-4ba1-ba08-282f89579ec2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:50.033814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd85f55-8b11-4ba1-ba08-282f89579ec2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:50.034086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd85f55-8b11-4ba1-ba08-282f89579ec2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] PATH_INFO: `/v3/regions/ce2332870cb7495b823a21632e2c0214` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:50.034746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd85f55-8b11-4ba1-ba08-282f89579ec2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorizing `identity:delete_region(region_id=ce2332870cb7495b823a21632e2c0214)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:50.036419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd85f55-8b11-4ba1-ba08-282f89579ec2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:50.053884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-7cd85f55-8b11-4ba1-ba08-282f89579ec2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Could not find region: ce2332870cb7495b823a21632e2c0214.: keystone.exception.RegionNotFound: Could not find region: ce2332870cb7495b823a21632e2c0214. Jul 02 21:26:50.053884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:26:50.053884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Jul 02 21:26:50.053884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Jul 02 21:26:50.053884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Jul 02 21:26:50.053884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Jul 02 21:26:50.053884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Jul 02 21:26:50.053884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jul 02 21:26:50.053884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: ce2332870cb7495b823a21632e2c0214. Jul 02 21:26:50.053884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:26:50.053884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:26:50.053884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:26:50.053884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:26:50.053884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:26:50.053884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:26:50.053884 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:26:50.054987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:26:50.054987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:26:50.054987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:26:50.054987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:26:50.054987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:26:50.054987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:26:50.054987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:26:50.054987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Jul 02 21:26:50.054987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Jul 02 21:26:50.054987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:26:50.054987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:26:50.054987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Jul 02 21:26:50.054987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jul 02 21:26:50.054987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: ce2332870cb7495b823a21632e2c0214. Jul 02 21:26:50.054987 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:26:50.056458 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3351/6661] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:26:50 2022] DELETE /identity/v3/regions/ce2332870cb7495b823a21632e2c0214 => generated 112 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:26:50.068250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedff7ac-deca-41d5-ac12-d1f717a1f2b2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:50.083408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedff7ac-deca-41d5-ac12-d1f717a1f2b2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:50.090560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d84cbf-09c2-4dd6-b8fb-994cdcf3c7fc tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00a980c8e3454a339a3dd7d5ae0fb8d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4479e7e629314d509931dbb33888b369', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:50.091251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d84cbf-09c2-4dd6-b8fb-994cdcf3c7fc tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:50.091533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d84cbf-09c2-4dd6-b8fb-994cdcf3c7fc tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:50.091805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d84cbf-09c2-4dd6-b8fb-994cdcf3c7fc tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] PATH_INFO: `/v3/regions` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:50.092894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d84cbf-09c2-4dd6-b8fb-994cdcf3c7fc tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:50.093987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d84cbf-09c2-4dd6-b8fb-994cdcf3c7fc tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:50.107754 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3311/6662] 10.222.0.43 () {58 vars in 1127 bytes} [Sat Jul 2 21:26:50 2022] GET /identity/v3/regions => generated 670 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:26:50.113303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd85f55-8b11-4ba1-ba08-282f89579ec2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:50.124347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd85f55-8b11-4ba1-ba08-282f89579ec2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:50.129323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d69d0f-0ef7-4952-a52f-2d8d459389e9 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00a980c8e3454a339a3dd7d5ae0fb8d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4479e7e629314d509931dbb33888b369', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:50.130000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d69d0f-0ef7-4952-a52f-2d8d459389e9 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:50.130280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d69d0f-0ef7-4952-a52f-2d8d459389e9 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:50.130557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d69d0f-0ef7-4952-a52f-2d8d459389e9 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] PATH_INFO: `/v3/regions` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:50.131299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d69d0f-0ef7-4952-a52f-2d8d459389e9 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:50.133069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d69d0f-0ef7-4952-a52f-2d8d459389e9 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:50.166438 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3352/6663] 10.222.0.43 () {60 vars in 1149 bytes} [Sat Jul 2 21:26:50 2022] POST /identity/v3/regions => generated 253 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:50.172076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d84cbf-09c2-4dd6-b8fb-994cdcf3c7fc tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:50.183692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d84cbf-09c2-4dd6-b8fb-994cdcf3c7fc tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:50.205275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a4cf4-8546-460d-8615-a69251d6f6d8 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00a980c8e3454a339a3dd7d5ae0fb8d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4479e7e629314d509931dbb33888b369', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:50.206258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a4cf4-8546-460d-8615-a69251d6f6d8 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:50.206562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a4cf4-8546-460d-8615-a69251d6f6d8 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:50.206836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a4cf4-8546-460d-8615-a69251d6f6d8 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] PATH_INFO: `/v3/regions` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:50.207547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a4cf4-8546-460d-8615-a69251d6f6d8 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Adding query filter params (parent_region_id=56a429c5cf4b46c3892d538a9f82e369) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:26:50.207842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a4cf4-8546-460d-8615-a69251d6f6d8 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:50.209162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a4cf4-8546-460d-8615-a69251d6f6d8 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:50.219731 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3312/6664] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:26:50 2022] GET /identity/v3/regions?parent_region_id=56a429c5cf4b46c3892d538a9f82e369 => generated 399 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:26:50.221338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d69d0f-0ef7-4952-a52f-2d8d459389e9 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:50.245978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d69d0f-0ef7-4952-a52f-2d8d459389e9 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:50.255908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1d0ae-4607-4fd1-96ba-ce38fb387723 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00a980c8e3454a339a3dd7d5ae0fb8d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4479e7e629314d509931dbb33888b369', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:50.256859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1d0ae-4607-4fd1-96ba-ce38fb387723 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:50.257145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1d0ae-4607-4fd1-96ba-ce38fb387723 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:50.257614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1d0ae-4607-4fd1-96ba-ce38fb387723 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] PATH_INFO: `/v3/regions/31e47e11169f4a9abefc647a46c2e6a4` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:50.258563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1d0ae-4607-4fd1-96ba-ce38fb387723 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorizing `identity:delete_region(region_id=31e47e11169f4a9abefc647a46c2e6a4)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:50.259967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1d0ae-4607-4fd1-96ba-ce38fb387723 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:50.289113 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3353/6665] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:26:50 2022] DELETE /identity/v3/regions/31e47e11169f4a9abefc647a46c2e6a4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:50.291104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a4cf4-8546-460d-8615-a69251d6f6d8 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:50.304408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a4cf4-8546-460d-8615-a69251d6f6d8 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:50.329321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef194f8-759f-42e4-875a-60713f4859c2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00a980c8e3454a339a3dd7d5ae0fb8d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4479e7e629314d509931dbb33888b369', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:50.330702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef194f8-759f-42e4-875a-60713f4859c2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:50.331194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef194f8-759f-42e4-875a-60713f4859c2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:50.331677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef194f8-759f-42e4-875a-60713f4859c2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] PATH_INFO: `/v3/regions/affb23960f4b44c291a3b39770207426` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:50.332628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef194f8-759f-42e4-875a-60713f4859c2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorizing `identity:delete_region(region_id=affb23960f4b44c291a3b39770207426)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:50.334758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef194f8-759f-42e4-875a-60713f4859c2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:50.370819 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3313/6666] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:26:50 2022] DELETE /identity/v3/regions/affb23960f4b44c291a3b39770207426 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:50.374915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1d0ae-4607-4fd1-96ba-ce38fb387723 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:50.390542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1d0ae-4607-4fd1-96ba-ce38fb387723 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:50.422178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be3085-1e26-4246-a77f-1a2792d29d28 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00a980c8e3454a339a3dd7d5ae0fb8d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4479e7e629314d509931dbb33888b369', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:50.424710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be3085-1e26-4246-a77f-1a2792d29d28 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:50.425584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be3085-1e26-4246-a77f-1a2792d29d28 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:50.425868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be3085-1e26-4246-a77f-1a2792d29d28 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] PATH_INFO: `/v3/regions/56a429c5cf4b46c3892d538a9f82e369` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:50.426567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be3085-1e26-4246-a77f-1a2792d29d28 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorizing `identity:delete_region(region_id=56a429c5cf4b46c3892d538a9f82e369)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:50.431094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be3085-1e26-4246-a77f-1a2792d29d28 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:50.458678 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3354/6667] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:26:50 2022] DELETE /identity/v3/regions/56a429c5cf4b46c3892d538a9f82e369 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:50.462982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef194f8-759f-42e4-875a-60713f4859c2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:50.562963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef194f8-759f-42e4-875a-60713f4859c2 tempest-RegionsTestJSON-1256031477 tempest-RegionsTestJSON-1256031477-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:50.578151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0ce85-aef9-4693-a42d-904cfaab3827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:50.579324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0ce85-aef9-4693-a42d-904cfaab3827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:50.579826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0ce85-aef9-4693-a42d-904cfaab3827 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:50.580307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0ce85-aef9-4693-a42d-904cfaab3827 admin admin] PATH_INFO: `/v3/users/1fd865805a294afead479ed50da12049` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:50.581751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0ce85-aef9-4693-a42d-904cfaab3827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd865805a294afead479ed50da12049)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:50.583926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0ce85-aef9-4693-a42d-904cfaab3827 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:50.641111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f8e0ce85-aef9-4693-a42d-904cfaab3827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd865805a294afead479ed50da12049'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:50.650853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f8e0ce85-aef9-4693-a42d-904cfaab3827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd865805a294afead479ed50da12049'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:50.654898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:50.663112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f8e0ce85-aef9-4693-a42d-904cfaab3827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd865805a294afead479ed50da12049'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:50.663795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f8e0ce85-aef9-4693-a42d-904cfaab3827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd865805a294afead479ed50da12049'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:50.665154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f8e0ce85-aef9-4693-a42d-904cfaab3827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd865805a294afead479ed50da12049'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:50.690300 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3314/6668] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:26:50 2022] DELETE /identity/v3/users/1fd865805a294afead479ed50da12049 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:50.694828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998e673-c23d-4c3f-a127-8a9d8826f74e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:50.695323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998e673-c23d-4c3f-a127-8a9d8826f74e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:50.695401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998e673-c23d-4c3f-a127-8a9d8826f74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:50.713854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0998e673-c23d-4c3f-a127-8a9d8826f74e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:50.715069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0998e673-c23d-4c3f-a127-8a9d8826f74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:50.781604 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3355/6669] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:50.801619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0ce85-aef9-4693-a42d-904cfaab3827 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:50.803543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f8e0ce85-aef9-4693-a42d-904cfaab3827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:50.907036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0ce85-aef9-4693-a42d-904cfaab3827 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:50.911066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5142120-831d-4ae5-8ea6-282a8676f44d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:50.911726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5142120-831d-4ae5-8ea6-282a8676f44d service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:50.912011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5142120-831d-4ae5-8ea6-282a8676f44d service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:50.912313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5142120-831d-4ae5-8ea6-282a8676f44d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:50.922921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5142120-831d-4ae5-8ea6-282a8676f44d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:50.924629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5142120-831d-4ae5-8ea6-282a8676f44d service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:50.940898 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3315/6670] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:26:51.679358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998e673-c23d-4c3f-a127-8a9d8826f74e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:51.681505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0998e673-c23d-4c3f-a127-8a9d8826f74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:51.694501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998e673-c23d-4c3f-a127-8a9d8826f74e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:51.699748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58401d9-8d95-4ae1-848b-1c45aaba1f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:51.702527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58401d9-8d95-4ae1-848b-1c45aaba1f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:51.703412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58401d9-8d95-4ae1-848b-1c45aaba1f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:51.704110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58401d9-8d95-4ae1-848b-1c45aaba1f81 admin admin] PATH_INFO: `/v3/projects/ca942fcd00a140db99e5f0be775988d3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:51.705625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58401d9-8d95-4ae1-848b-1c45aaba1f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca942fcd00a140db99e5f0be775988d3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:51.708731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58401d9-8d95-4ae1-848b-1c45aaba1f81 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:51.767196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a58401d9-8d95-4ae1-848b-1c45aaba1f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca942fcd00a140db99e5f0be775988d3', 'request_id': 'req-a58401d9-8d95-4ae1-848b-1c45aaba1f81'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:51.769052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:51.781130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a58401d9-8d95-4ae1-848b-1c45aaba1f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca942fcd00a140db99e5f0be775988d3', 'request_id': 'req-a58401d9-8d95-4ae1-848b-1c45aaba1f81'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:51.789341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a58401d9-8d95-4ae1-848b-1c45aaba1f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca942fcd00a140db99e5f0be775988d3', 'request_id': 'req-a58401d9-8d95-4ae1-848b-1c45aaba1f81'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:51.807403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a58401d9-8d95-4ae1-848b-1c45aaba1f81 admin admin] The token cache is being invalidate because project ca942fcd00a140db99e5f0be775988d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:26:51.807994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a58401d9-8d95-4ae1-848b-1c45aaba1f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:51.808938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a58401d9-8d95-4ae1-848b-1c45aaba1f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:51.810788 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3356/6671] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:51 2022] DELETE /identity/v3/projects/ca942fcd00a140db99e5f0be775988d3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:51.815055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5142120-831d-4ae5-8ea6-282a8676f44d service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:51.825596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5142120-831d-4ae5-8ea6-282a8676f44d service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:51.909962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0938b9-a60a-42e5-8f4e-b9bd1ce1f990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:51.911431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0938b9-a60a-42e5-8f4e-b9bd1ce1f990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:51.911660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0938b9-a60a-42e5-8f4e-b9bd1ce1f990 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:51.911856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0938b9-a60a-42e5-8f4e-b9bd1ce1f990 admin admin] PATH_INFO: `/v3/users/00a980c8e3454a339a3dd7d5ae0fb8d1` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:51.913621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0938b9-a60a-42e5-8f4e-b9bd1ce1f990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a980c8e3454a339a3dd7d5ae0fb8d1)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:51.916188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0938b9-a60a-42e5-8f4e-b9bd1ce1f990 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:52.002402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0b0938b9-a60a-42e5-8f4e-b9bd1ce1f990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a980c8e3454a339a3dd7d5ae0fb8d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:52.013143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0b0938b9-a60a-42e5-8f4e-b9bd1ce1f990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a980c8e3454a339a3dd7d5ae0fb8d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:52.022737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0b0938b9-a60a-42e5-8f4e-b9bd1ce1f990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a980c8e3454a339a3dd7d5ae0fb8d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:52.023479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0b0938b9-a60a-42e5-8f4e-b9bd1ce1f990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a980c8e3454a339a3dd7d5ae0fb8d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:52.024160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0b0938b9-a60a-42e5-8f4e-b9bd1ce1f990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a980c8e3454a339a3dd7d5ae0fb8d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:52.030408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:52.053878 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3316/6672] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:26:51 2022] DELETE /identity/v3/users/00a980c8e3454a339a3dd7d5ae0fb8d1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:26:52.863052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58401d9-8d95-4ae1-848b-1c45aaba1f81 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:52.864756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a58401d9-8d95-4ae1-848b-1c45aaba1f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:52.888558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58401d9-8d95-4ae1-848b-1c45aaba1f81 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:52.972508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702830bf-7e74-44c3-999e-74fb0e790a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:52.973392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702830bf-7e74-44c3-999e-74fb0e790a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:52.973672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702830bf-7e74-44c3-999e-74fb0e790a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:52.973943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702830bf-7e74-44c3-999e-74fb0e790a36 admin admin] PATH_INFO: `/v3/projects/4479e7e629314d509931dbb33888b369` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:52.975638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702830bf-7e74-44c3-999e-74fb0e790a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4479e7e629314d509931dbb33888b369)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:52.978060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702830bf-7e74-44c3-999e-74fb0e790a36 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:53.055294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-702830bf-7e74-44c3-999e-74fb0e790a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4479e7e629314d509931dbb33888b369', 'request_id': 'req-702830bf-7e74-44c3-999e-74fb0e790a36'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:53.068172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-702830bf-7e74-44c3-999e-74fb0e790a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4479e7e629314d509931dbb33888b369', 'request_id': 'req-702830bf-7e74-44c3-999e-74fb0e790a36'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:53.080597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-702830bf-7e74-44c3-999e-74fb0e790a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4479e7e629314d509931dbb33888b369', 'request_id': 'req-702830bf-7e74-44c3-999e-74fb0e790a36'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:53.102410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-702830bf-7e74-44c3-999e-74fb0e790a36 admin admin] The token cache is being invalidate because project 4479e7e629314d509931dbb33888b369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:26:53.102813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-702830bf-7e74-44c3-999e-74fb0e790a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:53.103548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-702830bf-7e74-44c3-999e-74fb0e790a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:53.107608 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3357/6673] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:52 2022] DELETE /identity/v3/projects/4479e7e629314d509931dbb33888b369 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:53.112275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf41e89-0b5d-4895-8feb-dac6ca136bf8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:53.114720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf41e89-0b5d-4895-8feb-dac6ca136bf8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:53.115279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf41e89-0b5d-4895-8feb-dac6ca136bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:53.130744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702830bf-7e74-44c3-999e-74fb0e790a36 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:53.133546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-702830bf-7e74-44c3-999e-74fb0e790a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:53.143701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-dcf41e89-0b5d-4895-8feb-dac6ca136bf8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:53.145321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dcf41e89-0b5d-4895-8feb-dac6ca136bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:53.208118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702830bf-7e74-44c3-999e-74fb0e790a36 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:53.214920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0c6c4-88eb-4df9-877c-5571a856a1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:53.215809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0c6c4-88eb-4df9-877c-5571a856a1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:53.216013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0c6c4-88eb-4df9-877c-5571a856a1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:53.216320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0c6c4-88eb-4df9-877c-5571a856a1d1 admin admin] PATH_INFO: `/v3/users/dbf79689e3074d2589296c97b0b16924` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:53.217657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0c6c4-88eb-4df9-877c-5571a856a1d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf79689e3074d2589296c97b0b16924)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:53.226494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0c6c4-88eb-4df9-877c-5571a856a1d1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:53.227338 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3317/6674] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:53.229433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80646b62-6b4a-41fc-87f9-937cf67de45a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:53.229911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80646b62-6b4a-41fc-87f9-937cf67de45a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:53.230190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80646b62-6b4a-41fc-87f9-937cf67de45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:53.239160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:53.249904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-80646b62-6b4a-41fc-87f9-937cf67de45a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:53.251165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-80646b62-6b4a-41fc-87f9-937cf67de45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:53.263444 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3318/6675] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:53.268378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80646b62-6b4a-41fc-87f9-937cf67de45a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:53.279424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80646b62-6b4a-41fc-87f9-937cf67de45a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:53.285890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49ec40-26df-4c2a-a0bf-79077c8967c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:53.286575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49ec40-26df-4c2a-a0bf-79077c8967c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:53.286845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49ec40-26df-4c2a-a0bf-79077c8967c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:53.287124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49ec40-26df-4c2a-a0bf-79077c8967c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:53.287848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49ec40-26df-4c2a-a0bf-79077c8967c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:26:53.288195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49ec40-26df-4c2a-a0bf-79077c8967c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:53.288641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9aa0c6c4-88eb-4df9-877c-5571a856a1d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf79689e3074d2589296c97b0b16924'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:53.289807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49ec40-26df-4c2a-a0bf-79077c8967c5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:53.301612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9aa0c6c4-88eb-4df9-877c-5571a856a1d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf79689e3074d2589296c97b0b16924'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:53.303244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9aa0c6c4-88eb-4df9-877c-5571a856a1d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf79689e3074d2589296c97b0b16924'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:53.304318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9aa0c6c4-88eb-4df9-877c-5571a856a1d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf79689e3074d2589296c97b0b16924'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:53.310279 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3319/6676] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:26:53.312117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49ec40-26df-4c2a-a0bf-79077c8967c5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:53.316111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-db49ec40-26df-4c2a-a0bf-79077c8967c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:53.326956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9aa0c6c4-88eb-4df9-877c-5571a856a1d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf79689e3074d2589296c97b0b16924'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:53.332821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49ec40-26df-4c2a-a0bf-79077c8967c5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:53.341781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964ab9e-5d7b-4819-b0a0-a9f70e16f26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:53.342762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964ab9e-5d7b-4819-b0a0-a9f70e16f26a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:53.343231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964ab9e-5d7b-4819-b0a0-a9f70e16f26a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:53.343688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964ab9e-5d7b-4819-b0a0-a9f70e16f26a admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:53.344629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964ab9e-5d7b-4819-b0a0-a9f70e16f26a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:53.346766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964ab9e-5d7b-4819-b0a0-a9f70e16f26a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:53.358815 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3358/6677] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:26:53 2022] DELETE /identity/v3/users/dbf79689e3074d2589296c97b0b16924 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:53.404253 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3320/6678] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:26:53 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:26:53.409691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0c6c4-88eb-4df9-877c-5571a856a1d1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:53.518014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0c6c4-88eb-4df9-877c-5571a856a1d1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:53.588129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964ab9e-5d7b-4819-b0a0-a9f70e16f26a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:53.590295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b964ab9e-5d7b-4819-b0a0-a9f70e16f26a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:53.641384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c75c1-d59a-4c53-aad2-b2ee0b371154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:53.642112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c75c1-d59a-4c53-aad2-b2ee0b371154 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:53.642491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c75c1-d59a-4c53-aad2-b2ee0b371154 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:53.642864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c75c1-d59a-4c53-aad2-b2ee0b371154 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:53.643813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c75c1-d59a-4c53-aad2-b2ee0b371154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:53.648985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c75c1-d59a-4c53-aad2-b2ee0b371154 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:53.702055 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3359/6679] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:26:53 2022] POST /identity/v3/users => generated 284 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:53.706118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c75c1-d59a-4c53-aad2-b2ee0b371154 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:53.708958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964ab9e-5d7b-4819-b0a0-a9f70e16f26a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:53.714934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65945b44-a1f5-4e4a-9ea2-fcaddb4cdc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:53.716768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65945b44-a1f5-4e4a-9ea2-fcaddb4cdc80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:53.717056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65945b44-a1f5-4e4a-9ea2-fcaddb4cdc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:53.717556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65945b44-a1f5-4e4a-9ea2-fcaddb4cdc80 admin admin] PATH_INFO: `/v3/projects/282d207988644c02869aec5ae667a2d3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:53.719036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65945b44-a1f5-4e4a-9ea2-fcaddb4cdc80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=282d207988644c02869aec5ae667a2d3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:53.721555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c75c1-d59a-4c53-aad2-b2ee0b371154 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:53.721787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65945b44-a1f5-4e4a-9ea2-fcaddb4cdc80 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:53.728453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a162bc8-a777-4f0c-9f3a-9793200d4683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:53.729466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a162bc8-a777-4f0c-9f3a-9793200d4683 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:53.732539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a162bc8-a777-4f0c-9f3a-9793200d4683 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:53.733080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a162bc8-a777-4f0c-9f3a-9793200d4683 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:53.734809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a162bc8-a777-4f0c-9f3a-9793200d4683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:53.737363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a162bc8-a777-4f0c-9f3a-9793200d4683 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:53.752779 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3360/6680] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:26:53.757066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a162bc8-a777-4f0c-9f3a-9793200d4683 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:53.772248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a162bc8-a777-4f0c-9f3a-9793200d4683 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:53.791374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:53.798464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:53.800851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-65945b44-a1f5-4e4a-9ea2-fcaddb4cdc80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '282d207988644c02869aec5ae667a2d3', 'request_id': 'req-65945b44-a1f5-4e4a-9ea2-fcaddb4cdc80'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:53.812586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-65945b44-a1f5-4e4a-9ea2-fcaddb4cdc80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '282d207988644c02869aec5ae667a2d3', 'request_id': 'req-65945b44-a1f5-4e4a-9ea2-fcaddb4cdc80'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:53.824385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-65945b44-a1f5-4e4a-9ea2-fcaddb4cdc80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '282d207988644c02869aec5ae667a2d3', 'request_id': 'req-65945b44-a1f5-4e4a-9ea2-fcaddb4cdc80'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:53.846473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-65945b44-a1f5-4e4a-9ea2-fcaddb4cdc80 admin admin] The token cache is being invalidate because project 282d207988644c02869aec5ae667a2d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:26:53.846903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-65945b44-a1f5-4e4a-9ea2-fcaddb4cdc80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:53.847701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-65945b44-a1f5-4e4a-9ea2-fcaddb4cdc80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:53.851724 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3321/6681] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:53 2022] DELETE /identity/v3/projects/282d207988644c02869aec5ae667a2d3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:53.873932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea215a-0b76-485d-bd61-d9334a6571b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:53.874621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea215a-0b76-485d-bd61-d9334a6571b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:53.874932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea215a-0b76-485d-bd61-d9334a6571b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:53.875196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea215a-0b76-485d-bd61-d9334a6571b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:53.875914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea215a-0b76-485d-bd61-d9334a6571b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:53.877624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea215a-0b76-485d-bd61-d9334a6571b2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:53.889435 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3361/6682] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:53.892003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7be5f2-1c67-404f-9b9d-7e115c31381d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:53.892346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7be5f2-1c67-404f-9b9d-7e115c31381d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:53.892617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7be5f2-1c67-404f-9b9d-7e115c31381d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:53.892868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea215a-0b76-485d-bd61-d9334a6571b2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:53.895084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1bea215a-0b76-485d-bd61-d9334a6571b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:53.909053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea215a-0b76-485d-bd61-d9334a6571b2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:53.911905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bc7be5f2-1c67-404f-9b9d-7e115c31381d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:53.913159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bc7be5f2-1c67-404f-9b9d-7e115c31381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:53.915476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccdb37-1290-4b92-b4d9-3b9b08482dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:53.916493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccdb37-1290-4b92-b4d9-3b9b08482dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:53.916850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccdb37-1290-4b92-b4d9-3b9b08482dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:53.917150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccdb37-1290-4b92-b4d9-3b9b08482dd0 admin admin] PATH_INFO: `/v3/projects/4ea3bca573484cc7a7616cc9ab410db3/users/9ae0f639bf414a2f865b84e8f1c052a8/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:53.922566 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3322/6683] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:53.931621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb0f0e-0e72-484b-9c77-16882c07fda0 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:53.932071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb0f0e-0e72-484b-9c77-16882c07fda0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:53.932460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb0f0e-0e72-484b-9c77-16882c07fda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:53.937034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ccdb37-1290-4b92-b4d9-3b9b08482dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea3bca573484cc7a7616cc9ab410db3, user_id=9ae0f639bf414a2f865b84e8f1c052a8, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:53.939755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ccdb37-1290-4b92-b4d9-3b9b08482dd0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:53.956210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e6eb0f0e-0e72-484b-9c77-16882c07fda0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:53.957592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e6eb0f0e-0e72-484b-9c77-16882c07fda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:53.958351 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3362/6684] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:53 2022] PUT /identity/v3/projects/4ea3bca573484cc7a7616cc9ab410db3/users/9ae0f639bf414a2f865b84e8f1c052a8/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:26:53.969911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07be8a0-4327-4c16-93b6-bb957ee6f7bc None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:53.970258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07be8a0-4327-4c16-93b6-bb957ee6f7bc None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:53.970648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07be8a0-4327-4c16-93b6-bb957ee6f7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:54.001514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a07be8a0-4327-4c16-93b6-bb957ee6f7bc None None] MFA Rules not processed for user `9ae0f639bf414a2f865b84e8f1c052a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:54.003781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a07be8a0-4327-4c16-93b6-bb957ee6f7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:54.032256 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3323/6685] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:26:54.034186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb0f0e-0e72-484b-9c77-16882c07fda0 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:54.043995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb0f0e-0e72-484b-9c77-16882c07fda0 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:54.049390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d39bdf-3e3d-4955-86d2-5ed44f7d39cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:54.050062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d39bdf-3e3d-4955-86d2-5ed44f7d39cd admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:54.050341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d39bdf-3e3d-4955-86d2-5ed44f7d39cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:54.050615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d39bdf-3e3d-4955-86d2-5ed44f7d39cd admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:54.051342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d39bdf-3e3d-4955-86d2-5ed44f7d39cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:26:54.051649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d39bdf-3e3d-4955-86d2-5ed44f7d39cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:54.053668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d39bdf-3e3d-4955-86d2-5ed44f7d39cd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:54.067039 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3324/6686] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:26:54.070985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d39bdf-3e3d-4955-86d2-5ed44f7d39cd admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:54.081431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d39bdf-3e3d-4955-86d2-5ed44f7d39cd admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:54.086989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b6d80-ced6-4fa4-9511-82e728122d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:54.087649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b6d80-ced6-4fa4-9511-82e728122d8c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:54.087927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b6d80-ced6-4fa4-9511-82e728122d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:54.088245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b6d80-ced6-4fa4-9511-82e728122d8c admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:54.094899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b6d80-ced6-4fa4-9511-82e728122d8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:54.094899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b6d80-ced6-4fa4-9511-82e728122d8c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:54.104078 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3363/6687] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:54.108659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07be8a0-4327-4c16-93b6-bb957ee6f7bc None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:54.122349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07be8a0-4327-4c16-93b6-bb957ee6f7bc None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:54.123164 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3325/6688] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:26:54 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:26:54.127556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b6d80-ced6-4fa4-9511-82e728122d8c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:54.186533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ecc51-bdf3-4bda-bc0a-7d5ff0223755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:54.187215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ecc51-bdf3-4bda-bc0a-7d5ff0223755 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:54.187495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ecc51-bdf3-4bda-bc0a-7d5ff0223755 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:54.187770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ecc51-bdf3-4bda-bc0a-7d5ff0223755 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:54.189167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ecc51-bdf3-4bda-bc0a-7d5ff0223755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:54.191335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ecc51-bdf3-4bda-bc0a-7d5ff0223755 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:54.199358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b6d80-ced6-4fa4-9511-82e728122d8c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:54.206319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694c726-25e5-4648-abb1-269b0a4f8cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:54.207242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694c726-25e5-4648-abb1-269b0a4f8cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:54.207589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694c726-25e5-4648-abb1-269b0a4f8cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:54.207925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694c726-25e5-4648-abb1-269b0a4f8cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:54.209097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694c726-25e5-4648-abb1-269b0a4f8cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:54.211785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694c726-25e5-4648-abb1-269b0a4f8cf9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:54.217681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:54.229580 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3364/6689] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:26:54 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:54.232966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ecc51-bdf3-4bda-bc0a-7d5ff0223755 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:54.238234 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3326/6690] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:26:54 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:26:54.242424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694c726-25e5-4648-abb1-269b0a4f8cf9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:54.253361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694c726-25e5-4648-abb1-269b0a4f8cf9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:54.277160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:54.306827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ecc51-bdf3-4bda-bc0a-7d5ff0223755 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:54.312854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0c210-05ed-4080-a9e6-8517d328d62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:54.314083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0c210-05ed-4080-a9e6-8517d328d62b admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:54.314083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0c210-05ed-4080-a9e6-8517d328d62b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:54.314289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0c210-05ed-4080-a9e6-8517d328d62b admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:54.314942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0c210-05ed-4080-a9e6-8517d328d62b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:54.316968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0c210-05ed-4080-a9e6-8517d328d62b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:54.322843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b86336-5123-431c-9958-101b44e00a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:54.324746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b86336-5123-431c-9958-101b44e00a71 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:54.325032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b86336-5123-431c-9958-101b44e00a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:54.325318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b86336-5123-431c-9958-101b44e00a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:54.326053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b86336-5123-431c-9958-101b44e00a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:54.327736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b86336-5123-431c-9958-101b44e00a71 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:54.345688 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3327/6691] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:26:54.350397 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3365/6692] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:26:54 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:26:54.352091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b86336-5123-431c-9958-101b44e00a71 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:54.357918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0c210-05ed-4080-a9e6-8517d328d62b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:54.362769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b86336-5123-431c-9958-101b44e00a71 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:54.369402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334fa69-c003-4a33-9bd8-8fb3a829b41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:54.370348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334fa69-c003-4a33-9bd8-8fb3a829b41d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:54.370809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334fa69-c003-4a33-9bd8-8fb3a829b41d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:54.371221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334fa69-c003-4a33-9bd8-8fb3a829b41d admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:54.372203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334fa69-c003-4a33-9bd8-8fb3a829b41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:54.374178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334fa69-c003-4a33-9bd8-8fb3a829b41d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:54.375124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0c210-05ed-4080-a9e6-8517d328d62b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:54.382223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d29971-5c79-4146-8ad3-d8a5ca7a61ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:54.383000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d29971-5c79-4146-8ad3-d8a5ca7a61ef admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:54.383430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d29971-5c79-4146-8ad3-d8a5ca7a61ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:54.383915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d29971-5c79-4146-8ad3-d8a5ca7a61ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:54.384751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d29971-5c79-4146-8ad3-d8a5ca7a61ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:54.386786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d29971-5c79-4146-8ad3-d8a5ca7a61ef admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:54.392200 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3328/6693] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:54.396475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334fa69-c003-4a33-9bd8-8fb3a829b41d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:54.406958 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3366/6694] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:54.408994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334fa69-c003-4a33-9bd8-8fb3a829b41d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:54.410616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d29971-5c79-4146-8ad3-d8a5ca7a61ef admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:54.414491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef219b02-c4eb-4c1a-b7a4-0f8da8cc79e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:54.415502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef219b02-c4eb-4c1a-b7a4-0f8da8cc79e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:54.415778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef219b02-c4eb-4c1a-b7a4-0f8da8cc79e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:54.416071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef219b02-c4eb-4c1a-b7a4-0f8da8cc79e3 admin admin] PATH_INFO: `/v3/projects/18bb6db6102b4d9f87530f9a71b78db0/users/9cf49b6497cd4485bee8253300a1ff96/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:54.422786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d29971-5c79-4146-8ad3-d8a5ca7a61ef admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:54.428180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da25c7a-e788-4dbf-ae4d-a6a5280ec386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:54.429189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da25c7a-e788-4dbf-ae4d-a6a5280ec386 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:54.429584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da25c7a-e788-4dbf-ae4d-a6a5280ec386 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:54.430143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da25c7a-e788-4dbf-ae4d-a6a5280ec386 admin admin] PATH_INFO: `/v3/projects/ba810512a08e44d88cc99dfab99d15a2/users/6bf228011b6049659c1488a177c8f276/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:54.445070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef219b02-c4eb-4c1a-b7a4-0f8da8cc79e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18bb6db6102b4d9f87530f9a71b78db0, user_id=9cf49b6497cd4485bee8253300a1ff96, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:54.448073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef219b02-c4eb-4c1a-b7a4-0f8da8cc79e3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:54.448661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da25c7a-e788-4dbf-ae4d-a6a5280ec386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba810512a08e44d88cc99dfab99d15a2, user_id=6bf228011b6049659c1488a177c8f276, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:54.451621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da25c7a-e788-4dbf-ae4d-a6a5280ec386 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:54.482159 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3329/6696] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:54 2022] PUT /identity/v3/projects/18bb6db6102b4d9f87530f9a71b78db0/users/9cf49b6497cd4485bee8253300a1ff96/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:54.484127 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3367/6696] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:54 2022] PUT /identity/v3/projects/ba810512a08e44d88cc99dfab99d15a2/users/6bf228011b6049659c1488a177c8f276/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:54.485952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef219b02-c4eb-4c1a-b7a4-0f8da8cc79e3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:54.487904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89a91f-c65a-4718-bbdc-25db8b6a52c2 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:54.488667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89a91f-c65a-4718-bbdc-25db8b6a52c2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:54.488667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89a91f-c65a-4718-bbdc-25db8b6a52c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:54.514776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0e89a91f-c65a-4718-bbdc-25db8b6a52c2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:54.516070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0e89a91f-c65a-4718-bbdc-25db8b6a52c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:54.577639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef219b02-c4eb-4c1a-b7a4-0f8da8cc79e3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:54.596206 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3368/6697] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:54.603176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89a91f-c65a-4718-bbdc-25db8b6a52c2 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:54.604914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0e89a91f-c65a-4718-bbdc-25db8b6a52c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:54.647973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc84f3f-3b7c-4932-a680-1d7b6449b702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:54.648715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc84f3f-3b7c-4932-a680-1d7b6449b702 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:54.649002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc84f3f-3b7c-4932-a680-1d7b6449b702 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:54.649925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc84f3f-3b7c-4932-a680-1d7b6449b702 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:54.650668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc84f3f-3b7c-4932-a680-1d7b6449b702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:54.654127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc84f3f-3b7c-4932-a680-1d7b6449b702 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:54.667942 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3330/6698] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:26:54.672402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc84f3f-3b7c-4932-a680-1d7b6449b702 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:54.684983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89a91f-c65a-4718-bbdc-25db8b6a52c2 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:54.690445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2e351-5c9b-44ca-8e87-96f3d86065be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:54.691176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2e351-5c9b-44ca-8e87-96f3d86065be service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:54.691528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2e351-5c9b-44ca-8e87-96f3d86065be service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:54.691858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2e351-5c9b-44ca-8e87-96f3d86065be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:54.694546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc84f3f-3b7c-4932-a680-1d7b6449b702 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:54.702747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2e351-5c9b-44ca-8e87-96f3d86065be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:54.704576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2e351-5c9b-44ca-8e87-96f3d86065be service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:54.709921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c84b8-a9de-4628-8221-97e1af37286d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:54.711226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c84b8-a9de-4628-8221-97e1af37286d admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:54.711714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c84b8-a9de-4628-8221-97e1af37286d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:54.712241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c84b8-a9de-4628-8221-97e1af37286d admin admin] PATH_INFO: `/v3/projects/ba810512a08e44d88cc99dfab99d15a2/users/6bf228011b6049659c1488a177c8f276/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:54.714619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c84b8-a9de-4628-8221-97e1af37286d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba810512a08e44d88cc99dfab99d15a2, user_id=6bf228011b6049659c1488a177c8f276, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:54.716570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:54.723633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c84b8-a9de-4628-8221-97e1af37286d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:54.727899 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3369/6699] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:26:54.741958 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3331/6700] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:54 2022] PUT /identity/v3/projects/ba810512a08e44d88cc99dfab99d15a2/users/6bf228011b6049659c1488a177c8f276/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:26:54.753029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fb0c0-eede-4239-907c-be235bc48562 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:54.753357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fb0c0-eede-4239-907c-be235bc48562 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:54.753559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fb0c0-eede-4239-907c-be235bc48562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:54.786499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-336fb0c0-eede-4239-907c-be235bc48562 None None] MFA Rules not processed for user `6bf228011b6049659c1488a177c8f276`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:54.789455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-336fb0c0-eede-4239-907c-be235bc48562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:54.896264 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3370/6701] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:26:54.900208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c84b8-a9de-4628-8221-97e1af37286d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:54.928056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:54.984244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c84b8-a9de-4628-8221-97e1af37286d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:54.989328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c955a-92ce-4efd-8da6-368fed23b7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:54.989999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c955a-92ce-4efd-8da6-368fed23b7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:54.990277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c955a-92ce-4efd-8da6-368fed23b7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:54.990748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c955a-92ce-4efd-8da6-368fed23b7c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:54.991484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c955a-92ce-4efd-8da6-368fed23b7c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:54.993410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c955a-92ce-4efd-8da6-368fed23b7c3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:55.033831 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3332/6702] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:26:54 2022] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:55.035537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fb0c0-eede-4239-907c-be235bc48562 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:55.047611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fb0c0-eede-4239-907c-be235bc48562 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:55.149731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252036a-7837-4739-a928-e8f17e0f60a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:55.150735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252036a-7837-4739-a928-e8f17e0f60a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:55.151178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252036a-7837-4739-a928-e8f17e0f60a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:55.151612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252036a-7837-4739-a928-e8f17e0f60a9 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:55.152557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252036a-7837-4739-a928-e8f17e0f60a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:55.154686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252036a-7837-4739-a928-e8f17e0f60a9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:55.185249 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3371/6703] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:26:55 2022] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:55.189090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c955a-92ce-4efd-8da6-368fed23b7c3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:55.200592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c955a-92ce-4efd-8da6-368fed23b7c3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:55.207257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a87e3e-2f31-4316-a58e-dd53e0c7d562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:55.208261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a87e3e-2f31-4316-a58e-dd53e0c7d562 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:55.208629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a87e3e-2f31-4316-a58e-dd53e0c7d562 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:55.209113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a87e3e-2f31-4316-a58e-dd53e0c7d562 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:55.209941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a87e3e-2f31-4316-a58e-dd53e0c7d562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:55.211777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a87e3e-2f31-4316-a58e-dd53e0c7d562 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:55.224374 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3333/6704] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:55.228405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252036a-7837-4739-a928-e8f17e0f60a9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:55.242104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252036a-7837-4739-a928-e8f17e0f60a9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:55.250627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbd28b-3a19-4e73-bfb9-8ea54c88389f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:55.251863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbd28b-3a19-4e73-bfb9-8ea54c88389f admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:55.252902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbd28b-3a19-4e73-bfb9-8ea54c88389f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:55.253346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbd28b-3a19-4e73-bfb9-8ea54c88389f admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:55.254703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbd28b-3a19-4e73-bfb9-8ea54c88389f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:55.257354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbd28b-3a19-4e73-bfb9-8ea54c88389f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:55.284811 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3372/6705] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:55.285653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a87e3e-2f31-4316-a58e-dd53e0c7d562 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:55.302044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a87e3e-2f31-4316-a58e-dd53e0c7d562 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:55.312311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139a4b1-88a6-4aab-952f-6022cc0fb272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:55.313317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139a4b1-88a6-4aab-952f-6022cc0fb272 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:55.313706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139a4b1-88a6-4aab-952f-6022cc0fb272 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:55.314103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139a4b1-88a6-4aab-952f-6022cc0fb272 admin admin] PATH_INFO: `/v3/projects/e74a5f2fe8464b79b6697006664a8764/users/71d833e978824becbbfdda39ac83aa8f/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:55.330713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139a4b1-88a6-4aab-952f-6022cc0fb272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74a5f2fe8464b79b6697006664a8764, user_id=71d833e978824becbbfdda39ac83aa8f, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:55.334117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139a4b1-88a6-4aab-952f-6022cc0fb272 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:55.354034 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3334/6706] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:55 2022] PUT /identity/v3/projects/e74a5f2fe8464b79b6697006664a8764/users/71d833e978824becbbfdda39ac83aa8f/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:26:55.365481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c0ee5-e60b-4742-96bf-c4f0d425dcd4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:55.365889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c0ee5-e60b-4742-96bf-c4f0d425dcd4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:55.366343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c0ee5-e60b-4742-96bf-c4f0d425dcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:55.399086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9f6c0ee5-e60b-4742-96bf-c4f0d425dcd4 None None] MFA Rules not processed for user `71d833e978824becbbfdda39ac83aa8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:26:55.401744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9f6c0ee5-e60b-4742-96bf-c4f0d425dcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:55.485140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:55.530325 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3373/6707] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:26:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:26:55.535566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139a4b1-88a6-4aab-952f-6022cc0fb272 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:55.634740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139a4b1-88a6-4aab-952f-6022cc0fb272 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:55.640394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf796c9c-f701-4955-8fd1-7453db673c2a tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:55.641091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf796c9c-f701-4955-8fd1-7453db673c2a tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:55.641466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf796c9c-f701-4955-8fd1-7453db673c2a tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:55.641871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf796c9c-f701-4955-8fd1-7453db673c2a tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:55.642791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf796c9c-f701-4955-8fd1-7453db673c2a tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:55.644705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf796c9c-f701-4955-8fd1-7453db673c2a tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:55.668370 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3335/6708] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:26:55 2022] POST /identity/v3/domains => generated 276 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:55.672678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c0ee5-e60b-4742-96bf-c4f0d425dcd4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:55.686396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c0ee5-e60b-4742-96bf-c4f0d425dcd4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:55.787668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41ece5-e7f4-455f-a196-6ea40266c319 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:55.788398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41ece5-e7f4-455f-a196-6ea40266c319 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:55.788661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41ece5-e7f4-455f-a196-6ea40266c319 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:55.788938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41ece5-e7f4-455f-a196-6ea40266c319 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:55.789684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41ece5-e7f4-455f-a196-6ea40266c319 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:55.791309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41ece5-e7f4-455f-a196-6ea40266c319 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:55.819318 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3374/6709] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:26:55 2022] POST /identity/v3/roles => generated 239 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:55.822844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf796c9c-f701-4955-8fd1-7453db673c2a tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:55.833787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf796c9c-f701-4955-8fd1-7453db673c2a tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:55.841828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b926a-1b10-4e0d-a3d5-e641b4e14683 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:55.843579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b926a-1b10-4e0d-a3d5-e641b4e14683 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:55.843958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b926a-1b10-4e0d-a3d5-e641b4e14683 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:55.844368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b926a-1b10-4e0d-a3d5-e641b4e14683 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/b31bfbe0b16a46859e5bfe25cc5c9575/users/71d833e978824becbbfdda39ac83aa8f/roles/7f236192b8704d7fabeadd646cd531db` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:55.860526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b926a-1b10-4e0d-a3d5-e641b4e14683 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=b31bfbe0b16a46859e5bfe25cc5c9575, user_id=71d833e978824becbbfdda39ac83aa8f, role_id=7f236192b8704d7fabeadd646cd531db)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:55.864893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b926a-1b10-4e0d-a3d5-e641b4e14683 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:55.888218 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3336/6710] 10.222.0.43 () {60 vars in 1479 bytes} [Sat Jul 2 21:26:55 2022] PUT /identity/v3/domains/b31bfbe0b16a46859e5bfe25cc5c9575/users/71d833e978824becbbfdda39ac83aa8f/roles/7f236192b8704d7fabeadd646cd531db => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:26:55.892222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41ece5-e7f4-455f-a196-6ea40266c319 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:55.903069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41ece5-e7f4-455f-a196-6ea40266c319 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:56.008453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443b222-5295-42ed-b7c3-e5049743f562 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:56.009716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443b222-5295-42ed-b7c3-e5049743f562 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:56.009716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443b222-5295-42ed-b7c3-e5049743f562 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:56.010106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443b222-5295-42ed-b7c3-e5049743f562 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:56.010999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443b222-5295-42ed-b7c3-e5049743f562 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:56.013633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443b222-5295-42ed-b7c3-e5049743f562 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:56.037215 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3375/6711] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:26:55 2022] POST /identity/v3/domains => generated 276 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:56.039225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b926a-1b10-4e0d-a3d5-e641b4e14683 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:56.056503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b926a-1b10-4e0d-a3d5-e641b4e14683 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:56.115374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:56.168058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028514e4-f33f-487f-9300-28ba4c167b01 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:56.168773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028514e4-f33f-487f-9300-28ba4c167b01 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:56.169063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028514e4-f33f-487f-9300-28ba4c167b01 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:56.169586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028514e4-f33f-487f-9300-28ba4c167b01 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:56.171591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028514e4-f33f-487f-9300-28ba4c167b01 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:56.173712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028514e4-f33f-487f-9300-28ba4c167b01 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:56.198031 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3337/6712] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:26:56 2022] POST /identity/v3/roles => generated 240 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:26:56.202499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443b222-5295-42ed-b7c3-e5049743f562 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:56.218128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443b222-5295-42ed-b7c3-e5049743f562 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:56.225408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac47b8-ede2-4b6a-aa70-7b76bf496769 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:56.226394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac47b8-ede2-4b6a-aa70-7b76bf496769 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:56.227320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac47b8-ede2-4b6a-aa70-7b76bf496769 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:56.227849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac47b8-ede2-4b6a-aa70-7b76bf496769 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/groups` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:56.228631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac47b8-ede2-4b6a-aa70-7b76bf496769 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:56.231062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac47b8-ede2-4b6a-aa70-7b76bf496769 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:56.268585 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3376/6713] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:26:56 2022] POST /identity/v3/groups => generated 327 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:56.273168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028514e4-f33f-487f-9300-28ba4c167b01 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:56.285178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028514e4-f33f-487f-9300-28ba4c167b01 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:56.290822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa814cc-f14f-4b13-869e-587fe1aa53da tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:56.291949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa814cc-f14f-4b13-869e-587fe1aa53da tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:56.292360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa814cc-f14f-4b13-869e-587fe1aa53da tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:56.292731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa814cc-f14f-4b13-869e-587fe1aa53da tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/groups/7f058d1ff24b47ae904b081df650ef0c/users/71d833e978824becbbfdda39ac83aa8f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:56.301356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa814cc-f14f-4b13-869e-587fe1aa53da tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=7f058d1ff24b47ae904b081df650ef0c, user_id=71d833e978824becbbfdda39ac83aa8f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:56.302935 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-8fa814cc-f14f-4b13-869e-587fe1aa53da tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:56.302935 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:26:56.302935 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:26:56.304537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa814cc-f14f-4b13-869e-587fe1aa53da tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:56.345415 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3338/6714] 10.222.0.43 () {60 vars in 1359 bytes} [Sat Jul 2 21:26:56 2022] PUT /identity/v3/groups/7f058d1ff24b47ae904b081df650ef0c/users/71d833e978824becbbfdda39ac83aa8f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:26:56.350374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac47b8-ede2-4b6a-aa70-7b76bf496769 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:56.361539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac47b8-ede2-4b6a-aa70-7b76bf496769 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:56.440404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:56.449891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281aa3ff-4bf7-45dc-825b-ed8f3ebd8411 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:56.451236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281aa3ff-4bf7-45dc-825b-ed8f3ebd8411 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:56.451979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281aa3ff-4bf7-45dc-825b-ed8f3ebd8411 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:56.452430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281aa3ff-4bf7-45dc-825b-ed8f3ebd8411 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/491da46e026540ae8ccda1ec04fcc9bd/groups/7f058d1ff24b47ae904b081df650ef0c/roles/998122826d3e48a2903a3a9e5ee7eafc` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:56.455711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281aa3ff-4bf7-45dc-825b-ed8f3ebd8411 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=491da46e026540ae8ccda1ec04fcc9bd, group_id=7f058d1ff24b47ae904b081df650ef0c, role_id=998122826d3e48a2903a3a9e5ee7eafc)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:56.460484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281aa3ff-4bf7-45dc-825b-ed8f3ebd8411 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:56.485816 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3377/6715] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:56 2022] PUT /identity/v3/domains/491da46e026540ae8ccda1ec04fcc9bd/groups/7f058d1ff24b47ae904b081df650ef0c/roles/998122826d3e48a2903a3a9e5ee7eafc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:56.491632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa814cc-f14f-4b13-869e-587fe1aa53da tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:56.508187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa814cc-f14f-4b13-869e-587fe1aa53da tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:56.613067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff379e2-8099-4679-8ead-ccdb326e1bc2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:56.617496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff379e2-8099-4679-8ead-ccdb326e1bc2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:56.618221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff379e2-8099-4679-8ead-ccdb326e1bc2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:56.618378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff379e2-8099-4679-8ead-ccdb326e1bc2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:56.619407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff379e2-8099-4679-8ead-ccdb326e1bc2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:56.625342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff379e2-8099-4679-8ead-ccdb326e1bc2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:56.662603 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3339/6716] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:26:56 2022] POST /identity/v3/domains => generated 275 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:56.663473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281aa3ff-4bf7-45dc-825b-ed8f3ebd8411 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:56.686835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281aa3ff-4bf7-45dc-825b-ed8f3ebd8411 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:56.800495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75911d2b-d768-4ef9-8319-39dbd7f30e3f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:56.802161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75911d2b-d768-4ef9-8319-39dbd7f30e3f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:56.804346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75911d2b-d768-4ef9-8319-39dbd7f30e3f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:56.804639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75911d2b-d768-4ef9-8319-39dbd7f30e3f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:56.805421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75911d2b-d768-4ef9-8319-39dbd7f30e3f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:56.817584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75911d2b-d768-4ef9-8319-39dbd7f30e3f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:56.868659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff379e2-8099-4679-8ead-ccdb326e1bc2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:56.868889 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3378/6717] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:26:56 2022] POST /identity/v3/roles => generated 240 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:56.880544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff379e2-8099-4679-8ead-ccdb326e1bc2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:56.886233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67a172-83b1-4f97-be9d-5029e595cafc tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:56.887306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67a172-83b1-4f97-be9d-5029e595cafc tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:56.887700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67a172-83b1-4f97-be9d-5029e595cafc tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:56.888620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67a172-83b1-4f97-be9d-5029e595cafc tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/0b1ae12dc03243f18c5363b0b9d82ef2/users/71d833e978824becbbfdda39ac83aa8f/roles/6f70ac04e2b946aeb2e626b5f1343bf4` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:56.920313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67a172-83b1-4f97-be9d-5029e595cafc tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0b1ae12dc03243f18c5363b0b9d82ef2, user_id=71d833e978824becbbfdda39ac83aa8f, role_id=6f70ac04e2b946aeb2e626b5f1343bf4)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:56.924390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67a172-83b1-4f97-be9d-5029e595cafc tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:56.958810 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3340/6718] 10.222.0.43 () {60 vars in 1479 bytes} [Sat Jul 2 21:26:56 2022] PUT /identity/v3/domains/0b1ae12dc03243f18c5363b0b9d82ef2/users/71d833e978824becbbfdda39ac83aa8f/roles/6f70ac04e2b946aeb2e626b5f1343bf4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:56.962938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75911d2b-d768-4ef9-8319-39dbd7f30e3f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:56.978345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75911d2b-d768-4ef9-8319-39dbd7f30e3f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:57.120871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fce9cb-5b81-46fe-b58f-9a2c3c98ab24 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:57.121568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fce9cb-5b81-46fe-b58f-9a2c3c98ab24 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:57.121858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fce9cb-5b81-46fe-b58f-9a2c3c98ab24 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:57.122135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fce9cb-5b81-46fe-b58f-9a2c3c98ab24 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:57.122890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fce9cb-5b81-46fe-b58f-9a2c3c98ab24 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:57.124572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fce9cb-5b81-46fe-b58f-9a2c3c98ab24 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:57.144722 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3379/6719] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:26:56 2022] POST /identity/v3/domains => generated 277 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:57.149658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67a172-83b1-4f97-be9d-5029e595cafc tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:57.162025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67a172-83b1-4f97-be9d-5029e595cafc tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:57.236475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c1f53-5df5-46e4-9830-ce73a28e6d3d tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:57.237305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c1f53-5df5-46e4-9830-ce73a28e6d3d tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:57.237690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c1f53-5df5-46e4-9830-ce73a28e6d3d tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:57.238071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c1f53-5df5-46e4-9830-ce73a28e6d3d tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:57.241647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c1f53-5df5-46e4-9830-ce73a28e6d3d tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:57.243274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c1f53-5df5-46e4-9830-ce73a28e6d3d tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:57.277453 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3341/6720] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:26:57 2022] POST /identity/v3/roles => generated 240 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:57.277649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fce9cb-5b81-46fe-b58f-9a2c3c98ab24 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:57.295625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fce9cb-5b81-46fe-b58f-9a2c3c98ab24 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:57.303702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19243e5c-b6ee-4eb4-b2a4-db425726191e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:57.304549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19243e5c-b6ee-4eb4-b2a4-db425726191e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:57.305294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19243e5c-b6ee-4eb4-b2a4-db425726191e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:57.306406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19243e5c-b6ee-4eb4-b2a4-db425726191e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/groups` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:57.307231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19243e5c-b6ee-4eb4-b2a4-db425726191e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:57.310004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19243e5c-b6ee-4eb4-b2a4-db425726191e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:57.352749 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3380/6721] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:26:57 2022] POST /identity/v3/groups => generated 325 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:26:57.358777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c1f53-5df5-46e4-9830-ce73a28e6d3d tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:57.379112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c1f53-5df5-46e4-9830-ce73a28e6d3d tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:57.389185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afb6b8-6b28-4b65-b7bb-b8198f11fae9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:57.391055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afb6b8-6b28-4b65-b7bb-b8198f11fae9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:57.391370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afb6b8-6b28-4b65-b7bb-b8198f11fae9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:57.392245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afb6b8-6b28-4b65-b7bb-b8198f11fae9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/groups/71299e2d5f274193bef4e11b94dca715/users/71d833e978824becbbfdda39ac83aa8f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:57.398627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15afb6b8-6b28-4b65-b7bb-b8198f11fae9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=71299e2d5f274193bef4e11b94dca715, user_id=71d833e978824becbbfdda39ac83aa8f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:57.401002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15afb6b8-6b28-4b65-b7bb-b8198f11fae9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:57.402693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:57.450634 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3342/6722] 10.222.0.43 () {60 vars in 1359 bytes} [Sat Jul 2 21:26:57 2022] PUT /identity/v3/groups/71299e2d5f274193bef4e11b94dca715/users/71d833e978824becbbfdda39ac83aa8f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:57.454865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19243e5c-b6ee-4eb4-b2a4-db425726191e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:57.466903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19243e5c-b6ee-4eb4-b2a4-db425726191e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:57.559268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:57.567284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb79ef4-28a8-4fa0-ad2e-670af46c4ac4 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:57.568551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79ef4-28a8-4fa0-ad2e-670af46c4ac4 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:57.569263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79ef4-28a8-4fa0-ad2e-670af46c4ac4 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:57.569614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79ef4-28a8-4fa0-ad2e-670af46c4ac4 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/0f42e975bcb14c6aa1358174ea07cc31/groups/71299e2d5f274193bef4e11b94dca715/roles/f12e3cd2bd9c4ac2a0457cfb4a4e1d96` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:57.572753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb79ef4-28a8-4fa0-ad2e-670af46c4ac4 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0f42e975bcb14c6aa1358174ea07cc31, group_id=71299e2d5f274193bef4e11b94dca715, role_id=f12e3cd2bd9c4ac2a0457cfb4a4e1d96)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:57.575521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb79ef4-28a8-4fa0-ad2e-670af46c4ac4 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:57.605030 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3381/6723] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:26:57 2022] PUT /identity/v3/domains/0f42e975bcb14c6aa1358174ea07cc31/groups/71299e2d5f274193bef4e11b94dca715/roles/f12e3cd2bd9c4ac2a0457cfb4a4e1d96 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:57.610208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afb6b8-6b28-4b65-b7bb-b8198f11fae9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:57.845007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afb6b8-6b28-4b65-b7bb-b8198f11fae9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:58.041731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7130d5-32fe-48b0-958d-baa641608736 tempest-TokensV3TestJSON-1891804793 tempest-TokensV3TestJSON-1891804793-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71d833e978824becbbfdda39ac83aa8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e74a5f2fe8464b79b6697006664a8764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:58.041731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7130d5-32fe-48b0-958d-baa641608736 tempest-TokensV3TestJSON-1891804793 tempest-TokensV3TestJSON-1891804793-project] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:58.042042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7130d5-32fe-48b0-958d-baa641608736 tempest-TokensV3TestJSON-1891804793 tempest-TokensV3TestJSON-1891804793-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:58.042293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7130d5-32fe-48b0-958d-baa641608736 tempest-TokensV3TestJSON-1891804793 tempest-TokensV3TestJSON-1891804793-project] PATH_INFO: `/v3/auth/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:58.042965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7130d5-32fe-48b0-958d-baa641608736 tempest-TokensV3TestJSON-1891804793 tempest-TokensV3TestJSON-1891804793-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:58.044084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7130d5-32fe-48b0-958d-baa641608736 tempest-TokensV3TestJSON-1891804793 tempest-TokensV3TestJSON-1891804793-project] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:58.129235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:58.187674 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3343/6724] 10.222.0.43 () {58 vars in 1142 bytes} [Sat Jul 2 21:26:57 2022] GET /identity/v3/auth/domains => generated 1172 bytes in 578 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:26:58.188563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb79ef4-28a8-4fa0-ad2e-670af46c4ac4 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:58.283073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb79ef4-28a8-4fa0-ad2e-670af46c4ac4 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:58.290679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b887d68-dc6b-47c8-9e0a-f3d222dcaf02 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:58.292013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b887d68-dc6b-47c8-9e0a-f3d222dcaf02 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:58.292228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b887d68-dc6b-47c8-9e0a-f3d222dcaf02 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:58.293222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b887d68-dc6b-47c8-9e0a-f3d222dcaf02 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/0f42e975bcb14c6aa1358174ea07cc31/groups/71299e2d5f274193bef4e11b94dca715/roles/f12e3cd2bd9c4ac2a0457cfb4a4e1d96` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:58.297393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b887d68-dc6b-47c8-9e0a-f3d222dcaf02 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0f42e975bcb14c6aa1358174ea07cc31, group_id=71299e2d5f274193bef4e11b94dca715, role_id=f12e3cd2bd9c4ac2a0457cfb4a4e1d96)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:58.312459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b887d68-dc6b-47c8-9e0a-f3d222dcaf02 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:58.327225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0b887d68-dc6b-47c8-9e0a-f3d222dcaf02 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invalidating the token cache because role f12e3cd2bd9c4ac2a0457cfb4a4e1d96 was removed from group 71299e2d5f274193bef4e11b94dca715 on domain 0f42e975bcb14c6aa1358174ea07cc31. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:26:58.327518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0b887d68-dc6b-47c8-9e0a-f3d222dcaf02 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:58.328306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0b887d68-dc6b-47c8-9e0a-f3d222dcaf02 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:58.346270 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3382/6725] 10.222.0.43 () {58 vars in 1466 bytes} [Sat Jul 2 21:26:58 2022] DELETE /identity/v3/domains/0f42e975bcb14c6aa1358174ea07cc31/groups/71299e2d5f274193bef4e11b94dca715/roles/f12e3cd2bd9c4ac2a0457cfb4a4e1d96 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:26:58.351444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7130d5-32fe-48b0-958d-baa641608736 tempest-TokensV3TestJSON-1891804793 tempest-TokensV3TestJSON-1891804793-project] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:58.353611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-be7130d5-32fe-48b0-958d-baa641608736 tempest-TokensV3TestJSON-1891804793 tempest-TokensV3TestJSON-1891804793-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:58.380291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7130d5-32fe-48b0-958d-baa641608736 tempest-TokensV3TestJSON-1891804793 tempest-TokensV3TestJSON-1891804793-project] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:58.486124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec843e-b39f-460b-b763-204610efeaaa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:58.487780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec843e-b39f-460b-b763-204610efeaaa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:58.488299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec843e-b39f-460b-b763-204610efeaaa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:58.489495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec843e-b39f-460b-b763-204610efeaaa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/groups/71299e2d5f274193bef4e11b94dca715/users/71d833e978824becbbfdda39ac83aa8f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:58.491660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec843e-b39f-460b-b763-204610efeaaa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=71299e2d5f274193bef4e11b94dca715, user_id=71d833e978824becbbfdda39ac83aa8f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:58.493420 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-b1ec843e-b39f-460b-b763-204610efeaaa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:58.493420 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:26:58.493420 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:26:58.495107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec843e-b39f-460b-b763-204610efeaaa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:58.511789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b1ec843e-b39f-460b-b763-204610efeaaa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '71d833e978824becbbfdda39ac83aa8f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:58.553275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b887d68-dc6b-47c8-9e0a-f3d222dcaf02 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:58.559894 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3344/6726] 10.222.0.43 () {58 vars in 1343 bytes} [Sat Jul 2 21:26:58 2022] DELETE /identity/v3/groups/71299e2d5f274193bef4e11b94dca715/users/71d833e978824becbbfdda39ac83aa8f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:58.573805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b887d68-dc6b-47c8-9e0a-f3d222dcaf02 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:58.654009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62273c8b-1324-4722-90d3-5b0d026177cd tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:58.655000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62273c8b-1324-4722-90d3-5b0d026177cd tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:58.655391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62273c8b-1324-4722-90d3-5b0d026177cd tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:58.655768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62273c8b-1324-4722-90d3-5b0d026177cd tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/groups/71299e2d5f274193bef4e11b94dca715` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:58.657688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62273c8b-1324-4722-90d3-5b0d026177cd tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:delete_group(group_id=71299e2d5f274193bef4e11b94dca715)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:58.661090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62273c8b-1324-4722-90d3-5b0d026177cd tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:58.728080 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3383/6727] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:26:58 2022] DELETE /identity/v3/groups/71299e2d5f274193bef4e11b94dca715 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:58.729325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec843e-b39f-460b-b763-204610efeaaa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:58.748631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec843e-b39f-460b-b763-204610efeaaa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:58.865969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca55c6-1d14-4b25-9951-dadea70b7903 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:58.869195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca55c6-1d14-4b25-9951-dadea70b7903 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:58.869675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca55c6-1d14-4b25-9951-dadea70b7903 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:58.872178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca55c6-1d14-4b25-9951-dadea70b7903 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/roles/f12e3cd2bd9c4ac2a0457cfb4a4e1d96` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:58.875441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca55c6-1d14-4b25-9951-dadea70b7903 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f12e3cd2bd9c4ac2a0457cfb4a4e1d96)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:58.886010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca55c6-1d14-4b25-9951-dadea70b7903 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:58.938027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7eca55c6-1d14-4b25-9951-dadea70b7903 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invalidating the token cache because role f12e3cd2bd9c4ac2a0457cfb4a4e1d96 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:26:58.938605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7eca55c6-1d14-4b25-9951-dadea70b7903 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:58.939517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7eca55c6-1d14-4b25-9951-dadea70b7903 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:58.941909 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3345/6728] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:26:58 2022] DELETE /identity/v3/roles/f12e3cd2bd9c4ac2a0457cfb4a4e1d96 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:26:58.946392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62273c8b-1324-4722-90d3-5b0d026177cd tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:58.948293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-62273c8b-1324-4722-90d3-5b0d026177cd tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:58.962177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62273c8b-1324-4722-90d3-5b0d026177cd tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:58.983281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca55c6-1d14-4b25-9951-dadea70b7903 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:58.984890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7eca55c6-1d14-4b25-9951-dadea70b7903 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:59.015080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:59.039552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:59.043831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a9bbe-bc34-4ac1-8e4b-9e4b9bb1f153 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:59.044762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a9bbe-bc34-4ac1-8e4b-9e4b9bb1f153 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:59.047019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a9bbe-bc34-4ac1-8e4b-9e4b9bb1f153 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:59.047275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a9bbe-bc34-4ac1-8e4b-9e4b9bb1f153 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/0f42e975bcb14c6aa1358174ea07cc31` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:59.049139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a9bbe-bc34-4ac1-8e4b-9e4b9bb1f153 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0f42e975bcb14c6aa1358174ea07cc31)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:59.051821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a9bbe-bc34-4ac1-8e4b-9e4b9bb1f153 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:59.083063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca55c6-1d14-4b25-9951-dadea70b7903 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:59.083935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-892a9bbe-bc34-4ac1-8e4b-9e4b9bb1f153 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0f42e975bcb14c6aa1358174ea07cc31'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.086116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-892a9bbe-bc34-4ac1-8e4b-9e4b9bb1f153 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0f42e975bcb14c6aa1358174ea07cc31'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.087939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb70ec-0b90-480b-bfc1-6661c0d98bff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:59.089758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb70ec-0b90-480b-bfc1-6661c0d98bff service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:59.089758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb70ec-0b90-480b-bfc1-6661c0d98bff service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:59.089758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb70ec-0b90-480b-bfc1-6661c0d98bff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:59.093068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-20cb70ec-0b90-480b-bfc1-6661c0d98bff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:59.126975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-892a9bbe-bc34-4ac1-8e4b-9e4b9bb1f153 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0f42e975bcb14c6aa1358174ea07cc31'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.127620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-892a9bbe-bc34-4ac1-8e4b-9e4b9bb1f153 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0f42e975bcb14c6aa1358174ea07cc31'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.131734 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3384/6729] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:26:58 2022] PATCH /identity/v3/domains/0f42e975bcb14c6aa1358174ea07cc31 => generated 278 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:26:59.137613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a9bbe-bc34-4ac1-8e4b-9e4b9bb1f153 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:59.140201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-892a9bbe-bc34-4ac1-8e4b-9e4b9bb1f153 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:59.215767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb70ec-0b90-480b-bfc1-6661c0d98bff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:59.217421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb70ec-0b90-480b-bfc1-6661c0d98bff service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:59.242504 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3346/6730] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:26:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:26:59.257804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a9bbe-bc34-4ac1-8e4b-9e4b9bb1f153 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:59.265622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:59.267710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:59.268003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:59.268815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/0f42e975bcb14c6aa1358174ea07cc31` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:59.287243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0f42e975bcb14c6aa1358174ea07cc31)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:59.288965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:59.316362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0f42e975bcb14c6aa1358174ea07cc31'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.336349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0f42e975bcb14c6aa1358174ea07cc31'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.404221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f42e975bcb14c6aa1358174ea07cc31', 'request_id': 'req-1f51a02a-666e-4629-87fc-620e43d140eb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.418558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f42e975bcb14c6aa1358174ea07cc31', 'request_id': 'req-1f51a02a-666e-4629-87fc-620e43d140eb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.428455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f42e975bcb14c6aa1358174ea07cc31', 'request_id': 'req-1f51a02a-666e-4629-87fc-620e43d140eb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.441036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] The token cache is being invalidate because project 0f42e975bcb14c6aa1358174ea07cc31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:26:59.441603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.442438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.445223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:59.453567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0f42e975bcb14c6aa1358174ea07cc31', 'request_id': 'req-1f51a02a-666e-4629-87fc-620e43d140eb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.454850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0f42e975bcb14c6aa1358174ea07cc31', 'request_id': 'req-1f51a02a-666e-4629-87fc-620e43d140eb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.455716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0f42e975bcb14c6aa1358174ea07cc31', 'request_id': 'req-1f51a02a-666e-4629-87fc-620e43d140eb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.468682 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3385/6731] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:26:59 2022] DELETE /identity/v3/domains/0f42e975bcb14c6aa1358174ea07cc31 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:59.472968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb70ec-0b90-480b-bfc1-6661c0d98bff service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:59.474579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-20cb70ec-0b90-480b-bfc1-6661c0d98bff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:59.490201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb70ec-0b90-480b-bfc1-6661c0d98bff service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:59.555704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38211ff1-5c1b-4e5f-b174-5d7c8186b4f2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:59.556683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38211ff1-5c1b-4e5f-b174-5d7c8186b4f2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:59.557026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38211ff1-5c1b-4e5f-b174-5d7c8186b4f2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:59.557365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38211ff1-5c1b-4e5f-b174-5d7c8186b4f2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/0b1ae12dc03243f18c5363b0b9d82ef2/users/71d833e978824becbbfdda39ac83aa8f/roles/6f70ac04e2b946aeb2e626b5f1343bf4` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:59.560280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38211ff1-5c1b-4e5f-b174-5d7c8186b4f2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0b1ae12dc03243f18c5363b0b9d82ef2, user_id=71d833e978824becbbfdda39ac83aa8f, role_id=6f70ac04e2b946aeb2e626b5f1343bf4)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:59.563384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38211ff1-5c1b-4e5f-b174-5d7c8186b4f2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:59.570575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-38211ff1-5c1b-4e5f-b174-5d7c8186b4f2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invalidating the token cache because role 6f70ac04e2b946aeb2e626b5f1343bf4 was removed from user 71d833e978824becbbfdda39ac83aa8f on domain 0b1ae12dc03243f18c5363b0b9d82ef2. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:26:59.570949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-38211ff1-5c1b-4e5f-b174-5d7c8186b4f2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.571736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-38211ff1-5c1b-4e5f-b174-5d7c8186b4f2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.601577 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3347/6732] 10.222.0.43 () {58 vars in 1463 bytes} [Sat Jul 2 21:26:59 2022] DELETE /identity/v3/domains/0b1ae12dc03243f18c5363b0b9d82ef2/users/71d833e978824becbbfdda39ac83aa8f/roles/6f70ac04e2b946aeb2e626b5f1343bf4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:59.603190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:59.609389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:59.629857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51a02a-666e-4629-87fc-620e43d140eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:59.721680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcb547-b726-4974-930e-0de9efeb8f27 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:59.722667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcb547-b726-4974-930e-0de9efeb8f27 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:59.723040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcb547-b726-4974-930e-0de9efeb8f27 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:59.723388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcb547-b726-4974-930e-0de9efeb8f27 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/roles/6f70ac04e2b946aeb2e626b5f1343bf4` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:59.726770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcb547-b726-4974-930e-0de9efeb8f27 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6f70ac04e2b946aeb2e626b5f1343bf4)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:59.729847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcb547-b726-4974-930e-0de9efeb8f27 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:59.772613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d9dcb547-b726-4974-930e-0de9efeb8f27 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invalidating the token cache because role 6f70ac04e2b946aeb2e626b5f1343bf4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:26:59.773937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d9dcb547-b726-4974-930e-0de9efeb8f27 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.774848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d9dcb547-b726-4974-930e-0de9efeb8f27 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.781287 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3386/6733] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:26:59 2022] DELETE /identity/v3/roles/6f70ac04e2b946aeb2e626b5f1343bf4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:26:59.783517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38211ff1-5c1b-4e5f-b174-5d7c8186b4f2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:26:59.785450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-38211ff1-5c1b-4e5f-b174-5d7c8186b4f2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:26:59.801544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38211ff1-5c1b-4e5f-b174-5d7c8186b4f2 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:26:59.874183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822db0c-6c76-4448-83d0-8f8c49428dc3 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:26:59.875067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822db0c-6c76-4448-83d0-8f8c49428dc3 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:26:59.875631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822db0c-6c76-4448-83d0-8f8c49428dc3 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:26:59.880613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822db0c-6c76-4448-83d0-8f8c49428dc3 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/0b1ae12dc03243f18c5363b0b9d82ef2` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:26:59.882322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822db0c-6c76-4448-83d0-8f8c49428dc3 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0b1ae12dc03243f18c5363b0b9d82ef2)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:26:59.883995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822db0c-6c76-4448-83d0-8f8c49428dc3 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:26:59.893166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:59.924207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3822db0c-6c76-4448-83d0-8f8c49428dc3 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0b1ae12dc03243f18c5363b0b9d82ef2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:26:59.925523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3822db0c-6c76-4448-83d0-8f8c49428dc3 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0b1ae12dc03243f18c5363b0b9d82ef2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:00.009858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3822db0c-6c76-4448-83d0-8f8c49428dc3 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0b1ae12dc03243f18c5363b0b9d82ef2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:00.010535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3822db0c-6c76-4448-83d0-8f8c49428dc3 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0b1ae12dc03243f18c5363b0b9d82ef2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:00.016757 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3348/6734] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:26:59 2022] PATCH /identity/v3/domains/0b1ae12dc03243f18c5363b0b9d82ef2 => generated 276 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:27:00.017662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcb547-b726-4974-930e-0de9efeb8f27 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:00.019111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d9dcb547-b726-4974-930e-0de9efeb8f27 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:00.033439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcb547-b726-4974-930e-0de9efeb8f27 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:00.171579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:00.172745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:00.173169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:00.173580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/0b1ae12dc03243f18c5363b0b9d82ef2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:00.190652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0b1ae12dc03243f18c5363b0b9d82ef2)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:00.192607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:00.221609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0b1ae12dc03243f18c5363b0b9d82ef2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:00.236130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0b1ae12dc03243f18c5363b0b9d82ef2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:00.254461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=7,keystone:SELECT=93 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:00.294680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1ae12dc03243f18c5363b0b9d82ef2', 'request_id': 'req-74261725-c0cd-4614-a939-c185e0d5da67'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:00.307249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1ae12dc03243f18c5363b0b9d82ef2', 'request_id': 'req-74261725-c0cd-4614-a939-c185e0d5da67'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:00.315457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1ae12dc03243f18c5363b0b9d82ef2', 'request_id': 'req-74261725-c0cd-4614-a939-c185e0d5da67'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:00.330970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] The token cache is being invalidate because project 0b1ae12dc03243f18c5363b0b9d82ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:00.330970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:00.330970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:00.341751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0b1ae12dc03243f18c5363b0b9d82ef2', 'request_id': 'req-74261725-c0cd-4614-a939-c185e0d5da67'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:00.343244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0b1ae12dc03243f18c5363b0b9d82ef2', 'request_id': 'req-74261725-c0cd-4614-a939-c185e0d5da67'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:00.344327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0b1ae12dc03243f18c5363b0b9d82ef2', 'request_id': 'req-74261725-c0cd-4614-a939-c185e0d5da67'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:00.356853 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3387/6735] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:27:00 2022] DELETE /identity/v3/domains/0b1ae12dc03243f18c5363b0b9d82ef2 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:27:00.361194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822db0c-6c76-4448-83d0-8f8c49428dc3 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:00.362682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3822db0c-6c76-4448-83d0-8f8c49428dc3 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:00.385407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822db0c-6c76-4448-83d0-8f8c49428dc3 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:00.457669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd30b15-dc18-40a1-b630-5097981a287e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:00.458586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd30b15-dc18-40a1-b630-5097981a287e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:00.458887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd30b15-dc18-40a1-b630-5097981a287e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:00.459156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd30b15-dc18-40a1-b630-5097981a287e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/491da46e026540ae8ccda1ec04fcc9bd/groups/7f058d1ff24b47ae904b081df650ef0c/roles/998122826d3e48a2903a3a9e5ee7eafc` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:00.462500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd30b15-dc18-40a1-b630-5097981a287e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=491da46e026540ae8ccda1ec04fcc9bd, group_id=7f058d1ff24b47ae904b081df650ef0c, role_id=998122826d3e48a2903a3a9e5ee7eafc)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:00.466066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd30b15-dc18-40a1-b630-5097981a287e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:00.473031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dcd30b15-dc18-40a1-b630-5097981a287e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invalidating the token cache because role 998122826d3e48a2903a3a9e5ee7eafc was removed from group 7f058d1ff24b47ae904b081df650ef0c on domain 491da46e026540ae8ccda1ec04fcc9bd. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:00.474007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dcd30b15-dc18-40a1-b630-5097981a287e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:00.475411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dcd30b15-dc18-40a1-b630-5097981a287e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:00.499393 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3349/6736] 10.222.0.43 () {58 vars in 1466 bytes} [Sat Jul 2 21:27:00 2022] DELETE /identity/v3/domains/491da46e026540ae8ccda1ec04fcc9bd/groups/7f058d1ff24b47ae904b081df650ef0c/roles/998122826d3e48a2903a3a9e5ee7eafc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:00.503919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:00.506104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:00.520333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74261725-c0cd-4614-a939-c185e0d5da67 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:00.601242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c3e6a-362b-485c-8345-6da250a6af0c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:00.602416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c3e6a-362b-485c-8345-6da250a6af0c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:00.602882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c3e6a-362b-485c-8345-6da250a6af0c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:00.603319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c3e6a-362b-485c-8345-6da250a6af0c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/groups/7f058d1ff24b47ae904b081df650ef0c/users/71d833e978824becbbfdda39ac83aa8f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:00.610022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c3e6a-362b-485c-8345-6da250a6af0c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=7f058d1ff24b47ae904b081df650ef0c, user_id=71d833e978824becbbfdda39ac83aa8f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:00.611620 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-412c3e6a-362b-485c-8345-6da250a6af0c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:27:00.611620 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:27:00.611620 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:27:00.613553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c3e6a-362b-485c-8345-6da250a6af0c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:00.635803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-412c3e6a-362b-485c-8345-6da250a6af0c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '71d833e978824becbbfdda39ac83aa8f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:00.666716 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3388/6737] 10.222.0.43 () {58 vars in 1343 bytes} [Sat Jul 2 21:27:00 2022] DELETE /identity/v3/groups/7f058d1ff24b47ae904b081df650ef0c/users/71d833e978824becbbfdda39ac83aa8f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:27:00.670816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd30b15-dc18-40a1-b630-5097981a287e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:00.678291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dcd30b15-dc18-40a1-b630-5097981a287e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:00.702299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd30b15-dc18-40a1-b630-5097981a287e tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:00.820615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436170f-fb63-4532-9e6d-02a475475bfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:00.821512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436170f-fb63-4532-9e6d-02a475475bfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:00.821802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436170f-fb63-4532-9e6d-02a475475bfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:00.822219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436170f-fb63-4532-9e6d-02a475475bfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/groups/7f058d1ff24b47ae904b081df650ef0c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:00.823416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436170f-fb63-4532-9e6d-02a475475bfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:delete_group(group_id=7f058d1ff24b47ae904b081df650ef0c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:00.824685 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-b436170f-fb63-4532-9e6d-02a475475bfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:27:00.824685 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:27:00.824685 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:27:00.825866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436170f-fb63-4532-9e6d-02a475475bfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:00.929142 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3350/6738] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:27:00 2022] DELETE /identity/v3/groups/7f058d1ff24b47ae904b081df650ef0c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:00.930558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c3e6a-362b-485c-8345-6da250a6af0c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:00.953274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c3e6a-362b-485c-8345-6da250a6af0c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:01.135565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af164b1-36b9-4c0f-9ced-15ec3bb71c17 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:01.136426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af164b1-36b9-4c0f-9ced-15ec3bb71c17 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:01.136713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af164b1-36b9-4c0f-9ced-15ec3bb71c17 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:01.136995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af164b1-36b9-4c0f-9ced-15ec3bb71c17 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/roles/998122826d3e48a2903a3a9e5ee7eafc` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:01.139862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af164b1-36b9-4c0f-9ced-15ec3bb71c17 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:delete_role(role_id=998122826d3e48a2903a3a9e5ee7eafc)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:01.148131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af164b1-36b9-4c0f-9ced-15ec3bb71c17 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:01.168688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:01.210115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1af164b1-36b9-4c0f-9ced-15ec3bb71c17 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invalidating the token cache because role 998122826d3e48a2903a3a9e5ee7eafc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:01.210409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1af164b1-36b9-4c0f-9ced-15ec3bb71c17 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:01.211101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1af164b1-36b9-4c0f-9ced-15ec3bb71c17 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:01.213659 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3389/6739] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:27:00 2022] DELETE /identity/v3/roles/998122826d3e48a2903a3a9e5ee7eafc => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:01.218276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436170f-fb63-4532-9e6d-02a475475bfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:01.224901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b436170f-fb63-4532-9e6d-02a475475bfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:01.257312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436170f-fb63-4532-9e6d-02a475475bfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:01.267953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:01.364563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ade92c-28c0-4211-a36a-19f334aa16a5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:01.365474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ade92c-28c0-4211-a36a-19f334aa16a5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:01.365909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ade92c-28c0-4211-a36a-19f334aa16a5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:01.366197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ade92c-28c0-4211-a36a-19f334aa16a5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/491da46e026540ae8ccda1ec04fcc9bd` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:01.368731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ade92c-28c0-4211-a36a-19f334aa16a5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=491da46e026540ae8ccda1ec04fcc9bd)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:01.370379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ade92c-28c0-4211-a36a-19f334aa16a5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:01.413342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c3ade92c-28c0-4211-a36a-19f334aa16a5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '491da46e026540ae8ccda1ec04fcc9bd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:01.414478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c3ade92c-28c0-4211-a36a-19f334aa16a5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '491da46e026540ae8ccda1ec04fcc9bd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:01.456469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c3ade92c-28c0-4211-a36a-19f334aa16a5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '491da46e026540ae8ccda1ec04fcc9bd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:01.457173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c3ade92c-28c0-4211-a36a-19f334aa16a5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '491da46e026540ae8ccda1ec04fcc9bd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:01.463435 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3351/6740] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:27:01 2022] PATCH /identity/v3/domains/491da46e026540ae8ccda1ec04fcc9bd => generated 277 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:27:01.465605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af164b1-36b9-4c0f-9ced-15ec3bb71c17 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:01.485045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af164b1-36b9-4c0f-9ced-15ec3bb71c17 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:01.565523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:01.566455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:01.566799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:01.567080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/491da46e026540ae8ccda1ec04fcc9bd` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:01.583992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=491da46e026540ae8ccda1ec04fcc9bd)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:01.586078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:01.643449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '491da46e026540ae8ccda1ec04fcc9bd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:01.657402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '491da46e026540ae8ccda1ec04fcc9bd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:01.711257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '491da46e026540ae8ccda1ec04fcc9bd', 'request_id': 'req-c16412e1-9796-4f27-8322-8c5e8792d2ba'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:01.721794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '491da46e026540ae8ccda1ec04fcc9bd', 'request_id': 'req-c16412e1-9796-4f27-8322-8c5e8792d2ba'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:01.731075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '491da46e026540ae8ccda1ec04fcc9bd', 'request_id': 'req-c16412e1-9796-4f27-8322-8c5e8792d2ba'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:01.746451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] The token cache is being invalidate because project 491da46e026540ae8ccda1ec04fcc9bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:01.747034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:01.747956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:01.757243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '491da46e026540ae8ccda1ec04fcc9bd', 'request_id': 'req-c16412e1-9796-4f27-8322-8c5e8792d2ba'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:01.758155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '491da46e026540ae8ccda1ec04fcc9bd', 'request_id': 'req-c16412e1-9796-4f27-8322-8c5e8792d2ba'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:01.759213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '491da46e026540ae8ccda1ec04fcc9bd', 'request_id': 'req-c16412e1-9796-4f27-8322-8c5e8792d2ba'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:01.778020 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3390/6741] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:27:01 2022] DELETE /identity/v3/domains/491da46e026540ae8ccda1ec04fcc9bd => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:01.782261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ade92c-28c0-4211-a36a-19f334aa16a5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:01.783854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c3ade92c-28c0-4211-a36a-19f334aa16a5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:01.797527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ade92c-28c0-4211-a36a-19f334aa16a5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:01.868666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65113145-3d41-4744-bdb5-0298bdba6931 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:01.869618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65113145-3d41-4744-bdb5-0298bdba6931 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:01.869952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65113145-3d41-4744-bdb5-0298bdba6931 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:01.870182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65113145-3d41-4744-bdb5-0298bdba6931 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/b31bfbe0b16a46859e5bfe25cc5c9575/users/71d833e978824becbbfdda39ac83aa8f/roles/7f236192b8704d7fabeadd646cd531db` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:01.872560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65113145-3d41-4744-bdb5-0298bdba6931 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=b31bfbe0b16a46859e5bfe25cc5c9575, user_id=71d833e978824becbbfdda39ac83aa8f, role_id=7f236192b8704d7fabeadd646cd531db)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:01.875215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65113145-3d41-4744-bdb5-0298bdba6931 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:01.881097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-65113145-3d41-4744-bdb5-0298bdba6931 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invalidating the token cache because role 7f236192b8704d7fabeadd646cd531db was removed from user 71d833e978824becbbfdda39ac83aa8f on domain b31bfbe0b16a46859e5bfe25cc5c9575. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:01.881399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-65113145-3d41-4744-bdb5-0298bdba6931 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:01.882540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-65113145-3d41-4744-bdb5-0298bdba6931 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:01.896736 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3352/6742] 10.222.0.43 () {58 vars in 1463 bytes} [Sat Jul 2 21:27:01 2022] DELETE /identity/v3/domains/b31bfbe0b16a46859e5bfe25cc5c9575/users/71d833e978824becbbfdda39ac83aa8f/roles/7f236192b8704d7fabeadd646cd531db => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:01.900903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:01.902437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:01.915836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16412e1-9796-4f27-8322-8c5e8792d2ba tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:01.925923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:01.979856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d69fc6-54dd-4b03-b2c3-de9b70b2e776 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:01.980768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d69fc6-54dd-4b03-b2c3-de9b70b2e776 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:01.981054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d69fc6-54dd-4b03-b2c3-de9b70b2e776 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:01.981334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d69fc6-54dd-4b03-b2c3-de9b70b2e776 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/roles/7f236192b8704d7fabeadd646cd531db` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:01.982888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d69fc6-54dd-4b03-b2c3-de9b70b2e776 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7f236192b8704d7fabeadd646cd531db)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:01.984727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d69fc6-54dd-4b03-b2c3-de9b70b2e776 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:02.021702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f4d69fc6-54dd-4b03-b2c3-de9b70b2e776 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invalidating the token cache because role 7f236192b8704d7fabeadd646cd531db has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:02.021952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f4d69fc6-54dd-4b03-b2c3-de9b70b2e776 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:02.022686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f4d69fc6-54dd-4b03-b2c3-de9b70b2e776 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:02.024785 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3391/6743] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:27:01 2022] DELETE /identity/v3/roles/7f236192b8704d7fabeadd646cd531db => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:02.029283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65113145-3d41-4744-bdb5-0298bdba6931 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:02.030960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-65113145-3d41-4744-bdb5-0298bdba6931 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:02.044895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65113145-3d41-4744-bdb5-0298bdba6931 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:02.120565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e173c39-629c-449a-b8b1-e2de2a8b0c0f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:02.121690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e173c39-629c-449a-b8b1-e2de2a8b0c0f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:02.122046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e173c39-629c-449a-b8b1-e2de2a8b0c0f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:02.122411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e173c39-629c-449a-b8b1-e2de2a8b0c0f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/b31bfbe0b16a46859e5bfe25cc5c9575` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:02.123828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e173c39-629c-449a-b8b1-e2de2a8b0c0f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b31bfbe0b16a46859e5bfe25cc5c9575)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:02.125603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e173c39-629c-449a-b8b1-e2de2a8b0c0f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:02.139050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:02.148433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6e173c39-629c-449a-b8b1-e2de2a8b0c0f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b31bfbe0b16a46859e5bfe25cc5c9575'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:02.149824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6e173c39-629c-449a-b8b1-e2de2a8b0c0f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b31bfbe0b16a46859e5bfe25cc5c9575'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:02.183729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6e173c39-629c-449a-b8b1-e2de2a8b0c0f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b31bfbe0b16a46859e5bfe25cc5c9575'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:02.184498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6e173c39-629c-449a-b8b1-e2de2a8b0c0f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b31bfbe0b16a46859e5bfe25cc5c9575'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:02.190166 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3353/6744] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:27:02 2022] PATCH /identity/v3/domains/b31bfbe0b16a46859e5bfe25cc5c9575 => generated 277 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:27:02.191342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d69fc6-54dd-4b03-b2c3-de9b70b2e776 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:02.192946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f4d69fc6-54dd-4b03-b2c3-de9b70b2e776 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:02.212104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d69fc6-54dd-4b03-b2c3-de9b70b2e776 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:02.294520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:02.295713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:02.296260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:02.296674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/b31bfbe0b16a46859e5bfe25cc5c9575` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:02.317048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b31bfbe0b16a46859e5bfe25cc5c9575)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:02.319419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:02.353257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b31bfbe0b16a46859e5bfe25cc5c9575'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:02.365567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b31bfbe0b16a46859e5bfe25cc5c9575'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:02.414459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:02.416878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b31bfbe0b16a46859e5bfe25cc5c9575', 'request_id': 'req-b050e612-a659-4a43-9539-aad767e9030c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:02.428366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b31bfbe0b16a46859e5bfe25cc5c9575', 'request_id': 'req-b050e612-a659-4a43-9539-aad767e9030c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:02.437445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b31bfbe0b16a46859e5bfe25cc5c9575', 'request_id': 'req-b050e612-a659-4a43-9539-aad767e9030c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:02.453841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] The token cache is being invalidate because project b31bfbe0b16a46859e5bfe25cc5c9575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:02.454317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:02.455253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:02.464366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b31bfbe0b16a46859e5bfe25cc5c9575', 'request_id': 'req-b050e612-a659-4a43-9539-aad767e9030c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:02.465128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b31bfbe0b16a46859e5bfe25cc5c9575', 'request_id': 'req-b050e612-a659-4a43-9539-aad767e9030c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:02.465749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b31bfbe0b16a46859e5bfe25cc5c9575', 'request_id': 'req-b050e612-a659-4a43-9539-aad767e9030c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:02.477261 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3392/6745] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:27:02 2022] DELETE /identity/v3/domains/b31bfbe0b16a46859e5bfe25cc5c9575 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:02.483618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e173c39-629c-449a-b8b1-e2de2a8b0c0f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:02.485287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6e173c39-629c-449a-b8b1-e2de2a8b0c0f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:02.509251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e173c39-629c-449a-b8b1-e2de2a8b0c0f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:02.611706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0ca06-c3f0-4442-abc9-e780b1e150db tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:02.612440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0ca06-c3f0-4442-abc9-e780b1e150db tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:02.612727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0ca06-c3f0-4442-abc9-e780b1e150db tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:02.613008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0ca06-c3f0-4442-abc9-e780b1e150db tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:02.613755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0ca06-c3f0-4442-abc9-e780b1e150db tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:02.615409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0ca06-c3f0-4442-abc9-e780b1e150db tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:02.627666 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3354/6746] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:27:02.632055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:02.633593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:02.647316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050e612-a659-4a43-9539-aad767e9030c tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:02.663419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad816f-fd9e-4abb-bc6e-514ca4c95de5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:02.664507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad816f-fd9e-4abb-bc6e-514ca4c95de5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:02.665243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad816f-fd9e-4abb-bc6e-514ca4c95de5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:02.665538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad816f-fd9e-4abb-bc6e-514ca4c95de5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/projects/4ea3bca573484cc7a7616cc9ab410db3/users/6bf228011b6049659c1488a177c8f276/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:02.668925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad816f-fd9e-4abb-bc6e-514ca4c95de5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4ea3bca573484cc7a7616cc9ab410db3, user_id=6bf228011b6049659c1488a177c8f276, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:02.674644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad816f-fd9e-4abb-bc6e-514ca4c95de5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:02.696560 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3393/6747] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:27:02 2022] PUT /identity/v3/projects/4ea3bca573484cc7a7616cc9ab410db3/users/6bf228011b6049659c1488a177c8f276/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:02.700313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0ca06-c3f0-4442-abc9-e780b1e150db tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:02.715173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0ca06-c3f0-4442-abc9-e780b1e150db tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:02.793543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70f1ab-2f27-4e2f-859f-e64f828c929f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:02.794974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70f1ab-2f27-4e2f-859f-e64f828c929f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:02.795870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70f1ab-2f27-4e2f-859f-e64f828c929f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:02.796066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70f1ab-2f27-4e2f-859f-e64f828c929f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:02.797035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70f1ab-2f27-4e2f-859f-e64f828c929f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:02.798075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70f1ab-2f27-4e2f-859f-e64f828c929f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:02.852075 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3355/6748] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:27:02 2022] GET /identity/v3/auth/projects => generated 824 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:27:02.856333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad816f-fd9e-4abb-bc6e-514ca4c95de5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:02.866901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad816f-fd9e-4abb-bc6e-514ca4c95de5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:02.871840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980c4d7-4252-4974-b5f8-1cacdb5a37eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:02.872780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980c4d7-4252-4974-b5f8-1cacdb5a37eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:02.873064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980c4d7-4252-4974-b5f8-1cacdb5a37eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:02.873343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980c4d7-4252-4974-b5f8-1cacdb5a37eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/projects/4ea3bca573484cc7a7616cc9ab410db3/users/6bf228011b6049659c1488a177c8f276/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:02.875463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980c4d7-4252-4974-b5f8-1cacdb5a37eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=4ea3bca573484cc7a7616cc9ab410db3, user_id=6bf228011b6049659c1488a177c8f276, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:02.878282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980c4d7-4252-4974-b5f8-1cacdb5a37eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:02.884448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c980c4d7-4252-4974-b5f8-1cacdb5a37eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invalidating the token cache because role fbc5ccb2ed1447f0a3df77c23347d54c was removed from user 6bf228011b6049659c1488a177c8f276 on project 4ea3bca573484cc7a7616cc9ab410db3. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:02.884738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c980c4d7-4252-4974-b5f8-1cacdb5a37eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:02.885430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c980c4d7-4252-4974-b5f8-1cacdb5a37eb tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:02.900080 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3394/6749] 10.222.0.43 () {58 vars in 1466 bytes} [Sat Jul 2 21:27:02 2022] DELETE /identity/v3/projects/4ea3bca573484cc7a7616cc9ab410db3/users/6bf228011b6049659c1488a177c8f276/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:02.905343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70f1ab-2f27-4e2f-859f-e64f828c929f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:02.907378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ca70f1ab-2f27-4e2f-859f-e64f828c929f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:02.921030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70f1ab-2f27-4e2f-859f-e64f828c929f tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:02.959752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:02.975511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec2696-9860-4e76-a85a-096df58ab728 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:02.975511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec2696-9860-4e76-a85a-096df58ab728 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:02.975812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec2696-9860-4e76-a85a-096df58ab728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:03.041724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939451c6-d926-49e1-933a-741518105c78 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:03.042574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939451c6-d926-49e1-933a-741518105c78 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:03.043455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939451c6-d926-49e1-933a-741518105c78 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:03.043804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939451c6-d926-49e1-933a-741518105c78 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:03.044548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939451c6-d926-49e1-933a-741518105c78 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:03.047658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-92ec2696-9860-4e76-a85a-096df58ab728 None None] MFA Rules not processed for user `9cf49b6497cd4485bee8253300a1ff96`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:03.049100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-92ec2696-9860-4e76-a85a-096df58ab728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:03.051893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939451c6-d926-49e1-933a-741518105c78 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:03.085749 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3356/6750] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:27:02 2022] POST /identity/v3/users => generated 323 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:03.086801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939451c6-d926-49e1-933a-741518105c78 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:03.102377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939451c6-d926-49e1-933a-741518105c78 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:03.108441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e402757-e883-451f-9c64-7cbd2e88bf88 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:03.109207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e402757-e883-451f-9c64-7cbd2e88bf88 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:03.109559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e402757-e883-451f-9c64-7cbd2e88bf88 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:03.109915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e402757-e883-451f-9c64-7cbd2e88bf88 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:03.110824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e402757-e883-451f-9c64-7cbd2e88bf88 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:03.112853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e402757-e883-451f-9c64-7cbd2e88bf88 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:03.169841 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3357/6751] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:27:03 2022] POST /identity/v3/projects => generated 363 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:03.176682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e402757-e883-451f-9c64-7cbd2e88bf88 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:03.243267 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3395/6752] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:03.252623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec2696-9860-4e76-a85a-096df58ab728 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:03.254536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-92ec2696-9860-4e76-a85a-096df58ab728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:03.381655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:03.392392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec2696-9860-4e76-a85a-096df58ab728 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:03.414632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e402757-e883-451f-9c64-7cbd2e88bf88 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:03.452397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0827567-f1a0-47b0-991f-acfb6f7d9713 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:03.453108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0827567-f1a0-47b0-991f-acfb6f7d9713 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:03.453391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0827567-f1a0-47b0-991f-acfb6f7d9713 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:03.453667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0827567-f1a0-47b0-991f-acfb6f7d9713 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:03.454420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0827567-f1a0-47b0-991f-acfb6f7d9713 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:03.461808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0827567-f1a0-47b0-991f-acfb6f7d9713 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:03.519773 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3358/6753] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:27:03 2022] POST /identity/v3/projects => generated 364 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:03.524241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0827567-f1a0-47b0-991f-acfb6f7d9713 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:03.533361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd8ca3-55b4-473b-b143-a7700c308c9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:03.534034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd8ca3-55b4-473b-b143-a7700c308c9e service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:03.534317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd8ca3-55b4-473b-b143-a7700c308c9e service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:03.534942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd8ca3-55b4-473b-b143-a7700c308c9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:03.659822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd8ca3-55b4-473b-b143-a7700c308c9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:03.663942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd8ca3-55b4-473b-b143-a7700c308c9e service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:03.692145 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3396/6754] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:27:03.701632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0827567-f1a0-47b0-991f-acfb6f7d9713 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:03.721242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2c189-84b5-4c40-8d5e-d36639a91970 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:03.721955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2c189-84b5-4c40-8d5e-d36639a91970 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:03.722239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2c189-84b5-4c40-8d5e-d36639a91970 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:03.722516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2c189-84b5-4c40-8d5e-d36639a91970 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:03.723270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2c189-84b5-4c40-8d5e-d36639a91970 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:03.725080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2c189-84b5-4c40-8d5e-d36639a91970 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:03.774391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd8ca3-55b4-473b-b143-a7700c308c9e service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:03.786804 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3359/6755] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:27:03 2022] POST /identity/v3/roles => generated 240 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:03.793871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd8ca3-55b4-473b-b143-a7700c308c9e service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:03.810202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6988df-d12a-4ce7-b2f4-a6edd61c4f11 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:03.811194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6988df-d12a-4ce7-b2f4-a6edd61c4f11 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:03.811650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6988df-d12a-4ce7-b2f4-a6edd61c4f11 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:03.812138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6988df-d12a-4ce7-b2f4-a6edd61c4f11 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/projects/8ac09ac1cfe44af98273a7285bb18aab/users/cec7438e3aa24f0b8bce59d6ca2a8279/roles/0ab39dd0f5c8491987e23c8fc7ca655e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:03.856850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6988df-d12a-4ce7-b2f4-a6edd61c4f11 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8ac09ac1cfe44af98273a7285bb18aab, user_id=cec7438e3aa24f0b8bce59d6ca2a8279, role_id=0ab39dd0f5c8491987e23c8fc7ca655e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:03.859862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6988df-d12a-4ce7-b2f4-a6edd61c4f11 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:03.892998 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3397/6756] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:27:03 2022] PUT /identity/v3/projects/8ac09ac1cfe44af98273a7285bb18aab/users/cec7438e3aa24f0b8bce59d6ca2a8279/roles/0ab39dd0f5c8491987e23c8fc7ca655e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:03.897426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2c189-84b5-4c40-8d5e-d36639a91970 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:03.915565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2c189-84b5-4c40-8d5e-d36639a91970 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:03.980532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:04.077298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb242ec-9206-47dc-b995-0815ba0eab68 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:04.086645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb242ec-9206-47dc-b995-0815ba0eab68 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:04.086968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb242ec-9206-47dc-b995-0815ba0eab68 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:04.090877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb242ec-9206-47dc-b995-0815ba0eab68 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/projects/a62e18086999475d84b322f52aaa1c9e/users/cec7438e3aa24f0b8bce59d6ca2a8279/roles/0ab39dd0f5c8491987e23c8fc7ca655e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:04.101980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb242ec-9206-47dc-b995-0815ba0eab68 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a62e18086999475d84b322f52aaa1c9e, user_id=cec7438e3aa24f0b8bce59d6ca2a8279, role_id=0ab39dd0f5c8491987e23c8fc7ca655e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:04.107520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb242ec-9206-47dc-b995-0815ba0eab68 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:04.126466 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3360/6757] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:27:03 2022] PUT /identity/v3/projects/a62e18086999475d84b322f52aaa1c9e/users/cec7438e3aa24f0b8bce59d6ca2a8279/roles/0ab39dd0f5c8491987e23c8fc7ca655e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:04.131607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fc8f4-e671-442f-9bac-07e3bfb71684 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:04.131922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fc8f4-e671-442f-9bac-07e3bfb71684 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:04.132235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fc8f4-e671-442f-9bac-07e3bfb71684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:04.197331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-828fc8f4-e671-442f-9bac-07e3bfb71684 None None] MFA Rules not processed for user `cec7438e3aa24f0b8bce59d6ca2a8279`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:04.198596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-828fc8f4-e671-442f-9bac-07e3bfb71684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:04.209829 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3398/6758] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:04 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 21:27:04.214768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50551c36-5b97-4462-9548-fa64fc39509a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:04.215257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50551c36-5b97-4462-9548-fa64fc39509a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:04.215711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50551c36-5b97-4462-9548-fa64fc39509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:04.232736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-50551c36-5b97-4462-9548-fa64fc39509a None None] MFA Rules not processed for user `cec7438e3aa24f0b8bce59d6ca2a8279`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:04.234717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-50551c36-5b97-4462-9548-fa64fc39509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:04.381967 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3361/6759] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:04 2022] POST /identity/v3/auth/tokens => generated 3216 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 02 21:27:04.382342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fc8f4-e671-442f-9bac-07e3bfb71684 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:04.538506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fc8f4-e671-442f-9bac-07e3bfb71684 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:04.558208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a1e76-683c-47da-a091-d56aeb115318 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:04.560492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a1e76-683c-47da-a091-d56aeb115318 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:04.560958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a1e76-683c-47da-a091-d56aeb115318 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:04.561353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a1e76-683c-47da-a091-d56aeb115318 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:04.587905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a1e76-683c-47da-a091-d56aeb115318 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:04.590149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a1e76-683c-47da-a091-d56aeb115318 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:04.595476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:04.632750 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3399/6760] 10.222.0.43 () {56 vars in 1307 bytes} [Sat Jul 2 21:27:04 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:27:04.638234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce57b5-bc37-4cfb-87ca-98375113d067 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:04.638659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce57b5-bc37-4cfb-87ca-98375113d067 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:04.639072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce57b5-bc37-4cfb-87ca-98375113d067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:04.678156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-94ce57b5-bc37-4cfb-87ca-98375113d067 None None] MFA Rules not processed for user `cec7438e3aa24f0b8bce59d6ca2a8279`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:04.680308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-94ce57b5-bc37-4cfb-87ca-98375113d067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:04.849404 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3362/6761] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:04 2022] POST /identity/v3/auth/tokens => generated 3216 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 02 21:27:04.851237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a1e76-683c-47da-a091-d56aeb115318 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:04.868152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a1e76-683c-47da-a091-d56aeb115318 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:04.881642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b971e9d-591e-41d7-b7f6-93a63d79fbfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:04.885085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b971e9d-591e-41d7-b7f6-93a63d79fbfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:04.886713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b971e9d-591e-41d7-b7f6-93a63d79fbfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:04.887886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b971e9d-591e-41d7-b7f6-93a63d79fbfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/roles/0ab39dd0f5c8491987e23c8fc7ca655e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:04.892524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b971e9d-591e-41d7-b7f6-93a63d79fbfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0ab39dd0f5c8491987e23c8fc7ca655e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:04.897503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b971e9d-591e-41d7-b7f6-93a63d79fbfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:04.986069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9b971e9d-591e-41d7-b7f6-93a63d79fbfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invalidating the token cache because role 0ab39dd0f5c8491987e23c8fc7ca655e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:04.986517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9b971e9d-591e-41d7-b7f6-93a63d79fbfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:04.987441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9b971e9d-591e-41d7-b7f6-93a63d79fbfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:04.994074 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3400/6762] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:27:04 2022] DELETE /identity/v3/roles/0ab39dd0f5c8491987e23c8fc7ca655e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:04.994664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce57b5-bc37-4cfb-87ca-98375113d067 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:05.012818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce57b5-bc37-4cfb-87ca-98375113d067 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:05.132733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:05.149568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa5e14-20bc-4e50-ad94-46a1ceb51e13 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:05.150701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa5e14-20bc-4e50-ad94-46a1ceb51e13 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:05.150991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa5e14-20bc-4e50-ad94-46a1ceb51e13 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:05.151267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa5e14-20bc-4e50-ad94-46a1ceb51e13 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/projects/a62e18086999475d84b322f52aaa1c9e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:05.158380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa5e14-20bc-4e50-ad94-46a1ceb51e13 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a62e18086999475d84b322f52aaa1c9e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:05.160353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa5e14-20bc-4e50-ad94-46a1ceb51e13 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:05.231754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-72fa5e14-20bc-4e50-ad94-46a1ceb51e13 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a62e18086999475d84b322f52aaa1c9e', 'request_id': 'req-72fa5e14-20bc-4e50-ad94-46a1ceb51e13'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:05.239851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-72fa5e14-20bc-4e50-ad94-46a1ceb51e13 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a62e18086999475d84b322f52aaa1c9e', 'request_id': 'req-72fa5e14-20bc-4e50-ad94-46a1ceb51e13'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:05.251346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-72fa5e14-20bc-4e50-ad94-46a1ceb51e13 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a62e18086999475d84b322f52aaa1c9e', 'request_id': 'req-72fa5e14-20bc-4e50-ad94-46a1ceb51e13'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:05.328176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-72fa5e14-20bc-4e50-ad94-46a1ceb51e13 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] The token cache is being invalidate because project a62e18086999475d84b322f52aaa1c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:05.328695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-72fa5e14-20bc-4e50-ad94-46a1ceb51e13 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:05.331861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-72fa5e14-20bc-4e50-ad94-46a1ceb51e13 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:05.340208 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3363/6763] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:27:04 2022] DELETE /identity/v3/projects/a62e18086999475d84b322f52aaa1c9e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:05.345604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b971e9d-591e-41d7-b7f6-93a63d79fbfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:05.347457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9b971e9d-591e-41d7-b7f6-93a63d79fbfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:05.391179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b971e9d-591e-41d7-b7f6-93a63d79fbfa tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:05.534743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef509b1-892c-4344-846c-ff8663c2bc6a tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:05.535639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef509b1-892c-4344-846c-ff8663c2bc6a tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:05.535923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef509b1-892c-4344-846c-ff8663c2bc6a tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:05.536345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef509b1-892c-4344-846c-ff8663c2bc6a tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/projects/a62e18086999475d84b322f52aaa1c9e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:05.544519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef509b1-892c-4344-846c-ff8663c2bc6a tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a62e18086999475d84b322f52aaa1c9e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:05.546439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef509b1-892c-4344-846c-ff8663c2bc6a tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:05.590791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-cef509b1-892c-4344-846c-ff8663c2bc6a tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Could not find project: a62e18086999475d84b322f52aaa1c9e.: keystone.exception.ProjectNotFound: Could not find project: a62e18086999475d84b322f52aaa1c9e. Jul 02 21:27:05.590791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:27:05.590791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:27:05.590791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:27:05.590791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:27:05.590791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:27:05.590791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:27:05.590791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:27:05.590791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:27:05.590791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:27:05.590791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:27:05.590791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:27:05.590791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 02 21:27:05.590791 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 02 21:27:05.591766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:27:05.591766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:27:05.591766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 02 21:27:05.591766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 02 21:27:05.591766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:27:05.591766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:27:05.591766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:27:05.591766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:27:05.591766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a62e18086999475d84b322f52aaa1c9e. Jul 02 21:27:05.591766 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:27:05.596563 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3401/6764] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:27:05 2022] DELETE /identity/v3/projects/a62e18086999475d84b322f52aaa1c9e => generated 113 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:27:05.597850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa5e14-20bc-4e50-ad94-46a1ceb51e13 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:05.600673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-72fa5e14-20bc-4e50-ad94-46a1ceb51e13 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:05.633811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa5e14-20bc-4e50-ad94-46a1ceb51e13 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:05.641976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2db74a-3238-4b85-a19c-7157f39eaeb6 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:05.642890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2db74a-3238-4b85-a19c-7157f39eaeb6 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:05.643171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2db74a-3238-4b85-a19c-7157f39eaeb6 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:05.643754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2db74a-3238-4b85-a19c-7157f39eaeb6 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/projects/8ac09ac1cfe44af98273a7285bb18aab` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:05.648437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2db74a-3238-4b85-a19c-7157f39eaeb6 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8ac09ac1cfe44af98273a7285bb18aab)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:05.650440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2db74a-3238-4b85-a19c-7157f39eaeb6 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:05.732312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1d2db74a-3238-4b85-a19c-7157f39eaeb6 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ac09ac1cfe44af98273a7285bb18aab', 'request_id': 'req-1d2db74a-3238-4b85-a19c-7157f39eaeb6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:05.740453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1d2db74a-3238-4b85-a19c-7157f39eaeb6 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ac09ac1cfe44af98273a7285bb18aab', 'request_id': 'req-1d2db74a-3238-4b85-a19c-7157f39eaeb6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:05.748094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1d2db74a-3238-4b85-a19c-7157f39eaeb6 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ac09ac1cfe44af98273a7285bb18aab', 'request_id': 'req-1d2db74a-3238-4b85-a19c-7157f39eaeb6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:05.766476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1d2db74a-3238-4b85-a19c-7157f39eaeb6 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] The token cache is being invalidate because project 8ac09ac1cfe44af98273a7285bb18aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:05.767169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1d2db74a-3238-4b85-a19c-7157f39eaeb6 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:05.773874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1d2db74a-3238-4b85-a19c-7157f39eaeb6 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:05.775851 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3364/6765] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:27:05 2022] DELETE /identity/v3/projects/8ac09ac1cfe44af98273a7285bb18aab => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:05.780263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef509b1-892c-4344-846c-ff8663c2bc6a tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:05.782225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cef509b1-892c-4344-846c-ff8663c2bc6a tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:05.798668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef509b1-892c-4344-846c-ff8663c2bc6a tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:05.876033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7ed9b-1d0c-4d47-aff0-d62a3c9bd5a9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:05.877187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7ed9b-1d0c-4d47-aff0-d62a3c9bd5a9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:05.877477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7ed9b-1d0c-4d47-aff0-d62a3c9bd5a9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:05.877761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7ed9b-1d0c-4d47-aff0-d62a3c9bd5a9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/users/cec7438e3aa24f0b8bce59d6ca2a8279` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:05.879268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7ed9b-1d0c-4d47-aff0-d62a3c9bd5a9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cec7438e3aa24f0b8bce59d6ca2a8279)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:05.881228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7ed9b-1d0c-4d47-aff0-d62a3c9bd5a9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:05.964158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:INSERT=1,keystone:DELETE=11 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:05.966317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fda7ed9b-1d0c-4d47-aff0-d62a3c9bd5a9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec7438e3aa24f0b8bce59d6ca2a8279'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:05.982286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fda7ed9b-1d0c-4d47-aff0-d62a3c9bd5a9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec7438e3aa24f0b8bce59d6ca2a8279'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:05.983226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fda7ed9b-1d0c-4d47-aff0-d62a3c9bd5a9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec7438e3aa24f0b8bce59d6ca2a8279'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:05.984209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fda7ed9b-1d0c-4d47-aff0-d62a3c9bd5a9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec7438e3aa24f0b8bce59d6ca2a8279'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:05.993670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fda7ed9b-1d0c-4d47-aff0-d62a3c9bd5a9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec7438e3aa24f0b8bce59d6ca2a8279'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:06.016188 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3402/6766] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:27:05 2022] DELETE /identity/v3/users/cec7438e3aa24f0b8bce59d6ca2a8279 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:06.025401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2db74a-3238-4b85-a19c-7157f39eaeb6 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:06.037815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2db74a-3238-4b85-a19c-7157f39eaeb6 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:06.115277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f863e61-9c6f-4bb3-b135-3f094e1ab791 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:06.116201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f863e61-9c6f-4bb3-b135-3f094e1ab791 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:06.116489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f863e61-9c6f-4bb3-b135-3f094e1ab791 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:06.116771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f863e61-9c6f-4bb3-b135-3f094e1ab791 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/0f42e975bcb14c6aa1358174ea07cc31` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:06.125129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f863e61-9c6f-4bb3-b135-3f094e1ab791 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 21:27:06.137039 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-7f863e61-9c6f-4bb3-b135-3f094e1ab791 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Could not find domain: 0f42e975bcb14c6aa1358174ea07cc31.: keystone.exception.DomainNotFound: Could not find domain: 0f42e975bcb14c6aa1358174ea07cc31. Jul 02 21:27:06.137039 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:27:06.137039 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 21:27:06.137039 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 21:27:06.137039 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:27:06.137039 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:27:06.137039 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:27:06.137039 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:27:06.137039 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0f42e975bcb14c6aa1358174ea07cc31. Jul 02 21:27:06.137039 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:27:06.137039 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:27:06.137039 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:27:06.137039 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:27:06.137039 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:27:06.137039 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:27:06.137039 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:27:06.138235 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:27:06.138235 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:27:06.138235 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:27:06.138235 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:27:06.138235 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:27:06.138235 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:27:06.138235 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:27:06.138235 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 02 21:27:06.138235 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 02 21:27:06.138235 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 21:27:06.138235 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 21:27:06.138235 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 21:27:06.138235 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 21:27:06.138235 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:27:06.138235 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:27:06.138235 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:27:06.139223 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:27:06.139223 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:27:06.139223 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:27:06.139223 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:27:06.139223 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 21:27:06.139223 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:27:06.139223 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:27:06.139223 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:27:06.139223 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:27:06.139223 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:27:06.139223 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:27:06.139223 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:27:06.139223 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:27:06.139223 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 21:27:06.139223 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 21:27:06.139223 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0f42e975bcb14c6aa1358174ea07cc31. Jul 02 21:27:06.139223 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:27:06.141675 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3365/6767] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:27:06 2022] PATCH /identity/v3/domains/0f42e975bcb14c6aa1358174ea07cc31 => generated 112 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:27:06.145701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7ed9b-1d0c-4d47-aff0-d62a3c9bd5a9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:06.147216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fda7ed9b-1d0c-4d47-aff0-d62a3c9bd5a9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:06.165226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7ed9b-1d0c-4d47-aff0-d62a3c9bd5a9 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:06.175252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d8c70-d370-40ad-a5ef-c9a20cda3257 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:06.176412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d8c70-d370-40ad-a5ef-c9a20cda3257 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:06.177309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d8c70-d370-40ad-a5ef-c9a20cda3257 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:06.177309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d8c70-d370-40ad-a5ef-c9a20cda3257 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/0b1ae12dc03243f18c5363b0b9d82ef2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:06.187804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d8c70-d370-40ad-a5ef-c9a20cda3257 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 21:27:06.198388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-c33d8c70-d370-40ad-a5ef-c9a20cda3257 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Could not find domain: 0b1ae12dc03243f18c5363b0b9d82ef2.: keystone.exception.DomainNotFound: Could not find domain: 0b1ae12dc03243f18c5363b0b9d82ef2. Jul 02 21:27:06.198388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:27:06.198388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 21:27:06.198388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 21:27:06.198388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:27:06.198388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:27:06.198388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:27:06.198388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:27:06.198388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0b1ae12dc03243f18c5363b0b9d82ef2. Jul 02 21:27:06.198388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:27:06.198388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:27:06.198388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:27:06.198388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:27:06.198388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:27:06.198388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:27:06.198388 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:27:06.199589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:27:06.199589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:27:06.199589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:27:06.199589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:27:06.199589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:27:06.199589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:27:06.199589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:27:06.199589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 02 21:27:06.199589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 02 21:27:06.199589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 21:27:06.199589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 21:27:06.199589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 21:27:06.199589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 21:27:06.199589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:27:06.199589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:27:06.199589 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:27:06.200634 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:27:06.200634 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:27:06.200634 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:27:06.200634 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:27:06.200634 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 21:27:06.200634 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:27:06.200634 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:27:06.200634 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:27:06.200634 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:27:06.200634 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:27:06.200634 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:27:06.200634 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:27:06.200634 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:27:06.200634 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 21:27:06.200634 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 21:27:06.200634 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0b1ae12dc03243f18c5363b0b9d82ef2. Jul 02 21:27:06.200634 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:27:06.201753 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3403/6768] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:27:06 2022] PATCH /identity/v3/domains/0b1ae12dc03243f18c5363b0b9d82ef2 => generated 112 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:27:06.203787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f863e61-9c6f-4bb3-b135-3f094e1ab791 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:06.216787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f863e61-9c6f-4bb3-b135-3f094e1ab791 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:06.222032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d6a71-14fe-4f1e-9a70-00bcca77ede1 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:06.222918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d6a71-14fe-4f1e-9a70-00bcca77ede1 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:06.223476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d6a71-14fe-4f1e-9a70-00bcca77ede1 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:06.223763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d6a71-14fe-4f1e-9a70-00bcca77ede1 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/491da46e026540ae8ccda1ec04fcc9bd` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:06.227766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:06.233726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d6a71-14fe-4f1e-9a70-00bcca77ede1 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 21:27:06.244768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-472d6a71-14fe-4f1e-9a70-00bcca77ede1 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Could not find domain: 491da46e026540ae8ccda1ec04fcc9bd.: keystone.exception.DomainNotFound: Could not find domain: 491da46e026540ae8ccda1ec04fcc9bd. Jul 02 21:27:06.244768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:27:06.244768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 21:27:06.244768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 21:27:06.244768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:27:06.244768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:27:06.244768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:27:06.244768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:27:06.244768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 491da46e026540ae8ccda1ec04fcc9bd. Jul 02 21:27:06.244768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:27:06.244768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:27:06.244768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:27:06.244768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:27:06.244768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:27:06.244768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:27:06.244768 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:27:06.245971 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:27:06.245971 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:27:06.245971 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:27:06.245971 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:27:06.245971 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:27:06.245971 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:27:06.245971 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:27:06.245971 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 02 21:27:06.245971 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 02 21:27:06.245971 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 21:27:06.245971 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 21:27:06.245971 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 21:27:06.245971 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 21:27:06.245971 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:27:06.245971 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:27:06.245971 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:27:06.247030 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:27:06.247030 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:27:06.247030 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:27:06.247030 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:27:06.247030 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 21:27:06.247030 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:27:06.247030 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:27:06.247030 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:27:06.247030 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:27:06.247030 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:27:06.247030 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:27:06.247030 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:27:06.247030 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:27:06.247030 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 21:27:06.247030 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 21:27:06.247030 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 491da46e026540ae8ccda1ec04fcc9bd. Jul 02 21:27:06.247030 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:27:06.253342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d8c70-d370-40ad-a5ef-c9a20cda3257 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:06.254500 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3366/6769] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:27:06 2022] PATCH /identity/v3/domains/491da46e026540ae8ccda1ec04fcc9bd => generated 112 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:27:06.264777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d8c70-d370-40ad-a5ef-c9a20cda3257 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:06.270069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9475b83-a3cf-4063-bb95-aeb6da8ffbf5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf228011b6049659c1488a177c8f276', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba810512a08e44d88cc99dfab99d15a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:06.271082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9475b83-a3cf-4063-bb95-aeb6da8ffbf5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:06.271456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9475b83-a3cf-4063-bb95-aeb6da8ffbf5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:06.271831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9475b83-a3cf-4063-bb95-aeb6da8ffbf5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] PATH_INFO: `/v3/domains/b31bfbe0b16a46859e5bfe25cc5c9575` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:06.281618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9475b83-a3cf-4063-bb95-aeb6da8ffbf5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 21:27:06.292410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-a9475b83-a3cf-4063-bb95-aeb6da8ffbf5 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Could not find domain: b31bfbe0b16a46859e5bfe25cc5c9575.: keystone.exception.DomainNotFound: Could not find domain: b31bfbe0b16a46859e5bfe25cc5c9575. Jul 02 21:27:06.292410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:27:06.292410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 21:27:06.292410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 21:27:06.292410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:27:06.292410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:27:06.292410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:27:06.292410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:27:06.292410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b31bfbe0b16a46859e5bfe25cc5c9575. Jul 02 21:27:06.292410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:27:06.292410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:27:06.292410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:27:06.292410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:27:06.292410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:27:06.292410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:27:06.292410 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:27:06.293832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:27:06.293832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:27:06.293832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:27:06.293832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:27:06.293832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:27:06.293832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:27:06.293832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:27:06.293832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 02 21:27:06.293832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 02 21:27:06.293832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 21:27:06.293832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 21:27:06.293832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 21:27:06.293832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 21:27:06.293832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:27:06.293832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:27:06.293832 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:27:06.295090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:27:06.295090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:27:06.295090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:27:06.295090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:27:06.295090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 21:27:06.295090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:27:06.295090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:27:06.295090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:27:06.295090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:27:06.295090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:27:06.295090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:27:06.295090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:27:06.295090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:27:06.295090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 21:27:06.295090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 21:27:06.295090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b31bfbe0b16a46859e5bfe25cc5c9575. Jul 02 21:27:06.295090 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:27:06.299472 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3404/6770] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:27:06 2022] PATCH /identity/v3/domains/b31bfbe0b16a46859e5bfe25cc5c9575 => generated 112 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 02 21:27:06.302094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d6a71-14fe-4f1e-9a70-00bcca77ede1 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:06.304874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-472d6a71-14fe-4f1e-9a70-00bcca77ede1 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:06.385149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d6a71-14fe-4f1e-9a70-00bcca77ede1 tempest-TokensV3TestJSON-712436177 tempest-TokensV3TestJSON-712436177-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:06.390304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d027a39-919c-4190-92cd-acfae6dcbb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:06.391343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d027a39-919c-4190-92cd-acfae6dcbb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:06.391833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d027a39-919c-4190-92cd-acfae6dcbb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:06.392394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d027a39-919c-4190-92cd-acfae6dcbb82 admin admin] PATH_INFO: `/v3/users/9ae0f639bf414a2f865b84e8f1c052a8` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:06.393951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d027a39-919c-4190-92cd-acfae6dcbb82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae0f639bf414a2f865b84e8f1c052a8)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:06.396152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d027a39-919c-4190-92cd-acfae6dcbb82 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:06.461533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3d027a39-919c-4190-92cd-acfae6dcbb82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae0f639bf414a2f865b84e8f1c052a8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:06.474008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3d027a39-919c-4190-92cd-acfae6dcbb82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae0f639bf414a2f865b84e8f1c052a8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:06.484107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3d027a39-919c-4190-92cd-acfae6dcbb82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae0f639bf414a2f865b84e8f1c052a8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:06.485171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3d027a39-919c-4190-92cd-acfae6dcbb82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae0f639bf414a2f865b84e8f1c052a8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:06.486416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3d027a39-919c-4190-92cd-acfae6dcbb82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae0f639bf414a2f865b84e8f1c052a8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:06.499448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecbe15-17c7-4b01-a980-8ac37c13acfe None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:06.499935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecbe15-17c7-4b01-a980-8ac37c13acfe None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:06.500528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecbe15-17c7-4b01-a980-8ac37c13acfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:06.520876 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3367/6771] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:27:06 2022] DELETE /identity/v3/users/9ae0f639bf414a2f865b84e8f1c052a8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:06.526066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbae36-dbd8-4c62-8b4c-8c89b9950649 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:06.526356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbae36-dbd8-4c62-8b4c-8c89b9950649 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:06.526629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbae36-dbd8-4c62-8b4c-8c89b9950649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:06.534513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-20ecbe15-17c7-4b01-a980-8ac37c13acfe None None] MFA Rules not processed for user `9cf49b6497cd4485bee8253300a1ff96`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:06.535923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-20ecbe15-17c7-4b01-a980-8ac37c13acfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:06.549041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fbbbae36-dbd8-4c62-8b4c-8c89b9950649 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:06.550513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fbbbae36-dbd8-4c62-8b4c-8c89b9950649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:06.629431 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3405/6772] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:06.646187 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3368/6773] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:06.656839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecbe15-17c7-4b01-a980-8ac37c13acfe None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:06.658437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-20ecbe15-17c7-4b01-a980-8ac37c13acfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:06.750067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecbe15-17c7-4b01-a980-8ac37c13acfe None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:06.754133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf5244-c5c8-4eac-bdce-424800b81145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:06.754929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf5244-c5c8-4eac-bdce-424800b81145 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:06.755270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf5244-c5c8-4eac-bdce-424800b81145 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:06.755601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf5244-c5c8-4eac-bdce-424800b81145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:06.765986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf5244-c5c8-4eac-bdce-424800b81145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:06.767643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf5244-c5c8-4eac-bdce-424800b81145 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:06.778119 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3406/6774] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:27:07.142211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbae36-dbd8-4c62-8b4c-8c89b9950649 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:07.143782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fbbbae36-dbd8-4c62-8b4c-8c89b9950649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:07.157753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbae36-dbd8-4c62-8b4c-8c89b9950649 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:07.162713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5c894-64b2-4ed0-9e57-f712ba891eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:07.163758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5c894-64b2-4ed0-9e57-f712ba891eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:07.164140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5c894-64b2-4ed0-9e57-f712ba891eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:07.164486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5c894-64b2-4ed0-9e57-f712ba891eeb admin admin] PATH_INFO: `/v3/projects/4ea3bca573484cc7a7616cc9ab410db3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:07.165790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5c894-64b2-4ed0-9e57-f712ba891eeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea3bca573484cc7a7616cc9ab410db3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:07.168270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5c894-64b2-4ed0-9e57-f712ba891eeb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:07.187313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:07.224394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-83b5c894-64b2-4ed0-9e57-f712ba891eeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea3bca573484cc7a7616cc9ab410db3', 'request_id': 'req-83b5c894-64b2-4ed0-9e57-f712ba891eeb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:07.230643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-83b5c894-64b2-4ed0-9e57-f712ba891eeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea3bca573484cc7a7616cc9ab410db3', 'request_id': 'req-83b5c894-64b2-4ed0-9e57-f712ba891eeb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:07.236937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-83b5c894-64b2-4ed0-9e57-f712ba891eeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea3bca573484cc7a7616cc9ab410db3', 'request_id': 'req-83b5c894-64b2-4ed0-9e57-f712ba891eeb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:07.250514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-83b5c894-64b2-4ed0-9e57-f712ba891eeb admin admin] The token cache is being invalidate because project 4ea3bca573484cc7a7616cc9ab410db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:07.250797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-83b5c894-64b2-4ed0-9e57-f712ba891eeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:07.251466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-83b5c894-64b2-4ed0-9e57-f712ba891eeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:07.253363 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3369/6775] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:27:07 2022] DELETE /identity/v3/projects/4ea3bca573484cc7a7616cc9ab410db3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:07.257301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf5244-c5c8-4eac-bdce-424800b81145 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:07.267542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf5244-c5c8-4eac-bdce-424800b81145 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:07.324569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:07.335437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87eb01-b73b-46f5-817e-b030be71c0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:07.336612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87eb01-b73b-46f5-817e-b030be71c0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:07.337502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87eb01-b73b-46f5-817e-b030be71c0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:07.337855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87eb01-b73b-46f5-817e-b030be71c0b6 admin admin] PATH_INFO: `/v3/users/6bf228011b6049659c1488a177c8f276` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:07.339607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87eb01-b73b-46f5-817e-b030be71c0b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf228011b6049659c1488a177c8f276)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:07.342203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87eb01-b73b-46f5-817e-b030be71c0b6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:07.391615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cd87eb01-b73b-46f5-817e-b030be71c0b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf228011b6049659c1488a177c8f276'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:07.401446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cd87eb01-b73b-46f5-817e-b030be71c0b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf228011b6049659c1488a177c8f276'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:07.402220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cd87eb01-b73b-46f5-817e-b030be71c0b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf228011b6049659c1488a177c8f276'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:07.402921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cd87eb01-b73b-46f5-817e-b030be71c0b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf228011b6049659c1488a177c8f276'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:07.410092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cd87eb01-b73b-46f5-817e-b030be71c0b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf228011b6049659c1488a177c8f276'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:07.432453 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3407/6776] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:27:07 2022] DELETE /identity/v3/users/6bf228011b6049659c1488a177c8f276 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:07.721254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5c894-64b2-4ed0-9e57-f712ba891eeb admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:07.723036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-83b5c894-64b2-4ed0-9e57-f712ba891eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:07.746693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5c894-64b2-4ed0-9e57-f712ba891eeb admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:07.812876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d452cf0-f3e8-4ab4-a2e4-a71dfa369a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:07.813879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d452cf0-f3e8-4ab4-a2e4-a71dfa369a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:07.814219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d452cf0-f3e8-4ab4-a2e4-a71dfa369a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:07.814561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d452cf0-f3e8-4ab4-a2e4-a71dfa369a4d admin admin] PATH_INFO: `/v3/projects/ba810512a08e44d88cc99dfab99d15a2` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:07.815863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d452cf0-f3e8-4ab4-a2e4-a71dfa369a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba810512a08e44d88cc99dfab99d15a2)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:07.817993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d452cf0-f3e8-4ab4-a2e4-a71dfa369a4d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:07.882202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6d452cf0-f3e8-4ab4-a2e4-a71dfa369a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba810512a08e44d88cc99dfab99d15a2', 'request_id': 'req-6d452cf0-f3e8-4ab4-a2e4-a71dfa369a4d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:07.889663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6d452cf0-f3e8-4ab4-a2e4-a71dfa369a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba810512a08e44d88cc99dfab99d15a2', 'request_id': 'req-6d452cf0-f3e8-4ab4-a2e4-a71dfa369a4d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:07.897890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6d452cf0-f3e8-4ab4-a2e4-a71dfa369a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba810512a08e44d88cc99dfab99d15a2', 'request_id': 'req-6d452cf0-f3e8-4ab4-a2e4-a71dfa369a4d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:07.918509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6d452cf0-f3e8-4ab4-a2e4-a71dfa369a4d admin admin] The token cache is being invalidate because project ba810512a08e44d88cc99dfab99d15a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:07.918770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6d452cf0-f3e8-4ab4-a2e4-a71dfa369a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:07.919924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6d452cf0-f3e8-4ab4-a2e4-a71dfa369a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:07.922282 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3370/6777] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:27:07 2022] DELETE /identity/v3/projects/ba810512a08e44d88cc99dfab99d15a2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:07.926630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87eb01-b73b-46f5-817e-b030be71c0b6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:07.928575 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cd87eb01-b73b-46f5-817e-b030be71c0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:07.951231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87eb01-b73b-46f5-817e-b030be71c0b6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:08.039021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24603dcf-5dd3-46d8-9f56-bbc42c579a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:08.040158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24603dcf-5dd3-46d8-9f56-bbc42c579a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:08.040535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24603dcf-5dd3-46d8-9f56-bbc42c579a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:08.042287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24603dcf-5dd3-46d8-9f56-bbc42c579a36 admin admin] PATH_INFO: `/v3/users/71d833e978824becbbfdda39ac83aa8f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:08.043758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24603dcf-5dd3-46d8-9f56-bbc42c579a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71d833e978824becbbfdda39ac83aa8f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:08.045814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24603dcf-5dd3-46d8-9f56-bbc42c579a36 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:08.124978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-24603dcf-5dd3-46d8-9f56-bbc42c579a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d833e978824becbbfdda39ac83aa8f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:08.151644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-24603dcf-5dd3-46d8-9f56-bbc42c579a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d833e978824becbbfdda39ac83aa8f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:08.152316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-24603dcf-5dd3-46d8-9f56-bbc42c579a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d833e978824becbbfdda39ac83aa8f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:08.153083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-24603dcf-5dd3-46d8-9f56-bbc42c579a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d833e978824becbbfdda39ac83aa8f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:08.186506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-24603dcf-5dd3-46d8-9f56-bbc42c579a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d833e978824becbbfdda39ac83aa8f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:08.203499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:08.216587 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3408/6778] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:27:07 2022] DELETE /identity/v3/users/71d833e978824becbbfdda39ac83aa8f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:08.580134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d452cf0-f3e8-4ab4-a2e4-a71dfa369a4d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:08.581846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6d452cf0-f3e8-4ab4-a2e4-a71dfa369a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:08.595952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d452cf0-f3e8-4ab4-a2e4-a71dfa369a4d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:08.672759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:08.736160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc78d0d-1c24-4e75-bb9f-82f19c9247a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:08.737657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc78d0d-1c24-4e75-bb9f-82f19c9247a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:08.739599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc78d0d-1c24-4e75-bb9f-82f19c9247a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:08.741139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc78d0d-1c24-4e75-bb9f-82f19c9247a2 admin admin] PATH_INFO: `/v3/projects/e74a5f2fe8464b79b6697006664a8764` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:08.743490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc78d0d-1c24-4e75-bb9f-82f19c9247a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e74a5f2fe8464b79b6697006664a8764)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:08.746014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc78d0d-1c24-4e75-bb9f-82f19c9247a2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:08.808363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2dc78d0d-1c24-4e75-bb9f-82f19c9247a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e74a5f2fe8464b79b6697006664a8764', 'request_id': 'req-2dc78d0d-1c24-4e75-bb9f-82f19c9247a2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:08.816608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2dc78d0d-1c24-4e75-bb9f-82f19c9247a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e74a5f2fe8464b79b6697006664a8764', 'request_id': 'req-2dc78d0d-1c24-4e75-bb9f-82f19c9247a2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:08.824649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2dc78d0d-1c24-4e75-bb9f-82f19c9247a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e74a5f2fe8464b79b6697006664a8764', 'request_id': 'req-2dc78d0d-1c24-4e75-bb9f-82f19c9247a2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:08.840587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2dc78d0d-1c24-4e75-bb9f-82f19c9247a2 admin admin] The token cache is being invalidate because project e74a5f2fe8464b79b6697006664a8764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:08.841122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2dc78d0d-1c24-4e75-bb9f-82f19c9247a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:08.842079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2dc78d0d-1c24-4e75-bb9f-82f19c9247a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:08.845029 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3371/6779] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:27:08 2022] DELETE /identity/v3/projects/e74a5f2fe8464b79b6697006664a8764 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:08.850399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824a878-9e59-4ad3-aac6-01fd1139d067 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:08.850697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824a878-9e59-4ad3-aac6-01fd1139d067 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:08.850982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824a878-9e59-4ad3-aac6-01fd1139d067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:08.881392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a824a878-9e59-4ad3-aac6-01fd1139d067 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:08.883304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a824a878-9e59-4ad3-aac6-01fd1139d067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:08.950476 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3409/6780] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:27:08.958619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c2ccf-7255-40c9-b0bd-6f99a11db4e5 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:08.958903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c2ccf-7255-40c9-b0bd-6f99a11db4e5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:08.959176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c2ccf-7255-40c9-b0bd-6f99a11db4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:08.977941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1e7c2ccf-7255-40c9-b0bd-6f99a11db4e5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:08.979156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1e7c2ccf-7255-40c9-b0bd-6f99a11db4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:08.988539 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3372/6781] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:08.993137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824a878-9e59-4ad3-aac6-01fd1139d067 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:09.003411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824a878-9e59-4ad3-aac6-01fd1139d067 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:09.007971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca14f4-9f0a-4797-9f1a-5a5cd31d68cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:09.008661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca14f4-9f0a-4797-9f1a-5a5cd31d68cd admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:09.009367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca14f4-9f0a-4797-9f1a-5a5cd31d68cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:09.009367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca14f4-9f0a-4797-9f1a-5a5cd31d68cd admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:09.009938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca14f4-9f0a-4797-9f1a-5a5cd31d68cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:27:09.010238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca14f4-9f0a-4797-9f1a-5a5cd31d68cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:09.011973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca14f4-9f0a-4797-9f1a-5a5cd31d68cd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:09.025062 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3410/6782] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:27:09.029591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c2ccf-7255-40c9-b0bd-6f99a11db4e5 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:09.040701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c2ccf-7255-40c9-b0bd-6f99a11db4e5 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:09.045384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79471238-6747-4e3a-8f5d-ac71bcb7fabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:09.046043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79471238-6747-4e3a-8f5d-ac71bcb7fabc admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:09.046323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79471238-6747-4e3a-8f5d-ac71bcb7fabc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:09.046599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79471238-6747-4e3a-8f5d-ac71bcb7fabc admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:09.047333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79471238-6747-4e3a-8f5d-ac71bcb7fabc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:09.050127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79471238-6747-4e3a-8f5d-ac71bcb7fabc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:09.092773 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3373/6783] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:27:09 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:09.102038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca14f4-9f0a-4797-9f1a-5a5cd31d68cd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:09.116545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca14f4-9f0a-4797-9f1a-5a5cd31d68cd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:09.176634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eaa6e0-d479-4da6-8c54-8cf3e523480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:09.177406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaa6e0-d479-4da6-8c54-8cf3e523480d admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:09.178249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaa6e0-d479-4da6-8c54-8cf3e523480d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:09.178911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaa6e0-d479-4da6-8c54-8cf3e523480d admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:09.179339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eaa6e0-d479-4da6-8c54-8cf3e523480d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:09.181389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eaa6e0-d479-4da6-8c54-8cf3e523480d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:09.219776 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3411/6784] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:27:09 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:09.221607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79471238-6747-4e3a-8f5d-ac71bcb7fabc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:09.235317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79471238-6747-4e3a-8f5d-ac71bcb7fabc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:09.241332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5b695-b5ab-4cce-b2a4-93530d8b14cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:09.242059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5b695-b5ab-4cce-b2a4-93530d8b14cd admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:09.242374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5b695-b5ab-4cce-b2a4-93530d8b14cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:09.242728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5b695-b5ab-4cce-b2a4-93530d8b14cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:09.243600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5b695-b5ab-4cce-b2a4-93530d8b14cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:09.246048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5b695-b5ab-4cce-b2a4-93530d8b14cd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:09.272532 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3374/6785] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:27:09.273787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eaa6e0-d479-4da6-8c54-8cf3e523480d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:09.289264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eaa6e0-d479-4da6-8c54-8cf3e523480d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:09.297576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0be71d-122d-4cea-bda7-5f401b5daa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:09.298824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0be71d-122d-4cea-bda7-5f401b5daa10 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:09.299277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0be71d-122d-4cea-bda7-5f401b5daa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:09.299695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0be71d-122d-4cea-bda7-5f401b5daa10 admin admin] PATH_INFO: `/v3/projects/25e45310f7c245bf98b00bc38d7689bc/users/2a2ac61913004266b808d07ace06c385/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:09.321153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0be71d-122d-4cea-bda7-5f401b5daa10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e45310f7c245bf98b00bc38d7689bc, user_id=2a2ac61913004266b808d07ace06c385, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:09.325439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0be71d-122d-4cea-bda7-5f401b5daa10 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:09.344794 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3412/6786] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:27:09 2022] PUT /identity/v3/projects/25e45310f7c245bf98b00bc38d7689bc/users/2a2ac61913004266b808d07ace06c385/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:09.349682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5b695-b5ab-4cce-b2a4-93530d8b14cd admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:09.365447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5b695-b5ab-4cce-b2a4-93530d8b14cd admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:09.445908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a522c-2ddd-4d68-a688-33c00a226c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:09.446586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a522c-2ddd-4d68-a688-33c00a226c1c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:09.446869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a522c-2ddd-4d68-a688-33c00a226c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:09.447141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a522c-2ddd-4d68-a688-33c00a226c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:09.447863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a522c-2ddd-4d68-a688-33c00a226c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:09.449529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a522c-2ddd-4d68-a688-33c00a226c1c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:09.461048 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3375/6787] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:27:09.465310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0be71d-122d-4cea-bda7-5f401b5daa10 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:09.476230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0be71d-122d-4cea-bda7-5f401b5daa10 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:09.481015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e48051-83df-4607-be1e-3e24dfd8280f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:09.482007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e48051-83df-4607-be1e-3e24dfd8280f admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:09.482419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e48051-83df-4607-be1e-3e24dfd8280f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:09.482763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e48051-83df-4607-be1e-3e24dfd8280f admin admin] PATH_INFO: `/v3/projects/25e45310f7c245bf98b00bc38d7689bc/users/2a2ac61913004266b808d07ace06c385/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:09.484868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e48051-83df-4607-be1e-3e24dfd8280f admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e45310f7c245bf98b00bc38d7689bc, user_id=2a2ac61913004266b808d07ace06c385, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:09.488145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e48051-83df-4607-be1e-3e24dfd8280f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:09.501711 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3413/6788] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:27:09 2022] PUT /identity/v3/projects/25e45310f7c245bf98b00bc38d7689bc/users/2a2ac61913004266b808d07ace06c385/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:09.512899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab59494-297c-4a0e-ae56-5e3083954e91 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:09.513278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab59494-297c-4a0e-ae56-5e3083954e91 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:09.513565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab59494-297c-4a0e-ae56-5e3083954e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:09.543746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3ab59494-297c-4a0e-ae56-5e3083954e91 None None] MFA Rules not processed for user `2a2ac61913004266b808d07ace06c385`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:09.545021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3ab59494-297c-4a0e-ae56-5e3083954e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:09.554068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:09.624077 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3376/6789] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:09.629296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e48051-83df-4607-be1e-3e24dfd8280f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:09.675686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:09.717577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e48051-83df-4607-be1e-3e24dfd8280f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:09.723845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861e5cc-b0a1-4796-a3b3-35e09e65ec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:09.724813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861e5cc-b0a1-4796-a3b3-35e09e65ec93 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:09.725339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861e5cc-b0a1-4796-a3b3-35e09e65ec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:09.725834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861e5cc-b0a1-4796-a3b3-35e09e65ec93 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:09.729875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861e5cc-b0a1-4796-a3b3-35e09e65ec93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:09.732462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861e5cc-b0a1-4796-a3b3-35e09e65ec93 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:09.776645 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3414/6790] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:27:09 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:09.781104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab59494-297c-4a0e-ae56-5e3083954e91 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:09.801390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab59494-297c-4a0e-ae56-5e3083954e91 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:09.881534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9a68-e7f6-4af6-b15c-4f190dafe6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:09.882739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9a68-e7f6-4af6-b15c-4f190dafe6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:09.883020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9a68-e7f6-4af6-b15c-4f190dafe6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:09.883291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9a68-e7f6-4af6-b15c-4f190dafe6f3 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:09.883978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e9a68-e7f6-4af6-b15c-4f190dafe6f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:09.886041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e9a68-e7f6-4af6-b15c-4f190dafe6f3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:09.913236 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3377/6791] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:27:09 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:27:09.914458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861e5cc-b0a1-4796-a3b3-35e09e65ec93 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:09.925287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861e5cc-b0a1-4796-a3b3-35e09e65ec93 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:09.931119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527ddd1-7c14-4b31-916f-e5d11238e6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:09.931811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527ddd1-7c14-4b31-916f-e5d11238e6ab admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:09.932119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527ddd1-7c14-4b31-916f-e5d11238e6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:09.932398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527ddd1-7c14-4b31-916f-e5d11238e6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:09.933266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527ddd1-7c14-4b31-916f-e5d11238e6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:09.934969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527ddd1-7c14-4b31-916f-e5d11238e6ab admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:09.947134 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3415/6792] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:27:09.951681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9a68-e7f6-4af6-b15c-4f190dafe6f3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:09.975290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9a68-e7f6-4af6-b15c-4f190dafe6f3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:09.985280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629a6e4-f9df-4399-a922-80fa963df44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:09.986653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629a6e4-f9df-4399-a922-80fa963df44b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:09.987409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629a6e4-f9df-4399-a922-80fa963df44b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:09.988467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629a6e4-f9df-4399-a922-80fa963df44b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:09.989744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629a6e4-f9df-4399-a922-80fa963df44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:09.991676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629a6e4-f9df-4399-a922-80fa963df44b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:10.011339 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3378/6793] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:27:10.012118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527ddd1-7c14-4b31-916f-e5d11238e6ab admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:10.026457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527ddd1-7c14-4b31-916f-e5d11238e6ab admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:10.034740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af938e-82d6-4b42-8972-af669b09dffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:10.036179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af938e-82d6-4b42-8972-af669b09dffd admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:10.036637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af938e-82d6-4b42-8972-af669b09dffd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:10.037069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af938e-82d6-4b42-8972-af669b09dffd admin admin] PATH_INFO: `/v3/projects/9567589aa70a4573814173cd8f0de105/users/837aa20ff2ea4fafa28aee3b1c813f51/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:10.062084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af938e-82d6-4b42-8972-af669b09dffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9567589aa70a4573814173cd8f0de105, user_id=837aa20ff2ea4fafa28aee3b1c813f51, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:10.065467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af938e-82d6-4b42-8972-af669b09dffd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:10.101553 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3416/6794] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:27:10 2022] PUT /identity/v3/projects/9567589aa70a4573814173cd8f0de105/users/837aa20ff2ea4fafa28aee3b1c813f51/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:10.113371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5912e8-3f44-41c3-aa3e-6c0006e51c56 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:10.113733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5912e8-3f44-41c3-aa3e-6c0006e51c56 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:10.114777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5912e8-3f44-41c3-aa3e-6c0006e51c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:10.151209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-de5912e8-3f44-41c3-aa3e-6c0006e51c56 None None] MFA Rules not processed for user `837aa20ff2ea4fafa28aee3b1c813f51`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:10.160241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-de5912e8-3f44-41c3-aa3e-6c0006e51c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:10.254793 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3379/6795] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:10.262227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af938e-82d6-4b42-8972-af669b09dffd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:10.264217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f3af938e-82d6-4b42-8972-af669b09dffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:10.373958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af938e-82d6-4b42-8972-af669b09dffd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:10.382111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00a6d0-5eb3-4abc-8598-afee68faa0db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:10.382975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00a6d0-5eb3-4abc-8598-afee68faa0db service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:10.383401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00a6d0-5eb3-4abc-8598-afee68faa0db service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:10.383857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00a6d0-5eb3-4abc-8598-afee68faa0db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:10.459001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00a6d0-5eb3-4abc-8598-afee68faa0db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:10.460506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00a6d0-5eb3-4abc-8598-afee68faa0db service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:10.475265 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3417/6796] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:27:10.720850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5912e8-3f44-41c3-aa3e-6c0006e51c56 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:10.735694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:10.860111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5912e8-3f44-41c3-aa3e-6c0006e51c56 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:10.873066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45bac8-671a-4771-bb99-ffecb6e7bf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:10.874684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45bac8-671a-4771-bb99-ffecb6e7bf7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:10.875169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45bac8-671a-4771-bb99-ffecb6e7bf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:10.875652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45bac8-671a-4771-bb99-ffecb6e7bf7f admin admin] PATH_INFO: `/v3/users/2a2ac61913004266b808d07ace06c385` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:10.877395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45bac8-671a-4771-bb99-ffecb6e7bf7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2ac61913004266b808d07ace06c385)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:10.880495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45bac8-671a-4771-bb99-ffecb6e7bf7f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:10.963543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fb45bac8-671a-4771-bb99-ffecb6e7bf7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2ac61913004266b808d07ace06c385'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:10.978298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fb45bac8-671a-4771-bb99-ffecb6e7bf7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2ac61913004266b808d07ace06c385'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:10.989226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fb45bac8-671a-4771-bb99-ffecb6e7bf7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2ac61913004266b808d07ace06c385'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:10.990206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fb45bac8-671a-4771-bb99-ffecb6e7bf7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2ac61913004266b808d07ace06c385'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:10.991620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fb45bac8-671a-4771-bb99-ffecb6e7bf7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2ac61913004266b808d07ace06c385'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:11.029809 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3380/6797] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:27:10 2022] DELETE /identity/v3/users/2a2ac61913004266b808d07ace06c385 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:11.036659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc8969-0e39-4517-a6c8-26768254fca5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:11.037223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc8969-0e39-4517-a6c8-26768254fca5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:11.037223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc8969-0e39-4517-a6c8-26768254fca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:11.107590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0ccc8969-0e39-4517-a6c8-26768254fca5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:11.109097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0ccc8969-0e39-4517-a6c8-26768254fca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:11.137507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:11.252500 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3418/6798] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:27:11.285800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45bac8-671a-4771-bb99-ffecb6e7bf7f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:11.292254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fb45bac8-671a-4771-bb99-ffecb6e7bf7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:11.392959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45bac8-671a-4771-bb99-ffecb6e7bf7f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:11.398262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902b5c4-26b4-4885-b032-36ec476206c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:11.398932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902b5c4-26b4-4885-b032-36ec476206c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:11.399213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902b5c4-26b4-4885-b032-36ec476206c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:11.399489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902b5c4-26b4-4885-b032-36ec476206c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:11.411333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902b5c4-26b4-4885-b032-36ec476206c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:11.412821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902b5c4-26b4-4885-b032-36ec476206c6 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:11.429325 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3381/6799] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:27:11.862430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc8969-0e39-4517-a6c8-26768254fca5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:11.863882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0ccc8969-0e39-4517-a6c8-26768254fca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:11.886313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc8969-0e39-4517-a6c8-26768254fca5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:11.892077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927b8f4-b491-4ada-ad63-d1c51d711dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:11.893064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927b8f4-b491-4ada-ad63-d1c51d711dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:11.893367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927b8f4-b491-4ada-ad63-d1c51d711dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:11.893661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927b8f4-b491-4ada-ad63-d1c51d711dfe admin admin] PATH_INFO: `/v3/projects/25e45310f7c245bf98b00bc38d7689bc` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:11.895367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927b8f4-b491-4ada-ad63-d1c51d711dfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=25e45310f7c245bf98b00bc38d7689bc)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:11.896800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927b8f4-b491-4ada-ad63-d1c51d711dfe admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:11.970108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9927b8f4-b491-4ada-ad63-d1c51d711dfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25e45310f7c245bf98b00bc38d7689bc', 'request_id': 'req-9927b8f4-b491-4ada-ad63-d1c51d711dfe'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:11.979345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9927b8f4-b491-4ada-ad63-d1c51d711dfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25e45310f7c245bf98b00bc38d7689bc', 'request_id': 'req-9927b8f4-b491-4ada-ad63-d1c51d711dfe'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:11.986432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9927b8f4-b491-4ada-ad63-d1c51d711dfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25e45310f7c245bf98b00bc38d7689bc', 'request_id': 'req-9927b8f4-b491-4ada-ad63-d1c51d711dfe'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:12.001840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9927b8f4-b491-4ada-ad63-d1c51d711dfe admin admin] The token cache is being invalidate because project 25e45310f7c245bf98b00bc38d7689bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:12.002129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9927b8f4-b491-4ada-ad63-d1c51d711dfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:12.002788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9927b8f4-b491-4ada-ad63-d1c51d711dfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:12.004786 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3419/6800] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:27:11 2022] DELETE /identity/v3/projects/25e45310f7c245bf98b00bc38d7689bc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:27:12.008817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902b5c4-26b4-4885-b032-36ec476206c6 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:12.019979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902b5c4-26b4-4885-b032-36ec476206c6 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:12.056648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:12.090372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cdbef-f05d-4905-9434-0114dc0ec0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:12.091518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cdbef-f05d-4905-9434-0114dc0ec0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:12.091870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cdbef-f05d-4905-9434-0114dc0ec0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:12.092243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cdbef-f05d-4905-9434-0114dc0ec0b6 admin admin] PATH_INFO: `/v3/users/837aa20ff2ea4fafa28aee3b1c813f51` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:12.093531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cdbef-f05d-4905-9434-0114dc0ec0b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=837aa20ff2ea4fafa28aee3b1c813f51)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:12.095701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cdbef-f05d-4905-9434-0114dc0ec0b6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:12.165698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f1cdbef-f05d-4905-9434-0114dc0ec0b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '837aa20ff2ea4fafa28aee3b1c813f51'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:12.174576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f1cdbef-f05d-4905-9434-0114dc0ec0b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '837aa20ff2ea4fafa28aee3b1c813f51'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:12.182494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f1cdbef-f05d-4905-9434-0114dc0ec0b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '837aa20ff2ea4fafa28aee3b1c813f51'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:12.183133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f1cdbef-f05d-4905-9434-0114dc0ec0b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '837aa20ff2ea4fafa28aee3b1c813f51'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:12.183739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f1cdbef-f05d-4905-9434-0114dc0ec0b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '837aa20ff2ea4fafa28aee3b1c813f51'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:12.203136 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3382/6801] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:27:12 2022] DELETE /identity/v3/users/837aa20ff2ea4fafa28aee3b1c813f51 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:12.777077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927b8f4-b491-4ada-ad63-d1c51d711dfe admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:12.778615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9927b8f4-b491-4ada-ad63-d1c51d711dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:12.795046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927b8f4-b491-4ada-ad63-d1c51d711dfe admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:12.857306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4d0b6-c313-4eb4-84cc-488b42727d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:12.858513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4d0b6-c313-4eb4-84cc-488b42727d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:12.858794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4d0b6-c313-4eb4-84cc-488b42727d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:12.859080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4d0b6-c313-4eb4-84cc-488b42727d71 admin admin] PATH_INFO: `/v3/projects/9567589aa70a4573814173cd8f0de105` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:12.860358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4d0b6-c313-4eb4-84cc-488b42727d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9567589aa70a4573814173cd8f0de105)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:12.863792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4d0b6-c313-4eb4-84cc-488b42727d71 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:12.914897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:12.917092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-49b4d0b6-c313-4eb4-84cc-488b42727d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9567589aa70a4573814173cd8f0de105', 'request_id': 'req-49b4d0b6-c313-4eb4-84cc-488b42727d71'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:12.928213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-49b4d0b6-c313-4eb4-84cc-488b42727d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9567589aa70a4573814173cd8f0de105', 'request_id': 'req-49b4d0b6-c313-4eb4-84cc-488b42727d71'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:12.936695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-49b4d0b6-c313-4eb4-84cc-488b42727d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9567589aa70a4573814173cd8f0de105', 'request_id': 'req-49b4d0b6-c313-4eb4-84cc-488b42727d71'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:12.948954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-49b4d0b6-c313-4eb4-84cc-488b42727d71 admin admin] The token cache is being invalidate because project 9567589aa70a4573814173cd8f0de105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:12.949229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-49b4d0b6-c313-4eb4-84cc-488b42727d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:12.949951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-49b4d0b6-c313-4eb4-84cc-488b42727d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:12.952095 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3420/6802] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:27:12 2022] DELETE /identity/v3/projects/9567589aa70a4573814173cd8f0de105 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:12.957326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06f9fe-dc68-408b-9fb8-6cab25456842 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:12.957632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06f9fe-dc68-408b-9fb8-6cab25456842 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:12.957909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06f9fe-dc68-408b-9fb8-6cab25456842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:12.980719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-df06f9fe-dc68-408b-9fb8-6cab25456842 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:12.981980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-df06f9fe-dc68-408b-9fb8-6cab25456842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:13.050633 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3383/6803] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:13.058959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ee2a7-3cdd-41df-b923-6812c1b93e2d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:13.059247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ee2a7-3cdd-41df-b923-6812c1b93e2d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:13.059521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ee2a7-3cdd-41df-b923-6812c1b93e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:13.078750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-090ee2a7-3cdd-41df-b923-6812c1b93e2d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:13.080366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-090ee2a7-3cdd-41df-b923-6812c1b93e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:13.090812 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3421/6804] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:27:13.095358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06f9fe-dc68-408b-9fb8-6cab25456842 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:13.105740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06f9fe-dc68-408b-9fb8-6cab25456842 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:13.110573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc0a81-bbaf-4cac-a20a-0d283f96c19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:13.111327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc0a81-bbaf-4cac-a20a-0d283f96c19f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:13.111682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc0a81-bbaf-4cac-a20a-0d283f96c19f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:13.112032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc0a81-bbaf-4cac-a20a-0d283f96c19f admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:13.112861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc0a81-bbaf-4cac-a20a-0d283f96c19f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:27:13.113241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc0a81-bbaf-4cac-a20a-0d283f96c19f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:13.114965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc0a81-bbaf-4cac-a20a-0d283f96c19f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:13.128528 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3384/6805] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:27:13.133163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ee2a7-3cdd-41df-b923-6812c1b93e2d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:13.143102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ee2a7-3cdd-41df-b923-6812c1b93e2d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:13.148404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e6813-f923-4d77-ae0a-e59ce29397f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:13.149069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e6813-f923-4d77-ae0a-e59ce29397f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:13.149354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e6813-f923-4d77-ae0a-e59ce29397f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:13.149610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e6813-f923-4d77-ae0a-e59ce29397f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:13.150349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e6813-f923-4d77-ae0a-e59ce29397f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:13.152299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e6813-f923-4d77-ae0a-e59ce29397f9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:13.193444 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3422/6806] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:27:13 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:27:13.195393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc0a81-bbaf-4cac-a20a-0d283f96c19f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:13.206276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc0a81-bbaf-4cac-a20a-0d283f96c19f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:13.269613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:13.281610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa3d76-5987-4120-a4a8-0ec2084f7246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:13.282397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa3d76-5987-4120-a4a8-0ec2084f7246 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:13.282756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa3d76-5987-4120-a4a8-0ec2084f7246 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:13.283193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa3d76-5987-4120-a4a8-0ec2084f7246 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:13.283977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa3d76-5987-4120-a4a8-0ec2084f7246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:13.287384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa3d76-5987-4120-a4a8-0ec2084f7246 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:13.336945 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3385/6807] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:27:13 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:13.339429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e6813-f923-4d77-ae0a-e59ce29397f9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:13.359045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e6813-f923-4d77-ae0a-e59ce29397f9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:13.369104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f540e9-6a84-4be7-ba74-b771b5cc0653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:13.369306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f540e9-6a84-4be7-ba74-b771b5cc0653 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:13.369780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f540e9-6a84-4be7-ba74-b771b5cc0653 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:13.370154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f540e9-6a84-4be7-ba74-b771b5cc0653 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:13.371071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f540e9-6a84-4be7-ba74-b771b5cc0653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:13.373053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f540e9-6a84-4be7-ba74-b771b5cc0653 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:13.393609 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3423/6808] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:27:13.395946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa3d76-5987-4120-a4a8-0ec2084f7246 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:13.420978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa3d76-5987-4120-a4a8-0ec2084f7246 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:13.426846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e0085-ceed-4ecb-a9ad-57dc58d0ee3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:13.427526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e0085-ceed-4ecb-a9ad-57dc58d0ee3b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:13.428213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e0085-ceed-4ecb-a9ad-57dc58d0ee3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:13.428494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e0085-ceed-4ecb-a9ad-57dc58d0ee3b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:13.429233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e0085-ceed-4ecb-a9ad-57dc58d0ee3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:13.431028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e0085-ceed-4ecb-a9ad-57dc58d0ee3b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:13.450091 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3386/6809] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:27:13.451309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f540e9-6a84-4be7-ba74-b771b5cc0653 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:13.470019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f540e9-6a84-4be7-ba74-b771b5cc0653 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:13.476159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe016e2c-cc65-4051-86b1-b26fd06fd936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:13.477285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe016e2c-cc65-4051-86b1-b26fd06fd936 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:13.477569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe016e2c-cc65-4051-86b1-b26fd06fd936 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:13.477849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe016e2c-cc65-4051-86b1-b26fd06fd936 admin admin] PATH_INFO: `/v3/projects/23ff36ad65c744c09f176aa17f4e7952/users/3ca42cf31c6e437da13364a2e94bba17/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:13.500272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe016e2c-cc65-4051-86b1-b26fd06fd936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ff36ad65c744c09f176aa17f4e7952, user_id=3ca42cf31c6e437da13364a2e94bba17, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:13.504686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe016e2c-cc65-4051-86b1-b26fd06fd936 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:13.522815 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3424/6810] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:27:13 2022] PUT /identity/v3/projects/23ff36ad65c744c09f176aa17f4e7952/users/3ca42cf31c6e437da13364a2e94bba17/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:13.533933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189bd43-9c07-4b5c-99c8-ee5a772d167e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:13.534224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189bd43-9c07-4b5c-99c8-ee5a772d167e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:13.534516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189bd43-9c07-4b5c-99c8-ee5a772d167e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:13.565750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c189bd43-9c07-4b5c-99c8-ee5a772d167e None None] MFA Rules not processed for user `3ca42cf31c6e437da13364a2e94bba17`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:13.566921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c189bd43-9c07-4b5c-99c8-ee5a772d167e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:13.642702 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3387/6811] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:13.647262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe016e2c-cc65-4051-86b1-b26fd06fd936 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:13.738058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe016e2c-cc65-4051-86b1-b26fd06fd936 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:13.743816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c73bf3-cce7-41f0-884d-28bdb3ea6b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:13.744816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c73bf3-cce7-41f0-884d-28bdb3ea6b4c admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:13.745204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c73bf3-cce7-41f0-884d-28bdb3ea6b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:13.745579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c73bf3-cce7-41f0-884d-28bdb3ea6b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:13.746408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c73bf3-cce7-41f0-884d-28bdb3ea6b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:13.748699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c73bf3-cce7-41f0-884d-28bdb3ea6b4c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:13.792884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189bd43-9c07-4b5c-99c8-ee5a772d167e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:13.798588 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3425/6812] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:27:13 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:13.806229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189bd43-9c07-4b5c-99c8-ee5a772d167e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:13.880440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abc313-ff98-4daa-add4-4a8569956981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:13.881472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abc313-ff98-4daa-add4-4a8569956981 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:13.881792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abc313-ff98-4daa-add4-4a8569956981 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:13.882295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abc313-ff98-4daa-add4-4a8569956981 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:13.883964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abc313-ff98-4daa-add4-4a8569956981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:13.886588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abc313-ff98-4daa-add4-4a8569956981 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:13.918650 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3388/6813] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:27:13 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:27:13.922535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c73bf3-cce7-41f0-884d-28bdb3ea6b4c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:13.936507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c73bf3-cce7-41f0-884d-28bdb3ea6b4c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:13.942387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbea10-4b3d-4d5e-b22e-0e9825623dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:13.943545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbea10-4b3d-4d5e-b22e-0e9825623dfd admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:13.943545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbea10-4b3d-4d5e-b22e-0e9825623dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:13.943750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbea10-4b3d-4d5e-b22e-0e9825623dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:13.944559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbea10-4b3d-4d5e-b22e-0e9825623dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:13.946256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbea10-4b3d-4d5e-b22e-0e9825623dfd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:13.963112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abc313-ff98-4daa-add4-4a8569956981 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:13.969362 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3426/6814] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:27:13.974630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abc313-ff98-4daa-add4-4a8569956981 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:13.980152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d26a21-b608-4c5e-8fe7-822ed908aee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:13.980839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d26a21-b608-4c5e-8fe7-822ed908aee8 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:13.981116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d26a21-b608-4c5e-8fe7-822ed908aee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:13.981389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d26a21-b608-4c5e-8fe7-822ed908aee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:13.982163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d26a21-b608-4c5e-8fe7-822ed908aee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:13.984605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d26a21-b608-4c5e-8fe7-822ed908aee8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:14.000240 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3389/6815] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:27:14.002953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbea10-4b3d-4d5e-b22e-0e9825623dfd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:14.014913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbea10-4b3d-4d5e-b22e-0e9825623dfd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:14.020815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8f75f-bfb6-4802-a717-33c6ce3d639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:14.021672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8f75f-bfb6-4802-a717-33c6ce3d639a admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:14.022488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8f75f-bfb6-4802-a717-33c6ce3d639a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:14.022488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8f75f-bfb6-4802-a717-33c6ce3d639a admin admin] PATH_INFO: `/v3/projects/883f3527367a481aade058037029cdf2/users/adea7863dbb94c8c8b9651fdef93bb17/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:14.039546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8f75f-bfb6-4802-a717-33c6ce3d639a admin admin] RBAC: Authorizing `identity:create_grant(project_id=883f3527367a481aade058037029cdf2, user_id=adea7863dbb94c8c8b9651fdef93bb17, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:14.042451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8f75f-bfb6-4802-a717-33c6ce3d639a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:14.078485 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3427/6816] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:27:14 2022] PUT /identity/v3/projects/883f3527367a481aade058037029cdf2/users/adea7863dbb94c8c8b9651fdef93bb17/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:27:14.085968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1132dc-5609-464b-a883-a681c90717f8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:14.087498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1132dc-5609-464b-a883-a681c90717f8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:14.087930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1132dc-5609-464b-a883-a681c90717f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:14.143298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fe1132dc-5609-464b-a883-a681c90717f8 None None] MFA Rules not processed for user `adea7863dbb94c8c8b9651fdef93bb17`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:14.144572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fe1132dc-5609-464b-a883-a681c90717f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:14.164715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:14.276166 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3390/6817] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:14.293054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8f75f-bfb6-4802-a717-33c6ce3d639a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:14.295270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bbf8f75f-bfb6-4802-a717-33c6ce3d639a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:14.335817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:14.397882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8f75f-bfb6-4802-a717-33c6ce3d639a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:14.405568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e32f7-0554-44a8-8ced-5d43f5d1f8ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:14.406580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e32f7-0554-44a8-8ced-5d43f5d1f8ae service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:14.407108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e32f7-0554-44a8-8ced-5d43f5d1f8ae service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:14.407639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e32f7-0554-44a8-8ced-5d43f5d1f8ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:14.486433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e32f7-0554-44a8-8ced-5d43f5d1f8ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:14.488087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e32f7-0554-44a8-8ced-5d43f5d1f8ae service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:14.500142 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3428/6818] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:27:14.626691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c11492-dc52-4892-ac09-7bdbc2f48444 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:14.627334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c11492-dc52-4892-ac09-7bdbc2f48444 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:14.627830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c11492-dc52-4892-ac09-7bdbc2f48444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:14.649313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a4c11492-dc52-4892-ac09-7bdbc2f48444 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:14.651149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a4c11492-dc52-4892-ac09-7bdbc2f48444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:14.757131 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3391/6819] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:27:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:14.765320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e32f7-0554-44a8-8ced-5d43f5d1f8ae service glance] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:14.766879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a73e32f7-0554-44a8-8ced-5d43f5d1f8ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:14.929530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e32f7-0554-44a8-8ced-5d43f5d1f8ae service glance] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:14.936553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8c630-d8e4-4e43-a776-59bde7affe48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:14.937405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8c630-d8e4-4e43-a776-59bde7affe48 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:14.938119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8c630-d8e4-4e43-a776-59bde7affe48 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:14.938475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8c630-d8e4-4e43-a776-59bde7affe48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:14.948486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8c630-d8e4-4e43-a776-59bde7affe48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:14.949858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8c630-d8e4-4e43-a776-59bde7affe48 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:14.968262 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3429/6820] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:27:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:27:15.252852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c11492-dc52-4892-ac09-7bdbc2f48444 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:15.254785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a4c11492-dc52-4892-ac09-7bdbc2f48444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:15.277354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c11492-dc52-4892-ac09-7bdbc2f48444 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:15.282026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46452a10-a7d4-4f96-a107-da47d1fbb7a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:15.282939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46452a10-a7d4-4f96-a107-da47d1fbb7a3 service glance] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:15.283558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46452a10-a7d4-4f96-a107-da47d1fbb7a3 service glance] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:15.283558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46452a10-a7d4-4f96-a107-da47d1fbb7a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:15.296208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46452a10-a7d4-4f96-a107-da47d1fbb7a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:15.298555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46452a10-a7d4-4f96-a107-da47d1fbb7a3 service glance] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:15.311575 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3392/6821] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:27:15.489552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddf8e8-6538-4705-938b-9deda560597a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:15.489969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddf8e8-6538-4705-938b-9deda560597a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:15.490339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddf8e8-6538-4705-938b-9deda560597a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:15.528496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0cddf8e8-6538-4705-938b-9deda560597a None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:15.529869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0cddf8e8-6538-4705-938b-9deda560597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:15.554657 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3430/6822] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:27:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:15.568015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46452a10-a7d4-4f96-a107-da47d1fbb7a3 service glance] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:15.584491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46452a10-a7d4-4f96-a107-da47d1fbb7a3 service glance] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:15.605325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56638116-500a-4955-b9c3-1aa59216a9c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:15.607245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56638116-500a-4955-b9c3-1aa59216a9c4 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:15.607769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56638116-500a-4955-b9c3-1aa59216a9c4 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:15.608551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56638116-500a-4955-b9c3-1aa59216a9c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:15.619983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56638116-500a-4955-b9c3-1aa59216a9c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:15.623276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56638116-500a-4955-b9c3-1aa59216a9c4 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:15.654373 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3393/6823] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:27:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:27:15.855508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddf8e8-6538-4705-938b-9deda560597a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:15.960827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:15.995429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddf8e8-6538-4705-938b-9deda560597a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:16.003212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bb3e6-337f-4df6-b524-966fa4fa205c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:16.004255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bb3e6-337f-4df6-b524-966fa4fa205c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:16.004624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bb3e6-337f-4df6-b524-966fa4fa205c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:16.005552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bb3e6-337f-4df6-b524-966fa4fa205c admin admin] PATH_INFO: `/v3/users/3ca42cf31c6e437da13364a2e94bba17` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:16.007615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bb3e6-337f-4df6-b524-966fa4fa205c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca42cf31c6e437da13364a2e94bba17)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:16.010520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bb3e6-337f-4df6-b524-966fa4fa205c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:16.084975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-340bb3e6-337f-4df6-b524-966fa4fa205c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca42cf31c6e437da13364a2e94bba17'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:16.101971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-340bb3e6-337f-4df6-b524-966fa4fa205c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca42cf31c6e437da13364a2e94bba17'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:16.102735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-340bb3e6-337f-4df6-b524-966fa4fa205c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca42cf31c6e437da13364a2e94bba17'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:16.103408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-340bb3e6-337f-4df6-b524-966fa4fa205c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca42cf31c6e437da13364a2e94bba17'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:16.112826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-340bb3e6-337f-4df6-b524-966fa4fa205c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca42cf31c6e437da13364a2e94bba17'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:16.139106 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3431/6824] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:27:15 2022] DELETE /identity/v3/users/3ca42cf31c6e437da13364a2e94bba17 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:16.146077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ee538-14df-4b3c-a670-7a8e3a6af883 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:16.146775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ee538-14df-4b3c-a670-7a8e3a6af883 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:16.147203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ee538-14df-4b3c-a670-7a8e3a6af883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:16.172281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-625ee538-14df-4b3c-a670-7a8e3a6af883 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:16.175016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-625ee538-14df-4b3c-a670-7a8e3a6af883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:16.275151 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3394/6825] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:16.294140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bb3e6-337f-4df6-b524-966fa4fa205c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:16.295835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-340bb3e6-337f-4df6-b524-966fa4fa205c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:16.378349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bb3e6-337f-4df6-b524-966fa4fa205c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:16.383777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb3c7a-e3ca-4fea-9b65-589145b1f96f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:16.384563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb3c7a-e3ca-4fea-9b65-589145b1f96f service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:16.384848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb3c7a-e3ca-4fea-9b65-589145b1f96f service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:16.385126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb3c7a-e3ca-4fea-9b65-589145b1f96f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:16.395009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb3c7a-e3ca-4fea-9b65-589145b1f96f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:16.396548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb3c7a-e3ca-4fea-9b65-589145b1f96f service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:16.407582 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3432/6826] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:27:17.051261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ee538-14df-4b3c-a670-7a8e3a6af883 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:17.055035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-625ee538-14df-4b3c-a670-7a8e3a6af883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:17.086536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ee538-14df-4b3c-a670-7a8e3a6af883 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:17.099653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3958aa-f731-4698-a66e-046fff5e991a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:17.100619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3958aa-f731-4698-a66e-046fff5e991a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:17.100873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3958aa-f731-4698-a66e-046fff5e991a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:17.101241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3958aa-f731-4698-a66e-046fff5e991a admin admin] PATH_INFO: `/v3/projects/23ff36ad65c744c09f176aa17f4e7952` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:17.102345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3958aa-f731-4698-a66e-046fff5e991a admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ff36ad65c744c09f176aa17f4e7952)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:17.104662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3958aa-f731-4698-a66e-046fff5e991a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:17.145607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:17.205378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ec3958aa-f731-4698-a66e-046fff5e991a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ff36ad65c744c09f176aa17f4e7952', 'request_id': 'req-ec3958aa-f731-4698-a66e-046fff5e991a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:17.215148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ec3958aa-f731-4698-a66e-046fff5e991a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ff36ad65c744c09f176aa17f4e7952', 'request_id': 'req-ec3958aa-f731-4698-a66e-046fff5e991a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:17.227335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ec3958aa-f731-4698-a66e-046fff5e991a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ff36ad65c744c09f176aa17f4e7952', 'request_id': 'req-ec3958aa-f731-4698-a66e-046fff5e991a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:17.246541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ec3958aa-f731-4698-a66e-046fff5e991a admin admin] The token cache is being invalidate because project 23ff36ad65c744c09f176aa17f4e7952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:17.247352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ec3958aa-f731-4698-a66e-046fff5e991a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:17.248216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ec3958aa-f731-4698-a66e-046fff5e991a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:17.253237 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3395/6827] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:27:17 2022] DELETE /identity/v3/projects/23ff36ad65c744c09f176aa17f4e7952 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:17.254011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb3c7a-e3ca-4fea-9b65-589145b1f96f service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:17.268496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb3c7a-e3ca-4fea-9b65-589145b1f96f service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:17.437719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996e77e-17a0-4f06-bc85-f4efaf0f8956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:17.438776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996e77e-17a0-4f06-bc85-f4efaf0f8956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:17.439117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996e77e-17a0-4f06-bc85-f4efaf0f8956 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:17.439572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996e77e-17a0-4f06-bc85-f4efaf0f8956 admin admin] PATH_INFO: `/v3/users/adea7863dbb94c8c8b9651fdef93bb17` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:17.441077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996e77e-17a0-4f06-bc85-f4efaf0f8956 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adea7863dbb94c8c8b9651fdef93bb17)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:17.443556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996e77e-17a0-4f06-bc85-f4efaf0f8956 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:17.465193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:17.532712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8996e77e-17a0-4f06-bc85-f4efaf0f8956 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adea7863dbb94c8c8b9651fdef93bb17'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:17.559700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8996e77e-17a0-4f06-bc85-f4efaf0f8956 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adea7863dbb94c8c8b9651fdef93bb17'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:17.563628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8996e77e-17a0-4f06-bc85-f4efaf0f8956 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adea7863dbb94c8c8b9651fdef93bb17'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:17.564741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8996e77e-17a0-4f06-bc85-f4efaf0f8956 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adea7863dbb94c8c8b9651fdef93bb17'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:17.576291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8996e77e-17a0-4f06-bc85-f4efaf0f8956 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adea7863dbb94c8c8b9651fdef93bb17'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:17.597526 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3433/6828] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:27:17 2022] DELETE /identity/v3/users/adea7863dbb94c8c8b9651fdef93bb17 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:18.186727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3958aa-f731-4698-a66e-046fff5e991a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:18.190238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ec3958aa-f731-4698-a66e-046fff5e991a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:18.230991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3958aa-f731-4698-a66e-046fff5e991a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:18.385966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252fec5-a017-42e5-aaa0-04e75f09cad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:18.386936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252fec5-a017-42e5-aaa0-04e75f09cad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:18.387289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252fec5-a017-42e5-aaa0-04e75f09cad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:18.387820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252fec5-a017-42e5-aaa0-04e75f09cad6 admin admin] PATH_INFO: `/v3/projects/883f3527367a481aade058037029cdf2` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:18.404532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252fec5-a017-42e5-aaa0-04e75f09cad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=883f3527367a481aade058037029cdf2)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:18.404532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252fec5-a017-42e5-aaa0-04e75f09cad6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:18.479301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c252fec5-a017-42e5-aaa0-04e75f09cad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '883f3527367a481aade058037029cdf2', 'request_id': 'req-c252fec5-a017-42e5-aaa0-04e75f09cad6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:18.488659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c252fec5-a017-42e5-aaa0-04e75f09cad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '883f3527367a481aade058037029cdf2', 'request_id': 'req-c252fec5-a017-42e5-aaa0-04e75f09cad6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:18.501448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c252fec5-a017-42e5-aaa0-04e75f09cad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '883f3527367a481aade058037029cdf2', 'request_id': 'req-c252fec5-a017-42e5-aaa0-04e75f09cad6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:18.532028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c252fec5-a017-42e5-aaa0-04e75f09cad6 admin admin] The token cache is being invalidate because project 883f3527367a481aade058037029cdf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:18.532415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c252fec5-a017-42e5-aaa0-04e75f09cad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:18.533712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c252fec5-a017-42e5-aaa0-04e75f09cad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:18.537496 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3396/6829] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:27:18 2022] DELETE /identity/v3/projects/883f3527367a481aade058037029cdf2 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:18.543387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6dfe4-ff51-4069-903c-c160e34f2517 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:18.543882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6dfe4-ff51-4069-903c-c160e34f2517 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:18.543974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6dfe4-ff51-4069-903c-c160e34f2517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:18.569114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252fec5-a017-42e5-aaa0-04e75f09cad6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:18.574106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c252fec5-a017-42e5-aaa0-04e75f09cad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:18.594755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bac6dfe4-ff51-4069-903c-c160e34f2517 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:18.596787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bac6dfe4-ff51-4069-903c-c160e34f2517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:18.652254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:18.712412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252fec5-a017-42e5-aaa0-04e75f09cad6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:18.719550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128e255-0b8e-47af-bbd8-cc94516fa1af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:18.720396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128e255-0b8e-47af-bbd8-cc94516fa1af service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:18.720696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128e255-0b8e-47af-bbd8-cc94516fa1af service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:18.721148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128e255-0b8e-47af-bbd8-cc94516fa1af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:18.723460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d128e255-0b8e-47af-bbd8-cc94516fa1af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:18.735648 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3434/6830] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:18.739846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa7e52-262c-4cca-9df6-7de9cc16f4e9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:18.740448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa7e52-262c-4cca-9df6-7de9cc16f4e9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:18.740736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa7e52-262c-4cca-9df6-7de9cc16f4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:18.743709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128e255-0b8e-47af-bbd8-cc94516fa1af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:18.747638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128e255-0b8e-47af-bbd8-cc94516fa1af service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:18.774181 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3397/6831] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:27:18.790691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-80fa7e52-262c-4cca-9df6-7de9cc16f4e9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:18.793029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-80fa7e52-262c-4cca-9df6-7de9cc16f4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:18.815451 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3435/6832] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:18.819730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128e255-0b8e-47af-bbd8-cc94516fa1af service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:18.831226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128e255-0b8e-47af-bbd8-cc94516fa1af service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:18.836117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2604e1f-bbc0-4b50-84cc-fbf7f3b7ed76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:18.836920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2604e1f-bbc0-4b50-84cc-fbf7f3b7ed76 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:18.837211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2604e1f-bbc0-4b50-84cc-fbf7f3b7ed76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:18.837489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2604e1f-bbc0-4b50-84cc-fbf7f3b7ed76 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:18.838236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2604e1f-bbc0-4b50-84cc-fbf7f3b7ed76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:27:18.838528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2604e1f-bbc0-4b50-84cc-fbf7f3b7ed76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:18.840174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2604e1f-bbc0-4b50-84cc-fbf7f3b7ed76 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:18.853204 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3398/6833] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:27:18.857885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa7e52-262c-4cca-9df6-7de9cc16f4e9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:18.878286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa7e52-262c-4cca-9df6-7de9cc16f4e9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:18.883884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc23bc0-6bc9-4318-915f-acc6638d1c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:18.885375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc23bc0-6bc9-4318-915f-acc6638d1c0d admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:18.885375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc23bc0-6bc9-4318-915f-acc6638d1c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:18.885670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc23bc0-6bc9-4318-915f-acc6638d1c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:18.887121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc23bc0-6bc9-4318-915f-acc6638d1c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:18.889230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc23bc0-6bc9-4318-915f-acc6638d1c0d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:18.931936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2604e1f-bbc0-4b50-84cc-fbf7f3b7ed76 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:18.934733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c2604e1f-bbc0-4b50-84cc-fbf7f3b7ed76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:18.947687 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3436/6834] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:27:18 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:27:18.948757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc23bc0-6bc9-4318-915f-acc6638d1c0d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:19.022968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2604e1f-bbc0-4b50-84cc-fbf7f3b7ed76 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:19.031561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc23bc0-6bc9-4318-915f-acc6638d1c0d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:19.039311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db1d26-ce3a-4d68-bcbd-8b19ce2ce902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:19.042243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db1d26-ce3a-4d68-bcbd-8b19ce2ce902 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:19.043240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db1d26-ce3a-4d68-bcbd-8b19ce2ce902 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:19.044337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db1d26-ce3a-4d68-bcbd-8b19ce2ce902 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:19.047252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db1d26-ce3a-4d68-bcbd-8b19ce2ce902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:19.054740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db1d26-ce3a-4d68-bcbd-8b19ce2ce902 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:19.085608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:19.117078 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3437/6835] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:27:18 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:19.121436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db1d26-ce3a-4d68-bcbd-8b19ce2ce902 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:19.138098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebfdc3-b476-46fe-aa7a-05378d2e918d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:19.138778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebfdc3-b476-46fe-aa7a-05378d2e918d service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:19.139057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebfdc3-b476-46fe-aa7a-05378d2e918d service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:19.139696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebfdc3-b476-46fe-aa7a-05378d2e918d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:19.146255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4bebfdc3-b476-46fe-aa7a-05378d2e918d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:19.148594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db1d26-ce3a-4d68-bcbd-8b19ce2ce902 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:19.160225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c83d2b-99b3-462d-8e68-b8ba880f25d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:19.163268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c83d2b-99b3-462d-8e68-b8ba880f25d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:19.163268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c83d2b-99b3-462d-8e68-b8ba880f25d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:19.163701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c83d2b-99b3-462d-8e68-b8ba880f25d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:19.164483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c83d2b-99b3-462d-8e68-b8ba880f25d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:19.167837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c83d2b-99b3-462d-8e68-b8ba880f25d7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:19.174701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebfdc3-b476-46fe-aa7a-05378d2e918d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:19.176583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebfdc3-b476-46fe-aa7a-05378d2e918d service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:19.197460 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3399/6836] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:27:19.198258 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3438/6837] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:27:19.198770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebfdc3-b476-46fe-aa7a-05378d2e918d service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:19.213290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebfdc3-b476-46fe-aa7a-05378d2e918d service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:19.218894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021072b-966e-48a8-a6f5-b295ad9ae7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:19.220441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021072b-966e-48a8-a6f5-b295ad9ae7dd admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:19.220570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021072b-966e-48a8-a6f5-b295ad9ae7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:19.220841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021072b-966e-48a8-a6f5-b295ad9ae7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:19.221676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021072b-966e-48a8-a6f5-b295ad9ae7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:19.223538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021072b-966e-48a8-a6f5-b295ad9ae7dd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:19.239452 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3400/6838] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:27:19.244427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c83d2b-99b3-462d-8e68-b8ba880f25d7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:19.259619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c83d2b-99b3-462d-8e68-b8ba880f25d7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:19.267077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987aeef-e1cd-417d-beda-e3c9959f3ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:19.268250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987aeef-e1cd-417d-beda-e3c9959f3ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:19.268754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987aeef-e1cd-417d-beda-e3c9959f3ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:19.269094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987aeef-e1cd-417d-beda-e3c9959f3ddc admin admin] PATH_INFO: `/v3/projects/e86a748df6bf47238461aa08142c54f2/users/2d98da2b43a843268f7cbe476d4fe946/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:19.292917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987aeef-e1cd-417d-beda-e3c9959f3ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86a748df6bf47238461aa08142c54f2, user_id=2d98da2b43a843268f7cbe476d4fe946, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:19.295766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987aeef-e1cd-417d-beda-e3c9959f3ddc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:19.321533 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3439/6839] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:27:19 2022] PUT /identity/v3/projects/e86a748df6bf47238461aa08142c54f2/users/2d98da2b43a843268f7cbe476d4fe946/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:27:19.326727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522d6c6-f12f-49cb-8a8f-43365180c183 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:19.327092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522d6c6-f12f-49cb-8a8f-43365180c183 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:19.327439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522d6c6-f12f-49cb-8a8f-43365180c183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:19.370176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f522d6c6-f12f-49cb-8a8f-43365180c183 None None] MFA Rules not processed for user `2d98da2b43a843268f7cbe476d4fe946`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:19.371723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f522d6c6-f12f-49cb-8a8f-43365180c183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:19.479069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:19.531716 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3401/6840] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:19.548566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987aeef-e1cd-417d-beda-e3c9959f3ddc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:19.551959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e987aeef-e1cd-417d-beda-e3c9959f3ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:19.671796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987aeef-e1cd-417d-beda-e3c9959f3ddc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:19.679420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821b811-f869-49b0-9353-008278b0cc62 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:19.680571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821b811-f869-49b0-9353-008278b0cc62 service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:19.680919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821b811-f869-49b0-9353-008278b0cc62 service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:19.681344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821b811-f869-49b0-9353-008278b0cc62 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:19.694258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821b811-f869-49b0-9353-008278b0cc62 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:19.695070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821b811-f869-49b0-9353-008278b0cc62 service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:19.712168 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3440/6841] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:27:19.876392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522d6c6-f12f-49cb-8a8f-43365180c183 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:19.998985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522d6c6-f12f-49cb-8a8f-43365180c183 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:20.017204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b1d6e-8260-4d08-b35f-5577fb0e892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:20.018375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b1d6e-8260-4d08-b35f-5577fb0e892b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:20.020393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b1d6e-8260-4d08-b35f-5577fb0e892b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:20.021194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b1d6e-8260-4d08-b35f-5577fb0e892b admin admin] PATH_INFO: `/v3/users/2d98da2b43a843268f7cbe476d4fe946` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:20.022771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b1d6e-8260-4d08-b35f-5577fb0e892b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d98da2b43a843268f7cbe476d4fe946)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:20.025257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b1d6e-8260-4d08-b35f-5577fb0e892b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:20.180865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-529b1d6e-8260-4d08-b35f-5577fb0e892b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d98da2b43a843268f7cbe476d4fe946'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:20.201710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-529b1d6e-8260-4d08-b35f-5577fb0e892b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d98da2b43a843268f7cbe476d4fe946'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:20.214045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-529b1d6e-8260-4d08-b35f-5577fb0e892b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d98da2b43a843268f7cbe476d4fe946'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:20.215260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-529b1d6e-8260-4d08-b35f-5577fb0e892b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d98da2b43a843268f7cbe476d4fe946'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:20.216345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-529b1d6e-8260-4d08-b35f-5577fb0e892b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d98da2b43a843268f7cbe476d4fe946'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:20.253064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee4d46-0639-45f7-a33f-35eddca95f36 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:20.253569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee4d46-0639-45f7-a33f-35eddca95f36 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:20.253944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee4d46-0639-45f7-a33f-35eddca95f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:20.256072 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3402/6842] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:27:19 2022] DELETE /identity/v3/users/2d98da2b43a843268f7cbe476d4fe946 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:20.280287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-36ee4d46-0639-45f7-a33f-35eddca95f36 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:20.282160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-36ee4d46-0639-45f7-a33f-35eddca95f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:20.365954 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3441/6843] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:20.374606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b1d6e-8260-4d08-b35f-5577fb0e892b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:20.376645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-529b1d6e-8260-4d08-b35f-5577fb0e892b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:20.441821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b1d6e-8260-4d08-b35f-5577fb0e892b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:20.449337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5b802-f2de-4762-9fea-86a4ffa5192b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:20.450712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5b802-f2de-4762-9fea-86a4ffa5192b service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:20.451046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5b802-f2de-4762-9fea-86a4ffa5192b service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:20.451562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5b802-f2de-4762-9fea-86a4ffa5192b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:20.463895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5b802-f2de-4762-9fea-86a4ffa5192b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:20.465621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5b802-f2de-4762-9fea-86a4ffa5192b service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:20.477592 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3403/6844] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:27:21.057724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee4d46-0639-45f7-a33f-35eddca95f36 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:21.059194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-36ee4d46-0639-45f7-a33f-35eddca95f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:21.100295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee4d46-0639-45f7-a33f-35eddca95f36 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:21.106172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e00c69-3e41-4f9b-a506-6dc5648e6b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:21.107170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e00c69-3e41-4f9b-a506-6dc5648e6b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:21.107534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e00c69-3e41-4f9b-a506-6dc5648e6b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:21.107884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e00c69-3e41-4f9b-a506-6dc5648e6b4b admin admin] PATH_INFO: `/v3/users/c5cd190cf88a4a50bf5e06dbba6c97ed` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:21.109409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e00c69-3e41-4f9b-a506-6dc5648e6b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5cd190cf88a4a50bf5e06dbba6c97ed)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:21.112087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e00c69-3e41-4f9b-a506-6dc5648e6b4b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:21.175626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-47e00c69-3e41-4f9b-a506-6dc5648e6b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5cd190cf88a4a50bf5e06dbba6c97ed'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:21.185450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-47e00c69-3e41-4f9b-a506-6dc5648e6b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5cd190cf88a4a50bf5e06dbba6c97ed'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:21.186212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-47e00c69-3e41-4f9b-a506-6dc5648e6b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5cd190cf88a4a50bf5e06dbba6c97ed'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:21.186827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-47e00c69-3e41-4f9b-a506-6dc5648e6b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5cd190cf88a4a50bf5e06dbba6c97ed'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:21.189692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:21.198615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-47e00c69-3e41-4f9b-a506-6dc5648e6b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5cd190cf88a4a50bf5e06dbba6c97ed'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:21.232886 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3442/6845] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:27:21 2022] DELETE /identity/v3/users/c5cd190cf88a4a50bf5e06dbba6c97ed => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:21.307689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5b802-f2de-4762-9fea-86a4ffa5192b service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:21.309419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-98b5b802-f2de-4762-9fea-86a4ffa5192b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:21.331159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5b802-f2de-4762-9fea-86a4ffa5192b service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:21.370363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:21.473868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a39a1-4396-4b13-a9a4-67e3d86abbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:21.475431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a39a1-4396-4b13-a9a4-67e3d86abbf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:21.475869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a39a1-4396-4b13-a9a4-67e3d86abbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:21.476332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a39a1-4396-4b13-a9a4-67e3d86abbf3 admin admin] PATH_INFO: `/v3/projects/e86a748df6bf47238461aa08142c54f2` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:21.478012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a39a1-4396-4b13-a9a4-67e3d86abbf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e86a748df6bf47238461aa08142c54f2)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:21.480190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a39a1-4396-4b13-a9a4-67e3d86abbf3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:21.559720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e4a39a1-4396-4b13-a9a4-67e3d86abbf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e86a748df6bf47238461aa08142c54f2', 'request_id': 'req-5e4a39a1-4396-4b13-a9a4-67e3d86abbf3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:21.569272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e4a39a1-4396-4b13-a9a4-67e3d86abbf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e86a748df6bf47238461aa08142c54f2', 'request_id': 'req-5e4a39a1-4396-4b13-a9a4-67e3d86abbf3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:21.576080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e4a39a1-4396-4b13-a9a4-67e3d86abbf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e86a748df6bf47238461aa08142c54f2', 'request_id': 'req-5e4a39a1-4396-4b13-a9a4-67e3d86abbf3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:21.600300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e4a39a1-4396-4b13-a9a4-67e3d86abbf3 admin admin] The token cache is being invalidate because project e86a748df6bf47238461aa08142c54f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:21.600544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e4a39a1-4396-4b13-a9a4-67e3d86abbf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:21.601193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5e4a39a1-4396-4b13-a9a4-67e3d86abbf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:21.608511 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3404/6846] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:27:21 2022] DELETE /identity/v3/projects/e86a748df6bf47238461aa08142c54f2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:21.614006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa53c-3868-4447-be02-666e312afe46 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:21.617925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa53c-3868-4447-be02-666e312afe46 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:21.618360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa53c-3868-4447-be02-666e312afe46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:21.633905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a39a1-4396-4b13-a9a4-67e3d86abbf3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:21.635937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5e4a39a1-4396-4b13-a9a4-67e3d86abbf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:21.671416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-86bfa53c-3868-4447-be02-666e312afe46 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:21.673833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-86bfa53c-3868-4447-be02-666e312afe46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:21.742131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a39a1-4396-4b13-a9a4-67e3d86abbf3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:21.749926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0796e-23d2-400d-9839-ead07c8170ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:21.751079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0796e-23d2-400d-9839-ead07c8170ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:21.751519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0796e-23d2-400d-9839-ead07c8170ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:21.751957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0796e-23d2-400d-9839-ead07c8170ec admin admin] PATH_INFO: `/v3/projects/b5e51914b1c3407281b54e1f83717b95` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:21.753926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0796e-23d2-400d-9839-ead07c8170ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5e51914b1c3407281b54e1f83717b95)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:21.757249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0796e-23d2-400d-9839-ead07c8170ec admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:21.829874 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3443/6847] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:21.838570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad6dd3-b2a5-480f-9d8e-b1ef1b619921 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:21.838999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad6dd3-b2a5-480f-9d8e-b1ef1b619921 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:21.839522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad6dd3-b2a5-480f-9d8e-b1ef1b619921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:21.857251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:21.860063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ea0796e-23d2-400d-9839-ead07c8170ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5e51914b1c3407281b54e1f83717b95', 'request_id': 'req-1ea0796e-23d2-400d-9839-ead07c8170ec'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:21.860691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-02ad6dd3-b2a5-480f-9d8e-b1ef1b619921 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:21.862409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-02ad6dd3-b2a5-480f-9d8e-b1ef1b619921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:21.877298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ea0796e-23d2-400d-9839-ead07c8170ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5e51914b1c3407281b54e1f83717b95', 'request_id': 'req-1ea0796e-23d2-400d-9839-ead07c8170ec'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:21.898802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ea0796e-23d2-400d-9839-ead07c8170ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5e51914b1c3407281b54e1f83717b95', 'request_id': 'req-1ea0796e-23d2-400d-9839-ead07c8170ec'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:21.919529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ea0796e-23d2-400d-9839-ead07c8170ec admin admin] The token cache is being invalidate because project b5e51914b1c3407281b54e1f83717b95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:21.922296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ea0796e-23d2-400d-9839-ead07c8170ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:21.923640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1ea0796e-23d2-400d-9839-ead07c8170ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:21.926033 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3405/6848] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:27:21 2022] DELETE /identity/v3/projects/b5e51914b1c3407281b54e1f83717b95 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:21.931761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0796e-23d2-400d-9839-ead07c8170ec admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:21.934586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1ea0796e-23d2-400d-9839-ead07c8170ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:21.955383 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3444/6849] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:27:21.959395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad6dd3-b2a5-480f-9d8e-b1ef1b619921 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:21.971514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad6dd3-b2a5-480f-9d8e-b1ef1b619921 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:21.977529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e18aa1-acd1-468b-936e-bb946c706db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:21.978504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e18aa1-acd1-468b-936e-bb946c706db7 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:21.978964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e18aa1-acd1-468b-936e-bb946c706db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:21.979383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e18aa1-acd1-468b-936e-bb946c706db7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:21.980633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e18aa1-acd1-468b-936e-bb946c706db7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:27:21.981091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e18aa1-acd1-468b-936e-bb946c706db7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:21.983095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e18aa1-acd1-468b-936e-bb946c706db7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:22.000213 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3445/6850] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:27:22.003945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e18aa1-acd1-468b-936e-bb946c706db7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:22.013021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0796e-23d2-400d-9839-ead07c8170ec admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:22.019170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bdf7d-463d-428a-8c8d-a06a4e996328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:22.019170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bdf7d-463d-428a-8c8d-a06a4e996328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:22.019708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bdf7d-463d-428a-8c8d-a06a4e996328 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:22.019799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bdf7d-463d-428a-8c8d-a06a4e996328 admin admin] PATH_INFO: `/v3/users/03f48b1e51b24b97acc169f4672af157` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:22.021138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bdf7d-463d-428a-8c8d-a06a4e996328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f48b1e51b24b97acc169f4672af157)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:22.023504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bdf7d-463d-428a-8c8d-a06a4e996328 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:22.026586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e18aa1-acd1-468b-936e-bb946c706db7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:22.033743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5525b0-c639-4f88-8b32-51a890c9152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:22.034611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5525b0-c639-4f88-8b32-51a890c9152f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:22.035059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5525b0-c639-4f88-8b32-51a890c9152f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:22.035619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5525b0-c639-4f88-8b32-51a890c9152f admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:22.036490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5525b0-c639-4f88-8b32-51a890c9152f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:22.040225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5525b0-c639-4f88-8b32-51a890c9152f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:22.083708 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3446/6851] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:27:22 2022] POST /identity/v3/projects => generated 391 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:27:22.088999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5525b0-c639-4f88-8b32-51a890c9152f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:22.091661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-395bdf7d-463d-428a-8c8d-a06a4e996328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f48b1e51b24b97acc169f4672af157'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:22.110871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-395bdf7d-463d-428a-8c8d-a06a4e996328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f48b1e51b24b97acc169f4672af157'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:22.131873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-395bdf7d-463d-428a-8c8d-a06a4e996328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f48b1e51b24b97acc169f4672af157'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:22.134427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-395bdf7d-463d-428a-8c8d-a06a4e996328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f48b1e51b24b97acc169f4672af157'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:22.136484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-395bdf7d-463d-428a-8c8d-a06a4e996328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f48b1e51b24b97acc169f4672af157'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:22.154728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:22.190256 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3406/6852] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:27:21 2022] DELETE /identity/v3/users/03f48b1e51b24b97acc169f4672af157 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:22.200081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5525b0-c639-4f88-8b32-51a890c9152f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:22.304202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979609b-c6a4-4112-a168-5a98d90c2a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:22.305156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979609b-c6a4-4112-a168-5a98d90c2a38 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:22.306069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979609b-c6a4-4112-a168-5a98d90c2a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:22.306466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979609b-c6a4-4112-a168-5a98d90c2a38 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:22.307398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979609b-c6a4-4112-a168-5a98d90c2a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:22.310410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979609b-c6a4-4112-a168-5a98d90c2a38 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:22.360006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bdf7d-463d-428a-8c8d-a06a4e996328 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:22.361238 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3447/6853] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:27:22 2022] POST /identity/v3/users => generated 296 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:22.362253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-395bdf7d-463d-428a-8c8d-a06a4e996328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:22.385469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bdf7d-463d-428a-8c8d-a06a4e996328 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:22.393268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11576af5-c829-4b32-8046-88ebcbaec2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:22.394709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11576af5-c829-4b32-8046-88ebcbaec2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:22.395094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11576af5-c829-4b32-8046-88ebcbaec2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:22.395470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11576af5-c829-4b32-8046-88ebcbaec2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:22.396543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11576af5-c829-4b32-8046-88ebcbaec2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:22.398306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11576af5-c829-4b32-8046-88ebcbaec2f6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:22.413441 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3407/6854] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:27:22.418021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979609b-c6a4-4112-a168-5a98d90c2a38 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:22.429879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979609b-c6a4-4112-a168-5a98d90c2a38 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:22.435160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ea5fe-f44e-4d6f-9e6c-449e69b4fe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:22.435642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ea5fe-f44e-4d6f-9e6c-449e69b4fe17 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:22.435995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ea5fe-f44e-4d6f-9e6c-449e69b4fe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:22.436313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ea5fe-f44e-4d6f-9e6c-449e69b4fe17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:22.437343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ea5fe-f44e-4d6f-9e6c-449e69b4fe17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:22.439099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ea5fe-f44e-4d6f-9e6c-449e69b4fe17 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:22.481834 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3448/6855] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:27:22.483556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11576af5-c829-4b32-8046-88ebcbaec2f6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:22.497328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11576af5-c829-4b32-8046-88ebcbaec2f6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:22.504529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff88cee-bf6e-4996-a902-2876708de4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:22.505893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff88cee-bf6e-4996-a902-2876708de4a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:22.506251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff88cee-bf6e-4996-a902-2876708de4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:22.507190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff88cee-bf6e-4996-a902-2876708de4a9 admin admin] PATH_INFO: `/v3/projects/73b38ea0aa5f482a97a4dd4e82f1c09c/users/dca3512c15924c0abceac8f637efa313/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:22.530648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff88cee-bf6e-4996-a902-2876708de4a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b38ea0aa5f482a97a4dd4e82f1c09c, user_id=dca3512c15924c0abceac8f637efa313, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:22.533563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff88cee-bf6e-4996-a902-2876708de4a9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:22.553422 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3408/6856] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:27:22 2022] PUT /identity/v3/projects/73b38ea0aa5f482a97a4dd4e82f1c09c/users/dca3512c15924c0abceac8f637efa313/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:22.569783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d777f-d526-4a25-820d-a82dd91a9996 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:22.570216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d777f-d526-4a25-820d-a82dd91a9996 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:22.570568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d777f-d526-4a25-820d-a82dd91a9996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:22.608771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-af3d777f-d526-4a25-820d-a82dd91a9996 None None] MFA Rules not processed for user `dca3512c15924c0abceac8f637efa313`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:22.610528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-af3d777f-d526-4a25-820d-a82dd91a9996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:22.702206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff88cee-bf6e-4996-a902-2876708de4a9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:22.703989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7ff88cee-bf6e-4996-a902-2876708de4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:22.745951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:22.749384 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3449/6857] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:22.754124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d777f-d526-4a25-820d-a82dd91a9996 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:22.866824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff88cee-bf6e-4996-a902-2876708de4a9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:22.888743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b7751-80a8-4e45-8410-9515021d086a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:22.889662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b7751-80a8-4e45-8410-9515021d086a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:22.890458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b7751-80a8-4e45-8410-9515021d086a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:22.890743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b7751-80a8-4e45-8410-9515021d086a admin admin] PATH_INFO: `/v3/projects/bd287eaf14654f86aaba0b98ebb2e612` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:22.892544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b7751-80a8-4e45-8410-9515021d086a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd287eaf14654f86aaba0b98ebb2e612)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:22.894839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:22.896812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b7751-80a8-4e45-8410-9515021d086a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:22.912081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d777f-d526-4a25-820d-a82dd91a9996 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:22.925261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17d53d-a289-4359-ade7-125e0111cc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:22.926261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17d53d-a289-4359-ade7-125e0111cc65 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:22.926545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17d53d-a289-4359-ade7-125e0111cc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:22.926833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17d53d-a289-4359-ade7-125e0111cc65 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:22.927521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17d53d-a289-4359-ade7-125e0111cc65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:22.932679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17d53d-a289-4359-ade7-125e0111cc65 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:22.978126 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3450/6858] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:27:22 2022] POST /identity/v3/projects => generated 389 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:22.979853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17d53d-a289-4359-ade7-125e0111cc65 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:22.994903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-290b7751-80a8-4e45-8410-9515021d086a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd287eaf14654f86aaba0b98ebb2e612', 'request_id': 'req-290b7751-80a8-4e45-8410-9515021d086a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:23.012996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-290b7751-80a8-4e45-8410-9515021d086a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd287eaf14654f86aaba0b98ebb2e612', 'request_id': 'req-290b7751-80a8-4e45-8410-9515021d086a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:23.025058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-290b7751-80a8-4e45-8410-9515021d086a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd287eaf14654f86aaba0b98ebb2e612', 'request_id': 'req-290b7751-80a8-4e45-8410-9515021d086a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:23.051452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-290b7751-80a8-4e45-8410-9515021d086a admin admin] The token cache is being invalidate because project bd287eaf14654f86aaba0b98ebb2e612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:23.053875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-290b7751-80a8-4e45-8410-9515021d086a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:23.055161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-290b7751-80a8-4e45-8410-9515021d086a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:23.057812 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3409/6859] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:27:22 2022] DELETE /identity/v3/projects/bd287eaf14654f86aaba0b98ebb2e612 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:27:23.064236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100a3dd-0adf-4177-8933-cba11e7a80a4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:23.064767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100a3dd-0adf-4177-8933-cba11e7a80a4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:23.065306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100a3dd-0adf-4177-8933-cba11e7a80a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:23.066153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17d53d-a289-4359-ade7-125e0111cc65 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:23.071873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3710a0-690d-4a6a-a648-5ff05d01b554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:23.072593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3710a0-690d-4a6a-a648-5ff05d01b554 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:23.072877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3710a0-690d-4a6a-a648-5ff05d01b554 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:23.073150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3710a0-690d-4a6a-a648-5ff05d01b554 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:23.074008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3710a0-690d-4a6a-a648-5ff05d01b554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:23.075972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3710a0-690d-4a6a-a648-5ff05d01b554 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:23.110866 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3451/6860] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:27:22 2022] POST /identity/v3/users => generated 301 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:23.116296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3710a0-690d-4a6a-a648-5ff05d01b554 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:23.120345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9a3710a0-690d-4a6a-a648-5ff05d01b554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:23.133182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5100a3dd-0adf-4177-8933-cba11e7a80a4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:23.134427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5100a3dd-0adf-4177-8933-cba11e7a80a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:23.144492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3710a0-690d-4a6a-a648-5ff05d01b554 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:23.163121 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3410/6861] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:23.165938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11793a-bcff-48d1-93bc-cd25466a35f1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:23.166430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11793a-bcff-48d1-93bc-cd25466a35f1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:23.166544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11793a-bcff-48d1-93bc-cd25466a35f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:23.167817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7595063-2480-44a2-869f-adbce71abd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:23.169623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7595063-2480-44a2-869f-adbce71abd9d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:23.171009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7595063-2480-44a2-869f-adbce71abd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:23.171301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7595063-2480-44a2-869f-adbce71abd9d admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:23.172442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7595063-2480-44a2-869f-adbce71abd9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:23.173816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7595063-2480-44a2-869f-adbce71abd9d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:23.192085 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3452/6862] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:27:23.197039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7595063-2480-44a2-869f-adbce71abd9d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:23.208287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7595063-2480-44a2-869f-adbce71abd9d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:23.208864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-cd11793a-bcff-48d1-93bc-cd25466a35f1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:23.210563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cd11793a-bcff-48d1-93bc-cd25466a35f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:23.216732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91841827-805d-4a72-bc24-ae3ecc6fbbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:23.218297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91841827-805d-4a72-bc24-ae3ecc6fbbba admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:23.218776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91841827-805d-4a72-bc24-ae3ecc6fbbba admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:23.219165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91841827-805d-4a72-bc24-ae3ecc6fbbba admin admin] PATH_INFO: `/v3/projects/bac55b94aa6b4d19b1c9d46791ee0d7f/users/ce3b652270ae423c83b305842966734d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:23.221808 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3411/6863] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:27:23.226003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11793a-bcff-48d1-93bc-cd25466a35f1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:23.241017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91841827-805d-4a72-bc24-ae3ecc6fbbba admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac55b94aa6b4d19b1c9d46791ee0d7f, user_id=ce3b652270ae423c83b305842966734d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:23.242723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11793a-bcff-48d1-93bc-cd25466a35f1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:23.244429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91841827-805d-4a72-bc24-ae3ecc6fbbba admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:23.247989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b22745-1e6a-4e36-aebf-cccb509529a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:23.248970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b22745-1e6a-4e36-aebf-cccb509529a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:23.249412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b22745-1e6a-4e36-aebf-cccb509529a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:23.250365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b22745-1e6a-4e36-aebf-cccb509529a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:23.250716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b22745-1e6a-4e36-aebf-cccb509529a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:27:23.251187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b22745-1e6a-4e36-aebf-cccb509529a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:23.252720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b22745-1e6a-4e36-aebf-cccb509529a1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:23.271052 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3453/6864] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:27:23 2022] PUT /identity/v3/projects/bac55b94aa6b4d19b1c9d46791ee0d7f/users/ce3b652270ae423c83b305842966734d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:23.272501 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3412/6865] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:27:23.274643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91841827-805d-4a72-bc24-ae3ecc6fbbba admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:23.278075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b22745-1e6a-4e36-aebf-cccb509529a1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:23.293606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b22745-1e6a-4e36-aebf-cccb509529a1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:23.362939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f735397-f93d-4c81-b13b-f19502bb331d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:23.365672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f735397-f93d-4c81-b13b-f19502bb331d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:23.366185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f735397-f93d-4c81-b13b-f19502bb331d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:23.366662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f735397-f93d-4c81-b13b-f19502bb331d admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:23.367567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f735397-f93d-4c81-b13b-f19502bb331d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:23.371470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f735397-f93d-4c81-b13b-f19502bb331d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:23.406339 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3413/6866] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:27:23 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:27:23.412257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f735397-f93d-4c81-b13b-f19502bb331d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:23.440825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91841827-805d-4a72-bc24-ae3ecc6fbbba admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:23.443227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:23.490687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:23.518131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49554b-0989-43ae-8e2f-8471b1edd06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:23.518853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49554b-0989-43ae-8e2f-8471b1edd06a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:23.519135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49554b-0989-43ae-8e2f-8471b1edd06a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:23.519405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49554b-0989-43ae-8e2f-8471b1edd06a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:23.522862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49554b-0989-43ae-8e2f-8471b1edd06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:23.526708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49554b-0989-43ae-8e2f-8471b1edd06a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:23.544251 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3454/6867] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:27:23.548229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49554b-0989-43ae-8e2f-8471b1edd06a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:23.555195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f735397-f93d-4c81-b13b-f19502bb331d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:23.561904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49554b-0989-43ae-8e2f-8471b1edd06a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:23.566031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8f5a6-d77c-4e6e-94ef-fd42e9a40309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:23.566826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8f5a6-d77c-4e6e-94ef-fd42e9a40309 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:23.567109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8f5a6-d77c-4e6e-94ef-fd42e9a40309 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:23.567384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8f5a6-d77c-4e6e-94ef-fd42e9a40309 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:23.568101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8f5a6-d77c-4e6e-94ef-fd42e9a40309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:23.569421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5c1d9-f4ad-45bc-8e00-a26228ee6af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:23.570499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5c1d9-f4ad-45bc-8e00-a26228ee6af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:23.570923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5c1d9-f4ad-45bc-8e00-a26228ee6af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:23.571351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5c1d9-f4ad-45bc-8e00-a26228ee6af2 admin admin] PATH_INFO: `/v3/projects/bac55b94aa6b4d19b1c9d46791ee0d7f/users/ce3b652270ae423c83b305842966734d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:23.572943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8f5a6-d77c-4e6e-94ef-fd42e9a40309 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:23.576293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5c1d9-f4ad-45bc-8e00-a26228ee6af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac55b94aa6b4d19b1c9d46791ee0d7f, user_id=ce3b652270ae423c83b305842966734d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:23.580403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5c1d9-f4ad-45bc-8e00-a26228ee6af2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:23.600984 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3455/6868] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:27:23 2022] PUT /identity/v3/projects/bac55b94aa6b4d19b1c9d46791ee0d7f/users/ce3b652270ae423c83b305842966734d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:23.611812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052defd2-19a3-45a1-bb21-5f3ba55c6a8a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:23.612135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052defd2-19a3-45a1-bb21-5f3ba55c6a8a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:23.612394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052defd2-19a3-45a1-bb21-5f3ba55c6a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:23.620679 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3414/6869] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:27:23 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:23.621599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8f5a6-d77c-4e6e-94ef-fd42e9a40309 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:23.647296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8f5a6-d77c-4e6e-94ef-fd42e9a40309 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:23.671734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-052defd2-19a3-45a1-bb21-5f3ba55c6a8a None None] MFA Rules not processed for user `ce3b652270ae423c83b305842966734d`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:23.673625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-052defd2-19a3-45a1-bb21-5f3ba55c6a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:23.749968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ae895-7c22-48a7-9380-5d19a0c8c1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:23.751399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ae895-7c22-48a7-9380-5d19a0c8c1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:23.753342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ae895-7c22-48a7-9380-5d19a0c8c1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:23.754051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ae895-7c22-48a7-9380-5d19a0c8c1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:23.755066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ae895-7c22-48a7-9380-5d19a0c8c1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:23.758452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ae895-7c22-48a7-9380-5d19a0c8c1f0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:23.777919 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3415/6870] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:27:23.782643 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3456/6871] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:23.783940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ae895-7c22-48a7-9380-5d19a0c8c1f0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:23.797098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052defd2-19a3-45a1-bb21-5f3ba55c6a8a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:23.797933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ae895-7c22-48a7-9380-5d19a0c8c1f0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:23.799131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-052defd2-19a3-45a1-bb21-5f3ba55c6a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:23.807089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72555957-dae1-4e06-9fca-6888bf1f4988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:23.808134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72555957-dae1-4e06-9fca-6888bf1f4988 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:23.808514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72555957-dae1-4e06-9fca-6888bf1f4988 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:23.808887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72555957-dae1-4e06-9fca-6888bf1f4988 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:23.809672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72555957-dae1-4e06-9fca-6888bf1f4988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:23.811503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72555957-dae1-4e06-9fca-6888bf1f4988 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:23.829344 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3416/6872] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:27:23.830278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72555957-dae1-4e06-9fca-6888bf1f4988 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:23.842213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72555957-dae1-4e06-9fca-6888bf1f4988 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:23.852548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff33bd-3ece-43ac-99f9-f11a9512a1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:23.854442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff33bd-3ece-43ac-99f9-f11a9512a1ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:23.854442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff33bd-3ece-43ac-99f9-f11a9512a1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:23.854442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff33bd-3ece-43ac-99f9-f11a9512a1ce admin admin] PATH_INFO: `/v3/projects/14611f1a06c7495c934849caf0089f94/users/ef602dcbd0e7441ea0f13a16b393e033/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:23.878200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff33bd-3ece-43ac-99f9-f11a9512a1ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=14611f1a06c7495c934849caf0089f94, user_id=ef602dcbd0e7441ea0f13a16b393e033, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:23.880993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff33bd-3ece-43ac-99f9-f11a9512a1ce admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:23.907565 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3417/6873] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:27:23 2022] PUT /identity/v3/projects/14611f1a06c7495c934849caf0089f94/users/ef602dcbd0e7441ea0f13a16b393e033/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:23.921786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e19a87-d008-4108-9aa5-a2b71f2002bd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:23.922110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e19a87-d008-4108-9aa5-a2b71f2002bd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:23.922393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e19a87-d008-4108-9aa5-a2b71f2002bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:23.924080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052defd2-19a3-45a1-bb21-5f3ba55c6a8a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:23.956877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-99e19a87-d008-4108-9aa5-a2b71f2002bd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:23.958087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-99e19a87-d008-4108-9aa5-a2b71f2002bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:23.984273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67143908-8f1e-4d52-89c8-3e0a02250174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:23.984862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67143908-8f1e-4d52-89c8-3e0a02250174 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:23.985245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67143908-8f1e-4d52-89c8-3e0a02250174 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:23.985662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67143908-8f1e-4d52-89c8-3e0a02250174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:23.987520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-67143908-8f1e-4d52-89c8-3e0a02250174 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:24.013683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:24.066829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:24.089322 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3418/6874] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:24.093282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e19a87-d008-4108-9aa5-a2b71f2002bd None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:24.098804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-99e19a87-d008-4108-9aa5-a2b71f2002bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:24.130399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67143908-8f1e-4d52-89c8-3e0a02250174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:24.132643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67143908-8f1e-4d52-89c8-3e0a02250174 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:24.160141 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3457/6875] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:27:24.161457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67143908-8f1e-4d52-89c8-3e0a02250174 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:24.182740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67143908-8f1e-4d52-89c8-3e0a02250174 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:24.194976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d407f8-6328-40d9-8175-cd3dbf6a1315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:24.195720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d407f8-6328-40d9-8175-cd3dbf6a1315 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:24.196009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d407f8-6328-40d9-8175-cd3dbf6a1315 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:24.196340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d407f8-6328-40d9-8175-cd3dbf6a1315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:24.227549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d407f8-6328-40d9-8175-cd3dbf6a1315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:24.233432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d407f8-6328-40d9-8175-cd3dbf6a1315 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:24.261951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e19a87-d008-4108-9aa5-a2b71f2002bd None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:24.266928 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3458/6876] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:27:24.278055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc7ff4-d2fa-41dd-a2d0-fe877ffae9de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:24.279258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc7ff4-d2fa-41dd-a2d0-fe877ffae9de service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:24.281183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc7ff4-d2fa-41dd-a2d0-fe877ffae9de service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:24.281704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc7ff4-d2fa-41dd-a2d0-fe877ffae9de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:24.286474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-02bc7ff4-d2fa-41dd-a2d0-fe877ffae9de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:24.310456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc7ff4-d2fa-41dd-a2d0-fe877ffae9de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:24.316611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc7ff4-d2fa-41dd-a2d0-fe877ffae9de service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:24.334408 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3419/6877] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:27:29.542175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d407f8-6328-40d9-8175-cd3dbf6a1315 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:29.564255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d407f8-6328-40d9-8175-cd3dbf6a1315 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:29.580530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a798ef4-e74d-4e70-89b4-19869280f794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:29.585169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a798ef4-e74d-4e70-89b4-19869280f794 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:29.585713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a798ef4-e74d-4e70-89b4-19869280f794 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:29.586308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a798ef4-e74d-4e70-89b4-19869280f794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:29.745969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a798ef4-e74d-4e70-89b4-19869280f794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:29.748168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a798ef4-e74d-4e70-89b4-19869280f794 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:29.784055 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3459/6878] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:27:32.019196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e27a12-65e4-438b-984b-93c4080a065a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:32.022523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e27a12-65e4-438b-984b-93c4080a065a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:32.023091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e27a12-65e4-438b-984b-93c4080a065a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:32.076490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-55e27a12-65e4-438b-984b-93c4080a065a None None] MFA Rules not processed for user `ef602dcbd0e7441ea0f13a16b393e033`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:32.077750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-55e27a12-65e4-438b-984b-93c4080a065a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:32.178249 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3420/6879] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:32.182680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a798ef4-e74d-4e70-89b4-19869280f794 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:32.203391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a798ef4-e74d-4e70-89b4-19869280f794 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:32.210198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e7dba-3472-47e6-952c-83164baff181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:32.210979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e7dba-3472-47e6-952c-83164baff181 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:32.211412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e7dba-3472-47e6-952c-83164baff181 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:32.211586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e7dba-3472-47e6-952c-83164baff181 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:32.212695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e7dba-3472-47e6-952c-83164baff181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:32.215293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e7dba-3472-47e6-952c-83164baff181 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:32.258257 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3460/6880] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:27:32 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:32.262661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e27a12-65e4-438b-984b-93c4080a065a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:32.274971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e27a12-65e4-438b-984b-93c4080a065a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:32.384610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e448cd-f04d-4c4d-84b0-07336244070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:32.385427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e448cd-f04d-4c4d-84b0-07336244070f admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:32.385762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e448cd-f04d-4c4d-84b0-07336244070f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:32.386126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e448cd-f04d-4c4d-84b0-07336244070f admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:32.386878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e448cd-f04d-4c4d-84b0-07336244070f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:32.389281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e448cd-f04d-4c4d-84b0-07336244070f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:32.431449 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3421/6881] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:27:32 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:32.434915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e7dba-3472-47e6-952c-83164baff181 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:32.454114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e7dba-3472-47e6-952c-83164baff181 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:32.461021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c738ad7-2a57-4d7d-9d8f-fd33f9484f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:32.463437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c738ad7-2a57-4d7d-9d8f-fd33f9484f87 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:32.463760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c738ad7-2a57-4d7d-9d8f-fd33f9484f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:32.464131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c738ad7-2a57-4d7d-9d8f-fd33f9484f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:32.465439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c738ad7-2a57-4d7d-9d8f-fd33f9484f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:32.469433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c738ad7-2a57-4d7d-9d8f-fd33f9484f87 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:32.484707 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3461/6882] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:27:32.490271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e448cd-f04d-4c4d-84b0-07336244070f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:32.497170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:32.505612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e448cd-f04d-4c4d-84b0-07336244070f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:32.527588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a9954-92be-49cf-addb-6bf60c78a773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:32.528606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a9954-92be-49cf-addb-6bf60c78a773 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:32.528900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a9954-92be-49cf-addb-6bf60c78a773 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:32.529129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a9954-92be-49cf-addb-6bf60c78a773 admin admin] PATH_INFO: `/v3/projects/df64f8b8391e418289eae2ccd94e1ab6/users/c1f6c8a07ba34281959cd8d36e08f01d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:32.585208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a9954-92be-49cf-addb-6bf60c78a773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df64f8b8391e418289eae2ccd94e1ab6, user_id=c1f6c8a07ba34281959cd8d36e08f01d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:32.587902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a9954-92be-49cf-addb-6bf60c78a773 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:32.623794 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3422/6883] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:27:32 2022] PUT /identity/v3/projects/df64f8b8391e418289eae2ccd94e1ab6/users/c1f6c8a07ba34281959cd8d36e08f01d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:32.624674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c738ad7-2a57-4d7d-9d8f-fd33f9484f87 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:32.646053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c738ad7-2a57-4d7d-9d8f-fd33f9484f87 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:32.824490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cf05f-0ec8-4171-8d67-59e931e2b71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:32.825208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cf05f-0ec8-4171-8d67-59e931e2b71f admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:32.825564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cf05f-0ec8-4171-8d67-59e931e2b71f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:32.825849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cf05f-0ec8-4171-8d67-59e931e2b71f admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:32.834945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cf05f-0ec8-4171-8d67-59e931e2b71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:32.842039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cf05f-0ec8-4171-8d67-59e931e2b71f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:32.867894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a9954-92be-49cf-addb-6bf60c78a773 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:32.868756 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3462/6884] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:27:32.887260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a9954-92be-49cf-addb-6bf60c78a773 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:32.902743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca036a9-b382-4b64-820d-5ca802b938a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:32.904647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca036a9-b382-4b64-820d-5ca802b938a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:32.905082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca036a9-b382-4b64-820d-5ca802b938a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:32.905869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca036a9-b382-4b64-820d-5ca802b938a7 admin admin] PATH_INFO: `/v3/projects/df64f8b8391e418289eae2ccd94e1ab6/users/c1f6c8a07ba34281959cd8d36e08f01d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:32.912109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca036a9-b382-4b64-820d-5ca802b938a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df64f8b8391e418289eae2ccd94e1ab6, user_id=c1f6c8a07ba34281959cd8d36e08f01d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:32.916240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca036a9-b382-4b64-820d-5ca802b938a7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:32.945453 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3423/6885] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:27:32 2022] PUT /identity/v3/projects/df64f8b8391e418289eae2ccd94e1ab6/users/c1f6c8a07ba34281959cd8d36e08f01d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:27:33.201271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cf05f-0ec8-4171-8d67-59e931e2b71f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:33.213420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:33.218219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cf05f-0ec8-4171-8d67-59e931e2b71f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:33.294967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab379c03-40cc-4dbc-82e0-5a786a770b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:33.295864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab379c03-40cc-4dbc-82e0-5a786a770b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:33.296294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab379c03-40cc-4dbc-82e0-5a786a770b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:33.296964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab379c03-40cc-4dbc-82e0-5a786a770b48 admin admin] PATH_INFO: `/v3/users/dca3512c15924c0abceac8f637efa313` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:33.298726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab379c03-40cc-4dbc-82e0-5a786a770b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dca3512c15924c0abceac8f637efa313)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:33.300274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab379c03-40cc-4dbc-82e0-5a786a770b48 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:33.362131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ab379c03-40cc-4dbc-82e0-5a786a770b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dca3512c15924c0abceac8f637efa313'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:33.375706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ab379c03-40cc-4dbc-82e0-5a786a770b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dca3512c15924c0abceac8f637efa313'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:33.376608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ab379c03-40cc-4dbc-82e0-5a786a770b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dca3512c15924c0abceac8f637efa313'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:33.377292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ab379c03-40cc-4dbc-82e0-5a786a770b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dca3512c15924c0abceac8f637efa313'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:33.387405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ab379c03-40cc-4dbc-82e0-5a786a770b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dca3512c15924c0abceac8f637efa313'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:33.423154 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3463/6886] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:27:33 2022] DELETE /identity/v3/users/dca3512c15924c0abceac8f637efa313 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:33.427644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1979cf8-f538-4379-adc9-42e2ec991456 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:33.428595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1979cf8-f538-4379-adc9-42e2ec991456 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:33.428708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1979cf8-f538-4379-adc9-42e2ec991456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:33.449555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d1979cf8-f538-4379-adc9-42e2ec991456 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:33.450944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d1979cf8-f538-4379-adc9-42e2ec991456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:33.543563 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3424/6887] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:33.549873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab379c03-40cc-4dbc-82e0-5a786a770b48 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:33.551453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ab379c03-40cc-4dbc-82e0-5a786a770b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:33.705314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab379c03-40cc-4dbc-82e0-5a786a770b48 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:33.709680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f8b6c-a04c-49a8-9c36-96936b6a1699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:33.710347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f8b6c-a04c-49a8-9c36-96936b6a1699 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:33.710631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f8b6c-a04c-49a8-9c36-96936b6a1699 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:33.710905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f8b6c-a04c-49a8-9c36-96936b6a1699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:33.738098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f8b6c-a04c-49a8-9c36-96936b6a1699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:33.739050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f8b6c-a04c-49a8-9c36-96936b6a1699 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:33.765518 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3464/6888] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:27:34.259862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1979cf8-f538-4379-adc9-42e2ec991456 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:34.267359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d1979cf8-f538-4379-adc9-42e2ec991456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:34.299922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1979cf8-f538-4379-adc9-42e2ec991456 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:34.312645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a30a6-e82d-4afe-80ba-29cb7e349f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:34.313745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a30a6-e82d-4afe-80ba-29cb7e349f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:34.314099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a30a6-e82d-4afe-80ba-29cb7e349f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:34.314371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a30a6-e82d-4afe-80ba-29cb7e349f5a admin admin] PATH_INFO: `/v3/projects/73b38ea0aa5f482a97a4dd4e82f1c09c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:34.316621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a30a6-e82d-4afe-80ba-29cb7e349f5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b38ea0aa5f482a97a4dd4e82f1c09c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:34.323453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a30a6-e82d-4afe-80ba-29cb7e349f5a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:34.461318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4f0a30a6-e82d-4afe-80ba-29cb7e349f5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b38ea0aa5f482a97a4dd4e82f1c09c', 'request_id': 'req-4f0a30a6-e82d-4afe-80ba-29cb7e349f5a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:34.470571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4f0a30a6-e82d-4afe-80ba-29cb7e349f5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b38ea0aa5f482a97a4dd4e82f1c09c', 'request_id': 'req-4f0a30a6-e82d-4afe-80ba-29cb7e349f5a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:34.478494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4f0a30a6-e82d-4afe-80ba-29cb7e349f5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b38ea0aa5f482a97a4dd4e82f1c09c', 'request_id': 'req-4f0a30a6-e82d-4afe-80ba-29cb7e349f5a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:34.497480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4f0a30a6-e82d-4afe-80ba-29cb7e349f5a admin admin] The token cache is being invalidate because project 73b38ea0aa5f482a97a4dd4e82f1c09c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:34.497819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4f0a30a6-e82d-4afe-80ba-29cb7e349f5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:34.498794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4f0a30a6-e82d-4afe-80ba-29cb7e349f5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:34.505149 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3425/6889] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:27:34 2022] DELETE /identity/v3/projects/73b38ea0aa5f482a97a4dd4e82f1c09c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:34.506551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f8b6c-a04c-49a8-9c36-96936b6a1699 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:34.525215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f8b6c-a04c-49a8-9c36-96936b6a1699 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:34.586315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:34.666215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129ad90-28e9-4577-b635-1486f47c70d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:34.667133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129ad90-28e9-4577-b635-1486f47c70d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:34.667418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129ad90-28e9-4577-b635-1486f47c70d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:34.667695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129ad90-28e9-4577-b635-1486f47c70d1 admin admin] PATH_INFO: `/v3/users/ce3b652270ae423c83b305842966734d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:34.668951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129ad90-28e9-4577-b635-1486f47c70d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce3b652270ae423c83b305842966734d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:34.674766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129ad90-28e9-4577-b635-1486f47c70d1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:34.830210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3129ad90-28e9-4577-b635-1486f47c70d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce3b652270ae423c83b305842966734d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:34.840742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3129ad90-28e9-4577-b635-1486f47c70d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce3b652270ae423c83b305842966734d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:34.849410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3129ad90-28e9-4577-b635-1486f47c70d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce3b652270ae423c83b305842966734d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:34.850297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3129ad90-28e9-4577-b635-1486f47c70d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce3b652270ae423c83b305842966734d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:34.866474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3129ad90-28e9-4577-b635-1486f47c70d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce3b652270ae423c83b305842966734d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:34.904179 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3465/6890] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:27:34 2022] DELETE /identity/v3/users/ce3b652270ae423c83b305842966734d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:35.549856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a30a6-e82d-4afe-80ba-29cb7e349f5a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:35.552030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4f0a30a6-e82d-4afe-80ba-29cb7e349f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:35.588108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a30a6-e82d-4afe-80ba-29cb7e349f5a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:35.727780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:35.755350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51802580-0e04-4a4c-b5a1-1f60df043970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:35.756378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51802580-0e04-4a4c-b5a1-1f60df043970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:35.756735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51802580-0e04-4a4c-b5a1-1f60df043970 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:35.757079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51802580-0e04-4a4c-b5a1-1f60df043970 admin admin] PATH_INFO: `/v3/projects/bac55b94aa6b4d19b1c9d46791ee0d7f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:35.759851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51802580-0e04-4a4c-b5a1-1f60df043970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bac55b94aa6b4d19b1c9d46791ee0d7f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:35.763934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51802580-0e04-4a4c-b5a1-1f60df043970 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:35.894402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-51802580-0e04-4a4c-b5a1-1f60df043970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bac55b94aa6b4d19b1c9d46791ee0d7f', 'request_id': 'req-51802580-0e04-4a4c-b5a1-1f60df043970'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:35.909184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-51802580-0e04-4a4c-b5a1-1f60df043970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bac55b94aa6b4d19b1c9d46791ee0d7f', 'request_id': 'req-51802580-0e04-4a4c-b5a1-1f60df043970'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:35.918081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-51802580-0e04-4a4c-b5a1-1f60df043970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bac55b94aa6b4d19b1c9d46791ee0d7f', 'request_id': 'req-51802580-0e04-4a4c-b5a1-1f60df043970'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:35.945502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-51802580-0e04-4a4c-b5a1-1f60df043970 admin admin] The token cache is being invalidate because project bac55b94aa6b4d19b1c9d46791ee0d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:35.945948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-51802580-0e04-4a4c-b5a1-1f60df043970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:35.948323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-51802580-0e04-4a4c-b5a1-1f60df043970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:35.954387 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3426/6891] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:27:35 2022] DELETE /identity/v3/projects/bac55b94aa6b4d19b1c9d46791ee0d7f => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:35.955714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc694c2-7dd9-4ef6-8eb8-494375647fa1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:35.956202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc694c2-7dd9-4ef6-8eb8-494375647fa1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:35.956313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc694c2-7dd9-4ef6-8eb8-494375647fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:35.984918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ecc694c2-7dd9-4ef6-8eb8-494375647fa1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:35.987442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ecc694c2-7dd9-4ef6-8eb8-494375647fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:36.205484 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3466/6892] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:27:36.206675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d07bb-67ef-4bb0-8442-428f86295bd9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:36.207058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d07bb-67ef-4bb0-8442-428f86295bd9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:36.207451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d07bb-67ef-4bb0-8442-428f86295bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:36.244968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ca5d07bb-67ef-4bb0-8442-428f86295bd9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:36.257254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ca5d07bb-67ef-4bb0-8442-428f86295bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:36.290531 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3427/6893] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:27:36.296480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc694c2-7dd9-4ef6-8eb8-494375647fa1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:36.321995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc694c2-7dd9-4ef6-8eb8-494375647fa1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:36.337539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e5922-f182-47a4-90f9-40fe449835f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:36.337539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e5922-f182-47a4-90f9-40fe449835f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:36.338040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e5922-f182-47a4-90f9-40fe449835f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:36.338410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e5922-f182-47a4-90f9-40fe449835f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:36.339274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e5922-f182-47a4-90f9-40fe449835f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:27:36.340167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e5922-f182-47a4-90f9-40fe449835f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:36.342144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e5922-f182-47a4-90f9-40fe449835f2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:36.376143 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3467/6894] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:27:36.377373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d07bb-67ef-4bb0-8442-428f86295bd9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:36.391886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d07bb-67ef-4bb0-8442-428f86295bd9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:36.404602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763efeb2-d860-4379-8fa5-19ff252d281d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:36.405289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763efeb2-d860-4379-8fa5-19ff252d281d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:36.405573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763efeb2-d860-4379-8fa5-19ff252d281d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:36.405853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763efeb2-d860-4379-8fa5-19ff252d281d admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:36.406564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763efeb2-d860-4379-8fa5-19ff252d281d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:36.408692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763efeb2-d860-4379-8fa5-19ff252d281d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:36.470152 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3428/6895] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:27:36 2022] POST /identity/v3/projects => generated 397 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:36.472094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e5922-f182-47a4-90f9-40fe449835f2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:36.502069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e5922-f182-47a4-90f9-40fe449835f2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:36.591732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:36.662531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf25766-e0c8-4b03-b812-7293f150d946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:36.664197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf25766-e0c8-4b03-b812-7293f150d946 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:36.664651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf25766-e0c8-4b03-b812-7293f150d946 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:36.665077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf25766-e0c8-4b03-b812-7293f150d946 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:36.666591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf25766-e0c8-4b03-b812-7293f150d946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:36.669302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf25766-e0c8-4b03-b812-7293f150d946 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:36.712138 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3468/6896] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:27:36 2022] POST /identity/v3/users => generated 299 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:36.717526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763efeb2-d860-4379-8fa5-19ff252d281d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:36.738583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763efeb2-d860-4379-8fa5-19ff252d281d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:36.748401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7466e-a4b0-4b28-aed8-bf560b387675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:36.749680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7466e-a4b0-4b28-aed8-bf560b387675 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:36.750348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7466e-a4b0-4b28-aed8-bf560b387675 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:36.750984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7466e-a4b0-4b28-aed8-bf560b387675 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:36.753750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7466e-a4b0-4b28-aed8-bf560b387675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:36.762879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7466e-a4b0-4b28-aed8-bf560b387675 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:36.785325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf25766-e0c8-4b03-b812-7293f150d946 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:36.786249 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3429/6897] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:27:36.801672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf25766-e0c8-4b03-b812-7293f150d946 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:36.808994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8c11c-2298-4060-8c58-4221458c6a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:36.810044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8c11c-2298-4060-8c58-4221458c6a0a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:36.810486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8c11c-2298-4060-8c58-4221458c6a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:36.810948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8c11c-2298-4060-8c58-4221458c6a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:36.813146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8c11c-2298-4060-8c58-4221458c6a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:36.815580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8c11c-2298-4060-8c58-4221458c6a0a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:36.832143 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3469/6898] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:27:36.845665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7466e-a4b0-4b28-aed8-bf560b387675 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:36.866270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7466e-a4b0-4b28-aed8-bf560b387675 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:36.871944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf300a6-f8d6-418e-9a50-f2f6eb3d4a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:36.872390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf300a6-f8d6-418e-9a50-f2f6eb3d4a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:36.872657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf300a6-f8d6-418e-9a50-f2f6eb3d4a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:36.872928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf300a6-f8d6-418e-9a50-f2f6eb3d4a2e admin admin] PATH_INFO: `/v3/projects/a91ac1e8df454dfeb2be0d45378ab421/users/fcb449ac6a05410c994a6a6c60d3bf43/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:36.901333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf300a6-f8d6-418e-9a50-f2f6eb3d4a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91ac1e8df454dfeb2be0d45378ab421, user_id=fcb449ac6a05410c994a6a6c60d3bf43, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:36.909403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf300a6-f8d6-418e-9a50-f2f6eb3d4a2e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:36.944288 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3430/6899] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:27:36 2022] PUT /identity/v3/projects/a91ac1e8df454dfeb2be0d45378ab421/users/fcb449ac6a05410c994a6a6c60d3bf43/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:37.078406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79530ac3-30ce-44b0-b214-7cb91d20dcec None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:37.079556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79530ac3-30ce-44b0-b214-7cb91d20dcec None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:37.080173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79530ac3-30ce-44b0-b214-7cb91d20dcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:37.120482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-79530ac3-30ce-44b0-b214-7cb91d20dcec None None] MFA Rules not processed for user `fcb449ac6a05410c994a6a6c60d3bf43`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:37.121978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-79530ac3-30ce-44b0-b214-7cb91d20dcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:37.251374 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3470/6900] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:37.269755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf300a6-f8d6-418e-9a50-f2f6eb3d4a2e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:37.272624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ccf300a6-f8d6-418e-9a50-f2f6eb3d4a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:37.374545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf300a6-f8d6-418e-9a50-f2f6eb3d4a2e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:37.379450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da743593-b23d-4f48-90b2-0d62902fe479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:37.380593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da743593-b23d-4f48-90b2-0d62902fe479 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:37.381678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da743593-b23d-4f48-90b2-0d62902fe479 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:37.381678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da743593-b23d-4f48-90b2-0d62902fe479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:37.409024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da743593-b23d-4f48-90b2-0d62902fe479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:37.411620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da743593-b23d-4f48-90b2-0d62902fe479 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:37.454210 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3431/6901] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:27:40.668370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e10d8b-aaf2-402f-949f-49009e3c64b8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:40.669387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e10d8b-aaf2-402f-949f-49009e3c64b8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:40.669814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e10d8b-aaf2-402f-949f-49009e3c64b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:40.720525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b5e10d8b-aaf2-402f-949f-49009e3c64b8 None None] MFA Rules not processed for user `c1f6c8a07ba34281959cd8d36e08f01d`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:40.721985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b5e10d8b-aaf2-402f-949f-49009e3c64b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:40.878157 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3471/6902] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:40.891415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da743593-b23d-4f48-90b2-0d62902fe479 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:40.893126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-da743593-b23d-4f48-90b2-0d62902fe479 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:40.933792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:40.993083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da743593-b23d-4f48-90b2-0d62902fe479 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:40.998207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fef51-a5d9-4188-b3a4-38cfcafdf504 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:40.999407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fef51-a5d9-4188-b3a4-38cfcafdf504 service glance] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:40.999808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fef51-a5d9-4188-b3a4-38cfcafdf504 service glance] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:41.000391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fef51-a5d9-4188-b3a4-38cfcafdf504 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:41.004819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a47fef51-a5d9-4188-b3a4-38cfcafdf504 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:41.074013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fef51-a5d9-4188-b3a4-38cfcafdf504 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:41.080236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fef51-a5d9-4188-b3a4-38cfcafdf504 service glance] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:41.101866 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3432/6903] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:27:44.929078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e10d8b-aaf2-402f-949f-49009e3c64b8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:44.929078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b5e10d8b-aaf2-402f-949f-49009e3c64b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:44.994476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:45.075924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e10d8b-aaf2-402f-949f-49009e3c64b8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:45.090094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dc6c3-4764-4918-874b-f1da8218ce8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:45.091066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dc6c3-4764-4918-874b-f1da8218ce8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:45.091352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dc6c3-4764-4918-874b-f1da8218ce8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:45.091553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dc6c3-4764-4918-874b-f1da8218ce8d admin admin] PATH_INFO: `/v3/users/9d5a44cc22364250a4eb17a765b91a1e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:45.097832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578dc6c3-4764-4918-874b-f1da8218ce8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5a44cc22364250a4eb17a765b91a1e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:45.100218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578dc6c3-4764-4918-874b-f1da8218ce8d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:45.223769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-578dc6c3-4764-4918-874b-f1da8218ce8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5a44cc22364250a4eb17a765b91a1e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:45.243133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-578dc6c3-4764-4918-874b-f1da8218ce8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5a44cc22364250a4eb17a765b91a1e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:45.244600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-578dc6c3-4764-4918-874b-f1da8218ce8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5a44cc22364250a4eb17a765b91a1e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:45.245681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-578dc6c3-4764-4918-874b-f1da8218ce8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5a44cc22364250a4eb17a765b91a1e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:45.261716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-578dc6c3-4764-4918-874b-f1da8218ce8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5a44cc22364250a4eb17a765b91a1e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:45.307239 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3472/6904] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:27:44 2022] DELETE /identity/v3/users/9d5a44cc22364250a4eb17a765b91a1e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:45.311543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1a918-d2b3-4601-9fe7-d5517e9532aa None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:45.312146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1a918-d2b3-4601-9fe7-d5517e9532aa None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:45.312146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1a918-d2b3-4601-9fe7-d5517e9532aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:45.340121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-eda1a918-d2b3-4601-9fe7-d5517e9532aa None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:45.345284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-eda1a918-d2b3-4601-9fe7-d5517e9532aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:45.442220 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3433/6905] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:45.448530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dc6c3-4764-4918-874b-f1da8218ce8d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:45.450197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-578dc6c3-4764-4918-874b-f1da8218ce8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:45.568389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dc6c3-4764-4918-874b-f1da8218ce8d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:45.591343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb299b-8f07-4d2c-88bf-b37b8105888a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:45.592029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb299b-8f07-4d2c-88bf-b37b8105888a service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:45.592584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb299b-8f07-4d2c-88bf-b37b8105888a service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:45.592869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb299b-8f07-4d2c-88bf-b37b8105888a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:45.618185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb299b-8f07-4d2c-88bf-b37b8105888a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:45.627789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb299b-8f07-4d2c-88bf-b37b8105888a service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:45.653197 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3473/6906] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:27:46.063068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1a918-d2b3-4601-9fe7-d5517e9532aa None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:46.065727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-eda1a918-d2b3-4601-9fe7-d5517e9532aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:46.096008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1a918-d2b3-4601-9fe7-d5517e9532aa None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:46.105415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6931ec-2ef0-4135-8222-c38ec82a8b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:46.106710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6931ec-2ef0-4135-8222-c38ec82a8b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:46.106945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6931ec-2ef0-4135-8222-c38ec82a8b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:46.107375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6931ec-2ef0-4135-8222-c38ec82a8b1a admin admin] PATH_INFO: `/v3/projects/6ff9b201a7404244a5ee0fc9912d11a3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:46.109765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6931ec-2ef0-4135-8222-c38ec82a8b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ff9b201a7404244a5ee0fc9912d11a3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:46.120723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6931ec-2ef0-4135-8222-c38ec82a8b1a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:46.195406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cc6931ec-2ef0-4135-8222-c38ec82a8b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ff9b201a7404244a5ee0fc9912d11a3', 'request_id': 'req-cc6931ec-2ef0-4135-8222-c38ec82a8b1a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:46.203179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cc6931ec-2ef0-4135-8222-c38ec82a8b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ff9b201a7404244a5ee0fc9912d11a3', 'request_id': 'req-cc6931ec-2ef0-4135-8222-c38ec82a8b1a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:46.211455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cc6931ec-2ef0-4135-8222-c38ec82a8b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ff9b201a7404244a5ee0fc9912d11a3', 'request_id': 'req-cc6931ec-2ef0-4135-8222-c38ec82a8b1a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:46.217701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:46.237173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cc6931ec-2ef0-4135-8222-c38ec82a8b1a admin admin] The token cache is being invalidate because project 6ff9b201a7404244a5ee0fc9912d11a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:46.237729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cc6931ec-2ef0-4135-8222-c38ec82a8b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:46.239090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cc6931ec-2ef0-4135-8222-c38ec82a8b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:46.241126 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3434/6907] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:27:46 2022] DELETE /identity/v3/projects/6ff9b201a7404244a5ee0fc9912d11a3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:46.246721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f0f6e-c416-48c1-b93f-62892e4b85d1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:46.247181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f0f6e-c416-48c1-b93f-62892e4b85d1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:46.247635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f0f6e-c416-48c1-b93f-62892e4b85d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:46.270782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-de1f0f6e-c416-48c1-b93f-62892e4b85d1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:46.272837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-de1f0f6e-c416-48c1-b93f-62892e4b85d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:46.325869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:46.352836 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3474/6908] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:46.361973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41894c6-182d-473f-9a1f-238ba8816b27 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:46.362508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41894c6-182d-473f-9a1f-238ba8816b27 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:46.362508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41894c6-182d-473f-9a1f-238ba8816b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:46.383599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a41894c6-182d-473f-9a1f-238ba8816b27 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:46.384848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a41894c6-182d-473f-9a1f-238ba8816b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:46.393590 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3435/6909] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:46.398162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f0f6e-c416-48c1-b93f-62892e4b85d1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:46.409428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f0f6e-c416-48c1-b93f-62892e4b85d1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:46.419694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a272ac-827d-4bfd-b8f8-d33e22bd916b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:46.420477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a272ac-827d-4bfd-b8f8-d33e22bd916b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:46.425618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a272ac-827d-4bfd-b8f8-d33e22bd916b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:46.426674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a272ac-827d-4bfd-b8f8-d33e22bd916b admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:46.426788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a272ac-827d-4bfd-b8f8-d33e22bd916b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:27:46.427364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a272ac-827d-4bfd-b8f8-d33e22bd916b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:46.430297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a272ac-827d-4bfd-b8f8-d33e22bd916b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:46.451080 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3475/6910] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:27:46.452364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41894c6-182d-473f-9a1f-238ba8816b27 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:46.466086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41894c6-182d-473f-9a1f-238ba8816b27 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:46.471981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab81de-15f4-4cec-8bcc-c12e45e35cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:46.472790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab81de-15f4-4cec-8bcc-c12e45e35cac admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:46.473139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab81de-15f4-4cec-8bcc-c12e45e35cac admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:46.473481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab81de-15f4-4cec-8bcc-c12e45e35cac admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:46.474247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab81de-15f4-4cec-8bcc-c12e45e35cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:46.476308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab81de-15f4-4cec-8bcc-c12e45e35cac admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:46.508243 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3436/6911] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:27:46 2022] POST /identity/v3/projects => generated 359 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:46.511147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a272ac-827d-4bfd-b8f8-d33e22bd916b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:46.523085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a272ac-827d-4bfd-b8f8-d33e22bd916b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:46.589763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbda89-7b31-4819-bace-2e564af8dce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:46.590651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbda89-7b31-4819-bace-2e564af8dce9 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:46.590985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbda89-7b31-4819-bace-2e564af8dce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:46.591503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbda89-7b31-4819-bace-2e564af8dce9 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:46.593449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbda89-7b31-4819-bace-2e564af8dce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:46.594769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbda89-7b31-4819-bace-2e564af8dce9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:46.634448 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3476/6912] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:27:46 2022] POST /identity/v3/users => generated 280 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:46.638864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab81de-15f4-4cec-8bcc-c12e45e35cac admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:46.654104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab81de-15f4-4cec-8bcc-c12e45e35cac admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:46.660246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2b47f-0ba1-4d8f-91ad-8004c46922df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:46.661235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2b47f-0ba1-4d8f-91ad-8004c46922df admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:46.661670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2b47f-0ba1-4d8f-91ad-8004c46922df admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:46.662089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2b47f-0ba1-4d8f-91ad-8004c46922df admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:46.663021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2b47f-0ba1-4d8f-91ad-8004c46922df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:46.664883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2b47f-0ba1-4d8f-91ad-8004c46922df admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:46.680689 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3437/6913] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:27:46.684520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbda89-7b31-4819-bace-2e564af8dce9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:46.698866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbda89-7b31-4819-bace-2e564af8dce9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:46.717236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123449d-8d61-4192-9565-5ff9ef3b042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:46.718041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123449d-8d61-4192-9565-5ff9ef3b042c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:46.720527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123449d-8d61-4192-9565-5ff9ef3b042c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:46.724357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123449d-8d61-4192-9565-5ff9ef3b042c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:46.725841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123449d-8d61-4192-9565-5ff9ef3b042c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:46.727527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123449d-8d61-4192-9565-5ff9ef3b042c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:46.745333 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3477/6914] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:27:46.751323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2b47f-0ba1-4d8f-91ad-8004c46922df admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:46.769177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2b47f-0ba1-4d8f-91ad-8004c46922df admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:46.779306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122754ce-b184-436c-b130-d6afd17c24ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:46.780391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122754ce-b184-436c-b130-d6afd17c24ac admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:46.781544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122754ce-b184-436c-b130-d6afd17c24ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:46.782391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122754ce-b184-436c-b130-d6afd17c24ac admin admin] PATH_INFO: `/v3/projects/155a3f07a35b4ed9ad8c4b9c9c89606d/users/11e7ee15fc334e308dda2a48f2344788/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:46.801787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122754ce-b184-436c-b130-d6afd17c24ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=155a3f07a35b4ed9ad8c4b9c9c89606d, user_id=11e7ee15fc334e308dda2a48f2344788, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:46.805366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122754ce-b184-436c-b130-d6afd17c24ac admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:46.824849 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3438/6915] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:27:46 2022] PUT /identity/v3/projects/155a3f07a35b4ed9ad8c4b9c9c89606d/users/11e7ee15fc334e308dda2a48f2344788/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:46.836793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffda994-b537-4c89-b6e8-b5d727278779 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:46.837351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffda994-b537-4c89-b6e8-b5d727278779 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:46.837786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffda994-b537-4c89-b6e8-b5d727278779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:46.879628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6ffda994-b537-4c89-b6e8-b5d727278779 None None] MFA Rules not processed for user `11e7ee15fc334e308dda2a48f2344788`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:46.881180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6ffda994-b537-4c89-b6e8-b5d727278779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:46.964472 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3478/6916] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:46 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:46.981672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122754ce-b184-436c-b130-d6afd17c24ac admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:46.983658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-122754ce-b184-436c-b130-d6afd17c24ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:47.101564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122754ce-b184-436c-b130-d6afd17c24ac admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:47.112874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55db6ac-1e79-4276-b604-b0ba09520ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:47.113835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55db6ac-1e79-4276-b604-b0ba09520ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:47.114117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55db6ac-1e79-4276-b604-b0ba09520ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:47.118982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55db6ac-1e79-4276-b604-b0ba09520ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:47.128922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55db6ac-1e79-4276-b604-b0ba09520ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:47.130520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55db6ac-1e79-4276-b604-b0ba09520ec3 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:47.144993 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3439/6917] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:46 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:27:55.121319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffda994-b537-4c89-b6e8-b5d727278779 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:55.122800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6ffda994-b537-4c89-b6e8-b5d727278779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:55.177852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:55.206654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffda994-b537-4c89-b6e8-b5d727278779 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:55.212026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc96f0-5a25-4215-a0b9-fb89258d8933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:55.213215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc96f0-5a25-4215-a0b9-fb89258d8933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:55.213568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc96f0-5a25-4215-a0b9-fb89258d8933 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:55.213770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc96f0-5a25-4215-a0b9-fb89258d8933 admin admin] PATH_INFO: `/v3/users/fcb449ac6a05410c994a6a6c60d3bf43` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:55.217927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc96f0-5a25-4215-a0b9-fb89258d8933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb449ac6a05410c994a6a6c60d3bf43)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:55.220223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc96f0-5a25-4215-a0b9-fb89258d8933 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:55.288094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-20bc96f0-5a25-4215-a0b9-fb89258d8933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb449ac6a05410c994a6a6c60d3bf43'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:55.299881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-20bc96f0-5a25-4215-a0b9-fb89258d8933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb449ac6a05410c994a6a6c60d3bf43'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:55.301486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-20bc96f0-5a25-4215-a0b9-fb89258d8933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb449ac6a05410c994a6a6c60d3bf43'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:55.302280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-20bc96f0-5a25-4215-a0b9-fb89258d8933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb449ac6a05410c994a6a6c60d3bf43'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:55.314717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-20bc96f0-5a25-4215-a0b9-fb89258d8933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb449ac6a05410c994a6a6c60d3bf43'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:55.372235 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3479/6918] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:27:55 2022] DELETE /identity/v3/users/fcb449ac6a05410c994a6a6c60d3bf43 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:55.376965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d845f-dc61-4891-ae09-ca39c147b5d9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:55.377849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d845f-dc61-4891-ae09-ca39c147b5d9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:55.378616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d845f-dc61-4891-ae09-ca39c147b5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:55.401538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a69d845f-dc61-4891-ae09-ca39c147b5d9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:55.405513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a69d845f-dc61-4891-ae09-ca39c147b5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:55.490431 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3440/6919] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:55.499268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc96f0-5a25-4215-a0b9-fb89258d8933 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:55.500955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-20bc96f0-5a25-4215-a0b9-fb89258d8933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:55.600444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc96f0-5a25-4215-a0b9-fb89258d8933 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:55.606264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dcbdf-d211-4a7a-802d-cf829963cdbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:55.608480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dcbdf-d211-4a7a-802d-cf829963cdbc service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:55.608773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dcbdf-d211-4a7a-802d-cf829963cdbc service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:55.609055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dcbdf-d211-4a7a-802d-cf829963cdbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:55.633876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dcbdf-d211-4a7a-802d-cf829963cdbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:55.636306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dcbdf-d211-4a7a-802d-cf829963cdbc service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:55.651388 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3480/6920] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:27:56.027674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d845f-dc61-4891-ae09-ca39c147b5d9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:56.029460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a69d845f-dc61-4891-ae09-ca39c147b5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:56.051260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d845f-dc61-4891-ae09-ca39c147b5d9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:56.061603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c579583-9966-4f80-9ec8-650d507c31e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:56.063028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c579583-9966-4f80-9ec8-650d507c31e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:56.063028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c579583-9966-4f80-9ec8-650d507c31e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:56.063252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c579583-9966-4f80-9ec8-650d507c31e0 admin admin] PATH_INFO: `/v3/projects/a91ac1e8df454dfeb2be0d45378ab421` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:56.064834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c579583-9966-4f80-9ec8-650d507c31e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a91ac1e8df454dfeb2be0d45378ab421)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:56.069333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c579583-9966-4f80-9ec8-650d507c31e0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:56.116925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:56.136163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3c579583-9966-4f80-9ec8-650d507c31e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a91ac1e8df454dfeb2be0d45378ab421', 'request_id': 'req-3c579583-9966-4f80-9ec8-650d507c31e0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:56.141653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3c579583-9966-4f80-9ec8-650d507c31e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a91ac1e8df454dfeb2be0d45378ab421', 'request_id': 'req-3c579583-9966-4f80-9ec8-650d507c31e0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:56.149475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3c579583-9966-4f80-9ec8-650d507c31e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a91ac1e8df454dfeb2be0d45378ab421', 'request_id': 'req-3c579583-9966-4f80-9ec8-650d507c31e0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:56.172068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3c579583-9966-4f80-9ec8-650d507c31e0 admin admin] The token cache is being invalidate because project a91ac1e8df454dfeb2be0d45378ab421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:27:56.172409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3c579583-9966-4f80-9ec8-650d507c31e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:56.173170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3c579583-9966-4f80-9ec8-650d507c31e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:27:56.175219 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3441/6921] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:27:56 2022] DELETE /identity/v3/projects/a91ac1e8df454dfeb2be0d45378ab421 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:27:56.180847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf5982-211f-478b-b76b-fa306eeed450 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:56.181574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf5982-211f-478b-b76b-fa306eeed450 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:56.181983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf5982-211f-478b-b76b-fa306eeed450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:56.205340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f2bf5982-211f-478b-b76b-fa306eeed450 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:56.206652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f2bf5982-211f-478b-b76b-fa306eeed450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:56.288207 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3481/6922] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:56.292033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89415d99-ea92-4d84-b717-e44f4024012b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:56.292339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89415d99-ea92-4d84-b717-e44f4024012b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:56.292618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89415d99-ea92-4d84-b717-e44f4024012b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:56.314531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-89415d99-ea92-4d84-b717-e44f4024012b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:56.315899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-89415d99-ea92-4d84-b717-e44f4024012b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:56.326792 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3442/6923] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:56.328996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf5982-211f-478b-b76b-fa306eeed450 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:56.341768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf5982-211f-478b-b76b-fa306eeed450 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:56.347409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9021a1-f5f6-4ee2-8fb3-efc47111e3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:56.348067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9021a1-f5f6-4ee2-8fb3-efc47111e3ae admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:56.348367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9021a1-f5f6-4ee2-8fb3-efc47111e3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:56.348645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9021a1-f5f6-4ee2-8fb3-efc47111e3ae admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:56.349377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9021a1-f5f6-4ee2-8fb3-efc47111e3ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:27:56.349676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9021a1-f5f6-4ee2-8fb3-efc47111e3ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:56.351830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9021a1-f5f6-4ee2-8fb3-efc47111e3ae admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:56.354635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:56.370771 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3482/6924] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:27:56.375290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89415d99-ea92-4d84-b717-e44f4024012b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:56.386381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89415d99-ea92-4d84-b717-e44f4024012b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:56.391361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98559f3-c80f-40a9-84d2-eb86339574bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:56.392072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98559f3-c80f-40a9-84d2-eb86339574bc admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:56.392365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98559f3-c80f-40a9-84d2-eb86339574bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:56.392800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98559f3-c80f-40a9-84d2-eb86339574bc admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:56.393511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98559f3-c80f-40a9-84d2-eb86339574bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:56.395669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98559f3-c80f-40a9-84d2-eb86339574bc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:56.434294 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3443/6925] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:27:56 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:27:56.438182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9021a1-f5f6-4ee2-8fb3-efc47111e3ae admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:56.452706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9021a1-f5f6-4ee2-8fb3-efc47111e3ae admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:56.526224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901ef71-31c1-41ee-aca5-72db2618b719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:56.527012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901ef71-31c1-41ee-aca5-72db2618b719 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:56.527376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901ef71-31c1-41ee-aca5-72db2618b719 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:56.527900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901ef71-31c1-41ee-aca5-72db2618b719 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:56.528701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901ef71-31c1-41ee-aca5-72db2618b719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:56.531540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901ef71-31c1-41ee-aca5-72db2618b719 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:56.563812 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3483/6926] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:27:56 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:27:56.565381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98559f3-c80f-40a9-84d2-eb86339574bc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:56.576323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98559f3-c80f-40a9-84d2-eb86339574bc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:56.581702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3277252-a76d-4e76-b656-5da04fd3a172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:56.581977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3277252-a76d-4e76-b656-5da04fd3a172 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:56.582264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3277252-a76d-4e76-b656-5da04fd3a172 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:56.582543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3277252-a76d-4e76-b656-5da04fd3a172 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:56.583273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3277252-a76d-4e76-b656-5da04fd3a172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:56.585056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3277252-a76d-4e76-b656-5da04fd3a172 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:56.600240 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3444/6927] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:27:56.601455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901ef71-31c1-41ee-aca5-72db2618b719 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:56.611778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901ef71-31c1-41ee-aca5-72db2618b719 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:56.616696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece7b27-6ff8-4f3a-aae5-23ea58969719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:56.617367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece7b27-6ff8-4f3a-aae5-23ea58969719 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:56.617647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece7b27-6ff8-4f3a-aae5-23ea58969719 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:56.618593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece7b27-6ff8-4f3a-aae5-23ea58969719 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:56.619318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece7b27-6ff8-4f3a-aae5-23ea58969719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:56.621042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece7b27-6ff8-4f3a-aae5-23ea58969719 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:56.634796 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3484/6928] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:27:56.635746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3277252-a76d-4e76-b656-5da04fd3a172 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:56.653615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3277252-a76d-4e76-b656-5da04fd3a172 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:56.658417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328db974-96fd-4a76-a6d2-f459b2a9f533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:56.659317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328db974-96fd-4a76-a6d2-f459b2a9f533 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:56.659596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328db974-96fd-4a76-a6d2-f459b2a9f533 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:56.659869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328db974-96fd-4a76-a6d2-f459b2a9f533 admin admin] PATH_INFO: `/v3/projects/8a4a41c55b8b453ca5abfbd5e82057f0/users/00474b316a264224b99da89285c024d1/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:56.674960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328db974-96fd-4a76-a6d2-f459b2a9f533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4a41c55b8b453ca5abfbd5e82057f0, user_id=00474b316a264224b99da89285c024d1, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:56.677710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328db974-96fd-4a76-a6d2-f459b2a9f533 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:56.693881 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3445/6929] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:27:56 2022] PUT /identity/v3/projects/8a4a41c55b8b453ca5abfbd5e82057f0/users/00474b316a264224b99da89285c024d1/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:27:56.704278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e584d42-dd12-4e21-b87d-34b016bcc78c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:56.704556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e584d42-dd12-4e21-b87d-34b016bcc78c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:56.704829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e584d42-dd12-4e21-b87d-34b016bcc78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:56.732395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2e584d42-dd12-4e21-b87d-34b016bcc78c None None] MFA Rules not processed for user `00474b316a264224b99da89285c024d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:27:56.733665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2e584d42-dd12-4e21-b87d-34b016bcc78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:56.803346 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3485/6930] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:27:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:27:56.813810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328db974-96fd-4a76-a6d2-f459b2a9f533 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:27:56.815986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-328db974-96fd-4a76-a6d2-f459b2a9f533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:27:56.886062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328db974-96fd-4a76-a6d2-f459b2a9f533 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:27:56.889856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550d7c0-6d25-4937-bde0-104ac0fd7889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:27:56.890509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550d7c0-6d25-4937-bde0-104ac0fd7889 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:27:56.890825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550d7c0-6d25-4937-bde0-104ac0fd7889 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:27:56.891126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550d7c0-6d25-4937-bde0-104ac0fd7889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:27:56.900983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550d7c0-6d25-4937-bde0-104ac0fd7889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:27:56.902822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550d7c0-6d25-4937-bde0-104ac0fd7889 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:27:56.914480 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3446/6931] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:27:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:28:01.978866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e584d42-dd12-4e21-b87d-34b016bcc78c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:01.980442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2e584d42-dd12-4e21-b87d-34b016bcc78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:02.073885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e584d42-dd12-4e21-b87d-34b016bcc78c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:02.086262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e8e9d-0da3-416a-b1b2-2d8b9c6c5ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:02.087339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e8e9d-0da3-416a-b1b2-2d8b9c6c5ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:02.087722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e8e9d-0da3-416a-b1b2-2d8b9c6c5ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:02.088167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e8e9d-0da3-416a-b1b2-2d8b9c6c5ea1 admin admin] PATH_INFO: `/v3/users/5a6e0a0f3a6e4856b0ab47fc81106454` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:02.096987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e8e9d-0da3-416a-b1b2-2d8b9c6c5ea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a6e0a0f3a6e4856b0ab47fc81106454)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:02.099258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e8e9d-0da3-416a-b1b2-2d8b9c6c5ea1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:02.102384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:02.184192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d58e8e9d-0da3-416a-b1b2-2d8b9c6c5ea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a6e0a0f3a6e4856b0ab47fc81106454'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:02.198856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d58e8e9d-0da3-416a-b1b2-2d8b9c6c5ea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a6e0a0f3a6e4856b0ab47fc81106454'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:02.199746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d58e8e9d-0da3-416a-b1b2-2d8b9c6c5ea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a6e0a0f3a6e4856b0ab47fc81106454'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:02.200622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d58e8e9d-0da3-416a-b1b2-2d8b9c6c5ea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a6e0a0f3a6e4856b0ab47fc81106454'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:02.209978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d58e8e9d-0da3-416a-b1b2-2d8b9c6c5ea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a6e0a0f3a6e4856b0ab47fc81106454'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:02.236959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e223041-14a5-48a1-955b-281a6b883703 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:02.237521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e223041-14a5-48a1-955b-281a6b883703 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:02.237521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e223041-14a5-48a1-955b-281a6b883703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:02.239318 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3486/6932] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:28:01 2022] DELETE /identity/v3/users/5a6e0a0f3a6e4856b0ab47fc81106454 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:02.265562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0e223041-14a5-48a1-955b-281a6b883703 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:02.267040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0e223041-14a5-48a1-955b-281a6b883703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:02.342086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:02.360908 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3447/6933] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:02.386268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e8e9d-0da3-416a-b1b2-2d8b9c6c5ea1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:02.388373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d58e8e9d-0da3-416a-b1b2-2d8b9c6c5ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:02.492367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e8e9d-0da3-416a-b1b2-2d8b9c6c5ea1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:02.497058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f39a9-7f85-4670-8df7-a96e847917ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:02.497875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f39a9-7f85-4670-8df7-a96e847917ef service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:02.498224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f39a9-7f85-4670-8df7-a96e847917ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:02.498627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f39a9-7f85-4670-8df7-a96e847917ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:02.518575 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f39a9-7f85-4670-8df7-a96e847917ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:02.522373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f39a9-7f85-4670-8df7-a96e847917ef service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:02.539706 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3487/6934] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:28:03.397758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e223041-14a5-48a1-955b-281a6b883703 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:03.399610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0e223041-14a5-48a1-955b-281a6b883703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:03.422090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e223041-14a5-48a1-955b-281a6b883703 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:03.429208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831c817-baa4-4b12-9ca2-b3f01918d536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:03.430468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831c817-baa4-4b12-9ca2-b3f01918d536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:03.430980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831c817-baa4-4b12-9ca2-b3f01918d536 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:03.431697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831c817-baa4-4b12-9ca2-b3f01918d536 admin admin] PATH_INFO: `/v3/projects/9d551fd6c0ca463fb120f6a0bc6d7431` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:03.433531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831c817-baa4-4b12-9ca2-b3f01918d536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d551fd6c0ca463fb120f6a0bc6d7431)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:03.438182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831c817-baa4-4b12-9ca2-b3f01918d536 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:03.511839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0831c817-baa4-4b12-9ca2-b3f01918d536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d551fd6c0ca463fb120f6a0bc6d7431', 'request_id': 'req-0831c817-baa4-4b12-9ca2-b3f01918d536'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:03.521808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0831c817-baa4-4b12-9ca2-b3f01918d536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d551fd6c0ca463fb120f6a0bc6d7431', 'request_id': 'req-0831c817-baa4-4b12-9ca2-b3f01918d536'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:03.535639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0831c817-baa4-4b12-9ca2-b3f01918d536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d551fd6c0ca463fb120f6a0bc6d7431', 'request_id': 'req-0831c817-baa4-4b12-9ca2-b3f01918d536'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:03.555639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0831c817-baa4-4b12-9ca2-b3f01918d536 admin admin] The token cache is being invalidate because project 9d551fd6c0ca463fb120f6a0bc6d7431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:28:03.556114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0831c817-baa4-4b12-9ca2-b3f01918d536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:03.557361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0831c817-baa4-4b12-9ca2-b3f01918d536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:03.566140 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3448/6935] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:28:03 2022] DELETE /identity/v3/projects/9d551fd6c0ca463fb120f6a0bc6d7431 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:03.568339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7b4fa-98b6-41a9-8469-dda9602c6429 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:03.568837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7b4fa-98b6-41a9-8469-dda9602c6429 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:03.569189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7b4fa-98b6-41a9-8469-dda9602c6429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:03.597389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e4f7b4fa-98b6-41a9-8469-dda9602c6429 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:03.600927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e4f7b4fa-98b6-41a9-8469-dda9602c6429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:03.740589 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3488/6936] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:03.748171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175828e1-86ba-4b03-bb92-7bc3d1582a8e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:03.748466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175828e1-86ba-4b03-bb92-7bc3d1582a8e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:03.748803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175828e1-86ba-4b03-bb92-7bc3d1582a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:03.770125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-175828e1-86ba-4b03-bb92-7bc3d1582a8e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:03.771417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-175828e1-86ba-4b03-bb92-7bc3d1582a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:03.781087 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3449/6937] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:03.785457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7b4fa-98b6-41a9-8469-dda9602c6429 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:03.797642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7b4fa-98b6-41a9-8469-dda9602c6429 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:03.803540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d88cd0-3fc5-4a3d-8917-673e8acc4b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:03.805220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d88cd0-3fc5-4a3d-8917-673e8acc4b09 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:03.805220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d88cd0-3fc5-4a3d-8917-673e8acc4b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:03.805603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d88cd0-3fc5-4a3d-8917-673e8acc4b09 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:03.806479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d88cd0-3fc5-4a3d-8917-673e8acc4b09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:28:03.806878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d88cd0-3fc5-4a3d-8917-673e8acc4b09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:03.813939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d88cd0-3fc5-4a3d-8917-673e8acc4b09 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:03.829627 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3489/6938] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:28:03.845999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175828e1-86ba-4b03-bb92-7bc3d1582a8e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:03.850957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175828e1-86ba-4b03-bb92-7bc3d1582a8e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:03.858062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e2fc9-b411-44bf-a6dc-1e3513d2193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:03.859048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e2fc9-b411-44bf-a6dc-1e3513d2193e admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:03.860099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e2fc9-b411-44bf-a6dc-1e3513d2193e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:03.860099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e2fc9-b411-44bf-a6dc-1e3513d2193e admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:03.860820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e2fc9-b411-44bf-a6dc-1e3513d2193e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:03.863046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e2fc9-b411-44bf-a6dc-1e3513d2193e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:03.904531 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3450/6939] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:28:03 2022] POST /identity/v3/projects => generated 393 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:28:03.905820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d88cd0-3fc5-4a3d-8917-673e8acc4b09 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:03.924756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d88cd0-3fc5-4a3d-8917-673e8acc4b09 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:03.930606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e2fc9-b411-44bf-a6dc-1e3513d2193e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:03.937944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1e7e2fc9-b411-44bf-a6dc-1e3513d2193e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:03.942092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:04.026838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d446b-f3be-4940-add1-781f5c60c10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:04.028742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d446b-f3be-4940-add1-781f5c60c10e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:04.029962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d446b-f3be-4940-add1-781f5c60c10e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:04.030884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d446b-f3be-4940-add1-781f5c60c10e admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:04.040598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d446b-f3be-4940-add1-781f5c60c10e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:04.044943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d446b-f3be-4940-add1-781f5c60c10e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:04.047661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e2fc9-b411-44bf-a6dc-1e3513d2193e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:04.054286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc8ea4-5289-40f6-91ce-3c1b3e90d895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:04.055228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc8ea4-5289-40f6-91ce-3c1b3e90d895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:04.055470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc8ea4-5289-40f6-91ce-3c1b3e90d895 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:04.055744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc8ea4-5289-40f6-91ce-3c1b3e90d895 admin admin] PATH_INFO: `/v3/users/ef602dcbd0e7441ea0f13a16b393e033` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:04.057311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc8ea4-5289-40f6-91ce-3c1b3e90d895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef602dcbd0e7441ea0f13a16b393e033)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:04.059453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc8ea4-5289-40f6-91ce-3c1b3e90d895 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:04.088369 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3490/6940] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:28:03 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:28:04.092381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d446b-f3be-4940-add1-781f5c60c10e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:04.105219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d446b-f3be-4940-add1-781f5c60c10e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:04.115242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8aad4-352f-44fa-9461-2ccbdc0645d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:04.116212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8aad4-352f-44fa-9461-2ccbdc0645d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:04.116646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8aad4-352f-44fa-9461-2ccbdc0645d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:04.117272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8aad4-352f-44fa-9461-2ccbdc0645d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:04.120886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8aad4-352f-44fa-9461-2ccbdc0645d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:04.126635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8aad4-352f-44fa-9461-2ccbdc0645d0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:04.147587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b7cc8ea4-5289-40f6-91ce-3c1b3e90d895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef602dcbd0e7441ea0f13a16b393e033'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:04.153493 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3491/6941] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:28:04.156468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8aad4-352f-44fa-9461-2ccbdc0645d0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:04.165046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b7cc8ea4-5289-40f6-91ce-3c1b3e90d895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef602dcbd0e7441ea0f13a16b393e033'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:04.168848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:04.175893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b7cc8ea4-5289-40f6-91ce-3c1b3e90d895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef602dcbd0e7441ea0f13a16b393e033'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:04.176940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b7cc8ea4-5289-40f6-91ce-3c1b3e90d895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef602dcbd0e7441ea0f13a16b393e033'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:04.178799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8aad4-352f-44fa-9461-2ccbdc0645d0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:04.179520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b7cc8ea4-5289-40f6-91ce-3c1b3e90d895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef602dcbd0e7441ea0f13a16b393e033'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:04.192971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7ab6e-17d3-4973-b5ef-861d031d7376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:04.194534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7ab6e-17d3-4973-b5ef-861d031d7376 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:04.195524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7ab6e-17d3-4973-b5ef-861d031d7376 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:04.196641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7ab6e-17d3-4973-b5ef-861d031d7376 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:04.198460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7ab6e-17d3-4973-b5ef-861d031d7376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:04.202423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7ab6e-17d3-4973-b5ef-861d031d7376 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:04.212384 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3451/6942] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:28:03 2022] DELETE /identity/v3/users/ef602dcbd0e7441ea0f13a16b393e033 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:04.223041 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3492/6943] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:28:04.227385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc8ea4-5289-40f6-91ce-3c1b3e90d895 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:04.228784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b7cc8ea4-5289-40f6-91ce-3c1b3e90d895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:04.331973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc8ea4-5289-40f6-91ce-3c1b3e90d895 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:04.337897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f47b3c-fc2d-466c-9cf3-43d64ebe57eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:04.339054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f47b3c-fc2d-466c-9cf3-43d64ebe57eb admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:04.339339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f47b3c-fc2d-466c-9cf3-43d64ebe57eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:04.339617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f47b3c-fc2d-466c-9cf3-43d64ebe57eb admin admin] PATH_INFO: `/v3/projects/e1b2fbfc815c48588a0bec36818df1a3/users/317a63cdd16b4fd69617fb9de95dc4ec/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:04.363161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f47b3c-fc2d-466c-9cf3-43d64ebe57eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b2fbfc815c48588a0bec36818df1a3, user_id=317a63cdd16b4fd69617fb9de95dc4ec, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:04.366773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f47b3c-fc2d-466c-9cf3-43d64ebe57eb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:04.388930 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3452/6944] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:28:04 2022] PUT /identity/v3/projects/e1b2fbfc815c48588a0bec36818df1a3/users/317a63cdd16b4fd69617fb9de95dc4ec/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:04.401540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6786efa-e57d-48a8-b653-dd3621870373 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:04.401827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6786efa-e57d-48a8-b653-dd3621870373 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:04.402105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6786efa-e57d-48a8-b653-dd3621870373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:04.459613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b6786efa-e57d-48a8-b653-dd3621870373 None None] MFA Rules not processed for user `317a63cdd16b4fd69617fb9de95dc4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:04.461152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b6786efa-e57d-48a8-b653-dd3621870373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:04.553582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f47b3c-fc2d-466c-9cf3-43d64ebe57eb admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:04.554764 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3493/6945] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:04.670731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f47b3c-fc2d-466c-9cf3-43d64ebe57eb admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:04.676270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2078cf-d52f-4718-9ace-7b5c7d485ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:04.677151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2078cf-d52f-4718-9ace-7b5c7d485ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:04.677428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2078cf-d52f-4718-9ace-7b5c7d485ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:04.677701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2078cf-d52f-4718-9ace-7b5c7d485ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:04.678830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2078cf-d52f-4718-9ace-7b5c7d485ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:04.680961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2078cf-d52f-4718-9ace-7b5c7d485ed5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:04.697348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6786efa-e57d-48a8-b653-dd3621870373 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:04.698914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b6786efa-e57d-48a8-b653-dd3621870373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:04.721755 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3453/6946] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:28:04 2022] POST /identity/v3/projects => generated 391 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:28:04.724583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2078cf-d52f-4718-9ace-7b5c7d485ed5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:04.725058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6786efa-e57d-48a8-b653-dd3621870373 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:04.790959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:04.827331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2078cf-d52f-4718-9ace-7b5c7d485ed5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:04.836030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db6712-3400-4bcc-a2eb-584aa84b17a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:04.836767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db6712-3400-4bcc-a2eb-584aa84b17a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:04.837144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db6712-3400-4bcc-a2eb-584aa84b17a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:04.837619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db6712-3400-4bcc-a2eb-584aa84b17a1 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:04.839011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db6712-3400-4bcc-a2eb-584aa84b17a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:04.841529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db6712-3400-4bcc-a2eb-584aa84b17a1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:04.865296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d842204-6a6b-4fa5-a9bb-e8a3359a2549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:04.868001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d842204-6a6b-4fa5-a9bb-e8a3359a2549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:04.868502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d842204-6a6b-4fa5-a9bb-e8a3359a2549 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:04.869063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d842204-6a6b-4fa5-a9bb-e8a3359a2549 admin admin] PATH_INFO: `/v3/projects/14611f1a06c7495c934849caf0089f94` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:04.871643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d842204-6a6b-4fa5-a9bb-e8a3359a2549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14611f1a06c7495c934849caf0089f94)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:04.877017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d842204-6a6b-4fa5-a9bb-e8a3359a2549 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:04.891074 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3454/6947] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:28:04 2022] POST /identity/v3/users => generated 302 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:28:04.894793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db6712-3400-4bcc-a2eb-584aa84b17a1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:04.907222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:04.908080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db6712-3400-4bcc-a2eb-584aa84b17a1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:04.915303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473c934-28d6-46e8-99ae-333cd4435029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:04.916241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473c934-28d6-46e8-99ae-333cd4435029 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:04.916471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473c934-28d6-46e8-99ae-333cd4435029 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:04.916890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473c934-28d6-46e8-99ae-333cd4435029 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:04.917625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473c934-28d6-46e8-99ae-333cd4435029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:04.919352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473c934-28d6-46e8-99ae-333cd4435029 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:04.942629 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3455/6948] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:28:04.943969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473c934-28d6-46e8-99ae-333cd4435029 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:04.956778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473c934-28d6-46e8-99ae-333cd4435029 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:04.978759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30410567-cf63-4fad-8a10-121a88160a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:04.980559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30410567-cf63-4fad-8a10-121a88160a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:04.980924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30410567-cf63-4fad-8a10-121a88160a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:04.981237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30410567-cf63-4fad-8a10-121a88160a9e admin admin] PATH_INFO: `/v3/projects/a8f5801df264467ab9c057b023a72caa/users/50d182d4b3f9416fb6d8e44c841dfc16/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:05.014195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6d842204-6a6b-4fa5-a9bb-e8a3359a2549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14611f1a06c7495c934849caf0089f94', 'request_id': 'req-6d842204-6a6b-4fa5-a9bb-e8a3359a2549'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:05.030901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6d842204-6a6b-4fa5-a9bb-e8a3359a2549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14611f1a06c7495c934849caf0089f94', 'request_id': 'req-6d842204-6a6b-4fa5-a9bb-e8a3359a2549'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:05.040706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30410567-cf63-4fad-8a10-121a88160a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f5801df264467ab9c057b023a72caa, user_id=50d182d4b3f9416fb6d8e44c841dfc16, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:05.046554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30410567-cf63-4fad-8a10-121a88160a9e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:05.048902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6d842204-6a6b-4fa5-a9bb-e8a3359a2549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14611f1a06c7495c934849caf0089f94', 'request_id': 'req-6d842204-6a6b-4fa5-a9bb-e8a3359a2549'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:05.094661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6d842204-6a6b-4fa5-a9bb-e8a3359a2549 admin admin] The token cache is being invalidate because project 14611f1a06c7495c934849caf0089f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:28:05.094883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6d842204-6a6b-4fa5-a9bb-e8a3359a2549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:05.096630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6d842204-6a6b-4fa5-a9bb-e8a3359a2549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:05.102782 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3494/6950] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:28:04 2022] DELETE /identity/v3/projects/14611f1a06c7495c934849caf0089f94 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:28:05.103101 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3456/6950] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:28:04 2022] PUT /identity/v3/projects/a8f5801df264467ab9c057b023a72caa/users/50d182d4b3f9416fb6d8e44c841dfc16/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:05.104228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d842204-6a6b-4fa5-a9bb-e8a3359a2549 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:05.105757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6d842204-6a6b-4fa5-a9bb-e8a3359a2549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:05.111978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30410567-cf63-4fad-8a10-121a88160a9e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:05.125728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-30410567-cf63-4fad-8a10-121a88160a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:05.251645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30410567-cf63-4fad-8a10-121a88160a9e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:05.272951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d9cc5-67a9-4d28-bb39-a94ba29450d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:05.273888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d9cc5-67a9-4d28-bb39-a94ba29450d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:05.274172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d9cc5-67a9-4d28-bb39-a94ba29450d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:05.274453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d9cc5-67a9-4d28-bb39-a94ba29450d0 admin admin] PATH_INFO: `/v3/users/c1f6c8a07ba34281959cd8d36e08f01d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:05.275791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d9cc5-67a9-4d28-bb39-a94ba29450d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f6c8a07ba34281959cd8d36e08f01d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:05.277804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d9cc5-67a9-4d28-bb39-a94ba29450d0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:05.281167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d842204-6a6b-4fa5-a9bb-e8a3359a2549 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:05.297554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f0e28-29a0-4378-8863-5cbe673e491d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:05.298817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f0e28-29a0-4378-8863-5cbe673e491d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:05.299329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f0e28-29a0-4378-8863-5cbe673e491d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:05.299804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f0e28-29a0-4378-8863-5cbe673e491d admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:05.301042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f0e28-29a0-4378-8863-5cbe673e491d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:05.303530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f0e28-29a0-4378-8863-5cbe673e491d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:05.335002 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3495/6951] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:28:05.339716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f0e28-29a0-4378-8863-5cbe673e491d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:05.372658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-993d9cc5-67a9-4d28-bb39-a94ba29450d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f6c8a07ba34281959cd8d36e08f01d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:05.380950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f0e28-29a0-4378-8863-5cbe673e491d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:05.401947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-993d9cc5-67a9-4d28-bb39-a94ba29450d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f6c8a07ba34281959cd8d36e08f01d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:05.404882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d229b-8c67-4185-a24f-170cd5caa662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:05.414682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-993d9cc5-67a9-4d28-bb39-a94ba29450d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f6c8a07ba34281959cd8d36e08f01d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:05.414969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d229b-8c67-4185-a24f-170cd5caa662 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:05.415569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-993d9cc5-67a9-4d28-bb39-a94ba29450d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f6c8a07ba34281959cd8d36e08f01d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:05.416216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-993d9cc5-67a9-4d28-bb39-a94ba29450d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f6c8a07ba34281959cd8d36e08f01d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:05.416465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d229b-8c67-4185-a24f-170cd5caa662 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:05.417612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d229b-8c67-4185-a24f-170cd5caa662 admin admin] PATH_INFO: `/v3/projects/a8f5801df264467ab9c057b023a72caa/users/50d182d4b3f9416fb6d8e44c841dfc16/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:05.427010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d229b-8c67-4185-a24f-170cd5caa662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f5801df264467ab9c057b023a72caa, user_id=50d182d4b3f9416fb6d8e44c841dfc16, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:05.440246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d229b-8c67-4185-a24f-170cd5caa662 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:05.456911 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3457/6952] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:28:05 2022] DELETE /identity/v3/users/c1f6c8a07ba34281959cd8d36e08f01d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:05.471273 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3496/6953] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:28:05 2022] PUT /identity/v3/projects/a8f5801df264467ab9c057b023a72caa/users/50d182d4b3f9416fb6d8e44c841dfc16/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:05.482420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494ce21-e3dd-43c0-a276-47ae9a88f975 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:05.482704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494ce21-e3dd-43c0-a276-47ae9a88f975 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:05.482980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494ce21-e3dd-43c0-a276-47ae9a88f975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:05.530951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:05.536577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9494ce21-e3dd-43c0-a276-47ae9a88f975 None None] MFA Rules not processed for user `50d182d4b3f9416fb6d8e44c841dfc16`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:05.539988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9494ce21-e3dd-43c0-a276-47ae9a88f975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:05.638507 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3458/6954] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:05.652439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d229b-8c67-4185-a24f-170cd5caa662 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:05.654160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f99d229b-8c67-4185-a24f-170cd5caa662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:05.793706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494ce21-e3dd-43c0-a276-47ae9a88f975 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:05.795562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9494ce21-e3dd-43c0-a276-47ae9a88f975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:05.820334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d229b-8c67-4185-a24f-170cd5caa662 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:05.846560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:05.924990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c331fa-caca-44a6-9764-de927426779e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:05.926973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c331fa-caca-44a6-9764-de927426779e service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:05.927251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c331fa-caca-44a6-9764-de927426779e service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:05.927586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c331fa-caca-44a6-9764-de927426779e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:05.930452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-08c331fa-caca-44a6-9764-de927426779e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:05.931964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494ce21-e3dd-43c0-a276-47ae9a88f975 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:05.951007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187f655-fe96-43ca-9cdd-6ac4f2d95fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:05.954273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187f655-fe96-43ca-9cdd-6ac4f2d95fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:05.955075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187f655-fe96-43ca-9cdd-6ac4f2d95fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:05.955520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187f655-fe96-43ca-9cdd-6ac4f2d95fa1 admin admin] PATH_INFO: `/v3/projects/df64f8b8391e418289eae2ccd94e1ab6` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:05.957304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187f655-fe96-43ca-9cdd-6ac4f2d95fa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df64f8b8391e418289eae2ccd94e1ab6)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:05.964001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187f655-fe96-43ca-9cdd-6ac4f2d95fa1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:06.100990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c331fa-caca-44a6-9764-de927426779e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:06.102792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c331fa-caca-44a6-9764-de927426779e service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:06.120608 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3497/6955] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:28:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:28:06.137031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a187f655-fe96-43ca-9cdd-6ac4f2d95fa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df64f8b8391e418289eae2ccd94e1ab6', 'request_id': 'req-a187f655-fe96-43ca-9cdd-6ac4f2d95fa1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:06.159572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a187f655-fe96-43ca-9cdd-6ac4f2d95fa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df64f8b8391e418289eae2ccd94e1ab6', 'request_id': 'req-a187f655-fe96-43ca-9cdd-6ac4f2d95fa1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:06.175124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a187f655-fe96-43ca-9cdd-6ac4f2d95fa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df64f8b8391e418289eae2ccd94e1ab6', 'request_id': 'req-a187f655-fe96-43ca-9cdd-6ac4f2d95fa1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:06.205272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a187f655-fe96-43ca-9cdd-6ac4f2d95fa1 admin admin] The token cache is being invalidate because project df64f8b8391e418289eae2ccd94e1ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:28:06.205613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a187f655-fe96-43ca-9cdd-6ac4f2d95fa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:06.206331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a187f655-fe96-43ca-9cdd-6ac4f2d95fa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:06.208497 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3459/6956] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:28:05 2022] DELETE /identity/v3/projects/df64f8b8391e418289eae2ccd94e1ab6 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:28:06.442014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c331fa-caca-44a6-9764-de927426779e service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:06.443756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-08c331fa-caca-44a6-9764-de927426779e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:06.470571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c331fa-caca-44a6-9764-de927426779e service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:06.607608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafc443-a1fb-4513-ae0c-3801e51c21b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:06.608569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafc443-a1fb-4513-ae0c-3801e51c21b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:06.608856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafc443-a1fb-4513-ae0c-3801e51c21b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:06.609146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafc443-a1fb-4513-ae0c-3801e51c21b4 admin admin] PATH_INFO: `/v3/users/00474b316a264224b99da89285c024d1` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:06.610871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafc443-a1fb-4513-ae0c-3801e51c21b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00474b316a264224b99da89285c024d1)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:06.616456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafc443-a1fb-4513-ae0c-3801e51c21b4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:06.748716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7dafc443-a1fb-4513-ae0c-3801e51c21b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00474b316a264224b99da89285c024d1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:06.772866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7dafc443-a1fb-4513-ae0c-3801e51c21b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00474b316a264224b99da89285c024d1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:06.773628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7dafc443-a1fb-4513-ae0c-3801e51c21b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00474b316a264224b99da89285c024d1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:06.774351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7dafc443-a1fb-4513-ae0c-3801e51c21b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00474b316a264224b99da89285c024d1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:06.782017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:06.786043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7dafc443-a1fb-4513-ae0c-3801e51c21b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00474b316a264224b99da89285c024d1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:06.810217 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3498/6957] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:28:06 2022] DELETE /identity/v3/users/00474b316a264224b99da89285c024d1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:06.814704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ada36-1577-4ba8-9ef6-7240e2957fad None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:06.815582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ada36-1577-4ba8-9ef6-7240e2957fad None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:06.815885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ada36-1577-4ba8-9ef6-7240e2957fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:06.841076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-dd0ada36-1577-4ba8-9ef6-7240e2957fad None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:06.842878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dd0ada36-1577-4ba8-9ef6-7240e2957fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:06.887587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:06.950220 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3460/6958] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:06.979738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafc443-a1fb-4513-ae0c-3801e51c21b4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:06.984364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7dafc443-a1fb-4513-ae0c-3801e51c21b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:07.078825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafc443-a1fb-4513-ae0c-3801e51c21b4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:07.085427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619aac11-fd33-4d72-9d40-d320f6fc3411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:07.086412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619aac11-fd33-4d72-9d40-d320f6fc3411 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:07.086803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619aac11-fd33-4d72-9d40-d320f6fc3411 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:07.087114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619aac11-fd33-4d72-9d40-d320f6fc3411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:07.102388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619aac11-fd33-4d72-9d40-d320f6fc3411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:07.104220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619aac11-fd33-4d72-9d40-d320f6fc3411 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:07.119075 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3499/6959] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:28:07.565012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ada36-1577-4ba8-9ef6-7240e2957fad None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:07.567724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dd0ada36-1577-4ba8-9ef6-7240e2957fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:07.592710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ada36-1577-4ba8-9ef6-7240e2957fad None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:07.610505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c8c5c-6cbd-4128-8931-b5d3a8e9e38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:07.615013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c8c5c-6cbd-4128-8931-b5d3a8e9e38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:07.615315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c8c5c-6cbd-4128-8931-b5d3a8e9e38b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:07.618940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c8c5c-6cbd-4128-8931-b5d3a8e9e38b admin admin] PATH_INFO: `/v3/projects/8a4a41c55b8b453ca5abfbd5e82057f0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:07.621012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c8c5c-6cbd-4128-8931-b5d3a8e9e38b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4a41c55b8b453ca5abfbd5e82057f0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:07.630525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c8c5c-6cbd-4128-8931-b5d3a8e9e38b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:07.728823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c00c8c5c-6cbd-4128-8931-b5d3a8e9e38b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4a41c55b8b453ca5abfbd5e82057f0', 'request_id': 'req-c00c8c5c-6cbd-4128-8931-b5d3a8e9e38b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:07.742891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c00c8c5c-6cbd-4128-8931-b5d3a8e9e38b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4a41c55b8b453ca5abfbd5e82057f0', 'request_id': 'req-c00c8c5c-6cbd-4128-8931-b5d3a8e9e38b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:07.762273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c00c8c5c-6cbd-4128-8931-b5d3a8e9e38b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4a41c55b8b453ca5abfbd5e82057f0', 'request_id': 'req-c00c8c5c-6cbd-4128-8931-b5d3a8e9e38b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:07.786807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c00c8c5c-6cbd-4128-8931-b5d3a8e9e38b admin admin] The token cache is being invalidate because project 8a4a41c55b8b453ca5abfbd5e82057f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:28:07.787253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c00c8c5c-6cbd-4128-8931-b5d3a8e9e38b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:07.788807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c00c8c5c-6cbd-4128-8931-b5d3a8e9e38b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:07.792520 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3461/6960] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:28:07 2022] DELETE /identity/v3/projects/8a4a41c55b8b453ca5abfbd5e82057f0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:07.797938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00122769-75ac-47d9-a467-62e0567218cd None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:07.798593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00122769-75ac-47d9-a467-62e0567218cd None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:07.799177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00122769-75ac-47d9-a467-62e0567218cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:07.839281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-00122769-75ac-47d9-a467-62e0567218cd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:07.841844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-00122769-75ac-47d9-a467-62e0567218cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:07.955399 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3500/6961] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:07.964858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29386208-0ae4-429b-a7b9-5e4a2ba2bd32 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:07.965919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29386208-0ae4-429b-a7b9-5e4a2ba2bd32 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:07.966407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29386208-0ae4-429b-a7b9-5e4a2ba2bd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:08.013964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-29386208-0ae4-429b-a7b9-5e4a2ba2bd32 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:08.015983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-29386208-0ae4-429b-a7b9-5e4a2ba2bd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:08.049250 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3462/6962] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:08.052992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00122769-75ac-47d9-a467-62e0567218cd None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:08.069884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00122769-75ac-47d9-a467-62e0567218cd None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:08.087130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fe085-6f42-4494-a513-3950c138b9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:08.088942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fe085-6f42-4494-a513-3950c138b9cb admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:08.089460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fe085-6f42-4494-a513-3950c138b9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:08.090033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fe085-6f42-4494-a513-3950c138b9cb admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:08.091066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469fe085-6f42-4494-a513-3950c138b9cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:28:08.091630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469fe085-6f42-4494-a513-3950c138b9cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:08.093819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469fe085-6f42-4494-a513-3950c138b9cb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:08.158777 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3501/6963] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:28:08.162849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29386208-0ae4-429b-a7b9-5e4a2ba2bd32 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:08.174704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29386208-0ae4-429b-a7b9-5e4a2ba2bd32 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:08.180138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ed16a-b848-4e2e-8024-fb01a6650d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:08.180925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ed16a-b848-4e2e-8024-fb01a6650d49 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:08.181320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ed16a-b848-4e2e-8024-fb01a6650d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:08.181663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ed16a-b848-4e2e-8024-fb01a6650d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:08.182595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ed16a-b848-4e2e-8024-fb01a6650d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:08.184840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ed16a-b848-4e2e-8024-fb01a6650d49 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:08.217169 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3463/6964] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:28:08 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:28:08.222116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fe085-6f42-4494-a513-3950c138b9cb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:08.248665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fe085-6f42-4494-a513-3950c138b9cb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:08.365494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180c07b-4d83-4a36-ba0f-5d6d9add5962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:08.366255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180c07b-4d83-4a36-ba0f-5d6d9add5962 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:08.366607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180c07b-4d83-4a36-ba0f-5d6d9add5962 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:08.367118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180c07b-4d83-4a36-ba0f-5d6d9add5962 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:08.367890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180c07b-4d83-4a36-ba0f-5d6d9add5962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:08.370616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180c07b-4d83-4a36-ba0f-5d6d9add5962 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:08.385801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:08.422392 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3502/6965] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:28:08 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:28:08.426519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ed16a-b848-4e2e-8024-fb01a6650d49 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:08.438420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ed16a-b848-4e2e-8024-fb01a6650d49 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:08.444018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58323823-7b29-4f16-b132-58da90b5b9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:08.444826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58323823-7b29-4f16-b132-58da90b5b9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:08.445182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58323823-7b29-4f16-b132-58da90b5b9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:08.445446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58323823-7b29-4f16-b132-58da90b5b9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:08.446413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58323823-7b29-4f16-b132-58da90b5b9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:08.448332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58323823-7b29-4f16-b132-58da90b5b9b2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:08.461991 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3464/6966] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:28:08.466447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180c07b-4d83-4a36-ba0f-5d6d9add5962 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:08.482977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180c07b-4d83-4a36-ba0f-5d6d9add5962 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:08.504964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9aa9d-e059-4591-ab1b-e11ff1a51174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:08.505694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9aa9d-e059-4591-ab1b-e11ff1a51174 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:08.506453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9aa9d-e059-4591-ab1b-e11ff1a51174 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:08.506922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9aa9d-e059-4591-ab1b-e11ff1a51174 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:08.508087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9aa9d-e059-4591-ab1b-e11ff1a51174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:08.510159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9aa9d-e059-4591-ab1b-e11ff1a51174 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:08.535329 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3503/6967] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:28:08.539280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58323823-7b29-4f16-b132-58da90b5b9b2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:08.551168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58323823-7b29-4f16-b132-58da90b5b9b2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:08.558785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a80a9a-98a5-4c05-af29-242bca90fbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:08.559811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a80a9a-98a5-4c05-af29-242bca90fbbf admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:08.560208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a80a9a-98a5-4c05-af29-242bca90fbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:08.560542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a80a9a-98a5-4c05-af29-242bca90fbbf admin admin] PATH_INFO: `/v3/projects/a90e650dd04f40808ef31242aa5a7b2d/users/36398a63c960444280f01f84be1d1bc0/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:08.582548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a80a9a-98a5-4c05-af29-242bca90fbbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90e650dd04f40808ef31242aa5a7b2d, user_id=36398a63c960444280f01f84be1d1bc0, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:08.586233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a80a9a-98a5-4c05-af29-242bca90fbbf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:08.602822 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3465/6968] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:28:08 2022] PUT /identity/v3/projects/a90e650dd04f40808ef31242aa5a7b2d/users/36398a63c960444280f01f84be1d1bc0/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:08.614080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9984f-cf18-41e7-ae36-01d087171fa5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:08.614780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9984f-cf18-41e7-ae36-01d087171fa5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:08.615263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9984f-cf18-41e7-ae36-01d087171fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:08.647740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-62b9984f-cf18-41e7-ae36-01d087171fa5 None None] MFA Rules not processed for user `36398a63c960444280f01f84be1d1bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:08.649028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-62b9984f-cf18-41e7-ae36-01d087171fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:08.754431 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3504/6969] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:08.768020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a80a9a-98a5-4c05-af29-242bca90fbbf admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:08.771234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-08a80a9a-98a5-4c05-af29-242bca90fbbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:08.864380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:08.869892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a80a9a-98a5-4c05-af29-242bca90fbbf admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:08.876824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce0033-5c70-4a01-9595-710491db0427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:08.877513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce0033-5c70-4a01-9595-710491db0427 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:08.877874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce0033-5c70-4a01-9595-710491db0427 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:08.878202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce0033-5c70-4a01-9595-710491db0427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:08.892920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce0033-5c70-4a01-9595-710491db0427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:08.894749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce0033-5c70-4a01-9595-710491db0427 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:08.905811 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3466/6970] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:28:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:28:11.743269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69be8f-e59a-4f65-984d-9ee99bdd81b0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:11.743888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69be8f-e59a-4f65-984d-9ee99bdd81b0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:11.743888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69be8f-e59a-4f65-984d-9ee99bdd81b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:11.762159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ee69be8f-e59a-4f65-984d-9ee99bdd81b0 None None] MFA Rules not processed for user `a90caf8a110549e39bbaf7ec50a6207d`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:11.763398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ee69be8f-e59a-4f65-984d-9ee99bdd81b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:11.847970 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3505/6971] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:12.600881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce0033-5c70-4a01-9595-710491db0427 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:12.613115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce0033-5c70-4a01-9595-710491db0427 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:12.626915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40424079-8a9e-49f8-8a90-4c6d280a9f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:12.627444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40424079-8a9e-49f8-8a90-4c6d280a9f63 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:12.627722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40424079-8a9e-49f8-8a90-4c6d280a9f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:12.627990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40424079-8a9e-49f8-8a90-4c6d280a9f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:12.629869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-40424079-8a9e-49f8-8a90-4c6d280a9f63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:12.710908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40424079-8a9e-49f8-8a90-4c6d280a9f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:12.712723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40424079-8a9e-49f8-8a90-4c6d280a9f63 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:12.741052 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3467/6972] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:28:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:28:19.621541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1563cae-5819-4109-b958-9df4cb5a37bb None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:19.622493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1563cae-5819-4109-b958-9df4cb5a37bb None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:19.623118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1563cae-5819-4109-b958-9df4cb5a37bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:19.663227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e1563cae-5819-4109-b958-9df4cb5a37bb None None] MFA Rules not processed for user `317a63cdd16b4fd69617fb9de95dc4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:19.665315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e1563cae-5819-4109-b958-9df4cb5a37bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:19.738050 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3506/6973] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:22.731154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=34 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:23.614703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40424079-8a9e-49f8-8a90-4c6d280a9f63 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:23.616516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-40424079-8a9e-49f8-8a90-4c6d280a9f63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:23.808484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40424079-8a9e-49f8-8a90-4c6d280a9f63 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:23.822278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415269d-08f0-4fd0-88ec-5bb3e486e9a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:23.823058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415269d-08f0-4fd0-88ec-5bb3e486e9a8 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:23.823551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415269d-08f0-4fd0-88ec-5bb3e486e9a8 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:23.823698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415269d-08f0-4fd0-88ec-5bb3e486e9a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:23.826677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9415269d-08f0-4fd0-88ec-5bb3e486e9a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:23.969377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415269d-08f0-4fd0-88ec-5bb3e486e9a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:23.990933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415269d-08f0-4fd0-88ec-5bb3e486e9a8 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:24.037839 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3468/6974] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:28:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:28:26.781788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1563cae-5819-4109-b958-9df4cb5a37bb None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:26.824378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1563cae-5819-4109-b958-9df4cb5a37bb None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:26.846278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df8395-c65b-4968-bac0-234b8bf38881 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:26.847393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df8395-c65b-4968-bac0-234b8bf38881 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:26.847901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df8395-c65b-4968-bac0-234b8bf38881 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:26.848424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df8395-c65b-4968-bac0-234b8bf38881 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:26.851035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-68df8395-c65b-4968-bac0-234b8bf38881 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:26.901130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df8395-c65b-4968-bac0-234b8bf38881 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:26.903278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df8395-c65b-4968-bac0-234b8bf38881 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:26.936171 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3507/6975] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:28:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:28:30.919127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415269d-08f0-4fd0-88ec-5bb3e486e9a8 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:30.995689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415269d-08f0-4fd0-88ec-5bb3e486e9a8 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:31.000844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5d849-928c-476c-93c1-c055da75ae8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:31.002309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5d849-928c-476c-93c1-c055da75ae8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:31.002700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5d849-928c-476c-93c1-c055da75ae8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:31.003079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5d849-928c-476c-93c1-c055da75ae8d admin admin] PATH_INFO: `/v3/users/36398a63c960444280f01f84be1d1bc0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:31.004438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5d849-928c-476c-93c1-c055da75ae8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=36398a63c960444280f01f84be1d1bc0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:31.006609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5d849-928c-476c-93c1-c055da75ae8d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:31.055525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:31.075874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a1e5d849-928c-476c-93c1-c055da75ae8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36398a63c960444280f01f84be1d1bc0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:31.091965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a1e5d849-928c-476c-93c1-c055da75ae8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36398a63c960444280f01f84be1d1bc0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:31.104670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a1e5d849-928c-476c-93c1-c055da75ae8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36398a63c960444280f01f84be1d1bc0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:31.105425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a1e5d849-928c-476c-93c1-c055da75ae8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36398a63c960444280f01f84be1d1bc0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:31.106040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a1e5d849-928c-476c-93c1-c055da75ae8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36398a63c960444280f01f84be1d1bc0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:31.129460 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3469/6976] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:28:30 2022] DELETE /identity/v3/users/36398a63c960444280f01f84be1d1bc0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:31.139154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d654648-47df-4228-acf2-05dc6ab1eb0e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:31.139679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d654648-47df-4228-acf2-05dc6ab1eb0e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:31.139772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d654648-47df-4228-acf2-05dc6ab1eb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:31.147337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:31.161608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4d654648-47df-4228-acf2-05dc6ab1eb0e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:31.162852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4d654648-47df-4228-acf2-05dc6ab1eb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:31.234217 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3508/6977] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:31.247481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5d849-928c-476c-93c1-c055da75ae8d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:31.249039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a1e5d849-928c-476c-93c1-c055da75ae8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:31.333207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5d849-928c-476c-93c1-c055da75ae8d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:31.338097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eac1d-b1c5-4af5-bdeb-f9b9c3ced34e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:31.338914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eac1d-b1c5-4af5-bdeb-f9b9c3ced34e service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:31.344221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eac1d-b1c5-4af5-bdeb-f9b9c3ced34e service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:31.344529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eac1d-b1c5-4af5-bdeb-f9b9c3ced34e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:31.357274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6eac1d-b1c5-4af5-bdeb-f9b9c3ced34e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:31.359076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6eac1d-b1c5-4af5-bdeb-f9b9c3ced34e service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:31.371662 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3470/6978] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:28:31.644579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d654648-47df-4228-acf2-05dc6ab1eb0e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:31.646080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4d654648-47df-4228-acf2-05dc6ab1eb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:31.662433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d654648-47df-4228-acf2-05dc6ab1eb0e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:31.667700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39419467-2b52-434b-9dd4-a258c90dc2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:31.668677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39419467-2b52-434b-9dd4-a258c90dc2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:31.669147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39419467-2b52-434b-9dd4-a258c90dc2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:31.669433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39419467-2b52-434b-9dd4-a258c90dc2a2 admin admin] PATH_INFO: `/v3/projects/a90e650dd04f40808ef31242aa5a7b2d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:31.670671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39419467-2b52-434b-9dd4-a258c90dc2a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a90e650dd04f40808ef31242aa5a7b2d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:31.672719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39419467-2b52-434b-9dd4-a258c90dc2a2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:31.740306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-39419467-2b52-434b-9dd4-a258c90dc2a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a90e650dd04f40808ef31242aa5a7b2d', 'request_id': 'req-39419467-2b52-434b-9dd4-a258c90dc2a2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:31.751843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-39419467-2b52-434b-9dd4-a258c90dc2a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a90e650dd04f40808ef31242aa5a7b2d', 'request_id': 'req-39419467-2b52-434b-9dd4-a258c90dc2a2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:31.760544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-39419467-2b52-434b-9dd4-a258c90dc2a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a90e650dd04f40808ef31242aa5a7b2d', 'request_id': 'req-39419467-2b52-434b-9dd4-a258c90dc2a2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:31.792181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-39419467-2b52-434b-9dd4-a258c90dc2a2 admin admin] The token cache is being invalidate because project a90e650dd04f40808ef31242aa5a7b2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:28:31.792564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-39419467-2b52-434b-9dd4-a258c90dc2a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:31.793300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-39419467-2b52-434b-9dd4-a258c90dc2a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:31.795717 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3509/6979] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:28:31 2022] DELETE /identity/v3/projects/a90e650dd04f40808ef31242aa5a7b2d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:31.800771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eef33e-2344-48d0-8ff2-c0dce2a10464 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:31.802163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eef33e-2344-48d0-8ff2-c0dce2a10464 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:31.802483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eef33e-2344-48d0-8ff2-c0dce2a10464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:31.805371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39419467-2b52-434b-9dd4-a258c90dc2a2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:31.808125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-39419467-2b52-434b-9dd4-a258c90dc2a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:31.827967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-74eef33e-2344-48d0-8ff2-c0dce2a10464 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:31.829387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-74eef33e-2344-48d0-8ff2-c0dce2a10464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:31.877351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39419467-2b52-434b-9dd4-a258c90dc2a2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:31.881145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c6296-6c48-47ce-92fe-9beddb29e75a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:31.881802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c6296-6c48-47ce-92fe-9beddb29e75a service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:31.882133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c6296-6c48-47ce-92fe-9beddb29e75a service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:31.882402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c6296-6c48-47ce-92fe-9beddb29e75a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:31.884262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1f0c6296-6c48-47ce-92fe-9beddb29e75a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:31.926335 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3471/6980] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:31.931119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9798d80-6aba-4650-9a4a-91cf1c830c4e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:31.931291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9798d80-6aba-4650-9a4a-91cf1c830c4e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:31.931582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9798d80-6aba-4650-9a4a-91cf1c830c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:31.944686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:31.957838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a9798d80-6aba-4650-9a4a-91cf1c830c4e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:31.959227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a9798d80-6aba-4650-9a4a-91cf1c830c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:31.972169 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3472/6981] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:31.973181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9798d80-6aba-4650-9a4a-91cf1c830c4e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:31.975203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c6296-6c48-47ce-92fe-9beddb29e75a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:31.976752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c6296-6c48-47ce-92fe-9beddb29e75a service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:31.985737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9798d80-6aba-4650-9a4a-91cf1c830c4e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:31.988844 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3510/6982] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:28:31.992132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc246df-8252-4e94-8ea7-02dcb289731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:31.992807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc246df-8252-4e94-8ea7-02dcb289731b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:31.993094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc246df-8252-4e94-8ea7-02dcb289731b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:31.993375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc246df-8252-4e94-8ea7-02dcb289731b admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:31.994109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc246df-8252-4e94-8ea7-02dcb289731b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:28:31.994418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc246df-8252-4e94-8ea7-02dcb289731b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:31.996047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc246df-8252-4e94-8ea7-02dcb289731b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:32.008492 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3473/6983] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:28:32.012795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c6296-6c48-47ce-92fe-9beddb29e75a service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:32.022916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c6296-6c48-47ce-92fe-9beddb29e75a service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:32.027592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fc41c-32cf-4248-98fe-e3b08dd083b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:32.028292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fc41c-32cf-4248-98fe-e3b08dd083b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:32.028574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fc41c-32cf-4248-98fe-e3b08dd083b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:32.028853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fc41c-32cf-4248-98fe-e3b08dd083b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:32.029546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fc41c-32cf-4248-98fe-e3b08dd083b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:32.031601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fc41c-32cf-4248-98fe-e3b08dd083b2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:32.058577 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3511/6984] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:28:32 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:28:32.063017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc246df-8252-4e94-8ea7-02dcb289731b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:32.078273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc246df-8252-4e94-8ea7-02dcb289731b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:32.119148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:32.155804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1f85f-8658-4c88-9ac2-61e8af7db136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:32.156555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1f85f-8658-4c88-9ac2-61e8af7db136 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:32.156843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1f85f-8658-4c88-9ac2-61e8af7db136 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:32.157121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1f85f-8658-4c88-9ac2-61e8af7db136 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:32.157816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1f85f-8658-4c88-9ac2-61e8af7db136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:32.159952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1f85f-8658-4c88-9ac2-61e8af7db136 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:32.187478 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3474/6985] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:28:32 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:28:32.188920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fc41c-32cf-4248-98fe-e3b08dd083b2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:32.203251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fc41c-32cf-4248-98fe-e3b08dd083b2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:32.209713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142589a5-6c57-44c0-b79e-33062d3860b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:32.210667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142589a5-6c57-44c0-b79e-33062d3860b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:32.211195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142589a5-6c57-44c0-b79e-33062d3860b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:32.211577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142589a5-6c57-44c0-b79e-33062d3860b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:32.212515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142589a5-6c57-44c0-b79e-33062d3860b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:32.214303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142589a5-6c57-44c0-b79e-33062d3860b0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:32.229449 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3512/6986] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:28:32.234061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1f85f-8658-4c88-9ac2-61e8af7db136 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:32.245171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1f85f-8658-4c88-9ac2-61e8af7db136 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:32.250005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543d2c2-09f8-4aef-8e69-4a8deb0c3ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:32.250734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543d2c2-09f8-4aef-8e69-4a8deb0c3ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:32.251024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543d2c2-09f8-4aef-8e69-4a8deb0c3ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:32.251298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543d2c2-09f8-4aef-8e69-4a8deb0c3ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:32.252188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543d2c2-09f8-4aef-8e69-4a8deb0c3ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:32.255433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543d2c2-09f8-4aef-8e69-4a8deb0c3ab7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:32.270251 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3475/6987] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:28:32.271547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142589a5-6c57-44c0-b79e-33062d3860b0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:32.282645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142589a5-6c57-44c0-b79e-33062d3860b0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:32.287857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89ed91-348f-4ef2-a46a-8e27e1d8347b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:32.289571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89ed91-348f-4ef2-a46a-8e27e1d8347b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:32.290044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89ed91-348f-4ef2-a46a-8e27e1d8347b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:32.290539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89ed91-348f-4ef2-a46a-8e27e1d8347b admin admin] PATH_INFO: `/v3/projects/c6509ce8fd8d4dc2a541020ad8586756/users/35f56cf81d884a23b76473acfdd630a0/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:32.309612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89ed91-348f-4ef2-a46a-8e27e1d8347b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6509ce8fd8d4dc2a541020ad8586756, user_id=35f56cf81d884a23b76473acfdd630a0, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:32.313340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89ed91-348f-4ef2-a46a-8e27e1d8347b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:32.335118 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3513/6988] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:28:32 2022] PUT /identity/v3/projects/c6509ce8fd8d4dc2a541020ad8586756/users/35f56cf81d884a23b76473acfdd630a0/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:32.345506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab25f7f-0c1b-4ab1-ba07-1b1835db6613 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:32.345785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab25f7f-0c1b-4ab1-ba07-1b1835db6613 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:32.346066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab25f7f-0c1b-4ab1-ba07-1b1835db6613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:32.398758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bab25f7f-0c1b-4ab1-ba07-1b1835db6613 None None] MFA Rules not processed for user `35f56cf81d884a23b76473acfdd630a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:32.400011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bab25f7f-0c1b-4ab1-ba07-1b1835db6613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:32.469729 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3476/6989] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:32.480425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89ed91-348f-4ef2-a46a-8e27e1d8347b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:32.482282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2e89ed91-348f-4ef2-a46a-8e27e1d8347b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:32.545431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89ed91-348f-4ef2-a46a-8e27e1d8347b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:32.549423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef43df4-3c3b-451e-b1f7-211eb018625e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:32.550084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef43df4-3c3b-451e-b1f7-211eb018625e service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:32.550358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef43df4-3c3b-451e-b1f7-211eb018625e service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:32.550636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef43df4-3c3b-451e-b1f7-211eb018625e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:32.561202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef43df4-3c3b-451e-b1f7-211eb018625e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:32.562911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef43df4-3c3b-451e-b1f7-211eb018625e service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:32.574440 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3514/6990] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:28:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:28:32.589358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab25f7f-0c1b-4ab1-ba07-1b1835db6613 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:32.667046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab25f7f-0c1b-4ab1-ba07-1b1835db6613 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:32.671671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d1c27-5ebb-4498-bc86-8d37983b4f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:32.672638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d1c27-5ebb-4498-bc86-8d37983b4f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:32.672920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d1c27-5ebb-4498-bc86-8d37983b4f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:32.673200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d1c27-5ebb-4498-bc86-8d37983b4f31 admin admin] PATH_INFO: `/v3/users/35f56cf81d884a23b76473acfdd630a0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:32.674410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d1c27-5ebb-4498-bc86-8d37983b4f31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35f56cf81d884a23b76473acfdd630a0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:32.676381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d1c27-5ebb-4498-bc86-8d37983b4f31 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:32.725013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:32.734167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b25d1c27-5ebb-4498-bc86-8d37983b4f31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f56cf81d884a23b76473acfdd630a0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:32.746011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b25d1c27-5ebb-4498-bc86-8d37983b4f31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f56cf81d884a23b76473acfdd630a0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:32.756446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b25d1c27-5ebb-4498-bc86-8d37983b4f31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f56cf81d884a23b76473acfdd630a0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:32.757225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b25d1c27-5ebb-4498-bc86-8d37983b4f31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f56cf81d884a23b76473acfdd630a0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:32.757842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b25d1c27-5ebb-4498-bc86-8d37983b4f31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f56cf81d884a23b76473acfdd630a0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:32.793125 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3477/6991] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:28:32 2022] DELETE /identity/v3/users/35f56cf81d884a23b76473acfdd630a0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:32.793250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670046d0-ea6c-4161-b3fc-7ea7dfdf84e2 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:32.793250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670046d0-ea6c-4161-b3fc-7ea7dfdf84e2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:32.793250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670046d0-ea6c-4161-b3fc-7ea7dfdf84e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:32.811936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-670046d0-ea6c-4161-b3fc-7ea7dfdf84e2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:32.813664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-670046d0-ea6c-4161-b3fc-7ea7dfdf84e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:32.890626 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3515/6992] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:28:32.899459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d1c27-5ebb-4498-bc86-8d37983b4f31 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:32.901567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b25d1c27-5ebb-4498-bc86-8d37983b4f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:32.990258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d1c27-5ebb-4498-bc86-8d37983b4f31 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:32.997982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39ab6e-6aed-464e-a16b-8add84712893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:32.999736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39ab6e-6aed-464e-a16b-8add84712893 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:33.000565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39ab6e-6aed-464e-a16b-8add84712893 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:33.001086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39ab6e-6aed-464e-a16b-8add84712893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:33.017693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39ab6e-6aed-464e-a16b-8add84712893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:33.019994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39ab6e-6aed-464e-a16b-8add84712893 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:33.044297 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3478/6993] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:28:33.363218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670046d0-ea6c-4161-b3fc-7ea7dfdf84e2 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:33.365336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-670046d0-ea6c-4161-b3fc-7ea7dfdf84e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:33.384830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670046d0-ea6c-4161-b3fc-7ea7dfdf84e2 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:33.393208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3191f2-db65-41ea-903e-a2050dfeaebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:33.394120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3191f2-db65-41ea-903e-a2050dfeaebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:33.394402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3191f2-db65-41ea-903e-a2050dfeaebb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:33.394686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3191f2-db65-41ea-903e-a2050dfeaebb admin admin] PATH_INFO: `/v3/projects/c6509ce8fd8d4dc2a541020ad8586756` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:33.397555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3191f2-db65-41ea-903e-a2050dfeaebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6509ce8fd8d4dc2a541020ad8586756)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:33.399687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3191f2-db65-41ea-903e-a2050dfeaebb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:33.436534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:33.483975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2d3191f2-db65-41ea-903e-a2050dfeaebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6509ce8fd8d4dc2a541020ad8586756', 'request_id': 'req-2d3191f2-db65-41ea-903e-a2050dfeaebb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:33.497138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2d3191f2-db65-41ea-903e-a2050dfeaebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6509ce8fd8d4dc2a541020ad8586756', 'request_id': 'req-2d3191f2-db65-41ea-903e-a2050dfeaebb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:33.504920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2d3191f2-db65-41ea-903e-a2050dfeaebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6509ce8fd8d4dc2a541020ad8586756', 'request_id': 'req-2d3191f2-db65-41ea-903e-a2050dfeaebb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:33.518414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2d3191f2-db65-41ea-903e-a2050dfeaebb admin admin] The token cache is being invalidate because project c6509ce8fd8d4dc2a541020ad8586756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:28:33.518703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2d3191f2-db65-41ea-903e-a2050dfeaebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:33.519674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2d3191f2-db65-41ea-903e-a2050dfeaebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:33.521530 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3516/6994] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:28:33 2022] DELETE /identity/v3/projects/c6509ce8fd8d4dc2a541020ad8586756 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:33.527658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c9da0-5fbe-475f-9d17-b8c763f8a7d4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:33.527954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c9da0-5fbe-475f-9d17-b8c763f8a7d4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:33.528302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c9da0-5fbe-475f-9d17-b8c763f8a7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:33.548595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b64c9da0-5fbe-475f-9d17-b8c763f8a7d4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:33.549878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b64c9da0-5fbe-475f-9d17-b8c763f8a7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:33.626973 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3479/6995] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:28:33.635627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf5fff-1f4a-459a-9b02-bd35254dc66e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:33.635912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf5fff-1f4a-459a-9b02-bd35254dc66e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:33.636201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf5fff-1f4a-459a-9b02-bd35254dc66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:33.683842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-24bf5fff-1f4a-459a-9b02-bd35254dc66e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:33.685197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-24bf5fff-1f4a-459a-9b02-bd35254dc66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:33.706453 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3517/6996] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:33.711553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c9da0-5fbe-475f-9d17-b8c763f8a7d4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:33.729583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c9da0-5fbe-475f-9d17-b8c763f8a7d4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:33.743804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18bf4a-80a4-4381-b65c-81803a4e0b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:33.746530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18bf4a-80a4-4381-b65c-81803a4e0b9c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:33.746983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18bf4a-80a4-4381-b65c-81803a4e0b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:33.753734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18bf4a-80a4-4381-b65c-81803a4e0b9c admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:33.754681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18bf4a-80a4-4381-b65c-81803a4e0b9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:28:33.755066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18bf4a-80a4-4381-b65c-81803a4e0b9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:33.763424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18bf4a-80a4-4381-b65c-81803a4e0b9c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:33.798118 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3480/6997] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:28:33.799321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf5fff-1f4a-459a-9b02-bd35254dc66e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:33.813014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf5fff-1f4a-459a-9b02-bd35254dc66e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:33.825007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fae82-b374-4415-b5b2-563315e9be7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:33.825824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fae82-b374-4415-b5b2-563315e9be7a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:33.826168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fae82-b374-4415-b5b2-563315e9be7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:33.826536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fae82-b374-4415-b5b2-563315e9be7a admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:33.828516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fae82-b374-4415-b5b2-563315e9be7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:33.834417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fae82-b374-4415-b5b2-563315e9be7a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:33.894895 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3518/6998] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:28:33 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:28:33.898926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18bf4a-80a4-4381-b65c-81803a4e0b9c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:33.914774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18bf4a-80a4-4381-b65c-81803a4e0b9c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:34.006037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:34.028357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fed592-2483-4b85-9186-02148a6e1665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:34.030102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fed592-2483-4b85-9186-02148a6e1665 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:34.030467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fed592-2483-4b85-9186-02148a6e1665 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:34.031958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fed592-2483-4b85-9186-02148a6e1665 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:34.032800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fed592-2483-4b85-9186-02148a6e1665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:34.038574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fed592-2483-4b85-9186-02148a6e1665 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:34.077333 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3481/6999] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:28:33 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:28:34.078177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fae82-b374-4415-b5b2-563315e9be7a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:34.101626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fae82-b374-4415-b5b2-563315e9be7a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:34.106519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb8886-dab1-4ad2-8e63-3dd3a63b9c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:34.107283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb8886-dab1-4ad2-8e63-3dd3a63b9c6c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:34.107557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb8886-dab1-4ad2-8e63-3dd3a63b9c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:34.107836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb8886-dab1-4ad2-8e63-3dd3a63b9c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:34.108611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb8886-dab1-4ad2-8e63-3dd3a63b9c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:34.110286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb8886-dab1-4ad2-8e63-3dd3a63b9c6c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:34.123893 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3519/7000] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:28:34.127760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fed592-2483-4b85-9186-02148a6e1665 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:34.138839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fed592-2483-4b85-9186-02148a6e1665 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:34.161013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db4508-630f-4823-8c26-bd53c64dcc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:34.161956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db4508-630f-4823-8c26-bd53c64dcc2c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:34.162159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db4508-630f-4823-8c26-bd53c64dcc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:34.162436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db4508-630f-4823-8c26-bd53c64dcc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:34.163186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db4508-630f-4823-8c26-bd53c64dcc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:34.164927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db4508-630f-4823-8c26-bd53c64dcc2c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:34.181441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb8886-dab1-4ad2-8e63-3dd3a63b9c6c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:34.182951 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3482/7001] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:28:34.210595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb8886-dab1-4ad2-8e63-3dd3a63b9c6c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:34.228300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82386737-f309-4da3-966c-434eace9021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:34.228745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82386737-f309-4da3-966c-434eace9021d admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:34.229143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82386737-f309-4da3-966c-434eace9021d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:34.229371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82386737-f309-4da3-966c-434eace9021d admin admin] PATH_INFO: `/v3/projects/89d200d36d5848fbab59b83e3db04c19/users/5ccce5ba6b09497caa3e91873b356a0a/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:34.260657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82386737-f309-4da3-966c-434eace9021d admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d200d36d5848fbab59b83e3db04c19, user_id=5ccce5ba6b09497caa3e91873b356a0a, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:34.263275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82386737-f309-4da3-966c-434eace9021d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:34.290525 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3520/7002] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:28:34 2022] PUT /identity/v3/projects/89d200d36d5848fbab59b83e3db04c19/users/5ccce5ba6b09497caa3e91873b356a0a/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:34.300100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cba31-ea05-453e-a55f-a235e13491a0 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:34.300391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cba31-ea05-453e-a55f-a235e13491a0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:34.300667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cba31-ea05-453e-a55f-a235e13491a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:34.342145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-367cba31-ea05-453e-a55f-a235e13491a0 None None] MFA Rules not processed for user `5ccce5ba6b09497caa3e91873b356a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:34.343395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-367cba31-ea05-453e-a55f-a235e13491a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:34.471485 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3483/7003] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:34.506408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82386737-f309-4da3-966c-434eace9021d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:34.509742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-82386737-f309-4da3-966c-434eace9021d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:34.634409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82386737-f309-4da3-966c-434eace9021d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:34.645955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65190331-6cbc-4fef-9064-8afe4c09f05c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:34.646769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65190331-6cbc-4fef-9064-8afe4c09f05c service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:34.647188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65190331-6cbc-4fef-9064-8afe4c09f05c service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:34.647532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65190331-6cbc-4fef-9064-8afe4c09f05c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:34.675299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65190331-6cbc-4fef-9064-8afe4c09f05c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:34.676925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65190331-6cbc-4fef-9064-8afe4c09f05c service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:34.695223 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3521/7004] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:28:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:28:44.467483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:44.690043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:50.984498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cba31-ea05-453e-a55f-a235e13491a0 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:50.991526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-367cba31-ea05-453e-a55f-a235e13491a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:51.150654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cba31-ea05-453e-a55f-a235e13491a0 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:51.159368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce13ad3-c16d-4d61-a0a5-8de80b0742ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:51.161086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13ad3-c16d-4d61-a0a5-8de80b0742ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:51.161086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13ad3-c16d-4d61-a0a5-8de80b0742ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:51.161676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13ad3-c16d-4d61-a0a5-8de80b0742ea admin admin] PATH_INFO: `/v3/users/8659f358b57b4574a0703b39e4cb0004` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:51.163039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce13ad3-c16d-4d61-a0a5-8de80b0742ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=8659f358b57b4574a0703b39e4cb0004)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:51.169787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce13ad3-c16d-4d61-a0a5-8de80b0742ea admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:51.319576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cce13ad3-c16d-4d61-a0a5-8de80b0742ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8659f358b57b4574a0703b39e4cb0004'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:51.335516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cce13ad3-c16d-4d61-a0a5-8de80b0742ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8659f358b57b4574a0703b39e4cb0004'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:51.345086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cce13ad3-c16d-4d61-a0a5-8de80b0742ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8659f358b57b4574a0703b39e4cb0004'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:51.350835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cce13ad3-c16d-4d61-a0a5-8de80b0742ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8659f358b57b4574a0703b39e4cb0004'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:51.352160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-cce13ad3-c16d-4d61-a0a5-8de80b0742ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8659f358b57b4574a0703b39e4cb0004'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:51.377882 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3484/7005] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:28:50 2022] DELETE /identity/v3/users/8659f358b57b4574a0703b39e4cb0004 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:52.051676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65190331-6cbc-4fef-9064-8afe4c09f05c service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:52.109742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65190331-6cbc-4fef-9064-8afe4c09f05c service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:52.252800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f2d79-d922-4bb0-a13f-621c96dacc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:52.254073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f2d79-d922-4bb0-a13f-621c96dacc6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:52.254449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f2d79-d922-4bb0-a13f-621c96dacc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:52.254815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f2d79-d922-4bb0-a13f-621c96dacc6a admin admin] PATH_INFO: `/v3/projects/04e1d850f7e34fc7997bbea3a4a4777f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:52.256977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f2d79-d922-4bb0-a13f-621c96dacc6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=04e1d850f7e34fc7997bbea3a4a4777f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:52.260255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f2d79-d922-4bb0-a13f-621c96dacc6a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:52.353889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e9f2d79-d922-4bb0-a13f-621c96dacc6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04e1d850f7e34fc7997bbea3a4a4777f', 'request_id': 'req-9e9f2d79-d922-4bb0-a13f-621c96dacc6a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:52.373542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e9f2d79-d922-4bb0-a13f-621c96dacc6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04e1d850f7e34fc7997bbea3a4a4777f', 'request_id': 'req-9e9f2d79-d922-4bb0-a13f-621c96dacc6a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:52.383471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e9f2d79-d922-4bb0-a13f-621c96dacc6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04e1d850f7e34fc7997bbea3a4a4777f', 'request_id': 'req-9e9f2d79-d922-4bb0-a13f-621c96dacc6a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:52.398050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e9f2d79-d922-4bb0-a13f-621c96dacc6a admin admin] The token cache is being invalidate because project 04e1d850f7e34fc7997bbea3a4a4777f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:28:52.399469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e9f2d79-d922-4bb0-a13f-621c96dacc6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:52.400339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e9f2d79-d922-4bb0-a13f-621c96dacc6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:52.405570 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3522/7006] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:28:52 2022] DELETE /identity/v3/projects/04e1d850f7e34fc7997bbea3a4a4777f => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:52.406785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce13ad3-c16d-4d61-a0a5-8de80b0742ea admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:52.408376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cce13ad3-c16d-4d61-a0a5-8de80b0742ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:52.444577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce13ad3-c16d-4d61-a0a5-8de80b0742ea admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:52.561249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbcbbf-9fce-4ef3-abf4-cd0d82994e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:52.562865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbcbbf-9fce-4ef3-abf4-cd0d82994e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:52.563294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbcbbf-9fce-4ef3-abf4-cd0d82994e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:52.563733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbcbbf-9fce-4ef3-abf4-cd0d82994e86 admin admin] PATH_INFO: `/v3/users/33ac4a69ea634e1384e67250fe0c0722` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:52.565209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbcbbf-9fce-4ef3-abf4-cd0d82994e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ac4a69ea634e1384e67250fe0c0722)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:52.567237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbcbbf-9fce-4ef3-abf4-cd0d82994e86 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:52.592313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:52.664827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-efdbcbbf-9fce-4ef3-abf4-cd0d82994e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ac4a69ea634e1384e67250fe0c0722'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:52.698402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-efdbcbbf-9fce-4ef3-abf4-cd0d82994e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ac4a69ea634e1384e67250fe0c0722'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:52.713940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-efdbcbbf-9fce-4ef3-abf4-cd0d82994e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ac4a69ea634e1384e67250fe0c0722'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:52.715817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-efdbcbbf-9fce-4ef3-abf4-cd0d82994e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ac4a69ea634e1384e67250fe0c0722'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:52.720550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-efdbcbbf-9fce-4ef3-abf4-cd0d82994e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ac4a69ea634e1384e67250fe0c0722'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:52.765722 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3485/7007] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:28:52 2022] DELETE /identity/v3/users/33ac4a69ea634e1384e67250fe0c0722 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:53.146582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f2d79-d922-4bb0-a13f-621c96dacc6a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:53.149011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9e9f2d79-d922-4bb0-a13f-621c96dacc6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:53.167455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f2d79-d922-4bb0-a13f-621c96dacc6a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:53.291250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b434710-f64c-4f2c-81b4-7a42eb9d8d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:53.292840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b434710-f64c-4f2c-81b4-7a42eb9d8d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:53.293279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b434710-f64c-4f2c-81b4-7a42eb9d8d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:53.293708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b434710-f64c-4f2c-81b4-7a42eb9d8d14 admin admin] PATH_INFO: `/v3/projects/61d2158b3b2a4ea994db3541c9d6699c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:53.295364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b434710-f64c-4f2c-81b4-7a42eb9d8d14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d2158b3b2a4ea994db3541c9d6699c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:53.297789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b434710-f64c-4f2c-81b4-7a42eb9d8d14 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:53.370243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:53.403536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9b434710-f64c-4f2c-81b4-7a42eb9d8d14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d2158b3b2a4ea994db3541c9d6699c', 'request_id': 'req-9b434710-f64c-4f2c-81b4-7a42eb9d8d14'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:53.425676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9b434710-f64c-4f2c-81b4-7a42eb9d8d14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d2158b3b2a4ea994db3541c9d6699c', 'request_id': 'req-9b434710-f64c-4f2c-81b4-7a42eb9d8d14'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:53.436302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9b434710-f64c-4f2c-81b4-7a42eb9d8d14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d2158b3b2a4ea994db3541c9d6699c', 'request_id': 'req-9b434710-f64c-4f2c-81b4-7a42eb9d8d14'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:53.451624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9b434710-f64c-4f2c-81b4-7a42eb9d8d14 admin admin] The token cache is being invalidate because project 61d2158b3b2a4ea994db3541c9d6699c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:28:53.451921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9b434710-f64c-4f2c-81b4-7a42eb9d8d14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:53.452761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9b434710-f64c-4f2c-81b4-7a42eb9d8d14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:53.468071 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3523/7008] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:28:53 2022] DELETE /identity/v3/projects/61d2158b3b2a4ea994db3541c9d6699c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:56.873405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbcbbf-9fce-4ef3-abf4-cd0d82994e86 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:56.874844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-efdbcbbf-9fce-4ef3-abf4-cd0d82994e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:56.902063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbcbbf-9fce-4ef3-abf4-cd0d82994e86 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:57.036262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d702390-ea0d-4910-b8e9-293772311074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:57.038214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d702390-ea0d-4910-b8e9-293772311074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:57.038885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d702390-ea0d-4910-b8e9-293772311074 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:57.039339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d702390-ea0d-4910-b8e9-293772311074 admin admin] PATH_INFO: `/v3/users/9cf49b6497cd4485bee8253300a1ff96` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:57.041949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d702390-ea0d-4910-b8e9-293772311074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cf49b6497cd4485bee8253300a1ff96)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:57.048626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d702390-ea0d-4910-b8e9-293772311074 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:57.139852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0d702390-ea0d-4910-b8e9-293772311074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf49b6497cd4485bee8253300a1ff96'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:57.175765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0d702390-ea0d-4910-b8e9-293772311074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf49b6497cd4485bee8253300a1ff96'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:57.188587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0d702390-ea0d-4910-b8e9-293772311074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf49b6497cd4485bee8253300a1ff96'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:57.190166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0d702390-ea0d-4910-b8e9-293772311074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf49b6497cd4485bee8253300a1ff96'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:57.190978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0d702390-ea0d-4910-b8e9-293772311074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf49b6497cd4485bee8253300a1ff96'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:57.217952 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3486/7009] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:28:56 2022] DELETE /identity/v3/users/9cf49b6497cd4485bee8253300a1ff96 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:58.201603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b434710-f64c-4f2c-81b4-7a42eb9d8d14 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:58.204246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9b434710-f64c-4f2c-81b4-7a42eb9d8d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:58.232843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b434710-f64c-4f2c-81b4-7a42eb9d8d14 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:58.353108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b57c0e-3291-4ab1-b069-d600b1220920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:58.354023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b57c0e-3291-4ab1-b069-d600b1220920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:58.354678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b57c0e-3291-4ab1-b069-d600b1220920 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:58.354803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b57c0e-3291-4ab1-b069-d600b1220920 admin admin] PATH_INFO: `/v3/projects/18bb6db6102b4d9f87530f9a71b78db0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:58.358897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b57c0e-3291-4ab1-b069-d600b1220920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18bb6db6102b4d9f87530f9a71b78db0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:58.361190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b57c0e-3291-4ab1-b069-d600b1220920 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:58.434343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b2b57c0e-3291-4ab1-b069-d600b1220920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18bb6db6102b4d9f87530f9a71b78db0', 'request_id': 'req-b2b57c0e-3291-4ab1-b069-d600b1220920'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:58.448267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b2b57c0e-3291-4ab1-b069-d600b1220920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18bb6db6102b4d9f87530f9a71b78db0', 'request_id': 'req-b2b57c0e-3291-4ab1-b069-d600b1220920'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:58.467183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b2b57c0e-3291-4ab1-b069-d600b1220920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18bb6db6102b4d9f87530f9a71b78db0', 'request_id': 'req-b2b57c0e-3291-4ab1-b069-d600b1220920'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:58.481074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b2b57c0e-3291-4ab1-b069-d600b1220920 admin admin] The token cache is being invalidate because project 18bb6db6102b4d9f87530f9a71b78db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:28:58.481370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b2b57c0e-3291-4ab1-b069-d600b1220920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:58.483017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b2b57c0e-3291-4ab1-b069-d600b1220920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:28:58.484649 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3524/7010] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:28:58 2022] DELETE /identity/v3/projects/18bb6db6102b4d9f87530f9a71b78db0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:58.489806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856e259-f8f8-49e1-a442-5e1c1ec324da None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:58.490612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856e259-f8f8-49e1-a442-5e1c1ec324da None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:58.490897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856e259-f8f8-49e1-a442-5e1c1ec324da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:58.525959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a856e259-f8f8-49e1-a442-5e1c1ec324da None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:58.527830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a856e259-f8f8-49e1-a442-5e1c1ec324da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:58.550993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:58.652604 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3487/7011] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:58.659302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcdf40-0a63-4d49-b896-d32f52eb4a45 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:58.659596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcdf40-0a63-4d49-b896-d32f52eb4a45 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:58.659878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcdf40-0a63-4d49-b896-d32f52eb4a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:58.695889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5efcdf40-0a63-4d49-b896-d32f52eb4a45 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:58.698720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5efcdf40-0a63-4d49-b896-d32f52eb4a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:58.723675 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3525/7012] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:58.728428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856e259-f8f8-49e1-a442-5e1c1ec324da None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:58.744590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856e259-f8f8-49e1-a442-5e1c1ec324da None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:58.750972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70010d27-9e30-4ed4-ae31-2d6ccfa3efc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:58.752169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70010d27-9e30-4ed4-ae31-2d6ccfa3efc9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:58.752678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70010d27-9e30-4ed4-ae31-2d6ccfa3efc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:58.753171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70010d27-9e30-4ed4-ae31-2d6ccfa3efc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:58.754110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70010d27-9e30-4ed4-ae31-2d6ccfa3efc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:28:58.754629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70010d27-9e30-4ed4-ae31-2d6ccfa3efc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:58.756729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70010d27-9e30-4ed4-ae31-2d6ccfa3efc9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:58.770447 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3488/7013] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:28:58.774532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcdf40-0a63-4d49-b896-d32f52eb4a45 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:58.786763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcdf40-0a63-4d49-b896-d32f52eb4a45 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:58.794988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73a29a-97c0-48ee-90f5-6b9d97a9f9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:58.795811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73a29a-97c0-48ee-90f5-6b9d97a9f9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:58.796228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73a29a-97c0-48ee-90f5-6b9d97a9f9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:58.796647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73a29a-97c0-48ee-90f5-6b9d97a9f9c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:58.797444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73a29a-97c0-48ee-90f5-6b9d97a9f9c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:58.799659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73a29a-97c0-48ee-90f5-6b9d97a9f9c9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:58.862135 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3526/7014] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:28:58 2022] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:28:58.866469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70010d27-9e30-4ed4-ae31-2d6ccfa3efc9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:58.888827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70010d27-9e30-4ed4-ae31-2d6ccfa3efc9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:59.017562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9417d-4b81-4388-b950-fcf3f2db5a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:59.018357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9417d-4b81-4388-b950-fcf3f2db5a78 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:59.018744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9417d-4b81-4388-b950-fcf3f2db5a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:59.019086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9417d-4b81-4388-b950-fcf3f2db5a78 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:59.021684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9417d-4b81-4388-b950-fcf3f2db5a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:59.025564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9417d-4b81-4388-b950-fcf3f2db5a78 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:59.058021 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3489/7015] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:28:58 2022] POST /identity/v3/users => generated 286 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:28:59.062121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73a29a-97c0-48ee-90f5-6b9d97a9f9c9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:59.073596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73a29a-97c0-48ee-90f5-6b9d97a9f9c9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:59.089936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3b236-41f1-4704-ad8e-13bd6f9fb127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:59.090955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3b236-41f1-4704-ad8e-13bd6f9fb127 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:59.091082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3b236-41f1-4704-ad8e-13bd6f9fb127 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:59.091405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3b236-41f1-4704-ad8e-13bd6f9fb127 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:59.093692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3b236-41f1-4704-ad8e-13bd6f9fb127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:59.095389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3b236-41f1-4704-ad8e-13bd6f9fb127 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:59.123844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9417d-4b81-4388-b950-fcf3f2db5a78 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:59.124558 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3527/7016] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:28:59.152507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9417d-4b81-4388-b950-fcf3f2db5a78 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:59.159315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dad178-1d64-4eef-9c78-5ce92fb1890f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:59.160488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dad178-1d64-4eef-9c78-5ce92fb1890f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:59.160945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dad178-1d64-4eef-9c78-5ce92fb1890f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:59.161657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dad178-1d64-4eef-9c78-5ce92fb1890f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:59.162560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dad178-1d64-4eef-9c78-5ce92fb1890f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:59.166388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dad178-1d64-4eef-9c78-5ce92fb1890f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:59.179624 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3490/7017] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:28:59.183500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3b236-41f1-4704-ad8e-13bd6f9fb127 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:59.196506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3b236-41f1-4704-ad8e-13bd6f9fb127 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:59.201903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91f2ee-a18d-48fc-ab1b-782dfe27ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:59.203051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91f2ee-a18d-48fc-ab1b-782dfe27ff65 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:59.203401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91f2ee-a18d-48fc-ab1b-782dfe27ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:59.203667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91f2ee-a18d-48fc-ab1b-782dfe27ff65 admin admin] PATH_INFO: `/v3/projects/c1b4e97dcb6c4d7ba62d67b02cf3bfca/users/e531117f50124183adfa6a09b5f2d0b7/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:59.213570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:59.248102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91f2ee-a18d-48fc-ab1b-782dfe27ff65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b4e97dcb6c4d7ba62d67b02cf3bfca, user_id=e531117f50124183adfa6a09b5f2d0b7, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:59.253778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91f2ee-a18d-48fc-ab1b-782dfe27ff65 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:59.281774 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3528/7018] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:28:59 2022] PUT /identity/v3/projects/c1b4e97dcb6c4d7ba62d67b02cf3bfca/users/e531117f50124183adfa6a09b5f2d0b7/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:28:59.294889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4624f-98c5-497b-a6ba-13556f475cb6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:59.294889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4624f-98c5-497b-a6ba-13556f475cb6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:59.294889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4624f-98c5-497b-a6ba-13556f475cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:59.357030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2ba4624f-98c5-497b-a6ba-13556f475cb6 None None] MFA Rules not processed for user `e531117f50124183adfa6a09b5f2d0b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:59.358279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2ba4624f-98c5-497b-a6ba-13556f475cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:59.535374 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3491/7019] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:28:59.547551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4a1f8-f6e3-4e98-a884-3b6ea2cbb4af None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:59.547960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4a1f8-f6e3-4e98-a884-3b6ea2cbb4af None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:59.548447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4a1f8-f6e3-4e98-a884-3b6ea2cbb4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:59.586351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0ca4a1f8-f6e3-4e98-a884-3b6ea2cbb4af None None] MFA Rules not processed for user `e531117f50124183adfa6a09b5f2d0b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:28:59.588920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0ca4a1f8-f6e3-4e98-a884-3b6ea2cbb4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:59.634727 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3529/7020] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:28:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:28:59.648767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4624f-98c5-497b-a6ba-13556f475cb6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:28:59.650576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2ba4624f-98c5-497b-a6ba-13556f475cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:28:59.669825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:59.788555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4624f-98c5-497b-a6ba-13556f475cb6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:28:59.798020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692d900-a30a-4b35-86eb-4a79bb9d1fef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:28:59.799592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692d900-a30a-4b35-86eb-4a79bb9d1fef service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:28:59.801962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692d900-a30a-4b35-86eb-4a79bb9d1fef service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:28:59.802799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692d900-a30a-4b35-86eb-4a79bb9d1fef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:28:59.820234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692d900-a30a-4b35-86eb-4a79bb9d1fef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:28:59.823733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692d900-a30a-4b35-86eb-4a79bb9d1fef service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:28:59.840681 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3492/7021] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:28:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:00.970417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4a1f8-f6e3-4e98-a884-3b6ea2cbb4af None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:00.974837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0ca4a1f8-f6e3-4e98-a884-3b6ea2cbb4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:01.115240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4a1f8-f6e3-4e98-a884-3b6ea2cbb4af None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:01.122164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adec9bb-b87e-44f3-9dec-c344a8395bf0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:01.123164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adec9bb-b87e-44f3-9dec-c344a8395bf0 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:01.123618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adec9bb-b87e-44f3-9dec-c344a8395bf0 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:01.124072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adec9bb-b87e-44f3-9dec-c344a8395bf0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:01.126264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2adec9bb-b87e-44f3-9dec-c344a8395bf0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:01.145320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adec9bb-b87e-44f3-9dec-c344a8395bf0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:01.147274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adec9bb-b87e-44f3-9dec-c344a8395bf0 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:01.177212 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3530/7022] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:01.241617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692d900-a30a-4b35-86eb-4a79bb9d1fef service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:01.243650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9692d900-a30a-4b35-86eb-4a79bb9d1fef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:01.396348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692d900-a30a-4b35-86eb-4a79bb9d1fef service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:01.405999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ddb1c-dd4a-4d14-adba-91092657559a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:01.407105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ddb1c-dd4a-4d14-adba-91092657559a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:01.407536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ddb1c-dd4a-4d14-adba-91092657559a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:01.407955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ddb1c-dd4a-4d14-adba-91092657559a admin admin] PATH_INFO: `/v3/users/5ccce5ba6b09497caa3e91873b356a0a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:01.409342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ddb1c-dd4a-4d14-adba-91092657559a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ccce5ba6b09497caa3e91873b356a0a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:01.411570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ddb1c-dd4a-4d14-adba-91092657559a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:01.490502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c13ddb1c-dd4a-4d14-adba-91092657559a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ccce5ba6b09497caa3e91873b356a0a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:01.499606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c13ddb1c-dd4a-4d14-adba-91092657559a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ccce5ba6b09497caa3e91873b356a0a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:01.507277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c13ddb1c-dd4a-4d14-adba-91092657559a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ccce5ba6b09497caa3e91873b356a0a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:01.507921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c13ddb1c-dd4a-4d14-adba-91092657559a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ccce5ba6b09497caa3e91873b356a0a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:01.508556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c13ddb1c-dd4a-4d14-adba-91092657559a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ccce5ba6b09497caa3e91873b356a0a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:01.527568 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3493/7023] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:01 2022] DELETE /identity/v3/users/5ccce5ba6b09497caa3e91873b356a0a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:01.532729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34f1c0-d40c-44dc-b8d3-5cfe5798d6d6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:01.533114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34f1c0-d40c-44dc-b8d3-5cfe5798d6d6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:01.533459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34f1c0-d40c-44dc-b8d3-5cfe5798d6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:01.551408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ce34f1c0-d40c-44dc-b8d3-5cfe5798d6d6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:01.552801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ce34f1c0-d40c-44dc-b8d3-5cfe5798d6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:01.621701 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3531/7024] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:01.631583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ddb1c-dd4a-4d14-adba-91092657559a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:01.633142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c13ddb1c-dd4a-4d14-adba-91092657559a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:01.655435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:01.703890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ddb1c-dd4a-4d14-adba-91092657559a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:01.707850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e8ba8-a132-4eca-81a5-b2538ee12ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:01.708528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e8ba8-a132-4eca-81a5-b2538ee12ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:01.708808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e8ba8-a132-4eca-81a5-b2538ee12ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:01.709081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e8ba8-a132-4eca-81a5-b2538ee12ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:01.719391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e8ba8-a132-4eca-81a5-b2538ee12ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:01.720891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e8ba8-a132-4eca-81a5-b2538ee12ff4 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:01.732164 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3494/7025] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:02.148975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34f1c0-d40c-44dc-b8d3-5cfe5798d6d6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:02.151057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ce34f1c0-d40c-44dc-b8d3-5cfe5798d6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:02.165132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34f1c0-d40c-44dc-b8d3-5cfe5798d6d6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:02.171555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebfd3d-75d3-42cd-9e52-5315493e1945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:02.172694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebfd3d-75d3-42cd-9e52-5315493e1945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:02.173196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebfd3d-75d3-42cd-9e52-5315493e1945 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:02.173957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebfd3d-75d3-42cd-9e52-5315493e1945 admin admin] PATH_INFO: `/v3/projects/89d200d36d5848fbab59b83e3db04c19` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:02.176365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cebfd3d-75d3-42cd-9e52-5315493e1945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d200d36d5848fbab59b83e3db04c19)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:02.179563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cebfd3d-75d3-42cd-9e52-5315493e1945 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:02.263013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0cebfd3d-75d3-42cd-9e52-5315493e1945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d200d36d5848fbab59b83e3db04c19', 'request_id': 'req-0cebfd3d-75d3-42cd-9e52-5315493e1945'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:02.289288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0cebfd3d-75d3-42cd-9e52-5315493e1945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d200d36d5848fbab59b83e3db04c19', 'request_id': 'req-0cebfd3d-75d3-42cd-9e52-5315493e1945'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:02.293542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:02.306424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0cebfd3d-75d3-42cd-9e52-5315493e1945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d200d36d5848fbab59b83e3db04c19', 'request_id': 'req-0cebfd3d-75d3-42cd-9e52-5315493e1945'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:02.337479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0cebfd3d-75d3-42cd-9e52-5315493e1945 admin admin] The token cache is being invalidate because project 89d200d36d5848fbab59b83e3db04c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:02.337775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0cebfd3d-75d3-42cd-9e52-5315493e1945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:02.338504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0cebfd3d-75d3-42cd-9e52-5315493e1945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:02.347252 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3532/7026] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:02 2022] DELETE /identity/v3/projects/89d200d36d5848fbab59b83e3db04c19 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:02.349629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea172408-7495-4899-a05f-ee9bd1ff2f2c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:02.350112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea172408-7495-4899-a05f-ee9bd1ff2f2c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:02.353211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea172408-7495-4899-a05f-ee9bd1ff2f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:02.378727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ea172408-7495-4899-a05f-ee9bd1ff2f2c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:02.380016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ea172408-7495-4899-a05f-ee9bd1ff2f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:02.493459 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3495/7027] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:02.493987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99e943-440b-428c-8c59-9c9bf8fa8236 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:02.494404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99e943-440b-428c-8c59-9c9bf8fa8236 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:02.494776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99e943-440b-428c-8c59-9c9bf8fa8236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:02.521081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-db99e943-440b-428c-8c59-9c9bf8fa8236 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:02.522535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-db99e943-440b-428c-8c59-9c9bf8fa8236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:02.532303 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3533/7028] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:02.536706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea172408-7495-4899-a05f-ee9bd1ff2f2c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:02.596511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea172408-7495-4899-a05f-ee9bd1ff2f2c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:02.616108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d448a0-3ec8-4726-98f8-9c9c1d2f76bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:02.620278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d448a0-3ec8-4726-98f8-9c9c1d2f76bc admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:02.620679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d448a0-3ec8-4726-98f8-9c9c1d2f76bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:02.621067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d448a0-3ec8-4726-98f8-9c9c1d2f76bc admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:02.622165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d448a0-3ec8-4726-98f8-9c9c1d2f76bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:02.622979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d448a0-3ec8-4726-98f8-9c9c1d2f76bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:02.625068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d448a0-3ec8-4726-98f8-9c9c1d2f76bc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:02.645622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99e943-440b-428c-8c59-9c9bf8fa8236 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:02.656420 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3496/7029] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:02.658540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99e943-440b-428c-8c59-9c9bf8fa8236 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:02.674397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed29789-d027-4e28-bc45-b2ad5f4a8f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:02.675243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed29789-d027-4e28-bc45-b2ad5f4a8f83 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:02.675535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed29789-d027-4e28-bc45-b2ad5f4a8f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:02.675810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed29789-d027-4e28-bc45-b2ad5f4a8f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:02.676647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed29789-d027-4e28-bc45-b2ad5f4a8f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:02.681157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed29789-d027-4e28-bc45-b2ad5f4a8f83 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:02.749393 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3534/7030] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:02 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:02.751671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d448a0-3ec8-4726-98f8-9c9c1d2f76bc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:02.772097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d448a0-3ec8-4726-98f8-9c9c1d2f76bc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:02.855199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cd1eb-5d00-4038-afe8-c674b1520a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:02.856877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cd1eb-5d00-4038-afe8-c674b1520a45 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:02.857686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cd1eb-5d00-4038-afe8-c674b1520a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:02.857686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cd1eb-5d00-4038-afe8-c674b1520a45 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:02.859317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cd1eb-5d00-4038-afe8-c674b1520a45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:02.861763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cd1eb-5d00-4038-afe8-c674b1520a45 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:02.886405 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3497/7031] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:02 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:02.890604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed29789-d027-4e28-bc45-b2ad5f4a8f83 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:02.904751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed29789-d027-4e28-bc45-b2ad5f4a8f83 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:02.910485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2a1ff-cb2e-471a-8219-1091c0f45e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:02.911577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2a1ff-cb2e-471a-8219-1091c0f45e24 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:02.912315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2a1ff-cb2e-471a-8219-1091c0f45e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:02.912315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2a1ff-cb2e-471a-8219-1091c0f45e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:02.913094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2a1ff-cb2e-471a-8219-1091c0f45e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:02.914750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2a1ff-cb2e-471a-8219-1091c0f45e24 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:02.929846 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3535/7032] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:02.931177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cd1eb-5d00-4038-afe8-c674b1520a45 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:02.943125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cd1eb-5d00-4038-afe8-c674b1520a45 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:02.949005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6f35d-e96e-4f0a-9066-0af0007d7490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:02.949981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6f35d-e96e-4f0a-9066-0af0007d7490 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:02.950360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6f35d-e96e-4f0a-9066-0af0007d7490 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:02.951290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6f35d-e96e-4f0a-9066-0af0007d7490 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:02.951743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6f35d-e96e-4f0a-9066-0af0007d7490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:02.955227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6f35d-e96e-4f0a-9066-0af0007d7490 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:02.971855 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3498/7033] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:02.973891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2a1ff-cb2e-471a-8219-1091c0f45e24 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:02.986255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2a1ff-cb2e-471a-8219-1091c0f45e24 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:02.991543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c4a62-45a5-4b7f-9aa0-3a7af96b7aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:02.992614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c4a62-45a5-4b7f-9aa0-3a7af96b7aa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:02.992996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c4a62-45a5-4b7f-9aa0-3a7af96b7aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:02.993371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c4a62-45a5-4b7f-9aa0-3a7af96b7aa9 admin admin] PATH_INFO: `/v3/projects/eafd29e49c2a483489c2b97618a8ef26/users/debd0b124db240e9898beac427182323/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:03.013750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c4a62-45a5-4b7f-9aa0-3a7af96b7aa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eafd29e49c2a483489c2b97618a8ef26, user_id=debd0b124db240e9898beac427182323, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:03.018631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c4a62-45a5-4b7f-9aa0-3a7af96b7aa9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:03.034913 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3536/7034] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:02 2022] PUT /identity/v3/projects/eafd29e49c2a483489c2b97618a8ef26/users/debd0b124db240e9898beac427182323/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:03.045634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805430b-95bb-466a-a699-7ee121049aa5 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:03.046102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805430b-95bb-466a-a699-7ee121049aa5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:03.047045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805430b-95bb-466a-a699-7ee121049aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:03.114691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1805430b-95bb-466a-a699-7ee121049aa5 None None] MFA Rules not processed for user `debd0b124db240e9898beac427182323`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:03.116181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1805430b-95bb-466a-a699-7ee121049aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:03.130447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:03.272201 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3499/7035] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:03.281496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c4a62-45a5-4b7f-9aa0-3a7af96b7aa9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:03.283571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5f6c4a62-45a5-4b7f-9aa0-3a7af96b7aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:03.392760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c4a62-45a5-4b7f-9aa0-3a7af96b7aa9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:03.400848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a942f98-200c-422c-b170-5a3c5a8fc3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:03.401708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a942f98-200c-422c-b170-5a3c5a8fc3ab service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:03.402332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a942f98-200c-422c-b170-5a3c5a8fc3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:03.402463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a942f98-200c-422c-b170-5a3c5a8fc3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:03.414445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a942f98-200c-422c-b170-5a3c5a8fc3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:03.416225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a942f98-200c-422c-b170-5a3c5a8fc3ab service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:03.438277 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3537/7036] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:12.292273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805430b-95bb-466a-a699-7ee121049aa5 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:12.378504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805430b-95bb-466a-a699-7ee121049aa5 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:12.390038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d053e-1c5f-42c6-b349-5db844497453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:12.391308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d053e-1c5f-42c6-b349-5db844497453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:12.391659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d053e-1c5f-42c6-b349-5db844497453 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:12.391932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d053e-1c5f-42c6-b349-5db844497453 admin admin] PATH_INFO: `/v3/users/debd0b124db240e9898beac427182323` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:12.393211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d053e-1c5f-42c6-b349-5db844497453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=debd0b124db240e9898beac427182323)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:12.397088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d053e-1c5f-42c6-b349-5db844497453 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:12.492190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-694d053e-1c5f-42c6-b349-5db844497453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'debd0b124db240e9898beac427182323'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:12.520518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-694d053e-1c5f-42c6-b349-5db844497453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'debd0b124db240e9898beac427182323'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:12.555369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-694d053e-1c5f-42c6-b349-5db844497453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'debd0b124db240e9898beac427182323'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:12.558595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-694d053e-1c5f-42c6-b349-5db844497453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'debd0b124db240e9898beac427182323'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:12.560524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-694d053e-1c5f-42c6-b349-5db844497453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'debd0b124db240e9898beac427182323'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:12.634406 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3500/7037] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:12 2022] DELETE /identity/v3/users/debd0b124db240e9898beac427182323 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:12.638856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b278ea-85ba-49c4-a260-af9ff9d21843 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:12.639363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b278ea-85ba-49c4-a260-af9ff9d21843 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:12.639506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b278ea-85ba-49c4-a260-af9ff9d21843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:12.682362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-94b278ea-85ba-49c4-a260-af9ff9d21843 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:12.686962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-94b278ea-85ba-49c4-a260-af9ff9d21843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:12.860747 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3538/7038] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:12.886918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d053e-1c5f-42c6-b349-5db844497453 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:12.888516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-694d053e-1c5f-42c6-b349-5db844497453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:12.935071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:12.961585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d053e-1c5f-42c6-b349-5db844497453 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:12.965240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910c877-72e5-4952-b25d-d4c07cd1221b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:12.965931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910c877-72e5-4952-b25d-d4c07cd1221b service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:12.966233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910c877-72e5-4952-b25d-d4c07cd1221b service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:12.966946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910c877-72e5-4952-b25d-d4c07cd1221b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:12.978048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910c877-72e5-4952-b25d-d4c07cd1221b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:12.979488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910c877-72e5-4952-b25d-d4c07cd1221b service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:12.993104 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3501/7039] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:13.215859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b278ea-85ba-49c4-a260-af9ff9d21843 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:13.221168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-94b278ea-85ba-49c4-a260-af9ff9d21843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:13.264223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b278ea-85ba-49c4-a260-af9ff9d21843 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:13.272850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095da48a-edeb-40c9-86eb-f46bfea65834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:13.274065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095da48a-edeb-40c9-86eb-f46bfea65834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:13.274500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095da48a-edeb-40c9-86eb-f46bfea65834 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:13.274942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095da48a-edeb-40c9-86eb-f46bfea65834 admin admin] PATH_INFO: `/v3/projects/eafd29e49c2a483489c2b97618a8ef26` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:13.276443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095da48a-edeb-40c9-86eb-f46bfea65834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eafd29e49c2a483489c2b97618a8ef26)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:13.279548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095da48a-edeb-40c9-86eb-f46bfea65834 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:13.314265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:13.376639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-095da48a-edeb-40c9-86eb-f46bfea65834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eafd29e49c2a483489c2b97618a8ef26', 'request_id': 'req-095da48a-edeb-40c9-86eb-f46bfea65834'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:13.389114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-095da48a-edeb-40c9-86eb-f46bfea65834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eafd29e49c2a483489c2b97618a8ef26', 'request_id': 'req-095da48a-edeb-40c9-86eb-f46bfea65834'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:13.402373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-095da48a-edeb-40c9-86eb-f46bfea65834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eafd29e49c2a483489c2b97618a8ef26', 'request_id': 'req-095da48a-edeb-40c9-86eb-f46bfea65834'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:13.418271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-095da48a-edeb-40c9-86eb-f46bfea65834 admin admin] The token cache is being invalidate because project eafd29e49c2a483489c2b97618a8ef26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:13.418602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-095da48a-edeb-40c9-86eb-f46bfea65834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:13.419469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-095da48a-edeb-40c9-86eb-f46bfea65834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:13.421717 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3539/7040] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:13 2022] DELETE /identity/v3/projects/eafd29e49c2a483489c2b97618a8ef26 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:13.427051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f48aa-086a-4e75-9b0c-47f15b2f68bc None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:13.427551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f48aa-086a-4e75-9b0c-47f15b2f68bc None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:13.427738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f48aa-086a-4e75-9b0c-47f15b2f68bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:13.454463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c02f48aa-086a-4e75-9b0c-47f15b2f68bc None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:13.455870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c02f48aa-086a-4e75-9b0c-47f15b2f68bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:13.570962 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3502/7041] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:13.583741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64aa5c7-b160-4a25-b9fe-f56c290a424f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:13.584128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64aa5c7-b160-4a25-b9fe-f56c290a424f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:13.584423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64aa5c7-b160-4a25-b9fe-f56c290a424f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:13.612688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f64aa5c7-b160-4a25-b9fe-f56c290a424f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:13.613927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f64aa5c7-b160-4a25-b9fe-f56c290a424f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:13.635466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f48aa-086a-4e75-9b0c-47f15b2f68bc None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:13.636776 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3540/7042] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:13.650275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f48aa-086a-4e75-9b0c-47f15b2f68bc None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:13.657315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d152f41-2bf6-498c-a6f6-08b3cb5f05a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:13.657917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d152f41-2bf6-498c-a6f6-08b3cb5f05a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:13.658038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d152f41-2bf6-498c-a6f6-08b3cb5f05a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:13.658262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d152f41-2bf6-498c-a6f6-08b3cb5f05a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:13.659315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d152f41-2bf6-498c-a6f6-08b3cb5f05a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:13.659315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d152f41-2bf6-498c-a6f6-08b3cb5f05a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:13.660930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d152f41-2bf6-498c-a6f6-08b3cb5f05a1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:13.689053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64aa5c7-b160-4a25-b9fe-f56c290a424f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:13.695705 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3503/7043] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:29:13.701627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64aa5c7-b160-4a25-b9fe-f56c290a424f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:13.708859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127bafa-4c16-43b9-9aed-61b120101500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:13.709554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127bafa-4c16-43b9-9aed-61b120101500 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:13.710001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127bafa-4c16-43b9-9aed-61b120101500 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:13.710286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127bafa-4c16-43b9-9aed-61b120101500 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:13.711056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127bafa-4c16-43b9-9aed-61b120101500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:13.713103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127bafa-4c16-43b9-9aed-61b120101500 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:13.763752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d152f41-2bf6-498c-a6f6-08b3cb5f05a1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:13.773904 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3541/7044] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:13 2022] POST /identity/v3/projects => generated 351 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:13.777678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d152f41-2bf6-498c-a6f6-08b3cb5f05a1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:13.881096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd7cca-6315-48e4-805b-890ac84470a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:13.881797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd7cca-6315-48e4-805b-890ac84470a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:13.882079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd7cca-6315-48e4-805b-890ac84470a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:13.882367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd7cca-6315-48e4-805b-890ac84470a9 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:13.883087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd7cca-6315-48e4-805b-890ac84470a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:13.887368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd7cca-6315-48e4-805b-890ac84470a9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:13.918777 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3504/7045] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:13 2022] POST /identity/v3/users => generated 276 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:13.923485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127bafa-4c16-43b9-9aed-61b120101500 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:13.939599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127bafa-4c16-43b9-9aed-61b120101500 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:13.950698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd092a-fa8a-4fb0-8d46-d8dd9517951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:13.953922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd092a-fa8a-4fb0-8d46-d8dd9517951c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:13.954431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd092a-fa8a-4fb0-8d46-d8dd9517951c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:13.956134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd092a-fa8a-4fb0-8d46-d8dd9517951c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:13.960805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd092a-fa8a-4fb0-8d46-d8dd9517951c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:13.982029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd092a-fa8a-4fb0-8d46-d8dd9517951c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:14.028918 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3542/7046] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:14.031677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd7cca-6315-48e4-805b-890ac84470a9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:14.056519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd7cca-6315-48e4-805b-890ac84470a9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:14.071240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f3b64-c18f-4311-85a0-7e44a9408e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:14.072022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f3b64-c18f-4311-85a0-7e44a9408e86 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:14.072810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f3b64-c18f-4311-85a0-7e44a9408e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:14.072810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f3b64-c18f-4311-85a0-7e44a9408e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:14.074951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f3b64-c18f-4311-85a0-7e44a9408e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:14.087088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f3b64-c18f-4311-85a0-7e44a9408e86 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:14.127021 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3505/7047] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:14.128359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd092a-fa8a-4fb0-8d46-d8dd9517951c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:14.140820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd092a-fa8a-4fb0-8d46-d8dd9517951c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:14.148553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4839af-91b0-4704-a509-6bb4181625c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:14.150512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4839af-91b0-4704-a509-6bb4181625c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:14.150805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4839af-91b0-4704-a509-6bb4181625c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:14.151139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4839af-91b0-4704-a509-6bb4181625c9 admin admin] PATH_INFO: `/v3/projects/5cf46a3725df43c287848c0cd57df883/users/f11561dc50a445e1a0355936d777b0b0/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:14.192018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4839af-91b0-4704-a509-6bb4181625c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf46a3725df43c287848c0cd57df883, user_id=f11561dc50a445e1a0355936d777b0b0, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:14.195269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4839af-91b0-4704-a509-6bb4181625c9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:14.232450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef77507-fb75-4407-99e2-1a54d7a075c2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:14.233065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef77507-fb75-4407-99e2-1a54d7a075c2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:14.233775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef77507-fb75-4407-99e2-1a54d7a075c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:14.240330 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3543/7048] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:14 2022] PUT /identity/v3/projects/5cf46a3725df43c287848c0cd57df883/users/f11561dc50a445e1a0355936d777b0b0/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:14.284928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fef77507-fb75-4407-99e2-1a54d7a075c2 None None] MFA Rules not processed for user `f11561dc50a445e1a0355936d777b0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:14.287164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fef77507-fb75-4407-99e2-1a54d7a075c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:14.329444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:14.370766 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3506/7049] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:14 2022] POST /identity/v3/auth/tokens => generated 3218 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:14.383700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4839af-91b0-4704-a509-6bb4181625c9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:14.385683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0e4839af-91b0-4704-a509-6bb4181625c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:14.463204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4839af-91b0-4704-a509-6bb4181625c9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:14.467717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda043b-3b03-4694-841f-e49a5a31d626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:14.468488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda043b-3b03-4694-841f-e49a5a31d626 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:14.468942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda043b-3b03-4694-841f-e49a5a31d626 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:14.469313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda043b-3b03-4694-841f-e49a5a31d626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:14.478608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda043b-3b03-4694-841f-e49a5a31d626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:14.480317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda043b-3b03-4694-841f-e49a5a31d626 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:14.489995 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3544/7050] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:14 2022] GET /identity/v3/auth/tokens => generated 3218 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:17.029631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef77507-fb75-4407-99e2-1a54d7a075c2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:17.122640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef77507-fb75-4407-99e2-1a54d7a075c2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:17.128378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306cc44-7717-46b5-84e9-8d044ddc76da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:17.129280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306cc44-7717-46b5-84e9-8d044ddc76da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:17.129563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306cc44-7717-46b5-84e9-8d044ddc76da admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:17.129832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306cc44-7717-46b5-84e9-8d044ddc76da admin admin] PATH_INFO: `/v3/users/f11561dc50a445e1a0355936d777b0b0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:17.131033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306cc44-7717-46b5-84e9-8d044ddc76da admin admin] RBAC: Authorizing `identity:delete_user(user_id=f11561dc50a445e1a0355936d777b0b0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:17.133030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306cc44-7717-46b5-84e9-8d044ddc76da admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:17.194434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8306cc44-7717-46b5-84e9-8d044ddc76da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f11561dc50a445e1a0355936d777b0b0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:17.203926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8306cc44-7717-46b5-84e9-8d044ddc76da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f11561dc50a445e1a0355936d777b0b0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:17.212601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8306cc44-7717-46b5-84e9-8d044ddc76da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f11561dc50a445e1a0355936d777b0b0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:17.213435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8306cc44-7717-46b5-84e9-8d044ddc76da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f11561dc50a445e1a0355936d777b0b0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:17.214262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8306cc44-7717-46b5-84e9-8d044ddc76da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f11561dc50a445e1a0355936d777b0b0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:17.246067 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3507/7051] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:17 2022] DELETE /identity/v3/users/f11561dc50a445e1a0355936d777b0b0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:17.250786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b3fa2-4f33-4364-a79b-a76d86c06605 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:17.251293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b3fa2-4f33-4364-a79b-a76d86c06605 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:17.251392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b3fa2-4f33-4364-a79b-a76d86c06605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:17.268938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3c8b3fa2-4f33-4364-a79b-a76d86c06605 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:17.270721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3c8b3fa2-4f33-4364-a79b-a76d86c06605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:17.342151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:17.378792 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3545/7052] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:17.388825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306cc44-7717-46b5-84e9-8d044ddc76da admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:17.392759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8306cc44-7717-46b5-84e9-8d044ddc76da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:17.483078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306cc44-7717-46b5-84e9-8d044ddc76da admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:17.487752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d03dd4-826a-491c-8e1a-74e9aee5d26f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:17.488525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d03dd4-826a-491c-8e1a-74e9aee5d26f service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:17.488877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d03dd4-826a-491c-8e1a-74e9aee5d26f service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:17.489277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d03dd4-826a-491c-8e1a-74e9aee5d26f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:17.498750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:17.502059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d03dd4-826a-491c-8e1a-74e9aee5d26f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:17.504304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d03dd4-826a-491c-8e1a-74e9aee5d26f service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:17.522476 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3508/7053] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:17.760978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b3fa2-4f33-4364-a79b-a76d86c06605 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:17.762432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3c8b3fa2-4f33-4364-a79b-a76d86c06605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:17.784767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b3fa2-4f33-4364-a79b-a76d86c06605 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:17.794063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afb34e-be10-424a-a77a-d683bf5d7947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:17.795030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afb34e-be10-424a-a77a-d683bf5d7947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:17.795315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afb34e-be10-424a-a77a-d683bf5d7947 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:17.795611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afb34e-be10-424a-a77a-d683bf5d7947 admin admin] PATH_INFO: `/v3/projects/5cf46a3725df43c287848c0cd57df883` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:17.797799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afb34e-be10-424a-a77a-d683bf5d7947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cf46a3725df43c287848c0cd57df883)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:17.801370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afb34e-be10-424a-a77a-d683bf5d7947 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:17.870885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-70afb34e-be10-424a-a77a-d683bf5d7947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cf46a3725df43c287848c0cd57df883', 'request_id': 'req-70afb34e-be10-424a-a77a-d683bf5d7947'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:17.879772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-70afb34e-be10-424a-a77a-d683bf5d7947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cf46a3725df43c287848c0cd57df883', 'request_id': 'req-70afb34e-be10-424a-a77a-d683bf5d7947'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:17.887746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-70afb34e-be10-424a-a77a-d683bf5d7947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cf46a3725df43c287848c0cd57df883', 'request_id': 'req-70afb34e-be10-424a-a77a-d683bf5d7947'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:17.899905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-70afb34e-be10-424a-a77a-d683bf5d7947 admin admin] The token cache is being invalidate because project 5cf46a3725df43c287848c0cd57df883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:17.900230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-70afb34e-be10-424a-a77a-d683bf5d7947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:17.900927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-70afb34e-be10-424a-a77a-d683bf5d7947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:17.902531 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3546/7054] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:17 2022] DELETE /identity/v3/projects/5cf46a3725df43c287848c0cd57df883 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:17.907831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417e84f-baae-4ef7-a1e3-50cfd65fb8a0 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:17.908149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417e84f-baae-4ef7-a1e3-50cfd65fb8a0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:17.908431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417e84f-baae-4ef7-a1e3-50cfd65fb8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:17.927581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0417e84f-baae-4ef7-a1e3-50cfd65fb8a0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:17.929163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0417e84f-baae-4ef7-a1e3-50cfd65fb8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:17.994025 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3509/7055] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:18.001845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d361f-e9aa-4f77-aab4-a26beb1a0e83 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:18.002141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d361f-e9aa-4f77-aab4-a26beb1a0e83 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:18.002425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d361f-e9aa-4f77-aab4-a26beb1a0e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:18.021785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e37d361f-e9aa-4f77-aab4-a26beb1a0e83 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:18.023038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e37d361f-e9aa-4f77-aab4-a26beb1a0e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:18.031497 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3547/7056] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:18.035753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417e84f-baae-4ef7-a1e3-50cfd65fb8a0 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:18.046186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417e84f-baae-4ef7-a1e3-50cfd65fb8a0 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:18.051260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682ec54-1e1f-404b-a43c-ecead26c23d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:18.051930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682ec54-1e1f-404b-a43c-ecead26c23d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:18.052259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682ec54-1e1f-404b-a43c-ecead26c23d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:18.052520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682ec54-1e1f-404b-a43c-ecead26c23d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:18.053258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682ec54-1e1f-404b-a43c-ecead26c23d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:18.053929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682ec54-1e1f-404b-a43c-ecead26c23d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:18.055541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682ec54-1e1f-404b-a43c-ecead26c23d4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:18.067886 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3510/7057] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:18.072291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d361f-e9aa-4f77-aab4-a26beb1a0e83 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:18.082212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d361f-e9aa-4f77-aab4-a26beb1a0e83 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:18.087496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cfb55-3a95-4a49-bc32-d6bc1c97a731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:18.088225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cfb55-3a95-4a49-bc32-d6bc1c97a731 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:18.088529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cfb55-3a95-4a49-bc32-d6bc1c97a731 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:18.088810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cfb55-3a95-4a49-bc32-d6bc1c97a731 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:18.089494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cfb55-3a95-4a49-bc32-d6bc1c97a731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:18.091622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cfb55-3a95-4a49-bc32-d6bc1c97a731 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:18.118984 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3548/7058] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:18 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:18.123484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682ec54-1e1f-404b-a43c-ecead26c23d4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:18.134040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682ec54-1e1f-404b-a43c-ecead26c23d4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:18.193504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33684b-751e-44c4-a67d-60001b18b77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:18.194129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33684b-751e-44c4-a67d-60001b18b77f admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:18.194408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33684b-751e-44c4-a67d-60001b18b77f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:18.194680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33684b-751e-44c4-a67d-60001b18b77f admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:18.195375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33684b-751e-44c4-a67d-60001b18b77f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:18.197331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33684b-751e-44c4-a67d-60001b18b77f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:18.220564 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3511/7059] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:18 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:18.224855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cfb55-3a95-4a49-bc32-d6bc1c97a731 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:18.236562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cfb55-3a95-4a49-bc32-d6bc1c97a731 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:18.242704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58b6e9-5a86-43c8-844d-041550e1f86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:18.243384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58b6e9-5a86-43c8-844d-041550e1f86b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:18.243764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58b6e9-5a86-43c8-844d-041550e1f86b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:18.244153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58b6e9-5a86-43c8-844d-041550e1f86b admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:18.244860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58b6e9-5a86-43c8-844d-041550e1f86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:18.246486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58b6e9-5a86-43c8-844d-041550e1f86b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:18.258686 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3549/7060] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:18.265422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33684b-751e-44c4-a67d-60001b18b77f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:18.278844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33684b-751e-44c4-a67d-60001b18b77f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:18.286535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4161d-a84e-4b93-9319-0f6f7358cc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:18.287387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4161d-a84e-4b93-9319-0f6f7358cc92 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:18.287668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4161d-a84e-4b93-9319-0f6f7358cc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:18.287958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4161d-a84e-4b93-9319-0f6f7358cc92 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:18.288854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4161d-a84e-4b93-9319-0f6f7358cc92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:18.290714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4161d-a84e-4b93-9319-0f6f7358cc92 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:18.302222 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3512/7061] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:18.307257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58b6e9-5a86-43c8-844d-041550e1f86b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:18.318786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58b6e9-5a86-43c8-844d-041550e1f86b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:18.323710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14e8ba-38fa-4405-a8ad-ed351c9d17af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:18.324676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14e8ba-38fa-4405-a8ad-ed351c9d17af admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:18.324943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14e8ba-38fa-4405-a8ad-ed351c9d17af admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:18.325418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14e8ba-38fa-4405-a8ad-ed351c9d17af admin admin] PATH_INFO: `/v3/projects/cbc3b8a6410c4cde86770df3ecfeeb02/users/9c97521c689d4f3590f79ec803f28109/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:18.340672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14e8ba-38fa-4405-a8ad-ed351c9d17af admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc3b8a6410c4cde86770df3ecfeeb02, user_id=9c97521c689d4f3590f79ec803f28109, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:18.343471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14e8ba-38fa-4405-a8ad-ed351c9d17af admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:18.357754 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3550/7062] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:18 2022] PUT /identity/v3/projects/cbc3b8a6410c4cde86770df3ecfeeb02/users/9c97521c689d4f3590f79ec803f28109/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:18.368741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5632499-ced4-46d2-8b18-6b4c8c0043b0 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:18.369032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5632499-ced4-46d2-8b18-6b4c8c0043b0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:18.369319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5632499-ced4-46d2-8b18-6b4c8c0043b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:18.397484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f5632499-ced4-46d2-8b18-6b4c8c0043b0 None None] MFA Rules not processed for user `9c97521c689d4f3590f79ec803f28109`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:18.398694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f5632499-ced4-46d2-8b18-6b4c8c0043b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:18.452319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:18.480724 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3513/7063] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:18.482462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14e8ba-38fa-4405-a8ad-ed351c9d17af admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:18.549612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14e8ba-38fa-4405-a8ad-ed351c9d17af admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:18.564296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89f531-570f-45d1-b854-5da19e48a1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:18.564296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89f531-570f-45d1-b854-5da19e48a1db admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:18.564296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89f531-570f-45d1-b854-5da19e48a1db admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:18.564296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89f531-570f-45d1-b854-5da19e48a1db admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:18.564721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89f531-570f-45d1-b854-5da19e48a1db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:18.564721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89f531-570f-45d1-b854-5da19e48a1db admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:18.570676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:18.591529 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3551/7064] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:18 2022] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:18.593310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5632499-ced4-46d2-8b18-6b4c8c0043b0 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:18.604919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5632499-ced4-46d2-8b18-6b4c8c0043b0 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:18.669399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b78d3-e840-49e5-97ab-a43470807b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:18.670089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b78d3-e840-49e5-97ab-a43470807b6e admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:18.670424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b78d3-e840-49e5-97ab-a43470807b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:18.670709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b78d3-e840-49e5-97ab-a43470807b6e admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:18.671487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b78d3-e840-49e5-97ab-a43470807b6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:18.673555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b78d3-e840-49e5-97ab-a43470807b6e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:18.700445 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3514/7065] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:18 2022] POST /identity/v3/users => generated 307 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:18.704276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89f531-570f-45d1-b854-5da19e48a1db admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:18.721324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89f531-570f-45d1-b854-5da19e48a1db admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:18.731020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e2ce8-2a3b-4a19-b6a4-3fbf57ba5ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:18.731902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e2ce8-2a3b-4a19-b6a4-3fbf57ba5ceb admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:18.732291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e2ce8-2a3b-4a19-b6a4-3fbf57ba5ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:18.732620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e2ce8-2a3b-4a19-b6a4-3fbf57ba5ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:18.733946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e2ce8-2a3b-4a19-b6a4-3fbf57ba5ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:18.735731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e2ce8-2a3b-4a19-b6a4-3fbf57ba5ceb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:18.757726 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3552/7066] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:18.759742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b78d3-e840-49e5-97ab-a43470807b6e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:18.771441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b78d3-e840-49e5-97ab-a43470807b6e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:18.778419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c789f33-f1e3-4f52-8e6d-f677692ae98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:18.779620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c789f33-f1e3-4f52-8e6d-f677692ae98f admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:18.779922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c789f33-f1e3-4f52-8e6d-f677692ae98f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:18.780259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c789f33-f1e3-4f52-8e6d-f677692ae98f admin admin] PATH_INFO: `/v3/projects/988cd80aa94a455b8881e8c241f50d41/users/820e85fa6e164559ab3c92131d3cb218/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:18.798760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c789f33-f1e3-4f52-8e6d-f677692ae98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=988cd80aa94a455b8881e8c241f50d41, user_id=820e85fa6e164559ab3c92131d3cb218, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:18.801499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c789f33-f1e3-4f52-8e6d-f677692ae98f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:18.817833 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3515/7067] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:18 2022] PUT /identity/v3/projects/988cd80aa94a455b8881e8c241f50d41/users/820e85fa6e164559ab3c92131d3cb218/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:18.821730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e2ce8-2a3b-4a19-b6a4-3fbf57ba5ceb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:18.832555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e2ce8-2a3b-4a19-b6a4-3fbf57ba5ceb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:18.910537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c8d74-8b4e-4a25-b6d9-9d89336f1664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:18.911236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c8d74-8b4e-4a25-b6d9-9d89336f1664 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:18.911524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c8d74-8b4e-4a25-b6d9-9d89336f1664 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:18.911803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c8d74-8b4e-4a25-b6d9-9d89336f1664 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:18.912593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c8d74-8b4e-4a25-b6d9-9d89336f1664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:18.914280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c8d74-8b4e-4a25-b6d9-9d89336f1664 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:18.928902 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3553/7068] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:29:18.933470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c789f33-f1e3-4f52-8e6d-f677692ae98f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:18.944953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c789f33-f1e3-4f52-8e6d-f677692ae98f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:18.950363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4611e-912b-4300-8944-17281b147fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:18.951350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4611e-912b-4300-8944-17281b147fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:18.951602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4611e-912b-4300-8944-17281b147fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:18.951880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4611e-912b-4300-8944-17281b147fb1 admin admin] PATH_INFO: `/v3/projects/988cd80aa94a455b8881e8c241f50d41/users/820e85fa6e164559ab3c92131d3cb218/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:18.954274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4611e-912b-4300-8944-17281b147fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=988cd80aa94a455b8881e8c241f50d41, user_id=820e85fa6e164559ab3c92131d3cb218, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:18.957396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4611e-912b-4300-8944-17281b147fb1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:18.970947 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3516/7069] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:18 2022] PUT /identity/v3/projects/988cd80aa94a455b8881e8c241f50d41/users/820e85fa6e164559ab3c92131d3cb218/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:18.981064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999bc66-9a15-4e29-8a63-794209c57223 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:18.981362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999bc66-9a15-4e29-8a63-794209c57223 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:18.981661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999bc66-9a15-4e29-8a63-794209c57223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:19.012296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9999bc66-9a15-4e29-8a63-794209c57223 None None] MFA Rules not processed for user `820e85fa6e164559ab3c92131d3cb218`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:19.013678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9999bc66-9a15-4e29-8a63-794209c57223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:19.098354 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3554/7070] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:18 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:19.109857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4611e-912b-4300-8944-17281b147fb1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:19.111833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-43b4611e-912b-4300-8944-17281b147fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:19.172356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4611e-912b-4300-8944-17281b147fb1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:19.176200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71071a-fb96-4ca0-a75d-340c2837aa00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:19.176858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71071a-fb96-4ca0-a75d-340c2837aa00 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:19.177137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71071a-fb96-4ca0-a75d-340c2837aa00 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:19.177412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71071a-fb96-4ca0-a75d-340c2837aa00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:19.187648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71071a-fb96-4ca0-a75d-340c2837aa00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:19.189111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71071a-fb96-4ca0-a75d-340c2837aa00 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:19.198660 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3517/7071] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:19 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:19.269437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999bc66-9a15-4e29-8a63-794209c57223 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:19.332655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999bc66-9a15-4e29-8a63-794209c57223 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:19.337334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1513088-05e3-4772-8f02-40928542aea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:19.338221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1513088-05e3-4772-8f02-40928542aea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:19.338503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1513088-05e3-4772-8f02-40928542aea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:19.338784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1513088-05e3-4772-8f02-40928542aea5 admin admin] PATH_INFO: `/v3/users/9c97521c689d4f3590f79ec803f28109` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:19.340100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1513088-05e3-4772-8f02-40928542aea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c97521c689d4f3590f79ec803f28109)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:19.342077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1513088-05e3-4772-8f02-40928542aea5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:19.344769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:19.395125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f1513088-05e3-4772-8f02-40928542aea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c97521c689d4f3590f79ec803f28109'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:19.404669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f1513088-05e3-4772-8f02-40928542aea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c97521c689d4f3590f79ec803f28109'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:19.405384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f1513088-05e3-4772-8f02-40928542aea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c97521c689d4f3590f79ec803f28109'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:19.406138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f1513088-05e3-4772-8f02-40928542aea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c97521c689d4f3590f79ec803f28109'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:19.413148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f1513088-05e3-4772-8f02-40928542aea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c97521c689d4f3590f79ec803f28109'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:19.430570 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3555/7072] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:19 2022] DELETE /identity/v3/users/9c97521c689d4f3590f79ec803f28109 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:19.435170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437f49e-ee35-45b8-a9fe-4c07de2b9cfe None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:19.435396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437f49e-ee35-45b8-a9fe-4c07de2b9cfe None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:19.435677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437f49e-ee35-45b8-a9fe-4c07de2b9cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:19.454623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6437f49e-ee35-45b8-a9fe-4c07de2b9cfe None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:19.455983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6437f49e-ee35-45b8-a9fe-4c07de2b9cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:19.508692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:19.533332 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3518/7073] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:19.545603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1513088-05e3-4772-8f02-40928542aea5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:19.547222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f1513088-05e3-4772-8f02-40928542aea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:19.629389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1513088-05e3-4772-8f02-40928542aea5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:19.632337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c723f-0862-4ea9-ba31-4705b8e3734a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:19.633591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c723f-0862-4ea9-ba31-4705b8e3734a service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:19.633946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c723f-0862-4ea9-ba31-4705b8e3734a service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:19.634421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c723f-0862-4ea9-ba31-4705b8e3734a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:19.648929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c723f-0862-4ea9-ba31-4705b8e3734a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:19.650515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c723f-0862-4ea9-ba31-4705b8e3734a service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:19.669951 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3556/7074] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:20.100266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437f49e-ee35-45b8-a9fe-4c07de2b9cfe None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:20.104463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6437f49e-ee35-45b8-a9fe-4c07de2b9cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:20.127892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437f49e-ee35-45b8-a9fe-4c07de2b9cfe None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:20.134639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd8aad-00d6-4d57-a3ad-d84bd87d52c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:20.135741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd8aad-00d6-4d57-a3ad-d84bd87d52c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:20.136029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd8aad-00d6-4d57-a3ad-d84bd87d52c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:20.136395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd8aad-00d6-4d57-a3ad-d84bd87d52c5 admin admin] PATH_INFO: `/v3/projects/cbc3b8a6410c4cde86770df3ecfeeb02` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:20.137892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd8aad-00d6-4d57-a3ad-d84bd87d52c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc3b8a6410c4cde86770df3ecfeeb02)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:20.140152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd8aad-00d6-4d57-a3ad-d84bd87d52c5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:20.203431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-95bd8aad-00d6-4d57-a3ad-d84bd87d52c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc3b8a6410c4cde86770df3ecfeeb02', 'request_id': 'req-95bd8aad-00d6-4d57-a3ad-d84bd87d52c5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:20.210572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-95bd8aad-00d6-4d57-a3ad-d84bd87d52c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc3b8a6410c4cde86770df3ecfeeb02', 'request_id': 'req-95bd8aad-00d6-4d57-a3ad-d84bd87d52c5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:20.218230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-95bd8aad-00d6-4d57-a3ad-d84bd87d52c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc3b8a6410c4cde86770df3ecfeeb02', 'request_id': 'req-95bd8aad-00d6-4d57-a3ad-d84bd87d52c5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:20.237039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-95bd8aad-00d6-4d57-a3ad-d84bd87d52c5 admin admin] The token cache is being invalidate because project cbc3b8a6410c4cde86770df3ecfeeb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:20.237364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-95bd8aad-00d6-4d57-a3ad-d84bd87d52c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:20.238302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-95bd8aad-00d6-4d57-a3ad-d84bd87d52c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:20.242827 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3519/7075] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:20 2022] DELETE /identity/v3/projects/cbc3b8a6410c4cde86770df3ecfeeb02 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:20.244153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c723f-0862-4ea9-ba31-4705b8e3734a service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:20.260674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c723f-0862-4ea9-ba31-4705b8e3734a service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:20.352403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0df8c-4903-42e4-9cbc-600e80119723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:20.353434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0df8c-4903-42e4-9cbc-600e80119723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:20.353786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0df8c-4903-42e4-9cbc-600e80119723 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:20.355738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0df8c-4903-42e4-9cbc-600e80119723 admin admin] PATH_INFO: `/v3/users/820e85fa6e164559ab3c92131d3cb218` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:20.357601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0df8c-4903-42e4-9cbc-600e80119723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=820e85fa6e164559ab3c92131d3cb218)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:20.359841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0df8c-4903-42e4-9cbc-600e80119723 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:20.400715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:20.429720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d8a0df8c-4903-42e4-9cbc-600e80119723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '820e85fa6e164559ab3c92131d3cb218'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:20.439590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d8a0df8c-4903-42e4-9cbc-600e80119723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '820e85fa6e164559ab3c92131d3cb218'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:20.440930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d8a0df8c-4903-42e4-9cbc-600e80119723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '820e85fa6e164559ab3c92131d3cb218'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:20.441548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d8a0df8c-4903-42e4-9cbc-600e80119723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '820e85fa6e164559ab3c92131d3cb218'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:20.450222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d8a0df8c-4903-42e4-9cbc-600e80119723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '820e85fa6e164559ab3c92131d3cb218'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:20.476835 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3557/7076] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:20 2022] DELETE /identity/v3/users/820e85fa6e164559ab3c92131d3cb218 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:20.990265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd8aad-00d6-4d57-a3ad-d84bd87d52c5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:20.991986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-95bd8aad-00d6-4d57-a3ad-d84bd87d52c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:21.011543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd8aad-00d6-4d57-a3ad-d84bd87d52c5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:21.101033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa093cf4-a4ed-4532-bf4f-5a4aad4a8331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:21.102181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa093cf4-a4ed-4532-bf4f-5a4aad4a8331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:21.102620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa093cf4-a4ed-4532-bf4f-5a4aad4a8331 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:21.102896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa093cf4-a4ed-4532-bf4f-5a4aad4a8331 admin admin] PATH_INFO: `/v3/projects/988cd80aa94a455b8881e8c241f50d41` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:21.104160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa093cf4-a4ed-4532-bf4f-5a4aad4a8331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=988cd80aa94a455b8881e8c241f50d41)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:21.106874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa093cf4-a4ed-4532-bf4f-5a4aad4a8331 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:21.156464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa093cf4-a4ed-4532-bf4f-5a4aad4a8331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '988cd80aa94a455b8881e8c241f50d41', 'request_id': 'req-fa093cf4-a4ed-4532-bf4f-5a4aad4a8331'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:21.164218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa093cf4-a4ed-4532-bf4f-5a4aad4a8331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '988cd80aa94a455b8881e8c241f50d41', 'request_id': 'req-fa093cf4-a4ed-4532-bf4f-5a4aad4a8331'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:21.169875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa093cf4-a4ed-4532-bf4f-5a4aad4a8331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '988cd80aa94a455b8881e8c241f50d41', 'request_id': 'req-fa093cf4-a4ed-4532-bf4f-5a4aad4a8331'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:21.179825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:21.184174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa093cf4-a4ed-4532-bf4f-5a4aad4a8331 admin admin] The token cache is being invalidate because project 988cd80aa94a455b8881e8c241f50d41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:21.184587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa093cf4-a4ed-4532-bf4f-5a4aad4a8331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:21.185751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fa093cf4-a4ed-4532-bf4f-5a4aad4a8331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:21.187678 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3520/7077] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:20 2022] DELETE /identity/v3/projects/988cd80aa94a455b8881e8c241f50d41 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:21.192687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4feeaf9-4c29-4cec-b1b5-d638288b52a4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:21.192978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4feeaf9-4c29-4cec-b1b5-d638288b52a4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:21.193274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4feeaf9-4c29-4cec-b1b5-d638288b52a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:21.211030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d4feeaf9-4c29-4cec-b1b5-d638288b52a4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:21.212288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d4feeaf9-4c29-4cec-b1b5-d638288b52a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:21.280160 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3558/7078] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:21.287685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4f424-740c-478c-bf52-8153330f652a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:21.287994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4f424-740c-478c-bf52-8153330f652a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:21.288312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4f424-740c-478c-bf52-8153330f652a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:21.308454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f6e4f424-740c-478c-bf52-8153330f652a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:21.309719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f6e4f424-740c-478c-bf52-8153330f652a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:21.318360 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3521/7079] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:21.322782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4feeaf9-4c29-4cec-b1b5-d638288b52a4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:21.333203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4feeaf9-4c29-4cec-b1b5-d638288b52a4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:21.339056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba03c97-9608-4c52-9cef-492a5d785ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:21.339725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba03c97-9608-4c52-9cef-492a5d785ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:21.340009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba03c97-9608-4c52-9cef-492a5d785ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:21.340319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba03c97-9608-4c52-9cef-492a5d785ef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:21.341050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba03c97-9608-4c52-9cef-492a5d785ef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:21.341361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba03c97-9608-4c52-9cef-492a5d785ef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:21.343361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba03c97-9608-4c52-9cef-492a5d785ef1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:21.359235 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3559/7080] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:21.360578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4f424-740c-478c-bf52-8153330f652a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:21.373455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4f424-740c-478c-bf52-8153330f652a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:21.379130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550ba5e-c39a-490c-9c0d-5637b7ec6776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:21.379806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550ba5e-c39a-490c-9c0d-5637b7ec6776 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:21.380084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550ba5e-c39a-490c-9c0d-5637b7ec6776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:21.380392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550ba5e-c39a-490c-9c0d-5637b7ec6776 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:21.381134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550ba5e-c39a-490c-9c0d-5637b7ec6776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:21.383079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550ba5e-c39a-490c-9c0d-5637b7ec6776 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:21.413947 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3522/7081] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:21 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:21.415155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba03c97-9608-4c52-9cef-492a5d785ef1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:21.426045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba03c97-9608-4c52-9cef-492a5d785ef1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:21.487281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8919ce-27bb-451a-aed3-ba8d8694cd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:21.487962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8919ce-27bb-451a-aed3-ba8d8694cd38 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:21.488317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8919ce-27bb-451a-aed3-ba8d8694cd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:21.488719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8919ce-27bb-451a-aed3-ba8d8694cd38 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:21.489276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8919ce-27bb-451a-aed3-ba8d8694cd38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:21.491199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8919ce-27bb-451a-aed3-ba8d8694cd38 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:21.514224 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3560/7082] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:21 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:21.515460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550ba5e-c39a-490c-9c0d-5637b7ec6776 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:21.527492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550ba5e-c39a-490c-9c0d-5637b7ec6776 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:21.532894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbe170-e0a6-4a6d-9f97-8af8cc268aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:21.533509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbe170-e0a6-4a6d-9f97-8af8cc268aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:21.533846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbe170-e0a6-4a6d-9f97-8af8cc268aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:21.534126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbe170-e0a6-4a6d-9f97-8af8cc268aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:21.534856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbe170-e0a6-4a6d-9f97-8af8cc268aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:21.536481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbe170-e0a6-4a6d-9f97-8af8cc268aa5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:21.562409 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3523/7083] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:21.567076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8919ce-27bb-451a-aed3-ba8d8694cd38 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:21.578677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8919ce-27bb-451a-aed3-ba8d8694cd38 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:21.587051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe33b6-7c87-46a8-8f4d-a6286e3189fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:21.587747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe33b6-7c87-46a8-8f4d-a6286e3189fc admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:21.588028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe33b6-7c87-46a8-8f4d-a6286e3189fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:21.588336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe33b6-7c87-46a8-8f4d-a6286e3189fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:21.589060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe33b6-7c87-46a8-8f4d-a6286e3189fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:21.590811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe33b6-7c87-46a8-8f4d-a6286e3189fc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:21.607050 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3561/7084] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:21.612305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbe170-e0a6-4a6d-9f97-8af8cc268aa5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:21.625458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbe170-e0a6-4a6d-9f97-8af8cc268aa5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:21.630783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be84c8-50ca-4bdf-9fb5-13ab25ce0f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:21.631709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be84c8-50ca-4bdf-9fb5-13ab25ce0f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:21.631997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be84c8-50ca-4bdf-9fb5-13ab25ce0f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:21.632315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be84c8-50ca-4bdf-9fb5-13ab25ce0f7e admin admin] PATH_INFO: `/v3/projects/96dfb3c467414da9b02c75aed9dd0e8d/users/fb61b9111ebb46379b3ffa977c1a1954/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:21.651993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be84c8-50ca-4bdf-9fb5-13ab25ce0f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=96dfb3c467414da9b02c75aed9dd0e8d, user_id=fb61b9111ebb46379b3ffa977c1a1954, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:21.654761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be84c8-50ca-4bdf-9fb5-13ab25ce0f7e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:21.671846 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3524/7085] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:21 2022] PUT /identity/v3/projects/96dfb3c467414da9b02c75aed9dd0e8d/users/fb61b9111ebb46379b3ffa977c1a1954/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:21.684080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793081f-ad03-4399-8c1f-e59ade724e3a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:21.684441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793081f-ad03-4399-8c1f-e59ade724e3a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:21.684718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793081f-ad03-4399-8c1f-e59ade724e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:21.705507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:21.718822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7793081f-ad03-4399-8c1f-e59ade724e3a None None] MFA Rules not processed for user `fb61b9111ebb46379b3ffa977c1a1954`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:21.720238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7793081f-ad03-4399-8c1f-e59ade724e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:21.794144 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3562/7086] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:21.795265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be84c8-50ca-4bdf-9fb5-13ab25ce0f7e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:21.864076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be84c8-50ca-4bdf-9fb5-13ab25ce0f7e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:21.871301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63afb91-a732-4719-9199-2c281bdfd9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:21.872008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63afb91-a732-4719-9199-2c281bdfd9ee admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:21.872310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63afb91-a732-4719-9199-2c281bdfd9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:21.872588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63afb91-a732-4719-9199-2c281bdfd9ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:21.873297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63afb91-a732-4719-9199-2c281bdfd9ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:21.875251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63afb91-a732-4719-9199-2c281bdfd9ee admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:21.913513 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3525/7087] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:21 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:21.917789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793081f-ad03-4399-8c1f-e59ade724e3a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:21.935393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793081f-ad03-4399-8c1f-e59ade724e3a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:22.004671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d90dc4-230e-452e-84e2-1d9b6a3b5919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:22.005364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d90dc4-230e-452e-84e2-1d9b6a3b5919 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:22.005647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d90dc4-230e-452e-84e2-1d9b6a3b5919 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:22.005927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d90dc4-230e-452e-84e2-1d9b6a3b5919 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:22.006760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d90dc4-230e-452e-84e2-1d9b6a3b5919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:22.008731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d90dc4-230e-452e-84e2-1d9b6a3b5919 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:22.036844 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3563/7088] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:21 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:22.038204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63afb91-a732-4719-9199-2c281bdfd9ee admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:22.049347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63afb91-a732-4719-9199-2c281bdfd9ee admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:22.054556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f66ab2-ea34-4893-8238-15e0a9bb843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:22.055448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f66ab2-ea34-4893-8238-15e0a9bb843a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:22.055813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f66ab2-ea34-4893-8238-15e0a9bb843a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:22.056427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f66ab2-ea34-4893-8238-15e0a9bb843a admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:22.057152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f66ab2-ea34-4893-8238-15e0a9bb843a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:22.059479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f66ab2-ea34-4893-8238-15e0a9bb843a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:22.073781 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3526/7089] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:22.075012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d90dc4-230e-452e-84e2-1d9b6a3b5919 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:22.097338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d90dc4-230e-452e-84e2-1d9b6a3b5919 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:22.102457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc304e0-b62d-4ae4-bae9-591cbc00e102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:22.103398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc304e0-b62d-4ae4-bae9-591cbc00e102 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:22.103678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc304e0-b62d-4ae4-bae9-591cbc00e102 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:22.103963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc304e0-b62d-4ae4-bae9-591cbc00e102 admin admin] PATH_INFO: `/v3/projects/b726bd751f9d45fbb217904038be9423/users/df3452ef1bbd47e6bcffe31b3d185702/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:22.121169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc304e0-b62d-4ae4-bae9-591cbc00e102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b726bd751f9d45fbb217904038be9423, user_id=df3452ef1bbd47e6bcffe31b3d185702, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:22.124323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc304e0-b62d-4ae4-bae9-591cbc00e102 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:22.139721 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3564/7090] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:22 2022] PUT /identity/v3/projects/b726bd751f9d45fbb217904038be9423/users/df3452ef1bbd47e6bcffe31b3d185702/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:22.143936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f66ab2-ea34-4893-8238-15e0a9bb843a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:22.155030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f66ab2-ea34-4893-8238-15e0a9bb843a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:22.225564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085293a-42c1-4940-afc2-4b421f743547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:22.226231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085293a-42c1-4940-afc2-4b421f743547 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:22.226629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085293a-42c1-4940-afc2-4b421f743547 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:22.226971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085293a-42c1-4940-afc2-4b421f743547 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:22.227796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085293a-42c1-4940-afc2-4b421f743547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:22.229494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085293a-42c1-4940-afc2-4b421f743547 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:22.242830 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3527/7091] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:22.246614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc304e0-b62d-4ae4-bae9-591cbc00e102 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:22.259571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc304e0-b62d-4ae4-bae9-591cbc00e102 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:22.271935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8938d4-05b6-4bda-aaf8-967fdd1dffb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:22.273130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8938d4-05b6-4bda-aaf8-967fdd1dffb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:22.273495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8938d4-05b6-4bda-aaf8-967fdd1dffb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:22.273892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8938d4-05b6-4bda-aaf8-967fdd1dffb4 admin admin] PATH_INFO: `/v3/projects/b726bd751f9d45fbb217904038be9423/users/df3452ef1bbd47e6bcffe31b3d185702/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:22.276926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8938d4-05b6-4bda-aaf8-967fdd1dffb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b726bd751f9d45fbb217904038be9423, user_id=df3452ef1bbd47e6bcffe31b3d185702, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:22.281974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8938d4-05b6-4bda-aaf8-967fdd1dffb4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:22.302186 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3565/7092] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:22 2022] PUT /identity/v3/projects/b726bd751f9d45fbb217904038be9423/users/df3452ef1bbd47e6bcffe31b3d185702/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:22.312820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344bae9-4ba2-4f3b-a64a-252536f83b44 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:22.313106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344bae9-4ba2-4f3b-a64a-252536f83b44 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:22.313381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344bae9-4ba2-4f3b-a64a-252536f83b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:22.326719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:22.344777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f344bae9-4ba2-4f3b-a64a-252536f83b44 None None] MFA Rules not processed for user `df3452ef1bbd47e6bcffe31b3d185702`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:22.346475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f344bae9-4ba2-4f3b-a64a-252536f83b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:22.429051 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3528/7093] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:22 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:22.440861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8938d4-05b6-4bda-aaf8-967fdd1dffb4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:22.442673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6b8938d4-05b6-4bda-aaf8-967fdd1dffb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:22.502210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8938d4-05b6-4bda-aaf8-967fdd1dffb4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:22.505899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fcd6b-b9fd-4dbc-9593-eb84a644748b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:22.506551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fcd6b-b9fd-4dbc-9593-eb84a644748b service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:22.506829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fcd6b-b9fd-4dbc-9593-eb84a644748b service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:22.507102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fcd6b-b9fd-4dbc-9593-eb84a644748b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:22.513205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:22.517257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fcd6b-b9fd-4dbc-9593-eb84a644748b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:22.519435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fcd6b-b9fd-4dbc-9593-eb84a644748b service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:22.530293 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3566/7094] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:22 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:22.607071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344bae9-4ba2-4f3b-a64a-252536f83b44 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:22.625060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344bae9-4ba2-4f3b-a64a-252536f83b44 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:22.633424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c540a-e659-456b-9332-0614bfb23058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:22.634764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c540a-e659-456b-9332-0614bfb23058 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:22.635058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c540a-e659-456b-9332-0614bfb23058 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:22.635464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c540a-e659-456b-9332-0614bfb23058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:22.750425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c540a-e659-456b-9332-0614bfb23058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:22.751818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c540a-e659-456b-9332-0614bfb23058 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:22.762191 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3529/7095] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:25.864997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fcd6b-b9fd-4dbc-9593-eb84a644748b service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:25.866933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b77fcd6b-b9fd-4dbc-9593-eb84a644748b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:25.934273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fcd6b-b9fd-4dbc-9593-eb84a644748b service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:25.938788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36864b-62ca-4670-aca4-2fb1fe838242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:25.939669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36864b-62ca-4670-aca4-2fb1fe838242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:25.940004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36864b-62ca-4670-aca4-2fb1fe838242 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:25.940319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36864b-62ca-4670-aca4-2fb1fe838242 admin admin] PATH_INFO: `/v3/users/11e7ee15fc334e308dda2a48f2344788` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:25.941553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36864b-62ca-4670-aca4-2fb1fe838242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e7ee15fc334e308dda2a48f2344788)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:25.943489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36864b-62ca-4670-aca4-2fb1fe838242 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:25.993436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1e36864b-62ca-4670-aca4-2fb1fe838242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e7ee15fc334e308dda2a48f2344788'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:26.002115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1e36864b-62ca-4670-aca4-2fb1fe838242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e7ee15fc334e308dda2a48f2344788'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:26.002728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1e36864b-62ca-4670-aca4-2fb1fe838242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e7ee15fc334e308dda2a48f2344788'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:26.003324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1e36864b-62ca-4670-aca4-2fb1fe838242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e7ee15fc334e308dda2a48f2344788'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:26.010224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1e36864b-62ca-4670-aca4-2fb1fe838242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e7ee15fc334e308dda2a48f2344788'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:26.028407 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3567/7096] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:25 2022] DELETE /identity/v3/users/11e7ee15fc334e308dda2a48f2344788 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:26.033403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e5179-0489-4905-b659-a4350e323324 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:26.033866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e5179-0489-4905-b659-a4350e323324 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:26.033866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e5179-0489-4905-b659-a4350e323324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:26.051898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3f7e5179-0489-4905-b659-a4350e323324 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:26.053212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3f7e5179-0489-4905-b659-a4350e323324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:26.118191 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3530/7097] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:26.129752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36864b-62ca-4670-aca4-2fb1fe838242 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:26.131585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1e36864b-62ca-4670-aca4-2fb1fe838242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:26.196710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36864b-62ca-4670-aca4-2fb1fe838242 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:26.200973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf71652-10c0-4018-b9da-c88c163db39c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:26.201625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf71652-10c0-4018-b9da-c88c163db39c service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:26.201904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf71652-10c0-4018-b9da-c88c163db39c service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:26.202285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf71652-10c0-4018-b9da-c88c163db39c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:26.212771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf71652-10c0-4018-b9da-c88c163db39c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:26.214242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf71652-10c0-4018-b9da-c88c163db39c service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:26.224124 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3568/7098] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:26.432065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e5179-0489-4905-b659-a4350e323324 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:26.433618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3f7e5179-0489-4905-b659-a4350e323324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:26.446716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e5179-0489-4905-b659-a4350e323324 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:26.452668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30169299-3d89-4845-92b2-d528a4c4f60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:26.453559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30169299-3d89-4845-92b2-d528a4c4f60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:26.453836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30169299-3d89-4845-92b2-d528a4c4f60d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:26.454097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30169299-3d89-4845-92b2-d528a4c4f60d admin admin] PATH_INFO: `/v3/projects/155a3f07a35b4ed9ad8c4b9c9c89606d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:26.455391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30169299-3d89-4845-92b2-d528a4c4f60d admin admin] RBAC: Authorizing `identity:delete_project(project_id=155a3f07a35b4ed9ad8c4b9c9c89606d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:26.457412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30169299-3d89-4845-92b2-d528a4c4f60d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:26.488997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:26.508430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-30169299-3d89-4845-92b2-d528a4c4f60d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '155a3f07a35b4ed9ad8c4b9c9c89606d', 'request_id': 'req-30169299-3d89-4845-92b2-d528a4c4f60d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:26.514511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-30169299-3d89-4845-92b2-d528a4c4f60d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '155a3f07a35b4ed9ad8c4b9c9c89606d', 'request_id': 'req-30169299-3d89-4845-92b2-d528a4c4f60d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:26.520584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-30169299-3d89-4845-92b2-d528a4c4f60d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '155a3f07a35b4ed9ad8c4b9c9c89606d', 'request_id': 'req-30169299-3d89-4845-92b2-d528a4c4f60d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:26.534715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-30169299-3d89-4845-92b2-d528a4c4f60d admin admin] The token cache is being invalidate because project 155a3f07a35b4ed9ad8c4b9c9c89606d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:26.535026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-30169299-3d89-4845-92b2-d528a4c4f60d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:26.535697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-30169299-3d89-4845-92b2-d528a4c4f60d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:26.537335 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3531/7099] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:26 2022] DELETE /identity/v3/projects/155a3f07a35b4ed9ad8c4b9c9c89606d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:26.542425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604dcf9-1fc6-4b19-bbe5-2b439acde112 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:26.542717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604dcf9-1fc6-4b19-bbe5-2b439acde112 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:26.542999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604dcf9-1fc6-4b19-bbe5-2b439acde112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:26.561391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c604dcf9-1fc6-4b19-bbe5-2b439acde112 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:26.562741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c604dcf9-1fc6-4b19-bbe5-2b439acde112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:26.572306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:26.627866 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3569/7100] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:26.637251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fad14-134e-4d7b-9383-99efc2a40f27 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:26.637535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fad14-134e-4d7b-9383-99efc2a40f27 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:26.637813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fad14-134e-4d7b-9383-99efc2a40f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:26.656956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-179fad14-134e-4d7b-9383-99efc2a40f27 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:26.658148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-179fad14-134e-4d7b-9383-99efc2a40f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:26.666918 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3532/7101] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:26.671334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604dcf9-1fc6-4b19-bbe5-2b439acde112 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:26.682275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604dcf9-1fc6-4b19-bbe5-2b439acde112 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:26.688395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5b22f-d5ee-447c-b084-c91b5686f476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:26.689059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5b22f-d5ee-447c-b084-c91b5686f476 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:26.689343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5b22f-d5ee-447c-b084-c91b5686f476 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:26.689620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5b22f-d5ee-447c-b084-c91b5686f476 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:26.690332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5b22f-d5ee-447c-b084-c91b5686f476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:26.690638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5b22f-d5ee-447c-b084-c91b5686f476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:26.692312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5b22f-d5ee-447c-b084-c91b5686f476 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:26.704700 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3570/7102] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:26.709306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fad14-134e-4d7b-9383-99efc2a40f27 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:26.719142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fad14-134e-4d7b-9383-99efc2a40f27 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:26.725009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde990a4-664b-42fd-aecd-37a6b94b5f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:26.725759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde990a4-664b-42fd-aecd-37a6b94b5f3b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:26.726046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde990a4-664b-42fd-aecd-37a6b94b5f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:26.726308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde990a4-664b-42fd-aecd-37a6b94b5f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:26.727001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde990a4-664b-42fd-aecd-37a6b94b5f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:26.728958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde990a4-664b-42fd-aecd-37a6b94b5f3b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:26.764402 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3533/7103] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:26 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:26.766205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5b22f-d5ee-447c-b084-c91b5686f476 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:26.781906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5b22f-d5ee-447c-b084-c91b5686f476 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:26.840908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a6dae-0da8-4c65-9450-959d89fb0d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:26.841586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a6dae-0da8-4c65-9450-959d89fb0d00 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:26.841871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a6dae-0da8-4c65-9450-959d89fb0d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:26.842138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a6dae-0da8-4c65-9450-959d89fb0d00 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:26.842855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a6dae-0da8-4c65-9450-959d89fb0d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:26.844850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a6dae-0da8-4c65-9450-959d89fb0d00 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:26.866313 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3571/7104] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:26 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:26.870635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde990a4-664b-42fd-aecd-37a6b94b5f3b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:26.882843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde990a4-664b-42fd-aecd-37a6b94b5f3b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:26.888250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026f8eb-91fb-42f9-a249-03a21d1da8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:26.888932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026f8eb-91fb-42f9-a249-03a21d1da8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:26.889299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026f8eb-91fb-42f9-a249-03a21d1da8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:26.889654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026f8eb-91fb-42f9-a249-03a21d1da8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:26.890399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026f8eb-91fb-42f9-a249-03a21d1da8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:26.892222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026f8eb-91fb-42f9-a249-03a21d1da8c9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:26.904377 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3534/7105] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:26.914516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a6dae-0da8-4c65-9450-959d89fb0d00 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:26.932995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a6dae-0da8-4c65-9450-959d89fb0d00 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:26.937930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f6bf3-7cb3-486f-b80b-96b3d387f318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:26.938607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f6bf3-7cb3-486f-b80b-96b3d387f318 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:26.938888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f6bf3-7cb3-486f-b80b-96b3d387f318 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:26.939163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f6bf3-7cb3-486f-b80b-96b3d387f318 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:26.939883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f6bf3-7cb3-486f-b80b-96b3d387f318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:26.941528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f6bf3-7cb3-486f-b80b-96b3d387f318 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:26.952195 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3572/7106] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:26.956558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026f8eb-91fb-42f9-a249-03a21d1da8c9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:26.966943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026f8eb-91fb-42f9-a249-03a21d1da8c9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:26.971670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95725c-c2d6-4dd0-86d6-31f446306776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:26.972605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95725c-c2d6-4dd0-86d6-31f446306776 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:26.972920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95725c-c2d6-4dd0-86d6-31f446306776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:26.973225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95725c-c2d6-4dd0-86d6-31f446306776 admin admin] PATH_INFO: `/v3/projects/34562a1800454cffb8b2cb86f80afc3a/users/1a3e88213e0b4159a8da7d0aa50cf3ab/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:26.988646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95725c-c2d6-4dd0-86d6-31f446306776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34562a1800454cffb8b2cb86f80afc3a, user_id=1a3e88213e0b4159a8da7d0aa50cf3ab, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:26.991294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95725c-c2d6-4dd0-86d6-31f446306776 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:27.005180 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3535/7107] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:26 2022] PUT /identity/v3/projects/34562a1800454cffb8b2cb86f80afc3a/users/1a3e88213e0b4159a8da7d0aa50cf3ab/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:27.015679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a45d1-45b6-4a79-9f28-f7ed3a4bbf36 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:27.015966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a45d1-45b6-4a79-9f28-f7ed3a4bbf36 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:27.016287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a45d1-45b6-4a79-9f28-f7ed3a4bbf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:27.044748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-aa6a45d1-45b6-4a79-9f28-f7ed3a4bbf36 None None] MFA Rules not processed for user `1a3e88213e0b4159a8da7d0aa50cf3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:27.046092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-aa6a45d1-45b6-4a79-9f28-f7ed3a4bbf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:27.115002 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3573/7108] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:27.126847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95725c-c2d6-4dd0-86d6-31f446306776 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:27.128628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0d95725c-c2d6-4dd0-86d6-31f446306776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:27.193423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95725c-c2d6-4dd0-86d6-31f446306776 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:27.197920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e868ee-f684-4f66-b258-56dc9aac4cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:27.198572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e868ee-f684-4f66-b258-56dc9aac4cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:27.198849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e868ee-f684-4f66-b258-56dc9aac4cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:27.199122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e868ee-f684-4f66-b258-56dc9aac4cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:27.208330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e868ee-f684-4f66-b258-56dc9aac4cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:27.209805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e868ee-f684-4f66-b258-56dc9aac4cb7 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:27.218885 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3536/7109] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:27.350011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a45d1-45b6-4a79-9f28-f7ed3a4bbf36 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:27.351445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-aa6a45d1-45b6-4a79-9f28-f7ed3a4bbf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:27.364805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:27.425065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a45d1-45b6-4a79-9f28-f7ed3a4bbf36 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:27.430843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc267fe-f709-4a67-a6c8-2bc012b2fbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:27.431882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc267fe-f709-4a67-a6c8-2bc012b2fbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:27.432286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc267fe-f709-4a67-a6c8-2bc012b2fbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:27.432758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc267fe-f709-4a67-a6c8-2bc012b2fbeb admin admin] PATH_INFO: `/v3/users/fb61b9111ebb46379b3ffa977c1a1954` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:27.433998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc267fe-f709-4a67-a6c8-2bc012b2fbeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb61b9111ebb46379b3ffa977c1a1954)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:27.436162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc267fe-f709-4a67-a6c8-2bc012b2fbeb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:27.490673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ffc267fe-f709-4a67-a6c8-2bc012b2fbeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb61b9111ebb46379b3ffa977c1a1954'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:27.500336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ffc267fe-f709-4a67-a6c8-2bc012b2fbeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb61b9111ebb46379b3ffa977c1a1954'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:27.501033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ffc267fe-f709-4a67-a6c8-2bc012b2fbeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb61b9111ebb46379b3ffa977c1a1954'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:27.501734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ffc267fe-f709-4a67-a6c8-2bc012b2fbeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb61b9111ebb46379b3ffa977c1a1954'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:27.508925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ffc267fe-f709-4a67-a6c8-2bc012b2fbeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb61b9111ebb46379b3ffa977c1a1954'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:27.525767 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3574/7110] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:27 2022] DELETE /identity/v3/users/fb61b9111ebb46379b3ffa977c1a1954 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:27.530693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec586f1d-7584-46c9-aaed-11b2f1a88366 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:27.530987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec586f1d-7584-46c9-aaed-11b2f1a88366 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:27.531313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec586f1d-7584-46c9-aaed-11b2f1a88366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:27.548867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ec586f1d-7584-46c9-aaed-11b2f1a88366 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:27.550265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ec586f1d-7584-46c9-aaed-11b2f1a88366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:27.596029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc267fe-f709-4a67-a6c8-2bc012b2fbeb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:27.597569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ffc267fe-f709-4a67-a6c8-2bc012b2fbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:27.599841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:27.614240 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3537/7111] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:27.624322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec586f1d-7584-46c9-aaed-11b2f1a88366 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:27.626333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ec586f1d-7584-46c9-aaed-11b2f1a88366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:27.665989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc267fe-f709-4a67-a6c8-2bc012b2fbeb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:27.670768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de0854-6282-48d6-a3a6-fc415d59ede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:27.672124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de0854-6282-48d6-a3a6-fc415d59ede6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:27.672517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de0854-6282-48d6-a3a6-fc415d59ede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:27.672794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de0854-6282-48d6-a3a6-fc415d59ede6 admin admin] PATH_INFO: `/v3/users/1a3e88213e0b4159a8da7d0aa50cf3ab` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:27.674005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de0854-6282-48d6-a3a6-fc415d59ede6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3e88213e0b4159a8da7d0aa50cf3ab)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:27.675997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de0854-6282-48d6-a3a6-fc415d59ede6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:27.687249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec586f1d-7584-46c9-aaed-11b2f1a88366 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:27.690894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d2374-184a-4f3e-9c08-349353b142f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:27.691542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d2374-184a-4f3e-9c08-349353b142f9 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:27.691831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d2374-184a-4f3e-9c08-349353b142f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:27.692138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d2374-184a-4f3e-9c08-349353b142f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:27.702599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d2374-184a-4f3e-9c08-349353b142f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:27.704217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d2374-184a-4f3e-9c08-349353b142f9 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:27.712700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:27.715530 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3538/7112] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:27.726718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-71de0854-6282-48d6-a3a6-fc415d59ede6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3e88213e0b4159a8da7d0aa50cf3ab'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:27.735119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-71de0854-6282-48d6-a3a6-fc415d59ede6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3e88213e0b4159a8da7d0aa50cf3ab'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:27.735800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-71de0854-6282-48d6-a3a6-fc415d59ede6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3e88213e0b4159a8da7d0aa50cf3ab'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:27.736549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-71de0854-6282-48d6-a3a6-fc415d59ede6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3e88213e0b4159a8da7d0aa50cf3ab'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:27.744201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-71de0854-6282-48d6-a3a6-fc415d59ede6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3e88213e0b4159a8da7d0aa50cf3ab'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:27.764107 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3575/7113] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:27 2022] DELETE /identity/v3/users/1a3e88213e0b4159a8da7d0aa50cf3ab => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:27.769115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ac874-2731-4681-b074-e171054700aa None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:27.769404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ac874-2731-4681-b074-e171054700aa None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:27.769691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ac874-2731-4681-b074-e171054700aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:27.794512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1e0ac874-2731-4681-b074-e171054700aa None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:27.796132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1e0ac874-2731-4681-b074-e171054700aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:27.862213 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3539/7114] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:27.875375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de0854-6282-48d6-a3a6-fc415d59ede6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:27.876947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-71de0854-6282-48d6-a3a6-fc415d59ede6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:27.939672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de0854-6282-48d6-a3a6-fc415d59ede6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:27.943936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b38e62-de55-4816-bc08-c8fa83c7176f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:27.944683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b38e62-de55-4816-bc08-c8fa83c7176f service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:27.945037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b38e62-de55-4816-bc08-c8fa83c7176f service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:27.945379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b38e62-de55-4816-bc08-c8fa83c7176f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:27.956718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b38e62-de55-4816-bc08-c8fa83c7176f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:27.958317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b38e62-de55-4816-bc08-c8fa83c7176f service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:27.969988 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3576/7115] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:28.049023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ac874-2731-4681-b074-e171054700aa None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:28.050627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1e0ac874-2731-4681-b074-e171054700aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:28.064109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ac874-2731-4681-b074-e171054700aa None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:28.073827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567b1c8-2398-44f6-9ed1-24989c726b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:28.074854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567b1c8-2398-44f6-9ed1-24989c726b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:28.075145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567b1c8-2398-44f6-9ed1-24989c726b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:28.075425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567b1c8-2398-44f6-9ed1-24989c726b72 admin admin] PATH_INFO: `/v3/projects/96dfb3c467414da9b02c75aed9dd0e8d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:28.076886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567b1c8-2398-44f6-9ed1-24989c726b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96dfb3c467414da9b02c75aed9dd0e8d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:28.079180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567b1c8-2398-44f6-9ed1-24989c726b72 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:28.137921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7567b1c8-2398-44f6-9ed1-24989c726b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96dfb3c467414da9b02c75aed9dd0e8d', 'request_id': 'req-7567b1c8-2398-44f6-9ed1-24989c726b72'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.144637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7567b1c8-2398-44f6-9ed1-24989c726b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96dfb3c467414da9b02c75aed9dd0e8d', 'request_id': 'req-7567b1c8-2398-44f6-9ed1-24989c726b72'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.150720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7567b1c8-2398-44f6-9ed1-24989c726b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96dfb3c467414da9b02c75aed9dd0e8d', 'request_id': 'req-7567b1c8-2398-44f6-9ed1-24989c726b72'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.165200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7567b1c8-2398-44f6-9ed1-24989c726b72 admin admin] The token cache is being invalidate because project 96dfb3c467414da9b02c75aed9dd0e8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:28.165495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7567b1c8-2398-44f6-9ed1-24989c726b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.166150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7567b1c8-2398-44f6-9ed1-24989c726b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.167732 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3540/7116] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:28 2022] DELETE /identity/v3/projects/96dfb3c467414da9b02c75aed9dd0e8d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:28.172152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b38e62-de55-4816-bc08-c8fa83c7176f service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:28.183416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b38e62-de55-4816-bc08-c8fa83c7176f service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:28.242695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35918bc0-c5e0-42a9-aa9f-f47ddbb37689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:28.243587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35918bc0-c5e0-42a9-aa9f-f47ddbb37689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:28.243878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35918bc0-c5e0-42a9-aa9f-f47ddbb37689 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:28.244189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35918bc0-c5e0-42a9-aa9f-f47ddbb37689 admin admin] PATH_INFO: `/v3/users/df3452ef1bbd47e6bcffe31b3d185702` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:28.245409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35918bc0-c5e0-42a9-aa9f-f47ddbb37689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df3452ef1bbd47e6bcffe31b3d185702)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:28.247372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35918bc0-c5e0-42a9-aa9f-f47ddbb37689 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:28.295475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-35918bc0-c5e0-42a9-aa9f-f47ddbb37689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df3452ef1bbd47e6bcffe31b3d185702'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.303902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-35918bc0-c5e0-42a9-aa9f-f47ddbb37689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df3452ef1bbd47e6bcffe31b3d185702'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.304544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-35918bc0-c5e0-42a9-aa9f-f47ddbb37689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df3452ef1bbd47e6bcffe31b3d185702'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.305168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-35918bc0-c5e0-42a9-aa9f-f47ddbb37689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df3452ef1bbd47e6bcffe31b3d185702'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.309238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:28.309878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567b1c8-2398-44f6-9ed1-24989c726b72 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:28.311658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7567b1c8-2398-44f6-9ed1-24989c726b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:28.318494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-35918bc0-c5e0-42a9-aa9f-f47ddbb37689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df3452ef1bbd47e6bcffe31b3d185702'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.332298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567b1c8-2398-44f6-9ed1-24989c726b72 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:28.337808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7849b-6c2c-4765-9fce-39d862550fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:28.338743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7849b-6c2c-4765-9fce-39d862550fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:28.339016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7849b-6c2c-4765-9fce-39d862550fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:28.339290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7849b-6c2c-4765-9fce-39d862550fbd admin admin] PATH_INFO: `/v3/projects/34562a1800454cffb8b2cb86f80afc3a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:28.340902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7849b-6c2c-4765-9fce-39d862550fbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=34562a1800454cffb8b2cb86f80afc3a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:28.341584 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3577/7117] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:28 2022] DELETE /identity/v3/users/df3452ef1bbd47e6bcffe31b3d185702 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:28.345668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7849b-6c2c-4765-9fce-39d862550fbd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:28.362978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:28.397748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-68c7849b-6c2c-4765-9fce-39d862550fbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34562a1800454cffb8b2cb86f80afc3a', 'request_id': 'req-68c7849b-6c2c-4765-9fce-39d862550fbd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.405771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-68c7849b-6c2c-4765-9fce-39d862550fbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34562a1800454cffb8b2cb86f80afc3a', 'request_id': 'req-68c7849b-6c2c-4765-9fce-39d862550fbd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.412581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-68c7849b-6c2c-4765-9fce-39d862550fbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34562a1800454cffb8b2cb86f80afc3a', 'request_id': 'req-68c7849b-6c2c-4765-9fce-39d862550fbd'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.426177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-68c7849b-6c2c-4765-9fce-39d862550fbd admin admin] The token cache is being invalidate because project 34562a1800454cffb8b2cb86f80afc3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:28.426460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-68c7849b-6c2c-4765-9fce-39d862550fbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.427203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-68c7849b-6c2c-4765-9fce-39d862550fbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.429243 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3541/7118] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:28 2022] DELETE /identity/v3/projects/34562a1800454cffb8b2cb86f80afc3a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:28.434361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b955f-c043-4b2e-808c-0c00712d99ca None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:28.434651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b955f-c043-4b2e-808c-0c00712d99ca None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:28.434929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b955f-c043-4b2e-808c-0c00712d99ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:28.453879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b29b955f-c043-4b2e-808c-0c00712d99ca None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:28.455107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b29b955f-c043-4b2e-808c-0c00712d99ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:28.520692 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3578/7119] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:28.528977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1efffd-5fc6-472b-8987-b710bd9ff2ed None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:28.529267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1efffd-5fc6-472b-8987-b710bd9ff2ed None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:28.529547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1efffd-5fc6-472b-8987-b710bd9ff2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:28.550909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8e1efffd-5fc6-472b-8987-b710bd9ff2ed None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:28.552250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8e1efffd-5fc6-472b-8987-b710bd9ff2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:28.561109 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3542/7120] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:28.565498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b955f-c043-4b2e-808c-0c00712d99ca None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:28.575371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b955f-c043-4b2e-808c-0c00712d99ca None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:28.580199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965dbd1-deb5-47af-a493-c836140203d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:28.580872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965dbd1-deb5-47af-a493-c836140203d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:28.581154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965dbd1-deb5-47af-a493-c836140203d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:28.581429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965dbd1-deb5-47af-a493-c836140203d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:28.582158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965dbd1-deb5-47af-a493-c836140203d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:28.582467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965dbd1-deb5-47af-a493-c836140203d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:28.584116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965dbd1-deb5-47af-a493-c836140203d6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:28.596928 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3579/7121] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:28.601147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1efffd-5fc6-472b-8987-b710bd9ff2ed None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:28.612915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1efffd-5fc6-472b-8987-b710bd9ff2ed None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:28.622043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00375d-102b-4a1f-a3fc-78dc3a5b8c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:28.622759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00375d-102b-4a1f-a3fc-78dc3a5b8c40 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:28.623024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00375d-102b-4a1f-a3fc-78dc3a5b8c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:28.623302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00375d-102b-4a1f-a3fc-78dc3a5b8c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:28.624074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00375d-102b-4a1f-a3fc-78dc3a5b8c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:28.626694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00375d-102b-4a1f-a3fc-78dc3a5b8c40 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:28.654654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965dbd1-deb5-47af-a493-c836140203d6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:28.656702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f965dbd1-deb5-47af-a493-c836140203d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:28.658337 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3543/7122] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:28 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:28.662849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00375d-102b-4a1f-a3fc-78dc3a5b8c40 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:28.685188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965dbd1-deb5-47af-a493-c836140203d6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:28.728001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00375d-102b-4a1f-a3fc-78dc3a5b8c40 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:28.733051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b766c76-df84-466b-958c-21a066510bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:28.733762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b766c76-df84-466b-958c-21a066510bec admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:28.734046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b766c76-df84-466b-958c-21a066510bec admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:28.734321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b766c76-df84-466b-958c-21a066510bec admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:28.735004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b766c76-df84-466b-958c-21a066510bec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:28.736972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b766c76-df84-466b-958c-21a066510bec admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:28.746643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a9f4d-9d0a-47cc-be8b-6b9577c80def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:28.747536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a9f4d-9d0a-47cc-be8b-6b9577c80def admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:28.747849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a9f4d-9d0a-47cc-be8b-6b9577c80def admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:28.748212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a9f4d-9d0a-47cc-be8b-6b9577c80def admin admin] PATH_INFO: `/v3/projects/b726bd751f9d45fbb217904038be9423` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:28.750245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a9f4d-9d0a-47cc-be8b-6b9577c80def admin admin] RBAC: Authorizing `identity:delete_project(project_id=b726bd751f9d45fbb217904038be9423)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:28.752505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a9f4d-9d0a-47cc-be8b-6b9577c80def admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:28.758861 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3544/7123] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:28 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:28.763367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b766c76-df84-466b-958c-21a066510bec admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:28.773498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b766c76-df84-466b-958c-21a066510bec admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:28.778126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5003b-9d24-4dda-ae9c-587fa0cada80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:28.778767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5003b-9d24-4dda-ae9c-587fa0cada80 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:28.779051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5003b-9d24-4dda-ae9c-587fa0cada80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:28.779334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5003b-9d24-4dda-ae9c-587fa0cada80 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:28.780175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5003b-9d24-4dda-ae9c-587fa0cada80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:28.781773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5003b-9d24-4dda-ae9c-587fa0cada80 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:28.795356 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3545/7124] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:29:28.796845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5003b-9d24-4dda-ae9c-587fa0cada80 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:28.805858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-650a9f4d-9d0a-47cc-be8b-6b9577c80def admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b726bd751f9d45fbb217904038be9423', 'request_id': 'req-650a9f4d-9d0a-47cc-be8b-6b9577c80def'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.806836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5003b-9d24-4dda-ae9c-587fa0cada80 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:28.815351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-650a9f4d-9d0a-47cc-be8b-6b9577c80def admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b726bd751f9d45fbb217904038be9423', 'request_id': 'req-650a9f4d-9d0a-47cc-be8b-6b9577c80def'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.822027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-650a9f4d-9d0a-47cc-be8b-6b9577c80def admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b726bd751f9d45fbb217904038be9423', 'request_id': 'req-650a9f4d-9d0a-47cc-be8b-6b9577c80def'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.823380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:28.834717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-650a9f4d-9d0a-47cc-be8b-6b9577c80def admin admin] The token cache is being invalidate because project b726bd751f9d45fbb217904038be9423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:28.835112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-650a9f4d-9d0a-47cc-be8b-6b9577c80def admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.836069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-650a9f4d-9d0a-47cc-be8b-6b9577c80def admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:28.837882 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3580/7125] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:28 2022] DELETE /identity/v3/projects/b726bd751f9d45fbb217904038be9423 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:28.842533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc003c1-306f-4f57-8909-2ebbb4a373bd None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:28.842900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc003c1-306f-4f57-8909-2ebbb4a373bd None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:28.843277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc003c1-306f-4f57-8909-2ebbb4a373bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:28.857472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:28.861046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ebc003c1-306f-4f57-8909-2ebbb4a373bd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:28.862277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ebc003c1-306f-4f57-8909-2ebbb4a373bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:28.868188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022f366-59a6-4069-ad6e-06e87fbb1702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:28.868899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022f366-59a6-4069-ad6e-06e87fbb1702 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:28.869193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022f366-59a6-4069-ad6e-06e87fbb1702 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:28.869665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022f366-59a6-4069-ad6e-06e87fbb1702 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:28.870487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022f366-59a6-4069-ad6e-06e87fbb1702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:28.872423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022f366-59a6-4069-ad6e-06e87fbb1702 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:28.886455 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3546/7126] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:29:28.887481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022f366-59a6-4069-ad6e-06e87fbb1702 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:28.889194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7022f366-59a6-4069-ad6e-06e87fbb1702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:28.901218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022f366-59a6-4069-ad6e-06e87fbb1702 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:28.905874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633357c-9ec4-4e6f-a796-d9d80b6da297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:28.906756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633357c-9ec4-4e6f-a796-d9d80b6da297 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:28.907037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633357c-9ec4-4e6f-a796-d9d80b6da297 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:28.907322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633357c-9ec4-4e6f-a796-d9d80b6da297 admin admin] PATH_INFO: `/v3/projects/cedb3b250a544c75a27099d69657307d/users/e21ad8e9f3fb41ee8960c0cdcaa8e10b/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:28.922130 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3581/7127] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:28.922664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633357c-9ec4-4e6f-a796-d9d80b6da297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cedb3b250a544c75a27099d69657307d, user_id=e21ad8e9f3fb41ee8960c0cdcaa8e10b, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:28.925540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633357c-9ec4-4e6f-a796-d9d80b6da297 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:28.930192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e0854-725c-4eaf-86d6-700d1a808bd1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:28.930484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e0854-725c-4eaf-86d6-700d1a808bd1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:28.930799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e0854-725c-4eaf-86d6-700d1a808bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:28.941166 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3547/7128] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:28 2022] PUT /identity/v3/projects/cedb3b250a544c75a27099d69657307d/users/e21ad8e9f3fb41ee8960c0cdcaa8e10b/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:28.949277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0a2e0854-725c-4eaf-86d6-700d1a808bd1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:28.950498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0a2e0854-725c-4eaf-86d6-700d1a808bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:28.952427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737105db-010a-4357-9156-ffe7dd951c06 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:28.952735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737105db-010a-4357-9156-ffe7dd951c06 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:28.953041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737105db-010a-4357-9156-ffe7dd951c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:28.978700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-737105db-010a-4357-9156-ffe7dd951c06 None None] MFA Rules not processed for user `e21ad8e9f3fb41ee8960c0cdcaa8e10b`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:28.979820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-737105db-010a-4357-9156-ffe7dd951c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:29.015515 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3582/7129] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:29.019931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e0854-725c-4eaf-86d6-700d1a808bd1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:29.030278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e0854-725c-4eaf-86d6-700d1a808bd1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:29.036923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429753c-f25b-4968-b80e-6aec56b117a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:29.037751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429753c-f25b-4968-b80e-6aec56b117a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.038070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429753c-f25b-4968-b80e-6aec56b117a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.038282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429753c-f25b-4968-b80e-6aec56b117a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.039032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429753c-f25b-4968-b80e-6aec56b117a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:29.039443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429753c-f25b-4968-b80e-6aec56b117a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:29.041225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429753c-f25b-4968-b80e-6aec56b117a5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:29.050309 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3548/7130] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:29.053789 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3583/7131] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:29.058127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737105db-010a-4357-9156-ffe7dd951c06 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:29.067492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429753c-f25b-4968-b80e-6aec56b117a5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:29.069448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c429753c-f25b-4968-b80e-6aec56b117a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:29.072146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737105db-010a-4357-9156-ffe7dd951c06 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:29.082621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221e7c2-bc04-407c-b648-643e66a4c179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:29.083296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221e7c2-bc04-407c-b648-643e66a4c179 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.083580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221e7c2-bc04-407c-b648-643e66a4c179 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.083853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221e7c2-bc04-407c-b648-643e66a4c179 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.084606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221e7c2-bc04-407c-b648-643e66a4c179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:29.086518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221e7c2-bc04-407c-b648-643e66a4c179 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:29.113907 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3549/7132] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:29 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:29.118500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221e7c2-bc04-407c-b648-643e66a4c179 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:29.134282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429753c-f25b-4968-b80e-6aec56b117a5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:29.164364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:29.182383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221e7c2-bc04-407c-b648-643e66a4c179 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:29.187264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d587c-b34c-4af6-b236-17c78e7d61c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:29.187935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d587c-b34c-4af6-b236-17c78e7d61c0 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.188248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d587c-b34c-4af6-b236-17c78e7d61c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.188531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d587c-b34c-4af6-b236-17c78e7d61c0 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.189246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d587c-b34c-4af6-b236-17c78e7d61c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:29.191178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d587c-b34c-4af6-b236-17c78e7d61c0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:29.193476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe184c5-90cf-465d-b789-a71de0eb9862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:29.194144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe184c5-90cf-465d-b789-a71de0eb9862 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.194425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe184c5-90cf-465d-b789-a71de0eb9862 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.194708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe184c5-90cf-465d-b789-a71de0eb9862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.216422 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3550/7133] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:29 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:29.217438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d587c-b34c-4af6-b236-17c78e7d61c0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:29.226909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d587c-b34c-4af6-b236-17c78e7d61c0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:29.232289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbf5e4-065c-4476-8023-64ac33326a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:29.232959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbf5e4-065c-4476-8023-64ac33326a1e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.233334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbf5e4-065c-4476-8023-64ac33326a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.233647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbf5e4-065c-4476-8023-64ac33326a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.234377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbf5e4-065c-4476-8023-64ac33326a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:29.236217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbf5e4-065c-4476-8023-64ac33326a1e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:29.246628 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3551/7134] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:29.250630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbf5e4-065c-4476-8023-64ac33326a1e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:29.257018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe184c5-90cf-465d-b789-a71de0eb9862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:29.258374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe184c5-90cf-465d-b789-a71de0eb9862 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:29.260427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbf5e4-065c-4476-8023-64ac33326a1e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:29.265383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e9bd3-6eeb-429a-bc80-651509a9f9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:29.266041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e9bd3-6eeb-429a-bc80-651509a9f9ee admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.266325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e9bd3-6eeb-429a-bc80-651509a9f9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.266628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e9bd3-6eeb-429a-bc80-651509a9f9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.267318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e9bd3-6eeb-429a-bc80-651509a9f9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:29.267446 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3584/7135] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:29.269623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e9bd3-6eeb-429a-bc80-651509a9f9ee admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:29.275107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:29.281488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe184c5-90cf-465d-b789-a71de0eb9862 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:29.283464 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3552/7136] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:29:29.286128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e9bd3-6eeb-429a-bc80-651509a9f9ee admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:29.292787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe184c5-90cf-465d-b789-a71de0eb9862 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:29.298442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd445a2f-ef7d-4edb-a1a3-c13f1c4e5a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:29.298594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e9bd3-6eeb-429a-bc80-651509a9f9ee admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:29.298704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd445a2f-ef7d-4edb-a1a3-c13f1c4e5a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.298995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd445a2f-ef7d-4edb-a1a3-c13f1c4e5a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.299111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd445a2f-ef7d-4edb-a1a3-c13f1c4e5a2d admin admin] PATH_INFO: `/v3/users/e21ad8e9f3fb41ee8960c0cdcaa8e10b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.300398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd445a2f-ef7d-4edb-a1a3-c13f1c4e5a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21ad8e9f3fb41ee8960c0cdcaa8e10b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:29.302338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd445a2f-ef7d-4edb-a1a3-c13f1c4e5a2d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:29.306233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bd24b-fcfa-4f85-8da8-a8861e59de53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:29.307133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bd24b-fcfa-4f85-8da8-a8861e59de53 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.307415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bd24b-fcfa-4f85-8da8-a8861e59de53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.307689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bd24b-fcfa-4f85-8da8-a8861e59de53 admin admin] PATH_INFO: `/v3/projects/422a316e58024fadb3bdfaac37fd421e/users/01078f9f62c94f968cabab533bafa48c/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.328500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bd24b-fcfa-4f85-8da8-a8861e59de53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=422a316e58024fadb3bdfaac37fd421e, user_id=01078f9f62c94f968cabab533bafa48c, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:29.331963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bd24b-fcfa-4f85-8da8-a8861e59de53 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:29.346503 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3553/7137] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:29 2022] PUT /identity/v3/projects/422a316e58024fadb3bdfaac37fd421e/users/01078f9f62c94f968cabab533bafa48c/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:29.351976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bd445a2f-ef7d-4edb-a1a3-c13f1c4e5a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21ad8e9f3fb41ee8960c0cdcaa8e10b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:29.357583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce5a1d-7261-4183-b978-f4f84a3716a2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.357912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce5a1d-7261-4183-b978-f4f84a3716a2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.358402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce5a1d-7261-4183-b978-f4f84a3716a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.361659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bd445a2f-ef7d-4edb-a1a3-c13f1c4e5a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21ad8e9f3fb41ee8960c0cdcaa8e10b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:29.362386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bd445a2f-ef7d-4edb-a1a3-c13f1c4e5a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21ad8e9f3fb41ee8960c0cdcaa8e10b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:29.363005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bd445a2f-ef7d-4edb-a1a3-c13f1c4e5a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21ad8e9f3fb41ee8960c0cdcaa8e10b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:29.370162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bd445a2f-ef7d-4edb-a1a3-c13f1c4e5a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21ad8e9f3fb41ee8960c0cdcaa8e10b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:29.386351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-39ce5a1d-7261-4183-b978-f4f84a3716a2 None None] MFA Rules not processed for user `01078f9f62c94f968cabab533bafa48c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:29.387299 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3585/7138] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:29 2022] DELETE /identity/v3/users/e21ad8e9f3fb41ee8960c0cdcaa8e10b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:29.387577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-39ce5a1d-7261-4183-b978-f4f84a3716a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:29.391723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e79d8-3719-44c1-9537-ec4147fe7417 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.392013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e79d8-3719-44c1-9537-ec4147fe7417 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.392325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e79d8-3719-44c1-9537-ec4147fe7417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.409296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0f4e79d8-3719-44c1-9537-ec4147fe7417 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:29.410492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0f4e79d8-3719-44c1-9537-ec4147fe7417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:29.454736 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3554/7139] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:29.459677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce5a1d-7261-4183-b978-f4f84a3716a2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:29.461062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-39ce5a1d-7261-4183-b978-f4f84a3716a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:29.462253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:29.473015 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3586/7140] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:29.482440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e79d8-3719-44c1-9537-ec4147fe7417 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:29.483972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0f4e79d8-3719-44c1-9537-ec4147fe7417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:29.534878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce5a1d-7261-4183-b978-f4f84a3716a2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:29.540331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438a85b-8f5b-45cf-92c1-f0b410d29148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:29.541055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438a85b-8f5b-45cf-92c1-f0b410d29148 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.541341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438a85b-8f5b-45cf-92c1-f0b410d29148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.541619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438a85b-8f5b-45cf-92c1-f0b410d29148 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.542388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438a85b-8f5b-45cf-92c1-f0b410d29148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:29.544321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438a85b-8f5b-45cf-92c1-f0b410d29148 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:29.552322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e79d8-3719-44c1-9537-ec4147fe7417 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:29.556709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66074ee-7a14-4f0d-92ad-97b514859db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:29.557360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66074ee-7a14-4f0d-92ad-97b514859db5 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.557641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66074ee-7a14-4f0d-92ad-97b514859db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.557913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66074ee-7a14-4f0d-92ad-97b514859db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.568077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66074ee-7a14-4f0d-92ad-97b514859db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:29.569541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66074ee-7a14-4f0d-92ad-97b514859db5 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:29.573417 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3555/7141] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:29 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:29.577486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438a85b-8f5b-45cf-92c1-f0b410d29148 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:29.579949 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3587/7142] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:29.634603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:29.653867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438a85b-8f5b-45cf-92c1-f0b410d29148 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:29.660259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a37fbe-ea9b-455d-a643-888086c46c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:29.661515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a37fbe-ea9b-455d-a643-888086c46c40 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.661834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a37fbe-ea9b-455d-a643-888086c46c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.662065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a37fbe-ea9b-455d-a643-888086c46c40 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.663328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a37fbe-ea9b-455d-a643-888086c46c40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:29.665792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a37fbe-ea9b-455d-a643-888086c46c40 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:29.692758 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3556/7143] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:29 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:29.696766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66074ee-7a14-4f0d-92ad-97b514859db5 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:29.709059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66074ee-7a14-4f0d-92ad-97b514859db5 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:29.713969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cdc47-ac88-49ec-bd92-11d2126067cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:29.714641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cdc47-ac88-49ec-bd92-11d2126067cd admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.714925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cdc47-ac88-49ec-bd92-11d2126067cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.715200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cdc47-ac88-49ec-bd92-11d2126067cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.715925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cdc47-ac88-49ec-bd92-11d2126067cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:29.717734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cdc47-ac88-49ec-bd92-11d2126067cd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:29.731521 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3588/7144] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:29.732825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a37fbe-ea9b-455d-a643-888086c46c40 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:29.744842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a37fbe-ea9b-455d-a643-888086c46c40 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:29.753462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cb956-691c-4a1d-88bd-81360494d8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:29.754549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cb956-691c-4a1d-88bd-81360494d8b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.754863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cb956-691c-4a1d-88bd-81360494d8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.755247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cb956-691c-4a1d-88bd-81360494d8b8 admin admin] PATH_INFO: `/v3/projects/e3ec5eddc44a4b36aad264ca1a47cd0b/users/e9a4334805f4492abcd2d2c568088fcb/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.777337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cb956-691c-4a1d-88bd-81360494d8b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ec5eddc44a4b36aad264ca1a47cd0b, user_id=e9a4334805f4492abcd2d2c568088fcb, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:29.780227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cb956-691c-4a1d-88bd-81360494d8b8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:29.794417 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3557/7145] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:29 2022] PUT /identity/v3/projects/e3ec5eddc44a4b36aad264ca1a47cd0b/users/e9a4334805f4492abcd2d2c568088fcb/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:29.798564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cdc47-ac88-49ec-bd92-11d2126067cd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:29.809799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cdc47-ac88-49ec-bd92-11d2126067cd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:29.870923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56ce3f-3601-4ea4-a7ad-135e6e1d78de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:29.871603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56ce3f-3601-4ea4-a7ad-135e6e1d78de admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.871906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56ce3f-3601-4ea4-a7ad-135e6e1d78de admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.872245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56ce3f-3601-4ea4-a7ad-135e6e1d78de admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.873069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56ce3f-3601-4ea4-a7ad-135e6e1d78de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:29.874713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56ce3f-3601-4ea4-a7ad-135e6e1d78de admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:29.885858 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3589/7146] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:29.890268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cb956-691c-4a1d-88bd-81360494d8b8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:29.902100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56ce3f-3601-4ea4-a7ad-135e6e1d78de admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:29.902301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cb956-691c-4a1d-88bd-81360494d8b8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:29.903950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0f56ce3f-3601-4ea4-a7ad-135e6e1d78de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:29.907625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6f763-7c3a-4bd6-a681-65897bb0e144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:29.908679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6f763-7c3a-4bd6-a681-65897bb0e144 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.909025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6f763-7c3a-4bd6-a681-65897bb0e144 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.909369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6f763-7c3a-4bd6-a681-65897bb0e144 admin admin] PATH_INFO: `/v3/projects/e3ec5eddc44a4b36aad264ca1a47cd0b/users/e9a4334805f4492abcd2d2c568088fcb/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.911536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6f763-7c3a-4bd6-a681-65897bb0e144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ec5eddc44a4b36aad264ca1a47cd0b, user_id=e9a4334805f4492abcd2d2c568088fcb, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:29.914615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6f763-7c3a-4bd6-a681-65897bb0e144 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:29.924583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56ce3f-3601-4ea4-a7ad-135e6e1d78de admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:29.927047 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3558/7147] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:29 2022] PUT /identity/v3/projects/e3ec5eddc44a4b36aad264ca1a47cd0b/users/e9a4334805f4492abcd2d2c568088fcb/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:29.937719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322e2db-1f44-4f5f-9085-ecb74b5247e4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.938079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322e2db-1f44-4f5f-9085-ecb74b5247e4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.938423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322e2db-1f44-4f5f-9085-ecb74b5247e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.969728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9322e2db-1f44-4f5f-9085-ecb74b5247e4 None None] MFA Rules not processed for user `e9a4334805f4492abcd2d2c568088fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:29.970963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9322e2db-1f44-4f5f-9085-ecb74b5247e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:29.991980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091190c-c8d7-43cd-a6a6-364f1c8c9f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:29.992737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091190c-c8d7-43cd-a6a6-364f1c8c9f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:29.993071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091190c-c8d7-43cd-a6a6-364f1c8c9f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:29.993373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091190c-c8d7-43cd-a6a6-364f1c8c9f3c admin admin] PATH_INFO: `/v3/projects/cedb3b250a544c75a27099d69657307d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:29.998511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091190c-c8d7-43cd-a6a6-364f1c8c9f3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cedb3b250a544c75a27099d69657307d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:29.998511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091190c-c8d7-43cd-a6a6-364f1c8c9f3c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:30.031975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:30.042341 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3559/7148] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:30.046697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2091190c-c8d7-43cd-a6a6-364f1c8c9f3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cedb3b250a544c75a27099d69657307d', 'request_id': 'req-2091190c-c8d7-43cd-a6a6-364f1c8c9f3c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:30.054638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2091190c-c8d7-43cd-a6a6-364f1c8c9f3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cedb3b250a544c75a27099d69657307d', 'request_id': 'req-2091190c-c8d7-43cd-a6a6-364f1c8c9f3c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:30.057535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322e2db-1f44-4f5f-9085-ecb74b5247e4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:30.060018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9322e2db-1f44-4f5f-9085-ecb74b5247e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:30.063409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2091190c-c8d7-43cd-a6a6-364f1c8c9f3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cedb3b250a544c75a27099d69657307d', 'request_id': 'req-2091190c-c8d7-43cd-a6a6-364f1c8c9f3c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:30.080471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2091190c-c8d7-43cd-a6a6-364f1c8c9f3c admin admin] The token cache is being invalidate because project cedb3b250a544c75a27099d69657307d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:30.080763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2091190c-c8d7-43cd-a6a6-364f1c8c9f3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:30.081432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2091190c-c8d7-43cd-a6a6-364f1c8c9f3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:30.083040 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3590/7149] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:29 2022] DELETE /identity/v3/projects/cedb3b250a544c75a27099d69657307d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:30.087908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd9bd8-b6a6-44c5-ae46-de626752c07d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:30.088411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd9bd8-b6a6-44c5-ae46-de626752c07d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:30.088696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd9bd8-b6a6-44c5-ae46-de626752c07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:30.109930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ccdd9bd8-b6a6-44c5-ae46-de626752c07d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:30.111168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ccdd9bd8-b6a6-44c5-ae46-de626752c07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:30.134869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322e2db-1f44-4f5f-9085-ecb74b5247e4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:30.171298 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3591/7150] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:30.179665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c160eb-d773-4beb-927f-76d50ca33fcc None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:30.180286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c160eb-d773-4beb-927f-76d50ca33fcc None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:30.180438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c160eb-d773-4beb-927f-76d50ca33fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:30.182174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:30.190035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049bdff2-7e18-4888-9993-bb9b350e7274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:30.191478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bdff2-7e18-4888-9993-bb9b350e7274 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:30.192091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bdff2-7e18-4888-9993-bb9b350e7274 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:30.192375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bdff2-7e18-4888-9993-bb9b350e7274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:30.194505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-049bdff2-7e18-4888-9993-bb9b350e7274 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:30.199944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c9c160eb-d773-4beb-927f-76d50ca33fcc None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:30.201157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c9c160eb-d773-4beb-927f-76d50ca33fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:30.212935 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3592/7151] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:30.220999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c160eb-d773-4beb-927f-76d50ca33fcc None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:30.231141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c160eb-d773-4beb-927f-76d50ca33fcc None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:30.239291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a54798-b3ce-4a7e-9f66-f31e2d6d93e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:30.239966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a54798-b3ce-4a7e-9f66-f31e2d6d93e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:30.240400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a54798-b3ce-4a7e-9f66-f31e2d6d93e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:30.240648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a54798-b3ce-4a7e-9f66-f31e2d6d93e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:30.241416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a54798-b3ce-4a7e-9f66-f31e2d6d93e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:30.241784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a54798-b3ce-4a7e-9f66-f31e2d6d93e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:30.243675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a54798-b3ce-4a7e-9f66-f31e2d6d93e6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:30.256683 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3593/7152] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:30.260977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a54798-b3ce-4a7e-9f66-f31e2d6d93e6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:30.269995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049bdff2-7e18-4888-9993-bb9b350e7274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:30.271370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a54798-b3ce-4a7e-9f66-f31e2d6d93e6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:30.271493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049bdff2-7e18-4888-9993-bb9b350e7274 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:30.276550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99da08-7660-4544-9a01-e4187320d8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:30.277111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99da08-7660-4544-9a01-e4187320d8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:30.277397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99da08-7660-4544-9a01-e4187320d8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:30.277673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99da08-7660-4544-9a01-e4187320d8b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:30.278369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99da08-7660-4544-9a01-e4187320d8b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:30.280382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99da08-7660-4544-9a01-e4187320d8b0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:30.283337 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3560/7153] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:30.311213 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3594/7154] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:30 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:30.312549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049bdff2-7e18-4888-9993-bb9b350e7274 service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:30.323862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049bdff2-7e18-4888-9993-bb9b350e7274 service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:30.388356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bac3d-6491-4ff7-9421-e64f273bcb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:30.389029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bac3d-6491-4ff7-9421-e64f273bcb4d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:30.389392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bac3d-6491-4ff7-9421-e64f273bcb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:30.389613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bac3d-6491-4ff7-9421-e64f273bcb4d admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:30.390298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bac3d-6491-4ff7-9421-e64f273bcb4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:30.395180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bac3d-6491-4ff7-9421-e64f273bcb4d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:30.412479 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3561/7155] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:30 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:30.416720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99da08-7660-4544-9a01-e4187320d8b0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:30.428107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99da08-7660-4544-9a01-e4187320d8b0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:30.433299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395d6b5-9000-4a9e-b012-377c24ccf21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:30.434059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395d6b5-9000-4a9e-b012-377c24ccf21f admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:30.434399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395d6b5-9000-4a9e-b012-377c24ccf21f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:30.434733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395d6b5-9000-4a9e-b012-377c24ccf21f admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:30.435509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395d6b5-9000-4a9e-b012-377c24ccf21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:30.437400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395d6b5-9000-4a9e-b012-377c24ccf21f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:30.447942 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3595/7156] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:30.451833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bac3d-6491-4ff7-9421-e64f273bcb4d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:30.462220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bac3d-6491-4ff7-9421-e64f273bcb4d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:30.467063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6a65b-4924-41b4-9e27-4b9af637ed9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:30.467796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6a65b-4924-41b4-9e27-4b9af637ed9d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:30.468155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6a65b-4924-41b4-9e27-4b9af637ed9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:30.468437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6a65b-4924-41b4-9e27-4b9af637ed9d admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:30.469156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6a65b-4924-41b4-9e27-4b9af637ed9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:30.470816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6a65b-4924-41b4-9e27-4b9af637ed9d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:30.483958 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3562/7157] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:30.488327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395d6b5-9000-4a9e-b012-377c24ccf21f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:30.498700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395d6b5-9000-4a9e-b012-377c24ccf21f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:30.503804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3dab1-9678-464c-aefe-97e24dfae21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:30.504735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3dab1-9678-464c-aefe-97e24dfae21b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:30.505025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3dab1-9678-464c-aefe-97e24dfae21b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:30.505416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3dab1-9678-464c-aefe-97e24dfae21b admin admin] PATH_INFO: `/v3/projects/667856fd5c4440fbbf131b1b5708687e/users/32957250e8e24c8faf8e5a463d0256fb/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:30.522169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3dab1-9678-464c-aefe-97e24dfae21b admin admin] RBAC: Authorizing `identity:create_grant(project_id=667856fd5c4440fbbf131b1b5708687e, user_id=32957250e8e24c8faf8e5a463d0256fb, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:30.525146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3dab1-9678-464c-aefe-97e24dfae21b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:30.540385 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3596/7158] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:30 2022] PUT /identity/v3/projects/667856fd5c4440fbbf131b1b5708687e/users/32957250e8e24c8faf8e5a463d0256fb/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:30.554381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5216d16-0d70-475f-9974-488d181ee777 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:30.554675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5216d16-0d70-475f-9974-488d181ee777 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:30.554956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5216d16-0d70-475f-9974-488d181ee777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:30.583815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d5216d16-0d70-475f-9974-488d181ee777 None None] MFA Rules not processed for user `32957250e8e24c8faf8e5a463d0256fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:30.585306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d5216d16-0d70-475f-9974-488d181ee777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:30.653761 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3563/7159] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:30.658299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3dab1-9678-464c-aefe-97e24dfae21b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:30.689747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5216d16-0d70-475f-9974-488d181ee777 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:30.691321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d5216d16-0d70-475f-9974-488d181ee777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:30.697053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:30.710759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:30.730120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3dab1-9678-464c-aefe-97e24dfae21b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:30.735175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea1182-b8d3-4a5c-afb4-bb94a6f36214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:30.735950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea1182-b8d3-4a5c-afb4-bb94a6f36214 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:30.736363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea1182-b8d3-4a5c-afb4-bb94a6f36214 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:30.736768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea1182-b8d3-4a5c-afb4-bb94a6f36214 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:30.737573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea1182-b8d3-4a5c-afb4-bb94a6f36214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:30.739636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea1182-b8d3-4a5c-afb4-bb94a6f36214 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:30.762197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5216d16-0d70-475f-9974-488d181ee777 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:30.766108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926bc65-1e9c-49c0-9431-74970a25e9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:30.766297 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3597/7160] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:30 2022] POST /identity/v3/projects => generated 361 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:30.767160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926bc65-1e9c-49c0-9431-74970a25e9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:30.767503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926bc65-1e9c-49c0-9431-74970a25e9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:30.767865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926bc65-1e9c-49c0-9431-74970a25e9c2 admin admin] PATH_INFO: `/v3/users/01078f9f62c94f968cabab533bafa48c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:30.769325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926bc65-1e9c-49c0-9431-74970a25e9c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01078f9f62c94f968cabab533bafa48c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:30.770384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea1182-b8d3-4a5c-afb4-bb94a6f36214 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:30.771111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926bc65-1e9c-49c0-9431-74970a25e9c2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:30.831636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7926bc65-1e9c-49c0-9431-74970a25e9c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01078f9f62c94f968cabab533bafa48c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:30.841059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7926bc65-1e9c-49c0-9431-74970a25e9c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01078f9f62c94f968cabab533bafa48c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:30.848512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea1182-b8d3-4a5c-afb4-bb94a6f36214 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:30.849435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7926bc65-1e9c-49c0-9431-74970a25e9c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01078f9f62c94f968cabab533bafa48c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:30.850201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7926bc65-1e9c-49c0-9431-74970a25e9c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01078f9f62c94f968cabab533bafa48c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:30.850773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7926bc65-1e9c-49c0-9431-74970a25e9c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01078f9f62c94f968cabab533bafa48c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:30.858571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138c485-a579-4e44-a08c-e03bf424e452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:30.859260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138c485-a579-4e44-a08c-e03bf424e452 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:30.859671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138c485-a579-4e44-a08c-e03bf424e452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:30.859988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138c485-a579-4e44-a08c-e03bf424e452 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:30.860743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138c485-a579-4e44-a08c-e03bf424e452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:30.863210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138c485-a579-4e44-a08c-e03bf424e452 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:30.872540 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3564/7161] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:30 2022] DELETE /identity/v3/users/01078f9f62c94f968cabab533bafa48c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:30.881900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51c079-403a-452f-83ac-88f71fed523f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:30.882216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51c079-403a-452f-83ac-88f71fed523f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:30.882541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51c079-403a-452f-83ac-88f71fed523f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:30.884778 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3598/7162] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:30 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:30.888428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138c485-a579-4e44-a08c-e03bf424e452 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:30.890078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9138c485-a579-4e44-a08c-e03bf424e452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:30.902669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4c51c079-403a-452f-83ac-88f71fed523f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:30.903686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138c485-a579-4e44-a08c-e03bf424e452 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:30.903854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4c51c079-403a-452f-83ac-88f71fed523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:30.960940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bada6e-4155-4934-aecc-05fae20fbed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:30.961616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bada6e-4155-4934-aecc-05fae20fbed1 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:30.961902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bada6e-4155-4934-aecc-05fae20fbed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:30.962210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bada6e-4155-4934-aecc-05fae20fbed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:30.962964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bada6e-4155-4934-aecc-05fae20fbed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:30.963624 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3565/7163] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:30.964781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bada6e-4155-4934-aecc-05fae20fbed1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:30.973610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51c079-403a-452f-83ac-88f71fed523f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:30.974967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4c51c079-403a-452f-83ac-88f71fed523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:30.975807 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3599/7164] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:29:30.979828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bada6e-4155-4934-aecc-05fae20fbed1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:30.990176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bada6e-4155-4934-aecc-05fae20fbed1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:30.994809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1613545-2667-4fd3-afae-bae7dd2b4201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:30.995690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1613545-2667-4fd3-afae-bae7dd2b4201 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:30.995972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1613545-2667-4fd3-afae-bae7dd2b4201 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:30.996284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1613545-2667-4fd3-afae-bae7dd2b4201 admin admin] PATH_INFO: `/v3/projects/6452aa8373ae466abc0a8a8ee8676a81/users/6ba1ddfc01fd4c57a2c7b1e41a02ccb2/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:31.002274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:31.012272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1613545-2667-4fd3-afae-bae7dd2b4201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6452aa8373ae466abc0a8a8ee8676a81, user_id=6ba1ddfc01fd4c57a2c7b1e41a02ccb2, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:31.015129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1613545-2667-4fd3-afae-bae7dd2b4201 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:31.029690 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3600/7165] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:30 2022] PUT /identity/v3/projects/6452aa8373ae466abc0a8a8ee8676a81/users/6ba1ddfc01fd4c57a2c7b1e41a02ccb2/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:31.033933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1613545-2667-4fd3-afae-bae7dd2b4201 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:31.043604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51c079-403a-452f-83ac-88f71fed523f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:31.066523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:31.100555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1613545-2667-4fd3-afae-bae7dd2b4201 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:31.101663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058050cb-2657-4138-991f-fc27c6c7913c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:31.102326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058050cb-2657-4138-991f-fc27c6c7913c service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:31.102604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058050cb-2657-4138-991f-fc27c6c7913c service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:31.102875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058050cb-2657-4138-991f-fc27c6c7913c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:31.105437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9acebb-7cdb-478c-9e3e-148dfdf3c858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:31.106152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9acebb-7cdb-478c-9e3e-148dfdf3c858 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:31.106434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9acebb-7cdb-478c-9e3e-148dfdf3c858 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:31.106709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9acebb-7cdb-478c-9e3e-148dfdf3c858 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:31.107440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9acebb-7cdb-478c-9e3e-148dfdf3c858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:31.109145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9acebb-7cdb-478c-9e3e-148dfdf3c858 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:31.112606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058050cb-2657-4138-991f-fc27c6c7913c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:31.114295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058050cb-2657-4138-991f-fc27c6c7913c service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:31.122729 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3601/7166] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:29:31.123776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9acebb-7cdb-478c-9e3e-148dfdf3c858 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:31.129532 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3566/7167] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:31.134076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9acebb-7cdb-478c-9e3e-148dfdf3c858 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:31.138957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b1fe1-57a6-4a8d-8629-bbf1df7aa972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:31.140079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b1fe1-57a6-4a8d-8629-bbf1df7aa972 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:31.140459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b1fe1-57a6-4a8d-8629-bbf1df7aa972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:31.140735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b1fe1-57a6-4a8d-8629-bbf1df7aa972 admin admin] PATH_INFO: `/v3/projects/6452aa8373ae466abc0a8a8ee8676a81/users/6ba1ddfc01fd4c57a2c7b1e41a02ccb2/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:31.142799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b1fe1-57a6-4a8d-8629-bbf1df7aa972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6452aa8373ae466abc0a8a8ee8676a81, user_id=6ba1ddfc01fd4c57a2c7b1e41a02ccb2, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:31.145738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b1fe1-57a6-4a8d-8629-bbf1df7aa972 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:31.167036 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3602/7168] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:31 2022] PUT /identity/v3/projects/6452aa8373ae466abc0a8a8ee8676a81/users/6ba1ddfc01fd4c57a2c7b1e41a02ccb2/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:31.168806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c08e7-3e20-404f-a329-cb20c30330b6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:31.169099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c08e7-3e20-404f-a329-cb20c30330b6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:31.169380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c08e7-3e20-404f-a329-cb20c30330b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:31.198192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-407c08e7-3e20-404f-a329-cb20c30330b6 None None] MFA Rules not processed for user `6ba1ddfc01fd4c57a2c7b1e41a02ccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:31.200283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-407c08e7-3e20-404f-a329-cb20c30330b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:31.283910 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3567/7169] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:31 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:31.292640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b1fe1-57a6-4a8d-8629-bbf1df7aa972 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:31.294482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-337b1fe1-57a6-4a8d-8629-bbf1df7aa972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:31.361535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b1fe1-57a6-4a8d-8629-bbf1df7aa972 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:31.365216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc2cd3-b45e-4cb1-912f-c89381c2e65a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:31.365861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc2cd3-b45e-4cb1-912f-c89381c2e65a service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:31.366259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc2cd3-b45e-4cb1-912f-c89381c2e65a service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:31.366541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc2cd3-b45e-4cb1-912f-c89381c2e65a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:31.377946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc2cd3-b45e-4cb1-912f-c89381c2e65a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:31.379410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc2cd3-b45e-4cb1-912f-c89381c2e65a service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:31.389175 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3603/7170] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:31 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:31.426851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c08e7-3e20-404f-a329-cb20c30330b6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:31.429134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-407c08e7-3e20-404f-a329-cb20c30330b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:31.526823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c08e7-3e20-404f-a329-cb20c30330b6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:31.532677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd0076-1bd7-499b-ba9e-644aaefd32ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:31.533770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd0076-1bd7-499b-ba9e-644aaefd32ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:31.534231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd0076-1bd7-499b-ba9e-644aaefd32ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:31.534560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd0076-1bd7-499b-ba9e-644aaefd32ba admin admin] PATH_INFO: `/v3/projects/422a316e58024fadb3bdfaac37fd421e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:31.535826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd0076-1bd7-499b-ba9e-644aaefd32ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=422a316e58024fadb3bdfaac37fd421e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:31.537829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd0076-1bd7-499b-ba9e-644aaefd32ba admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:31.546485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:31.588229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b7fd0076-1bd7-499b-ba9e-644aaefd32ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '422a316e58024fadb3bdfaac37fd421e', 'request_id': 'req-b7fd0076-1bd7-499b-ba9e-644aaefd32ba'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:31.598896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b7fd0076-1bd7-499b-ba9e-644aaefd32ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '422a316e58024fadb3bdfaac37fd421e', 'request_id': 'req-b7fd0076-1bd7-499b-ba9e-644aaefd32ba'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:31.604653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b7fd0076-1bd7-499b-ba9e-644aaefd32ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '422a316e58024fadb3bdfaac37fd421e', 'request_id': 'req-b7fd0076-1bd7-499b-ba9e-644aaefd32ba'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:31.619290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b7fd0076-1bd7-499b-ba9e-644aaefd32ba admin admin] The token cache is being invalidate because project 422a316e58024fadb3bdfaac37fd421e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:31.619576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b7fd0076-1bd7-499b-ba9e-644aaefd32ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:31.620362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b7fd0076-1bd7-499b-ba9e-644aaefd32ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:31.622292 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3568/7171] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:31 2022] DELETE /identity/v3/projects/422a316e58024fadb3bdfaac37fd421e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:31.629495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc2cd3-b45e-4cb1-912f-c89381c2e65a service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:31.643487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc2cd3-b45e-4cb1-912f-c89381c2e65a service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:31.704966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a69833-0806-46b9-a2df-09dabac65d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:31.705867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a69833-0806-46b9-a2df-09dabac65d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:31.706142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a69833-0806-46b9-a2df-09dabac65d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:31.706413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a69833-0806-46b9-a2df-09dabac65d10 admin admin] PATH_INFO: `/v3/users/e9a4334805f4492abcd2d2c568088fcb` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:31.707611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a69833-0806-46b9-a2df-09dabac65d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9a4334805f4492abcd2d2c568088fcb)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:31.709581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a69833-0806-46b9-a2df-09dabac65d10 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:31.759748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-90a69833-0806-46b9-a2df-09dabac65d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9a4334805f4492abcd2d2c568088fcb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:31.768053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-90a69833-0806-46b9-a2df-09dabac65d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9a4334805f4492abcd2d2c568088fcb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:31.768856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-90a69833-0806-46b9-a2df-09dabac65d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9a4334805f4492abcd2d2c568088fcb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:31.769495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-90a69833-0806-46b9-a2df-09dabac65d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9a4334805f4492abcd2d2c568088fcb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:31.771630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:31.778307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-90a69833-0806-46b9-a2df-09dabac65d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9a4334805f4492abcd2d2c568088fcb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:31.800204 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3604/7172] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:31 2022] DELETE /identity/v3/users/e9a4334805f4492abcd2d2c568088fcb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:31.822112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd0076-1bd7-499b-ba9e-644aaefd32ba admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:31.823579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b7fd0076-1bd7-499b-ba9e-644aaefd32ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:31.837040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd0076-1bd7-499b-ba9e-644aaefd32ba admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:31.901422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d245fa-99b2-488a-9dcd-b09742fe92a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:31.902531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d245fa-99b2-488a-9dcd-b09742fe92a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:31.903014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d245fa-99b2-488a-9dcd-b09742fe92a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:31.903284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d245fa-99b2-488a-9dcd-b09742fe92a3 admin admin] PATH_INFO: `/v3/users/32957250e8e24c8faf8e5a463d0256fb` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:31.904958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d245fa-99b2-488a-9dcd-b09742fe92a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32957250e8e24c8faf8e5a463d0256fb)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:31.907215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d245fa-99b2-488a-9dcd-b09742fe92a3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:31.975913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-33d245fa-99b2-488a-9dcd-b09742fe92a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32957250e8e24c8faf8e5a463d0256fb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:31.985168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-33d245fa-99b2-488a-9dcd-b09742fe92a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32957250e8e24c8faf8e5a463d0256fb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:31.993184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-33d245fa-99b2-488a-9dcd-b09742fe92a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32957250e8e24c8faf8e5a463d0256fb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:31.993880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-33d245fa-99b2-488a-9dcd-b09742fe92a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32957250e8e24c8faf8e5a463d0256fb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:31.994921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-33d245fa-99b2-488a-9dcd-b09742fe92a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32957250e8e24c8faf8e5a463d0256fb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:32.015396 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3569/7173] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:31 2022] DELETE /identity/v3/users/32957250e8e24c8faf8e5a463d0256fb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:32.019955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2e65e-2c8a-4591-a515-f81b2eae152e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:32.020477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2e65e-2c8a-4591-a515-f81b2eae152e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:32.020682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2e65e-2c8a-4591-a515-f81b2eae152e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:32.038376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f3a2e65e-2c8a-4591-a515-f81b2eae152e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:32.039550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f3a2e65e-2c8a-4591-a515-f81b2eae152e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:32.103089 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3605/7174] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:32.112325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d245fa-99b2-488a-9dcd-b09742fe92a3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:32.113478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2e65e-2c8a-4591-a515-f81b2eae152e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:32.113832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-33d245fa-99b2-488a-9dcd-b09742fe92a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:32.114966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f3a2e65e-2c8a-4591-a515-f81b2eae152e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:32.129922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d245fa-99b2-488a-9dcd-b09742fe92a3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:32.135119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539043eb-d68a-4f7b-ba96-832515ee6695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:32.135656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539043eb-d68a-4f7b-ba96-832515ee6695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:32.135958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539043eb-d68a-4f7b-ba96-832515ee6695 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:32.136258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539043eb-d68a-4f7b-ba96-832515ee6695 admin admin] PATH_INFO: `/v3/projects/e3ec5eddc44a4b36aad264ca1a47cd0b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:32.137457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539043eb-d68a-4f7b-ba96-832515ee6695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ec5eddc44a4b36aad264ca1a47cd0b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:32.139452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539043eb-d68a-4f7b-ba96-832515ee6695 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:32.150914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:32.183524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2e65e-2c8a-4591-a515-f81b2eae152e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:32.196908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-539043eb-d68a-4f7b-ba96-832515ee6695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ec5eddc44a4b36aad264ca1a47cd0b', 'request_id': 'req-539043eb-d68a-4f7b-ba96-832515ee6695'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:32.204741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-539043eb-d68a-4f7b-ba96-832515ee6695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ec5eddc44a4b36aad264ca1a47cd0b', 'request_id': 'req-539043eb-d68a-4f7b-ba96-832515ee6695'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:32.212747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-539043eb-d68a-4f7b-ba96-832515ee6695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ec5eddc44a4b36aad264ca1a47cd0b', 'request_id': 'req-539043eb-d68a-4f7b-ba96-832515ee6695'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:32.227130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-539043eb-d68a-4f7b-ba96-832515ee6695 admin admin] The token cache is being invalidate because project e3ec5eddc44a4b36aad264ca1a47cd0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:32.227414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-539043eb-d68a-4f7b-ba96-832515ee6695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:32.228104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-539043eb-d68a-4f7b-ba96-832515ee6695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:32.229746 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3570/7175] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:32 2022] DELETE /identity/v3/projects/e3ec5eddc44a4b36aad264ca1a47cd0b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:32.235074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c40f3e-a370-445e-863c-7a28a0e48923 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:32.235416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c40f3e-a370-445e-863c-7a28a0e48923 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:32.235721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c40f3e-a370-445e-863c-7a28a0e48923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:32.242038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896aa38-c90d-4003-949b-1a7960d366a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:32.242688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896aa38-c90d-4003-949b-1a7960d366a0 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:32.243022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896aa38-c90d-4003-949b-1a7960d366a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:32.243286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896aa38-c90d-4003-949b-1a7960d366a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:32.245880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9896aa38-c90d-4003-949b-1a7960d366a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:32.255313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e3c40f3e-a370-445e-863c-7a28a0e48923 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:32.256624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e3c40f3e-a370-445e-863c-7a28a0e48923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:32.299119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:32.320232 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3571/7176] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:32.322188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896aa38-c90d-4003-949b-1a7960d366a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:32.323677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896aa38-c90d-4003-949b-1a7960d366a0 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:32.328760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d1638-43cf-4806-945e-257bbd39f79e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:32.329112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d1638-43cf-4806-945e-257bbd39f79e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:32.329392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d1638-43cf-4806-945e-257bbd39f79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:32.334065 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3606/7177] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:32.356240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ee5d1638-43cf-4806-945e-257bbd39f79e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:32.357493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ee5d1638-43cf-4806-945e-257bbd39f79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:32.366124 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3572/7178] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:32.370832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896aa38-c90d-4003-949b-1a7960d366a0 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:32.381686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896aa38-c90d-4003-949b-1a7960d366a0 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:32.387570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e678a8-ddd6-449d-aaa4-87b8ba14bede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:32.388276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e678a8-ddd6-449d-aaa4-87b8ba14bede admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:32.388564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e678a8-ddd6-449d-aaa4-87b8ba14bede admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:32.388843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e678a8-ddd6-449d-aaa4-87b8ba14bede admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:32.389670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e678a8-ddd6-449d-aaa4-87b8ba14bede admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:32.389983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e678a8-ddd6-449d-aaa4-87b8ba14bede admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:32.391609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e678a8-ddd6-449d-aaa4-87b8ba14bede admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:32.409170 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3607/7179] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:32.410411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d1638-43cf-4806-945e-257bbd39f79e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:32.420117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d1638-43cf-4806-945e-257bbd39f79e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:32.425155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ad0f5-99f1-4d02-98b9-e4eb6609055c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:32.425914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ad0f5-99f1-4d02-98b9-e4eb6609055c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:32.426260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ad0f5-99f1-4d02-98b9-e4eb6609055c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:32.426653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ad0f5-99f1-4d02-98b9-e4eb6609055c admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:32.427411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ad0f5-99f1-4d02-98b9-e4eb6609055c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:32.429710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ad0f5-99f1-4d02-98b9-e4eb6609055c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:32.459988 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3573/7180] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:32 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:32.461316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e678a8-ddd6-449d-aaa4-87b8ba14bede admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:32.472711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e678a8-ddd6-449d-aaa4-87b8ba14bede admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:32.536360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1c9b5-d88a-4fdd-ac4a-6024c7773259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:32.537049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1c9b5-d88a-4fdd-ac4a-6024c7773259 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:32.537678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1c9b5-d88a-4fdd-ac4a-6024c7773259 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:32.537678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1c9b5-d88a-4fdd-ac4a-6024c7773259 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:32.538282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1c9b5-d88a-4fdd-ac4a-6024c7773259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:32.540287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1c9b5-d88a-4fdd-ac4a-6024c7773259 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:32.563148 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3608/7181] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:32 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:32.567165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ad0f5-99f1-4d02-98b9-e4eb6609055c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:32.578017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ad0f5-99f1-4d02-98b9-e4eb6609055c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:32.582642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e542cb-d481-4232-8e49-f77a7aa2ce6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:32.583314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e542cb-d481-4232-8e49-f77a7aa2ce6c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:32.583599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e542cb-d481-4232-8e49-f77a7aa2ce6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:32.583878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e542cb-d481-4232-8e49-f77a7aa2ce6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:32.584633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e542cb-d481-4232-8e49-f77a7aa2ce6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:32.586245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e542cb-d481-4232-8e49-f77a7aa2ce6c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:32.598363 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3574/7182] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:32.602869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1c9b5-d88a-4fdd-ac4a-6024c7773259 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:32.615143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e542cb-d481-4232-8e49-f77a7aa2ce6c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:32.617179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-46e542cb-d481-4232-8e49-f77a7aa2ce6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:32.620893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1c9b5-d88a-4fdd-ac4a-6024c7773259 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:32.627105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f0c39-518b-4990-a183-034eef3a2734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:32.627791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f0c39-518b-4990-a183-034eef3a2734 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:32.628078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f0c39-518b-4990-a183-034eef3a2734 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:32.628385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f0c39-518b-4990-a183-034eef3a2734 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:32.629489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f0c39-518b-4990-a183-034eef3a2734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:32.631173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f0c39-518b-4990-a183-034eef3a2734 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:32.642062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e542cb-d481-4232-8e49-f77a7aa2ce6c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:32.645625 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3609/7183] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:32.648818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df965b-9fd0-4667-8ae0-67afeff8f006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:32.649899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df965b-9fd0-4667-8ae0-67afeff8f006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:32.651002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f0c39-518b-4990-a183-034eef3a2734 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:32.651668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df965b-9fd0-4667-8ae0-67afeff8f006 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:32.651949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df965b-9fd0-4667-8ae0-67afeff8f006 admin admin] PATH_INFO: `/v3/projects/667856fd5c4440fbbf131b1b5708687e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:32.653254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df965b-9fd0-4667-8ae0-67afeff8f006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=667856fd5c4440fbbf131b1b5708687e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:32.655813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df965b-9fd0-4667-8ae0-67afeff8f006 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:32.661700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f0c39-518b-4990-a183-034eef3a2734 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:32.667781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d78df-b3d6-4048-abef-972a4a765899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:32.668702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d78df-b3d6-4048-abef-972a4a765899 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:32.668985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d78df-b3d6-4048-abef-972a4a765899 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:32.669284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d78df-b3d6-4048-abef-972a4a765899 admin admin] PATH_INFO: `/v3/projects/8d26a0db1fa04822a650e0197c662f4d/users/e0fa19f0aeec4d5693d6e07a2c0b6912/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:32.685856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d78df-b3d6-4048-abef-972a4a765899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d26a0db1fa04822a650e0197c662f4d, user_id=e0fa19f0aeec4d5693d6e07a2c0b6912, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:32.688655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d78df-b3d6-4048-abef-972a4a765899 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:32.702698 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3610/7184] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:32 2022] PUT /identity/v3/projects/8d26a0db1fa04822a650e0197c662f4d/users/e0fa19f0aeec4d5693d6e07a2c0b6912/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:32.712781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c7df965b-9fd0-4667-8ae0-67afeff8f006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '667856fd5c4440fbbf131b1b5708687e', 'request_id': 'req-c7df965b-9fd0-4667-8ae0-67afeff8f006'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:32.713043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dc5d5-9a93-4bd3-9efb-5877bbaab88e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:32.713404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dc5d5-9a93-4bd3-9efb-5877bbaab88e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:32.713793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dc5d5-9a93-4bd3-9efb-5877bbaab88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:32.719448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c7df965b-9fd0-4667-8ae0-67afeff8f006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '667856fd5c4440fbbf131b1b5708687e', 'request_id': 'req-c7df965b-9fd0-4667-8ae0-67afeff8f006'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:32.720884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:32.727078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c7df965b-9fd0-4667-8ae0-67afeff8f006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '667856fd5c4440fbbf131b1b5708687e', 'request_id': 'req-c7df965b-9fd0-4667-8ae0-67afeff8f006'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:32.741210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c7df965b-9fd0-4667-8ae0-67afeff8f006 admin admin] The token cache is being invalidate because project 667856fd5c4440fbbf131b1b5708687e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:32.741501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c7df965b-9fd0-4667-8ae0-67afeff8f006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:32.742143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c7df965b-9fd0-4667-8ae0-67afeff8f006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:32.743725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-810dc5d5-9a93-4bd3-9efb-5877bbaab88e None None] MFA Rules not processed for user `e0fa19f0aeec4d5693d6e07a2c0b6912`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:32.744016 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3575/7185] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:32 2022] DELETE /identity/v3/projects/667856fd5c4440fbbf131b1b5708687e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:32.744996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-810dc5d5-9a93-4bd3-9efb-5877bbaab88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:32.747853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df965b-9fd0-4667-8ae0-67afeff8f006 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:32.749278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c7df965b-9fd0-4667-8ae0-67afeff8f006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:32.815721 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3611/7186] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:32.819722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dc5d5-9a93-4bd3-9efb-5877bbaab88e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:32.821197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-810dc5d5-9a93-4bd3-9efb-5877bbaab88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:32.821705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df965b-9fd0-4667-8ae0-67afeff8f006 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:32.826377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6367b-74a1-45d7-a70a-3c27c6b4b279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:32.827344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6367b-74a1-45d7-a70a-3c27c6b4b279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:32.827620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6367b-74a1-45d7-a70a-3c27c6b4b279 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:32.827897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6367b-74a1-45d7-a70a-3c27c6b4b279 admin admin] PATH_INFO: `/v3/users/6ba1ddfc01fd4c57a2c7b1e41a02ccb2` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:32.829283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6367b-74a1-45d7-a70a-3c27c6b4b279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ba1ddfc01fd4c57a2c7b1e41a02ccb2)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:32.831369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6367b-74a1-45d7-a70a-3c27c6b4b279 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:32.834524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dc5d5-9a93-4bd3-9efb-5877bbaab88e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:32.839131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b33cf-3853-4b04-beaf-b4892bf6141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:32.839777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b33cf-3853-4b04-beaf-b4892bf6141e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:32.840091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b33cf-3853-4b04-beaf-b4892bf6141e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:32.840372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b33cf-3853-4b04-beaf-b4892bf6141e admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:32.841078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b33cf-3853-4b04-beaf-b4892bf6141e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:32.843021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b33cf-3853-4b04-beaf-b4892bf6141e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:32.851297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:32.872081 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3612/7187] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:32 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:32.874888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b33cf-3853-4b04-beaf-b4892bf6141e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:32.882907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ecd6367b-74a1-45d7-a70a-3c27c6b4b279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ba1ddfc01fd4c57a2c7b1e41a02ccb2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:32.892162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ecd6367b-74a1-45d7-a70a-3c27c6b4b279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ba1ddfc01fd4c57a2c7b1e41a02ccb2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:32.902162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ecd6367b-74a1-45d7-a70a-3c27c6b4b279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ba1ddfc01fd4c57a2c7b1e41a02ccb2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:32.902952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ecd6367b-74a1-45d7-a70a-3c27c6b4b279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ba1ddfc01fd4c57a2c7b1e41a02ccb2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:32.905074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ecd6367b-74a1-45d7-a70a-3c27c6b4b279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ba1ddfc01fd4c57a2c7b1e41a02ccb2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:32.924900 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3576/7188] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:32 2022] DELETE /identity/v3/users/6ba1ddfc01fd4c57a2c7b1e41a02ccb2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:32.952816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b33cf-3853-4b04-beaf-b4892bf6141e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:33.014792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40853d-d409-4d12-8e6d-27d4e0323e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:33.015506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40853d-d409-4d12-8e6d-27d4e0323e63 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:33.015790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40853d-d409-4d12-8e6d-27d4e0323e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:33.016112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40853d-d409-4d12-8e6d-27d4e0323e63 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:33.016989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40853d-d409-4d12-8e6d-27d4e0323e63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:33.019094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40853d-d409-4d12-8e6d-27d4e0323e63 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:33.044086 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3613/7189] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:32 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:33.046212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6367b-74a1-45d7-a70a-3c27c6b4b279 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:33.047908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ecd6367b-74a1-45d7-a70a-3c27c6b4b279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:33.062800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6367b-74a1-45d7-a70a-3c27c6b4b279 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:33.068136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40756e5-5198-4251-a684-491df3a64faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:33.068859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40756e5-5198-4251-a684-491df3a64faa admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:33.069699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40756e5-5198-4251-a684-491df3a64faa admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:33.069699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40756e5-5198-4251-a684-491df3a64faa admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:33.070480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40756e5-5198-4251-a684-491df3a64faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:33.072353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40756e5-5198-4251-a684-491df3a64faa admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:33.100771 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3577/7190] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:33.102068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40853d-d409-4d12-8e6d-27d4e0323e63 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:33.113900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40853d-d409-4d12-8e6d-27d4e0323e63 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:33.120964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9f505-e2c4-49b9-841f-d1fbc522323f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:33.122209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9f505-e2c4-49b9-841f-d1fbc522323f admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:33.123008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9f505-e2c4-49b9-841f-d1fbc522323f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:33.123293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9f505-e2c4-49b9-841f-d1fbc522323f admin admin] PATH_INFO: `/v3/projects/42f71d34f2594672a4a0702414f04d7f/users/af63349819af435bbc9863e8698e43cd/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:33.143772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9f505-e2c4-49b9-841f-d1fbc522323f admin admin] RBAC: Authorizing `identity:create_grant(project_id=42f71d34f2594672a4a0702414f04d7f, user_id=af63349819af435bbc9863e8698e43cd, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:33.146583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9f505-e2c4-49b9-841f-d1fbc522323f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:33.161328 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3614/7191] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:33 2022] PUT /identity/v3/projects/42f71d34f2594672a4a0702414f04d7f/users/af63349819af435bbc9863e8698e43cd/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:33.165449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40756e5-5198-4251-a684-491df3a64faa admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:33.176130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40756e5-5198-4251-a684-491df3a64faa admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:33.230342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:33.252538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c023ed7-3bf9-48ac-bcf0-90daedcf377b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:33.253381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c023ed7-3bf9-48ac-bcf0-90daedcf377b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:33.253636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9f505-e2c4-49b9-841f-d1fbc522323f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:33.253875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c023ed7-3bf9-48ac-bcf0-90daedcf377b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:33.254352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c023ed7-3bf9-48ac-bcf0-90daedcf377b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:33.255367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c023ed7-3bf9-48ac-bcf0-90daedcf377b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:33.256063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-04b9f505-e2c4-49b9-841f-d1fbc522323f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:33.257449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c023ed7-3bf9-48ac-bcf0-90daedcf377b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:33.270059 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3578/7192] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:33.273882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c023ed7-3bf9-48ac-bcf0-90daedcf377b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:33.281936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9f505-e2c4-49b9-841f-d1fbc522323f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:33.285264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c023ed7-3bf9-48ac-bcf0-90daedcf377b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:33.287623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10eabf3-0303-441d-b789-ad3239a1b683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:33.288597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10eabf3-0303-441d-b789-ad3239a1b683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:33.289149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10eabf3-0303-441d-b789-ad3239a1b683 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:33.289374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10eabf3-0303-441d-b789-ad3239a1b683 admin admin] PATH_INFO: `/v3/projects/6452aa8373ae466abc0a8a8ee8676a81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:33.290551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10eabf3-0303-441d-b789-ad3239a1b683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6452aa8373ae466abc0a8a8ee8676a81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:33.290942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d7ac0-8caf-4d11-9167-6feb35b4cc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:33.291899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d7ac0-8caf-4d11-9167-6feb35b4cc3b admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:33.292280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d7ac0-8caf-4d11-9167-6feb35b4cc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:33.292545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10eabf3-0303-441d-b789-ad3239a1b683 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:33.292668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d7ac0-8caf-4d11-9167-6feb35b4cc3b admin admin] PATH_INFO: `/v3/projects/42f71d34f2594672a4a0702414f04d7f/users/af63349819af435bbc9863e8698e43cd/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:33.294825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d7ac0-8caf-4d11-9167-6feb35b4cc3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=42f71d34f2594672a4a0702414f04d7f, user_id=af63349819af435bbc9863e8698e43cd, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:33.297678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d7ac0-8caf-4d11-9167-6feb35b4cc3b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:33.310861 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3579/7193] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:33 2022] PUT /identity/v3/projects/42f71d34f2594672a4a0702414f04d7f/users/af63349819af435bbc9863e8698e43cd/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:33.321551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7a717-3051-46d7-90cb-b837e4bd11a1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:33.321815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7a717-3051-46d7-90cb-b837e4bd11a1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:33.322111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7a717-3051-46d7-90cb-b837e4bd11a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:33.348142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c10eabf3-0303-441d-b789-ad3239a1b683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6452aa8373ae466abc0a8a8ee8676a81', 'request_id': 'req-c10eabf3-0303-441d-b789-ad3239a1b683'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:33.351367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e5d7a717-3051-46d7-90cb-b837e4bd11a1 None None] MFA Rules not processed for user `af63349819af435bbc9863e8698e43cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:33.352672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e5d7a717-3051-46d7-90cb-b837e4bd11a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:33.356362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c10eabf3-0303-441d-b789-ad3239a1b683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6452aa8373ae466abc0a8a8ee8676a81', 'request_id': 'req-c10eabf3-0303-441d-b789-ad3239a1b683'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:33.357721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:33.365870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c10eabf3-0303-441d-b789-ad3239a1b683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6452aa8373ae466abc0a8a8ee8676a81', 'request_id': 'req-c10eabf3-0303-441d-b789-ad3239a1b683'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:33.378113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c10eabf3-0303-441d-b789-ad3239a1b683 admin admin] The token cache is being invalidate because project 6452aa8373ae466abc0a8a8ee8676a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:33.378403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c10eabf3-0303-441d-b789-ad3239a1b683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:33.379069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c10eabf3-0303-441d-b789-ad3239a1b683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:33.380719 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3615/7194] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:33 2022] DELETE /identity/v3/projects/6452aa8373ae466abc0a8a8ee8676a81 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:33.385495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c822a-b356-476b-9eb3-37e7b65c1417 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:33.385891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c822a-b356-476b-9eb3-37e7b65c1417 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:33.386186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c822a-b356-476b-9eb3-37e7b65c1417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:33.404344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d82c822a-b356-476b-9eb3-37e7b65c1417 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:33.405689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d82c822a-b356-476b-9eb3-37e7b65c1417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:33.423131 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3580/7195] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:33.434277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7a717-3051-46d7-90cb-b837e4bd11a1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:33.435640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e5d7a717-3051-46d7-90cb-b837e4bd11a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:33.468123 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3616/7196] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:33.475834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a1ab7-bae8-46d9-b27c-e74742d2c445 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:33.476191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a1ab7-bae8-46d9-b27c-e74742d2c445 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:33.476890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a1ab7-bae8-46d9-b27c-e74742d2c445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:33.495250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-935a1ab7-bae8-46d9-b27c-e74742d2c445 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:33.495462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7a717-3051-46d7-90cb-b837e4bd11a1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:33.496502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-935a1ab7-bae8-46d9-b27c-e74742d2c445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:33.499019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c32c2-58cd-4c76-a69b-9e720e8819bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:33.499721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c32c2-58cd-4c76-a69b-9e720e8819bb service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:33.499951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c32c2-58cd-4c76-a69b-9e720e8819bb service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:33.500272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c32c2-58cd-4c76-a69b-9e720e8819bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:33.504877 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3617/7197] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:33.508824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a1ab7-bae8-46d9-b27c-e74742d2c445 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:33.510195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c32c2-58cd-4c76-a69b-9e720e8819bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:33.511643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c32c2-58cd-4c76-a69b-9e720e8819bb service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:33.517804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a1ab7-bae8-46d9-b27c-e74742d2c445 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:33.521300 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3581/7198] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:33.524232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142a13d-427c-4300-9c00-4604dbc3ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:33.524877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142a13d-427c-4300-9c00-4604dbc3ae1e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:33.525158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142a13d-427c-4300-9c00-4604dbc3ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:33.525434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142a13d-427c-4300-9c00-4604dbc3ae1e admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:33.526153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142a13d-427c-4300-9c00-4604dbc3ae1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:33.526464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142a13d-427c-4300-9c00-4604dbc3ae1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:33.528115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142a13d-427c-4300-9c00-4604dbc3ae1e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:33.541630 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3618/7199] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:33.546602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c32c2-58cd-4c76-a69b-9e720e8819bb service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:33.558361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c32c2-58cd-4c76-a69b-9e720e8819bb service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:33.563227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f09f6-65ae-4db4-a782-5780ee6c7d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:33.563875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f09f6-65ae-4db4-a782-5780ee6c7d46 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:33.564211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f09f6-65ae-4db4-a782-5780ee6c7d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:33.564486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f09f6-65ae-4db4-a782-5780ee6c7d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:33.565182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f09f6-65ae-4db4-a782-5780ee6c7d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:33.567144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f09f6-65ae-4db4-a782-5780ee6c7d46 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:33.596261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142a13d-427c-4300-9c00-4604dbc3ae1e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:33.604240 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3582/7200] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:33 2022] POST /identity/v3/projects => generated 357 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:33.604577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f09f6-65ae-4db4-a782-5780ee6c7d46 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:33.608633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142a13d-427c-4300-9c00-4604dbc3ae1e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:33.657875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:33.663505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b7207-83a7-4e6a-a138-24ff4d836f0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:33.664243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b7207-83a7-4e6a-a138-24ff4d836f0c service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:33.664536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b7207-83a7-4e6a-a138-24ff4d836f0c service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:33.664818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b7207-83a7-4e6a-a138-24ff4d836f0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:33.666782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d87b7207-83a7-4e6a-a138-24ff4d836f0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:33.680304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f09f6-65ae-4db4-a782-5780ee6c7d46 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:33.685220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f2837-93b5-4ef0-922e-cf6c081d12bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:33.685936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f2837-93b5-4ef0-922e-cf6c081d12bb admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:33.686252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f2837-93b5-4ef0-922e-cf6c081d12bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:33.686534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f2837-93b5-4ef0-922e-cf6c081d12bb admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:33.687227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f2837-93b5-4ef0-922e-cf6c081d12bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:33.689197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f2837-93b5-4ef0-922e-cf6c081d12bb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:33.713489 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3583/7201] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:33 2022] POST /identity/v3/users => generated 279 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:33.714950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f2837-93b5-4ef0-922e-cf6c081d12bb admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:33.724846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f2837-93b5-4ef0-922e-cf6c081d12bb admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:33.727257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b7207-83a7-4e6a-a138-24ff4d836f0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:33.728778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b7207-83a7-4e6a-a138-24ff4d836f0c service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:33.729630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03646939-15a6-4119-b00a-07b5b317ea53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:33.730282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03646939-15a6-4119-b00a-07b5b317ea53 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:33.730571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03646939-15a6-4119-b00a-07b5b317ea53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:33.730851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03646939-15a6-4119-b00a-07b5b317ea53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:33.731575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03646939-15a6-4119-b00a-07b5b317ea53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:33.733270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03646939-15a6-4119-b00a-07b5b317ea53 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:33.737759 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3619/7202] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:33.746722 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3584/7203] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:29:33.748154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b7207-83a7-4e6a-a138-24ff4d836f0c service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:33.759626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b7207-83a7-4e6a-a138-24ff4d836f0c service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:33.764921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276897f-9e25-4859-8dc5-dbe95c62032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:33.765584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276897f-9e25-4859-8dc5-dbe95c62032b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:33.765893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276897f-9e25-4859-8dc5-dbe95c62032b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:33.766165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276897f-9e25-4859-8dc5-dbe95c62032b admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:33.766877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276897f-9e25-4859-8dc5-dbe95c62032b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:33.768525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276897f-9e25-4859-8dc5-dbe95c62032b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:33.778919 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3620/7204] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:33.783595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03646939-15a6-4119-b00a-07b5b317ea53 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:33.793743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03646939-15a6-4119-b00a-07b5b317ea53 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:33.799036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d97e44-0c6c-45f1-8409-8a282622c639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:33.799947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d97e44-0c6c-45f1-8409-8a282622c639 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:33.800265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d97e44-0c6c-45f1-8409-8a282622c639 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:33.800544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d97e44-0c6c-45f1-8409-8a282622c639 admin admin] PATH_INFO: `/v3/projects/43d4ccb8f0a44c24aee8bc553d82f8c9/users/1fed24436f96416ebfb6d68183f0d28d/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:33.818634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d97e44-0c6c-45f1-8409-8a282622c639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d4ccb8f0a44c24aee8bc553d82f8c9, user_id=1fed24436f96416ebfb6d68183f0d28d, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:33.821594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d97e44-0c6c-45f1-8409-8a282622c639 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:33.835606 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3585/7205] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:33 2022] PUT /identity/v3/projects/43d4ccb8f0a44c24aee8bc553d82f8c9/users/1fed24436f96416ebfb6d68183f0d28d/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:33.847065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1efc6-9e5e-49bd-bb4a-493759780d83 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:33.847597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1efc6-9e5e-49bd-bb4a-493759780d83 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:33.847898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1efc6-9e5e-49bd-bb4a-493759780d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:33.868760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:33.880724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-00e1efc6-9e5e-49bd-bb4a-493759780d83 None None] MFA Rules not processed for user `1fed24436f96416ebfb6d68183f0d28d`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:33.883281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-00e1efc6-9e5e-49bd-bb4a-493759780d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:33.957558 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3621/7206] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:33 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:33.962725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d97e44-0c6c-45f1-8409-8a282622c639 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:34.034646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d97e44-0c6c-45f1-8409-8a282622c639 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:34.040066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0138f-5067-42d3-9040-a493f90c7fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:34.040738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0138f-5067-42d3-9040-a493f90c7fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:34.041020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0138f-5067-42d3-9040-a493f90c7fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:34.041292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0138f-5067-42d3-9040-a493f90c7fb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:34.041992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0138f-5067-42d3-9040-a493f90c7fb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:34.043891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0138f-5067-42d3-9040-a493f90c7fb8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:34.070886 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3586/7207] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:33 2022] POST /identity/v3/projects => generated 357 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:34.075107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1efc6-9e5e-49bd-bb4a-493759780d83 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:34.087138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1efc6-9e5e-49bd-bb4a-493759780d83 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:34.147328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430508f-6807-4da7-8ab6-e5f20b49b5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:34.148015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430508f-6807-4da7-8ab6-e5f20b49b5cb admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:34.148331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430508f-6807-4da7-8ab6-e5f20b49b5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:34.148609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430508f-6807-4da7-8ab6-e5f20b49b5cb admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:34.149326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430508f-6807-4da7-8ab6-e5f20b49b5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:34.151278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430508f-6807-4da7-8ab6-e5f20b49b5cb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:34.173709 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3622/7208] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:34 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:34.177927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0138f-5067-42d3-9040-a493f90c7fb8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:34.190090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0138f-5067-42d3-9040-a493f90c7fb8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:34.195404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9068e-4ceb-4905-b911-11b35fa2b4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:34.196126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9068e-4ceb-4905-b911-11b35fa2b4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:34.196421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9068e-4ceb-4905-b911-11b35fa2b4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:34.196716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9068e-4ceb-4905-b911-11b35fa2b4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:34.197465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9068e-4ceb-4905-b911-11b35fa2b4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:34.199212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9068e-4ceb-4905-b911-11b35fa2b4e7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:34.212214 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3587/7209] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:34.216534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430508f-6807-4da7-8ab6-e5f20b49b5cb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:34.227110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430508f-6807-4da7-8ab6-e5f20b49b5cb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:34.233116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d36789-dcd4-4fc4-9112-fa31010c9440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:34.233920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d36789-dcd4-4fc4-9112-fa31010c9440 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:34.234201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d36789-dcd4-4fc4-9112-fa31010c9440 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:34.234549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d36789-dcd4-4fc4-9112-fa31010c9440 admin admin] PATH_INFO: `/v3/projects/207151fc1ba849e08ff0f8fac1631856/users/8ebec638f48942ed83fdf09437d88e4b/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:34.251580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d36789-dcd4-4fc4-9112-fa31010c9440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=207151fc1ba849e08ff0f8fac1631856, user_id=8ebec638f48942ed83fdf09437d88e4b, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:34.254331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d36789-dcd4-4fc4-9112-fa31010c9440 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:34.270596 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3623/7210] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:34 2022] PUT /identity/v3/projects/207151fc1ba849e08ff0f8fac1631856/users/8ebec638f48942ed83fdf09437d88e4b/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:34.274947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9068e-4ceb-4905-b911-11b35fa2b4e7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:34.288127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9068e-4ceb-4905-b911-11b35fa2b4e7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:34.355844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9c37f-1582-456a-a236-2358a2bb6df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:34.356479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9c37f-1582-456a-a236-2358a2bb6df4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:34.356762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9c37f-1582-456a-a236-2358a2bb6df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:34.357041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9c37f-1582-456a-a236-2358a2bb6df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:34.357769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9c37f-1582-456a-a236-2358a2bb6df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:34.359453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9c37f-1582-456a-a236-2358a2bb6df4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:34.369850 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3588/7211] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:29:34.374444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d36789-dcd4-4fc4-9112-fa31010c9440 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:34.388062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d36789-dcd4-4fc4-9112-fa31010c9440 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:34.393629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaba4a-b0e9-44a0-abd3-2e440e4e4ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:34.394531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaba4a-b0e9-44a0-abd3-2e440e4e4ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:34.394838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaba4a-b0e9-44a0-abd3-2e440e4e4ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:34.395119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaba4a-b0e9-44a0-abd3-2e440e4e4ea0 admin admin] PATH_INFO: `/v3/projects/207151fc1ba849e08ff0f8fac1631856/users/8ebec638f48942ed83fdf09437d88e4b/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:34.397162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eaba4a-b0e9-44a0-abd3-2e440e4e4ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=207151fc1ba849e08ff0f8fac1631856, user_id=8ebec638f48942ed83fdf09437d88e4b, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:34.399829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eaba4a-b0e9-44a0-abd3-2e440e4e4ea0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:34.410188 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3624/7212] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:34 2022] PUT /identity/v3/projects/207151fc1ba849e08ff0f8fac1631856/users/8ebec638f48942ed83fdf09437d88e4b/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:34.422018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec484431-2346-40ba-80ff-d1612d36c297 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:34.422386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec484431-2346-40ba-80ff-d1612d36c297 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:34.422731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec484431-2346-40ba-80ff-d1612d36c297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:34.430743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:34.452866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ec484431-2346-40ba-80ff-d1612d36c297 None None] MFA Rules not processed for user `8ebec638f48942ed83fdf09437d88e4b`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:34.454087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ec484431-2346-40ba-80ff-d1612d36c297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:34.528148 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3589/7213] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:34 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:34.544663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaba4a-b0e9-44a0-abd3-2e440e4e4ea0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:34.546815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-82eaba4a-b0e9-44a0-abd3-2e440e4e4ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:34.609738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaba4a-b0e9-44a0-abd3-2e440e4e4ea0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:34.614371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783814e-36e6-4da9-832a-25179fc28309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:34.615054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783814e-36e6-4da9-832a-25179fc28309 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:34.615341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783814e-36e6-4da9-832a-25179fc28309 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:34.615613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783814e-36e6-4da9-832a-25179fc28309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:34.622079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:34.626416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783814e-36e6-4da9-832a-25179fc28309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:34.627997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783814e-36e6-4da9-832a-25179fc28309 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:34.638553 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3625/7214] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:34 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:34.714659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec484431-2346-40ba-80ff-d1612d36c297 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:34.726872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec484431-2346-40ba-80ff-d1612d36c297 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:34.731201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26531b-6d7e-4347-ada2-10a515fdd0c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:34.731861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26531b-6d7e-4347-ada2-10a515fdd0c0 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:34.732158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26531b-6d7e-4347-ada2-10a515fdd0c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:34.732425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26531b-6d7e-4347-ada2-10a515fdd0c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:34.790943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26531b-6d7e-4347-ada2-10a515fdd0c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:34.792443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26531b-6d7e-4347-ada2-10a515fdd0c0 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:34.801698 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3590/7215] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:34 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:35.211559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783814e-36e6-4da9-832a-25179fc28309 service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:35.213060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2783814e-36e6-4da9-832a-25179fc28309 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:35.282696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783814e-36e6-4da9-832a-25179fc28309 service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:35.290064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272bc58-2d6b-4b19-b784-6ca05c468750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:35.291347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272bc58-2d6b-4b19-b784-6ca05c468750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:35.291815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272bc58-2d6b-4b19-b784-6ca05c468750 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:35.292362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272bc58-2d6b-4b19-b784-6ca05c468750 admin admin] PATH_INFO: `/v3/users/e0fa19f0aeec4d5693d6e07a2c0b6912` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:35.294301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272bc58-2d6b-4b19-b784-6ca05c468750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0fa19f0aeec4d5693d6e07a2c0b6912)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:35.296952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272bc58-2d6b-4b19-b784-6ca05c468750 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:35.355435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e272bc58-2d6b-4b19-b784-6ca05c468750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0fa19f0aeec4d5693d6e07a2c0b6912'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:35.370822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e272bc58-2d6b-4b19-b784-6ca05c468750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0fa19f0aeec4d5693d6e07a2c0b6912'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:35.371372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e272bc58-2d6b-4b19-b784-6ca05c468750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0fa19f0aeec4d5693d6e07a2c0b6912'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:35.372116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e272bc58-2d6b-4b19-b784-6ca05c468750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0fa19f0aeec4d5693d6e07a2c0b6912'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:35.395403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e272bc58-2d6b-4b19-b784-6ca05c468750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0fa19f0aeec4d5693d6e07a2c0b6912'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:35.427425 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3626/7216] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:35 2022] DELETE /identity/v3/users/e0fa19f0aeec4d5693d6e07a2c0b6912 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:35.432648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5da78-aae8-474f-a0ca-7d3bd2a4898f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:35.432648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5da78-aae8-474f-a0ca-7d3bd2a4898f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:35.435444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5da78-aae8-474f-a0ca-7d3bd2a4898f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:35.450530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-42f5da78-aae8-474f-a0ca-7d3bd2a4898f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:35.451717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-42f5da78-aae8-474f-a0ca-7d3bd2a4898f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:35.511958 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3591/7217] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:35.521769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272bc58-2d6b-4b19-b784-6ca05c468750 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:35.523316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e272bc58-2d6b-4b19-b784-6ca05c468750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:35.590445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272bc58-2d6b-4b19-b784-6ca05c468750 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:35.594370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3f808-e0ba-4e3b-8511-d18da79b8e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:35.595015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3f808-e0ba-4e3b-8511-d18da79b8e84 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:35.595283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3f808-e0ba-4e3b-8511-d18da79b8e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:35.595563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3f808-e0ba-4e3b-8511-d18da79b8e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:35.604625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3f808-e0ba-4e3b-8511-d18da79b8e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:35.606364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3f808-e0ba-4e3b-8511-d18da79b8e84 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:35.615676 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3627/7218] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:35.895496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5da78-aae8-474f-a0ca-7d3bd2a4898f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:35.897630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-42f5da78-aae8-474f-a0ca-7d3bd2a4898f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:35.911244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5da78-aae8-474f-a0ca-7d3bd2a4898f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:35.917314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38748558-920d-4685-a716-05d23dd4006d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:35.918386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38748558-920d-4685-a716-05d23dd4006d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:35.918871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38748558-920d-4685-a716-05d23dd4006d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:35.919163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38748558-920d-4685-a716-05d23dd4006d admin admin] PATH_INFO: `/v3/projects/8d26a0db1fa04822a650e0197c662f4d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:35.922160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38748558-920d-4685-a716-05d23dd4006d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d26a0db1fa04822a650e0197c662f4d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:35.924695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38748558-920d-4685-a716-05d23dd4006d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:35.955026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:35.992633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-38748558-920d-4685-a716-05d23dd4006d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d26a0db1fa04822a650e0197c662f4d', 'request_id': 'req-38748558-920d-4685-a716-05d23dd4006d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:36.000634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-38748558-920d-4685-a716-05d23dd4006d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d26a0db1fa04822a650e0197c662f4d', 'request_id': 'req-38748558-920d-4685-a716-05d23dd4006d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:36.007215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-38748558-920d-4685-a716-05d23dd4006d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d26a0db1fa04822a650e0197c662f4d', 'request_id': 'req-38748558-920d-4685-a716-05d23dd4006d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:36.020392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-38748558-920d-4685-a716-05d23dd4006d admin admin] The token cache is being invalidate because project 8d26a0db1fa04822a650e0197c662f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:36.020816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-38748558-920d-4685-a716-05d23dd4006d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:36.021590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-38748558-920d-4685-a716-05d23dd4006d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:36.023276 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3592/7219] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:35 2022] DELETE /identity/v3/projects/8d26a0db1fa04822a650e0197c662f4d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:36.028180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3f808-e0ba-4e3b-8511-d18da79b8e84 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:36.040380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3f808-e0ba-4e3b-8511-d18da79b8e84 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:36.058681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:36.109731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e307ab-e279-46fb-863f-eafd0e246e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:36.110640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e307ab-e279-46fb-863f-eafd0e246e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:36.111029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e307ab-e279-46fb-863f-eafd0e246e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:36.111204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e307ab-e279-46fb-863f-eafd0e246e96 admin admin] PATH_INFO: `/v3/users/af63349819af435bbc9863e8698e43cd` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:36.112616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e307ab-e279-46fb-863f-eafd0e246e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af63349819af435bbc9863e8698e43cd)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:36.114699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e307ab-e279-46fb-863f-eafd0e246e96 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:36.166225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b7e307ab-e279-46fb-863f-eafd0e246e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af63349819af435bbc9863e8698e43cd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:36.175224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b7e307ab-e279-46fb-863f-eafd0e246e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af63349819af435bbc9863e8698e43cd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:36.175900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b7e307ab-e279-46fb-863f-eafd0e246e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af63349819af435bbc9863e8698e43cd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:36.176509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b7e307ab-e279-46fb-863f-eafd0e246e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af63349819af435bbc9863e8698e43cd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:36.188955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b7e307ab-e279-46fb-863f-eafd0e246e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af63349819af435bbc9863e8698e43cd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:36.207867 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3628/7220] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:36 2022] DELETE /identity/v3/users/af63349819af435bbc9863e8698e43cd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:36.510465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38748558-920d-4685-a716-05d23dd4006d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:36.512547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-38748558-920d-4685-a716-05d23dd4006d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:36.532539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38748558-920d-4685-a716-05d23dd4006d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:36.601295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a5bb1-a529-4d9b-bc97-244e1ed1151a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:36.602172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a5bb1-a529-4d9b-bc97-244e1ed1151a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:36.602454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a5bb1-a529-4d9b-bc97-244e1ed1151a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:36.602754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a5bb1-a529-4d9b-bc97-244e1ed1151a admin admin] PATH_INFO: `/v3/projects/42f71d34f2594672a4a0702414f04d7f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:36.603950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a5bb1-a529-4d9b-bc97-244e1ed1151a admin admin] RBAC: Authorizing `identity:delete_project(project_id=42f71d34f2594672a4a0702414f04d7f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:36.605894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a5bb1-a529-4d9b-bc97-244e1ed1151a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:36.658306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc2a5bb1-a529-4d9b-bc97-244e1ed1151a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42f71d34f2594672a4a0702414f04d7f', 'request_id': 'req-fc2a5bb1-a529-4d9b-bc97-244e1ed1151a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:36.665328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc2a5bb1-a529-4d9b-bc97-244e1ed1151a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42f71d34f2594672a4a0702414f04d7f', 'request_id': 'req-fc2a5bb1-a529-4d9b-bc97-244e1ed1151a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:36.672428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc2a5bb1-a529-4d9b-bc97-244e1ed1151a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42f71d34f2594672a4a0702414f04d7f', 'request_id': 'req-fc2a5bb1-a529-4d9b-bc97-244e1ed1151a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:36.690209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc2a5bb1-a529-4d9b-bc97-244e1ed1151a admin admin] The token cache is being invalidate because project 42f71d34f2594672a4a0702414f04d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:36.690542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc2a5bb1-a529-4d9b-bc97-244e1ed1151a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:36.692974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc2a5bb1-a529-4d9b-bc97-244e1ed1151a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:36.695104 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3593/7221] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:36 2022] DELETE /identity/v3/projects/42f71d34f2594672a4a0702414f04d7f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:36.702125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e009046-afe3-4d40-a846-e8a37c10c16e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:36.702859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e009046-afe3-4d40-a846-e8a37c10c16e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:36.702859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e009046-afe3-4d40-a846-e8a37c10c16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:36.726090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9e009046-afe3-4d40-a846-e8a37c10c16e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:36.727323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9e009046-afe3-4d40-a846-e8a37c10c16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:36.795685 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3629/7222] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:36.804906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11d73d-2ee9-487a-9091-ace0c4df32e9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:36.805262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11d73d-2ee9-487a-9091-ace0c4df32e9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:36.805605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11d73d-2ee9-487a-9091-ace0c4df32e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:36.824184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-aa11d73d-2ee9-487a-9091-ace0c4df32e9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:36.825490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-aa11d73d-2ee9-487a-9091-ace0c4df32e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:36.834215 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3594/7223] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:36.838799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e009046-afe3-4d40-a846-e8a37c10c16e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:36.850044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e009046-afe3-4d40-a846-e8a37c10c16e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:36.854908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510a00a-d79e-4a47-852b-7d63f811553d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:36.855585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510a00a-d79e-4a47-852b-7d63f811553d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:36.855869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510a00a-d79e-4a47-852b-7d63f811553d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:36.856211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510a00a-d79e-4a47-852b-7d63f811553d admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:36.856949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510a00a-d79e-4a47-852b-7d63f811553d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:36.857259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510a00a-d79e-4a47-852b-7d63f811553d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:36.858950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510a00a-d79e-4a47-852b-7d63f811553d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:36.871277 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3630/7224] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:36.875769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11d73d-2ee9-487a-9091-ace0c4df32e9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:36.885576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11d73d-2ee9-487a-9091-ace0c4df32e9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:36.890784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10382ac0-7eda-446a-9fae-e65f6de828e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:36.891441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10382ac0-7eda-446a-9fae-e65f6de828e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:36.891700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10382ac0-7eda-446a-9fae-e65f6de828e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:36.891994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10382ac0-7eda-446a-9fae-e65f6de828e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:36.892711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10382ac0-7eda-446a-9fae-e65f6de828e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:36.894654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10382ac0-7eda-446a-9fae-e65f6de828e6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:36.923248 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3595/7225] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:36 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:36.927781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510a00a-d79e-4a47-852b-7d63f811553d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:36.938418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510a00a-d79e-4a47-852b-7d63f811553d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:36.958692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:36.999626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488654ec-e62f-4f9f-9db4-d29b83b1e197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:37.000332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488654ec-e62f-4f9f-9db4-d29b83b1e197 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:37.000613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488654ec-e62f-4f9f-9db4-d29b83b1e197 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:37.000889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488654ec-e62f-4f9f-9db4-d29b83b1e197 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:37.001585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488654ec-e62f-4f9f-9db4-d29b83b1e197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:37.003509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488654ec-e62f-4f9f-9db4-d29b83b1e197 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:37.025876 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3631/7226] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:36 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:37.030253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10382ac0-7eda-446a-9fae-e65f6de828e6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:37.040816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10382ac0-7eda-446a-9fae-e65f6de828e6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:37.046640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da54e4-77f2-4b7c-865b-6f8cca4ee161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:37.047305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da54e4-77f2-4b7c-865b-6f8cca4ee161 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:37.047616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da54e4-77f2-4b7c-865b-6f8cca4ee161 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:37.047881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da54e4-77f2-4b7c-865b-6f8cca4ee161 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:37.048671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da54e4-77f2-4b7c-865b-6f8cca4ee161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:37.050279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da54e4-77f2-4b7c-865b-6f8cca4ee161 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:37.061837 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3596/7227] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:37.066066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488654ec-e62f-4f9f-9db4-d29b83b1e197 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:37.076574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488654ec-e62f-4f9f-9db4-d29b83b1e197 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:37.082485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3225e6c-a077-4804-8f96-e2d19962ef37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:37.083177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3225e6c-a077-4804-8f96-e2d19962ef37 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:37.083420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3225e6c-a077-4804-8f96-e2d19962ef37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:37.083712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3225e6c-a077-4804-8f96-e2d19962ef37 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:37.084514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3225e6c-a077-4804-8f96-e2d19962ef37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:37.086137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3225e6c-a077-4804-8f96-e2d19962ef37 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:37.097116 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3632/7228] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:37.101653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da54e4-77f2-4b7c-865b-6f8cca4ee161 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:37.107077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:37.114046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da54e4-77f2-4b7c-865b-6f8cca4ee161 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:37.120193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2c8f3-d332-40e7-b94b-a0e6aae6d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:37.121085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2c8f3-d332-40e7-b94b-a0e6aae6d215 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:37.121366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2c8f3-d332-40e7-b94b-a0e6aae6d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:37.121643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2c8f3-d332-40e7-b94b-a0e6aae6d215 admin admin] PATH_INFO: `/v3/projects/432dcf53803f4693881ca00d57f70011/users/f2b7019dbf244c738280cdb3411625de/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:37.136724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2c8f3-d332-40e7-b94b-a0e6aae6d215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=432dcf53803f4693881ca00d57f70011, user_id=f2b7019dbf244c738280cdb3411625de, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:37.139369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2c8f3-d332-40e7-b94b-a0e6aae6d215 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:37.153335 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3597/7229] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:37 2022] PUT /identity/v3/projects/432dcf53803f4693881ca00d57f70011/users/f2b7019dbf244c738280cdb3411625de/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:37.163967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deab6f9-34f4-4bbd-b41a-4e6a2e000b00 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:37.164293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deab6f9-34f4-4bbd-b41a-4e6a2e000b00 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:37.164686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deab6f9-34f4-4bbd-b41a-4e6a2e000b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:37.193247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7deab6f9-34f4-4bbd-b41a-4e6a2e000b00 None None] MFA Rules not processed for user `f2b7019dbf244c738280cdb3411625de`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:37.194400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7deab6f9-34f4-4bbd-b41a-4e6a2e000b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:37.261710 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3633/7230] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:37.266447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2c8f3-d332-40e7-b94b-a0e6aae6d215 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:37.333922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2c8f3-d332-40e7-b94b-a0e6aae6d215 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:37.339265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69ae41-926a-4d10-b9e5-383c2994a947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:37.339924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69ae41-926a-4d10-b9e5-383c2994a947 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:37.340245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69ae41-926a-4d10-b9e5-383c2994a947 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:37.340530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69ae41-926a-4d10-b9e5-383c2994a947 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:37.341215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69ae41-926a-4d10-b9e5-383c2994a947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:37.343163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69ae41-926a-4d10-b9e5-383c2994a947 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:37.370300 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3598/7231] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:37 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:37.374988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deab6f9-34f4-4bbd-b41a-4e6a2e000b00 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:37.386959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deab6f9-34f4-4bbd-b41a-4e6a2e000b00 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:37.448815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b43f4-ca51-48ee-8043-3e41df743112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:37.449425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b43f4-ca51-48ee-8043-3e41df743112 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:37.449713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b43f4-ca51-48ee-8043-3e41df743112 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:37.449989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b43f4-ca51-48ee-8043-3e41df743112 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:37.450730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b43f4-ca51-48ee-8043-3e41df743112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:37.452955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b43f4-ca51-48ee-8043-3e41df743112 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:37.478148 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3634/7232] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:37 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:37.479400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69ae41-926a-4d10-b9e5-383c2994a947 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:37.492364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69ae41-926a-4d10-b9e5-383c2994a947 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:37.498274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26122f2e-84f8-4157-93c4-e23f7be34ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:37.498955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26122f2e-84f8-4157-93c4-e23f7be34ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:37.499239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26122f2e-84f8-4157-93c4-e23f7be34ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:37.499514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26122f2e-84f8-4157-93c4-e23f7be34ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:37.500423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26122f2e-84f8-4157-93c4-e23f7be34ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:37.502105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26122f2e-84f8-4157-93c4-e23f7be34ec3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:37.514066 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3599/7233] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:29:37.518509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b43f4-ca51-48ee-8043-3e41df743112 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:37.528936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b43f4-ca51-48ee-8043-3e41df743112 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:37.534436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc9bd2-3477-4f4e-a487-3c71ac3e4714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:37.535437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc9bd2-3477-4f4e-a487-3c71ac3e4714 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:37.535720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc9bd2-3477-4f4e-a487-3c71ac3e4714 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:37.535992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc9bd2-3477-4f4e-a487-3c71ac3e4714 admin admin] PATH_INFO: `/v3/projects/09f728784eb84c5dbfd1908521ba9d6d/users/aa04910a585a4a5b8197ac5483dbf10f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:37.551920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc9bd2-3477-4f4e-a487-3c71ac3e4714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f728784eb84c5dbfd1908521ba9d6d, user_id=aa04910a585a4a5b8197ac5483dbf10f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:37.555004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc9bd2-3477-4f4e-a487-3c71ac3e4714 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:37.558310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:37.573686 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3635/7234] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:37 2022] PUT /identity/v3/projects/09f728784eb84c5dbfd1908521ba9d6d/users/aa04910a585a4a5b8197ac5483dbf10f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:37.575401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26122f2e-84f8-4157-93c4-e23f7be34ec3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:37.585957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26122f2e-84f8-4157-93c4-e23f7be34ec3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:37.649852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03c341-4398-413f-bc62-62db3c167474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:37.650531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03c341-4398-413f-bc62-62db3c167474 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:37.650813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03c341-4398-413f-bc62-62db3c167474 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:37.651087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03c341-4398-413f-bc62-62db3c167474 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:37.651807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03c341-4398-413f-bc62-62db3c167474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:37.653473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03c341-4398-413f-bc62-62db3c167474 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:37.667423 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3600/7235] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:37.668927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc9bd2-3477-4f4e-a487-3c71ac3e4714 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:37.680732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc9bd2-3477-4f4e-a487-3c71ac3e4714 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:37.685598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88298c7d-6843-4068-ada6-5b596d69c989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:37.686389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88298c7d-6843-4068-ada6-5b596d69c989 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:37.686669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88298c7d-6843-4068-ada6-5b596d69c989 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:37.687235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88298c7d-6843-4068-ada6-5b596d69c989 admin admin] PATH_INFO: `/v3/projects/09f728784eb84c5dbfd1908521ba9d6d/users/aa04910a585a4a5b8197ac5483dbf10f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:37.689295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88298c7d-6843-4068-ada6-5b596d69c989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f728784eb84c5dbfd1908521ba9d6d, user_id=aa04910a585a4a5b8197ac5483dbf10f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:37.691999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88298c7d-6843-4068-ada6-5b596d69c989 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:37.702961 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3636/7236] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:37 2022] PUT /identity/v3/projects/09f728784eb84c5dbfd1908521ba9d6d/users/aa04910a585a4a5b8197ac5483dbf10f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:37.714285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c234c-9259-4b81-ab7c-8aa6c97e9d67 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:37.714654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c234c-9259-4b81-ab7c-8aa6c97e9d67 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:37.715027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c234c-9259-4b81-ab7c-8aa6c97e9d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:37.748127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-563c234c-9259-4b81-ab7c-8aa6c97e9d67 None None] MFA Rules not processed for user `aa04910a585a4a5b8197ac5483dbf10f`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:37.748127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-563c234c-9259-4b81-ab7c-8aa6c97e9d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:37.766065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88298c7d-6843-4068-ada6-5b596d69c989 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:37.767804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-88298c7d-6843-4068-ada6-5b596d69c989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:37.787692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:37.826493 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3601/7237] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:37.839596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c234c-9259-4b81-ab7c-8aa6c97e9d67 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:37.840331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88298c7d-6843-4068-ada6-5b596d69c989 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:37.840898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-563c234c-9259-4b81-ab7c-8aa6c97e9d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:37.845655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bb382-d596-4ac9-9126-9cce3ea7f4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:37.846630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bb382-d596-4ac9-9126-9cce3ea7f4cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:37.846942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bb382-d596-4ac9-9126-9cce3ea7f4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:37.847223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bb382-d596-4ac9-9126-9cce3ea7f4cf admin admin] PATH_INFO: `/v3/users/1fed24436f96416ebfb6d68183f0d28d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:37.848914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bb382-d596-4ac9-9126-9cce3ea7f4cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fed24436f96416ebfb6d68183f0d28d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:37.850993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bb382-d596-4ac9-9126-9cce3ea7f4cf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:37.904282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c234c-9259-4b81-ab7c-8aa6c97e9d67 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:37.915843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400d5f2-545e-4574-b931-1bcc93bac5d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:37.916544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400d5f2-545e-4574-b931-1bcc93bac5d4 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:37.916827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400d5f2-545e-4574-b931-1bcc93bac5d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:37.917103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400d5f2-545e-4574-b931-1bcc93bac5d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:37.918673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-de0bb382-d596-4ac9-9126-9cce3ea7f4cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fed24436f96416ebfb6d68183f0d28d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:37.926136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-de0bb382-d596-4ac9-9126-9cce3ea7f4cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fed24436f96416ebfb6d68183f0d28d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:37.926819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-de0bb382-d596-4ac9-9126-9cce3ea7f4cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fed24436f96416ebfb6d68183f0d28d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:37.927438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-de0bb382-d596-4ac9-9126-9cce3ea7f4cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fed24436f96416ebfb6d68183f0d28d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:37.927588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400d5f2-545e-4574-b931-1bcc93bac5d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:37.929441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400d5f2-545e-4574-b931-1bcc93bac5d4 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:37.935104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-de0bb382-d596-4ac9-9126-9cce3ea7f4cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fed24436f96416ebfb6d68183f0d28d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:37.939150 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3602/7238] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:37.953853 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3637/7239] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:37 2022] DELETE /identity/v3/users/1fed24436f96416ebfb6d68183f0d28d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:37.958434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5b89a-2e75-448f-83d8-b53892147714 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:37.958728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5b89a-2e75-448f-83d8-b53892147714 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:37.959010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5b89a-2e75-448f-83d8-b53892147714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:37.980445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-94e5b89a-2e75-448f-83d8-b53892147714 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:37.981668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-94e5b89a-2e75-448f-83d8-b53892147714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:38.022118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bb382-d596-4ac9-9126-9cce3ea7f4cf admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:38.024009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-de0bb382-d596-4ac9-9126-9cce3ea7f4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:38.046150 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3603/7240] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:38.056581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5b89a-2e75-448f-83d8-b53892147714 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:38.057925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-94e5b89a-2e75-448f-83d8-b53892147714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:38.097539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bb382-d596-4ac9-9126-9cce3ea7f4cf admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:38.101925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456a917-b4d6-4e0a-869f-e004dfd1fc23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:38.102575 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456a917-b4d6-4e0a-869f-e004dfd1fc23 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:38.102920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456a917-b4d6-4e0a-869f-e004dfd1fc23 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:38.103247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456a917-b4d6-4e0a-869f-e004dfd1fc23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:38.105963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0456a917-b4d6-4e0a-869f-e004dfd1fc23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:38.120778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:38.127255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5b89a-2e75-448f-83d8-b53892147714 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:38.130999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ac4c2-1a50-47fe-a07e-6099f1876a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:38.131675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ac4c2-1a50-47fe-a07e-6099f1876a28 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:38.131956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ac4c2-1a50-47fe-a07e-6099f1876a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:38.132267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ac4c2-1a50-47fe-a07e-6099f1876a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:38.142104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ac4c2-1a50-47fe-a07e-6099f1876a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:38.143579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ac4c2-1a50-47fe-a07e-6099f1876a28 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:38.153661 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3604/7241] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:38.173005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456a917-b4d6-4e0a-869f-e004dfd1fc23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:38.174472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456a917-b4d6-4e0a-869f-e004dfd1fc23 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:38.184360 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3638/7242] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:38.482111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ac4c2-1a50-47fe-a07e-6099f1876a28 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:38.485365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-061ac4c2-1a50-47fe-a07e-6099f1876a28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:38.511062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ac4c2-1a50-47fe-a07e-6099f1876a28 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:38.521667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a59c1-5e60-47b8-a137-e9d81ed0747b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:38.522709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a59c1-5e60-47b8-a137-e9d81ed0747b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:38.523227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a59c1-5e60-47b8-a137-e9d81ed0747b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:38.523521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a59c1-5e60-47b8-a137-e9d81ed0747b admin admin] PATH_INFO: `/v3/projects/43d4ccb8f0a44c24aee8bc553d82f8c9` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:38.537957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a59c1-5e60-47b8-a137-e9d81ed0747b admin admin] RBAC: Authorizing `identity:delete_project(project_id=43d4ccb8f0a44c24aee8bc553d82f8c9)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:38.545395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a59c1-5e60-47b8-a137-e9d81ed0747b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:38.563678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:38.595138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-352a59c1-5e60-47b8-a137-e9d81ed0747b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43d4ccb8f0a44c24aee8bc553d82f8c9', 'request_id': 'req-352a59c1-5e60-47b8-a137-e9d81ed0747b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:38.601543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-352a59c1-5e60-47b8-a137-e9d81ed0747b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43d4ccb8f0a44c24aee8bc553d82f8c9', 'request_id': 'req-352a59c1-5e60-47b8-a137-e9d81ed0747b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:38.607492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-352a59c1-5e60-47b8-a137-e9d81ed0747b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43d4ccb8f0a44c24aee8bc553d82f8c9', 'request_id': 'req-352a59c1-5e60-47b8-a137-e9d81ed0747b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:38.621727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-352a59c1-5e60-47b8-a137-e9d81ed0747b admin admin] The token cache is being invalidate because project 43d4ccb8f0a44c24aee8bc553d82f8c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:38.622012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-352a59c1-5e60-47b8-a137-e9d81ed0747b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:38.622661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-352a59c1-5e60-47b8-a137-e9d81ed0747b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:38.624374 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3605/7243] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:38 2022] DELETE /identity/v3/projects/43d4ccb8f0a44c24aee8bc553d82f8c9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:38.628538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456a917-b4d6-4e0a-869f-e004dfd1fc23 service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:38.639904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456a917-b4d6-4e0a-869f-e004dfd1fc23 service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:38.699372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076d104-2e8d-4ab4-a02f-3a3a023a0d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:38.700287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076d104-2e8d-4ab4-a02f-3a3a023a0d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:38.700567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076d104-2e8d-4ab4-a02f-3a3a023a0d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:38.700838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076d104-2e8d-4ab4-a02f-3a3a023a0d2b admin admin] PATH_INFO: `/v3/users/8ebec638f48942ed83fdf09437d88e4b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:38.702021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076d104-2e8d-4ab4-a02f-3a3a023a0d2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ebec638f48942ed83fdf09437d88e4b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:38.703957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076d104-2e8d-4ab4-a02f-3a3a023a0d2b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:38.751067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9076d104-2e8d-4ab4-a02f-3a3a023a0d2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ebec638f48942ed83fdf09437d88e4b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:38.759529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9076d104-2e8d-4ab4-a02f-3a3a023a0d2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ebec638f48942ed83fdf09437d88e4b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:38.760203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9076d104-2e8d-4ab4-a02f-3a3a023a0d2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ebec638f48942ed83fdf09437d88e4b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:38.760849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9076d104-2e8d-4ab4-a02f-3a3a023a0d2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ebec638f48942ed83fdf09437d88e4b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:38.768573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9076d104-2e8d-4ab4-a02f-3a3a023a0d2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ebec638f48942ed83fdf09437d88e4b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:38.788759 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3639/7244] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:38 2022] DELETE /identity/v3/users/8ebec638f48942ed83fdf09437d88e4b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:38.957439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a59c1-5e60-47b8-a137-e9d81ed0747b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:38.959323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-352a59c1-5e60-47b8-a137-e9d81ed0747b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:38.971909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a59c1-5e60-47b8-a137-e9d81ed0747b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:39.031613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f1292-f92c-4028-ad4b-54e48c6e8fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:39.032545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f1292-f92c-4028-ad4b-54e48c6e8fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:39.032823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f1292-f92c-4028-ad4b-54e48c6e8fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:39.033088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f1292-f92c-4028-ad4b-54e48c6e8fe6 admin admin] PATH_INFO: `/v3/users/e531117f50124183adfa6a09b5f2d0b7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:39.034295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f1292-f92c-4028-ad4b-54e48c6e8fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e531117f50124183adfa6a09b5f2d0b7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:39.036255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f1292-f92c-4028-ad4b-54e48c6e8fe6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:39.081511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076d104-2e8d-4ab4-a02f-3a3a023a0d2b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:39.082963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9076d104-2e8d-4ab4-a02f-3a3a023a0d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:39.097278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076d104-2e8d-4ab4-a02f-3a3a023a0d2b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:39.101544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fb1f2-1d7f-469a-9be8-4e6db7628980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:39.102420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fb1f2-1d7f-469a-9be8-4e6db7628980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:39.102707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fb1f2-1d7f-469a-9be8-4e6db7628980 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:39.103263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fb1f2-1d7f-469a-9be8-4e6db7628980 admin admin] PATH_INFO: `/v3/projects/207151fc1ba849e08ff0f8fac1631856` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:39.104440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fb1f2-1d7f-469a-9be8-4e6db7628980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=207151fc1ba849e08ff0f8fac1631856)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:39.106475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fb1f2-1d7f-469a-9be8-4e6db7628980 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:39.108263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7f3f1292-f92c-4028-ad4b-54e48c6e8fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e531117f50124183adfa6a09b5f2d0b7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:39.120475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7f3f1292-f92c-4028-ad4b-54e48c6e8fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e531117f50124183adfa6a09b5f2d0b7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:39.129261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7f3f1292-f92c-4028-ad4b-54e48c6e8fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e531117f50124183adfa6a09b5f2d0b7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:39.130343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7f3f1292-f92c-4028-ad4b-54e48c6e8fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e531117f50124183adfa6a09b5f2d0b7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:39.130951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7f3f1292-f92c-4028-ad4b-54e48c6e8fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e531117f50124183adfa6a09b5f2d0b7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:39.144014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:39.150828 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3606/7245] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:38 2022] DELETE /identity/v3/users/e531117f50124183adfa6a09b5f2d0b7 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:39.155499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018758c-fd3a-4490-b1e2-786c55cc8261 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:39.155796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018758c-fd3a-4490-b1e2-786c55cc8261 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:39.156105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018758c-fd3a-4490-b1e2-786c55cc8261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:39.159599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c96fb1f2-1d7f-469a-9be8-4e6db7628980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207151fc1ba849e08ff0f8fac1631856', 'request_id': 'req-c96fb1f2-1d7f-469a-9be8-4e6db7628980'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:39.167758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c96fb1f2-1d7f-469a-9be8-4e6db7628980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207151fc1ba849e08ff0f8fac1631856', 'request_id': 'req-c96fb1f2-1d7f-469a-9be8-4e6db7628980'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:39.174336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c96fb1f2-1d7f-469a-9be8-4e6db7628980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207151fc1ba849e08ff0f8fac1631856', 'request_id': 'req-c96fb1f2-1d7f-469a-9be8-4e6db7628980'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:39.175826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0018758c-fd3a-4490-b1e2-786c55cc8261 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:39.177134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0018758c-fd3a-4490-b1e2-786c55cc8261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:39.186030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c96fb1f2-1d7f-469a-9be8-4e6db7628980 admin admin] The token cache is being invalidate because project 207151fc1ba849e08ff0f8fac1631856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:39.186365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c96fb1f2-1d7f-469a-9be8-4e6db7628980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:39.187026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c96fb1f2-1d7f-469a-9be8-4e6db7628980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:39.188646 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3640/7246] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:39 2022] DELETE /identity/v3/projects/207151fc1ba849e08ff0f8fac1631856 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:39.193444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3150a7-9af9-4aee-bbae-31870bde224d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:39.193736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3150a7-9af9-4aee-bbae-31870bde224d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:39.194009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3150a7-9af9-4aee-bbae-31870bde224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:39.194603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:39.212675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6f3150a7-9af9-4aee-bbae-31870bde224d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:39.213883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6f3150a7-9af9-4aee-bbae-31870bde224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:39.241340 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3607/7247] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:39.251178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018758c-fd3a-4490-b1e2-786c55cc8261 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:39.252555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0018758c-fd3a-4490-b1e2-786c55cc8261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:39.273253 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3641/7248] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:39.281020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca77f9c-c6a7-468a-afad-feb84d3e75dd None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:39.281309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca77f9c-c6a7-468a-afad-feb84d3e75dd None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:39.281597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca77f9c-c6a7-468a-afad-feb84d3e75dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:39.299215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1ca77f9c-c6a7-468a-afad-feb84d3e75dd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:39.300456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1ca77f9c-c6a7-468a-afad-feb84d3e75dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:39.310244 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3642/7249] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:39.313071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018758c-fd3a-4490-b1e2-786c55cc8261 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:39.314566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca77f9c-c6a7-468a-afad-feb84d3e75dd None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:39.316863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05198422-ff6f-47dc-8a47-47ccdbb0c0a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:39.317522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05198422-ff6f-47dc-8a47-47ccdbb0c0a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:39.317809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05198422-ff6f-47dc-8a47-47ccdbb0c0a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:39.318367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05198422-ff6f-47dc-8a47-47ccdbb0c0a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:39.323629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca77f9c-c6a7-468a-afad-feb84d3e75dd None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:39.328546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed566c-23f8-424b-b08c-4e5619ce0301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:39.329000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed566c-23f8-424b-b08c-4e5619ce0301 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:39.329281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed566c-23f8-424b-b08c-4e5619ce0301 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:39.329557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed566c-23f8-424b-b08c-4e5619ce0301 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:39.330068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05198422-ff6f-47dc-8a47-47ccdbb0c0a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:39.330274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed566c-23f8-424b-b08c-4e5619ce0301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:39.330583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed566c-23f8-424b-b08c-4e5619ce0301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:39.331559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05198422-ff6f-47dc-8a47-47ccdbb0c0a6 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:39.332282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed566c-23f8-424b-b08c-4e5619ce0301 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:39.341425 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3608/7250] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:39.344355 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3643/7251] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:39.348603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05198422-ff6f-47dc-8a47-47ccdbb0c0a6 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:39.358734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05198422-ff6f-47dc-8a47-47ccdbb0c0a6 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:39.363888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82914275-3342-41db-ab3c-af97680dd47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:39.364593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82914275-3342-41db-ab3c-af97680dd47a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:39.364877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82914275-3342-41db-ab3c-af97680dd47a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:39.365155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82914275-3342-41db-ab3c-af97680dd47a admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:39.365843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82914275-3342-41db-ab3c-af97680dd47a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:39.367752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82914275-3342-41db-ab3c-af97680dd47a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:39.397101 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3609/7252] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:39 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:39.401509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed566c-23f8-424b-b08c-4e5619ce0301 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:39.413033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed566c-23f8-424b-b08c-4e5619ce0301 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:39.472702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f51732-2e61-460c-84d2-a5cc078ad1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:39.473382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f51732-2e61-460c-84d2-a5cc078ad1fd admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:39.473668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f51732-2e61-460c-84d2-a5cc078ad1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:39.473942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f51732-2e61-460c-84d2-a5cc078ad1fd admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:39.474631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f51732-2e61-460c-84d2-a5cc078ad1fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:39.476635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f51732-2e61-460c-84d2-a5cc078ad1fd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:39.498992 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3644/7253] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:39 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:39.503726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82914275-3342-41db-ab3c-af97680dd47a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:39.515318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82914275-3342-41db-ab3c-af97680dd47a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:39.520984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163ef30-2612-49e2-adf5-05db7799b5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:39.521954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163ef30-2612-49e2-adf5-05db7799b5cc admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:39.522511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163ef30-2612-49e2-adf5-05db7799b5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:39.522511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163ef30-2612-49e2-adf5-05db7799b5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:39.524250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163ef30-2612-49e2-adf5-05db7799b5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:39.525726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163ef30-2612-49e2-adf5-05db7799b5cc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:39.537922 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3610/7254] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:39.541737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f51732-2e61-460c-84d2-a5cc078ad1fd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:39.554285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f51732-2e61-460c-84d2-a5cc078ad1fd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:39.564684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd9603-df04-4c3d-98ed-d9190257bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:39.564684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9603-df04-4c3d-98ed-d9190257bf96 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:39.564684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9603-df04-4c3d-98ed-d9190257bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:39.564684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9603-df04-4c3d-98ed-d9190257bf96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:39.565063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd9603-df04-4c3d-98ed-d9190257bf96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:39.565063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd9603-df04-4c3d-98ed-d9190257bf96 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:39.578682 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3645/7255] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:39.582783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163ef30-2612-49e2-adf5-05db7799b5cc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:39.597299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163ef30-2612-49e2-adf5-05db7799b5cc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:39.609558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e37ba-a791-4b00-8410-74faa902ee44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:39.610568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e37ba-a791-4b00-8410-74faa902ee44 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:39.610922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e37ba-a791-4b00-8410-74faa902ee44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:39.611331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e37ba-a791-4b00-8410-74faa902ee44 admin admin] PATH_INFO: `/v3/projects/d2ea4ac896b64fe6a6338327dfe8f04f/users/2c190c48078343bea8dda367867994b4/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:39.632452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e37ba-a791-4b00-8410-74faa902ee44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ea4ac896b64fe6a6338327dfe8f04f, user_id=2c190c48078343bea8dda367867994b4, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:39.636410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e37ba-a791-4b00-8410-74faa902ee44 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:39.637709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd9603-df04-4c3d-98ed-d9190257bf96 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:39.640069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-91fd9603-df04-4c3d-98ed-d9190257bf96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:39.658216 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3611/7256] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:39 2022] PUT /identity/v3/projects/d2ea4ac896b64fe6a6338327dfe8f04f/users/2c190c48078343bea8dda367867994b4/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:39.659218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd9603-df04-4c3d-98ed-d9190257bf96 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:39.682093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:39.750119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112601f-b3fa-40f8-a938-c1c1605ac36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:39.751507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112601f-b3fa-40f8-a938-c1c1605ac36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:39.751793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112601f-b3fa-40f8-a938-c1c1605ac36c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:39.752236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112601f-b3fa-40f8-a938-c1c1605ac36c admin admin] PATH_INFO: `/v3/projects/c1b4e97dcb6c4d7ba62d67b02cf3bfca` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:39.755499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112601f-b3fa-40f8-a938-c1c1605ac36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b4e97dcb6c4d7ba62d67b02cf3bfca)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:39.758010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112601f-b3fa-40f8-a938-c1c1605ac36c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:39.770902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21036eb-50f6-4352-b2ad-b37246383ea1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:39.771193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21036eb-50f6-4352-b2ad-b37246383ea1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:39.771464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21036eb-50f6-4352-b2ad-b37246383ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:39.804860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d21036eb-50f6-4352-b2ad-b37246383ea1 None None] MFA Rules not processed for user `2c190c48078343bea8dda367867994b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:39.806132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d21036eb-50f6-4352-b2ad-b37246383ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:39.816729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8112601f-b3fa-40f8-a938-c1c1605ac36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'request_id': 'req-8112601f-b3fa-40f8-a938-c1c1605ac36c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:39.825593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8112601f-b3fa-40f8-a938-c1c1605ac36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'request_id': 'req-8112601f-b3fa-40f8-a938-c1c1605ac36c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:39.835246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8112601f-b3fa-40f8-a938-c1c1605ac36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'request_id': 'req-8112601f-b3fa-40f8-a938-c1c1605ac36c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:39.852353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8112601f-b3fa-40f8-a938-c1c1605ac36c admin admin] The token cache is being invalidate because project c1b4e97dcb6c4d7ba62d67b02cf3bfca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:39.852564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8112601f-b3fa-40f8-a938-c1c1605ac36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:39.853302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-8112601f-b3fa-40f8-a938-c1c1605ac36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:39.855551 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3646/7257] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:39 2022] DELETE /identity/v3/projects/c1b4e97dcb6c4d7ba62d67b02cf3bfca => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:39.860489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72ebe8-faaa-4d84-b5f3-04db20ce1a71 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:39.860765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72ebe8-faaa-4d84-b5f3-04db20ce1a71 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:39.861337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72ebe8-faaa-4d84-b5f3-04db20ce1a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:39.879432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:39.880819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-cb72ebe8-faaa-4d84-b5f3-04db20ce1a71 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:39.882116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cb72ebe8-faaa-4d84-b5f3-04db20ce1a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:39.888185 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3612/7258] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:39.890253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21036eb-50f6-4352-b2ad-b37246383ea1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:39.891638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d21036eb-50f6-4352-b2ad-b37246383ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:39.950242 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3647/7259] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:39.958333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ea446-7961-48ef-9668-eda000cffb71 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:39.958591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ea446-7961-48ef-9668-eda000cffb71 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:39.958870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ea446-7961-48ef-9668-eda000cffb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:39.972847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21036eb-50f6-4352-b2ad-b37246383ea1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:39.982741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b22ea446-7961-48ef-9668-eda000cffb71 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:39.984012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b22ea446-7961-48ef-9668-eda000cffb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:39.984466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dee97-0451-4ea4-a1e0-5b6e60439b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:39.985306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dee97-0451-4ea4-a1e0-5b6e60439b7c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:39.985650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dee97-0451-4ea4-a1e0-5b6e60439b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:39.985985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dee97-0451-4ea4-a1e0-5b6e60439b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:39.986746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06dee97-0451-4ea4-a1e0-5b6e60439b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:39.989513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06dee97-0451-4ea4-a1e0-5b6e60439b7c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:39.995090 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3648/7260] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:40.000510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ea446-7961-48ef-9668-eda000cffb71 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:40.012062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ea446-7961-48ef-9668-eda000cffb71 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:40.019644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e1aeb-6d52-47b1-8d9b-131985deb465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:40.021139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e1aeb-6d52-47b1-8d9b-131985deb465 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:40.021429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e1aeb-6d52-47b1-8d9b-131985deb465 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:40.021705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e1aeb-6d52-47b1-8d9b-131985deb465 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:40.024079 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3613/7261] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:39 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:40.024245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e1aeb-6d52-47b1-8d9b-131985deb465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:40.024245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e1aeb-6d52-47b1-8d9b-131985deb465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:40.024642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e1aeb-6d52-47b1-8d9b-131985deb465 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:40.026685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dee97-0451-4ea4-a1e0-5b6e60439b7c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:40.044095 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3649/7262] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:40.046665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e1aeb-6d52-47b1-8d9b-131985deb465 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:40.057037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e1aeb-6d52-47b1-8d9b-131985deb465 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:40.095526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:40.106172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dee97-0451-4ea4-a1e0-5b6e60439b7c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:40.112304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03223b35-10b8-4968-bcdc-c2060c16564c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:40.113456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03223b35-10b8-4968-bcdc-c2060c16564c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:40.114048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03223b35-10b8-4968-bcdc-c2060c16564c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:40.114373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03223b35-10b8-4968-bcdc-c2060c16564c admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:40.115109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03223b35-10b8-4968-bcdc-c2060c16564c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:40.117087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03223b35-10b8-4968-bcdc-c2060c16564c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:40.141234 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3614/7263] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:40 2022] POST /identity/v3/users => generated 300 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:40.144006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb7808-c851-474b-927a-efedbea386f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:40.144754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb7808-c851-474b-927a-efedbea386f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:40.145058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb7808-c851-474b-927a-efedbea386f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:40.145304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03223b35-10b8-4968-bcdc-c2060c16564c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:40.145439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb7808-c851-474b-927a-efedbea386f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:40.146038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb7808-c851-474b-927a-efedbea386f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:40.148221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb7808-c851-474b-927a-efedbea386f2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:40.156480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03223b35-10b8-4968-bcdc-c2060c16564c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:40.162395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1e696-e969-43a2-91cc-a8205b70bdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:40.163218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1e696-e969-43a2-91cc-a8205b70bdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:40.163488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1e696-e969-43a2-91cc-a8205b70bdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:40.163857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1e696-e969-43a2-91cc-a8205b70bdf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:40.164841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1e696-e969-43a2-91cc-a8205b70bdf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:40.166742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1e696-e969-43a2-91cc-a8205b70bdf0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:40.180620 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3615/7264] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:29:40.182360 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3650/7265] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:40 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:40.184738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb7808-c851-474b-927a-efedbea386f2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:40.187944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1e696-e969-43a2-91cc-a8205b70bdf0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:40.199247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1e696-e969-43a2-91cc-a8205b70bdf0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:40.266533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb7808-c851-474b-927a-efedbea386f2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:40.271783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9d9c0-266f-4466-a767-b54a8c396ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:40.272755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9d9c0-266f-4466-a767-b54a8c396ade admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:40.273046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9d9c0-266f-4466-a767-b54a8c396ade admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:40.273324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9d9c0-266f-4466-a767-b54a8c396ade admin admin] PATH_INFO: `/v3/projects/5ed3c46669e54043b21c8143282c5b54/users/5b4e19a477614c58953f2fbd6f7527bf/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:40.273881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c5648-8b1d-4b47-84d2-ec295841d942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:40.274729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c5648-8b1d-4b47-84d2-ec295841d942 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:40.275013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c5648-8b1d-4b47-84d2-ec295841d942 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:40.275286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c5648-8b1d-4b47-84d2-ec295841d942 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:40.276115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c5648-8b1d-4b47-84d2-ec295841d942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:40.278166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c5648-8b1d-4b47-84d2-ec295841d942 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:40.288733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:40.293284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9d9c0-266f-4466-a767-b54a8c396ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed3c46669e54043b21c8143282c5b54, user_id=5b4e19a477614c58953f2fbd6f7527bf, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:40.297043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9d9c0-266f-4466-a767-b54a8c396ade admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:40.309372 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3616/7266] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:40 2022] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:40.310662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c5648-8b1d-4b47-84d2-ec295841d942 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:40.316533 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3651/7267] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:40 2022] PUT /identity/v3/projects/5ed3c46669e54043b21c8143282c5b54/users/5b4e19a477614c58953f2fbd6f7527bf/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:40.320790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9d9c0-266f-4466-a767-b54a8c396ade admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:40.324851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c5648-8b1d-4b47-84d2-ec295841d942 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:40.398088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7438937-3251-415c-9714-681f296ea828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:40.398832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7438937-3251-415c-9714-681f296ea828 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:40.399772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7438937-3251-415c-9714-681f296ea828 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:40.399772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7438937-3251-415c-9714-681f296ea828 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:40.400483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7438937-3251-415c-9714-681f296ea828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:40.402119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7438937-3251-415c-9714-681f296ea828 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:40.403644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9d9c0-266f-4466-a767-b54a8c396ade admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:40.408992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37996ee2-1a23-4a38-89fe-2c2840aa8cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:40.409678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37996ee2-1a23-4a38-89fe-2c2840aa8cff admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:40.409960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37996ee2-1a23-4a38-89fe-2c2840aa8cff admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:40.410249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37996ee2-1a23-4a38-89fe-2c2840aa8cff admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:40.410970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37996ee2-1a23-4a38-89fe-2c2840aa8cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:40.412825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37996ee2-1a23-4a38-89fe-2c2840aa8cff admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:40.415628 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3617/7268] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:29:40.419669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7438937-3251-415c-9714-681f296ea828 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:40.423945 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3652/7269] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:29:40.428148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37996ee2-1a23-4a38-89fe-2c2840aa8cff admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:40.434373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7438937-3251-415c-9714-681f296ea828 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:40.440692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37996ee2-1a23-4a38-89fe-2c2840aa8cff admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:40.441176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775855f-41b5-40cf-a619-6faa92151027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:40.441970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775855f-41b5-40cf-a619-6faa92151027 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:40.442251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775855f-41b5-40cf-a619-6faa92151027 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:40.442516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775855f-41b5-40cf-a619-6faa92151027 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:40.443268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775855f-41b5-40cf-a619-6faa92151027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:40.445528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775855f-41b5-40cf-a619-6faa92151027 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:40.445673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45750e-aabd-47e5-9354-b5985f1809d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:40.446459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45750e-aabd-47e5-9354-b5985f1809d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:40.446737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45750e-aabd-47e5-9354-b5985f1809d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:40.447015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45750e-aabd-47e5-9354-b5985f1809d6 admin admin] PATH_INFO: `/v3/projects/5ed3c46669e54043b21c8143282c5b54/users/5b4e19a477614c58953f2fbd6f7527bf/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:40.449130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45750e-aabd-47e5-9354-b5985f1809d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed3c46669e54043b21c8143282c5b54, user_id=5b4e19a477614c58953f2fbd6f7527bf, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:40.451895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45750e-aabd-47e5-9354-b5985f1809d6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:40.461396 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3618/7270] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:29:40.465332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775855f-41b5-40cf-a619-6faa92151027 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:40.466010 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3653/7271] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:40 2022] PUT /identity/v3/projects/5ed3c46669e54043b21c8143282c5b54/users/5b4e19a477614c58953f2fbd6f7527bf/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:40.476307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09799eb1-3b6c-4597-9952-e611031d2e84 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:40.476663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09799eb1-3b6c-4597-9952-e611031d2e84 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:40.476946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09799eb1-3b6c-4597-9952-e611031d2e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:40.479260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775855f-41b5-40cf-a619-6faa92151027 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:40.505583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-09799eb1-3b6c-4597-9952-e611031d2e84 None None] MFA Rules not processed for user `5b4e19a477614c58953f2fbd6f7527bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:40.506796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-09799eb1-3b6c-4597-9952-e611031d2e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:40.515911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:40.542081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b855e7-f318-4860-9e33-d6bfc278245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:40.542803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b855e7-f318-4860-9e33-d6bfc278245e admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:40.543508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b855e7-f318-4860-9e33-d6bfc278245e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:40.543508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b855e7-f318-4860-9e33-d6bfc278245e admin admin] PATH_INFO: `/v3/projects/ddda8059d4194d56851b99ee26422965/users/5bf1e57e8a7144669654ca1c229274d7/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:40.559373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b855e7-f318-4860-9e33-d6bfc278245e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddda8059d4194d56851b99ee26422965, user_id=5bf1e57e8a7144669654ca1c229274d7, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:40.562369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b855e7-f318-4860-9e33-d6bfc278245e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:40.577453 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3619/7272] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:40 2022] PUT /identity/v3/projects/ddda8059d4194d56851b99ee26422965/users/5bf1e57e8a7144669654ca1c229274d7/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:40.588805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405ed08-ff51-49f7-b555-e4623563858e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:40.589093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405ed08-ff51-49f7-b555-e4623563858e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:40.589418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405ed08-ff51-49f7-b555-e4623563858e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:40.615586 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3654/7273] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:40.618319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8405ed08-ff51-49f7-b555-e4623563858e None None] MFA Rules not processed for user `5bf1e57e8a7144669654ca1c229274d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:40.619488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8405ed08-ff51-49f7-b555-e4623563858e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:40.630679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09799eb1-3b6c-4597-9952-e611031d2e84 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:40.632378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-09799eb1-3b6c-4597-9952-e611031d2e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:40.677808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:40.710022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09799eb1-3b6c-4597-9952-e611031d2e84 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:40.713052 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3620/7274] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:40.754796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405ed08-ff51-49f7-b555-e4623563858e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:40.756370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8405ed08-ff51-49f7-b555-e4623563858e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:40.770976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf86be-b6c1-4deb-8675-7f5c53edbad4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:40.771629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf86be-b6c1-4deb-8675-7f5c53edbad4 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:40.771910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf86be-b6c1-4deb-8675-7f5c53edbad4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:40.772216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf86be-b6c1-4deb-8675-7f5c53edbad4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:40.816148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405ed08-ff51-49f7-b555-e4623563858e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:40.827280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0e366-295b-4f53-b753-02082a5657b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:40.827977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0e366-295b-4f53-b753-02082a5657b7 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:40.828290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0e366-295b-4f53-b753-02082a5657b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:40.828597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0e366-295b-4f53-b753-02082a5657b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:40.835436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf86be-b6c1-4deb-8675-7f5c53edbad4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:40.836961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf86be-b6c1-4deb-8675-7f5c53edbad4 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:40.837812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0e366-295b-4f53-b753-02082a5657b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:40.839241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0e366-295b-4f53-b753-02082a5657b7 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:40.847635 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3655/7275] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:40.854817 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3621/7276] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:40.982639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf86be-b6c1-4deb-8675-7f5c53edbad4 service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:41.002931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0e366-295b-4f53-b753-02082a5657b7 service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:41.003089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:41.004393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f1a0e366-295b-4f53-b753-02082a5657b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:41.078334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf86be-b6c1-4deb-8675-7f5c53edbad4 service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:41.083852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d451c28-d650-438d-9846-c0cd862c164c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:41.084872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d451c28-d650-438d-9846-c0cd862c164c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:41.085210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d451c28-d650-438d-9846-c0cd862c164c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:41.085559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d451c28-d650-438d-9846-c0cd862c164c admin admin] PATH_INFO: `/v3/users/2c190c48078343bea8dda367867994b4` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:41.086858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d451c28-d650-438d-9846-c0cd862c164c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c190c48078343bea8dda367867994b4)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:41.090703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d451c28-d650-438d-9846-c0cd862c164c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:41.095627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0e366-295b-4f53-b753-02082a5657b7 service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:41.105675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c27c74-6d97-408d-b635-93864c6ffe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:41.107433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c27c74-6d97-408d-b635-93864c6ffe78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:41.108761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c27c74-6d97-408d-b635-93864c6ffe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:41.111288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c27c74-6d97-408d-b635-93864c6ffe78 admin admin] PATH_INFO: `/v3/users/f2b7019dbf244c738280cdb3411625de` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:41.113020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c27c74-6d97-408d-b635-93864c6ffe78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b7019dbf244c738280cdb3411625de)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:41.116721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c27c74-6d97-408d-b635-93864c6ffe78 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:41.167563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0d451c28-d650-438d-9846-c0cd862c164c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c190c48078343bea8dda367867994b4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.176704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b1c27c74-6d97-408d-b635-93864c6ffe78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b7019dbf244c738280cdb3411625de'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.182192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0d451c28-d650-438d-9846-c0cd862c164c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c190c48078343bea8dda367867994b4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.183099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0d451c28-d650-438d-9846-c0cd862c164c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c190c48078343bea8dda367867994b4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.184006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0d451c28-d650-438d-9846-c0cd862c164c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c190c48078343bea8dda367867994b4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.190201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b1c27c74-6d97-408d-b635-93864c6ffe78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b7019dbf244c738280cdb3411625de'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.201579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0d451c28-d650-438d-9846-c0cd862c164c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c190c48078343bea8dda367867994b4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.221248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b1c27c74-6d97-408d-b635-93864c6ffe78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b7019dbf244c738280cdb3411625de'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.223074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b1c27c74-6d97-408d-b635-93864c6ffe78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b7019dbf244c738280cdb3411625de'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.223803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b1c27c74-6d97-408d-b635-93864c6ffe78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b7019dbf244c738280cdb3411625de'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.244904 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3656/7277] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:40 2022] DELETE /identity/v3/users/2c190c48078343bea8dda367867994b4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:41.246911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4458d6-905e-4cf5-952e-d4ca97c11355 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:41.247204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4458d6-905e-4cf5-952e-d4ca97c11355 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:41.247976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4458d6-905e-4cf5-952e-d4ca97c11355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:41.251382 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3622/7278] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:41 2022] DELETE /identity/v3/users/f2b7019dbf244c738280cdb3411625de => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:41.262414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9673b11-7af0-409f-b390-a7bb40cc2279 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:41.262414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9673b11-7af0-409f-b390-a7bb40cc2279 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:41.262414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9673b11-7af0-409f-b390-a7bb40cc2279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:41.270545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3d4458d6-905e-4cf5-952e-d4ca97c11355 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:41.272550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3d4458d6-905e-4cf5-952e-d4ca97c11355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:41.280252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f9673b11-7af0-409f-b390-a7bb40cc2279 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:41.281690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f9673b11-7af0-409f-b390-a7bb40cc2279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:41.296461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:41.338560 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3657/7279] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:41.348343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4458d6-905e-4cf5-952e-d4ca97c11355 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:41.349690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3d4458d6-905e-4cf5-952e-d4ca97c11355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:41.358163 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3623/7280] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:41.367680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9673b11-7af0-409f-b390-a7bb40cc2279 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:41.369083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f9673b11-7af0-409f-b390-a7bb40cc2279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:41.386953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:41.420563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4458d6-905e-4cf5-952e-d4ca97c11355 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:41.424533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca9ab7-1f02-48a2-8c57-664211c14f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:41.425190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca9ab7-1f02-48a2-8c57-664211c14f3e service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:41.425471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca9ab7-1f02-48a2-8c57-664211c14f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:41.425749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca9ab7-1f02-48a2-8c57-664211c14f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:41.431973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9673b11-7af0-409f-b390-a7bb40cc2279 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:41.435561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca9ab7-1f02-48a2-8c57-664211c14f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:41.435706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d8f84-1c23-445e-8ff6-96b474b4a6ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:41.436430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d8f84-1c23-445e-8ff6-96b474b4a6ea service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:41.436710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d8f84-1c23-445e-8ff6-96b474b4a6ea service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:41.437019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d8f84-1c23-445e-8ff6-96b474b4a6ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:41.437141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca9ab7-1f02-48a2-8c57-664211c14f3e service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:41.446486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d8f84-1c23-445e-8ff6-96b474b4a6ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:41.447607 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3658/7281] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:41.447935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d8f84-1c23-445e-8ff6-96b474b4a6ea service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:41.458625 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3624/7282] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:41.819870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca9ab7-1f02-48a2-8c57-664211c14f3e service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:41.822430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7eca9ab7-1f02-48a2-8c57-664211c14f3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:41.832349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d8f84-1c23-445e-8ff6-96b474b4a6ea service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:41.834178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-db9d8f84-1c23-445e-8ff6-96b474b4a6ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:41.837080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca9ab7-1f02-48a2-8c57-664211c14f3e service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:41.841821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd752c-bbd1-45bc-a9c0-f412b75fb5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:41.843412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd752c-bbd1-45bc-a9c0-f412b75fb5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:41.843699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd752c-bbd1-45bc-a9c0-f412b75fb5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:41.843983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd752c-bbd1-45bc-a9c0-f412b75fb5b0 admin admin] PATH_INFO: `/v3/projects/d2ea4ac896b64fe6a6338327dfe8f04f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:41.845211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd752c-bbd1-45bc-a9c0-f412b75fb5b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ea4ac896b64fe6a6338327dfe8f04f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:41.848566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd752c-bbd1-45bc-a9c0-f412b75fb5b0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:41.855156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d8f84-1c23-445e-8ff6-96b474b4a6ea service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:41.861035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010cc85-54bd-4c00-9739-c67ed13e0bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:41.862429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010cc85-54bd-4c00-9739-c67ed13e0bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:41.862727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010cc85-54bd-4c00-9739-c67ed13e0bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:41.863069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010cc85-54bd-4c00-9739-c67ed13e0bd9 admin admin] PATH_INFO: `/v3/projects/432dcf53803f4693881ca00d57f70011` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:41.864386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010cc85-54bd-4c00-9739-c67ed13e0bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=432dcf53803f4693881ca00d57f70011)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:41.866309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010cc85-54bd-4c00-9739-c67ed13e0bd9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:41.902521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88fd752c-bbd1-45bc-a9c0-f412b75fb5b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ea4ac896b64fe6a6338327dfe8f04f', 'request_id': 'req-88fd752c-bbd1-45bc-a9c0-f412b75fb5b0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.910674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88fd752c-bbd1-45bc-a9c0-f412b75fb5b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ea4ac896b64fe6a6338327dfe8f04f', 'request_id': 'req-88fd752c-bbd1-45bc-a9c0-f412b75fb5b0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.917909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88fd752c-bbd1-45bc-a9c0-f412b75fb5b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ea4ac896b64fe6a6338327dfe8f04f', 'request_id': 'req-88fd752c-bbd1-45bc-a9c0-f412b75fb5b0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.918115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d010cc85-54bd-4c00-9739-c67ed13e0bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432dcf53803f4693881ca00d57f70011', 'request_id': 'req-d010cc85-54bd-4c00-9739-c67ed13e0bd9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.924662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d010cc85-54bd-4c00-9739-c67ed13e0bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432dcf53803f4693881ca00d57f70011', 'request_id': 'req-d010cc85-54bd-4c00-9739-c67ed13e0bd9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.928727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88fd752c-bbd1-45bc-a9c0-f412b75fb5b0 admin admin] The token cache is being invalidate because project d2ea4ac896b64fe6a6338327dfe8f04f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:41.929120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88fd752c-bbd1-45bc-a9c0-f412b75fb5b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.929754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88fd752c-bbd1-45bc-a9c0-f412b75fb5b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.930815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d010cc85-54bd-4c00-9739-c67ed13e0bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432dcf53803f4693881ca00d57f70011', 'request_id': 'req-d010cc85-54bd-4c00-9739-c67ed13e0bd9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.931541 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3659/7283] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:41 2022] DELETE /identity/v3/projects/d2ea4ac896b64fe6a6338327dfe8f04f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:41.935822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd752c-bbd1-45bc-a9c0-f412b75fb5b0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:41.937371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-88fd752c-bbd1-45bc-a9c0-f412b75fb5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:41.947204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d010cc85-54bd-4c00-9739-c67ed13e0bd9 admin admin] The token cache is being invalidate because project 432dcf53803f4693881ca00d57f70011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:41.947715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d010cc85-54bd-4c00-9739-c67ed13e0bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.948460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d010cc85-54bd-4c00-9739-c67ed13e0bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:41.950127 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3625/7284] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:41 2022] DELETE /identity/v3/projects/432dcf53803f4693881ca00d57f70011 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:41.954326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010cc85-54bd-4c00-9739-c67ed13e0bd9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:41.956152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d010cc85-54bd-4c00-9739-c67ed13e0bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:41.999195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:42.005257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd752c-bbd1-45bc-a9c0-f412b75fb5b0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:42.024284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010cc85-54bd-4c00-9739-c67ed13e0bd9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:42.028898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901b034-b8da-4a9f-ab52-1a8b94979628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:42.029806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901b034-b8da-4a9f-ab52-1a8b94979628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:42.030083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901b034-b8da-4a9f-ab52-1a8b94979628 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:42.030357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901b034-b8da-4a9f-ab52-1a8b94979628 admin admin] PATH_INFO: `/v3/users/aa04910a585a4a5b8197ac5483dbf10f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:42.031536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901b034-b8da-4a9f-ab52-1a8b94979628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa04910a585a4a5b8197ac5483dbf10f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:42.033489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901b034-b8da-4a9f-ab52-1a8b94979628 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:42.065731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170e8cd-60c0-4ec3-999b-1aa0ea09f17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:42.066631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170e8cd-60c0-4ec3-999b-1aa0ea09f17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:42.066910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170e8cd-60c0-4ec3-999b-1aa0ea09f17a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:42.067221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170e8cd-60c0-4ec3-999b-1aa0ea09f17a admin admin] PATH_INFO: `/v3/users/5b4e19a477614c58953f2fbd6f7527bf` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:42.069035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170e8cd-60c0-4ec3-999b-1aa0ea09f17a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b4e19a477614c58953f2fbd6f7527bf)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:42.071375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170e8cd-60c0-4ec3-999b-1aa0ea09f17a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:42.076178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:42.087500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3901b034-b8da-4a9f-ab52-1a8b94979628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa04910a585a4a5b8197ac5483dbf10f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.101213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3901b034-b8da-4a9f-ab52-1a8b94979628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa04910a585a4a5b8197ac5483dbf10f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.110138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3901b034-b8da-4a9f-ab52-1a8b94979628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa04910a585a4a5b8197ac5483dbf10f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.110815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3901b034-b8da-4a9f-ab52-1a8b94979628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa04910a585a4a5b8197ac5483dbf10f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.111673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3901b034-b8da-4a9f-ab52-1a8b94979628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa04910a585a4a5b8197ac5483dbf10f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.127453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7170e8cd-60c0-4ec3-999b-1aa0ea09f17a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b4e19a477614c58953f2fbd6f7527bf'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.129247 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3626/7285] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:41 2022] DELETE /identity/v3/users/aa04910a585a4a5b8197ac5483dbf10f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:42.136546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7170e8cd-60c0-4ec3-999b-1aa0ea09f17a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b4e19a477614c58953f2fbd6f7527bf'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.137176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7170e8cd-60c0-4ec3-999b-1aa0ea09f17a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b4e19a477614c58953f2fbd6f7527bf'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.137809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7170e8cd-60c0-4ec3-999b-1aa0ea09f17a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b4e19a477614c58953f2fbd6f7527bf'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.146119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7170e8cd-60c0-4ec3-999b-1aa0ea09f17a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b4e19a477614c58953f2fbd6f7527bf'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.163788 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3660/7286] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:41 2022] DELETE /identity/v3/users/5b4e19a477614c58953f2fbd6f7527bf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:42.452202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901b034-b8da-4a9f-ab52-1a8b94979628 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:42.454806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3901b034-b8da-4a9f-ab52-1a8b94979628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:42.476858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170e8cd-60c0-4ec3-999b-1aa0ea09f17a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:42.478643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7170e8cd-60c0-4ec3-999b-1aa0ea09f17a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:42.554075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901b034-b8da-4a9f-ab52-1a8b94979628 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:42.567602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170e8cd-60c0-4ec3-999b-1aa0ea09f17a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:42.572317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490d50a-b2bb-42ff-a256-4261114eb6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:42.573218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d50a-b2bb-42ff-a256-4261114eb6fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:42.573505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d50a-b2bb-42ff-a256-4261114eb6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:42.573781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d50a-b2bb-42ff-a256-4261114eb6fe admin admin] PATH_INFO: `/v3/projects/5ed3c46669e54043b21c8143282c5b54` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:42.574976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490d50a-b2bb-42ff-a256-4261114eb6fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed3c46669e54043b21c8143282c5b54)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:42.577131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490d50a-b2bb-42ff-a256-4261114eb6fe admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:42.611236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42f786-4547-4e34-9b55-0dd5dc0d9b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:42.612210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42f786-4547-4e34-9b55-0dd5dc0d9b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:42.612535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42f786-4547-4e34-9b55-0dd5dc0d9b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:42.612797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42f786-4547-4e34-9b55-0dd5dc0d9b77 admin admin] PATH_INFO: `/v3/projects/09f728784eb84c5dbfd1908521ba9d6d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:42.614008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42f786-4547-4e34-9b55-0dd5dc0d9b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f728784eb84c5dbfd1908521ba9d6d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:42.615914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42f786-4547-4e34-9b55-0dd5dc0d9b77 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:42.622242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:42.627858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6490d50a-b2bb-42ff-a256-4261114eb6fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed3c46669e54043b21c8143282c5b54', 'request_id': 'req-6490d50a-b2bb-42ff-a256-4261114eb6fe'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.638405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6490d50a-b2bb-42ff-a256-4261114eb6fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed3c46669e54043b21c8143282c5b54', 'request_id': 'req-6490d50a-b2bb-42ff-a256-4261114eb6fe'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.646065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6490d50a-b2bb-42ff-a256-4261114eb6fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed3c46669e54043b21c8143282c5b54', 'request_id': 'req-6490d50a-b2bb-42ff-a256-4261114eb6fe'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.659265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6490d50a-b2bb-42ff-a256-4261114eb6fe admin admin] The token cache is being invalidate because project 5ed3c46669e54043b21c8143282c5b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:42.659595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6490d50a-b2bb-42ff-a256-4261114eb6fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.660287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6490d50a-b2bb-42ff-a256-4261114eb6fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.661905 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3661/7287] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:42 2022] DELETE /identity/v3/projects/5ed3c46669e54043b21c8143282c5b54 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:42.662733 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490d50a-b2bb-42ff-a256-4261114eb6fe admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:42.664011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6490d50a-b2bb-42ff-a256-4261114eb6fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:42.674345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9f42f786-4547-4e34-9b55-0dd5dc0d9b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f728784eb84c5dbfd1908521ba9d6d', 'request_id': 'req-9f42f786-4547-4e34-9b55-0dd5dc0d9b77'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.678336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:42.681806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9f42f786-4547-4e34-9b55-0dd5dc0d9b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f728784eb84c5dbfd1908521ba9d6d', 'request_id': 'req-9f42f786-4547-4e34-9b55-0dd5dc0d9b77'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.689134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9f42f786-4547-4e34-9b55-0dd5dc0d9b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f728784eb84c5dbfd1908521ba9d6d', 'request_id': 'req-9f42f786-4547-4e34-9b55-0dd5dc0d9b77'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.702909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9f42f786-4547-4e34-9b55-0dd5dc0d9b77 admin admin] The token cache is being invalidate because project 09f728784eb84c5dbfd1908521ba9d6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:42.703203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9f42f786-4547-4e34-9b55-0dd5dc0d9b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.703862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9f42f786-4547-4e34-9b55-0dd5dc0d9b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.705602 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3627/7288] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:42 2022] DELETE /identity/v3/projects/09f728784eb84c5dbfd1908521ba9d6d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:42.707100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c89508-edd9-4356-8777-c21841766134 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:42.707547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c89508-edd9-4356-8777-c21841766134 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:42.707831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c89508-edd9-4356-8777-c21841766134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:42.727559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e7c89508-edd9-4356-8777-c21841766134 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:42.729418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e7c89508-edd9-4356-8777-c21841766134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:42.734631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490d50a-b2bb-42ff-a256-4261114eb6fe admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:42.788988 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3628/7289] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:42.790321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5eb00-8d92-4b29-a349-7cde7a3612e7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:42.790613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5eb00-8d92-4b29-a349-7cde7a3612e7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:42.790895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5eb00-8d92-4b29-a349-7cde7a3612e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:42.798266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300f174-f4fe-4ac6-b2b8-de37ddfea5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:42.799349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300f174-f4fe-4ac6-b2b8-de37ddfea5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:42.799449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300f174-f4fe-4ac6-b2b8-de37ddfea5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:42.799694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300f174-f4fe-4ac6-b2b8-de37ddfea5d7 admin admin] PATH_INFO: `/v3/users/5bf1e57e8a7144669654ca1c229274d7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:42.800990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300f174-f4fe-4ac6-b2b8-de37ddfea5d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf1e57e8a7144669654ca1c229274d7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:42.802929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300f174-f4fe-4ac6-b2b8-de37ddfea5d7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:42.821704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1af5eb00-8d92-4b29-a349-7cde7a3612e7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:42.823112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1af5eb00-8d92-4b29-a349-7cde7a3612e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:42.845911 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3629/7290] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:42.845911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae18ac-05fc-473c-80b3-436762b68419 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:42.845911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae18ac-05fc-473c-80b3-436762b68419 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:42.845911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae18ac-05fc-473c-80b3-436762b68419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:42.852511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3300f174-f4fe-4ac6-b2b8-de37ddfea5d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf1e57e8a7144669654ca1c229274d7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.859157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c7ae18ac-05fc-473c-80b3-436762b68419 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:42.860403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c7ae18ac-05fc-473c-80b3-436762b68419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:42.861184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3300f174-f4fe-4ac6-b2b8-de37ddfea5d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf1e57e8a7144669654ca1c229274d7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.861890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3300f174-f4fe-4ac6-b2b8-de37ddfea5d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf1e57e8a7144669654ca1c229274d7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.862503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3300f174-f4fe-4ac6-b2b8-de37ddfea5d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf1e57e8a7144669654ca1c229274d7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.869119 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3630/7291] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:42.869820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3300f174-f4fe-4ac6-b2b8-de37ddfea5d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf1e57e8a7144669654ca1c229274d7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:42.870462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec90fac-7551-4068-b7c5-2d85d4f3c366 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:42.870752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec90fac-7551-4068-b7c5-2d85d4f3c366 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:42.871030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec90fac-7551-4068-b7c5-2d85d4f3c366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:42.888253 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3662/7292] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:42 2022] DELETE /identity/v3/users/5bf1e57e8a7144669654ca1c229274d7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:42.889222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300f174-f4fe-4ac6-b2b8-de37ddfea5d7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:42.889589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1ec90fac-7551-4068-b7c5-2d85d4f3c366 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:42.890918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1ec90fac-7551-4068-b7c5-2d85d4f3c366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:42.931109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:42.952597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300f174-f4fe-4ac6-b2b8-de37ddfea5d7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:42.953702 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3631/7293] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:42.953702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a435c-5ea4-4fba-bb0f-b6ab73678d5d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:42.953702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a435c-5ea4-4fba-bb0f-b6ab73678d5d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:42.953702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a435c-5ea4-4fba-bb0f-b6ab73678d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:42.957371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271b124-b9ef-4d14-85e2-f1adbae82d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:42.958037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271b124-b9ef-4d14-85e2-f1adbae82d76 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:42.958330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271b124-b9ef-4d14-85e2-f1adbae82d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:42.958609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271b124-b9ef-4d14-85e2-f1adbae82d76 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:42.959341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271b124-b9ef-4d14-85e2-f1adbae82d76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:42.959653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271b124-b9ef-4d14-85e2-f1adbae82d76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:42.961306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271b124-b9ef-4d14-85e2-f1adbae82d76 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:42.976545 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3663/7294] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:42.976545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271b124-b9ef-4d14-85e2-f1adbae82d76 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:42.976815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2f0a435c-5ea4-4fba-bb0f-b6ab73678d5d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:42.976815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2f0a435c-5ea4-4fba-bb0f-b6ab73678d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:42.983455 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3632/7295] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:42.984234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a435c-5ea4-4fba-bb0f-b6ab73678d5d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:42.986771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271b124-b9ef-4d14-85e2-f1adbae82d76 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:42.991550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c98362-172c-4ff5-90ca-99d01303da60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:42.992256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c98362-172c-4ff5-90ca-99d01303da60 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:42.992620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c98362-172c-4ff5-90ca-99d01303da60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:42.992827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c98362-172c-4ff5-90ca-99d01303da60 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:42.993547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c98362-172c-4ff5-90ca-99d01303da60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:42.993856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c98362-172c-4ff5-90ca-99d01303da60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:42.994849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a435c-5ea4-4fba-bb0f-b6ab73678d5d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:42.995465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c98362-172c-4ff5-90ca-99d01303da60 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:42.999801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5c4f9-152a-4f0b-b5e3-a183983a7348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.000525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5c4f9-152a-4f0b-b5e3-a183983a7348 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.000807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5c4f9-152a-4f0b-b5e3-a183983a7348 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.001084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5c4f9-152a-4f0b-b5e3-a183983a7348 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.001767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5c4f9-152a-4f0b-b5e3-a183983a7348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.003701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5c4f9-152a-4f0b-b5e3-a183983a7348 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.009168 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3664/7296] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:43.009817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c98362-172c-4ff5-90ca-99d01303da60 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.011488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e0c98362-172c-4ff5-90ca-99d01303da60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:43.017829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:43.033009 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3633/7297] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:42 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:43.033870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5c4f9-152a-4f0b-b5e3-a183983a7348 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.071215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c98362-172c-4ff5-90ca-99d01303da60 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.109098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5c4f9-152a-4f0b-b5e3-a183983a7348 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.113776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a2ea9-1c84-45e1-8a7e-f6fe67f0fa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.114370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a2ea9-1c84-45e1-8a7e-f6fe67f0fa7d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.114650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a2ea9-1c84-45e1-8a7e-f6fe67f0fa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.114919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a2ea9-1c84-45e1-8a7e-f6fe67f0fa7d admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.115609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a2ea9-1c84-45e1-8a7e-f6fe67f0fa7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.117549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a2ea9-1c84-45e1-8a7e-f6fe67f0fa7d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.120232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b8d62-04c6-40ba-904c-06dc16efa329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.120885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b8d62-04c6-40ba-904c-06dc16efa329 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.121165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b8d62-04c6-40ba-904c-06dc16efa329 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.121448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b8d62-04c6-40ba-904c-06dc16efa329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.130929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b8d62-04c6-40ba-904c-06dc16efa329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.132396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b8d62-04c6-40ba-904c-06dc16efa329 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.142149 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3665/7298] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:43.143019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b8d62-04c6-40ba-904c-06dc16efa329 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.144429 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3634/7299] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:43 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:43.148779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a2ea9-1c84-45e1-8a7e-f6fe67f0fa7d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.152832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b8d62-04c6-40ba-904c-06dc16efa329 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.215525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d6dba-cc38-4a26-aa16-ccd6b3b328be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.216254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d6dba-cc38-4a26-aa16-ccd6b3b328be admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.216569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d6dba-cc38-4a26-aa16-ccd6b3b328be admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.216879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d6dba-cc38-4a26-aa16-ccd6b3b328be admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.217784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d6dba-cc38-4a26-aa16-ccd6b3b328be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.219741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d6dba-cc38-4a26-aa16-ccd6b3b328be admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.220566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a2ea9-1c84-45e1-8a7e-f6fe67f0fa7d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.225865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffe045-00f2-447a-bf23-915d1255f7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.226839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffe045-00f2-447a-bf23-915d1255f7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.226839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffe045-00f2-447a-bf23-915d1255f7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.227103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffe045-00f2-447a-bf23-915d1255f7f9 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.227759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffe045-00f2-447a-bf23-915d1255f7f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.230004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffe045-00f2-447a-bf23-915d1255f7f9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.248318 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3666/7300] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:43 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:43.252555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d6dba-cc38-4a26-aa16-ccd6b3b328be admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.256097 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3635/7301] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:43 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:43.259518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffe045-00f2-447a-bf23-915d1255f7f9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.265062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d6dba-cc38-4a26-aa16-ccd6b3b328be admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.269851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c772056-23b6-47e5-bd18-a3bed034d7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.270523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c772056-23b6-47e5-bd18-a3bed034d7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.270800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c772056-23b6-47e5-bd18-a3bed034d7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.271076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c772056-23b6-47e5-bd18-a3bed034d7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.271796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c772056-23b6-47e5-bd18-a3bed034d7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.272771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffe045-00f2-447a-bf23-915d1255f7f9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.273457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c772056-23b6-47e5-bd18-a3bed034d7a4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.276245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:43.279292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e148c0-8a5f-4f99-8d15-a519432da1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.280248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e148c0-8a5f-4f99-8d15-a519432da1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.280707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e148c0-8a5f-4f99-8d15-a519432da1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.281070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e148c0-8a5f-4f99-8d15-a519432da1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.282369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e148c0-8a5f-4f99-8d15-a519432da1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.284306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e148c0-8a5f-4f99-8d15-a519432da1c9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.290466 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3667/7302] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:43.291955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c772056-23b6-47e5-bd18-a3bed034d7a4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.296322 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3636/7303] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:29:43.300074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e148c0-8a5f-4f99-8d15-a519432da1c9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.304777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c772056-23b6-47e5-bd18-a3bed034d7a4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.311021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bee39a-e9a4-49d2-8453-08849cc5ffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.311491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e148c0-8a5f-4f99-8d15-a519432da1c9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.311860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bee39a-e9a4-49d2-8453-08849cc5ffdd admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.312195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bee39a-e9a4-49d2-8453-08849cc5ffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.312674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bee39a-e9a4-49d2-8453-08849cc5ffdd admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.313431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bee39a-e9a4-49d2-8453-08849cc5ffdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.315018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bee39a-e9a4-49d2-8453-08849cc5ffdd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.318600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7268c19-f726-430a-b2b8-73fee287ba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.319278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7268c19-f726-430a-b2b8-73fee287ba3d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.319560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7268c19-f726-430a-b2b8-73fee287ba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.319874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7268c19-f726-430a-b2b8-73fee287ba3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.320583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7268c19-f726-430a-b2b8-73fee287ba3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.322186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7268c19-f726-430a-b2b8-73fee287ba3d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.330846 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3668/7304] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:43.332407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bee39a-e9a4-49d2-8453-08849cc5ffdd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.335678 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3637/7305] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:29:43.340078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7268c19-f726-430a-b2b8-73fee287ba3d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.343634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bee39a-e9a4-49d2-8453-08849cc5ffdd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.350779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7268c19-f726-430a-b2b8-73fee287ba3d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.351067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fb9d4-0f0f-4db5-bffc-0fdd4b131baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.351976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fb9d4-0f0f-4db5-bffc-0fdd4b131baa admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.352413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fb9d4-0f0f-4db5-bffc-0fdd4b131baa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.352691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fb9d4-0f0f-4db5-bffc-0fdd4b131baa admin admin] PATH_INFO: `/v3/projects/b6dda845cd2c4afd9e0a36ed7bddfd5e/users/d3afecf3eeba49ea9bd2af5b3ac821af/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.358050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ecf39-273e-48c3-be01-5340a13c1c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.359051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ecf39-273e-48c3-be01-5340a13c1c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.359383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ecf39-273e-48c3-be01-5340a13c1c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.359724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ecf39-273e-48c3-be01-5340a13c1c9a admin admin] PATH_INFO: `/v3/projects/213de313db1248379db9cbe64ef033a8/users/d4735feddea34bc2af71d4333d0f8f3f/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.370396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fb9d4-0f0f-4db5-bffc-0fdd4b131baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6dda845cd2c4afd9e0a36ed7bddfd5e, user_id=d3afecf3eeba49ea9bd2af5b3ac821af, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.374042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fb9d4-0f0f-4db5-bffc-0fdd4b131baa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.376779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ecf39-273e-48c3-be01-5340a13c1c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=213de313db1248379db9cbe64ef033a8, user_id=d4735feddea34bc2af71d4333d0f8f3f, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.379729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ecf39-273e-48c3-be01-5340a13c1c9a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.392002 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3669/7306] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:43 2022] PUT /identity/v3/projects/b6dda845cd2c4afd9e0a36ed7bddfd5e/users/d3afecf3eeba49ea9bd2af5b3ac821af/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:43.394533 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3638/7307] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:43 2022] PUT /identity/v3/projects/213de313db1248379db9cbe64ef033a8/users/d4735feddea34bc2af71d4333d0f8f3f/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:43.403775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8f578-af35-41eb-a2e3-983488eb1d98 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.403963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8f578-af35-41eb-a2e3-983488eb1d98 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.404271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8f578-af35-41eb-a2e3-983488eb1d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.404666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a101cf-37fa-4bf2-b4a8-3e856d1a756f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.405064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a101cf-37fa-4bf2-b4a8-3e856d1a756f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.405345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a101cf-37fa-4bf2-b4a8-3e856d1a756f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.438345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-00b8f578-af35-41eb-a2e3-983488eb1d98 None None] MFA Rules not processed for user `d3afecf3eeba49ea9bd2af5b3ac821af`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:43.441752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-00b8f578-af35-41eb-a2e3-983488eb1d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:43.442561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-96a101cf-37fa-4bf2-b4a8-3e856d1a756f None None] MFA Rules not processed for user `d4735feddea34bc2af71d4333d0f8f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:43.444220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-96a101cf-37fa-4bf2-b4a8-3e856d1a756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:43.459586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:43.522907 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3639/7308] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:43.523904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a101cf-37fa-4bf2-b4a8-3e856d1a756f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.525217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-96a101cf-37fa-4bf2-b4a8-3e856d1a756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:43.540517 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3670/7309] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:43.541617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8f578-af35-41eb-a2e3-983488eb1d98 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.590822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a101cf-37fa-4bf2-b4a8-3e856d1a756f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.595504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5770a14-2997-475d-be07-37fc43519ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.596411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5770a14-2997-475d-be07-37fc43519ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.596689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5770a14-2997-475d-be07-37fc43519ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.596964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5770a14-2997-475d-be07-37fc43519ef4 admin admin] PATH_INFO: `/v3/projects/ddda8059d4194d56851b99ee26422965` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.598136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5770a14-2997-475d-be07-37fc43519ef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddda8059d4194d56851b99ee26422965)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.600060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5770a14-2997-475d-be07-37fc43519ef4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.605679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8f578-af35-41eb-a2e3-983488eb1d98 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.610482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65337107-88fb-474a-8da3-0b9f9ca4952d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.611150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65337107-88fb-474a-8da3-0b9f9ca4952d admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.611463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65337107-88fb-474a-8da3-0b9f9ca4952d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.611741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65337107-88fb-474a-8da3-0b9f9ca4952d admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.612463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65337107-88fb-474a-8da3-0b9f9ca4952d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.614362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65337107-88fb-474a-8da3-0b9f9ca4952d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.641324 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3671/7310] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:43 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:43.642209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65337107-88fb-474a-8da3-0b9f9ca4952d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.649001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b5770a14-2997-475d-be07-37fc43519ef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddda8059d4194d56851b99ee26422965', 'request_id': 'req-b5770a14-2997-475d-be07-37fc43519ef4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:43.656680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b5770a14-2997-475d-be07-37fc43519ef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddda8059d4194d56851b99ee26422965', 'request_id': 'req-b5770a14-2997-475d-be07-37fc43519ef4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:43.663076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b5770a14-2997-475d-be07-37fc43519ef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddda8059d4194d56851b99ee26422965', 'request_id': 'req-b5770a14-2997-475d-be07-37fc43519ef4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:43.676997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b5770a14-2997-475d-be07-37fc43519ef4 admin admin] The token cache is being invalidate because project ddda8059d4194d56851b99ee26422965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:43.677288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b5770a14-2997-475d-be07-37fc43519ef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:43.677921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b5770a14-2997-475d-be07-37fc43519ef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:43.679997 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3640/7311] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:43 2022] DELETE /identity/v3/projects/ddda8059d4194d56851b99ee26422965 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:43.682750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5770a14-2997-475d-be07-37fc43519ef4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.684011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b5770a14-2997-475d-be07-37fc43519ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:43.685837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:43.709694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65337107-88fb-474a-8da3-0b9f9ca4952d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.715594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec9843-4c25-40d9-a62a-821706a8c9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.716355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec9843-4c25-40d9-a62a-821706a8c9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.716638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec9843-4c25-40d9-a62a-821706a8c9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.716921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec9843-4c25-40d9-a62a-821706a8c9b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.717657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec9843-4c25-40d9-a62a-821706a8c9b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.719589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec9843-4c25-40d9-a62a-821706a8c9b2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.733238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:43.747942 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3672/7312] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:43 2022] POST /identity/v3/projects => generated 393 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:43.750194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bcf43-9e68-4fda-9d82-ce93d152205e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.750488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bcf43-9e68-4fda-9d82-ce93d152205e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.750768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bcf43-9e68-4fda-9d82-ce93d152205e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.759911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5770a14-2997-475d-be07-37fc43519ef4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.774045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d93bcf43-9e68-4fda-9d82-ce93d152205e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:43.775298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d93bcf43-9e68-4fda-9d82-ce93d152205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:43.821645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4dbf88-0ea6-4299-b727-466051dadff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.822291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dbf88-0ea6-4299-b727-466051dadff8 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.822573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dbf88-0ea6-4299-b727-466051dadff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.822847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4dbf88-0ea6-4299-b727-466051dadff8 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.823532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4dbf88-0ea6-4299-b727-466051dadff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.825512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4dbf88-0ea6-4299-b727-466051dadff8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.839611 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3673/7313] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:43.840657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bcf43-9e68-4fda-9d82-ce93d152205e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.842055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d93bcf43-9e68-4fda-9d82-ce93d152205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:43.847468 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3641/7314] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:43 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:43.849483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc087a-b9d7-4ef4-aafd-36affb7a4a11 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.849926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc087a-b9d7-4ef4-aafd-36affb7a4a11 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.850380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc087a-b9d7-4ef4-aafd-36affb7a4a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.854933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bcf43-9e68-4fda-9d82-ce93d152205e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.859840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f6c8b-4940-40b9-a683-798914eb5c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.860676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f6c8b-4940-40b9-a683-798914eb5c19 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.860986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f6c8b-4940-40b9-a683-798914eb5c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.861240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f6c8b-4940-40b9-a683-798914eb5c19 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.861958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f6c8b-4940-40b9-a683-798914eb5c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.863945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f6c8b-4940-40b9-a683-798914eb5c19 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.869566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f0cc087a-b9d7-4ef4-aafd-36affb7a4a11 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:43.870910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f0cc087a-b9d7-4ef4-aafd-36affb7a4a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:43.880511 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3642/7315] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:43.881336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc087a-b9d7-4ef4-aafd-36affb7a4a11 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.891258 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3674/7316] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:43 2022] POST /identity/v3/users => generated 303 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:43.891444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc087a-b9d7-4ef4-aafd-36affb7a4a11 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.892488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f6c8b-4940-40b9-a683-798914eb5c19 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.902668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f6c8b-4940-40b9-a683-798914eb5c19 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.905058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c241f-33be-4435-8ae7-dcdf378456de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.905761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c241f-33be-4435-8ae7-dcdf378456de admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.906041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c241f-33be-4435-8ae7-dcdf378456de admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.906313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c241f-33be-4435-8ae7-dcdf378456de admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.907040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c241f-33be-4435-8ae7-dcdf378456de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.907836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14603c72-3237-4342-85fc-d1c74acbd5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.908513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14603c72-3237-4342-85fc-d1c74acbd5ec admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.908693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c241f-33be-4435-8ae7-dcdf378456de admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.908809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14603c72-3237-4342-85fc-d1c74acbd5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.909064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14603c72-3237-4342-85fc-d1c74acbd5ec admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.909812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14603c72-3237-4342-85fc-d1c74acbd5ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:43.910238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14603c72-3237-4342-85fc-d1c74acbd5ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.911839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14603c72-3237-4342-85fc-d1c74acbd5ec admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.922508 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3643/7317] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:43.922508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c241f-33be-4435-8ae7-dcdf378456de admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.926326 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3675/7318] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:43.927565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14603c72-3237-4342-85fc-d1c74acbd5ec admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.930226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c241f-33be-4435-8ae7-dcdf378456de admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.934853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ffec1-b603-4f25-a4f0-85f438e76fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.935534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ffec1-b603-4f25-a4f0-85f438e76fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.935810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ffec1-b603-4f25-a4f0-85f438e76fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.936147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ffec1-b603-4f25-a4f0-85f438e76fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.936867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ffec1-b603-4f25-a4f0-85f438e76fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.938451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ffec1-b603-4f25-a4f0-85f438e76fa9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.938689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14603c72-3237-4342-85fc-d1c74acbd5ec admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.944095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6378873-cf50-4db3-9c47-d1c65de321d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.945203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6378873-cf50-4db3-9c47-d1c65de321d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.945487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6378873-cf50-4db3-9c47-d1c65de321d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.945766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6378873-cf50-4db3-9c47-d1c65de321d3 admin admin] PATH_INFO: `/v3/projects/ab40306e1dfc44ce8a2a8489b1f0c66f/users/f8e1303a89c844feae8e420c575e8954/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.952613 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3644/7319] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:43.952613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ffec1-b603-4f25-a4f0-85f438e76fa9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:43.962272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6378873-cf50-4db3-9c47-d1c65de321d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab40306e1dfc44ce8a2a8489b1f0c66f, user_id=f8e1303a89c844feae8e420c575e8954, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.962423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ffec1-b603-4f25-a4f0-85f438e76fa9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:43.964994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6378873-cf50-4db3-9c47-d1c65de321d3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.967071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089adee4-15c1-4df1-8732-5101b0e068c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:43.967785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089adee4-15c1-4df1-8732-5101b0e068c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:43.968104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089adee4-15c1-4df1-8732-5101b0e068c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:43.968387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089adee4-15c1-4df1-8732-5101b0e068c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:43.969085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089adee4-15c1-4df1-8732-5101b0e068c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:43.970946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089adee4-15c1-4df1-8732-5101b0e068c1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:43.980616 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3676/7320] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:43 2022] PUT /identity/v3/projects/ab40306e1dfc44ce8a2a8489b1f0c66f/users/f8e1303a89c844feae8e420c575e8954/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:43.981597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6378873-cf50-4db3-9c47-d1c65de321d3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:44.002221 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3645/7321] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:43 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:44.002221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089adee4-15c1-4df1-8732-5101b0e068c1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:44.045222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6378873-cf50-4db3-9c47-d1c65de321d3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:44.057624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:44.064615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089adee4-15c1-4df1-8732-5101b0e068c1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:44.069551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009865ba-8a07-49cf-accb-14f039dea63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:44.070217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009865ba-8a07-49cf-accb-14f039dea63d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:44.070496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009865ba-8a07-49cf-accb-14f039dea63d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:44.070770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009865ba-8a07-49cf-accb-14f039dea63d admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:44.071517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009865ba-8a07-49cf-accb-14f039dea63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:44.073175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009865ba-8a07-49cf-accb-14f039dea63d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:44.086708 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3646/7322] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:44.086708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009865ba-8a07-49cf-accb-14f039dea63d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:44.101258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009865ba-8a07-49cf-accb-14f039dea63d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:44.106215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d69865-5d01-4998-b066-29623b16836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:44.106885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d69865-5d01-4998-b066-29623b16836e admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:44.107196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d69865-5d01-4998-b066-29623b16836e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:44.107470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d69865-5d01-4998-b066-29623b16836e admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:44.108127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c2e80-dcd3-4315-975d-6453402d09d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:44.108300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d69865-5d01-4998-b066-29623b16836e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:44.109033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c2e80-dcd3-4315-975d-6453402d09d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:44.109317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c2e80-dcd3-4315-975d-6453402d09d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:44.109596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c2e80-dcd3-4315-975d-6453402d09d4 admin admin] PATH_INFO: `/v3/projects/4d6f1fadae804036b986367209f954c5/users/f0a9be6956a049dca661ece6e3a7e526/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:44.110236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d69865-5d01-4998-b066-29623b16836e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:44.124703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c2e80-dcd3-4315-975d-6453402d09d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6f1fadae804036b986367209f954c5, user_id=f0a9be6956a049dca661ece6e3a7e526, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:44.127650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c2e80-dcd3-4315-975d-6453402d09d4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:44.135014 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3647/7323] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:44 2022] POST /identity/v3/users => generated 284 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:44.135014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d69865-5d01-4998-b066-29623b16836e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:44.142375 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3677/7324] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:43 2022] PUT /identity/v3/projects/4d6f1fadae804036b986367209f954c5/users/f0a9be6956a049dca661ece6e3a7e526/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:44.142945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d69865-5d01-4998-b066-29623b16836e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:44.143207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c2e80-dcd3-4315-975d-6453402d09d4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:44.148476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:44.207089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f26e2-4964-469c-adee-71c993a5d52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:44.208203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f26e2-4964-469c-adee-71c993a5d52b admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:44.208599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f26e2-4964-469c-adee-71c993a5d52b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:44.208884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f26e2-4964-469c-adee-71c993a5d52b admin admin] PATH_INFO: `/v3/projects/ab40306e1dfc44ce8a2a8489b1f0c66f/users/f8e1303a89c844feae8e420c575e8954/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:44.210940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f26e2-4964-469c-adee-71c993a5d52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab40306e1dfc44ce8a2a8489b1f0c66f, user_id=f8e1303a89c844feae8e420c575e8954, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:44.211083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c2e80-dcd3-4315-975d-6453402d09d4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:44.213614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f26e2-4964-469c-adee-71c993a5d52b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:44.215935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea758f-8f03-4c39-be83-8b962512a777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:44.216623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea758f-8f03-4c39-be83-8b962512a777 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:44.216936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea758f-8f03-4c39-be83-8b962512a777 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:44.217232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea758f-8f03-4c39-be83-8b962512a777 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:44.217996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea758f-8f03-4c39-be83-8b962512a777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:44.219740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea758f-8f03-4c39-be83-8b962512a777 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:44.236070 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3648/7325] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:44 2022] PUT /identity/v3/projects/ab40306e1dfc44ce8a2a8489b1f0c66f/users/f8e1303a89c844feae8e420c575e8954/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:44.236070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f26e2-4964-469c-adee-71c993a5d52b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:44.250086 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3678/7326] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:44.254940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea758f-8f03-4c39-be83-8b962512a777 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:44.267621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea758f-8f03-4c39-be83-8b962512a777 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:44.305828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f26e2-4964-469c-adee-71c993a5d52b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:44.311625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99810f20-0ee2-4c03-9e0f-c87773b2dfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:44.313152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99810f20-0ee2-4c03-9e0f-c87773b2dfe1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:44.313152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99810f20-0ee2-4c03-9e0f-c87773b2dfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:44.313152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99810f20-0ee2-4c03-9e0f-c87773b2dfe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:44.313678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99810f20-0ee2-4c03-9e0f-c87773b2dfe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:44.315380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99810f20-0ee2-4c03-9e0f-c87773b2dfe1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:44.330678 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3649/7327] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:44.332339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99810f20-0ee2-4c03-9e0f-c87773b2dfe1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:44.343781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99810f20-0ee2-4c03-9e0f-c87773b2dfe1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:44.344326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae47aea-ff17-4cdf-b6d9-1001aa0d0421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:44.345030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae47aea-ff17-4cdf-b6d9-1001aa0d0421 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:44.345305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae47aea-ff17-4cdf-b6d9-1001aa0d0421 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:44.345582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae47aea-ff17-4cdf-b6d9-1001aa0d0421 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:44.346301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae47aea-ff17-4cdf-b6d9-1001aa0d0421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:44.347943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae47aea-ff17-4cdf-b6d9-1001aa0d0421 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:44.349196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2eb67d-0711-4e26-aaf0-7898e91fcd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:44.350095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2eb67d-0711-4e26-aaf0-7898e91fcd30 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:44.350377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2eb67d-0711-4e26-aaf0-7898e91fcd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:44.350689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2eb67d-0711-4e26-aaf0-7898e91fcd30 admin admin] PATH_INFO: `/v3/projects/4d6f1fadae804036b986367209f954c5/users/f0a9be6956a049dca661ece6e3a7e526/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:44.352894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2eb67d-0711-4e26-aaf0-7898e91fcd30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6f1fadae804036b986367209f954c5, user_id=f0a9be6956a049dca661ece6e3a7e526, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:44.355551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2eb67d-0711-4e26-aaf0-7898e91fcd30 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:44.358798 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3679/7328] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:44.363306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3bbaf-c628-447a-8c9e-41860578778b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:44.363587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3bbaf-c628-447a-8c9e-41860578778b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:44.363911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3bbaf-c628-447a-8c9e-41860578778b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:44.366449 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3650/7329] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:44 2022] PUT /identity/v3/projects/4d6f1fadae804036b986367209f954c5/users/f0a9be6956a049dca661ece6e3a7e526/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:44.367220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2eb67d-0711-4e26-aaf0-7898e91fcd30 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:44.390974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1fd3bbaf-c628-447a-8c9e-41860578778b None None] MFA Rules not processed for user `f8e1303a89c844feae8e420c575e8954`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:44.392669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1fd3bbaf-c628-447a-8c9e-41860578778b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:44.411666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:44.436278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2eb67d-0711-4e26-aaf0-7898e91fcd30 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:44.441082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b5355-6895-4a31-9875-ac24cb813a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:44.441980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b5355-6895-4a31-9875-ac24cb813a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:44.442262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b5355-6895-4a31-9875-ac24cb813a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:44.442534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b5355-6895-4a31-9875-ac24cb813a14 admin admin] PATH_INFO: `/v3/projects/9977226f71304cc1a5d1e2afa4682988/users/43f0dae32796440ca55bd86121f904a8/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:44.457711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b5355-6895-4a31-9875-ac24cb813a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9977226f71304cc1a5d1e2afa4682988, user_id=43f0dae32796440ca55bd86121f904a8, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:44.460969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b5355-6895-4a31-9875-ac24cb813a14 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:44.468497 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3680/7330] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:44.476161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed523c-ee91-4551-9739-8b26f10e32ea None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:44.476515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed523c-ee91-4551-9739-8b26f10e32ea None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:44.476796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed523c-ee91-4551-9739-8b26f10e32ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:44.480371 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3651/7331] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:44 2022] PUT /identity/v3/projects/9977226f71304cc1a5d1e2afa4682988/users/43f0dae32796440ca55bd86121f904a8/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:44.481413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b5355-6895-4a31-9875-ac24cb813a14 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:44.483311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-574b5355-6895-4a31-9875-ac24cb813a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:44.496683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:44.507878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-02ed523c-ee91-4551-9739-8b26f10e32ea None None] MFA Rules not processed for user `f0a9be6956a049dca661ece6e3a7e526`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:44.509758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-02ed523c-ee91-4551-9739-8b26f10e32ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:44.555933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b5355-6895-4a31-9875-ac24cb813a14 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:44.560025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc4928-27ce-4913-b9d8-3c972c75f182 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:44.560743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4928-27ce-4913-b9d8-3c972c75f182 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:44.561104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4928-27ce-4913-b9d8-3c972c75f182 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:44.561383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4928-27ce-4913-b9d8-3c972c75f182 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:44.563915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-94dc4928-27ce-4913-b9d8-3c972c75f182 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:44.600780 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3681/7332] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:44.602816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60389303-24d4-4856-a553-acc87af291de None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:44.603182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60389303-24d4-4856-a553-acc87af291de None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:44.608145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60389303-24d4-4856-a553-acc87af291de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:44.636052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc4928-27ce-4913-b9d8-3c972c75f182 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:44.637813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc4928-27ce-4913-b9d8-3c972c75f182 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:44.639840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-60389303-24d4-4856-a553-acc87af291de None None] MFA Rules not processed for user `43f0dae32796440ca55bd86121f904a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:44.642389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-60389303-24d4-4856-a553-acc87af291de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:44.649557 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3652/7333] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:44.650508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc4928-27ce-4913-b9d8-3c972c75f182 service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:44.661162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-94dc4928-27ce-4913-b9d8-3c972c75f182 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:44.682148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc4928-27ce-4913-b9d8-3c972c75f182 service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:44.688211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb0032-105c-4965-837a-ddeb84f6e225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:44.688952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb0032-105c-4965-837a-ddeb84f6e225 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:44.689303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb0032-105c-4965-837a-ddeb84f6e225 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:44.689655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb0032-105c-4965-837a-ddeb84f6e225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:44.704351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb0032-105c-4965-837a-ddeb84f6e225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:44.706141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb0032-105c-4965-837a-ddeb84f6e225 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:44.728551 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3682/7334] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:44.733020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60389303-24d4-4856-a553-acc87af291de None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:44.736701 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3653/7335] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:44.778735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:44.785185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb0032-105c-4965-837a-ddeb84f6e225 service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:44.799978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb0032-105c-4965-837a-ddeb84f6e225 service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:44.805278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d9759-d507-4683-8caa-e0c6a03f74c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:44.806622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d9759-d507-4683-8caa-e0c6a03f74c5 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:44.806922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d9759-d507-4683-8caa-e0c6a03f74c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:44.807203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d9759-d507-4683-8caa-e0c6a03f74c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:44.809118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-727d9759-d507-4683-8caa-e0c6a03f74c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:44.816576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60389303-24d4-4856-a553-acc87af291de None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:44.821452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bcdfb-5bdc-4525-b5e7-0848a4a64c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:44.822387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bcdfb-5bdc-4525-b5e7-0848a4a64c58 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:44.822752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bcdfb-5bdc-4525-b5e7-0848a4a64c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:44.823118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bcdfb-5bdc-4525-b5e7-0848a4a64c58 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:44.824165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bcdfb-5bdc-4525-b5e7-0848a4a64c58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:44.826851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bcdfb-5bdc-4525-b5e7-0848a4a64c58 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:44.860481 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3683/7336] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:44 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:44.865578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bcdfb-5bdc-4525-b5e7-0848a4a64c58 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:44.891186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d9759-d507-4683-8caa-e0c6a03f74c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:44.892798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d9759-d507-4683-8caa-e0c6a03f74c5 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:44.905704 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3654/7337] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:44.950397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bcdfb-5bdc-4525-b5e7-0848a4a64c58 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:44.964709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c3600-f29c-4a17-9b48-5ebb396f65c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:44.964955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c3600-f29c-4a17-9b48-5ebb396f65c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:44.965217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c3600-f29c-4a17-9b48-5ebb396f65c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:44.965499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c3600-f29c-4a17-9b48-5ebb396f65c7 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:44.966202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c3600-f29c-4a17-9b48-5ebb396f65c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:44.969578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c3600-f29c-4a17-9b48-5ebb396f65c7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:45.002769 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3684/7338] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:44 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:45.004340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d9759-d507-4683-8caa-e0c6a03f74c5 service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:45.021471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d9759-d507-4683-8caa-e0c6a03f74c5 service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:45.028798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ec2eb-a9af-4d26-849a-07a3c2ad0187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:45.029675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ec2eb-a9af-4d26-849a-07a3c2ad0187 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:45.030036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ec2eb-a9af-4d26-849a-07a3c2ad0187 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:45.030315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ec2eb-a9af-4d26-849a-07a3c2ad0187 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:45.031030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ec2eb-a9af-4d26-849a-07a3c2ad0187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:45.033008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ec2eb-a9af-4d26-849a-07a3c2ad0187 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:45.052083 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3655/7339] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:29:45.057149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c3600-f29c-4a17-9b48-5ebb396f65c7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:45.069248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c3600-f29c-4a17-9b48-5ebb396f65c7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:45.081308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d05fc2-5cf5-4dca-bb0f-425994538d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:45.081308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d05fc2-5cf5-4dca-bb0f-425994538d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:45.081308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d05fc2-5cf5-4dca-bb0f-425994538d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:45.081308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d05fc2-5cf5-4dca-bb0f-425994538d2a admin admin] PATH_INFO: `/v3/projects/ec58695e287d40c689963afaa809919a/users/d26ee5b1294e40a79144187c0321f1c6/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:45.103106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d05fc2-5cf5-4dca-bb0f-425994538d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec58695e287d40c689963afaa809919a, user_id=d26ee5b1294e40a79144187c0321f1c6, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:45.106136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d05fc2-5cf5-4dca-bb0f-425994538d2a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:45.121046 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3685/7340] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:45 2022] PUT /identity/v3/projects/ec58695e287d40c689963afaa809919a/users/d26ee5b1294e40a79144187c0321f1c6/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:45.125794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ec2eb-a9af-4d26-849a-07a3c2ad0187 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:45.137367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ec2eb-a9af-4d26-849a-07a3c2ad0187 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:45.182037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:45.225994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49ac58-702d-402c-8a04-e3ed65a26f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:45.227007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49ac58-702d-402c-8a04-e3ed65a26f7d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:45.227431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49ac58-702d-402c-8a04-e3ed65a26f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:45.227815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49ac58-702d-402c-8a04-e3ed65a26f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:45.228843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49ac58-702d-402c-8a04-e3ed65a26f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:45.230626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49ac58-702d-402c-8a04-e3ed65a26f7d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:45.245783 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3656/7341] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:45.250246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d05fc2-5cf5-4dca-bb0f-425994538d2a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:45.262053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d05fc2-5cf5-4dca-bb0f-425994538d2a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:45.267589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d9701-018a-4bb8-a03b-17f11ae31238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:45.268583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d9701-018a-4bb8-a03b-17f11ae31238 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:45.268855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d9701-018a-4bb8-a03b-17f11ae31238 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:45.269133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d9701-018a-4bb8-a03b-17f11ae31238 admin admin] PATH_INFO: `/v3/projects/ec58695e287d40c689963afaa809919a/users/d26ee5b1294e40a79144187c0321f1c6/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:45.271360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d9701-018a-4bb8-a03b-17f11ae31238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec58695e287d40c689963afaa809919a, user_id=d26ee5b1294e40a79144187c0321f1c6, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:45.274817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d9701-018a-4bb8-a03b-17f11ae31238 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:45.297672 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3686/7342] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:45 2022] PUT /identity/v3/projects/ec58695e287d40c689963afaa809919a/users/d26ee5b1294e40a79144187c0321f1c6/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:45.299277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684f34a-8824-433b-9bd8-19fc49fe49ec None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:45.299578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684f34a-8824-433b-9bd8-19fc49fe49ec None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:45.299865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684f34a-8824-433b-9bd8-19fc49fe49ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:45.334372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e684f34a-8824-433b-9bd8-19fc49fe49ec None None] MFA Rules not processed for user `d26ee5b1294e40a79144187c0321f1c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:45.335637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e684f34a-8824-433b-9bd8-19fc49fe49ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:45.419186 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3657/7343] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:45.424030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d9701-018a-4bb8-a03b-17f11ae31238 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:45.436399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d9701-018a-4bb8-a03b-17f11ae31238 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:45.441020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc3a7d-906f-4a66-89c4-d039944b31d6 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd26ee5b1294e40a79144187c0321f1c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec58695e287d40c689963afaa809919a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:45.441684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc3a7d-906f-4a66-89c4-d039944b31d6 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:45.441969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc3a7d-906f-4a66-89c4-d039944b31d6 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:45.442252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc3a7d-906f-4a66-89c4-d039944b31d6 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:45.442973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc3a7d-906f-4a66-89c4-d039944b31d6 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:45.444633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc3a7d-906f-4a66-89c4-d039944b31d6 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:45.460019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684f34a-8824-433b-9bd8-19fc49fe49ec None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:45.461084 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3687/7344] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:29:45 2022] POST /identity/v3/domains => generated 277 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:45.464675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e684f34a-8824-433b-9bd8-19fc49fe49ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:45.465039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc3a7d-906f-4a66-89c4-d039944b31d6 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:45.522418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:45.524447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684f34a-8824-433b-9bd8-19fc49fe49ec None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:45.527967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc3a7d-906f-4a66-89c4-d039944b31d6 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:45.533946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adf95e-84e6-451c-9bcc-90d1a409cd79 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd26ee5b1294e40a79144187c0321f1c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec58695e287d40c689963afaa809919a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:45.534844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adf95e-84e6-451c-9bcc-90d1a409cd79 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:45.535127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adf95e-84e6-451c-9bcc-90d1a409cd79 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:45.535407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adf95e-84e6-451c-9bcc-90d1a409cd79 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:45.536207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adf95e-84e6-451c-9bcc-90d1a409cd79 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:45.538302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adf95e-84e6-451c-9bcc-90d1a409cd79 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:45.571648 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3688/7345] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:45 2022] POST /identity/v3/users => generated 346 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:45.576716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adf95e-84e6-451c-9bcc-90d1a409cd79 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:45.584517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca077db-f211-4530-b554-1aff7396c095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:45.585183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca077db-f211-4530-b554-1aff7396c095 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:45.585559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca077db-f211-4530-b554-1aff7396c095 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:45.585957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca077db-f211-4530-b554-1aff7396c095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:45.586110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adf95e-84e6-451c-9bcc-90d1a409cd79 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:45.588119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9ca077db-f211-4530-b554-1aff7396c095 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:45.591073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c2c28-6acb-48ca-a33b-2157cff8d738 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd26ee5b1294e40a79144187c0321f1c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec58695e287d40c689963afaa809919a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:45.591738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c2c28-6acb-48ca-a33b-2157cff8d738 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:45.592024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c2c28-6acb-48ca-a33b-2157cff8d738 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:45.592363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c2c28-6acb-48ca-a33b-2157cff8d738 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:45.593059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c2c28-6acb-48ca-a33b-2157cff8d738 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:45.595000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c2c28-6acb-48ca-a33b-2157cff8d738 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:45.599600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca077db-f211-4530-b554-1aff7396c095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:45.601059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca077db-f211-4530-b554-1aff7396c095 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:45.611412 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3658/7346] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:45.623696 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3689/7347] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:45 2022] POST /identity/v3/users => generated 324 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:45.624948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca077db-f211-4530-b554-1aff7396c095 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:45.636671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca077db-f211-4530-b554-1aff7396c095 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:45.641623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275b76a-20f9-4e0c-b25e-e59b260c5749 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd26ee5b1294e40a79144187c0321f1c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec58695e287d40c689963afaa809919a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:45.642011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c2c28-6acb-48ca-a33b-2157cff8d738 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:45.642498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275b76a-20f9-4e0c-b25e-e59b260c5749 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:45.642792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275b76a-20f9-4e0c-b25e-e59b260c5749 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:45.643097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275b76a-20f9-4e0c-b25e-e59b260c5749 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] PATH_INFO: `/v3/users/c309498fe6c54b3e9458d6a710244ac3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:45.644199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-813c2c28-6acb-48ca-a33b-2157cff8d738 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:45.656431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:45.659251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275b76a-20f9-4e0c-b25e-e59b260c5749 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorizing `identity:get_user(user_id=c309498fe6c54b3e9458d6a710244ac3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:45.662111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275b76a-20f9-4e0c-b25e-e59b260c5749 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:45.664406 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3659/7348] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:29:45 2022] GET /identity/v3/users/c309498fe6c54b3e9458d6a710244ac3 => generated 346 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:29:45.669140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275b76a-20f9-4e0c-b25e-e59b260c5749 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:45.679406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275b76a-20f9-4e0c-b25e-e59b260c5749 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:45.684007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a891697-2b39-42fd-b00a-7a21332da656 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd26ee5b1294e40a79144187c0321f1c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec58695e287d40c689963afaa809919a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:45.684696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a891697-2b39-42fd-b00a-7a21332da656 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:45.684982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a891697-2b39-42fd-b00a-7a21332da656 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:45.685260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a891697-2b39-42fd-b00a-7a21332da656 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:45.686200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a891697-2b39-42fd-b00a-7a21332da656 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Adding query filter params (domain_id=1577820e9e0f49be8e20cfa865ddc415) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:45.686507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a891697-2b39-42fd-b00a-7a21332da656 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:45.688660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a891697-2b39-42fd-b00a-7a21332da656 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:45.700309 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3660/7349] 10.222.0.43 () {58 vars in 1206 bytes} [Sat Jul 2 21:29:45 2022] GET /identity/v3/users?domain_id=1577820e9e0f49be8e20cfa865ddc415 => generated 483 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:29:45.705683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a891697-2b39-42fd-b00a-7a21332da656 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:45.715651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a891697-2b39-42fd-b00a-7a21332da656 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:45.720331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fef62-3e36-47d1-81ee-8f29a77ad988 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd26ee5b1294e40a79144187c0321f1c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec58695e287d40c689963afaa809919a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:45.720977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fef62-3e36-47d1-81ee-8f29a77ad988 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:45.721262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fef62-3e36-47d1-81ee-8f29a77ad988 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:45.721544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fef62-3e36-47d1-81ee-8f29a77ad988 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:45.722286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fef62-3e36-47d1-81ee-8f29a77ad988 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:45.724148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fef62-3e36-47d1-81ee-8f29a77ad988 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:45.724361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c2c28-6acb-48ca-a33b-2157cff8d738 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:45.729615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1cb93-d9e8-4c72-bf72-e0c16d9f3cf1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:45.730273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1cb93-d9e8-4c72-bf72-e0c16d9f3cf1 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:45.730557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1cb93-d9e8-4c72-bf72-e0c16d9f3cf1 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:45.730837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1cb93-d9e8-4c72-bf72-e0c16d9f3cf1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:45.732691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f7f1cb93-d9e8-4c72-bf72-e0c16d9f3cf1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:45.745907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1cb93-d9e8-4c72-bf72-e0c16d9f3cf1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:45.747635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1cb93-d9e8-4c72-bf72-e0c16d9f3cf1 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:45.752906 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3661/7350] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:45 2022] GET /identity/v3/users => generated 8339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:45.758267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fef62-3e36-47d1-81ee-8f29a77ad988 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:45.760212 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3690/7351] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:45.771164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fef62-3e36-47d1-81ee-8f29a77ad988 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:45.776065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbbb36-d1f8-4f7f-8833-939a703da71b tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd26ee5b1294e40a79144187c0321f1c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec58695e287d40c689963afaa809919a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:45.776747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbbb36-d1f8-4f7f-8833-939a703da71b tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:45.777036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbbb36-d1f8-4f7f-8833-939a703da71b tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:45.777307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbbb36-d1f8-4f7f-8833-939a703da71b tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:45.778109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbbb36-d1f8-4f7f-8833-939a703da71b tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Adding query filter params (name=tempest-test_user-44136293) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:45.778395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbbb36-d1f8-4f7f-8833-939a703da71b tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:45.780341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbbb36-d1f8-4f7f-8833-939a703da71b tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:45.799348 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3662/7352] 10.222.0.43 () {58 vars in 1184 bytes} [Sat Jul 2 21:29:45 2022] GET /identity/v3/users?name=tempest-test_user-44136293 => generated 472 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:29:45.805552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1cb93-d9e8-4c72-bf72-e0c16d9f3cf1 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:45.817176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1cb93-d9e8-4c72-bf72-e0c16d9f3cf1 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:45.824599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0118cb0-4779-4e1b-bfff-2a1871037e73 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd26ee5b1294e40a79144187c0321f1c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec58695e287d40c689963afaa809919a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:45.825757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0118cb0-4779-4e1b-bfff-2a1871037e73 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:45.826238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0118cb0-4779-4e1b-bfff-2a1871037e73 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:45.826742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0118cb0-4779-4e1b-bfff-2a1871037e73 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:45.827536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0118cb0-4779-4e1b-bfff-2a1871037e73 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:45.827852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0118cb0-4779-4e1b-bfff-2a1871037e73 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:45.829917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0118cb0-4779-4e1b-bfff-2a1871037e73 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:45.852500 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3691/7353] 10.222.0.43 () {58 vars in 1148 bytes} [Sat Jul 2 21:29:45 2022] GET /identity/v3/users?enabled=False => generated 432 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:45.858369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbbb36-d1f8-4f7f-8833-939a703da71b tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:45.869063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbbb36-d1f8-4f7f-8833-939a703da71b tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:45.873997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2717021-8cf9-4439-a730-27a541c568ac tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd26ee5b1294e40a79144187c0321f1c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec58695e287d40c689963afaa809919a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:45.878335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2717021-8cf9-4439-a730-27a541c568ac tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:45.878335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2717021-8cf9-4439-a730-27a541c568ac tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:45.878335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2717021-8cf9-4439-a730-27a541c568ac tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] PATH_INFO: `/v3/users/67c1df6b38d648cdb341408c5a616075` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:45.892550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2717021-8cf9-4439-a730-27a541c568ac tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorizing `identity:delete_user(user_id=67c1df6b38d648cdb341408c5a616075)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:45.894505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2717021-8cf9-4439-a730-27a541c568ac tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:45.943049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0118cb0-4779-4e1b-bfff-2a1871037e73 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:45.944855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b0118cb0-4779-4e1b-bfff-2a1871037e73 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:45.949947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2717021-8cf9-4439-a730-27a541c568ac tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67c1df6b38d648cdb341408c5a616075'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:45.959407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2717021-8cf9-4439-a730-27a541c568ac tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67c1df6b38d648cdb341408c5a616075'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:45.959985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0118cb0-4779-4e1b-bfff-2a1871037e73 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:45.964570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab92f5-7ebf-485e-abc0-f2a17bfd856d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:45.965228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab92f5-7ebf-485e-abc0-f2a17bfd856d service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:45.965519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab92f5-7ebf-485e-abc0-f2a17bfd856d service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:45.965801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab92f5-7ebf-485e-abc0-f2a17bfd856d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:45.967996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b0ab92f5-7ebf-485e-abc0-f2a17bfd856d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:45.968385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2717021-8cf9-4439-a730-27a541c568ac tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67c1df6b38d648cdb341408c5a616075'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:45.969223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2717021-8cf9-4439-a730-27a541c568ac tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67c1df6b38d648cdb341408c5a616075'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:45.969947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2717021-8cf9-4439-a730-27a541c568ac tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67c1df6b38d648cdb341408c5a616075'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:45.981048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab92f5-7ebf-485e-abc0-f2a17bfd856d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:45.982121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab92f5-7ebf-485e-abc0-f2a17bfd856d service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:45.992861 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3692/7354] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:45.995613 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3663/7355] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:45 2022] DELETE /identity/v3/users/67c1df6b38d648cdb341408c5a616075 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:45.999563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab92f5-7ebf-485e-abc0-f2a17bfd856d service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:46.013315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab92f5-7ebf-485e-abc0-f2a17bfd856d service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:46.084959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df975afe-6bde-46f6-9a01-3b33a958fe0f tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd26ee5b1294e40a79144187c0321f1c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec58695e287d40c689963afaa809919a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:46.085869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df975afe-6bde-46f6-9a01-3b33a958fe0f tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:46.086316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df975afe-6bde-46f6-9a01-3b33a958fe0f tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:46.086602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df975afe-6bde-46f6-9a01-3b33a958fe0f tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] PATH_INFO: `/v3/users/c309498fe6c54b3e9458d6a710244ac3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:46.087821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df975afe-6bde-46f6-9a01-3b33a958fe0f tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c309498fe6c54b3e9458d6a710244ac3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:46.094623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df975afe-6bde-46f6-9a01-3b33a958fe0f tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:46.096767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c7c5e-8b90-4fea-919f-42063063172b None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:46.099193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c7c5e-8b90-4fea-919f-42063063172b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:46.099295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c7c5e-8b90-4fea-919f-42063063172b None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:46.101026 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3664/7356] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:29:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:29:46.106615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ea71d-61a2-4f7a-b74f-0294a7564f7f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:46.106933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ea71d-61a2-4f7a-b74f-0294a7564f7f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:46.107237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ea71d-61a2-4f7a-b74f-0294a7564f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:46.119576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:46.138202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-df975afe-6bde-46f6-9a01-3b33a958fe0f tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c309498fe6c54b3e9458d6a710244ac3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.144561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-674ea71d-61a2-4f7a-b74f-0294a7564f7f None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:46.145805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-674ea71d-61a2-4f7a-b74f-0294a7564f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:46.146632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-df975afe-6bde-46f6-9a01-3b33a958fe0f tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c309498fe6c54b3e9458d6a710244ac3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.147439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-df975afe-6bde-46f6-9a01-3b33a958fe0f tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c309498fe6c54b3e9458d6a710244ac3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.148276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-df975afe-6bde-46f6-9a01-3b33a958fe0f tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c309498fe6c54b3e9458d6a710244ac3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.156057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-df975afe-6bde-46f6-9a01-3b33a958fe0f tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c309498fe6c54b3e9458d6a710244ac3'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.173663 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3693/7357] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:45 2022] DELETE /identity/v3/users/c309498fe6c54b3e9458d6a710244ac3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:46.177685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df975afe-6bde-46f6-9a01-3b33a958fe0f tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:46.179770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-df975afe-6bde-46f6-9a01-3b33a958fe0f tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:46.216768 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3665/7358] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:29:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:46.238335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ea71d-61a2-4f7a-b74f-0294a7564f7f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:46.240139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-674ea71d-61a2-4f7a-b74f-0294a7564f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:46.256294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ea71d-61a2-4f7a-b74f-0294a7564f7f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:46.256709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df975afe-6bde-46f6-9a01-3b33a958fe0f tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:46.260201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:46.263082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042c02d-1faa-410f-a751-f9d0abed923e tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd26ee5b1294e40a79144187c0321f1c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec58695e287d40c689963afaa809919a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:46.263971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042c02d-1faa-410f-a751-f9d0abed923e tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:46.264326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042c02d-1faa-410f-a751-f9d0abed923e tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:46.264606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042c02d-1faa-410f-a751-f9d0abed923e tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] PATH_INFO: `/v3/domains/1577820e9e0f49be8e20cfa865ddc415` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:46.265980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042c02d-1faa-410f-a751-f9d0abed923e tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1577820e9e0f49be8e20cfa865ddc415)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:46.267642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042c02d-1faa-410f-a751-f9d0abed923e tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:46.293097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0042c02d-1faa-410f-a751-f9d0abed923e tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1577820e9e0f49be8e20cfa865ddc415'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.293867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0042c02d-1faa-410f-a751-f9d0abed923e tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1577820e9e0f49be8e20cfa865ddc415'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.320441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0042c02d-1faa-410f-a751-f9d0abed923e tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1577820e9e0f49be8e20cfa865ddc415'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.321224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0042c02d-1faa-410f-a751-f9d0abed923e tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1577820e9e0f49be8e20cfa865ddc415'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.326998 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3694/7359] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:29:46 2022] PATCH /identity/v3/domains/1577820e9e0f49be8e20cfa865ddc415 => generated 278 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:29:46.328158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042c02d-1faa-410f-a751-f9d0abed923e tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:46.329722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0042c02d-1faa-410f-a751-f9d0abed923e tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:46.330265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11616349-df01-4e02-9324-cbdf06d6a83d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:46.331534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11616349-df01-4e02-9324-cbdf06d6a83d service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:46.331952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11616349-df01-4e02-9324-cbdf06d6a83d service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:46.332277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11616349-df01-4e02-9324-cbdf06d6a83d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:46.334115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-11616349-df01-4e02-9324-cbdf06d6a83d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:46.348590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11616349-df01-4e02-9324-cbdf06d6a83d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:46.350200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11616349-df01-4e02-9324-cbdf06d6a83d service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:46.361644 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3666/7360] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:46.401347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042c02d-1faa-410f-a751-f9d0abed923e tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:46.410290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd26ee5b1294e40a79144187c0321f1c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec58695e287d40c689963afaa809919a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:46.411532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:46.412123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:46.412551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] PATH_INFO: `/v3/domains/1577820e9e0f49be8e20cfa865ddc415` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:46.428273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1577820e9e0f49be8e20cfa865ddc415)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:46.430336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:46.432618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:46.468288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1577820e9e0f49be8e20cfa865ddc415'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.478173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1577820e9e0f49be8e20cfa865ddc415'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.549188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1577820e9e0f49be8e20cfa865ddc415', 'request_id': 'req-b5c82299-f36b-4183-b507-e9a4585a9ee8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.561592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1577820e9e0f49be8e20cfa865ddc415', 'request_id': 'req-b5c82299-f36b-4183-b507-e9a4585a9ee8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.563663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11616349-df01-4e02-9324-cbdf06d6a83d service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:46.565546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-11616349-df01-4e02-9324-cbdf06d6a83d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:46.569931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1577820e9e0f49be8e20cfa865ddc415', 'request_id': 'req-b5c82299-f36b-4183-b507-e9a4585a9ee8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.585148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] The token cache is being invalidate because project 1577820e9e0f49be8e20cfa865ddc415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:46.585452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.586191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.597205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1577820e9e0f49be8e20cfa865ddc415', 'request_id': 'req-b5c82299-f36b-4183-b507-e9a4585a9ee8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.597973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1577820e9e0f49be8e20cfa865ddc415', 'request_id': 'req-b5c82299-f36b-4183-b507-e9a4585a9ee8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.598634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1577820e9e0f49be8e20cfa865ddc415', 'request_id': 'req-b5c82299-f36b-4183-b507-e9a4585a9ee8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.611954 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3695/7361] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:29:46 2022] DELETE /identity/v3/domains/1577820e9e0f49be8e20cfa865ddc415 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:46.616784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:46.618511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:46.652564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11616349-df01-4e02-9324-cbdf06d6a83d service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:46.711364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34316d14-72ca-459c-87d3-abd7157fa3b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:46.711936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34316d14-72ca-459c-87d3-abd7157fa3b7 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:46.712283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34316d14-72ca-459c-87d3-abd7157fa3b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:46.712545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34316d14-72ca-459c-87d3-abd7157fa3b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:46.714679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-34316d14-72ca-459c-87d3-abd7157fa3b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:46.714824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c82299-f36b-4183-b507-e9a4585a9ee8 tempest-UsersV3TestJSON-212225575 tempest-UsersV3TestJSON-212225575-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:46.722302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf835d-285f-475a-8a23-de5aafcfd724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:46.723551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf835d-285f-475a-8a23-de5aafcfd724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:46.724059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf835d-285f-475a-8a23-de5aafcfd724 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:46.724493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf835d-285f-475a-8a23-de5aafcfd724 admin admin] PATH_INFO: `/v3/users/43f0dae32796440ca55bd86121f904a8` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:46.725933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf835d-285f-475a-8a23-de5aafcfd724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f0dae32796440ca55bd86121f904a8)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:46.728803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf835d-285f-475a-8a23-de5aafcfd724 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:46.788372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9fdf835d-285f-475a-8a23-de5aafcfd724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f0dae32796440ca55bd86121f904a8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.790165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:46.797655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9fdf835d-285f-475a-8a23-de5aafcfd724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f0dae32796440ca55bd86121f904a8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.798754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9fdf835d-285f-475a-8a23-de5aafcfd724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f0dae32796440ca55bd86121f904a8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.799191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:46.799339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9fdf835d-285f-475a-8a23-de5aafcfd724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f0dae32796440ca55bd86121f904a8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.806125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34316d14-72ca-459c-87d3-abd7157fa3b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:46.807667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34316d14-72ca-459c-87d3-abd7157fa3b7 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:46.808265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9fdf835d-285f-475a-8a23-de5aafcfd724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f0dae32796440ca55bd86121f904a8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.821018 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3667/7362] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:46.821994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34316d14-72ca-459c-87d3-abd7157fa3b7 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:46.823387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-34316d14-72ca-459c-87d3-abd7157fa3b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:46.832872 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3696/7363] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:46 2022] DELETE /identity/v3/users/43f0dae32796440ca55bd86121f904a8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:46.833937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf835d-285f-475a-8a23-de5aafcfd724 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:46.835454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9fdf835d-285f-475a-8a23-de5aafcfd724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:46.839690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34316d14-72ca-459c-87d3-abd7157fa3b7 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:46.903155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf835d-285f-475a-8a23-de5aafcfd724 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:46.904431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095398b-8eb7-471c-ad9b-2a9296b13c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:46.905396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095398b-8eb7-471c-ad9b-2a9296b13c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:46.905681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095398b-8eb7-471c-ad9b-2a9296b13c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:46.905961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095398b-8eb7-471c-ad9b-2a9296b13c6d admin admin] PATH_INFO: `/v3/users/d4735feddea34bc2af71d4333d0f8f3f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:46.907226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095398b-8eb7-471c-ad9b-2a9296b13c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4735feddea34bc2af71d4333d0f8f3f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:46.909185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095398b-8eb7-471c-ad9b-2a9296b13c6d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:46.909289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b71239-7008-4250-a100-076794266bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:46.910237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b71239-7008-4250-a100-076794266bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:46.910519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b71239-7008-4250-a100-076794266bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:46.910936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b71239-7008-4250-a100-076794266bd5 admin admin] PATH_INFO: `/v3/users/d3afecf3eeba49ea9bd2af5b3ac821af` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:46.912534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b71239-7008-4250-a100-076794266bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3afecf3eeba49ea9bd2af5b3ac821af)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:46.914545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b71239-7008-4250-a100-076794266bd5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:46.968799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2095398b-8eb7-471c-ad9b-2a9296b13c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4735feddea34bc2af71d4333d0f8f3f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.970974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-71b71239-7008-4250-a100-076794266bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3afecf3eeba49ea9bd2af5b3ac821af'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.979516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2095398b-8eb7-471c-ad9b-2a9296b13c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4735feddea34bc2af71d4333d0f8f3f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.983518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-71b71239-7008-4250-a100-076794266bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3afecf3eeba49ea9bd2af5b3ac821af'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.984680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-71b71239-7008-4250-a100-076794266bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3afecf3eeba49ea9bd2af5b3ac821af'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.985948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-71b71239-7008-4250-a100-076794266bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3afecf3eeba49ea9bd2af5b3ac821af'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.988666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2095398b-8eb7-471c-ad9b-2a9296b13c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4735feddea34bc2af71d4333d0f8f3f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.989588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2095398b-8eb7-471c-ad9b-2a9296b13c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4735feddea34bc2af71d4333d0f8f3f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.990432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2095398b-8eb7-471c-ad9b-2a9296b13c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4735feddea34bc2af71d4333d0f8f3f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:46.996167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-71b71239-7008-4250-a100-076794266bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3afecf3eeba49ea9bd2af5b3ac821af'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:47.012476 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3668/7364] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:46 2022] DELETE /identity/v3/users/d4735feddea34bc2af71d4333d0f8f3f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:47.015486 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3697/7365] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:46 2022] DELETE /identity/v3/users/d3afecf3eeba49ea9bd2af5b3ac821af => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:47.016942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cf42a-7f5a-4816-80f7-30f988d916e4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:47.017223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cf42a-7f5a-4816-80f7-30f988d916e4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:47.017504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cf42a-7f5a-4816-80f7-30f988d916e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:47.018061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8643ab9-b9c8-4725-a901-e1d1f93a8cfb None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:47.018513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8643ab9-b9c8-4725-a901-e1d1f93a8cfb None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:47.018785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8643ab9-b9c8-4725-a901-e1d1f93a8cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:47.037254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c8643ab9-b9c8-4725-a901-e1d1f93a8cfb None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:47.037492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fc9cf42a-7f5a-4816-80f7-30f988d916e4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:47.038518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fc9cf42a-7f5a-4816-80f7-30f988d916e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:47.038840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c8643ab9-b9c8-4725-a901-e1d1f93a8cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:47.086972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:47.126877 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3698/7366] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:47.128792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da1dc0-b562-4230-995e-63c11314605c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:47.129245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da1dc0-b562-4230-995e-63c11314605c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:47.129887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da1dc0-b562-4230-995e-63c11314605c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:47.145280 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3669/7367] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:47.145280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cf42a-7f5a-4816-80f7-30f988d916e4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:47.149184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fc9cf42a-7f5a-4816-80f7-30f988d916e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:47.153628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-83da1dc0-b562-4230-995e-63c11314605c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:47.155459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-83da1dc0-b562-4230-995e-63c11314605c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:47.170209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:47.177382 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3699/7368] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:47.182064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da1dc0-b562-4230-995e-63c11314605c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:47.182064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-83da1dc0-b562-4230-995e-63c11314605c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:47.257209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cf42a-7f5a-4816-80f7-30f988d916e4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:47.269048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d210b13-8f56-4f09-8a95-3b7049b8ad53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:47.269785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d210b13-8f56-4f09-8a95-3b7049b8ad53 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:47.270076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d210b13-8f56-4f09-8a95-3b7049b8ad53 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:47.270348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d210b13-8f56-4f09-8a95-3b7049b8ad53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:47.279216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da1dc0-b562-4230-995e-63c11314605c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:47.287689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6c502-0f97-4d3a-8b10-ed452c96286f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:47.288952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6c502-0f97-4d3a-8b10-ed452c96286f service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:47.289513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6c502-0f97-4d3a-8b10-ed452c96286f service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:47.289948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6c502-0f97-4d3a-8b10-ed452c96286f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:47.290073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d210b13-8f56-4f09-8a95-3b7049b8ad53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:47.291447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d210b13-8f56-4f09-8a95-3b7049b8ad53 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:47.303919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6c502-0f97-4d3a-8b10-ed452c96286f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:47.305415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6c502-0f97-4d3a-8b10-ed452c96286f service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:47.308666 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3670/7369] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:47.309924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d210b13-8f56-4f09-8a95-3b7049b8ad53 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:47.321967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d210b13-8f56-4f09-8a95-3b7049b8ad53 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:47.324901 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3700/7370] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:47.326742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfff0a-ae86-46bc-90f9-5632898e7783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:47.327405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfff0a-ae86-46bc-90f9-5632898e7783 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:47.327714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfff0a-ae86-46bc-90f9-5632898e7783 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:47.327990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfff0a-ae86-46bc-90f9-5632898e7783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:47.337865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfff0a-ae86-46bc-90f9-5632898e7783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:47.339303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfff0a-ae86-46bc-90f9-5632898e7783 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:47.349876 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3671/7371] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:48.013872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6c502-0f97-4d3a-8b10-ed452c96286f service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:48.015847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5ff6c502-0f97-4d3a-8b10-ed452c96286f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:48.030710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6c502-0f97-4d3a-8b10-ed452c96286f service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:48.034348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfff0a-ae86-46bc-90f9-5632898e7783 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:48.035993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-79bfff0a-ae86-46bc-90f9-5632898e7783 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:48.038888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a664be-fdca-4af4-accc-edbc6a97f4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:48.040181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a664be-fdca-4af4-accc-edbc6a97f4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:48.040668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a664be-fdca-4af4-accc-edbc6a97f4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:48.041106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a664be-fdca-4af4-accc-edbc6a97f4c1 admin admin] PATH_INFO: `/v3/projects/9977226f71304cc1a5d1e2afa4682988` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:48.042534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a664be-fdca-4af4-accc-edbc6a97f4c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9977226f71304cc1a5d1e2afa4682988)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:48.044944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a664be-fdca-4af4-accc-edbc6a97f4c1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:48.059206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfff0a-ae86-46bc-90f9-5632898e7783 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:48.065120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7dd05-38b6-4a2b-aea4-02335a0afbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:48.067780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7dd05-38b6-4a2b-aea4-02335a0afbf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:48.068812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7dd05-38b6-4a2b-aea4-02335a0afbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:48.069105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7dd05-38b6-4a2b-aea4-02335a0afbf9 admin admin] PATH_INFO: `/v3/projects/213de313db1248379db9cbe64ef033a8` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:48.070530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7dd05-38b6-4a2b-aea4-02335a0afbf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=213de313db1248379db9cbe64ef033a8)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:48.073824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7dd05-38b6-4a2b-aea4-02335a0afbf9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:48.125215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e7a664be-fdca-4af4-accc-edbc6a97f4c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9977226f71304cc1a5d1e2afa4682988', 'request_id': 'req-e7a664be-fdca-4af4-accc-edbc6a97f4c1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.137170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e7a664be-fdca-4af4-accc-edbc6a97f4c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9977226f71304cc1a5d1e2afa4682988', 'request_id': 'req-e7a664be-fdca-4af4-accc-edbc6a97f4c1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.137475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-99d7dd05-38b6-4a2b-aea4-02335a0afbf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '213de313db1248379db9cbe64ef033a8', 'request_id': 'req-99d7dd05-38b6-4a2b-aea4-02335a0afbf9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.144214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-99d7dd05-38b6-4a2b-aea4-02335a0afbf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '213de313db1248379db9cbe64ef033a8', 'request_id': 'req-99d7dd05-38b6-4a2b-aea4-02335a0afbf9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.144978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e7a664be-fdca-4af4-accc-edbc6a97f4c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9977226f71304cc1a5d1e2afa4682988', 'request_id': 'req-e7a664be-fdca-4af4-accc-edbc6a97f4c1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.152668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-99d7dd05-38b6-4a2b-aea4-02335a0afbf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '213de313db1248379db9cbe64ef033a8', 'request_id': 'req-99d7dd05-38b6-4a2b-aea4-02335a0afbf9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.159652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e7a664be-fdca-4af4-accc-edbc6a97f4c1 admin admin] The token cache is being invalidate because project 9977226f71304cc1a5d1e2afa4682988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:48.159927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e7a664be-fdca-4af4-accc-edbc6a97f4c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.160637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e7a664be-fdca-4af4-accc-edbc6a97f4c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.165535 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3701/7372] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:48 2022] DELETE /identity/v3/projects/9977226f71304cc1a5d1e2afa4682988 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:48.166266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a664be-fdca-4af4-accc-edbc6a97f4c1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:48.167725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e7a664be-fdca-4af4-accc-edbc6a97f4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:48.167961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-99d7dd05-38b6-4a2b-aea4-02335a0afbf9 admin admin] The token cache is being invalidate because project 213de313db1248379db9cbe64ef033a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:48.168417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-99d7dd05-38b6-4a2b-aea4-02335a0afbf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.169204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-99d7dd05-38b6-4a2b-aea4-02335a0afbf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.170959 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3672/7373] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:48 2022] DELETE /identity/v3/projects/213de313db1248379db9cbe64ef033a8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:48.174648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7dd05-38b6-4a2b-aea4-02335a0afbf9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:48.175933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-99d7dd05-38b6-4a2b-aea4-02335a0afbf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:48.249471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a664be-fdca-4af4-accc-edbc6a97f4c1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:48.252560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7dd05-38b6-4a2b-aea4-02335a0afbf9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:48.254968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2ebd1-a51b-433a-b267-eb2f5af2ab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:48.255863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2ebd1-a51b-433a-b267-eb2f5af2ab11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:48.256321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2ebd1-a51b-433a-b267-eb2f5af2ab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:48.256543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2ebd1-a51b-433a-b267-eb2f5af2ab11 admin admin] PATH_INFO: `/v3/projects/b6dda845cd2c4afd9e0a36ed7bddfd5e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:48.257832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2ebd1-a51b-433a-b267-eb2f5af2ab11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6dda845cd2c4afd9e0a36ed7bddfd5e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:48.258353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874faed-628b-4870-a9eb-752a95326a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:48.259325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874faed-628b-4870-a9eb-752a95326a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:48.259668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874faed-628b-4870-a9eb-752a95326a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:48.259935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d2ebd1-a51b-433a-b267-eb2f5af2ab11 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:48.260075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874faed-628b-4870-a9eb-752a95326a9f admin admin] PATH_INFO: `/v3/users/d26ee5b1294e40a79144187c0321f1c6` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:48.261374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874faed-628b-4870-a9eb-752a95326a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d26ee5b1294e40a79144187c0321f1c6)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:48.263421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874faed-628b-4870-a9eb-752a95326a9f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:48.267863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:48.308587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:48.322757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-70d2ebd1-a51b-433a-b267-eb2f5af2ab11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6dda845cd2c4afd9e0a36ed7bddfd5e', 'request_id': 'req-70d2ebd1-a51b-433a-b267-eb2f5af2ab11'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.335391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-70d2ebd1-a51b-433a-b267-eb2f5af2ab11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6dda845cd2c4afd9e0a36ed7bddfd5e', 'request_id': 'req-70d2ebd1-a51b-433a-b267-eb2f5af2ab11'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.346564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-70d2ebd1-a51b-433a-b267-eb2f5af2ab11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6dda845cd2c4afd9e0a36ed7bddfd5e', 'request_id': 'req-70d2ebd1-a51b-433a-b267-eb2f5af2ab11'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.350306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5874faed-628b-4870-a9eb-752a95326a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd26ee5b1294e40a79144187c0321f1c6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.366420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5874faed-628b-4870-a9eb-752a95326a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd26ee5b1294e40a79144187c0321f1c6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.367041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-70d2ebd1-a51b-433a-b267-eb2f5af2ab11 admin admin] The token cache is being invalidate because project b6dda845cd2c4afd9e0a36ed7bddfd5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:48.367408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-70d2ebd1-a51b-433a-b267-eb2f5af2ab11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.372592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-70d2ebd1-a51b-433a-b267-eb2f5af2ab11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.375136 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3702/7374] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:48 2022] DELETE /identity/v3/projects/b6dda845cd2c4afd9e0a36ed7bddfd5e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:48.376083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2ebd1-a51b-433a-b267-eb2f5af2ab11 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:48.377594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-70d2ebd1-a51b-433a-b267-eb2f5af2ab11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:48.383811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5874faed-628b-4870-a9eb-752a95326a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd26ee5b1294e40a79144187c0321f1c6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.384800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5874faed-628b-4870-a9eb-752a95326a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd26ee5b1294e40a79144187c0321f1c6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.385586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5874faed-628b-4870-a9eb-752a95326a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd26ee5b1294e40a79144187c0321f1c6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.417389 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3673/7375] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:48 2022] DELETE /identity/v3/users/d26ee5b1294e40a79144187c0321f1c6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:48.418442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874faed-628b-4870-a9eb-752a95326a9f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:48.421328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5874faed-628b-4870-a9eb-752a95326a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:48.499450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874faed-628b-4870-a9eb-752a95326a9f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:48.500256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2ebd1-a51b-433a-b267-eb2f5af2ab11 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:48.505998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc85f4-1a6d-4ea5-a02b-f7ce4053a34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:48.506723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc85f4-1a6d-4ea5-a02b-f7ce4053a34d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:48.506975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc85f4-1a6d-4ea5-a02b-f7ce4053a34d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:48.507360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc85f4-1a6d-4ea5-a02b-f7ce4053a34d admin admin] PATH_INFO: `/v3/users/f0a9be6956a049dca661ece6e3a7e526` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:48.507755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d292d2-1b8e-4d90-a253-ee1fb761593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:48.508666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc85f4-1a6d-4ea5-a02b-f7ce4053a34d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a9be6956a049dca661ece6e3a7e526)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:48.509582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d292d2-1b8e-4d90-a253-ee1fb761593e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:48.509582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d292d2-1b8e-4d90-a253-ee1fb761593e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:48.509766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d292d2-1b8e-4d90-a253-ee1fb761593e admin admin] PATH_INFO: `/v3/users/f8e1303a89c844feae8e420c575e8954` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:48.510633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc85f4-1a6d-4ea5-a02b-f7ce4053a34d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:48.511500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d292d2-1b8e-4d90-a253-ee1fb761593e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8e1303a89c844feae8e420c575e8954)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:48.513480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d292d2-1b8e-4d90-a253-ee1fb761593e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:48.592228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-27fc85f4-1a6d-4ea5-a02b-f7ce4053a34d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a9be6956a049dca661ece6e3a7e526'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.595537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-27d292d2-1b8e-4d90-a253-ee1fb761593e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8e1303a89c844feae8e420c575e8954'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.602181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-27fc85f4-1a6d-4ea5-a02b-f7ce4053a34d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a9be6956a049dca661ece6e3a7e526'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.608241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-27d292d2-1b8e-4d90-a253-ee1fb761593e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8e1303a89c844feae8e420c575e8954'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.610146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-27fc85f4-1a6d-4ea5-a02b-f7ce4053a34d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a9be6956a049dca661ece6e3a7e526'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.610952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-27fc85f4-1a6d-4ea5-a02b-f7ce4053a34d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a9be6956a049dca661ece6e3a7e526'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.611655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-27fc85f4-1a6d-4ea5-a02b-f7ce4053a34d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a9be6956a049dca661ece6e3a7e526'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.616098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-27d292d2-1b8e-4d90-a253-ee1fb761593e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8e1303a89c844feae8e420c575e8954'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.616764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-27d292d2-1b8e-4d90-a253-ee1fb761593e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8e1303a89c844feae8e420c575e8954'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.624719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-27d292d2-1b8e-4d90-a253-ee1fb761593e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8e1303a89c844feae8e420c575e8954'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:48.636324 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3674/7376] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:48 2022] DELETE /identity/v3/users/f0a9be6956a049dca661ece6e3a7e526 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:48.643831 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3703/7377] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:48 2022] DELETE /identity/v3/users/f8e1303a89c844feae8e420c575e8954 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:48.970334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc85f4-1a6d-4ea5-a02b-f7ce4053a34d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:48.972165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-27fc85f4-1a6d-4ea5-a02b-f7ce4053a34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:48.981960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d292d2-1b8e-4d90-a253-ee1fb761593e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:48.984308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-27d292d2-1b8e-4d90-a253-ee1fb761593e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:49.005321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:49.016454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:49.069701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc85f4-1a6d-4ea5-a02b-f7ce4053a34d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:49.074620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d292d2-1b8e-4d90-a253-ee1fb761593e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:49.081795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8e007-a225-4c20-9871-0ededc114e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:49.081795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8e007-a225-4c20-9871-0ededc114e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.081795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8e007-a225-4c20-9871-0ededc114e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.081795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8e007-a225-4c20-9871-0ededc114e13 admin admin] PATH_INFO: `/v3/projects/ec58695e287d40c689963afaa809919a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.082195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8e007-a225-4c20-9871-0ededc114e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec58695e287d40c689963afaa809919a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:49.082195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8e007-a225-4c20-9871-0ededc114e13 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:49.085145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d1694-ea7c-40a6-b1de-68795b1f6663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:49.086026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d1694-ea7c-40a6-b1de-68795b1f6663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.086314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d1694-ea7c-40a6-b1de-68795b1f6663 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.086589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d1694-ea7c-40a6-b1de-68795b1f6663 admin admin] PATH_INFO: `/v3/projects/4d6f1fadae804036b986367209f954c5` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.087935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d1694-ea7c-40a6-b1de-68795b1f6663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d6f1fadae804036b986367209f954c5)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:49.091480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d1694-ea7c-40a6-b1de-68795b1f6663 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:49.134975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-32d8e007-a225-4c20-9871-0ededc114e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec58695e287d40c689963afaa809919a', 'request_id': 'req-32d8e007-a225-4c20-9871-0ededc114e13'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:49.141375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-32d8e007-a225-4c20-9871-0ededc114e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec58695e287d40c689963afaa809919a', 'request_id': 'req-32d8e007-a225-4c20-9871-0ededc114e13'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:49.142886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a2d1694-ea7c-40a6-b1de-68795b1f6663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d6f1fadae804036b986367209f954c5', 'request_id': 'req-4a2d1694-ea7c-40a6-b1de-68795b1f6663'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:49.147048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-32d8e007-a225-4c20-9871-0ededc114e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec58695e287d40c689963afaa809919a', 'request_id': 'req-32d8e007-a225-4c20-9871-0ededc114e13'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:49.150831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a2d1694-ea7c-40a6-b1de-68795b1f6663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d6f1fadae804036b986367209f954c5', 'request_id': 'req-4a2d1694-ea7c-40a6-b1de-68795b1f6663'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:49.157465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a2d1694-ea7c-40a6-b1de-68795b1f6663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d6f1fadae804036b986367209f954c5', 'request_id': 'req-4a2d1694-ea7c-40a6-b1de-68795b1f6663'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:49.159428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-32d8e007-a225-4c20-9871-0ededc114e13 admin admin] The token cache is being invalidate because project ec58695e287d40c689963afaa809919a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:49.159716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-32d8e007-a225-4c20-9871-0ededc114e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:49.160344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-32d8e007-a225-4c20-9871-0ededc114e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:49.162264 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3675/7378] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:48 2022] DELETE /identity/v3/projects/ec58695e287d40c689963afaa809919a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:49.162683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8e007-a225-4c20-9871-0ededc114e13 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:49.163953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-32d8e007-a225-4c20-9871-0ededc114e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:49.173896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a2d1694-ea7c-40a6-b1de-68795b1f6663 admin admin] The token cache is being invalidate because project 4d6f1fadae804036b986367209f954c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:49.174257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a2d1694-ea7c-40a6-b1de-68795b1f6663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:49.174819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a2d1694-ea7c-40a6-b1de-68795b1f6663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:49.176836 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3704/7379] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:48 2022] DELETE /identity/v3/projects/4d6f1fadae804036b986367209f954c5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:49.178048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda55b2e-a888-4b07-b7b7-fb1050d9f0eb None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.178332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda55b2e-a888-4b07-b7b7-fb1050d9f0eb None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.178969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda55b2e-a888-4b07-b7b7-fb1050d9f0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.200935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bda55b2e-a888-4b07-b7b7-fb1050d9f0eb None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:49.202198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bda55b2e-a888-4b07-b7b7-fb1050d9f0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:49.237411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8e007-a225-4c20-9871-0ededc114e13 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:49.265099 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3705/7380] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:49.266562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8fe57-c5a8-48c4-bed6-924209506c96 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.266851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8fe57-c5a8-48c4-bed6-924209506c96 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.267133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8fe57-c5a8-48c4-bed6-924209506c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.284794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-74f8fe57-c5a8-48c4-bed6-924209506c96 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:49.286257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-74f8fe57-c5a8-48c4-bed6-924209506c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:49.294233 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3706/7381] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:49.295455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa082283-0672-45ed-a662-b96f82a956ea None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.295735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa082283-0672-45ed-a662-b96f82a956ea None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.296008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa082283-0672-45ed-a662-b96f82a956ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.302626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3c4fd-537d-4210-a9e1-b38645bfdb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:49.303893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3c4fd-537d-4210-a9e1-b38645bfdb25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.304220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3c4fd-537d-4210-a9e1-b38645bfdb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.304494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3c4fd-537d-4210-a9e1-b38645bfdb25 admin admin] PATH_INFO: `/v3/projects/ab40306e1dfc44ce8a2a8489b1f0c66f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.305686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3c4fd-537d-4210-a9e1-b38645bfdb25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab40306e1dfc44ce8a2a8489b1f0c66f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:49.307609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3c4fd-537d-4210-a9e1-b38645bfdb25 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:49.310599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:49.317048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-aa082283-0672-45ed-a662-b96f82a956ea None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:49.318298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-aa082283-0672-45ed-a662-b96f82a956ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:49.327208 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3707/7382] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:49.328400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f438a28-8019-43cc-afc1-76c638fd9c1d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.328684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f438a28-8019-43cc-afc1-76c638fd9c1d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.328959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f438a28-8019-43cc-afc1-76c638fd9c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.348259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0f438a28-8019-43cc-afc1-76c638fd9c1d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:49.349538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0f438a28-8019-43cc-afc1-76c638fd9c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:49.358824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2a3c4fd-537d-4210-a9e1-b38645bfdb25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab40306e1dfc44ce8a2a8489b1f0c66f', 'request_id': 'req-c2a3c4fd-537d-4210-a9e1-b38645bfdb25'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:49.365448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2a3c4fd-537d-4210-a9e1-b38645bfdb25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab40306e1dfc44ce8a2a8489b1f0c66f', 'request_id': 'req-c2a3c4fd-537d-4210-a9e1-b38645bfdb25'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:49.371325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2a3c4fd-537d-4210-a9e1-b38645bfdb25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab40306e1dfc44ce8a2a8489b1f0c66f', 'request_id': 'req-c2a3c4fd-537d-4210-a9e1-b38645bfdb25'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:49.377511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:49.386443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2a3c4fd-537d-4210-a9e1-b38645bfdb25 admin admin] The token cache is being invalidate because project ab40306e1dfc44ce8a2a8489b1f0c66f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:49.386952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2a3c4fd-537d-4210-a9e1-b38645bfdb25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:49.387806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c2a3c4fd-537d-4210-a9e1-b38645bfdb25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:49.389742 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3676/7383] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:49 2022] DELETE /identity/v3/projects/ab40306e1dfc44ce8a2a8489b1f0c66f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:49.392794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3c4fd-537d-4210-a9e1-b38645bfdb25 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:49.397894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c2a3c4fd-537d-4210-a9e1-b38645bfdb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:49.420190 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3708/7384] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:49.425032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e7be5-424d-4616-be93-606d0922faef None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.425302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e7be5-424d-4616-be93-606d0922faef None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.425609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e7be5-424d-4616-be93-606d0922faef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.449983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8a5e7be5-424d-4616-be93-606d0922faef None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:49.451232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8a5e7be5-424d-4616-be93-606d0922faef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:49.465765 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3709/7385] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:49.465765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e7be5-424d-4616-be93-606d0922faef None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:49.466045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3c4fd-537d-4210-a9e1-b38645bfdb25 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:49.470629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5302d-1c15-4002-ba8d-9302996f1c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:49.470890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e7be5-424d-4616-be93-606d0922faef None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:49.471299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5302d-1c15-4002-ba8d-9302996f1c0d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.471579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5302d-1c15-4002-ba8d-9302996f1c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.471858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5302d-1c15-4002-ba8d-9302996f1c0d admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.472624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5302d-1c15-4002-ba8d-9302996f1c0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:49.472945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5302d-1c15-4002-ba8d-9302996f1c0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:49.474588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5302d-1c15-4002-ba8d-9302996f1c0d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:49.475560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38104d0-cb8f-41c6-ba6c-62ec46fc380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:49.476246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38104d0-cb8f-41c6-ba6c-62ec46fc380b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.476532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38104d0-cb8f-41c6-ba6c-62ec46fc380b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.476808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38104d0-cb8f-41c6-ba6c-62ec46fc380b admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.477530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38104d0-cb8f-41c6-ba6c-62ec46fc380b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:49.477837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38104d0-cb8f-41c6-ba6c-62ec46fc380b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:49.479433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38104d0-cb8f-41c6-ba6c-62ec46fc380b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:49.487668 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3677/7386] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:49.487834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a386a69-1763-4959-8a9a-489b3d71c8f1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.488216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a386a69-1763-4959-8a9a-489b3d71c8f1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.488370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a386a69-1763-4959-8a9a-489b3d71c8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.491714 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3710/7387] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:49.492866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38104d0-cb8f-41c6-ba6c-62ec46fc380b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:49.505177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38104d0-cb8f-41c6-ba6c-62ec46fc380b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:49.509840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663591f1-31d1-4ef1-bb2c-c1ca3367022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:49.509993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9a386a69-1763-4959-8a9a-489b3d71c8f1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:49.510482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663591f1-31d1-4ef1-bb2c-c1ca3367022d admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.510762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663591f1-31d1-4ef1-bb2c-c1ca3367022d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.511035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663591f1-31d1-4ef1-bb2c-c1ca3367022d admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.511138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9a386a69-1763-4959-8a9a-489b3d71c8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:49.511714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663591f1-31d1-4ef1-bb2c-c1ca3367022d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:49.513650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663591f1-31d1-4ef1-bb2c-c1ca3367022d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:49.519509 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3678/7388] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:49.520347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a386a69-1763-4959-8a9a-489b3d71c8f1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:49.529874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a386a69-1763-4959-8a9a-489b3d71c8f1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:49.534698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa1c8c-89b0-44d0-ab66-d92779d34602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:49.535339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa1c8c-89b0-44d0-ab66-d92779d34602 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.535643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa1c8c-89b0-44d0-ab66-d92779d34602 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.535894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa1c8c-89b0-44d0-ab66-d92779d34602 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.536617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa1c8c-89b0-44d0-ab66-d92779d34602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:49.538515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa1c8c-89b0-44d0-ab66-d92779d34602 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:49.540852 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3711/7389] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:49 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:49.541693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663591f1-31d1-4ef1-bb2c-c1ca3367022d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:49.565794 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3679/7390] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:49 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:49.570038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa1c8c-89b0-44d0-ab66-d92779d34602 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:49.610742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663591f1-31d1-4ef1-bb2c-c1ca3367022d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:49.635897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:49.643464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa1c8c-89b0-44d0-ab66-d92779d34602 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:49.656421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ad035-a2d2-434e-b0ed-7d67a6ddcec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:49.657258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ad035-a2d2-434e-b0ed-7d67a6ddcec8 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.657767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ad035-a2d2-434e-b0ed-7d67a6ddcec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.658682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ad035-a2d2-434e-b0ed-7d67a6ddcec8 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.659756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ad035-a2d2-434e-b0ed-7d67a6ddcec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:49.661764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ad035-a2d2-434e-b0ed-7d67a6ddcec8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:49.677716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5f13c-d8f6-4045-908f-0e01618a84d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:49.678842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5f13c-d8f6-4045-908f-0e01618a84d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.679254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5f13c-d8f6-4045-908f-0e01618a84d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.679510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5f13c-d8f6-4045-908f-0e01618a84d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.680383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5f13c-d8f6-4045-908f-0e01618a84d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:49.680721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5f13c-d8f6-4045-908f-0e01618a84d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:49.682351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5f13c-d8f6-4045-908f-0e01618a84d6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:49.687356 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3680/7391] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:49 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:49.688183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ad035-a2d2-434e-b0ed-7d67a6ddcec8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:49.698773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ad035-a2d2-434e-b0ed-7d67a6ddcec8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:49.703119 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3712/7392] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:49.703119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5f13c-d8f6-4045-908f-0e01618a84d6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:49.709569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac39a29-8076-4c51-add9-bf89ca4882fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:49.710521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac39a29-8076-4c51-add9-bf89ca4882fa admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.710969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac39a29-8076-4c51-add9-bf89ca4882fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.711247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac39a29-8076-4c51-add9-bf89ca4882fa admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.711950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac39a29-8076-4c51-add9-bf89ca4882fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:49.713023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5f13c-d8f6-4045-908f-0e01618a84d6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:49.713969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac39a29-8076-4c51-add9-bf89ca4882fa admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:49.717965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a0c15-e839-4312-9c64-5ce2d16a9918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:49.718722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0c15-e839-4312-9c64-5ce2d16a9918 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.719072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0c15-e839-4312-9c64-5ce2d16a9918 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.719597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0c15-e839-4312-9c64-5ce2d16a9918 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.720262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a0c15-e839-4312-9c64-5ce2d16a9918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:49.722409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a0c15-e839-4312-9c64-5ce2d16a9918 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:49.735099 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3713/7393] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:49.736283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a0c15-e839-4312-9c64-5ce2d16a9918 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:49.740802 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3681/7394] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:49 2022] POST /identity/v3/users => generated 287 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:49.741832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac39a29-8076-4c51-add9-bf89ca4882fa admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:49.746755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a0c15-e839-4312-9c64-5ce2d16a9918 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:49.751919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fe8cf-2d7d-40b1-9b1f-e3b93f89671e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:49.752641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fe8cf-2d7d-40b1-9b1f-e3b93f89671e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.752925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fe8cf-2d7d-40b1-9b1f-e3b93f89671e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.753208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fe8cf-2d7d-40b1-9b1f-e3b93f89671e admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.753819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac39a29-8076-4c51-add9-bf89ca4882fa admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:49.753968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fe8cf-2d7d-40b1-9b1f-e3b93f89671e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:49.755907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fe8cf-2d7d-40b1-9b1f-e3b93f89671e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:49.758551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f40ec4-09f0-42c9-9b95-3ef694189bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:49.759300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f40ec4-09f0-42c9-9b95-3ef694189bac admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.759635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f40ec4-09f0-42c9-9b95-3ef694189bac admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.759919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f40ec4-09f0-42c9-9b95-3ef694189bac admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.760665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f40ec4-09f0-42c9-9b95-3ef694189bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:49.762252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f40ec4-09f0-42c9-9b95-3ef694189bac admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:49.780572 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3682/7395] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:49.781491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f40ec4-09f0-42c9-9b95-3ef694189bac admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:49.788233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:49.790314 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3714/7396] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:49 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:49.791194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fe8cf-2d7d-40b1-9b1f-e3b93f89671e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:49.796715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f40ec4-09f0-42c9-9b95-3ef694189bac admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:49.856676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fe8cf-2d7d-40b1-9b1f-e3b93f89671e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:49.861560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded5820-e7ea-4668-86bb-3860ee60c284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:49.862467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded5820-e7ea-4668-86bb-3860ee60c284 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.862753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded5820-e7ea-4668-86bb-3860ee60c284 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.863028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded5820-e7ea-4668-86bb-3860ee60c284 admin admin] PATH_INFO: `/v3/projects/f77e00280e17459785c6f7d8a5fd68fa/users/c014a61e2bc449c6a05a164834770565/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.866884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8b8e6-daf7-4742-b039-bde67b5fabec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:49.867558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8b8e6-daf7-4742-b039-bde67b5fabec admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.867840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8b8e6-daf7-4742-b039-bde67b5fabec admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.868148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8b8e6-daf7-4742-b039-bde67b5fabec admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.868905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8b8e6-daf7-4742-b039-bde67b5fabec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:49.870505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8b8e6-daf7-4742-b039-bde67b5fabec admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:49.879405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded5820-e7ea-4668-86bb-3860ee60c284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77e00280e17459785c6f7d8a5fd68fa, user_id=c014a61e2bc449c6a05a164834770565, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:49.881320 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3683/7397] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:49.882165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded5820-e7ea-4668-86bb-3860ee60c284 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:49.885421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8b8e6-daf7-4742-b039-bde67b5fabec admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:49.896676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8b8e6-daf7-4742-b039-bde67b5fabec admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:49.898199 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3715/7398] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:49 2022] PUT /identity/v3/projects/f77e00280e17459785c6f7d8a5fd68fa/users/c014a61e2bc449c6a05a164834770565/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:49.899100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded5820-e7ea-4668-86bb-3860ee60c284 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:49.955332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c163670-ede6-4ac3-8f70-c9c7d0a8b7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:49.956005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c163670-ede6-4ac3-8f70-c9c7d0a8b7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.956317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c163670-ede6-4ac3-8f70-c9c7d0a8b7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.956581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c163670-ede6-4ac3-8f70-c9c7d0a8b7c4 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.957281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c163670-ede6-4ac3-8f70-c9c7d0a8b7c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:49.959195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c163670-ede6-4ac3-8f70-c9c7d0a8b7c4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:49.969770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded5820-e7ea-4668-86bb-3860ee60c284 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:49.975445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c66a45-259f-4880-a40c-8a95aaab8069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:49.976380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c66a45-259f-4880-a40c-8a95aaab8069 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.976761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c66a45-259f-4880-a40c-8a95aaab8069 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.977052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c66a45-259f-4880-a40c-8a95aaab8069 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.977773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c66a45-259f-4880-a40c-8a95aaab8069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:49.979754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c66a45-259f-4880-a40c-8a95aaab8069 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:49.981224 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3684/7399] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:49 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:49.982521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be142a-ab56-4e4b-8a46-1b3b2cfd540b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:49.982869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be142a-ab56-4e4b-8a46-1b3b2cfd540b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:49.983148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be142a-ab56-4e4b-8a46-1b3b2cfd540b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:49.995578 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3716/7400] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:49.997118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c66a45-259f-4880-a40c-8a95aaab8069 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:50.007088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c66a45-259f-4880-a40c-8a95aaab8069 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:50.011280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d1be142a-ab56-4e4b-8a46-1b3b2cfd540b None None] MFA Rules not processed for user `c014a61e2bc449c6a05a164834770565`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:50.012743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d1be142a-ab56-4e4b-8a46-1b3b2cfd540b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:50.012984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a6b06-51dc-40d0-8c93-59cbedebe4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:50.013650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a6b06-51dc-40d0-8c93-59cbedebe4dc admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.014025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a6b06-51dc-40d0-8c93-59cbedebe4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.014250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a6b06-51dc-40d0-8c93-59cbedebe4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.015075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a6b06-51dc-40d0-8c93-59cbedebe4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:50.016598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a6b06-51dc-40d0-8c93-59cbedebe4dc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:50.027266 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3717/7401] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:50.028044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a6b06-51dc-40d0-8c93-59cbedebe4dc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:50.037927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a6b06-51dc-40d0-8c93-59cbedebe4dc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:50.042531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341216f-6b1b-4364-8e80-bbb449514070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:50.043401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341216f-6b1b-4364-8e80-bbb449514070 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.043679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341216f-6b1b-4364-8e80-bbb449514070 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.043953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341216f-6b1b-4364-8e80-bbb449514070 admin admin] PATH_INFO: `/v3/projects/7060b2c5cb5f497c953754722640c8f7/users/312f75b6d05240afb369a20bc453b6ce/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.051596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:50.059537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341216f-6b1b-4364-8e80-bbb449514070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7060b2c5cb5f497c953754722640c8f7, user_id=312f75b6d05240afb369a20bc453b6ce, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:50.062509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341216f-6b1b-4364-8e80-bbb449514070 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:50.081291 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3718/7402] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:50 2022] PUT /identity/v3/projects/7060b2c5cb5f497c953754722640c8f7/users/312f75b6d05240afb369a20bc453b6ce/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:50.081291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341216f-6b1b-4364-8e80-bbb449514070 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:50.097558 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3685/7403] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:50.100105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99a870-d679-44e5-8e70-a9996bd8c719 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.100398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99a870-d679-44e5-8e70-a9996bd8c719 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.100678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99a870-d679-44e5-8e70-a9996bd8c719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.129345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8e99a870-d679-44e5-8e70-a9996bd8c719 None None] MFA Rules not processed for user `312f75b6d05240afb369a20bc453b6ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:50.130483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8e99a870-d679-44e5-8e70-a9996bd8c719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:50.138176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:50.158413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341216f-6b1b-4364-8e80-bbb449514070 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:50.163466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d607fbf-edc5-4049-be80-831dcb1095e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:50.164853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d607fbf-edc5-4049-be80-831dcb1095e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.164853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d607fbf-edc5-4049-be80-831dcb1095e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.164853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d607fbf-edc5-4049-be80-831dcb1095e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.165421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d607fbf-edc5-4049-be80-831dcb1095e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:50.167036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d607fbf-edc5-4049-be80-831dcb1095e8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:50.181918 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3719/7404] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:50.181918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d607fbf-edc5-4049-be80-831dcb1095e8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:50.198540 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3686/7405] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:50.199628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99a870-d679-44e5-8e70-a9996bd8c719 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:50.210811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99a870-d679-44e5-8e70-a9996bd8c719 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:50.215946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f9786-a557-422c-b9c3-c859ae56ac86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:50.217205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f9786-a557-422c-b9c3-c859ae56ac86 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.217501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f9786-a557-422c-b9c3-c859ae56ac86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.217778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f9786-a557-422c-b9c3-c859ae56ac86 admin admin] PATH_INFO: `/v3/projects/2d932cb0b3ce497d91434197e26d49df/users/3b64f98782de40a283355c7b08f0b06c/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.233827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f9786-a557-422c-b9c3-c859ae56ac86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d932cb0b3ce497d91434197e26d49df, user_id=3b64f98782de40a283355c7b08f0b06c, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:50.237801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f9786-a557-422c-b9c3-c859ae56ac86 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:50.245727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d607fbf-edc5-4049-be80-831dcb1095e8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:50.252338 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3687/7406] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:50 2022] PUT /identity/v3/projects/2d932cb0b3ce497d91434197e26d49df/users/3b64f98782de40a283355c7b08f0b06c/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:50.253204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f9786-a557-422c-b9c3-c859ae56ac86 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:50.300326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9cb0a-9915-4f04-afed-ef9741b467bb tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c014a61e2bc449c6a05a164834770565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f77e00280e17459785c6f7d8a5fd68fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:50.301225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9cb0a-9915-4f04-afed-ef9741b467bb tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.301512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9cb0a-9915-4f04-afed-ef9741b467bb tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.301831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9cb0a-9915-4f04-afed-ef9741b467bb tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] PATH_INFO: `/v3/users/c014a61e2bc449c6a05a164834770565/application_credentials` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.302552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9cb0a-9915-4f04-afed-ef9741b467bb tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorizing `identity:create_application_credential(user_id=c014a61e2bc449c6a05a164834770565)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:50.304129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9cb0a-9915-4f04-afed-ef9741b467bb tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:50.316452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f9786-a557-422c-b9c3-c859ae56ac86 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:50.321272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75ab3c-85ff-4064-9021-223696743178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:50.321999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75ab3c-85ff-4064-9021-223696743178 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.322341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75ab3c-85ff-4064-9021-223696743178 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.322621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75ab3c-85ff-4064-9021-223696743178 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.323329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75ab3c-85ff-4064-9021-223696743178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:50.325378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75ab3c-85ff-4064-9021-223696743178 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:50.354503 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3688/7407] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:50 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:50.354503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b9ed7-caca-4084-a48a-1958d59feb45 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.354503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b9ed7-caca-4084-a48a-1958d59feb45 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.354503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b9ed7-caca-4084-a48a-1958d59feb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.383970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e47b9ed7-caca-4084-a48a-1958d59feb45 None None] MFA Rules not processed for user `3b64f98782de40a283355c7b08f0b06c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:50.385158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e47b9ed7-caca-4084-a48a-1958d59feb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:50.394165 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3720/7408] 10.222.0.43 () {60 vars in 1314 bytes} [Sat Jul 2 21:29:50 2022] POST /identity/v3/users/c014a61e2bc449c6a05a164834770565/application_credentials => generated 921 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:50.396028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9cb0a-9915-4f04-afed-ef9741b467bb tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:50.397381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:50.408492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9cb0a-9915-4f04-afed-ef9741b467bb tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:50.433506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:50.454591 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3689/7409] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:50.455451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b9ed7-caca-4084-a48a-1958d59feb45 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:50.480352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720fa7c-1d51-44cf-b6bd-6192c8ec4119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:50.481047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720fa7c-1d51-44cf-b6bd-6192c8ec4119 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.481363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720fa7c-1d51-44cf-b6bd-6192c8ec4119 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.481641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720fa7c-1d51-44cf-b6bd-6192c8ec4119 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.482356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720fa7c-1d51-44cf-b6bd-6192c8ec4119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:50.484392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720fa7c-1d51-44cf-b6bd-6192c8ec4119 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:50.505915 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3721/7410] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:50 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:50.506923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720fa7c-1d51-44cf-b6bd-6192c8ec4119 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:50.516550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720fa7c-1d51-44cf-b6bd-6192c8ec4119 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:50.519548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b9ed7-caca-4084-a48a-1958d59feb45 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:50.521240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d9fc2-a7e0-4ed2-b115-ca8d633b41f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:50.521877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d9fc2-a7e0-4ed2-b115-ca8d633b41f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.522162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d9fc2-a7e0-4ed2-b115-ca8d633b41f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.522442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d9fc2-a7e0-4ed2-b115-ca8d633b41f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.523125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d9fc2-a7e0-4ed2-b115-ca8d633b41f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:50.523600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa51945-d581-4469-af4e-15f3b650b3e1 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c014a61e2bc449c6a05a164834770565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f77e00280e17459785c6f7d8a5fd68fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:50.524583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa51945-d581-4469-af4e-15f3b650b3e1 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.524865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa51945-d581-4469-af4e-15f3b650b3e1 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.525081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d9fc2-a7e0-4ed2-b115-ca8d633b41f4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:50.525189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa51945-d581-4469-af4e-15f3b650b3e1 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] PATH_INFO: `/v3/users/c014a61e2bc449c6a05a164834770565/access_rules/2770adcbb3ae468caef5bf82a9680f2e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.526340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa51945-d581-4469-af4e-15f3b650b3e1 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorizing `identity:delete_access_rule(user_id=c014a61e2bc449c6a05a164834770565, access_rule_id=2770adcbb3ae468caef5bf82a9680f2e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:50.527691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa51945-d581-4469-af4e-15f3b650b3e1 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:50.551545 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3722/7411] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:50 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:50.552423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d9fc2-a7e0-4ed2-b115-ca8d633b41f4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:50.581057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-2fa51945-d581-4469-af4e-15f3b650b3e1 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jul 02 21:29:50.581057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:29:50.581057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Jul 02 21:29:50.581057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application session.delete(ref) Jul 02 21:29:50.581057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 21:29:50.581057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application next(self.gen) Jul 02 21:29:50.581057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 02 21:29:50.581057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application yield resource Jul 02 21:29:50.581057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 21:29:50.581057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application next(self.gen) Jul 02 21:29:50.581057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 02 21:29:50.581057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.session.rollback() Jul 02 21:29:50.581057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:29:50.581057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.force_reraise() Jul 02 21:29:50.581057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:29:50.581057 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise self.value Jul 02 21:29:50.582504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 02 21:29:50.582504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 02 21:29:50.582504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 02 21:29:50.582504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application session.commit() Jul 02 21:29:50.582504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 02 21:29:50.582504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 02 21:29:50.582504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 02 21:29:50.582504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._prepare_impl() Jul 02 21:29:50.582504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 02 21:29:50.582504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.session.flush() Jul 02 21:29:50.582504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 02 21:29:50.582504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._flush(objects) Jul 02 21:29:50.582504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 02 21:29:50.582504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 02 21:29:50.582504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 02 21:29:50.582504 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application compat.raise_( Jul 02 21:29:50.583530 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 21:29:50.583530 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception Jul 02 21:29:50.583530 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 02 21:29:50.583530 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application flush_context.execute() Jul 02 21:29:50.583530 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 02 21:29:50.583530 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rec.execute(self) Jul 02 21:29:50.583530 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Jul 02 21:29:50.583530 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Jul 02 21:29:50.583530 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Jul 02 21:29:50.583530 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._synchronize( Jul 02 21:29:50.583530 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Jul 02 21:29:50.583530 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Jul 02 21:29:50.583530 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Jul 02 21:29:50.583530 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise AssertionError( Jul 02 21:29:50.583530 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Jul 02 21:29:50.583530 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:29:50.584702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:29:50.584702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:29:50.584702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:29:50.584702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:29:50.584702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:29:50.584702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:29:50.584702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:29:50.584702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:29:50.584702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:29:50.584702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:29:50.584702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:29:50.584702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:29:50.584702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:29:50.584702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Jul 02 21:29:50.584702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Jul 02 21:29:50.584702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:29:50.584702 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:29:50.586216 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Jul 02 21:29:50.586216 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Jul 02 21:29:50.586216 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Jul 02 21:29:50.586216 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jul 02 21:29:50.586216 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jul 02 21:29:50.586216 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:29:50.586216 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3690/7412] 10.222.0.43 () {58 vars in 1361 bytes} [Sat Jul 2 21:29:50 2022] DELETE /identity/v3/users/c014a61e2bc449c6a05a164834770565/access_rules/2770adcbb3ae468caef5bf82a9680f2e => generated 89 bytes in 127 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Jul 02 21:29:50.586216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa51945-d581-4469-af4e-15f3b650b3e1 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:50.597581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa51945-d581-4469-af4e-15f3b650b3e1 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:50.622030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d9fc2-a7e0-4ed2-b115-ca8d633b41f4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:50.627069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691314d-08e1-4add-a751-e0a17f19ed40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:50.627868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691314d-08e1-4add-a751-e0a17f19ed40 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.628198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691314d-08e1-4add-a751-e0a17f19ed40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.628494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691314d-08e1-4add-a751-e0a17f19ed40 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.629388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691314d-08e1-4add-a751-e0a17f19ed40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:50.630992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691314d-08e1-4add-a751-e0a17f19ed40 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:50.641317 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3723/7413] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:50.642177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691314d-08e1-4add-a751-e0a17f19ed40 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:50.655794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e9a94-41a5-471d-8dc0-e66d4d1ad218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:50.656515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e9a94-41a5-471d-8dc0-e66d4d1ad218 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.656855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e9a94-41a5-471d-8dc0-e66d4d1ad218 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.657468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e9a94-41a5-471d-8dc0-e66d4d1ad218 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.658218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e9a94-41a5-471d-8dc0-e66d4d1ad218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:50.660204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e9a94-41a5-471d-8dc0-e66d4d1ad218 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:50.682314 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3691/7414] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:50 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:50.683654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e9a94-41a5-471d-8dc0-e66d4d1ad218 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:50.694211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e9a94-41a5-471d-8dc0-e66d4d1ad218 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:50.699868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19a0db-91bf-40a4-92e6-f1e35c442255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:50.700579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19a0db-91bf-40a4-92e6-f1e35c442255 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.700862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19a0db-91bf-40a4-92e6-f1e35c442255 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.701379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19a0db-91bf-40a4-92e6-f1e35c442255 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.702144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19a0db-91bf-40a4-92e6-f1e35c442255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:50.703754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19a0db-91bf-40a4-92e6-f1e35c442255 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:50.707867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691314d-08e1-4add-a751-e0a17f19ed40 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:50.712307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c364c26-0f35-41dc-92c7-22417420a47a tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c014a61e2bc449c6a05a164834770565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f77e00280e17459785c6f7d8a5fd68fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:50.713401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c364c26-0f35-41dc-92c7-22417420a47a tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.713764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c364c26-0f35-41dc-92c7-22417420a47a tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.714116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c364c26-0f35-41dc-92c7-22417420a47a tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] PATH_INFO: `/v3/users/c014a61e2bc449c6a05a164834770565/application_credentials/8126d2ccd2b74362a7c05cc60eb5508a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.715171 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3692/7415] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:50.719283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19a0db-91bf-40a4-92e6-f1e35c442255 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:50.730239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19a0db-91bf-40a4-92e6-f1e35c442255 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:50.734258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c364c26-0f35-41dc-92c7-22417420a47a tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorizing `identity:delete_application_credential(user_id=c014a61e2bc449c6a05a164834770565, application_credential_id=8126d2ccd2b74362a7c05cc60eb5508a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:50.735767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e9cde-d224-4491-9fc9-864a805d843f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:50.735961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c364c26-0f35-41dc-92c7-22417420a47a tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:50.736496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e9cde-d224-4491-9fc9-864a805d843f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.736759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e9cde-d224-4491-9fc9-864a805d843f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.737033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e9cde-d224-4491-9fc9-864a805d843f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.737759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e9cde-d224-4491-9fc9-864a805d843f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:50.739381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e9cde-d224-4491-9fc9-864a805d843f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:50.754590 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3693/7416] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:50.755536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e9cde-d224-4491-9fc9-864a805d843f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:50.762911 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3724/7417] 10.222.0.43 () {58 vars in 1394 bytes} [Sat Jul 2 21:29:50 2022] DELETE /identity/v3/users/c014a61e2bc449c6a05a164834770565/application_credentials/8126d2ccd2b74362a7c05cc60eb5508a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:50.764020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c364c26-0f35-41dc-92c7-22417420a47a tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:50.769698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e9cde-d224-4491-9fc9-864a805d843f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:50.774883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe70098-cf4e-4dea-8427-5d4f7363d173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:50.775432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c364c26-0f35-41dc-92c7-22417420a47a tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:50.775779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe70098-cf4e-4dea-8427-5d4f7363d173 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.776083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe70098-cf4e-4dea-8427-5d4f7363d173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.776355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe70098-cf4e-4dea-8427-5d4f7363d173 admin admin] PATH_INFO: `/v3/projects/d3967f4a16fd4f79953634bbf7ec0ae9/users/813e1edc04d849dca2993cd55df03302/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.780392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95966e76-fc44-4a13-884d-0035cd1bfc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:50.781054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95966e76-fc44-4a13-884d-0035cd1bfc4c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.781335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95966e76-fc44-4a13-884d-0035cd1bfc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.781613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95966e76-fc44-4a13-884d-0035cd1bfc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.782333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95966e76-fc44-4a13-884d-0035cd1bfc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:50.784077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95966e76-fc44-4a13-884d-0035cd1bfc4c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:50.785483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:50.793017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe70098-cf4e-4dea-8427-5d4f7363d173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3967f4a16fd4f79953634bbf7ec0ae9, user_id=813e1edc04d849dca2993cd55df03302, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:50.796517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe70098-cf4e-4dea-8427-5d4f7363d173 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:50.797176 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3725/7418] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:50.798077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95966e76-fc44-4a13-884d-0035cd1bfc4c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:50.808726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:50.813510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95966e76-fc44-4a13-884d-0035cd1bfc4c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:50.823977 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3694/7419] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:50 2022] PUT /identity/v3/projects/d3967f4a16fd4f79953634bbf7ec0ae9/users/813e1edc04d849dca2993cd55df03302/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:50.826159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe70098-cf4e-4dea-8427-5d4f7363d173 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:50.914315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe70098-cf4e-4dea-8427-5d4f7363d173 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:50.923524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb114af3-9f22-45da-b3e8-0870736b857f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:50.924649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb114af3-9f22-45da-b3e8-0870736b857f admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.924931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb114af3-9f22-45da-b3e8-0870736b857f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.925204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb114af3-9f22-45da-b3e8-0870736b857f admin admin] PATH_INFO: `/v3/projects/f7ecb8f0e10c4cd092c8815e639c65c6/users/3d7a22fdc8404ff9859c025311bfb789/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:50.946585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb114af3-9f22-45da-b3e8-0870736b857f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ecb8f0e10c4cd092c8815e639c65c6, user_id=3d7a22fdc8404ff9859c025311bfb789, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:50.950115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb114af3-9f22-45da-b3e8-0870736b857f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:50.968386 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3695/7420] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:50 2022] PUT /identity/v3/projects/f7ecb8f0e10c4cd092c8815e639c65c6/users/3d7a22fdc8404ff9859c025311bfb789/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:50.969899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee8eeb-fbea-48f8-a2e0-13e54b5b3c46 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:50.970195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee8eeb-fbea-48f8-a2e0-13e54b5b3c46 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:50.970473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee8eeb-fbea-48f8-a2e0-13e54b5b3c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.000124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-33ee8eeb-fbea-48f8-a2e0-13e54b5b3c46 None None] MFA Rules not processed for user `813e1edc04d849dca2993cd55df03302`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:51.001372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-33ee8eeb-fbea-48f8-a2e0-13e54b5b3c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:51.055118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6e50b-05f5-475c-8a12-c042f4504c1f tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c014a61e2bc449c6a05a164834770565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f77e00280e17459785c6f7d8a5fd68fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.056009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6e50b-05f5-475c-8a12-c042f4504c1f tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.056321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6e50b-05f5-475c-8a12-c042f4504c1f tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.056599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6e50b-05f5-475c-8a12-c042f4504c1f tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] PATH_INFO: `/v3/users/c014a61e2bc449c6a05a164834770565/access_rules` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.057883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6e50b-05f5-475c-8a12-c042f4504c1f tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorizing `identity:list_access_rules(user_id=c014a61e2bc449c6a05a164834770565)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.059380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6e50b-05f5-475c-8a12-c042f4504c1f tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.064529 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3726/7421] 10.222.0.43 () {58 vars in 1259 bytes} [Sat Jul 2 21:29:50 2022] GET /identity/v3/users/c014a61e2bc449c6a05a164834770565/access_rules => generated 369 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:51.065790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f8ff0-4fb0-4809-a298-82fb696cc1d7 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.066078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f8ff0-4fb0-4809-a298-82fb696cc1d7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.066356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f8ff0-4fb0-4809-a298-82fb696cc1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.069140 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3696/7422] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:51.069990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee8eeb-fbea-48f8-a2e0-13e54b5b3c46 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.094571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a82f8ff0-4fb0-4809-a298-82fb696cc1d7 None None] MFA Rules not processed for user `3d7a22fdc8404ff9859c025311bfb789`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:51.095734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a82f8ff0-4fb0-4809-a298-82fb696cc1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:51.127517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee8eeb-fbea-48f8-a2e0-13e54b5b3c46 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:51.132140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51763d1d-15f4-427d-bd82-e7865ce2fcf5 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c014a61e2bc449c6a05a164834770565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f77e00280e17459785c6f7d8a5fd68fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.133123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51763d1d-15f4-427d-bd82-e7865ce2fcf5 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.133403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51763d1d-15f4-427d-bd82-e7865ce2fcf5 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.133682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51763d1d-15f4-427d-bd82-e7865ce2fcf5 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] PATH_INFO: `/v3/users/c014a61e2bc449c6a05a164834770565/access_rules/2770adcbb3ae468caef5bf82a9680f2e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.134899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51763d1d-15f4-427d-bd82-e7865ce2fcf5 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorizing `identity:delete_access_rule(user_id=c014a61e2bc449c6a05a164834770565, access_rule_id=2770adcbb3ae468caef5bf82a9680f2e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.136368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51763d1d-15f4-427d-bd82-e7865ce2fcf5 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.153274 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3697/7423] 10.222.0.43 () {58 vars in 1361 bytes} [Sat Jul 2 21:29:51 2022] DELETE /identity/v3/users/c014a61e2bc449c6a05a164834770565/access_rules/2770adcbb3ae468caef5bf82a9680f2e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:51.154107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51763d1d-15f4-427d-bd82-e7865ce2fcf5 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.159468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:51.163102 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3727/7424] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:51.165214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f8ff0-4fb0-4809-a298-82fb696cc1d7 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.175243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f8ff0-4fb0-4809-a298-82fb696cc1d7 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:51.179738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2d199-6743-4399-97b8-68c77a8afc32 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c014a61e2bc449c6a05a164834770565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f77e00280e17459785c6f7d8a5fd68fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.180630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2d199-6743-4399-97b8-68c77a8afc32 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.180914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2d199-6743-4399-97b8-68c77a8afc32 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.181187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2d199-6743-4399-97b8-68c77a8afc32 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] PATH_INFO: `/v3/users/c014a61e2bc449c6a05a164834770565/access_rules` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.182414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2d199-6743-4399-97b8-68c77a8afc32 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorizing `identity:list_access_rules(user_id=c014a61e2bc449c6a05a164834770565)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.183897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2d199-6743-4399-97b8-68c77a8afc32 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.188570 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3728/7425] 10.222.0.43 () {58 vars in 1259 bytes} [Sat Jul 2 21:29:51 2022] GET /identity/v3/users/c014a61e2bc449c6a05a164834770565/access_rules => generated 158 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:51.189344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2d199-6743-4399-97b8-68c77a8afc32 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.222039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51763d1d-15f4-427d-bd82-e7865ce2fcf5 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:51.226791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087aafc-a6b1-438a-acc0-c3e64805be49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.227454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087aafc-a6b1-438a-acc0-c3e64805be49 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.227736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087aafc-a6b1-438a-acc0-c3e64805be49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.228015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087aafc-a6b1-438a-acc0-c3e64805be49 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.228737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087aafc-a6b1-438a-acc0-c3e64805be49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.230660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087aafc-a6b1-438a-acc0-c3e64805be49 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.254345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2d199-6743-4399-97b8-68c77a8afc32 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:51.257077 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3698/7426] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:51 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:51.257974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087aafc-a6b1-438a-acc0-c3e64805be49 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.261887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63351e2a-54a3-4970-aa81-2ca0a4b809a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.262561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63351e2a-54a3-4970-aa81-2ca0a4b809a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.262842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63351e2a-54a3-4970-aa81-2ca0a4b809a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.263111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63351e2a-54a3-4970-aa81-2ca0a4b809a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.263796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63351e2a-54a3-4970-aa81-2ca0a4b809a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.265817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63351e2a-54a3-4970-aa81-2ca0a4b809a4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.292950 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3729/7427] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:51 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:51.293816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63351e2a-54a3-4970-aa81-2ca0a4b809a4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.300308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:51.322264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087aafc-a6b1-438a-acc0-c3e64805be49 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:51.361617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63351e2a-54a3-4970-aa81-2ca0a4b809a4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:51.366788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aba75e-d92f-448d-87fa-f62314eab95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.367460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aba75e-d92f-448d-87fa-f62314eab95c admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.367737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aba75e-d92f-448d-87fa-f62314eab95c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.368013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aba75e-d92f-448d-87fa-f62314eab95c admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.368728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aba75e-d92f-448d-87fa-f62314eab95c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.370685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aba75e-d92f-448d-87fa-f62314eab95c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.375716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68c75c-e438-4ae4-810f-51bfb7991459 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c014a61e2bc449c6a05a164834770565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f77e00280e17459785c6f7d8a5fd68fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.376678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68c75c-e438-4ae4-810f-51bfb7991459 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.376960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68c75c-e438-4ae4-810f-51bfb7991459 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.377358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68c75c-e438-4ae4-810f-51bfb7991459 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] PATH_INFO: `/v3/users/c014a61e2bc449c6a05a164834770565/application_credentials` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.377958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68c75c-e438-4ae4-810f-51bfb7991459 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorizing `identity:create_application_credential(user_id=c014a61e2bc449c6a05a164834770565)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.379213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68c75c-e438-4ae4-810f-51bfb7991459 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.394134 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3730/7428] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:51 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:51.395192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aba75e-d92f-448d-87fa-f62314eab95c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.404949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aba75e-d92f-448d-87fa-f62314eab95c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:51.409549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a6a05-4fda-4da7-b08e-0de692cb5c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.410223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a6a05-4fda-4da7-b08e-0de692cb5c6f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.410504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a6a05-4fda-4da7-b08e-0de692cb5c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.410776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a6a05-4fda-4da7-b08e-0de692cb5c6f admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.411444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a6a05-4fda-4da7-b08e-0de692cb5c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.413405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a6a05-4fda-4da7-b08e-0de692cb5c6f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.430083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:51.434207 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3731/7429] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:51 2022] POST /identity/v3/users => generated 294 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:51.435070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a6a05-4fda-4da7-b08e-0de692cb5c6f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.447180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a6a05-4fda-4da7-b08e-0de692cb5c6f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:51.451882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadeb3e-d649-4936-aad3-b4315140bed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.452578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadeb3e-d649-4936-aad3-b4315140bed8 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.452895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadeb3e-d649-4936-aad3-b4315140bed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.453104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadeb3e-d649-4936-aad3-b4315140bed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.454128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadeb3e-d649-4936-aad3-b4315140bed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.455868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadeb3e-d649-4936-aad3-b4315140bed8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.469936 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3732/7430] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:51.469936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadeb3e-d649-4936-aad3-b4315140bed8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.470210 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3699/7431] 10.222.0.43 () {60 vars in 1314 bytes} [Sat Jul 2 21:29:51 2022] POST /identity/v3/users/c014a61e2bc449c6a05a164834770565/application_credentials => generated 919 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:51.471842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68c75c-e438-4ae4-810f-51bfb7991459 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.481477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadeb3e-d649-4936-aad3-b4315140bed8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:51.483577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68c75c-e438-4ae4-810f-51bfb7991459 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:51.486238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4a53f-bb5b-4cf9-a022-d919c126f6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.486898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4a53f-bb5b-4cf9-a022-d919c126f6ae admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.487178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4a53f-bb5b-4cf9-a022-d919c126f6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.487466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4a53f-bb5b-4cf9-a022-d919c126f6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.488290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4a53f-bb5b-4cf9-a022-d919c126f6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.488900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c76cc3-7150-49c4-a038-3ee2487bf0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.489797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c76cc3-7150-49c4-a038-3ee2487bf0d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.489926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4a53f-bb5b-4cf9-a022-d919c126f6ae admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.490068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c76cc3-7150-49c4-a038-3ee2487bf0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.490400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c76cc3-7150-49c4-a038-3ee2487bf0d5 admin admin] PATH_INFO: `/v3/projects/d761de65933b4e32885db1535309c2c4/users/17d630e3a3744f7f9232c069fe843d80/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.507178 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3733/7432] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:51.507178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4a53f-bb5b-4cf9-a022-d919c126f6ae admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.507672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c76cc3-7150-49c4-a038-3ee2487bf0d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d761de65933b4e32885db1535309c2c4, user_id=17d630e3a3744f7f9232c069fe843d80, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.510796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c76cc3-7150-49c4-a038-3ee2487bf0d5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.518589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4a53f-bb5b-4cf9-a022-d919c126f6ae admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:51.523388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb165c99-01ab-432c-bf17-e88ea13a91c0 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c014a61e2bc449c6a05a164834770565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f77e00280e17459785c6f7d8a5fd68fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.524468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb165c99-01ab-432c-bf17-e88ea13a91c0 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.524702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb165c99-01ab-432c-bf17-e88ea13a91c0 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.524990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb165c99-01ab-432c-bf17-e88ea13a91c0 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] PATH_INFO: `/v3/users/c014a61e2bc449c6a05a164834770565/access_rules` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.526268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb165c99-01ab-432c-bf17-e88ea13a91c0 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorizing `identity:list_access_rules(user_id=c014a61e2bc449c6a05a164834770565)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.526773 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3700/7433] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:51 2022] PUT /identity/v3/projects/d761de65933b4e32885db1535309c2c4/users/17d630e3a3744f7f9232c069fe843d80/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:51.527660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c76cc3-7150-49c4-a038-3ee2487bf0d5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.527772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb165c99-01ab-432c-bf17-e88ea13a91c0 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.533837 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3734/7434] 10.222.0.43 () {58 vars in 1259 bytes} [Sat Jul 2 21:29:51 2022] GET /identity/v3/users/c014a61e2bc449c6a05a164834770565/access_rules => generated 369 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:51.534644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb165c99-01ab-432c-bf17-e88ea13a91c0 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.550763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb165c99-01ab-432c-bf17-e88ea13a91c0 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:51.603112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c76cc3-7150-49c4-a038-3ee2487bf0d5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:51.607557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0964c09-f0eb-45f1-95cf-7ca849174cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.608226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3361f-ae30-4c64-870e-d6a8a3aee6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.608550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0964c09-f0eb-45f1-95cf-7ca849174cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.608833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0964c09-f0eb-45f1-95cf-7ca849174cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.609109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0964c09-f0eb-45f1-95cf-7ca849174cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.609209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3361f-ae30-4c64-870e-d6a8a3aee6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.609428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3361f-ae30-4c64-870e-d6a8a3aee6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.609722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3361f-ae30-4c64-870e-d6a8a3aee6a4 admin admin] PATH_INFO: `/v3/projects/c970adae9c614485828995b2b100e57f/users/57738b3dc8724df7b4796415772a1574/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.609834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0964c09-f0eb-45f1-95cf-7ca849174cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.611431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0964c09-f0eb-45f1-95cf-7ca849174cd5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.621718 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3735/7435] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:51.622521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0964c09-f0eb-45f1-95cf-7ca849174cd5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.626651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3361f-ae30-4c64-870e-d6a8a3aee6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c970adae9c614485828995b2b100e57f, user_id=57738b3dc8724df7b4796415772a1574, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.629346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3361f-ae30-4c64-870e-d6a8a3aee6a4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.644491 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3701/7436] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:51 2022] PUT /identity/v3/projects/c970adae9c614485828995b2b100e57f/users/57738b3dc8724df7b4796415772a1574/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:51.645431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3361f-ae30-4c64-870e-d6a8a3aee6a4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.672820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:51.688312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0964c09-f0eb-45f1-95cf-7ca849174cd5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:51.714937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3361f-ae30-4c64-870e-d6a8a3aee6a4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:51.719668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808b857-0d97-45ec-a082-6dd8df24471a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.720596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808b857-0d97-45ec-a082-6dd8df24471a admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.720879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808b857-0d97-45ec-a082-6dd8df24471a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.721157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808b857-0d97-45ec-a082-6dd8df24471a admin admin] PATH_INFO: `/v3/projects/d761de65933b4e32885db1535309c2c4/users/17d630e3a3744f7f9232c069fe843d80/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.723296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808b857-0d97-45ec-a082-6dd8df24471a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d761de65933b4e32885db1535309c2c4, user_id=17d630e3a3744f7f9232c069fe843d80, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.726196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808b857-0d97-45ec-a082-6dd8df24471a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.737822 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3702/7437] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:51 2022] PUT /identity/v3/projects/d761de65933b4e32885db1535309c2c4/users/17d630e3a3744f7f9232c069fe843d80/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:51.738536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808b857-0d97-45ec-a082-6dd8df24471a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.746313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6fc59-2264-48a6-8d06-171f07bcf732 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c014a61e2bc449c6a05a164834770565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f77e00280e17459785c6f7d8a5fd68fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.747229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6fc59-2264-48a6-8d06-171f07bcf732 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.747573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6fc59-2264-48a6-8d06-171f07bcf732 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.747900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6fc59-2264-48a6-8d06-171f07bcf732 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] PATH_INFO: `/v3/users/c014a61e2bc449c6a05a164834770565/application_credentials` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.748669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6fc59-2264-48a6-8d06-171f07bcf732 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorizing `identity:create_application_credential(user_id=c014a61e2bc449c6a05a164834770565)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.749847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6fc59-2264-48a6-8d06-171f07bcf732 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.773055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:51.803312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808b857-0d97-45ec-a082-6dd8df24471a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:51.808982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08deb8e-63a5-4302-a506-d38398d85272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.809844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08deb8e-63a5-4302-a506-d38398d85272 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.810132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08deb8e-63a5-4302-a506-d38398d85272 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.810413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08deb8e-63a5-4302-a506-d38398d85272 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.811228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08deb8e-63a5-4302-a506-d38398d85272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.812920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08deb8e-63a5-4302-a506-d38398d85272 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.823828 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3703/7438] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:51.825173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f439d-f146-4eec-b546-e2e83324a56b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.825582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f439d-f146-4eec-b546-e2e83324a56b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.825868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f439d-f146-4eec-b546-e2e83324a56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.830695 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3736/7439] 10.222.0.43 () {60 vars in 1314 bytes} [Sat Jul 2 21:29:51 2022] POST /identity/v3/users/c014a61e2bc449c6a05a164834770565/application_credentials => generated 921 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:51.831623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6fc59-2264-48a6-8d06-171f07bcf732 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.845101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6fc59-2264-48a6-8d06-171f07bcf732 tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:51.849803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b55da-9cb9-4f77-897b-8111f7cd9c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.850754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b55da-9cb9-4f77-897b-8111f7cd9c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.851036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b55da-9cb9-4f77-897b-8111f7cd9c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.851311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b55da-9cb9-4f77-897b-8111f7cd9c16 admin admin] PATH_INFO: `/v3/projects/c970adae9c614485828995b2b100e57f/users/57738b3dc8724df7b4796415772a1574/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.853331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b55da-9cb9-4f77-897b-8111f7cd9c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c970adae9c614485828995b2b100e57f, user_id=57738b3dc8724df7b4796415772a1574, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.853590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9b6f439d-f146-4eec-b546-e2e83324a56b None None] MFA Rules not processed for user `17d630e3a3744f7f9232c069fe843d80`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:51.854820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9b6f439d-f146-4eec-b546-e2e83324a56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:51.855975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b55da-9cb9-4f77-897b-8111f7cd9c16 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.866580 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3737/7440] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:51 2022] PUT /identity/v3/projects/c970adae9c614485828995b2b100e57f/users/57738b3dc8724df7b4796415772a1574/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:51.867375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b55da-9cb9-4f77-897b-8111f7cd9c16 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.926716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b55da-9cb9-4f77-897b-8111f7cd9c16 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:51.930408 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3704/7441] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:51.931431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872d144-89f7-4910-bea1-4a918ce9453c tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c014a61e2bc449c6a05a164834770565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f77e00280e17459785c6f7d8a5fd68fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:51.931716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3f898-c119-45cd-96d7-cdc71018b9de None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.932002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3f898-c119-45cd-96d7-cdc71018b9de None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.932458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872d144-89f7-4910-bea1-4a918ce9453c tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:51.933029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872d144-89f7-4910-bea1-4a918ce9453c tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:51.933137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3f898-c119-45cd-96d7-cdc71018b9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.933232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872d144-89f7-4910-bea1-4a918ce9453c tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] PATH_INFO: `/v3/users/c014a61e2bc449c6a05a164834770565/access_rules/d7f44bfccfe04b7d8621dfab2326ede8` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:51.934419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872d144-89f7-4910-bea1-4a918ce9453c tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorizing `identity:get_access_rule(user_id=c014a61e2bc449c6a05a164834770565, access_rule_id=d7f44bfccfe04b7d8621dfab2326ede8)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:51.935979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872d144-89f7-4910-bea1-4a918ce9453c tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:51.942442 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3738/7442] 10.222.0.43 () {58 vars in 1358 bytes} [Sat Jul 2 21:29:51 2022] GET /identity/v3/users/c014a61e2bc449c6a05a164834770565/access_rules/d7f44bfccfe04b7d8621dfab2326ede8 => generated 229 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:51.947103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872d144-89f7-4910-bea1-4a918ce9453c tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:51.948838 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7872d144-89f7-4910-bea1-4a918ce9453c tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:51.962105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b4c3f898-c119-45cd-96d7-cdc71018b9de None None] MFA Rules not processed for user `57738b3dc8724df7b4796415772a1574`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:51.963522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b4c3f898-c119-45cd-96d7-cdc71018b9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:51.974381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:52.009138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872d144-89f7-4910-bea1-4a918ce9453c tempest-AccessRulesV3Test-1801490504 tempest-AccessRulesV3Test-1801490504-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:52.012835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f801b1f-cae2-443b-a82c-6770c2d42ac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:52.013488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f801b1f-cae2-443b-a82c-6770c2d42ac2 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:52.013771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f801b1f-cae2-443b-a82c-6770c2d42ac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:52.014094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f801b1f-cae2-443b-a82c-6770c2d42ac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:52.039765 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3705/7443] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:52.040702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3f898-c119-45cd-96d7-cdc71018b9de None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:52.084001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f801b1f-cae2-443b-a82c-6770c2d42ac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:52.085698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f801b1f-cae2-443b-a82c-6770c2d42ac2 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:52.102758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:52.102942 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3739/7444] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:52.105173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f801b1f-cae2-443b-a82c-6770c2d42ac2 service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:52.107165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0f801b1f-cae2-443b-a82c-6770c2d42ac2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:52.132482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3f898-c119-45cd-96d7-cdc71018b9de None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:52.133193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f801b1f-cae2-443b-a82c-6770c2d42ac2 service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:52.142400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfcac4-1f9d-4a10-8077-15673f344b87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:52.143113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfcac4-1f9d-4a10-8077-15673f344b87 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:52.143398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfcac4-1f9d-4a10-8077-15673f344b87 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:52.143678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfcac4-1f9d-4a10-8077-15673f344b87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:52.145047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7fbb4-92fd-4676-9625-84458ff70fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:52.145952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7fbb4-92fd-4676-9625-84458ff70fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:52.146282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7fbb4-92fd-4676-9625-84458ff70fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:52.146561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7fbb4-92fd-4676-9625-84458ff70fb7 admin admin] PATH_INFO: `/v3/users/c014a61e2bc449c6a05a164834770565` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:52.147825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7fbb4-92fd-4676-9625-84458ff70fb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c014a61e2bc449c6a05a164834770565)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:52.150547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7fbb4-92fd-4676-9625-84458ff70fb7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:52.201783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7c7fbb4-92fd-4676-9625-84458ff70fb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c014a61e2bc449c6a05a164834770565'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:52.205580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfcac4-1f9d-4a10-8077-15673f344b87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:52.207025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfcac4-1f9d-4a10-8077-15673f344b87 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:52.209013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7c7fbb4-92fd-4676-9625-84458ff70fb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c014a61e2bc449c6a05a164834770565'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:52.216065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7c7fbb4-92fd-4676-9625-84458ff70fb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c014a61e2bc449c6a05a164834770565'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:52.216232 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3740/7445] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:52.216895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7c7fbb4-92fd-4676-9625-84458ff70fb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c014a61e2bc449c6a05a164834770565'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:52.217017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfcac4-1f9d-4a10-8077-15673f344b87 service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:52.217729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e7c7fbb4-92fd-4676-9625-84458ff70fb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c014a61e2bc449c6a05a164834770565'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:52.227782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfcac4-1f9d-4a10-8077-15673f344b87 service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:52.233331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b28fa8-dab0-4e14-b1c6-81578190bb6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:52.234465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b28fa8-dab0-4e14-b1c6-81578190bb6b service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:52.234892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b28fa8-dab0-4e14-b1c6-81578190bb6b service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:52.235386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b28fa8-dab0-4e14-b1c6-81578190bb6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:52.237567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a5b28fa8-dab0-4e14-b1c6-81578190bb6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:52.280475 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3706/7446] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:52 2022] DELETE /identity/v3/users/c014a61e2bc449c6a05a164834770565 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:52.284901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766f0d3-a53f-4b95-8354-9752861b7b63 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:52.285396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766f0d3-a53f-4b95-8354-9752861b7b63 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:52.285713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766f0d3-a53f-4b95-8354-9752861b7b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:52.304158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b766f0d3-a53f-4b95-8354-9752861b7b63 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:52.305393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b766f0d3-a53f-4b95-8354-9752861b7b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:52.308840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b28fa8-dab0-4e14-b1c6-81578190bb6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:52.310318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b28fa8-dab0-4e14-b1c6-81578190bb6b service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:52.325994 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3741/7447] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:52.394506 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3707/7448] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:52.404915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b28fa8-dab0-4e14-b1c6-81578190bb6b service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:52.406841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a5b28fa8-dab0-4e14-b1c6-81578190bb6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:52.421459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:52.484765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b28fa8-dab0-4e14-b1c6-81578190bb6b service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:52.546773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8d8e6-5e52-4550-829e-8876ced56de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:52.547660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8d8e6-5e52-4550-829e-8876ced56de4 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:52.548072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8d8e6-5e52-4550-829e-8876ced56de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:52.548338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8d8e6-5e52-4550-829e-8876ced56de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:52.561864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8d8e6-5e52-4550-829e-8876ced56de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:52.563783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8d8e6-5e52-4550-829e-8876ced56de4 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:52.577719 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3742/7449] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:52.874522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766f0d3-a53f-4b95-8354-9752861b7b63 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:52.876140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b766f0d3-a53f-4b95-8354-9752861b7b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:52.889707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766f0d3-a53f-4b95-8354-9752861b7b63 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:52.895047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badffbcb-6a80-4ded-859d-5a1b32b77bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:52.895946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badffbcb-6a80-4ded-859d-5a1b32b77bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:52.896455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badffbcb-6a80-4ded-859d-5a1b32b77bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:52.896737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badffbcb-6a80-4ded-859d-5a1b32b77bc9 admin admin] PATH_INFO: `/v3/projects/f77e00280e17459785c6f7d8a5fd68fa` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:52.898058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badffbcb-6a80-4ded-859d-5a1b32b77bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f77e00280e17459785c6f7d8a5fd68fa)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:52.899983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badffbcb-6a80-4ded-859d-5a1b32b77bc9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:52.935566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:52.952076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-badffbcb-6a80-4ded-859d-5a1b32b77bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f77e00280e17459785c6f7d8a5fd68fa', 'request_id': 'req-badffbcb-6a80-4ded-859d-5a1b32b77bc9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:52.958408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-badffbcb-6a80-4ded-859d-5a1b32b77bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f77e00280e17459785c6f7d8a5fd68fa', 'request_id': 'req-badffbcb-6a80-4ded-859d-5a1b32b77bc9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:52.964200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-badffbcb-6a80-4ded-859d-5a1b32b77bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f77e00280e17459785c6f7d8a5fd68fa', 'request_id': 'req-badffbcb-6a80-4ded-859d-5a1b32b77bc9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:52.980144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-badffbcb-6a80-4ded-859d-5a1b32b77bc9 admin admin] The token cache is being invalidate because project f77e00280e17459785c6f7d8a5fd68fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:52.980438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-badffbcb-6a80-4ded-859d-5a1b32b77bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:52.981171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-badffbcb-6a80-4ded-859d-5a1b32b77bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:52.982945 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3708/7450] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:52 2022] DELETE /identity/v3/projects/f77e00280e17459785c6f7d8a5fd68fa => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:52.988388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703a4de-4e9e-40a5-a989-020adf5e877b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:52.988678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703a4de-4e9e-40a5-a989-020adf5e877b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:52.988918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703a4de-4e9e-40a5-a989-020adf5e877b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:53.008165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5703a4de-4e9e-40a5-a989-020adf5e877b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:53.009376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5703a4de-4e9e-40a5-a989-020adf5e877b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:53.069804 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3743/7451] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:53.078927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b43dc1-de07-4f13-b0be-6d9c06c0b680 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:53.079208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b43dc1-de07-4f13-b0be-6d9c06c0b680 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:53.079453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b43dc1-de07-4f13-b0be-6d9c06c0b680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:53.099392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-43b43dc1-de07-4f13-b0be-6d9c06c0b680 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:53.100617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-43b43dc1-de07-4f13-b0be-6d9c06c0b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:53.109524 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3709/7452] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:53.114083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703a4de-4e9e-40a5-a989-020adf5e877b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:53.124470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703a4de-4e9e-40a5-a989-020adf5e877b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:53.130014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004aa30-7348-47e6-a9b8-880b4f0ec4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:53.130765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004aa30-7348-47e6-a9b8-880b4f0ec4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:53.131050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004aa30-7348-47e6-a9b8-880b4f0ec4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:53.131325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004aa30-7348-47e6-a9b8-880b4f0ec4e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:53.132336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004aa30-7348-47e6-a9b8-880b4f0ec4e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:53.132828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004aa30-7348-47e6-a9b8-880b4f0ec4e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:53.135839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004aa30-7348-47e6-a9b8-880b4f0ec4e8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:53.151463 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3744/7453] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:53.155924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b43dc1-de07-4f13-b0be-6d9c06c0b680 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:53.165714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b43dc1-de07-4f13-b0be-6d9c06c0b680 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:53.171504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9a00b-5651-4584-b105-40090a1bb4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:53.172201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9a00b-5651-4584-b105-40090a1bb4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:53.172489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9a00b-5651-4584-b105-40090a1bb4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:53.172769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9a00b-5651-4584-b105-40090a1bb4b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:53.173466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9a00b-5651-4584-b105-40090a1bb4b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:53.175380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9a00b-5651-4584-b105-40090a1bb4b5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:53.207151 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3710/7454] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:53 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:53.208482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004aa30-7348-47e6-a9b8-880b4f0ec4e8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:53.218687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004aa30-7348-47e6-a9b8-880b4f0ec4e8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:53.271535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:53.279074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365272e-2f52-44d4-bc83-5a046cf2fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:53.279823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365272e-2f52-44d4-bc83-5a046cf2fd6d admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:53.280134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365272e-2f52-44d4-bc83-5a046cf2fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:53.280417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365272e-2f52-44d4-bc83-5a046cf2fd6d admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:53.281113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365272e-2f52-44d4-bc83-5a046cf2fd6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:53.283095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365272e-2f52-44d4-bc83-5a046cf2fd6d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:53.307833 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3745/7455] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:53 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:53.311879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9a00b-5651-4584-b105-40090a1bb4b5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:53.322518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9a00b-5651-4584-b105-40090a1bb4b5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:53.327379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f8b3f-4018-49a7-84e6-29d31f69e4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:53.328087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f8b3f-4018-49a7-84e6-29d31f69e4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:53.328379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f8b3f-4018-49a7-84e6-29d31f69e4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:53.328662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f8b3f-4018-49a7-84e6-29d31f69e4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:53.329617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f8b3f-4018-49a7-84e6-29d31f69e4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:53.331238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f8b3f-4018-49a7-84e6-29d31f69e4a3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:53.494289 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3711/7456] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:53.497745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365272e-2f52-44d4-bc83-5a046cf2fd6d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:53.508319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365272e-2f52-44d4-bc83-5a046cf2fd6d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:53.513442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78966b89-d398-49c8-9282-087eb2d9da95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:53.514126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78966b89-d398-49c8-9282-087eb2d9da95 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:53.514411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78966b89-d398-49c8-9282-087eb2d9da95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:53.514692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78966b89-d398-49c8-9282-087eb2d9da95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:53.515416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78966b89-d398-49c8-9282-087eb2d9da95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:53.517072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78966b89-d398-49c8-9282-087eb2d9da95 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:53.529374 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3746/7457] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:53.533736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f8b3f-4018-49a7-84e6-29d31f69e4a3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:53.544588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f8b3f-4018-49a7-84e6-29d31f69e4a3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:53.550279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796cb64-adda-44e2-9151-94f9e8f9d75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:53.551167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796cb64-adda-44e2-9151-94f9e8f9d75e admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:53.551443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796cb64-adda-44e2-9151-94f9e8f9d75e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:53.551712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796cb64-adda-44e2-9151-94f9e8f9d75e admin admin] PATH_INFO: `/v3/projects/213dc9626b6c4872b39674d06bb8958d/users/542fb8039c324ba6bf022b0e96836043/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:53.567249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796cb64-adda-44e2-9151-94f9e8f9d75e admin admin] RBAC: Authorizing `identity:create_grant(project_id=213dc9626b6c4872b39674d06bb8958d, user_id=542fb8039c324ba6bf022b0e96836043, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:53.569891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796cb64-adda-44e2-9151-94f9e8f9d75e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:53.583813 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3712/7458] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:53 2022] PUT /identity/v3/projects/213dc9626b6c4872b39674d06bb8958d/users/542fb8039c324ba6bf022b0e96836043/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:53.594588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6a15c-714c-42a3-a5a5-75f6d5add119 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:53.594907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6a15c-714c-42a3-a5a5-75f6d5add119 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:53.595190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6a15c-714c-42a3-a5a5-75f6d5add119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:53.625222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4de6a15c-714c-42a3-a5a5-75f6d5add119 None None] MFA Rules not processed for user `542fb8039c324ba6bf022b0e96836043`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:53.626620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4de6a15c-714c-42a3-a5a5-75f6d5add119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:53.696579 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3747/7459] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:53.701816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796cb64-adda-44e2-9151-94f9e8f9d75e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:53.711966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796cb64-adda-44e2-9151-94f9e8f9d75e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:53.716483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204bf53-979f-4f6a-873a-21a0e9dc4d93 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542fb8039c324ba6bf022b0e96836043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '213dc9626b6c4872b39674d06bb8958d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:53.717507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204bf53-979f-4f6a-873a-21a0e9dc4d93 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:53.717847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204bf53-979f-4f6a-873a-21a0e9dc4d93 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:53.718182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204bf53-979f-4f6a-873a-21a0e9dc4d93 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] PATH_INFO: `/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:53.718967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204bf53-979f-4f6a-873a-21a0e9dc4d93 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorizing `identity:create_application_credential(user_id=542fb8039c324ba6bf022b0e96836043)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:53.720200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204bf53-979f-4f6a-873a-21a0e9dc4d93 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:53.804307 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3713/7460] 10.222.0.43 () {60 vars in 1313 bytes} [Sat Jul 2 21:29:53 2022] POST /identity/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials => generated 789 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:53.809573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6a15c-714c-42a3-a5a5-75f6d5add119 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:53.823962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6a15c-714c-42a3-a5a5-75f6d5add119 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:53.828408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255b37e-b4ef-480b-88e8-9f8786b25f80 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542fb8039c324ba6bf022b0e96836043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '213dc9626b6c4872b39674d06bb8958d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:53.829362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255b37e-b4ef-480b-88e8-9f8786b25f80 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:53.830007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255b37e-b4ef-480b-88e8-9f8786b25f80 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:53.830007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255b37e-b4ef-480b-88e8-9f8786b25f80 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] PATH_INFO: `/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials/f4c54cb5b5a84906afe8248067816685` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:53.840290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255b37e-b4ef-480b-88e8-9f8786b25f80 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorizing `identity:get_application_credential(user_id=542fb8039c324ba6bf022b0e96836043, application_credential_id=f4c54cb5b5a84906afe8248067816685)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:53.842024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255b37e-b4ef-480b-88e8-9f8786b25f80 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:53.843940 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3748/7461] 10.222.0.43 () {58 vars in 1391 bytes} [Sat Jul 2 21:29:53 2022] GET /identity/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials/f4c54cb5b5a84906afe8248067816685 => generated 689 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:29:53.848323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f2d3a-9a68-461e-adf2-0f8f4be82ff4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:53.848787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f2d3a-9a68-461e-adf2-0f8f4be82ff4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:53.856100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f2d3a-9a68-461e-adf2-0f8f4be82ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:53.874044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4f4f2d3a-9a68-461e-adf2-0f8f4be82ff4 None None] MFA Rules not processed for user `542fb8039c324ba6bf022b0e96836043`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:53.876561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4f4f2d3a-9a68-461e-adf2-0f8f4be82ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:53.955111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:54.020897 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3714/7462] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:53 2022] POST /identity/v3/auth/tokens => generated 3415 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Jul 02 21:29:54.025017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255b37e-b4ef-480b-88e8-9f8786b25f80 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:54.035363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255b37e-b4ef-480b-88e8-9f8786b25f80 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:54.039675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d6f74-cb90-48ae-9b58-d3b950364d1d tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542fb8039c324ba6bf022b0e96836043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '213dc9626b6c4872b39674d06bb8958d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:54.040665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d6f74-cb90-48ae-9b58-d3b950364d1d tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:54.041035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d6f74-cb90-48ae-9b58-d3b950364d1d tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:54.041271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d6f74-cb90-48ae-9b58-d3b950364d1d tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] PATH_INFO: `/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials/f4c54cb5b5a84906afe8248067816685` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:54.042532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d6f74-cb90-48ae-9b58-d3b950364d1d tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorizing `identity:delete_application_credential(user_id=542fb8039c324ba6bf022b0e96836043, application_credential_id=f4c54cb5b5a84906afe8248067816685)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:54.044230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d6f74-cb90-48ae-9b58-d3b950364d1d tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:54.063971 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3749/7463] 10.222.0.43 () {58 vars in 1394 bytes} [Sat Jul 2 21:29:54 2022] DELETE /identity/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials/f4c54cb5b5a84906afe8248067816685 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:54.069353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f2d3a-9a68-461e-adf2-0f8f4be82ff4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:54.080906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f2d3a-9a68-461e-adf2-0f8f4be82ff4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:54.084562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e6ecd-4bbf-49fd-b4b2-0e4bffda5271 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542fb8039c324ba6bf022b0e96836043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '213dc9626b6c4872b39674d06bb8958d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:54.085451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e6ecd-4bbf-49fd-b4b2-0e4bffda5271 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:54.085794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e6ecd-4bbf-49fd-b4b2-0e4bffda5271 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:54.085987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e6ecd-4bbf-49fd-b4b2-0e4bffda5271 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] PATH_INFO: `/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:54.086713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e6ecd-4bbf-49fd-b4b2-0e4bffda5271 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorizing `identity:create_application_credential(user_id=542fb8039c324ba6bf022b0e96836043)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:54.087887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e6ecd-4bbf-49fd-b4b2-0e4bffda5271 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:54.170531 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3715/7464] 10.222.0.43 () {60 vars in 1314 bytes} [Sat Jul 2 21:29:54 2022] POST /identity/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials => generated 921 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:54.174946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d6f74-cb90-48ae-9b58-d3b950364d1d tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:54.184885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d6f74-cb90-48ae-9b58-d3b950364d1d tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:54.189092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced0914-af92-4005-ba72-0e60dad2bba9 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542fb8039c324ba6bf022b0e96836043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '213dc9626b6c4872b39674d06bb8958d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:54.190040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced0914-af92-4005-ba72-0e60dad2bba9 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:54.190319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced0914-af92-4005-ba72-0e60dad2bba9 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:54.190596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced0914-af92-4005-ba72-0e60dad2bba9 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] PATH_INFO: `/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials/1057ded8758a4dbb8c2bc11906ffb82c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:54.201661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced0914-af92-4005-ba72-0e60dad2bba9 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorizing `identity:delete_application_credential(user_id=542fb8039c324ba6bf022b0e96836043, application_credential_id=1057ded8758a4dbb8c2bc11906ffb82c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:54.203188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced0914-af92-4005-ba72-0e60dad2bba9 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:54.223400 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3750/7465] 10.222.0.43 () {58 vars in 1394 bytes} [Sat Jul 2 21:29:54 2022] DELETE /identity/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials/1057ded8758a4dbb8c2bc11906ffb82c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:54.228645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e6ecd-4bbf-49fd-b4b2-0e4bffda5271 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:54.238397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e6ecd-4bbf-49fd-b4b2-0e4bffda5271 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:54.242552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649bde2-efc2-4cce-b28f-7819257848fd tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542fb8039c324ba6bf022b0e96836043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '213dc9626b6c4872b39674d06bb8958d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:54.243436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649bde2-efc2-4cce-b28f-7819257848fd tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:54.243718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649bde2-efc2-4cce-b28f-7819257848fd tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:54.243995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649bde2-efc2-4cce-b28f-7819257848fd tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] PATH_INFO: `/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:54.244773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649bde2-efc2-4cce-b28f-7819257848fd tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorizing `identity:create_application_credential(user_id=542fb8039c324ba6bf022b0e96836043)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:54.245922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649bde2-efc2-4cce-b28f-7819257848fd tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:54.320865 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3716/7466] 10.222.0.43 () {60 vars in 1314 bytes} [Sat Jul 2 21:29:54 2022] POST /identity/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials => generated 812 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:54.326118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced0914-af92-4005-ba72-0e60dad2bba9 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:54.336058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced0914-af92-4005-ba72-0e60dad2bba9 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:54.340926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2660e-2dbe-4a19-aff8-bed12cad8908 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542fb8039c324ba6bf022b0e96836043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '213dc9626b6c4872b39674d06bb8958d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:54.341880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2660e-2dbe-4a19-aff8-bed12cad8908 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:54.342274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2660e-2dbe-4a19-aff8-bed12cad8908 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:54.342545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2660e-2dbe-4a19-aff8-bed12cad8908 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] PATH_INFO: `/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials/a8a90a199a6b4e52842ba606e61bf77f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:54.354486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2660e-2dbe-4a19-aff8-bed12cad8908 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorizing `identity:delete_application_credential(user_id=542fb8039c324ba6bf022b0e96836043, application_credential_id=a8a90a199a6b4e52842ba606e61bf77f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:54.356010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2660e-2dbe-4a19-aff8-bed12cad8908 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:54.369932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649bde2-efc2-4cce-b28f-7819257848fd tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:54.371980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8649bde2-efc2-4cce-b28f-7819257848fd tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:54.380111 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3751/7467] 10.222.0.43 () {58 vars in 1394 bytes} [Sat Jul 2 21:29:54 2022] DELETE /identity/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials/a8a90a199a6b4e52842ba606e61bf77f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:54.385652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2660e-2dbe-4a19-aff8-bed12cad8908 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:54.396618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2660e-2dbe-4a19-aff8-bed12cad8908 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:54.401646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd375d8-56df-4c23-b52b-b6cb45185569 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542fb8039c324ba6bf022b0e96836043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '213dc9626b6c4872b39674d06bb8958d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:54.402539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd375d8-56df-4c23-b52b-b6cb45185569 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:54.402826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd375d8-56df-4c23-b52b-b6cb45185569 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:54.403119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd375d8-56df-4c23-b52b-b6cb45185569 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] PATH_INFO: `/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:54.403948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd375d8-56df-4c23-b52b-b6cb45185569 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorizing `identity:create_application_credential(user_id=542fb8039c324ba6bf022b0e96836043)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:54.405423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd375d8-56df-4c23-b52b-b6cb45185569 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:54.406836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:54.428844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:54.457589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649bde2-efc2-4cce-b28f-7819257848fd tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:54.463160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e69647-ec2d-4bcc-aeb3-62af4a7f8ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:54.464153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e69647-ec2d-4bcc-aeb3-62af4a7f8ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:54.464505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e69647-ec2d-4bcc-aeb3-62af4a7f8ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:54.464880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e69647-ec2d-4bcc-aeb3-62af4a7f8ab9 admin admin] PATH_INFO: `/v3/users/312f75b6d05240afb369a20bc453b6ce` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:54.466182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e69647-ec2d-4bcc-aeb3-62af4a7f8ab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=312f75b6d05240afb369a20bc453b6ce)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:54.468437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e69647-ec2d-4bcc-aeb3-62af4a7f8ab9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:54.483623 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3752/7468] 10.222.0.43 () {60 vars in 1313 bytes} [Sat Jul 2 21:29:54 2022] POST /identity/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials => generated 789 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:54.488092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd375d8-56df-4c23-b52b-b6cb45185569 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:54.505941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd375d8-56df-4c23-b52b-b6cb45185569 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:54.511173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be236a4a-b189-4df5-93df-06f67f710aaf tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542fb8039c324ba6bf022b0e96836043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '213dc9626b6c4872b39674d06bb8958d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:54.512056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be236a4a-b189-4df5-93df-06f67f710aaf tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:54.512328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be236a4a-b189-4df5-93df-06f67f710aaf tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:54.512620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be236a4a-b189-4df5-93df-06f67f710aaf tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] PATH_INFO: `/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:54.513356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be236a4a-b189-4df5-93df-06f67f710aaf tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorizing `identity:create_application_credential(user_id=542fb8039c324ba6bf022b0e96836043)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:54.514545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be236a4a-b189-4df5-93df-06f67f710aaf tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:54.533900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23e69647-ec2d-4bcc-aeb3-62af4a7f8ab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '312f75b6d05240afb369a20bc453b6ce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:54.541701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23e69647-ec2d-4bcc-aeb3-62af4a7f8ab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '312f75b6d05240afb369a20bc453b6ce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:54.548905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23e69647-ec2d-4bcc-aeb3-62af4a7f8ab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '312f75b6d05240afb369a20bc453b6ce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:54.549556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23e69647-ec2d-4bcc-aeb3-62af4a7f8ab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '312f75b6d05240afb369a20bc453b6ce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:54.550173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23e69647-ec2d-4bcc-aeb3-62af4a7f8ab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '312f75b6d05240afb369a20bc453b6ce'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:54.568801 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3717/7469] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:54 2022] DELETE /identity/v3/users/312f75b6d05240afb369a20bc453b6ce => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:54.573437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8580f-ef95-4f64-826f-724810d3574a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:54.573745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8580f-ef95-4f64-826f-724810d3574a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:54.574058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8580f-ef95-4f64-826f-724810d3574a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:54.582698 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3753/7470] 10.222.0.43 () {60 vars in 1313 bytes} [Sat Jul 2 21:29:54 2022] POST /identity/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials => generated 788 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:54.586764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be236a4a-b189-4df5-93df-06f67f710aaf tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:54.588516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-be236a4a-b189-4df5-93df-06f67f710aaf tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:54.594760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8be8580f-ef95-4f64-826f-724810d3574a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:54.595947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8be8580f-ef95-4f64-826f-724810d3574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:54.599977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be236a4a-b189-4df5-93df-06f67f710aaf tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:54.653946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e5600-4e51-4c27-8d50-18334f56b4a5 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542fb8039c324ba6bf022b0e96836043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '213dc9626b6c4872b39674d06bb8958d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:54.654845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e5600-4e51-4c27-8d50-18334f56b4a5 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:54.655135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e5600-4e51-4c27-8d50-18334f56b4a5 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:54.655418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e5600-4e51-4c27-8d50-18334f56b4a5 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] PATH_INFO: `/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:54.655687 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3718/7471] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:54.658931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e5600-4e51-4c27-8d50-18334f56b4a5 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorizing `identity:list_application_credentials(user_id=542fb8039c324ba6bf022b0e96836043)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:54.658931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e5600-4e51-4c27-8d50-18334f56b4a5 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:54.665989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8580f-ef95-4f64-826f-724810d3574a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:54.667387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8be8580f-ef95-4f64-826f-724810d3574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:54.671559 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3754/7472] 10.222.0.43 () {58 vars in 1292 bytes} [Sat Jul 2 21:29:54 2022] GET /identity/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials => generated 1501 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:29:54.678101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e5600-4e51-4c27-8d50-18334f56b4a5 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:54.690035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e5600-4e51-4c27-8d50-18334f56b4a5 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:54.697003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a1131-cf2c-4a8a-ac9a-5f7047680f66 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542fb8039c324ba6bf022b0e96836043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '213dc9626b6c4872b39674d06bb8958d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:54.697960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a1131-cf2c-4a8a-ac9a-5f7047680f66 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:54.698250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a1131-cf2c-4a8a-ac9a-5f7047680f66 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:54.699037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a1131-cf2c-4a8a-ac9a-5f7047680f66 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] PATH_INFO: `/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials/3a1b7f5a8d9c40c3bc7eade4f909a55f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:54.711714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a1131-cf2c-4a8a-ac9a-5f7047680f66 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorizing `identity:delete_application_credential(user_id=542fb8039c324ba6bf022b0e96836043, application_credential_id=3a1b7f5a8d9c40c3bc7eade4f909a55f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:54.721607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a1131-cf2c-4a8a-ac9a-5f7047680f66 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:54.722185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:54.737642 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3755/7473] 10.222.0.43 () {58 vars in 1394 bytes} [Sat Jul 2 21:29:54 2022] DELETE /identity/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials/3a1b7f5a8d9c40c3bc7eade4f909a55f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:54.737909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8580f-ef95-4f64-826f-724810d3574a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:54.741899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27901c3-4403-4445-a980-4304e15d940a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:54.742052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a1131-cf2c-4a8a-ac9a-5f7047680f66 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:54.742635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27901c3-4403-4445-a980-4304e15d940a service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:54.742851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27901c3-4403-4445-a980-4304e15d940a service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:54.743124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27901c3-4403-4445-a980-4304e15d940a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:54.751033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a1131-cf2c-4a8a-ac9a-5f7047680f66 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:54.753020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27901c3-4403-4445-a980-4304e15d940a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:54.754463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27901c3-4403-4445-a980-4304e15d940a service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:54.755605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cc646-db2e-44b9-a120-f237e5ca9cd6 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542fb8039c324ba6bf022b0e96836043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '213dc9626b6c4872b39674d06bb8958d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:54.756569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cc646-db2e-44b9-a120-f237e5ca9cd6 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:54.756848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cc646-db2e-44b9-a120-f237e5ca9cd6 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:54.757121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cc646-db2e-44b9-a120-f237e5ca9cd6 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] PATH_INFO: `/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials/8dac9681403d405a9da87123b2340e37` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:54.765060 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3719/7474] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:54.765934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14cc646-db2e-44b9-a120-f237e5ca9cd6 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorizing `identity:delete_application_credential(user_id=542fb8039c324ba6bf022b0e96836043, application_credential_id=8dac9681403d405a9da87123b2340e37)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:54.767416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14cc646-db2e-44b9-a120-f237e5ca9cd6 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:54.770027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:54.788308 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3756/7475] 10.222.0.43 () {58 vars in 1394 bytes} [Sat Jul 2 21:29:54 2022] DELETE /identity/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials/8dac9681403d405a9da87123b2340e37 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:54.793466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27901c3-4403-4445-a980-4304e15d940a service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:54.804442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27901c3-4403-4445-a980-4304e15d940a service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:54.809873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabab0a7-c16f-4878-a789-11380eb342f3 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542fb8039c324ba6bf022b0e96836043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '213dc9626b6c4872b39674d06bb8958d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:54.810766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabab0a7-c16f-4878-a789-11380eb342f3 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:54.811045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabab0a7-c16f-4878-a789-11380eb342f3 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:54.811316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabab0a7-c16f-4878-a789-11380eb342f3 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] PATH_INFO: `/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:54.812056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabab0a7-c16f-4878-a789-11380eb342f3 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorizing `identity:create_application_credential(user_id=542fb8039c324ba6bf022b0e96836043)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:54.813427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabab0a7-c16f-4878-a789-11380eb342f3 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:54.883888 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3720/7476] 10.222.0.43 () {60 vars in 1313 bytes} [Sat Jul 2 21:29:54 2022] POST /identity/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials => generated 788 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:54.888412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cc646-db2e-44b9-a120-f237e5ca9cd6 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:54.898754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cc646-db2e-44b9-a120-f237e5ca9cd6 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:54.903602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de9fdc-edce-47de-ad64-f9060167d050 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542fb8039c324ba6bf022b0e96836043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '213dc9626b6c4872b39674d06bb8958d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:54.904548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de9fdc-edce-47de-ad64-f9060167d050 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:54.904835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de9fdc-edce-47de-ad64-f9060167d050 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:54.905225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de9fdc-edce-47de-ad64-f9060167d050 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] PATH_INFO: `/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:54.905983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de9fdc-edce-47de-ad64-f9060167d050 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorizing `identity:create_application_credential(user_id=542fb8039c324ba6bf022b0e96836043)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:54.907238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de9fdc-edce-47de-ad64-f9060167d050 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:54.999480 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3757/7477] 10.222.0.43 () {60 vars in 1313 bytes} [Sat Jul 2 21:29:54 2022] POST /identity/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials => generated 789 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:55.003930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabab0a7-c16f-4878-a789-11380eb342f3 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:55.014628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabab0a7-c16f-4878-a789-11380eb342f3 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:55.021495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a1237-c561-4962-a33a-d65a3ba43b9d tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542fb8039c324ba6bf022b0e96836043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '213dc9626b6c4872b39674d06bb8958d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:55.022508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a1237-c561-4962-a33a-d65a3ba43b9d tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:55.022951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a1237-c561-4962-a33a-d65a3ba43b9d tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:55.025049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a1237-c561-4962-a33a-d65a3ba43b9d tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] PATH_INFO: `/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:55.026100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a1237-c561-4962-a33a-d65a3ba43b9d tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Adding query filter params (name=tempest-application_credential-1143817111) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:55.026572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a1237-c561-4962-a33a-d65a3ba43b9d tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorizing `identity:list_application_credentials(user_id=542fb8039c324ba6bf022b0e96836043)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:55.029037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a1237-c561-4962-a33a-d65a3ba43b9d tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:55.042204 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3721/7478] 10.222.0.43 () {58 vars in 1385 bytes} [Sat Jul 2 21:29:55 2022] GET /identity/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials?name=tempest-application_credential-1143817111 => generated 887 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:29:55.046857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de9fdc-edce-47de-ad64-f9060167d050 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:55.059834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de9fdc-edce-47de-ad64-f9060167d050 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:55.064995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670eb32-61af-485c-b72b-59f3b3cde96b tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542fb8039c324ba6bf022b0e96836043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '213dc9626b6c4872b39674d06bb8958d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:55.065966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670eb32-61af-485c-b72b-59f3b3cde96b tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:55.066253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670eb32-61af-485c-b72b-59f3b3cde96b tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:55.066532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670eb32-61af-485c-b72b-59f3b3cde96b tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] PATH_INFO: `/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials/05c0d2bbe1344c5f9f1f6071fbfcb0da` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:55.083651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670eb32-61af-485c-b72b-59f3b3cde96b tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorizing `identity:delete_application_credential(user_id=542fb8039c324ba6bf022b0e96836043, application_credential_id=05c0d2bbe1344c5f9f1f6071fbfcb0da)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:55.085581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670eb32-61af-485c-b72b-59f3b3cde96b tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:55.111167 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3758/7479] 10.222.0.43 () {58 vars in 1394 bytes} [Sat Jul 2 21:29:55 2022] DELETE /identity/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials/05c0d2bbe1344c5f9f1f6071fbfcb0da => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:55.115139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a1237-c561-4962-a33a-d65a3ba43b9d tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:55.126211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a1237-c561-4962-a33a-d65a3ba43b9d tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:55.130555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf98124-fa0f-421c-803b-00877b8dbd52 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '542fb8039c324ba6bf022b0e96836043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '213dc9626b6c4872b39674d06bb8958d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:55.131511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf98124-fa0f-421c-803b-00877b8dbd52 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:55.131831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf98124-fa0f-421c-803b-00877b8dbd52 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:55.132148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf98124-fa0f-421c-803b-00877b8dbd52 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] PATH_INFO: `/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials/08966cbd4e9d4e09918cd041a07573e9` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:55.142907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf98124-fa0f-421c-803b-00877b8dbd52 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorizing `identity:delete_application_credential(user_id=542fb8039c324ba6bf022b0e96836043, application_credential_id=08966cbd4e9d4e09918cd041a07573e9)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:55.144636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf98124-fa0f-421c-803b-00877b8dbd52 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:55.170015 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3722/7480] 10.222.0.43 () {58 vars in 1394 bytes} [Sat Jul 2 21:29:55 2022] DELETE /identity/v3/users/542fb8039c324ba6bf022b0e96836043/application_credentials/08966cbd4e9d4e09918cd041a07573e9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:55.175576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670eb32-61af-485c-b72b-59f3b3cde96b tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:55.178281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2670eb32-61af-485c-b72b-59f3b3cde96b tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:55.197808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670eb32-61af-485c-b72b-59f3b3cde96b tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:55.204368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f944c-4a06-4504-9fb2-51813d4c170e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:55.205383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f944c-4a06-4504-9fb2-51813d4c170e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:55.205822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f944c-4a06-4504-9fb2-51813d4c170e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:55.206088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f944c-4a06-4504-9fb2-51813d4c170e admin admin] PATH_INFO: `/v3/users/542fb8039c324ba6bf022b0e96836043` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:55.207447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f944c-4a06-4504-9fb2-51813d4c170e admin admin] RBAC: Authorizing `identity:delete_user(user_id=542fb8039c324ba6bf022b0e96836043)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:55.209547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f944c-4a06-4504-9fb2-51813d4c170e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:55.274370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-066f944c-4a06-4504-9fb2-51813d4c170e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542fb8039c324ba6bf022b0e96836043'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.285310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf98124-fa0f-421c-803b-00877b8dbd52 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:55.287285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bbf98124-fa0f-421c-803b-00877b8dbd52 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:55.288842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-066f944c-4a06-4504-9fb2-51813d4c170e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542fb8039c324ba6bf022b0e96836043'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.289652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-066f944c-4a06-4504-9fb2-51813d4c170e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542fb8039c324ba6bf022b0e96836043'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.290345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-066f944c-4a06-4504-9fb2-51813d4c170e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542fb8039c324ba6bf022b0e96836043'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.299491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-066f944c-4a06-4504-9fb2-51813d4c170e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542fb8039c324ba6bf022b0e96836043'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.302383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf98124-fa0f-421c-803b-00877b8dbd52 tempest-ApplicationCredentialsV3Test-850222108 tempest-ApplicationCredentialsV3Test-850222108-project] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:55.307815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fc47f-1ba6-4cda-9fc2-d09ee0c82a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:55.308907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fc47f-1ba6-4cda-9fc2-d09ee0c82a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:55.309151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fc47f-1ba6-4cda-9fc2-d09ee0c82a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:55.309425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fc47f-1ba6-4cda-9fc2-d09ee0c82a88 admin admin] PATH_INFO: `/v3/users/3b64f98782de40a283355c7b08f0b06c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:55.311347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fc47f-1ba6-4cda-9fc2-d09ee0c82a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b64f98782de40a283355c7b08f0b06c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:55.313546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fc47f-1ba6-4cda-9fc2-d09ee0c82a88 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:55.330910 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3759/7481] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:55 2022] DELETE /identity/v3/users/542fb8039c324ba6bf022b0e96836043 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:55.335396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e528125-fd3f-40c0-b0fe-93f6981216fa None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:55.335690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e528125-fd3f-40c0-b0fe-93f6981216fa None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:55.335975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e528125-fd3f-40c0-b0fe-93f6981216fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:55.354350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4e528125-fd3f-40c0-b0fe-93f6981216fa None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:55.355659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4e528125-fd3f-40c0-b0fe-93f6981216fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:55.370969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:55.371557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f83fc47f-1ba6-4cda-9fc2-d09ee0c82a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b64f98782de40a283355c7b08f0b06c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.382996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f83fc47f-1ba6-4cda-9fc2-d09ee0c82a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b64f98782de40a283355c7b08f0b06c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.393992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f83fc47f-1ba6-4cda-9fc2-d09ee0c82a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b64f98782de40a283355c7b08f0b06c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.394829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f83fc47f-1ba6-4cda-9fc2-d09ee0c82a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b64f98782de40a283355c7b08f0b06c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.395519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f83fc47f-1ba6-4cda-9fc2-d09ee0c82a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b64f98782de40a283355c7b08f0b06c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.416434 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3723/7482] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:55 2022] DELETE /identity/v3/users/3b64f98782de40a283355c7b08f0b06c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:55.421525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c0570-9f11-4106-874b-ac55b9fce0ed None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:55.421809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c0570-9f11-4106-874b-ac55b9fce0ed None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:55.422113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c0570-9f11-4106-874b-ac55b9fce0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:55.433537 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3760/7483] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:55.439221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e528125-fd3f-40c0-b0fe-93f6981216fa None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:55.440807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4e528125-fd3f-40c0-b0fe-93f6981216fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:55.447976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-213c0570-9f11-4106-874b-ac55b9fce0ed None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:55.449349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-213c0570-9f11-4106-874b-ac55b9fce0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:55.456237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e528125-fd3f-40c0-b0fe-93f6981216fa None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:55.466120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:55.518097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f3baa-c468-491e-bf7a-34776bfb5cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:55.519034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f3baa-c468-491e-bf7a-34776bfb5cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:55.519322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f3baa-c468-491e-bf7a-34776bfb5cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:55.519605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f3baa-c468-491e-bf7a-34776bfb5cd8 admin admin] PATH_INFO: `/v3/projects/7060b2c5cb5f497c953754722640c8f7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:55.520890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f3baa-c468-491e-bf7a-34776bfb5cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7060b2c5cb5f497c953754722640c8f7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:55.522818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f3baa-c468-491e-bf7a-34776bfb5cd8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:55.528363 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3724/7484] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:55.529065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c0570-9f11-4106-874b-ac55b9fce0ed None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:55.530429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-213c0570-9f11-4106-874b-ac55b9fce0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:55.578645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7d7f3baa-c468-491e-bf7a-34776bfb5cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7060b2c5cb5f497c953754722640c8f7', 'request_id': 'req-7d7f3baa-c468-491e-bf7a-34776bfb5cd8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.589282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7d7f3baa-c468-491e-bf7a-34776bfb5cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7060b2c5cb5f497c953754722640c8f7', 'request_id': 'req-7d7f3baa-c468-491e-bf7a-34776bfb5cd8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.597063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7d7f3baa-c468-491e-bf7a-34776bfb5cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7060b2c5cb5f497c953754722640c8f7', 'request_id': 'req-7d7f3baa-c468-491e-bf7a-34776bfb5cd8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.603517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c0570-9f11-4106-874b-ac55b9fce0ed None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:55.609834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7d7f3baa-c468-491e-bf7a-34776bfb5cd8 admin admin] The token cache is being invalidate because project 7060b2c5cb5f497c953754722640c8f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:55.610130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7d7f3baa-c468-491e-bf7a-34776bfb5cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.610877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7d7f3baa-c468-491e-bf7a-34776bfb5cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.612657 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3761/7485] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:55 2022] DELETE /identity/v3/projects/7060b2c5cb5f497c953754722640c8f7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:55.613229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f3baa-c468-491e-bf7a-34776bfb5cd8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:55.614512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7d7f3baa-c468-491e-bf7a-34776bfb5cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:55.658943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcb49e-df9c-4098-a1eb-20ce338a732f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:55.659610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcb49e-df9c-4098-a1eb-20ce338a732f service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:55.659890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcb49e-df9c-4098-a1eb-20ce338a732f service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:55.660203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcb49e-df9c-4098-a1eb-20ce338a732f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:55.662369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c6bcb49e-df9c-4098-a1eb-20ce338a732f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:55.684415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f3baa-c468-491e-bf7a-34776bfb5cd8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:55.689613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dea93a-bf37-4e19-b94b-2008b6c556a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:55.690327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dea93a-bf37-4e19-b94b-2008b6c556a1 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:55.691018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dea93a-bf37-4e19-b94b-2008b6c556a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:55.691306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dea93a-bf37-4e19-b94b-2008b6c556a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:55.693621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-29dea93a-bf37-4e19-b94b-2008b6c556a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:55.698977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:55.742926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bcb49e-df9c-4098-a1eb-20ce338a732f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:55.744726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bcb49e-df9c-4098-a1eb-20ce338a732f service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:55.755765 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3725/7486] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:55.756490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcb49e-df9c-4098-a1eb-20ce338a732f service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:55.757824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c6bcb49e-df9c-4098-a1eb-20ce338a732f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:55.776962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dea93a-bf37-4e19-b94b-2008b6c556a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:55.777124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcb49e-df9c-4098-a1eb-20ce338a732f service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:55.778627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dea93a-bf37-4e19-b94b-2008b6c556a1 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:55.783016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcce03-416f-48db-b97b-32a57eefbd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:55.784300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcce03-416f-48db-b97b-32a57eefbd5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:55.784679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcce03-416f-48db-b97b-32a57eefbd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:55.785474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcce03-416f-48db-b97b-32a57eefbd5e admin admin] PATH_INFO: `/v3/users/813e1edc04d849dca2993cd55df03302` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:55.786343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcce03-416f-48db-b97b-32a57eefbd5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=813e1edc04d849dca2993cd55df03302)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:55.788388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcce03-416f-48db-b97b-32a57eefbd5e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:55.789160 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3762/7487] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:55.803742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:55.839351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3ffcce03-416f-48db-b97b-32a57eefbd5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813e1edc04d849dca2993cd55df03302'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.848024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3ffcce03-416f-48db-b97b-32a57eefbd5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813e1edc04d849dca2993cd55df03302'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.855879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3ffcce03-416f-48db-b97b-32a57eefbd5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813e1edc04d849dca2993cd55df03302'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.856624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3ffcce03-416f-48db-b97b-32a57eefbd5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813e1edc04d849dca2993cd55df03302'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.857284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3ffcce03-416f-48db-b97b-32a57eefbd5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813e1edc04d849dca2993cd55df03302'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:55.876480 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3726/7488] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:55 2022] DELETE /identity/v3/users/813e1edc04d849dca2993cd55df03302 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:56.204200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dea93a-bf37-4e19-b94b-2008b6c556a1 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:56.215939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dea93a-bf37-4e19-b94b-2008b6c556a1 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:56.255143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcce03-416f-48db-b97b-32a57eefbd5e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:56.256754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3ffcce03-416f-48db-b97b-32a57eefbd5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:56.302514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b79d4-9d92-4f63-98b4-0af5e953b789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:56.304116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b79d4-9d92-4f63-98b4-0af5e953b789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:56.304302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b79d4-9d92-4f63-98b4-0af5e953b789 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:56.304574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b79d4-9d92-4f63-98b4-0af5e953b789 admin admin] PATH_INFO: `/v3/projects/d3967f4a16fd4f79953634bbf7ec0ae9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:56.306976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b79d4-9d92-4f63-98b4-0af5e953b789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3967f4a16fd4f79953634bbf7ec0ae9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:56.309023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b79d4-9d92-4f63-98b4-0af5e953b789 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:56.363842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcce03-416f-48db-b97b-32a57eefbd5e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:56.379160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5f5b79d4-9d92-4f63-98b4-0af5e953b789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3967f4a16fd4f79953634bbf7ec0ae9', 'request_id': 'req-5f5b79d4-9d92-4f63-98b4-0af5e953b789'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.390582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5f5b79d4-9d92-4f63-98b4-0af5e953b789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3967f4a16fd4f79953634bbf7ec0ae9', 'request_id': 'req-5f5b79d4-9d92-4f63-98b4-0af5e953b789'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.399367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5f5b79d4-9d92-4f63-98b4-0af5e953b789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3967f4a16fd4f79953634bbf7ec0ae9', 'request_id': 'req-5f5b79d4-9d92-4f63-98b4-0af5e953b789'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.417805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5f5b79d4-9d92-4f63-98b4-0af5e953b789 admin admin] The token cache is being invalidate because project d3967f4a16fd4f79953634bbf7ec0ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:56.418094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5f5b79d4-9d92-4f63-98b4-0af5e953b789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.418772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5f5b79d4-9d92-4f63-98b4-0af5e953b789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.420709 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3763/7489] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:56 2022] DELETE /identity/v3/projects/d3967f4a16fd4f79953634bbf7ec0ae9 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:56.421519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b79d4-9d92-4f63-98b4-0af5e953b789 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:56.422915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5f5b79d4-9d92-4f63-98b4-0af5e953b789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:56.438181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6a512-b6c5-4160-8542-f5345aca9b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:56.439637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6a512-b6c5-4160-8542-f5345aca9b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:56.439989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6a512-b6c5-4160-8542-f5345aca9b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:56.440393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6a512-b6c5-4160-8542-f5345aca9b3b admin admin] PATH_INFO: `/v3/projects/213dc9626b6c4872b39674d06bb8958d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:56.442007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6a512-b6c5-4160-8542-f5345aca9b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=213dc9626b6c4872b39674d06bb8958d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:56.444616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6a512-b6c5-4160-8542-f5345aca9b3b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:56.461377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:56.495537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:56.499737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b79d4-9d92-4f63-98b4-0af5e953b789 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:56.503700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eef6a512-b6c5-4160-8542-f5345aca9b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '213dc9626b6c4872b39674d06bb8958d', 'request_id': 'req-eef6a512-b6c5-4160-8542-f5345aca9b3b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.511501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eef6a512-b6c5-4160-8542-f5345aca9b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '213dc9626b6c4872b39674d06bb8958d', 'request_id': 'req-eef6a512-b6c5-4160-8542-f5345aca9b3b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.517183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eef6a512-b6c5-4160-8542-f5345aca9b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '213dc9626b6c4872b39674d06bb8958d', 'request_id': 'req-eef6a512-b6c5-4160-8542-f5345aca9b3b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.530240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eef6a512-b6c5-4160-8542-f5345aca9b3b admin admin] The token cache is being invalidate because project 213dc9626b6c4872b39674d06bb8958d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:56.530519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eef6a512-b6c5-4160-8542-f5345aca9b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.531160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-eef6a512-b6c5-4160-8542-f5345aca9b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.532791 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3727/7490] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:56 2022] DELETE /identity/v3/projects/213dc9626b6c4872b39674d06bb8958d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:56.533601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6a512-b6c5-4160-8542-f5345aca9b3b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:56.534863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-eef6a512-b6c5-4160-8542-f5345aca9b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:56.563590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77a048-af0d-4b70-a475-be17051a1fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:56.564500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77a048-af0d-4b70-a475-be17051a1fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:56.564790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77a048-af0d-4b70-a475-be17051a1fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:56.565069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77a048-af0d-4b70-a475-be17051a1fd6 admin admin] PATH_INFO: `/v3/projects/2d932cb0b3ce497d91434197e26d49df` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:56.566267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77a048-af0d-4b70-a475-be17051a1fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d932cb0b3ce497d91434197e26d49df)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:56.568262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77a048-af0d-4b70-a475-be17051a1fd6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:56.597299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6a512-b6c5-4160-8542-f5345aca9b3b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:56.602465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e65cbc-9f2a-4cff-8990-17a5a4757fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:56.603346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e65cbc-9f2a-4cff-8990-17a5a4757fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:56.603626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e65cbc-9f2a-4cff-8990-17a5a4757fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:56.603932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e65cbc-9f2a-4cff-8990-17a5a4757fd7 admin admin] PATH_INFO: `/v3/users/17d630e3a3744f7f9232c069fe843d80` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:56.605297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e65cbc-9f2a-4cff-8990-17a5a4757fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d630e3a3744f7f9232c069fe843d80)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:56.607476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e65cbc-9f2a-4cff-8990-17a5a4757fd7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:56.615203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1a77a048-af0d-4b70-a475-be17051a1fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d932cb0b3ce497d91434197e26d49df', 'request_id': 'req-1a77a048-af0d-4b70-a475-be17051a1fd6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.623379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1a77a048-af0d-4b70-a475-be17051a1fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d932cb0b3ce497d91434197e26d49df', 'request_id': 'req-1a77a048-af0d-4b70-a475-be17051a1fd6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.629771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1a77a048-af0d-4b70-a475-be17051a1fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d932cb0b3ce497d91434197e26d49df', 'request_id': 'req-1a77a048-af0d-4b70-a475-be17051a1fd6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.641652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1a77a048-af0d-4b70-a475-be17051a1fd6 admin admin] The token cache is being invalidate because project 2d932cb0b3ce497d91434197e26d49df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:56.641956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1a77a048-af0d-4b70-a475-be17051a1fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.642692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1a77a048-af0d-4b70-a475-be17051a1fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.644379 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3764/7491] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:56 2022] DELETE /identity/v3/projects/2d932cb0b3ce497d91434197e26d49df => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:56.647492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe856c7-1329-4f77-9b1c-fd99d4e894a0 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:56.647492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe856c7-1329-4f77-9b1c-fd99d4e894a0 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:56.647492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe856c7-1329-4f77-9b1c-fd99d4e894a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:56.660530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-71e65cbc-9f2a-4cff-8990-17a5a4757fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d630e3a3744f7f9232c069fe843d80'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.664528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bfe856c7-1329-4f77-9b1c-fd99d4e894a0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:56.665829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bfe856c7-1329-4f77-9b1c-fd99d4e894a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:56.669312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-71e65cbc-9f2a-4cff-8990-17a5a4757fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d630e3a3744f7f9232c069fe843d80'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.677874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-71e65cbc-9f2a-4cff-8990-17a5a4757fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d630e3a3744f7f9232c069fe843d80'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.678913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-71e65cbc-9f2a-4cff-8990-17a5a4757fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d630e3a3744f7f9232c069fe843d80'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.679578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-71e65cbc-9f2a-4cff-8990-17a5a4757fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d630e3a3744f7f9232c069fe843d80'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.697187 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3728/7492] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:56 2022] DELETE /identity/v3/users/17d630e3a3744f7f9232c069fe843d80 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:56.698074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e65cbc-9f2a-4cff-8990-17a5a4757fd7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:56.699665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-71e65cbc-9f2a-4cff-8990-17a5a4757fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:56.731204 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3765/7493] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:56.739209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b5e22-e99a-4b48-b6b3-bc72a3f5e407 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:56.739495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b5e22-e99a-4b48-b6b3-bc72a3f5e407 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:56.740186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b5e22-e99a-4b48-b6b3-bc72a3f5e407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:56.763803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bf7b5e22-e99a-4b48-b6b3-bc72a3f5e407 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:56.764489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:56.765158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bf7b5e22-e99a-4b48-b6b3-bc72a3f5e407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:56.771691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:56.790694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e65cbc-9f2a-4cff-8990-17a5a4757fd7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:56.799781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bccb68-1165-49cb-9467-5b2a8079d7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:56.801093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bccb68-1165-49cb-9467-5b2a8079d7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:56.801864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bccb68-1165-49cb-9467-5b2a8079d7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:56.802480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bccb68-1165-49cb-9467-5b2a8079d7ae admin admin] PATH_INFO: `/v3/users/3d7a22fdc8404ff9859c025311bfb789` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:56.805549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bccb68-1165-49cb-9467-5b2a8079d7ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d7a22fdc8404ff9859c025311bfb789)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:56.808793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bccb68-1165-49cb-9467-5b2a8079d7ae admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:56.873626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b3bccb68-1165-49cb-9467-5b2a8079d7ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d7a22fdc8404ff9859c025311bfb789'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.878026 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3766/7494] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:56.878831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b5e22-e99a-4b48-b6b3-bc72a3f5e407 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:56.885028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b3bccb68-1165-49cb-9467-5b2a8079d7ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d7a22fdc8404ff9859c025311bfb789'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.888830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b5e22-e99a-4b48-b6b3-bc72a3f5e407 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:56.893965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e20b74-785a-4a86-bde8-c7f6ccdae2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:56.894701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e20b74-785a-4a86-bde8-c7f6ccdae2cf admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:56.895409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e20b74-785a-4a86-bde8-c7f6ccdae2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:56.895409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e20b74-785a-4a86-bde8-c7f6ccdae2cf admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:56.896265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e20b74-785a-4a86-bde8-c7f6ccdae2cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:29:56.896676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e20b74-785a-4a86-bde8-c7f6ccdae2cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:56.898397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e20b74-785a-4a86-bde8-c7f6ccdae2cf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:56.899346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b3bccb68-1165-49cb-9467-5b2a8079d7ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d7a22fdc8404ff9859c025311bfb789'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.901089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b3bccb68-1165-49cb-9467-5b2a8079d7ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d7a22fdc8404ff9859c025311bfb789'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.901419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b3bccb68-1165-49cb-9467-5b2a8079d7ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d7a22fdc8404ff9859c025311bfb789'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:56.912083 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3767/7495] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:29:56.924924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e20b74-785a-4a86-bde8-c7f6ccdae2cf admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:56.927432 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3729/7496] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:56 2022] DELETE /identity/v3/users/3d7a22fdc8404ff9859c025311bfb789 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:56.927827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-72e20b74-785a-4a86-bde8-c7f6ccdae2cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:56.942884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e20b74-785a-4a86-bde8-c7f6ccdae2cf admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:57.020747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9df795-30e2-449b-8247-2265f79ee4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:57.021589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9df795-30e2-449b-8247-2265f79ee4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:57.022353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9df795-30e2-449b-8247-2265f79ee4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:57.022702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9df795-30e2-449b-8247-2265f79ee4b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:57.023626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9df795-30e2-449b-8247-2265f79ee4b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:57.025915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9df795-30e2-449b-8247-2265f79ee4b9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:57.074236 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3768/7497] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:56 2022] POST /identity/v3/projects => generated 391 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:57.078711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bccb68-1165-49cb-9467-5b2a8079d7ae admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:57.100370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bccb68-1165-49cb-9467-5b2a8079d7ae admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:57.154783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9df795-30e2-449b-8247-2265f79ee4b9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:57.157120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6c9df795-30e2-449b-8247-2265f79ee4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:57.196334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3416770-9b40-47ea-910d-edac747d2843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:57.196628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3416770-9b40-47ea-910d-edac747d2843 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:57.196917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3416770-9b40-47ea-910d-edac747d2843 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:57.197201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3416770-9b40-47ea-910d-edac747d2843 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:57.197891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3416770-9b40-47ea-910d-edac747d2843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:57.199887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3416770-9b40-47ea-910d-edac747d2843 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:57.228921 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3730/7498] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:57 2022] POST /identity/v3/users => generated 302 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:57.229842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3416770-9b40-47ea-910d-edac747d2843 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:57.242028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9df795-30e2-449b-8247-2265f79ee4b9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:57.242579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3416770-9b40-47ea-910d-edac747d2843 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:57.248345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f552616-27be-483c-9038-ed29776233de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:57.248506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e7844-0dc5-4ac8-9200-c024a56a3178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:57.249198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e7844-0dc5-4ac8-9200-c024a56a3178 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:57.249619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e7844-0dc5-4ac8-9200-c024a56a3178 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:57.249758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f552616-27be-483c-9038-ed29776233de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:57.252158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e7844-0dc5-4ac8-9200-c024a56a3178 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:57.252158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e7844-0dc5-4ac8-9200-c024a56a3178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:57.252395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f552616-27be-483c-9038-ed29776233de admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:57.252395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f552616-27be-483c-9038-ed29776233de admin admin] PATH_INFO: `/v3/projects/d761de65933b4e32885db1535309c2c4` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:57.252395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f552616-27be-483c-9038-ed29776233de admin admin] RBAC: Authorizing `identity:delete_project(project_id=d761de65933b4e32885db1535309c2c4)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:57.252645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e7844-0dc5-4ac8-9200-c024a56a3178 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:57.255062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f552616-27be-483c-9038-ed29776233de admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:57.267310 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3731/7499] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:57.271739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e7844-0dc5-4ac8-9200-c024a56a3178 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:57.287344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e7844-0dc5-4ac8-9200-c024a56a3178 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:57.292582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:57.294840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63763f-61cd-4301-a699-ab9635bfe47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:57.295888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63763f-61cd-4301-a699-ab9635bfe47c admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:57.296266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63763f-61cd-4301-a699-ab9635bfe47c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:57.296642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63763f-61cd-4301-a699-ab9635bfe47c admin admin] PATH_INFO: `/v3/projects/2136df352e57413785c0f2ad287e6a95/users/e3cbe709684f4023a5a5050f44bd25e8/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:57.317725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63763f-61cd-4301-a699-ab9635bfe47c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2136df352e57413785c0f2ad287e6a95, user_id=e3cbe709684f4023a5a5050f44bd25e8, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:57.320324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0f552616-27be-483c-9038-ed29776233de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd761de65933b4e32885db1535309c2c4', 'request_id': 'req-0f552616-27be-483c-9038-ed29776233de'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:57.320502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63763f-61cd-4301-a699-ab9635bfe47c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:57.330313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0f552616-27be-483c-9038-ed29776233de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd761de65933b4e32885db1535309c2c4', 'request_id': 'req-0f552616-27be-483c-9038-ed29776233de'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:57.335176 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3732/7500] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:57 2022] PUT /identity/v3/projects/2136df352e57413785c0f2ad287e6a95/users/e3cbe709684f4023a5a5050f44bd25e8/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:57.338287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63763f-61cd-4301-a699-ab9635bfe47c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:57.338287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6d63763f-61cd-4301-a699-ab9635bfe47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:57.339121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0f552616-27be-483c-9038-ed29776233de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd761de65933b4e32885db1535309c2c4', 'request_id': 'req-0f552616-27be-483c-9038-ed29776233de'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:57.349974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0f552616-27be-483c-9038-ed29776233de admin admin] The token cache is being invalidate because project d761de65933b4e32885db1535309c2c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:57.350341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0f552616-27be-483c-9038-ed29776233de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:57.350985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0f552616-27be-483c-9038-ed29776233de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:57.352611 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3769/7501] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:57 2022] DELETE /identity/v3/projects/d761de65933b4e32885db1535309c2c4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:57.364061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f552616-27be-483c-9038-ed29776233de admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:57.364061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0f552616-27be-483c-9038-ed29776233de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:57.369289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:57.429848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63763f-61cd-4301-a699-ab9635bfe47c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:57.431792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f552616-27be-483c-9038-ed29776233de admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:57.435349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24f6f8-7707-4d6b-814b-339ece42aa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:57.436514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24f6f8-7707-4d6b-814b-339ece42aa41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:57.436862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24f6f8-7707-4d6b-814b-339ece42aa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:57.437207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24f6f8-7707-4d6b-814b-339ece42aa41 admin admin] PATH_INFO: `/v3/projects/f7ecb8f0e10c4cd092c8815e639c65c6` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:57.438581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e1672-ed95-471f-8be3-419517c1be68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:57.438581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e1672-ed95-471f-8be3-419517c1be68 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:57.438581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e1672-ed95-471f-8be3-419517c1be68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:57.439029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e1672-ed95-471f-8be3-419517c1be68 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:57.439781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24f6f8-7707-4d6b-814b-339ece42aa41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7ecb8f0e10c4cd092c8815e639c65c6)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:57.439898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e1672-ed95-471f-8be3-419517c1be68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:57.441664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e1672-ed95-471f-8be3-419517c1be68 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:57.442026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24f6f8-7707-4d6b-814b-339ece42aa41 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:57.457811 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3770/7502] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:57.458990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e1672-ed95-471f-8be3-419517c1be68 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:57.469760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e1672-ed95-471f-8be3-419517c1be68 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:57.477077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40539c-852d-49d1-afff-9f848f274f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:57.478528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40539c-852d-49d1-afff-9f848f274f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:57.478826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40539c-852d-49d1-afff-9f848f274f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:57.479147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40539c-852d-49d1-afff-9f848f274f5b admin admin] PATH_INFO: `/v3/projects/2136df352e57413785c0f2ad287e6a95/users/e3cbe709684f4023a5a5050f44bd25e8/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:57.481868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40539c-852d-49d1-afff-9f848f274f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2136df352e57413785c0f2ad287e6a95, user_id=e3cbe709684f4023a5a5050f44bd25e8, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:57.485438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40539c-852d-49d1-afff-9f848f274f5b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:57.499524 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3771/7503] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:57 2022] PUT /identity/v3/projects/2136df352e57413785c0f2ad287e6a95/users/e3cbe709684f4023a5a5050f44bd25e8/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:57.503265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8c24f6f8-7707-4d6b-814b-339ece42aa41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7ecb8f0e10c4cd092c8815e639c65c6', 'request_id': 'req-8c24f6f8-7707-4d6b-814b-339ece42aa41'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:57.511428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2197f3-691b-4df8-8a1d-850e344bd682 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:57.511647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8c24f6f8-7707-4d6b-814b-339ece42aa41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7ecb8f0e10c4cd092c8815e639c65c6', 'request_id': 'req-8c24f6f8-7707-4d6b-814b-339ece42aa41'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:57.511761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2197f3-691b-4df8-8a1d-850e344bd682 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:57.512094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2197f3-691b-4df8-8a1d-850e344bd682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:57.518545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8c24f6f8-7707-4d6b-814b-339ece42aa41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7ecb8f0e10c4cd092c8815e639c65c6', 'request_id': 'req-8c24f6f8-7707-4d6b-814b-339ece42aa41'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:57.535254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8c24f6f8-7707-4d6b-814b-339ece42aa41 admin admin] The token cache is being invalidate because project f7ecb8f0e10c4cd092c8815e639c65c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:57.535557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8c24f6f8-7707-4d6b-814b-339ece42aa41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:57.537140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8c24f6f8-7707-4d6b-814b-339ece42aa41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:57.541812 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3733/7504] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:57 2022] DELETE /identity/v3/projects/f7ecb8f0e10c4cd092c8815e639c65c6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:57.543244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24f6f8-7707-4d6b-814b-339ece42aa41 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:57.544682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8c24f6f8-7707-4d6b-814b-339ece42aa41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:57.546304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ad2197f3-691b-4df8-8a1d-850e344bd682 None None] MFA Rules not processed for user `e3cbe709684f4023a5a5050f44bd25e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:57.547758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ad2197f3-691b-4df8-8a1d-850e344bd682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:57.617262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24f6f8-7707-4d6b-814b-339ece42aa41 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:57.631004 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3772/7505] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:57.635882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2197f3-691b-4df8-8a1d-850e344bd682 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:57.637457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ad2197f3-691b-4df8-8a1d-850e344bd682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:57.667105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:57.688059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:57.696404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e6a19-283b-458c-a1a8-0a5834ceb9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:57.697612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e6a19-283b-458c-a1a8-0a5834ceb9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:57.697941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e6a19-283b-458c-a1a8-0a5834ceb9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:57.698413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e6a19-283b-458c-a1a8-0a5834ceb9a5 admin admin] PATH_INFO: `/v3/users/57738b3dc8724df7b4796415772a1574` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:57.700806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e6a19-283b-458c-a1a8-0a5834ceb9a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57738b3dc8724df7b4796415772a1574)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:57.703511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e6a19-283b-458c-a1a8-0a5834ceb9a5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:57.727202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2197f3-691b-4df8-8a1d-850e344bd682 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:57.733670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb302b4-57cb-453e-8144-50ed395351d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:57.733918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb302b4-57cb-453e-8144-50ed395351d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:57.734198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb302b4-57cb-453e-8144-50ed395351d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:57.734479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb302b4-57cb-453e-8144-50ed395351d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:57.735219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb302b4-57cb-453e-8144-50ed395351d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:57.737689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb302b4-57cb-453e-8144-50ed395351d9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:57.767271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-449e6a19-283b-458c-a1a8-0a5834ceb9a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57738b3dc8724df7b4796415772a1574'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:57.770723 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3773/7506] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:29:57 2022] POST /identity/v3/projects => generated 393 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:29:57.774885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb302b4-57cb-453e-8144-50ed395351d9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:57.778332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-449e6a19-283b-458c-a1a8-0a5834ceb9a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57738b3dc8724df7b4796415772a1574'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:57.787085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-449e6a19-283b-458c-a1a8-0a5834ceb9a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57738b3dc8724df7b4796415772a1574'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:57.787847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-449e6a19-283b-458c-a1a8-0a5834ceb9a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57738b3dc8724df7b4796415772a1574'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:57.788599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-449e6a19-283b-458c-a1a8-0a5834ceb9a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57738b3dc8724df7b4796415772a1574'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:57.819828 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3734/7507] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:57 2022] DELETE /identity/v3/users/57738b3dc8724df7b4796415772a1574 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:57.863174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb302b4-57cb-453e-8144-50ed395351d9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:57.932142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdde758-637a-4f4f-bdb5-4e3adf5bc507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:57.932831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdde758-637a-4f4f-bdb5-4e3adf5bc507 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:57.933121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdde758-637a-4f4f-bdb5-4e3adf5bc507 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:57.933398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdde758-637a-4f4f-bdb5-4e3adf5bc507 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:57.934233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdde758-637a-4f4f-bdb5-4e3adf5bc507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:57.936374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdde758-637a-4f4f-bdb5-4e3adf5bc507 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:57.959590 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3774/7508] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:29:57 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:29:57.960930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e6a19-283b-458c-a1a8-0a5834ceb9a5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:57.962426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-449e6a19-283b-458c-a1a8-0a5834ceb9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:57.975885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e6a19-283b-458c-a1a8-0a5834ceb9a5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:57.980441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e2734-9166-47b4-8a79-64dda50aa0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:57.981106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e2734-9166-47b4-8a79-64dda50aa0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:57.981383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e2734-9166-47b4-8a79-64dda50aa0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:57.981654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e2734-9166-47b4-8a79-64dda50aa0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:57.982440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e2734-9166-47b4-8a79-64dda50aa0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:57.983974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e2734-9166-47b4-8a79-64dda50aa0a5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:57.994778 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3735/7509] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:29:58.003145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdde758-637a-4f4f-bdb5-4e3adf5bc507 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:58.014528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdde758-637a-4f4f-bdb5-4e3adf5bc507 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:58.019350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b553e91-afe5-48b2-be8f-99873c759412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:58.020154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b553e91-afe5-48b2-be8f-99873c759412 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:58.020508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b553e91-afe5-48b2-be8f-99873c759412 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:58.020848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b553e91-afe5-48b2-be8f-99873c759412 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:58.021642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b553e91-afe5-48b2-be8f-99873c759412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:58.023347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b553e91-afe5-48b2-be8f-99873c759412 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:58.034247 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3775/7510] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:29:58.039093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e2734-9166-47b4-8a79-64dda50aa0a5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:58.066867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e2734-9166-47b4-8a79-64dda50aa0a5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:58.076027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea11aa7-494f-4678-bd86-68c1ca77832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:58.077055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea11aa7-494f-4678-bd86-68c1ca77832a admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:58.077339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea11aa7-494f-4678-bd86-68c1ca77832a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:58.077612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea11aa7-494f-4678-bd86-68c1ca77832a admin admin] PATH_INFO: `/v3/projects/4119364b1c3a458799ac3fd2060a2f88/users/6d2254b99cf6467bb43ee5f2a0ac99f4/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:58.097188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea11aa7-494f-4678-bd86-68c1ca77832a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4119364b1c3a458799ac3fd2060a2f88, user_id=6d2254b99cf6467bb43ee5f2a0ac99f4, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:58.100345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea11aa7-494f-4678-bd86-68c1ca77832a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:58.116224 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3736/7511] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:29:58 2022] PUT /identity/v3/projects/4119364b1c3a458799ac3fd2060a2f88/users/6d2254b99cf6467bb43ee5f2a0ac99f4/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:58.128087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd48450-dc4b-4f1d-bea7-f5a75e66a393 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:58.128087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd48450-dc4b-4f1d-bea7-f5a75e66a393 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:58.128087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd48450-dc4b-4f1d-bea7-f5a75e66a393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:58.166692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea11aa7-494f-4678-bd86-68c1ca77832a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:58.169669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1ea11aa7-494f-4678-bd86-68c1ca77832a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:58.172147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5dd48450-dc4b-4f1d-bea7-f5a75e66a393 None None] MFA Rules not processed for user `6d2254b99cf6467bb43ee5f2a0ac99f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:58.172615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5dd48450-dc4b-4f1d-bea7-f5a75e66a393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:58.193170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:58.256278 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3776/7512] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:29:58.263564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea11aa7-494f-4678-bd86-68c1ca77832a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:58.269345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac00c9-49fe-4098-abf6-81f97924b8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:58.270633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac00c9-49fe-4098-abf6-81f97924b8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:58.270963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac00c9-49fe-4098-abf6-81f97924b8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:58.271236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac00c9-49fe-4098-abf6-81f97924b8b4 admin admin] PATH_INFO: `/v3/projects/c970adae9c614485828995b2b100e57f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:58.272757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac00c9-49fe-4098-abf6-81f97924b8b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c970adae9c614485828995b2b100e57f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:58.274915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac00c9-49fe-4098-abf6-81f97924b8b4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:58.277286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd48450-dc4b-4f1d-bea7-f5a75e66a393 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:58.278714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5dd48450-dc4b-4f1d-bea7-f5a75e66a393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:58.329432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:58.334487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d1ac00c9-49fe-4098-abf6-81f97924b8b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c970adae9c614485828995b2b100e57f', 'request_id': 'req-d1ac00c9-49fe-4098-abf6-81f97924b8b4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:58.343629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d1ac00c9-49fe-4098-abf6-81f97924b8b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c970adae9c614485828995b2b100e57f', 'request_id': 'req-d1ac00c9-49fe-4098-abf6-81f97924b8b4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:58.347310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd48450-dc4b-4f1d-bea7-f5a75e66a393 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:58.351678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d1ac00c9-49fe-4098-abf6-81f97924b8b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c970adae9c614485828995b2b100e57f', 'request_id': 'req-d1ac00c9-49fe-4098-abf6-81f97924b8b4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:58.365608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d1ac00c9-49fe-4098-abf6-81f97924b8b4 admin admin] The token cache is being invalidate because project c970adae9c614485828995b2b100e57f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:58.365898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d1ac00c9-49fe-4098-abf6-81f97924b8b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:58.366549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d1ac00c9-49fe-4098-abf6-81f97924b8b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:58.368295 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3737/7513] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:58 2022] DELETE /identity/v3/projects/c970adae9c614485828995b2b100e57f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:29:58.405886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239ebeb-66f4-412a-8074-cb3f70e4d939 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:58.406579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239ebeb-66f4-412a-8074-cb3f70e4d939 service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:58.406858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239ebeb-66f4-412a-8074-cb3f70e4d939 service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:58.407133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239ebeb-66f4-412a-8074-cb3f70e4d939 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:58.409144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1239ebeb-66f4-412a-8074-cb3f70e4d939 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:58.483150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239ebeb-66f4-412a-8074-cb3f70e4d939 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:58.484729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239ebeb-66f4-412a-8074-cb3f70e4d939 service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:58.496554 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3777/7514] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:29:59.126258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac00c9-49fe-4098-abf6-81f97924b8b4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:59.127767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d1ac00c9-49fe-4098-abf6-81f97924b8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:59.194922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac00c9-49fe-4098-abf6-81f97924b8b4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:59.199837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0a2ca-0f3e-43db-975b-4dfe28469f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:59.200744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0a2ca-0f3e-43db-975b-4dfe28469f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:59.201019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0a2ca-0f3e-43db-975b-4dfe28469f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:59.201338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0a2ca-0f3e-43db-975b-4dfe28469f92 admin admin] PATH_INFO: `/v3/users/e3cbe709684f4023a5a5050f44bd25e8` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:59.202587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0a2ca-0f3e-43db-975b-4dfe28469f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3cbe709684f4023a5a5050f44bd25e8)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:59.204520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0a2ca-0f3e-43db-975b-4dfe28469f92 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:59.252516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f9d0a2ca-0f3e-43db-975b-4dfe28469f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3cbe709684f4023a5a5050f44bd25e8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:59.260664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f9d0a2ca-0f3e-43db-975b-4dfe28469f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3cbe709684f4023a5a5050f44bd25e8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:59.267780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f9d0a2ca-0f3e-43db-975b-4dfe28469f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3cbe709684f4023a5a5050f44bd25e8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:59.268506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f9d0a2ca-0f3e-43db-975b-4dfe28469f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3cbe709684f4023a5a5050f44bd25e8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:59.269164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f9d0a2ca-0f3e-43db-975b-4dfe28469f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3cbe709684f4023a5a5050f44bd25e8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:59.287391 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3738/7515] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:59 2022] DELETE /identity/v3/users/e3cbe709684f4023a5a5050f44bd25e8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:59.292033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2e0e4-1fc9-4613-84f5-fbbe39589dbd None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:59.292568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2e0e4-1fc9-4613-84f5-fbbe39589dbd None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:59.292568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2e0e4-1fc9-4613-84f5-fbbe39589dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:59.311753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-18a2e0e4-1fc9-4613-84f5-fbbe39589dbd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:29:59.313431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-18a2e0e4-1fc9-4613-84f5-fbbe39589dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:59.335389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:59.375603 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3778/7516] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:29:59.386489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0a2ca-0f3e-43db-975b-4dfe28469f92 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:59.387988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f9d0a2ca-0f3e-43db-975b-4dfe28469f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:59.449946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0a2ca-0f3e-43db-975b-4dfe28469f92 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:59.453650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93954837-158d-4e08-ae24-f2f0577dee12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:59.454305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93954837-158d-4e08-ae24-f2f0577dee12 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:59.454591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93954837-158d-4e08-ae24-f2f0577dee12 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:59.454870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93954837-158d-4e08-ae24-f2f0577dee12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:59.461088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:59.465214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93954837-158d-4e08-ae24-f2f0577dee12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:59.466760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93954837-158d-4e08-ae24-f2f0577dee12 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:59.477720 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3739/7517] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:29:59.781299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2e0e4-1fc9-4613-84f5-fbbe39589dbd None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:59.782992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-18a2e0e4-1fc9-4613-84f5-fbbe39589dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:29:59.796055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2e0e4-1fc9-4613-84f5-fbbe39589dbd None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:59.801404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec5c3e-0c1c-4fc0-855f-c2d569b062e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:59.803755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec5c3e-0c1c-4fc0-855f-c2d569b062e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:59.804081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec5c3e-0c1c-4fc0-855f-c2d569b062e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:59.804536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec5c3e-0c1c-4fc0-855f-c2d569b062e1 admin admin] PATH_INFO: `/v3/projects/2136df352e57413785c0f2ad287e6a95` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:59.805724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec5c3e-0c1c-4fc0-855f-c2d569b062e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2136df352e57413785c0f2ad287e6a95)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:59.807867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec5c3e-0c1c-4fc0-855f-c2d569b062e1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:29:59.856818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-98ec5c3e-0c1c-4fc0-855f-c2d569b062e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2136df352e57413785c0f2ad287e6a95', 'request_id': 'req-98ec5c3e-0c1c-4fc0-855f-c2d569b062e1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:59.865466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-98ec5c3e-0c1c-4fc0-855f-c2d569b062e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2136df352e57413785c0f2ad287e6a95', 'request_id': 'req-98ec5c3e-0c1c-4fc0-855f-c2d569b062e1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:59.872013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-98ec5c3e-0c1c-4fc0-855f-c2d569b062e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2136df352e57413785c0f2ad287e6a95', 'request_id': 'req-98ec5c3e-0c1c-4fc0-855f-c2d569b062e1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:59.882501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-98ec5c3e-0c1c-4fc0-855f-c2d569b062e1 admin admin] The token cache is being invalidate because project 2136df352e57413785c0f2ad287e6a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:29:59.882791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-98ec5c3e-0c1c-4fc0-855f-c2d569b062e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:59.883458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-98ec5c3e-0c1c-4fc0-855f-c2d569b062e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:29:59.885121 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3779/7518] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:29:59 2022] DELETE /identity/v3/projects/2136df352e57413785c0f2ad287e6a95 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:29:59.889407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93954837-158d-4e08-ae24-f2f0577dee12 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:29:59.899632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93954837-158d-4e08-ae24-f2f0577dee12 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:29:59.963835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168ca34-bf94-4e00-b7d8-89698e3797c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:29:59.964763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168ca34-bf94-4e00-b7d8-89698e3797c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:29:59.965030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168ca34-bf94-4e00-b7d8-89698e3797c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:29:59.965317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168ca34-bf94-4e00-b7d8-89698e3797c5 admin admin] PATH_INFO: `/v3/users/6d2254b99cf6467bb43ee5f2a0ac99f4` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:29:59.966558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168ca34-bf94-4e00-b7d8-89698e3797c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d2254b99cf6467bb43ee5f2a0ac99f4)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:29:59.968531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168ca34-bf94-4e00-b7d8-89698e3797c5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:00.020900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e168ca34-bf94-4e00-b7d8-89698e3797c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d2254b99cf6467bb43ee5f2a0ac99f4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:00.028593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e168ca34-bf94-4e00-b7d8-89698e3797c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d2254b99cf6467bb43ee5f2a0ac99f4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:00.036952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e168ca34-bf94-4e00-b7d8-89698e3797c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d2254b99cf6467bb43ee5f2a0ac99f4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:00.037990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e168ca34-bf94-4e00-b7d8-89698e3797c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d2254b99cf6467bb43ee5f2a0ac99f4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:00.038921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e168ca34-bf94-4e00-b7d8-89698e3797c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d2254b99cf6467bb43ee5f2a0ac99f4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:00.063370 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3740/7519] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:29:59 2022] DELETE /identity/v3/users/6d2254b99cf6467bb43ee5f2a0ac99f4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:00.370723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec5c3e-0c1c-4fc0-855f-c2d569b062e1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:00.372431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-98ec5c3e-0c1c-4fc0-855f-c2d569b062e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:00.388172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec5c3e-0c1c-4fc0-855f-c2d569b062e1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:00.451352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8593ea-c89e-42c5-a3a3-cbd5947f2276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:00.452315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8593ea-c89e-42c5-a3a3-cbd5947f2276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:00.452602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8593ea-c89e-42c5-a3a3-cbd5947f2276 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:00.452865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8593ea-c89e-42c5-a3a3-cbd5947f2276 admin admin] PATH_INFO: `/v3/projects/4119364b1c3a458799ac3fd2060a2f88` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:00.454496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8593ea-c89e-42c5-a3a3-cbd5947f2276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4119364b1c3a458799ac3fd2060a2f88)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:00.456494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8593ea-c89e-42c5-a3a3-cbd5947f2276 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:00.505991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2a8593ea-c89e-42c5-a3a3-cbd5947f2276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4119364b1c3a458799ac3fd2060a2f88', 'request_id': 'req-2a8593ea-c89e-42c5-a3a3-cbd5947f2276'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:00.509353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:00.516371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2a8593ea-c89e-42c5-a3a3-cbd5947f2276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4119364b1c3a458799ac3fd2060a2f88', 'request_id': 'req-2a8593ea-c89e-42c5-a3a3-cbd5947f2276'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:00.524436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2a8593ea-c89e-42c5-a3a3-cbd5947f2276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4119364b1c3a458799ac3fd2060a2f88', 'request_id': 'req-2a8593ea-c89e-42c5-a3a3-cbd5947f2276'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:00.535900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2a8593ea-c89e-42c5-a3a3-cbd5947f2276 admin admin] The token cache is being invalidate because project 4119364b1c3a458799ac3fd2060a2f88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:30:00.536221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2a8593ea-c89e-42c5-a3a3-cbd5947f2276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:00.536930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2a8593ea-c89e-42c5-a3a3-cbd5947f2276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:00.538518 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3780/7520] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:30:00 2022] DELETE /identity/v3/projects/4119364b1c3a458799ac3fd2060a2f88 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:00.543583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a79cd6-cf81-4c62-b01a-fa2c9a936198 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:00.544105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a79cd6-cf81-4c62-b01a-fa2c9a936198 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:00.544220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a79cd6-cf81-4c62-b01a-fa2c9a936198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:00.562663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-30a79cd6-cf81-4c62-b01a-fa2c9a936198 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:30:00.563857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-30a79cd6-cf81-4c62-b01a-fa2c9a936198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:00.626080 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3741/7521] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:30:00.633988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0d31f-a96b-4fd8-88d4-c025ecef00f5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:00.634280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0d31f-a96b-4fd8-88d4-c025ecef00f5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:00.634563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0d31f-a96b-4fd8-88d4-c025ecef00f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:00.653596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9db0d31f-a96b-4fd8-88d4-c025ecef00f5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:30:00.654588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9db0d31f-a96b-4fd8-88d4-c025ecef00f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:00.664018 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3781/7522] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:30:00.668479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a79cd6-cf81-4c62-b01a-fa2c9a936198 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:00.679202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a79cd6-cf81-4c62-b01a-fa2c9a936198 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:00.684313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2ecca-3314-4df7-8e20-88cc99fff1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:00.684968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2ecca-3314-4df7-8e20-88cc99fff1ad admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:00.685247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2ecca-3314-4df7-8e20-88cc99fff1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:00.685531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2ecca-3314-4df7-8e20-88cc99fff1ad admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:00.686322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2ecca-3314-4df7-8e20-88cc99fff1ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:30:00.686626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2ecca-3314-4df7-8e20-88cc99fff1ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:00.688312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2ecca-3314-4df7-8e20-88cc99fff1ad admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:00.697305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:00.700717 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3742/7523] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:30:00.705353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0d31f-a96b-4fd8-88d4-c025ecef00f5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:00.715187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0d31f-a96b-4fd8-88d4-c025ecef00f5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:00.720308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8cd75-01ba-4544-bf9c-c4fc101eb38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:00.721048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8cd75-01ba-4544-bf9c-c4fc101eb38f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:00.721271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8cd75-01ba-4544-bf9c-c4fc101eb38f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:00.721647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8cd75-01ba-4544-bf9c-c4fc101eb38f admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:00.722387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8cd75-01ba-4544-bf9c-c4fc101eb38f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:00.724520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8cd75-01ba-4544-bf9c-c4fc101eb38f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:00.757120 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3782/7524] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:30:00 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:30:00.761404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2ecca-3314-4df7-8e20-88cc99fff1ad admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:00.772810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2ecca-3314-4df7-8e20-88cc99fff1ad admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:00.833641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee54a07-b234-4d14-bd24-b08961a9ce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:00.834320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee54a07-b234-4d14-bd24-b08961a9ce67 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:00.834638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee54a07-b234-4d14-bd24-b08961a9ce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:00.834914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee54a07-b234-4d14-bd24-b08961a9ce67 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:00.835625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee54a07-b234-4d14-bd24-b08961a9ce67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:00.837644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee54a07-b234-4d14-bd24-b08961a9ce67 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:00.862247 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3743/7525] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:30:00 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:30:00.863943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8cd75-01ba-4544-bf9c-c4fc101eb38f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:00.874847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8cd75-01ba-4544-bf9c-c4fc101eb38f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:00.880435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f13ec5-1044-429a-8887-f7bd2bb0f154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:00.881090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f13ec5-1044-429a-8887-f7bd2bb0f154 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:00.881368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f13ec5-1044-429a-8887-f7bd2bb0f154 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:00.881639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f13ec5-1044-429a-8887-f7bd2bb0f154 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:00.882355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f13ec5-1044-429a-8887-f7bd2bb0f154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:00.883961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f13ec5-1044-429a-8887-f7bd2bb0f154 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:00.894786 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3783/7526] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:30:00.898794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee54a07-b234-4d14-bd24-b08961a9ce67 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:00.909185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee54a07-b234-4d14-bd24-b08961a9ce67 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:00.915129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d3cac-f3ad-4cdd-ba0b-7cb8de1cb44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:00.915902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d3cac-f3ad-4cdd-ba0b-7cb8de1cb44f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:00.916231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d3cac-f3ad-4cdd-ba0b-7cb8de1cb44f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:00.916510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d3cac-f3ad-4cdd-ba0b-7cb8de1cb44f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:00.917235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d3cac-f3ad-4cdd-ba0b-7cb8de1cb44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:00.918844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d3cac-f3ad-4cdd-ba0b-7cb8de1cb44f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:00.930303 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3744/7527] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:30:00.934705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f13ec5-1044-429a-8887-f7bd2bb0f154 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:00.945384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f13ec5-1044-429a-8887-f7bd2bb0f154 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:00.951205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f743f-0555-408e-988d-babf027833a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:00.952183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f743f-0555-408e-988d-babf027833a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:00.952486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f743f-0555-408e-988d-babf027833a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:00.952759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f743f-0555-408e-988d-babf027833a3 admin admin] PATH_INFO: `/v3/projects/54e0ada4484442988a2d6458a9f13bd1/users/247362ddd7a549b3816094a3cd771cff/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:00.968080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f743f-0555-408e-988d-babf027833a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e0ada4484442988a2d6458a9f13bd1, user_id=247362ddd7a549b3816094a3cd771cff, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:00.970787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f743f-0555-408e-988d-babf027833a3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:00.988063 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3784/7528] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:30:00 2022] PUT /identity/v3/projects/54e0ada4484442988a2d6458a9f13bd1/users/247362ddd7a549b3816094a3cd771cff/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:01.079644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d17f1-1a55-494b-97b3-27d5eb6c23fd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:01.079953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d17f1-1a55-494b-97b3-27d5eb6c23fd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:01.080265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d17f1-1a55-494b-97b3-27d5eb6c23fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:01.108314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d16d17f1-1a55-494b-97b3-27d5eb6c23fd None None] MFA Rules not processed for user `247362ddd7a549b3816094a3cd771cff`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:30:01.109858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d16d17f1-1a55-494b-97b3-27d5eb6c23fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:01.178892 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3745/7529] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:30:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:30:01.191136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f743f-0555-408e-988d-babf027833a3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:01.193180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f39f743f-0555-408e-988d-babf027833a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:01.255638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f743f-0555-408e-988d-babf027833a3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:01.259436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa671a92-1015-4844-8d0e-caece72287f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:01.260111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa671a92-1015-4844-8d0e-caece72287f4 service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:01.260413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa671a92-1015-4844-8d0e-caece72287f4 service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:01.260685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa671a92-1015-4844-8d0e-caece72287f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:01.269533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa671a92-1015-4844-8d0e-caece72287f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:01.270916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa671a92-1015-4844-8d0e-caece72287f4 service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:01.280078 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3785/7530] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:30:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:30:01.873151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d17f1-1a55-494b-97b3-27d5eb6c23fd None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:01.937860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d17f1-1a55-494b-97b3-27d5eb6c23fd None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:01.943113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc2baa-0a6b-4097-b3a6-67558918cd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:01.944006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc2baa-0a6b-4097-b3a6-67558918cd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:01.944326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc2baa-0a6b-4097-b3a6-67558918cd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:01.944600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc2baa-0a6b-4097-b3a6-67558918cd63 admin admin] PATH_INFO: `/v3/users/247362ddd7a549b3816094a3cd771cff` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:01.945853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc2baa-0a6b-4097-b3a6-67558918cd63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=247362ddd7a549b3816094a3cd771cff)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:01.947809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc2baa-0a6b-4097-b3a6-67558918cd63 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:01.959615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:01.999782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-06fc2baa-0a6b-4097-b3a6-67558918cd63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247362ddd7a549b3816094a3cd771cff'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:02.007696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-06fc2baa-0a6b-4097-b3a6-67558918cd63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247362ddd7a549b3816094a3cd771cff'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:02.014640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-06fc2baa-0a6b-4097-b3a6-67558918cd63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247362ddd7a549b3816094a3cd771cff'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:02.015380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-06fc2baa-0a6b-4097-b3a6-67558918cd63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247362ddd7a549b3816094a3cd771cff'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:02.015946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-06fc2baa-0a6b-4097-b3a6-67558918cd63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247362ddd7a549b3816094a3cd771cff'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:02.033158 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3746/7531] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:30:01 2022] DELETE /identity/v3/users/247362ddd7a549b3816094a3cd771cff => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:02.038152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7df49-1fc8-43bc-acda-7a47cd4534a3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:02.038637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7df49-1fc8-43bc-acda-7a47cd4534a3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:02.038736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7df49-1fc8-43bc-acda-7a47cd4534a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:02.056837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-92b7df49-1fc8-43bc-acda-7a47cd4534a3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:30:02.058003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-92b7df49-1fc8-43bc-acda-7a47cd4534a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:02.128218 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3786/7532] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:30:02.138170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc2baa-0a6b-4097-b3a6-67558918cd63 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:02.139914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-06fc2baa-0a6b-4097-b3a6-67558918cd63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:02.206901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc2baa-0a6b-4097-b3a6-67558918cd63 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:02.212325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c71bb9-8b4e-4670-bcdf-d9ed5d72896d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:02.212982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c71bb9-8b4e-4670-bcdf-d9ed5d72896d service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:02.213266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c71bb9-8b4e-4670-bcdf-d9ed5d72896d service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:02.213571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c71bb9-8b4e-4670-bcdf-d9ed5d72896d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:02.223573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c71bb9-8b4e-4670-bcdf-d9ed5d72896d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:02.225032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c71bb9-8b4e-4670-bcdf-d9ed5d72896d service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:02.234778 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3747/7533] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:30:02.538329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7df49-1fc8-43bc-acda-7a47cd4534a3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:02.539897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-92b7df49-1fc8-43bc-acda-7a47cd4534a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:02.552571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7df49-1fc8-43bc-acda-7a47cd4534a3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:02.558638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680535cb-e1bb-4c89-acb2-753b5c757905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:02.559521 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680535cb-e1bb-4c89-acb2-753b5c757905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:02.559785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680535cb-e1bb-4c89-acb2-753b5c757905 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:02.560100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680535cb-e1bb-4c89-acb2-753b5c757905 admin admin] PATH_INFO: `/v3/projects/54e0ada4484442988a2d6458a9f13bd1` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:02.561485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680535cb-e1bb-4c89-acb2-753b5c757905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e0ada4484442988a2d6458a9f13bd1)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:02.563621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680535cb-e1bb-4c89-acb2-753b5c757905 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:02.581370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:02.616118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-680535cb-e1bb-4c89-acb2-753b5c757905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e0ada4484442988a2d6458a9f13bd1', 'request_id': 'req-680535cb-e1bb-4c89-acb2-753b5c757905'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:02.624452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-680535cb-e1bb-4c89-acb2-753b5c757905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e0ada4484442988a2d6458a9f13bd1', 'request_id': 'req-680535cb-e1bb-4c89-acb2-753b5c757905'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:02.630957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-680535cb-e1bb-4c89-acb2-753b5c757905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e0ada4484442988a2d6458a9f13bd1', 'request_id': 'req-680535cb-e1bb-4c89-acb2-753b5c757905'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:02.642247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-680535cb-e1bb-4c89-acb2-753b5c757905 admin admin] The token cache is being invalidate because project 54e0ada4484442988a2d6458a9f13bd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:30:02.642540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-680535cb-e1bb-4c89-acb2-753b5c757905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:02.643253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-680535cb-e1bb-4c89-acb2-753b5c757905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:02.644980 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3787/7534] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:30:02 2022] DELETE /identity/v3/projects/54e0ada4484442988a2d6458a9f13bd1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:02.650380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d75b6-f745-48aa-98b5-f79e79aa2ecd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:02.650665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d75b6-f745-48aa-98b5-f79e79aa2ecd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:02.650978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d75b6-f745-48aa-98b5-f79e79aa2ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:02.670930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fb9d75b6-f745-48aa-98b5-f79e79aa2ecd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:30:02.672240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fb9d75b6-f745-48aa-98b5-f79e79aa2ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:02.734929 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3748/7535] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:30:02.742904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d040f6-1ee4-454d-a7d5-bea35bfcfe76 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:02.743199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d040f6-1ee4-454d-a7d5-bea35bfcfe76 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:02.743479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d040f6-1ee4-454d-a7d5-bea35bfcfe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:02.764421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-77d040f6-1ee4-454d-a7d5-bea35bfcfe76 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:30:02.765700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-77d040f6-1ee4-454d-a7d5-bea35bfcfe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:02.775302 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3788/7536] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:30:02.779983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d75b6-f745-48aa-98b5-f79e79aa2ecd None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:02.790731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d75b6-f745-48aa-98b5-f79e79aa2ecd None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:02.796168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533c134-cbb4-40c3-b43d-ca157cc7adff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:02.796835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533c134-cbb4-40c3-b43d-ca157cc7adff admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:02.797123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533c134-cbb4-40c3-b43d-ca157cc7adff admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:02.797388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533c134-cbb4-40c3-b43d-ca157cc7adff admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:02.798151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533c134-cbb4-40c3-b43d-ca157cc7adff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:30:02.798456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533c134-cbb4-40c3-b43d-ca157cc7adff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:02.800073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533c134-cbb4-40c3-b43d-ca157cc7adff admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:02.813020 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3749/7537] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:30:02.817482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d040f6-1ee4-454d-a7d5-bea35bfcfe76 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:02.827404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d040f6-1ee4-454d-a7d5-bea35bfcfe76 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:02.833052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4f934-d77e-4187-9329-714b9a37036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:02.833696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4f934-d77e-4187-9329-714b9a37036d admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:02.833965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4f934-d77e-4187-9329-714b9a37036d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:02.834277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4f934-d77e-4187-9329-714b9a37036d admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:02.835034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4f934-d77e-4187-9329-714b9a37036d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:02.836992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4f934-d77e-4187-9329-714b9a37036d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:02.865521 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3789/7538] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:30:02 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:30:02.870111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533c134-cbb4-40c3-b43d-ca157cc7adff admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:02.882551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533c134-cbb4-40c3-b43d-ca157cc7adff admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:02.895388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:02.945323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56350983-ab2e-419a-8109-808aa3802847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:02.945996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56350983-ab2e-419a-8109-808aa3802847 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:02.946276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56350983-ab2e-419a-8109-808aa3802847 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:02.946549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56350983-ab2e-419a-8109-808aa3802847 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:02.947233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56350983-ab2e-419a-8109-808aa3802847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:02.949185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56350983-ab2e-419a-8109-808aa3802847 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:02.972345 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3750/7539] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:30:02 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:30:02.976617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4f934-d77e-4187-9329-714b9a37036d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:02.987199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4f934-d77e-4187-9329-714b9a37036d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:02.991889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551cda9-8e4d-40a4-94df-a8ea8bd2680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:02.992595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551cda9-8e4d-40a4-94df-a8ea8bd2680e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:02.992879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551cda9-8e4d-40a4-94df-a8ea8bd2680e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:02.993157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551cda9-8e4d-40a4-94df-a8ea8bd2680e admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:02.993881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551cda9-8e4d-40a4-94df-a8ea8bd2680e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:02.995512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551cda9-8e4d-40a4-94df-a8ea8bd2680e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:03.005946 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3790/7540] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:30:03.009989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56350983-ab2e-419a-8109-808aa3802847 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:03.020912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56350983-ab2e-419a-8109-808aa3802847 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:03.026495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b891d-ca2d-4cdb-8923-c80be56502cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:03.027161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b891d-ca2d-4cdb-8923-c80be56502cd admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:03.027480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b891d-ca2d-4cdb-8923-c80be56502cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:03.027761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b891d-ca2d-4cdb-8923-c80be56502cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:03.028523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b891d-ca2d-4cdb-8923-c80be56502cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:03.030230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b891d-ca2d-4cdb-8923-c80be56502cd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:03.041244 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3751/7541] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:30:03.045393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551cda9-8e4d-40a4-94df-a8ea8bd2680e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:03.056297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551cda9-8e4d-40a4-94df-a8ea8bd2680e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:03.061391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c348f-04c0-4e12-aa25-b26500b6ca5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:03.062272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c348f-04c0-4e12-aa25-b26500b6ca5f admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:03.062552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c348f-04c0-4e12-aa25-b26500b6ca5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:03.062839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c348f-04c0-4e12-aa25-b26500b6ca5f admin admin] PATH_INFO: `/v3/projects/94616bb313ef45d9a87c34122c5d51b4/users/6ce0d08ad4604c3c93a9c01d037055a4/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:03.077877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c348f-04c0-4e12-aa25-b26500b6ca5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=94616bb313ef45d9a87c34122c5d51b4, user_id=6ce0d08ad4604c3c93a9c01d037055a4, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:03.080589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c348f-04c0-4e12-aa25-b26500b6ca5f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:03.096088 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3791/7542] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:30:03 2022] PUT /identity/v3/projects/94616bb313ef45d9a87c34122c5d51b4/users/6ce0d08ad4604c3c93a9c01d037055a4/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:03.108154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec44c4-bb42-4eb0-ad3c-d5e9736f330b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:03.108452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec44c4-bb42-4eb0-ad3c-d5e9736f330b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:03.108731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec44c4-bb42-4eb0-ad3c-d5e9736f330b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:03.137322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a7ec44c4-bb42-4eb0-ad3c-d5e9736f330b None None] MFA Rules not processed for user `6ce0d08ad4604c3c93a9c01d037055a4`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:30:03.138584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a7ec44c4-bb42-4eb0-ad3c-d5e9736f330b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:03.206785 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3752/7543] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:30:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:30:03.211565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c348f-04c0-4e12-aa25-b26500b6ca5f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:03.277168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c348f-04c0-4e12-aa25-b26500b6ca5f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:03.283013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1e67c-db30-4039-a7f4-dcd3046265cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:03.283689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1e67c-db30-4039-a7f4-dcd3046265cf admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:03.283977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1e67c-db30-4039-a7f4-dcd3046265cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:03.284298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1e67c-db30-4039-a7f4-dcd3046265cf admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:03.284993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf1e67c-db30-4039-a7f4-dcd3046265cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:03.286972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf1e67c-db30-4039-a7f4-dcd3046265cf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:03.316785 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3792/7544] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:30:03 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:30:03.321247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec44c4-bb42-4eb0-ad3c-d5e9736f330b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:03.332883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec44c4-bb42-4eb0-ad3c-d5e9736f330b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:03.391338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c3ed6-251f-4954-81a0-ceb3a7920232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:03.391925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c3ed6-251f-4954-81a0-ceb3a7920232 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:03.392203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c3ed6-251f-4954-81a0-ceb3a7920232 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:03.392508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c3ed6-251f-4954-81a0-ceb3a7920232 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:03.393191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c3ed6-251f-4954-81a0-ceb3a7920232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:03.395117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c3ed6-251f-4954-81a0-ceb3a7920232 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:03.416888 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3753/7545] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:30:03 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:30:03.421126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1e67c-db30-4039-a7f4-dcd3046265cf admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:03.432236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1e67c-db30-4039-a7f4-dcd3046265cf admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:03.438205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c68565-523f-4927-8844-c4c0901e13d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:03.438869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c68565-523f-4927-8844-c4c0901e13d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:03.439154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c68565-523f-4927-8844-c4c0901e13d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:03.439431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c68565-523f-4927-8844-c4c0901e13d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:03.440179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c68565-523f-4927-8844-c4c0901e13d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:03.441795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c68565-523f-4927-8844-c4c0901e13d2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:03.452835 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3793/7546] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:30:03.457100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c3ed6-251f-4954-81a0-ceb3a7920232 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:03.467289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c3ed6-251f-4954-81a0-ceb3a7920232 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:03.472791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8aea1-e4ee-4bda-91a8-a85097234c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:03.473676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8aea1-e4ee-4bda-91a8-a85097234c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:03.473960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8aea1-e4ee-4bda-91a8-a85097234c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:03.474273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8aea1-e4ee-4bda-91a8-a85097234c65 admin admin] PATH_INFO: `/v3/projects/d93d47879c2a4e07a2e66ae4379999de/users/cbc9670d5f8742819484c1b9b80797a9/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:03.486432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:03.489797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8aea1-e4ee-4bda-91a8-a85097234c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93d47879c2a4e07a2e66ae4379999de, user_id=cbc9670d5f8742819484c1b9b80797a9, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:03.492908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8aea1-e4ee-4bda-91a8-a85097234c65 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:03.508259 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3754/7547] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:30:03 2022] PUT /identity/v3/projects/d93d47879c2a4e07a2e66ae4379999de/users/cbc9670d5f8742819484c1b9b80797a9/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:03.512320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c68565-523f-4927-8844-c4c0901e13d2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:03.522862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c68565-523f-4927-8844-c4c0901e13d2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:03.532866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:03.585861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c000068-890f-4e25-84e2-d64b87d2bb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:03.586534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c000068-890f-4e25-84e2-d64b87d2bb71 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:03.586821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c000068-890f-4e25-84e2-d64b87d2bb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:03.587099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c000068-890f-4e25-84e2-d64b87d2bb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:03.587818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c000068-890f-4e25-84e2-d64b87d2bb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:03.589480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c000068-890f-4e25-84e2-d64b87d2bb71 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:03.599370 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3794/7548] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:30:03.603668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8aea1-e4ee-4bda-91a8-a85097234c65 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:03.614426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8aea1-e4ee-4bda-91a8-a85097234c65 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:03.619983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28310ac6-3c94-44d8-a763-75c16b7801b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:03.620938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28310ac6-3c94-44d8-a763-75c16b7801b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:03.621208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28310ac6-3c94-44d8-a763-75c16b7801b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:03.621480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28310ac6-3c94-44d8-a763-75c16b7801b6 admin admin] PATH_INFO: `/v3/projects/d93d47879c2a4e07a2e66ae4379999de/users/cbc9670d5f8742819484c1b9b80797a9/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:03.623886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28310ac6-3c94-44d8-a763-75c16b7801b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93d47879c2a4e07a2e66ae4379999de, user_id=cbc9670d5f8742819484c1b9b80797a9, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:03.626621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28310ac6-3c94-44d8-a763-75c16b7801b6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:03.640792 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3755/7549] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:30:03 2022] PUT /identity/v3/projects/d93d47879c2a4e07a2e66ae4379999de/users/cbc9670d5f8742819484c1b9b80797a9/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:03.654056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb08c3-9ad7-48d0-932a-3ac6b11e6824 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:03.654344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb08c3-9ad7-48d0-932a-3ac6b11e6824 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:03.654617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb08c3-9ad7-48d0-932a-3ac6b11e6824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:03.682960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-bafb08c3-9ad7-48d0-932a-3ac6b11e6824 None None] MFA Rules not processed for user `cbc9670d5f8742819484c1b9b80797a9`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:30:03.684219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bafb08c3-9ad7-48d0-932a-3ac6b11e6824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:03.763719 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3795/7550] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:30:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:30:03.778913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28310ac6-3c94-44d8-a763-75c16b7801b6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:03.784513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-28310ac6-3c94-44d8-a763-75c16b7801b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:03.850445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28310ac6-3c94-44d8-a763-75c16b7801b6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:03.855133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7224e-1273-4e91-a8bd-56fc4eefb776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:03.855776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7224e-1273-4e91-a8bd-56fc4eefb776 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:03.856078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7224e-1273-4e91-a8bd-56fc4eefb776 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:03.856359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7224e-1273-4e91-a8bd-56fc4eefb776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:03.865932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7224e-1273-4e91-a8bd-56fc4eefb776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:03.867374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7224e-1273-4e91-a8bd-56fc4eefb776 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:03.877182 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3756/7551] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:30:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:30:09.994381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb08c3-9ad7-48d0-932a-3ac6b11e6824 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:09.995881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bafb08c3-9ad7-48d0-932a-3ac6b11e6824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:10.072317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7224e-1273-4e91-a8bd-56fc4eefb776 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:10.073302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb08c3-9ad7-48d0-932a-3ac6b11e6824 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:10.085893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b550961-11da-49ff-95cd-f8ff88eeaea5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:10.086073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7224e-1273-4e91-a8bd-56fc4eefb776 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:10.086640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b550961-11da-49ff-95cd-f8ff88eeaea5 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:10.086989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b550961-11da-49ff-95cd-f8ff88eeaea5 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:10.087702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b550961-11da-49ff-95cd-f8ff88eeaea5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:10.092157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1b550961-11da-49ff-95cd-f8ff88eeaea5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:10.099745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed1a3e-60e6-4058-8702-47b70db6f78a tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc9670d5f8742819484c1b9b80797a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93d47879c2a4e07a2e66ae4379999de', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:10.100882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed1a3e-60e6-4058-8702-47b70db6f78a tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:10.101325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed1a3e-60e6-4058-8702-47b70db6f78a tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:10.101907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed1a3e-60e6-4058-8702-47b70db6f78a tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:10.102646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed1a3e-60e6-4058-8702-47b70db6f78a tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:30:10.102956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed1a3e-60e6-4058-8702-47b70db6f78a tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:10.105547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed1a3e-60e6-4058-8702-47b70db6f78a tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:10.106242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b550961-11da-49ff-95cd-f8ff88eeaea5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:10.107972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b550961-11da-49ff-95cd-f8ff88eeaea5 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:10.120183 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3757/7552] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:30:10.123582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed1a3e-60e6-4058-8702-47b70db6f78a tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:10.124196 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3796/7553] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:30:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:30:10.135246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed1a3e-60e6-4058-8702-47b70db6f78a tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:10.141312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab603e8-b875-4eaf-8715-32d08b21f39f tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc9670d5f8742819484c1b9b80797a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93d47879c2a4e07a2e66ae4379999de', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:10.141995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab603e8-b875-4eaf-8715-32d08b21f39f tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:10.142281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab603e8-b875-4eaf-8715-32d08b21f39f tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:10.142559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab603e8-b875-4eaf-8715-32d08b21f39f tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:10.143407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab603e8-b875-4eaf-8715-32d08b21f39f tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:10.145477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab603e8-b875-4eaf-8715-32d08b21f39f tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:10.177954 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3758/7554] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:30:10 2022] POST /identity/v3/projects => generated 349 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:30:10.182436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b550961-11da-49ff-95cd-f8ff88eeaea5 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:10.195889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b550961-11da-49ff-95cd-f8ff88eeaea5 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:10.218293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:10.261308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc016f1-495a-4119-81c3-bbd2a115ecee tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc9670d5f8742819484c1b9b80797a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93d47879c2a4e07a2e66ae4379999de', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:10.262002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc016f1-495a-4119-81c3-bbd2a115ecee tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:10.262265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc016f1-495a-4119-81c3-bbd2a115ecee tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:10.262544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc016f1-495a-4119-81c3-bbd2a115ecee tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:10.263302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc016f1-495a-4119-81c3-bbd2a115ecee tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:30:10.263609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc016f1-495a-4119-81c3-bbd2a115ecee tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:10.265273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc016f1-495a-4119-81c3-bbd2a115ecee tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:10.287872 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3797/7555] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:30:10.840131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab603e8-b875-4eaf-8715-32d08b21f39f tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:10.853122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab603e8-b875-4eaf-8715-32d08b21f39f tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:10.857720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e54fc-4c28-4468-9b6b-cff0d7c0f1a1 tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc9670d5f8742819484c1b9b80797a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93d47879c2a4e07a2e66ae4379999de', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:10.858597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e54fc-4c28-4468-9b6b-cff0d7c0f1a1 tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:10.858885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e54fc-4c28-4468-9b6b-cff0d7c0f1a1 tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:10.859185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e54fc-4c28-4468-9b6b-cff0d7c0f1a1 tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] PATH_INFO: `/v3/projects/bc24cb2e30a0435083ede3cc500aa3c0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:10.860822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e54fc-4c28-4468-9b6b-cff0d7c0f1a1 tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bc24cb2e30a0435083ede3cc500aa3c0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:10.863313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e54fc-4c28-4468-9b6b-cff0d7c0f1a1 tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:10.910941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-917e54fc-4c28-4468-9b6b-cff0d7c0f1a1 tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc24cb2e30a0435083ede3cc500aa3c0', 'request_id': 'req-917e54fc-4c28-4468-9b6b-cff0d7c0f1a1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:10.917449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-917e54fc-4c28-4468-9b6b-cff0d7c0f1a1 tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc24cb2e30a0435083ede3cc500aa3c0', 'request_id': 'req-917e54fc-4c28-4468-9b6b-cff0d7c0f1a1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:10.923429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-917e54fc-4c28-4468-9b6b-cff0d7c0f1a1 tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc24cb2e30a0435083ede3cc500aa3c0', 'request_id': 'req-917e54fc-4c28-4468-9b6b-cff0d7c0f1a1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:10.937615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-917e54fc-4c28-4468-9b6b-cff0d7c0f1a1 tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] The token cache is being invalidate because project bc24cb2e30a0435083ede3cc500aa3c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:30:10.937899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-917e54fc-4c28-4468-9b6b-cff0d7c0f1a1 tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:10.938531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-917e54fc-4c28-4468-9b6b-cff0d7c0f1a1 tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:10.940134 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3759/7556] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:30:10 2022] DELETE /identity/v3/projects/bc24cb2e30a0435083ede3cc500aa3c0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:10.951124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc016f1-495a-4119-81c3-bbd2a115ecee tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:10.952985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6bc016f1-495a-4119-81c3-bbd2a115ecee tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:11.014883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc016f1-495a-4119-81c3-bbd2a115ecee tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:11.066432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343c933-3548-430b-83ec-4e0f13af6d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:11.067076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343c933-3548-430b-83ec-4e0f13af6d7a service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:11.067360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343c933-3548-430b-83ec-4e0f13af6d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:11.067634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343c933-3548-430b-83ec-4e0f13af6d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:11.069623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d343c933-3548-430b-83ec-4e0f13af6d7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:11.136084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343c933-3548-430b-83ec-4e0f13af6d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:11.137548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343c933-3548-430b-83ec-4e0f13af6d7a service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:11.146638 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3798/7557] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:30:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:30:13.209582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e54fc-4c28-4468-9b6b-cff0d7c0f1a1 tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:13.211282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-917e54fc-4c28-4468-9b6b-cff0d7c0f1a1 tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:13.262734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:13.310459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e54fc-4c28-4468-9b6b-cff0d7c0f1a1 tempest-RoutersIpV6AdminTest-1133787882 tempest-RoutersIpV6AdminTest-1133787882-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:13.315967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7282f-345f-49ea-b17d-eaef6a608a0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:13.316660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7282f-345f-49ea-b17d-eaef6a608a0a service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:13.317204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7282f-345f-49ea-b17d-eaef6a608a0a service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:13.317496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7282f-345f-49ea-b17d-eaef6a608a0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:13.319989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a3c7282f-345f-49ea-b17d-eaef6a608a0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:13.334018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7282f-345f-49ea-b17d-eaef6a608a0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:13.336334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7282f-345f-49ea-b17d-eaef6a608a0a service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:13.348479 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3760/7558] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:30:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:30:21.142544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:23.343891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=19 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:35.845010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343c933-3548-430b-83ec-4e0f13af6d7a service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:35.846667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d343c933-3548-430b-83ec-4e0f13af6d7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:35.915149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343c933-3548-430b-83ec-4e0f13af6d7a service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:35.923809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb6e16-c9c0-4c7f-b0a2-1f11743b8b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:35.924768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb6e16-c9c0-4c7f-b0a2-1f11743b8b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:35.925056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb6e16-c9c0-4c7f-b0a2-1f11743b8b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:35.925330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb6e16-c9c0-4c7f-b0a2-1f11743b8b83 admin admin] PATH_INFO: `/v3/users/6ce0d08ad4604c3c93a9c01d037055a4` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:35.926647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb6e16-c9c0-4c7f-b0a2-1f11743b8b83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce0d08ad4604c3c93a9c01d037055a4)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:35.929026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb6e16-c9c0-4c7f-b0a2-1f11743b8b83 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:35.980744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88cb6e16-c9c0-4c7f-b0a2-1f11743b8b83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce0d08ad4604c3c93a9c01d037055a4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:35.989895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88cb6e16-c9c0-4c7f-b0a2-1f11743b8b83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce0d08ad4604c3c93a9c01d037055a4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:35.990730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88cb6e16-c9c0-4c7f-b0a2-1f11743b8b83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce0d08ad4604c3c93a9c01d037055a4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:35.991387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88cb6e16-c9c0-4c7f-b0a2-1f11743b8b83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce0d08ad4604c3c93a9c01d037055a4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:35.998804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-88cb6e16-c9c0-4c7f-b0a2-1f11743b8b83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce0d08ad4604c3c93a9c01d037055a4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:36.018913 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3799/7559] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:30:35 2022] DELETE /identity/v3/users/6ce0d08ad4604c3c93a9c01d037055a4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:36.023492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9227a2-bc39-49ae-95d3-0986587810a1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:36.024331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9227a2-bc39-49ae-95d3-0986587810a1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:36.024331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9227a2-bc39-49ae-95d3-0986587810a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:36.042443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-7c9227a2-bc39-49ae-95d3-0986587810a1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:30:36.043685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7c9227a2-bc39-49ae-95d3-0986587810a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:36.111058 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3761/7560] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:30:36.121112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb6e16-c9c0-4c7f-b0a2-1f11743b8b83 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:36.122568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-88cb6e16-c9c0-4c7f-b0a2-1f11743b8b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:36.182996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb6e16-c9c0-4c7f-b0a2-1f11743b8b83 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:36.187193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9813a35-a3fa-4285-bf7c-b01059d35294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:36.187836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9813a35-a3fa-4285-bf7c-b01059d35294 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:36.188145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9813a35-a3fa-4285-bf7c-b01059d35294 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:36.188420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9813a35-a3fa-4285-bf7c-b01059d35294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:36.198110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9813a35-a3fa-4285-bf7c-b01059d35294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:36.199559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9813a35-a3fa-4285-bf7c-b01059d35294 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:36.209549 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3800/7561] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:30:36.500506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9227a2-bc39-49ae-95d3-0986587810a1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:36.502077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7c9227a2-bc39-49ae-95d3-0986587810a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:36.514582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9227a2-bc39-49ae-95d3-0986587810a1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:36.519996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24116014-3cf7-4cd3-a904-488417d34a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:36.520906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24116014-3cf7-4cd3-a904-488417d34a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:36.521185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24116014-3cf7-4cd3-a904-488417d34a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:36.521457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24116014-3cf7-4cd3-a904-488417d34a01 admin admin] PATH_INFO: `/v3/projects/94616bb313ef45d9a87c34122c5d51b4` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:36.522759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24116014-3cf7-4cd3-a904-488417d34a01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94616bb313ef45d9a87c34122c5d51b4)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:36.524707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24116014-3cf7-4cd3-a904-488417d34a01 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:36.577455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24116014-3cf7-4cd3-a904-488417d34a01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94616bb313ef45d9a87c34122c5d51b4', 'request_id': 'req-24116014-3cf7-4cd3-a904-488417d34a01'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:36.584129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24116014-3cf7-4cd3-a904-488417d34a01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94616bb313ef45d9a87c34122c5d51b4', 'request_id': 'req-24116014-3cf7-4cd3-a904-488417d34a01'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:36.590464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24116014-3cf7-4cd3-a904-488417d34a01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94616bb313ef45d9a87c34122c5d51b4', 'request_id': 'req-24116014-3cf7-4cd3-a904-488417d34a01'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:36.603591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24116014-3cf7-4cd3-a904-488417d34a01 admin admin] The token cache is being invalidate because project 94616bb313ef45d9a87c34122c5d51b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:30:36.603874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24116014-3cf7-4cd3-a904-488417d34a01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:36.604515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24116014-3cf7-4cd3-a904-488417d34a01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:36.606070 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3762/7562] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:30:36 2022] DELETE /identity/v3/projects/94616bb313ef45d9a87c34122c5d51b4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:36.610478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9813a35-a3fa-4285-bf7c-b01059d35294 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:36.620481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9813a35-a3fa-4285-bf7c-b01059d35294 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:36.638820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:36.683888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7adf5dd-6b9d-4d03-a593-57b825dc8ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:36.684867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adf5dd-6b9d-4d03-a593-57b825dc8ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:36.685146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adf5dd-6b9d-4d03-a593-57b825dc8ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:36.685422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adf5dd-6b9d-4d03-a593-57b825dc8ca5 admin admin] PATH_INFO: `/v3/users/cbc9670d5f8742819484c1b9b80797a9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:36.686627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7adf5dd-6b9d-4d03-a593-57b825dc8ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc9670d5f8742819484c1b9b80797a9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:36.688678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7adf5dd-6b9d-4d03-a593-57b825dc8ca5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:36.739004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c7adf5dd-6b9d-4d03-a593-57b825dc8ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc9670d5f8742819484c1b9b80797a9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:36.747600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c7adf5dd-6b9d-4d03-a593-57b825dc8ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc9670d5f8742819484c1b9b80797a9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:36.748260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c7adf5dd-6b9d-4d03-a593-57b825dc8ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc9670d5f8742819484c1b9b80797a9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:36.748973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c7adf5dd-6b9d-4d03-a593-57b825dc8ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc9670d5f8742819484c1b9b80797a9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:36.756389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c7adf5dd-6b9d-4d03-a593-57b825dc8ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc9670d5f8742819484c1b9b80797a9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:36.773268 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3801/7563] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:30:36 2022] DELETE /identity/v3/users/cbc9670d5f8742819484c1b9b80797a9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:36.969326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24116014-3cf7-4cd3-a904-488417d34a01 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:36.971433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-24116014-3cf7-4cd3-a904-488417d34a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:36.985629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24116014-3cf7-4cd3-a904-488417d34a01 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:37.046542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f409051-1c87-4104-9968-7b8b3cdab716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:37.047419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f409051-1c87-4104-9968-7b8b3cdab716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:37.047686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f409051-1c87-4104-9968-7b8b3cdab716 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:37.047976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f409051-1c87-4104-9968-7b8b3cdab716 admin admin] PATH_INFO: `/v3/projects/d93d47879c2a4e07a2e66ae4379999de` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:37.049263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f409051-1c87-4104-9968-7b8b3cdab716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d93d47879c2a4e07a2e66ae4379999de)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:37.051182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f409051-1c87-4104-9968-7b8b3cdab716 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:37.089507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:37.107456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f409051-1c87-4104-9968-7b8b3cdab716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93d47879c2a4e07a2e66ae4379999de', 'request_id': 'req-3f409051-1c87-4104-9968-7b8b3cdab716'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:37.114049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f409051-1c87-4104-9968-7b8b3cdab716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93d47879c2a4e07a2e66ae4379999de', 'request_id': 'req-3f409051-1c87-4104-9968-7b8b3cdab716'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:37.120283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f409051-1c87-4104-9968-7b8b3cdab716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93d47879c2a4e07a2e66ae4379999de', 'request_id': 'req-3f409051-1c87-4104-9968-7b8b3cdab716'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:37.135640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f409051-1c87-4104-9968-7b8b3cdab716 admin admin] The token cache is being invalidate because project d93d47879c2a4e07a2e66ae4379999de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:30:37.135866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f409051-1c87-4104-9968-7b8b3cdab716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:37.136610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f409051-1c87-4104-9968-7b8b3cdab716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:37.138272 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3763/7564] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:30:36 2022] DELETE /identity/v3/projects/d93d47879c2a4e07a2e66ae4379999de => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:37.143493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16085afb-c3f4-4134-b54c-d0ccfe2e5266 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:37.143981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16085afb-c3f4-4134-b54c-d0ccfe2e5266 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:37.144113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16085afb-c3f4-4134-b54c-d0ccfe2e5266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:37.162510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-16085afb-c3f4-4134-b54c-d0ccfe2e5266 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:30:37.163740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-16085afb-c3f4-4134-b54c-d0ccfe2e5266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:37.226201 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3802/7565] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:30:37.238045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8564276-3215-46b2-8f42-a89ff0b682cf None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:37.238355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8564276-3215-46b2-8f42-a89ff0b682cf None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:37.238658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8564276-3215-46b2-8f42-a89ff0b682cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:37.258492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d8564276-3215-46b2-8f42-a89ff0b682cf None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:30:37.259696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d8564276-3215-46b2-8f42-a89ff0b682cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:37.268447 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3764/7566] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:30:37.273461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16085afb-c3f4-4134-b54c-d0ccfe2e5266 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:37.285952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16085afb-c3f4-4134-b54c-d0ccfe2e5266 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:37.294877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caacf970-6a1d-413f-a7a6-98a2f57e49df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:37.295842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caacf970-6a1d-413f-a7a6-98a2f57e49df admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:37.296238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caacf970-6a1d-413f-a7a6-98a2f57e49df admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:37.296576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caacf970-6a1d-413f-a7a6-98a2f57e49df admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:37.297640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caacf970-6a1d-413f-a7a6-98a2f57e49df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:30:37.298091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caacf970-6a1d-413f-a7a6-98a2f57e49df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:37.299890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caacf970-6a1d-413f-a7a6-98a2f57e49df admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:37.312924 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3803/7567] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:30:37.317755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8564276-3215-46b2-8f42-a89ff0b682cf None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:37.327789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8564276-3215-46b2-8f42-a89ff0b682cf None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:37.333819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95c8b0-c6ec-4776-8290-866facff9d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:37.334476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95c8b0-c6ec-4776-8290-866facff9d8a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:37.334752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95c8b0-c6ec-4776-8290-866facff9d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:37.335020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95c8b0-c6ec-4776-8290-866facff9d8a admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:37.335706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95c8b0-c6ec-4776-8290-866facff9d8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:37.337675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95c8b0-c6ec-4776-8290-866facff9d8a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:37.367836 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3765/7568] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:30:37 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:30:37.372343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caacf970-6a1d-413f-a7a6-98a2f57e49df admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:37.389261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caacf970-6a1d-413f-a7a6-98a2f57e49df admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:37.420167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:37.455516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d839ae-ba24-46c6-a601-3bf42e2436d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:37.456235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d839ae-ba24-46c6-a601-3bf42e2436d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:37.456523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d839ae-ba24-46c6-a601-3bf42e2436d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:37.456819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d839ae-ba24-46c6-a601-3bf42e2436d1 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:37.457537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d839ae-ba24-46c6-a601-3bf42e2436d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:37.459565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d839ae-ba24-46c6-a601-3bf42e2436d1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:37.482908 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3804/7569] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:30:37 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:30:37.487366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95c8b0-c6ec-4776-8290-866facff9d8a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:37.499475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95c8b0-c6ec-4776-8290-866facff9d8a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:37.504942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78611c20-ab2b-41d7-824c-d936815c0519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:37.505619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78611c20-ab2b-41d7-824c-d936815c0519 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:37.505898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78611c20-ab2b-41d7-824c-d936815c0519 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:37.506170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78611c20-ab2b-41d7-824c-d936815c0519 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:37.506903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78611c20-ab2b-41d7-824c-d936815c0519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:37.508546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78611c20-ab2b-41d7-824c-d936815c0519 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:37.519540 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3766/7570] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:30:37.523745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d839ae-ba24-46c6-a601-3bf42e2436d1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:37.534126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d839ae-ba24-46c6-a601-3bf42e2436d1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:37.539148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ad95e-848c-43b0-9021-191cca35c6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:37.539811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ad95e-848c-43b0-9021-191cca35c6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:37.540125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ad95e-848c-43b0-9021-191cca35c6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:37.540402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ad95e-848c-43b0-9021-191cca35c6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:37.541127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ad95e-848c-43b0-9021-191cca35c6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:37.542743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ad95e-848c-43b0-9021-191cca35c6f3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:37.552908 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3805/7571] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:30:37.557541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78611c20-ab2b-41d7-824c-d936815c0519 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:37.568189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78611c20-ab2b-41d7-824c-d936815c0519 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:37.574099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb981b-2705-4b5a-968d-6c594ec2d453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:37.574973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb981b-2705-4b5a-968d-6c594ec2d453 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:37.575261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb981b-2705-4b5a-968d-6c594ec2d453 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:37.575545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb981b-2705-4b5a-968d-6c594ec2d453 admin admin] PATH_INFO: `/v3/projects/216b3a5d86dc4f29a30e518ebed0b81e/users/d474b70336d34e77a6849ce12643fdbc/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:37.591836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb981b-2705-4b5a-968d-6c594ec2d453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216b3a5d86dc4f29a30e518ebed0b81e, user_id=d474b70336d34e77a6849ce12643fdbc, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:37.594570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb981b-2705-4b5a-968d-6c594ec2d453 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:37.610015 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3767/7572] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:30:37 2022] PUT /identity/v3/projects/216b3a5d86dc4f29a30e518ebed0b81e/users/d474b70336d34e77a6849ce12643fdbc/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:37.622549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36634f90-29a0-4551-b1b8-3b35752b42fc None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:37.622936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36634f90-29a0-4551-b1b8-3b35752b42fc None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:37.623331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36634f90-29a0-4551-b1b8-3b35752b42fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:37.651209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-36634f90-29a0-4551-b1b8-3b35752b42fc None None] MFA Rules not processed for user `d474b70336d34e77a6849ce12643fdbc`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:30:37.652382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-36634f90-29a0-4551-b1b8-3b35752b42fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:37.718404 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3806/7573] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:30:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:30:37.723342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb981b-2705-4b5a-968d-6c594ec2d453 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:37.787419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb981b-2705-4b5a-968d-6c594ec2d453 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:37.793283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d2df7-0472-42c7-a5be-6e9b0770edde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:37.794258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d2df7-0472-42c7-a5be-6e9b0770edde admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:37.794667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d2df7-0472-42c7-a5be-6e9b0770edde admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:37.795063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d2df7-0472-42c7-a5be-6e9b0770edde admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:37.796119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d2df7-0472-42c7-a5be-6e9b0770edde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:37.799891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d2df7-0472-42c7-a5be-6e9b0770edde admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:37.829387 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3768/7574] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:30:37 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:30:37.833673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36634f90-29a0-4551-b1b8-3b35752b42fc None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:37.847277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36634f90-29a0-4551-b1b8-3b35752b42fc None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:37.915842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6530679-66ea-4280-9fdb-4c8f839eec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:37.916562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6530679-66ea-4280-9fdb-4c8f839eec3a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:37.916839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6530679-66ea-4280-9fdb-4c8f839eec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:37.917117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6530679-66ea-4280-9fdb-4c8f839eec3a admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:37.917785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6530679-66ea-4280-9fdb-4c8f839eec3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:37.919714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6530679-66ea-4280-9fdb-4c8f839eec3a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:37.943243 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3807/7575] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:30:37 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:30:37.947327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d2df7-0472-42c7-a5be-6e9b0770edde admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:37.958419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d2df7-0472-42c7-a5be-6e9b0770edde admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:37.964348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f3b9c-d944-4251-a3ac-67e6b4783891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:37.965026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f3b9c-d944-4251-a3ac-67e6b4783891 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:37.965307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f3b9c-d944-4251-a3ac-67e6b4783891 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:37.965582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f3b9c-d944-4251-a3ac-67e6b4783891 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:37.966303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f3b9c-d944-4251-a3ac-67e6b4783891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:37.967934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f3b9c-d944-4251-a3ac-67e6b4783891 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:37.980669 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3769/7576] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:30:37.985107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6530679-66ea-4280-9fdb-4c8f839eec3a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:37.995724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6530679-66ea-4280-9fdb-4c8f839eec3a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:38.000701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35f612-6863-4912-a8bd-3b865b50eaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:38.001590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35f612-6863-4912-a8bd-3b865b50eaec admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:38.001878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35f612-6863-4912-a8bd-3b865b50eaec admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:38.002150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35f612-6863-4912-a8bd-3b865b50eaec admin admin] PATH_INFO: `/v3/projects/1614cdf0a995450c8fbaa52de5a274e9/users/75501f447bfa493ba011a7ff5c6dcb56/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:38.016986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35f612-6863-4912-a8bd-3b865b50eaec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1614cdf0a995450c8fbaa52de5a274e9, user_id=75501f447bfa493ba011a7ff5c6dcb56, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:38.019774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35f612-6863-4912-a8bd-3b865b50eaec admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:38.034180 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3808/7577] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:30:37 2022] PUT /identity/v3/projects/1614cdf0a995450c8fbaa52de5a274e9/users/75501f447bfa493ba011a7ff5c6dcb56/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:38.038365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f3b9c-d944-4251-a3ac-67e6b4783891 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:38.049338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f3b9c-d944-4251-a3ac-67e6b4783891 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:38.070027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:38.114702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0407ca4-f9fa-4cca-9037-6b1cda793d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:38.115376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0407ca4-f9fa-4cca-9037-6b1cda793d5a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:38.115658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0407ca4-f9fa-4cca-9037-6b1cda793d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:38.115933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0407ca4-f9fa-4cca-9037-6b1cda793d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:38.116807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0407ca4-f9fa-4cca-9037-6b1cda793d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:38.118476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0407ca4-f9fa-4cca-9037-6b1cda793d5a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:38.130947 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3770/7578] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:30:38.133081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35f612-6863-4912-a8bd-3b865b50eaec admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:38.138806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:38.145371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35f612-6863-4912-a8bd-3b865b50eaec admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:38.150515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0de60-3a39-40a6-89fd-be3f414b07ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:38.151400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0de60-3a39-40a6-89fd-be3f414b07ac admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:38.151677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0de60-3a39-40a6-89fd-be3f414b07ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:38.151953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0de60-3a39-40a6-89fd-be3f414b07ac admin admin] PATH_INFO: `/v3/projects/1614cdf0a995450c8fbaa52de5a274e9/users/75501f447bfa493ba011a7ff5c6dcb56/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:38.154069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0de60-3a39-40a6-89fd-be3f414b07ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1614cdf0a995450c8fbaa52de5a274e9, user_id=75501f447bfa493ba011a7ff5c6dcb56, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:38.157035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0de60-3a39-40a6-89fd-be3f414b07ac admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:38.167761 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3809/7579] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:30:38 2022] PUT /identity/v3/projects/1614cdf0a995450c8fbaa52de5a274e9/users/75501f447bfa493ba011a7ff5c6dcb56/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:38.178335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ab408-28e1-4540-847c-1af042c31016 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:38.179005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ab408-28e1-4540-847c-1af042c31016 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:38.179278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ab408-28e1-4540-847c-1af042c31016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:38.206214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-577ab408-28e1-4540-847c-1af042c31016 None None] MFA Rules not processed for user `75501f447bfa493ba011a7ff5c6dcb56`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:30:38.207451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-577ab408-28e1-4540-847c-1af042c31016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:38.287140 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3771/7580] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:30:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:30:38.297421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0de60-3a39-40a6-89fd-be3f414b07ac admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:38.299432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cec0de60-3a39-40a6-89fd-be3f414b07ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:38.366924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0de60-3a39-40a6-89fd-be3f414b07ac admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:38.371178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac07fd1-2a85-4e54-a6f8-ca4126d5e344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:38.371830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac07fd1-2a85-4e54-a6f8-ca4126d5e344 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:38.372178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac07fd1-2a85-4e54-a6f8-ca4126d5e344 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:38.372461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac07fd1-2a85-4e54-a6f8-ca4126d5e344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:38.382404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac07fd1-2a85-4e54-a6f8-ca4126d5e344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:38.383902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac07fd1-2a85-4e54-a6f8-ca4126d5e344 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:38.393895 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3810/7581] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:30:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:30:40.162416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ab408-28e1-4540-847c-1af042c31016 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:40.175994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ab408-28e1-4540-847c-1af042c31016 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:40.180920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409eb5d-a457-41f9-939b-a96499f4015f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:40.181576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409eb5d-a457-41f9-939b-a96499f4015f service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:40.181864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409eb5d-a457-41f9-939b-a96499f4015f service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:40.182126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409eb5d-a457-41f9-939b-a96499f4015f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:40.243314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409eb5d-a457-41f9-939b-a96499f4015f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:40.244894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409eb5d-a457-41f9-939b-a96499f4015f service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:40.254274 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3772/7582] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:30:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:30:41.011637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac07fd1-2a85-4e54-a6f8-ca4126d5e344 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:41.086664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac07fd1-2a85-4e54-a6f8-ca4126d5e344 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:41.092856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6b69a-2d06-4d71-8eb5-84f49800decb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:41.093749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6b69a-2d06-4d71-8eb5-84f49800decb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:41.094035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6b69a-2d06-4d71-8eb5-84f49800decb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:41.094314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6b69a-2d06-4d71-8eb5-84f49800decb admin admin] PATH_INFO: `/v3/users/d474b70336d34e77a6849ce12643fdbc` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:41.095572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6b69a-2d06-4d71-8eb5-84f49800decb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d474b70336d34e77a6849ce12643fdbc)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:41.097539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6b69a-2d06-4d71-8eb5-84f49800decb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:41.146824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9cb6b69a-2d06-4d71-8eb5-84f49800decb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd474b70336d34e77a6849ce12643fdbc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:41.154663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9cb6b69a-2d06-4d71-8eb5-84f49800decb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd474b70336d34e77a6849ce12643fdbc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:41.155295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9cb6b69a-2d06-4d71-8eb5-84f49800decb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd474b70336d34e77a6849ce12643fdbc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:41.155887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9cb6b69a-2d06-4d71-8eb5-84f49800decb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd474b70336d34e77a6849ce12643fdbc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:41.162777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9cb6b69a-2d06-4d71-8eb5-84f49800decb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd474b70336d34e77a6849ce12643fdbc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:41.179889 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3811/7583] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:30:41 2022] DELETE /identity/v3/users/d474b70336d34e77a6849ce12643fdbc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:41.184670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd17afc-a9f3-4e7c-8061-16ba3d1ea8cf None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:41.185197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd17afc-a9f3-4e7c-8061-16ba3d1ea8cf None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:41.185197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd17afc-a9f3-4e7c-8061-16ba3d1ea8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:41.203184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-cfd17afc-a9f3-4e7c-8061-16ba3d1ea8cf None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:30:41.204356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cfd17afc-a9f3-4e7c-8061-16ba3d1ea8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:41.249956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:41.275608 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3773/7584] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:30:41.292339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6b69a-2d06-4d71-8eb5-84f49800decb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:41.293890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9cb6b69a-2d06-4d71-8eb5-84f49800decb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:41.309141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:41.364883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6b69a-2d06-4d71-8eb5-84f49800decb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:41.368876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e601b4-7c65-4769-8eb8-69895eaedfe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:41.369745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e601b4-7c65-4769-8eb8-69895eaedfe7 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:41.370099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e601b4-7c65-4769-8eb8-69895eaedfe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:41.370445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e601b4-7c65-4769-8eb8-69895eaedfe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:41.380659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e601b4-7c65-4769-8eb8-69895eaedfe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:41.382128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e601b4-7c65-4769-8eb8-69895eaedfe7 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:41.391698 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3812/7585] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:30:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:30:41.682841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd17afc-a9f3-4e7c-8061-16ba3d1ea8cf None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:41.684324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cfd17afc-a9f3-4e7c-8061-16ba3d1ea8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:41.697268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd17afc-a9f3-4e7c-8061-16ba3d1ea8cf None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:41.702644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79f07b-9714-473a-b059-5156bcdb78e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:41.703532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79f07b-9714-473a-b059-5156bcdb78e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:41.703811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79f07b-9714-473a-b059-5156bcdb78e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:41.704113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79f07b-9714-473a-b059-5156bcdb78e8 admin admin] PATH_INFO: `/v3/projects/216b3a5d86dc4f29a30e518ebed0b81e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:41.705405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79f07b-9714-473a-b059-5156bcdb78e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=216b3a5d86dc4f29a30e518ebed0b81e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:41.707380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79f07b-9714-473a-b059-5156bcdb78e8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:41.757538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc79f07b-9714-473a-b059-5156bcdb78e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216b3a5d86dc4f29a30e518ebed0b81e', 'request_id': 'req-fc79f07b-9714-473a-b059-5156bcdb78e8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:41.763912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc79f07b-9714-473a-b059-5156bcdb78e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216b3a5d86dc4f29a30e518ebed0b81e', 'request_id': 'req-fc79f07b-9714-473a-b059-5156bcdb78e8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:41.772168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc79f07b-9714-473a-b059-5156bcdb78e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216b3a5d86dc4f29a30e518ebed0b81e', 'request_id': 'req-fc79f07b-9714-473a-b059-5156bcdb78e8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:41.788141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc79f07b-9714-473a-b059-5156bcdb78e8 admin admin] The token cache is being invalidate because project 216b3a5d86dc4f29a30e518ebed0b81e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:30:41.788452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc79f07b-9714-473a-b059-5156bcdb78e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:41.789147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fc79f07b-9714-473a-b059-5156bcdb78e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:41.790884 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3774/7586] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:30:41 2022] DELETE /identity/v3/projects/216b3a5d86dc4f29a30e518ebed0b81e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:41.795047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e601b4-7c65-4769-8eb8-69895eaedfe7 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:41.805659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e601b4-7c65-4769-8eb8-69895eaedfe7 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:41.862581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2e5fb-e323-4cbc-bf3e-751b44790598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:41.863464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2e5fb-e323-4cbc-bf3e-751b44790598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:41.863748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2e5fb-e323-4cbc-bf3e-751b44790598 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:41.864027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2e5fb-e323-4cbc-bf3e-751b44790598 admin admin] PATH_INFO: `/v3/users/75501f447bfa493ba011a7ff5c6dcb56` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:41.865292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2e5fb-e323-4cbc-bf3e-751b44790598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75501f447bfa493ba011a7ff5c6dcb56)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:41.867233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2e5fb-e323-4cbc-bf3e-751b44790598 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:41.914869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-22e2e5fb-e323-4cbc-bf3e-751b44790598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75501f447bfa493ba011a7ff5c6dcb56'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:41.922704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-22e2e5fb-e323-4cbc-bf3e-751b44790598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75501f447bfa493ba011a7ff5c6dcb56'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:41.923359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-22e2e5fb-e323-4cbc-bf3e-751b44790598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75501f447bfa493ba011a7ff5c6dcb56'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:41.924057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-22e2e5fb-e323-4cbc-bf3e-751b44790598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75501f447bfa493ba011a7ff5c6dcb56'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:41.931361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-22e2e5fb-e323-4cbc-bf3e-751b44790598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75501f447bfa493ba011a7ff5c6dcb56'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:41.948928 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3813/7587] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:30:41 2022] DELETE /identity/v3/users/75501f447bfa493ba011a7ff5c6dcb56 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:42.223535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79f07b-9714-473a-b059-5156bcdb78e8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:42.225409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fc79f07b-9714-473a-b059-5156bcdb78e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:42.239805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79f07b-9714-473a-b059-5156bcdb78e8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:42.302197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d779ee9-2f32-408c-883c-8eff5a40e018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:42.303169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d779ee9-2f32-408c-883c-8eff5a40e018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:42.303881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d779ee9-2f32-408c-883c-8eff5a40e018 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:42.304265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d779ee9-2f32-408c-883c-8eff5a40e018 admin admin] PATH_INFO: `/v3/projects/1614cdf0a995450c8fbaa52de5a274e9` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:42.305531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d779ee9-2f32-408c-883c-8eff5a40e018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1614cdf0a995450c8fbaa52de5a274e9)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:42.307452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d779ee9-2f32-408c-883c-8eff5a40e018 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:42.356252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2d779ee9-2f32-408c-883c-8eff5a40e018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1614cdf0a995450c8fbaa52de5a274e9', 'request_id': 'req-2d779ee9-2f32-408c-883c-8eff5a40e018'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:42.362628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2d779ee9-2f32-408c-883c-8eff5a40e018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1614cdf0a995450c8fbaa52de5a274e9', 'request_id': 'req-2d779ee9-2f32-408c-883c-8eff5a40e018'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:42.368463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2d779ee9-2f32-408c-883c-8eff5a40e018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1614cdf0a995450c8fbaa52de5a274e9', 'request_id': 'req-2d779ee9-2f32-408c-883c-8eff5a40e018'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:42.378676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:42.383878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2d779ee9-2f32-408c-883c-8eff5a40e018 admin admin] The token cache is being invalidate because project 1614cdf0a995450c8fbaa52de5a274e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:30:42.384249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2d779ee9-2f32-408c-883c-8eff5a40e018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:42.385538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2d779ee9-2f32-408c-883c-8eff5a40e018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:30:42.387205 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3775/7588] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:30:42 2022] DELETE /identity/v3/projects/1614cdf0a995450c8fbaa52de5a274e9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:30:42.392457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53354de0-007f-4de4-b423-d3e0788207a3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:42.392949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53354de0-007f-4de4-b423-d3e0788207a3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:42.393056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53354de0-007f-4de4-b423-d3e0788207a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:42.411682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-53354de0-007f-4de4-b423-d3e0788207a3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:30:42.412988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-53354de0-007f-4de4-b423-d3e0788207a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:42.445122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:42.476220 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3814/7589] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:30:42.484413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c1848-3b62-48ce-b54c-64a4376d7715 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:42.484708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c1848-3b62-48ce-b54c-64a4376d7715 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:42.484995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c1848-3b62-48ce-b54c-64a4376d7715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:42.504424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8e6c1848-3b62-48ce-b54c-64a4376d7715 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:30:42.506305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8e6c1848-3b62-48ce-b54c-64a4376d7715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:42.515053 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3776/7590] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:30:42.519726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53354de0-007f-4de4-b423-d3e0788207a3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:42.530505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53354de0-007f-4de4-b423-d3e0788207a3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:42.535316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615893f4-0bbd-4bee-96b5-6de0fd49d37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:42.535970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615893f4-0bbd-4bee-96b5-6de0fd49d37c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:42.536279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615893f4-0bbd-4bee-96b5-6de0fd49d37c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:42.536548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615893f4-0bbd-4bee-96b5-6de0fd49d37c admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:42.537267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615893f4-0bbd-4bee-96b5-6de0fd49d37c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:30:42.537569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615893f4-0bbd-4bee-96b5-6de0fd49d37c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:42.539166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615893f4-0bbd-4bee-96b5-6de0fd49d37c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:42.550977 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3815/7591] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:30:42.555845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c1848-3b62-48ce-b54c-64a4376d7715 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:42.565641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c1848-3b62-48ce-b54c-64a4376d7715 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:42.570633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7873a-6b1a-4663-8e00-b1f4dd292d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:42.571278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7873a-6b1a-4663-8e00-b1f4dd292d81 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:42.571559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7873a-6b1a-4663-8e00-b1f4dd292d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:42.571841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7873a-6b1a-4663-8e00-b1f4dd292d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:42.572559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7873a-6b1a-4663-8e00-b1f4dd292d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:42.574463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7873a-6b1a-4663-8e00-b1f4dd292d81 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:42.602884 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3777/7592] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:30:42 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:30:42.607069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615893f4-0bbd-4bee-96b5-6de0fd49d37c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:42.617711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615893f4-0bbd-4bee-96b5-6de0fd49d37c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:42.679249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a87eb-75c6-45d5-9369-fdfba018b3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:42.680067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a87eb-75c6-45d5-9369-fdfba018b3ce admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:42.680377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a87eb-75c6-45d5-9369-fdfba018b3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:42.680720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a87eb-75c6-45d5-9369-fdfba018b3ce admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:42.681419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a87eb-75c6-45d5-9369-fdfba018b3ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:42.683569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a87eb-75c6-45d5-9369-fdfba018b3ce admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:42.705220 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3816/7593] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:30:42 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:30:42.709341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7873a-6b1a-4663-8e00-b1f4dd292d81 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:42.719802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7873a-6b1a-4663-8e00-b1f4dd292d81 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:42.724494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213ee4f-0e64-425a-89b5-ca98154010c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:42.725152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213ee4f-0e64-425a-89b5-ca98154010c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:42.725443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213ee4f-0e64-425a-89b5-ca98154010c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:42.725706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213ee4f-0e64-425a-89b5-ca98154010c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:42.726445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213ee4f-0e64-425a-89b5-ca98154010c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:42.728063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213ee4f-0e64-425a-89b5-ca98154010c7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:42.738989 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3778/7594] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:30:42.743332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a87eb-75c6-45d5-9369-fdfba018b3ce admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:42.755110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a87eb-75c6-45d5-9369-fdfba018b3ce admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:42.762344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3ff1d-c6c3-4ece-831b-44eb37428ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:42.763017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3ff1d-c6c3-4ece-831b-44eb37428ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:42.763294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3ff1d-c6c3-4ece-831b-44eb37428ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:42.763567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3ff1d-c6c3-4ece-831b-44eb37428ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:42.764301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3ff1d-c6c3-4ece-831b-44eb37428ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:42.765924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3ff1d-c6c3-4ece-831b-44eb37428ed0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:42.776929 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3817/7595] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:30:42.781307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213ee4f-0e64-425a-89b5-ca98154010c7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:42.791837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213ee4f-0e64-425a-89b5-ca98154010c7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:42.797417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85102fd1-c154-4649-b379-6f409ca2f296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:42.798411 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85102fd1-c154-4649-b379-6f409ca2f296 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:42.798744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85102fd1-c154-4649-b379-6f409ca2f296 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:42.799013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85102fd1-c154-4649-b379-6f409ca2f296 admin admin] PATH_INFO: `/v3/projects/c32171f444aa410bb8bb4ee3ae7446cd/users/a1e229727a8e4caea9a4b85b877de1f4/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:42.814546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85102fd1-c154-4649-b379-6f409ca2f296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c32171f444aa410bb8bb4ee3ae7446cd, user_id=a1e229727a8e4caea9a4b85b877de1f4, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:42.817396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85102fd1-c154-4649-b379-6f409ca2f296 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:42.832266 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3779/7596] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:30:42 2022] PUT /identity/v3/projects/c32171f444aa410bb8bb4ee3ae7446cd/users/a1e229727a8e4caea9a4b85b877de1f4/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:30:42.843645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc48296-7346-4ba1-8909-9e1885724d1f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:42.843936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc48296-7346-4ba1-8909-9e1885724d1f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:42.844258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc48296-7346-4ba1-8909-9e1885724d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:42.870382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-5fc48296-7346-4ba1-8909-9e1885724d1f None None] MFA Rules not processed for user `a1e229727a8e4caea9a4b85b877de1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:30:42.871587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5fc48296-7346-4ba1-8909-9e1885724d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:42.937317 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3818/7597] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:30:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:30:42.948527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85102fd1-c154-4649-b379-6f409ca2f296 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:42.950629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-85102fd1-c154-4649-b379-6f409ca2f296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:43.014147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85102fd1-c154-4649-b379-6f409ca2f296 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:43.018531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b0287-785d-4ce6-9ca4-c567d324cb7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:43.019170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b0287-785d-4ce6-9ca4-c567d324cb7a service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:43.019446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b0287-785d-4ce6-9ca4-c567d324cb7a service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:43.019714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b0287-785d-4ce6-9ca4-c567d324cb7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:43.029045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b0287-785d-4ce6-9ca4-c567d324cb7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:43.031206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b0287-785d-4ce6-9ca4-c567d324cb7a service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:43.041566 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3780/7598] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:30:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:30:52.934418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:53.037989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:55.752607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc48296-7346-4ba1-8909-9e1885724d1f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:55.754742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5fc48296-7346-4ba1-8909-9e1885724d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:55.955788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc48296-7346-4ba1-8909-9e1885724d1f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:55.970595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058e80a-7f99-4b30-b3ae-654c18f9b01d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:55.971229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058e80a-7f99-4b30-b3ae-654c18f9b01d service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:55.971516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058e80a-7f99-4b30-b3ae-654c18f9b01d service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:55.971800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058e80a-7f99-4b30-b3ae-654c18f9b01d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:55.973695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d058e80a-7f99-4b30-b3ae-654c18f9b01d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:55.987845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058e80a-7f99-4b30-b3ae-654c18f9b01d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:55.989615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058e80a-7f99-4b30-b3ae-654c18f9b01d service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:56.005035 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3819/7599] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:30:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:30:57.378740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b0287-785d-4ce6-9ca4-c567d324cb7a service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:30:57.380369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1b2b0287-785d-4ce6-9ca4-c567d324cb7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:57.481150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b0287-785d-4ce6-9ca4-c567d324cb7a service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:30:57.485444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8522dab-a4a1-4909-8fd6-fb92161733c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:30:57.489112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8522dab-a4a1-4909-8fd6-fb92161733c4 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:30:57.489415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8522dab-a4a1-4909-8fd6-fb92161733c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:30:57.489673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8522dab-a4a1-4909-8fd6-fb92161733c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:30:57.496147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e8522dab-a4a1-4909-8fd6-fb92161733c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:30:57.605594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8522dab-a4a1-4909-8fd6-fb92161733c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:30:57.607514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8522dab-a4a1-4909-8fd6-fb92161733c4 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:30:57.620245 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3781/7600] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:30:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:03.495855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36613e30-5fa4-411e-901c-e58bccd7b822 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:03.496535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36613e30-5fa4-411e-901c-e58bccd7b822 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:03.496535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36613e30-5fa4-411e-901c-e58bccd7b822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:03.519643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-36613e30-5fa4-411e-901c-e58bccd7b822 None None] MFA Rules not processed for user `317a63cdd16b4fd69617fb9de95dc4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:03.521225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-36613e30-5fa4-411e-901c-e58bccd7b822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:03.625452 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3820/7601] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:31:03.693070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8522dab-a4a1-4909-8fd6-fb92161733c4 service cinder] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:03.695239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e8522dab-a4a1-4909-8fd6-fb92161733c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:03.786415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8522dab-a4a1-4909-8fd6-fb92161733c4 service cinder] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:03.791991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dcf74-23ab-4525-9715-f6e4c11ae179 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:03.792724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dcf74-23ab-4525-9715-f6e4c11ae179 service glance] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:03.793013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dcf74-23ab-4525-9715-f6e4c11ae179 service glance] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:03.793925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dcf74-23ab-4525-9715-f6e4c11ae179 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:03.795816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-905dcf74-23ab-4525-9715-f6e4c11ae179 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:03.861915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:03.948011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905dcf74-23ab-4525-9715-f6e4c11ae179 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:03.950230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905dcf74-23ab-4525-9715-f6e4c11ae179 service glance] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:03.970954 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3782/7602] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:05.298248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36613e30-5fa4-411e-901c-e58bccd7b822 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:05.389831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:05.425269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36613e30-5fa4-411e-901c-e58bccd7b822 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:05.434735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ce8b6-76bf-46dc-8d47-4205ae837ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:05.434735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ce8b6-76bf-46dc-8d47-4205ae837ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:05.434735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ce8b6-76bf-46dc-8d47-4205ae837ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:05.435022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ce8b6-76bf-46dc-8d47-4205ae837ed8 admin admin] PATH_INFO: `/v3/users/a1e229727a8e4caea9a4b85b877de1f4` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:05.436900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ce8b6-76bf-46dc-8d47-4205ae837ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1e229727a8e4caea9a4b85b877de1f4)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:05.440404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ce8b6-76bf-46dc-8d47-4205ae837ed8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:05.477473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dcf74-23ab-4525-9715-f6e4c11ae179 service glance] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:05.489140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dcf74-23ab-4525-9715-f6e4c11ae179 service glance] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:05.498935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7501e3-27b1-4534-bd74-7a4e3ae7595a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:05.499713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7501e3-27b1-4534-bd74-7a4e3ae7595a service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:05.499888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7501e3-27b1-4534-bd74-7a4e3ae7595a service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:05.500176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7501e3-27b1-4534-bd74-7a4e3ae7595a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:05.503357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0c7501e3-27b1-4534-bd74-7a4e3ae7595a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:05.521484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7501e3-27b1-4534-bd74-7a4e3ae7595a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:05.523058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7501e3-27b1-4534-bd74-7a4e3ae7595a service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:05.531260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a58ce8b6-76bf-46dc-8d47-4205ae837ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e229727a8e4caea9a4b85b877de1f4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:05.541711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a58ce8b6-76bf-46dc-8d47-4205ae837ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e229727a8e4caea9a4b85b877de1f4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:05.542476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a58ce8b6-76bf-46dc-8d47-4205ae837ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e229727a8e4caea9a4b85b877de1f4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:05.544543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a58ce8b6-76bf-46dc-8d47-4205ae837ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e229727a8e4caea9a4b85b877de1f4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:05.545864 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3783/7603] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:31:05.555927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a58ce8b6-76bf-46dc-8d47-4205ae837ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e229727a8e4caea9a4b85b877de1f4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:05.584552 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3821/7604] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:31:05 2022] DELETE /identity/v3/users/a1e229727a8e4caea9a4b85b877de1f4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:05.589514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169e668-52bd-4a08-bac3-e0a0d863d42e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:05.590278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169e668-52bd-4a08-bac3-e0a0d863d42e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:05.591195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169e668-52bd-4a08-bac3-e0a0d863d42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:05.656412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b169e668-52bd-4a08-bac3-e0a0d863d42e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:05.657991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b169e668-52bd-4a08-bac3-e0a0d863d42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:05.747500 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3784/7605] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:31:05.754739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ce8b6-76bf-46dc-8d47-4205ae837ed8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:05.756323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a58ce8b6-76bf-46dc-8d47-4205ae837ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:05.842651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ce8b6-76bf-46dc-8d47-4205ae837ed8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:05.846630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ded969-6f7d-4355-8aa8-4d867e730272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:05.846940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ded969-6f7d-4355-8aa8-4d867e730272 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:05.847222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ded969-6f7d-4355-8aa8-4d867e730272 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:05.847494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ded969-6f7d-4355-8aa8-4d867e730272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:05.857648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ded969-6f7d-4355-8aa8-4d867e730272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:05.860257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ded969-6f7d-4355-8aa8-4d867e730272 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:05.870766 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3822/7606] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:06.082351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169e668-52bd-4a08-bac3-e0a0d863d42e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:06.084093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b169e668-52bd-4a08-bac3-e0a0d863d42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:06.100089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169e668-52bd-4a08-bac3-e0a0d863d42e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:06.105768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35145e-b1bb-4abe-a14f-6a64e3f67500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:06.106674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35145e-b1bb-4abe-a14f-6a64e3f67500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:06.106963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35145e-b1bb-4abe-a14f-6a64e3f67500 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:06.107242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35145e-b1bb-4abe-a14f-6a64e3f67500 admin admin] PATH_INFO: `/v3/projects/c32171f444aa410bb8bb4ee3ae7446cd` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:06.108612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35145e-b1bb-4abe-a14f-6a64e3f67500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c32171f444aa410bb8bb4ee3ae7446cd)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:06.111420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35145e-b1bb-4abe-a14f-6a64e3f67500 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:06.166358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-be35145e-b1bb-4abe-a14f-6a64e3f67500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c32171f444aa410bb8bb4ee3ae7446cd', 'request_id': 'req-be35145e-b1bb-4abe-a14f-6a64e3f67500'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:06.173709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-be35145e-b1bb-4abe-a14f-6a64e3f67500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c32171f444aa410bb8bb4ee3ae7446cd', 'request_id': 'req-be35145e-b1bb-4abe-a14f-6a64e3f67500'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:06.181332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-be35145e-b1bb-4abe-a14f-6a64e3f67500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c32171f444aa410bb8bb4ee3ae7446cd', 'request_id': 'req-be35145e-b1bb-4abe-a14f-6a64e3f67500'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:06.197537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-be35145e-b1bb-4abe-a14f-6a64e3f67500 admin admin] The token cache is being invalidate because project c32171f444aa410bb8bb4ee3ae7446cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:31:06.198246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:06.198732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-be35145e-b1bb-4abe-a14f-6a64e3f67500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:06.199658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-be35145e-b1bb-4abe-a14f-6a64e3f67500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:06.201434 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3785/7607] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:31:06 2022] DELETE /identity/v3/projects/c32171f444aa410bb8bb4ee3ae7446cd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:06.206589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c112203-c36d-4a18-b42d-2a637429f225 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:06.206890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c112203-c36d-4a18-b42d-2a637429f225 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:06.207280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c112203-c36d-4a18-b42d-2a637429f225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:06.264675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8c112203-c36d-4a18-b42d-2a637429f225 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:06.266327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8c112203-c36d-4a18-b42d-2a637429f225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:06.300389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:06.335290 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3823/7608] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:06.343129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e63cdf-744d-4ee2-bb69-84bae4678b25 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:06.343421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e63cdf-744d-4ee2-bb69-84bae4678b25 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:06.343705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e63cdf-744d-4ee2-bb69-84bae4678b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:06.363056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-17e63cdf-744d-4ee2-bb69-84bae4678b25 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:06.364363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-17e63cdf-744d-4ee2-bb69-84bae4678b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:06.372822 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3786/7609] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:31:06.377396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c112203-c36d-4a18-b42d-2a637429f225 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:06.388242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c112203-c36d-4a18-b42d-2a637429f225 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:06.393041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdce77-ab6c-4322-b0f1-68bf843a8ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:06.393724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdce77-ab6c-4322-b0f1-68bf843a8ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:06.394001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdce77-ab6c-4322-b0f1-68bf843a8ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:06.394416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdce77-ab6c-4322-b0f1-68bf843a8ab3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:06.395155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdce77-ab6c-4322-b0f1-68bf843a8ab3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:31:06.395603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdce77-ab6c-4322-b0f1-68bf843a8ab3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:06.397222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdce77-ab6c-4322-b0f1-68bf843a8ab3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:06.410481 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3824/7610] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:31:06.415162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e63cdf-744d-4ee2-bb69-84bae4678b25 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:06.425249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e63cdf-744d-4ee2-bb69-84bae4678b25 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:06.430414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fe79c-a686-4fba-af1f-d60e71e33e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:06.431081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fe79c-a686-4fba-af1f-d60e71e33e68 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:06.431365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fe79c-a686-4fba-af1f-d60e71e33e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:06.431649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fe79c-a686-4fba-af1f-d60e71e33e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:06.432399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fe79c-a686-4fba-af1f-d60e71e33e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:06.434320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fe79c-a686-4fba-af1f-d60e71e33e68 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:06.466025 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3787/7611] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:31:06 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:31:06.467277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdce77-ab6c-4322-b0f1-68bf843a8ab3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:06.479265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdce77-ab6c-4322-b0f1-68bf843a8ab3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:06.553210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04f639-8133-4951-9b7f-150d2a225b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:06.554298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04f639-8133-4951-9b7f-150d2a225b91 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:06.554666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04f639-8133-4951-9b7f-150d2a225b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:06.555019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04f639-8133-4951-9b7f-150d2a225b91 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:06.560765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04f639-8133-4951-9b7f-150d2a225b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:06.563062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04f639-8133-4951-9b7f-150d2a225b91 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:06.588162 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3825/7612] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:31:06 2022] POST /identity/v3/users => generated 285 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:31:06.591918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fe79c-a686-4fba-af1f-d60e71e33e68 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:06.603346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fe79c-a686-4fba-af1f-d60e71e33e68 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:06.609743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf5bd5-6f29-4644-9d53-28745e243192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:06.609743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf5bd5-6f29-4644-9d53-28745e243192 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:06.609743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf5bd5-6f29-4644-9d53-28745e243192 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:06.612180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf5bd5-6f29-4644-9d53-28745e243192 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:06.613313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf5bd5-6f29-4644-9d53-28745e243192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:06.616311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf5bd5-6f29-4644-9d53-28745e243192 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:06.634116 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3788/7613] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:31:06.638040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04f639-8133-4951-9b7f-150d2a225b91 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:06.654249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04f639-8133-4951-9b7f-150d2a225b91 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:06.661961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2097bb-fd49-4dfc-8179-b27bfa8f548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:06.662651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2097bb-fd49-4dfc-8179-b27bfa8f548e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:06.662938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2097bb-fd49-4dfc-8179-b27bfa8f548e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:06.663218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2097bb-fd49-4dfc-8179-b27bfa8f548e admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:06.664106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2097bb-fd49-4dfc-8179-b27bfa8f548e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:06.665909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2097bb-fd49-4dfc-8179-b27bfa8f548e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:06.681074 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3826/7614] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:31:06.685052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf5bd5-6f29-4644-9d53-28745e243192 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:06.708778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf5bd5-6f29-4644-9d53-28745e243192 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:06.714855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ed900-53ea-405d-986e-e1e488d623e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:06.715193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ed900-53ea-405d-986e-e1e488d623e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:06.715461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ed900-53ea-405d-986e-e1e488d623e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:06.715737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ed900-53ea-405d-986e-e1e488d623e4 admin admin] PATH_INFO: `/v3/projects/e39127b834aa464b8d98462e24bb5dca/users/2672e346bb3c4b069af80782f2058ab1/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:06.736633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ed900-53ea-405d-986e-e1e488d623e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39127b834aa464b8d98462e24bb5dca, user_id=2672e346bb3c4b069af80782f2058ab1, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:06.739386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ed900-53ea-405d-986e-e1e488d623e4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:06.762859 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3789/7615] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:31:06 2022] PUT /identity/v3/projects/e39127b834aa464b8d98462e24bb5dca/users/2672e346bb3c4b069af80782f2058ab1/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:06.773984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bf6b6-7ef1-4616-ab52-fce2d6e76551 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:06.774283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bf6b6-7ef1-4616-ab52-fce2d6e76551 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:06.774563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bf6b6-7ef1-4616-ab52-fce2d6e76551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:06.820288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-177bf6b6-7ef1-4616-ab52-fce2d6e76551 None None] MFA Rules not processed for user `2672e346bb3c4b069af80782f2058ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:06.821674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-177bf6b6-7ef1-4616-ab52-fce2d6e76551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:06.908826 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3827/7616] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:06.915714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ed900-53ea-405d-986e-e1e488d623e4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:06.917914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ba8ed900-53ea-405d-986e-e1e488d623e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:07.000748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ed900-53ea-405d-986e-e1e488d623e4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:07.007931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82530f2f-96a7-42d0-9f71-4ec06046f290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:07.008775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82530f2f-96a7-42d0-9f71-4ec06046f290 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:07.009277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82530f2f-96a7-42d0-9f71-4ec06046f290 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:07.009720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82530f2f-96a7-42d0-9f71-4ec06046f290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:07.020580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82530f2f-96a7-42d0-9f71-4ec06046f290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:07.022221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82530f2f-96a7-42d0-9f71-4ec06046f290 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:07.033452 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3790/7617] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:06 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:14.545824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bf6b6-7ef1-4616-ab52-fce2d6e76551 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:14.582123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:14.618002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bf6b6-7ef1-4616-ab52-fce2d6e76551 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:14.622926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502666-e615-4826-8aed-955cc84d85e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:14.623868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502666-e615-4826-8aed-955cc84d85e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:14.624208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502666-e615-4826-8aed-955cc84d85e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:14.624488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502666-e615-4826-8aed-955cc84d85e5 admin admin] PATH_INFO: `/v3/users/2672e346bb3c4b069af80782f2058ab1` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:14.625721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf502666-e615-4826-8aed-955cc84d85e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2672e346bb3c4b069af80782f2058ab1)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:14.627698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf502666-e615-4826-8aed-955cc84d85e5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:14.679021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cf502666-e615-4826-8aed-955cc84d85e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2672e346bb3c4b069af80782f2058ab1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:14.687537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cf502666-e615-4826-8aed-955cc84d85e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2672e346bb3c4b069af80782f2058ab1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:14.688213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cf502666-e615-4826-8aed-955cc84d85e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2672e346bb3c4b069af80782f2058ab1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:14.689210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cf502666-e615-4826-8aed-955cc84d85e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2672e346bb3c4b069af80782f2058ab1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:14.696462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cf502666-e615-4826-8aed-955cc84d85e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2672e346bb3c4b069af80782f2058ab1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:14.714620 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3828/7618] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:31:14 2022] DELETE /identity/v3/users/2672e346bb3c4b069af80782f2058ab1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:14.719301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28103f-7334-4319-9310-eb57015fc930 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:14.719861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28103f-7334-4319-9310-eb57015fc930 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:14.719980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28103f-7334-4319-9310-eb57015fc930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:14.737659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9d28103f-7334-4319-9310-eb57015fc930 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:14.738871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9d28103f-7334-4319-9310-eb57015fc930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:14.804214 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3791/7619] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:14.814349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502666-e615-4826-8aed-955cc84d85e5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:14.815885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cf502666-e615-4826-8aed-955cc84d85e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:14.890101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502666-e615-4826-8aed-955cc84d85e5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:14.894913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33647df-2835-4844-ad4d-78c3c4835ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:14.895599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33647df-2835-4844-ad4d-78c3c4835ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:14.895876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33647df-2835-4844-ad4d-78c3c4835ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:14.896182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33647df-2835-4844-ad4d-78c3c4835ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:14.906527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33647df-2835-4844-ad4d-78c3c4835ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:14.907982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33647df-2835-4844-ad4d-78c3c4835ce5 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:14.917835 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3829/7620] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:15.116390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28103f-7334-4319-9310-eb57015fc930 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:15.118000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9d28103f-7334-4319-9310-eb57015fc930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:15.141751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28103f-7334-4319-9310-eb57015fc930 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:15.148148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e62961-0b89-4e45-81d6-f432d480b446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:15.149142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e62961-0b89-4e45-81d6-f432d480b446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:15.149523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e62961-0b89-4e45-81d6-f432d480b446 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:15.149902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e62961-0b89-4e45-81d6-f432d480b446 admin admin] PATH_INFO: `/v3/projects/e39127b834aa464b8d98462e24bb5dca` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:15.151637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e62961-0b89-4e45-81d6-f432d480b446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39127b834aa464b8d98462e24bb5dca)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:15.153671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e62961-0b89-4e45-81d6-f432d480b446 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:15.198782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:15.211714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f4e62961-0b89-4e45-81d6-f432d480b446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39127b834aa464b8d98462e24bb5dca', 'request_id': 'req-f4e62961-0b89-4e45-81d6-f432d480b446'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:15.218139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f4e62961-0b89-4e45-81d6-f432d480b446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39127b834aa464b8d98462e24bb5dca', 'request_id': 'req-f4e62961-0b89-4e45-81d6-f432d480b446'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:15.223741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f4e62961-0b89-4e45-81d6-f432d480b446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39127b834aa464b8d98462e24bb5dca', 'request_id': 'req-f4e62961-0b89-4e45-81d6-f432d480b446'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:15.238357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f4e62961-0b89-4e45-81d6-f432d480b446 admin admin] The token cache is being invalidate because project e39127b834aa464b8d98462e24bb5dca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:31:15.238649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f4e62961-0b89-4e45-81d6-f432d480b446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:15.239399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f4e62961-0b89-4e45-81d6-f432d480b446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:15.244165 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3792/7621] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:31:15 2022] DELETE /identity/v3/projects/e39127b834aa464b8d98462e24bb5dca => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:15.250660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6486f-ad0b-4289-9ead-f3ca3208c938 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:15.251127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6486f-ad0b-4289-9ead-f3ca3208c938 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:15.251486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6486f-ad0b-4289-9ead-f3ca3208c938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:15.270686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-86d6486f-ad0b-4289-9ead-f3ca3208c938 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:15.271949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-86d6486f-ad0b-4289-9ead-f3ca3208c938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:15.316662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:15.335916 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3830/7622] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:15.346290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c13ac6-4238-4469-a1d7-17452a2ae5b7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:15.346551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c13ac6-4238-4469-a1d7-17452a2ae5b7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:15.346847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c13ac6-4238-4469-a1d7-17452a2ae5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:15.369986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-91c13ac6-4238-4469-a1d7-17452a2ae5b7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:15.371226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-91c13ac6-4238-4469-a1d7-17452a2ae5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:15.379659 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3793/7623] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:15.384093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6486f-ad0b-4289-9ead-f3ca3208c938 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:15.395970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6486f-ad0b-4289-9ead-f3ca3208c938 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:15.401234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5c2f7-c605-425d-a042-b221d9498965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:15.401897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5c2f7-c605-425d-a042-b221d9498965 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:15.402177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5c2f7-c605-425d-a042-b221d9498965 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:15.402450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5c2f7-c605-425d-a042-b221d9498965 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:15.403173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5c2f7-c605-425d-a042-b221d9498965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:31:15.403472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5c2f7-c605-425d-a042-b221d9498965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:15.405115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5c2f7-c605-425d-a042-b221d9498965 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:15.417376 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3831/7624] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:31:15.421789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c13ac6-4238-4469-a1d7-17452a2ae5b7 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:15.431958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c13ac6-4238-4469-a1d7-17452a2ae5b7 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:15.437789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140f696-948d-4aa0-8693-2ce67f4e6465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:15.438570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140f696-948d-4aa0-8693-2ce67f4e6465 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:15.438845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140f696-948d-4aa0-8693-2ce67f4e6465 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:15.439275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140f696-948d-4aa0-8693-2ce67f4e6465 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:15.441064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140f696-948d-4aa0-8693-2ce67f4e6465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:15.441982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140f696-948d-4aa0-8693-2ce67f4e6465 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:15.470248 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3794/7625] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:31:15 2022] POST /identity/v3/projects => generated 359 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:31:15.474435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5c2f7-c605-425d-a042-b221d9498965 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:15.485193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5c2f7-c605-425d-a042-b221d9498965 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:15.549730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72bcd9-436a-4919-8e09-1a76619d61fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:15.550513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72bcd9-436a-4919-8e09-1a76619d61fa admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:15.550992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72bcd9-436a-4919-8e09-1a76619d61fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:15.551327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72bcd9-436a-4919-8e09-1a76619d61fa admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:15.552129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72bcd9-436a-4919-8e09-1a76619d61fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:15.554498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72bcd9-436a-4919-8e09-1a76619d61fa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:15.585573 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3832/7626] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:31:15 2022] POST /identity/v3/users => generated 280 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:31:15.590315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140f696-948d-4aa0-8693-2ce67f4e6465 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:15.601136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140f696-948d-4aa0-8693-2ce67f4e6465 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:15.605975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3122a-36d4-4844-8862-bcc4253b0c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:15.606641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3122a-36d4-4844-8862-bcc4253b0c8f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:15.606919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3122a-36d4-4844-8862-bcc4253b0c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:15.607191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3122a-36d4-4844-8862-bcc4253b0c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:15.607903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3122a-36d4-4844-8862-bcc4253b0c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:15.609606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3122a-36d4-4844-8862-bcc4253b0c8f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:15.620607 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3795/7627] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:31:15.624860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72bcd9-436a-4919-8e09-1a76619d61fa admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:15.635338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72bcd9-436a-4919-8e09-1a76619d61fa admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:15.640005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0e1ec-b18c-4aa4-830e-82130eec57a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:15.640704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0e1ec-b18c-4aa4-830e-82130eec57a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:15.640988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0e1ec-b18c-4aa4-830e-82130eec57a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:15.641265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0e1ec-b18c-4aa4-830e-82130eec57a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:15.642050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0e1ec-b18c-4aa4-830e-82130eec57a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:15.643672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0e1ec-b18c-4aa4-830e-82130eec57a1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:15.653861 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3833/7628] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:31:15.658254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3122a-36d4-4844-8862-bcc4253b0c8f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:15.669608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3122a-36d4-4844-8862-bcc4253b0c8f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:15.676744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d1b2b-fe31-4c89-b55f-d1ca05badbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:15.677659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d1b2b-fe31-4c89-b55f-d1ca05badbde admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:15.677942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d1b2b-fe31-4c89-b55f-d1ca05badbde admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:15.678218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d1b2b-fe31-4c89-b55f-d1ca05badbde admin admin] PATH_INFO: `/v3/projects/dd079269f60d42c79417409e370fe0b3/users/e5d0f2fd1bc2438e9bf288c636b69eb9/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:15.694729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d1b2b-fe31-4c89-b55f-d1ca05badbde admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd079269f60d42c79417409e370fe0b3, user_id=e5d0f2fd1bc2438e9bf288c636b69eb9, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:15.697555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d1b2b-fe31-4c89-b55f-d1ca05badbde admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:15.713309 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3796/7629] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:31:15 2022] PUT /identity/v3/projects/dd079269f60d42c79417409e370fe0b3/users/e5d0f2fd1bc2438e9bf288c636b69eb9/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:15.723599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c261dcf-5f7b-44b8-bda4-9647808121a1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:15.723919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c261dcf-5f7b-44b8-bda4-9647808121a1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:15.724237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c261dcf-5f7b-44b8-bda4-9647808121a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:15.751113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6c261dcf-5f7b-44b8-bda4-9647808121a1 None None] MFA Rules not processed for user `e5d0f2fd1bc2438e9bf288c636b69eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:15.752396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6c261dcf-5f7b-44b8-bda4-9647808121a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:15.819508 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3834/7630] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:15 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:31:15.829984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d1b2b-fe31-4c89-b55f-d1ca05badbde admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:15.831769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-303d1b2b-fe31-4c89-b55f-d1ca05badbde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:15.895396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d1b2b-fe31-4c89-b55f-d1ca05badbde admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:15.899308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e6afa-793b-4951-919d-6f7a580aeb4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:15.899956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e6afa-793b-4951-919d-6f7a580aeb4c service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:15.900284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e6afa-793b-4951-919d-6f7a580aeb4c service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:15.900564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e6afa-793b-4951-919d-6f7a580aeb4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:15.909502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e6afa-793b-4951-919d-6f7a580aeb4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:15.910973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e6afa-793b-4951-919d-6f7a580aeb4c service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:15.919938 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3797/7631] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:15 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:23.945672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c261dcf-5f7b-44b8-bda4-9647808121a1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:23.994413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:24.013594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c261dcf-5f7b-44b8-bda4-9647808121a1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:24.018829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35d390-5fa7-4d2b-b396-8a63d6b03ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:24.019714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35d390-5fa7-4d2b-b396-8a63d6b03ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:24.019988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35d390-5fa7-4d2b-b396-8a63d6b03ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:24.020319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35d390-5fa7-4d2b-b396-8a63d6b03ac0 admin admin] PATH_INFO: `/v3/users/e5d0f2fd1bc2438e9bf288c636b69eb9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:24.021541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35d390-5fa7-4d2b-b396-8a63d6b03ac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d0f2fd1bc2438e9bf288c636b69eb9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:24.023570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35d390-5fa7-4d2b-b396-8a63d6b03ac0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:24.079051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bb35d390-5fa7-4d2b-b396-8a63d6b03ac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d0f2fd1bc2438e9bf288c636b69eb9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:24.088720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bb35d390-5fa7-4d2b-b396-8a63d6b03ac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d0f2fd1bc2438e9bf288c636b69eb9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:24.089470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bb35d390-5fa7-4d2b-b396-8a63d6b03ac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d0f2fd1bc2438e9bf288c636b69eb9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:24.090034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bb35d390-5fa7-4d2b-b396-8a63d6b03ac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d0f2fd1bc2438e9bf288c636b69eb9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:24.097405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-bb35d390-5fa7-4d2b-b396-8a63d6b03ac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d0f2fd1bc2438e9bf288c636b69eb9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:24.114816 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3835/7632] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:31:23 2022] DELETE /identity/v3/users/e5d0f2fd1bc2438e9bf288c636b69eb9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:24.119562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a78d4-2568-4772-964a-30bead529eef None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:24.120016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a78d4-2568-4772-964a-30bead529eef None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:24.120165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a78d4-2568-4772-964a-30bead529eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:24.138390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c87a78d4-2568-4772-964a-30bead529eef None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:24.139621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c87a78d4-2568-4772-964a-30bead529eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:24.206514 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3798/7633] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:24.216204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35d390-5fa7-4d2b-b396-8a63d6b03ac0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:24.217679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bb35d390-5fa7-4d2b-b396-8a63d6b03ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:24.277788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35d390-5fa7-4d2b-b396-8a63d6b03ac0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:24.281925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940a543-ce5f-4dfd-9c39-664c5e0d2204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:24.282572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940a543-ce5f-4dfd-9c39-664c5e0d2204 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:24.282855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940a543-ce5f-4dfd-9c39-664c5e0d2204 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:24.283130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940a543-ce5f-4dfd-9c39-664c5e0d2204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:24.292896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940a543-ce5f-4dfd-9c39-664c5e0d2204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:24.294347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940a543-ce5f-4dfd-9c39-664c5e0d2204 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:24.304842 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3836/7634] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:24.481031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a78d4-2568-4772-964a-30bead529eef None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:24.482743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c87a78d4-2568-4772-964a-30bead529eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:24.490862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:24.498769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a78d4-2568-4772-964a-30bead529eef None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:24.504836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0bdfc-7408-41d3-8779-74f143ffcd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:24.505885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0bdfc-7408-41d3-8779-74f143ffcd6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:24.506348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0bdfc-7408-41d3-8779-74f143ffcd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:24.506584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0bdfc-7408-41d3-8779-74f143ffcd6a admin admin] PATH_INFO: `/v3/projects/dd079269f60d42c79417409e370fe0b3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:24.508276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0bdfc-7408-41d3-8779-74f143ffcd6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd079269f60d42c79417409e370fe0b3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:24.510296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0bdfc-7408-41d3-8779-74f143ffcd6a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:24.560137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-08c0bdfc-7408-41d3-8779-74f143ffcd6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd079269f60d42c79417409e370fe0b3', 'request_id': 'req-08c0bdfc-7408-41d3-8779-74f143ffcd6a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:24.566401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-08c0bdfc-7408-41d3-8779-74f143ffcd6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd079269f60d42c79417409e370fe0b3', 'request_id': 'req-08c0bdfc-7408-41d3-8779-74f143ffcd6a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:24.571796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-08c0bdfc-7408-41d3-8779-74f143ffcd6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd079269f60d42c79417409e370fe0b3', 'request_id': 'req-08c0bdfc-7408-41d3-8779-74f143ffcd6a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:24.586563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-08c0bdfc-7408-41d3-8779-74f143ffcd6a admin admin] The token cache is being invalidate because project dd079269f60d42c79417409e370fe0b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:31:24.586937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-08c0bdfc-7408-41d3-8779-74f143ffcd6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:24.587566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-08c0bdfc-7408-41d3-8779-74f143ffcd6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:24.589255 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3799/7635] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:31:24 2022] DELETE /identity/v3/projects/dd079269f60d42c79417409e370fe0b3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:24.594465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a665410-42d1-42a2-9c4a-fb7959da275c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:24.594771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a665410-42d1-42a2-9c4a-fb7959da275c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:24.595052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a665410-42d1-42a2-9c4a-fb7959da275c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:24.613206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4a665410-42d1-42a2-9c4a-fb7959da275c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:24.614342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4a665410-42d1-42a2-9c4a-fb7959da275c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:24.676193 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3837/7636] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:24.684276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c9da9-90ec-44e9-a0a4-7caeca35c6ed None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:24.684566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c9da9-90ec-44e9-a0a4-7caeca35c6ed None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:24.684846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c9da9-90ec-44e9-a0a4-7caeca35c6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:24.705011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9e5c9da9-90ec-44e9-a0a4-7caeca35c6ed None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:24.707027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9e5c9da9-90ec-44e9-a0a4-7caeca35c6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:24.718143 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3800/7637] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:24.722534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a665410-42d1-42a2-9c4a-fb7959da275c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:24.738458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a665410-42d1-42a2-9c4a-fb7959da275c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:24.743765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb657a-f216-4336-bda5-9233268c5845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:24.744463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb657a-f216-4336-bda5-9233268c5845 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:24.744748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb657a-f216-4336-bda5-9233268c5845 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:24.745011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb657a-f216-4336-bda5-9233268c5845 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:24.745742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb657a-f216-4336-bda5-9233268c5845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:31:24.746042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb657a-f216-4336-bda5-9233268c5845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:24.747688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb657a-f216-4336-bda5-9233268c5845 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:24.749410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:24.765112 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3838/7638] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:31:24.767791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c9da9-90ec-44e9-a0a4-7caeca35c6ed None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:24.778870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c9da9-90ec-44e9-a0a4-7caeca35c6ed None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:24.783944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48206540-4215-4f88-acf4-7bd5e4061f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:24.784640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48206540-4215-4f88-acf4-7bd5e4061f08 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:24.784919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48206540-4215-4f88-acf4-7bd5e4061f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:24.785188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48206540-4215-4f88-acf4-7bd5e4061f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:24.785880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48206540-4215-4f88-acf4-7bd5e4061f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:24.787791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48206540-4215-4f88-acf4-7bd5e4061f08 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:24.816993 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3801/7639] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:31:24 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:31:24.821270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb657a-f216-4336-bda5-9233268c5845 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:24.831767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb657a-f216-4336-bda5-9233268c5845 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:24.890872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a41d84-f1d8-4c98-8aa9-b4f3aa49120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:24.891468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a41d84-f1d8-4c98-8aa9-b4f3aa49120c admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:24.891749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a41d84-f1d8-4c98-8aa9-b4f3aa49120c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:24.892072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a41d84-f1d8-4c98-8aa9-b4f3aa49120c admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:24.892735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a41d84-f1d8-4c98-8aa9-b4f3aa49120c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:24.894702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a41d84-f1d8-4c98-8aa9-b4f3aa49120c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:24.916421 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3839/7640] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:31:24 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:31:24.920926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48206540-4215-4f88-acf4-7bd5e4061f08 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:24.932501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48206540-4215-4f88-acf4-7bd5e4061f08 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:24.938243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5099a-0d20-46b3-84d8-4cdbb3fe5584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:24.938912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5099a-0d20-46b3-84d8-4cdbb3fe5584 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:24.939194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5099a-0d20-46b3-84d8-4cdbb3fe5584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:24.939468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5099a-0d20-46b3-84d8-4cdbb3fe5584 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:24.940228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5099a-0d20-46b3-84d8-4cdbb3fe5584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:24.941833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5099a-0d20-46b3-84d8-4cdbb3fe5584 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:24.952920 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3802/7641] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:31:24.957222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a41d84-f1d8-4c98-8aa9-b4f3aa49120c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:24.967754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a41d84-f1d8-4c98-8aa9-b4f3aa49120c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:24.972929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f621f-f28f-4ea6-919b-f45437206fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:24.973683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f621f-f28f-4ea6-919b-f45437206fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:24.974073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f621f-f28f-4ea6-919b-f45437206fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:24.974364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f621f-f28f-4ea6-919b-f45437206fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:24.975082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f621f-f28f-4ea6-919b-f45437206fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:24.976741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f621f-f28f-4ea6-919b-f45437206fe7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:24.986974 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3840/7642] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:31:24.991070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5099a-0d20-46b3-84d8-4cdbb3fe5584 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:25.001486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5099a-0d20-46b3-84d8-4cdbb3fe5584 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:25.006504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2df359-6f8f-4bfe-a545-1c76e212d5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:25.007404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2df359-6f8f-4bfe-a545-1c76e212d5fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:25.007691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2df359-6f8f-4bfe-a545-1c76e212d5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:25.007970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2df359-6f8f-4bfe-a545-1c76e212d5fb admin admin] PATH_INFO: `/v3/projects/9b6f39fe2b9f4c5198759bac2847d8cf/users/5475b2c399e74b3abe84d50201326881/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:25.024136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2df359-6f8f-4bfe-a545-1c76e212d5fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6f39fe2b9f4c5198759bac2847d8cf, user_id=5475b2c399e74b3abe84d50201326881, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:25.026815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2df359-6f8f-4bfe-a545-1c76e212d5fb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:25.042998 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3803/7643] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:31:24 2022] PUT /identity/v3/projects/9b6f39fe2b9f4c5198759bac2847d8cf/users/5475b2c399e74b3abe84d50201326881/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:25.054536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a27cad-066f-4e28-beab-1fd3fa32f643 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:25.054967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a27cad-066f-4e28-beab-1fd3fa32f643 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:25.055383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a27cad-066f-4e28-beab-1fd3fa32f643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:25.086386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-87a27cad-066f-4e28-beab-1fd3fa32f643 None None] MFA Rules not processed for user `5475b2c399e74b3abe84d50201326881`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:25.087614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-87a27cad-066f-4e28-beab-1fd3fa32f643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:25.162873 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3841/7644] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:31:25.167689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2df359-6f8f-4bfe-a545-1c76e212d5fb admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:25.233820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2df359-6f8f-4bfe-a545-1c76e212d5fb admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:25.238801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4809689-6a89-4284-940e-c05e28d15e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:25.239467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4809689-6a89-4284-940e-c05e28d15e8d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:25.239742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4809689-6a89-4284-940e-c05e28d15e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:25.240013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4809689-6a89-4284-940e-c05e28d15e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:25.240745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4809689-6a89-4284-940e-c05e28d15e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:25.242647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4809689-6a89-4284-940e-c05e28d15e8d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:25.270993 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3804/7645] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:31:25 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:31:25.275156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a27cad-066f-4e28-beab-1fd3fa32f643 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:25.286419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a27cad-066f-4e28-beab-1fd3fa32f643 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:25.347075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a9a4a-e617-45a2-8711-be0265f7dcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:25.347741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a9a4a-e617-45a2-8711-be0265f7dcc2 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:25.348016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a9a4a-e617-45a2-8711-be0265f7dcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:25.348323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a9a4a-e617-45a2-8711-be0265f7dcc2 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:25.349017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a9a4a-e617-45a2-8711-be0265f7dcc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:25.350925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a9a4a-e617-45a2-8711-be0265f7dcc2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:25.358590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:25.374233 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3842/7646] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:31:25 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:31:25.375514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4809689-6a89-4284-940e-c05e28d15e8d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:25.386659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4809689-6a89-4284-940e-c05e28d15e8d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:25.392148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b04b3f-1682-4615-ba7a-197c3747dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:25.392831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b04b3f-1682-4615-ba7a-197c3747dd64 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:25.393115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b04b3f-1682-4615-ba7a-197c3747dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:25.393394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b04b3f-1682-4615-ba7a-197c3747dd64 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:25.394112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b04b3f-1682-4615-ba7a-197c3747dd64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:25.395714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b04b3f-1682-4615-ba7a-197c3747dd64 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:25.397038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:25.408487 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3805/7647] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:31:25.412990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a9a4a-e617-45a2-8711-be0265f7dcc2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:25.423656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a9a4a-e617-45a2-8711-be0265f7dcc2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:25.429323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f288db-aac5-4891-8385-477401baf347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:25.430231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f288db-aac5-4891-8385-477401baf347 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:25.430506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f288db-aac5-4891-8385-477401baf347 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:25.430777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f288db-aac5-4891-8385-477401baf347 admin admin] PATH_INFO: `/v3/projects/2268b550f21749ee9055c8e30c1825ca/users/f8120a0067454a3d82a21696ec253465/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:25.448881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f288db-aac5-4891-8385-477401baf347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2268b550f21749ee9055c8e30c1825ca, user_id=f8120a0067454a3d82a21696ec253465, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:25.451551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f288db-aac5-4891-8385-477401baf347 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:25.468264 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3843/7648] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:31:25 2022] PUT /identity/v3/projects/2268b550f21749ee9055c8e30c1825ca/users/f8120a0067454a3d82a21696ec253465/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:25.472829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b04b3f-1682-4615-ba7a-197c3747dd64 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:25.483629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b04b3f-1682-4615-ba7a-197c3747dd64 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:25.542165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42142936-30f2-408b-beb5-5db030f5999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:25.542837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42142936-30f2-408b-beb5-5db030f5999e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:25.543120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42142936-30f2-408b-beb5-5db030f5999e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:25.543403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42142936-30f2-408b-beb5-5db030f5999e admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:25.544136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42142936-30f2-408b-beb5-5db030f5999e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:25.545750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42142936-30f2-408b-beb5-5db030f5999e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:25.556438 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3806/7649] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:31:25.560918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f288db-aac5-4891-8385-477401baf347 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:25.571713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f288db-aac5-4891-8385-477401baf347 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:25.576699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b24947-c80f-4a67-90a9-f59fe5d87ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:25.577585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b24947-c80f-4a67-90a9-f59fe5d87ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:25.577867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b24947-c80f-4a67-90a9-f59fe5d87ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:25.578133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b24947-c80f-4a67-90a9-f59fe5d87ee6 admin admin] PATH_INFO: `/v3/projects/2268b550f21749ee9055c8e30c1825ca/users/f8120a0067454a3d82a21696ec253465/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:25.580258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b24947-c80f-4a67-90a9-f59fe5d87ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2268b550f21749ee9055c8e30c1825ca, user_id=f8120a0067454a3d82a21696ec253465, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:25.582895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b24947-c80f-4a67-90a9-f59fe5d87ee6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:25.592966 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3844/7650] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:31:25 2022] PUT /identity/v3/projects/2268b550f21749ee9055c8e30c1825ca/users/f8120a0067454a3d82a21696ec253465/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:25.604475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6bc37-c73b-48ff-a6d3-4c3d25c8b6e9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:25.604768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6bc37-c73b-48ff-a6d3-4c3d25c8b6e9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:25.605048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6bc37-c73b-48ff-a6d3-4c3d25c8b6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:25.631642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-36c6bc37-c73b-48ff-a6d3-4c3d25c8b6e9 None None] MFA Rules not processed for user `f8120a0067454a3d82a21696ec253465`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:25.632941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-36c6bc37-c73b-48ff-a6d3-4c3d25c8b6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:25.703226 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3807/7651] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:25 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:25.714097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b24947-c80f-4a67-90a9-f59fe5d87ee6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:25.716189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-55b24947-c80f-4a67-90a9-f59fe5d87ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:25.794098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b24947-c80f-4a67-90a9-f59fe5d87ee6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:25.798466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e475b37-ae88-47c6-a5c9-8d992a012c9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:25.799122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e475b37-ae88-47c6-a5c9-8d992a012c9e service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:25.799452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e475b37-ae88-47c6-a5c9-8d992a012c9e service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:25.799720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e475b37-ae88-47c6-a5c9-8d992a012c9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:25.810716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e475b37-ae88-47c6-a5c9-8d992a012c9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:25.812213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e475b37-ae88-47c6-a5c9-8d992a012c9e service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:25.822489 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3845/7652] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:25 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:27.228031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6bc37-c73b-48ff-a6d3-4c3d25c8b6e9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:27.292032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6bc37-c73b-48ff-a6d3-4c3d25c8b6e9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:27.296972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a2b8a-11be-4c01-a260-494c738af04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:27.297880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a2b8a-11be-4c01-a260-494c738af04c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:27.298156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a2b8a-11be-4c01-a260-494c738af04c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:27.298436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a2b8a-11be-4c01-a260-494c738af04c admin admin] PATH_INFO: `/v3/users/5475b2c399e74b3abe84d50201326881` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:27.299663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a2b8a-11be-4c01-a260-494c738af04c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5475b2c399e74b3abe84d50201326881)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:27.301645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a2b8a-11be-4c01-a260-494c738af04c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:27.324072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:27.352957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a80a2b8a-11be-4c01-a260-494c738af04c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5475b2c399e74b3abe84d50201326881'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:27.362107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a80a2b8a-11be-4c01-a260-494c738af04c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5475b2c399e74b3abe84d50201326881'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:27.370114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a80a2b8a-11be-4c01-a260-494c738af04c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5475b2c399e74b3abe84d50201326881'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:27.370775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a80a2b8a-11be-4c01-a260-494c738af04c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5475b2c399e74b3abe84d50201326881'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:27.371457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a80a2b8a-11be-4c01-a260-494c738af04c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5475b2c399e74b3abe84d50201326881'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:27.389189 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3808/7653] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:31:27 2022] DELETE /identity/v3/users/5475b2c399e74b3abe84d50201326881 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:27.393813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cffafa-531d-4064-9413-7e15f6198da4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:27.394324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cffafa-531d-4064-9413-7e15f6198da4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:27.394425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cffafa-531d-4064-9413-7e15f6198da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:27.412489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b4cffafa-531d-4064-9413-7e15f6198da4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:27.413664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b4cffafa-531d-4064-9413-7e15f6198da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:27.474444 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3846/7654] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:27.484340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a2b8a-11be-4c01-a260-494c738af04c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:27.486044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a80a2b8a-11be-4c01-a260-494c738af04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:27.555913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a2b8a-11be-4c01-a260-494c738af04c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:27.559928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bccace-4221-4881-81f7-5bab3564d5d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:27.560612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bccace-4221-4881-81f7-5bab3564d5d7 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:27.560925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bccace-4221-4881-81f7-5bab3564d5d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:27.561174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bccace-4221-4881-81f7-5bab3564d5d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:27.570740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bccace-4221-4881-81f7-5bab3564d5d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:27.572218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bccace-4221-4881-81f7-5bab3564d5d7 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:27.581956 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3809/7655] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:27.879398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cffafa-531d-4064-9413-7e15f6198da4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:27.881025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b4cffafa-531d-4064-9413-7e15f6198da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:27.894632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cffafa-531d-4064-9413-7e15f6198da4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:27.900255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac45aa1-5e9d-457e-9b5c-524f02ac40af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:27.901144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac45aa1-5e9d-457e-9b5c-524f02ac40af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:27.901467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac45aa1-5e9d-457e-9b5c-524f02ac40af admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:27.901758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac45aa1-5e9d-457e-9b5c-524f02ac40af admin admin] PATH_INFO: `/v3/projects/9b6f39fe2b9f4c5198759bac2847d8cf` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:27.903049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac45aa1-5e9d-457e-9b5c-524f02ac40af admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b6f39fe2b9f4c5198759bac2847d8cf)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:27.905064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac45aa1-5e9d-457e-9b5c-524f02ac40af admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:27.955705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0ac45aa1-5e9d-457e-9b5c-524f02ac40af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b6f39fe2b9f4c5198759bac2847d8cf', 'request_id': 'req-0ac45aa1-5e9d-457e-9b5c-524f02ac40af'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:27.958795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:27.967572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0ac45aa1-5e9d-457e-9b5c-524f02ac40af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b6f39fe2b9f4c5198759bac2847d8cf', 'request_id': 'req-0ac45aa1-5e9d-457e-9b5c-524f02ac40af'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:27.975643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0ac45aa1-5e9d-457e-9b5c-524f02ac40af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b6f39fe2b9f4c5198759bac2847d8cf', 'request_id': 'req-0ac45aa1-5e9d-457e-9b5c-524f02ac40af'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:27.986913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0ac45aa1-5e9d-457e-9b5c-524f02ac40af admin admin] The token cache is being invalidate because project 9b6f39fe2b9f4c5198759bac2847d8cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:31:27.987209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0ac45aa1-5e9d-457e-9b5c-524f02ac40af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:27.987968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0ac45aa1-5e9d-457e-9b5c-524f02ac40af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:27.989699 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3847/7656] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:31:27 2022] DELETE /identity/v3/projects/9b6f39fe2b9f4c5198759bac2847d8cf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:27.993844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bccace-4221-4881-81f7-5bab3564d5d7 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:28.004230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bccace-4221-4881-81f7-5bab3564d5d7 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:28.064271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ee669-cda8-47c0-a3ae-5261d9de0fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:28.065156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ee669-cda8-47c0-a3ae-5261d9de0fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:28.065442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ee669-cda8-47c0-a3ae-5261d9de0fde admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:28.065715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ee669-cda8-47c0-a3ae-5261d9de0fde admin admin] PATH_INFO: `/v3/users/f8120a0067454a3d82a21696ec253465` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:28.066941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ee669-cda8-47c0-a3ae-5261d9de0fde admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8120a0067454a3d82a21696ec253465)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:28.068972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ee669-cda8-47c0-a3ae-5261d9de0fde admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:28.116168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:28.121808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c67ee669-cda8-47c0-a3ae-5261d9de0fde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8120a0067454a3d82a21696ec253465'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:28.130304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c67ee669-cda8-47c0-a3ae-5261d9de0fde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8120a0067454a3d82a21696ec253465'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:28.137579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c67ee669-cda8-47c0-a3ae-5261d9de0fde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8120a0067454a3d82a21696ec253465'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:28.138218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c67ee669-cda8-47c0-a3ae-5261d9de0fde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8120a0067454a3d82a21696ec253465'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:28.138837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c67ee669-cda8-47c0-a3ae-5261d9de0fde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8120a0067454a3d82a21696ec253465'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:28.157054 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3810/7657] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:31:27 2022] DELETE /identity/v3/users/f8120a0067454a3d82a21696ec253465 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:28.446491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac45aa1-5e9d-457e-9b5c-524f02ac40af admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:28.448012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0ac45aa1-5e9d-457e-9b5c-524f02ac40af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:28.462136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac45aa1-5e9d-457e-9b5c-524f02ac40af admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:28.519747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37125c9c-6b76-49de-813a-9420e1266b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:28.520656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37125c9c-6b76-49de-813a-9420e1266b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:28.520939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37125c9c-6b76-49de-813a-9420e1266b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:28.521218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37125c9c-6b76-49de-813a-9420e1266b94 admin admin] PATH_INFO: `/v3/projects/2268b550f21749ee9055c8e30c1825ca` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:28.522522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37125c9c-6b76-49de-813a-9420e1266b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2268b550f21749ee9055c8e30c1825ca)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:28.524517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37125c9c-6b76-49de-813a-9420e1266b94 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:28.580584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-37125c9c-6b76-49de-813a-9420e1266b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2268b550f21749ee9055c8e30c1825ca', 'request_id': 'req-37125c9c-6b76-49de-813a-9420e1266b94'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:28.590273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-37125c9c-6b76-49de-813a-9420e1266b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2268b550f21749ee9055c8e30c1825ca', 'request_id': 'req-37125c9c-6b76-49de-813a-9420e1266b94'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:28.596899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-37125c9c-6b76-49de-813a-9420e1266b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2268b550f21749ee9055c8e30c1825ca', 'request_id': 'req-37125c9c-6b76-49de-813a-9420e1266b94'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:28.607673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-37125c9c-6b76-49de-813a-9420e1266b94 admin admin] The token cache is being invalidate because project 2268b550f21749ee9055c8e30c1825ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:31:28.607961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-37125c9c-6b76-49de-813a-9420e1266b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:28.608636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-37125c9c-6b76-49de-813a-9420e1266b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:28.610263 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3848/7658] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:31:28 2022] DELETE /identity/v3/projects/2268b550f21749ee9055c8e30c1825ca => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:28.615399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f38a4b-e6df-43c5-94c0-da4d89beecf9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:28.615872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f38a4b-e6df-43c5-94c0-da4d89beecf9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:28.615872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f38a4b-e6df-43c5-94c0-da4d89beecf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:28.634222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-53f38a4b-e6df-43c5-94c0-da4d89beecf9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:28.635441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-53f38a4b-e6df-43c5-94c0-da4d89beecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:28.704675 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3811/7659] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:28.712870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaedc48-6d7b-42dd-906c-327db762184f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:28.713160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaedc48-6d7b-42dd-906c-327db762184f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:28.713443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaedc48-6d7b-42dd-906c-327db762184f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:28.732896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1aaedc48-6d7b-42dd-906c-327db762184f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:28.734106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1aaedc48-6d7b-42dd-906c-327db762184f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:28.742708 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3849/7660] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:28.747104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f38a4b-e6df-43c5-94c0-da4d89beecf9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:28.757741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f38a4b-e6df-43c5-94c0-da4d89beecf9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:28.763185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdebd8-a5b6-4d31-b9cb-1a2bd47807f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:28.763846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdebd8-a5b6-4d31-b9cb-1a2bd47807f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:28.764177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdebd8-a5b6-4d31-b9cb-1a2bd47807f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:28.764462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdebd8-a5b6-4d31-b9cb-1a2bd47807f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:28.765217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cdebd8-a5b6-4d31-b9cb-1a2bd47807f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:31:28.765507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cdebd8-a5b6-4d31-b9cb-1a2bd47807f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:28.767132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cdebd8-a5b6-4d31-b9cb-1a2bd47807f6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:28.778896 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3812/7661] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:31:28.783394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaedc48-6d7b-42dd-906c-327db762184f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:28.792950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaedc48-6d7b-42dd-906c-327db762184f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:28.798274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb3d0e-922a-46d7-bea2-d0cb21977f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:28.798920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb3d0e-922a-46d7-bea2-d0cb21977f73 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:28.799200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb3d0e-922a-46d7-bea2-d0cb21977f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:28.799476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb3d0e-922a-46d7-bea2-d0cb21977f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:28.800239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb3d0e-922a-46d7-bea2-d0cb21977f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:28.802139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb3d0e-922a-46d7-bea2-d0cb21977f73 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:28.830898 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3850/7662] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:31:28 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:31:28.835196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdebd8-a5b6-4d31-b9cb-1a2bd47807f6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:28.845798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdebd8-a5b6-4d31-b9cb-1a2bd47807f6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:28.914824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e9ba4-0ead-401a-b8f1-be213481ca50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:28.915492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e9ba4-0ead-401a-b8f1-be213481ca50 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:28.915769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e9ba4-0ead-401a-b8f1-be213481ca50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:28.916063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e9ba4-0ead-401a-b8f1-be213481ca50 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:28.916772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e9ba4-0ead-401a-b8f1-be213481ca50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:28.918687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e9ba4-0ead-401a-b8f1-be213481ca50 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:28.945188 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3813/7663] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:31:28 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:31:28.949875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb3d0e-922a-46d7-bea2-d0cb21977f73 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:28.961418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb3d0e-922a-46d7-bea2-d0cb21977f73 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:28.967233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3baa8-1207-49f6-a43d-654e6bb26218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:28.967899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3baa8-1207-49f6-a43d-654e6bb26218 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:28.968216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3baa8-1207-49f6-a43d-654e6bb26218 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:28.968493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3baa8-1207-49f6-a43d-654e6bb26218 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:28.969272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3baa8-1207-49f6-a43d-654e6bb26218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:28.970905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3baa8-1207-49f6-a43d-654e6bb26218 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:28.981946 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3851/7664] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:31:28.986029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e9ba4-0ead-401a-b8f1-be213481ca50 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:28.996941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e9ba4-0ead-401a-b8f1-be213481ca50 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:29.002521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee267ab-52f9-4829-b150-3ea9b89c2d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:29.003181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee267ab-52f9-4829-b150-3ea9b89c2d7b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:29.003464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee267ab-52f9-4829-b150-3ea9b89c2d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:29.003742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee267ab-52f9-4829-b150-3ea9b89c2d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:29.004546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee267ab-52f9-4829-b150-3ea9b89c2d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:29.006155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee267ab-52f9-4829-b150-3ea9b89c2d7b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:29.016416 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3814/7665] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:31:29.020496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3baa8-1207-49f6-a43d-654e6bb26218 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:29.030969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3baa8-1207-49f6-a43d-654e6bb26218 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:29.035878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b794e19-e2bf-49d4-bdf2-5f0f42884481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:29.036797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b794e19-e2bf-49d4-bdf2-5f0f42884481 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:29.037078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b794e19-e2bf-49d4-bdf2-5f0f42884481 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:29.037354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b794e19-e2bf-49d4-bdf2-5f0f42884481 admin admin] PATH_INFO: `/v3/projects/c5387975b4e049cda66e8385265cc6cf/users/a67772d818764d0d8d8ed3c5ec9e9c23/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:29.052375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b794e19-e2bf-49d4-bdf2-5f0f42884481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5387975b4e049cda66e8385265cc6cf, user_id=a67772d818764d0d8d8ed3c5ec9e9c23, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:29.055435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b794e19-e2bf-49d4-bdf2-5f0f42884481 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:29.069735 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3852/7666] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:31:29 2022] PUT /identity/v3/projects/c5387975b4e049cda66e8385265cc6cf/users/a67772d818764d0d8d8ed3c5ec9e9c23/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:29.080370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981444df-f918-4067-a5b6-1c7228dd4b21 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:29.080660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981444df-f918-4067-a5b6-1c7228dd4b21 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:29.080939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981444df-f918-4067-a5b6-1c7228dd4b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:29.108006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-981444df-f918-4067-a5b6-1c7228dd4b21 None None] MFA Rules not processed for user `a67772d818764d0d8d8ed3c5ec9e9c23`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:29.109263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-981444df-f918-4067-a5b6-1c7228dd4b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:29.121509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:29.177328 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3815/7667] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:31:29.182383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b794e19-e2bf-49d4-bdf2-5f0f42884481 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:29.191774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:29.246321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b794e19-e2bf-49d4-bdf2-5f0f42884481 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:29.252588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b3f43-13ea-4a4f-a86f-70dd9f0bb960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:29.253254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b3f43-13ea-4a4f-a86f-70dd9f0bb960 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:29.253541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b3f43-13ea-4a4f-a86f-70dd9f0bb960 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:29.253820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b3f43-13ea-4a4f-a86f-70dd9f0bb960 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:29.254512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b3f43-13ea-4a4f-a86f-70dd9f0bb960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:29.256491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b3f43-13ea-4a4f-a86f-70dd9f0bb960 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:29.284910 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3853/7668] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:31:29 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:31:29.289111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981444df-f918-4067-a5b6-1c7228dd4b21 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:29.300334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981444df-f918-4067-a5b6-1c7228dd4b21 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:29.363355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a6722-c3ee-4c47-ab19-b81f4b4932d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:29.364070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a6722-c3ee-4c47-ab19-b81f4b4932d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:29.364364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a6722-c3ee-4c47-ab19-b81f4b4932d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:29.364639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a6722-c3ee-4c47-ab19-b81f4b4932d1 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:29.365338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a6722-c3ee-4c47-ab19-b81f4b4932d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:29.367261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a6722-c3ee-4c47-ab19-b81f4b4932d1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:29.388365 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3816/7669] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:31:29 2022] POST /identity/v3/users => generated 301 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:31:29.392603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b3f43-13ea-4a4f-a86f-70dd9f0bb960 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:29.403577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b3f43-13ea-4a4f-a86f-70dd9f0bb960 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:29.408745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abdb64-9a55-419a-b682-1f47ac93cfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:29.409402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abdb64-9a55-419a-b682-1f47ac93cfb7 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:29.409684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abdb64-9a55-419a-b682-1f47ac93cfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:29.409963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abdb64-9a55-419a-b682-1f47ac93cfb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:29.410681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abdb64-9a55-419a-b682-1f47ac93cfb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:29.412347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abdb64-9a55-419a-b682-1f47ac93cfb7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:29.424201 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3854/7670] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:31:29.428638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a6722-c3ee-4c47-ab19-b81f4b4932d1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:29.438928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a6722-c3ee-4c47-ab19-b81f4b4932d1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:29.443700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2d15a-3dd3-4401-a95d-5185fb8b301b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:29.444618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2d15a-3dd3-4401-a95d-5185fb8b301b admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:29.444893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2d15a-3dd3-4401-a95d-5185fb8b301b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:29.445175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2d15a-3dd3-4401-a95d-5185fb8b301b admin admin] PATH_INFO: `/v3/projects/c07e4a6d7c094175948cb871723d7ebb/users/d55ccc77ac474828a69fe02859a3a4d7/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:29.461312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2d15a-3dd3-4401-a95d-5185fb8b301b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c07e4a6d7c094175948cb871723d7ebb, user_id=d55ccc77ac474828a69fe02859a3a4d7, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:29.464361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2d15a-3dd3-4401-a95d-5185fb8b301b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:29.479695 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3817/7671] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:31:29 2022] PUT /identity/v3/projects/c07e4a6d7c094175948cb871723d7ebb/users/d55ccc77ac474828a69fe02859a3a4d7/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:29.483763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abdb64-9a55-419a-b682-1f47ac93cfb7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:29.494986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abdb64-9a55-419a-b682-1f47ac93cfb7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:29.554578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1080e8-e629-4b3a-b407-19cd130845b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:29.555263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1080e8-e629-4b3a-b407-19cd130845b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:29.555543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1080e8-e629-4b3a-b407-19cd130845b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:29.555816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1080e8-e629-4b3a-b407-19cd130845b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:29.556581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1080e8-e629-4b3a-b407-19cd130845b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:29.558215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1080e8-e629-4b3a-b407-19cd130845b1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:29.568399 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3855/7672] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:31:29.572670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2d15a-3dd3-4401-a95d-5185fb8b301b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:29.583955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2d15a-3dd3-4401-a95d-5185fb8b301b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:29.589643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b7f2b-3462-40b8-ab44-09f0d265484b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:29.590538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b7f2b-3462-40b8-ab44-09f0d265484b admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:29.590823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b7f2b-3462-40b8-ab44-09f0d265484b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:29.591100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b7f2b-3462-40b8-ab44-09f0d265484b admin admin] PATH_INFO: `/v3/projects/c07e4a6d7c094175948cb871723d7ebb/users/d55ccc77ac474828a69fe02859a3a4d7/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:29.593310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b7f2b-3462-40b8-ab44-09f0d265484b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c07e4a6d7c094175948cb871723d7ebb, user_id=d55ccc77ac474828a69fe02859a3a4d7, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:29.596080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b7f2b-3462-40b8-ab44-09f0d265484b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:29.607147 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3818/7673] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:31:29 2022] PUT /identity/v3/projects/c07e4a6d7c094175948cb871723d7ebb/users/d55ccc77ac474828a69fe02859a3a4d7/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:29.618693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e911d52-2ca0-4f5b-9b21-9389c13056f9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:29.619087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e911d52-2ca0-4f5b-9b21-9389c13056f9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:29.619376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e911d52-2ca0-4f5b-9b21-9389c13056f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:29.647584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1e911d52-2ca0-4f5b-9b21-9389c13056f9 None None] MFA Rules not processed for user `d55ccc77ac474828a69fe02859a3a4d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:29.648835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1e911d52-2ca0-4f5b-9b21-9389c13056f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:29.719371 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3856/7674] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:31:29.730705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b7f2b-3462-40b8-ab44-09f0d265484b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:29.732697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-657b7f2b-3462-40b8-ab44-09f0d265484b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:29.795848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b7f2b-3462-40b8-ab44-09f0d265484b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:29.799915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72905a8-7c59-4a62-b513-20e14d9f4f04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:29.800585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72905a8-7c59-4a62-b513-20e14d9f4f04 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:29.800870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72905a8-7c59-4a62-b513-20e14d9f4f04 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:29.801141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72905a8-7c59-4a62-b513-20e14d9f4f04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:29.810911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72905a8-7c59-4a62-b513-20e14d9f4f04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:29.812436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72905a8-7c59-4a62-b513-20e14d9f4f04 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:29.822177 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3819/7675] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:29.954424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e911d52-2ca0-4f5b-9b21-9389c13056f9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:29.958935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:30.024561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e911d52-2ca0-4f5b-9b21-9389c13056f9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:30.029265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a941df7-baac-4b80-a6cb-558f301c40ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:30.030177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a941df7-baac-4b80-a6cb-558f301c40ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:30.030451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a941df7-baac-4b80-a6cb-558f301c40ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:30.030721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a941df7-baac-4b80-a6cb-558f301c40ab admin admin] PATH_INFO: `/v3/users/a67772d818764d0d8d8ed3c5ec9e9c23` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:30.031940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a941df7-baac-4b80-a6cb-558f301c40ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67772d818764d0d8d8ed3c5ec9e9c23)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:30.033910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a941df7-baac-4b80-a6cb-558f301c40ab admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:30.082970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a941df7-baac-4b80-a6cb-558f301c40ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67772d818764d0d8d8ed3c5ec9e9c23'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:30.091657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a941df7-baac-4b80-a6cb-558f301c40ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67772d818764d0d8d8ed3c5ec9e9c23'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:30.092372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a941df7-baac-4b80-a6cb-558f301c40ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67772d818764d0d8d8ed3c5ec9e9c23'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:30.093007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a941df7-baac-4b80-a6cb-558f301c40ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67772d818764d0d8d8ed3c5ec9e9c23'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:30.101561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a941df7-baac-4b80-a6cb-558f301c40ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67772d818764d0d8d8ed3c5ec9e9c23'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:30.120286 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3857/7676] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:31:29 2022] DELETE /identity/v3/users/a67772d818764d0d8d8ed3c5ec9e9c23 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:30.125141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8072190-ca65-474b-9c46-c2277124535a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:30.125515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8072190-ca65-474b-9c46-c2277124535a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:30.125805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8072190-ca65-474b-9c46-c2277124535a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:30.144278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b8072190-ca65-474b-9c46-c2277124535a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:30.145505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b8072190-ca65-474b-9c46-c2277124535a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:30.150121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:30.209559 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3820/7677] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:30.224405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a941df7-baac-4b80-a6cb-558f301c40ab admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:30.226055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4a941df7-baac-4b80-a6cb-558f301c40ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:30.286881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a941df7-baac-4b80-a6cb-558f301c40ab admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:30.290865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf7685-ad5d-49d3-aa72-391f3850f116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:30.291534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf7685-ad5d-49d3-aa72-391f3850f116 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:30.291815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf7685-ad5d-49d3-aa72-391f3850f116 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:30.292141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf7685-ad5d-49d3-aa72-391f3850f116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:30.302366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf7685-ad5d-49d3-aa72-391f3850f116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:30.304286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf7685-ad5d-49d3-aa72-391f3850f116 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:30.314117 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3858/7678] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:30.594183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8072190-ca65-474b-9c46-c2277124535a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:30.595804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b8072190-ca65-474b-9c46-c2277124535a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:30.609883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8072190-ca65-474b-9c46-c2277124535a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:30.614715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fa639-d874-4bc3-9e32-8cced0551e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:30.615599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fa639-d874-4bc3-9e32-8cced0551e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:30.616014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fa639-d874-4bc3-9e32-8cced0551e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:30.616333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fa639-d874-4bc3-9e32-8cced0551e41 admin admin] PATH_INFO: `/v3/projects/c5387975b4e049cda66e8385265cc6cf` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:30.617534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fa639-d874-4bc3-9e32-8cced0551e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5387975b4e049cda66e8385265cc6cf)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:30.619980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fa639-d874-4bc3-9e32-8cced0551e41 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:30.670050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-844fa639-d874-4bc3-9e32-8cced0551e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5387975b4e049cda66e8385265cc6cf', 'request_id': 'req-844fa639-d874-4bc3-9e32-8cced0551e41'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:30.676586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-844fa639-d874-4bc3-9e32-8cced0551e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5387975b4e049cda66e8385265cc6cf', 'request_id': 'req-844fa639-d874-4bc3-9e32-8cced0551e41'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:30.683349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-844fa639-d874-4bc3-9e32-8cced0551e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5387975b4e049cda66e8385265cc6cf', 'request_id': 'req-844fa639-d874-4bc3-9e32-8cced0551e41'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:30.698091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-844fa639-d874-4bc3-9e32-8cced0551e41 admin admin] The token cache is being invalidate because project c5387975b4e049cda66e8385265cc6cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:31:30.698384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-844fa639-d874-4bc3-9e32-8cced0551e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:30.699024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-844fa639-d874-4bc3-9e32-8cced0551e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:30.700685 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3821/7679] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:31:30 2022] DELETE /identity/v3/projects/c5387975b4e049cda66e8385265cc6cf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:30.705089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf7685-ad5d-49d3-aa72-391f3850f116 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:30.715172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf7685-ad5d-49d3-aa72-391f3850f116 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:30.735123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:30.772927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88eae00-f9ad-48f3-9b88-9adc1d555e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:30.773821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88eae00-f9ad-48f3-9b88-9adc1d555e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:30.774103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88eae00-f9ad-48f3-9b88-9adc1d555e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:30.774381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88eae00-f9ad-48f3-9b88-9adc1d555e42 admin admin] PATH_INFO: `/v3/users/d55ccc77ac474828a69fe02859a3a4d7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:30.775570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88eae00-f9ad-48f3-9b88-9adc1d555e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d55ccc77ac474828a69fe02859a3a4d7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:30.777571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88eae00-f9ad-48f3-9b88-9adc1d555e42 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:30.827856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d88eae00-f9ad-48f3-9b88-9adc1d555e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd55ccc77ac474828a69fe02859a3a4d7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:30.838262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d88eae00-f9ad-48f3-9b88-9adc1d555e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd55ccc77ac474828a69fe02859a3a4d7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:30.838961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d88eae00-f9ad-48f3-9b88-9adc1d555e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd55ccc77ac474828a69fe02859a3a4d7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:30.839621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d88eae00-f9ad-48f3-9b88-9adc1d555e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd55ccc77ac474828a69fe02859a3a4d7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:30.846923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d88eae00-f9ad-48f3-9b88-9adc1d555e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd55ccc77ac474828a69fe02859a3a4d7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:30.864868 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3859/7680] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:31:30 2022] DELETE /identity/v3/users/d55ccc77ac474828a69fe02859a3a4d7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:31.155257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fa639-d874-4bc3-9e32-8cced0551e41 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:31.157074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-844fa639-d874-4bc3-9e32-8cced0551e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:31.171932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fa639-d874-4bc3-9e32-8cced0551e41 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:31.231780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93219d3-cfd1-4522-aacb-7dee3f274313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:31.232767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93219d3-cfd1-4522-aacb-7dee3f274313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:31.233012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93219d3-cfd1-4522-aacb-7dee3f274313 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:31.233283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93219d3-cfd1-4522-aacb-7dee3f274313 admin admin] PATH_INFO: `/v3/projects/c07e4a6d7c094175948cb871723d7ebb` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:31.234465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93219d3-cfd1-4522-aacb-7dee3f274313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c07e4a6d7c094175948cb871723d7ebb)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:31.236473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93219d3-cfd1-4522-aacb-7dee3f274313 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:31.282397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:31.297524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a93219d3-cfd1-4522-aacb-7dee3f274313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c07e4a6d7c094175948cb871723d7ebb', 'request_id': 'req-a93219d3-cfd1-4522-aacb-7dee3f274313'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:31.304442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a93219d3-cfd1-4522-aacb-7dee3f274313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c07e4a6d7c094175948cb871723d7ebb', 'request_id': 'req-a93219d3-cfd1-4522-aacb-7dee3f274313'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:31.310416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a93219d3-cfd1-4522-aacb-7dee3f274313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c07e4a6d7c094175948cb871723d7ebb', 'request_id': 'req-a93219d3-cfd1-4522-aacb-7dee3f274313'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:31.324484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a93219d3-cfd1-4522-aacb-7dee3f274313 admin admin] The token cache is being invalidate because project c07e4a6d7c094175948cb871723d7ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:31:31.324770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a93219d3-cfd1-4522-aacb-7dee3f274313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:31.325519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a93219d3-cfd1-4522-aacb-7dee3f274313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:31.327106 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3822/7681] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:31:31 2022] DELETE /identity/v3/projects/c07e4a6d7c094175948cb871723d7ebb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:31.332388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a9f34-30a9-4fb6-a79a-eddf6d33937f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:31.332666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a9f34-30a9-4fb6-a79a-eddf6d33937f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:31.332956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a9f34-30a9-4fb6-a79a-eddf6d33937f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:31.352400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1f3a9f34-30a9-4fb6-a79a-eddf6d33937f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:31.353578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1f3a9f34-30a9-4fb6-a79a-eddf6d33937f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:31.415143 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3860/7682] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:31.423319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d0d8d-8823-4728-9a13-f031f20f550e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:31.423643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d0d8d-8823-4728-9a13-f031f20f550e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:31.423924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d0d8d-8823-4728-9a13-f031f20f550e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:31.445212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-768d0d8d-8823-4728-9a13-f031f20f550e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:31.446429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-768d0d8d-8823-4728-9a13-f031f20f550e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:31.455891 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3823/7683] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:31.460329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a9f34-30a9-4fb6-a79a-eddf6d33937f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:31.470625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a9f34-30a9-4fb6-a79a-eddf6d33937f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:31.477032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91256fe6-a2ed-40fb-addb-9342eb162787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:31.477708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91256fe6-a2ed-40fb-addb-9342eb162787 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:31.477994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91256fe6-a2ed-40fb-addb-9342eb162787 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:31.478282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91256fe6-a2ed-40fb-addb-9342eb162787 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:31.479009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91256fe6-a2ed-40fb-addb-9342eb162787 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:31:31.479320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91256fe6-a2ed-40fb-addb-9342eb162787 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:31.480989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91256fe6-a2ed-40fb-addb-9342eb162787 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:31.494605 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3861/7684] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:31:31.499318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d0d8d-8823-4728-9a13-f031f20f550e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:31.513216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d0d8d-8823-4728-9a13-f031f20f550e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:31.519256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff86f76-dea1-4710-bc3c-6777510f8eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:31.519942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff86f76-dea1-4710-bc3c-6777510f8eda admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:31.520262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff86f76-dea1-4710-bc3c-6777510f8eda admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:31.520538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff86f76-dea1-4710-bc3c-6777510f8eda admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:31.521246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff86f76-dea1-4710-bc3c-6777510f8eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:31.523160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff86f76-dea1-4710-bc3c-6777510f8eda admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:31.551270 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3824/7685] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:31:31 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:31:31.555779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91256fe6-a2ed-40fb-addb-9342eb162787 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:31.566652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91256fe6-a2ed-40fb-addb-9342eb162787 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:31.596820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:31.632868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23809d22-f497-45ab-ac6b-2a0de3426747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:31.633547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23809d22-f497-45ab-ac6b-2a0de3426747 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:31.633833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23809d22-f497-45ab-ac6b-2a0de3426747 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:31.634112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23809d22-f497-45ab-ac6b-2a0de3426747 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:31.634801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23809d22-f497-45ab-ac6b-2a0de3426747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:31.636848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23809d22-f497-45ab-ac6b-2a0de3426747 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:31.657843 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3862/7686] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:31:31 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:31:31.662043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff86f76-dea1-4710-bc3c-6777510f8eda admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:31.672679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff86f76-dea1-4710-bc3c-6777510f8eda admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:31.677608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2a18e-5609-4625-bed3-4fc36a9949f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:31.678611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2a18e-5609-4625-bed3-4fc36a9949f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:31.678899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2a18e-5609-4625-bed3-4fc36a9949f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:31.679176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2a18e-5609-4625-bed3-4fc36a9949f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:31.679912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2a18e-5609-4625-bed3-4fc36a9949f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:31.681554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2a18e-5609-4625-bed3-4fc36a9949f8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:31.692146 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3825/7687] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:31:31.696519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23809d22-f497-45ab-ac6b-2a0de3426747 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:31.707689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23809d22-f497-45ab-ac6b-2a0de3426747 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:31.720510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f32c3-1cf7-4f69-8297-4f3441545cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:31.721195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f32c3-1cf7-4f69-8297-4f3441545cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:31.721473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f32c3-1cf7-4f69-8297-4f3441545cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:31.721740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f32c3-1cf7-4f69-8297-4f3441545cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:31.722468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f32c3-1cf7-4f69-8297-4f3441545cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:31.724118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f32c3-1cf7-4f69-8297-4f3441545cf5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:31.735143 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3863/7688] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:31:31.740604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2a18e-5609-4625-bed3-4fc36a9949f8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:31.751518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2a18e-5609-4625-bed3-4fc36a9949f8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:31.756364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcea90-d3b0-49df-83dc-3383b4ec1280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:31.757261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcea90-d3b0-49df-83dc-3383b4ec1280 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:31.757547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcea90-d3b0-49df-83dc-3383b4ec1280 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:31.757829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcea90-d3b0-49df-83dc-3383b4ec1280 admin admin] PATH_INFO: `/v3/projects/cda4484113d34b209a3b6c4c0567d332/users/5209bb6133234c70b6a357dc217b7fe9/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:31.772983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcea90-d3b0-49df-83dc-3383b4ec1280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda4484113d34b209a3b6c4c0567d332, user_id=5209bb6133234c70b6a357dc217b7fe9, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:31.775671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcea90-d3b0-49df-83dc-3383b4ec1280 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:31.790011 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3826/7689] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:31:31 2022] PUT /identity/v3/projects/cda4484113d34b209a3b6c4c0567d332/users/5209bb6133234c70b6a357dc217b7fe9/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:31:31.800639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d4172-c41b-4b1a-a123-dcc22f7f48eb None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:31.801093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d4172-c41b-4b1a-a123-dcc22f7f48eb None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:31.801402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d4172-c41b-4b1a-a123-dcc22f7f48eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:31.831372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ca5d4172-c41b-4b1a-a123-dcc22f7f48eb None None] MFA Rules not processed for user `5209bb6133234c70b6a357dc217b7fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:31.832632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ca5d4172-c41b-4b1a-a123-dcc22f7f48eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:31.899034 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3864/7690] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:31.903755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcea90-d3b0-49df-83dc-3383b4ec1280 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:31.967499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcea90-d3b0-49df-83dc-3383b4ec1280 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:31.973767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34412b1-957b-4b43-830e-a91b25208f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:31.974422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34412b1-957b-4b43-830e-a91b25208f7a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:31.974707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34412b1-957b-4b43-830e-a91b25208f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:31.974965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34412b1-957b-4b43-830e-a91b25208f7a admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:31.975651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34412b1-957b-4b43-830e-a91b25208f7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:31.977637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34412b1-957b-4b43-830e-a91b25208f7a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:32.010823 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3827/7691] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:31:31 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:31:32.015466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d4172-c41b-4b1a-a123-dcc22f7f48eb None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:32.027354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d4172-c41b-4b1a-a123-dcc22f7f48eb None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:32.085907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038213f5-4f7b-43b3-a467-2eb419719882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:32.086581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038213f5-4f7b-43b3-a467-2eb419719882 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:32.086864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038213f5-4f7b-43b3-a467-2eb419719882 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:32.087140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038213f5-4f7b-43b3-a467-2eb419719882 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:32.087839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038213f5-4f7b-43b3-a467-2eb419719882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:32.089811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038213f5-4f7b-43b3-a467-2eb419719882 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:32.112120 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3865/7692] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:31:32 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:31:32.116298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34412b1-957b-4b43-830e-a91b25208f7a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:32.126758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34412b1-957b-4b43-830e-a91b25208f7a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:32.131586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336eb7cb-795c-4558-99dc-ece2833f1a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:32.132275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eb7cb-795c-4558-99dc-ece2833f1a57 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:32.132554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eb7cb-795c-4558-99dc-ece2833f1a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:32.132823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eb7cb-795c-4558-99dc-ece2833f1a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:32.133539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336eb7cb-795c-4558-99dc-ece2833f1a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:32.135117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336eb7cb-795c-4558-99dc-ece2833f1a57 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:32.145868 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3828/7693] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:31:32.150381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038213f5-4f7b-43b3-a467-2eb419719882 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:32.161189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038213f5-4f7b-43b3-a467-2eb419719882 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:32.166476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cc097-f293-4e18-ba38-96ba592746f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:32.167362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cc097-f293-4e18-ba38-96ba592746f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:32.167642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cc097-f293-4e18-ba38-96ba592746f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:32.167914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cc097-f293-4e18-ba38-96ba592746f2 admin admin] PATH_INFO: `/v3/projects/0b159563bc1d4d38a5b1e5e314d7ea47/users/f6aa41527d96444f941b0ed889f6a152/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:32.183040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cc097-f293-4e18-ba38-96ba592746f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b159563bc1d4d38a5b1e5e314d7ea47, user_id=f6aa41527d96444f941b0ed889f6a152, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:32.185761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cc097-f293-4e18-ba38-96ba592746f2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:32.200803 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3866/7694] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:31:32 2022] PUT /identity/v3/projects/0b159563bc1d4d38a5b1e5e314d7ea47/users/f6aa41527d96444f941b0ed889f6a152/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:32.205031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336eb7cb-795c-4558-99dc-ece2833f1a57 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:32.215719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336eb7cb-795c-4558-99dc-ece2833f1a57 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:32.247653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:32.276546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f823680-7feb-4e51-a90f-44649320bdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:32.277212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f823680-7feb-4e51-a90f-44649320bdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:32.277498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f823680-7feb-4e51-a90f-44649320bdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:32.277769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f823680-7feb-4e51-a90f-44649320bdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:32.278483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f823680-7feb-4e51-a90f-44649320bdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:32.280104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f823680-7feb-4e51-a90f-44649320bdd9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:32.289974 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3829/7695] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:31:32.294421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cc097-f293-4e18-ba38-96ba592746f2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:32.301354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:32.305932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cc097-f293-4e18-ba38-96ba592746f2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:32.312168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede411e-6037-4879-8245-91ac0d6449a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:32.313079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede411e-6037-4879-8245-91ac0d6449a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:32.313394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede411e-6037-4879-8245-91ac0d6449a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:32.313647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede411e-6037-4879-8245-91ac0d6449a0 admin admin] PATH_INFO: `/v3/projects/0b159563bc1d4d38a5b1e5e314d7ea47/users/f6aa41527d96444f941b0ed889f6a152/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:32.315752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede411e-6037-4879-8245-91ac0d6449a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b159563bc1d4d38a5b1e5e314d7ea47, user_id=f6aa41527d96444f941b0ed889f6a152, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:32.318443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede411e-6037-4879-8245-91ac0d6449a0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:32.329126 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3867/7696] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:31:32 2022] PUT /identity/v3/projects/0b159563bc1d4d38a5b1e5e314d7ea47/users/f6aa41527d96444f941b0ed889f6a152/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:32.340369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc6994-4697-4f1c-b0c2-aa9f4ec1a2f8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:32.340661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc6994-4697-4f1c-b0c2-aa9f4ec1a2f8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:32.340942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc6994-4697-4f1c-b0c2-aa9f4ec1a2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:32.369212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e6cc6994-4697-4f1c-b0c2-aa9f4ec1a2f8 None None] MFA Rules not processed for user `f6aa41527d96444f941b0ed889f6a152`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:32.370465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e6cc6994-4697-4f1c-b0c2-aa9f4ec1a2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:32.438604 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3830/7697] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:31:32.452757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede411e-6037-4879-8245-91ac0d6449a0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:32.454872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fede411e-6037-4879-8245-91ac0d6449a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:32.515362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede411e-6037-4879-8245-91ac0d6449a0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:32.519439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f5a9e-92f4-4a58-825c-808332ef625b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:32.520124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f5a9e-92f4-4a58-825c-808332ef625b service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:32.520410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f5a9e-92f4-4a58-825c-808332ef625b service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:32.520689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f5a9e-92f4-4a58-825c-808332ef625b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:32.530274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f5a9e-92f4-4a58-825c-808332ef625b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:32.531821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f5a9e-92f4-4a58-825c-808332ef625b service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:32.541633 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3868/7698] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:32.612856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc6994-4697-4f1c-b0c2-aa9f4ec1a2f8 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:32.614424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e6cc6994-4697-4f1c-b0c2-aa9f4ec1a2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:32.629137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc6994-4697-4f1c-b0c2-aa9f4ec1a2f8 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:32.632934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0830fb6-acae-4d53-b87c-d1ec623498ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:32.633578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0830fb6-acae-4d53-b87c-d1ec623498ab service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:32.633860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0830fb6-acae-4d53-b87c-d1ec623498ab service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:32.634168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0830fb6-acae-4d53-b87c-d1ec623498ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:32.691706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0830fb6-acae-4d53-b87c-d1ec623498ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:32.693098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0830fb6-acae-4d53-b87c-d1ec623498ab service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:32.702207 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3831/7699] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:32.985833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f5a9e-92f4-4a58-825c-808332ef625b service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:33.049991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f5a9e-92f4-4a58-825c-808332ef625b service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:33.055395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc6d77-1f6b-49ab-b51d-cd267d2deea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:33.056298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc6d77-1f6b-49ab-b51d-cd267d2deea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:33.056574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc6d77-1f6b-49ab-b51d-cd267d2deea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:33.056843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc6d77-1f6b-49ab-b51d-cd267d2deea8 admin admin] PATH_INFO: `/v3/users/5209bb6133234c70b6a357dc217b7fe9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:33.058126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc6d77-1f6b-49ab-b51d-cd267d2deea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5209bb6133234c70b6a357dc217b7fe9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:33.060414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc6d77-1f6b-49ab-b51d-cd267d2deea8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:33.114030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-69dc6d77-1f6b-49ab-b51d-cd267d2deea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5209bb6133234c70b6a357dc217b7fe9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:33.122088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-69dc6d77-1f6b-49ab-b51d-cd267d2deea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5209bb6133234c70b6a357dc217b7fe9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:33.122797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-69dc6d77-1f6b-49ab-b51d-cd267d2deea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5209bb6133234c70b6a357dc217b7fe9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:33.123500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-69dc6d77-1f6b-49ab-b51d-cd267d2deea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5209bb6133234c70b6a357dc217b7fe9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:33.131284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-69dc6d77-1f6b-49ab-b51d-cd267d2deea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5209bb6133234c70b6a357dc217b7fe9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:33.149972 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3869/7700] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:31:32 2022] DELETE /identity/v3/users/5209bb6133234c70b6a357dc217b7fe9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:33.154965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b505e-3bef-4072-9d26-174f80c8256b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:33.155255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b505e-3bef-4072-9d26-174f80c8256b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:33.155528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b505e-3bef-4072-9d26-174f80c8256b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:33.175997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-884b505e-3bef-4072-9d26-174f80c8256b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:33.177230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-884b505e-3bef-4072-9d26-174f80c8256b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:33.225997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:33.239550 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3832/7701] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:33.249993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc6d77-1f6b-49ab-b51d-cd267d2deea8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:33.251808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-69dc6d77-1f6b-49ab-b51d-cd267d2deea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:33.267366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:33.314613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc6d77-1f6b-49ab-b51d-cd267d2deea8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:33.318787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b6c54-1472-4940-b95a-128315145510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:33.319430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b6c54-1472-4940-b95a-128315145510 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:33.319712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b6c54-1472-4940-b95a-128315145510 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:33.319988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b6c54-1472-4940-b95a-128315145510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:33.329664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b6c54-1472-4940-b95a-128315145510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:33.331134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b6c54-1472-4940-b95a-128315145510 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:33.340703 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3870/7702] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:33.619949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b505e-3bef-4072-9d26-174f80c8256b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:33.621451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-884b505e-3bef-4072-9d26-174f80c8256b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:33.635716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b505e-3bef-4072-9d26-174f80c8256b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:33.642756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2770475-cb45-4f26-a873-1b85d6fe78d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:33.643637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2770475-cb45-4f26-a873-1b85d6fe78d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:33.643948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2770475-cb45-4f26-a873-1b85d6fe78d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:33.644252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2770475-cb45-4f26-a873-1b85d6fe78d0 admin admin] PATH_INFO: `/v3/projects/cda4484113d34b209a3b6c4c0567d332` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:33.648220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2770475-cb45-4f26-a873-1b85d6fe78d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda4484113d34b209a3b6c4c0567d332)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:33.654603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2770475-cb45-4f26-a873-1b85d6fe78d0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:33.706988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f2770475-cb45-4f26-a873-1b85d6fe78d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda4484113d34b209a3b6c4c0567d332', 'request_id': 'req-f2770475-cb45-4f26-a873-1b85d6fe78d0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:33.713354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f2770475-cb45-4f26-a873-1b85d6fe78d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda4484113d34b209a3b6c4c0567d332', 'request_id': 'req-f2770475-cb45-4f26-a873-1b85d6fe78d0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:33.719276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f2770475-cb45-4f26-a873-1b85d6fe78d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda4484113d34b209a3b6c4c0567d332', 'request_id': 'req-f2770475-cb45-4f26-a873-1b85d6fe78d0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:33.733081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f2770475-cb45-4f26-a873-1b85d6fe78d0 admin admin] The token cache is being invalidate because project cda4484113d34b209a3b6c4c0567d332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:31:33.733302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f2770475-cb45-4f26-a873-1b85d6fe78d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:33.733921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f2770475-cb45-4f26-a873-1b85d6fe78d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:33.735608 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3833/7703] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:31:33 2022] DELETE /identity/v3/projects/cda4484113d34b209a3b6c4c0567d332 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:33.739812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b6c54-1472-4940-b95a-128315145510 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:33.750391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b6c54-1472-4940-b95a-128315145510 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:33.815611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233db94-75c3-4ce3-a3c4-2d200f972b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:33.816559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233db94-75c3-4ce3-a3c4-2d200f972b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:33.816841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233db94-75c3-4ce3-a3c4-2d200f972b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:33.817115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233db94-75c3-4ce3-a3c4-2d200f972b9b admin admin] PATH_INFO: `/v3/users/f6aa41527d96444f941b0ed889f6a152` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:33.818317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233db94-75c3-4ce3-a3c4-2d200f972b9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6aa41527d96444f941b0ed889f6a152)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:33.820319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233db94-75c3-4ce3-a3c4-2d200f972b9b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:33.877038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b233db94-75c3-4ce3-a3c4-2d200f972b9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6aa41527d96444f941b0ed889f6a152'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:33.885737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b233db94-75c3-4ce3-a3c4-2d200f972b9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6aa41527d96444f941b0ed889f6a152'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:33.886380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b233db94-75c3-4ce3-a3c4-2d200f972b9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6aa41527d96444f941b0ed889f6a152'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:33.887005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b233db94-75c3-4ce3-a3c4-2d200f972b9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6aa41527d96444f941b0ed889f6a152'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:33.894208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b233db94-75c3-4ce3-a3c4-2d200f972b9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6aa41527d96444f941b0ed889f6a152'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:33.911976 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3871/7704] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:31:33 2022] DELETE /identity/v3/users/f6aa41527d96444f941b0ed889f6a152 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:34.197650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2770475-cb45-4f26-a873-1b85d6fe78d0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:34.199206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f2770475-cb45-4f26-a873-1b85d6fe78d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:34.213672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2770475-cb45-4f26-a873-1b85d6fe78d0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:34.276367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f04124-14e6-4f7a-b670-dedcf67bea4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:34.277199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f04124-14e6-4f7a-b670-dedcf67bea4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:34.277469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f04124-14e6-4f7a-b670-dedcf67bea4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:34.277739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f04124-14e6-4f7a-b670-dedcf67bea4e admin admin] PATH_INFO: `/v3/projects/0b159563bc1d4d38a5b1e5e314d7ea47` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:34.278923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f04124-14e6-4f7a-b670-dedcf67bea4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b159563bc1d4d38a5b1e5e314d7ea47)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:34.280864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f04124-14e6-4f7a-b670-dedcf67bea4e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:34.332023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f6f04124-14e6-4f7a-b670-dedcf67bea4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b159563bc1d4d38a5b1e5e314d7ea47', 'request_id': 'req-f6f04124-14e6-4f7a-b670-dedcf67bea4e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:34.338153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f6f04124-14e6-4f7a-b670-dedcf67bea4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b159563bc1d4d38a5b1e5e314d7ea47', 'request_id': 'req-f6f04124-14e6-4f7a-b670-dedcf67bea4e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:34.344294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f6f04124-14e6-4f7a-b670-dedcf67bea4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b159563bc1d4d38a5b1e5e314d7ea47', 'request_id': 'req-f6f04124-14e6-4f7a-b670-dedcf67bea4e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:34.360109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f6f04124-14e6-4f7a-b670-dedcf67bea4e admin admin] The token cache is being invalidate because project 0b159563bc1d4d38a5b1e5e314d7ea47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:31:34.360394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f6f04124-14e6-4f7a-b670-dedcf67bea4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:34.361029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f6f04124-14e6-4f7a-b670-dedcf67bea4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:31:34.362596 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3834/7705] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:31:34 2022] DELETE /identity/v3/projects/0b159563bc1d4d38a5b1e5e314d7ea47 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:34.367608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7be4ba-2304-465f-902a-34ac7f9251ab None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:34.368133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7be4ba-2304-465f-902a-34ac7f9251ab None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:34.368263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7be4ba-2304-465f-902a-34ac7f9251ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:34.386466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8c7be4ba-2304-465f-902a-34ac7f9251ab None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:34.387683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8c7be4ba-2304-465f-902a-34ac7f9251ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:34.422852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:34.455126 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3872/7706] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:34.463879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee661fb-364d-4020-80fb-c50a87997492 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:34.464195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee661fb-364d-4020-80fb-c50a87997492 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:34.464469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee661fb-364d-4020-80fb-c50a87997492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:34.477983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:34.484986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fee661fb-364d-4020-80fb-c50a87997492 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:34.486757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fee661fb-364d-4020-80fb-c50a87997492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:34.495732 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3835/7707] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:34.500243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7be4ba-2304-465f-902a-34ac7f9251ab None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:34.510365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7be4ba-2304-465f-902a-34ac7f9251ab None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:34.516122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f8be7-0955-4d25-ae59-f886d2852055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:34.516778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f8be7-0955-4d25-ae59-f886d2852055 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:34.517057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f8be7-0955-4d25-ae59-f886d2852055 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:34.517328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f8be7-0955-4d25-ae59-f886d2852055 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:34.518051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f8be7-0955-4d25-ae59-f886d2852055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:31:34.518396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f8be7-0955-4d25-ae59-f886d2852055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:34.520033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f8be7-0955-4d25-ae59-f886d2852055 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:34.532449 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3873/7708] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:31:34.536805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee661fb-364d-4020-80fb-c50a87997492 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:34.546559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee661fb-364d-4020-80fb-c50a87997492 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:34.551981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a5a77-1910-454a-846b-0ecaa2225670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:34.552693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a5a77-1910-454a-846b-0ecaa2225670 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:34.552990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a5a77-1910-454a-846b-0ecaa2225670 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:34.553588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a5a77-1910-454a-846b-0ecaa2225670 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:34.554273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a5a77-1910-454a-846b-0ecaa2225670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:34.556208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a5a77-1910-454a-846b-0ecaa2225670 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:34.585054 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3836/7709] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:31:34 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:31:34.589753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f8be7-0955-4d25-ae59-f886d2852055 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:34.600118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f8be7-0955-4d25-ae59-f886d2852055 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:34.664511 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745add74-4847-4a5b-8b89-db5d62169919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:34.665258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745add74-4847-4a5b-8b89-db5d62169919 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:34.665570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745add74-4847-4a5b-8b89-db5d62169919 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:34.665847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745add74-4847-4a5b-8b89-db5d62169919 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:34.666555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745add74-4847-4a5b-8b89-db5d62169919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:34.668524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745add74-4847-4a5b-8b89-db5d62169919 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:34.693556 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3874/7710] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:31:34 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:31:34.694654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a5a77-1910-454a-846b-0ecaa2225670 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:34.706067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a5a77-1910-454a-846b-0ecaa2225670 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:34.712187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e5fe5-5627-4533-a79a-a2d5d85620c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:34.712898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e5fe5-5627-4533-a79a-a2d5d85620c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:34.713189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e5fe5-5627-4533-a79a-a2d5d85620c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:34.713472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e5fe5-5627-4533-a79a-a2d5d85620c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:34.714204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e5fe5-5627-4533-a79a-a2d5d85620c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:34.715806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e5fe5-5627-4533-a79a-a2d5d85620c2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:34.730231 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3837/7711] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:31:34.731836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745add74-4847-4a5b-8b89-db5d62169919 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:34.742773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745add74-4847-4a5b-8b89-db5d62169919 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:34.748124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c232a0-cbba-49a4-9e56-d01b4bae2b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:34.748793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c232a0-cbba-49a4-9e56-d01b4bae2b18 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:34.749083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c232a0-cbba-49a4-9e56-d01b4bae2b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:34.749368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c232a0-cbba-49a4-9e56-d01b4bae2b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:34.750086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c232a0-cbba-49a4-9e56-d01b4bae2b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:34.751858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c232a0-cbba-49a4-9e56-d01b4bae2b18 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:34.764283 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3875/7712] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:31:34.768731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e5fe5-5627-4533-a79a-a2d5d85620c2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:34.779331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e5fe5-5627-4533-a79a-a2d5d85620c2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:34.784665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fd5ce-d60c-4bcf-9961-30cebbbf58a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:34.785504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fd5ce-d60c-4bcf-9961-30cebbbf58a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:34.785788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fd5ce-d60c-4bcf-9961-30cebbbf58a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:34.786067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fd5ce-d60c-4bcf-9961-30cebbbf58a5 admin admin] PATH_INFO: `/v3/projects/6cb4e38dc4144c839e51ae6332b9ae68/users/703991a781474b48a1bfe5dca0fac66f/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:34.801649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fd5ce-d60c-4bcf-9961-30cebbbf58a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb4e38dc4144c839e51ae6332b9ae68, user_id=703991a781474b48a1bfe5dca0fac66f, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:34.804840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fd5ce-d60c-4bcf-9961-30cebbbf58a5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:34.819470 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3838/7713] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:31:34 2022] PUT /identity/v3/projects/6cb4e38dc4144c839e51ae6332b9ae68/users/703991a781474b48a1bfe5dca0fac66f/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:34.824785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b94b13-ff6d-47c7-a7db-9c8a251b60fb None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:34.825059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b94b13-ff6d-47c7-a7db-9c8a251b60fb None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:34.825335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b94b13-ff6d-47c7-a7db-9c8a251b60fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:34.843253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-02b94b13-ff6d-47c7-a7db-9c8a251b60fb None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:34.844618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-02b94b13-ff6d-47c7-a7db-9c8a251b60fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:34.904875 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3876/7714] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:34.914825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fd5ce-d60c-4bcf-9961-30cebbbf58a5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:34.916713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c74fd5ce-d60c-4bcf-9961-30cebbbf58a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:34.977647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fd5ce-d60c-4bcf-9961-30cebbbf58a5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:34.981725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c950aa6-3c9d-46b1-930f-79ab4fc992c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:34.982369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c950aa6-3c9d-46b1-930f-79ab4fc992c2 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:34.982655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c950aa6-3c9d-46b1-930f-79ab4fc992c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:34.982930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c950aa6-3c9d-46b1-930f-79ab4fc992c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:34.992533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c950aa6-3c9d-46b1-930f-79ab4fc992c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:34.993986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c950aa6-3c9d-46b1-930f-79ab4fc992c2 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:35.003677 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3839/7715] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:35.690331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2e2ab-fb14-415a-b518-59b06b25fbe8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:35.690887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2e2ab-fb14-415a-b518-59b06b25fbe8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:35.690887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2e2ab-fb14-415a-b518-59b06b25fbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:35.717987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3be2e2ab-fb14-415a-b518-59b06b25fbe8 None None] MFA Rules not processed for user `703991a781474b48a1bfe5dca0fac66f`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:35.719290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3be2e2ab-fb14-415a-b518-59b06b25fbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:35.755480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:35.807178 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3877/7716] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:35.811878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c950aa6-3c9d-46b1-930f-79ab4fc992c2 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:35.826024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c950aa6-3c9d-46b1-930f-79ab4fc992c2 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:35.831348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9023d-d5ca-4853-ac6f-fcd546169a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:35.832019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9023d-d5ca-4853-ac6f-fcd546169a99 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:35.832337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9023d-d5ca-4853-ac6f-fcd546169a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:35.832617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9023d-d5ca-4853-ac6f-fcd546169a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:35.833307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9023d-d5ca-4853-ac6f-fcd546169a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:35.835225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9023d-d5ca-4853-ac6f-fcd546169a99 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:35.862160 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3840/7717] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:31:35 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:31:35.866567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2e2ab-fb14-415a-b518-59b06b25fbe8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:35.877768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2e2ab-fb14-415a-b518-59b06b25fbe8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:35.934285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea842e-187f-4b7a-a406-743c5872a0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:35.934968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea842e-187f-4b7a-a406-743c5872a0cd admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:35.935253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea842e-187f-4b7a-a406-743c5872a0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:35.935537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea842e-187f-4b7a-a406-743c5872a0cd admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:35.936260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea842e-187f-4b7a-a406-743c5872a0cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:35.938278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea842e-187f-4b7a-a406-743c5872a0cd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:35.960828 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3878/7718] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:31:35 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:31:35.965049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9023d-d5ca-4853-ac6f-fcd546169a99 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:35.976121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9023d-d5ca-4853-ac6f-fcd546169a99 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:35.981697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8d0e7-1b2c-4552-b837-4066d0616f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:35.982456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8d0e7-1b2c-4552-b837-4066d0616f0e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:35.982736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8d0e7-1b2c-4552-b837-4066d0616f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:35.983007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8d0e7-1b2c-4552-b837-4066d0616f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:35.983720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8d0e7-1b2c-4552-b837-4066d0616f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:35.985416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8d0e7-1b2c-4552-b837-4066d0616f0e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:35.996502 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3841/7719] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:31:36.000778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea842e-187f-4b7a-a406-743c5872a0cd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:36.011099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea842e-187f-4b7a-a406-743c5872a0cd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:36.016129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b627b-4974-4685-bfd9-35749e06d1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:36.017014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b627b-4974-4685-bfd9-35749e06d1c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:36.017298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b627b-4974-4685-bfd9-35749e06d1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:36.017582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b627b-4974-4685-bfd9-35749e06d1c2 admin admin] PATH_INFO: `/v3/projects/3272e7868c4c40b888cb9bfe09599a53/users/bed8ebf8855d44b7b65e25f718435aea/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:36.032901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b627b-4974-4685-bfd9-35749e06d1c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3272e7868c4c40b888cb9bfe09599a53, user_id=bed8ebf8855d44b7b65e25f718435aea, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:36.035583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b627b-4974-4685-bfd9-35749e06d1c2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:36.050583 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3879/7720] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:31:35 2022] PUT /identity/v3/projects/3272e7868c4c40b888cb9bfe09599a53/users/bed8ebf8855d44b7b65e25f718435aea/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:36.054998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8d0e7-1b2c-4552-b837-4066d0616f0e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:36.066235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8d0e7-1b2c-4552-b837-4066d0616f0e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:36.133991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ebcf6-5668-405f-a190-1c5328d56569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:36.134619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ebcf6-5668-405f-a190-1c5328d56569 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:36.134902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ebcf6-5668-405f-a190-1c5328d56569 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:36.135175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ebcf6-5668-405f-a190-1c5328d56569 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:36.135929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ebcf6-5668-405f-a190-1c5328d56569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:36.137608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ebcf6-5668-405f-a190-1c5328d56569 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:36.148651 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3842/7721] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:31:36.153351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b627b-4974-4685-bfd9-35749e06d1c2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:36.165194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b627b-4974-4685-bfd9-35749e06d1c2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:36.170461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f48ef-5fe9-4a28-9389-57d0b6f620e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:36.171345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f48ef-5fe9-4a28-9389-57d0b6f620e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:36.171623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f48ef-5fe9-4a28-9389-57d0b6f620e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:36.171893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f48ef-5fe9-4a28-9389-57d0b6f620e8 admin admin] PATH_INFO: `/v3/projects/3272e7868c4c40b888cb9bfe09599a53/users/bed8ebf8855d44b7b65e25f718435aea/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:36.174041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f48ef-5fe9-4a28-9389-57d0b6f620e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3272e7868c4c40b888cb9bfe09599a53, user_id=bed8ebf8855d44b7b65e25f718435aea, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:36.176767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f48ef-5fe9-4a28-9389-57d0b6f620e8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:36.188508 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3880/7722] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:31:36 2022] PUT /identity/v3/projects/3272e7868c4c40b888cb9bfe09599a53/users/bed8ebf8855d44b7b65e25f718435aea/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:31:36.847587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a48eb3-2222-4ea6-8a38-14aeb0029326 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:36.848115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a48eb3-2222-4ea6-8a38-14aeb0029326 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:36.848115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a48eb3-2222-4ea6-8a38-14aeb0029326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:36.867135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:36.878438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-49a48eb3-2222-4ea6-8a38-14aeb0029326 None None] MFA Rules not processed for user `bed8ebf8855d44b7b65e25f718435aea`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:36.879658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-49a48eb3-2222-4ea6-8a38-14aeb0029326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:36.952919 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3843/7723] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:31:36.963957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2cba4-d30c-4bfe-80fa-923b42d449ea None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:36.964735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2cba4-d30c-4bfe-80fa-923b42d449ea None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:36.964735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2cba4-d30c-4bfe-80fa-923b42d449ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:36.982524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d5b2cba4-d30c-4bfe-80fa-923b42d449ea None None] MFA Rules not processed for user `703991a781474b48a1bfe5dca0fac66f`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:36.983763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d5b2cba4-d30c-4bfe-80fa-923b42d449ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:37.041860 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3881/7724] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:31:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:31:37.056621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a48eb3-2222-4ea6-8a38-14aeb0029326 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:37.058120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-49a48eb3-2222-4ea6-8a38-14aeb0029326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:37.136347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a48eb3-2222-4ea6-8a38-14aeb0029326 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:37.142239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747a60d-c65d-4dde-8a34-da297fd1d3e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:37.142884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747a60d-c65d-4dde-8a34-da297fd1d3e8 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:37.143168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747a60d-c65d-4dde-8a34-da297fd1d3e8 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:37.143447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747a60d-c65d-4dde-8a34-da297fd1d3e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:37.151519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747a60d-c65d-4dde-8a34-da297fd1d3e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:37.153136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747a60d-c65d-4dde-8a34-da297fd1d3e8 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:37.162260 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3844/7725] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:37.751269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2cba4-d30c-4bfe-80fa-923b42d449ea None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:37.752763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d5b2cba4-d30c-4bfe-80fa-923b42d449ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:37.792457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:37.852992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2cba4-d30c-4bfe-80fa-923b42d449ea None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:37.859810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2981e-98fb-49ac-a1db-cc025d03a1c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:37.860525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2981e-98fb-49ac-a1db-cc025d03a1c7 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:37.860805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2981e-98fb-49ac-a1db-cc025d03a1c7 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:37.861070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2981e-98fb-49ac-a1db-cc025d03a1c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:37.863182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ecb2981e-98fb-49ac-a1db-cc025d03a1c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:37.878352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2981e-98fb-49ac-a1db-cc025d03a1c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:37.879973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2981e-98fb-49ac-a1db-cc025d03a1c7 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:37.892339 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3882/7726] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:47.158823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=64 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:47.886007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=24 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:55.769807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747a60d-c65d-4dde-8a34-da297fd1d3e8 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:55.771326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d747a60d-c65d-4dde-8a34-da297fd1d3e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:55.838674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747a60d-c65d-4dde-8a34-da297fd1d3e8 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:55.842825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa0045-c163-49bf-8c4f-51a5f14f30cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:55.843566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa0045-c163-49bf-8c4f-51a5f14f30cc service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:55.844608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa0045-c163-49bf-8c4f-51a5f14f30cc service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:55.844906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa0045-c163-49bf-8c4f-51a5f14f30cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:55.846940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f3aa0045-c163-49bf-8c4f-51a5f14f30cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:55.861441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa0045-c163-49bf-8c4f-51a5f14f30cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:55.863101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa0045-c163-49bf-8c4f-51a5f14f30cc service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:55.877026 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3845/7727] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:55.973268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2199f89-54cc-4c66-bbab-670037389055 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:55.973860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2199f89-54cc-4c66-bbab-670037389055 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:55.973963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2199f89-54cc-4c66-bbab-670037389055 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:55.975348 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3883/7728] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:31:55.980558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15169e9-3f6e-42ef-a4fa-53eb4753408e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:55.980851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15169e9-3f6e-42ef-a4fa-53eb4753408e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:55.981129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15169e9-3f6e-42ef-a4fa-53eb4753408e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:56.011139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d15169e9-3f6e-42ef-a4fa-53eb4753408e None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:31:56.012399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d15169e9-3f6e-42ef-a4fa-53eb4753408e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:56.021767 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3846/7729] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:31:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:31:56.043023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2199f89-54cc-4c66-bbab-670037389055 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:56.045012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f2199f89-54cc-4c66-bbab-670037389055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:56.065914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2199f89-54cc-4c66-bbab-670037389055 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:56.070991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee7709-1bd5-4ac7-b164-d779c9ebeca4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:56.071640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee7709-1bd5-4ac7-b164-d779c9ebeca4 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:56.071924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee7709-1bd5-4ac7-b164-d779c9ebeca4 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:56.072240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee7709-1bd5-4ac7-b164-d779c9ebeca4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:56.081163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee7709-1bd5-4ac7-b164-d779c9ebeca4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:56.082883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee7709-1bd5-4ac7-b164-d779c9ebeca4 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:56.094223 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3884/7730] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:56.275995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15169e9-3f6e-42ef-a4fa-53eb4753408e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:56.288608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15169e9-3f6e-42ef-a4fa-53eb4753408e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:56.293141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58f047-96d2-46fa-b7ce-884317d10522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:56.293789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58f047-96d2-46fa-b7ce-884317d10522 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:56.294072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58f047-96d2-46fa-b7ce-884317d10522 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:56.294349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58f047-96d2-46fa-b7ce-884317d10522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:56.296227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ec58f047-96d2-46fa-b7ce-884317d10522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:56.312203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58f047-96d2-46fa-b7ce-884317d10522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:56.313636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58f047-96d2-46fa-b7ce-884317d10522 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:56.326766 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3847/7731] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:31:57.242743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee7709-1bd5-4ac7-b164-d779c9ebeca4 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:31:57.255627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee7709-1bd5-4ac7-b164-d779c9ebeca4 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:31:57.259523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacc17d-5fea-47fb-b7c6-f96ae68a551a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:31:57.260210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacc17d-5fea-47fb-b7c6-f96ae68a551a service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:31:57.260619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacc17d-5fea-47fb-b7c6-f96ae68a551a service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:31:57.260904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacc17d-5fea-47fb-b7c6-f96ae68a551a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:31:57.262689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6bacc17d-5fea-47fb-b7c6-f96ae68a551a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:31:57.275289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bacc17d-5fea-47fb-b7c6-f96ae68a551a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:31:57.276777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bacc17d-5fea-47fb-b7c6-f96ae68a551a service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:31:57.287473 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3885/7732] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:31:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:32:03.608064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58f047-96d2-46fa-b7ce-884317d10522 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:03.676595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58f047-96d2-46fa-b7ce-884317d10522 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:03.682805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4af0a-a1c3-45c3-8e9c-24a636e6273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:03.683755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4af0a-a1c3-45c3-8e9c-24a636e6273d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:03.684058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4af0a-a1c3-45c3-8e9c-24a636e6273d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:03.684349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4af0a-a1c3-45c3-8e9c-24a636e6273d admin admin] PATH_INFO: `/v3/users/703991a781474b48a1bfe5dca0fac66f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:03.685753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4af0a-a1c3-45c3-8e9c-24a636e6273d admin admin] RBAC: Authorizing `identity:delete_user(user_id=703991a781474b48a1bfe5dca0fac66f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:03.687712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4af0a-a1c3-45c3-8e9c-24a636e6273d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:03.744703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e2f4af0a-a1c3-45c3-8e9c-24a636e6273d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '703991a781474b48a1bfe5dca0fac66f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:03.755728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e2f4af0a-a1c3-45c3-8e9c-24a636e6273d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '703991a781474b48a1bfe5dca0fac66f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:03.763968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e2f4af0a-a1c3-45c3-8e9c-24a636e6273d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '703991a781474b48a1bfe5dca0fac66f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:03.764910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e2f4af0a-a1c3-45c3-8e9c-24a636e6273d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '703991a781474b48a1bfe5dca0fac66f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:03.765701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e2f4af0a-a1c3-45c3-8e9c-24a636e6273d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '703991a781474b48a1bfe5dca0fac66f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:03.777469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:03.786373 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3848/7733] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:32:03 2022] DELETE /identity/v3/users/703991a781474b48a1bfe5dca0fac66f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:03.975186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacc17d-5fea-47fb-b7c6-f96ae68a551a service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:03.987642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacc17d-5fea-47fb-b7c6-f96ae68a551a service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:04.049129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f5ff4-0c3e-47df-ab7d-0a5fd5655357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:04.050011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f5ff4-0c3e-47df-ab7d-0a5fd5655357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:04.050297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f5ff4-0c3e-47df-ab7d-0a5fd5655357 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:04.050599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f5ff4-0c3e-47df-ab7d-0a5fd5655357 admin admin] PATH_INFO: `/v3/projects/6cb4e38dc4144c839e51ae6332b9ae68` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:04.051789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f5ff4-0c3e-47df-ab7d-0a5fd5655357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb4e38dc4144c839e51ae6332b9ae68)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:04.058445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f5ff4-0c3e-47df-ab7d-0a5fd5655357 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:04.116064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-650f5ff4-0c3e-47df-ab7d-0a5fd5655357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb4e38dc4144c839e51ae6332b9ae68', 'request_id': 'req-650f5ff4-0c3e-47df-ab7d-0a5fd5655357'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:04.127027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-650f5ff4-0c3e-47df-ab7d-0a5fd5655357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb4e38dc4144c839e51ae6332b9ae68', 'request_id': 'req-650f5ff4-0c3e-47df-ab7d-0a5fd5655357'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:04.135359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-650f5ff4-0c3e-47df-ab7d-0a5fd5655357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb4e38dc4144c839e51ae6332b9ae68', 'request_id': 'req-650f5ff4-0c3e-47df-ab7d-0a5fd5655357'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:04.151761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-650f5ff4-0c3e-47df-ab7d-0a5fd5655357 admin admin] The token cache is being invalidate because project 6cb4e38dc4144c839e51ae6332b9ae68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:32:04.152063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-650f5ff4-0c3e-47df-ab7d-0a5fd5655357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:04.152738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-650f5ff4-0c3e-47df-ab7d-0a5fd5655357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:04.154422 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3886/7734] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:32:03 2022] DELETE /identity/v3/projects/6cb4e38dc4144c839e51ae6332b9ae68 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:04.158744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4af0a-a1c3-45c3-8e9c-24a636e6273d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:04.160416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e2f4af0a-a1c3-45c3-8e9c-24a636e6273d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:04.173732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4af0a-a1c3-45c3-8e9c-24a636e6273d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:04.240029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b057bba-7102-4981-a712-bb10597e1085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:04.240978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b057bba-7102-4981-a712-bb10597e1085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:04.241313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b057bba-7102-4981-a712-bb10597e1085 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:04.241591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b057bba-7102-4981-a712-bb10597e1085 admin admin] PATH_INFO: `/v3/users/bed8ebf8855d44b7b65e25f718435aea` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:04.242940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b057bba-7102-4981-a712-bb10597e1085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed8ebf8855d44b7b65e25f718435aea)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:04.244927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b057bba-7102-4981-a712-bb10597e1085 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:04.293382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6b057bba-7102-4981-a712-bb10597e1085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed8ebf8855d44b7b65e25f718435aea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:04.301242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6b057bba-7102-4981-a712-bb10597e1085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed8ebf8855d44b7b65e25f718435aea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:04.309589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6b057bba-7102-4981-a712-bb10597e1085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed8ebf8855d44b7b65e25f718435aea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:04.310245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6b057bba-7102-4981-a712-bb10597e1085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed8ebf8855d44b7b65e25f718435aea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:04.310901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-6b057bba-7102-4981-a712-bb10597e1085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed8ebf8855d44b7b65e25f718435aea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:04.328978 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3849/7735] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:32:04 2022] DELETE /identity/v3/users/bed8ebf8855d44b7b65e25f718435aea => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:04.515340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f5ff4-0c3e-47df-ab7d-0a5fd5655357 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:04.517478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-650f5ff4-0c3e-47df-ab7d-0a5fd5655357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:04.544311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f5ff4-0c3e-47df-ab7d-0a5fd5655357 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:04.610793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ceb34-a349-45b2-a4f8-fcf7c361bd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:04.612074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ceb34-a349-45b2-a4f8-fcf7c361bd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:04.612074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ceb34-a349-45b2-a4f8-fcf7c361bd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:04.612304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ceb34-a349-45b2-a4f8-fcf7c361bd03 admin admin] PATH_INFO: `/v3/projects/3272e7868c4c40b888cb9bfe09599a53` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:04.613563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ceb34-a349-45b2-a4f8-fcf7c361bd03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3272e7868c4c40b888cb9bfe09599a53)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:04.615408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ceb34-a349-45b2-a4f8-fcf7c361bd03 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:04.622307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:04.675572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-725ceb34-a349-45b2-a4f8-fcf7c361bd03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3272e7868c4c40b888cb9bfe09599a53', 'request_id': 'req-725ceb34-a349-45b2-a4f8-fcf7c361bd03'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:04.684008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-725ceb34-a349-45b2-a4f8-fcf7c361bd03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3272e7868c4c40b888cb9bfe09599a53', 'request_id': 'req-725ceb34-a349-45b2-a4f8-fcf7c361bd03'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:04.690348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-725ceb34-a349-45b2-a4f8-fcf7c361bd03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3272e7868c4c40b888cb9bfe09599a53', 'request_id': 'req-725ceb34-a349-45b2-a4f8-fcf7c361bd03'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:04.700803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-725ceb34-a349-45b2-a4f8-fcf7c361bd03 admin admin] The token cache is being invalidate because project 3272e7868c4c40b888cb9bfe09599a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:32:04.701090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-725ceb34-a349-45b2-a4f8-fcf7c361bd03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:04.701727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-725ceb34-a349-45b2-a4f8-fcf7c361bd03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:04.703308 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3887/7736] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:32:04 2022] DELETE /identity/v3/projects/3272e7868c4c40b888cb9bfe09599a53 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:04.708380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2328a-3ed5-4431-88a6-a08c292ade6a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:04.708899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2328a-3ed5-4431-88a6-a08c292ade6a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:04.709004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2328a-3ed5-4431-88a6-a08c292ade6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:04.726657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f4a2328a-3ed5-4431-88a6-a08c292ade6a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:04.727902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f4a2328a-3ed5-4431-88a6-a08c292ade6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:04.792157 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3850/7737] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:04.800981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b5a3b-80dd-445a-9f40-6fd7b7b1124d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:04.801403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b5a3b-80dd-445a-9f40-6fd7b7b1124d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:04.801738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b5a3b-80dd-445a-9f40-6fd7b7b1124d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:04.822510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-941b5a3b-80dd-445a-9f40-6fd7b7b1124d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:04.823746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-941b5a3b-80dd-445a-9f40-6fd7b7b1124d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:04.833115 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3888/7738] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:04.837705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2328a-3ed5-4431-88a6-a08c292ade6a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:04.847656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2328a-3ed5-4431-88a6-a08c292ade6a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:04.852779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d43f5-73f5-42c2-bbfd-25e6f3c13061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:04.853462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d43f5-73f5-42c2-bbfd-25e6f3c13061 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:04.853726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d43f5-73f5-42c2-bbfd-25e6f3c13061 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:04.854002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d43f5-73f5-42c2-bbfd-25e6f3c13061 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:04.854879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d43f5-73f5-42c2-bbfd-25e6f3c13061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:32:04.855153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d43f5-73f5-42c2-bbfd-25e6f3c13061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:04.856844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d43f5-73f5-42c2-bbfd-25e6f3c13061 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:04.865554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:04.869075 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3851/7739] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:32:04.874065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b5a3b-80dd-445a-9f40-6fd7b7b1124d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:04.883689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b5a3b-80dd-445a-9f40-6fd7b7b1124d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:04.889429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8795ec-1afd-4b6d-838e-7b43c16052ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:04.890094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8795ec-1afd-4b6d-838e-7b43c16052ba admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:04.890374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8795ec-1afd-4b6d-838e-7b43c16052ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:04.890648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8795ec-1afd-4b6d-838e-7b43c16052ba admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:04.891362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8795ec-1afd-4b6d-838e-7b43c16052ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:04.893358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8795ec-1afd-4b6d-838e-7b43c16052ba admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:04.920498 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3889/7740] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:32:04 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:32:04.924730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d43f5-73f5-42c2-bbfd-25e6f3c13061 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:04.935895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d43f5-73f5-42c2-bbfd-25e6f3c13061 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:04.998002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bccb7-16a5-4878-94d4-41ff9d254669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:04.998677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bccb7-16a5-4878-94d4-41ff9d254669 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:04.998960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bccb7-16a5-4878-94d4-41ff9d254669 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:04.999240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bccb7-16a5-4878-94d4-41ff9d254669 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:04.999928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bccb7-16a5-4878-94d4-41ff9d254669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:05.001935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bccb7-16a5-4878-94d4-41ff9d254669 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:05.023711 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3852/7741] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:32:04 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:32:05.028052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8795ec-1afd-4b6d-838e-7b43c16052ba admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:05.038887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8795ec-1afd-4b6d-838e-7b43c16052ba admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:05.044019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0bef2-7d32-4bdf-b5d8-3902c33a6ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:05.044637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0bef2-7d32-4bdf-b5d8-3902c33a6ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:05.044913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0bef2-7d32-4bdf-b5d8-3902c33a6ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:05.045187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0bef2-7d32-4bdf-b5d8-3902c33a6ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:05.045898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0bef2-7d32-4bdf-b5d8-3902c33a6ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:05.047495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0bef2-7d32-4bdf-b5d8-3902c33a6ac4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:05.058500 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3890/7742] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:32:05.062792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bccb7-16a5-4878-94d4-41ff9d254669 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:05.073378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bccb7-16a5-4878-94d4-41ff9d254669 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:05.079368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4228537-4ada-4aed-b39f-e18a6b967b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:05.080069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4228537-4ada-4aed-b39f-e18a6b967b7c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:05.080375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4228537-4ada-4aed-b39f-e18a6b967b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:05.080650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4228537-4ada-4aed-b39f-e18a6b967b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:05.081371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4228537-4ada-4aed-b39f-e18a6b967b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:05.082977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4228537-4ada-4aed-b39f-e18a6b967b7c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:05.093826 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3853/7743] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:32:05.098372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0bef2-7d32-4bdf-b5d8-3902c33a6ac4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:05.108926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0bef2-7d32-4bdf-b5d8-3902c33a6ac4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:05.114800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8f0fa-c088-41a3-b954-17f0bb8e8e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:05.115685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8f0fa-c088-41a3-b954-17f0bb8e8e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:05.115976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8f0fa-c088-41a3-b954-17f0bb8e8e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:05.116380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8f0fa-c088-41a3-b954-17f0bb8e8e83 admin admin] PATH_INFO: `/v3/projects/070b670b49f1475d9ab2f43139c39d39/users/26b5bfb11bb04e969ce525d2e1b75f95/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:05.132072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8f0fa-c088-41a3-b954-17f0bb8e8e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070b670b49f1475d9ab2f43139c39d39, user_id=26b5bfb11bb04e969ce525d2e1b75f95, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:05.134871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8f0fa-c088-41a3-b954-17f0bb8e8e83 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:05.149482 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3891/7744] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:32:05 2022] PUT /identity/v3/projects/070b670b49f1475d9ab2f43139c39d39/users/26b5bfb11bb04e969ce525d2e1b75f95/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:32:05.160147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014817c-51ea-497d-aa71-19f62f073ce1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:05.160526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014817c-51ea-497d-aa71-19f62f073ce1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:05.160832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014817c-51ea-497d-aa71-19f62f073ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:05.191387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8014817c-51ea-497d-aa71-19f62f073ce1 None None] MFA Rules not processed for user `26b5bfb11bb04e969ce525d2e1b75f95`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:05.192652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8014817c-51ea-497d-aa71-19f62f073ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:05.278792 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3854/7745] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:05.291460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8f0fa-c088-41a3-b954-17f0bb8e8e83 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:05.293558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-14b8f0fa-c088-41a3-b954-17f0bb8e8e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:05.358452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8f0fa-c088-41a3-b954-17f0bb8e8e83 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:05.362653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b862dd0-a30e-44a8-bc51-ae8042f0f5b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:05.363313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862dd0-a30e-44a8-bc51-ae8042f0f5b0 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:05.363600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862dd0-a30e-44a8-bc51-ae8042f0f5b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:05.363878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862dd0-a30e-44a8-bc51-ae8042f0f5b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:05.374137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b862dd0-a30e-44a8-bc51-ae8042f0f5b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:05.375587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b862dd0-a30e-44a8-bc51-ae8042f0f5b0 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:05.384804 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3892/7746] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:32:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:32:05.405067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014817c-51ea-497d-aa71-19f62f073ce1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:05.484956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014817c-51ea-497d-aa71-19f62f073ce1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:05.490407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2272c4-d204-4ae8-9db5-5ff70153cdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:05.491284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2272c4-d204-4ae8-9db5-5ff70153cdb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:05.491598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2272c4-d204-4ae8-9db5-5ff70153cdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:05.491873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2272c4-d204-4ae8-9db5-5ff70153cdb7 admin admin] PATH_INFO: `/v3/users/26b5bfb11bb04e969ce525d2e1b75f95` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:05.493219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2272c4-d204-4ae8-9db5-5ff70153cdb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26b5bfb11bb04e969ce525d2e1b75f95)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:05.495147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2272c4-d204-4ae8-9db5-5ff70153cdb7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:05.505954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:05.549934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ed2272c4-d204-4ae8-9db5-5ff70153cdb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26b5bfb11bb04e969ce525d2e1b75f95'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:05.557863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ed2272c4-d204-4ae8-9db5-5ff70153cdb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26b5bfb11bb04e969ce525d2e1b75f95'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:05.564666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ed2272c4-d204-4ae8-9db5-5ff70153cdb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26b5bfb11bb04e969ce525d2e1b75f95'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:05.565290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ed2272c4-d204-4ae8-9db5-5ff70153cdb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26b5bfb11bb04e969ce525d2e1b75f95'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:05.565894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ed2272c4-d204-4ae8-9db5-5ff70153cdb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26b5bfb11bb04e969ce525d2e1b75f95'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:05.582924 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3855/7747] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:32:05 2022] DELETE /identity/v3/users/26b5bfb11bb04e969ce525d2e1b75f95 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:05.587646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593b70b-d1ce-44a5-a1bc-dc50a64be908 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:05.587936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593b70b-d1ce-44a5-a1bc-dc50a64be908 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:05.588235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593b70b-d1ce-44a5-a1bc-dc50a64be908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:05.605680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0593b70b-d1ce-44a5-a1bc-dc50a64be908 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:05.606882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0593b70b-d1ce-44a5-a1bc-dc50a64be908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:05.638674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:05.673736 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3893/7748] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:05.684211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2272c4-d204-4ae8-9db5-5ff70153cdb7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:05.685710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ed2272c4-d204-4ae8-9db5-5ff70153cdb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:05.748719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2272c4-d204-4ae8-9db5-5ff70153cdb7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:05.752909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b7fb1-8133-4b05-a76d-cc7d231a21d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:05.753580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b7fb1-8133-4b05-a76d-cc7d231a21d3 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:05.753853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b7fb1-8133-4b05-a76d-cc7d231a21d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:05.754124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b7fb1-8133-4b05-a76d-cc7d231a21d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:05.764195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b7fb1-8133-4b05-a76d-cc7d231a21d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:05.765636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b7fb1-8133-4b05-a76d-cc7d231a21d3 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:05.775873 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3856/7749] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:32:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:32:06.069427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593b70b-d1ce-44a5-a1bc-dc50a64be908 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:06.071157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0593b70b-d1ce-44a5-a1bc-dc50a64be908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:06.087453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593b70b-d1ce-44a5-a1bc-dc50a64be908 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:06.094770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d3569-5c66-4d60-8ad1-6353e17fa644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:06.095796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d3569-5c66-4d60-8ad1-6353e17fa644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:06.101665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d3569-5c66-4d60-8ad1-6353e17fa644 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:06.101665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d3569-5c66-4d60-8ad1-6353e17fa644 admin admin] PATH_INFO: `/v3/projects/070b670b49f1475d9ab2f43139c39d39` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:06.101665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d3569-5c66-4d60-8ad1-6353e17fa644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=070b670b49f1475d9ab2f43139c39d39)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:06.101665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d3569-5c66-4d60-8ad1-6353e17fa644 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:06.152270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a99d3569-5c66-4d60-8ad1-6353e17fa644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070b670b49f1475d9ab2f43139c39d39', 'request_id': 'req-a99d3569-5c66-4d60-8ad1-6353e17fa644'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:06.161035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a99d3569-5c66-4d60-8ad1-6353e17fa644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070b670b49f1475d9ab2f43139c39d39', 'request_id': 'req-a99d3569-5c66-4d60-8ad1-6353e17fa644'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:06.168170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a99d3569-5c66-4d60-8ad1-6353e17fa644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070b670b49f1475d9ab2f43139c39d39', 'request_id': 'req-a99d3569-5c66-4d60-8ad1-6353e17fa644'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:06.178873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a99d3569-5c66-4d60-8ad1-6353e17fa644 admin admin] The token cache is being invalidate because project 070b670b49f1475d9ab2f43139c39d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:32:06.179193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a99d3569-5c66-4d60-8ad1-6353e17fa644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:06.179850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a99d3569-5c66-4d60-8ad1-6353e17fa644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:06.181464 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3894/7750] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:32:06 2022] DELETE /identity/v3/projects/070b670b49f1475d9ab2f43139c39d39 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:32:06.186605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534d058-9896-4b48-9a69-6104a283c373 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:06.186903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534d058-9896-4b48-9a69-6104a283c373 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:06.187181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534d058-9896-4b48-9a69-6104a283c373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:06.205203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0534d058-9896-4b48-9a69-6104a283c373 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:06.206421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0534d058-9896-4b48-9a69-6104a283c373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:06.269450 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3857/7751] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:06.278529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74bbaf-cc38-41d1-87a4-e4118585ccb6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:06.278819 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74bbaf-cc38-41d1-87a4-e4118585ccb6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:06.279102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74bbaf-cc38-41d1-87a4-e4118585ccb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:06.298189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ad74bbaf-cc38-41d1-87a4-e4118585ccb6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:06.299399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ad74bbaf-cc38-41d1-87a4-e4118585ccb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:06.310942 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3895/7752] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:06.315448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534d058-9896-4b48-9a69-6104a283c373 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:06.326143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534d058-9896-4b48-9a69-6104a283c373 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:06.331335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde10ad0-a770-4c34-b430-583754709465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:06.331987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde10ad0-a770-4c34-b430-583754709465 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:06.332300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde10ad0-a770-4c34-b430-583754709465 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:06.332580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde10ad0-a770-4c34-b430-583754709465 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:06.333285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde10ad0-a770-4c34-b430-583754709465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:32:06.333592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde10ad0-a770-4c34-b430-583754709465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:06.335198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde10ad0-a770-4c34-b430-583754709465 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:06.347118 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3858/7753] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:32:06.351982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74bbaf-cc38-41d1-87a4-e4118585ccb6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:06.366225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74bbaf-cc38-41d1-87a4-e4118585ccb6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:06.371977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454691e-2750-4e76-a3e9-cebf76648667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:06.372673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454691e-2750-4e76-a3e9-cebf76648667 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:06.372955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454691e-2750-4e76-a3e9-cebf76648667 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:06.373232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454691e-2750-4e76-a3e9-cebf76648667 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:06.373962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454691e-2750-4e76-a3e9-cebf76648667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:06.375988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454691e-2750-4e76-a3e9-cebf76648667 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:06.407536 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3896/7754] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:32:06 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:32:06.408728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde10ad0-a770-4c34-b430-583754709465 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:06.425811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde10ad0-a770-4c34-b430-583754709465 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:06.434220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:06.482290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1969d90-67d5-4c96-bb74-439425948390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:06.482968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1969d90-67d5-4c96-bb74-439425948390 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:06.483252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1969d90-67d5-4c96-bb74-439425948390 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:06.483524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1969d90-67d5-4c96-bb74-439425948390 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:06.484243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1969d90-67d5-4c96-bb74-439425948390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:06.486165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1969d90-67d5-4c96-bb74-439425948390 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:06.512184 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3859/7755] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:32:06 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:32:06.518013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454691e-2750-4e76-a3e9-cebf76648667 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:06.529918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454691e-2750-4e76-a3e9-cebf76648667 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:06.535218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82220d0-8c9f-4598-8ec4-800ceed05fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:06.535876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82220d0-8c9f-4598-8ec4-800ceed05fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:06.536202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82220d0-8c9f-4598-8ec4-800ceed05fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:06.536465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82220d0-8c9f-4598-8ec4-800ceed05fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:06.537178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82220d0-8c9f-4598-8ec4-800ceed05fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:06.538841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82220d0-8c9f-4598-8ec4-800ceed05fd6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:06.549933 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3897/7756] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:32:06.554859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1969d90-67d5-4c96-bb74-439425948390 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:06.565262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1969d90-67d5-4c96-bb74-439425948390 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:06.570433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e3c4b-6627-4ac7-8eb3-ee31d9e07d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:06.571080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e3c4b-6627-4ac7-8eb3-ee31d9e07d36 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:06.571363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e3c4b-6627-4ac7-8eb3-ee31d9e07d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:06.571632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e3c4b-6627-4ac7-8eb3-ee31d9e07d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:06.572377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e3c4b-6627-4ac7-8eb3-ee31d9e07d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:06.573954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e3c4b-6627-4ac7-8eb3-ee31d9e07d36 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:06.584400 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3860/7757] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:32:06.588680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82220d0-8c9f-4598-8ec4-800ceed05fd6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:06.598884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82220d0-8c9f-4598-8ec4-800ceed05fd6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:06.604550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966344b1-6639-49eb-bc7b-09210155a692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:06.605515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966344b1-6639-49eb-bc7b-09210155a692 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:06.605794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966344b1-6639-49eb-bc7b-09210155a692 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:06.606148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966344b1-6639-49eb-bc7b-09210155a692 admin admin] PATH_INFO: `/v3/projects/ec6476c619984026bef8bc9cc51f7a75/users/309d4c790d2f4e9c826441444ded6b04/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:06.622760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966344b1-6639-49eb-bc7b-09210155a692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6476c619984026bef8bc9cc51f7a75, user_id=309d4c790d2f4e9c826441444ded6b04, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:06.625528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966344b1-6639-49eb-bc7b-09210155a692 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:06.640326 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3898/7758] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:32:06 2022] PUT /identity/v3/projects/ec6476c619984026bef8bc9cc51f7a75/users/309d4c790d2f4e9c826441444ded6b04/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:06.745426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb8b13-17fe-4aa2-898d-1f536af1c131 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:06.745941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb8b13-17fe-4aa2-898d-1f536af1c131 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:06.746226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb8b13-17fe-4aa2-898d-1f536af1c131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:06.777690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b2eb8b13-17fe-4aa2-898d-1f536af1c131 None None] MFA Rules not processed for user `309d4c790d2f4e9c826441444ded6b04`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:06.778901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b2eb8b13-17fe-4aa2-898d-1f536af1c131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:06.847883 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3861/7759] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:06.859576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966344b1-6639-49eb-bc7b-09210155a692 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:06.862362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-966344b1-6639-49eb-bc7b-09210155a692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:06.923410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966344b1-6639-49eb-bc7b-09210155a692 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:06.927370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957831e1-3f1d-4bc0-91c2-ecae95287a63 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:06.928419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957831e1-3f1d-4bc0-91c2-ecae95287a63 service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:06.928714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957831e1-3f1d-4bc0-91c2-ecae95287a63 service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:06.929020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957831e1-3f1d-4bc0-91c2-ecae95287a63 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:06.936440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:06.942462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957831e1-3f1d-4bc0-91c2-ecae95287a63 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:06.944919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957831e1-3f1d-4bc0-91c2-ecae95287a63 service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:06.955901 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3899/7760] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:32:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:32:08.597988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb8b13-17fe-4aa2-898d-1f536af1c131 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:08.664929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb8b13-17fe-4aa2-898d-1f536af1c131 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:08.670003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d392ef-9f3f-4af6-9392-c0d9278bfaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:08.670888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d392ef-9f3f-4af6-9392-c0d9278bfaec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:08.671169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d392ef-9f3f-4af6-9392-c0d9278bfaec admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:08.671443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d392ef-9f3f-4af6-9392-c0d9278bfaec admin admin] PATH_INFO: `/v3/users/309d4c790d2f4e9c826441444ded6b04` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:08.672701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d392ef-9f3f-4af6-9392-c0d9278bfaec admin admin] RBAC: Authorizing `identity:delete_user(user_id=309d4c790d2f4e9c826441444ded6b04)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:08.674639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d392ef-9f3f-4af6-9392-c0d9278bfaec admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:08.705886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:08.726099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-20d392ef-9f3f-4af6-9392-c0d9278bfaec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '309d4c790d2f4e9c826441444ded6b04'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:08.734364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-20d392ef-9f3f-4af6-9392-c0d9278bfaec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '309d4c790d2f4e9c826441444ded6b04'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:08.742456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-20d392ef-9f3f-4af6-9392-c0d9278bfaec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '309d4c790d2f4e9c826441444ded6b04'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:08.743126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-20d392ef-9f3f-4af6-9392-c0d9278bfaec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '309d4c790d2f4e9c826441444ded6b04'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:08.743802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-20d392ef-9f3f-4af6-9392-c0d9278bfaec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '309d4c790d2f4e9c826441444ded6b04'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:08.762309 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3862/7761] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:32:08 2022] DELETE /identity/v3/users/309d4c790d2f4e9c826441444ded6b04 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:08.767199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9e60a-bb6d-4949-b35b-d4c5040fb87a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:08.767716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9e60a-bb6d-4949-b35b-d4c5040fb87a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:08.767817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9e60a-bb6d-4949-b35b-d4c5040fb87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:08.785797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e7d9e60a-bb6d-4949-b35b-d4c5040fb87a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:08.786996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e7d9e60a-bb6d-4949-b35b-d4c5040fb87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:08.849936 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3900/7762] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:08.860020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d392ef-9f3f-4af6-9392-c0d9278bfaec admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:08.861553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-20d392ef-9f3f-4af6-9392-c0d9278bfaec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:08.922518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d392ef-9f3f-4af6-9392-c0d9278bfaec admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:08.926851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adee91-02af-46e9-ad74-d0c910fa944c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:08.927551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adee91-02af-46e9-ad74-d0c910fa944c service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:08.927830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adee91-02af-46e9-ad74-d0c910fa944c service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:08.928507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adee91-02af-46e9-ad74-d0c910fa944c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:08.939230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adee91-02af-46e9-ad74-d0c910fa944c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:08.941498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adee91-02af-46e9-ad74-d0c910fa944c service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:08.952876 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3863/7763] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:32:09.253576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9e60a-bb6d-4949-b35b-d4c5040fb87a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:09.255366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e7d9e60a-bb6d-4949-b35b-d4c5040fb87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:09.268627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9e60a-bb6d-4949-b35b-d4c5040fb87a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:09.274598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f31fed-8036-4fe6-8c7e-f50e77cadaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:09.275528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f31fed-8036-4fe6-8c7e-f50e77cadaf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:09.275773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f31fed-8036-4fe6-8c7e-f50e77cadaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:09.276074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f31fed-8036-4fe6-8c7e-f50e77cadaf4 admin admin] PATH_INFO: `/v3/projects/ec6476c619984026bef8bc9cc51f7a75` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:09.277419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f31fed-8036-4fe6-8c7e-f50e77cadaf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec6476c619984026bef8bc9cc51f7a75)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:09.279424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f31fed-8036-4fe6-8c7e-f50e77cadaf4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:09.331524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-94f31fed-8036-4fe6-8c7e-f50e77cadaf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec6476c619984026bef8bc9cc51f7a75', 'request_id': 'req-94f31fed-8036-4fe6-8c7e-f50e77cadaf4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:09.340192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-94f31fed-8036-4fe6-8c7e-f50e77cadaf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec6476c619984026bef8bc9cc51f7a75', 'request_id': 'req-94f31fed-8036-4fe6-8c7e-f50e77cadaf4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:09.347124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-94f31fed-8036-4fe6-8c7e-f50e77cadaf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec6476c619984026bef8bc9cc51f7a75', 'request_id': 'req-94f31fed-8036-4fe6-8c7e-f50e77cadaf4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:09.357988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-94f31fed-8036-4fe6-8c7e-f50e77cadaf4 admin admin] The token cache is being invalidate because project ec6476c619984026bef8bc9cc51f7a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:32:09.358274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-94f31fed-8036-4fe6-8c7e-f50e77cadaf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:09.359190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-94f31fed-8036-4fe6-8c7e-f50e77cadaf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:09.360889 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3901/7764] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:32:09 2022] DELETE /identity/v3/projects/ec6476c619984026bef8bc9cc51f7a75 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:09.369840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89e441-86db-4630-84ae-d12cca89d01c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:09.370131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89e441-86db-4630-84ae-d12cca89d01c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:09.370407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89e441-86db-4630-84ae-d12cca89d01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:09.389161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2c89e441-86db-4630-84ae-d12cca89d01c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:09.390370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2c89e441-86db-4630-84ae-d12cca89d01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:09.451001 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3864/7765] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:09.459646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0a385-1011-40a6-8e37-a9ae32bb63e3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:09.460224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0a385-1011-40a6-8e37-a9ae32bb63e3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:09.460517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0a385-1011-40a6-8e37-a9ae32bb63e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:09.480937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4fd0a385-1011-40a6-8e37-a9ae32bb63e3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:09.482187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4fd0a385-1011-40a6-8e37-a9ae32bb63e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:09.491655 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3902/7766] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:09.498401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89e441-86db-4630-84ae-d12cca89d01c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:09.514540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89e441-86db-4630-84ae-d12cca89d01c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:09.523753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa5a97-fbde-43ba-be46-142458f541dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:09.524461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa5a97-fbde-43ba-be46-142458f541dd admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:09.524734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa5a97-fbde-43ba-be46-142458f541dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:09.525010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa5a97-fbde-43ba-be46-142458f541dd admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:09.525731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa5a97-fbde-43ba-be46-142458f541dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:32:09.526039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa5a97-fbde-43ba-be46-142458f541dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:09.527653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa5a97-fbde-43ba-be46-142458f541dd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:09.540664 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3865/7767] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:32:09.545009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0a385-1011-40a6-8e37-a9ae32bb63e3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:09.555497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0a385-1011-40a6-8e37-a9ae32bb63e3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:09.560847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee4dce-87e6-44d6-9059-031876fe5f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:09.561527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee4dce-87e6-44d6-9059-031876fe5f17 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:09.561808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee4dce-87e6-44d6-9059-031876fe5f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:09.562085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee4dce-87e6-44d6-9059-031876fe5f17 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:09.562743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee4dce-87e6-44d6-9059-031876fe5f17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:09.564759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee4dce-87e6-44d6-9059-031876fe5f17 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:09.592682 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3903/7768] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:32:09 2022] POST /identity/v3/projects => generated 359 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:32:09.596927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa5a97-fbde-43ba-be46-142458f541dd admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:09.607696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa5a97-fbde-43ba-be46-142458f541dd admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:09.647862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:09.675630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbc487-ca9e-4d71-a8c0-8ce44c5cfab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:09.676360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbc487-ca9e-4d71-a8c0-8ce44c5cfab0 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:09.676644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbc487-ca9e-4d71-a8c0-8ce44c5cfab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:09.676915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbc487-ca9e-4d71-a8c0-8ce44c5cfab0 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:09.677614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbc487-ca9e-4d71-a8c0-8ce44c5cfab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:09.679887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbc487-ca9e-4d71-a8c0-8ce44c5cfab0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:09.701492 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3866/7769] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:32:09 2022] POST /identity/v3/users => generated 280 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:32:09.705901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee4dce-87e6-44d6-9059-031876fe5f17 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:09.716657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee4dce-87e6-44d6-9059-031876fe5f17 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:09.721666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a9b7b-9365-40b3-8b8d-7f21af2bed45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:09.722330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a9b7b-9365-40b3-8b8d-7f21af2bed45 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:09.722613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a9b7b-9365-40b3-8b8d-7f21af2bed45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:09.722899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a9b7b-9365-40b3-8b8d-7f21af2bed45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:09.723622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a9b7b-9365-40b3-8b8d-7f21af2bed45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:09.725311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a9b7b-9365-40b3-8b8d-7f21af2bed45 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:09.736154 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3904/7770] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:32:09.740397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbc487-ca9e-4d71-a8c0-8ce44c5cfab0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:09.751168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbc487-ca9e-4d71-a8c0-8ce44c5cfab0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:09.756690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526dc52-646b-4d19-8b62-50dd574a2a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:09.757455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526dc52-646b-4d19-8b62-50dd574a2a48 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:09.757738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526dc52-646b-4d19-8b62-50dd574a2a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:09.758017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526dc52-646b-4d19-8b62-50dd574a2a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:09.758745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526dc52-646b-4d19-8b62-50dd574a2a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:09.760405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526dc52-646b-4d19-8b62-50dd574a2a48 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:09.770928 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3867/7771] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:32:09.774918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a9b7b-9365-40b3-8b8d-7f21af2bed45 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:09.785369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a9b7b-9365-40b3-8b8d-7f21af2bed45 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:09.791019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c8cc4-9e34-4647-a78d-38aed7344a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:09.791910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c8cc4-9e34-4647-a78d-38aed7344a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:09.792303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c8cc4-9e34-4647-a78d-38aed7344a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:09.792586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c8cc4-9e34-4647-a78d-38aed7344a2f admin admin] PATH_INFO: `/v3/projects/7d17fcc28bea4fc18bc0efac023ae2f0/users/6d2522a49d1b4d59bdf600e96c05dde4/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:09.811381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c8cc4-9e34-4647-a78d-38aed7344a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d17fcc28bea4fc18bc0efac023ae2f0, user_id=6d2522a49d1b4d59bdf600e96c05dde4, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:09.814179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c8cc4-9e34-4647-a78d-38aed7344a2f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:09.829293 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3905/7772] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:32:09 2022] PUT /identity/v3/projects/7d17fcc28bea4fc18bc0efac023ae2f0/users/6d2522a49d1b4d59bdf600e96c05dde4/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:09.840702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e0ddc-4faf-492b-af23-ebc8f09a92be None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:09.840996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e0ddc-4faf-492b-af23-ebc8f09a92be None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:09.841278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e0ddc-4faf-492b-af23-ebc8f09a92be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:09.868106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b94e0ddc-4faf-492b-af23-ebc8f09a92be None None] MFA Rules not processed for user `6d2522a49d1b4d59bdf600e96c05dde4`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:09.869288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b94e0ddc-4faf-492b-af23-ebc8f09a92be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:09.935258 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3868/7773] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:09 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:09.965657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c8cc4-9e34-4647-a78d-38aed7344a2f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:09.967409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-af6c8cc4-9e34-4647-a78d-38aed7344a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:09.986749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:10.031751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c8cc4-9e34-4647-a78d-38aed7344a2f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:10.036504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2362e-ef29-4109-ade0-1576c1237bf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:10.037162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2362e-ef29-4109-ade0-1576c1237bf6 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:10.037448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2362e-ef29-4109-ade0-1576c1237bf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:10.037729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2362e-ef29-4109-ade0-1576c1237bf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:10.050653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2362e-ef29-4109-ade0-1576c1237bf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:10.052213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2362e-ef29-4109-ade0-1576c1237bf6 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:10.061999 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3906/7774] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:32:09 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:32:10.076283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e0ddc-4faf-492b-af23-ebc8f09a92be None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:10.139946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e0ddc-4faf-492b-af23-ebc8f09a92be None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:10.145097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cc97b-496c-4bcf-88f3-925316143bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:10.145985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cc97b-496c-4bcf-88f3-925316143bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:10.146269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cc97b-496c-4bcf-88f3-925316143bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:10.146542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cc97b-496c-4bcf-88f3-925316143bf3 admin admin] PATH_INFO: `/v3/users/6d2522a49d1b4d59bdf600e96c05dde4` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:10.147806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cc97b-496c-4bcf-88f3-925316143bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d2522a49d1b4d59bdf600e96c05dde4)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:10.149896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cc97b-496c-4bcf-88f3-925316143bf3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:10.195824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:10.198040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-694cc97b-496c-4bcf-88f3-925316143bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d2522a49d1b4d59bdf600e96c05dde4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:10.206603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-694cc97b-496c-4bcf-88f3-925316143bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d2522a49d1b4d59bdf600e96c05dde4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:10.215021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-694cc97b-496c-4bcf-88f3-925316143bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d2522a49d1b4d59bdf600e96c05dde4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:10.215675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-694cc97b-496c-4bcf-88f3-925316143bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d2522a49d1b4d59bdf600e96c05dde4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:10.216345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-694cc97b-496c-4bcf-88f3-925316143bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d2522a49d1b4d59bdf600e96c05dde4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:10.234188 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3869/7775] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:32:10 2022] DELETE /identity/v3/users/6d2522a49d1b4d59bdf600e96c05dde4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:10.239019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e8d10-2228-48c1-bf82-1cd50d1a584d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:10.239308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e8d10-2228-48c1-bf82-1cd50d1a584d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:10.239589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e8d10-2228-48c1-bf82-1cd50d1a584d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:10.258885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d80e8d10-2228-48c1-bf82-1cd50d1a584d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:10.260169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d80e8d10-2228-48c1-bf82-1cd50d1a584d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:10.324775 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3907/7776] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:10.336225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cc97b-496c-4bcf-88f3-925316143bf3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:10.337859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-694cc97b-496c-4bcf-88f3-925316143bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:10.400437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cc97b-496c-4bcf-88f3-925316143bf3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:10.404232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dceb871-beb6-40ed-8724-ad9560b10515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:10.404909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dceb871-beb6-40ed-8724-ad9560b10515 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:10.405186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dceb871-beb6-40ed-8724-ad9560b10515 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:10.405457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dceb871-beb6-40ed-8724-ad9560b10515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:10.415022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dceb871-beb6-40ed-8724-ad9560b10515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:10.416540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dceb871-beb6-40ed-8724-ad9560b10515 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:10.426091 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3870/7777] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:32:10.712415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e8d10-2228-48c1-bf82-1cd50d1a584d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:10.714193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d80e8d10-2228-48c1-bf82-1cd50d1a584d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:10.729163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e8d10-2228-48c1-bf82-1cd50d1a584d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:10.734593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499d876-4065-4dd6-b9c0-5127cf8d67dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:10.735861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499d876-4065-4dd6-b9c0-5127cf8d67dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:10.736193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499d876-4065-4dd6-b9c0-5127cf8d67dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:10.736485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499d876-4065-4dd6-b9c0-5127cf8d67dd admin admin] PATH_INFO: `/v3/projects/7d17fcc28bea4fc18bc0efac023ae2f0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:10.738345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499d876-4065-4dd6-b9c0-5127cf8d67dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d17fcc28bea4fc18bc0efac023ae2f0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:10.740788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499d876-4065-4dd6-b9c0-5127cf8d67dd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:10.796346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c499d876-4065-4dd6-b9c0-5127cf8d67dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d17fcc28bea4fc18bc0efac023ae2f0', 'request_id': 'req-c499d876-4065-4dd6-b9c0-5127cf8d67dd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:10.806477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c499d876-4065-4dd6-b9c0-5127cf8d67dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d17fcc28bea4fc18bc0efac023ae2f0', 'request_id': 'req-c499d876-4065-4dd6-b9c0-5127cf8d67dd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:10.812975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c499d876-4065-4dd6-b9c0-5127cf8d67dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d17fcc28bea4fc18bc0efac023ae2f0', 'request_id': 'req-c499d876-4065-4dd6-b9c0-5127cf8d67dd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:10.823662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c499d876-4065-4dd6-b9c0-5127cf8d67dd admin admin] The token cache is being invalidate because project 7d17fcc28bea4fc18bc0efac023ae2f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:32:10.823971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c499d876-4065-4dd6-b9c0-5127cf8d67dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:10.824737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c499d876-4065-4dd6-b9c0-5127cf8d67dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:10.826455 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3908/7778] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:32:10 2022] DELETE /identity/v3/projects/7d17fcc28bea4fc18bc0efac023ae2f0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:10.831661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb97d54-d157-4478-b847-dd1b5bd6b9b6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:10.832198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb97d54-d157-4478-b847-dd1b5bd6b9b6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:10.832287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb97d54-d157-4478-b847-dd1b5bd6b9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:10.852927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9eb97d54-d157-4478-b847-dd1b5bd6b9b6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:10.854131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9eb97d54-d157-4478-b847-dd1b5bd6b9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:10.915433 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3871/7779] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:10.923611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd853d-4cc0-4846-9ad5-2c1a037d2b50 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:10.923903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd853d-4cc0-4846-9ad5-2c1a037d2b50 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:10.924232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd853d-4cc0-4846-9ad5-2c1a037d2b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:10.943412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-65dd853d-4cc0-4846-9ad5-2c1a037d2b50 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:10.944661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-65dd853d-4cc0-4846-9ad5-2c1a037d2b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:10.953020 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3909/7780] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:10.957398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb97d54-d157-4478-b847-dd1b5bd6b9b6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:10.967400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb97d54-d157-4478-b847-dd1b5bd6b9b6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:10.972457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f938c5-0e90-4b87-9a41-7c7f58be9dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:10.973106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f938c5-0e90-4b87-9a41-7c7f58be9dde admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:10.973381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f938c5-0e90-4b87-9a41-7c7f58be9dde admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:10.973658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f938c5-0e90-4b87-9a41-7c7f58be9dde admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:10.974382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f938c5-0e90-4b87-9a41-7c7f58be9dde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:32:10.974697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f938c5-0e90-4b87-9a41-7c7f58be9dde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:10.976371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f938c5-0e90-4b87-9a41-7c7f58be9dde admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:10.988269 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3872/7781] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:32:10.992556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd853d-4cc0-4846-9ad5-2c1a037d2b50 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:11.001875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd853d-4cc0-4846-9ad5-2c1a037d2b50 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:11.006938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e962d-428b-4d97-85de-cbfb4d0d208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:11.007621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e962d-428b-4d97-85de-cbfb4d0d208d admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:11.007897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e962d-428b-4d97-85de-cbfb4d0d208d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:11.008226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e962d-428b-4d97-85de-cbfb4d0d208d admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:11.008918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e962d-428b-4d97-85de-cbfb4d0d208d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:11.010855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e962d-428b-4d97-85de-cbfb4d0d208d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:11.046990 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3910/7782] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:32:10 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:32:11.054380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f938c5-0e90-4b87-9a41-7c7f58be9dde admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:11.065272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f938c5-0e90-4b87-9a41-7c7f58be9dde admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:11.116133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:11.127318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab3a9f-2e2b-4c8a-9b58-8fef9b7b184c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:11.128022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab3a9f-2e2b-4c8a-9b58-8fef9b7b184c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:11.128331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab3a9f-2e2b-4c8a-9b58-8fef9b7b184c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:11.128607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab3a9f-2e2b-4c8a-9b58-8fef9b7b184c admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:11.129294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab3a9f-2e2b-4c8a-9b58-8fef9b7b184c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:11.131273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab3a9f-2e2b-4c8a-9b58-8fef9b7b184c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:11.152724 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3873/7783] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:32:11 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:32:11.157147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e962d-428b-4d97-85de-cbfb4d0d208d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:11.168272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e962d-428b-4d97-85de-cbfb4d0d208d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:11.173365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48c0c6-1c31-4cad-8f02-09d3d5308858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:11.174027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48c0c6-1c31-4cad-8f02-09d3d5308858 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:11.174315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48c0c6-1c31-4cad-8f02-09d3d5308858 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:11.174594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48c0c6-1c31-4cad-8f02-09d3d5308858 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:11.175303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48c0c6-1c31-4cad-8f02-09d3d5308858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:11.176963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48c0c6-1c31-4cad-8f02-09d3d5308858 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:11.188081 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3911/7784] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:32:11.192143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab3a9f-2e2b-4c8a-9b58-8fef9b7b184c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:11.202914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab3a9f-2e2b-4c8a-9b58-8fef9b7b184c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:11.208178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb94fa-4faf-4a48-b02a-88d6f108dfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:11.208952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb94fa-4faf-4a48-b02a-88d6f108dfaf admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:11.209228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb94fa-4faf-4a48-b02a-88d6f108dfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:11.209516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb94fa-4faf-4a48-b02a-88d6f108dfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:11.210233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb94fa-4faf-4a48-b02a-88d6f108dfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:11.211855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb94fa-4faf-4a48-b02a-88d6f108dfaf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:11.222257 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3874/7785] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:32:11.226385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48c0c6-1c31-4cad-8f02-09d3d5308858 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:11.233006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:11.240164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48c0c6-1c31-4cad-8f02-09d3d5308858 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:11.246208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e8eea-e6ca-40bf-a7d9-99a01bfbb5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:11.247095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e8eea-e6ca-40bf-a7d9-99a01bfbb5c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:11.247388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e8eea-e6ca-40bf-a7d9-99a01bfbb5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:11.247684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e8eea-e6ca-40bf-a7d9-99a01bfbb5c3 admin admin] PATH_INFO: `/v3/projects/56dbb142d71f47ee83054c58443d232d/users/f46c2e148213452ab6d6d5e0db4e7573/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:11.262847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e8eea-e6ca-40bf-a7d9-99a01bfbb5c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56dbb142d71f47ee83054c58443d232d, user_id=f46c2e148213452ab6d6d5e0db4e7573, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:11.265560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e8eea-e6ca-40bf-a7d9-99a01bfbb5c3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:11.280741 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3912/7786] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:32:11 2022] PUT /identity/v3/projects/56dbb142d71f47ee83054c58443d232d/users/f46c2e148213452ab6d6d5e0db4e7573/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:11.286088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a214d-e1a8-4096-9912-acd450651017 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:11.286389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a214d-e1a8-4096-9912-acd450651017 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:11.286662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a214d-e1a8-4096-9912-acd450651017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:11.305795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-454a214d-e1a8-4096-9912-acd450651017 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:11.306985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-454a214d-e1a8-4096-9912-acd450651017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:11.367158 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3875/7787] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:11.380342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e8eea-e6ca-40bf-a7d9-99a01bfbb5c3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:11.382213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-510e8eea-e6ca-40bf-a7d9-99a01bfbb5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:11.448610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e8eea-e6ca-40bf-a7d9-99a01bfbb5c3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:11.452707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa800098-6193-45ee-8225-2c4988896843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:11.453416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa800098-6193-45ee-8225-2c4988896843 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:11.453605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa800098-6193-45ee-8225-2c4988896843 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:11.454014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa800098-6193-45ee-8225-2c4988896843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:11.465830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa800098-6193-45ee-8225-2c4988896843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:11.467294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa800098-6193-45ee-8225-2c4988896843 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:11.477812 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3913/7788] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:32:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:32:12.218010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4393f7b-71ab-4b56-be02-9094da64257a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:12.218646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4393f7b-71ab-4b56-be02-9094da64257a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:12.218646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4393f7b-71ab-4b56-be02-9094da64257a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:12.245713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a4393f7b-71ab-4b56-be02-9094da64257a None None] MFA Rules not processed for user `f46c2e148213452ab6d6d5e0db4e7573`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:12.246935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a4393f7b-71ab-4b56-be02-9094da64257a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:12.317164 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3876/7789] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:12.328575 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa800098-6193-45ee-8225-2c4988896843 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:12.330646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fa800098-6193-45ee-8225-2c4988896843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:12.392178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa800098-6193-45ee-8225-2c4988896843 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:12.395942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0280e-0f05-4477-a3d9-5dec15f17862 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:12.396660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0280e-0f05-4477-a3d9-5dec15f17862 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:12.397068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0280e-0f05-4477-a3d9-5dec15f17862 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:12.397384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0280e-0f05-4477-a3d9-5dec15f17862 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:12.406768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0280e-0f05-4477-a3d9-5dec15f17862 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:12.408261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0280e-0f05-4477-a3d9-5dec15f17862 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:12.417479 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3914/7790] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:32:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:32:14.443468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4393f7b-71ab-4b56-be02-9094da64257a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:14.455229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4393f7b-71ab-4b56-be02-9094da64257a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:14.460531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc528de-b5d8-491a-9214-9d47f68aee05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:14.461468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc528de-b5d8-491a-9214-9d47f68aee05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:14.461774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc528de-b5d8-491a-9214-9d47f68aee05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:14.462048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc528de-b5d8-491a-9214-9d47f68aee05 admin admin] PATH_INFO: `/v3/users/f46c2e148213452ab6d6d5e0db4e7573` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:14.463251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc528de-b5d8-491a-9214-9d47f68aee05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46c2e148213452ab6d6d5e0db4e7573)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:14.465232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc528de-b5d8-491a-9214-9d47f68aee05 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:14.519483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8fc528de-b5d8-491a-9214-9d47f68aee05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46c2e148213452ab6d6d5e0db4e7573'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:14.526947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8fc528de-b5d8-491a-9214-9d47f68aee05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46c2e148213452ab6d6d5e0db4e7573'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:14.529206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:14.536630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8fc528de-b5d8-491a-9214-9d47f68aee05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46c2e148213452ab6d6d5e0db4e7573'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:14.537722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8fc528de-b5d8-491a-9214-9d47f68aee05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46c2e148213452ab6d6d5e0db4e7573'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:14.538891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8fc528de-b5d8-491a-9214-9d47f68aee05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46c2e148213452ab6d6d5e0db4e7573'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:14.559162 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3877/7791] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:32:14 2022] DELETE /identity/v3/users/f46c2e148213452ab6d6d5e0db4e7573 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:14.748983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0280e-0f05-4477-a3d9-5dec15f17862 service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:14.761627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0280e-0f05-4477-a3d9-5dec15f17862 service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:14.823406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8282e4-631f-4d04-ab63-f281d919b3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:14.824252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8282e4-631f-4d04-ab63-f281d919b3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:14.824534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8282e4-631f-4d04-ab63-f281d919b3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:14.824829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8282e4-631f-4d04-ab63-f281d919b3b6 admin admin] PATH_INFO: `/v3/projects/56dbb142d71f47ee83054c58443d232d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:14.826013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8282e4-631f-4d04-ab63-f281d919b3b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56dbb142d71f47ee83054c58443d232d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:14.827957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8282e4-631f-4d04-ab63-f281d919b3b6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:14.859765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:14.877274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba8282e4-631f-4d04-ab63-f281d919b3b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56dbb142d71f47ee83054c58443d232d', 'request_id': 'req-ba8282e4-631f-4d04-ab63-f281d919b3b6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:14.885005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba8282e4-631f-4d04-ab63-f281d919b3b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56dbb142d71f47ee83054c58443d232d', 'request_id': 'req-ba8282e4-631f-4d04-ab63-f281d919b3b6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:14.891431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba8282e4-631f-4d04-ab63-f281d919b3b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56dbb142d71f47ee83054c58443d232d', 'request_id': 'req-ba8282e4-631f-4d04-ab63-f281d919b3b6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:14.901444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba8282e4-631f-4d04-ab63-f281d919b3b6 admin admin] The token cache is being invalidate because project 56dbb142d71f47ee83054c58443d232d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:32:14.901726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba8282e4-631f-4d04-ab63-f281d919b3b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:14.902399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ba8282e4-631f-4d04-ab63-f281d919b3b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:14.904008 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3915/7792] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:32:14 2022] DELETE /identity/v3/projects/56dbb142d71f47ee83054c58443d232d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:14.910986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa133d3-2e50-4bed-b98f-dfb90f1f7b47 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:14.911264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa133d3-2e50-4bed-b98f-dfb90f1f7b47 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:14.911547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa133d3-2e50-4bed-b98f-dfb90f1f7b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:14.929677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-dfa133d3-2e50-4bed-b98f-dfb90f1f7b47 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:14.930874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dfa133d3-2e50-4bed-b98f-dfb90f1f7b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:14.992305 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3878/7793] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:32:15.001620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f423da-353c-4421-849b-4070407eb44b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:15.001879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f423da-353c-4421-849b-4070407eb44b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:15.002142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f423da-353c-4421-849b-4070407eb44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:15.022104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-57f423da-353c-4421-849b-4070407eb44b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:15.023778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-57f423da-353c-4421-849b-4070407eb44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:15.033258 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3916/7794] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:15.038066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa133d3-2e50-4bed-b98f-dfb90f1f7b47 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:15.051589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa133d3-2e50-4bed-b98f-dfb90f1f7b47 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:15.057666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debedb0d-e71c-48c3-b982-8eb7771ee668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:15.058379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debedb0d-e71c-48c3-b982-8eb7771ee668 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:15.058670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debedb0d-e71c-48c3-b982-8eb7771ee668 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:15.058947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debedb0d-e71c-48c3-b982-8eb7771ee668 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:15.059675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debedb0d-e71c-48c3-b982-8eb7771ee668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:32:15.059987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debedb0d-e71c-48c3-b982-8eb7771ee668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:15.061657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debedb0d-e71c-48c3-b982-8eb7771ee668 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:15.074214 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3879/7795] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:32:15.078502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f423da-353c-4421-849b-4070407eb44b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:15.096933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f423da-353c-4421-849b-4070407eb44b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:15.101987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf37641-4f81-4921-a9b5-346a63470298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:15.102665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf37641-4f81-4921-a9b5-346a63470298 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:15.102950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf37641-4f81-4921-a9b5-346a63470298 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:15.103228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf37641-4f81-4921-a9b5-346a63470298 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:15.103937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf37641-4f81-4921-a9b5-346a63470298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:15.105913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf37641-4f81-4921-a9b5-346a63470298 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:15.132792 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3917/7796] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:32:15 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:32:15.137284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debedb0d-e71c-48c3-b982-8eb7771ee668 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:15.147651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debedb0d-e71c-48c3-b982-8eb7771ee668 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:15.219107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74cd3e-5f77-4044-9b01-c6daabd1c41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:15.219863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74cd3e-5f77-4044-9b01-c6daabd1c41c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:15.220295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74cd3e-5f77-4044-9b01-c6daabd1c41c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:15.220637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74cd3e-5f77-4044-9b01-c6daabd1c41c admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:15.221437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74cd3e-5f77-4044-9b01-c6daabd1c41c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:15.223453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74cd3e-5f77-4044-9b01-c6daabd1c41c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:15.246381 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3880/7797] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:32:15 2022] POST /identity/v3/users => generated 282 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:32:15.252153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf37641-4f81-4921-a9b5-346a63470298 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:15.264309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf37641-4f81-4921-a9b5-346a63470298 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:15.269301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba864895-bcc8-4ab3-b2f5-e5006ec47120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:15.270048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba864895-bcc8-4ab3-b2f5-e5006ec47120 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:15.270396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba864895-bcc8-4ab3-b2f5-e5006ec47120 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:15.270846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba864895-bcc8-4ab3-b2f5-e5006ec47120 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:15.271635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba864895-bcc8-4ab3-b2f5-e5006ec47120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:15.273379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba864895-bcc8-4ab3-b2f5-e5006ec47120 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:15.288942 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3918/7798] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:32:15.290245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74cd3e-5f77-4044-9b01-c6daabd1c41c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:15.301460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74cd3e-5f77-4044-9b01-c6daabd1c41c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:15.307304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918784e6-66dc-43a7-803c-c287eb7d34f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:15.308005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918784e6-66dc-43a7-803c-c287eb7d34f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:15.308337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918784e6-66dc-43a7-803c-c287eb7d34f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:15.308616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918784e6-66dc-43a7-803c-c287eb7d34f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:15.309348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918784e6-66dc-43a7-803c-c287eb7d34f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:15.311028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918784e6-66dc-43a7-803c-c287eb7d34f4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:15.322272 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3881/7799] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:32:15.326573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba864895-bcc8-4ab3-b2f5-e5006ec47120 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:15.338849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba864895-bcc8-4ab3-b2f5-e5006ec47120 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:15.344067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b4cac-06b9-4fcf-aad9-1854e20fb552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:15.344990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b4cac-06b9-4fcf-aad9-1854e20fb552 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:15.345446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b4cac-06b9-4fcf-aad9-1854e20fb552 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:15.346140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b4cac-06b9-4fcf-aad9-1854e20fb552 admin admin] PATH_INFO: `/v3/projects/ab9f5298136241cbb4b4d1601c112296/users/14f9470fed23407a91b58f5a7184c303/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:15.362121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b4cac-06b9-4fcf-aad9-1854e20fb552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab9f5298136241cbb4b4d1601c112296, user_id=14f9470fed23407a91b58f5a7184c303, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:15.365081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b4cac-06b9-4fcf-aad9-1854e20fb552 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:15.380173 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3919/7800] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:32:15 2022] PUT /identity/v3/projects/ab9f5298136241cbb4b4d1601c112296/users/14f9470fed23407a91b58f5a7184c303/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:15.390708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc050895-6916-4dc3-9db8-8806b3da4ebb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:15.391007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc050895-6916-4dc3-9db8-8806b3da4ebb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:15.391296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc050895-6916-4dc3-9db8-8806b3da4ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:15.418514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bc050895-6916-4dc3-9db8-8806b3da4ebb None None] MFA Rules not processed for user `14f9470fed23407a91b58f5a7184c303`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:15.419747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bc050895-6916-4dc3-9db8-8806b3da4ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:15.450527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:15.493024 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3882/7801] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:15 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:15.504895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b4cac-06b9-4fcf-aad9-1854e20fb552 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:15.506579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fc8b4cac-06b9-4fcf-aad9-1854e20fb552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:15.572773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b4cac-06b9-4fcf-aad9-1854e20fb552 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:15.576940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffbc91-2c58-4e10-ae64-ac96d071f551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:15.577603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffbc91-2c58-4e10-ae64-ac96d071f551 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:15.577953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffbc91-2c58-4e10-ae64-ac96d071f551 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:15.578327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffbc91-2c58-4e10-ae64-ac96d071f551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:15.587704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffbc91-2c58-4e10-ae64-ac96d071f551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:15.589213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffbc91-2c58-4e10-ae64-ac96d071f551 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:15.598718 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3920/7802] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:32:15 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:32:19.854281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc050895-6916-4dc3-9db8-8806b3da4ebb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:19.855970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bc050895-6916-4dc3-9db8-8806b3da4ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:19.929449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc050895-6916-4dc3-9db8-8806b3da4ebb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:19.934374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c68e7f-cd71-4fc8-b571-3e90513d3f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:19.935041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c68e7f-cd71-4fc8-b571-3e90513d3f16 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:19.935344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c68e7f-cd71-4fc8-b571-3e90513d3f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:19.935579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c68e7f-cd71-4fc8-b571-3e90513d3f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:19.937814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-26c68e7f-cd71-4fc8-b571-3e90513d3f16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:19.952813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c68e7f-cd71-4fc8-b571-3e90513d3f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:19.955029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c68e7f-cd71-4fc8-b571-3e90513d3f16 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:19.967797 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3883/7803] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:32:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:32:20.311319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffbc91-2c58-4e10-ae64-ac96d071f551 service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:20.371997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:20.387023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffbc91-2c58-4e10-ae64-ac96d071f551 service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:20.392341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5b254-540f-4185-8dab-de1e1b05fd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:20.393412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5b254-540f-4185-8dab-de1e1b05fd56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:20.393702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5b254-540f-4185-8dab-de1e1b05fd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:20.393982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5b254-540f-4185-8dab-de1e1b05fd56 admin admin] PATH_INFO: `/v3/users/14f9470fed23407a91b58f5a7184c303` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:20.395876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5b254-540f-4185-8dab-de1e1b05fd56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f9470fed23407a91b58f5a7184c303)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:20.398033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5b254-540f-4185-8dab-de1e1b05fd56 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:20.453369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-60d5b254-540f-4185-8dab-de1e1b05fd56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f9470fed23407a91b58f5a7184c303'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:20.461252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-60d5b254-540f-4185-8dab-de1e1b05fd56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f9470fed23407a91b58f5a7184c303'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:20.462776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-60d5b254-540f-4185-8dab-de1e1b05fd56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f9470fed23407a91b58f5a7184c303'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:20.463449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-60d5b254-540f-4185-8dab-de1e1b05fd56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f9470fed23407a91b58f5a7184c303'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:20.471219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-60d5b254-540f-4185-8dab-de1e1b05fd56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f9470fed23407a91b58f5a7184c303'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:20.489966 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3921/7804] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:32:20 2022] DELETE /identity/v3/users/14f9470fed23407a91b58f5a7184c303 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:20.494755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f4fe-7dec-4166-8323-0705974a9094 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:20.495050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f4fe-7dec-4166-8323-0705974a9094 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:20.495325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f4fe-7dec-4166-8323-0705974a9094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:20.514721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-df30f4fe-7dec-4166-8323-0705974a9094 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:20.516536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-df30f4fe-7dec-4166-8323-0705974a9094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:20.582570 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3884/7805] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:32:20.592878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5b254-540f-4185-8dab-de1e1b05fd56 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:20.594661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-60d5b254-540f-4185-8dab-de1e1b05fd56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:20.656425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5b254-540f-4185-8dab-de1e1b05fd56 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:20.662748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4842908-255d-4b6d-825f-42c762e19798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:20.663894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4842908-255d-4b6d-825f-42c762e19798 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:20.664336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4842908-255d-4b6d-825f-42c762e19798 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:20.664716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4842908-255d-4b6d-825f-42c762e19798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:20.677767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4842908-255d-4b6d-825f-42c762e19798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:20.679704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4842908-255d-4b6d-825f-42c762e19798 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:20.692235 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3922/7806] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:32:21.128294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30f4fe-7dec-4166-8323-0705974a9094 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:21.129957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-df30f4fe-7dec-4166-8323-0705974a9094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:21.142816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30f4fe-7dec-4166-8323-0705974a9094 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:21.149097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010362d-7ab6-41ad-8ba2-c73c8c0ba831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:21.149996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010362d-7ab6-41ad-8ba2-c73c8c0ba831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:21.150282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010362d-7ab6-41ad-8ba2-c73c8c0ba831 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:21.150555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010362d-7ab6-41ad-8ba2-c73c8c0ba831 admin admin] PATH_INFO: `/v3/projects/ab9f5298136241cbb4b4d1601c112296` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:21.151870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010362d-7ab6-41ad-8ba2-c73c8c0ba831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab9f5298136241cbb4b4d1601c112296)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:21.158113 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010362d-7ab6-41ad-8ba2-c73c8c0ba831 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:21.254088 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3010362d-7ab6-41ad-8ba2-c73c8c0ba831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab9f5298136241cbb4b4d1601c112296', 'request_id': 'req-3010362d-7ab6-41ad-8ba2-c73c8c0ba831'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:21.262362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3010362d-7ab6-41ad-8ba2-c73c8c0ba831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab9f5298136241cbb4b4d1601c112296', 'request_id': 'req-3010362d-7ab6-41ad-8ba2-c73c8c0ba831'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:21.271553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3010362d-7ab6-41ad-8ba2-c73c8c0ba831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab9f5298136241cbb4b4d1601c112296', 'request_id': 'req-3010362d-7ab6-41ad-8ba2-c73c8c0ba831'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:21.277461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:21.294227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3010362d-7ab6-41ad-8ba2-c73c8c0ba831 admin admin] The token cache is being invalidate because project ab9f5298136241cbb4b4d1601c112296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:32:21.294613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3010362d-7ab6-41ad-8ba2-c73c8c0ba831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:21.295370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3010362d-7ab6-41ad-8ba2-c73c8c0ba831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:21.298245 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3885/7807] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:32:21 2022] DELETE /identity/v3/projects/ab9f5298136241cbb4b4d1601c112296 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:21.302889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a65382-c54e-441a-b0c4-80bbf85f4fb5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:21.303609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a65382-c54e-441a-b0c4-80bbf85f4fb5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:21.303888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a65382-c54e-441a-b0c4-80bbf85f4fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:21.329612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f6a65382-c54e-441a-b0c4-80bbf85f4fb5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:21.330933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f6a65382-c54e-441a-b0c4-80bbf85f4fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:21.403339 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3923/7808] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:21.411309 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf156b-005d-4eca-9cb8-0dae790e34bb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:21.411600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf156b-005d-4eca-9cb8-0dae790e34bb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:21.411882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf156b-005d-4eca-9cb8-0dae790e34bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:21.436563 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f0cf156b-005d-4eca-9cb8-0dae790e34bb None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:21.437815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f0cf156b-005d-4eca-9cb8-0dae790e34bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:21.454579 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3886/7809] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:21.455541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a65382-c54e-441a-b0c4-80bbf85f4fb5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:21.465940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a65382-c54e-441a-b0c4-80bbf85f4fb5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:21.471970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199471b-dff8-4671-a3c5-5111bee6e74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:21.473124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199471b-dff8-4671-a3c5-5111bee6e74a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:21.473415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199471b-dff8-4671-a3c5-5111bee6e74a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:21.473697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199471b-dff8-4671-a3c5-5111bee6e74a admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:21.474949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199471b-dff8-4671-a3c5-5111bee6e74a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:32:21.475682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199471b-dff8-4671-a3c5-5111bee6e74a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:21.479425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199471b-dff8-4671-a3c5-5111bee6e74a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:21.499861 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3924/7810] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:32:21.501602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf156b-005d-4eca-9cb8-0dae790e34bb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:21.513722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf156b-005d-4eca-9cb8-0dae790e34bb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:21.519157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea808e-6d52-4a5d-bee0-0b090d700bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:21.519920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea808e-6d52-4a5d-bee0-0b090d700bea admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:21.520239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea808e-6d52-4a5d-bee0-0b090d700bea admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:21.520482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea808e-6d52-4a5d-bee0-0b090d700bea admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:21.521209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea808e-6d52-4a5d-bee0-0b090d700bea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:21.523175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea808e-6d52-4a5d-bee0-0b090d700bea admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:21.555980 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3887/7811] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:32:21 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:32:21.560839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199471b-dff8-4671-a3c5-5111bee6e74a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:21.568190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:21.574358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199471b-dff8-4671-a3c5-5111bee6e74a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:21.645875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8133c-2cff-4a79-9e67-3edd4b1e5085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:21.646618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8133c-2cff-4a79-9e67-3edd4b1e5085 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:21.647001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8133c-2cff-4a79-9e67-3edd4b1e5085 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:21.647399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8133c-2cff-4a79-9e67-3edd4b1e5085 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:21.648397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8133c-2cff-4a79-9e67-3edd4b1e5085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:21.650477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8133c-2cff-4a79-9e67-3edd4b1e5085 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:21.680698 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3925/7812] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:32:21 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:32:21.684712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea808e-6d52-4a5d-bee0-0b090d700bea admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:21.697119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea808e-6d52-4a5d-bee0-0b090d700bea admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:21.703020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bca6be-cddd-4548-95ae-137d8228848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:21.703698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bca6be-cddd-4548-95ae-137d8228848e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:21.703976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bca6be-cddd-4548-95ae-137d8228848e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:21.704639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bca6be-cddd-4548-95ae-137d8228848e admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:21.705472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bca6be-cddd-4548-95ae-137d8228848e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:21.707752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bca6be-cddd-4548-95ae-137d8228848e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:21.725238 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3888/7813] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:32:21.726129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8133c-2cff-4a79-9e67-3edd4b1e5085 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:21.739356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8133c-2cff-4a79-9e67-3edd4b1e5085 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:21.744701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d95228-1dc2-496a-a902-de529407041f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:21.745382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d95228-1dc2-496a-a902-de529407041f admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:21.745669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d95228-1dc2-496a-a902-de529407041f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:21.745953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d95228-1dc2-496a-a902-de529407041f admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:21.746681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d95228-1dc2-496a-a902-de529407041f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:21.748363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d95228-1dc2-496a-a902-de529407041f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:21.767854 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3926/7814] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:32:21.769303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bca6be-cddd-4548-95ae-137d8228848e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:21.781167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bca6be-cddd-4548-95ae-137d8228848e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:21.787404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b6090-cbdb-43af-bd89-20a88043db0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:21.789604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b6090-cbdb-43af-bd89-20a88043db0b admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:21.789604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b6090-cbdb-43af-bd89-20a88043db0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:21.789604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b6090-cbdb-43af-bd89-20a88043db0b admin admin] PATH_INFO: `/v3/projects/45479078494645e4a9632b7f102f8c02/users/b0d3ad86d2654467b5e600ee9de3d2ba/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:21.806814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b6090-cbdb-43af-bd89-20a88043db0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=45479078494645e4a9632b7f102f8c02, user_id=b0d3ad86d2654467b5e600ee9de3d2ba, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:21.809520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b6090-cbdb-43af-bd89-20a88043db0b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:21.827811 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3889/7815] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:32:21 2022] PUT /identity/v3/projects/45479078494645e4a9632b7f102f8c02/users/b0d3ad86d2654467b5e600ee9de3d2ba/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:21.839599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd36e3-4266-4de4-ab4a-a9e74a14ed83 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:21.839891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd36e3-4266-4de4-ab4a-a9e74a14ed83 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:21.840455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd36e3-4266-4de4-ab4a-a9e74a14ed83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:21.871791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c6dd36e3-4266-4de4-ab4a-a9e74a14ed83 None None] MFA Rules not processed for user `b0d3ad86d2654467b5e600ee9de3d2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:21.873310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c6dd36e3-4266-4de4-ab4a-a9e74a14ed83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:21.946742 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3927/7816] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:21.958028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b6090-cbdb-43af-bd89-20a88043db0b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:21.959984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1a0b6090-cbdb-43af-bd89-20a88043db0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:22.031018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b6090-cbdb-43af-bd89-20a88043db0b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:22.035382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3668a3b-fc41-4409-ba71-19bc3bda9a08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:22.036065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3668a3b-fc41-4409-ba71-19bc3bda9a08 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:22.036359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3668a3b-fc41-4409-ba71-19bc3bda9a08 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:22.036908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3668a3b-fc41-4409-ba71-19bc3bda9a08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:22.051502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3668a3b-fc41-4409-ba71-19bc3bda9a08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:22.053419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3668a3b-fc41-4409-ba71-19bc3bda9a08 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:22.065430 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3890/7817] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:32:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:32:22.096639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd36e3-4266-4de4-ab4a-a9e74a14ed83 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:22.163315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd36e3-4266-4de4-ab4a-a9e74a14ed83 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:22.168472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ee356-c5f0-4e40-a723-43c2f3251c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:22.169560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ee356-c5f0-4e40-a723-43c2f3251c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:22.169879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ee356-c5f0-4e40-a723-43c2f3251c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:22.170311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ee356-c5f0-4e40-a723-43c2f3251c0d admin admin] PATH_INFO: `/v3/users/b0d3ad86d2654467b5e600ee9de3d2ba` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:22.171570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ee356-c5f0-4e40-a723-43c2f3251c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d3ad86d2654467b5e600ee9de3d2ba)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:22.173586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ee356-c5f0-4e40-a723-43c2f3251c0d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:22.188613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:22.224481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6e7ee356-c5f0-4e40-a723-43c2f3251c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d3ad86d2654467b5e600ee9de3d2ba'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:22.231952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6e7ee356-c5f0-4e40-a723-43c2f3251c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d3ad86d2654467b5e600ee9de3d2ba'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:22.232670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6e7ee356-c5f0-4e40-a723-43c2f3251c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d3ad86d2654467b5e600ee9de3d2ba'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:22.233283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6e7ee356-c5f0-4e40-a723-43c2f3251c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d3ad86d2654467b5e600ee9de3d2ba'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:22.240906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6e7ee356-c5f0-4e40-a723-43c2f3251c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d3ad86d2654467b5e600ee9de3d2ba'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:22.263825 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3928/7818] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:32:22 2022] DELETE /identity/v3/users/b0d3ad86d2654467b5e600ee9de3d2ba => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:22.268440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039780c-5a95-484c-ad7d-e84b7efc8d81 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:22.268958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039780c-5a95-484c-ad7d-e84b7efc8d81 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:22.269063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039780c-5a95-484c-ad7d-e84b7efc8d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:22.286355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3039780c-5a95-484c-ad7d-e84b7efc8d81 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:22.287589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3039780c-5a95-484c-ad7d-e84b7efc8d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:22.350007 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3891/7819] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:22.359925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ee356-c5f0-4e40-a723-43c2f3251c0d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:22.361549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6e7ee356-c5f0-4e40-a723-43c2f3251c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:22.424376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ee356-c5f0-4e40-a723-43c2f3251c0d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:22.429139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dde52e-0f4a-418e-ada6-e516dda1d5eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:22.429811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dde52e-0f4a-418e-ada6-e516dda1d5eb service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:22.430127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dde52e-0f4a-418e-ada6-e516dda1d5eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:22.430412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dde52e-0f4a-418e-ada6-e516dda1d5eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:22.440409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dde52e-0f4a-418e-ada6-e516dda1d5eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:22.441800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dde52e-0f4a-418e-ada6-e516dda1d5eb service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:22.451611 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3929/7820] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:32:22.721227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039780c-5a95-484c-ad7d-e84b7efc8d81 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:22.722933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3039780c-5a95-484c-ad7d-e84b7efc8d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:22.737871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039780c-5a95-484c-ad7d-e84b7efc8d81 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:22.744679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936c3f3-5dbf-4b1a-963a-cdcb4fced4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:22.745514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936c3f3-5dbf-4b1a-963a-cdcb4fced4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:22.745830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936c3f3-5dbf-4b1a-963a-cdcb4fced4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:22.746068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936c3f3-5dbf-4b1a-963a-cdcb4fced4f5 admin admin] PATH_INFO: `/v3/projects/45479078494645e4a9632b7f102f8c02` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:22.747362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936c3f3-5dbf-4b1a-963a-cdcb4fced4f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45479078494645e4a9632b7f102f8c02)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:22.749336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936c3f3-5dbf-4b1a-963a-cdcb4fced4f5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:22.786677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:22.802233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7936c3f3-5dbf-4b1a-963a-cdcb4fced4f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45479078494645e4a9632b7f102f8c02', 'request_id': 'req-7936c3f3-5dbf-4b1a-963a-cdcb4fced4f5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:22.809345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7936c3f3-5dbf-4b1a-963a-cdcb4fced4f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45479078494645e4a9632b7f102f8c02', 'request_id': 'req-7936c3f3-5dbf-4b1a-963a-cdcb4fced4f5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:22.815157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7936c3f3-5dbf-4b1a-963a-cdcb4fced4f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45479078494645e4a9632b7f102f8c02', 'request_id': 'req-7936c3f3-5dbf-4b1a-963a-cdcb4fced4f5'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:22.831804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7936c3f3-5dbf-4b1a-963a-cdcb4fced4f5 admin admin] The token cache is being invalidate because project 45479078494645e4a9632b7f102f8c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:32:22.832131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7936c3f3-5dbf-4b1a-963a-cdcb4fced4f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:22.832768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7936c3f3-5dbf-4b1a-963a-cdcb4fced4f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:32:22.834390 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3892/7821] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:32:22 2022] DELETE /identity/v3/projects/45479078494645e4a9632b7f102f8c02 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:32:22.840170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990b2a7-dd23-41b3-a507-fc8130dfe176 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:22.840463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990b2a7-dd23-41b3-a507-fc8130dfe176 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:22.840754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990b2a7-dd23-41b3-a507-fc8130dfe176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:22.858742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a990b2a7-dd23-41b3-a507-fc8130dfe176 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:22.859968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a990b2a7-dd23-41b3-a507-fc8130dfe176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:22.929273 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3930/7822] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:22.937553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a51ff7-b25d-4f67-b222-0056bd5171dc None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:22.937871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a51ff7-b25d-4f67-b222-0056bd5171dc None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:22.938169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a51ff7-b25d-4f67-b222-0056bd5171dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:22.956584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-71a51ff7-b25d-4f67-b222-0056bd5171dc None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:22.957796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-71a51ff7-b25d-4f67-b222-0056bd5171dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:22.966151 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3893/7823] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:22.970460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990b2a7-dd23-41b3-a507-fc8130dfe176 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:22.980606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990b2a7-dd23-41b3-a507-fc8130dfe176 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:22.985772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baddfc1-cb44-4e9f-a4da-a655da06a4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:22.986425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baddfc1-cb44-4e9f-a4da-a655da06a4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:22.986707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baddfc1-cb44-4e9f-a4da-a655da06a4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:22.986986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baddfc1-cb44-4e9f-a4da-a655da06a4a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:22.987708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baddfc1-cb44-4e9f-a4da-a655da06a4a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:32:22.988021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baddfc1-cb44-4e9f-a4da-a655da06a4a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:22.989696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baddfc1-cb44-4e9f-a4da-a655da06a4a0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:23.002361 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3931/7824] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:32:23.006737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a51ff7-b25d-4f67-b222-0056bd5171dc None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:23.016203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a51ff7-b25d-4f67-b222-0056bd5171dc None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:23.023132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac39497-7d25-4b91-936a-c6e32e22f220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:23.024372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac39497-7d25-4b91-936a-c6e32e22f220 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:23.024857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac39497-7d25-4b91-936a-c6e32e22f220 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:23.025305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac39497-7d25-4b91-936a-c6e32e22f220 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:23.026432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac39497-7d25-4b91-936a-c6e32e22f220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:23.028622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac39497-7d25-4b91-936a-c6e32e22f220 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:23.056715 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3894/7825] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:32:23 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:32:23.061027 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baddfc1-cb44-4e9f-a4da-a655da06a4a0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:23.071374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baddfc1-cb44-4e9f-a4da-a655da06a4a0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:23.088960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:23.131641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8eb9-4ffb-4ab2-8f0a-5fd7fbd5d851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:23.132358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8eb9-4ffb-4ab2-8f0a-5fd7fbd5d851 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:23.132645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8eb9-4ffb-4ab2-8f0a-5fd7fbd5d851 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:23.132924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8eb9-4ffb-4ab2-8f0a-5fd7fbd5d851 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:23.133697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a8eb9-4ffb-4ab2-8f0a-5fd7fbd5d851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:23.135687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a8eb9-4ffb-4ab2-8f0a-5fd7fbd5d851 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:23.159223 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3932/7826] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:32:23 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:32:23.160572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac39497-7d25-4b91-936a-c6e32e22f220 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:23.171823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac39497-7d25-4b91-936a-c6e32e22f220 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:23.177212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962a0ce-3d8d-46d2-8763-fdd23c2e6d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:23.178317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962a0ce-3d8d-46d2-8763-fdd23c2e6d3a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:23.178612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962a0ce-3d8d-46d2-8763-fdd23c2e6d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:23.178885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962a0ce-3d8d-46d2-8763-fdd23c2e6d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:23.179611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962a0ce-3d8d-46d2-8763-fdd23c2e6d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:23.181286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962a0ce-3d8d-46d2-8763-fdd23c2e6d3a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:23.192369 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3895/7827] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:32:23.196871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8eb9-4ffb-4ab2-8f0a-5fd7fbd5d851 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:23.207572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8eb9-4ffb-4ab2-8f0a-5fd7fbd5d851 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:23.212372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52463dd-ae3f-4d6c-b1f9-e531d394c7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:23.213043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52463dd-ae3f-4d6c-b1f9-e531d394c7ce admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:23.213323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52463dd-ae3f-4d6c-b1f9-e531d394c7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:23.213626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52463dd-ae3f-4d6c-b1f9-e531d394c7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:23.214345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52463dd-ae3f-4d6c-b1f9-e531d394c7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:23.216005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52463dd-ae3f-4d6c-b1f9-e531d394c7ce admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:23.227247 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3933/7828] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:32:23.231228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962a0ce-3d8d-46d2-8763-fdd23c2e6d3a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:23.242143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962a0ce-3d8d-46d2-8763-fdd23c2e6d3a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:23.247494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148de2b-5d63-483b-842b-a5668b4ae64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:23.248433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148de2b-5d63-483b-842b-a5668b4ae64b admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:23.248711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148de2b-5d63-483b-842b-a5668b4ae64b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:23.249011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148de2b-5d63-483b-842b-a5668b4ae64b admin admin] PATH_INFO: `/v3/projects/f74b842162f6463a9e93046d070919e7/users/150099eea6064cebbd876d26a3d6fe4a/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:23.265657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148de2b-5d63-483b-842b-a5668b4ae64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74b842162f6463a9e93046d070919e7, user_id=150099eea6064cebbd876d26a3d6fe4a, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:23.268347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148de2b-5d63-483b-842b-a5668b4ae64b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:23.283351 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3896/7829] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:32:23 2022] PUT /identity/v3/projects/f74b842162f6463a9e93046d070919e7/users/150099eea6064cebbd876d26a3d6fe4a/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:23.293974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1bc05-2352-4495-9f64-6403f0446750 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:23.294276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1bc05-2352-4495-9f64-6403f0446750 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:23.294583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1bc05-2352-4495-9f64-6403f0446750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:23.324184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3cf1bc05-2352-4495-9f64-6403f0446750 None None] MFA Rules not processed for user `150099eea6064cebbd876d26a3d6fe4a`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:23.326495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3cf1bc05-2352-4495-9f64-6403f0446750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:23.336405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148de2b-5d63-483b-842b-a5668b4ae64b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:23.339030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7148de2b-5d63-483b-842b-a5668b4ae64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:23.410375 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3934/7830] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:23.414946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1bc05-2352-4495-9f64-6403f0446750 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:23.435257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148de2b-5d63-483b-842b-a5668b4ae64b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:23.442041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc48478-6d5f-4c18-b585-c4934437abad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:23.442964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc48478-6d5f-4c18-b585-c4934437abad service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:23.443274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc48478-6d5f-4c18-b585-c4934437abad service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:23.443530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc48478-6d5f-4c18-b585-c4934437abad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:23.445398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9dc48478-6d5f-4c18-b585-c4934437abad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:23.459622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc48478-6d5f-4c18-b585-c4934437abad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:23.461391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc48478-6d5f-4c18-b585-c4934437abad service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:23.473784 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3897/7831] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:32:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:32:23.476381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1bc05-2352-4495-9f64-6403f0446750 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:23.481821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf997b2-9e53-428f-8a30-01a434ba0567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:23.482555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf997b2-9e53-428f-8a30-01a434ba0567 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:23.482785 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf997b2-9e53-428f-8a30-01a434ba0567 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:23.483082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf997b2-9e53-428f-8a30-01a434ba0567 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:23.483738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf997b2-9e53-428f-8a30-01a434ba0567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:23.485723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf997b2-9e53-428f-8a30-01a434ba0567 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:23.515086 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3935/7832] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:32:23 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:32:23.519443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc48478-6d5f-4c18-b585-c4934437abad service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:23.530950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc48478-6d5f-4c18-b585-c4934437abad service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:23.570495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:23.597319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe7e9c-c45c-4e36-b67a-ec38f24f238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:23.597994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe7e9c-c45c-4e36-b67a-ec38f24f238b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:23.598300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe7e9c-c45c-4e36-b67a-ec38f24f238b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:23.598576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe7e9c-c45c-4e36-b67a-ec38f24f238b admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:23.599272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe7e9c-c45c-4e36-b67a-ec38f24f238b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:23.601250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe7e9c-c45c-4e36-b67a-ec38f24f238b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:23.627851 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3898/7833] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:32:23 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:32:23.629134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf997b2-9e53-428f-8a30-01a434ba0567 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:23.640355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf997b2-9e53-428f-8a30-01a434ba0567 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:23.646194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d06c0c-1c27-41d0-94ec-e02238d626fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:23.646855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d06c0c-1c27-41d0-94ec-e02238d626fe admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:23.647141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d06c0c-1c27-41d0-94ec-e02238d626fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:23.647422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d06c0c-1c27-41d0-94ec-e02238d626fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:23.648241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d06c0c-1c27-41d0-94ec-e02238d626fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:23.650011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d06c0c-1c27-41d0-94ec-e02238d626fe admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:23.661096 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3936/7834] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:32:23.665425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe7e9c-c45c-4e36-b67a-ec38f24f238b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:23.676069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe7e9c-c45c-4e36-b67a-ec38f24f238b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:23.682483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f835e-792d-40b7-98b2-29ebfc84c031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:23.683373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f835e-792d-40b7-98b2-29ebfc84c031 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:23.683655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f835e-792d-40b7-98b2-29ebfc84c031 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:23.683924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f835e-792d-40b7-98b2-29ebfc84c031 admin admin] PATH_INFO: `/v3/projects/8ca08f2f073b4a3cbeedddc9ff7d12ed/users/de6a1f275eeb40958879db4fbea287fa/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:23.699540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f835e-792d-40b7-98b2-29ebfc84c031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca08f2f073b4a3cbeedddc9ff7d12ed, user_id=de6a1f275eeb40958879db4fbea287fa, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:23.702332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f835e-792d-40b7-98b2-29ebfc84c031 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:23.719103 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3899/7835] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:32:23 2022] PUT /identity/v3/projects/8ca08f2f073b4a3cbeedddc9ff7d12ed/users/de6a1f275eeb40958879db4fbea287fa/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:23.723382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d06c0c-1c27-41d0-94ec-e02238d626fe admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:23.728727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:23.736482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d06c0c-1c27-41d0-94ec-e02238d626fe admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:23.809788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996418a-c517-420b-87a5-fd7fcae35452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:23.810461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996418a-c517-420b-87a5-fd7fcae35452 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:23.810734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996418a-c517-420b-87a5-fd7fcae35452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:23.811018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996418a-c517-420b-87a5-fd7fcae35452 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:23.811808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996418a-c517-420b-87a5-fd7fcae35452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:23.813667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996418a-c517-420b-87a5-fd7fcae35452 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:23.823936 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3937/7836] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:32:23.828557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f835e-792d-40b7-98b2-29ebfc84c031 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:23.839975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f835e-792d-40b7-98b2-29ebfc84c031 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:23.845292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91498b22-76ea-4049-825d-488cbee2d975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:23.846302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91498b22-76ea-4049-825d-488cbee2d975 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:23.846652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91498b22-76ea-4049-825d-488cbee2d975 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:23.847000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91498b22-76ea-4049-825d-488cbee2d975 admin admin] PATH_INFO: `/v3/projects/8ca08f2f073b4a3cbeedddc9ff7d12ed/users/de6a1f275eeb40958879db4fbea287fa/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:23.849439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91498b22-76ea-4049-825d-488cbee2d975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca08f2f073b4a3cbeedddc9ff7d12ed, user_id=de6a1f275eeb40958879db4fbea287fa, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:23.852449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91498b22-76ea-4049-825d-488cbee2d975 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:23.864666 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3900/7837] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:32:23 2022] PUT /identity/v3/projects/8ca08f2f073b4a3cbeedddc9ff7d12ed/users/de6a1f275eeb40958879db4fbea287fa/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:32:23.876517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffe096-af7b-4296-8fa7-ea07d14e8034 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:23.876934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffe096-af7b-4296-8fa7-ea07d14e8034 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:23.877283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffe096-af7b-4296-8fa7-ea07d14e8034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:23.909933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-13ffe096-af7b-4296-8fa7-ea07d14e8034 None None] MFA Rules not processed for user `de6a1f275eeb40958879db4fbea287fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:23.911177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-13ffe096-af7b-4296-8fa7-ea07d14e8034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:23.985804 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3938/7838] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:23.996816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91498b22-76ea-4049-825d-488cbee2d975 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:23.998663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-91498b22-76ea-4049-825d-488cbee2d975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:24.062590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91498b22-76ea-4049-825d-488cbee2d975 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:24.066527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79897a59-9cfb-4f85-9e0f-d59e3873c11d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:24.067185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79897a59-9cfb-4f85-9e0f-d59e3873c11d service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:24.067460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79897a59-9cfb-4f85-9e0f-d59e3873c11d service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:24.067734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79897a59-9cfb-4f85-9e0f-d59e3873c11d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:24.135893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79897a59-9cfb-4f85-9e0f-d59e3873c11d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:24.137437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79897a59-9cfb-4f85-9e0f-d59e3873c11d service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:24.146847 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3901/7839] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:32:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:32:24.991949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffe096-af7b-4296-8fa7-ea07d14e8034 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:25.102955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffe096-af7b-4296-8fa7-ea07d14e8034 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:25.110167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994315a-2e06-43cd-b816-a96b0b923423 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:25.111500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994315a-2e06-43cd-b816-a96b0b923423 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:25.111884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994315a-2e06-43cd-b816-a96b0b923423 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:25.112300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994315a-2e06-43cd-b816-a96b0b923423 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:25.114800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f994315a-2e06-43cd-b816-a96b0b923423 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:25.141116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994315a-2e06-43cd-b816-a96b0b923423 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:25.144109 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994315a-2e06-43cd-b816-a96b0b923423 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:25.181975 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3939/7840] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:32:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:32:26.019868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79897a59-9cfb-4f85-9e0f-d59e3873c11d service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:32:26.022207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-79897a59-9cfb-4f85-9e0f-d59e3873c11d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:26.040066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79897a59-9cfb-4f85-9e0f-d59e3873c11d service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:32:26.046407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898109e-ab02-43e0-a270-9d49078d817d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:32:26.047062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898109e-ab02-43e0-a270-9d49078d817d service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:26.047339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898109e-ab02-43e0-a270-9d49078d817d service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:26.047586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898109e-ab02-43e0-a270-9d49078d817d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:26.057818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898109e-ab02-43e0-a270-9d49078d817d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:32:26.059275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898109e-ab02-43e0-a270-9d49078d817d service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:32:26.069577 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3902/7841] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:32:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:32:32.179261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ba375-fc12-485f-a7e3-1fcd2a4bc844 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:32:32.179809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ba375-fc12-485f-a7e3-1fcd2a4bc844 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:32:32.179930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ba375-fc12-485f-a7e3-1fcd2a4bc844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:32:32.200328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c68ba375-fc12-485f-a7e3-1fcd2a4bc844 None None] MFA Rules not processed for user `150099eea6064cebbd876d26a3d6fe4a`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:32:32.201618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c68ba375-fc12-485f-a7e3-1fcd2a4bc844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:32:32.209052 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3940/7842] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:32:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:32:36.065199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=80,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:42.193646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:33:06.881885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898109e-ab02-43e0-a270-9d49078d817d service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:33:06.899577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898109e-ab02-43e0-a270-9d49078d817d service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:33:06.907284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52e988-d4a7-4761-9c96-7e38862de761 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:33:06.907925 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52e988-d4a7-4761-9c96-7e38862de761 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:33:06.908251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52e988-d4a7-4761-9c96-7e38862de761 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:33:06.908525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52e988-d4a7-4761-9c96-7e38862de761 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:33:06.910646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8e52e988-d4a7-4761-9c96-7e38862de761 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:33:06.972958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52e988-d4a7-4761-9c96-7e38862de761 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:33:06.974492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52e988-d4a7-4761-9c96-7e38862de761 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:33:06.983934 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3903/7843] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:33:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:33:13.422694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ba375-fc12-485f-a7e3-1fcd2a4bc844 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:33:13.435647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ba375-fc12-485f-a7e3-1fcd2a4bc844 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:33:13.440305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084c919-d4f7-42e4-bcdf-b8e29521dc60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:33:13.441055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084c919-d4f7-42e4-bcdf-b8e29521dc60 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:33:13.441402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084c919-d4f7-42e4-bcdf-b8e29521dc60 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:33:13.441673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084c919-d4f7-42e4-bcdf-b8e29521dc60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:33:13.444592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7084c919-d4f7-42e4-bcdf-b8e29521dc60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:33:13.514862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084c919-d4f7-42e4-bcdf-b8e29521dc60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:33:13.516702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084c919-d4f7-42e4-bcdf-b8e29521dc60 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:33:13.527535 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3941/7844] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:33:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:33:16.480283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8e94a-28c3-46ad-a064-4cf3375235f7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:33:16.480913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8e94a-28c3-46ad-a064-4cf3375235f7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:33:16.480913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8e94a-28c3-46ad-a064-4cf3375235f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:33:16.500638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6ca8e94a-28c3-46ad-a064-4cf3375235f7 None None] MFA Rules not processed for user `317a63cdd16b4fd69617fb9de95dc4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:33:16.502151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6ca8e94a-28c3-46ad-a064-4cf3375235f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:33:16.509782 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3904/7845] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:33:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:33:16.879190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084c919-d4f7-42e4-bcdf-b8e29521dc60 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:33:16.890420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084c919-d4f7-42e4-bcdf-b8e29521dc60 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:33:16.895229 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db56d9-9a10-4fe4-902e-a42a84e05903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:33:16.895964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db56d9-9a10-4fe4-902e-a42a84e05903 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:33:16.896372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db56d9-9a10-4fe4-902e-a42a84e05903 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:33:16.896716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db56d9-9a10-4fe4-902e-a42a84e05903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:33:16.898660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-21db56d9-9a10-4fe4-902e-a42a84e05903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:33:16.910810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db56d9-9a10-4fe4-902e-a42a84e05903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:33:16.912432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db56d9-9a10-4fe4-902e-a42a84e05903 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:33:16.924454 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3942/7846] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:33:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:33:26.494996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=31 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:33:26.917099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=36 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:33:53.816193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cb8cf-f0a9-4fed-81ae-87ad35f4fb34 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:33:53.816750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cb8cf-f0a9-4fed-81ae-87ad35f4fb34 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:33:53.816750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cb8cf-f0a9-4fed-81ae-87ad35f4fb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:33:53.837647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d77cb8cf-f0a9-4fed-81ae-87ad35f4fb34 None None] MFA Rules not processed for user `150099eea6064cebbd876d26a3d6fe4a`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:33:53.839597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d77cb8cf-f0a9-4fed-81ae-87ad35f4fb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:33:53.851868 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3905/7847] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:33:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:33:56.967084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db56d9-9a10-4fe4-902e-a42a84e05903 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:33:56.969319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-21db56d9-9a10-4fe4-902e-a42a84e05903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:33:56.990492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db56d9-9a10-4fe4-902e-a42a84e05903 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:33:56.996949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ea702-a6a4-4b71-ad4a-11cb13b8cf97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:33:56.997627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ea702-a6a4-4b71-ad4a-11cb13b8cf97 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:33:56.997911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ea702-a6a4-4b71-ad4a-11cb13b8cf97 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:33:56.998189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ea702-a6a4-4b71-ad4a-11cb13b8cf97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:33:57.000030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a91ea702-a6a4-4b71-ad4a-11cb13b8cf97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:33:57.015463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ea702-a6a4-4b71-ad4a-11cb13b8cf97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:33:57.017134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ea702-a6a4-4b71-ad4a-11cb13b8cf97 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:33:57.031528 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3943/7848] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:33:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:34:03.829828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:34:05.594432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4bbde-95f2-459d-ae9f-73d8942cbea3 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:34:05.595114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4bbde-95f2-459d-ae9f-73d8942cbea3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:34:05.595114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4bbde-95f2-459d-ae9f-73d8942cbea3 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:34:05.596423 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3906/7849] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:34:05.601492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac4a85-142e-458c-bc12-4edb371022d4 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:34:05.601965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac4a85-142e-458c-bc12-4edb371022d4 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:34:05.602082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac4a85-142e-458c-bc12-4edb371022d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:34:05.625291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-40ac4a85-142e-458c-bc12-4edb371022d4 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:34:05.626597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-40ac4a85-142e-458c-bc12-4edb371022d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:34:05.692560 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3944/7850] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:34:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:34:05.713253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4bbde-95f2-459d-ae9f-73d8942cbea3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:34:05.715156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-63d4bbde-95f2-459d-ae9f-73d8942cbea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:34:05.735373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4bbde-95f2-459d-ae9f-73d8942cbea3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:34:05.741187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b3d04-30a9-403a-82a1-cdd93cc44e1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:34:05.741830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b3d04-30a9-403a-82a1-cdd93cc44e1f service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:34:05.742114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b3d04-30a9-403a-82a1-cdd93cc44e1f service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:34:05.742387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b3d04-30a9-403a-82a1-cdd93cc44e1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:34:05.751564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b3d04-30a9-403a-82a1-cdd93cc44e1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:34:05.753240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b3d04-30a9-403a-82a1-cdd93cc44e1f service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:34:05.763450 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3907/7851] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:34:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:34:10.059353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac4a85-142e-458c-bc12-4edb371022d4 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:34:10.085710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac4a85-142e-458c-bc12-4edb371022d4 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:34:10.097736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1636d2-5ea4-4914-9709-3e3ad633b521 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:34:10.097929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1636d2-5ea4-4914-9709-3e3ad633b521 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:34:10.098425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1636d2-5ea4-4914-9709-3e3ad633b521 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:34:10.098863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1636d2-5ea4-4914-9709-3e3ad633b521 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:34:10.101529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fa1636d2-5ea4-4914-9709-3e3ad633b521 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:34:10.124860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1636d2-5ea4-4914-9709-3e3ad633b521 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:34:10.126508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1636d2-5ea4-4914-9709-3e3ad633b521 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:34:10.139617 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3945/7852] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:34:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:34:15.759283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:34:20.132886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=41 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:34:32.286970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728cc42-168e-4da0-9e9a-80ab6891dc0a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:34:32.287565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728cc42-168e-4da0-9e9a-80ab6891dc0a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:34:32.287565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728cc42-168e-4da0-9e9a-80ab6891dc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:34:32.310506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2728cc42-168e-4da0-9e9a-80ab6891dc0a None None] MFA Rules not processed for user `317a63cdd16b4fd69617fb9de95dc4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:34:32.311851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2728cc42-168e-4da0-9e9a-80ab6891dc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:34:32.325212 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3908/7853] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:34:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:34:42.303248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:35:02.945657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006125db-9bc5-4598-864d-019e597f1162 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:02.946557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006125db-9bc5-4598-864d-019e597f1162 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:02.946993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006125db-9bc5-4598-864d-019e597f1162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:02.981993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-006125db-9bc5-4598-864d-019e597f1162 None None] MFA Rules not processed for user `150099eea6064cebbd876d26a3d6fe4a`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:35:02.983446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-006125db-9bc5-4598-864d-019e597f1162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:35:02.998611 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3946/7854] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:35:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:35:12.973509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:35:15.708339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728cc42-168e-4da0-9e9a-80ab6891dc0a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:35:15.721034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728cc42-168e-4da0-9e9a-80ab6891dc0a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:35:15.726346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58a8d5-bc13-453a-9d59-c1bd79d1abe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:35:15.727022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58a8d5-bc13-453a-9d59-c1bd79d1abe7 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:15.727310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58a8d5-bc13-453a-9d59-c1bd79d1abe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:15.727591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58a8d5-bc13-453a-9d59-c1bd79d1abe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:15.730324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7b58a8d5-bc13-453a-9d59-c1bd79d1abe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:35:15.799456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58a8d5-bc13-453a-9d59-c1bd79d1abe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:35:15.800781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58a8d5-bc13-453a-9d59-c1bd79d1abe7 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:35:15.812166 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3909/7855] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:35:18.000923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006125db-9bc5-4598-864d-019e597f1162 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:35:18.002449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-006125db-9bc5-4598-864d-019e597f1162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:35:18.020176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006125db-9bc5-4598-864d-019e597f1162 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:35:18.026454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e40327-fbc8-4b36-94d1-11f94321fd42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:35:18.027104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e40327-fbc8-4b36-94d1-11f94321fd42 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:18.027393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e40327-fbc8-4b36-94d1-11f94321fd42 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:18.027673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e40327-fbc8-4b36-94d1-11f94321fd42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:18.029656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-46e40327-fbc8-4b36-94d1-11f94321fd42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:35:18.044872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e40327-fbc8-4b36-94d1-11f94321fd42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:35:18.046503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e40327-fbc8-4b36-94d1-11f94321fd42 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:35:18.060006 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3947/7856] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:35:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:35:18.857097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58a8d5-bc13-453a-9d59-c1bd79d1abe7 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:35:18.878536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58a8d5-bc13-453a-9d59-c1bd79d1abe7 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:35:18.900290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374abce-9826-45ef-ba75-218d7682a93a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:35:18.901544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374abce-9826-45ef-ba75-218d7682a93a service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:18.901842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374abce-9826-45ef-ba75-218d7682a93a service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:18.902124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374abce-9826-45ef-ba75-218d7682a93a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:18.905687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2374abce-9826-45ef-ba75-218d7682a93a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:35:18.925642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e40327-fbc8-4b36-94d1-11f94321fd42 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:35:18.925905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374abce-9826-45ef-ba75-218d7682a93a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:35:18.927803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-46e40327-fbc8-4b36-94d1-11f94321fd42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:35:18.928263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374abce-9826-45ef-ba75-218d7682a93a service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:35:18.950847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e40327-fbc8-4b36-94d1-11f94321fd42 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:35:18.956207 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3910/7857] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:35:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:35:18.957739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d38e5-182d-42ea-b408-858c56a50e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:35:18.958728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d38e5-182d-42ea-b408-858c56a50e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:18.959092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d38e5-182d-42ea-b408-858c56a50e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:18.959371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d38e5-182d-42ea-b408-858c56a50e8b admin admin] PATH_INFO: `/v3/users/a90caf8a110549e39bbaf7ec50a6207d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:18.960780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d38e5-182d-42ea-b408-858c56a50e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a90caf8a110549e39bbaf7ec50a6207d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:35:18.962788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d38e5-182d-42ea-b408-858c56a50e8b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:35:19.038877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-897d38e5-182d-42ea-b408-858c56a50e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90caf8a110549e39bbaf7ec50a6207d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:35:19.048933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-897d38e5-182d-42ea-b408-858c56a50e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90caf8a110549e39bbaf7ec50a6207d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:35:19.049602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-897d38e5-182d-42ea-b408-858c56a50e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90caf8a110549e39bbaf7ec50a6207d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:35:19.050237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-897d38e5-182d-42ea-b408-858c56a50e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90caf8a110549e39bbaf7ec50a6207d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:35:19.057816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-897d38e5-182d-42ea-b408-858c56a50e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90caf8a110549e39bbaf7ec50a6207d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:35:19.075320 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3948/7858] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:35:18 2022] DELETE /identity/v3/users/a90caf8a110549e39bbaf7ec50a6207d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:35:19.262154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374abce-9826-45ef-ba75-218d7682a93a service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:35:19.274477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374abce-9826-45ef-ba75-218d7682a93a service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:35:19.337723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f3dc3-2413-40d4-9e90-8cf11559ce5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:35:19.338636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f3dc3-2413-40d4-9e90-8cf11559ce5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:19.338918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f3dc3-2413-40d4-9e90-8cf11559ce5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:19.339199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f3dc3-2413-40d4-9e90-8cf11559ce5f admin admin] PATH_INFO: `/v3/projects/44ceefe86e694dc8a2c9a478eeb1d1c5` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:19.340433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f3dc3-2413-40d4-9e90-8cf11559ce5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=44ceefe86e694dc8a2c9a478eeb1d1c5)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:35:19.342394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f3dc3-2413-40d4-9e90-8cf11559ce5f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:35:19.389541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e13f3dc3-2413-40d4-9e90-8cf11559ce5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'request_id': 'req-e13f3dc3-2413-40d4-9e90-8cf11559ce5f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:35:19.395616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e13f3dc3-2413-40d4-9e90-8cf11559ce5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'request_id': 'req-e13f3dc3-2413-40d4-9e90-8cf11559ce5f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:35:19.401375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e13f3dc3-2413-40d4-9e90-8cf11559ce5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'request_id': 'req-e13f3dc3-2413-40d4-9e90-8cf11559ce5f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:35:19.414868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e13f3dc3-2413-40d4-9e90-8cf11559ce5f admin admin] The token cache is being invalidate because project 44ceefe86e694dc8a2c9a478eeb1d1c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:35:19.415160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e13f3dc3-2413-40d4-9e90-8cf11559ce5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:35:19.415798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e13f3dc3-2413-40d4-9e90-8cf11559ce5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:35:19.417398 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3911/7859] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:35:19 2022] DELETE /identity/v3/projects/44ceefe86e694dc8a2c9a478eeb1d1c5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:35:19.423477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17266482-ca58-4704-9a95-a64f813a577a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:19.423716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17266482-ca58-4704-9a95-a64f813a577a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:19.423999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17266482-ca58-4704-9a95-a64f813a577a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:19.443842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-17266482-ca58-4704-9a95-a64f813a577a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:35:19.445120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-17266482-ca58-4704-9a95-a64f813a577a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:35:19.507133 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3949/7860] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:35:19.519707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44a4b3-1a87-428f-9ad6-174d18c804a6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:19.519992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44a4b3-1a87-428f-9ad6-174d18c804a6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:19.520377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44a4b3-1a87-428f-9ad6-174d18c804a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:19.549605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-df44a4b3-1a87-428f-9ad6-174d18c804a6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:35:19.550835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-df44a4b3-1a87-428f-9ad6-174d18c804a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:35:19.561049 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3912/7861] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:35:19.565901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17266482-ca58-4704-9a95-a64f813a577a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:35:19.576079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17266482-ca58-4704-9a95-a64f813a577a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:35:19.581187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0df75-ea94-4587-ae59-d27fba385edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:35:19.581848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0df75-ea94-4587-ae59-d27fba385edb admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:19.582128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0df75-ea94-4587-ae59-d27fba385edb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:19.582410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0df75-ea94-4587-ae59-d27fba385edb admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:19.583140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0df75-ea94-4587-ae59-d27fba385edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:35:19.583451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0df75-ea94-4587-ae59-d27fba385edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:35:19.585143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0df75-ea94-4587-ae59-d27fba385edb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:35:19.596988 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3950/7862] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:35:19.601352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44a4b3-1a87-428f-9ad6-174d18c804a6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:35:19.607143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:35:19.611118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44a4b3-1a87-428f-9ad6-174d18c804a6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:35:19.618019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910eb51-7d86-48f3-9597-b39f72969d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:35:19.618694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910eb51-7d86-48f3-9597-b39f72969d6f admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:19.619742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910eb51-7d86-48f3-9597-b39f72969d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:19.620025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910eb51-7d86-48f3-9597-b39f72969d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:19.620767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910eb51-7d86-48f3-9597-b39f72969d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:35:19.622733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910eb51-7d86-48f3-9597-b39f72969d6f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:35:19.649995 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3913/7863] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:35:19 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:35:19.654222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0df75-ea94-4587-ae59-d27fba385edb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:35:19.665114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0df75-ea94-4587-ae59-d27fba385edb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:35:19.712381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:35:19.727821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24f9d7-5d49-494c-a8f5-2acee7b7e202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:35:19.728536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24f9d7-5d49-494c-a8f5-2acee7b7e202 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:19.728830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24f9d7-5d49-494c-a8f5-2acee7b7e202 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:19.729108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24f9d7-5d49-494c-a8f5-2acee7b7e202 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:19.729812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24f9d7-5d49-494c-a8f5-2acee7b7e202 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:35:19.731777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24f9d7-5d49-494c-a8f5-2acee7b7e202 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:35:19.752488 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3951/7864] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:35:19 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:35:19.756771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910eb51-7d86-48f3-9597-b39f72969d6f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:35:19.767601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910eb51-7d86-48f3-9597-b39f72969d6f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:35:19.772570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0f023-fca0-469d-9b63-64d2a7636a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:35:19.773230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0f023-fca0-469d-9b63-64d2a7636a82 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:19.773515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0f023-fca0-469d-9b63-64d2a7636a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:19.773792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0f023-fca0-469d-9b63-64d2a7636a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:19.774513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0f023-fca0-469d-9b63-64d2a7636a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:35:19.776168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0f023-fca0-469d-9b63-64d2a7636a82 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:35:19.787730 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3914/7865] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:35:19.791921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24f9d7-5d49-494c-a8f5-2acee7b7e202 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:35:19.804297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24f9d7-5d49-494c-a8f5-2acee7b7e202 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:35:19.809584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99a4bf-43ff-4998-875a-2d818c05765c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:35:19.810258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99a4bf-43ff-4998-875a-2d818c05765c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:19.810543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99a4bf-43ff-4998-875a-2d818c05765c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:19.810820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99a4bf-43ff-4998-875a-2d818c05765c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:19.811532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99a4bf-43ff-4998-875a-2d818c05765c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:35:19.813191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99a4bf-43ff-4998-875a-2d818c05765c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:35:19.824831 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3952/7866] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:35:19.829179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0f023-fca0-469d-9b63-64d2a7636a82 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:35:19.839982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0f023-fca0-469d-9b63-64d2a7636a82 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:35:19.845160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26b49d-5eb5-4400-b5fe-0c1485b360d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:35:19.846092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26b49d-5eb5-4400-b5fe-0c1485b360d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:19.846374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26b49d-5eb5-4400-b5fe-0c1485b360d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:19.846641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26b49d-5eb5-4400-b5fe-0c1485b360d6 admin admin] PATH_INFO: `/v3/projects/89d5b5b1b03f495d9dcdfdc29598fe8f/users/39889b52b09a40ecacbf5a790e5bd20e/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:19.862165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26b49d-5eb5-4400-b5fe-0c1485b360d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d5b5b1b03f495d9dcdfdc29598fe8f, user_id=39889b52b09a40ecacbf5a790e5bd20e, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:35:19.864902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26b49d-5eb5-4400-b5fe-0c1485b360d6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:35:19.880257 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3915/7867] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:35:19 2022] PUT /identity/v3/projects/89d5b5b1b03f495d9dcdfdc29598fe8f/users/39889b52b09a40ecacbf5a790e5bd20e/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:35:19.885403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca2c65-aaec-4fa4-9b16-0f78c1c513b5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:19.885688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca2c65-aaec-4fa4-9b16-0f78c1c513b5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:19.885958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca2c65-aaec-4fa4-9b16-0f78c1c513b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:19.903517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4cca2c65-aaec-4fa4-9b16-0f78c1c513b5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:35:19.904768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4cca2c65-aaec-4fa4-9b16-0f78c1c513b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:35:19.968146 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3953/7868] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:35:19.978345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26b49d-5eb5-4400-b5fe-0c1485b360d6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:35:19.980236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0e26b49d-5eb5-4400-b5fe-0c1485b360d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:35:20.043686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26b49d-5eb5-4400-b5fe-0c1485b360d6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:35:20.047788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37caa4e-1f7d-4195-be0f-70078ba47f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:35:20.048483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37caa4e-1f7d-4195-be0f-70078ba47f20 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:20.048764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37caa4e-1f7d-4195-be0f-70078ba47f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:20.049038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37caa4e-1f7d-4195-be0f-70078ba47f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:20.059248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37caa4e-1f7d-4195-be0f-70078ba47f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:35:20.060730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37caa4e-1f7d-4195-be0f-70078ba47f20 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:35:20.070559 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3916/7869] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:35:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:35:24.261164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dcb67-8d61-4d66-9ff5-1a94a619f55d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:24.261742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dcb67-8d61-4d66-9ff5-1a94a619f55d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:24.261742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dcb67-8d61-4d66-9ff5-1a94a619f55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:24.291234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2d1dcb67-8d61-4d66-9ff5-1a94a619f55d None None] MFA Rules not processed for user `39889b52b09a40ecacbf5a790e5bd20e`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:35:24.292524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2d1dcb67-8d61-4d66-9ff5-1a94a619f55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:35:24.367597 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3954/7870] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:35:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:35:24.382899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37caa4e-1f7d-4195-be0f-70078ba47f20 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:35:24.384373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f37caa4e-1f7d-4195-be0f-70078ba47f20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:35:24.465237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37caa4e-1f7d-4195-be0f-70078ba47f20 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:35:24.471038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04cb05-4b14-466a-a934-787e25b432fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:35:24.471704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04cb05-4b14-466a-a934-787e25b432fb service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:24.471990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04cb05-4b14-466a-a934-787e25b432fb service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:24.472307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04cb05-4b14-466a-a934-787e25b432fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:24.485190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04cb05-4b14-466a-a934-787e25b432fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:35:24.486864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04cb05-4b14-466a-a934-787e25b432fb service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:35:24.497453 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3917/7871] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:35:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:35:25.959326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd8aff-0769-4d01-b14b-1d1a63b3fe48 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:35:25.959886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd8aff-0769-4d01-b14b-1d1a63b3fe48 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:35:25.959886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd8aff-0769-4d01-b14b-1d1a63b3fe48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:35:25.979327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-defd8aff-0769-4d01-b14b-1d1a63b3fe48 None None] MFA Rules not processed for user `39889b52b09a40ecacbf5a790e5bd20e`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:35:25.980609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-defd8aff-0769-4d01-b14b-1d1a63b3fe48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:35:25.988816 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3955/7872] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:35:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:35:34.498296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=82,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:35:35.974055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:15.372475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04cb05-4b14-466a-a934-787e25b432fb service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:15.374796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fe04cb05-4b14-466a-a934-787e25b432fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:15.390713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04cb05-4b14-466a-a934-787e25b432fb service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:15.395306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66109b9-bce5-45a9-833e-02e88c34ba2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:15.396552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66109b9-bce5-45a9-833e-02e88c34ba2c service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:15.397075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66109b9-bce5-45a9-833e-02e88c34ba2c service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:15.397582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66109b9-bce5-45a9-833e-02e88c34ba2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:15.399761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a66109b9-bce5-45a9-833e-02e88c34ba2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:15.416427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66109b9-bce5-45a9-833e-02e88c34ba2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:15.418931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66109b9-bce5-45a9-833e-02e88c34ba2c service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:15.433002 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3918/7873] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:36:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:36:16.623292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd8aff-0769-4d01-b14b-1d1a63b3fe48 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:16.635654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd8aff-0769-4d01-b14b-1d1a63b3fe48 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:16.639719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010edfe1-fe5d-4985-9f85-123e443c3f5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:16.640392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010edfe1-fe5d-4985-9f85-123e443c3f5a service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:16.640668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010edfe1-fe5d-4985-9f85-123e443c3f5a service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:16.641085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010edfe1-fe5d-4985-9f85-123e443c3f5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:16.642878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-010edfe1-fe5d-4985-9f85-123e443c3f5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:16.662594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010edfe1-fe5d-4985-9f85-123e443c3f5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:16.664066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010edfe1-fe5d-4985-9f85-123e443c3f5a service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:16.678883 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3956/7874] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:36:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:36:24.274438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2006f0-e5e0-419e-b4e7-4129e161fd87 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:24.275518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2006f0-e5e0-419e-b4e7-4129e161fd87 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:24.275923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2006f0-e5e0-419e-b4e7-4129e161fd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:24.296879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0a2006f0-e5e0-419e-b4e7-4129e161fd87 None None] MFA Rules not processed for user `39889b52b09a40ecacbf5a790e5bd20e`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:36:24.298259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0a2006f0-e5e0-419e-b4e7-4129e161fd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:24.306608 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3919/7875] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:36:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:36:24.850117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010edfe1-fe5d-4985-9f85-123e443c3f5a service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:24.861230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-010edfe1-fe5d-4985-9f85-123e443c3f5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:24.967827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010edfe1-fe5d-4985-9f85-123e443c3f5a service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:24.974729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76468410-8cf9-4ed9-b6a0-8cd4b971583a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:24.975486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76468410-8cf9-4ed9-b6a0-8cd4b971583a service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:24.975730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76468410-8cf9-4ed9-b6a0-8cd4b971583a service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:24.975973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76468410-8cf9-4ed9-b6a0-8cd4b971583a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:24.978282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-76468410-8cf9-4ed9-b6a0-8cd4b971583a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:24.995608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76468410-8cf9-4ed9-b6a0-8cd4b971583a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:24.997948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76468410-8cf9-4ed9-b6a0-8cd4b971583a service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:25.029666 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3957/7876] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:36:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:36:25.316516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2006f0-e5e0-419e-b4e7-4129e161fd87 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:25.325104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0a2006f0-e5e0-419e-b4e7-4129e161fd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:25.349568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2006f0-e5e0-419e-b4e7-4129e161fd87 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:25.355286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2d3bf-65f6-44f5-80f3-fd851777d030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:25.356287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2d3bf-65f6-44f5-80f3-fd851777d030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:25.356651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2d3bf-65f6-44f5-80f3-fd851777d030 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:25.356984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2d3bf-65f6-44f5-80f3-fd851777d030 admin admin] PATH_INFO: `/v3/users/317a63cdd16b4fd69617fb9de95dc4ec` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:25.358274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2d3bf-65f6-44f5-80f3-fd851777d030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=317a63cdd16b4fd69617fb9de95dc4ec)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:25.360502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2d3bf-65f6-44f5-80f3-fd851777d030 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:25.429033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-28a2d3bf-65f6-44f5-80f3-fd851777d030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '317a63cdd16b4fd69617fb9de95dc4ec'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:25.449296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-28a2d3bf-65f6-44f5-80f3-fd851777d030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '317a63cdd16b4fd69617fb9de95dc4ec'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:25.458636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-28a2d3bf-65f6-44f5-80f3-fd851777d030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '317a63cdd16b4fd69617fb9de95dc4ec'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:25.459491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-28a2d3bf-65f6-44f5-80f3-fd851777d030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '317a63cdd16b4fd69617fb9de95dc4ec'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:25.460314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-28a2d3bf-65f6-44f5-80f3-fd851777d030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '317a63cdd16b4fd69617fb9de95dc4ec'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:25.483530 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3920/7877] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:36:25 2022] DELETE /identity/v3/users/317a63cdd16b4fd69617fb9de95dc4ec => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:36:25.484960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e2253-f5e9-4931-b348-c020b6a65d3a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:25.485257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e2253-f5e9-4931-b348-c020b6a65d3a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:25.485542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e2253-f5e9-4931-b348-c020b6a65d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:25.503776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-932e2253-f5e9-4931-b348-c020b6a65d3a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:36:25.505563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-932e2253-f5e9-4931-b348-c020b6a65d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:25.591910 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3958/7878] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:36:25.598617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2d3bf-65f6-44f5-80f3-fd851777d030 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:25.600363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-28a2d3bf-65f6-44f5-80f3-fd851777d030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:25.668259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2d3bf-65f6-44f5-80f3-fd851777d030 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:25.674112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03380b6f-fda4-4f3d-8b96-aa13941f7437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:25.674785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03380b6f-fda4-4f3d-8b96-aa13941f7437 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:25.675072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03380b6f-fda4-4f3d-8b96-aa13941f7437 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:25.675351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03380b6f-fda4-4f3d-8b96-aa13941f7437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:25.686071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03380b6f-fda4-4f3d-8b96-aa13941f7437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:25.687538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03380b6f-fda4-4f3d-8b96-aa13941f7437 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:25.698207 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3921/7879] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:36:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:36:25.883305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e2253-f5e9-4931-b348-c020b6a65d3a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:25.885037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-932e2253-f5e9-4931-b348-c020b6a65d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:25.900449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e2253-f5e9-4931-b348-c020b6a65d3a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:25.905592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0d28b-c962-4edd-b16d-e5948044a432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:25.906555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0d28b-c962-4edd-b16d-e5948044a432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:25.906929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0d28b-c962-4edd-b16d-e5948044a432 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:25.907268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0d28b-c962-4edd-b16d-e5948044a432 admin admin] PATH_INFO: `/v3/projects/e1b2fbfc815c48588a0bec36818df1a3` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:25.908570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0d28b-c962-4edd-b16d-e5948044a432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b2fbfc815c48588a0bec36818df1a3)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:25.910569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0d28b-c962-4edd-b16d-e5948044a432 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:25.977907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d7c0d28b-c962-4edd-b16d-e5948044a432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b2fbfc815c48588a0bec36818df1a3', 'request_id': 'req-d7c0d28b-c962-4edd-b16d-e5948044a432'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:25.986599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d7c0d28b-c962-4edd-b16d-e5948044a432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b2fbfc815c48588a0bec36818df1a3', 'request_id': 'req-d7c0d28b-c962-4edd-b16d-e5948044a432'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:25.993751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d7c0d28b-c962-4edd-b16d-e5948044a432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b2fbfc815c48588a0bec36818df1a3', 'request_id': 'req-d7c0d28b-c962-4edd-b16d-e5948044a432'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:26.002198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:26.007180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d7c0d28b-c962-4edd-b16d-e5948044a432 admin admin] The token cache is being invalidate because project e1b2fbfc815c48588a0bec36818df1a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:36:26.007556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d7c0d28b-c962-4edd-b16d-e5948044a432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:26.008340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d7c0d28b-c962-4edd-b16d-e5948044a432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:26.010134 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3959/7880] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:36:25 2022] DELETE /identity/v3/projects/e1b2fbfc815c48588a0bec36818df1a3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:36:26.014431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03380b6f-fda4-4f3d-8b96-aa13941f7437 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:26.027044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03380b6f-fda4-4f3d-8b96-aa13941f7437 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:26.083556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:26.087294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ddf96-75ad-4ba2-adef-c6bf47cdaa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:26.088521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ddf96-75ad-4ba2-adef-c6bf47cdaa92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:26.088858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ddf96-75ad-4ba2-adef-c6bf47cdaa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:26.089624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ddf96-75ad-4ba2-adef-c6bf47cdaa92 admin admin] PATH_INFO: `/v3/users/50d182d4b3f9416fb6d8e44c841dfc16` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:26.091322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ddf96-75ad-4ba2-adef-c6bf47cdaa92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50d182d4b3f9416fb6d8e44c841dfc16)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:26.093864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ddf96-75ad-4ba2-adef-c6bf47cdaa92 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:26.144112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-215ddf96-75ad-4ba2-adef-c6bf47cdaa92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50d182d4b3f9416fb6d8e44c841dfc16'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:26.153825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-215ddf96-75ad-4ba2-adef-c6bf47cdaa92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50d182d4b3f9416fb6d8e44c841dfc16'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:26.161283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-215ddf96-75ad-4ba2-adef-c6bf47cdaa92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50d182d4b3f9416fb6d8e44c841dfc16'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:26.161979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-215ddf96-75ad-4ba2-adef-c6bf47cdaa92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50d182d4b3f9416fb6d8e44c841dfc16'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:26.162649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-215ddf96-75ad-4ba2-adef-c6bf47cdaa92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50d182d4b3f9416fb6d8e44c841dfc16'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:26.182116 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3922/7881] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:36:26 2022] DELETE /identity/v3/users/50d182d4b3f9416fb6d8e44c841dfc16 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:36:26.464833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0d28b-c962-4edd-b16d-e5948044a432 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:26.466883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d7c0d28b-c962-4edd-b16d-e5948044a432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:26.492520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0d28b-c962-4edd-b16d-e5948044a432 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:26.593112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ba029-1cc0-4034-89a8-0e74a72ebe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:26.594213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ba029-1cc0-4034-89a8-0e74a72ebe33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:26.594678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ba029-1cc0-4034-89a8-0e74a72ebe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:26.595134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ba029-1cc0-4034-89a8-0e74a72ebe33 admin admin] PATH_INFO: `/v3/projects/a8f5801df264467ab9c057b023a72caa` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:26.596717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ba029-1cc0-4034-89a8-0e74a72ebe33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f5801df264467ab9c057b023a72caa)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:26.599421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ba029-1cc0-4034-89a8-0e74a72ebe33 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:26.659227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1b5ba029-1cc0-4034-89a8-0e74a72ebe33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f5801df264467ab9c057b023a72caa', 'request_id': 'req-1b5ba029-1cc0-4034-89a8-0e74a72ebe33'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:26.667341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1b5ba029-1cc0-4034-89a8-0e74a72ebe33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f5801df264467ab9c057b023a72caa', 'request_id': 'req-1b5ba029-1cc0-4034-89a8-0e74a72ebe33'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:26.675346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1b5ba029-1cc0-4034-89a8-0e74a72ebe33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f5801df264467ab9c057b023a72caa', 'request_id': 'req-1b5ba029-1cc0-4034-89a8-0e74a72ebe33'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:26.686292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1b5ba029-1cc0-4034-89a8-0e74a72ebe33 admin admin] The token cache is being invalidate because project a8f5801df264467ab9c057b023a72caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:36:26.686578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1b5ba029-1cc0-4034-89a8-0e74a72ebe33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:26.687231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1b5ba029-1cc0-4034-89a8-0e74a72ebe33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:26.688881 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3960/7882] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:36:26 2022] DELETE /identity/v3/projects/a8f5801df264467ab9c057b023a72caa => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:36:26.696759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efec16-fc2d-4ec6-91ca-ea986b5684ff None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:26.697323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efec16-fc2d-4ec6-91ca-ea986b5684ff None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:26.697323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efec16-fc2d-4ec6-91ca-ea986b5684ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:26.716109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-90efec16-fc2d-4ec6-91ca-ea986b5684ff None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:36:26.717363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-90efec16-fc2d-4ec6-91ca-ea986b5684ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:26.781877 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3923/7883] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:36:26.790024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2e478-3482-4af4-b16c-f52acc41d6b8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:26.790311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2e478-3482-4af4-b16c-f52acc41d6b8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:26.790590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2e478-3482-4af4-b16c-f52acc41d6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:26.811545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-aff2e478-3482-4af4-b16c-f52acc41d6b8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:36:26.812866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-aff2e478-3482-4af4-b16c-f52acc41d6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:26.822028 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3961/7884] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:36:26.826475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efec16-fc2d-4ec6-91ca-ea986b5684ff None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:26.837147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efec16-fc2d-4ec6-91ca-ea986b5684ff None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:26.842051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c8d83-f1a9-41f3-8626-f802ab165e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:26.842715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c8d83-f1a9-41f3-8626-f802ab165e3b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:26.843000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c8d83-f1a9-41f3-8626-f802ab165e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:26.843281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c8d83-f1a9-41f3-8626-f802ab165e3b admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:26.844051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c8d83-f1a9-41f3-8626-f802ab165e3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:36:26.844373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c8d83-f1a9-41f3-8626-f802ab165e3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:26.845995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c8d83-f1a9-41f3-8626-f802ab165e3b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:26.858924 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3924/7885] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:36:26.863423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2e478-3482-4af4-b16c-f52acc41d6b8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:26.874155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2e478-3482-4af4-b16c-f52acc41d6b8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:26.879186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399172fe-5770-4e7d-a0c8-2c21581954d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:26.879894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399172fe-5770-4e7d-a0c8-2c21581954d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:26.880288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399172fe-5770-4e7d-a0c8-2c21581954d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:26.880566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399172fe-5770-4e7d-a0c8-2c21581954d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:26.881296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399172fe-5770-4e7d-a0c8-2c21581954d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:26.883220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399172fe-5770-4e7d-a0c8-2c21581954d5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:26.936966 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3962/7886] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:36:26 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:36:26.941143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c8d83-f1a9-41f3-8626-f802ab165e3b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:26.952064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c8d83-f1a9-41f3-8626-f802ab165e3b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:27.041174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a55fb-bfd6-48b9-95b3-75d0ab0777f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:27.041874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a55fb-bfd6-48b9-95b3-75d0ab0777f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:27.042145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a55fb-bfd6-48b9-95b3-75d0ab0777f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:27.042428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a55fb-bfd6-48b9-95b3-75d0ab0777f6 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:27.043155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a55fb-bfd6-48b9-95b3-75d0ab0777f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:27.045783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a55fb-bfd6-48b9-95b3-75d0ab0777f6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:27.055264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:27.075618 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3925/7887] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:36:26 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:36:27.077294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399172fe-5770-4e7d-a0c8-2c21581954d5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:27.089200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399172fe-5770-4e7d-a0c8-2c21581954d5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:27.095904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec3717-c0b6-4f44-813a-55f017728a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:27.096115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec3717-c0b6-4f44-813a-55f017728a57 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:27.096401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec3717-c0b6-4f44-813a-55f017728a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:27.096680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec3717-c0b6-4f44-813a-55f017728a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:27.097409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec3717-c0b6-4f44-813a-55f017728a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:27.099104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec3717-c0b6-4f44-813a-55f017728a57 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:27.109945 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3963/7888] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:36:27.114125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a55fb-bfd6-48b9-95b3-75d0ab0777f6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:27.124999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a55fb-bfd6-48b9-95b3-75d0ab0777f6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:27.129783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416ca58-0233-44e2-81bd-72580277889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:27.130595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416ca58-0233-44e2-81bd-72580277889a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:27.130888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416ca58-0233-44e2-81bd-72580277889a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:27.131181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416ca58-0233-44e2-81bd-72580277889a admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:27.131914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416ca58-0233-44e2-81bd-72580277889a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:27.133597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416ca58-0233-44e2-81bd-72580277889a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:27.145412 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3926/7889] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:36:27.150271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec3717-c0b6-4f44-813a-55f017728a57 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:27.163587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec3717-c0b6-4f44-813a-55f017728a57 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:27.168760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd38fbe-8f85-4e82-9723-595aefae44ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:27.169486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd38fbe-8f85-4e82-9723-595aefae44ea admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:27.169771 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd38fbe-8f85-4e82-9723-595aefae44ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:27.170058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd38fbe-8f85-4e82-9723-595aefae44ea admin admin] PATH_INFO: `/v3/projects/655a8ac13c4d47208cc9437074595d8d/users/253740c520d7432da9b93d8d2e7aa418/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:27.186997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd38fbe-8f85-4e82-9723-595aefae44ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=655a8ac13c4d47208cc9437074595d8d, user_id=253740c520d7432da9b93d8d2e7aa418, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:27.190401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd38fbe-8f85-4e82-9723-595aefae44ea admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:27.227307 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3964/7890] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:36:27 2022] PUT /identity/v3/projects/655a8ac13c4d47208cc9437074595d8d/users/253740c520d7432da9b93d8d2e7aa418/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:36:27.229337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0400e5-fb7c-408b-8162-5a505770e979 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:27.229790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0400e5-fb7c-408b-8162-5a505770e979 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:27.230076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0400e5-fb7c-408b-8162-5a505770e979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:27.263603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-cd0400e5-fb7c-408b-8162-5a505770e979 None None] MFA Rules not processed for user `253740c520d7432da9b93d8d2e7aa418`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:36:27.264989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cd0400e5-fb7c-408b-8162-5a505770e979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:27.367048 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3927/7891] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:36:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:36:27.371020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd38fbe-8f85-4e82-9723-595aefae44ea admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:27.398866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:27.464493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd38fbe-8f85-4e82-9723-595aefae44ea admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:27.469900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c1450-711b-404b-84ba-603f8dce0985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:27.470749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c1450-711b-404b-84ba-603f8dce0985 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:27.471043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c1450-711b-404b-84ba-603f8dce0985 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:27.471324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c1450-711b-404b-84ba-603f8dce0985 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:27.472106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c1450-711b-404b-84ba-603f8dce0985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:27.474397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c1450-711b-404b-84ba-603f8dce0985 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:27.520449 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3965/7892] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:36:27 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:36:27.525080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0400e5-fb7c-408b-8162-5a505770e979 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:27.539168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0400e5-fb7c-408b-8162-5a505770e979 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:27.674493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9a0f1-7db0-4e38-a8dd-b348d78839c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:27.675936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9a0f1-7db0-4e38-a8dd-b348d78839c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:27.676250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9a0f1-7db0-4e38-a8dd-b348d78839c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:27.676532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9a0f1-7db0-4e38-a8dd-b348d78839c5 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:27.678125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9a0f1-7db0-4e38-a8dd-b348d78839c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:27.684541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9a0f1-7db0-4e38-a8dd-b348d78839c5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:27.732173 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3928/7893] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:36:27 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:36:27.737188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c1450-711b-404b-84ba-603f8dce0985 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:27.756367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c1450-711b-404b-84ba-603f8dce0985 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:27.762021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec91968-db33-4a41-b3b6-15e3fce3cd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:27.762860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec91968-db33-4a41-b3b6-15e3fce3cd1c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:27.763287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec91968-db33-4a41-b3b6-15e3fce3cd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:27.763658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec91968-db33-4a41-b3b6-15e3fce3cd1c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:27.765198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec91968-db33-4a41-b3b6-15e3fce3cd1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:27.766336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec91968-db33-4a41-b3b6-15e3fce3cd1c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:27.779892 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3966/7894] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:36:27.784304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9a0f1-7db0-4e38-a8dd-b348d78839c5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:27.832150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9a0f1-7db0-4e38-a8dd-b348d78839c5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:27.840470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec0154-983d-408e-8d23-028957c4a74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:27.842819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec0154-983d-408e-8d23-028957c4a74e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:27.843335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec0154-983d-408e-8d23-028957c4a74e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:27.843838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec0154-983d-408e-8d23-028957c4a74e admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:27.845639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec0154-983d-408e-8d23-028957c4a74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:27.883304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec0154-983d-408e-8d23-028957c4a74e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:27.906425 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3929/7895] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:36:27.908589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec91968-db33-4a41-b3b6-15e3fce3cd1c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:27.925992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec91968-db33-4a41-b3b6-15e3fce3cd1c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:27.937013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7a477-3d49-476e-999e-273696698b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:27.937956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7a477-3d49-476e-999e-273696698b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:27.938244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7a477-3d49-476e-999e-273696698b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:27.938525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7a477-3d49-476e-999e-273696698b86 admin admin] PATH_INFO: `/v3/projects/324f0de0fb90476891405096b301dfd0/users/5d70927e18364f58a94c59b98920a7d0/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:27.982870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7a477-3d49-476e-999e-273696698b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=324f0de0fb90476891405096b301dfd0, user_id=5d70927e18364f58a94c59b98920a7d0, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:27.985940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7a477-3d49-476e-999e-273696698b86 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:28.024289 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3967/7896] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:36:27 2022] PUT /identity/v3/projects/324f0de0fb90476891405096b301dfd0/users/5d70927e18364f58a94c59b98920a7d0/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:36:28.026382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ff13b-9b0b-4c74-9bef-85258f020e2c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:28.027889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ff13b-9b0b-4c74-9bef-85258f020e2c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:28.027889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ff13b-9b0b-4c74-9bef-85258f020e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:28.096909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-cd8ff13b-9b0b-4c74-9bef-85258f020e2c None None] MFA Rules not processed for user `5d70927e18364f58a94c59b98920a7d0`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:36:28.097593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cd8ff13b-9b0b-4c74-9bef-85258f020e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:28.174688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:28.264935 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3930/7897] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:36:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:36:28.269362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7a477-3d49-476e-999e-273696698b86 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:28.346697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7a477-3d49-476e-999e-273696698b86 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:28.352399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ecc8d-7dc7-460f-a132-2bf897ad3ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:28.353137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ecc8d-7dc7-460f-a132-2bf897ad3ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:28.353433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ecc8d-7dc7-460f-a132-2bf897ad3ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:28.354019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ecc8d-7dc7-460f-a132-2bf897ad3ef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:28.354604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ecc8d-7dc7-460f-a132-2bf897ad3ef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:28.357060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ecc8d-7dc7-460f-a132-2bf897ad3ef5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:28.385874 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3968/7898] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:36:28 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:36:28.390581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ff13b-9b0b-4c74-9bef-85258f020e2c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:28.404415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ff13b-9b0b-4c74-9bef-85258f020e2c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:28.478657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395b14e-7c7f-450a-9859-d033700a6e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:28.479511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395b14e-7c7f-450a-9859-d033700a6e5c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:28.479958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395b14e-7c7f-450a-9859-d033700a6e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:28.480965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395b14e-7c7f-450a-9859-d033700a6e5c admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:28.481780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395b14e-7c7f-450a-9859-d033700a6e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:28.484211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395b14e-7c7f-450a-9859-d033700a6e5c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:28.521415 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3931/7899] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:36:28 2022] POST /identity/v3/users => generated 301 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:36:28.530393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ecc8d-7dc7-460f-a132-2bf897ad3ef5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:28.546758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ecc8d-7dc7-460f-a132-2bf897ad3ef5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:28.561098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38ab6b-24ad-4ba1-aa4d-c0e03e1889e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:28.561716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38ab6b-24ad-4ba1-aa4d-c0e03e1889e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:28.562190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38ab6b-24ad-4ba1-aa4d-c0e03e1889e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:28.562418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38ab6b-24ad-4ba1-aa4d-c0e03e1889e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:28.563142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38ab6b-24ad-4ba1-aa4d-c0e03e1889e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:28.564870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38ab6b-24ad-4ba1-aa4d-c0e03e1889e5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:28.593514 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3969/7900] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:36:28.595049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395b14e-7c7f-450a-9859-d033700a6e5c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:28.611661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395b14e-7c7f-450a-9859-d033700a6e5c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:28.626795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fafb6-1809-43ce-acf6-49bde72c3ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:28.628137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fafb6-1809-43ce-acf6-49bde72c3ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:28.628818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fafb6-1809-43ce-acf6-49bde72c3ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:28.629209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fafb6-1809-43ce-acf6-49bde72c3ca2 admin admin] PATH_INFO: `/v3/projects/dc72eb7a5c104c44b9050cac9c72cf14/users/471a3ad2091b4baba28dd6b1767f48d8/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:28.651384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fafb6-1809-43ce-acf6-49bde72c3ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc72eb7a5c104c44b9050cac9c72cf14, user_id=471a3ad2091b4baba28dd6b1767f48d8, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:28.658914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fafb6-1809-43ce-acf6-49bde72c3ca2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:28.685660 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3932/7901] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:36:28 2022] PUT /identity/v3/projects/dc72eb7a5c104c44b9050cac9c72cf14/users/471a3ad2091b4baba28dd6b1767f48d8/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:36:28.689777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38ab6b-24ad-4ba1-aa4d-c0e03e1889e5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:28.707334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38ab6b-24ad-4ba1-aa4d-c0e03e1889e5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:28.784977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:28.811592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b726d-7072-4262-b0c7-cda39cdf9686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:28.812622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b726d-7072-4262-b0c7-cda39cdf9686 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:28.813084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b726d-7072-4262-b0c7-cda39cdf9686 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:28.813540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b726d-7072-4262-b0c7-cda39cdf9686 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:28.814468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b726d-7072-4262-b0c7-cda39cdf9686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:28.816514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b726d-7072-4262-b0c7-cda39cdf9686 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:28.828994 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3970/7902] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:36:28.833792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fafb6-1809-43ce-acf6-49bde72c3ca2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:28.845317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fafb6-1809-43ce-acf6-49bde72c3ca2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:28.850297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717a05a-4e1e-4bff-83a0-e02489867181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:28.851410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717a05a-4e1e-4bff-83a0-e02489867181 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:28.851694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717a05a-4e1e-4bff-83a0-e02489867181 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:28.851977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717a05a-4e1e-4bff-83a0-e02489867181 admin admin] PATH_INFO: `/v3/projects/dc72eb7a5c104c44b9050cac9c72cf14/users/471a3ad2091b4baba28dd6b1767f48d8/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:28.854947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717a05a-4e1e-4bff-83a0-e02489867181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc72eb7a5c104c44b9050cac9c72cf14, user_id=471a3ad2091b4baba28dd6b1767f48d8, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:28.858090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717a05a-4e1e-4bff-83a0-e02489867181 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:28.873776 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3933/7903] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:36:28 2022] PUT /identity/v3/projects/dc72eb7a5c104c44b9050cac9c72cf14/users/471a3ad2091b4baba28dd6b1767f48d8/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:36:28.885848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b0a46-341d-40c5-a42d-f3d34616fd3b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:28.886142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b0a46-341d-40c5-a42d-f3d34616fd3b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:28.886420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b0a46-341d-40c5-a42d-f3d34616fd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:28.915731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f69b0a46-341d-40c5-a42d-f3d34616fd3b None None] MFA Rules not processed for user `471a3ad2091b4baba28dd6b1767f48d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:36:28.917105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f69b0a46-341d-40c5-a42d-f3d34616fd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:29.021212 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3971/7904] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:36:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:36:29.036854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717a05a-4e1e-4bff-83a0-e02489867181 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:29.046147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3717a05a-4e1e-4bff-83a0-e02489867181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:29.192958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717a05a-4e1e-4bff-83a0-e02489867181 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:29.200447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe67433-48c9-4724-a68c-7d39b2655c2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:29.201531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67433-48c9-4724-a68c-7d39b2655c2f service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:29.202192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67433-48c9-4724-a68c-7d39b2655c2f service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:29.202634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67433-48c9-4724-a68c-7d39b2655c2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:29.241223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:29.292970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe67433-48c9-4724-a68c-7d39b2655c2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:29.294237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe67433-48c9-4724-a68c-7d39b2655c2f service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:29.310537 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3934/7905] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:36:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:36:29.515473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b0a46-341d-40c5-a42d-f3d34616fd3b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:29.517121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f69b0a46-341d-40c5-a42d-f3d34616fd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:29.608582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b0a46-341d-40c5-a42d-f3d34616fd3b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:29.613361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344da39-15f5-471f-98e9-1a061d4723dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:29.614474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344da39-15f5-471f-98e9-1a061d4723dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:29.614899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344da39-15f5-471f-98e9-1a061d4723dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:29.615183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344da39-15f5-471f-98e9-1a061d4723dc admin admin] PATH_INFO: `/v3/users/150099eea6064cebbd876d26a3d6fe4a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:29.616472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344da39-15f5-471f-98e9-1a061d4723dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=150099eea6064cebbd876d26a3d6fe4a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:29.618622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344da39-15f5-471f-98e9-1a061d4723dc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:29.686760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6344da39-15f5-471f-98e9-1a061d4723dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '150099eea6064cebbd876d26a3d6fe4a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:29.699179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6344da39-15f5-471f-98e9-1a061d4723dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '150099eea6064cebbd876d26a3d6fe4a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:29.699793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6344da39-15f5-471f-98e9-1a061d4723dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '150099eea6064cebbd876d26a3d6fe4a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:29.700629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6344da39-15f5-471f-98e9-1a061d4723dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '150099eea6064cebbd876d26a3d6fe4a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:29.708148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6344da39-15f5-471f-98e9-1a061d4723dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '150099eea6064cebbd876d26a3d6fe4a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:29.710509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:29.735822 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3972/7906] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:36:29 2022] DELETE /identity/v3/users/150099eea6064cebbd876d26a3d6fe4a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:36:29.743220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8db08-204a-4de6-ad95-02617c213dab None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:29.743692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8db08-204a-4de6-ad95-02617c213dab None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:29.743692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8db08-204a-4de6-ad95-02617c213dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:29.766637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b7c8db08-204a-4de6-ad95-02617c213dab None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:36:29.767870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b7c8db08-204a-4de6-ad95-02617c213dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:29.860687 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3935/7907] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:36:29.871386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344da39-15f5-471f-98e9-1a061d4723dc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:29.872867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6344da39-15f5-471f-98e9-1a061d4723dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:29.932698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344da39-15f5-471f-98e9-1a061d4723dc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:29.936381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34680e5d-3588-4a16-939e-bf78db7017e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:29.937068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34680e5d-3588-4a16-939e-bf78db7017e8 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:29.937344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34680e5d-3588-4a16-939e-bf78db7017e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:29.937647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34680e5d-3588-4a16-939e-bf78db7017e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:29.947669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34680e5d-3588-4a16-939e-bf78db7017e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:29.949180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34680e5d-3588-4a16-939e-bf78db7017e8 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:29.959194 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3973/7908] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:36:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:36:30.139517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8db08-204a-4de6-ad95-02617c213dab None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:30.141759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b7c8db08-204a-4de6-ad95-02617c213dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:30.156285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8db08-204a-4de6-ad95-02617c213dab None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:30.163833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2cc07-756d-4bbb-8d1b-f8885c2f20af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:30.165245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2cc07-756d-4bbb-8d1b-f8885c2f20af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:30.165741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2cc07-756d-4bbb-8d1b-f8885c2f20af admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:30.166022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2cc07-756d-4bbb-8d1b-f8885c2f20af admin admin] PATH_INFO: `/v3/projects/f74b842162f6463a9e93046d070919e7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:30.167475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2cc07-756d-4bbb-8d1b-f8885c2f20af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f74b842162f6463a9e93046d070919e7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:30.173083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2cc07-756d-4bbb-8d1b-f8885c2f20af admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:30.222534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-22f2cc07-756d-4bbb-8d1b-f8885c2f20af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f74b842162f6463a9e93046d070919e7', 'request_id': 'req-22f2cc07-756d-4bbb-8d1b-f8885c2f20af'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:30.229613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-22f2cc07-756d-4bbb-8d1b-f8885c2f20af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f74b842162f6463a9e93046d070919e7', 'request_id': 'req-22f2cc07-756d-4bbb-8d1b-f8885c2f20af'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:30.235313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-22f2cc07-756d-4bbb-8d1b-f8885c2f20af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f74b842162f6463a9e93046d070919e7', 'request_id': 'req-22f2cc07-756d-4bbb-8d1b-f8885c2f20af'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:30.250143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-22f2cc07-756d-4bbb-8d1b-f8885c2f20af admin admin] The token cache is being invalidate because project f74b842162f6463a9e93046d070919e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:36:30.250422 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-22f2cc07-756d-4bbb-8d1b-f8885c2f20af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:30.251177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-22f2cc07-756d-4bbb-8d1b-f8885c2f20af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:30.253452 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3936/7909] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:36:30 2022] DELETE /identity/v3/projects/f74b842162f6463a9e93046d070919e7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:36:30.257204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34680e5d-3588-4a16-939e-bf78db7017e8 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:30.267594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34680e5d-3588-4a16-939e-bf78db7017e8 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:30.332541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fadea-e4f6-4cd9-ae35-2a07164a140a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:30.333498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fadea-e4f6-4cd9-ae35-2a07164a140a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:30.333778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fadea-e4f6-4cd9-ae35-2a07164a140a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:30.334051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fadea-e4f6-4cd9-ae35-2a07164a140a admin admin] PATH_INFO: `/v3/users/de6a1f275eeb40958879db4fbea287fa` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:30.335299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fadea-e4f6-4cd9-ae35-2a07164a140a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de6a1f275eeb40958879db4fbea287fa)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:30.337300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fadea-e4f6-4cd9-ae35-2a07164a140a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:30.389291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f35fadea-e4f6-4cd9-ae35-2a07164a140a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de6a1f275eeb40958879db4fbea287fa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:30.398230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f35fadea-e4f6-4cd9-ae35-2a07164a140a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de6a1f275eeb40958879db4fbea287fa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:30.398882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f35fadea-e4f6-4cd9-ae35-2a07164a140a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de6a1f275eeb40958879db4fbea287fa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:30.399510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f35fadea-e4f6-4cd9-ae35-2a07164a140a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de6a1f275eeb40958879db4fbea287fa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:30.406779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f35fadea-e4f6-4cd9-ae35-2a07164a140a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de6a1f275eeb40958879db4fbea287fa'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:30.426981 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3974/7910] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:36:30 2022] DELETE /identity/v3/users/de6a1f275eeb40958879db4fbea287fa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:36:30.894258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2cc07-756d-4bbb-8d1b-f8885c2f20af admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:30.896740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-22f2cc07-756d-4bbb-8d1b-f8885c2f20af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:30.911734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2cc07-756d-4bbb-8d1b-f8885c2f20af admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:30.967249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:30.979539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716aadce-479c-4fc2-9645-8e1a8602914b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:30.980542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716aadce-479c-4fc2-9645-8e1a8602914b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:30.980826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716aadce-479c-4fc2-9645-8e1a8602914b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:30.981127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716aadce-479c-4fc2-9645-8e1a8602914b admin admin] PATH_INFO: `/v3/projects/8ca08f2f073b4a3cbeedddc9ff7d12ed` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:30.982331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716aadce-479c-4fc2-9645-8e1a8602914b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca08f2f073b4a3cbeedddc9ff7d12ed)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:30.984277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716aadce-479c-4fc2-9645-8e1a8602914b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:31.040797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-716aadce-479c-4fc2-9645-8e1a8602914b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca08f2f073b4a3cbeedddc9ff7d12ed', 'request_id': 'req-716aadce-479c-4fc2-9645-8e1a8602914b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:31.047166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-716aadce-479c-4fc2-9645-8e1a8602914b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca08f2f073b4a3cbeedddc9ff7d12ed', 'request_id': 'req-716aadce-479c-4fc2-9645-8e1a8602914b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:31.053218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-716aadce-479c-4fc2-9645-8e1a8602914b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca08f2f073b4a3cbeedddc9ff7d12ed', 'request_id': 'req-716aadce-479c-4fc2-9645-8e1a8602914b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:31.065838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-716aadce-479c-4fc2-9645-8e1a8602914b admin admin] The token cache is being invalidate because project 8ca08f2f073b4a3cbeedddc9ff7d12ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:36:31.066073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-716aadce-479c-4fc2-9645-8e1a8602914b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:31.066662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-716aadce-479c-4fc2-9645-8e1a8602914b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:36:31.068403 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3937/7911] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:36:30 2022] DELETE /identity/v3/projects/8ca08f2f073b4a3cbeedddc9ff7d12ed => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:36:31.396818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fadea-e4f6-4cd9-ae35-2a07164a140a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:31.399254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f35fadea-e4f6-4cd9-ae35-2a07164a140a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:31.406535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:31.475432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fadea-e4f6-4cd9-ae35-2a07164a140a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:31.535951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98a099-5ae0-43ca-8309-475d77ead26a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:31.536778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98a099-5ae0-43ca-8309-475d77ead26a service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:31.537067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98a099-5ae0-43ca-8309-475d77ead26a service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:31.537349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98a099-5ae0-43ca-8309-475d77ead26a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:31.539508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8d98a099-5ae0-43ca-8309-475d77ead26a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:31.628773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98a099-5ae0-43ca-8309-475d77ead26a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:31.630207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98a099-5ae0-43ca-8309-475d77ead26a service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:31.640598 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3975/7912] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:36:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:36:35.410082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40527f-daad-42c2-a72b-0682176925da None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:35.410568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40527f-daad-42c2-a72b-0682176925da None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:35.410852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40527f-daad-42c2-a72b-0682176925da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:35.442913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9a40527f-daad-42c2-a72b-0682176925da None None] MFA Rules not processed for user `253740c520d7432da9b93d8d2e7aa418`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:36:35.444242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9a40527f-daad-42c2-a72b-0682176925da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:35.540217 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3938/7913] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:36:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:36:35.980015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98a099-5ae0-43ca-8309-475d77ead26a service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:36:35.981696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8d98a099-5ae0-43ca-8309-475d77ead26a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:35.996283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98a099-5ae0-43ca-8309-475d77ead26a service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:36:36.000588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4c863-8f51-4a76-9425-4a435d9acc91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:36:36.001448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4c863-8f51-4a76-9425-4a435d9acc91 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:36:36.001920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4c863-8f51-4a76-9425-4a435d9acc91 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:36:36.002368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4c863-8f51-4a76-9425-4a435d9acc91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:36:36.004626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0bd4c863-8f51-4a76-9425-4a435d9acc91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:36:36.018120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4c863-8f51-4a76-9425-4a435d9acc91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:36:36.020086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4c863-8f51-4a76-9425-4a435d9acc91 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:36:36.036579 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3976/7914] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:36:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:36:45.518959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:46.025683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=74 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:37:22.747901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40527f-daad-42c2-a72b-0682176925da None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:37:22.772809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40527f-daad-42c2-a72b-0682176925da None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:37:22.777574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b4175-deec-4d0d-95c5-402fd9992fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:37:22.778227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b4175-deec-4d0d-95c5-402fd9992fff service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:37:22.778517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b4175-deec-4d0d-95c5-402fd9992fff service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:37:22.778801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b4175-deec-4d0d-95c5-402fd9992fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:37:22.781147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-840b4175-deec-4d0d-95c5-402fd9992fff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:37:22.795758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b4175-deec-4d0d-95c5-402fd9992fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:37:22.797262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b4175-deec-4d0d-95c5-402fd9992fff service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:37:22.807930 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3939/7915] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:37:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:37:29.489407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d466d67-0b33-4ab4-824e-4a1f0baa3292 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:37:29.490536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d466d67-0b33-4ab4-824e-4a1f0baa3292 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:37:29.490858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d466d67-0b33-4ab4-824e-4a1f0baa3292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:37:29.508567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0d466d67-0b33-4ab4-824e-4a1f0baa3292 None None] MFA Rules not processed for user `253740c520d7432da9b93d8d2e7aa418`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:37:29.509962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0d466d67-0b33-4ab4-824e-4a1f0baa3292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:37:29.517171 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3977/7916] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:37:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:37:30.182627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b4175-deec-4d0d-95c5-402fd9992fff service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:37:30.189134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-840b4175-deec-4d0d-95c5-402fd9992fff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:37:30.296990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b4175-deec-4d0d-95c5-402fd9992fff service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:37:30.303157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94847c7b-8ce2-4d64-bde1-ab959663a969 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:37:30.304376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94847c7b-8ce2-4d64-bde1-ab959663a969 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:37:30.304874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94847c7b-8ce2-4d64-bde1-ab959663a969 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:37:30.305149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94847c7b-8ce2-4d64-bde1-ab959663a969 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:37:30.308822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-94847c7b-8ce2-4d64-bde1-ab959663a969 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:37:30.325259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94847c7b-8ce2-4d64-bde1-ab959663a969 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:37:30.327039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94847c7b-8ce2-4d64-bde1-ab959663a969 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:37:30.342973 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3940/7917] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:37:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:37:32.872102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d466d67-0b33-4ab4-824e-4a1f0baa3292 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:37:32.874566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0d466d67-0b33-4ab4-824e-4a1f0baa3292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:37:32.976164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d466d67-0b33-4ab4-824e-4a1f0baa3292 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:37:32.981643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5813f-38c0-44d3-ae51-6dbca72d836b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:37:32.982448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5813f-38c0-44d3-ae51-6dbca72d836b service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:37:32.982729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5813f-38c0-44d3-ae51-6dbca72d836b service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:37:32.983000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5813f-38c0-44d3-ae51-6dbca72d836b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:37:32.984919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ced5813f-38c0-44d3-ae51-6dbca72d836b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:37:33.000599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5813f-38c0-44d3-ae51-6dbca72d836b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:37:33.002403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5813f-38c0-44d3-ae51-6dbca72d836b service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:37:33.018031 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3978/7918] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:37:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:37:38.922204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94847c7b-8ce2-4d64-bde1-ab959663a969 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:37:38.938630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94847c7b-8ce2-4d64-bde1-ab959663a969 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:37:38.945214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5436073-bd7f-44cf-aaa0-624294276cf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:37:38.945910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5436073-bd7f-44cf-aaa0-624294276cf3 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:37:38.946195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5436073-bd7f-44cf-aaa0-624294276cf3 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:37:38.946465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5436073-bd7f-44cf-aaa0-624294276cf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:37:38.948522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b5436073-bd7f-44cf-aaa0-624294276cf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:37:38.963619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5436073-bd7f-44cf-aaa0-624294276cf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:37:38.965199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5436073-bd7f-44cf-aaa0-624294276cf3 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:37:38.978348 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3941/7919] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:37:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:37:43.010856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=41 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:37:48.971731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=48 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:37:50.564219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5813f-38c0-44d3-ae51-6dbca72d836b service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:37:50.565966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ced5813f-38c0-44d3-ae51-6dbca72d836b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:37:50.585792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5813f-38c0-44d3-ae51-6dbca72d836b service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:37:50.590339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc1fa0-983f-44cc-9776-0c121bc0cff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:37:50.591627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc1fa0-983f-44cc-9776-0c121bc0cff8 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:37:50.592259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc1fa0-983f-44cc-9776-0c121bc0cff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:37:50.593685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc1fa0-983f-44cc-9776-0c121bc0cff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:37:50.596723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-88fc1fa0-983f-44cc-9776-0c121bc0cff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:37:50.613459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc1fa0-983f-44cc-9776-0c121bc0cff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:37:50.619809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc1fa0-983f-44cc-9776-0c121bc0cff8 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:37:50.633489 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3979/7920] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:37:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:37:50.992144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c5db1-3104-40f5-96d7-e6e53f16b21e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:37:50.992709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c5db1-3104-40f5-96d7-e6e53f16b21e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:37:50.992709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c5db1-3104-40f5-96d7-e6e53f16b21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:37:51.011608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-855c5db1-3104-40f5-96d7-e6e53f16b21e None None] MFA Rules not processed for user `39889b52b09a40ecacbf5a790e5bd20e`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:37:51.012964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-855c5db1-3104-40f5-96d7-e6e53f16b21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:37:51.077017 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3942/7921] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:37:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:37:58.182588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc1fa0-983f-44cc-9776-0c121bc0cff8 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:37:58.184266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-88fc1fa0-983f-44cc-9776-0c121bc0cff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:37:58.260876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc1fa0-983f-44cc-9776-0c121bc0cff8 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:37:58.266412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5822a61-1657-49f8-95c2-f42c0d52a9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:37:58.267371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5822a61-1657-49f8-95c2-f42c0d52a9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:37:58.267690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5822a61-1657-49f8-95c2-f42c0d52a9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:37:58.267883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5822a61-1657-49f8-95c2-f42c0d52a9ac admin admin] PATH_INFO: `/v3/users/253740c520d7432da9b93d8d2e7aa418` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:37:58.269098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5822a61-1657-49f8-95c2-f42c0d52a9ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=253740c520d7432da9b93d8d2e7aa418)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:37:58.271082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5822a61-1657-49f8-95c2-f42c0d52a9ac admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:37:58.325956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f5822a61-1657-49f8-95c2-f42c0d52a9ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '253740c520d7432da9b93d8d2e7aa418'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:58.334807 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f5822a61-1657-49f8-95c2-f42c0d52a9ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '253740c520d7432da9b93d8d2e7aa418'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:58.335418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f5822a61-1657-49f8-95c2-f42c0d52a9ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '253740c520d7432da9b93d8d2e7aa418'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:58.336349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f5822a61-1657-49f8-95c2-f42c0d52a9ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '253740c520d7432da9b93d8d2e7aa418'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:58.343579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f5822a61-1657-49f8-95c2-f42c0d52a9ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '253740c520d7432da9b93d8d2e7aa418'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:58.361627 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3980/7922] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:37:58 2022] DELETE /identity/v3/users/253740c520d7432da9b93d8d2e7aa418 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:37:58.366338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563f68-2ced-43c4-b94a-bc73916714c9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:37:58.366838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563f68-2ced-43c4-b94a-bc73916714c9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:37:58.366945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563f68-2ced-43c4-b94a-bc73916714c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:37:58.386282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9c563f68-2ced-43c4-b94a-bc73916714c9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:37:58.387476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9c563f68-2ced-43c4-b94a-bc73916714c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:37:58.446712 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3943/7923] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:37:58.456915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5822a61-1657-49f8-95c2-f42c0d52a9ac admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:37:58.458518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f5822a61-1657-49f8-95c2-f42c0d52a9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:37:58.519427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5822a61-1657-49f8-95c2-f42c0d52a9ac admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:37:58.523829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b51fa-7967-48c3-ae35-ccc1aea32c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:37:58.524506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b51fa-7967-48c3-ae35-ccc1aea32c7d service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:37:58.524787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b51fa-7967-48c3-ae35-ccc1aea32c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:37:58.525055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b51fa-7967-48c3-ae35-ccc1aea32c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:37:58.534870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b51fa-7967-48c3-ae35-ccc1aea32c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:37:58.536367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b51fa-7967-48c3-ae35-ccc1aea32c7d service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:37:58.541384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:37:58.546423 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3981/7924] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:37:58.726413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c563f68-2ced-43c4-b94a-bc73916714c9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:37:58.727981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9c563f68-2ced-43c4-b94a-bc73916714c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:37:58.744670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c563f68-2ced-43c4-b94a-bc73916714c9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:37:58.751891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ba070-77c5-447c-8726-43005f6c384d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:37:58.753499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ba070-77c5-447c-8726-43005f6c384d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:37:58.753718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ba070-77c5-447c-8726-43005f6c384d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:37:58.753996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ba070-77c5-447c-8726-43005f6c384d admin admin] PATH_INFO: `/v3/projects/655a8ac13c4d47208cc9437074595d8d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:37:58.755185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ba070-77c5-447c-8726-43005f6c384d admin admin] RBAC: Authorizing `identity:delete_project(project_id=655a8ac13c4d47208cc9437074595d8d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:37:58.757176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ba070-77c5-447c-8726-43005f6c384d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:37:58.805654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c7ba070-77c5-447c-8726-43005f6c384d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655a8ac13c4d47208cc9437074595d8d', 'request_id': 'req-2c7ba070-77c5-447c-8726-43005f6c384d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:58.812571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c7ba070-77c5-447c-8726-43005f6c384d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655a8ac13c4d47208cc9437074595d8d', 'request_id': 'req-2c7ba070-77c5-447c-8726-43005f6c384d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:58.818444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c7ba070-77c5-447c-8726-43005f6c384d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655a8ac13c4d47208cc9437074595d8d', 'request_id': 'req-2c7ba070-77c5-447c-8726-43005f6c384d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:58.832382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c7ba070-77c5-447c-8726-43005f6c384d admin admin] The token cache is being invalidate because project 655a8ac13c4d47208cc9437074595d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:37:58.832710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c7ba070-77c5-447c-8726-43005f6c384d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:58.833863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c7ba070-77c5-447c-8726-43005f6c384d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:58.835688 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3944/7925] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:37:58 2022] DELETE /identity/v3/projects/655a8ac13c4d47208cc9437074595d8d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:37:58.839925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b51fa-7967-48c3-ae35-ccc1aea32c7d service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:37:58.853145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b51fa-7967-48c3-ae35-ccc1aea32c7d service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:37:58.928875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98748ed6-1c5f-4284-9920-506feb28c389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:37:58.929775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98748ed6-1c5f-4284-9920-506feb28c389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:37:58.930056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98748ed6-1c5f-4284-9920-506feb28c389 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:37:58.930327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98748ed6-1c5f-4284-9920-506feb28c389 admin admin] PATH_INFO: `/v3/users/5d70927e18364f58a94c59b98920a7d0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:37:58.931638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98748ed6-1c5f-4284-9920-506feb28c389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d70927e18364f58a94c59b98920a7d0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:37:58.933685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98748ed6-1c5f-4284-9920-506feb28c389 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:37:58.985453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-98748ed6-1c5f-4284-9920-506feb28c389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d70927e18364f58a94c59b98920a7d0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:58.993555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-98748ed6-1c5f-4284-9920-506feb28c389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d70927e18364f58a94c59b98920a7d0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:58.994300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-98748ed6-1c5f-4284-9920-506feb28c389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d70927e18364f58a94c59b98920a7d0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:58.995067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-98748ed6-1c5f-4284-9920-506feb28c389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d70927e18364f58a94c59b98920a7d0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:59.003594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-98748ed6-1c5f-4284-9920-506feb28c389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d70927e18364f58a94c59b98920a7d0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:59.020864 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3982/7926] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:37:58 2022] DELETE /identity/v3/users/5d70927e18364f58a94c59b98920a7d0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:37:59.397116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ba070-77c5-447c-8726-43005f6c384d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:37:59.399138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2c7ba070-77c5-447c-8726-43005f6c384d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:37:59.412523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ba070-77c5-447c-8726-43005f6c384d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:37:59.440637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:37:59.475171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e65081-9c75-46d2-a1d3-ff5912f924df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:37:59.476084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e65081-9c75-46d2-a1d3-ff5912f924df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:37:59.476374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e65081-9c75-46d2-a1d3-ff5912f924df admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:37:59.476655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e65081-9c75-46d2-a1d3-ff5912f924df admin admin] PATH_INFO: `/v3/projects/324f0de0fb90476891405096b301dfd0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:37:59.477871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e65081-9c75-46d2-a1d3-ff5912f924df admin admin] RBAC: Authorizing `identity:delete_project(project_id=324f0de0fb90476891405096b301dfd0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:37:59.479786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e65081-9c75-46d2-a1d3-ff5912f924df admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:37:59.526986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-15e65081-9c75-46d2-a1d3-ff5912f924df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '324f0de0fb90476891405096b301dfd0', 'request_id': 'req-15e65081-9c75-46d2-a1d3-ff5912f924df'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:59.533190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-15e65081-9c75-46d2-a1d3-ff5912f924df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '324f0de0fb90476891405096b301dfd0', 'request_id': 'req-15e65081-9c75-46d2-a1d3-ff5912f924df'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:59.538731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-15e65081-9c75-46d2-a1d3-ff5912f924df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '324f0de0fb90476891405096b301dfd0', 'request_id': 'req-15e65081-9c75-46d2-a1d3-ff5912f924df'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:59.554097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-15e65081-9c75-46d2-a1d3-ff5912f924df admin admin] The token cache is being invalidate because project 324f0de0fb90476891405096b301dfd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:37:59.554392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-15e65081-9c75-46d2-a1d3-ff5912f924df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:59.555027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-15e65081-9c75-46d2-a1d3-ff5912f924df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:59.556675 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3945/7927] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:37:59 2022] DELETE /identity/v3/projects/324f0de0fb90476891405096b301dfd0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:37:59.560872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98748ed6-1c5f-4284-9920-506feb28c389 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:37:59.562322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-98748ed6-1c5f-4284-9920-506feb28c389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:37:59.575394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98748ed6-1c5f-4284-9920-506feb28c389 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:37:59.631353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c245dd-a781-40d8-a2f0-8f7854128748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:37:59.632277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c245dd-a781-40d8-a2f0-8f7854128748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:37:59.632564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c245dd-a781-40d8-a2f0-8f7854128748 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:37:59.632842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c245dd-a781-40d8-a2f0-8f7854128748 admin admin] PATH_INFO: `/v3/users/471a3ad2091b4baba28dd6b1767f48d8` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:37:59.634103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c245dd-a781-40d8-a2f0-8f7854128748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=471a3ad2091b4baba28dd6b1767f48d8)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:37:59.636080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c245dd-a781-40d8-a2f0-8f7854128748 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:37:59.657696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:37:59.686191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-01c245dd-a781-40d8-a2f0-8f7854128748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471a3ad2091b4baba28dd6b1767f48d8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:59.694427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-01c245dd-a781-40d8-a2f0-8f7854128748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471a3ad2091b4baba28dd6b1767f48d8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:59.695103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-01c245dd-a781-40d8-a2f0-8f7854128748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471a3ad2091b4baba28dd6b1767f48d8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:59.695707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-01c245dd-a781-40d8-a2f0-8f7854128748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471a3ad2091b4baba28dd6b1767f48d8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:59.702674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-01c245dd-a781-40d8-a2f0-8f7854128748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471a3ad2091b4baba28dd6b1767f48d8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:37:59.720950 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3983/7928] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:37:59 2022] DELETE /identity/v3/users/471a3ad2091b4baba28dd6b1767f48d8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:37:59.905134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e65081-9c75-46d2-a1d3-ff5912f924df admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:37:59.906688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-15e65081-9c75-46d2-a1d3-ff5912f924df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:37:59.922413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e65081-9c75-46d2-a1d3-ff5912f924df admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:37:59.983600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716555f6-6696-414c-863e-6adf99b8590d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:37:59.985014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716555f6-6696-414c-863e-6adf99b8590d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:37:59.985416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716555f6-6696-414c-863e-6adf99b8590d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:37:59.985908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716555f6-6696-414c-863e-6adf99b8590d admin admin] PATH_INFO: `/v3/projects/dc72eb7a5c104c44b9050cac9c72cf14` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:37:59.987249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716555f6-6696-414c-863e-6adf99b8590d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc72eb7a5c104c44b9050cac9c72cf14)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:37:59.989755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716555f6-6696-414c-863e-6adf99b8590d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:00.038539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-716555f6-6696-414c-863e-6adf99b8590d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc72eb7a5c104c44b9050cac9c72cf14', 'request_id': 'req-716555f6-6696-414c-863e-6adf99b8590d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:00.044943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-716555f6-6696-414c-863e-6adf99b8590d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc72eb7a5c104c44b9050cac9c72cf14', 'request_id': 'req-716555f6-6696-414c-863e-6adf99b8590d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:00.050392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:38:00.052166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-716555f6-6696-414c-863e-6adf99b8590d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc72eb7a5c104c44b9050cac9c72cf14', 'request_id': 'req-716555f6-6696-414c-863e-6adf99b8590d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:00.067011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-716555f6-6696-414c-863e-6adf99b8590d admin admin] The token cache is being invalidate because project dc72eb7a5c104c44b9050cac9c72cf14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:38:00.067296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-716555f6-6696-414c-863e-6adf99b8590d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:00.067928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-716555f6-6696-414c-863e-6adf99b8590d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:00.069566 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3946/7929] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:37:59 2022] DELETE /identity/v3/projects/dc72eb7a5c104c44b9050cac9c72cf14 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:38:00.074720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96705d-b375-441d-adff-f5ed2f912de9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:00.075080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96705d-b375-441d-adff-f5ed2f912de9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:00.075386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96705d-b375-441d-adff-f5ed2f912de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:00.095056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ce96705d-b375-441d-adff-f5ed2f912de9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:38:00.096321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ce96705d-b375-441d-adff-f5ed2f912de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:38:00.160029 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3984/7930] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:38:00.168103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb7eab-1669-420e-b7bd-cddd5dd0fb5e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:00.168390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb7eab-1669-420e-b7bd-cddd5dd0fb5e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:00.168672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb7eab-1669-420e-b7bd-cddd5dd0fb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:00.190711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-cacb7eab-1669-420e-b7bd-cddd5dd0fb5e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:38:00.191952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cacb7eab-1669-420e-b7bd-cddd5dd0fb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:38:00.200639 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3947/7931] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:38:00.205129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96705d-b375-441d-adff-f5ed2f912de9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:38:00.215187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96705d-b375-441d-adff-f5ed2f912de9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:38:00.220057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0290e7a-774d-4e59-90eb-5331049d2442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:38:00.220737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0290e7a-774d-4e59-90eb-5331049d2442 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:00.221023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0290e7a-774d-4e59-90eb-5331049d2442 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:00.221300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0290e7a-774d-4e59-90eb-5331049d2442 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:00.222021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0290e7a-774d-4e59-90eb-5331049d2442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:38:00.222341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0290e7a-774d-4e59-90eb-5331049d2442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:38:00.223963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0290e7a-774d-4e59-90eb-5331049d2442 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:00.235801 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3985/7932] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:38:00.239990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb7eab-1669-420e-b7bd-cddd5dd0fb5e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:38:00.249573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb7eab-1669-420e-b7bd-cddd5dd0fb5e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:38:00.254731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff4ed2-02ee-4f35-b20e-7885870fe70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:38:00.255382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff4ed2-02ee-4f35-b20e-7885870fe70c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:00.255662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff4ed2-02ee-4f35-b20e-7885870fe70c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:00.255935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff4ed2-02ee-4f35-b20e-7885870fe70c admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:00.256654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff4ed2-02ee-4f35-b20e-7885870fe70c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:38:00.259178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff4ed2-02ee-4f35-b20e-7885870fe70c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:00.288162 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3948/7933] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:38:00 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:38:00.292415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0290e7a-774d-4e59-90eb-5331049d2442 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:38:00.303086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0290e7a-774d-4e59-90eb-5331049d2442 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:38:00.361441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2e24d-4ff6-4da4-8301-ee91ac5ab7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:38:00.362123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2e24d-4ff6-4da4-8301-ee91ac5ab7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:00.362406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2e24d-4ff6-4da4-8301-ee91ac5ab7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:00.362680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2e24d-4ff6-4da4-8301-ee91ac5ab7d9 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:00.363410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2e24d-4ff6-4da4-8301-ee91ac5ab7d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:38:00.365387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2e24d-4ff6-4da4-8301-ee91ac5ab7d9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:00.387868 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3986/7934] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:38:00 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:38:00.392725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff4ed2-02ee-4f35-b20e-7885870fe70c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:38:00.403313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff4ed2-02ee-4f35-b20e-7885870fe70c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:38:00.408048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b6b13-9cc6-4c82-8613-6e1311626eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:38:00.408742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b6b13-9cc6-4c82-8613-6e1311626eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:00.409029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b6b13-9cc6-4c82-8613-6e1311626eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:00.409304 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b6b13-9cc6-4c82-8613-6e1311626eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:00.410027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b6b13-9cc6-4c82-8613-6e1311626eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:38:00.411628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b6b13-9cc6-4c82-8613-6e1311626eb8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:00.422550 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3949/7935] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:38:00.427255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2e24d-4ff6-4da4-8301-ee91ac5ab7d9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:38:00.438455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2e24d-4ff6-4da4-8301-ee91ac5ab7d9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:38:00.443654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7673cd-9ad0-455b-a27b-3a96b2947031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:38:00.444388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7673cd-9ad0-455b-a27b-3a96b2947031 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:00.444676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7673cd-9ad0-455b-a27b-3a96b2947031 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:00.444958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7673cd-9ad0-455b-a27b-3a96b2947031 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:00.445686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7673cd-9ad0-455b-a27b-3a96b2947031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:38:00.447317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7673cd-9ad0-455b-a27b-3a96b2947031 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:00.458540 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3987/7936] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:38:00.462961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b6b13-9cc6-4c82-8613-6e1311626eb8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:38:00.473465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b6b13-9cc6-4c82-8613-6e1311626eb8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:38:00.478260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacb4d5-0e0a-423b-82a6-1ed08a9f8135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:38:00.479321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacb4d5-0e0a-423b-82a6-1ed08a9f8135 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:00.479619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacb4d5-0e0a-423b-82a6-1ed08a9f8135 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:00.479898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacb4d5-0e0a-423b-82a6-1ed08a9f8135 admin admin] PATH_INFO: `/v3/projects/688e8d2d43834f6cb479ac4f39743985/users/6a2fe633e508408688baa0cf4a74b0a9/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:00.495704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacb4d5-0e0a-423b-82a6-1ed08a9f8135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688e8d2d43834f6cb479ac4f39743985, user_id=6a2fe633e508408688baa0cf4a74b0a9, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:38:00.498459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacb4d5-0e0a-423b-82a6-1ed08a9f8135 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:00.512524 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3950/7937] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:38:00 2022] PUT /identity/v3/projects/688e8d2d43834f6cb479ac4f39743985/users/6a2fe633e508408688baa0cf4a74b0a9/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:38:00.517837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02965dc-e070-4f29-83c6-e05d88976afa None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:00.518205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02965dc-e070-4f29-83c6-e05d88976afa None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:00.518553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02965dc-e070-4f29-83c6-e05d88976afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:00.525651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:38:00.538391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e02965dc-e070-4f29-83c6-e05d88976afa None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:38:00.540127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e02965dc-e070-4f29-83c6-e05d88976afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:38:00.597820 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3988/7938] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:38:00.608185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacb4d5-0e0a-423b-82a6-1ed08a9f8135 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:38:00.610757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1eacb4d5-0e0a-423b-82a6-1ed08a9f8135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:38:00.676317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacb4d5-0e0a-423b-82a6-1ed08a9f8135 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:38:00.680360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bca81-e832-4a03-9537-53d1319ee385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:38:00.681014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bca81-e832-4a03-9537-53d1319ee385 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:00.681299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bca81-e832-4a03-9537-53d1319ee385 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:00.681691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bca81-e832-4a03-9537-53d1319ee385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:00.691771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bca81-e832-4a03-9537-53d1319ee385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:38:00.693269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bca81-e832-4a03-9537-53d1319ee385 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:00.703579 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3951/7939] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:38:05.231628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb209937-b199-4603-b720-ed353efd52db None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:05.232171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb209937-b199-4603-b720-ed353efd52db None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:05.232281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb209937-b199-4603-b720-ed353efd52db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:05.305746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fb209937-b199-4603-b720-ed353efd52db None None] MFA Rules not processed for user `6a2fe633e508408688baa0cf4a74b0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:38:05.306550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fb209937-b199-4603-b720-ed353efd52db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:38:05.434975 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3989/7940] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:38:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:38:05.439214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bca81-e832-4a03-9537-53d1319ee385 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:38:05.455223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bca81-e832-4a03-9537-53d1319ee385 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:38:05.467132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22da18-9c97-4970-80dc-f042dfe10184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:38:05.467984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22da18-9c97-4970-80dc-f042dfe10184 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:05.468704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22da18-9c97-4970-80dc-f042dfe10184 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:05.468704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22da18-9c97-4970-80dc-f042dfe10184 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:05.469529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22da18-9c97-4970-80dc-f042dfe10184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:38:05.471638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22da18-9c97-4970-80dc-f042dfe10184 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:05.504116 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3952/7941] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:38:05 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:38:05.508141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb209937-b199-4603-b720-ed353efd52db None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:38:05.520169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb209937-b199-4603-b720-ed353efd52db None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:38:05.633671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87bdc5-60f1-421b-b509-2d87ef36a81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:38:05.634699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87bdc5-60f1-421b-b509-2d87ef36a81b admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:05.635280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87bdc5-60f1-421b-b509-2d87ef36a81b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:05.635750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87bdc5-60f1-421b-b509-2d87ef36a81b admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:05.636925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87bdc5-60f1-421b-b509-2d87ef36a81b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:38:05.639411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87bdc5-60f1-421b-b509-2d87ef36a81b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:05.666973 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3990/7942] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:38:05 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:38:05.671235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22da18-9c97-4970-80dc-f042dfe10184 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:38:05.684435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22da18-9c97-4970-80dc-f042dfe10184 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:38:05.689610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d8cae-2736-4053-98e2-575133cdcfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:38:05.690298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d8cae-2736-4053-98e2-575133cdcfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:05.690758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d8cae-2736-4053-98e2-575133cdcfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:05.691040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d8cae-2736-4053-98e2-575133cdcfc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:05.691780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d8cae-2736-4053-98e2-575133cdcfc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:38:05.693454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d8cae-2736-4053-98e2-575133cdcfc1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:05.705746 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3953/7943] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:38:05.709980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87bdc5-60f1-421b-b509-2d87ef36a81b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:38:05.725152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87bdc5-60f1-421b-b509-2d87ef36a81b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:38:05.730842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f5be4-1d80-4974-9ad9-6959194e9405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:38:05.731828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f5be4-1d80-4974-9ad9-6959194e9405 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:05.732144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f5be4-1d80-4974-9ad9-6959194e9405 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:05.732494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f5be4-1d80-4974-9ad9-6959194e9405 admin admin] PATH_INFO: `/v3/projects/4506e9baebb142c98d653afd879da543/users/19198356f04c4de0aeb7b72a8b4ab442/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:05.752729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f5be4-1d80-4974-9ad9-6959194e9405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4506e9baebb142c98d653afd879da543, user_id=19198356f04c4de0aeb7b72a8b4ab442, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:38:05.755443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f5be4-1d80-4974-9ad9-6959194e9405 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:05.767946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:38:05.776113 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3991/7944] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:38:05 2022] PUT /identity/v3/projects/4506e9baebb142c98d653afd879da543/users/19198356f04c4de0aeb7b72a8b4ab442/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:38:05.780357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d8cae-2736-4053-98e2-575133cdcfc1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:38:05.791568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d8cae-2736-4053-98e2-575133cdcfc1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:38:05.849225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:38:05.857486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a478be0-1f2c-432e-bc95-fa9e5190f8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:38:05.859341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a478be0-1f2c-432e-bc95-fa9e5190f8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:05.860346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a478be0-1f2c-432e-bc95-fa9e5190f8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:05.860596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a478be0-1f2c-432e-bc95-fa9e5190f8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:05.861592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a478be0-1f2c-432e-bc95-fa9e5190f8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:38:05.863751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a478be0-1f2c-432e-bc95-fa9e5190f8d0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:05.877190 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3954/7945] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:38:05.881942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f5be4-1d80-4974-9ad9-6959194e9405 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:38:05.893311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f5be4-1d80-4974-9ad9-6959194e9405 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:38:05.898306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdffd0e-20ed-4761-b661-7bb6dde6277c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:38:05.899221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdffd0e-20ed-4761-b661-7bb6dde6277c admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:05.899500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdffd0e-20ed-4761-b661-7bb6dde6277c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:05.899835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdffd0e-20ed-4761-b661-7bb6dde6277c admin admin] PATH_INFO: `/v3/projects/4506e9baebb142c98d653afd879da543/users/19198356f04c4de0aeb7b72a8b4ab442/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:05.902580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdffd0e-20ed-4761-b661-7bb6dde6277c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4506e9baebb142c98d653afd879da543, user_id=19198356f04c4de0aeb7b72a8b4ab442, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:38:05.905303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdffd0e-20ed-4761-b661-7bb6dde6277c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:05.925343 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3992/7946] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:38:05 2022] PUT /identity/v3/projects/4506e9baebb142c98d653afd879da543/users/19198356f04c4de0aeb7b72a8b4ab442/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:38:10.688247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9e72d-9783-43f6-aa2f-ed0106ccfb79 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:10.688945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9e72d-9783-43f6-aa2f-ed0106ccfb79 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:10.688945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9e72d-9783-43f6-aa2f-ed0106ccfb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:10.717938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fee9e72d-9783-43f6-aa2f-ed0106ccfb79 None None] MFA Rules not processed for user `19198356f04c4de0aeb7b72a8b4ab442`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:38:10.719353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fee9e72d-9783-43f6-aa2f-ed0106ccfb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:38:10.794950 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3955/7947] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:38:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:38:10.807556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdffd0e-20ed-4761-b661-7bb6dde6277c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:38:10.809909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fbdffd0e-20ed-4761-b661-7bb6dde6277c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:38:10.903310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdffd0e-20ed-4761-b661-7bb6dde6277c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:38:10.911328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbaee2-f471-48a0-bbd5-eaba1f148ad0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:38:10.912268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbaee2-f471-48a0-bbd5-eaba1f148ad0 service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:10.912673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbaee2-f471-48a0-bbd5-eaba1f148ad0 service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:10.913033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbaee2-f471-48a0-bbd5-eaba1f148ad0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:10.973958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cbaee2-f471-48a0-bbd5-eaba1f148ad0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:38:10.975432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cbaee2-f471-48a0-bbd5-eaba1f148ad0 service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:10.985088 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3993/7948] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:38:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:38:19.316100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9e72d-9783-43f6-aa2f-ed0106ccfb79 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:38:19.382618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9e72d-9783-43f6-aa2f-ed0106ccfb79 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:38:19.387725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bea83-b888-4ec3-855f-863ee9ceffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:38:19.388674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bea83-b888-4ec3-855f-863ee9ceffa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:19.388951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bea83-b888-4ec3-855f-863ee9ceffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:19.389253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bea83-b888-4ec3-855f-863ee9ceffa3 admin admin] PATH_INFO: `/v3/users/6a2fe633e508408688baa0cf4a74b0a9` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:19.390536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bea83-b888-4ec3-855f-863ee9ceffa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2fe633e508408688baa0cf4a74b0a9)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:38:19.392429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bea83-b888-4ec3-855f-863ee9ceffa3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:19.439552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-217bea83-b888-4ec3-855f-863ee9ceffa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2fe633e508408688baa0cf4a74b0a9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:19.448336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-217bea83-b888-4ec3-855f-863ee9ceffa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2fe633e508408688baa0cf4a74b0a9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:19.455434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-217bea83-b888-4ec3-855f-863ee9ceffa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2fe633e508408688baa0cf4a74b0a9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:19.456193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-217bea83-b888-4ec3-855f-863ee9ceffa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2fe633e508408688baa0cf4a74b0a9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:19.456793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-217bea83-b888-4ec3-855f-863ee9ceffa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2fe633e508408688baa0cf4a74b0a9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:19.467733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:38:19.475702 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3956/7949] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:38:19 2022] DELETE /identity/v3/users/6a2fe633e508408688baa0cf4a74b0a9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:38:19.663045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbaee2-f471-48a0-bbd5-eaba1f148ad0 service glance] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:38:19.674772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbaee2-f471-48a0-bbd5-eaba1f148ad0 service glance] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:38:19.736369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcf5b3-44ff-4779-b7af-5641b5369cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:38:19.737275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcf5b3-44ff-4779-b7af-5641b5369cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:19.737590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcf5b3-44ff-4779-b7af-5641b5369cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:19.737989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcf5b3-44ff-4779-b7af-5641b5369cc0 admin admin] PATH_INFO: `/v3/projects/688e8d2d43834f6cb479ac4f39743985` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:19.739172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcf5b3-44ff-4779-b7af-5641b5369cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=688e8d2d43834f6cb479ac4f39743985)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:38:19.741178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcf5b3-44ff-4779-b7af-5641b5369cc0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:19.767932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:38:19.793904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a7dcf5b3-44ff-4779-b7af-5641b5369cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688e8d2d43834f6cb479ac4f39743985', 'request_id': 'req-a7dcf5b3-44ff-4779-b7af-5641b5369cc0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:19.802392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a7dcf5b3-44ff-4779-b7af-5641b5369cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688e8d2d43834f6cb479ac4f39743985', 'request_id': 'req-a7dcf5b3-44ff-4779-b7af-5641b5369cc0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:19.808826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a7dcf5b3-44ff-4779-b7af-5641b5369cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688e8d2d43834f6cb479ac4f39743985', 'request_id': 'req-a7dcf5b3-44ff-4779-b7af-5641b5369cc0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:19.820451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a7dcf5b3-44ff-4779-b7af-5641b5369cc0 admin admin] The token cache is being invalidate because project 688e8d2d43834f6cb479ac4f39743985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:38:19.820735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a7dcf5b3-44ff-4779-b7af-5641b5369cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:19.821495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a7dcf5b3-44ff-4779-b7af-5641b5369cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:19.823466 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3994/7950] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:38:19 2022] DELETE /identity/v3/projects/688e8d2d43834f6cb479ac4f39743985 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:38:19.827382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bea83-b888-4ec3-855f-863ee9ceffa3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:38:19.828877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-217bea83-b888-4ec3-855f-863ee9ceffa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:38:19.842833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bea83-b888-4ec3-855f-863ee9ceffa3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:38:19.901249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0744411-401b-4718-865c-60293554782e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:38:19.902136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0744411-401b-4718-865c-60293554782e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:19.902419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0744411-401b-4718-865c-60293554782e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:19.902710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0744411-401b-4718-865c-60293554782e admin admin] PATH_INFO: `/v3/users/19198356f04c4de0aeb7b72a8b4ab442` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:19.903964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0744411-401b-4718-865c-60293554782e admin admin] RBAC: Authorizing `identity:delete_user(user_id=19198356f04c4de0aeb7b72a8b4ab442)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:38:19.906099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0744411-401b-4718-865c-60293554782e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:19.954353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d0744411-401b-4718-865c-60293554782e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19198356f04c4de0aeb7b72a8b4ab442'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:19.964299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d0744411-401b-4718-865c-60293554782e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19198356f04c4de0aeb7b72a8b4ab442'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:19.972239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d0744411-401b-4718-865c-60293554782e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19198356f04c4de0aeb7b72a8b4ab442'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:19.972928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d0744411-401b-4718-865c-60293554782e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19198356f04c4de0aeb7b72a8b4ab442'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:19.973636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d0744411-401b-4718-865c-60293554782e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19198356f04c4de0aeb7b72a8b4ab442'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:19.993344 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3957/7951] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:38:19 2022] DELETE /identity/v3/users/19198356f04c4de0aeb7b72a8b4ab442 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:38:20.180454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcf5b3-44ff-4779-b7af-5641b5369cc0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:38:20.181909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a7dcf5b3-44ff-4779-b7af-5641b5369cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:38:20.200938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcf5b3-44ff-4779-b7af-5641b5369cc0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:38:20.260031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2932aad-cfe6-406c-873d-7c78a78daa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:38:20.260943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2932aad-cfe6-406c-873d-7c78a78daa52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:38:20.261228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2932aad-cfe6-406c-873d-7c78a78daa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:38:20.261506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2932aad-cfe6-406c-873d-7c78a78daa52 admin admin] PATH_INFO: `/v3/projects/4506e9baebb142c98d653afd879da543` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:38:20.262719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2932aad-cfe6-406c-873d-7c78a78daa52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4506e9baebb142c98d653afd879da543)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:38:20.264780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2932aad-cfe6-406c-873d-7c78a78daa52 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:38:20.313897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a2932aad-cfe6-406c-873d-7c78a78daa52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4506e9baebb142c98d653afd879da543', 'request_id': 'req-a2932aad-cfe6-406c-873d-7c78a78daa52'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:20.322263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a2932aad-cfe6-406c-873d-7c78a78daa52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4506e9baebb142c98d653afd879da543', 'request_id': 'req-a2932aad-cfe6-406c-873d-7c78a78daa52'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:20.328782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a2932aad-cfe6-406c-873d-7c78a78daa52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4506e9baebb142c98d653afd879da543', 'request_id': 'req-a2932aad-cfe6-406c-873d-7c78a78daa52'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:20.340257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a2932aad-cfe6-406c-873d-7c78a78daa52 admin admin] The token cache is being invalidate because project 4506e9baebb142c98d653afd879da543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:38:20.340544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a2932aad-cfe6-406c-873d-7c78a78daa52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:20.341186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a2932aad-cfe6-406c-873d-7c78a78daa52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:38:20.342816 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3995/7952] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:38:20 2022] DELETE /identity/v3/projects/4506e9baebb142c98d653afd879da543 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:38:29.989579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:38:30.337089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=66,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:15.000160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0744411-401b-4718-865c-60293554782e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:15.001645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d0744411-401b-4718-865c-60293554782e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:15.106887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0744411-401b-4718-865c-60293554782e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:15.178253 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c29fc-b2f9-4c67-b37f-5ac1a4e79b81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:15.178932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c29fc-b2f9-4c67-b37f-5ac1a4e79b81 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:15.179217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c29fc-b2f9-4c67-b37f-5ac1a4e79b81 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:15.179493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c29fc-b2f9-4c67-b37f-5ac1a4e79b81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:15.181435 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f04c29fc-b2f9-4c67-b37f-5ac1a4e79b81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:15.195342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c29fc-b2f9-4c67-b37f-5ac1a4e79b81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:15.196986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c29fc-b2f9-4c67-b37f-5ac1a4e79b81 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:15.209456 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3958/7953] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:39:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:39:19.326213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2932aad-cfe6-406c-873d-7c78a78daa52 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:19.327749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a2932aad-cfe6-406c-873d-7c78a78daa52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:19.395141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2932aad-cfe6-406c-873d-7c78a78daa52 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:19.400002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ef7fe-6f8b-44c1-b98c-33ec42c4d0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:19.401003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ef7fe-6f8b-44c1-b98c-33ec42c4d0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:19.401282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ef7fe-6f8b-44c1-b98c-33ec42c4d0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:19.401561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ef7fe-6f8b-44c1-b98c-33ec42c4d0fa admin admin] PATH_INFO: `/v3/users/39889b52b09a40ecacbf5a790e5bd20e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:19.402773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ef7fe-6f8b-44c1-b98c-33ec42c4d0fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=39889b52b09a40ecacbf5a790e5bd20e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:19.404778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ef7fe-6f8b-44c1-b98c-33ec42c4d0fa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:19.459649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-381ef7fe-6f8b-44c1-b98c-33ec42c4d0fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39889b52b09a40ecacbf5a790e5bd20e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:19.472555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-381ef7fe-6f8b-44c1-b98c-33ec42c4d0fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39889b52b09a40ecacbf5a790e5bd20e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:19.473644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-381ef7fe-6f8b-44c1-b98c-33ec42c4d0fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39889b52b09a40ecacbf5a790e5bd20e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:19.474354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-381ef7fe-6f8b-44c1-b98c-33ec42c4d0fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39889b52b09a40ecacbf5a790e5bd20e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:19.481927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-381ef7fe-6f8b-44c1-b98c-33ec42c4d0fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39889b52b09a40ecacbf5a790e5bd20e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:19.499092 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3996/7954] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:19 2022] DELETE /identity/v3/users/39889b52b09a40ecacbf5a790e5bd20e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:19.688497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c29fc-b2f9-4c67-b37f-5ac1a4e79b81 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:19.700683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c29fc-b2f9-4c67-b37f-5ac1a4e79b81 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:19.760370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d460e8-d766-436c-b56b-dfaa8b4a6a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:19.761217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d460e8-d766-436c-b56b-dfaa8b4a6a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:19.761498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d460e8-d766-436c-b56b-dfaa8b4a6a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:19.761772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d460e8-d766-436c-b56b-dfaa8b4a6a39 admin admin] PATH_INFO: `/v3/projects/89d5b5b1b03f495d9dcdfdc29598fe8f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:19.762954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d460e8-d766-436c-b56b-dfaa8b4a6a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d5b5b1b03f495d9dcdfdc29598fe8f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:19.764913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d460e8-d766-436c-b56b-dfaa8b4a6a39 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:19.796553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:19.814795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f9d460e8-d766-436c-b56b-dfaa8b4a6a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'request_id': 'req-f9d460e8-d766-436c-b56b-dfaa8b4a6a39'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:19.821318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f9d460e8-d766-436c-b56b-dfaa8b4a6a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'request_id': 'req-f9d460e8-d766-436c-b56b-dfaa8b4a6a39'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:19.829406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f9d460e8-d766-436c-b56b-dfaa8b4a6a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'request_id': 'req-f9d460e8-d766-436c-b56b-dfaa8b4a6a39'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:19.842867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f9d460e8-d766-436c-b56b-dfaa8b4a6a39 admin admin] The token cache is being invalidate because project 89d5b5b1b03f495d9dcdfdc29598fe8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:19.843158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f9d460e8-d766-436c-b56b-dfaa8b4a6a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:19.843863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f9d460e8-d766-436c-b56b-dfaa8b4a6a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:19.845578 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3959/7955] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:39:19 2022] DELETE /identity/v3/projects/89d5b5b1b03f495d9dcdfdc29598fe8f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:39:19.853631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0111df3-4db8-48b4-9cf2-2af8aad65d47 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:19.853923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0111df3-4db8-48b4-9cf2-2af8aad65d47 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:19.854200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0111df3-4db8-48b4-9cf2-2af8aad65d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:19.872065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e0111df3-4db8-48b4-9cf2-2af8aad65d47 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:19.873285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e0111df3-4db8-48b4-9cf2-2af8aad65d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:19.934133 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3997/7956] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:19.942220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7207fef-23cc-45fe-82cd-3ef615dfaed3 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:19.942505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7207fef-23cc-45fe-82cd-3ef615dfaed3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:19.942777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7207fef-23cc-45fe-82cd-3ef615dfaed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:19.962099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e7207fef-23cc-45fe-82cd-3ef615dfaed3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:19.963302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e7207fef-23cc-45fe-82cd-3ef615dfaed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:19.971812 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3960/7957] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:19.976182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0111df3-4db8-48b4-9cf2-2af8aad65d47 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:19.986421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0111df3-4db8-48b4-9cf2-2af8aad65d47 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:19.992350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44468bd5-4117-40ca-aeab-9120c51678ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:19.993128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44468bd5-4117-40ca-aeab-9120c51678ce admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:19.993417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44468bd5-4117-40ca-aeab-9120c51678ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:19.993696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44468bd5-4117-40ca-aeab-9120c51678ce admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:19.994432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44468bd5-4117-40ca-aeab-9120c51678ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:39:19.994741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44468bd5-4117-40ca-aeab-9120c51678ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:19.996502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44468bd5-4117-40ca-aeab-9120c51678ce admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:20.009472 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3998/7958] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:20.013989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7207fef-23cc-45fe-82cd-3ef615dfaed3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:20.023983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7207fef-23cc-45fe-82cd-3ef615dfaed3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:20.031628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33aaf82-2522-442b-bf6c-60d976fbd696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:20.032380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aaf82-2522-442b-bf6c-60d976fbd696 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:20.032696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aaf82-2522-442b-bf6c-60d976fbd696 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:20.032977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aaf82-2522-442b-bf6c-60d976fbd696 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:20.033639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33aaf82-2522-442b-bf6c-60d976fbd696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:20.035711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33aaf82-2522-442b-bf6c-60d976fbd696 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:20.064540 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3961/7959] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:39:20 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:20.068778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44468bd5-4117-40ca-aeab-9120c51678ce admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:20.079164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44468bd5-4117-40ca-aeab-9120c51678ce admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:20.083059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:20.142119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962ae3f-06ff-473e-afd3-b5f9d80d7e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:20.142795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962ae3f-06ff-473e-afd3-b5f9d80d7e2b admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:20.143079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962ae3f-06ff-473e-afd3-b5f9d80d7e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:20.143360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962ae3f-06ff-473e-afd3-b5f9d80d7e2b admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:20.144069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962ae3f-06ff-473e-afd3-b5f9d80d7e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:20.146076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962ae3f-06ff-473e-afd3-b5f9d80d7e2b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:20.168657 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 3999/7960] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:20 2022] POST /identity/v3/users => generated 302 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:20.173523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33aaf82-2522-442b-bf6c-60d976fbd696 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:20.184927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33aaf82-2522-442b-bf6c-60d976fbd696 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:20.189712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf8586-b819-44e5-b480-708126c482ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:20.190358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf8586-b819-44e5-b480-708126c482ca admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:20.190640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf8586-b819-44e5-b480-708126c482ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:20.190918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf8586-b819-44e5-b480-708126c482ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:20.191639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf8586-b819-44e5-b480-708126c482ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:20.193404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf8586-b819-44e5-b480-708126c482ca admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:20.204110 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3962/7961] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:20.208026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962ae3f-06ff-473e-afd3-b5f9d80d7e2b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:20.218488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962ae3f-06ff-473e-afd3-b5f9d80d7e2b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:20.223524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303ecf5-76f5-43f8-a171-4bd544b18d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:20.224235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303ecf5-76f5-43f8-a171-4bd544b18d48 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:20.224518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303ecf5-76f5-43f8-a171-4bd544b18d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:20.224802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303ecf5-76f5-43f8-a171-4bd544b18d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:20.225529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303ecf5-76f5-43f8-a171-4bd544b18d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:20.227148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303ecf5-76f5-43f8-a171-4bd544b18d48 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:20.237885 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4000/7962] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:20.242647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf8586-b819-44e5-b480-708126c482ca admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:20.256988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf8586-b819-44e5-b480-708126c482ca admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:20.263051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c20b31-e348-4f00-a8fa-771253e069f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:20.263969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c20b31-e348-4f00-a8fa-771253e069f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:20.264266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c20b31-e348-4f00-a8fa-771253e069f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:20.264546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c20b31-e348-4f00-a8fa-771253e069f4 admin admin] PATH_INFO: `/v3/projects/2064e302507445cb95733fc29ad2c711/users/3c7c36146f524f49addf9d7fea0ccd6e/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:20.280122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c20b31-e348-4f00-a8fa-771253e069f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2064e302507445cb95733fc29ad2c711, user_id=3c7c36146f524f49addf9d7fea0ccd6e, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:20.282817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c20b31-e348-4f00-a8fa-771253e069f4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:20.301159 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3963/7963] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:20 2022] PUT /identity/v3/projects/2064e302507445cb95733fc29ad2c711/users/3c7c36146f524f49addf9d7fea0ccd6e/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:20.312378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28553d5-a074-4fcf-b56e-16fd5db33ce1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:20.312710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28553d5-a074-4fcf-b56e-16fd5db33ce1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:20.313029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28553d5-a074-4fcf-b56e-16fd5db33ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:20.340210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c28553d5-a074-4fcf-b56e-16fd5db33ce1 None None] MFA Rules not processed for user `3c7c36146f524f49addf9d7fea0ccd6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:20.341428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c28553d5-a074-4fcf-b56e-16fd5db33ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:20.406760 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4001/7964] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:20.411660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c20b31-e348-4f00-a8fa-771253e069f4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:20.474095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c20b31-e348-4f00-a8fa-771253e069f4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:20.478966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee8c1e-40b8-4756-bdfe-76fdd844a4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:20.479609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee8c1e-40b8-4756-bdfe-76fdd844a4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:20.479886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee8c1e-40b8-4756-bdfe-76fdd844a4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:20.480192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee8c1e-40b8-4756-bdfe-76fdd844a4b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:20.480891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee8c1e-40b8-4756-bdfe-76fdd844a4b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:20.482766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee8c1e-40b8-4756-bdfe-76fdd844a4b3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:20.515395 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3964/7965] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:39:20 2022] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:20.520070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28553d5-a074-4fcf-b56e-16fd5db33ce1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:20.532073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28553d5-a074-4fcf-b56e-16fd5db33ce1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:20.596513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09bf54-56fe-4fbf-87a9-2059402f1e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:20.597192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09bf54-56fe-4fbf-87a9-2059402f1e06 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:20.597472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09bf54-56fe-4fbf-87a9-2059402f1e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:20.597736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09bf54-56fe-4fbf-87a9-2059402f1e06 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:20.598621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09bf54-56fe-4fbf-87a9-2059402f1e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:20.601581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09bf54-56fe-4fbf-87a9-2059402f1e06 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:20.630658 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4002/7966] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:20 2022] POST /identity/v3/users => generated 308 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:20.632746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee8c1e-40b8-4756-bdfe-76fdd844a4b3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:20.650219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee8c1e-40b8-4756-bdfe-76fdd844a4b3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:20.656183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11278b66-8ce2-47d9-9e5a-3cf45f02b923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:20.656886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11278b66-8ce2-47d9-9e5a-3cf45f02b923 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:20.657141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11278b66-8ce2-47d9-9e5a-3cf45f02b923 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:20.657443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11278b66-8ce2-47d9-9e5a-3cf45f02b923 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:20.658167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11278b66-8ce2-47d9-9e5a-3cf45f02b923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:20.659777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11278b66-8ce2-47d9-9e5a-3cf45f02b923 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:20.670803 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3965/7967] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:20.675525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09bf54-56fe-4fbf-87a9-2059402f1e06 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:20.682596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:20.686973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09bf54-56fe-4fbf-87a9-2059402f1e06 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:20.695133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df824e00-fbc7-4985-acc9-708b7b943549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:20.696028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df824e00-fbc7-4985-acc9-708b7b943549 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:20.696338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df824e00-fbc7-4985-acc9-708b7b943549 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:20.696617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df824e00-fbc7-4985-acc9-708b7b943549 admin admin] PATH_INFO: `/v3/projects/2ca6cdcf5b3242049dc5bc90edd1d29e/users/c6d7ec8f68974cdc9bea4d2d086d79c6/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:20.711590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df824e00-fbc7-4985-acc9-708b7b943549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca6cdcf5b3242049dc5bc90edd1d29e, user_id=c6d7ec8f68974cdc9bea4d2d086d79c6, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:20.714304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df824e00-fbc7-4985-acc9-708b7b943549 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:20.728384 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4003/7968] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:20 2022] PUT /identity/v3/projects/2ca6cdcf5b3242049dc5bc90edd1d29e/users/c6d7ec8f68974cdc9bea4d2d086d79c6/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:20.732468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11278b66-8ce2-47d9-9e5a-3cf45f02b923 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:20.742635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11278b66-8ce2-47d9-9e5a-3cf45f02b923 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:20.765354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:20.818461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d52cf0-919e-498b-94fa-39bc3f744f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:20.819414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d52cf0-919e-498b-94fa-39bc3f744f94 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:20.819808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d52cf0-919e-498b-94fa-39bc3f744f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:20.820216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d52cf0-919e-498b-94fa-39bc3f744f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:20.821254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d52cf0-919e-498b-94fa-39bc3f744f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:20.822852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d52cf0-919e-498b-94fa-39bc3f744f94 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:20.832801 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3966/7969] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:20.837404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df824e00-fbc7-4985-acc9-708b7b943549 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:20.848210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df824e00-fbc7-4985-acc9-708b7b943549 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:20.853615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e2e01-cbd8-4930-b4a8-aa02e51894e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:20.854520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e2e01-cbd8-4930-b4a8-aa02e51894e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:20.854800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e2e01-cbd8-4930-b4a8-aa02e51894e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:20.855063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e2e01-cbd8-4930-b4a8-aa02e51894e8 admin admin] PATH_INFO: `/v3/projects/2ca6cdcf5b3242049dc5bc90edd1d29e/users/c6d7ec8f68974cdc9bea4d2d086d79c6/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:20.857200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e2e01-cbd8-4930-b4a8-aa02e51894e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca6cdcf5b3242049dc5bc90edd1d29e, user_id=c6d7ec8f68974cdc9bea4d2d086d79c6, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:20.859878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e2e01-cbd8-4930-b4a8-aa02e51894e8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:20.870920 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4004/7970] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:20 2022] PUT /identity/v3/projects/2ca6cdcf5b3242049dc5bc90edd1d29e/users/c6d7ec8f68974cdc9bea4d2d086d79c6/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:39:20.882385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90875a-9c38-4598-ae34-566c33c11627 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:20.882743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90875a-9c38-4598-ae34-566c33c11627 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:20.882905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90875a-9c38-4598-ae34-566c33c11627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:20.910843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8e90875a-9c38-4598-ae34-566c33c11627 None None] MFA Rules not processed for user `c6d7ec8f68974cdc9bea4d2d086d79c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:20.912127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8e90875a-9c38-4598-ae34-566c33c11627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:20.989584 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3967/7971] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:20 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:39:20.995061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e2e01-cbd8-4930-b4a8-aa02e51894e8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:21.006622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e2e01-cbd8-4930-b4a8-aa02e51894e8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:21.012224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398a9e8-89bb-4e29-892a-7989dae69e2f tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d7ec8f68974cdc9bea4d2d086d79c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca6cdcf5b3242049dc5bc90edd1d29e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:21.012919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398a9e8-89bb-4e29-892a-7989dae69e2f tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:21.013205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398a9e8-89bb-4e29-892a-7989dae69e2f tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:21.013487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398a9e8-89bb-4e29-892a-7989dae69e2f tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:21.014235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398a9e8-89bb-4e29-892a-7989dae69e2f tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:21.015875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398a9e8-89bb-4e29-892a-7989dae69e2f tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:21.031470 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4005/7972] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:39:20 2022] POST /identity/v3/roles => generated 240 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:21.035503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90875a-9c38-4598-ae34-566c33c11627 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:21.045062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90875a-9c38-4598-ae34-566c33c11627 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:21.050598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a6935-5ab3-415c-9652-615f3adfdae8 tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d7ec8f68974cdc9bea4d2d086d79c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca6cdcf5b3242049dc5bc90edd1d29e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:21.051491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a6935-5ab3-415c-9652-615f3adfdae8 tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:21.051783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a6935-5ab3-415c-9652-615f3adfdae8 tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:21.052078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a6935-5ab3-415c-9652-615f3adfdae8 tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] PATH_INFO: `/v3/projects/2064e302507445cb95733fc29ad2c711/users/3c7c36146f524f49addf9d7fea0ccd6e/roles/70408e51b1924028abbfc041fd53e652` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:21.054556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a6935-5ab3-415c-9652-615f3adfdae8 tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2064e302507445cb95733fc29ad2c711, user_id=3c7c36146f524f49addf9d7fea0ccd6e, role_id=70408e51b1924028abbfc041fd53e652)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:21.057390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a6935-5ab3-415c-9652-615f3adfdae8 tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:21.073547 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3968/7973] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:21 2022] PUT /identity/v3/projects/2064e302507445cb95733fc29ad2c711/users/3c7c36146f524f49addf9d7fea0ccd6e/roles/70408e51b1924028abbfc041fd53e652 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:39:21.078115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398a9e8-89bb-4e29-892a-7989dae69e2f tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:21.147767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398a9e8-89bb-4e29-892a-7989dae69e2f tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:21.223992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b231a77-fb73-4cf7-9f83-cf15a947ebac tempest-ApplicationCredentialsV3AdminTest-1785148458 tempest-ApplicationCredentialsV3AdminTest-1785148458-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c7c36146f524f49addf9d7fea0ccd6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2064e302507445cb95733fc29ad2c711', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1880589562', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:21.224926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b231a77-fb73-4cf7-9f83-cf15a947ebac tempest-ApplicationCredentialsV3AdminTest-1785148458 tempest-ApplicationCredentialsV3AdminTest-1785148458-project] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:21.225214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b231a77-fb73-4cf7-9f83-cf15a947ebac tempest-ApplicationCredentialsV3AdminTest-1785148458 tempest-ApplicationCredentialsV3AdminTest-1785148458-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:21.225494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b231a77-fb73-4cf7-9f83-cf15a947ebac tempest-ApplicationCredentialsV3AdminTest-1785148458 tempest-ApplicationCredentialsV3AdminTest-1785148458-project] PATH_INFO: `/v3/users/3c7c36146f524f49addf9d7fea0ccd6e/application_credentials` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:21.226251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b231a77-fb73-4cf7-9f83-cf15a947ebac tempest-ApplicationCredentialsV3AdminTest-1785148458 tempest-ApplicationCredentialsV3AdminTest-1785148458-project] RBAC: Authorizing `identity:create_application_credential(user_id=3c7c36146f524f49addf9d7fea0ccd6e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:21.227438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b231a77-fb73-4cf7-9f83-cf15a947ebac tempest-ApplicationCredentialsV3AdminTest-1785148458 tempest-ApplicationCredentialsV3AdminTest-1785148458-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:21.305969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:21.312604 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4006/7974] 10.222.0.43 () {60 vars in 1314 bytes} [Sat Jul 2 21:39:21 2022] POST /identity/v3/users/3c7c36146f524f49addf9d7fea0ccd6e/application_credentials => generated 660 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:21.316789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e20c5-06e6-420b-9335-f763e68f3eb1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:21.317079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e20c5-06e6-420b-9335-f763e68f3eb1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:21.317379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e20c5-06e6-420b-9335-f763e68f3eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:21.339959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b27e20c5-06e6-420b-9335-f763e68f3eb1 None None] MFA Rules not processed for user `3c7c36146f524f49addf9d7fea0ccd6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:21.341233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b27e20c5-06e6-420b-9335-f763e68f3eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:21.421624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:21.455517 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3969/7975] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:21 2022] POST /identity/v3/auth/tokens => generated 3387 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 02 21:39:21.460307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b231a77-fb73-4cf7-9f83-cf15a947ebac tempest-ApplicationCredentialsV3AdminTest-1785148458 tempest-ApplicationCredentialsV3AdminTest-1785148458-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:21.470650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b231a77-fb73-4cf7-9f83-cf15a947ebac tempest-ApplicationCredentialsV3AdminTest-1785148458 tempest-ApplicationCredentialsV3AdminTest-1785148458-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:21.475866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b6fe2-736d-4155-9461-1b4dbf9fc8da tempest-ApplicationCredentialsV3AdminTest-1785148458 tempest-ApplicationCredentialsV3AdminTest-1785148458-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c7c36146f524f49addf9d7fea0ccd6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2064e302507445cb95733fc29ad2c711', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1880589562', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:21.476835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b6fe2-736d-4155-9461-1b4dbf9fc8da tempest-ApplicationCredentialsV3AdminTest-1785148458 tempest-ApplicationCredentialsV3AdminTest-1785148458-project] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:21.477114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b6fe2-736d-4155-9461-1b4dbf9fc8da tempest-ApplicationCredentialsV3AdminTest-1785148458 tempest-ApplicationCredentialsV3AdminTest-1785148458-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:21.477391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b6fe2-736d-4155-9461-1b4dbf9fc8da tempest-ApplicationCredentialsV3AdminTest-1785148458 tempest-ApplicationCredentialsV3AdminTest-1785148458-project] PATH_INFO: `/v3/users/3c7c36146f524f49addf9d7fea0ccd6e/application_credentials/4f2a22da223a49588ae453f779a2f250` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:21.478657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b6fe2-736d-4155-9461-1b4dbf9fc8da tempest-ApplicationCredentialsV3AdminTest-1785148458 tempest-ApplicationCredentialsV3AdminTest-1785148458-project] RBAC: Authorizing `identity:delete_application_credential(user_id=3c7c36146f524f49addf9d7fea0ccd6e, application_credential_id=4f2a22da223a49588ae453f779a2f250)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:21.480218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b6fe2-736d-4155-9461-1b4dbf9fc8da tempest-ApplicationCredentialsV3AdminTest-1785148458 tempest-ApplicationCredentialsV3AdminTest-1785148458-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:21.501945 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4007/7976] 10.222.0.43 () {58 vars in 1394 bytes} [Sat Jul 2 21:39:21 2022] DELETE /identity/v3/users/3c7c36146f524f49addf9d7fea0ccd6e/application_credentials/4f2a22da223a49588ae453f779a2f250 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:21.506120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e20c5-06e6-420b-9335-f763e68f3eb1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:21.571202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e20c5-06e6-420b-9335-f763e68f3eb1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:21.576384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653a09d-b114-4551-9a05-6e5dcad4413a tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d7ec8f68974cdc9bea4d2d086d79c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ca6cdcf5b3242049dc5bc90edd1d29e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:21.577246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653a09d-b114-4551-9a05-6e5dcad4413a tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:21.577516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653a09d-b114-4551-9a05-6e5dcad4413a tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:21.577777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653a09d-b114-4551-9a05-6e5dcad4413a tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] PATH_INFO: `/v3/roles/70408e51b1924028abbfc041fd53e652` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:21.579549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653a09d-b114-4551-9a05-6e5dcad4413a tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] RBAC: Authorizing `identity:delete_role(role_id=70408e51b1924028abbfc041fd53e652)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:21.581190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653a09d-b114-4551-9a05-6e5dcad4413a tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:21.623742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b653a09d-b114-4551-9a05-6e5dcad4413a tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] Invalidating the token cache because role 70408e51b1924028abbfc041fd53e652 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:21.624030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b653a09d-b114-4551-9a05-6e5dcad4413a tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:21.624790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b653a09d-b114-4551-9a05-6e5dcad4413a tempest-ApplicationCredentialsV3AdminTest-1149945501 tempest-ApplicationCredentialsV3AdminTest-1149945501-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:21.626996 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3970/7977] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:21 2022] DELETE /identity/v3/roles/70408e51b1924028abbfc041fd53e652 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:39:21.631971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b6fe2-736d-4155-9461-1b4dbf9fc8da tempest-ApplicationCredentialsV3AdminTest-1785148458 tempest-ApplicationCredentialsV3AdminTest-1785148458-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:21.633715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2e1b6fe2-736d-4155-9461-1b4dbf9fc8da tempest-ApplicationCredentialsV3AdminTest-1785148458 tempest-ApplicationCredentialsV3AdminTest-1785148458-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:21.701620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b6fe2-736d-4155-9461-1b4dbf9fc8da tempest-ApplicationCredentialsV3AdminTest-1785148458 tempest-ApplicationCredentialsV3AdminTest-1785148458-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:21.764353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f96b2-92d5-43aa-8335-52fe23738caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:21.765601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f96b2-92d5-43aa-8335-52fe23738caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:21.765987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f96b2-92d5-43aa-8335-52fe23738caa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:21.766266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f96b2-92d5-43aa-8335-52fe23738caa admin admin] PATH_INFO: `/v3/users/3c7c36146f524f49addf9d7fea0ccd6e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:21.767939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f96b2-92d5-43aa-8335-52fe23738caa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7c36146f524f49addf9d7fea0ccd6e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:21.769984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f96b2-92d5-43aa-8335-52fe23738caa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:21.823078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5c9f96b2-92d5-43aa-8335-52fe23738caa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7c36146f524f49addf9d7fea0ccd6e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:21.833756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5c9f96b2-92d5-43aa-8335-52fe23738caa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7c36146f524f49addf9d7fea0ccd6e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:21.834732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5c9f96b2-92d5-43aa-8335-52fe23738caa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7c36146f524f49addf9d7fea0ccd6e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:21.835672 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5c9f96b2-92d5-43aa-8335-52fe23738caa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7c36146f524f49addf9d7fea0ccd6e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:21.843745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5c9f96b2-92d5-43aa-8335-52fe23738caa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7c36146f524f49addf9d7fea0ccd6e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:21.861932 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4008/7978] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:21 2022] DELETE /identity/v3/users/3c7c36146f524f49addf9d7fea0ccd6e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:21.866591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d886e8-5260-40b4-9fed-8d433fa7c4b9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:21.867090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d886e8-5260-40b4-9fed-8d433fa7c4b9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:21.867211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d886e8-5260-40b4-9fed-8d433fa7c4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:21.885668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e9d886e8-5260-40b4-9fed-8d433fa7c4b9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:21.886887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e9d886e8-5260-40b4-9fed-8d433fa7c4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:21.954286 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3971/7979] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:21.964401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f96b2-92d5-43aa-8335-52fe23738caa admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:21.965923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5c9f96b2-92d5-43aa-8335-52fe23738caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:21.972879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:22.028282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f96b2-92d5-43aa-8335-52fe23738caa admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:22.032360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910170a0-a218-45e9-9fe9-c25ecdb95101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:22.033006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910170a0-a218-45e9-9fe9-c25ecdb95101 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:22.033294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910170a0-a218-45e9-9fe9-c25ecdb95101 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:22.033572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910170a0-a218-45e9-9fe9-c25ecdb95101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:22.043481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910170a0-a218-45e9-9fe9-c25ecdb95101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:22.044961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910170a0-a218-45e9-9fe9-c25ecdb95101 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:22.055259 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4009/7980] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:39:22.341853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d886e8-5260-40b4-9fed-8d433fa7c4b9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:22.343461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e9d886e8-5260-40b4-9fed-8d433fa7c4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:22.358693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d886e8-5260-40b4-9fed-8d433fa7c4b9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:22.364536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb4e64-fc04-41f0-b152-2471b046aa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:22.365465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb4e64-fc04-41f0-b152-2471b046aa62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:22.365669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb4e64-fc04-41f0-b152-2471b046aa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:22.365979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb4e64-fc04-41f0-b152-2471b046aa62 admin admin] PATH_INFO: `/v3/projects/2064e302507445cb95733fc29ad2c711` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:22.367202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb4e64-fc04-41f0-b152-2471b046aa62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2064e302507445cb95733fc29ad2c711)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:22.369275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb4e64-fc04-41f0-b152-2471b046aa62 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:22.408156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:22.422194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4abb4e64-fc04-41f0-b152-2471b046aa62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2064e302507445cb95733fc29ad2c711', 'request_id': 'req-4abb4e64-fc04-41f0-b152-2471b046aa62'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:22.428783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4abb4e64-fc04-41f0-b152-2471b046aa62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2064e302507445cb95733fc29ad2c711', 'request_id': 'req-4abb4e64-fc04-41f0-b152-2471b046aa62'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:22.434259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4abb4e64-fc04-41f0-b152-2471b046aa62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2064e302507445cb95733fc29ad2c711', 'request_id': 'req-4abb4e64-fc04-41f0-b152-2471b046aa62'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:22.447590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4abb4e64-fc04-41f0-b152-2471b046aa62 admin admin] The token cache is being invalidate because project 2064e302507445cb95733fc29ad2c711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:22.447876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4abb4e64-fc04-41f0-b152-2471b046aa62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:22.448574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4abb4e64-fc04-41f0-b152-2471b046aa62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:22.450145 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3972/7981] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:39:22 2022] DELETE /identity/v3/projects/2064e302507445cb95733fc29ad2c711 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:22.454273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910170a0-a218-45e9-9fe9-c25ecdb95101 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:22.464446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910170a0-a218-45e9-9fe9-c25ecdb95101 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:22.523956 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdb81b-93f6-4606-8982-f0ab16b7ab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:22.524938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdb81b-93f6-4606-8982-f0ab16b7ab75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:22.525217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdb81b-93f6-4606-8982-f0ab16b7ab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:22.525491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdb81b-93f6-4606-8982-f0ab16b7ab75 admin admin] PATH_INFO: `/v3/users/c6d7ec8f68974cdc9bea4d2d086d79c6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:22.526753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdb81b-93f6-4606-8982-f0ab16b7ab75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d7ec8f68974cdc9bea4d2d086d79c6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:22.528787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdb81b-93f6-4606-8982-f0ab16b7ab75 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:22.578866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-85cdb81b-93f6-4606-8982-f0ab16b7ab75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d7ec8f68974cdc9bea4d2d086d79c6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:22.586539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-85cdb81b-93f6-4606-8982-f0ab16b7ab75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d7ec8f68974cdc9bea4d2d086d79c6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:22.587319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-85cdb81b-93f6-4606-8982-f0ab16b7ab75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d7ec8f68974cdc9bea4d2d086d79c6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:22.587932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-85cdb81b-93f6-4606-8982-f0ab16b7ab75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d7ec8f68974cdc9bea4d2d086d79c6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:22.594890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-85cdb81b-93f6-4606-8982-f0ab16b7ab75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d7ec8f68974cdc9bea4d2d086d79c6'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:22.614430 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4010/7982] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:22 2022] DELETE /identity/v3/users/c6d7ec8f68974cdc9bea4d2d086d79c6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:39:22.895275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb4e64-fc04-41f0-b152-2471b046aa62 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:22.896858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4abb4e64-fc04-41f0-b152-2471b046aa62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:22.915089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb4e64-fc04-41f0-b152-2471b046aa62 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:22.988700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4575810-5104-4751-8f64-3544e97d7ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:22.989584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4575810-5104-4751-8f64-3544e97d7ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:22.989856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4575810-5104-4751-8f64-3544e97d7ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:22.990134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4575810-5104-4751-8f64-3544e97d7ca3 admin admin] PATH_INFO: `/v3/projects/2ca6cdcf5b3242049dc5bc90edd1d29e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:22.991466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4575810-5104-4751-8f64-3544e97d7ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca6cdcf5b3242049dc5bc90edd1d29e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:22.993449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4575810-5104-4751-8f64-3544e97d7ca3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:23.040601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a4575810-5104-4751-8f64-3544e97d7ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca6cdcf5b3242049dc5bc90edd1d29e', 'request_id': 'req-a4575810-5104-4751-8f64-3544e97d7ca3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:23.047166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a4575810-5104-4751-8f64-3544e97d7ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca6cdcf5b3242049dc5bc90edd1d29e', 'request_id': 'req-a4575810-5104-4751-8f64-3544e97d7ca3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:23.053911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a4575810-5104-4751-8f64-3544e97d7ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca6cdcf5b3242049dc5bc90edd1d29e', 'request_id': 'req-a4575810-5104-4751-8f64-3544e97d7ca3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:23.070681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a4575810-5104-4751-8f64-3544e97d7ca3 admin admin] The token cache is being invalidate because project 2ca6cdcf5b3242049dc5bc90edd1d29e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:23.070972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a4575810-5104-4751-8f64-3544e97d7ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:23.071712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a4575810-5104-4751-8f64-3544e97d7ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:23.073401 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3973/7983] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:39:22 2022] DELETE /identity/v3/projects/2ca6cdcf5b3242049dc5bc90edd1d29e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:23.078670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c3d4f-3af7-4b4d-996c-922a6a6c556f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:23.078963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c3d4f-3af7-4b4d-996c-922a6a6c556f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:23.079249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c3d4f-3af7-4b4d-996c-922a6a6c556f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:23.097339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-159c3d4f-3af7-4b4d-996c-922a6a6c556f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:23.098568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-159c3d4f-3af7-4b4d-996c-922a6a6c556f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:23.120356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:23.160272 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4011/7984] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:23.169114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e6882-e685-4315-bb80-116dd628588a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:23.169493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e6882-e685-4315-bb80-116dd628588a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:23.169841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e6882-e685-4315-bb80-116dd628588a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:23.198180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-be7e6882-e685-4315-bb80-116dd628588a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:23.199418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-be7e6882-e685-4315-bb80-116dd628588a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:23.210022 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3974/7985] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:23.214590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c3d4f-3af7-4b4d-996c-922a6a6c556f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:23.225368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c3d4f-3af7-4b4d-996c-922a6a6c556f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:23.230763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791c360-a340-4446-9de4-c268a904a7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:23.231458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791c360-a340-4446-9de4-c268a904a7bf admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:23.231743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791c360-a340-4446-9de4-c268a904a7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:23.232073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791c360-a340-4446-9de4-c268a904a7bf admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:23.232815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791c360-a340-4446-9de4-c268a904a7bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:39:23.233120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791c360-a340-4446-9de4-c268a904a7bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:23.234787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791c360-a340-4446-9de4-c268a904a7bf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:23.248029 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4012/7986] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:23.252626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e6882-e685-4315-bb80-116dd628588a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:23.262932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e6882-e685-4315-bb80-116dd628588a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:23.271542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13c3af-715f-437d-b580-a55e5ab4cd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:23.272640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13c3af-715f-437d-b580-a55e5ab4cd1a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:23.273107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13c3af-715f-437d-b580-a55e5ab4cd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:23.273571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13c3af-715f-437d-b580-a55e5ab4cd1a admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:23.274745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13c3af-715f-437d-b580-a55e5ab4cd1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:23.276997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13c3af-715f-437d-b580-a55e5ab4cd1a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:23.309232 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3975/7987] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:39:23 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:23.311615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791c360-a340-4446-9de4-c268a904a7bf admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:23.322106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791c360-a340-4446-9de4-c268a904a7bf admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:23.380752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfc300-9514-47a5-b79c-b64b3d478dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:23.381417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfc300-9514-47a5-b79c-b64b3d478dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:23.381705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfc300-9514-47a5-b79c-b64b3d478dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:23.381988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfc300-9514-47a5-b79c-b64b3d478dd0 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:23.382673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfc300-9514-47a5-b79c-b64b3d478dd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:23.384899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfc300-9514-47a5-b79c-b64b3d478dd0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:23.404920 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4013/7988] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:23 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:23.409115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13c3af-715f-437d-b580-a55e5ab4cd1a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:23.420901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13c3af-715f-437d-b580-a55e5ab4cd1a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:23.427005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c1d47-da74-4fd5-943b-8d22b7dafeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:23.427638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c1d47-da74-4fd5-943b-8d22b7dafeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:23.427928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c1d47-da74-4fd5-943b-8d22b7dafeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:23.428261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c1d47-da74-4fd5-943b-8d22b7dafeb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:23.428986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c1d47-da74-4fd5-943b-8d22b7dafeb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:23.430624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c1d47-da74-4fd5-943b-8d22b7dafeb0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:23.441996 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3976/7989] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:23.446432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfc300-9514-47a5-b79c-b64b3d478dd0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:23.457452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfc300-9514-47a5-b79c-b64b3d478dd0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:23.463254 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851d932-93be-48ff-aa25-7887bacdb583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:23.463917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851d932-93be-48ff-aa25-7887bacdb583 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:23.464239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851d932-93be-48ff-aa25-7887bacdb583 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:23.464515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851d932-93be-48ff-aa25-7887bacdb583 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:23.465230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851d932-93be-48ff-aa25-7887bacdb583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:23.466853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851d932-93be-48ff-aa25-7887bacdb583 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:23.478096 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4014/7990] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:23.482268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c1d47-da74-4fd5-943b-8d22b7dafeb0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:23.492696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c1d47-da74-4fd5-943b-8d22b7dafeb0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:23.497820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785da09-fc95-4307-bc0a-421b77c97e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:23.498707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785da09-fc95-4307-bc0a-421b77c97e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:23.499129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785da09-fc95-4307-bc0a-421b77c97e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:23.499540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785da09-fc95-4307-bc0a-421b77c97e90 admin admin] PATH_INFO: `/v3/projects/d1e80263ded44ba08003a70bd5ee5651/users/d4f58401e2514a02ab214c16db1a9568/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:23.502776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:23.516028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785da09-fc95-4307-bc0a-421b77c97e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e80263ded44ba08003a70bd5ee5651, user_id=d4f58401e2514a02ab214c16db1a9568, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:23.518953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785da09-fc95-4307-bc0a-421b77c97e90 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:23.533213 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3977/7991] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:23 2022] PUT /identity/v3/projects/d1e80263ded44ba08003a70bd5ee5651/users/d4f58401e2514a02ab214c16db1a9568/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:23.543768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a199f-fc0a-40a5-8672-632644735047 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:23.544065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a199f-fc0a-40a5-8672-632644735047 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:23.544367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a199f-fc0a-40a5-8672-632644735047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:23.575013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-557a199f-fc0a-40a5-8672-632644735047 None None] MFA Rules not processed for user `d4f58401e2514a02ab214c16db1a9568`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:23.576259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-557a199f-fc0a-40a5-8672-632644735047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:23.652058 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4015/7992] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:23.656906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785da09-fc95-4307-bc0a-421b77c97e90 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:23.721513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785da09-fc95-4307-bc0a-421b77c97e90 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:23.726606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20704daf-0c7f-40bb-97bd-0cd336746565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:23.727262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20704daf-0c7f-40bb-97bd-0cd336746565 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:23.727537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20704daf-0c7f-40bb-97bd-0cd336746565 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:23.727808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20704daf-0c7f-40bb-97bd-0cd336746565 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:23.728561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20704daf-0c7f-40bb-97bd-0cd336746565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:23.730553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20704daf-0c7f-40bb-97bd-0cd336746565 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:23.759975 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3978/7993] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:39:23 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:23.763648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a199f-fc0a-40a5-8672-632644735047 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:23.774681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a199f-fc0a-40a5-8672-632644735047 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:23.793382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:23.834053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdc795-939b-4139-81e3-0304a5d6a07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:23.834727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdc795-939b-4139-81e3-0304a5d6a07c admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:23.835004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdc795-939b-4139-81e3-0304a5d6a07c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:23.835276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdc795-939b-4139-81e3-0304a5d6a07c admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:23.835965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdc795-939b-4139-81e3-0304a5d6a07c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:23.837941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdc795-939b-4139-81e3-0304a5d6a07c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:23.858843 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4016/7994] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:23 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:23.863065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20704daf-0c7f-40bb-97bd-0cd336746565 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:23.873735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20704daf-0c7f-40bb-97bd-0cd336746565 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:23.879490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548ea29-7995-4301-90ca-212679f04d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:23.880191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548ea29-7995-4301-90ca-212679f04d93 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:23.880461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548ea29-7995-4301-90ca-212679f04d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:23.880755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548ea29-7995-4301-90ca-212679f04d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:23.881486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548ea29-7995-4301-90ca-212679f04d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:23.883103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548ea29-7995-4301-90ca-212679f04d93 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:23.895519 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3979/7995] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:39:23.899770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdc795-939b-4139-81e3-0304a5d6a07c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:23.910713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdc795-939b-4139-81e3-0304a5d6a07c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:23.916813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfe524-bb8c-4634-83b6-6139cda33c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:23.917744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfe524-bb8c-4634-83b6-6139cda33c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:23.918030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfe524-bb8c-4634-83b6-6139cda33c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:23.918305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfe524-bb8c-4634-83b6-6139cda33c83 admin admin] PATH_INFO: `/v3/projects/5fabc02429714b68be67d4ee798050fd/users/47af4b1bcce045d3a13cf41918ce407c/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:23.934332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfe524-bb8c-4634-83b6-6139cda33c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fabc02429714b68be67d4ee798050fd, user_id=47af4b1bcce045d3a13cf41918ce407c, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:23.937085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfe524-bb8c-4634-83b6-6139cda33c83 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:23.952856 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4017/7996] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:23 2022] PUT /identity/v3/projects/5fabc02429714b68be67d4ee798050fd/users/47af4b1bcce045d3a13cf41918ce407c/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:23.956928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548ea29-7995-4301-90ca-212679f04d93 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:23.967470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548ea29-7995-4301-90ca-212679f04d93 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:24.025111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c51c2d-e5ed-49ef-8a48-248dc67e2d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:24.025955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c51c2d-e5ed-49ef-8a48-248dc67e2d3f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:24.026390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c51c2d-e5ed-49ef-8a48-248dc67e2d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:24.026737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c51c2d-e5ed-49ef-8a48-248dc67e2d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:24.027499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c51c2d-e5ed-49ef-8a48-248dc67e2d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:24.029255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c51c2d-e5ed-49ef-8a48-248dc67e2d3f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:24.040144 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3980/7997] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:24.044573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfe524-bb8c-4634-83b6-6139cda33c83 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:24.055724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfe524-bb8c-4634-83b6-6139cda33c83 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:24.060871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05428140-3d82-425c-9133-85e98aae2cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:24.061758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05428140-3d82-425c-9133-85e98aae2cde admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:24.062041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05428140-3d82-425c-9133-85e98aae2cde admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:24.062316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05428140-3d82-425c-9133-85e98aae2cde admin admin] PATH_INFO: `/v3/projects/5fabc02429714b68be67d4ee798050fd/users/47af4b1bcce045d3a13cf41918ce407c/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:24.064309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05428140-3d82-425c-9133-85e98aae2cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fabc02429714b68be67d4ee798050fd, user_id=47af4b1bcce045d3a13cf41918ce407c, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:24.066979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05428140-3d82-425c-9133-85e98aae2cde admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:24.077437 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4018/7998] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:24 2022] PUT /identity/v3/projects/5fabc02429714b68be67d4ee798050fd/users/47af4b1bcce045d3a13cf41918ce407c/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:24.089137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286073f-7aea-42d2-b766-99b47d3d6640 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:24.089430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286073f-7aea-42d2-b766-99b47d3d6640 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:24.089713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286073f-7aea-42d2-b766-99b47d3d6640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:24.116560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9286073f-7aea-42d2-b766-99b47d3d6640 None None] MFA Rules not processed for user `47af4b1bcce045d3a13cf41918ce407c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:24.117766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9286073f-7aea-42d2-b766-99b47d3d6640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:24.161450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:24.189052 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3981/7999] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:24 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:24.193944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05428140-3d82-425c-9133-85e98aae2cde admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:24.205259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05428140-3d82-425c-9133-85e98aae2cde admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:24.210436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1422239-d0c9-4f7e-a3ed-281068187235 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:24.211076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1422239-d0c9-4f7e-a3ed-281068187235 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:24.211358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1422239-d0c9-4f7e-a3ed-281068187235 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:24.211636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1422239-d0c9-4f7e-a3ed-281068187235 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:24.212409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1422239-d0c9-4f7e-a3ed-281068187235 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:24.214104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1422239-d0c9-4f7e-a3ed-281068187235 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:24.231417 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4019/8000] 10.222.0.43 () {60 vars in 1149 bytes} [Sat Jul 2 21:39:24 2022] POST /identity/v3/domains => generated 274 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:24.236988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286073f-7aea-42d2-b766-99b47d3d6640 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:24.247879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286073f-7aea-42d2-b766-99b47d3d6640 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:24.312998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaff3a0-303d-4a50-a755-5eb0fd721482 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:24.313673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaff3a0-303d-4a50-a755-5eb0fd721482 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:24.313958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaff3a0-303d-4a50-a755-5eb0fd721482 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:24.314237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaff3a0-303d-4a50-a755-5eb0fd721482 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:24.314992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaff3a0-303d-4a50-a755-5eb0fd721482 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:24.316665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaff3a0-303d-4a50-a755-5eb0fd721482 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:24.332727 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3982/8001] 10.222.0.43 () {60 vars in 1149 bytes} [Sat Jul 2 21:39:24 2022] POST /identity/v3/domains => generated 273 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:24.336845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1422239-d0c9-4f7e-a3ed-281068187235 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:24.347615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1422239-d0c9-4f7e-a3ed-281068187235 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:24.405806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e1647-ef6c-4097-b1e3-c8fda5c6724a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:24.406499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e1647-ef6c-4097-b1e3-c8fda5c6724a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:24.406783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e1647-ef6c-4097-b1e3-c8fda5c6724a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:24.407067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e1647-ef6c-4097-b1e3-c8fda5c6724a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:24.407823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e1647-ef6c-4097-b1e3-c8fda5c6724a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:24.409540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e1647-ef6c-4097-b1e3-c8fda5c6724a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:24.425159 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4020/8002] 10.222.0.43 () {60 vars in 1149 bytes} [Sat Jul 2 21:39:24 2022] POST /identity/v3/domains => generated 278 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:24.429713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaff3a0-303d-4a50-a755-5eb0fd721482 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:24.440902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaff3a0-303d-4a50-a755-5eb0fd721482 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:24.499885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f8cbd-9db1-455a-84f5-c7326e44fec0 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:24.500510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f8cbd-9db1-455a-84f5-c7326e44fec0 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:24.500798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f8cbd-9db1-455a-84f5-c7326e44fec0 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:24.501084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f8cbd-9db1-455a-84f5-c7326e44fec0 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:24.501805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f8cbd-9db1-455a-84f5-c7326e44fec0 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:24.503431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f8cbd-9db1-455a-84f5-c7326e44fec0 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:24.519236 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3983/8003] 10.222.0.43 () {60 vars in 1149 bytes} [Sat Jul 2 21:39:24 2022] POST /identity/v3/domains => generated 279 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:24.523563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e1647-ef6c-4097-b1e3-c8fda5c6724a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:24.534874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e1647-ef6c-4097-b1e3-c8fda5c6724a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:24.589964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:24.601200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:24.602482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:24.602856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:24.603564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains/b116a992d8d14e28911e64c30dc74b2b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:24.616668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b116a992d8d14e28911e64c30dc74b2b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:24.618366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:24.643423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b116a992d8d14e28911e64c30dc74b2b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:24.653754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b116a992d8d14e28911e64c30dc74b2b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:24.701623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b116a992d8d14e28911e64c30dc74b2b', 'request_id': 'req-f381d229-be58-4d48-a971-2f8c5596347c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:24.709569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b116a992d8d14e28911e64c30dc74b2b', 'request_id': 'req-f381d229-be58-4d48-a971-2f8c5596347c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:24.716552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b116a992d8d14e28911e64c30dc74b2b', 'request_id': 'req-f381d229-be58-4d48-a971-2f8c5596347c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:24.726851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] The token cache is being invalidate because project b116a992d8d14e28911e64c30dc74b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:24.727140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:24.727789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:24.735152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b116a992d8d14e28911e64c30dc74b2b', 'request_id': 'req-f381d229-be58-4d48-a971-2f8c5596347c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:24.735797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b116a992d8d14e28911e64c30dc74b2b', 'request_id': 'req-f381d229-be58-4d48-a971-2f8c5596347c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:24.736480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b116a992d8d14e28911e64c30dc74b2b', 'request_id': 'req-f381d229-be58-4d48-a971-2f8c5596347c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:24.745006 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4021/8004] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:39:24 2022] DELETE /identity/v3/domains/b116a992d8d14e28911e64c30dc74b2b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:24.750140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f8cbd-9db1-455a-84f5-c7326e44fec0 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:24.751963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-673f8cbd-9db1-455a-84f5-c7326e44fec0 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:24.764814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f8cbd-9db1-455a-84f5-c7326e44fec0 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:24.826222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42940115-c562-4a9e-9116-8963e5b4d99f tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:24.826890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42940115-c562-4a9e-9116-8963e5b4d99f tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:24.827177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42940115-c562-4a9e-9116-8963e5b4d99f tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:24.827453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42940115-c562-4a9e-9116-8963e5b4d99f tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:24.828224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42940115-c562-4a9e-9116-8963e5b4d99f tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:24.829833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42940115-c562-4a9e-9116-8963e5b4d99f tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:24.847131 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3984/8005] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:39:24 2022] POST /identity/v3/domains => generated 248 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:24.851495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:24.861734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381d229-be58-4d48-a971-2f8c5596347c tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:24.924907 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0eea10-df9e-44b6-b5fa-faa56a9ee426 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:24.925795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0eea10-df9e-44b6-b5fa-faa56a9ee426 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:24.926081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0eea10-df9e-44b6-b5fa-faa56a9ee426 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:24.926360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0eea10-df9e-44b6-b5fa-faa56a9ee426 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains/bd8c3a4088a340e481c0d980c0a0b8b7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:24.938334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0eea10-df9e-44b6-b5fa-faa56a9ee426 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bd8c3a4088a340e481c0d980c0a0b8b7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:24.939994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0eea10-df9e-44b6-b5fa-faa56a9ee426 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:24.959915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cf0eea10-df9e-44b6-b5fa-faa56a9ee426 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bd8c3a4088a340e481c0d980c0a0b8b7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:24.960739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cf0eea10-df9e-44b6-b5fa-faa56a9ee426 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bd8c3a4088a340e481c0d980c0a0b8b7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:24.969210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:24.991212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cf0eea10-df9e-44b6-b5fa-faa56a9ee426 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bd8c3a4088a340e481c0d980c0a0b8b7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:24.991832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cf0eea10-df9e-44b6-b5fa-faa56a9ee426 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bd8c3a4088a340e481c0d980c0a0b8b7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:24.994588 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4022/8006] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:39:24 2022] PATCH /identity/v3/domains/bd8c3a4088a340e481c0d980c0a0b8b7 => generated 249 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:24.998653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42940115-c562-4a9e-9116-8963e5b4d99f tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:25.000764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-42940115-c562-4a9e-9116-8963e5b4d99f tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:25.008637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:25.015686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42940115-c562-4a9e-9116-8963e5b4d99f tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:25.076344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:25.077221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:25.077504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:25.077764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains/bd8c3a4088a340e481c0d980c0a0b8b7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:25.090140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bd8c3a4088a340e481c0d980c0a0b8b7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:25.091803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:25.115287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bd8c3a4088a340e481c0d980c0a0b8b7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.125762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bd8c3a4088a340e481c0d980c0a0b8b7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.176920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8c3a4088a340e481c0d980c0a0b8b7', 'request_id': 'req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.183998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8c3a4088a340e481c0d980c0a0b8b7', 'request_id': 'req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.189858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8c3a4088a340e481c0d980c0a0b8b7', 'request_id': 'req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.203224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] The token cache is being invalidate because project bd8c3a4088a340e481c0d980c0a0b8b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:25.203508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.204163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.211640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bd8c3a4088a340e481c0d980c0a0b8b7', 'request_id': 'req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.212324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bd8c3a4088a340e481c0d980c0a0b8b7', 'request_id': 'req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.212954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bd8c3a4088a340e481c0d980c0a0b8b7', 'request_id': 'req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.221184 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3985/8007] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:39:24 2022] DELETE /identity/v3/domains/bd8c3a4088a340e481c0d980c0a0b8b7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:25.226335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0eea10-df9e-44b6-b5fa-faa56a9ee426 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:25.236870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0eea10-df9e-44b6-b5fa-faa56a9ee426 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:25.309544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53989a7c-7f36-4e32-95db-9e5686f2d3a3 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:25.310134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53989a7c-7f36-4e32-95db-9e5686f2d3a3 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:25.310424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53989a7c-7f36-4e32-95db-9e5686f2d3a3 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:25.310704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53989a7c-7f36-4e32-95db-9e5686f2d3a3 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:25.311435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53989a7c-7f36-4e32-95db-9e5686f2d3a3 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:25.313091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53989a7c-7f36-4e32-95db-9e5686f2d3a3 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:25.328214 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4023/8008] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:39:25 2022] POST /identity/v3/domains => generated 279 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:25.332460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:25.333997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:25.347239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb4e76-75ef-4a9a-b3df-e92fea0ed571 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:25.387861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:25.408747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f3209-3f1b-4a25-bfd4-50c0f54c8217 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:25.409630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f3209-3f1b-4a25-bfd4-50c0f54c8217 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:25.409916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f3209-3f1b-4a25-bfd4-50c0f54c8217 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:25.410213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f3209-3f1b-4a25-bfd4-50c0f54c8217 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains/b4dcd5092e4749599c131fd93da9df42` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:25.421308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f3209-3f1b-4a25-bfd4-50c0f54c8217 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b4dcd5092e4749599c131fd93da9df42)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:25.423295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f3209-3f1b-4a25-bfd4-50c0f54c8217 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:25.444419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7f6f3209-3f1b-4a25-bfd4-50c0f54c8217 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b4dcd5092e4749599c131fd93da9df42'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.445097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7f6f3209-3f1b-4a25-bfd4-50c0f54c8217 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b4dcd5092e4749599c131fd93da9df42'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.473769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7f6f3209-3f1b-4a25-bfd4-50c0f54c8217 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b4dcd5092e4749599c131fd93da9df42'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.474407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7f6f3209-3f1b-4a25-bfd4-50c0f54c8217 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b4dcd5092e4749599c131fd93da9df42'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.477025 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3986/8009] 10.222.0.43 () {60 vars in 1249 bytes} [Sat Jul 2 21:39:25 2022] PATCH /identity/v3/domains/b4dcd5092e4749599c131fd93da9df42 => generated 278 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:25.481462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53989a7c-7f36-4e32-95db-9e5686f2d3a3 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:25.483248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-53989a7c-7f36-4e32-95db-9e5686f2d3a3 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:25.495762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53989a7c-7f36-4e32-95db-9e5686f2d3a3 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:25.554332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9c7ed-118d-4427-8a62-23ce4e6f71b5 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:25.555216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9c7ed-118d-4427-8a62-23ce4e6f71b5 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:25.555528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9c7ed-118d-4427-8a62-23ce4e6f71b5 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:25.555828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9c7ed-118d-4427-8a62-23ce4e6f71b5 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains/b4dcd5092e4749599c131fd93da9df42` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:25.567737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9c7ed-118d-4427-8a62-23ce4e6f71b5 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=b4dcd5092e4749599c131fd93da9df42)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:25.569707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9c7ed-118d-4427-8a62-23ce4e6f71b5 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:25.571382 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4024/8010] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:39:25 2022] GET /identity/v3/domains/b4dcd5092e4749599c131fd93da9df42 => generated 278 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:25.575760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f3209-3f1b-4a25-bfd4-50c0f54c8217 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:25.586452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f3209-3f1b-4a25-bfd4-50c0f54c8217 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:25.591447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:25.592357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:25.592647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:25.592927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains/b4dcd5092e4749599c131fd93da9df42` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:25.594243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b4dcd5092e4749599c131fd93da9df42)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:25.595844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:25.619186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b4dcd5092e4749599c131fd93da9df42'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.629809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b4dcd5092e4749599c131fd93da9df42'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.677176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4dcd5092e4749599c131fd93da9df42', 'request_id': 'req-29f3c172-3e27-4d28-a28d-7a13103e9531'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.684150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4dcd5092e4749599c131fd93da9df42', 'request_id': 'req-29f3c172-3e27-4d28-a28d-7a13103e9531'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.689886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4dcd5092e4749599c131fd93da9df42', 'request_id': 'req-29f3c172-3e27-4d28-a28d-7a13103e9531'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.703419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] The token cache is being invalidate because project b4dcd5092e4749599c131fd93da9df42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:25.703708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.704379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.712420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b4dcd5092e4749599c131fd93da9df42', 'request_id': 'req-29f3c172-3e27-4d28-a28d-7a13103e9531'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.713087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b4dcd5092e4749599c131fd93da9df42', 'request_id': 'req-29f3c172-3e27-4d28-a28d-7a13103e9531'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.713730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b4dcd5092e4749599c131fd93da9df42', 'request_id': 'req-29f3c172-3e27-4d28-a28d-7a13103e9531'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:25.721978 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3987/8011] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:39:25 2022] DELETE /identity/v3/domains/b4dcd5092e4749599c131fd93da9df42 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:39:25.726911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9c7ed-118d-4427-8a62-23ce4e6f71b5 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:25.729451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-20d9c7ed-118d-4427-8a62-23ce4e6f71b5 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:25.754277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9c7ed-118d-4427-8a62-23ce4e6f71b5 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:25.827963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9c473-3b7a-4057-8b8d-281c98567d60 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:25.828689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9c473-3b7a-4057-8b8d-281c98567d60 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:25.828977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9c473-3b7a-4057-8b8d-281c98567d60 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:25.829259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9c473-3b7a-4057-8b8d-281c98567d60 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:25.829958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9c473-3b7a-4057-8b8d-281c98567d60 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:25.831594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9c473-3b7a-4057-8b8d-281c98567d60 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:25.844109 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4025/8012] 10.222.0.43 () {58 vars in 1127 bytes} [Sat Jul 2 21:39:25 2022] GET /identity/v3/domains => generated 1343 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:25.848481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:25.858803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3c172-3e27-4d28-a28d-7a13103e9531 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:25.863670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e7a6d-8c06-417b-902d-060981075f43 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:25.864588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e7a6d-8c06-417b-902d-060981075f43 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:25.864889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e7a6d-8c06-417b-902d-060981075f43 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:25.865204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e7a6d-8c06-417b-902d-060981075f43 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains/b4dcd5092e4749599c131fd93da9df42` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:25.872665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e7a6d-8c06-417b-902d-060981075f43 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 21:39:25.882853 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-c83e7a6d-8c06-417b-902d-060981075f43 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Could not find domain: b4dcd5092e4749599c131fd93da9df42.: keystone.exception.DomainNotFound: Could not find domain: b4dcd5092e4749599c131fd93da9df42. Jul 02 21:39:25.882853 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:25.882853 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 21:39:25.882853 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 21:39:25.882853 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:39:25.882853 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:39:25.882853 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:39:25.882853 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:39:25.882853 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b4dcd5092e4749599c131fd93da9df42. Jul 02 21:39:25.882853 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:39:25.882853 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:39:25.882853 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:39:25.882853 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:25.882853 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:39:25.882853 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:39:25.882853 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:39:25.884462 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:39:25.884462 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:39:25.884462 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:39:25.884462 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:39:25.884462 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:39:25.884462 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:39:25.884462 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:39:25.884462 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 02 21:39:25.884462 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 02 21:39:25.884462 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 21:39:25.884462 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 21:39:25.884462 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 21:39:25.884462 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 21:39:25.884462 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:25.884462 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:25.884462 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:39:25.885918 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:39:25.885918 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:39:25.885918 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:39:25.885918 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:39:25.885918 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 21:39:25.885918 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:39:25.885918 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:39:25.885918 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:39:25.885918 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:39:25.885918 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:39:25.885918 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:39:25.885918 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:39:25.885918 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:39:25.885918 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 21:39:25.885918 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 21:39:25.885918 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b4dcd5092e4749599c131fd93da9df42. Jul 02 21:39:25.885918 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:39:25.887293 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3988/8013] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:39:25 2022] PATCH /identity/v3/domains/b4dcd5092e4749599c131fd93da9df42 => generated 112 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:39:25.889321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9c473-3b7a-4057-8b8d-281c98567d60 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:25.902714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9c473-3b7a-4057-8b8d-281c98567d60 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:25.908997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf169ca-5196-4a9c-b7a6-e8e8b5d416ea tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:25.909662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf169ca-5196-4a9c-b7a6-e8e8b5d416ea tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:25.909983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf169ca-5196-4a9c-b7a6-e8e8b5d416ea tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:25.910256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf169ca-5196-4a9c-b7a6-e8e8b5d416ea tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:25.910970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf169ca-5196-4a9c-b7a6-e8e8b5d416ea tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:25.912749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf169ca-5196-4a9c-b7a6-e8e8b5d416ea tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:25.924059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:UPDATE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:25.935314 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4026/8014] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:39:25 2022] POST /identity/v3/domains => generated 276 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:25.939567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e7a6d-8c06-417b-902d-060981075f43 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:25.950352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e7a6d-8c06-417b-902d-060981075f43 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:25.977821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:26.014381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10489cf-6307-49a3-9c35-7a65318b46bc tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:26.015087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10489cf-6307-49a3-9c35-7a65318b46bc tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:26.015323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10489cf-6307-49a3-9c35-7a65318b46bc tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:26.015712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10489cf-6307-49a3-9c35-7a65318b46bc tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:26.016588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10489cf-6307-49a3-9c35-7a65318b46bc tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:26.018538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10489cf-6307-49a3-9c35-7a65318b46bc tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:26.055764 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3989/8015] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:25 2022] POST /identity/v3/users => generated 346 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:26.057159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf169ca-5196-4a9c-b7a6-e8e8b5d416ea tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:26.068471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf169ca-5196-4a9c-b7a6-e8e8b5d416ea tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:26.074165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4c75b-98f2-4a71-9103-bb6ee3becfa0 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:26.074834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4c75b-98f2-4a71-9103-bb6ee3becfa0 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:26.075129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4c75b-98f2-4a71-9103-bb6ee3becfa0 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:26.075407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4c75b-98f2-4a71-9103-bb6ee3becfa0 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/groups` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:26.076096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4c75b-98f2-4a71-9103-bb6ee3becfa0 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:26.078148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4c75b-98f2-4a71-9103-bb6ee3becfa0 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:26.094852 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4027/8016] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:39:26 2022] POST /identity/v3/groups => generated 324 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:26.099234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10489cf-6307-49a3-9c35-7a65318b46bc tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:26.109926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10489cf-6307-49a3-9c35-7a65318b46bc tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:26.115248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf60e2-8cab-430d-8143-f51e55657c19 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:26.116158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf60e2-8cab-430d-8143-f51e55657c19 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:26.116449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf60e2-8cab-430d-8143-f51e55657c19 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:26.116727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf60e2-8cab-430d-8143-f51e55657c19 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains/e430bbce003642798001ca580fb12e12` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:26.118049 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf60e2-8cab-430d-8143-f51e55657c19 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e430bbce003642798001ca580fb12e12)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:26.119676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf60e2-8cab-430d-8143-f51e55657c19 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:26.140901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24cf60e2-8cab-430d-8143-f51e55657c19 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e430bbce003642798001ca580fb12e12'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.141685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24cf60e2-8cab-430d-8143-f51e55657c19 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e430bbce003642798001ca580fb12e12'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.170852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24cf60e2-8cab-430d-8143-f51e55657c19 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e430bbce003642798001ca580fb12e12'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.171526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24cf60e2-8cab-430d-8143-f51e55657c19 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e430bbce003642798001ca580fb12e12'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.174497 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3990/8017] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:39:26 2022] PATCH /identity/v3/domains/e430bbce003642798001ca580fb12e12 => generated 277 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:26.178711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4c75b-98f2-4a71-9103-bb6ee3becfa0 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:26.180650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-90c4c75b-98f2-4a71-9103-bb6ee3becfa0 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:26.194074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4c75b-98f2-4a71-9103-bb6ee3becfa0 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:26.256185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:26.257060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:26.257336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:26.257612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains/e430bbce003642798001ca580fb12e12` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:26.269777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e430bbce003642798001ca580fb12e12)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:26.271419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:26.295200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e430bbce003642798001ca580fb12e12'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.441498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a553dae4f93c4843a7958cd5f3e9107a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.445166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:26.453026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a553dae4f93c4843a7958cd5f3e9107a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.454122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a553dae4f93c4843a7958cd5f3e9107a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.455115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a553dae4f93c4843a7958cd5f3e9107a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.464085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a553dae4f93c4843a7958cd5f3e9107a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.485338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e430bbce003642798001ca580fb12e12'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.530699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e430bbce003642798001ca580fb12e12', 'request_id': 'req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.539461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e430bbce003642798001ca580fb12e12', 'request_id': 'req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.546270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e430bbce003642798001ca580fb12e12', 'request_id': 'req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.557084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] The token cache is being invalidate because project e430bbce003642798001ca580fb12e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:26.557857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.557974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.565515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e430bbce003642798001ca580fb12e12', 'request_id': 'req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.566151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e430bbce003642798001ca580fb12e12', 'request_id': 'req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.566769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e430bbce003642798001ca580fb12e12', 'request_id': 'req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:26.575213 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4028/8018] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:39:26 2022] DELETE /identity/v3/domains/e430bbce003642798001ca580fb12e12 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:26.579663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf60e2-8cab-430d-8143-f51e55657c19 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:26.590899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf60e2-8cab-430d-8143-f51e55657c19 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:26.658928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb2f75-fa0d-4c06-9bac-a9439ccc4117 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:26.660415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb2f75-fa0d-4c06-9bac-a9439ccc4117 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:26.660808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb2f75-fa0d-4c06-9bac-a9439ccc4117 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:26.661112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb2f75-fa0d-4c06-9bac-a9439ccc4117 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains/e430bbce003642798001ca580fb12e12` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:26.673349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb2f75-fa0d-4c06-9bac-a9439ccc4117 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=e430bbce003642798001ca580fb12e12)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:26.675910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb2f75-fa0d-4c06-9bac-a9439ccc4117 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:26.697789 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-f2bb2f75-fa0d-4c06-9bac-a9439ccc4117 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Could not find domain: e430bbce003642798001ca580fb12e12.: keystone.exception.DomainNotFound: Could not find domain: e430bbce003642798001ca580fb12e12. Jul 02 21:39:26.697789 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:26.697789 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 21:39:26.697789 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 21:39:26.697789 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:39:26.697789 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:39:26.697789 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:39:26.697789 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:39:26.697789 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e430bbce003642798001ca580fb12e12. Jul 02 21:39:26.697789 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:39:26.697789 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:39:26.697789 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:39:26.697789 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:26.697789 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:39:26.697789 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:39:26.697789 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:39:26.699196 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:39:26.699196 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:39:26.699196 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:39:26.699196 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:39:26.699196 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:39:26.699196 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:39:26.699196 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:39:26.699196 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 21:39:26.699196 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 21:39:26.699196 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 21:39:26.699196 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 21:39:26.699196 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:26.699196 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:26.699196 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:39:26.699196 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:39:26.699196 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:39:26.699196 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:39:26.700671 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:39:26.700671 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 21:39:26.700671 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:39:26.700671 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:39:26.700671 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:39:26.700671 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:39:26.700671 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:39:26.700671 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:39:26.700671 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:39:26.700671 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:39:26.700671 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 21:39:26.700671 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 21:39:26.700671 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e430bbce003642798001ca580fb12e12. Jul 02 21:39:26.700671 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:39:26.702279 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3991/8019] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:39:26 2022] GET /identity/v3/domains/e430bbce003642798001ca580fb12e12 => generated 112 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:39:26.703203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:26.704951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:26.719753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8928e-edcf-49a7-b4b7-77925c2a3a5e tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:26.726245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55f061-54f2-46f7-b8da-43c1d50d035f tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:26.727144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55f061-54f2-46f7-b8da-43c1d50d035f tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:26.727430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55f061-54f2-46f7-b8da-43c1d50d035f tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:26.727711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55f061-54f2-46f7-b8da-43c1d50d035f tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/users/a553dae4f93c4843a7958cd5f3e9107a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:26.737588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55f061-54f2-46f7-b8da-43c1d50d035f tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:get_user(user_id=a553dae4f93c4843a7958cd5f3e9107a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:26.739649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55f061-54f2-46f7-b8da-43c1d50d035f tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:26.757227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-0a55f061-54f2-46f7-b8da-43c1d50d035f tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Could not find user: a553dae4f93c4843a7958cd5f3e9107a.: keystone.exception.UserNotFound: Could not find user: a553dae4f93c4843a7958cd5f3e9107a. Jul 02 21:39:26.757227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:26.757227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:39:26.757227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:39:26.757227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:39:26.757227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:39:26.757227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:39:26.757227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:39:26.757227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:39:26.757227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:39:26.757227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:39:26.757227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:39:26.757227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 21:39:26.757227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 21:39:26.758442 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 21:39:26.758442 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 21:39:26.758442 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:26.758442 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:26.758442 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 21:39:26.758442 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 21:39:26.758442 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 21:39:26.758442 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 21:39:26.758442 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:39:26.758442 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:39:26.758442 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:39:26.758442 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:39:26.758442 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:39:26.758442 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 21:39:26.758442 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:39:26.758442 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:39:26.758442 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:39:26.759626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:39:26.759626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:39:26.759626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:39:26.759626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:39:26.759626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:39:26.759626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 21:39:26.759626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 21:39:26.759626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 21:39:26.759626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 21:39:26.759626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 21:39:26.759626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 21:39:26.759626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: a553dae4f93c4843a7958cd5f3e9107a. Jul 02 21:39:26.759626 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:39:26.759626 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4029/8020] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:39:26 2022] GET /identity/v3/users/a553dae4f93c4843a7958cd5f3e9107a => generated 110 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:39:26.763145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb2f75-fa0d-4c06-9bac-a9439ccc4117 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:26.775350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb2f75-fa0d-4c06-9bac-a9439ccc4117 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:26.781290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781a431-aa33-4dc9-b95a-ddeb6676dfc1 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:26.782122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781a431-aa33-4dc9-b95a-ddeb6676dfc1 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:26.782406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781a431-aa33-4dc9-b95a-ddeb6676dfc1 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:26.782688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781a431-aa33-4dc9-b95a-ddeb6676dfc1 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/groups/2a404a4ea4b548c898f040868b019e2c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:26.788069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781a431-aa33-4dc9-b95a-ddeb6676dfc1 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:get_group(group_id=2a404a4ea4b548c898f040868b019e2c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:26.789152 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-8781a431-aa33-4dc9-b95a-ddeb6676dfc1 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:26.789152 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:26.789152 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:26.790303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781a431-aa33-4dc9-b95a-ddeb6676dfc1 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:26.808656 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-8781a431-aa33-4dc9-b95a-ddeb6676dfc1 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Could not find group: 2a404a4ea4b548c898f040868b019e2c.: keystone.exception.GroupNotFound: Could not find group: 2a404a4ea4b548c898f040868b019e2c. Jul 02 21:39:26.808656 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:26.808656 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:39:26.808656 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:39:26.808656 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:39:26.808656 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:39:26.808656 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:39:26.808656 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:39:26.808656 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:39:26.808656 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:39:26.808656 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:39:26.808656 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:39:26.808656 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Jul 02 21:39:26.808656 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_group(group_id) Jul 02 21:39:26.810567 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Jul 02 21:39:26.810567 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Jul 02 21:39:26.810567 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:26.810567 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:26.810567 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 21:39:26.810567 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 21:39:26.810567 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 21:39:26.810567 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 21:39:26.810567 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:39:26.810567 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:39:26.810567 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:39:26.810567 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:39:26.810567 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:39:26.810567 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 21:39:26.810567 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:39:26.810567 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:39:26.810567 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:39:26.812862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:39:26.812862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:39:26.812862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:39:26.812862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:39:26.812862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:39:26.812862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jul 02 21:39:26.812862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jul 02 21:39:26.812862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jul 02 21:39:26.812862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jul 02 21:39:26.812862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jul 02 21:39:26.812862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jul 02 21:39:26.812862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 2a404a4ea4b548c898f040868b019e2c. Jul 02 21:39:26.812862 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:39:26.812862 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3992/8021] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:26 2022] GET /identity/v3/groups/2a404a4ea4b548c898f040868b019e2c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:39:26.815041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55f061-54f2-46f7-b8da-43c1d50d035f tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:26.829683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55f061-54f2-46f7-b8da-43c1d50d035f tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:26.835598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04fb69-0bc7-4d57-8e07-050136c8b6c2 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:26.836495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04fb69-0bc7-4d57-8e07-050136c8b6c2 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:26.836782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04fb69-0bc7-4d57-8e07-050136c8b6c2 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:26.837064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04fb69-0bc7-4d57-8e07-050136c8b6c2 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/groups/2a404a4ea4b548c898f040868b019e2c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:26.841962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04fb69-0bc7-4d57-8e07-050136c8b6c2 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 21:39:26.851885 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-1c04fb69-0bc7-4d57-8e07-050136c8b6c2 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Could not find group: 2a404a4ea4b548c898f040868b019e2c.: keystone.exception.GroupNotFound: Could not find group: 2a404a4ea4b548c898f040868b019e2c. Jul 02 21:39:26.851885 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:26.851885 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:39:26.851885 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:39:26.851885 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:39:26.851885 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:39:26.851885 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:39:26.851885 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:39:26.851885 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:39:26.851885 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:39:26.851885 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:39:26.851885 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:39:26.851885 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Jul 02 21:39:26.851885 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Jul 02 21:39:26.853148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 21:39:26.853148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 21:39:26.853148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 21:39:26.853148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 21:39:26.853148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:26.853148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:26.853148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 21:39:26.853148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 21:39:26.853148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 21:39:26.853148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 21:39:26.853148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:39:26.853148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:39:26.853148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:39:26.853148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:39:26.853148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:39:26.853148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 21:39:26.853148 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:39:26.854525 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:39:26.854525 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:39:26.854525 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:39:26.854525 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:39:26.854525 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:39:26.854525 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:39:26.854525 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:39:26.854525 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jul 02 21:39:26.854525 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jul 02 21:39:26.854525 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jul 02 21:39:26.854525 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jul 02 21:39:26.854525 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jul 02 21:39:26.854525 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jul 02 21:39:26.854525 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 2a404a4ea4b548c898f040868b019e2c. Jul 02 21:39:26.854525 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:39:26.856463 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4030/8022] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:39:26 2022] DELETE /identity/v3/groups/2a404a4ea4b548c898f040868b019e2c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:39:26.857249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781a431-aa33-4dc9-b95a-ddeb6676dfc1 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:26.867626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781a431-aa33-4dc9-b95a-ddeb6676dfc1 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:26.872874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce7f37-2199-43cb-91cd-4ff72dbcd025 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:26.873746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce7f37-2199-43cb-91cd-4ff72dbcd025 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:26.874038 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce7f37-2199-43cb-91cd-4ff72dbcd025 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:26.874311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce7f37-2199-43cb-91cd-4ff72dbcd025 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/users/a553dae4f93c4843a7958cd5f3e9107a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:26.882669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce7f37-2199-43cb-91cd-4ff72dbcd025 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a553dae4f93c4843a7958cd5f3e9107a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:26.884565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce7f37-2199-43cb-91cd-4ff72dbcd025 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:26.901788 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-44ce7f37-2199-43cb-91cd-4ff72dbcd025 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Could not find user: a553dae4f93c4843a7958cd5f3e9107a.: keystone.exception.UserNotFound: Could not find user: a553dae4f93c4843a7958cd5f3e9107a. Jul 02 21:39:26.901788 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:26.901788 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:39:26.901788 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:39:26.901788 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:39:26.901788 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:39:26.901788 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:39:26.901788 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:39:26.901788 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:39:26.901788 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:39:26.901788 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:39:26.901788 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:39:26.901788 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Jul 02 21:39:26.901788 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Jul 02 21:39:26.903070 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:26.903070 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:26.903070 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 21:39:26.903070 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 21:39:26.903070 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 21:39:26.903070 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 21:39:26.903070 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Jul 02 21:39:26.903070 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Jul 02 21:39:26.903070 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:26.903070 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:26.903070 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 21:39:26.903070 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 21:39:26.903070 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 21:39:26.903070 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 21:39:26.903070 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:39:26.903070 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:39:26.903070 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:39:26.903070 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:39:26.904499 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:39:26.904499 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 21:39:26.904499 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:39:26.904499 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:39:26.904499 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:39:26.904499 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:39:26.904499 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:39:26.904499 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:39:26.904499 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:39:26.904499 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:39:26.904499 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 21:39:26.904499 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 21:39:26.904499 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 21:39:26.904499 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 21:39:26.904499 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 21:39:26.904499 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 21:39:26.904499 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: a553dae4f93c4843a7958cd5f3e9107a. Jul 02 21:39:26.904499 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:39:26.906021 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3993/8023] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:26 2022] DELETE /identity/v3/users/a553dae4f93c4843a7958cd5f3e9107a => generated 110 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 02 21:39:26.906955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04fb69-0bc7-4d57-8e07-050136c8b6c2 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:26.917658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04fb69-0bc7-4d57-8e07-050136c8b6c2 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:26.922794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a233ab7-c4a8-4607-8d34-b4c69738d8af tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:26.924004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a233ab7-c4a8-4607-8d34-b4c69738d8af tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:26.924323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a233ab7-c4a8-4607-8d34-b4c69738d8af tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:26.924595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a233ab7-c4a8-4607-8d34-b4c69738d8af tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains/e430bbce003642798001ca580fb12e12` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:26.933496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a233ab7-c4a8-4607-8d34-b4c69738d8af tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 21:39:26.943702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-5a233ab7-c4a8-4607-8d34-b4c69738d8af tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Could not find domain: e430bbce003642798001ca580fb12e12.: keystone.exception.DomainNotFound: Could not find domain: e430bbce003642798001ca580fb12e12. Jul 02 21:39:26.943702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:26.943702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 21:39:26.943702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 21:39:26.943702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:39:26.943702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:39:26.943702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:39:26.943702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:39:26.943702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e430bbce003642798001ca580fb12e12. Jul 02 21:39:26.943702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:39:26.943702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:39:26.943702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:39:26.943702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:26.943702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:39:26.943702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:39:26.943702 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:39:26.945060 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:39:26.945060 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:39:26.945060 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:39:26.945060 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:39:26.945060 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:39:26.945060 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:39:26.945060 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:39:26.945060 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 02 21:39:26.945060 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 02 21:39:26.945060 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 21:39:26.945060 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 21:39:26.945060 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 21:39:26.945060 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 21:39:26.945060 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:26.945060 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:26.945060 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:39:26.946337 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:39:26.946337 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:39:26.946337 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:39:26.946337 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:39:26.946337 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 21:39:26.946337 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:39:26.946337 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:39:26.946337 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:39:26.946337 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:39:26.946337 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:39:26.946337 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:39:26.946337 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:39:26.946337 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:39:26.946337 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 21:39:26.946337 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 21:39:26.946337 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e430bbce003642798001ca580fb12e12. Jul 02 21:39:26.946337 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:39:26.947719 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4031/8024] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:39:26 2022] PATCH /identity/v3/domains/e430bbce003642798001ca580fb12e12 => generated 112 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:39:26.951155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce7f37-2199-43cb-91cd-4ff72dbcd025 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:26.961786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce7f37-2199-43cb-91cd-4ff72dbcd025 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:26.967723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a04560-c88c-43e8-bf24-1845098494da tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:26.968405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a04560-c88c-43e8-bf24-1845098494da tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:26.968690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a04560-c88c-43e8-bf24-1845098494da tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:26.968974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a04560-c88c-43e8-bf24-1845098494da tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:26.969681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a04560-c88c-43e8-bf24-1845098494da tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:26.971498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a04560-c88c-43e8-bf24-1845098494da tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:26.990544 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3994/8025] 10.222.0.43 () {58 vars in 1127 bytes} [Sat Jul 2 21:39:26 2022] GET /identity/v3/domains => generated 1343 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:26.995605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a233ab7-c4a8-4607-8d34-b4c69738d8af tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:27.007009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a233ab7-c4a8-4607-8d34-b4c69738d8af tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:27.012591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8b319-089a-4559-9926-cf42da35d95a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:27.013343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8b319-089a-4559-9926-cf42da35d95a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:27.013667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8b319-089a-4559-9926-cf42da35d95a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:27.013979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8b319-089a-4559-9926-cf42da35d95a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:27.014805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8b319-089a-4559-9926-cf42da35d95a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:39:27.015139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8b319-089a-4559-9926-cf42da35d95a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:27.016998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8b319-089a-4559-9926-cf42da35d95a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:27.037652 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4032/8026] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:39:26 2022] GET /identity/v3/domains?enabled=True => generated 1089 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:27.049926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a04560-c88c-43e8-bf24-1845098494da tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:27.061242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a04560-c88c-43e8-bf24-1845098494da tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:27.067132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf67c1c-2e7d-44c0-b706-c0b6e7c4aecf tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:27.067799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf67c1c-2e7d-44c0-b706-c0b6e7c4aecf tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:27.068115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf67c1c-2e7d-44c0-b706-c0b6e7c4aecf tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:27.068402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf67c1c-2e7d-44c0-b706-c0b6e7c4aecf tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:27.069128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf67c1c-2e7d-44c0-b706-c0b6e7c4aecf tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-629939522) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:39:27.069436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf67c1c-2e7d-44c0-b706-c0b6e7c4aecf tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:27.071042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf67c1c-2e7d-44c0-b706-c0b6e7c4aecf tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:27.084182 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3995/8027] 10.222.0.43 () {58 vars in 1196 bytes} [Sat Jul 2 21:39:27 2022] GET /identity/v3/domains?name=tempest-test_domain-629939522 => generated 405 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:27.089306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8b319-089a-4559-9926-cf42da35d95a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:27.100486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8b319-089a-4559-9926-cf42da35d95a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:27.106045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0a1d9-5776-4cc0-9e7f-2fbbc6ff92b7 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:27.106966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a1d9-5776-4cc0-9e7f-2fbbc6ff92b7 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:27.107243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a1d9-5776-4cc0-9e7f-2fbbc6ff92b7 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:27.107522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a1d9-5776-4cc0-9e7f-2fbbc6ff92b7 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains/e430bbce003642798001ca580fb12e12` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:27.114938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0a1d9-5776-4cc0-9e7f-2fbbc6ff92b7 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 21:39:27.125240 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-03f0a1d9-5776-4cc0-9e7f-2fbbc6ff92b7 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Could not find domain: e430bbce003642798001ca580fb12e12.: keystone.exception.DomainNotFound: Could not find domain: e430bbce003642798001ca580fb12e12. Jul 02 21:39:27.125240 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:27.125240 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 21:39:27.125240 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 21:39:27.125240 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:39:27.125240 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:39:27.125240 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:39:27.125240 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:39:27.125240 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e430bbce003642798001ca580fb12e12. Jul 02 21:39:27.125240 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:39:27.125240 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:39:27.125240 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:39:27.125240 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:27.125240 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:39:27.125240 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:39:27.125240 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:39:27.126610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:39:27.126610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:39:27.126610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:39:27.126610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:39:27.126610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:39:27.126610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:39:27.126610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:39:27.126610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 02 21:39:27.126610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 02 21:39:27.126610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 21:39:27.126610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 21:39:27.126610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 21:39:27.126610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 21:39:27.126610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:27.126610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:27.126610 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:39:27.127945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:39:27.127945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:39:27.127945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:39:27.127945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:39:27.127945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 21:39:27.127945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:39:27.127945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:39:27.127945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:39:27.127945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:39:27.127945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:39:27.127945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:39:27.127945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:39:27.127945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:39:27.127945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 21:39:27.127945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 21:39:27.127945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e430bbce003642798001ca580fb12e12. Jul 02 21:39:27.127945 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:39:27.129356 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4033/8028] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:39:27 2022] PATCH /identity/v3/domains/e430bbce003642798001ca580fb12e12 => generated 112 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:39:27.130564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf67c1c-2e7d-44c0-b706-c0b6e7c4aecf tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:27.141208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf67c1c-2e7d-44c0-b706-c0b6e7c4aecf tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:27.146524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf380af6-4317-4047-ac4e-cd9b3610494a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:27.147391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf380af6-4317-4047-ac4e-cd9b3610494a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:27.147676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf380af6-4317-4047-ac4e-cd9b3610494a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:27.147942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf380af6-4317-4047-ac4e-cd9b3610494a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains/64cc61becc944ffda187a0f5dec5ae68` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:27.150257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:27.161756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf380af6-4317-4047-ac4e-cd9b3610494a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=64cc61becc944ffda187a0f5dec5ae68)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:27.163852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf380af6-4317-4047-ac4e-cd9b3610494a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:27.208937 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3996/8029] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:39:27 2022] PATCH /identity/v3/domains/64cc61becc944ffda187a0f5dec5ae68 => generated 278 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:27.213065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0a1d9-5776-4cc0-9e7f-2fbbc6ff92b7 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:27.223870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0a1d9-5776-4cc0-9e7f-2fbbc6ff92b7 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:27.231645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:27.232538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:27.232820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:27.233130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains/64cc61becc944ffda187a0f5dec5ae68` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:27.245600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=64cc61becc944ffda187a0f5dec5ae68)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:27.247233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:27.273810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '64cc61becc944ffda187a0f5dec5ae68'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.285880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '64cc61becc944ffda187a0f5dec5ae68'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.291079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:27.331381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64cc61becc944ffda187a0f5dec5ae68', 'request_id': 'req-4a35556b-d0b7-43e5-bc98-07935ded158d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.340892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64cc61becc944ffda187a0f5dec5ae68', 'request_id': 'req-4a35556b-d0b7-43e5-bc98-07935ded158d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.355879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64cc61becc944ffda187a0f5dec5ae68', 'request_id': 'req-4a35556b-d0b7-43e5-bc98-07935ded158d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.368584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] The token cache is being invalidate because project 64cc61becc944ffda187a0f5dec5ae68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:27.368875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.369595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.377673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '64cc61becc944ffda187a0f5dec5ae68', 'request_id': 'req-4a35556b-d0b7-43e5-bc98-07935ded158d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.378490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '64cc61becc944ffda187a0f5dec5ae68', 'request_id': 'req-4a35556b-d0b7-43e5-bc98-07935ded158d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.379481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '64cc61becc944ffda187a0f5dec5ae68', 'request_id': 'req-4a35556b-d0b7-43e5-bc98-07935ded158d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.388861 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4034/8030] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:39:27 2022] DELETE /identity/v3/domains/64cc61becc944ffda187a0f5dec5ae68 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:27.392934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf380af6-4317-4047-ac4e-cd9b3610494a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:27.394691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bf380af6-4317-4047-ac4e-cd9b3610494a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:27.407838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf380af6-4317-4047-ac4e-cd9b3610494a tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:27.465702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2056f-2655-490a-b723-1c63bcef2700 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:27.466494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2056f-2655-490a-b723-1c63bcef2700 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:27.466780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2056f-2655-490a-b723-1c63bcef2700 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:27.467059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2056f-2655-490a-b723-1c63bcef2700 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains/1c2e792b36774b29a0499ea0b3d58937` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:27.477837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2056f-2655-490a-b723-1c63bcef2700 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1c2e792b36774b29a0499ea0b3d58937)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:27.479481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2056f-2655-490a-b723-1c63bcef2700 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:27.499816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-61c2056f-2655-490a-b723-1c63bcef2700 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1c2e792b36774b29a0499ea0b3d58937'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.500651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-61c2056f-2655-490a-b723-1c63bcef2700 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1c2e792b36774b29a0499ea0b3d58937'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.527286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-61c2056f-2655-490a-b723-1c63bcef2700 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1c2e792b36774b29a0499ea0b3d58937'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.527958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-61c2056f-2655-490a-b723-1c63bcef2700 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1c2e792b36774b29a0499ea0b3d58937'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.530660 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3997/8031] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:39:27 2022] PATCH /identity/v3/domains/1c2e792b36774b29a0499ea0b3d58937 => generated 274 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:39:27.534833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:27.545197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35556b-d0b7-43e5-bc98-07935ded158d tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:27.602223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:27.603095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:27.603379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:27.603656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains/1c2e792b36774b29a0499ea0b3d58937` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:27.614608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1c2e792b36774b29a0499ea0b3d58937)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:27.616345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:27.638830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1c2e792b36774b29a0499ea0b3d58937'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.648873 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1c2e792b36774b29a0499ea0b3d58937'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.689548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:27.690999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c2e792b36774b29a0499ea0b3d58937', 'request_id': 'req-a9ead8e1-212e-470d-8954-64883c6caf48'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.699911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c2e792b36774b29a0499ea0b3d58937', 'request_id': 'req-a9ead8e1-212e-470d-8954-64883c6caf48'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.706991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c2e792b36774b29a0499ea0b3d58937', 'request_id': 'req-a9ead8e1-212e-470d-8954-64883c6caf48'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.718331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] The token cache is being invalidate because project 1c2e792b36774b29a0499ea0b3d58937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:27.718551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.719209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.727036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1c2e792b36774b29a0499ea0b3d58937', 'request_id': 'req-a9ead8e1-212e-470d-8954-64883c6caf48'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.727678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1c2e792b36774b29a0499ea0b3d58937', 'request_id': 'req-a9ead8e1-212e-470d-8954-64883c6caf48'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.728332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1c2e792b36774b29a0499ea0b3d58937', 'request_id': 'req-a9ead8e1-212e-470d-8954-64883c6caf48'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.737357 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4035/8032] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:39:27 2022] DELETE /identity/v3/domains/1c2e792b36774b29a0499ea0b3d58937 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:27.741648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2056f-2655-490a-b723-1c63bcef2700 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:27.743365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-61c2056f-2655-490a-b723-1c63bcef2700 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:27.756999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2056f-2655-490a-b723-1c63bcef2700 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:27.816844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff2fd6-4c07-4f62-943d-f65e74172778 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:27.818048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff2fd6-4c07-4f62-943d-f65e74172778 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:27.818417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff2fd6-4c07-4f62-943d-f65e74172778 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:27.818815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff2fd6-4c07-4f62-943d-f65e74172778 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains/301d8a22549b413292c914766cb9ba4b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:27.830256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff2fd6-4c07-4f62-943d-f65e74172778 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=301d8a22549b413292c914766cb9ba4b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:27.831888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff2fd6-4c07-4f62-943d-f65e74172778 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:27.841111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:27.853033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-58ff2fd6-4c07-4f62-943d-f65e74172778 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '301d8a22549b413292c914766cb9ba4b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.853763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-58ff2fd6-4c07-4f62-943d-f65e74172778 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '301d8a22549b413292c914766cb9ba4b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.878878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-58ff2fd6-4c07-4f62-943d-f65e74172778 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '301d8a22549b413292c914766cb9ba4b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.879478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-58ff2fd6-4c07-4f62-943d-f65e74172778 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '301d8a22549b413292c914766cb9ba4b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:27.881919 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3998/8033] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:39:27 2022] PATCH /identity/v3/domains/301d8a22549b413292c914766cb9ba4b => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:27.886196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:27.887719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:27.900972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ead8e1-212e-470d-8954-64883c6caf48 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:27.960806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e84b1-03e3-441b-b813-533cea9b9aeb tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47af4b1bcce045d3a13cf41918ce407c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5fabc02429714b68be67d4ee798050fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:27.961697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e84b1-03e3-441b-b813-533cea9b9aeb tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:27.961975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e84b1-03e3-441b-b813-533cea9b9aeb tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:27.962245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e84b1-03e3-441b-b813-533cea9b9aeb tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] PATH_INFO: `/v3/domains/301d8a22549b413292c914766cb9ba4b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:27.973185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e84b1-03e3-441b-b813-533cea9b9aeb tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=301d8a22549b413292c914766cb9ba4b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:27.974775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e84b1-03e3-441b-b813-533cea9b9aeb tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:27.996569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-606e84b1-03e3-441b-b813-533cea9b9aeb tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '301d8a22549b413292c914766cb9ba4b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.006387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-606e84b1-03e3-441b-b813-533cea9b9aeb tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '301d8a22549b413292c914766cb9ba4b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.049731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-606e84b1-03e3-441b-b813-533cea9b9aeb tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '301d8a22549b413292c914766cb9ba4b', 'request_id': 'req-606e84b1-03e3-441b-b813-533cea9b9aeb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.057861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-606e84b1-03e3-441b-b813-533cea9b9aeb tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '301d8a22549b413292c914766cb9ba4b', 'request_id': 'req-606e84b1-03e3-441b-b813-533cea9b9aeb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.064629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-606e84b1-03e3-441b-b813-533cea9b9aeb tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '301d8a22549b413292c914766cb9ba4b', 'request_id': 'req-606e84b1-03e3-441b-b813-533cea9b9aeb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.074988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-606e84b1-03e3-441b-b813-533cea9b9aeb tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] The token cache is being invalidate because project 301d8a22549b413292c914766cb9ba4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:28.075302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-606e84b1-03e3-441b-b813-533cea9b9aeb tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.075950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-606e84b1-03e3-441b-b813-533cea9b9aeb tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.083954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-606e84b1-03e3-441b-b813-533cea9b9aeb tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '301d8a22549b413292c914766cb9ba4b', 'request_id': 'req-606e84b1-03e3-441b-b813-533cea9b9aeb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.084699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-606e84b1-03e3-441b-b813-533cea9b9aeb tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '301d8a22549b413292c914766cb9ba4b', 'request_id': 'req-606e84b1-03e3-441b-b813-533cea9b9aeb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.085492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-606e84b1-03e3-441b-b813-533cea9b9aeb tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '301d8a22549b413292c914766cb9ba4b', 'request_id': 'req-606e84b1-03e3-441b-b813-533cea9b9aeb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.086993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:28.095285 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4036/8034] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:39:27 2022] DELETE /identity/v3/domains/301d8a22549b413292c914766cb9ba4b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:28.099443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff2fd6-4c07-4f62-943d-f65e74172778 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:28.100988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-58ff2fd6-4c07-4f62-943d-f65e74172778 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:28.167138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff2fd6-4c07-4f62-943d-f65e74172778 tempest-DomainsTestJSON-1090041758 tempest-DomainsTestJSON-1090041758-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:28.226163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e63469-a909-4701-88a0-b5810239a051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:28.226958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e63469-a909-4701-88a0-b5810239a051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:28.227233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e63469-a909-4701-88a0-b5810239a051 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:28.227489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e63469-a909-4701-88a0-b5810239a051 admin admin] PATH_INFO: `/v3/users/d4f58401e2514a02ab214c16db1a9568` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:28.228694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e63469-a909-4701-88a0-b5810239a051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4f58401e2514a02ab214c16db1a9568)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:28.230627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e63469-a909-4701-88a0-b5810239a051 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:28.287958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-81e63469-a909-4701-88a0-b5810239a051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4f58401e2514a02ab214c16db1a9568'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.299185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-81e63469-a909-4701-88a0-b5810239a051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4f58401e2514a02ab214c16db1a9568'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.310073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-81e63469-a909-4701-88a0-b5810239a051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4f58401e2514a02ab214c16db1a9568'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.310806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-81e63469-a909-4701-88a0-b5810239a051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4f58401e2514a02ab214c16db1a9568'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.311493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-81e63469-a909-4701-88a0-b5810239a051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4f58401e2514a02ab214c16db1a9568'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.325862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:28.332411 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 3999/8035] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:28 2022] DELETE /identity/v3/users/d4f58401e2514a02ab214c16db1a9568 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:28.338179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba96d09-61dd-44ac-8869-e62d476c9430 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:28.338650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba96d09-61dd-44ac-8869-e62d476c9430 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:28.338932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba96d09-61dd-44ac-8869-e62d476c9430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:28.360370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fba96d09-61dd-44ac-8869-e62d476c9430 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:28.361581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fba96d09-61dd-44ac-8869-e62d476c9430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:28.427812 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4037/8036] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:28.438500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e63469-a909-4701-88a0-b5810239a051 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:28.440931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-81e63469-a909-4701-88a0-b5810239a051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:28.505810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e63469-a909-4701-88a0-b5810239a051 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:28.509987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08bb85-cf6d-41ad-8b5f-7c96d8e1cbeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:28.510632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08bb85-cf6d-41ad-8b5f-7c96d8e1cbeb service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:28.510918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08bb85-cf6d-41ad-8b5f-7c96d8e1cbeb service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:28.511190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08bb85-cf6d-41ad-8b5f-7c96d8e1cbeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:28.521079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08bb85-cf6d-41ad-8b5f-7c96d8e1cbeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:28.522520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08bb85-cf6d-41ad-8b5f-7c96d8e1cbeb service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:28.532489 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4000/8037] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:39:28.825066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba96d09-61dd-44ac-8869-e62d476c9430 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:28.826563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fba96d09-61dd-44ac-8869-e62d476c9430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:28.840162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba96d09-61dd-44ac-8869-e62d476c9430 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:28.846829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f70b75-9c5f-4fc4-8975-99ec137d6233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:28.847729 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f70b75-9c5f-4fc4-8975-99ec137d6233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:28.848008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f70b75-9c5f-4fc4-8975-99ec137d6233 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:28.848329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f70b75-9c5f-4fc4-8975-99ec137d6233 admin admin] PATH_INFO: `/v3/projects/d1e80263ded44ba08003a70bd5ee5651` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:28.849681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f70b75-9c5f-4fc4-8975-99ec137d6233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e80263ded44ba08003a70bd5ee5651)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:28.851701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f70b75-9c5f-4fc4-8975-99ec137d6233 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:28.901533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a2f70b75-9c5f-4fc4-8975-99ec137d6233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e80263ded44ba08003a70bd5ee5651', 'request_id': 'req-a2f70b75-9c5f-4fc4-8975-99ec137d6233'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.910137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a2f70b75-9c5f-4fc4-8975-99ec137d6233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e80263ded44ba08003a70bd5ee5651', 'request_id': 'req-a2f70b75-9c5f-4fc4-8975-99ec137d6233'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.917208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a2f70b75-9c5f-4fc4-8975-99ec137d6233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e80263ded44ba08003a70bd5ee5651', 'request_id': 'req-a2f70b75-9c5f-4fc4-8975-99ec137d6233'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.928624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a2f70b75-9c5f-4fc4-8975-99ec137d6233 admin admin] The token cache is being invalidate because project d1e80263ded44ba08003a70bd5ee5651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:28.928944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a2f70b75-9c5f-4fc4-8975-99ec137d6233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.929613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a2f70b75-9c5f-4fc4-8975-99ec137d6233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:28.931189 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4038/8038] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:39:28 2022] DELETE /identity/v3/projects/d1e80263ded44ba08003a70bd5ee5651 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:28.935444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08bb85-cf6d-41ad-8b5f-7c96d8e1cbeb service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:28.946238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08bb85-cf6d-41ad-8b5f-7c96d8e1cbeb service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:29.008742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ca244-d7d3-4c5f-a460-6d13f60bb918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:29.009623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ca244-d7d3-4c5f-a460-6d13f60bb918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:29.009909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ca244-d7d3-4c5f-a460-6d13f60bb918 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:29.010190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ca244-d7d3-4c5f-a460-6d13f60bb918 admin admin] PATH_INFO: `/v3/users/47af4b1bcce045d3a13cf41918ce407c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:29.011463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ca244-d7d3-4c5f-a460-6d13f60bb918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47af4b1bcce045d3a13cf41918ce407c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:29.013583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ca244-d7d3-4c5f-a460-6d13f60bb918 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:29.063703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-462ca244-d7d3-4c5f-a460-6d13f60bb918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47af4b1bcce045d3a13cf41918ce407c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:29.072184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-462ca244-d7d3-4c5f-a460-6d13f60bb918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47af4b1bcce045d3a13cf41918ce407c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:29.079404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-462ca244-d7d3-4c5f-a460-6d13f60bb918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47af4b1bcce045d3a13cf41918ce407c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:29.080103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-462ca244-d7d3-4c5f-a460-6d13f60bb918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47af4b1bcce045d3a13cf41918ce407c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:29.080716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-462ca244-d7d3-4c5f-a460-6d13f60bb918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47af4b1bcce045d3a13cf41918ce407c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:29.099680 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4001/8039] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:28 2022] DELETE /identity/v3/users/47af4b1bcce045d3a13cf41918ce407c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:29.383179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f70b75-9c5f-4fc4-8975-99ec137d6233 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:29.384760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a2f70b75-9c5f-4fc4-8975-99ec137d6233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:29.398736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f70b75-9c5f-4fc4-8975-99ec137d6233 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:29.459846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768805e-25e4-4ce8-962b-e3390c1664b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:29.460761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768805e-25e4-4ce8-962b-e3390c1664b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:29.461047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768805e-25e4-4ce8-962b-e3390c1664b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:29.461331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768805e-25e4-4ce8-962b-e3390c1664b9 admin admin] PATH_INFO: `/v3/projects/5fabc02429714b68be67d4ee798050fd` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:29.462506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768805e-25e4-4ce8-962b-e3390c1664b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fabc02429714b68be67d4ee798050fd)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:29.464487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768805e-25e4-4ce8-962b-e3390c1664b9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:29.484925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:29.511381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9768805e-25e4-4ce8-962b-e3390c1664b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fabc02429714b68be67d4ee798050fd', 'request_id': 'req-9768805e-25e4-4ce8-962b-e3390c1664b9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:29.520104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9768805e-25e4-4ce8-962b-e3390c1664b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fabc02429714b68be67d4ee798050fd', 'request_id': 'req-9768805e-25e4-4ce8-962b-e3390c1664b9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:29.526485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9768805e-25e4-4ce8-962b-e3390c1664b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fabc02429714b68be67d4ee798050fd', 'request_id': 'req-9768805e-25e4-4ce8-962b-e3390c1664b9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:29.537250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9768805e-25e4-4ce8-962b-e3390c1664b9 admin admin] The token cache is being invalidate because project 5fabc02429714b68be67d4ee798050fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:29.537539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9768805e-25e4-4ce8-962b-e3390c1664b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:29.538226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9768805e-25e4-4ce8-962b-e3390c1664b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:29.539854 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4039/8040] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:39:29 2022] DELETE /identity/v3/projects/5fabc02429714b68be67d4ee798050fd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:29.545100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b5a8f-0027-480f-b37d-462b0f77ed3e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:29.545388 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b5a8f-0027-480f-b37d-462b0f77ed3e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:29.545660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b5a8f-0027-480f-b37d-462b0f77ed3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:29.565431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-431b5a8f-0027-480f-b37d-462b0f77ed3e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:29.566665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-431b5a8f-0027-480f-b37d-462b0f77ed3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:29.581845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:29.633886 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4002/8041] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:29.642808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bda89e-5de2-498f-b8b7-7a812e2e72aa None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:29.643191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bda89e-5de2-498f-b8b7-7a812e2e72aa None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:29.643579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bda89e-5de2-498f-b8b7-7a812e2e72aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:29.664727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-11bda89e-5de2-498f-b8b7-7a812e2e72aa None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:29.665949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-11bda89e-5de2-498f-b8b7-7a812e2e72aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:29.675610 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4040/8042] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:29.680130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b5a8f-0027-480f-b37d-462b0f77ed3e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:29.690393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b5a8f-0027-480f-b37d-462b0f77ed3e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:29.696017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6eff23-e741-49ef-a324-90107cb54ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:29.696702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6eff23-e741-49ef-a324-90107cb54ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:29.696988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6eff23-e741-49ef-a324-90107cb54ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:29.697258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6eff23-e741-49ef-a324-90107cb54ec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:29.697978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6eff23-e741-49ef-a324-90107cb54ec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:39:29.698286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6eff23-e741-49ef-a324-90107cb54ec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:29.699892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6eff23-e741-49ef-a324-90107cb54ec9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:29.711975 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4003/8043] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:29.716416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bda89e-5de2-498f-b8b7-7a812e2e72aa None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:29.726183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bda89e-5de2-498f-b8b7-7a812e2e72aa None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:29.732274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cb32c-eaf2-48f5-adef-84ccc6943e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:29.732923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cb32c-eaf2-48f5-adef-84ccc6943e87 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:29.733203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cb32c-eaf2-48f5-adef-84ccc6943e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:29.733474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cb32c-eaf2-48f5-adef-84ccc6943e87 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:29.734162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cb32c-eaf2-48f5-adef-84ccc6943e87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:29.736204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cb32c-eaf2-48f5-adef-84ccc6943e87 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:29.765600 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4041/8044] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:39:29 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:29.768652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6eff23-e741-49ef-a324-90107cb54ec9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:29.779115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6eff23-e741-49ef-a324-90107cb54ec9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:29.836703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a86f6-ddda-4ee0-8bde-590d7b3a6fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:29.837369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a86f6-ddda-4ee0-8bde-590d7b3a6fcd admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:29.837652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a86f6-ddda-4ee0-8bde-590d7b3a6fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:29.837929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a86f6-ddda-4ee0-8bde-590d7b3a6fcd admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:29.838598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a86f6-ddda-4ee0-8bde-590d7b3a6fcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:29.840610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a86f6-ddda-4ee0-8bde-590d7b3a6fcd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:29.861703 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4004/8045] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:29 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:39:29.865949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cb32c-eaf2-48f5-adef-84ccc6943e87 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:29.877269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cb32c-eaf2-48f5-adef-84ccc6943e87 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:29.882970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f4f0b-dad2-4f6b-90cb-1b993cd015dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:29.883634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f4f0b-dad2-4f6b-90cb-1b993cd015dc admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:29.883921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f4f0b-dad2-4f6b-90cb-1b993cd015dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:29.884239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f4f0b-dad2-4f6b-90cb-1b993cd015dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:29.885101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f4f0b-dad2-4f6b-90cb-1b993cd015dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:29.886768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f4f0b-dad2-4f6b-90cb-1b993cd015dc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:29.897607 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4042/8046] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:29.901664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a86f6-ddda-4ee0-8bde-590d7b3a6fcd admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:29.912144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a86f6-ddda-4ee0-8bde-590d7b3a6fcd admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:29.917093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b2924-071c-466f-88a5-6aed54f2311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:29.917773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b2924-071c-466f-88a5-6aed54f2311a admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:29.918037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b2924-071c-466f-88a5-6aed54f2311a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:29.918308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b2924-071c-466f-88a5-6aed54f2311a admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:29.919104 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b2924-071c-466f-88a5-6aed54f2311a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:29.920795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b2924-071c-466f-88a5-6aed54f2311a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:29.931265 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4005/8047] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:29.935527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f4f0b-dad2-4f6b-90cb-1b993cd015dc admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:29.945525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f4f0b-dad2-4f6b-90cb-1b993cd015dc admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:29.951060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a159f-6701-4e70-aa6d-09a3726e1d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:29.951942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a159f-6701-4e70-aa6d-09a3726e1d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:29.952252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a159f-6701-4e70-aa6d-09a3726e1d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:29.952526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a159f-6701-4e70-aa6d-09a3726e1d53 admin admin] PATH_INFO: `/v3/projects/536b641553fe466cb76f21e40cdfff2b/users/8ec2918478754122b0061dbcabefc39a/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:29.968023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a159f-6701-4e70-aa6d-09a3726e1d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=536b641553fe466cb76f21e40cdfff2b, user_id=8ec2918478754122b0061dbcabefc39a, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:29.970840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a159f-6701-4e70-aa6d-09a3726e1d53 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:29.986153 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4043/8048] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:29 2022] PUT /identity/v3/projects/536b641553fe466cb76f21e40cdfff2b/users/8ec2918478754122b0061dbcabefc39a/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:29.996614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad6ec6-f2b2-40f9-92f3-bd105d9d2216 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:29.996906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad6ec6-f2b2-40f9-92f3-bd105d9d2216 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:29.997185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad6ec6-f2b2-40f9-92f3-bd105d9d2216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:30.023868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6fad6ec6-f2b2-40f9-92f3-bd105d9d2216 None None] MFA Rules not processed for user `8ec2918478754122b0061dbcabefc39a`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:30.025235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6fad6ec6-f2b2-40f9-92f3-bd105d9d2216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:30.097331 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4006/8049] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:30.102080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a159f-6701-4e70-aa6d-09a3726e1d53 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:30.168867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a159f-6701-4e70-aa6d-09a3726e1d53 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:30.174744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5bb2-4ab4-4c41-b6be-d6e2a3537fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:30.175413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5bb2-4ab4-4c41-b6be-d6e2a3537fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:30.175693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5bb2-4ab4-4c41-b6be-d6e2a3537fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:30.175970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5bb2-4ab4-4c41-b6be-d6e2a3537fb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:30.176693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed5bb2-4ab4-4c41-b6be-d6e2a3537fb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:30.178633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed5bb2-4ab4-4c41-b6be-d6e2a3537fb8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:30.209023 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4044/8050] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:39:30 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:30.210387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad6ec6-f2b2-40f9-92f3-bd105d9d2216 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:30.226457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad6ec6-f2b2-40f9-92f3-bd105d9d2216 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:30.238139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:30.286008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25774d01-0504-4423-9a46-d35b75f40a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:30.286595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25774d01-0504-4423-9a46-d35b75f40a4e admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:30.286869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25774d01-0504-4423-9a46-d35b75f40a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:30.287139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25774d01-0504-4423-9a46-d35b75f40a4e admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:30.287824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25774d01-0504-4423-9a46-d35b75f40a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:30.289805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25774d01-0504-4423-9a46-d35b75f40a4e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:30.311842 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4007/8051] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:30 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:30.316356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5bb2-4ab4-4c41-b6be-d6e2a3537fb8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:30.327610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5bb2-4ab4-4c41-b6be-d6e2a3537fb8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:30.332426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf62aa6-d616-4f35-9a21-9b73f1fcae6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:30.333089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf62aa6-d616-4f35-9a21-9b73f1fcae6b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:30.333371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf62aa6-d616-4f35-9a21-9b73f1fcae6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:30.333646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf62aa6-d616-4f35-9a21-9b73f1fcae6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:30.334392 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf62aa6-d616-4f35-9a21-9b73f1fcae6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:30.336148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf62aa6-d616-4f35-9a21-9b73f1fcae6b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:30.347186 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4045/8052] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:30.351577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25774d01-0504-4423-9a46-d35b75f40a4e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:30.362282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25774d01-0504-4423-9a46-d35b75f40a4e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:30.368195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ae69f-6c99-4fec-8f22-27fbeedac682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:30.369118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ae69f-6c99-4fec-8f22-27fbeedac682 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:30.369402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ae69f-6c99-4fec-8f22-27fbeedac682 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:30.369687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ae69f-6c99-4fec-8f22-27fbeedac682 admin admin] PATH_INFO: `/v3/projects/72e3ff58a4e14d92ab919f86f3b5f533/users/afea12e9555044e98a2314562f61c9e5/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:30.385395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ae69f-6c99-4fec-8f22-27fbeedac682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e3ff58a4e14d92ab919f86f3b5f533, user_id=afea12e9555044e98a2314562f61c9e5, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:30.388071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ae69f-6c99-4fec-8f22-27fbeedac682 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:30.402413 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4008/8053] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:30 2022] PUT /identity/v3/projects/72e3ff58a4e14d92ab919f86f3b5f533/users/afea12e9555044e98a2314562f61c9e5/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:30.406557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf62aa6-d616-4f35-9a21-9b73f1fcae6b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:30.416760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf62aa6-d616-4f35-9a21-9b73f1fcae6b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:30.429972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:30.488104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1f80e-e9e1-4896-9f4d-a19ca1a3e522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:30.488784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1f80e-e9e1-4896-9f4d-a19ca1a3e522 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:30.489049 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1f80e-e9e1-4896-9f4d-a19ca1a3e522 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:30.489316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1f80e-e9e1-4896-9f4d-a19ca1a3e522 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:30.490025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1f80e-e9e1-4896-9f4d-a19ca1a3e522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:30.491848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1f80e-e9e1-4896-9f4d-a19ca1a3e522 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:30.501877 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4046/8054] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:30.506298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ae69f-6c99-4fec-8f22-27fbeedac682 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:30.517374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ae69f-6c99-4fec-8f22-27fbeedac682 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:30.522590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456d29d-e507-4a54-a582-4273d72c169b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:30.523480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456d29d-e507-4a54-a582-4273d72c169b admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:30.523783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456d29d-e507-4a54-a582-4273d72c169b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:30.524065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456d29d-e507-4a54-a582-4273d72c169b admin admin] PATH_INFO: `/v3/projects/72e3ff58a4e14d92ab919f86f3b5f533/users/afea12e9555044e98a2314562f61c9e5/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:30.526199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456d29d-e507-4a54-a582-4273d72c169b admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e3ff58a4e14d92ab919f86f3b5f533, user_id=afea12e9555044e98a2314562f61c9e5, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:30.529053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456d29d-e507-4a54-a582-4273d72c169b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:30.540431 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4009/8055] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:30 2022] PUT /identity/v3/projects/72e3ff58a4e14d92ab919f86f3b5f533/users/afea12e9555044e98a2314562f61c9e5/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:30.552472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588cc68-900a-481e-b7c8-85ae4a3bf5d2 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:30.552762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588cc68-900a-481e-b7c8-85ae4a3bf5d2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:30.553033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588cc68-900a-481e-b7c8-85ae4a3bf5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:30.581626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6588cc68-900a-481e-b7c8-85ae4a3bf5d2 None None] MFA Rules not processed for user `afea12e9555044e98a2314562f61c9e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:30.582835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6588cc68-900a-481e-b7c8-85ae4a3bf5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:30.656077 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4047/8056] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:30.660770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456d29d-e507-4a54-a582-4273d72c169b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:30.671823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456d29d-e507-4a54-a582-4273d72c169b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:30.677391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f824245-e4e9-43b8-914b-897fa5ae6a0f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:30.678055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f824245-e4e9-43b8-914b-897fa5ae6a0f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:30.678340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f824245-e4e9-43b8-914b-897fa5ae6a0f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:30.678650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f824245-e4e9-43b8-914b-897fa5ae6a0f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:30.679374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f824245-e4e9-43b8-914b-897fa5ae6a0f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:30.681047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f824245-e4e9-43b8-914b-897fa5ae6a0f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:30.698800 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4010/8057] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:39:30 2022] POST /identity/v3/domains => generated 276 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:39:30.703539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588cc68-900a-481e-b7c8-85ae4a3bf5d2 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:30.712958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588cc68-900a-481e-b7c8-85ae4a3bf5d2 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:30.784621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89783b74-108e-4ad2-ac16-6020afa1d19a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:30.785303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89783b74-108e-4ad2-ac16-6020afa1d19a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:30.785589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89783b74-108e-4ad2-ac16-6020afa1d19a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:30.785862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89783b74-108e-4ad2-ac16-6020afa1d19a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:30.786551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89783b74-108e-4ad2-ac16-6020afa1d19a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:30.788526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89783b74-108e-4ad2-ac16-6020afa1d19a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:30.829069 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4048/8058] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:39:30 2022] POST /identity/v3/groups => generated 280 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:30.833629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f824245-e4e9-43b8-914b-897fa5ae6a0f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:30.849962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f824245-e4e9-43b8-914b-897fa5ae6a0f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:30.856468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad020fad-5b0f-4608-9b44-ead84e3e7bcf tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:30.857390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad020fad-5b0f-4608-9b44-ead84e3e7bcf tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:30.857671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad020fad-5b0f-4608-9b44-ead84e3e7bcf tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:30.857935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad020fad-5b0f-4608-9b44-ead84e3e7bcf tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/df9176b7068947d49af201aad96258b6` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:30.864027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad020fad-5b0f-4608-9b44-ead84e3e7bcf tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:update_group(group_id=df9176b7068947d49af201aad96258b6)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:30.865094 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-ad020fad-5b0f-4608-9b44-ead84e3e7bcf tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:30.865094 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:30.865094 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:30.866294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad020fad-5b0f-4608-9b44-ead84e3e7bcf tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:30.884725 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4011/8059] 10.222.0.43 () {60 vars in 1246 bytes} [Sat Jul 2 21:39:30 2022] PATCH /identity/v3/groups/df9176b7068947d49af201aad96258b6 => generated 291 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:30.889245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89783b74-108e-4ad2-ac16-6020afa1d19a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:30.899400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89783b74-108e-4ad2-ac16-6020afa1d19a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:30.904290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec3333-5ffa-4318-a1bf-9dbbafcac55f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:30.905235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec3333-5ffa-4318-a1bf-9dbbafcac55f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:30.905586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec3333-5ffa-4318-a1bf-9dbbafcac55f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:30.905871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec3333-5ffa-4318-a1bf-9dbbafcac55f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/df9176b7068947d49af201aad96258b6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:30.911787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec3333-5ffa-4318-a1bf-9dbbafcac55f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:get_group(group_id=df9176b7068947d49af201aad96258b6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:30.912877 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-c0ec3333-5ffa-4318-a1bf-9dbbafcac55f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:30.912877 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:30.912877 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:30.914112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec3333-5ffa-4318-a1bf-9dbbafcac55f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:30.915800 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4049/8060] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:30 2022] GET /identity/v3/groups/df9176b7068947d49af201aad96258b6 => generated 291 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:30.920098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad020fad-5b0f-4608-9b44-ead84e3e7bcf tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:30.930972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad020fad-5b0f-4608-9b44-ead84e3e7bcf tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:30.936265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02163f-8f08-4d93-a6b9-3c864c8bae65 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:30.937118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02163f-8f08-4d93-a6b9-3c864c8bae65 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:30.937402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02163f-8f08-4d93-a6b9-3c864c8bae65 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:30.937701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02163f-8f08-4d93-a6b9-3c864c8bae65 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/df9176b7068947d49af201aad96258b6` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:30.938998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02163f-8f08-4d93-a6b9-3c864c8bae65 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:update_group(group_id=df9176b7068947d49af201aad96258b6)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:30.940944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02163f-8f08-4d93-a6b9-3c864c8bae65 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:30.960025 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4012/8061] 10.222.0.43 () {60 vars in 1245 bytes} [Sat Jul 2 21:39:30 2022] PATCH /identity/v3/groups/df9176b7068947d49af201aad96258b6 => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:39:30.964421 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec3333-5ffa-4318-a1bf-9dbbafcac55f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:30.974686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec3333-5ffa-4318-a1bf-9dbbafcac55f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:30.980092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff602f-417e-4c6b-a24b-ab743f1b036d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:30.980965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff602f-417e-4c6b-a24b-ab743f1b036d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:30.981370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff602f-417e-4c6b-a24b-ab743f1b036d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:30.981648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff602f-417e-4c6b-a24b-ab743f1b036d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/df9176b7068947d49af201aad96258b6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:30.987014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff602f-417e-4c6b-a24b-ab743f1b036d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:delete_group(group_id=df9176b7068947d49af201aad96258b6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:30.988978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff602f-417e-4c6b-a24b-ab743f1b036d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:30.994409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:31.033577 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4050/8062] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:39:30 2022] DELETE /identity/v3/groups/df9176b7068947d49af201aad96258b6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:31.038897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02163f-8f08-4d93-a6b9-3c864c8bae65 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:31.049660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02163f-8f08-4d93-a6b9-3c864c8bae65 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:31.110439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ee8aa-3065-4d75-aca0-f87858d6a42e tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:31.111119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ee8aa-3065-4d75-aca0-f87858d6a42e tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:31.111405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ee8aa-3065-4d75-aca0-f87858d6a42e tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:31.111686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ee8aa-3065-4d75-aca0-f87858d6a42e tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:31.112447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ee8aa-3065-4d75-aca0-f87858d6a42e tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:31.113472 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-5d6ee8aa-3065-4d75-aca0-f87858d6a42e tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:31.113472 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:31.113472 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:31.114679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ee8aa-3065-4d75-aca0-f87858d6a42e tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:31.130420 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4013/8063] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:39:31 2022] POST /identity/v3/groups => generated 327 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:31.134835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff602f-417e-4c6b-a24b-ab743f1b036d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:31.145614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff602f-417e-4c6b-a24b-ab743f1b036d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:31.151651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeb59a-e779-4eeb-8d6b-24012e91e041 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:31.152121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeb59a-e779-4eeb-8d6b-24012e91e041 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:31.152391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeb59a-e779-4eeb-8d6b-24012e91e041 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:31.152709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeb59a-e779-4eeb-8d6b-24012e91e041 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:31.153500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaeb59a-e779-4eeb-8d6b-24012e91e041 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:31.155430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaeb59a-e779-4eeb-8d6b-24012e91e041 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:31.185669 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4051/8064] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:31 2022] POST /identity/v3/users => generated 321 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:31.190118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ee8aa-3065-4d75-aca0-f87858d6a42e tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:31.201012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ee8aa-3065-4d75-aca0-f87858d6a42e tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:31.206171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abaf68-e0b3-4c57-a88f-9f4299fe883b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:31.207105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abaf68-e0b3-4c57-a88f-9f4299fe883b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:31.207406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abaf68-e0b3-4c57-a88f-9f4299fe883b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:31.207677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abaf68-e0b3-4c57-a88f-9f4299fe883b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/d44f9131437d473c85579a2fe7d6303e/users/2b05c5d13bbd41169e227b8db78a5ce2` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:31.215577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:UPDATE=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:31.228699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abaf68-e0b3-4c57-a88f-9f4299fe883b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=d44f9131437d473c85579a2fe7d6303e, user_id=2b05c5d13bbd41169e227b8db78a5ce2)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:31.230937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abaf68-e0b3-4c57-a88f-9f4299fe883b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:31.255499 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4014/8065] 10.222.0.43 () {60 vars in 1359 bytes} [Sat Jul 2 21:39:31 2022] PUT /identity/v3/groups/d44f9131437d473c85579a2fe7d6303e/users/2b05c5d13bbd41169e227b8db78a5ce2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:31.259862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeb59a-e779-4eeb-8d6b-24012e91e041 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:31.270716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeb59a-e779-4eeb-8d6b-24012e91e041 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:31.334875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0153fe-972b-4ac1-96ac-c7fe2f551bd8 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:31.335561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0153fe-972b-4ac1-96ac-c7fe2f551bd8 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:31.335848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0153fe-972b-4ac1-96ac-c7fe2f551bd8 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:31.336159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0153fe-972b-4ac1-96ac-c7fe2f551bd8 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:31.336850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0153fe-972b-4ac1-96ac-c7fe2f551bd8 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:31.338941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0153fe-972b-4ac1-96ac-c7fe2f551bd8 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:31.365940 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4052/8066] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:31 2022] POST /identity/v3/users => generated 323 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:31.370160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abaf68-e0b3-4c57-a88f-9f4299fe883b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:31.381305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abaf68-e0b3-4c57-a88f-9f4299fe883b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:31.387052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d6b02-b0bd-4ed5-a8f8-d29e10044e07 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:31.387954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d6b02-b0bd-4ed5-a8f8-d29e10044e07 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:31.388264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d6b02-b0bd-4ed5-a8f8-d29e10044e07 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:31.388539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d6b02-b0bd-4ed5-a8f8-d29e10044e07 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/d44f9131437d473c85579a2fe7d6303e/users/bc8dc02d9f724985a8162cda0e3f8ded` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:31.404124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d6b02-b0bd-4ed5-a8f8-d29e10044e07 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=d44f9131437d473c85579a2fe7d6303e, user_id=bc8dc02d9f724985a8162cda0e3f8ded)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:31.406051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d6b02-b0bd-4ed5-a8f8-d29e10044e07 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:31.432254 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4015/8067] 10.222.0.43 () {60 vars in 1359 bytes} [Sat Jul 2 21:39:31 2022] PUT /identity/v3/groups/d44f9131437d473c85579a2fe7d6303e/users/bc8dc02d9f724985a8162cda0e3f8ded => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:39:31.438019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0153fe-972b-4ac1-96ac-c7fe2f551bd8 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:31.449461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0153fe-972b-4ac1-96ac-c7fe2f551bd8 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:31.511311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2450f-796c-42ca-bf8c-d9cab983807a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:31.512078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2450f-796c-42ca-bf8c-d9cab983807a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:31.512383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2450f-796c-42ca-bf8c-d9cab983807a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:31.512665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2450f-796c-42ca-bf8c-d9cab983807a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:31.513408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2450f-796c-42ca-bf8c-d9cab983807a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:31.515582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2450f-796c-42ca-bf8c-d9cab983807a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:31.544080 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4053/8068] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:31 2022] POST /identity/v3/users => generated 323 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:31.548724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d6b02-b0bd-4ed5-a8f8-d29e10044e07 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:31.559267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d6b02-b0bd-4ed5-a8f8-d29e10044e07 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:31.564012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05c02a-ba45-4fe2-9f28-677e8de948dc tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:31.564935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05c02a-ba45-4fe2-9f28-677e8de948dc tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:31.565220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05c02a-ba45-4fe2-9f28-677e8de948dc tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:31.565499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05c02a-ba45-4fe2-9f28-677e8de948dc tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/d44f9131437d473c85579a2fe7d6303e/users/ebaf3b22d57446728431b9acecd3609f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:31.580376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05c02a-ba45-4fe2-9f28-677e8de948dc tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=d44f9131437d473c85579a2fe7d6303e, user_id=ebaf3b22d57446728431b9acecd3609f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:31.582300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05c02a-ba45-4fe2-9f28-677e8de948dc tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:31.607154 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4016/8069] 10.222.0.43 () {60 vars in 1359 bytes} [Sat Jul 2 21:39:31 2022] PUT /identity/v3/groups/d44f9131437d473c85579a2fe7d6303e/users/ebaf3b22d57446728431b9acecd3609f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:31.611446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2450f-796c-42ca-bf8c-d9cab983807a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:31.622172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2450f-796c-42ca-bf8c-d9cab983807a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:31.645084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:DELETE=4,keystone:INSERT=9 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:31.685870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a440910-7c61-4588-a13a-7a4250400b87 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:31.686756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a440910-7c61-4588-a13a-7a4250400b87 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:31.687035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a440910-7c61-4588-a13a-7a4250400b87 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:31.687308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a440910-7c61-4588-a13a-7a4250400b87 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/d44f9131437d473c85579a2fe7d6303e/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:31.688708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a440910-7c61-4588-a13a-7a4250400b87 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=d44f9131437d473c85579a2fe7d6303e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:31.689939 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-7a440910-7c61-4588-a13a-7a4250400b87 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:31.689939 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:31.689939 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:31.691273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a440910-7c61-4588-a13a-7a4250400b87 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:31.709851 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4054/8070] 10.222.0.43 () {58 vars in 1241 bytes} [Sat Jul 2 21:39:31 2022] GET /identity/v3/groups/d44f9131437d473c85579a2fe7d6303e/users => generated 1083 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:31.714235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05c02a-ba45-4fe2-9f28-677e8de948dc tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:31.724996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05c02a-ba45-4fe2-9f28-677e8de948dc tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:31.730069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99f13b-c12f-4d44-a140-4918cbf07dac tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:31.730966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99f13b-c12f-4d44-a140-4918cbf07dac tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:31.731369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99f13b-c12f-4d44-a140-4918cbf07dac tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:31.731649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99f13b-c12f-4d44-a140-4918cbf07dac tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/d44f9131437d473c85579a2fe7d6303e/users/2b05c5d13bbd41169e227b8db78a5ce2` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:31.733459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99f13b-c12f-4d44-a140-4918cbf07dac tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=d44f9131437d473c85579a2fe7d6303e, user_id=2b05c5d13bbd41169e227b8db78a5ce2)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:31.734492 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-9b99f13b-c12f-4d44-a140-4918cbf07dac tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:31.734492 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:31.734492 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:31.735689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99f13b-c12f-4d44-a140-4918cbf07dac tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:31.749817 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4017/8071] 10.222.0.43 () {58 vars in 1341 bytes} [Sat Jul 2 21:39:31 2022] HEAD /identity/v3/groups/d44f9131437d473c85579a2fe7d6303e/users/2b05c5d13bbd41169e227b8db78a5ce2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:31.754124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a440910-7c61-4588-a13a-7a4250400b87 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:31.765798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a440910-7c61-4588-a13a-7a4250400b87 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:31.771138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9063b08-13e2-44fd-b39d-6f1ea90b6e03 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:31.772083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9063b08-13e2-44fd-b39d-6f1ea90b6e03 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:31.772401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9063b08-13e2-44fd-b39d-6f1ea90b6e03 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:31.772684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9063b08-13e2-44fd-b39d-6f1ea90b6e03 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/d44f9131437d473c85579a2fe7d6303e/users/2b05c5d13bbd41169e227b8db78a5ce2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:31.774476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9063b08-13e2-44fd-b39d-6f1ea90b6e03 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=d44f9131437d473c85579a2fe7d6303e, user_id=2b05c5d13bbd41169e227b8db78a5ce2)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:31.776500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9063b08-13e2-44fd-b39d-6f1ea90b6e03 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:31.786541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b9063b08-13e2-44fd-b39d-6f1ea90b6e03 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2b05c5d13bbd41169e227b8db78a5ce2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:31.801457 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4055/8072] 10.222.0.43 () {58 vars in 1343 bytes} [Sat Jul 2 21:39:31 2022] DELETE /identity/v3/groups/d44f9131437d473c85579a2fe7d6303e/users/2b05c5d13bbd41169e227b8db78a5ce2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:31.805687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99f13b-c12f-4d44-a140-4918cbf07dac tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:31.816155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99f13b-c12f-4d44-a140-4918cbf07dac tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:31.878267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35023fb2-23fd-4524-a859-1244a66c6381 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:31.879066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35023fb2-23fd-4524-a859-1244a66c6381 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:31.879354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35023fb2-23fd-4524-a859-1244a66c6381 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:31.879630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35023fb2-23fd-4524-a859-1244a66c6381 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/d44f9131437d473c85579a2fe7d6303e/users/bc8dc02d9f724985a8162cda0e3f8ded` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:31.881536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35023fb2-23fd-4524-a859-1244a66c6381 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=d44f9131437d473c85579a2fe7d6303e, user_id=bc8dc02d9f724985a8162cda0e3f8ded)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:31.883439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35023fb2-23fd-4524-a859-1244a66c6381 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:31.896909 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4018/8073] 10.222.0.43 () {58 vars in 1341 bytes} [Sat Jul 2 21:39:31 2022] HEAD /identity/v3/groups/d44f9131437d473c85579a2fe7d6303e/users/bc8dc02d9f724985a8162cda0e3f8ded => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:31.901241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9063b08-13e2-44fd-b39d-6f1ea90b6e03 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:31.912497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9063b08-13e2-44fd-b39d-6f1ea90b6e03 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:31.918330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a8200-0277-4c64-9de0-3c797c5fd37f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:31.919228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a8200-0277-4c64-9de0-3c797c5fd37f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:31.919514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a8200-0277-4c64-9de0-3c797c5fd37f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:31.919791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a8200-0277-4c64-9de0-3c797c5fd37f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/d44f9131437d473c85579a2fe7d6303e/users/bc8dc02d9f724985a8162cda0e3f8ded` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:31.921575 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a8200-0277-4c64-9de0-3c797c5fd37f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=d44f9131437d473c85579a2fe7d6303e, user_id=bc8dc02d9f724985a8162cda0e3f8ded)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:31.923891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a8200-0277-4c64-9de0-3c797c5fd37f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:31.933546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5b9a8200-0277-4c64-9de0-3c797c5fd37f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bc8dc02d9f724985a8162cda0e3f8ded'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:31.947900 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4056/8074] 10.222.0.43 () {58 vars in 1343 bytes} [Sat Jul 2 21:39:31 2022] DELETE /identity/v3/groups/d44f9131437d473c85579a2fe7d6303e/users/bc8dc02d9f724985a8162cda0e3f8ded => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:31.951981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35023fb2-23fd-4524-a859-1244a66c6381 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:31.963057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35023fb2-23fd-4524-a859-1244a66c6381 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:32.012868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:32.027733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414c6e2-9652-44c4-a370-ae55712c44c0 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:32.028797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414c6e2-9652-44c4-a370-ae55712c44c0 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:32.029086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414c6e2-9652-44c4-a370-ae55712c44c0 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:32.029367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414c6e2-9652-44c4-a370-ae55712c44c0 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/d44f9131437d473c85579a2fe7d6303e/users/ebaf3b22d57446728431b9acecd3609f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:32.031347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414c6e2-9652-44c4-a370-ae55712c44c0 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=d44f9131437d473c85579a2fe7d6303e, user_id=ebaf3b22d57446728431b9acecd3609f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:32.033328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414c6e2-9652-44c4-a370-ae55712c44c0 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:32.047511 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4019/8075] 10.222.0.43 () {58 vars in 1341 bytes} [Sat Jul 2 21:39:31 2022] HEAD /identity/v3/groups/d44f9131437d473c85579a2fe7d6303e/users/ebaf3b22d57446728431b9acecd3609f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:32.052080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a8200-0277-4c64-9de0-3c797c5fd37f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:32.062882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a8200-0277-4c64-9de0-3c797c5fd37f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:32.068080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965090ab-0ed7-45d5-9d99-4ac8c0f3b54a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:32.068992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965090ab-0ed7-45d5-9d99-4ac8c0f3b54a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:32.069282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965090ab-0ed7-45d5-9d99-4ac8c0f3b54a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:32.069551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965090ab-0ed7-45d5-9d99-4ac8c0f3b54a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/d44f9131437d473c85579a2fe7d6303e/users/ebaf3b22d57446728431b9acecd3609f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:32.071330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965090ab-0ed7-45d5-9d99-4ac8c0f3b54a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=d44f9131437d473c85579a2fe7d6303e, user_id=ebaf3b22d57446728431b9acecd3609f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:32.073291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965090ab-0ed7-45d5-9d99-4ac8c0f3b54a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:32.082699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-965090ab-0ed7-45d5-9d99-4ac8c0f3b54a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ebaf3b22d57446728431b9acecd3609f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:32.096703 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4057/8076] 10.222.0.43 () {58 vars in 1343 bytes} [Sat Jul 2 21:39:32 2022] DELETE /identity/v3/groups/d44f9131437d473c85579a2fe7d6303e/users/ebaf3b22d57446728431b9acecd3609f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:32.100830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414c6e2-9652-44c4-a370-ae55712c44c0 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:32.111323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414c6e2-9652-44c4-a370-ae55712c44c0 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:32.172124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffa1ef-dd64-4137-b593-1424910f734d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:32.173321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffa1ef-dd64-4137-b593-1424910f734d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:32.173609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffa1ef-dd64-4137-b593-1424910f734d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:32.173886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffa1ef-dd64-4137-b593-1424910f734d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/d44f9131437d473c85579a2fe7d6303e/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:32.175166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffa1ef-dd64-4137-b593-1424910f734d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=d44f9131437d473c85579a2fe7d6303e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:32.176223 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-71ffa1ef-dd64-4137-b593-1424910f734d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:32.176223 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:32.176223 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:32.177438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffa1ef-dd64-4137-b593-1424910f734d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:32.186759 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4020/8077] 10.222.0.43 () {58 vars in 1241 bytes} [Sat Jul 2 21:39:32 2022] GET /identity/v3/groups/d44f9131437d473c85579a2fe7d6303e/users => generated 145 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:32.191107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965090ab-0ed7-45d5-9d99-4ac8c0f3b54a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:32.202064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965090ab-0ed7-45d5-9d99-4ac8c0f3b54a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:32.207324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50568be5-3377-4d29-b756-124d15505e56 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:32.208239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50568be5-3377-4d29-b756-124d15505e56 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:32.208527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50568be5-3377-4d29-b756-124d15505e56 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:32.208804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50568be5-3377-4d29-b756-124d15505e56 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/users/ebaf3b22d57446728431b9acecd3609f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:32.210030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50568be5-3377-4d29-b756-124d15505e56 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ebaf3b22d57446728431b9acecd3609f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:32.211971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50568be5-3377-4d29-b756-124d15505e56 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:32.262505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-50568be5-3377-4d29-b756-124d15505e56 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebaf3b22d57446728431b9acecd3609f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:32.272266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-50568be5-3377-4d29-b756-124d15505e56 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebaf3b22d57446728431b9acecd3609f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:32.273089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-50568be5-3377-4d29-b756-124d15505e56 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebaf3b22d57446728431b9acecd3609f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:32.273863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-50568be5-3377-4d29-b756-124d15505e56 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebaf3b22d57446728431b9acecd3609f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:32.280967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-50568be5-3377-4d29-b756-124d15505e56 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebaf3b22d57446728431b9acecd3609f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:32.299082 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4058/8078] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:32 2022] DELETE /identity/v3/users/ebaf3b22d57446728431b9acecd3609f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:32.303999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffa1ef-dd64-4137-b593-1424910f734d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:32.306026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-71ffa1ef-dd64-4137-b593-1424910f734d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:32.319558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffa1ef-dd64-4137-b593-1424910f734d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:32.379999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e0160-b4da-460d-89f9-957252cdada9 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:32.380988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e0160-b4da-460d-89f9-957252cdada9 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:32.381236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e0160-b4da-460d-89f9-957252cdada9 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:32.381514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e0160-b4da-460d-89f9-957252cdada9 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/users/bc8dc02d9f724985a8162cda0e3f8ded` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:32.382800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e0160-b4da-460d-89f9-957252cdada9 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bc8dc02d9f724985a8162cda0e3f8ded)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:32.384882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e0160-b4da-460d-89f9-957252cdada9 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:32.431209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d42e0160-b4da-460d-89f9-957252cdada9 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc8dc02d9f724985a8162cda0e3f8ded'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:32.439267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d42e0160-b4da-460d-89f9-957252cdada9 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc8dc02d9f724985a8162cda0e3f8ded'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:32.446380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d42e0160-b4da-460d-89f9-957252cdada9 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc8dc02d9f724985a8162cda0e3f8ded'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:32.447039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d42e0160-b4da-460d-89f9-957252cdada9 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc8dc02d9f724985a8162cda0e3f8ded'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:32.447657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d42e0160-b4da-460d-89f9-957252cdada9 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc8dc02d9f724985a8162cda0e3f8ded'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:32.458278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:32.467244 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4021/8079] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:32 2022] DELETE /identity/v3/users/bc8dc02d9f724985a8162cda0e3f8ded => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:32.471800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50568be5-3377-4d29-b756-124d15505e56 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:32.482495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50568be5-3377-4d29-b756-124d15505e56 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:32.503008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:32.543780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93668d-3b97-442e-aabc-3fa67a81778a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:32.544699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93668d-3b97-442e-aabc-3fa67a81778a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:32.544986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93668d-3b97-442e-aabc-3fa67a81778a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:32.545276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93668d-3b97-442e-aabc-3fa67a81778a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/users/2b05c5d13bbd41169e227b8db78a5ce2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:32.546482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93668d-3b97-442e-aabc-3fa67a81778a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2b05c5d13bbd41169e227b8db78a5ce2)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:32.548841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93668d-3b97-442e-aabc-3fa67a81778a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:32.594349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4b93668d-3b97-442e-aabc-3fa67a81778a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b05c5d13bbd41169e227b8db78a5ce2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:32.602696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4b93668d-3b97-442e-aabc-3fa67a81778a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b05c5d13bbd41169e227b8db78a5ce2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:32.603326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4b93668d-3b97-442e-aabc-3fa67a81778a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b05c5d13bbd41169e227b8db78a5ce2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:32.603959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4b93668d-3b97-442e-aabc-3fa67a81778a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b05c5d13bbd41169e227b8db78a5ce2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:32.611069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4b93668d-3b97-442e-aabc-3fa67a81778a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b05c5d13bbd41169e227b8db78a5ce2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:32.628967 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4059/8080] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:32 2022] DELETE /identity/v3/users/2b05c5d13bbd41169e227b8db78a5ce2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:32.633210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e0160-b4da-460d-89f9-957252cdada9 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:32.634647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d42e0160-b4da-460d-89f9-957252cdada9 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:32.648005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e0160-b4da-460d-89f9-957252cdada9 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:32.708640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4e195-60c9-4c58-97c8-72114e83280b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:32.709426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4e195-60c9-4c58-97c8-72114e83280b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:32.709708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4e195-60c9-4c58-97c8-72114e83280b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:32.709998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4e195-60c9-4c58-97c8-72114e83280b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/d44f9131437d473c85579a2fe7d6303e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:32.711261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4e195-60c9-4c58-97c8-72114e83280b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d44f9131437d473c85579a2fe7d6303e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:32.713200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4e195-60c9-4c58-97c8-72114e83280b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:32.756505 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4022/8081] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:39:32 2022] DELETE /identity/v3/groups/d44f9131437d473c85579a2fe7d6303e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:32.761989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93668d-3b97-442e-aabc-3fa67a81778a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:32.763767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4b93668d-3b97-442e-aabc-3fa67a81778a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:32.777755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93668d-3b97-442e-aabc-3fa67a81778a tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:32.836565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fe94a-2832-4f80-9674-2365d81cd4fc tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:32.837236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fe94a-2832-4f80-9674-2365d81cd4fc tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:32.837522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fe94a-2832-4f80-9674-2365d81cd4fc tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:32.837791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fe94a-2832-4f80-9674-2365d81cd4fc tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:32.838474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fe94a-2832-4f80-9674-2365d81cd4fc tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:32.840636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fe94a-2832-4f80-9674-2365d81cd4fc tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:32.855306 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4060/8082] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:39:32 2022] POST /identity/v3/groups => generated 325 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:32.859641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4e195-60c9-4c58-97c8-72114e83280b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:32.870010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4e195-60c9-4c58-97c8-72114e83280b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:32.876349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8ef38-17e5-470e-9d79-2d66319c3f85 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:32.877241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8ef38-17e5-470e-9d79-2d66319c3f85 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:32.877525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8ef38-17e5-470e-9d79-2d66319c3f85 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:32.877808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8ef38-17e5-470e-9d79-2d66319c3f85 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:32.878590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8ef38-17e5-470e-9d79-2d66319c3f85 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:32.881282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8ef38-17e5-470e-9d79-2d66319c3f85 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:32.897188 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4023/8083] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:39:32 2022] POST /identity/v3/groups => generated 327 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:32.901367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fe94a-2832-4f80-9674-2365d81cd4fc tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:32.911970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fe94a-2832-4f80-9674-2365d81cd4fc tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:32.916693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0d7c9-d1f9-47ad-873b-25243fcbf7d6 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:32.917355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0d7c9-d1f9-47ad-873b-25243fcbf7d6 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:32.917640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0d7c9-d1f9-47ad-873b-25243fcbf7d6 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:32.917917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0d7c9-d1f9-47ad-873b-25243fcbf7d6 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:32.918767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0d7c9-d1f9-47ad-873b-25243fcbf7d6 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:32.920783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0d7c9-d1f9-47ad-873b-25243fcbf7d6 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:32.936213 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4061/8084] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:39:32 2022] POST /identity/v3/groups => generated 326 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:32.940378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8ef38-17e5-470e-9d79-2d66319c3f85 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:32.950861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8ef38-17e5-470e-9d79-2d66319c3f85 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:32.955777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f0701-c4d6-4bf8-8fb2-10e6dd3c2280 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:32.956458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f0701-c4d6-4bf8-8fb2-10e6dd3c2280 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:32.956744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f0701-c4d6-4bf8-8fb2-10e6dd3c2280 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:32.957026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f0701-c4d6-4bf8-8fb2-10e6dd3c2280 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:32.957737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f0701-c4d6-4bf8-8fb2-10e6dd3c2280 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:32.958822 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-428f0701-c4d6-4bf8-8fb2-10e6dd3c2280 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:32.958822 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:32.958822 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:32.959933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f0701-c4d6-4bf8-8fb2-10e6dd3c2280 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:32.966840 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4024/8085] 10.222.0.43 () {58 vars in 1124 bytes} [Sat Jul 2 21:39:32 2022] GET /identity/v3/groups => generated 1488 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:32.970976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0d7c9-d1f9-47ad-873b-25243fcbf7d6 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:32.981904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0d7c9-d1f9-47ad-873b-25243fcbf7d6 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:32.987885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a054663-239c-4605-99a9-ab18b8e2e23b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:32.988767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a054663-239c-4605-99a9-ab18b8e2e23b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:32.989046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a054663-239c-4605-99a9-ab18b8e2e23b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:32.989322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a054663-239c-4605-99a9-ab18b8e2e23b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/da03974ac9c14d14b12361ef02f35515` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:32.995016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a054663-239c-4605-99a9-ab18b8e2e23b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:delete_group(group_id=da03974ac9c14d14b12361ef02f35515)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:32.997020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a054663-239c-4605-99a9-ab18b8e2e23b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:33.007753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:33.040705 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4062/8086] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:39:32 2022] DELETE /identity/v3/groups/da03974ac9c14d14b12361ef02f35515 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:33.045196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f0701-c4d6-4bf8-8fb2-10e6dd3c2280 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:33.055887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f0701-c4d6-4bf8-8fb2-10e6dd3c2280 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:33.113945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002f891-ea57-449e-a57a-6708a675df3b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:33.114819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002f891-ea57-449e-a57a-6708a675df3b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:33.115103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002f891-ea57-449e-a57a-6708a675df3b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:33.115381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002f891-ea57-449e-a57a-6708a675df3b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/1ce9cbfb95194c628c270478e8f66a10` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:33.120212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002f891-ea57-449e-a57a-6708a675df3b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:delete_group(group_id=1ce9cbfb95194c628c270478e8f66a10)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:33.122179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002f891-ea57-449e-a57a-6708a675df3b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:33.151177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:33.170221 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4025/8087] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:39:33 2022] DELETE /identity/v3/groups/1ce9cbfb95194c628c270478e8f66a10 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:33.174894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a054663-239c-4605-99a9-ab18b8e2e23b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:33.186555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a054663-239c-4605-99a9-ab18b8e2e23b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:33.254268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0aef0-9821-49f8-892d-d0fb40469073 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:33.255091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0aef0-9821-49f8-892d-d0fb40469073 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:33.255376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0aef0-9821-49f8-892d-d0fb40469073 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:33.255656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0aef0-9821-49f8-892d-d0fb40469073 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/7def877677fb4d8cb979362e1ba45dfb` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:33.261438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0aef0-9821-49f8-892d-d0fb40469073 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:delete_group(group_id=7def877677fb4d8cb979362e1ba45dfb)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:33.263491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0aef0-9821-49f8-892d-d0fb40469073 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:33.309517 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4063/8088] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:39:33 2022] DELETE /identity/v3/groups/7def877677fb4d8cb979362e1ba45dfb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:33.315870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002f891-ea57-449e-a57a-6708a675df3b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:33.327676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002f891-ea57-449e-a57a-6708a675df3b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:33.392293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c710c9-a3bb-4288-afa4-d19e9b28d910 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:33.392966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c710c9-a3bb-4288-afa4-d19e9b28d910 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:33.393247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c710c9-a3bb-4288-afa4-d19e9b28d910 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:33.393558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c710c9-a3bb-4288-afa4-d19e9b28d910 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:33.394807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c710c9-a3bb-4288-afa4-d19e9b28d910 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:33.397653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c710c9-a3bb-4288-afa4-d19e9b28d910 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:33.426805 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4026/8089] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:33 2022] POST /identity/v3/users => generated 323 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:33.431238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0aef0-9821-49f8-892d-d0fb40469073 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:33.442416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0aef0-9821-49f8-892d-d0fb40469073 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:33.448424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a146c29-0de9-4426-8934-53a706c9ea8f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:33.449114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a146c29-0de9-4426-8934-53a706c9ea8f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:33.449405 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a146c29-0de9-4426-8934-53a706c9ea8f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:33.449840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a146c29-0de9-4426-8934-53a706c9ea8f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:33.450380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a146c29-0de9-4426-8934-53a706c9ea8f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:33.452355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a146c29-0de9-4426-8934-53a706c9ea8f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:33.467991 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4064/8090] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:39:33 2022] POST /identity/v3/groups => generated 326 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:33.473096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c710c9-a3bb-4288-afa4-d19e9b28d910 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:33.489679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c710c9-a3bb-4288-afa4-d19e9b28d910 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:33.496805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cbf52-2bde-4db8-848e-0e7583f76133 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:33.497713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cbf52-2bde-4db8-848e-0e7583f76133 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:33.497999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cbf52-2bde-4db8-848e-0e7583f76133 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:33.498277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cbf52-2bde-4db8-848e-0e7583f76133 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/67de90b35148426da03290ae474a1fef/users/2d244060abf44fb0ad4b26bc8f123850` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:33.517128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cbf52-2bde-4db8-848e-0e7583f76133 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=67de90b35148426da03290ae474a1fef, user_id=2d244060abf44fb0ad4b26bc8f123850)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:33.519155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cbf52-2bde-4db8-848e-0e7583f76133 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:33.548206 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4027/8091] 10.222.0.43 () {60 vars in 1359 bytes} [Sat Jul 2 21:39:33 2022] PUT /identity/v3/groups/67de90b35148426da03290ae474a1fef/users/2d244060abf44fb0ad4b26bc8f123850 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:33.553626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a146c29-0de9-4426-8934-53a706c9ea8f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:33.564401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a146c29-0de9-4426-8934-53a706c9ea8f tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:33.624325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969d584-69c2-4722-94df-cd1341896e98 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:33.624998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969d584-69c2-4722-94df-cd1341896e98 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:33.625284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969d584-69c2-4722-94df-cd1341896e98 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:33.625559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969d584-69c2-4722-94df-cd1341896e98 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:33.626243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969d584-69c2-4722-94df-cd1341896e98 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:33.628206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969d584-69c2-4722-94df-cd1341896e98 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:33.643473 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4065/8092] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:39:33 2022] POST /identity/v3/groups => generated 326 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:33.647869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cbf52-2bde-4db8-848e-0e7583f76133 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:33.659009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cbf52-2bde-4db8-848e-0e7583f76133 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:33.664780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a858ace-6484-4dd0-afb0-d63630cf8671 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:33.665829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a858ace-6484-4dd0-afb0-d63630cf8671 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:33.666189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a858ace-6484-4dd0-afb0-d63630cf8671 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:33.666570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a858ace-6484-4dd0-afb0-d63630cf8671 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/9bbe7a93045c4892901cc82c47ba2cde/users/2d244060abf44fb0ad4b26bc8f123850` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:33.673665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a858ace-6484-4dd0-afb0-d63630cf8671 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=9bbe7a93045c4892901cc82c47ba2cde, user_id=2d244060abf44fb0ad4b26bc8f123850)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:33.675593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a858ace-6484-4dd0-afb0-d63630cf8671 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:33.702564 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4028/8093] 10.222.0.43 () {60 vars in 1359 bytes} [Sat Jul 2 21:39:33 2022] PUT /identity/v3/groups/9bbe7a93045c4892901cc82c47ba2cde/users/2d244060abf44fb0ad4b26bc8f123850 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:33.706734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969d584-69c2-4722-94df-cd1341896e98 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:33.719044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969d584-69c2-4722-94df-cd1341896e98 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:33.723302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:33.781310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92397e0a-b0ff-421c-a5f8-63aab141831d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:33.782110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92397e0a-b0ff-421c-a5f8-63aab141831d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:33.782397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92397e0a-b0ff-421c-a5f8-63aab141831d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:33.782676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92397e0a-b0ff-421c-a5f8-63aab141831d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/users/2d244060abf44fb0ad4b26bc8f123850/groups` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:33.783955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92397e0a-b0ff-421c-a5f8-63aab141831d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=2d244060abf44fb0ad4b26bc8f123850)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:33.786130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92397e0a-b0ff-421c-a5f8-63aab141831d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:33.802108 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4066/8094] 10.222.0.43 () {58 vars in 1241 bytes} [Sat Jul 2 21:39:33 2022] GET /identity/v3/users/2d244060abf44fb0ad4b26bc8f123850/groups => generated 838 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:33.806514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a858ace-6484-4dd0-afb0-d63630cf8671 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:33.818352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a858ace-6484-4dd0-afb0-d63630cf8671 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:33.824617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59040750-7161-48af-a95a-3676acddcb89 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:33.825559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59040750-7161-48af-a95a-3676acddcb89 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:33.825843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59040750-7161-48af-a95a-3676acddcb89 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:33.826119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59040750-7161-48af-a95a-3676acddcb89 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/9bbe7a93045c4892901cc82c47ba2cde` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:33.827428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59040750-7161-48af-a95a-3676acddcb89 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9bbe7a93045c4892901cc82c47ba2cde)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:33.829409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59040750-7161-48af-a95a-3676acddcb89 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:33.879800 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4029/8095] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:39:33 2022] DELETE /identity/v3/groups/9bbe7a93045c4892901cc82c47ba2cde => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:33.884145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92397e0a-b0ff-421c-a5f8-63aab141831d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:33.894655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92397e0a-b0ff-421c-a5f8-63aab141831d tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:33.953581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175de3fa-6c22-4a0a-8ca6-779457f80847 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:33.954563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175de3fa-6c22-4a0a-8ca6-779457f80847 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:33.954850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175de3fa-6c22-4a0a-8ca6-779457f80847 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:33.955150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175de3fa-6c22-4a0a-8ca6-779457f80847 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/groups/67de90b35148426da03290ae474a1fef` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:33.956438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175de3fa-6c22-4a0a-8ca6-779457f80847 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:delete_group(group_id=67de90b35148426da03290ae474a1fef)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:33.958374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175de3fa-6c22-4a0a-8ca6-779457f80847 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:34.005350 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4067/8096] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:39:33 2022] DELETE /identity/v3/groups/67de90b35148426da03290ae474a1fef => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:34.009664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59040750-7161-48af-a95a-3676acddcb89 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:34.020642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59040750-7161-48af-a95a-3676acddcb89 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:34.038100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:34.087475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e0fc1-cf3b-406f-ad0f-eebca5d0cc6b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:34.088447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e0fc1-cf3b-406f-ad0f-eebca5d0cc6b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:34.088708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e0fc1-cf3b-406f-ad0f-eebca5d0cc6b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:34.089014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e0fc1-cf3b-406f-ad0f-eebca5d0cc6b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/users/2d244060abf44fb0ad4b26bc8f123850` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:34.090544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e0fc1-cf3b-406f-ad0f-eebca5d0cc6b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2d244060abf44fb0ad4b26bc8f123850)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:34.092526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e0fc1-cf3b-406f-ad0f-eebca5d0cc6b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:34.139043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee5e0fc1-cf3b-406f-ad0f-eebca5d0cc6b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d244060abf44fb0ad4b26bc8f123850'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.147249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee5e0fc1-cf3b-406f-ad0f-eebca5d0cc6b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d244060abf44fb0ad4b26bc8f123850'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.154276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee5e0fc1-cf3b-406f-ad0f-eebca5d0cc6b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d244060abf44fb0ad4b26bc8f123850'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.154993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee5e0fc1-cf3b-406f-ad0f-eebca5d0cc6b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d244060abf44fb0ad4b26bc8f123850'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.155679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee5e0fc1-cf3b-406f-ad0f-eebca5d0cc6b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d244060abf44fb0ad4b26bc8f123850'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.173358 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4030/8097] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:34 2022] DELETE /identity/v3/users/2d244060abf44fb0ad4b26bc8f123850 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:34.178646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175de3fa-6c22-4a0a-8ca6-779457f80847 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:34.180793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-175de3fa-6c22-4a0a-8ca6-779457f80847 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:34.194303 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175de3fa-6c22-4a0a-8ca6-779457f80847 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:34.245497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:34.254213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cf536-0d52-4700-9edc-9dff7f61f724 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:34.255092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cf536-0d52-4700-9edc-9dff7f61f724 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:34.255368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cf536-0d52-4700-9edc-9dff7f61f724 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:34.255629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cf536-0d52-4700-9edc-9dff7f61f724 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/domains/5ebf3203956748e19bfbd11cd04a739a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:34.256971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cf536-0d52-4700-9edc-9dff7f61f724 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5ebf3203956748e19bfbd11cd04a739a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:34.258619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cf536-0d52-4700-9edc-9dff7f61f724 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:34.278925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d75cf536-0d52-4700-9edc-9dff7f61f724 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5ebf3203956748e19bfbd11cd04a739a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.279664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d75cf536-0d52-4700-9edc-9dff7f61f724 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5ebf3203956748e19bfbd11cd04a739a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.308279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d75cf536-0d52-4700-9edc-9dff7f61f724 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5ebf3203956748e19bfbd11cd04a739a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.308860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d75cf536-0d52-4700-9edc-9dff7f61f724 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5ebf3203956748e19bfbd11cd04a739a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.311466 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4068/8098] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:39:34 2022] PATCH /identity/v3/domains/5ebf3203956748e19bfbd11cd04a739a => generated 277 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:34.315547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e0fc1-cf3b-406f-ad0f-eebca5d0cc6b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:34.326249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e0fc1-cf3b-406f-ad0f-eebca5d0cc6b tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:34.386975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f82e7-e101-4a61-ae24-83a1440cf748 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afea12e9555044e98a2314562f61c9e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72e3ff58a4e14d92ab919f86f3b5f533', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:34.387851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f82e7-e101-4a61-ae24-83a1440cf748 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:34.388165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f82e7-e101-4a61-ae24-83a1440cf748 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:34.388443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f82e7-e101-4a61-ae24-83a1440cf748 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] PATH_INFO: `/v3/domains/5ebf3203956748e19bfbd11cd04a739a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:34.399654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f82e7-e101-4a61-ae24-83a1440cf748 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5ebf3203956748e19bfbd11cd04a739a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:34.401274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f82e7-e101-4a61-ae24-83a1440cf748 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:34.424123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-154f82e7-e101-4a61-ae24-83a1440cf748 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5ebf3203956748e19bfbd11cd04a739a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.433934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-154f82e7-e101-4a61-ae24-83a1440cf748 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5ebf3203956748e19bfbd11cd04a739a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.435874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:34.483910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-154f82e7-e101-4a61-ae24-83a1440cf748 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ebf3203956748e19bfbd11cd04a739a', 'request_id': 'req-154f82e7-e101-4a61-ae24-83a1440cf748'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.490573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-154f82e7-e101-4a61-ae24-83a1440cf748 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ebf3203956748e19bfbd11cd04a739a', 'request_id': 'req-154f82e7-e101-4a61-ae24-83a1440cf748'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.496898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-154f82e7-e101-4a61-ae24-83a1440cf748 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ebf3203956748e19bfbd11cd04a739a', 'request_id': 'req-154f82e7-e101-4a61-ae24-83a1440cf748'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.509756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-154f82e7-e101-4a61-ae24-83a1440cf748 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] The token cache is being invalidate because project 5ebf3203956748e19bfbd11cd04a739a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:34.510039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-154f82e7-e101-4a61-ae24-83a1440cf748 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.510665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-154f82e7-e101-4a61-ae24-83a1440cf748 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.517973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-154f82e7-e101-4a61-ae24-83a1440cf748 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5ebf3203956748e19bfbd11cd04a739a', 'request_id': 'req-154f82e7-e101-4a61-ae24-83a1440cf748'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.518633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-154f82e7-e101-4a61-ae24-83a1440cf748 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5ebf3203956748e19bfbd11cd04a739a', 'request_id': 'req-154f82e7-e101-4a61-ae24-83a1440cf748'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.519240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-154f82e7-e101-4a61-ae24-83a1440cf748 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5ebf3203956748e19bfbd11cd04a739a', 'request_id': 'req-154f82e7-e101-4a61-ae24-83a1440cf748'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.527728 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4031/8099] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:39:34 2022] DELETE /identity/v3/domains/5ebf3203956748e19bfbd11cd04a739a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:34.532064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cf536-0d52-4700-9edc-9dff7f61f724 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:34.533691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d75cf536-0d52-4700-9edc-9dff7f61f724 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:34.604964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cf536-0d52-4700-9edc-9dff7f61f724 tempest-GroupsV3TestJSON-646277498 tempest-GroupsV3TestJSON-646277498-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:34.664786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2e683-22f1-4635-ac32-84280a77c511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:34.665680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2e683-22f1-4635-ac32-84280a77c511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:34.665964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2e683-22f1-4635-ac32-84280a77c511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:34.666241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2e683-22f1-4635-ac32-84280a77c511 admin admin] PATH_INFO: `/v3/users/8ec2918478754122b0061dbcabefc39a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:34.667623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2e683-22f1-4635-ac32-84280a77c511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec2918478754122b0061dbcabefc39a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:34.669768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2e683-22f1-4635-ac32-84280a77c511 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:34.720239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-15a2e683-22f1-4635-ac32-84280a77c511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec2918478754122b0061dbcabefc39a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.729102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-15a2e683-22f1-4635-ac32-84280a77c511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec2918478754122b0061dbcabefc39a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.729727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-15a2e683-22f1-4635-ac32-84280a77c511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec2918478754122b0061dbcabefc39a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.730377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-15a2e683-22f1-4635-ac32-84280a77c511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec2918478754122b0061dbcabefc39a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.739971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-15a2e683-22f1-4635-ac32-84280a77c511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec2918478754122b0061dbcabefc39a'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:34.745717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:34.761322 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4069/8100] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:34 2022] DELETE /identity/v3/users/8ec2918478754122b0061dbcabefc39a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:34.766406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fb70a-1ac6-4c7d-8708-9e1e05c5ca62 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:34.766696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fb70a-1ac6-4c7d-8708-9e1e05c5ca62 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:34.766972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fb70a-1ac6-4c7d-8708-9e1e05c5ca62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:34.785983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f85fb70a-1ac6-4c7d-8708-9e1e05c5ca62 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:34.791769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f85fb70a-1ac6-4c7d-8708-9e1e05c5ca62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:34.862163 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4032/8101] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:39:34.872246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2e683-22f1-4635-ac32-84280a77c511 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:34.874053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-15a2e683-22f1-4635-ac32-84280a77c511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:34.938968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2e683-22f1-4635-ac32-84280a77c511 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:34.943624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2757c-ef0b-4f8e-882d-153e6fcd0573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:34.944321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2757c-ef0b-4f8e-882d-153e6fcd0573 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:34.944602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2757c-ef0b-4f8e-882d-153e6fcd0573 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:34.944879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2757c-ef0b-4f8e-882d-153e6fcd0573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:34.954878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2757c-ef0b-4f8e-882d-153e6fcd0573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:34.956397 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2757c-ef0b-4f8e-882d-153e6fcd0573 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:34.966403 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4070/8102] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:39:35.250410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fb70a-1ac6-4c7d-8708-9e1e05c5ca62 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:35.251984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f85fb70a-1ac6-4c7d-8708-9e1e05c5ca62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:35.267525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fb70a-1ac6-4c7d-8708-9e1e05c5ca62 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:35.272729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ef621-08bb-49fa-9b77-e52e169059bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:35.273624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ef621-08bb-49fa-9b77-e52e169059bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:35.273983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ef621-08bb-49fa-9b77-e52e169059bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:35.274171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ef621-08bb-49fa-9b77-e52e169059bf admin admin] PATH_INFO: `/v3/projects/536b641553fe466cb76f21e40cdfff2b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:35.275430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ef621-08bb-49fa-9b77-e52e169059bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=536b641553fe466cb76f21e40cdfff2b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:35.277392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ef621-08bb-49fa-9b77-e52e169059bf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:35.327394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-551ef621-08bb-49fa-9b77-e52e169059bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536b641553fe466cb76f21e40cdfff2b', 'request_id': 'req-551ef621-08bb-49fa-9b77-e52e169059bf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:35.335018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-551ef621-08bb-49fa-9b77-e52e169059bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536b641553fe466cb76f21e40cdfff2b', 'request_id': 'req-551ef621-08bb-49fa-9b77-e52e169059bf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:35.341558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-551ef621-08bb-49fa-9b77-e52e169059bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536b641553fe466cb76f21e40cdfff2b', 'request_id': 'req-551ef621-08bb-49fa-9b77-e52e169059bf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:35.353987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:35.359033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-551ef621-08bb-49fa-9b77-e52e169059bf admin admin] The token cache is being invalidate because project 536b641553fe466cb76f21e40cdfff2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:35.359351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-551ef621-08bb-49fa-9b77-e52e169059bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:35.360400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-551ef621-08bb-49fa-9b77-e52e169059bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:35.362525 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4033/8103] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:39:35 2022] DELETE /identity/v3/projects/536b641553fe466cb76f21e40cdfff2b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:35.366656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2757c-ef0b-4f8e-882d-153e6fcd0573 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:35.377018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2757c-ef0b-4f8e-882d-153e6fcd0573 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:35.439637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9a4df-a83e-4d17-890e-5ddf598b7483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:35.440562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9a4df-a83e-4d17-890e-5ddf598b7483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:35.440875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9a4df-a83e-4d17-890e-5ddf598b7483 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:35.441175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9a4df-a83e-4d17-890e-5ddf598b7483 admin admin] PATH_INFO: `/v3/users/afea12e9555044e98a2314562f61c9e5` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:35.442373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9a4df-a83e-4d17-890e-5ddf598b7483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afea12e9555044e98a2314562f61c9e5)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:35.444387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9a4df-a83e-4d17-890e-5ddf598b7483 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:35.492418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1eb9a4df-a83e-4d17-890e-5ddf598b7483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afea12e9555044e98a2314562f61c9e5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:35.501070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1eb9a4df-a83e-4d17-890e-5ddf598b7483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afea12e9555044e98a2314562f61c9e5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:35.501831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1eb9a4df-a83e-4d17-890e-5ddf598b7483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afea12e9555044e98a2314562f61c9e5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:35.502452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1eb9a4df-a83e-4d17-890e-5ddf598b7483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afea12e9555044e98a2314562f61c9e5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:35.509486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1eb9a4df-a83e-4d17-890e-5ddf598b7483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afea12e9555044e98a2314562f61c9e5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:35.527424 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4071/8104] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:35 2022] DELETE /identity/v3/users/afea12e9555044e98a2314562f61c9e5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:35.810835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ef621-08bb-49fa-9b77-e52e169059bf admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:35.812777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-551ef621-08bb-49fa-9b77-e52e169059bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:35.836423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ef621-08bb-49fa-9b77-e52e169059bf admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:35.897622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3947f0c-b239-4d72-a8dd-f8bf91a348b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:35.898381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3947f0c-b239-4d72-a8dd-f8bf91a348b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:35.898668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3947f0c-b239-4d72-a8dd-f8bf91a348b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:35.898948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3947f0c-b239-4d72-a8dd-f8bf91a348b9 admin admin] PATH_INFO: `/v3/projects/72e3ff58a4e14d92ab919f86f3b5f533` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:35.900278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3947f0c-b239-4d72-a8dd-f8bf91a348b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e3ff58a4e14d92ab919f86f3b5f533)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:35.902252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3947f0c-b239-4d72-a8dd-f8bf91a348b9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:35.958636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b3947f0c-b239-4d72-a8dd-f8bf91a348b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e3ff58a4e14d92ab919f86f3b5f533', 'request_id': 'req-b3947f0c-b239-4d72-a8dd-f8bf91a348b9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:35.964892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b3947f0c-b239-4d72-a8dd-f8bf91a348b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e3ff58a4e14d92ab919f86f3b5f533', 'request_id': 'req-b3947f0c-b239-4d72-a8dd-f8bf91a348b9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:35.971380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b3947f0c-b239-4d72-a8dd-f8bf91a348b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e3ff58a4e14d92ab919f86f3b5f533', 'request_id': 'req-b3947f0c-b239-4d72-a8dd-f8bf91a348b9'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:35.986414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b3947f0c-b239-4d72-a8dd-f8bf91a348b9 admin admin] The token cache is being invalidate because project 72e3ff58a4e14d92ab919f86f3b5f533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:35.986708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b3947f0c-b239-4d72-a8dd-f8bf91a348b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:35.987387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b3947f0c-b239-4d72-a8dd-f8bf91a348b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:35.989096 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4034/8105] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:39:35 2022] DELETE /identity/v3/projects/72e3ff58a4e14d92ab919f86f3b5f533 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:35.994288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e863e3-8d73-4dcc-9792-4893b72e6c18 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:35.994793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e863e3-8d73-4dcc-9792-4893b72e6c18 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:35.994906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e863e3-8d73-4dcc-9792-4893b72e6c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:36.012872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a9e863e3-8d73-4dcc-9792-4893b72e6c18 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:36.014171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a9e863e3-8d73-4dcc-9792-4893b72e6c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:36.018613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:36.077957 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4072/8106] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:36.086151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a22373-3bd1-4e54-b46d-9cf4ca63f5f3 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:36.086471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a22373-3bd1-4e54-b46d-9cf4ca63f5f3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:36.086753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a22373-3bd1-4e54-b46d-9cf4ca63f5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:36.107316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-05a22373-3bd1-4e54-b46d-9cf4ca63f5f3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:36.108558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-05a22373-3bd1-4e54-b46d-9cf4ca63f5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:36.118277 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4035/8107] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:36.122987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e863e3-8d73-4dcc-9792-4893b72e6c18 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:36.133096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e863e3-8d73-4dcc-9792-4893b72e6c18 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:36.138350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4c5ad-df5e-4134-a5bc-35a0855228d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:36.139013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4c5ad-df5e-4134-a5bc-35a0855228d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:36.139286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4c5ad-df5e-4134-a5bc-35a0855228d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:36.139567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4c5ad-df5e-4134-a5bc-35a0855228d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:36.140313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4c5ad-df5e-4134-a5bc-35a0855228d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:39:36.140603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4c5ad-df5e-4134-a5bc-35a0855228d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:36.142195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4c5ad-df5e-4134-a5bc-35a0855228d1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:36.153971 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4073/8108] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:36.158400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a22373-3bd1-4e54-b46d-9cf4ca63f5f3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:36.168222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a22373-3bd1-4e54-b46d-9cf4ca63f5f3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:36.174382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ae034-16fc-4d74-a6b4-1036b5c0658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:36.175069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ae034-16fc-4d74-a6b4-1036b5c0658b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:36.175351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ae034-16fc-4d74-a6b4-1036b5c0658b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:36.175659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ae034-16fc-4d74-a6b4-1036b5c0658b admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:36.176386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ae034-16fc-4d74-a6b4-1036b5c0658b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:36.178289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ae034-16fc-4d74-a6b4-1036b5c0658b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:36.207505 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4036/8109] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:39:36 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:36.211967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4c5ad-df5e-4134-a5bc-35a0855228d1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:36.222695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4c5ad-df5e-4134-a5bc-35a0855228d1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:36.282811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba75c63-9126-4d12-b3a7-da430f7b8bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:36.283481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba75c63-9126-4d12-b3a7-da430f7b8bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:36.283761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba75c63-9126-4d12-b3a7-da430f7b8bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:36.284063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba75c63-9126-4d12-b3a7-da430f7b8bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:36.284720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba75c63-9126-4d12-b3a7-da430f7b8bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:36.286685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba75c63-9126-4d12-b3a7-da430f7b8bf0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:36.308783 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4074/8110] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:36 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:36.313205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ae034-16fc-4d74-a6b4-1036b5c0658b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:36.323609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ae034-16fc-4d74-a6b4-1036b5c0658b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:36.328815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f69126-960c-4a5b-9e33-c3c4cdbfb3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:36.329431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f69126-960c-4a5b-9e33-c3c4cdbfb3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:36.329733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f69126-960c-4a5b-9e33-c3c4cdbfb3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:36.330011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f69126-960c-4a5b-9e33-c3c4cdbfb3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:36.330717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f69126-960c-4a5b-9e33-c3c4cdbfb3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:36.332364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f69126-960c-4a5b-9e33-c3c4cdbfb3a4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:36.343259 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4037/8111] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:36.347387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba75c63-9126-4d12-b3a7-da430f7b8bf0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:36.358567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba75c63-9126-4d12-b3a7-da430f7b8bf0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:36.364647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8c7de-7a88-4a66-9dc8-fbb733df99b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:36.365322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8c7de-7a88-4a66-9dc8-fbb733df99b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:36.365608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8c7de-7a88-4a66-9dc8-fbb733df99b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:36.365909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8c7de-7a88-4a66-9dc8-fbb733df99b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:36.366629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8c7de-7a88-4a66-9dc8-fbb733df99b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:36.368311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8c7de-7a88-4a66-9dc8-fbb733df99b4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:36.379052 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4075/8112] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:36.383305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f69126-960c-4a5b-9e33-c3c4cdbfb3a4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:36.394516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f69126-960c-4a5b-9e33-c3c4cdbfb3a4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:36.402539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856fef5-d1ab-4cc2-ac93-c6a6aaec8cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:36.403893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856fef5-d1ab-4cc2-ac93-c6a6aaec8cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:36.404300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856fef5-d1ab-4cc2-ac93-c6a6aaec8cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:36.404492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856fef5-d1ab-4cc2-ac93-c6a6aaec8cf5 admin admin] PATH_INFO: `/v3/projects/b22b1038f68b40af8ba2563ab1b10b16/users/f495a407fe5b43688fbf153ebad32fb3/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:36.420324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856fef5-d1ab-4cc2-ac93-c6a6aaec8cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b22b1038f68b40af8ba2563ab1b10b16, user_id=f495a407fe5b43688fbf153ebad32fb3, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:36.423335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856fef5-d1ab-4cc2-ac93-c6a6aaec8cf5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:36.437140 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4038/8113] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:36 2022] PUT /identity/v3/projects/b22b1038f68b40af8ba2563ab1b10b16/users/f495a407fe5b43688fbf153ebad32fb3/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:36.449812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb572c-58c1-475a-a7db-0bf9e0500854 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:36.450167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb572c-58c1-475a-a7db-0bf9e0500854 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:36.450517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb572c-58c1-475a-a7db-0bf9e0500854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:36.483960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-53eb572c-58c1-475a-a7db-0bf9e0500854 None None] MFA Rules not processed for user `f495a407fe5b43688fbf153ebad32fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:36.485217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-53eb572c-58c1-475a-a7db-0bf9e0500854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:36.560676 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4076/8114] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:36.565371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856fef5-d1ab-4cc2-ac93-c6a6aaec8cf5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:36.596947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:36.632026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856fef5-d1ab-4cc2-ac93-c6a6aaec8cf5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:36.637219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169179f2-4010-47aa-a546-9e12342b4bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:36.637885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169179f2-4010-47aa-a546-9e12342b4bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:36.638197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169179f2-4010-47aa-a546-9e12342b4bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:36.638476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169179f2-4010-47aa-a546-9e12342b4bb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:36.639170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169179f2-4010-47aa-a546-9e12342b4bb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:36.641218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169179f2-4010-47aa-a546-9e12342b4bb1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:36.671305 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4039/8115] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:39:36 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:36.675943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb572c-58c1-475a-a7db-0bf9e0500854 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:36.683058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:36.688061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb572c-58c1-475a-a7db-0bf9e0500854 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:36.750160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95c4be-926f-490d-af2e-76341f316f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:36.750845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95c4be-926f-490d-af2e-76341f316f69 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:36.751128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95c4be-926f-490d-af2e-76341f316f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:36.751434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95c4be-926f-490d-af2e-76341f316f69 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:36.752196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95c4be-926f-490d-af2e-76341f316f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:36.754212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be95c4be-926f-490d-af2e-76341f316f69 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:36.778111 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4077/8116] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:36 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:36.782335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169179f2-4010-47aa-a546-9e12342b4bb1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:36.793317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169179f2-4010-47aa-a546-9e12342b4bb1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:36.799165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae0ffb-2af0-4565-b3a0-0dc816e636d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:36.799968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae0ffb-2af0-4565-b3a0-0dc816e636d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:36.800297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae0ffb-2af0-4565-b3a0-0dc816e636d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:36.800564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae0ffb-2af0-4565-b3a0-0dc816e636d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:36.801289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae0ffb-2af0-4565-b3a0-0dc816e636d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:36.802903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae0ffb-2af0-4565-b3a0-0dc816e636d5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:36.813919 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4040/8117] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:36.818267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95c4be-926f-490d-af2e-76341f316f69 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:36.829050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95c4be-926f-490d-af2e-76341f316f69 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:36.834092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21482ae-7c40-4562-801c-d28bbd89eaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:36.834987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21482ae-7c40-4562-801c-d28bbd89eaae admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:36.835274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21482ae-7c40-4562-801c-d28bbd89eaae admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:36.835539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21482ae-7c40-4562-801c-d28bbd89eaae admin admin] PATH_INFO: `/v3/projects/cca982e738804ea596ae3b811199373b/users/d548021b7e90470eb7442f5e54ca527c/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:36.850493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21482ae-7c40-4562-801c-d28bbd89eaae admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca982e738804ea596ae3b811199373b, user_id=d548021b7e90470eb7442f5e54ca527c, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:36.853282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21482ae-7c40-4562-801c-d28bbd89eaae admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:36.868644 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4078/8118] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:36 2022] PUT /identity/v3/projects/cca982e738804ea596ae3b811199373b/users/d548021b7e90470eb7442f5e54ca527c/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:36.872789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae0ffb-2af0-4565-b3a0-0dc816e636d5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:36.883409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae0ffb-2af0-4565-b3a0-0dc816e636d5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:36.950880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f5f33-257b-4b58-a10a-08a75d0403c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:36.951476 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f5f33-257b-4b58-a10a-08a75d0403c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:36.951755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f5f33-257b-4b58-a10a-08a75d0403c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:36.952030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f5f33-257b-4b58-a10a-08a75d0403c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:36.952782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f5f33-257b-4b58-a10a-08a75d0403c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:36.954391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f5f33-257b-4b58-a10a-08a75d0403c6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:36.964632 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4041/8119] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:36.968707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21482ae-7c40-4562-801c-d28bbd89eaae admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:36.979404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21482ae-7c40-4562-801c-d28bbd89eaae admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:36.984438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0e5c8-dcab-41bf-827a-f39894c250fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:36.985318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0e5c8-dcab-41bf-827a-f39894c250fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:36.985643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0e5c8-dcab-41bf-827a-f39894c250fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:36.985936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0e5c8-dcab-41bf-827a-f39894c250fb admin admin] PATH_INFO: `/v3/projects/cca982e738804ea596ae3b811199373b/users/d548021b7e90470eb7442f5e54ca527c/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:36.988088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0e5c8-dcab-41bf-827a-f39894c250fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca982e738804ea596ae3b811199373b, user_id=d548021b7e90470eb7442f5e54ca527c, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:36.990786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0e5c8-dcab-41bf-827a-f39894c250fb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:37.002901 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4079/8120] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:36 2022] PUT /identity/v3/projects/cca982e738804ea596ae3b811199373b/users/d548021b7e90470eb7442f5e54ca527c/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:37.013393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5315c7-1994-47a8-a523-f5cfc96b63f9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.013681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5315c7-1994-47a8-a523-f5cfc96b63f9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.013952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5315c7-1994-47a8-a523-f5cfc96b63f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.042027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2d5315c7-1994-47a8-a523-f5cfc96b63f9 None None] MFA Rules not processed for user `d548021b7e90470eb7442f5e54ca527c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:37.043283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2d5315c7-1994-47a8-a523-f5cfc96b63f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:37.115299 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4042/8121] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:37.120678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0e5c8-dcab-41bf-827a-f39894c250fb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:37.131667 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0e5c8-dcab-41bf-827a-f39894c250fb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:37.136505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458ea78-a15b-4d2c-94f8-64342cc26069 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd548021b7e90470eb7442f5e54ca527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cca982e738804ea596ae3b811199373b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:37.137146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458ea78-a15b-4d2c-94f8-64342cc26069 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.137434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458ea78-a15b-4d2c-94f8-64342cc26069 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.137717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458ea78-a15b-4d2c-94f8-64342cc26069 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.138502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458ea78-a15b-4d2c-94f8-64342cc26069 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:37.139539 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-1458ea78-a15b-4d2c-94f8-64342cc26069 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:37.139539 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:37.139539 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:37.140461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458ea78-a15b-4d2c-94f8-64342cc26069 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:37.156993 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4080/8122] 10.222.0.43 () {60 vars in 1184 bytes} [Sat Jul 2 21:39:37 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:37.161313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5315c7-1994-47a8-a523-f5cfc96b63f9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:37.171280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5315c7-1994-47a8-a523-f5cfc96b63f9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:37.177245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cba46-56c3-41d0-be68-f78ffe57b952 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd548021b7e90470eb7442f5e54ca527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cca982e738804ea596ae3b811199373b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:37.178094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cba46-56c3-41d0-be68-f78ffe57b952 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.178381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cba46-56c3-41d0-be68-f78ffe57b952 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.178663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cba46-56c3-41d0-be68-f78ffe57b952 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a90e6675063a47cbb8c24dc8bebf459b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.179324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cba46-56c3-41d0-be68-f78ffe57b952 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=a90e6675063a47cbb8c24dc8bebf459b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:37.180396 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-3d2cba46-56c3-41d0-be68-f78ffe57b952 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:37.180396 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:37.180396 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:37.181290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cba46-56c3-41d0-be68-f78ffe57b952 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:37.188435 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4043/8123] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:39:37 2022] GET /identity/v3/OS-OAUTH1/consumers/a90e6675063a47cbb8c24dc8bebf459b => generated 221 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:37.192424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458ea78-a15b-4d2c-94f8-64342cc26069 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:37.202898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458ea78-a15b-4d2c-94f8-64342cc26069 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:37.208110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662d091-4294-4b38-9143-81a5bcbf4c46 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd548021b7e90470eb7442f5e54ca527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cca982e738804ea596ae3b811199373b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:37.208966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662d091-4294-4b38-9143-81a5bcbf4c46 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.209257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662d091-4294-4b38-9143-81a5bcbf4c46 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.209568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662d091-4294-4b38-9143-81a5bcbf4c46 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a90e6675063a47cbb8c24dc8bebf459b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.210226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662d091-4294-4b38-9143-81a5bcbf4c46 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a90e6675063a47cbb8c24dc8bebf459b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:37.211256 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-a662d091-4294-4b38-9143-81a5bcbf4c46 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:37.211256 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:37.211256 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:37.212179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662d091-4294-4b38-9143-81a5bcbf4c46 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:37.212454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a662d091-4294-4b38-9143-81a5bcbf4c46 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invalidating token cache because consumer a90e6675063a47cbb8c24dc8bebf459b has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:37.212734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a662d091-4294-4b38-9143-81a5bcbf4c46 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:37.213535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a662d091-4294-4b38-9143-81a5bcbf4c46 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:37.234558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a662d091-4294-4b38-9143-81a5bcbf4c46 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'a90e6675063a47cbb8c24dc8bebf459b', 'request_id': 'req-a662d091-4294-4b38-9143-81a5bcbf4c46'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:37.248178 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4081/8124] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:39:37 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a90e6675063a47cbb8c24dc8bebf459b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:37.253268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cba46-56c3-41d0-be68-f78ffe57b952 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:37.255068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3d2cba46-56c3-41d0-be68-f78ffe57b952 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:37.269225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cba46-56c3-41d0-be68-f78ffe57b952 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:37.275151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588998f-78f4-4938-88e6-3013d234cdf4 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd548021b7e90470eb7442f5e54ca527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cca982e738804ea596ae3b811199373b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:37.275797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588998f-78f4-4938-88e6-3013d234cdf4 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.276083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588998f-78f4-4938-88e6-3013d234cdf4 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.276393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588998f-78f4-4938-88e6-3013d234cdf4 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.277120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588998f-78f4-4938-88e6-3013d234cdf4 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:37.278140 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-8588998f-78f4-4938-88e6-3013d234cdf4 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:37.278140 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:37.278140 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:37.279082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588998f-78f4-4938-88e6-3013d234cdf4 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:37.290510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:37.297193 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4044/8125] 10.222.0.43 () {60 vars in 1184 bytes} [Sat Jul 2 21:39:37 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:37.302422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662d091-4294-4b38-9143-81a5bcbf4c46 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:37.312744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662d091-4294-4b38-9143-81a5bcbf4c46 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:37.318174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc7b8e-5bc0-423e-a929-ea3741062fb0 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd548021b7e90470eb7442f5e54ca527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cca982e738804ea596ae3b811199373b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:37.319006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc7b8e-5bc0-423e-a929-ea3741062fb0 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.319292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc7b8e-5bc0-423e-a929-ea3741062fb0 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.319567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc7b8e-5bc0-423e-a929-ea3741062fb0 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d157404d99ec48718e264741d21b3193` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.320257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc7b8e-5bc0-423e-a929-ea3741062fb0 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=d157404d99ec48718e264741d21b3193)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:37.321298 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-66dc7b8e-5bc0-423e-a929-ea3741062fb0 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:37.321298 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:37.321298 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:37.322202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc7b8e-5bc0-423e-a929-ea3741062fb0 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:37.327240 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4082/8126] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:39:37 2022] GET /identity/v3/OS-OAUTH1/consumers/d157404d99ec48718e264741d21b3193 => generated 220 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:37.331291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588998f-78f4-4938-88e6-3013d234cdf4 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:37.342233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588998f-78f4-4938-88e6-3013d234cdf4 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:37.348330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb691c-9ffe-4cfe-b71a-075bfd0a8029 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd548021b7e90470eb7442f5e54ca527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cca982e738804ea596ae3b811199373b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:37.349165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb691c-9ffe-4cfe-b71a-075bfd0a8029 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.349457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb691c-9ffe-4cfe-b71a-075bfd0a8029 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.349739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb691c-9ffe-4cfe-b71a-075bfd0a8029 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d157404d99ec48718e264741d21b3193` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.350668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb691c-9ffe-4cfe-b71a-075bfd0a8029 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=d157404d99ec48718e264741d21b3193)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:37.351444 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-5eeb691c-9ffe-4cfe-b71a-075bfd0a8029 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:37.351444 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:37.351444 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:37.352366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb691c-9ffe-4cfe-b71a-075bfd0a8029 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:37.352639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5eeb691c-9ffe-4cfe-b71a-075bfd0a8029 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invalidating token cache because consumer d157404d99ec48718e264741d21b3193 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:37.352916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5eeb691c-9ffe-4cfe-b71a-075bfd0a8029 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:37.353692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5eeb691c-9ffe-4cfe-b71a-075bfd0a8029 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:37.373279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5eeb691c-9ffe-4cfe-b71a-075bfd0a8029 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'd157404d99ec48718e264741d21b3193', 'request_id': 'req-5eeb691c-9ffe-4cfe-b71a-075bfd0a8029'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:37.387179 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4045/8127] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:39:37 2022] DELETE /identity/v3/OS-OAUTH1/consumers/d157404d99ec48718e264741d21b3193 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:39:37.391508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc7b8e-5bc0-423e-a929-ea3741062fb0 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:37.393347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-66dc7b8e-5bc0-423e-a929-ea3741062fb0 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:37.407219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc7b8e-5bc0-423e-a929-ea3741062fb0 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:37.412674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93846a1-3c85-414b-8163-58e38c31fee2 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd548021b7e90470eb7442f5e54ca527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cca982e738804ea596ae3b811199373b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:37.413537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93846a1-3c85-414b-8163-58e38c31fee2 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.413835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93846a1-3c85-414b-8163-58e38c31fee2 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.414113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93846a1-3c85-414b-8163-58e38c31fee2 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d157404d99ec48718e264741d21b3193` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.414765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93846a1-3c85-414b-8163-58e38c31fee2 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=d157404d99ec48718e264741d21b3193)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:37.416428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93846a1-3c85-414b-8163-58e38c31fee2 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:37.444591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-b93846a1-3c85-414b-8163-58e38c31fee2 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jul 02 21:39:37.444591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:37.444591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:39:37.444591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:39:37.444591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:39:37.444591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:39:37.444591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:39:37.444591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:39:37.444591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:39:37.444591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:39:37.444591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:39:37.444591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:39:37.444591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Jul 02 21:39:37.444591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Jul 02 21:39:37.444591 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Jul 02 21:39:37.445891 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Jul 02 21:39:37.445891 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Jul 02 21:39:37.445891 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Jul 02 21:39:37.445891 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Jul 02 21:39:37.445891 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jul 02 21:39:37.445891 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jul 02 21:39:37.445891 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jul 02 21:39:37.445891 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jul 02 21:39:37.445891 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:39:37.445891 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4083/8128] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:39:37 2022] GET /identity/v3/OS-OAUTH1/consumers/d157404d99ec48718e264741d21b3193 => generated 74 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 21:39:37.449995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb691c-9ffe-4cfe-b71a-075bfd0a8029 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:37.460503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb691c-9ffe-4cfe-b71a-075bfd0a8029 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:37.465634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49f01f-24e3-4d60-b36c-4d984b7dcd3f tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd548021b7e90470eb7442f5e54ca527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cca982e738804ea596ae3b811199373b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:37.466487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49f01f-24e3-4d60-b36c-4d984b7dcd3f tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.466783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49f01f-24e3-4d60-b36c-4d984b7dcd3f tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.467057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49f01f-24e3-4d60-b36c-4d984b7dcd3f tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d157404d99ec48718e264741d21b3193` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.467720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49f01f-24e3-4d60-b36c-4d984b7dcd3f tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=d157404d99ec48718e264741d21b3193)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:37.469378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49f01f-24e3-4d60-b36c-4d984b7dcd3f tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:37.469654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1d49f01f-24e3-4d60-b36c-4d984b7dcd3f tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invalidating token cache because consumer d157404d99ec48718e264741d21b3193 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:37.469939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1d49f01f-24e3-4d60-b36c-4d984b7dcd3f tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:37.470651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1d49f01f-24e3-4d60-b36c-4d984b7dcd3f tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:37.494498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-1d49f01f-24e3-4d60-b36c-4d984b7dcd3f tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jul 02 21:39:37.494498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:37.494498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:39:37.494498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:39:37.494498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:39:37.494498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:39:37.494498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:39:37.494498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:39:37.494498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:39:37.494498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:39:37.494498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:39:37.494498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:39:37.494498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Jul 02 21:39:37.494498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Jul 02 21:39:37.494498 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:37.495816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:37.495816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Jul 02 21:39:37.495816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Jul 02 21:39:37.495816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Jul 02 21:39:37.495816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Jul 02 21:39:37.495816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Jul 02 21:39:37.495816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jul 02 21:39:37.495816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jul 02 21:39:37.495816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jul 02 21:39:37.495816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jul 02 21:39:37.495816 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:39:37.495816 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4046/8129] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:39:37 2022] DELETE /identity/v3/OS-OAUTH1/consumers/d157404d99ec48718e264741d21b3193 => generated 74 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 21:39:37.500691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93846a1-3c85-414b-8163-58e38c31fee2 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:37.502557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b93846a1-3c85-414b-8163-58e38c31fee2 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:37.516282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93846a1-3c85-414b-8163-58e38c31fee2 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:37.521674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f81dd-ac48-4e2f-abf7-e9cfd388fa3d tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd548021b7e90470eb7442f5e54ca527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cca982e738804ea596ae3b811199373b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:37.522382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f81dd-ac48-4e2f-abf7-e9cfd388fa3d tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.522645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f81dd-ac48-4e2f-abf7-e9cfd388fa3d tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.522926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f81dd-ac48-4e2f-abf7-e9cfd388fa3d tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.523655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f81dd-ac48-4e2f-abf7-e9cfd388fa3d tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:37.525330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f81dd-ac48-4e2f-abf7-e9cfd388fa3d tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:37.540559 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4084/8130] 10.222.0.43 () {60 vars in 1184 bytes} [Sat Jul 2 21:39:37 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:39:37.544510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49f01f-24e3-4d60-b36c-4d984b7dcd3f tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:37.555173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49f01f-24e3-4d60-b36c-4d984b7dcd3f tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:37.560073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febe480-f8fc-4d0f-a379-19eb67ea2a2a tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd548021b7e90470eb7442f5e54ca527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cca982e738804ea596ae3b811199373b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:37.560713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febe480-f8fc-4d0f-a379-19eb67ea2a2a tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.560985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febe480-f8fc-4d0f-a379-19eb67ea2a2a tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.561266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febe480-f8fc-4d0f-a379-19eb67ea2a2a tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.561979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febe480-f8fc-4d0f-a379-19eb67ea2a2a tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:37.563562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febe480-f8fc-4d0f-a379-19eb67ea2a2a tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:37.578808 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4047/8131] 10.222.0.43 () {60 vars in 1184 bytes} [Sat Jul 2 21:39:37 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:37.582365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f81dd-ac48-4e2f-abf7-e9cfd388fa3d tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:37.593645 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f81dd-ac48-4e2f-abf7-e9cfd388fa3d tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:37.599351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d499678-f74b-4710-872b-8e1f240ab3be tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd548021b7e90470eb7442f5e54ca527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cca982e738804ea596ae3b811199373b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:37.600174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d499678-f74b-4710-872b-8e1f240ab3be tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.600453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d499678-f74b-4710-872b-8e1f240ab3be tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.600730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d499678-f74b-4710-872b-8e1f240ab3be tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.601353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d499678-f74b-4710-872b-8e1f240ab3be tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:37.602384 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-3d499678-f74b-4710-872b-8e1f240ab3be tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:37.602384 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:37.602384 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:37.603261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d499678-f74b-4710-872b-8e1f240ab3be tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:37.609467 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4085/8132] 10.222.0.43 () {58 vars in 1163 bytes} [Sat Jul 2 21:39:37 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:37.613498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febe480-f8fc-4d0f-a379-19eb67ea2a2a tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:37.624177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febe480-f8fc-4d0f-a379-19eb67ea2a2a tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:37.630072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c257589-cc90-4205-84e4-d49f29e97b34 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd548021b7e90470eb7442f5e54ca527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cca982e738804ea596ae3b811199373b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:37.630888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c257589-cc90-4205-84e4-d49f29e97b34 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.631168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c257589-cc90-4205-84e4-d49f29e97b34 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.631442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c257589-cc90-4205-84e4-d49f29e97b34 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/dc5e0912b0694e30931ccce7460887d2` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.632120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c257589-cc90-4205-84e4-d49f29e97b34 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=dc5e0912b0694e30931ccce7460887d2)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:37.633711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c257589-cc90-4205-84e4-d49f29e97b34 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:37.633978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5c257589-cc90-4205-84e4-d49f29e97b34 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invalidating token cache because consumer dc5e0912b0694e30931ccce7460887d2 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:37.634249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5c257589-cc90-4205-84e4-d49f29e97b34 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:37.635110 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5c257589-cc90-4205-84e4-d49f29e97b34 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:37.648452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5c257589-cc90-4205-84e4-d49f29e97b34 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'dc5e0912b0694e30931ccce7460887d2', 'request_id': 'req-5c257589-cc90-4205-84e4-d49f29e97b34'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:37.662843 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4048/8133] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:39:37 2022] DELETE /identity/v3/OS-OAUTH1/consumers/dc5e0912b0694e30931ccce7460887d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:39:37.667099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d499678-f74b-4710-872b-8e1f240ab3be tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:37.668968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3d499678-f74b-4710-872b-8e1f240ab3be tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:37.683333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d499678-f74b-4710-872b-8e1f240ab3be tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:37.689168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bba75-3732-4273-bb2d-f4e7b62fffca tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd548021b7e90470eb7442f5e54ca527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cca982e738804ea596ae3b811199373b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:37.689994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bba75-3732-4273-bb2d-f4e7b62fffca tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.690285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bba75-3732-4273-bb2d-f4e7b62fffca tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.690565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bba75-3732-4273-bb2d-f4e7b62fffca tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8265209e1e4945a28f58a2e879cfc43f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.691221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bba75-3732-4273-bb2d-f4e7b62fffca tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=8265209e1e4945a28f58a2e879cfc43f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:37.692885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bba75-3732-4273-bb2d-f4e7b62fffca tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:37.693158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-084bba75-3732-4273-bb2d-f4e7b62fffca tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invalidating token cache because consumer 8265209e1e4945a28f58a2e879cfc43f has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:37.693432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-084bba75-3732-4273-bb2d-f4e7b62fffca tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:37.694222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-084bba75-3732-4273-bb2d-f4e7b62fffca tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:37.706183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-084bba75-3732-4273-bb2d-f4e7b62fffca tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '8265209e1e4945a28f58a2e879cfc43f', 'request_id': 'req-084bba75-3732-4273-bb2d-f4e7b62fffca'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:37.720915 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4086/8134] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:39:37 2022] DELETE /identity/v3/OS-OAUTH1/consumers/8265209e1e4945a28f58a2e879cfc43f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:37.726228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c257589-cc90-4205-84e4-d49f29e97b34 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:37.738972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c257589-cc90-4205-84e4-d49f29e97b34 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:37.747222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794b101-1b93-49ad-93db-f20352ebddd3 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd548021b7e90470eb7442f5e54ca527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cca982e738804ea596ae3b811199373b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:37.748289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794b101-1b93-49ad-93db-f20352ebddd3 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.748661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794b101-1b93-49ad-93db-f20352ebddd3 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.749034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794b101-1b93-49ad-93db-f20352ebddd3 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.750031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794b101-1b93-49ad-93db-f20352ebddd3 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:37.752486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794b101-1b93-49ad-93db-f20352ebddd3 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:37.770170 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4049/8135] 10.222.0.43 () {60 vars in 1184 bytes} [Sat Jul 2 21:39:37 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:39:37.775207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bba75-3732-4273-bb2d-f4e7b62fffca tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:37.776739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-084bba75-3732-4273-bb2d-f4e7b62fffca tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:37.790810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bba75-3732-4273-bb2d-f4e7b62fffca tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:37.796849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342ee46-1fc9-4cd0-85ee-07663d9051a5 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd548021b7e90470eb7442f5e54ca527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cca982e738804ea596ae3b811199373b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:37.798004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342ee46-1fc9-4cd0-85ee-07663d9051a5 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.798313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342ee46-1fc9-4cd0-85ee-07663d9051a5 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.798590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342ee46-1fc9-4cd0-85ee-07663d9051a5 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/02425863e8c64acda811407abfdb92f7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.799298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342ee46-1fc9-4cd0-85ee-07663d9051a5 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=02425863e8c64acda811407abfdb92f7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:37.800474 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-d342ee46-1fc9-4cd0-85ee-07663d9051a5 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:37.800474 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:37.800474 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:37.801518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342ee46-1fc9-4cd0-85ee-07663d9051a5 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:37.806847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=86,keystone:INSERT=9,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:37.822015 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4087/8136] 10.222.0.43 () {60 vars in 1284 bytes} [Sat Jul 2 21:39:37 2022] PATCH /identity/v3/OS-OAUTH1/consumers/02425863e8c64acda811407abfdb92f7 => generated 221 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:37.825797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794b101-1b93-49ad-93db-f20352ebddd3 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:37.836688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794b101-1b93-49ad-93db-f20352ebddd3 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:37.842300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccae2f-09bc-4154-8f7c-b42e0c4ea60e tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd548021b7e90470eb7442f5e54ca527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cca982e738804ea596ae3b811199373b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:37.843136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccae2f-09bc-4154-8f7c-b42e0c4ea60e tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.843426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccae2f-09bc-4154-8f7c-b42e0c4ea60e tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.843710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccae2f-09bc-4154-8f7c-b42e0c4ea60e tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/02425863e8c64acda811407abfdb92f7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.844380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccae2f-09bc-4154-8f7c-b42e0c4ea60e tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=02425863e8c64acda811407abfdb92f7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:37.845976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccae2f-09bc-4154-8f7c-b42e0c4ea60e tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:37.850742 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4050/8137] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:39:37 2022] GET /identity/v3/OS-OAUTH1/consumers/02425863e8c64acda811407abfdb92f7 => generated 221 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:37.854906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342ee46-1fc9-4cd0-85ee-07663d9051a5 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:37.866506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342ee46-1fc9-4cd0-85ee-07663d9051a5 tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:37.871786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5213d-aaf6-488f-bdd0-9f42b823f94d tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd548021b7e90470eb7442f5e54ca527c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cca982e738804ea596ae3b811199373b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:37.872837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5213d-aaf6-488f-bdd0-9f42b823f94d tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.873131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5213d-aaf6-488f-bdd0-9f42b823f94d tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.873410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5213d-aaf6-488f-bdd0-9f42b823f94d tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/02425863e8c64acda811407abfdb92f7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.874060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5213d-aaf6-488f-bdd0-9f42b823f94d tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=02425863e8c64acda811407abfdb92f7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:37.875686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5213d-aaf6-488f-bdd0-9f42b823f94d tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:37.875973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d3b5213d-aaf6-488f-bdd0-9f42b823f94d tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invalidating token cache because consumer 02425863e8c64acda811407abfdb92f7 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:37.876298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d3b5213d-aaf6-488f-bdd0-9f42b823f94d tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:37.876990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d3b5213d-aaf6-488f-bdd0-9f42b823f94d tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:37.889759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d3b5213d-aaf6-488f-bdd0-9f42b823f94d tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '02425863e8c64acda811407abfdb92f7', 'request_id': 'req-d3b5213d-aaf6-488f-bdd0-9f42b823f94d'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:37.902898 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4088/8138] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:39:37 2022] DELETE /identity/v3/OS-OAUTH1/consumers/02425863e8c64acda811407abfdb92f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:37.907968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccae2f-09bc-4154-8f7c-b42e0c4ea60e tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:37.909973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-36ccae2f-09bc-4154-8f7c-b42e0c4ea60e tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:37.981125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccae2f-09bc-4154-8f7c-b42e0c4ea60e tempest-OAUTHConsumersV3Test-1187092788 tempest-OAUTHConsumersV3Test-1187092788-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:37.986312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e0792-47ac-4712-bdbd-d3a26cee2719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:37.987194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e0792-47ac-4712-bdbd-d3a26cee2719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:37.987474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e0792-47ac-4712-bdbd-d3a26cee2719 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:37.987743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e0792-47ac-4712-bdbd-d3a26cee2719 admin admin] PATH_INFO: `/v3/users/f495a407fe5b43688fbf153ebad32fb3` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:37.989022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e0792-47ac-4712-bdbd-d3a26cee2719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f495a407fe5b43688fbf153ebad32fb3)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:37.990949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e0792-47ac-4712-bdbd-d3a26cee2719 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:38.041771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5f3e0792-47ac-4712-bdbd-d3a26cee2719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f495a407fe5b43688fbf153ebad32fb3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:38.050753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5f3e0792-47ac-4712-bdbd-d3a26cee2719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f495a407fe5b43688fbf153ebad32fb3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:38.056673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:38.058763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5f3e0792-47ac-4712-bdbd-d3a26cee2719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f495a407fe5b43688fbf153ebad32fb3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:38.059572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5f3e0792-47ac-4712-bdbd-d3a26cee2719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f495a407fe5b43688fbf153ebad32fb3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:38.060733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5f3e0792-47ac-4712-bdbd-d3a26cee2719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f495a407fe5b43688fbf153ebad32fb3'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:38.078718 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4051/8139] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:37 2022] DELETE /identity/v3/users/f495a407fe5b43688fbf153ebad32fb3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:38.083449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111f5dd-f8e4-4b96-a45e-d29e85946c56 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:38.083941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111f5dd-f8e4-4b96-a45e-d29e85946c56 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:38.084068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111f5dd-f8e4-4b96-a45e-d29e85946c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:38.103269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1111f5dd-f8e4-4b96-a45e-d29e85946c56 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:38.104538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1111f5dd-f8e4-4b96-a45e-d29e85946c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:38.167600 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4089/8140] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:38.178157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e0792-47ac-4712-bdbd-d3a26cee2719 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:38.179713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5f3e0792-47ac-4712-bdbd-d3a26cee2719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:38.242752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e0792-47ac-4712-bdbd-d3a26cee2719 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:38.246728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a6fca-be86-4b4c-9fb9-fbf9021cc91b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:38.247427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a6fca-be86-4b4c-9fb9-fbf9021cc91b service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:38.247708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a6fca-be86-4b4c-9fb9-fbf9021cc91b service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:38.247989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a6fca-be86-4b4c-9fb9-fbf9021cc91b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:38.257455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a6fca-be86-4b4c-9fb9-fbf9021cc91b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:38.258993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a6fca-be86-4b4c-9fb9-fbf9021cc91b service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:38.268659 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4052/8141] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:39:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:39:38.572752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111f5dd-f8e4-4b96-a45e-d29e85946c56 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:38.574301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1111f5dd-f8e4-4b96-a45e-d29e85946c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:38.588439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111f5dd-f8e4-4b96-a45e-d29e85946c56 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:38.593892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6a799-8946-40c7-b9ea-71b029e465de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:38.594893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6a799-8946-40c7-b9ea-71b029e465de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:38.595187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6a799-8946-40c7-b9ea-71b029e465de admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:38.595761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6a799-8946-40c7-b9ea-71b029e465de admin admin] PATH_INFO: `/v3/projects/b22b1038f68b40af8ba2563ab1b10b16` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:38.596792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6a799-8946-40c7-b9ea-71b029e465de admin admin] RBAC: Authorizing `identity:delete_project(project_id=b22b1038f68b40af8ba2563ab1b10b16)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:38.598751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6a799-8946-40c7-b9ea-71b029e465de admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:38.647073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-30f6a799-8946-40c7-b9ea-71b029e465de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b22b1038f68b40af8ba2563ab1b10b16', 'request_id': 'req-30f6a799-8946-40c7-b9ea-71b029e465de'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:38.655450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-30f6a799-8946-40c7-b9ea-71b029e465de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b22b1038f68b40af8ba2563ab1b10b16', 'request_id': 'req-30f6a799-8946-40c7-b9ea-71b029e465de'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:38.662116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-30f6a799-8946-40c7-b9ea-71b029e465de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b22b1038f68b40af8ba2563ab1b10b16', 'request_id': 'req-30f6a799-8946-40c7-b9ea-71b029e465de'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:38.673488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-30f6a799-8946-40c7-b9ea-71b029e465de admin admin] The token cache is being invalidate because project b22b1038f68b40af8ba2563ab1b10b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:38.673781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-30f6a799-8946-40c7-b9ea-71b029e465de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:38.674509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-30f6a799-8946-40c7-b9ea-71b029e465de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:38.676212 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4090/8142] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:39:38 2022] DELETE /identity/v3/projects/b22b1038f68b40af8ba2563ab1b10b16 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:38.680604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a6fca-be86-4b4c-9fb9-fbf9021cc91b service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:38.691651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a6fca-be86-4b4c-9fb9-fbf9021cc91b service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:38.750359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f61f01-f07d-454d-bb6b-d0043c544723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:38.751164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f61f01-f07d-454d-bb6b-d0043c544723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:38.751444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f61f01-f07d-454d-bb6b-d0043c544723 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:38.751719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f61f01-f07d-454d-bb6b-d0043c544723 admin admin] PATH_INFO: `/v3/users/d548021b7e90470eb7442f5e54ca527c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:38.752965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f61f01-f07d-454d-bb6b-d0043c544723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d548021b7e90470eb7442f5e54ca527c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:38.754903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f61f01-f07d-454d-bb6b-d0043c544723 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:38.805488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-80f61f01-f07d-454d-bb6b-d0043c544723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd548021b7e90470eb7442f5e54ca527c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:38.813062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-80f61f01-f07d-454d-bb6b-d0043c544723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd548021b7e90470eb7442f5e54ca527c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:38.820179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-80f61f01-f07d-454d-bb6b-d0043c544723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd548021b7e90470eb7442f5e54ca527c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:38.820811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-80f61f01-f07d-454d-bb6b-d0043c544723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd548021b7e90470eb7442f5e54ca527c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:38.821610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-80f61f01-f07d-454d-bb6b-d0043c544723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd548021b7e90470eb7442f5e54ca527c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:38.834786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:38.839344 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4053/8143] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:38 2022] DELETE /identity/v3/users/d548021b7e90470eb7442f5e54ca527c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:39.122258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6a799-8946-40c7-b9ea-71b029e465de admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:39.124059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-30f6a799-8946-40c7-b9ea-71b029e465de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:39.138081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6a799-8946-40c7-b9ea-71b029e465de admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:39.186301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:39.198360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ec578-7d06-4fa3-a3b9-55b7abf23ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:39.199283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ec578-7d06-4fa3-a3b9-55b7abf23ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:39.199881 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ec578-7d06-4fa3-a3b9-55b7abf23ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:39.200273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ec578-7d06-4fa3-a3b9-55b7abf23ec8 admin admin] PATH_INFO: `/v3/projects/cca982e738804ea596ae3b811199373b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:39.201581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ec578-7d06-4fa3-a3b9-55b7abf23ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cca982e738804ea596ae3b811199373b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:39.203513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ec578-7d06-4fa3-a3b9-55b7abf23ec8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:39.250224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2e8ec578-7d06-4fa3-a3b9-55b7abf23ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cca982e738804ea596ae3b811199373b', 'request_id': 'req-2e8ec578-7d06-4fa3-a3b9-55b7abf23ec8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:39.258510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2e8ec578-7d06-4fa3-a3b9-55b7abf23ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cca982e738804ea596ae3b811199373b', 'request_id': 'req-2e8ec578-7d06-4fa3-a3b9-55b7abf23ec8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:39.264861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2e8ec578-7d06-4fa3-a3b9-55b7abf23ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cca982e738804ea596ae3b811199373b', 'request_id': 'req-2e8ec578-7d06-4fa3-a3b9-55b7abf23ec8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:39.274942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2e8ec578-7d06-4fa3-a3b9-55b7abf23ec8 admin admin] The token cache is being invalidate because project cca982e738804ea596ae3b811199373b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:39.275228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2e8ec578-7d06-4fa3-a3b9-55b7abf23ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:39.275855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2e8ec578-7d06-4fa3-a3b9-55b7abf23ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:39.277418 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4091/8144] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:39:39 2022] DELETE /identity/v3/projects/cca982e738804ea596ae3b811199373b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:39.282521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c24f9-a390-4715-9353-60652a7695b8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:39.282812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c24f9-a390-4715-9353-60652a7695b8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:39.283091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c24f9-a390-4715-9353-60652a7695b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:39.303598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-038c24f9-a390-4715-9353-60652a7695b8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:39.305006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-038c24f9-a390-4715-9353-60652a7695b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:39.385257 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4054/8145] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:39.396828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a6a73-e287-4edc-b0ca-ddfd9248ad46 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:39.397126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a6a73-e287-4edc-b0ca-ddfd9248ad46 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:39.397453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a6a73-e287-4edc-b0ca-ddfd9248ad46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:39.419662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0f1a6a73-e287-4edc-b0ca-ddfd9248ad46 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:39.420938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0f1a6a73-e287-4edc-b0ca-ddfd9248ad46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:39.431015 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4092/8146] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:39.435460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c24f9-a390-4715-9353-60652a7695b8 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:39.445944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c24f9-a390-4715-9353-60652a7695b8 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:39.451953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1ba23-43b9-4dcb-938b-73be587d97c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:39.452645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1ba23-43b9-4dcb-938b-73be587d97c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:39.452926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1ba23-43b9-4dcb-938b-73be587d97c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:39.453197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1ba23-43b9-4dcb-938b-73be587d97c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:39.453940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1ba23-43b9-4dcb-938b-73be587d97c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:39:39.454246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1ba23-43b9-4dcb-938b-73be587d97c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:39.455909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1ba23-43b9-4dcb-938b-73be587d97c2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:39.468649 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4055/8147] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:39.474983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a6a73-e287-4edc-b0ca-ddfd9248ad46 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:39.489561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a6a73-e287-4edc-b0ca-ddfd9248ad46 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:39.498448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a197a5-ae5e-4411-87c7-024157d609b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:39.499099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a197a5-ae5e-4411-87c7-024157d609b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:39.499391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a197a5-ae5e-4411-87c7-024157d609b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:39.499670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a197a5-ae5e-4411-87c7-024157d609b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:39.500400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a197a5-ae5e-4411-87c7-024157d609b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:39.502330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a197a5-ae5e-4411-87c7-024157d609b1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:39.530077 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4093/8148] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:39:39 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:39.534589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1ba23-43b9-4dcb-938b-73be587d97c2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:39.545292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1ba23-43b9-4dcb-938b-73be587d97c2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:39.604077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e34d0c-6e7d-439e-aa04-0c4ca722b161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:39.604719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e34d0c-6e7d-439e-aa04-0c4ca722b161 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:39.604979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e34d0c-6e7d-439e-aa04-0c4ca722b161 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:39.605255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e34d0c-6e7d-439e-aa04-0c4ca722b161 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:39.605969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e34d0c-6e7d-439e-aa04-0c4ca722b161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:39.607920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e34d0c-6e7d-439e-aa04-0c4ca722b161 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:39.630915 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4056/8149] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:39 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:39.635196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a197a5-ae5e-4411-87c7-024157d609b1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:39.646093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a197a5-ae5e-4411-87c7-024157d609b1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:39.651714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1d9e-64f1-4e0b-a75b-84d3d842ffbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:39.652414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1d9e-64f1-4e0b-a75b-84d3d842ffbd admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:39.652700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1d9e-64f1-4e0b-a75b-84d3d842ffbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:39.652977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d1d9e-64f1-4e0b-a75b-84d3d842ffbd admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:39.653720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d1d9e-64f1-4e0b-a75b-84d3d842ffbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:39.655323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d1d9e-64f1-4e0b-a75b-84d3d842ffbd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:39.666014 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4094/8150] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:39.670170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e34d0c-6e7d-439e-aa04-0c4ca722b161 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:39.681256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e34d0c-6e7d-439e-aa04-0c4ca722b161 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:39.686438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808637b8-336b-460a-8ac2-cf7e7a778702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:39.687092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808637b8-336b-460a-8ac2-cf7e7a778702 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:39.687372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808637b8-336b-460a-8ac2-cf7e7a778702 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:39.687646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808637b8-336b-460a-8ac2-cf7e7a778702 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:39.688421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808637b8-336b-460a-8ac2-cf7e7a778702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:39.690016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808637b8-336b-460a-8ac2-cf7e7a778702 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:39.700676 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4057/8151] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:39.706386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1d9e-64f1-4e0b-a75b-84d3d842ffbd admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:39.721619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d1d9e-64f1-4e0b-a75b-84d3d842ffbd admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:39.728861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e57bd-bc49-4afe-9609-d9c19696999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:39.730136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e57bd-bc49-4afe-9609-d9c19696999e admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:39.730487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e57bd-bc49-4afe-9609-d9c19696999e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:39.730851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e57bd-bc49-4afe-9609-d9c19696999e admin admin] PATH_INFO: `/v3/projects/34acd883771b405d999cae4424a6e300/users/cf02a4dd2e9749adbd00ad430a25a039/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:39.745906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e57bd-bc49-4afe-9609-d9c19696999e admin admin] RBAC: Authorizing `identity:create_grant(project_id=34acd883771b405d999cae4424a6e300, user_id=cf02a4dd2e9749adbd00ad430a25a039, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:39.748634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e57bd-bc49-4afe-9609-d9c19696999e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:39.765224 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4095/8152] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:39 2022] PUT /identity/v3/projects/34acd883771b405d999cae4424a6e300/users/cf02a4dd2e9749adbd00ad430a25a039/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:39:39.776665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78714b8b-217f-4973-85a6-464692689eeb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:39.776959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78714b8b-217f-4973-85a6-464692689eeb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:39.777240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78714b8b-217f-4973-85a6-464692689eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:39.804754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-78714b8b-217f-4973-85a6-464692689eeb None None] MFA Rules not processed for user `cf02a4dd2e9749adbd00ad430a25a039`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:39.805978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-78714b8b-217f-4973-85a6-464692689eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:39.875393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:39.887537 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4058/8153] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:39.890774 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e57bd-bc49-4afe-9609-d9c19696999e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:39.956995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e57bd-bc49-4afe-9609-d9c19696999e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:39.961962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66504e6a-8c61-4f64-8085-e307712a15e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:39.962632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66504e6a-8c61-4f64-8085-e307712a15e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:39.962915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66504e6a-8c61-4f64-8085-e307712a15e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:39.963195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66504e6a-8c61-4f64-8085-e307712a15e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:39.963888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66504e6a-8c61-4f64-8085-e307712a15e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:39.965933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66504e6a-8c61-4f64-8085-e307712a15e8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:39.994804 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4096/8154] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:39:39 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:40.000236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78714b8b-217f-4973-85a6-464692689eeb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:40.013772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78714b8b-217f-4973-85a6-464692689eeb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:40.071739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2855b3-25db-4e97-9e59-3e8b89660c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:40.072443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2855b3-25db-4e97-9e59-3e8b89660c9c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:40.072728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2855b3-25db-4e97-9e59-3e8b89660c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:40.073003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2855b3-25db-4e97-9e59-3e8b89660c9c admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:40.073697 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2855b3-25db-4e97-9e59-3e8b89660c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:40.075622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2855b3-25db-4e97-9e59-3e8b89660c9c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:40.096808 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4059/8155] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:39 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:39:40.101271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66504e6a-8c61-4f64-8085-e307712a15e8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:40.108252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:40.112269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66504e6a-8c61-4f64-8085-e307712a15e8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:40.119022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a3bd7-4f27-4089-999f-e81c30d09b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:40.119687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a3bd7-4f27-4089-999f-e81c30d09b96 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:40.119973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a3bd7-4f27-4089-999f-e81c30d09b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:40.120276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a3bd7-4f27-4089-999f-e81c30d09b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:40.121211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a3bd7-4f27-4089-999f-e81c30d09b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:40.123632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a3bd7-4f27-4089-999f-e81c30d09b96 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:40.134952 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4097/8156] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:40.139072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2855b3-25db-4e97-9e59-3e8b89660c9c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:40.149975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2855b3-25db-4e97-9e59-3e8b89660c9c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:40.156450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260154b-0eba-4f56-9c94-6a460d52ce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:40.157336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260154b-0eba-4f56-9c94-6a460d52ce0e admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:40.157614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260154b-0eba-4f56-9c94-6a460d52ce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:40.157890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260154b-0eba-4f56-9c94-6a460d52ce0e admin admin] PATH_INFO: `/v3/projects/b788b2d48fda4a74a3e42b97c5aee09c/users/6429b680465444f4aac946fb78777a79/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:40.177138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260154b-0eba-4f56-9c94-6a460d52ce0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b788b2d48fda4a74a3e42b97c5aee09c, user_id=6429b680465444f4aac946fb78777a79, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:40.179812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260154b-0eba-4f56-9c94-6a460d52ce0e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:40.195692 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4060/8157] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:40 2022] PUT /identity/v3/projects/b788b2d48fda4a74a3e42b97c5aee09c/users/6429b680465444f4aac946fb78777a79/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:39:40.199966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a3bd7-4f27-4089-999f-e81c30d09b96 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:40.212144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a3bd7-4f27-4089-999f-e81c30d09b96 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:40.276535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f202915-4a88-4506-9155-27096c61004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:40.277211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f202915-4a88-4506-9155-27096c61004b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:40.277493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f202915-4a88-4506-9155-27096c61004b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:40.277766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f202915-4a88-4506-9155-27096c61004b admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:40.278509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f202915-4a88-4506-9155-27096c61004b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:40.280264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f202915-4a88-4506-9155-27096c61004b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:40.290614 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4098/8158] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:40.295123 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260154b-0eba-4f56-9c94-6a460d52ce0e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:40.307541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260154b-0eba-4f56-9c94-6a460d52ce0e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:40.313892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed0239-ad15-4527-a540-d1f01af11af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:40.314831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed0239-ad15-4527-a540-d1f01af11af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:40.315216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed0239-ad15-4527-a540-d1f01af11af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:40.315387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed0239-ad15-4527-a540-d1f01af11af2 admin admin] PATH_INFO: `/v3/projects/b788b2d48fda4a74a3e42b97c5aee09c/users/6429b680465444f4aac946fb78777a79/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:40.317672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed0239-ad15-4527-a540-d1f01af11af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b788b2d48fda4a74a3e42b97c5aee09c, user_id=6429b680465444f4aac946fb78777a79, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:40.320430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed0239-ad15-4527-a540-d1f01af11af2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:40.331597 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4061/8159] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:40 2022] PUT /identity/v3/projects/b788b2d48fda4a74a3e42b97c5aee09c/users/6429b680465444f4aac946fb78777a79/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:39:40.342917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb50d69-5b01-4f30-918e-2f3c87172e1f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:40.343213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb50d69-5b01-4f30-918e-2f3c87172e1f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:40.343624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb50d69-5b01-4f30-918e-2f3c87172e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:40.371709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9eb50d69-5b01-4f30-918e-2f3c87172e1f None None] MFA Rules not processed for user `6429b680465444f4aac946fb78777a79`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:40.373069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9eb50d69-5b01-4f30-918e-2f3c87172e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:40.444482 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4099/8160] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:40 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:39:40.449062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed0239-ad15-4527-a540-d1f01af11af2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:40.460522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed0239-ad15-4527-a540-d1f01af11af2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:40.465671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab2d5a-2140-40ce-9332-0d55a9866675 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:40.466327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab2d5a-2140-40ce-9332-0d55a9866675 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:40.466691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab2d5a-2140-40ce-9332-0d55a9866675 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:40.466973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab2d5a-2140-40ce-9332-0d55a9866675 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:40.467714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab2d5a-2140-40ce-9332-0d55a9866675 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:40.469358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab2d5a-2140-40ce-9332-0d55a9866675 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:40.485469 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4062/8161] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:39:40 2022] POST /identity/v3/roles => generated 235 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:40.489468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb50d69-5b01-4f30-918e-2f3c87172e1f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:40.499118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb50d69-5b01-4f30-918e-2f3c87172e1f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:40.504204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6a660-8fea-4385-ad86-8a03a91daa4e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:40.504874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6a660-8fea-4385-ad86-8a03a91daa4e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:40.505186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6a660-8fea-4385-ad86-8a03a91daa4e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:40.505498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6a660-8fea-4385-ad86-8a03a91daa4e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:40.506210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6a660-8fea-4385-ad86-8a03a91daa4e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:40.507823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6a660-8fea-4385-ad86-8a03a91daa4e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:40.521909 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4100/8162] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:39:40 2022] POST /identity/v3/roles => generated 234 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:40.525726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab2d5a-2140-40ce-9332-0d55a9866675 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:40.535816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab2d5a-2140-40ce-9332-0d55a9866675 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:40.541219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bc6b0-2a0e-40bc-9404-c4f1615521f3 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:40.541872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bc6b0-2a0e-40bc-9404-c4f1615521f3 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:40.542155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bc6b0-2a0e-40bc-9404-c4f1615521f3 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:40.542430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bc6b0-2a0e-40bc-9404-c4f1615521f3 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:40.543167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bc6b0-2a0e-40bc-9404-c4f1615521f3 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:40.544948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bc6b0-2a0e-40bc-9404-c4f1615521f3 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:40.560291 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4063/8163] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:39:40 2022] POST /identity/v3/roles => generated 235 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:39:40.564358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6a660-8fea-4385-ad86-8a03a91daa4e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:40.574671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6a660-8fea-4385-ad86-8a03a91daa4e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:40.579621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4bdbd-dfef-4868-9131-c2a716bb0451 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:40.580304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4bdbd-dfef-4868-9131-c2a716bb0451 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:40.580637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4bdbd-dfef-4868-9131-c2a716bb0451 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:40.580918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4bdbd-dfef-4868-9131-c2a716bb0451 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:40.581649 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4bdbd-dfef-4868-9131-c2a716bb0451 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:40.583251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4bdbd-dfef-4868-9131-c2a716bb0451 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:40.598895 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4101/8164] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:39:40 2022] POST /identity/v3/domains => generated 275 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:39:40.603000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bc6b0-2a0e-40bc-9404-c4f1615521f3 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:40.612862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bc6b0-2a0e-40bc-9404-c4f1615521f3 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:40.670016 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783edca5-b59c-41b1-afb0-1552c3f12e36 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:40.670664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783edca5-b59c-41b1-afb0-1552c3f12e36 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:40.670952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783edca5-b59c-41b1-afb0-1552c3f12e36 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:40.671224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783edca5-b59c-41b1-afb0-1552c3f12e36 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:40.671912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783edca5-b59c-41b1-afb0-1552c3f12e36 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:40.674207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783edca5-b59c-41b1-afb0-1552c3f12e36 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:40.705141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:40.715784 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4064/8165] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:39:40 2022] POST /identity/v3/projects => generated 398 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:39:40.716990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4bdbd-dfef-4868-9131-c2a716bb0451 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:40.727621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4bdbd-dfef-4868-9131-c2a716bb0451 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:40.774484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:40.787787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d15c3a-7833-4407-b566-140a26b757b7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:40.788506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d15c3a-7833-4407-b566-140a26b757b7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:40.788795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d15c3a-7833-4407-b566-140a26b757b7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:40.789083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d15c3a-7833-4407-b566-140a26b757b7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/groups` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:40.789751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d15c3a-7833-4407-b566-140a26b757b7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:40.791694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d15c3a-7833-4407-b566-140a26b757b7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:40.809394 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4102/8166] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:39:40 2022] POST /identity/v3/groups => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:40.810677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783edca5-b59c-41b1-afb0-1552c3f12e36 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:40.822154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783edca5-b59c-41b1-afb0-1552c3f12e36 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:40.827077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aea133-b5ba-4888-8e05-aac4e6b402ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:40.827758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aea133-b5ba-4888-8e05-aac4e6b402ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:40.828072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aea133-b5ba-4888-8e05-aac4e6b402ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:40.828363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aea133-b5ba-4888-8e05-aac4e6b402ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:40.829103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aea133-b5ba-4888-8e05-aac4e6b402ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:40.830746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aea133-b5ba-4888-8e05-aac4e6b402ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:40.856266 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4065/8167] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:39:40 2022] POST /identity/v3/roles => generated 235 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:40.860501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d15c3a-7833-4407-b566-140a26b757b7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:40.871016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d15c3a-7833-4407-b566-140a26b757b7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:40.876245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1f875-3aa4-403f-8f8a-2ece63aef5d4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:40.876911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1f875-3aa4-403f-8f8a-2ece63aef5d4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:40.877199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1f875-3aa4-403f-8f8a-2ece63aef5d4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:40.877480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1f875-3aa4-403f-8f8a-2ece63aef5d4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:40.878180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1f875-3aa4-403f-8f8a-2ece63aef5d4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:40.880153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1f875-3aa4-403f-8f8a-2ece63aef5d4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:40.901879 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4103/8168] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:40 2022] POST /identity/v3/users => generated 442 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:40.906363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aea133-b5ba-4888-8e05-aac4e6b402ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:40.917845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aea133-b5ba-4888-8e05-aac4e6b402ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:40.923170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bda2c2-e27e-4390-84b7-2e86d461a87a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:40.923830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bda2c2-e27e-4390-84b7-2e86d461a87a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:40.924117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bda2c2-e27e-4390-84b7-2e86d461a87a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:40.924437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bda2c2-e27e-4390-84b7-2e86d461a87a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:40.925161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bda2c2-e27e-4390-84b7-2e86d461a87a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:40.926199 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-42bda2c2-e27e-4390-84b7-2e86d461a87a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:40.926199 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:40.926199 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:40.927073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bda2c2-e27e-4390-84b7-2e86d461a87a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:40.944920 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4066/8169] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:39:40 2022] POST /identity/v3/roles => generated 270 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:40.949050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1f875-3aa4-403f-8f8a-2ece63aef5d4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:40.959489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1f875-3aa4-403f-8f8a-2ece63aef5d4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:40.964434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a814d-8372-4927-8b7f-af47d3ba520a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:40.965327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a814d-8372-4927-8b7f-af47d3ba520a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:40.965609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a814d-8372-4927-8b7f-af47d3ba520a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:40.965883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a814d-8372-4927-8b7f-af47d3ba520a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/projects/9c004cc4ab874de09d88c1f0203c740c/users/231703d6a42e4b0ca6d656b4c1309227/roles/1519224a788f41c7b8bc62ea20fe00af` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:40.981259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a814d-8372-4927-8b7f-af47d3ba520a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9c004cc4ab874de09d88c1f0203c740c, user_id=231703d6a42e4b0ca6d656b4c1309227, role_id=1519224a788f41c7b8bc62ea20fe00af)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:40.983935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a814d-8372-4927-8b7f-af47d3ba520a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:40.998831 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4104/8170] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:40 2022] PUT /identity/v3/projects/9c004cc4ab874de09d88c1f0203c740c/users/231703d6a42e4b0ca6d656b4c1309227/roles/1519224a788f41c7b8bc62ea20fe00af => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:39:41.003424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bda2c2-e27e-4390-84b7-2e86d461a87a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:41.013999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bda2c2-e27e-4390-84b7-2e86d461a87a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:41.076141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1cdf5-808e-4778-9265-46f9cfbdfe7f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:41.076830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1cdf5-808e-4778-9265-46f9cfbdfe7f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:41.077124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1cdf5-808e-4778-9265-46f9cfbdfe7f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:41.077427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1cdf5-808e-4778-9265-46f9cfbdfe7f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:41.078248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1cdf5-808e-4778-9265-46f9cfbdfe7f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Adding query filter params (scope.project.id=9c004cc4ab874de09d88c1f0203c740c, user.id=231703d6a42e4b0ca6d656b4c1309227) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:39:41.078589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1cdf5-808e-4778-9265-46f9cfbdfe7f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:41.080557 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1cdf5-808e-4778-9265-46f9cfbdfe7f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:41.132129 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4067/8171] 10.222.0.43 () {58 vars in 1355 bytes} [Sat Jul 2 21:39:41 2022] GET /identity/v3/role_assignments?scope.project.id=9c004cc4ab874de09d88c1f0203c740c&user.id=231703d6a42e4b0ca6d656b4c1309227&effective => generated 228 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:41.137345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a814d-8372-4927-8b7f-af47d3ba520a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:41.148847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a814d-8372-4927-8b7f-af47d3ba520a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:41.154437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59ba04-c9d0-416c-aa7b-0154e24da912 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:41.155298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59ba04-c9d0-416c-aa7b-0154e24da912 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:41.155578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59ba04-c9d0-416c-aa7b-0154e24da912 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:41.155863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59ba04-c9d0-416c-aa7b-0154e24da912 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/projects/9c004cc4ab874de09d88c1f0203c740c/users/231703d6a42e4b0ca6d656b4c1309227/roles/1519224a788f41c7b8bc62ea20fe00af` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:41.158590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59ba04-c9d0-416c-aa7b-0154e24da912 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=9c004cc4ab874de09d88c1f0203c740c, user_id=231703d6a42e4b0ca6d656b4c1309227, role_id=1519224a788f41c7b8bc62ea20fe00af)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:41.161297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59ba04-c9d0-416c-aa7b-0154e24da912 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:41.166943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ca59ba04-c9d0-416c-aa7b-0154e24da912 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invalidating the token cache because role 1519224a788f41c7b8bc62ea20fe00af was removed from user 231703d6a42e4b0ca6d656b4c1309227 on project 9c004cc4ab874de09d88c1f0203c740c. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:41.167227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ca59ba04-c9d0-416c-aa7b-0154e24da912 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:41.167967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ca59ba04-c9d0-416c-aa7b-0154e24da912 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:41.185043 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4105/8172] 10.222.0.43 () {58 vars in 1466 bytes} [Sat Jul 2 21:39:41 2022] DELETE /identity/v3/projects/9c004cc4ab874de09d88c1f0203c740c/users/231703d6a42e4b0ca6d656b4c1309227/roles/1519224a788f41c7b8bc62ea20fe00af => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:41.190015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1cdf5-808e-4778-9265-46f9cfbdfe7f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:41.192891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4fa1cdf5-808e-4778-9265-46f9cfbdfe7f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:41.209086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1cdf5-808e-4778-9265-46f9cfbdfe7f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:41.271993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84700c4-99fa-4e03-8b48-4c84429fca67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:41.272820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84700c4-99fa-4e03-8b48-4c84429fca67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:41.273106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84700c4-99fa-4e03-8b48-4c84429fca67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:41.273374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84700c4-99fa-4e03-8b48-4c84429fca67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/1519224a788f41c7b8bc62ea20fe00af` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:41.274637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84700c4-99fa-4e03-8b48-4c84429fca67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=1519224a788f41c7b8bc62ea20fe00af)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:41.275662 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-e84700c4-99fa-4e03-8b48-4c84429fca67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:41.275662 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:41.275662 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:41.276582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84700c4-99fa-4e03-8b48-4c84429fca67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:41.304122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:41.317830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e84700c4-99fa-4e03-8b48-4c84429fca67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invalidating the token cache because role 1519224a788f41c7b8bc62ea20fe00af has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:41.318265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e84700c4-99fa-4e03-8b48-4c84429fca67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:41.319190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e84700c4-99fa-4e03-8b48-4c84429fca67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:41.321987 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4068/8173] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:41 2022] DELETE /identity/v3/roles/1519224a788f41c7b8bc62ea20fe00af => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:41.327370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59ba04-c9d0-416c-aa7b-0154e24da912 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:41.337936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59ba04-c9d0-416c-aa7b-0154e24da912 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:41.402934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64eea4e-9b73-45d4-880c-d7c9173697d7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:41.403840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64eea4e-9b73-45d4-880c-d7c9173697d7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:41.404156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64eea4e-9b73-45d4-880c-d7c9173697d7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:41.404420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64eea4e-9b73-45d4-880c-d7c9173697d7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/projects/9c004cc4ab874de09d88c1f0203c740c/users/231703d6a42e4b0ca6d656b4c1309227/roles/e460451f62974c51beec4af38e400225` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:41.406952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64eea4e-9b73-45d4-880c-d7c9173697d7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9c004cc4ab874de09d88c1f0203c740c, user_id=231703d6a42e4b0ca6d656b4c1309227, role_id=e460451f62974c51beec4af38e400225)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:41.409668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64eea4e-9b73-45d4-880c-d7c9173697d7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:41.423846 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4106/8174] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:41 2022] PUT /identity/v3/projects/9c004cc4ab874de09d88c1f0203c740c/users/231703d6a42e4b0ca6d656b4c1309227/roles/e460451f62974c51beec4af38e400225 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:41.427987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84700c4-99fa-4e03-8b48-4c84429fca67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:41.429452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e84700c4-99fa-4e03-8b48-4c84429fca67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:41.442305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84700c4-99fa-4e03-8b48-4c84429fca67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:41.500675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750d08d-cf16-4b4b-8ddf-6065a0899148 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:41.501597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750d08d-cf16-4b4b-8ddf-6065a0899148 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:41.501886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750d08d-cf16-4b4b-8ddf-6065a0899148 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:41.502161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750d08d-cf16-4b4b-8ddf-6065a0899148 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:41.504024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750d08d-cf16-4b4b-8ddf-6065a0899148 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e460451f62974c51beec4af38e400225, implied_role_id=4de34ec25d0e4102a892d0e202751609)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:41.505092 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-d750d08d-cf16-4b4b-8ddf-6065a0899148 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:41.505092 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:41.505092 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:41.505985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750d08d-cf16-4b4b-8ddf-6065a0899148 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:41.534695 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4069/8175] 10.222.0.43 () {60 vars in 1362 bytes} [Sat Jul 2 21:39:41 2022] PUT /identity/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609 => generated 520 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:41.539979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64eea4e-9b73-45d4-880c-d7c9173697d7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:41.559434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64eea4e-9b73-45d4-880c-d7c9173697d7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:41.621239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb783b0d-8eff-4b9b-b424-ea5acd7ec2b1 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:41.621900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb783b0d-8eff-4b9b-b424-ea5acd7ec2b1 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:41.622187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb783b0d-8eff-4b9b-b424-ea5acd7ec2b1 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:41.622467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb783b0d-8eff-4b9b-b424-ea5acd7ec2b1 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:41.623338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb783b0d-8eff-4b9b-b424-ea5acd7ec2b1 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Adding query filter params (scope.project.id=9c004cc4ab874de09d88c1f0203c740c, user.id=231703d6a42e4b0ca6d656b4c1309227) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:39:41.623660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb783b0d-8eff-4b9b-b424-ea5acd7ec2b1 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:41.625586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb783b0d-8eff-4b9b-b424-ea5acd7ec2b1 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:41.644522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:41.679863 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4107/8176] 10.222.0.43 () {58 vars in 1355 bytes} [Sat Jul 2 21:39:41 2022] GET /identity/v3/role_assignments?scope.project.id=9c004cc4ab874de09d88c1f0203c740c&user.id=231703d6a42e4b0ca6d656b4c1309227&effective => generated 1061 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:41.684258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750d08d-cf16-4b4b-8ddf-6065a0899148 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:41.695894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750d08d-cf16-4b4b-8ddf-6065a0899148 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:41.701294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc94aef-82f0-4356-94b8-f535952ece20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:41.702267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc94aef-82f0-4356-94b8-f535952ece20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:41.702547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc94aef-82f0-4356-94b8-f535952ece20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:41.702822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc94aef-82f0-4356-94b8-f535952ece20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:41.704715 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc94aef-82f0-4356-94b8-f535952ece20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e460451f62974c51beec4af38e400225, implied_role_id=4de34ec25d0e4102a892d0e202751609)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:41.705740 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-dbc94aef-82f0-4356-94b8-f535952ece20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:41.705740 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:41.705740 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:41.706619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc94aef-82f0-4356-94b8-f535952ece20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:41.718256 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4070/8177] 10.222.0.43 () {58 vars in 1346 bytes} [Sat Jul 2 21:39:41 2022] DELETE /identity/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:41.722668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb783b0d-8eff-4b9b-b424-ea5acd7ec2b1 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:41.735893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb783b0d-8eff-4b9b-b424-ea5acd7ec2b1 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:41.810686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9676693-318c-4e4d-bcab-0d7582f53124 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:41.811241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9676693-318c-4e4d-bcab-0d7582f53124 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:41.811529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9676693-318c-4e4d-bcab-0d7582f53124 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:41.811811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9676693-318c-4e4d-bcab-0d7582f53124 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:41.812669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9676693-318c-4e4d-bcab-0d7582f53124 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Adding query filter params (scope.project.id=9c004cc4ab874de09d88c1f0203c740c, user.id=231703d6a42e4b0ca6d656b4c1309227) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:39:41.812986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9676693-318c-4e4d-bcab-0d7582f53124 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:41.814898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9676693-318c-4e4d-bcab-0d7582f53124 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:41.862777 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4108/8178] 10.222.0.43 () {58 vars in 1355 bytes} [Sat Jul 2 21:39:41 2022] GET /identity/v3/role_assignments?scope.project.id=9c004cc4ab874de09d88c1f0203c740c&user.id=231703d6a42e4b0ca6d656b4c1309227&effective => generated 577 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:41.867067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc94aef-82f0-4356-94b8-f535952ece20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:41.877570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc94aef-82f0-4356-94b8-f535952ece20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:41.882385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac47445-5555-4938-b3f0-d4be73ecb832 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:41.883291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac47445-5555-4938-b3f0-d4be73ecb832 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:41.883576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac47445-5555-4938-b3f0-d4be73ecb832 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:41.883852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac47445-5555-4938-b3f0-d4be73ecb832 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:41.885695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac47445-5555-4938-b3f0-d4be73ecb832 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e460451f62974c51beec4af38e400225, implied_role_id=4de34ec25d0e4102a892d0e202751609)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:41.887324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac47445-5555-4938-b3f0-d4be73ecb832 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:41.921121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-0ac47445-5555-4938-b3f0-d4be73ecb832 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] e460451f62974c51beec4af38e400225 does not imply 4de34ec25d0e4102a892d0e202751609.: keystone.exception.ImpliedRoleNotFound: e460451f62974c51beec4af38e400225 does not imply 4de34ec25d0e4102a892d0e202751609. Jul 02 21:39:41.921121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:41.921121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 02 21:39:41.921121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = query.one() Jul 02 21:39:41.921121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 02 21:39:41.921121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._iter().one() Jul 02 21:39:41.921121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 02 21:39:41.921121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._only_one_row( Jul 02 21:39:41.921121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 02 21:39:41.921121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 02 21:39:41.921121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 02 21:39:41.921121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:39:41.921121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:39:41.921121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:39:41.921121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:41.921121 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:39:41.923013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:39:41.923013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:39:41.923013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:39:41.923013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:39:41.923013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:39:41.923013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:39:41.923013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:39:41.923013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:39:41.923013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:39:41.923013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jul 02 21:39:41.923013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jul 02 21:39:41.923013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:41.923013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:41.923013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jul 02 21:39:41.923013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jul 02 21:39:41.923013 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jul 02 21:39:41.925237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 02 21:39:41.925237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 02 21:39:41.925237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 02 21:39:41.925237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: e460451f62974c51beec4af38e400225 does not imply 4de34ec25d0e4102a892d0e202751609. Jul 02 21:39:41.925237 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:39:41.925237 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4071/8179] 10.222.0.43 () {58 vars in 1346 bytes} [Sat Jul 2 21:39:41 2022] DELETE /identity/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609 => generated 137 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:39:41.929256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9676693-318c-4e4d-bcab-0d7582f53124 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:41.946202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9676693-318c-4e4d-bcab-0d7582f53124 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:41.953651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bef0f-1f3b-4e7c-a248-bf5d749161f0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:41.954522 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bef0f-1f3b-4e7c-a248-bf5d749161f0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:41.954846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bef0f-1f3b-4e7c-a248-bf5d749161f0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:41.955115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bef0f-1f3b-4e7c-a248-bf5d749161f0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/projects/9c004cc4ab874de09d88c1f0203c740c/users/231703d6a42e4b0ca6d656b4c1309227/roles/e460451f62974c51beec4af38e400225` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:41.957813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bef0f-1f3b-4e7c-a248-bf5d749161f0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=9c004cc4ab874de09d88c1f0203c740c, user_id=231703d6a42e4b0ca6d656b4c1309227, role_id=e460451f62974c51beec4af38e400225)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:41.960599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bef0f-1f3b-4e7c-a248-bf5d749161f0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:41.966543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b87bef0f-1f3b-4e7c-a248-bf5d749161f0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invalidating the token cache because role e460451f62974c51beec4af38e400225 was removed from user 231703d6a42e4b0ca6d656b4c1309227 on project 9c004cc4ab874de09d88c1f0203c740c. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:41.966839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b87bef0f-1f3b-4e7c-a248-bf5d749161f0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:41.967634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b87bef0f-1f3b-4e7c-a248-bf5d749161f0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:41.983641 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4109/8180] 10.222.0.43 () {58 vars in 1466 bytes} [Sat Jul 2 21:39:41 2022] DELETE /identity/v3/projects/9c004cc4ab874de09d88c1f0203c740c/users/231703d6a42e4b0ca6d656b4c1309227/roles/e460451f62974c51beec4af38e400225 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:41.989139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac47445-5555-4938-b3f0-d4be73ecb832 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:41.991031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0ac47445-5555-4938-b3f0-d4be73ecb832 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:42.004968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac47445-5555-4938-b3f0-d4be73ecb832 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:42.070667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b31a93-3234-40a8-ac9f-89cfbb3215e6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:42.071501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b31a93-3234-40a8-ac9f-89cfbb3215e6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:42.071868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b31a93-3234-40a8-ac9f-89cfbb3215e6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:42.072277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b31a93-3234-40a8-ac9f-89cfbb3215e6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:42.073281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b31a93-3234-40a8-ac9f-89cfbb3215e6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:42.075358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b31a93-3234-40a8-ac9f-89cfbb3215e6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:42.091803 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4072/8181] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:41 2022] POST /identity/v3/roles => generated 272 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:42.096221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bef0f-1f3b-4e7c-a248-bf5d749161f0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:42.106966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bef0f-1f3b-4e7c-a248-bf5d749161f0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:42.112261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bee9c0-0971-4618-a4b4-b460cccf66c7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:42.112917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bee9c0-0971-4618-a4b4-b460cccf66c7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:42.113201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bee9c0-0971-4618-a4b4-b460cccf66c7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:42.113479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bee9c0-0971-4618-a4b4-b460cccf66c7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:42.114209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bee9c0-0971-4618-a4b4-b460cccf66c7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Adding query filter params (domain_id=c9f3ab2d7f764dc0b1e4946ea180ab2f) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:39:42.114519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bee9c0-0971-4618-a4b4-b460cccf66c7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:42.115551 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-80bee9c0-0971-4618-a4b4-b460cccf66c7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:42.115551 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:42.115551 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:42.116477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bee9c0-0971-4618-a4b4-b460cccf66c7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:42.124776 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4110/8182] 10.222.0.43 () {58 vars in 1206 bytes} [Sat Jul 2 21:39:42 2022] GET /identity/v3/roles?domain_id=c9f3ab2d7f764dc0b1e4946ea180ab2f => generated 409 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:42.129020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b31a93-3234-40a8-ac9f-89cfbb3215e6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:42.139428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b31a93-3234-40a8-ac9f-89cfbb3215e6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:42.144464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b875b-f33b-4a73-b510-3507fef88b20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:42.145319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b875b-f33b-4a73-b510-3507fef88b20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:42.145598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b875b-f33b-4a73-b510-3507fef88b20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:42.145877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b875b-f33b-4a73-b510-3507fef88b20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/b761fb10d66242638459df1f3c84e4d4` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:42.147144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b875b-f33b-4a73-b510-3507fef88b20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=b761fb10d66242638459df1f3c84e4d4)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:42.148795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b875b-f33b-4a73-b510-3507fef88b20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:42.187400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3c0b875b-f33b-4a73-b510-3507fef88b20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invalidating the token cache because role b761fb10d66242638459df1f3c84e4d4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:42.187706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3c0b875b-f33b-4a73-b510-3507fef88b20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:42.188400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3c0b875b-f33b-4a73-b510-3507fef88b20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:42.190294 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4073/8183] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:42 2022] DELETE /identity/v3/roles/b761fb10d66242638459df1f3c84e4d4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:42.194657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bee9c0-0971-4618-a4b4-b460cccf66c7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:42.196402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-80bee9c0-0971-4618-a4b4-b460cccf66c7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:42.210154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bee9c0-0971-4618-a4b4-b460cccf66c7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:42.268699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44bf7d-dbb9-4716-84ca-d93c5bdc3b70 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:42.269375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44bf7d-dbb9-4716-84ca-d93c5bdc3b70 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:42.269661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44bf7d-dbb9-4716-84ca-d93c5bdc3b70 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:42.269942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44bf7d-dbb9-4716-84ca-d93c5bdc3b70 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:42.270700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44bf7d-dbb9-4716-84ca-d93c5bdc3b70 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Adding query filter params (domain_id=c9f3ab2d7f764dc0b1e4946ea180ab2f) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:39:42.271008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44bf7d-dbb9-4716-84ca-d93c5bdc3b70 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:42.272811 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44bf7d-dbb9-4716-84ca-d93c5bdc3b70 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:42.274969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:42.279580 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4111/8184] 10.222.0.43 () {58 vars in 1206 bytes} [Sat Jul 2 21:39:42 2022] GET /identity/v3/roles?domain_id=c9f3ab2d7f764dc0b1e4946ea180ab2f => generated 148 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:42.284014 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b875b-f33b-4a73-b510-3507fef88b20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:42.294488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b875b-f33b-4a73-b510-3507fef88b20 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:42.299781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42637082-3f3b-4211-b046-2ede4da8ea4a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:42.300675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42637082-3f3b-4211-b046-2ede4da8ea4a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:42.300965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42637082-3f3b-4211-b046-2ede4da8ea4a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:42.301226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42637082-3f3b-4211-b046-2ede4da8ea4a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/b761fb10d66242638459df1f3c84e4d4` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:42.304429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:42.314622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42637082-3f3b-4211-b046-2ede4da8ea4a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 21:39:42.324871 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-42637082-3f3b-4211-b046-2ede4da8ea4a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Could not find role: b761fb10d66242638459df1f3c84e4d4.: keystone.exception.RoleNotFound: Could not find role: b761fb10d66242638459df1f3c84e4d4. Jul 02 21:39:42.324871 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:42.324871 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:39:42.324871 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:39:42.324871 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:39:42.324871 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:39:42.324871 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:39:42.324871 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:39:42.324871 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:39:42.324871 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:39:42.324871 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:39:42.324871 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:39:42.324871 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Jul 02 21:39:42.324871 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Jul 02 21:39:42.326114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 21:39:42.326114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 21:39:42.326114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 21:39:42.326114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 21:39:42.326114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:42.326114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:42.326114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:39:42.326114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:39:42.326114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:39:42.326114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:39:42.326114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:39:42.326114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application with Lock( Jul 02 21:39:42.326114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:39:42.326114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:39:42.326114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:39:42.326114 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:39:42.327662 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:39:42.327662 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:39:42.327662 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:39:42.327662 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:39:42.327662 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 21:39:42.327662 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 21:39:42.327662 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 21:39:42.327662 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 21:39:42.327662 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 21:39:42.327662 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 21:39:42.327662 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: b761fb10d66242638459df1f3c84e4d4. Jul 02 21:39:42.327662 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:39:42.327662 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4074/8185] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:42 2022] DELETE /identity/v3/roles/b761fb10d66242638459df1f3c84e4d4 => generated 110 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:39:42.331440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44bf7d-dbb9-4716-84ca-d93c5bdc3b70 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:42.342077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44bf7d-dbb9-4716-84ca-d93c5bdc3b70 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:42.347423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb754d3-d0fd-4ee0-9836-a31be661ff3f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:42.348396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb754d3-d0fd-4ee0-9836-a31be661ff3f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:42.348682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb754d3-d0fd-4ee0-9836-a31be661ff3f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:42.348959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb754d3-d0fd-4ee0-9836-a31be661ff3f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:42.355966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb754d3-d0fd-4ee0-9836-a31be661ff3f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=c9f3ab2d7f764dc0b1e4946ea180ab2f, group_id=d4a4b38229cd443eb0b90b0d7a78cc6a, role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:42.358708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb754d3-d0fd-4ee0-9836-a31be661ff3f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:42.373929 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4112/8186] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:42 2022] PUT /identity/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:42.378151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42637082-3f3b-4211-b046-2ede4da8ea4a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:42.389538 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42637082-3f3b-4211-b046-2ede4da8ea4a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:42.450599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05139c14-10e4-4148-8aba-7e30c6b4eae2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:42.451655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05139c14-10e4-4148-8aba-7e30c6b4eae2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:42.451943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05139c14-10e4-4148-8aba-7e30c6b4eae2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:42.452257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05139c14-10e4-4148-8aba-7e30c6b4eae2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:42.454056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05139c14-10e4-4148-8aba-7e30c6b4eae2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=c9f3ab2d7f764dc0b1e4946ea180ab2f, group_id=d4a4b38229cd443eb0b90b0d7a78cc6a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:42.456750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05139c14-10e4-4148-8aba-7e30c6b4eae2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:42.468990 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4075/8187] 10.222.0.43 () {58 vars in 1364 bytes} [Sat Jul 2 21:39:42 2022] GET /identity/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles => generated 410 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:42.473325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb754d3-d0fd-4ee0-9836-a31be661ff3f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:42.483945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb754d3-d0fd-4ee0-9836-a31be661ff3f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:42.489210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e960f91-51b6-4d36-b7cc-3a3191e49883 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:42.490110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e960f91-51b6-4d36-b7cc-3a3191e49883 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:42.490393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e960f91-51b6-4d36-b7cc-3a3191e49883 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:42.490670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e960f91-51b6-4d36-b7cc-3a3191e49883 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:42.493316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e960f91-51b6-4d36-b7cc-3a3191e49883 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=c9f3ab2d7f764dc0b1e4946ea180ab2f, group_id=d4a4b38229cd443eb0b90b0d7a78cc6a, role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:42.496059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e960f91-51b6-4d36-b7cc-3a3191e49883 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:42.502023 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4113/8188] 10.222.0.43 () {58 vars in 1464 bytes} [Sat Jul 2 21:39:42 2022] HEAD /identity/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:42.505788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05139c14-10e4-4148-8aba-7e30c6b4eae2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:42.515830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05139c14-10e4-4148-8aba-7e30c6b4eae2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:42.520803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ee374-a48b-470b-842d-ddc3e8a817ee tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:42.521686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ee374-a48b-470b-842d-ddc3e8a817ee tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:42.521977 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ee374-a48b-470b-842d-ddc3e8a817ee tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:42.522259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ee374-a48b-470b-842d-ddc3e8a817ee tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:42.524632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ee374-a48b-470b-842d-ddc3e8a817ee tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=c9f3ab2d7f764dc0b1e4946ea180ab2f, group_id=d4a4b38229cd443eb0b90b0d7a78cc6a, role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:42.527263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ee374-a48b-470b-842d-ddc3e8a817ee tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:42.532777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4f7ee374-a48b-470b-842d-ddc3e8a817ee tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invalidating the token cache because role eb7fe192653146dfafc0e89eb818a58d was removed from group d4a4b38229cd443eb0b90b0d7a78cc6a on domain c9f3ab2d7f764dc0b1e4946ea180ab2f. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:42.533061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4f7ee374-a48b-470b-842d-ddc3e8a817ee tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:42.533774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4f7ee374-a48b-470b-842d-ddc3e8a817ee tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:42.551652 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4076/8189] 10.222.0.43 () {58 vars in 1466 bytes} [Sat Jul 2 21:39:42 2022] DELETE /identity/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:42.557710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e960f91-51b6-4d36-b7cc-3a3191e49883 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:42.560336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5e960f91-51b6-4d36-b7cc-3a3191e49883 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:42.573861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e960f91-51b6-4d36-b7cc-3a3191e49883 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:42.637258 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c10deb-a6e7-4ed1-bc8b-58ce503918b2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:42.638099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c10deb-a6e7-4ed1-bc8b-58ce503918b2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:42.638387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c10deb-a6e7-4ed1-bc8b-58ce503918b2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:42.638720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c10deb-a6e7-4ed1-bc8b-58ce503918b2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/projects/9c004cc4ab874de09d88c1f0203c740c/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:42.641107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c10deb-a6e7-4ed1-bc8b-58ce503918b2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9c004cc4ab874de09d88c1f0203c740c, group_id=d4a4b38229cd443eb0b90b0d7a78cc6a, role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:42.643776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c10deb-a6e7-4ed1-bc8b-58ce503918b2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:42.659584 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4114/8190] 10.222.0.43 () {60 vars in 1485 bytes} [Sat Jul 2 21:39:42 2022] PUT /identity/v3/projects/9c004cc4ab874de09d88c1f0203c740c/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:42.664070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ee374-a48b-470b-842d-ddc3e8a817ee tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:42.675672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ee374-a48b-470b-842d-ddc3e8a817ee tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:42.735250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ddfd8-2bec-4853-b9b6-0c8b241fa7dd tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:42.736129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ddfd8-2bec-4853-b9b6-0c8b241fa7dd tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:42.736418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ddfd8-2bec-4853-b9b6-0c8b241fa7dd tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:42.736699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ddfd8-2bec-4853-b9b6-0c8b241fa7dd tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/projects/9c004cc4ab874de09d88c1f0203c740c/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:42.738544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ddfd8-2bec-4853-b9b6-0c8b241fa7dd tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:list_grants(project_id=9c004cc4ab874de09d88c1f0203c740c, group_id=d4a4b38229cd443eb0b90b0d7a78cc6a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:42.741136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ddfd8-2bec-4853-b9b6-0c8b241fa7dd tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:42.753043 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4077/8191] 10.222.0.43 () {58 vars in 1367 bytes} [Sat Jul 2 21:39:42 2022] GET /identity/v3/projects/9c004cc4ab874de09d88c1f0203c740c/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles => generated 411 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:39:42.757817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c10deb-a6e7-4ed1-bc8b-58ce503918b2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:42.770954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c10deb-a6e7-4ed1-bc8b-58ce503918b2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:42.776809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f228d-d145-42c7-88c0-e36b6be77ecc tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:42.777711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f228d-d145-42c7-88c0-e36b6be77ecc tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:42.777997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f228d-d145-42c7-88c0-e36b6be77ecc tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:42.778281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f228d-d145-42c7-88c0-e36b6be77ecc tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/users/231703d6a42e4b0ca6d656b4c1309227` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:42.780312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f228d-d145-42c7-88c0-e36b6be77ecc tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=d4a4b38229cd443eb0b90b0d7a78cc6a, user_id=231703d6a42e4b0ca6d656b4c1309227)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:42.781368 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-b21f228d-d145-42c7-88c0-e36b6be77ecc tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:42.781368 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:42.781368 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:42.782581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f228d-d145-42c7-88c0-e36b6be77ecc tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:42.809460 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4115/8192] 10.222.0.43 () {60 vars in 1359 bytes} [Sat Jul 2 21:39:42 2022] PUT /identity/v3/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/users/231703d6a42e4b0ca6d656b4c1309227 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:42.817510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbda309-4bca-459c-864a-b97825606cb0 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:42.817990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbda309-4bca-459c-864a-b97825606cb0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:42.818496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbda309-4bca-459c-864a-b97825606cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:42.868650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4dbda309-4bca-459c-864a-b97825606cb0 None None] MFA Rules not processed for user `231703d6a42e4b0ca6d656b4c1309227`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:42.869895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4dbda309-4bca-459c-864a-b97825606cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:42.915777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:42.970972 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4078/8193] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:42.975632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f228d-d145-42c7-88c0-e36b6be77ecc tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:43.039368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f228d-d145-42c7-88c0-e36b6be77ecc tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:43.044830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30d207-befd-4502-b8f8-e75562205fd7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:43.045708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30d207-befd-4502-b8f8-e75562205fd7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:43.045989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30d207-befd-4502-b8f8-e75562205fd7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:43.046266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30d207-befd-4502-b8f8-e75562205fd7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/projects/9c004cc4ab874de09d88c1f0203c740c/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:43.049033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30d207-befd-4502-b8f8-e75562205fd7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:check_grant(project_id=9c004cc4ab874de09d88c1f0203c740c, group_id=d4a4b38229cd443eb0b90b0d7a78cc6a, role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:43.051697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30d207-befd-4502-b8f8-e75562205fd7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:43.057662 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4116/8194] 10.222.0.43 () {58 vars in 1467 bytes} [Sat Jul 2 21:39:42 2022] HEAD /identity/v3/projects/9c004cc4ab874de09d88c1f0203c740c/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:43.062200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbda309-4bca-459c-864a-b97825606cb0 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:43.074814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbda309-4bca-459c-864a-b97825606cb0 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:43.080286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885825a1-e1b1-482f-80f2-e63d7cff6496 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:43.081189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885825a1-e1b1-482f-80f2-e63d7cff6496 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:43.081477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885825a1-e1b1-482f-80f2-e63d7cff6496 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:43.081759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885825a1-e1b1-482f-80f2-e63d7cff6496 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/projects/9c004cc4ab874de09d88c1f0203c740c/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:43.084144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885825a1-e1b1-482f-80f2-e63d7cff6496 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=9c004cc4ab874de09d88c1f0203c740c, group_id=d4a4b38229cd443eb0b90b0d7a78cc6a, role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:43.086919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885825a1-e1b1-482f-80f2-e63d7cff6496 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:43.093074 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-885825a1-e1b1-482f-80f2-e63d7cff6496 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invalidating the token cache because role eb7fe192653146dfafc0e89eb818a58d was removed from group d4a4b38229cd443eb0b90b0d7a78cc6a on project 9c004cc4ab874de09d88c1f0203c740c. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:43.093325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-885825a1-e1b1-482f-80f2-e63d7cff6496 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:43.094057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-885825a1-e1b1-482f-80f2-e63d7cff6496 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:43.109068 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4079/8195] 10.222.0.43 () {58 vars in 1469 bytes} [Sat Jul 2 21:39:43 2022] DELETE /identity/v3/projects/9c004cc4ab874de09d88c1f0203c740c/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:43.113538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30d207-befd-4502-b8f8-e75562205fd7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:43.115310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0e30d207-befd-4502-b8f8-e75562205fd7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:43.128082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30d207-befd-4502-b8f8-e75562205fd7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:43.172193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:43.189078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874ec4b-ce5c-4052-a187-fafd8a7566f9 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:43.189997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874ec4b-ce5c-4052-a187-fafd8a7566f9 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:43.190311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874ec4b-ce5c-4052-a187-fafd8a7566f9 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:43.190586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874ec4b-ce5c-4052-a187-fafd8a7566f9 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/users/231703d6a42e4b0ca6d656b4c1309227` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:43.192490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874ec4b-ce5c-4052-a187-fafd8a7566f9 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=d4a4b38229cd443eb0b90b0d7a78cc6a, user_id=231703d6a42e4b0ca6d656b4c1309227)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:43.194488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874ec4b-ce5c-4052-a187-fafd8a7566f9 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:43.203691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6874ec4b-ce5c-4052-a187-fafd8a7566f9 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '231703d6a42e4b0ca6d656b4c1309227'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:43.218205 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4117/8196] 10.222.0.43 () {58 vars in 1343 bytes} [Sat Jul 2 21:39:43 2022] DELETE /identity/v3/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/users/231703d6a42e4b0ca6d656b4c1309227 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:43.223483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885825a1-e1b1-482f-80f2-e63d7cff6496 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:43.233846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885825a1-e1b1-482f-80f2-e63d7cff6496 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:43.295063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd0f99-6c54-4002-9fc2-caf4c7fe4278 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:43.295923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd0f99-6c54-4002-9fc2-caf4c7fe4278 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:43.296191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd0f99-6c54-4002-9fc2-caf4c7fe4278 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:43.296506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd0f99-6c54-4002-9fc2-caf4c7fe4278 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/system/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:43.298692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd0f99-6c54-4002-9fc2-caf4c7fe4278 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=d4a4b38229cd443eb0b90b0d7a78cc6a, role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:43.299767 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-9cdd0f99-6c54-4002-9fc2-caf4c7fe4278 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:43.299767 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:43.299767 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:43.300838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd0f99-6c54-4002-9fc2-caf4c7fe4278 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:43.309543 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4080/8197] 10.222.0.43 () {60 vars in 1380 bytes} [Sat Jul 2 21:39:43 2022] PUT /identity/v3/system/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:39:43.313778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874ec4b-ce5c-4052-a187-fafd8a7566f9 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:43.324329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874ec4b-ce5c-4052-a187-fafd8a7566f9 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:43.330011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ceea11-d9c8-4e2f-98da-6a6564bc907a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:43.330848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ceea11-d9c8-4e2f-98da-6a6564bc907a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:43.331131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ceea11-d9c8-4e2f-98da-6a6564bc907a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:43.331404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ceea11-d9c8-4e2f-98da-6a6564bc907a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/system/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:43.332763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ceea11-d9c8-4e2f-98da-6a6564bc907a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=d4a4b38229cd443eb0b90b0d7a78cc6a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:43.333817 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-82ceea11-d9c8-4e2f-98da-6a6564bc907a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:43.333817 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:43.333817 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:43.334720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ceea11-d9c8-4e2f-98da-6a6564bc907a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:43.347152 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4118/8198] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:39:43 2022] GET /identity/v3/system/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles => generated 376 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:43.351767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd0f99-6c54-4002-9fc2-caf4c7fe4278 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:43.366836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd0f99-6c54-4002-9fc2-caf4c7fe4278 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:43.373933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268856ae-89e2-4319-a6b6-60ff672f0a83 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:43.374812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268856ae-89e2-4319-a6b6-60ff672f0a83 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:43.375096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268856ae-89e2-4319-a6b6-60ff672f0a83 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:43.375377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268856ae-89e2-4319-a6b6-60ff672f0a83 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/system/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:43.377429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268856ae-89e2-4319-a6b6-60ff672f0a83 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=d4a4b38229cd443eb0b90b0d7a78cc6a, role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:43.378504 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-268856ae-89e2-4319-a6b6-60ff672f0a83 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:43.378504 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:43.378504 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:43.379416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268856ae-89e2-4319-a6b6-60ff672f0a83 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:43.386128 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4081/8199] 10.222.0.43 () {58 vars in 1362 bytes} [Sat Jul 2 21:39:43 2022] HEAD /identity/v3/system/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:43.390278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ceea11-d9c8-4e2f-98da-6a6564bc907a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:43.403302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ceea11-d9c8-4e2f-98da-6a6564bc907a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:43.409561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9e378-195e-4be4-9768-7e0c340f734d tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:43.410435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9e378-195e-4be4-9768-7e0c340f734d tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:43.410720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9e378-195e-4be4-9768-7e0c340f734d tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:43.411002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9e378-195e-4be4-9768-7e0c340f734d tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/system/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:43.413034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9e378-195e-4be4-9768-7e0c340f734d tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=d4a4b38229cd443eb0b90b0d7a78cc6a, role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:43.414105 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-bfb9e378-195e-4be4-9768-7e0c340f734d tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:43.414105 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:43.414105 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:43.415015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9e378-195e-4be4-9768-7e0c340f734d tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:43.424260 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4119/8200] 10.222.0.43 () {58 vars in 1364 bytes} [Sat Jul 2 21:39:43 2022] DELETE /identity/v3/system/groups/d4a4b38229cd443eb0b90b0d7a78cc6a/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:43.429216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268856ae-89e2-4319-a6b6-60ff672f0a83 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:43.440492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268856ae-89e2-4319-a6b6-60ff672f0a83 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:43.449225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ceac6-4d49-4930-bc52-30592145a447 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:43.449649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ceac6-4d49-4930-bc52-30592145a447 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:43.449940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ceac6-4d49-4930-bc52-30592145a447 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:43.450222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ceac6-4d49-4930-bc52-30592145a447 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f/users/231703d6a42e4b0ca6d656b4c1309227/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:43.452686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ceac6-4d49-4930-bc52-30592145a447 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=c9f3ab2d7f764dc0b1e4946ea180ab2f, user_id=231703d6a42e4b0ca6d656b4c1309227, role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:43.455489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ceac6-4d49-4930-bc52-30592145a447 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:43.470132 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4082/8201] 10.222.0.43 () {60 vars in 1479 bytes} [Sat Jul 2 21:39:43 2022] PUT /identity/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f/users/231703d6a42e4b0ca6d656b4c1309227/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:43.474365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9e378-195e-4be4-9768-7e0c340f734d tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:43.484425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9e378-195e-4be4-9768-7e0c340f734d tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:43.544829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe36824-ec7a-4ca0-a092-cf5dc3041d21 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:43.545823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe36824-ec7a-4ca0-a092-cf5dc3041d21 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:43.546168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe36824-ec7a-4ca0-a092-cf5dc3041d21 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:43.546515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe36824-ec7a-4ca0-a092-cf5dc3041d21 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f/users/231703d6a42e4b0ca6d656b4c1309227/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:43.548922 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe36824-ec7a-4ca0-a092-cf5dc3041d21 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=c9f3ab2d7f764dc0b1e4946ea180ab2f, user_id=231703d6a42e4b0ca6d656b4c1309227)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:43.551573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe36824-ec7a-4ca0-a092-cf5dc3041d21 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:43.565868 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4120/8202] 10.222.0.43 () {58 vars in 1361 bytes} [Sat Jul 2 21:39:43 2022] GET /identity/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f/users/231703d6a42e4b0ca6d656b4c1309227/roles => generated 409 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:43.569184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ceac6-4d49-4930-bc52-30592145a447 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:43.580252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ceac6-4d49-4930-bc52-30592145a447 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:43.585689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffd651-e136-4646-aa26-43975b19241c tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:43.586712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffd651-e136-4646-aa26-43975b19241c tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:43.587095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffd651-e136-4646-aa26-43975b19241c tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:43.587473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffd651-e136-4646-aa26-43975b19241c tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f/users/231703d6a42e4b0ca6d656b4c1309227/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:43.590213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffd651-e136-4646-aa26-43975b19241c tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=c9f3ab2d7f764dc0b1e4946ea180ab2f, user_id=231703d6a42e4b0ca6d656b4c1309227, role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:43.593047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffd651-e136-4646-aa26-43975b19241c tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:43.603124 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4083/8203] 10.222.0.43 () {58 vars in 1461 bytes} [Sat Jul 2 21:39:43 2022] HEAD /identity/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f/users/231703d6a42e4b0ca6d656b4c1309227/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:43.604404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe36824-ec7a-4ca0-a092-cf5dc3041d21 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:43.614980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe36824-ec7a-4ca0-a092-cf5dc3041d21 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:43.619924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5228a-12db-4a3d-856a-b0c9472176ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:43.620924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5228a-12db-4a3d-856a-b0c9472176ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:43.621219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5228a-12db-4a3d-856a-b0c9472176ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:43.621524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5228a-12db-4a3d-856a-b0c9472176ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f/users/231703d6a42e4b0ca6d656b4c1309227/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:43.623848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5228a-12db-4a3d-856a-b0c9472176ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=c9f3ab2d7f764dc0b1e4946ea180ab2f, user_id=231703d6a42e4b0ca6d656b4c1309227, role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:43.626704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5228a-12db-4a3d-856a-b0c9472176ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:43.632374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d7a5228a-12db-4a3d-856a-b0c9472176ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invalidating the token cache because role eb7fe192653146dfafc0e89eb818a58d was removed from user 231703d6a42e4b0ca6d656b4c1309227 on domain c9f3ab2d7f764dc0b1e4946ea180ab2f. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:43.632664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d7a5228a-12db-4a3d-856a-b0c9472176ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:43.633344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d7a5228a-12db-4a3d-856a-b0c9472176ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:43.647861 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4121/8204] 10.222.0.43 () {58 vars in 1463 bytes} [Sat Jul 2 21:39:43 2022] DELETE /identity/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f/users/231703d6a42e4b0ca6d656b4c1309227/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:43.653155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffd651-e136-4646-aa26-43975b19241c tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:43.655125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-eaffd651-e136-4646-aa26-43975b19241c tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:43.668267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffd651-e136-4646-aa26-43975b19241c tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:43.727065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541861b-e81d-43a9-9778-b7bf625c3492 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:43.727972 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541861b-e81d-43a9-9778-b7bf625c3492 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:43.728292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541861b-e81d-43a9-9778-b7bf625c3492 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:43.728712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541861b-e81d-43a9-9778-b7bf625c3492 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/projects/9c004cc4ab874de09d88c1f0203c740c/users/231703d6a42e4b0ca6d656b4c1309227/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:43.731036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541861b-e81d-43a9-9778-b7bf625c3492 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9c004cc4ab874de09d88c1f0203c740c, user_id=231703d6a42e4b0ca6d656b4c1309227, role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:43.733896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541861b-e81d-43a9-9778-b7bf625c3492 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:43.748442 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4084/8205] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:43 2022] PUT /identity/v3/projects/9c004cc4ab874de09d88c1f0203c740c/users/231703d6a42e4b0ca6d656b4c1309227/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:43.752558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5228a-12db-4a3d-856a-b0c9472176ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:43.763195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5228a-12db-4a3d-856a-b0c9472176ce tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:43.820596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac50443-632f-4e80-8cf2-969c0df70c4e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:43.821456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac50443-632f-4e80-8cf2-969c0df70c4e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:43.821745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac50443-632f-4e80-8cf2-969c0df70c4e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:43.822032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac50443-632f-4e80-8cf2-969c0df70c4e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/projects/9c004cc4ab874de09d88c1f0203c740c/users/231703d6a42e4b0ca6d656b4c1309227/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:43.823928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac50443-632f-4e80-8cf2-969c0df70c4e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:list_grants(project_id=9c004cc4ab874de09d88c1f0203c740c, user_id=231703d6a42e4b0ca6d656b4c1309227)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:43.826588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac50443-632f-4e80-8cf2-969c0df70c4e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:43.838537 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4122/8206] 10.222.0.43 () {58 vars in 1364 bytes} [Sat Jul 2 21:39:43 2022] GET /identity/v3/projects/9c004cc4ab874de09d88c1f0203c740c/users/231703d6a42e4b0ca6d656b4c1309227/roles => generated 410 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:39:43.842985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541861b-e81d-43a9-9778-b7bf625c3492 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:43.848798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:43.855547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541861b-e81d-43a9-9778-b7bf625c3492 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:43.861378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296225a-9ee9-4453-9b53-6840e62225a7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:43.862292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296225a-9ee9-4453-9b53-6840e62225a7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:43.862579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296225a-9ee9-4453-9b53-6840e62225a7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:43.862861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296225a-9ee9-4453-9b53-6840e62225a7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/projects/9c004cc4ab874de09d88c1f0203c740c/users/231703d6a42e4b0ca6d656b4c1309227/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:43.865145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296225a-9ee9-4453-9b53-6840e62225a7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:check_grant(project_id=9c004cc4ab874de09d88c1f0203c740c, user_id=231703d6a42e4b0ca6d656b4c1309227, role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:43.867878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296225a-9ee9-4453-9b53-6840e62225a7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:43.873964 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4085/8207] 10.222.0.43 () {58 vars in 1464 bytes} [Sat Jul 2 21:39:43 2022] HEAD /identity/v3/projects/9c004cc4ab874de09d88c1f0203c740c/users/231703d6a42e4b0ca6d656b4c1309227/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:39:43.880430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac50443-632f-4e80-8cf2-969c0df70c4e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:43.895458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac50443-632f-4e80-8cf2-969c0df70c4e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:43.903408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83a4b8-fe3c-41b1-9dea-faa6438ab0f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:43.904760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83a4b8-fe3c-41b1-9dea-faa6438ab0f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:43.905047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83a4b8-fe3c-41b1-9dea-faa6438ab0f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:43.905322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83a4b8-fe3c-41b1-9dea-faa6438ab0f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/projects/9c004cc4ab874de09d88c1f0203c740c/users/231703d6a42e4b0ca6d656b4c1309227/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:43.907983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83a4b8-fe3c-41b1-9dea-faa6438ab0f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=9c004cc4ab874de09d88c1f0203c740c, user_id=231703d6a42e4b0ca6d656b4c1309227, role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:43.910706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83a4b8-fe3c-41b1-9dea-faa6438ab0f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:43.917459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ec83a4b8-fe3c-41b1-9dea-faa6438ab0f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invalidating the token cache because role eb7fe192653146dfafc0e89eb818a58d was removed from user 231703d6a42e4b0ca6d656b4c1309227 on project 9c004cc4ab874de09d88c1f0203c740c. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:43.917767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ec83a4b8-fe3c-41b1-9dea-faa6438ab0f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:43.918529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ec83a4b8-fe3c-41b1-9dea-faa6438ab0f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:43.921248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:43.942054 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4123/8208] 10.222.0.43 () {58 vars in 1466 bytes} [Sat Jul 2 21:39:43 2022] DELETE /identity/v3/projects/9c004cc4ab874de09d88c1f0203c740c/users/231703d6a42e4b0ca6d656b4c1309227/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:43.947508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296225a-9ee9-4453-9b53-6840e62225a7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:43.949613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6296225a-9ee9-4453-9b53-6840e62225a7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:43.965607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296225a-9ee9-4453-9b53-6840e62225a7 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:44.030008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dca2e5-3ca1-4f91-97fb-d8c945c00766 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:44.030812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dca2e5-3ca1-4f91-97fb-d8c945c00766 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:44.031099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dca2e5-3ca1-4f91-97fb-d8c945c00766 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:44.031381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dca2e5-3ca1-4f91-97fb-d8c945c00766 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/system/users/231703d6a42e4b0ca6d656b4c1309227/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:44.033223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dca2e5-3ca1-4f91-97fb-d8c945c00766 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=231703d6a42e4b0ca6d656b4c1309227, role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:44.034261 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-21dca2e5-3ca1-4f91-97fb-d8c945c00766 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:44.034261 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:44.034261 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:44.035155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dca2e5-3ca1-4f91-97fb-d8c945c00766 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:44.043695 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4086/8209] 10.222.0.43 () {60 vars in 1377 bytes} [Sat Jul 2 21:39:43 2022] PUT /identity/v3/system/users/231703d6a42e4b0ca6d656b4c1309227/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:44.048603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83a4b8-fe3c-41b1-9dea-faa6438ab0f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:44.059296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83a4b8-fe3c-41b1-9dea-faa6438ab0f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:44.064539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85099a73-9367-4c67-ad4f-4650f8122cec tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:44.065352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85099a73-9367-4c67-ad4f-4650f8122cec tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:44.065650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85099a73-9367-4c67-ad4f-4650f8122cec tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:44.065941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85099a73-9367-4c67-ad4f-4650f8122cec tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/system/users/231703d6a42e4b0ca6d656b4c1309227/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:44.067278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85099a73-9367-4c67-ad4f-4650f8122cec tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=231703d6a42e4b0ca6d656b4c1309227)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:44.068366 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-85099a73-9367-4c67-ad4f-4650f8122cec tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:44.068366 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:44.068366 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:44.069265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85099a73-9367-4c67-ad4f-4650f8122cec tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:44.082676 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4124/8210] 10.222.0.43 () {58 vars in 1259 bytes} [Sat Jul 2 21:39:44 2022] GET /identity/v3/system/users/231703d6a42e4b0ca6d656b4c1309227/roles => generated 375 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:44.086871 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dca2e5-3ca1-4f91-97fb-d8c945c00766 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:44.097530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dca2e5-3ca1-4f91-97fb-d8c945c00766 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:44.102735 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dba10-717b-4934-bfb0-d4f00a3ea77f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:44.103591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dba10-717b-4934-bfb0-d4f00a3ea77f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:44.103843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dba10-717b-4934-bfb0-d4f00a3ea77f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:44.104160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dba10-717b-4934-bfb0-d4f00a3ea77f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/system/users/231703d6a42e4b0ca6d656b4c1309227/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:44.106141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2dba10-717b-4934-bfb0-d4f00a3ea77f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=231703d6a42e4b0ca6d656b4c1309227, role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:44.107178 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-6f2dba10-717b-4934-bfb0-d4f00a3ea77f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:44.107178 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:44.107178 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:44.108213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2dba10-717b-4934-bfb0-d4f00a3ea77f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:44.113242 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4087/8211] 10.222.0.43 () {58 vars in 1359 bytes} [Sat Jul 2 21:39:44 2022] HEAD /identity/v3/system/users/231703d6a42e4b0ca6d656b4c1309227/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 27 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:44.117251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85099a73-9367-4c67-ad4f-4650f8122cec tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:44.127535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85099a73-9367-4c67-ad4f-4650f8122cec tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:44.132329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c349225-e260-4e4b-bad8-13fa0f1cd9af tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:44.133189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c349225-e260-4e4b-bad8-13fa0f1cd9af tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:44.133479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c349225-e260-4e4b-bad8-13fa0f1cd9af tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:44.133753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c349225-e260-4e4b-bad8-13fa0f1cd9af tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/system/users/231703d6a42e4b0ca6d656b4c1309227/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:44.135513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c349225-e260-4e4b-bad8-13fa0f1cd9af tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=231703d6a42e4b0ca6d656b4c1309227, role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:44.136581 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-6c349225-e260-4e4b-bad8-13fa0f1cd9af tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:44.136581 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:44.136581 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:44.137466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c349225-e260-4e4b-bad8-13fa0f1cd9af tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:44.146682 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4125/8212] 10.222.0.43 () {58 vars in 1361 bytes} [Sat Jul 2 21:39:44 2022] DELETE /identity/v3/system/users/231703d6a42e4b0ca6d656b4c1309227/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:39:44.152240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dba10-717b-4934-bfb0-d4f00a3ea77f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:44.166083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dba10-717b-4934-bfb0-d4f00a3ea77f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:44.171827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c1056-4612-4fa1-b7fa-9b37e56ef14b tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:44.172512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c1056-4612-4fa1-b7fa-9b37e56ef14b tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:44.173157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c1056-4612-4fa1-b7fa-9b37e56ef14b tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:44.173427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c1056-4612-4fa1-b7fa-9b37e56ef14b tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:44.174165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c1056-4612-4fa1-b7fa-9b37e56ef14b tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:44.175755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c1056-4612-4fa1-b7fa-9b37e56ef14b tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:44.191870 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4088/8213] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:39:44 2022] POST /identity/v3/roles => generated 269 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:44.196111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c349225-e260-4e4b-bad8-13fa0f1cd9af tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:44.207155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c349225-e260-4e4b-bad8-13fa0f1cd9af tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:44.212417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8593ac2-6cdb-4a9c-80c6-dc7bee11f9fb tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:44.213083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8593ac2-6cdb-4a9c-80c6-dc7bee11f9fb tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:44.213366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8593ac2-6cdb-4a9c-80c6-dc7bee11f9fb tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:44.213644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8593ac2-6cdb-4a9c-80c6-dc7bee11f9fb tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:44.214363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8593ac2-6cdb-4a9c-80c6-dc7bee11f9fb tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:44.215388 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-a8593ac2-6cdb-4a9c-80c6-dc7bee11f9fb tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:44.215388 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:44.215388 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:44.216410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8593ac2-6cdb-4a9c-80c6-dc7bee11f9fb tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:44.231430 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4126/8214] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:39:44 2022] POST /identity/v3/roles => generated 270 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:44.235539 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c1056-4612-4fa1-b7fa-9b37e56ef14b tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:44.246103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c1056-4612-4fa1-b7fa-9b37e56ef14b tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:44.251953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dda7df-be01-46f1-be41-364c70d8f8db tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:44.252915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dda7df-be01-46f1-be41-364c70d8f8db tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:44.253210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dda7df-be01-46f1-be41-364c70d8f8db tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:44.253481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dda7df-be01-46f1-be41-364c70d8f8db tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/b3010095c8bb4403ad10a5e6f129f394/implies/1479c1f29f2b41279a513b5f1c61fde6` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:44.255424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dda7df-be01-46f1-be41-364c70d8f8db tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b3010095c8bb4403ad10a5e6f129f394, implied_role_id=1479c1f29f2b41279a513b5f1c61fde6)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:44.257082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dda7df-be01-46f1-be41-364c70d8f8db tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:44.285183 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4089/8215] 10.222.0.43 () {60 vars in 1362 bytes} [Sat Jul 2 21:39:44 2022] PUT /identity/v3/roles/b3010095c8bb4403ad10a5e6f129f394/implies/1479c1f29f2b41279a513b5f1c61fde6 => generated 530 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:44.287742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8593ac2-6cdb-4a9c-80c6-dc7bee11f9fb tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:44.298799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8593ac2-6cdb-4a9c-80c6-dc7bee11f9fb tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:44.358141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4092d-4578-4e85-9ef4-3ca049407964 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:44.358953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4092d-4578-4e85-9ef4-3ca049407964 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:44.359263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4092d-4578-4e85-9ef4-3ca049407964 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:44.359505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4092d-4578-4e85-9ef4-3ca049407964 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:44.360264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4092d-4578-4e85-9ef4-3ca049407964 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:44.361916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4092d-4578-4e85-9ef4-3ca049407964 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:44.378900 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4127/8216] 10.222.0.43 () {60 vars in 1148 bytes} [Sat Jul 2 21:39:44 2022] POST /identity/v3/domains => generated 276 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:44.383087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dda7df-be01-46f1-be41-364c70d8f8db tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:44.394003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dda7df-be01-46f1-be41-364c70d8f8db tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:44.451604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d6c38-91a8-4864-b2ea-2ad643b61150 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:44.452283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d6c38-91a8-4864-b2ea-2ad643b61150 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:44.452562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d6c38-91a8-4864-b2ea-2ad643b61150 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:44.452835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d6c38-91a8-4864-b2ea-2ad643b61150 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:44.453567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d6c38-91a8-4864-b2ea-2ad643b61150 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:44.455163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d6c38-91a8-4864-b2ea-2ad643b61150 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:44.470151 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4090/8217] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:39:44 2022] POST /identity/v3/roles => generated 270 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:44.474259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4092d-4578-4e85-9ef4-3ca049407964 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:44.485119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4092d-4578-4e85-9ef4-3ca049407964 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:44.489932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbb015-a86c-4c77-b5f1-f90f4f92aa13 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:44.490849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbb015-a86c-4c77-b5f1-f90f4f92aa13 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:44.491136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbb015-a86c-4c77-b5f1-f90f4f92aa13 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:44.491414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbb015-a86c-4c77-b5f1-f90f4f92aa13 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/b3010095c8bb4403ad10a5e6f129f394/implies/8c9f45f2ecc04ea1bf384b34e6a853a7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:44.493261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbb015-a86c-4c77-b5f1-f90f4f92aa13 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b3010095c8bb4403ad10a5e6f129f394, implied_role_id=8c9f45f2ecc04ea1bf384b34e6a853a7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:44.494300 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-2afbb015-a86c-4c77-b5f1-f90f4f92aa13 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:44.494300 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:44.494300 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:44.495190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbb015-a86c-4c77-b5f1-f90f4f92aa13 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:44.528645 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4128/8218] 10.222.0.43 () {60 vars in 1362 bytes} [Sat Jul 2 21:39:44 2022] PUT /identity/v3/roles/b3010095c8bb4403ad10a5e6f129f394/implies/8c9f45f2ecc04ea1bf384b34e6a853a7 => generated 530 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:44.532649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d6c38-91a8-4864-b2ea-2ad643b61150 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:44.543181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d6c38-91a8-4864-b2ea-2ad643b61150 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:44.578470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:44.604086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbdffc-d1f1-45b1-8bac-d453225744dc tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:44.605033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbdffc-d1f1-45b1-8bac-d453225744dc tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:44.605317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbdffc-d1f1-45b1-8bac-d453225744dc tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:44.605590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbdffc-d1f1-45b1-8bac-d453225744dc tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/b3010095c8bb4403ad10a5e6f129f394/implies/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:44.607367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbdffc-d1f1-45b1-8bac-d453225744dc tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b3010095c8bb4403ad10a5e6f129f394, implied_role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:44.609009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbdffc-d1f1-45b1-8bac-d453225744dc tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:44.634367 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4091/8219] 10.222.0.43 () {60 vars in 1362 bytes} [Sat Jul 2 21:39:44 2022] PUT /identity/v3/roles/b3010095c8bb4403ad10a5e6f129f394/implies/eb7fe192653146dfafc0e89eb818a58d => generated 525 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:44.638932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbb015-a86c-4c77-b5f1-f90f4f92aa13 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:44.651583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbb015-a86c-4c77-b5f1-f90f4f92aa13 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:44.709864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffc966-212b-4e83-b2c9-fb29ba19c266 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:44.710792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffc966-212b-4e83-b2c9-fb29ba19c266 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:44.711073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffc966-212b-4e83-b2c9-fb29ba19c266 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:44.711348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffc966-212b-4e83-b2c9-fb29ba19c266 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/eb7fe192653146dfafc0e89eb818a58d/implies/b3010095c8bb4403ad10a5e6f129f394` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:44.713213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffc966-212b-4e83-b2c9-fb29ba19c266 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=eb7fe192653146dfafc0e89eb818a58d, implied_role_id=b3010095c8bb4403ad10a5e6f129f394)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:44.714832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffc966-212b-4e83-b2c9-fb29ba19c266 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:44.738880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-6fffc966-212b-4e83-b2c9-fb29ba19c266 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] b3010095c8bb4403ad10a5e6f129f394 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: b3010095c8bb4403ad10a5e6f129f394 cannot be an implied roles. Jul 02 21:39:44.738880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:44.738880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:39:44.738880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:39:44.738880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:39:44.738880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:39:44.738880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:39:44.738880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:39:44.738880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:39:44.738880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:39:44.738880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:39:44.738880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:39:44.738880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Jul 02 21:39:44.738880 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Jul 02 21:39:44.740242 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:44.740242 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:44.740242 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Jul 02 21:39:44.740242 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Jul 02 21:39:44.740242 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: b3010095c8bb4403ad10a5e6f129f394 cannot be an implied roles. Jul 02 21:39:44.740242 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:39:44.740242 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4129/8220] 10.222.0.43 () {60 vars in 1362 bytes} [Sat Jul 2 21:39:44 2022] PUT /identity/v3/roles/eb7fe192653146dfafc0e89eb818a58d/implies/b3010095c8bb4403ad10a5e6f129f394 => generated 116 bytes in 102 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:39:44.744711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbdffc-d1f1-45b1-8bac-d453225744dc tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:44.755844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbdffc-d1f1-45b1-8bac-d453225744dc tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:44.761195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434b106-d252-4b13-b874-02a4f517ba6d tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:44.762124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434b106-d252-4b13-b874-02a4f517ba6d tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:44.762406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434b106-d252-4b13-b874-02a4f517ba6d tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:44.762679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434b106-d252-4b13-b874-02a4f517ba6d tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/b3010095c8bb4403ad10a5e6f129f394/implies/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:44.764536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434b106-d252-4b13-b874-02a4f517ba6d tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b3010095c8bb4403ad10a5e6f129f394, implied_role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:44.766160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434b106-d252-4b13-b874-02a4f517ba6d tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:44.777128 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4092/8221] 10.222.0.43 () {58 vars in 1346 bytes} [Sat Jul 2 21:39:44 2022] DELETE /identity/v3/roles/b3010095c8bb4403ad10a5e6f129f394/implies/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:44.782045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffc966-212b-4e83-b2c9-fb29ba19c266 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:44.793103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffc966-212b-4e83-b2c9-fb29ba19c266 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:44.802484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:44.853613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58231b-9fd6-41fc-802f-7ba46f69dfc4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:44.854583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58231b-9fd6-41fc-802f-7ba46f69dfc4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:44.854867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58231b-9fd6-41fc-802f-7ba46f69dfc4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:44.855144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58231b-9fd6-41fc-802f-7ba46f69dfc4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/b3010095c8bb4403ad10a5e6f129f394/implies/8c9f45f2ecc04ea1bf384b34e6a853a7` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:44.857005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58231b-9fd6-41fc-802f-7ba46f69dfc4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b3010095c8bb4403ad10a5e6f129f394, implied_role_id=8c9f45f2ecc04ea1bf384b34e6a853a7)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:44.858113 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-ec58231b-9fd6-41fc-802f-7ba46f69dfc4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:44.858113 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:44.858113 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:44.859004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58231b-9fd6-41fc-802f-7ba46f69dfc4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:44.869165 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4130/8222] 10.222.0.43 () {58 vars in 1346 bytes} [Sat Jul 2 21:39:44 2022] DELETE /identity/v3/roles/b3010095c8bb4403ad10a5e6f129f394/implies/8c9f45f2ecc04ea1bf384b34e6a853a7 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:44.873484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434b106-d252-4b13-b874-02a4f517ba6d tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:44.884224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434b106-d252-4b13-b874-02a4f517ba6d tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:44.942862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd470de-c55b-43e9-9589-4e31923c14c6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:44.943741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd470de-c55b-43e9-9589-4e31923c14c6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:44.944026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd470de-c55b-43e9-9589-4e31923c14c6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:44.944339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd470de-c55b-43e9-9589-4e31923c14c6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/8c9f45f2ecc04ea1bf384b34e6a853a7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:44.945631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd470de-c55b-43e9-9589-4e31923c14c6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=8c9f45f2ecc04ea1bf384b34e6a853a7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:44.947239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd470de-c55b-43e9-9589-4e31923c14c6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:44.988354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dcd470de-c55b-43e9-9589-4e31923c14c6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invalidating the token cache because role 8c9f45f2ecc04ea1bf384b34e6a853a7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:44.988636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dcd470de-c55b-43e9-9589-4e31923c14c6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:44.989395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-dcd470de-c55b-43e9-9589-4e31923c14c6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:44.991292 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4093/8223] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:44 2022] DELETE /identity/v3/roles/8c9f45f2ecc04ea1bf384b34e6a853a7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:44.995735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58231b-9fd6-41fc-802f-7ba46f69dfc4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:44.997745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ec58231b-9fd6-41fc-802f-7ba46f69dfc4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:45.011188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58231b-9fd6-41fc-802f-7ba46f69dfc4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:45.070508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fa474-c69a-4492-97f8-d6a1712aead2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:45.071338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fa474-c69a-4492-97f8-d6a1712aead2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:45.071623 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fa474-c69a-4492-97f8-d6a1712aead2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:45.071905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fa474-c69a-4492-97f8-d6a1712aead2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/domains/d686b7ba0e0d4c0da19bbd3338cf49ea` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:45.083590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fa474-c69a-4492-97f8-d6a1712aead2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d686b7ba0e0d4c0da19bbd3338cf49ea)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:45.085276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fa474-c69a-4492-97f8-d6a1712aead2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:45.105100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-596fa474-c69a-4492-97f8-d6a1712aead2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd686b7ba0e0d4c0da19bbd3338cf49ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:45.105879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-596fa474-c69a-4492-97f8-d6a1712aead2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd686b7ba0e0d4c0da19bbd3338cf49ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:45.131287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-596fa474-c69a-4492-97f8-d6a1712aead2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd686b7ba0e0d4c0da19bbd3338cf49ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:45.132089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-596fa474-c69a-4492-97f8-d6a1712aead2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd686b7ba0e0d4c0da19bbd3338cf49ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:45.134694 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4131/8224] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:39:44 2022] PATCH /identity/v3/domains/d686b7ba0e0d4c0da19bbd3338cf49ea => generated 277 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:45.139122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd470de-c55b-43e9-9589-4e31923c14c6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:45.149760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd470de-c55b-43e9-9589-4e31923c14c6 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:45.211017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:45.211930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:45.212245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:45.212640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/domains/d686b7ba0e0d4c0da19bbd3338cf49ea` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:45.224181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d686b7ba0e0d4c0da19bbd3338cf49ea)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:45.225836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:45.231814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:45.250365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd686b7ba0e0d4c0da19bbd3338cf49ea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:45.260641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd686b7ba0e0d4c0da19bbd3338cf49ea'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:45.302846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd686b7ba0e0d4c0da19bbd3338cf49ea', 'request_id': 'req-e001831b-04e5-4756-899e-ffe83fdad91e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:45.310870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd686b7ba0e0d4c0da19bbd3338cf49ea', 'request_id': 'req-e001831b-04e5-4756-899e-ffe83fdad91e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:45.316655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd686b7ba0e0d4c0da19bbd3338cf49ea', 'request_id': 'req-e001831b-04e5-4756-899e-ffe83fdad91e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:45.332719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] The token cache is being invalidate because project d686b7ba0e0d4c0da19bbd3338cf49ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:45.332990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:45.333948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:45.345136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd686b7ba0e0d4c0da19bbd3338cf49ea', 'request_id': 'req-e001831b-04e5-4756-899e-ffe83fdad91e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:45.345776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd686b7ba0e0d4c0da19bbd3338cf49ea', 'request_id': 'req-e001831b-04e5-4756-899e-ffe83fdad91e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:45.346404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd686b7ba0e0d4c0da19bbd3338cf49ea', 'request_id': 'req-e001831b-04e5-4756-899e-ffe83fdad91e'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:45.354892 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4094/8225] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:39:45 2022] DELETE /identity/v3/domains/d686b7ba0e0d4c0da19bbd3338cf49ea => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:45.359200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fa474-c69a-4492-97f8-d6a1712aead2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:45.360903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-596fa474-c69a-4492-97f8-d6a1712aead2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:45.374630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fa474-c69a-4492-97f8-d6a1712aead2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:45.439606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a659ce-a358-4980-9da3-b3be4dc9d049 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:45.440587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a659ce-a358-4980-9da3-b3be4dc9d049 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:45.440875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a659ce-a358-4980-9da3-b3be4dc9d049 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:45.441178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a659ce-a358-4980-9da3-b3be4dc9d049 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/b3010095c8bb4403ad10a5e6f129f394/implies/1479c1f29f2b41279a513b5f1c61fde6` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:45.442987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a659ce-a358-4980-9da3-b3be4dc9d049 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b3010095c8bb4403ad10a5e6f129f394, implied_role_id=1479c1f29f2b41279a513b5f1c61fde6)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:45.444653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a659ce-a358-4980-9da3-b3be4dc9d049 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:45.455775 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4132/8226] 10.222.0.43 () {58 vars in 1346 bytes} [Sat Jul 2 21:39:45 2022] DELETE /identity/v3/roles/b3010095c8bb4403ad10a5e6f129f394/implies/1479c1f29f2b41279a513b5f1c61fde6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:45.460239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:45.462494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:45.477326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001831b-04e5-4756-899e-ffe83fdad91e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:45.535056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44050da5-4bc4-4ce3-8a6b-206451314125 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:45.536018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44050da5-4bc4-4ce3-8a6b-206451314125 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:45.536248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44050da5-4bc4-4ce3-8a6b-206451314125 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:45.536471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44050da5-4bc4-4ce3-8a6b-206451314125 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/1479c1f29f2b41279a513b5f1c61fde6` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:45.537712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44050da5-4bc4-4ce3-8a6b-206451314125 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=1479c1f29f2b41279a513b5f1c61fde6)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:45.539357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44050da5-4bc4-4ce3-8a6b-206451314125 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:45.574660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-44050da5-4bc4-4ce3-8a6b-206451314125 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invalidating the token cache because role 1479c1f29f2b41279a513b5f1c61fde6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:45.574947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-44050da5-4bc4-4ce3-8a6b-206451314125 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:45.575622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-44050da5-4bc4-4ce3-8a6b-206451314125 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:45.577556 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4095/8227] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:45 2022] DELETE /identity/v3/roles/1479c1f29f2b41279a513b5f1c61fde6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:45.581875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a659ce-a358-4980-9da3-b3be4dc9d049 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:45.583670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f5a659ce-a358-4980-9da3-b3be4dc9d049 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:45.591756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:45.598555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a659ce-a358-4980-9da3-b3be4dc9d049 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:45.659777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be8712-cebd-4752-8930-b3f5c9be8065 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:45.660691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be8712-cebd-4752-8930-b3f5c9be8065 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:45.660954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be8712-cebd-4752-8930-b3f5c9be8065 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:45.661266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be8712-cebd-4752-8930-b3f5c9be8065 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/b3010095c8bb4403ad10a5e6f129f394` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:45.662508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be8712-cebd-4752-8930-b3f5c9be8065 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=b3010095c8bb4403ad10a5e6f129f394)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:45.663553 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-e2be8712-cebd-4752-8930-b3f5c9be8065 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:45.663553 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:45.663553 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:45.664495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be8712-cebd-4752-8930-b3f5c9be8065 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:45.702047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e2be8712-cebd-4752-8930-b3f5c9be8065 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invalidating the token cache because role b3010095c8bb4403ad10a5e6f129f394 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:45.702338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e2be8712-cebd-4752-8930-b3f5c9be8065 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:45.703066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-e2be8712-cebd-4752-8930-b3f5c9be8065 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:45.705020 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4133/8228] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:45 2022] DELETE /identity/v3/roles/b3010095c8bb4403ad10a5e6f129f394 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:45.711481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44050da5-4bc4-4ce3-8a6b-206451314125 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:45.721975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44050da5-4bc4-4ce3-8a6b-206451314125 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:45.733747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:45.781434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425150a-0af4-47e7-b6a9-f81516e86a37 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:45.782393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425150a-0af4-47e7-b6a9-f81516e86a37 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:45.782650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425150a-0af4-47e7-b6a9-f81516e86a37 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:45.782909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425150a-0af4-47e7-b6a9-f81516e86a37 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:45.784774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425150a-0af4-47e7-b6a9-f81516e86a37 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e460451f62974c51beec4af38e400225, implied_role_id=4de34ec25d0e4102a892d0e202751609)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:45.786391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425150a-0af4-47e7-b6a9-f81516e86a37 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:45.813914 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4096/8229] 10.222.0.43 () {60 vars in 1362 bytes} [Sat Jul 2 21:39:45 2022] PUT /identity/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609 => generated 520 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:45.818250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be8712-cebd-4752-8930-b3f5c9be8065 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:45.819793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e2be8712-cebd-4752-8930-b3f5c9be8065 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:45.833946 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be8712-cebd-4752-8930-b3f5c9be8065 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:45.895945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513d578-31fb-45f8-9fc6-5a754b85049a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:45.896915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513d578-31fb-45f8-9fc6-5a754b85049a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:45.897227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513d578-31fb-45f8-9fc6-5a754b85049a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:45.897506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513d578-31fb-45f8-9fc6-5a754b85049a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:45.899262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513d578-31fb-45f8-9fc6-5a754b85049a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=e460451f62974c51beec4af38e400225, implied_role_id=4de34ec25d0e4102a892d0e202751609)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:45.900338 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-0513d578-31fb-45f8-9fc6-5a754b85049a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:45.900338 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:45.900338 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:45.901233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513d578-31fb-45f8-9fc6-5a754b85049a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:45.902162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513d578-31fb-45f8-9fc6-5a754b85049a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=e460451f62974c51beec4af38e400225, implied_role_id=4de34ec25d0e4102a892d0e202751609)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:45.903042 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-0513d578-31fb-45f8-9fc6-5a754b85049a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:45.903042 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:45.903042 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:45.903861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513d578-31fb-45f8-9fc6-5a754b85049a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:45.909550 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4134/8230] 10.222.0.43 () {58 vars in 1344 bytes} [Sat Jul 2 21:39:45 2022] HEAD /identity/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:45.914002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425150a-0af4-47e7-b6a9-f81516e86a37 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:45.925575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425150a-0af4-47e7-b6a9-f81516e86a37 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:45.931372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0e006-45d7-42ca-96ab-1b5c6cb831c0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:45.932329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0e006-45d7-42ca-96ab-1b5c6cb831c0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:45.932615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0e006-45d7-42ca-96ab-1b5c6cb831c0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:45.932894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0e006-45d7-42ca-96ab-1b5c6cb831c0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:45.934738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0e006-45d7-42ca-96ab-1b5c6cb831c0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=e460451f62974c51beec4af38e400225, implied_role_id=4de34ec25d0e4102a892d0e202751609)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:45.935805 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-15a0e006-45d7-42ca-96ab-1b5c6cb831c0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:45.935805 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:45.935805 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:45.937377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0e006-45d7-42ca-96ab-1b5c6cb831c0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:45.943638 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4097/8231] 10.222.0.43 () {58 vars in 1343 bytes} [Sat Jul 2 21:39:45 2022] GET /identity/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609 => generated 520 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:45.947862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513d578-31fb-45f8-9fc6-5a754b85049a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:45.958622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513d578-31fb-45f8-9fc6-5a754b85049a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:45.964693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dec16c-73f0-47de-be82-734a980f28af tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:45.965627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dec16c-73f0-47de-be82-734a980f28af tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:45.965906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dec16c-73f0-47de-be82-734a980f28af tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:45.966185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dec16c-73f0-47de-be82-734a980f28af tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:45.968210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dec16c-73f0-47de-be82-734a980f28af tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e460451f62974c51beec4af38e400225, implied_role_id=4de34ec25d0e4102a892d0e202751609)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:45.969918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dec16c-73f0-47de-be82-734a980f28af tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:45.979795 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4135/8232] 10.222.0.43 () {58 vars in 1346 bytes} [Sat Jul 2 21:39:45 2022] DELETE /identity/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:45.984307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0e006-45d7-42ca-96ab-1b5c6cb831c0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:45.994812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0e006-45d7-42ca-96ab-1b5c6cb831c0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:46.057550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd58c4-e4d5-46ff-a674-1c8891fe0e2a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:46.058462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd58c4-e4d5-46ff-a674-1c8891fe0e2a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:46.058744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd58c4-e4d5-46ff-a674-1c8891fe0e2a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:46.059022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd58c4-e4d5-46ff-a674-1c8891fe0e2a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:46.061054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd58c4-e4d5-46ff-a674-1c8891fe0e2a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=e460451f62974c51beec4af38e400225, implied_role_id=4de34ec25d0e4102a892d0e202751609)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:46.062732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd58c4-e4d5-46ff-a674-1c8891fe0e2a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:46.078719 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-6ffd58c4-e4d5-46ff-a674-1c8891fe0e2a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] e460451f62974c51beec4af38e400225 does not imply 4de34ec25d0e4102a892d0e202751609.: keystone.exception.ImpliedRoleNotFound: e460451f62974c51beec4af38e400225 does not imply 4de34ec25d0e4102a892d0e202751609. Jul 02 21:39:46.078719 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:46.078719 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 02 21:39:46.078719 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = query.one() Jul 02 21:39:46.078719 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 02 21:39:46.078719 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._iter().one() Jul 02 21:39:46.078719 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 02 21:39:46.078719 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._only_one_row( Jul 02 21:39:46.078719 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 02 21:39:46.078719 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 02 21:39:46.078719 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 02 21:39:46.078719 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:39:46.078719 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:39:46.078719 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:39:46.078719 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:46.078719 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:39:46.080268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:39:46.080268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:39:46.080268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:39:46.080268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:39:46.080268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:39:46.080268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:39:46.080268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:39:46.080268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:39:46.080268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:39:46.080268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Jul 02 21:39:46.080268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Jul 02 21:39:46.080268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Jul 02 21:39:46.080268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Jul 02 21:39:46.080268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Jul 02 21:39:46.080268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 02 21:39:46.080268 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 02 21:39:46.081423 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 02 21:39:46.081423 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: e460451f62974c51beec4af38e400225 does not imply 4de34ec25d0e4102a892d0e202751609. Jul 02 21:39:46.081423 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:39:46.081423 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4098/8233] 10.222.0.43 () {58 vars in 1343 bytes} [Sat Jul 2 21:39:45 2022] GET /identity/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609 => generated 137 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:39:46.085186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dec16c-73f0-47de-be82-734a980f28af tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:46.098388 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dec16c-73f0-47de-be82-734a980f28af tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:46.103822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdae51-3d46-4fb9-a1e8-aa51d4dde9eb tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:46.104781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdae51-3d46-4fb9-a1e8-aa51d4dde9eb tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:46.105064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdae51-3d46-4fb9-a1e8-aa51d4dde9eb tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:46.105339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdae51-3d46-4fb9-a1e8-aa51d4dde9eb tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:46.107304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdae51-3d46-4fb9-a1e8-aa51d4dde9eb tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e460451f62974c51beec4af38e400225, implied_role_id=4de34ec25d0e4102a892d0e202751609)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:46.108964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdae51-3d46-4fb9-a1e8-aa51d4dde9eb tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:46.125955 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-25bdae51-3d46-4fb9-a1e8-aa51d4dde9eb tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] e460451f62974c51beec4af38e400225 does not imply 4de34ec25d0e4102a892d0e202751609.: keystone.exception.ImpliedRoleNotFound: e460451f62974c51beec4af38e400225 does not imply 4de34ec25d0e4102a892d0e202751609. Jul 02 21:39:46.125955 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:46.125955 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 02 21:39:46.125955 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = query.one() Jul 02 21:39:46.125955 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 02 21:39:46.125955 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._iter().one() Jul 02 21:39:46.125955 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 02 21:39:46.125955 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._only_one_row( Jul 02 21:39:46.125955 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 02 21:39:46.125955 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 02 21:39:46.125955 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 02 21:39:46.125955 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:39:46.125955 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:39:46.125955 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:39:46.125955 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:46.125955 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:39:46.127350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:39:46.127350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:39:46.127350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:39:46.127350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:39:46.127350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:39:46.127350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:39:46.127350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:39:46.127350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:39:46.127350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:39:46.127350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jul 02 21:39:46.127350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jul 02 21:39:46.127350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:46.127350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:46.127350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jul 02 21:39:46.127350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jul 02 21:39:46.127350 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jul 02 21:39:46.128597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 02 21:39:46.128597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 02 21:39:46.128597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 02 21:39:46.128597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: e460451f62974c51beec4af38e400225 does not imply 4de34ec25d0e4102a892d0e202751609. Jul 02 21:39:46.128597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:39:46.128597 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4136/8234] 10.222.0.43 () {58 vars in 1346 bytes} [Sat Jul 2 21:39:46 2022] DELETE /identity/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609 => generated 137 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:39:46.132373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd58c4-e4d5-46ff-a674-1c8891fe0e2a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:46.142598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd58c4-e4d5-46ff-a674-1c8891fe0e2a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:46.147759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac9b5a-77fb-4b6a-ba35-98c08bb257ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:46.148694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac9b5a-77fb-4b6a-ba35-98c08bb257ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:46.148986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac9b5a-77fb-4b6a-ba35-98c08bb257ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:46.149291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac9b5a-77fb-4b6a-ba35-98c08bb257ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:46.151039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac9b5a-77fb-4b6a-ba35-98c08bb257ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e460451f62974c51beec4af38e400225, implied_role_id=4de34ec25d0e4102a892d0e202751609)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:46.152661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac9b5a-77fb-4b6a-ba35-98c08bb257ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:46.181214 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4099/8235] 10.222.0.43 () {60 vars in 1362 bytes} [Sat Jul 2 21:39:46 2022] PUT /identity/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609 => generated 520 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:46.185456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdae51-3d46-4fb9-a1e8-aa51d4dde9eb tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:46.195504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdae51-3d46-4fb9-a1e8-aa51d4dde9eb tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:46.239252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:46.253320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1405f-2b9f-493b-ae32-552f15f73df3 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:46.254251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1405f-2b9f-493b-ae32-552f15f73df3 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:46.254540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1405f-2b9f-493b-ae32-552f15f73df3 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:46.254822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1405f-2b9f-493b-ae32-552f15f73df3 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225/implies/aeb934369bad4b1ba89e5942be520ac0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:46.256675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1405f-2b9f-493b-ae32-552f15f73df3 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e460451f62974c51beec4af38e400225, implied_role_id=aeb934369bad4b1ba89e5942be520ac0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:46.258306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1405f-2b9f-493b-ae32-552f15f73df3 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:46.282049 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4137/8236] 10.222.0.43 () {60 vars in 1362 bytes} [Sat Jul 2 21:39:46 2022] PUT /identity/v3/roles/e460451f62974c51beec4af38e400225/implies/aeb934369bad4b1ba89e5942be520ac0 => generated 521 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:39:46.286395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac9b5a-77fb-4b6a-ba35-98c08bb257ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:46.297072 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac9b5a-77fb-4b6a-ba35-98c08bb257ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:46.373232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20962c-6e78-445f-aea0-cb3c5bc1799e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:46.374078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20962c-6e78-445f-aea0-cb3c5bc1799e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:46.374366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20962c-6e78-445f-aea0-cb3c5bc1799e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:46.374648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20962c-6e78-445f-aea0-cb3c5bc1799e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/aeb934369bad4b1ba89e5942be520ac0/implies/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:46.379465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20962c-6e78-445f-aea0-cb3c5bc1799e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=aeb934369bad4b1ba89e5942be520ac0, implied_role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:46.381142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20962c-6e78-445f-aea0-cb3c5bc1799e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:46.382409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:46.411490 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4100/8237] 10.222.0.43 () {60 vars in 1362 bytes} [Sat Jul 2 21:39:46 2022] PUT /identity/v3/roles/aeb934369bad4b1ba89e5942be520ac0/implies/eb7fe192653146dfafc0e89eb818a58d => generated 521 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:39:46.416570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1405f-2b9f-493b-ae32-552f15f73df3 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:46.429278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1405f-2b9f-493b-ae32-552f15f73df3 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:46.489195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e9469-cd5c-4dad-a3ec-2e089e2ee36a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:46.489856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e9469-cd5c-4dad-a3ec-2e089e2ee36a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:46.490133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e9469-cd5c-4dad-a3ec-2e089e2ee36a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:46.490390 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e9469-cd5c-4dad-a3ec-2e089e2ee36a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:46.491018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e9469-cd5c-4dad-a3ec-2e089e2ee36a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:46.492077 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-d68e9469-cd5c-4dad-a3ec-2e089e2ee36a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:46.492077 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:46.492077 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:46.492957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e9469-cd5c-4dad-a3ec-2e089e2ee36a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:46.510287 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4138/8238] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:39:46 2022] GET /identity/v3/role_inferences => generated 1607 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:46.514931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20962c-6e78-445f-aea0-cb3c5bc1799e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:46.526548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20962c-6e78-445f-aea0-cb3c5bc1799e tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:46.532262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54630d7c-a36f-4b3a-a9c7-d4b03dc1951c tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:46.533219 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54630d7c-a36f-4b3a-a9c7-d4b03dc1951c tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:46.533507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54630d7c-a36f-4b3a-a9c7-d4b03dc1951c tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:46.533784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54630d7c-a36f-4b3a-a9c7-d4b03dc1951c tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/aeb934369bad4b1ba89e5942be520ac0/implies/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:46.535625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54630d7c-a36f-4b3a-a9c7-d4b03dc1951c tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=aeb934369bad4b1ba89e5942be520ac0, implied_role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:46.537280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54630d7c-a36f-4b3a-a9c7-d4b03dc1951c tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:46.548884 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4101/8239] 10.222.0.43 () {58 vars in 1346 bytes} [Sat Jul 2 21:39:46 2022] DELETE /identity/v3/roles/aeb934369bad4b1ba89e5942be520ac0/implies/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:46.554549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e9469-cd5c-4dad-a3ec-2e089e2ee36a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:46.570698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e9469-cd5c-4dad-a3ec-2e089e2ee36a tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:46.630023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8086e3-d673-4ab2-befc-01208757442f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:46.630879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8086e3-d673-4ab2-befc-01208757442f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:46.631170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8086e3-d673-4ab2-befc-01208757442f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:46.631453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8086e3-d673-4ab2-befc-01208757442f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225/implies/aeb934369bad4b1ba89e5942be520ac0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:46.633237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8086e3-d673-4ab2-befc-01208757442f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e460451f62974c51beec4af38e400225, implied_role_id=aeb934369bad4b1ba89e5942be520ac0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:46.634878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8086e3-d673-4ab2-befc-01208757442f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:46.644330 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4139/8240] 10.222.0.43 () {58 vars in 1346 bytes} [Sat Jul 2 21:39:46 2022] DELETE /identity/v3/roles/e460451f62974c51beec4af38e400225/implies/aeb934369bad4b1ba89e5942be520ac0 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:46.648793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54630d7c-a36f-4b3a-a9c7-d4b03dc1951c tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:46.659421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54630d7c-a36f-4b3a-a9c7-d4b03dc1951c tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:46.716838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2289c-f9b2-4dc5-94bb-3a15013e7642 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:46.717752 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2289c-f9b2-4dc5-94bb-3a15013e7642 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:46.718174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2289c-f9b2-4dc5-94bb-3a15013e7642 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:46.718459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2289c-f9b2-4dc5-94bb-3a15013e7642 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:46.720298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2289c-f9b2-4dc5-94bb-3a15013e7642 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e460451f62974c51beec4af38e400225, implied_role_id=4de34ec25d0e4102a892d0e202751609)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:46.722092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2289c-f9b2-4dc5-94bb-3a15013e7642 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:46.732018 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4102/8241] 10.222.0.43 () {58 vars in 1346 bytes} [Sat Jul 2 21:39:46 2022] DELETE /identity/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:46.737355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8086e3-d673-4ab2-befc-01208757442f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:46.748201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8086e3-d673-4ab2-befc-01208757442f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:46.802630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:46.812536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800c864-89c4-42ee-992f-06958e1a6b56 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:46.813332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800c864-89c4-42ee-992f-06958e1a6b56 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:46.813832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800c864-89c4-42ee-992f-06958e1a6b56 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:46.814327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800c864-89c4-42ee-992f-06958e1a6b56 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:46.815065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800c864-89c4-42ee-992f-06958e1a6b56 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:46.816945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800c864-89c4-42ee-992f-06958e1a6b56 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:46.828062 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4140/8242] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:46 2022] GET /identity/v3/roles => generated 2323 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:46.833196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2289c-f9b2-4dc5-94bb-3a15013e7642 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:46.846045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2289c-f9b2-4dc5-94bb-3a15013e7642 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:46.853909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629dae9-7d97-40b7-a94c-c353d8fa4c67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:46.854575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629dae9-7d97-40b7-a94c-c353d8fa4c67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:46.854866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629dae9-7d97-40b7-a94c-c353d8fa4c67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:46.855152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629dae9-7d97-40b7-a94c-c353d8fa4c67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:46.855895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629dae9-7d97-40b7-a94c-c353d8fa4c67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:46.857594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629dae9-7d97-40b7-a94c-c353d8fa4c67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:46.873338 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4103/8243] 10.222.0.43 () {60 vars in 1142 bytes} [Sat Jul 2 21:39:46 2022] POST /identity/v3/roles => generated 235 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:46.877602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800c864-89c4-42ee-992f-06958e1a6b56 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:46.888267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800c864-89c4-42ee-992f-06958e1a6b56 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:46.893173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167819b-3060-473e-9a29-90781b0ea60b tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:46.894035 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167819b-3060-473e-9a29-90781b0ea60b tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:46.894320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167819b-3060-473e-9a29-90781b0ea60b tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:46.894599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167819b-3060-473e-9a29-90781b0ea60b tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/4c0cdd37a53d40c8aeb5c7501396299c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:46.896201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167819b-3060-473e-9a29-90781b0ea60b tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:update_role(role_id=4c0cdd37a53d40c8aeb5c7501396299c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:46.897239 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-a167819b-3060-473e-9a29-90781b0ea60b tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:46.897239 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:46.897239 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:46.898120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167819b-3060-473e-9a29-90781b0ea60b tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:46.925775 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4141/8244] 10.222.0.43 () {60 vars in 1242 bytes} [Sat Jul 2 21:39:46 2022] PATCH /identity/v3/roles/4c0cdd37a53d40c8aeb5c7501396299c => generated 238 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:46.929796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629dae9-7d97-40b7-a94c-c353d8fa4c67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:46.941040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629dae9-7d97-40b7-a94c-c353d8fa4c67 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:46.946250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27acc6f-1a67-4143-8834-ed872b0def51 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:46.947116 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27acc6f-1a67-4143-8834-ed872b0def51 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:46.947395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27acc6f-1a67-4143-8834-ed872b0def51 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:46.947695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27acc6f-1a67-4143-8834-ed872b0def51 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/4c0cdd37a53d40c8aeb5c7501396299c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:46.956598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27acc6f-1a67-4143-8834-ed872b0def51 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:get_role(role_id=4c0cdd37a53d40c8aeb5c7501396299c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:46.958213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27acc6f-1a67-4143-8834-ed872b0def51 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:46.959591 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4104/8245] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:39:46 2022] GET /identity/v3/roles/4c0cdd37a53d40c8aeb5c7501396299c => generated 238 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:46.963862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167819b-3060-473e-9a29-90781b0ea60b tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:46.974845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167819b-3060-473e-9a29-90781b0ea60b tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:46.980821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7683e66-0d98-470b-bf7a-30c07d48414f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:46.981493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7683e66-0d98-470b-bf7a-30c07d48414f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:46.981757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7683e66-0d98-470b-bf7a-30c07d48414f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:46.982038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7683e66-0d98-470b-bf7a-30c07d48414f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:46.982945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7683e66-0d98-470b-bf7a-30c07d48414f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:46.984596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7683e66-0d98-470b-bf7a-30c07d48414f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:46.997052 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4142/8246] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:46 2022] GET /identity/v3/roles => generated 2552 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:47.003452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27acc6f-1a67-4143-8834-ed872b0def51 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:47.018220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27acc6f-1a67-4143-8834-ed872b0def51 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:47.023905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81f0c0-bc03-4e50-a5b6-a614bc77c241 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:47.025174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81f0c0-bc03-4e50-a5b6-a614bc77c241 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:47.025555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81f0c0-bc03-4e50-a5b6-a614bc77c241 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:47.026140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81f0c0-bc03-4e50-a5b6-a614bc77c241 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/4c0cdd37a53d40c8aeb5c7501396299c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:47.028321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81f0c0-bc03-4e50-a5b6-a614bc77c241 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4c0cdd37a53d40c8aeb5c7501396299c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:47.030198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81f0c0-bc03-4e50-a5b6-a614bc77c241 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:47.069084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4b81f0c0-bc03-4e50-a5b6-a614bc77c241 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invalidating the token cache because role 4c0cdd37a53d40c8aeb5c7501396299c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:47.069377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4b81f0c0-bc03-4e50-a5b6-a614bc77c241 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:47.070345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4b81f0c0-bc03-4e50-a5b6-a614bc77c241 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:47.073276 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4105/8247] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:47 2022] DELETE /identity/v3/roles/4c0cdd37a53d40c8aeb5c7501396299c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:47.078585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7683e66-0d98-470b-bf7a-30c07d48414f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:47.080490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f7683e66-0d98-470b-bf7a-30c07d48414f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:47.094402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7683e66-0d98-470b-bf7a-30c07d48414f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:47.160462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4136bff-4be6-4ed9-a11d-08098b563dea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:47.161361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4136bff-4be6-4ed9-a11d-08098b563dea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:47.161644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4136bff-4be6-4ed9-a11d-08098b563dea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:47.161950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4136bff-4be6-4ed9-a11d-08098b563dea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:47.163762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4136bff-4be6-4ed9-a11d-08098b563dea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e460451f62974c51beec4af38e400225, implied_role_id=4de34ec25d0e4102a892d0e202751609)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:47.165442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4136bff-4be6-4ed9-a11d-08098b563dea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:47.191783 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4143/8248] 10.222.0.43 () {60 vars in 1362 bytes} [Sat Jul 2 21:39:47 2022] PUT /identity/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609 => generated 520 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:47.195979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81f0c0-bc03-4e50-a5b6-a614bc77c241 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:47.206407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81f0c0-bc03-4e50-a5b6-a614bc77c241 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:47.277542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5efcf3-f168-4f43-9609-f84b4847bb85 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:47.278512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5efcf3-f168-4f43-9609-f84b4847bb85 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:47.278828 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5efcf3-f168-4f43-9609-f84b4847bb85 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:47.279135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5efcf3-f168-4f43-9609-f84b4847bb85 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225/implies/aeb934369bad4b1ba89e5942be520ac0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:47.281065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5efcf3-f168-4f43-9609-f84b4847bb85 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e460451f62974c51beec4af38e400225, implied_role_id=aeb934369bad4b1ba89e5942be520ac0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:47.282710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5efcf3-f168-4f43-9609-f84b4847bb85 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:47.283889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:47.311410 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4106/8249] 10.222.0.43 () {60 vars in 1362 bytes} [Sat Jul 2 21:39:47 2022] PUT /identity/v3/roles/e460451f62974c51beec4af38e400225/implies/aeb934369bad4b1ba89e5942be520ac0 => generated 521 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:39:47.315597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4136bff-4be6-4ed9-a11d-08098b563dea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:47.326546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4136bff-4be6-4ed9-a11d-08098b563dea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:47.387014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd23bb-cd25-4d28-a3a1-b6405c5f3c12 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:47.387949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd23bb-cd25-4d28-a3a1-b6405c5f3c12 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:47.388268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd23bb-cd25-4d28-a3a1-b6405c5f3c12 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:47.388589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd23bb-cd25-4d28-a3a1-b6405c5f3c12 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/aeb934369bad4b1ba89e5942be520ac0/implies/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:47.390530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd23bb-cd25-4d28-a3a1-b6405c5f3c12 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=aeb934369bad4b1ba89e5942be520ac0, implied_role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:47.392213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd23bb-cd25-4d28-a3a1-b6405c5f3c12 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:47.417731 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4144/8250] 10.222.0.43 () {60 vars in 1362 bytes} [Sat Jul 2 21:39:47 2022] PUT /identity/v3/roles/aeb934369bad4b1ba89e5942be520ac0/implies/eb7fe192653146dfafc0e89eb818a58d => generated 521 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:47.422041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5efcf3-f168-4f43-9609-f84b4847bb85 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:47.433694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5efcf3-f168-4f43-9609-f84b4847bb85 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:47.495562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4584b-6ede-4dae-828c-b647419299f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:47.496464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4584b-6ede-4dae-828c-b647419299f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:47.496756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4584b-6ede-4dae-828c-b647419299f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:47.497028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4584b-6ede-4dae-828c-b647419299f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/aeb934369bad4b1ba89e5942be520ac0/implies` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:47.498486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4584b-6ede-4dae-828c-b647419299f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=aeb934369bad4b1ba89e5942be520ac0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:47.499530 ncdv-master-1 devstack@keystone.service[91077]: WARNING py.warnings [None req-05e4584b-6ede-4dae-828c-b647419299f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:47.499530 ncdv-master-1 devstack@keystone.service[91077]: warnings.warn(msg) Jul 02 21:39:47.499530 ncdv-master-1 devstack@keystone.service[91077]: Jul 02 21:39:47.500477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4584b-6ede-4dae-828c-b647419299f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:47.506567 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4107/8251] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:39:47 2022] GET /identity/v3/roles/aeb934369bad4b1ba89e5942be520ac0/implies => generated 490 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:47.510822 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd23bb-cd25-4d28-a3a1-b6405c5f3c12 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:47.521555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd23bb-cd25-4d28-a3a1-b6405c5f3c12 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:47.526828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f34d82-f01a-4243-9e2a-f39d524c4419 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:47.527678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f34d82-f01a-4243-9e2a-f39d524c4419 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:47.527961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f34d82-f01a-4243-9e2a-f39d524c4419 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:47.528263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f34d82-f01a-4243-9e2a-f39d524c4419 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225/implies` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:47.529581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f34d82-f01a-4243-9e2a-f39d524c4419 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=e460451f62974c51beec4af38e400225)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:47.530606 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-e6f34d82-f01a-4243-9e2a-f39d524c4419 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:39:47.530606 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:39:47.530606 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:39:47.531489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f34d82-f01a-4243-9e2a-f39d524c4419 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:47.538538 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4145/8252] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:39:47 2022] GET /identity/v3/roles/e460451f62974c51beec4af38e400225/implies => generated 660 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:47.542542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4584b-6ede-4dae-828c-b647419299f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:47.553493 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4584b-6ede-4dae-828c-b647419299f2 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:47.559226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0229dce-d97c-4c1a-8870-0717127e91e4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:47.560182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0229dce-d97c-4c1a-8870-0717127e91e4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:47.560546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0229dce-d97c-4c1a-8870-0717127e91e4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:47.560826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0229dce-d97c-4c1a-8870-0717127e91e4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/aeb934369bad4b1ba89e5942be520ac0/implies/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:47.562761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0229dce-d97c-4c1a-8870-0717127e91e4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=aeb934369bad4b1ba89e5942be520ac0, implied_role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:47.564438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0229dce-d97c-4c1a-8870-0717127e91e4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:47.574283 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4108/8253] 10.222.0.43 () {58 vars in 1346 bytes} [Sat Jul 2 21:39:47 2022] DELETE /identity/v3/roles/aeb934369bad4b1ba89e5942be520ac0/implies/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:47.578749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f34d82-f01a-4243-9e2a-f39d524c4419 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:47.589329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f34d82-f01a-4243-9e2a-f39d524c4419 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:47.594162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:47.649365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cbecc-d838-427f-9311-5ac1519355db tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:47.650301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cbecc-d838-427f-9311-5ac1519355db tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:47.650582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cbecc-d838-427f-9311-5ac1519355db tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:47.650855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cbecc-d838-427f-9311-5ac1519355db tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225/implies/aeb934369bad4b1ba89e5942be520ac0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:47.652776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cbecc-d838-427f-9311-5ac1519355db tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e460451f62974c51beec4af38e400225, implied_role_id=aeb934369bad4b1ba89e5942be520ac0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:47.654516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cbecc-d838-427f-9311-5ac1519355db tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:47.666025 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4146/8254] 10.222.0.43 () {58 vars in 1346 bytes} [Sat Jul 2 21:39:47 2022] DELETE /identity/v3/roles/e460451f62974c51beec4af38e400225/implies/aeb934369bad4b1ba89e5942be520ac0 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:47.672354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0229dce-d97c-4c1a-8870-0717127e91e4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:47.686542 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0229dce-d97c-4c1a-8870-0717127e91e4 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:47.753373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2a9b7-14ac-422c-9a63-7da253b7abab tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:47.754301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a9b7-14ac-422c-9a63-7da253b7abab tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:47.754577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a9b7-14ac-422c-9a63-7da253b7abab tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:47.754847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a9b7-14ac-422c-9a63-7da253b7abab tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:47.756774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2a9b7-14ac-422c-9a63-7da253b7abab tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e460451f62974c51beec4af38e400225, implied_role_id=4de34ec25d0e4102a892d0e202751609)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:47.758375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2a9b7-14ac-422c-9a63-7da253b7abab tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:47.769597 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4109/8255] 10.222.0.43 () {58 vars in 1346 bytes} [Sat Jul 2 21:39:47 2022] DELETE /identity/v3/roles/e460451f62974c51beec4af38e400225/implies/4de34ec25d0e4102a892d0e202751609 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:47.775730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cbecc-d838-427f-9311-5ac1519355db tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:47.786637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cbecc-d838-427f-9311-5ac1519355db tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:47.844932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681fec4-6b56-4256-994a-eb3fb5e314a0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:47.845809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681fec4-6b56-4256-994a-eb3fb5e314a0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:47.846076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681fec4-6b56-4256-994a-eb3fb5e314a0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:47.846350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681fec4-6b56-4256-994a-eb3fb5e314a0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/domains/d686b7ba0e0d4c0da19bbd3338cf49ea` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:47.853428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681fec4-6b56-4256-994a-eb3fb5e314a0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 21:39:47.863597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-f681fec4-6b56-4256-994a-eb3fb5e314a0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Could not find domain: d686b7ba0e0d4c0da19bbd3338cf49ea.: keystone.exception.DomainNotFound: Could not find domain: d686b7ba0e0d4c0da19bbd3338cf49ea. Jul 02 21:39:47.863597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:47.863597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 21:39:47.863597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 21:39:47.863597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:39:47.863597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:39:47.863597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:39:47.863597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:39:47.863597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d686b7ba0e0d4c0da19bbd3338cf49ea. Jul 02 21:39:47.863597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:39:47.863597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 21:39:47.863597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:39:47.863597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:47.863597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:39:47.863597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:39:47.863597 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:39:47.865004 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:39:47.865004 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:39:47.865004 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:39:47.865004 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:39:47.865004 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:39:47.865004 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:39:47.865004 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:39:47.865004 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 02 21:39:47.865004 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 02 21:39:47.865004 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 21:39:47.865004 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 21:39:47.865004 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 21:39:47.865004 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 21:39:47.865004 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:47.865004 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:47.865004 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 21:39:47.866189 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 21:39:47.866189 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 21:39:47.866189 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 21:39:47.866189 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 21:39:47.866189 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application with Lock( Jul 02 21:39:47.866189 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 21:39:47.866189 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self._enter() Jul 02 21:39:47.866189 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 21:39:47.866189 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 21:39:47.866189 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 21:39:47.866189 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.creator() Jul 02 21:39:47.866189 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 21:39:47.866189 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application created_value = creator( Jul 02 21:39:47.866189 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 21:39:47.866189 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 21:39:47.866189 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d686b7ba0e0d4c0da19bbd3338cf49ea. Jul 02 21:39:47.866189 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:39:47.867435 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4147/8256] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:39:47 2022] PATCH /identity/v3/domains/d686b7ba0e0d4c0da19bbd3338cf49ea => generated 112 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:39:47.869159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2a9b7-14ac-422c-9a63-7da253b7abab tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:47.880177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2a9b7-14ac-422c-9a63-7da253b7abab tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:47.885021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3480074-f5ab-489f-82cf-eb7200234616 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:47.885895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3480074-f5ab-489f-82cf-eb7200234616 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:47.886181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3480074-f5ab-489f-82cf-eb7200234616 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:47.886463 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3480074-f5ab-489f-82cf-eb7200234616 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/users/231703d6a42e4b0ca6d656b4c1309227` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:47.887776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3480074-f5ab-489f-82cf-eb7200234616 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_user(user_id=231703d6a42e4b0ca6d656b4c1309227)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:47.889803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3480074-f5ab-489f-82cf-eb7200234616 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:47.942444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f3480074-f5ab-489f-82cf-eb7200234616 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231703d6a42e4b0ca6d656b4c1309227'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:47.951926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f3480074-f5ab-489f-82cf-eb7200234616 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231703d6a42e4b0ca6d656b4c1309227'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:47.956949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:47.960958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f3480074-f5ab-489f-82cf-eb7200234616 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231703d6a42e4b0ca6d656b4c1309227'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:47.961879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f3480074-f5ab-489f-82cf-eb7200234616 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231703d6a42e4b0ca6d656b4c1309227'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:47.962781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f3480074-f5ab-489f-82cf-eb7200234616 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231703d6a42e4b0ca6d656b4c1309227'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:47.980213 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4110/8257] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:47 2022] DELETE /identity/v3/users/231703d6a42e4b0ca6d656b4c1309227 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:47.984442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681fec4-6b56-4256-994a-eb3fb5e314a0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:47.986206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f681fec4-6b56-4256-994a-eb3fb5e314a0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:47.999331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681fec4-6b56-4256-994a-eb3fb5e314a0 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:48.062005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ea96f-275b-4fd0-ae03-fbba96ff7a97 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:48.062913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ea96f-275b-4fd0-ae03-fbba96ff7a97 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:48.063169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ea96f-275b-4fd0-ae03-fbba96ff7a97 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:48.063447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ea96f-275b-4fd0-ae03-fbba96ff7a97 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/eb7fe192653146dfafc0e89eb818a58d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:48.065124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ea96f-275b-4fd0-ae03-fbba96ff7a97 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_role(role_id=eb7fe192653146dfafc0e89eb818a58d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:48.066752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ea96f-275b-4fd0-ae03-fbba96ff7a97 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:48.103455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a83ea96f-275b-4fd0-ae03-fbba96ff7a97 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invalidating the token cache because role eb7fe192653146dfafc0e89eb818a58d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:48.103738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a83ea96f-275b-4fd0-ae03-fbba96ff7a97 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.104488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a83ea96f-275b-4fd0-ae03-fbba96ff7a97 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.106432 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4148/8258] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:47 2022] DELETE /identity/v3/roles/eb7fe192653146dfafc0e89eb818a58d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:48.110693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3480074-f5ab-489f-82cf-eb7200234616 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:48.121044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3480074-f5ab-489f-82cf-eb7200234616 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:48.179054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2915a0-67d6-4fe9-bd3e-8fb3a5fc6bae tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:48.179946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2915a0-67d6-4fe9-bd3e-8fb3a5fc6bae tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:48.180259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2915a0-67d6-4fe9-bd3e-8fb3a5fc6bae tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:48.180532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2915a0-67d6-4fe9-bd3e-8fb3a5fc6bae tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/groups/d4a4b38229cd443eb0b90b0d7a78cc6a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:48.181831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2915a0-67d6-4fe9-bd3e-8fb3a5fc6bae tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d4a4b38229cd443eb0b90b0d7a78cc6a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:48.183742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2915a0-67d6-4fe9-bd3e-8fb3a5fc6bae tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:48.228752 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4111/8259] 10.222.0.43 () {58 vars in 1226 bytes} [Sat Jul 2 21:39:48 2022] DELETE /identity/v3/groups/d4a4b38229cd443eb0b90b0d7a78cc6a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:48.232919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ea96f-275b-4fd0-ae03-fbba96ff7a97 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:48.234374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a83ea96f-275b-4fd0-ae03-fbba96ff7a97 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:48.247146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ea96f-275b-4fd0-ae03-fbba96ff7a97 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:48.252516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:48.309249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddac3a-89d8-42f3-b53d-630a867aea88 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:48.310145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddac3a-89d8-42f3-b53d-630a867aea88 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:48.310484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddac3a-89d8-42f3-b53d-630a867aea88 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:48.310766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddac3a-89d8-42f3-b53d-630a867aea88 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/projects/9c004cc4ab874de09d88c1f0203c740c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:48.312512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddac3a-89d8-42f3-b53d-630a867aea88 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9c004cc4ab874de09d88c1f0203c740c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:48.314563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddac3a-89d8-42f3-b53d-630a867aea88 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:48.371961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-caddac3a-89d8-42f3-b53d-630a867aea88 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c004cc4ab874de09d88c1f0203c740c', 'request_id': 'req-caddac3a-89d8-42f3-b53d-630a867aea88'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.381313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-caddac3a-89d8-42f3-b53d-630a867aea88 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c004cc4ab874de09d88c1f0203c740c', 'request_id': 'req-caddac3a-89d8-42f3-b53d-630a867aea88'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.387741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-caddac3a-89d8-42f3-b53d-630a867aea88 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c004cc4ab874de09d88c1f0203c740c', 'request_id': 'req-caddac3a-89d8-42f3-b53d-630a867aea88'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.398129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-caddac3a-89d8-42f3-b53d-630a867aea88 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] The token cache is being invalidate because project 9c004cc4ab874de09d88c1f0203c740c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:48.398414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-caddac3a-89d8-42f3-b53d-630a867aea88 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.399125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-caddac3a-89d8-42f3-b53d-630a867aea88 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.400768 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4149/8260] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:39:48 2022] DELETE /identity/v3/projects/9c004cc4ab874de09d88c1f0203c740c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:48.405148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2915a0-67d6-4fe9-bd3e-8fb3a5fc6bae tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:48.407146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5d2915a0-67d6-4fe9-bd3e-8fb3a5fc6bae tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:48.421191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2915a0-67d6-4fe9-bd3e-8fb3a5fc6bae tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:48.480587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cf44d-f474-43a4-86b6-e6821091fc28 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:48.481378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cf44d-f474-43a4-86b6-e6821091fc28 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:48.481701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cf44d-f474-43a4-86b6-e6821091fc28 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:48.481968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cf44d-f474-43a4-86b6-e6821091fc28 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:48.483298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cf44d-f474-43a4-86b6-e6821091fc28 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c9f3ab2d7f764dc0b1e4946ea180ab2f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:48.484959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cf44d-f474-43a4-86b6-e6821091fc28 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:48.505449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7b1cf44d-f474-43a4-86b6-e6821091fc28 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c9f3ab2d7f764dc0b1e4946ea180ab2f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.506131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7b1cf44d-f474-43a4-86b6-e6821091fc28 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c9f3ab2d7f764dc0b1e4946ea180ab2f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.528624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:48.532641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7b1cf44d-f474-43a4-86b6-e6821091fc28 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c9f3ab2d7f764dc0b1e4946ea180ab2f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.533843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7b1cf44d-f474-43a4-86b6-e6821091fc28 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c9f3ab2d7f764dc0b1e4946ea180ab2f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.536673 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4112/8261] 10.222.0.43 () {60 vars in 1248 bytes} [Sat Jul 2 21:39:48 2022] PATCH /identity/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f => generated 276 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:48.540603 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddac3a-89d8-42f3-b53d-630a867aea88 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:48.551504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddac3a-89d8-42f3-b53d-630a867aea88 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:48.610846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:48.611723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:48.612012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:48.612328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:48.623560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c9f3ab2d7f764dc0b1e4946ea180ab2f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:48.625235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:48.649116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c9f3ab2d7f764dc0b1e4946ea180ab2f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.659817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c9f3ab2d7f764dc0b1e4946ea180ab2f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.661894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:48.703038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f3ab2d7f764dc0b1e4946ea180ab2f', 'request_id': 'req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.711935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f3ab2d7f764dc0b1e4946ea180ab2f', 'request_id': 'req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.718835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f3ab2d7f764dc0b1e4946ea180ab2f', 'request_id': 'req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.729719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] The token cache is being invalidate because project c9f3ab2d7f764dc0b1e4946ea180ab2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:48.730007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.730730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.738456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c9f3ab2d7f764dc0b1e4946ea180ab2f', 'request_id': 'req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.739117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c9f3ab2d7f764dc0b1e4946ea180ab2f', 'request_id': 'req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.739764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c9f3ab2d7f764dc0b1e4946ea180ab2f', 'request_id': 'req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.748317 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4150/8262] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:39:48 2022] DELETE /identity/v3/domains/c9f3ab2d7f764dc0b1e4946ea180ab2f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:48.752461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cf44d-f474-43a4-86b6-e6821091fc28 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:48.753877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7b1cf44d-f474-43a4-86b6-e6821091fc28 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:48.766858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cf44d-f474-43a4-86b6-e6821091fc28 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:48.827149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb153b65-a8f7-4f37-b2cb-1b389d19951f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:48.828026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb153b65-a8f7-4f37-b2cb-1b389d19951f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:48.828354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb153b65-a8f7-4f37-b2cb-1b389d19951f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:48.828646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb153b65-a8f7-4f37-b2cb-1b389d19951f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/aeb934369bad4b1ba89e5942be520ac0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:48.830119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb153b65-a8f7-4f37-b2cb-1b389d19951f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_role(role_id=aeb934369bad4b1ba89e5942be520ac0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:48.831739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb153b65-a8f7-4f37-b2cb-1b389d19951f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:48.869653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bb153b65-a8f7-4f37-b2cb-1b389d19951f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invalidating the token cache because role aeb934369bad4b1ba89e5942be520ac0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:48.870316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bb153b65-a8f7-4f37-b2cb-1b389d19951f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.870637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-bb153b65-a8f7-4f37-b2cb-1b389d19951f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.872589 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4113/8263] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:48 2022] DELETE /identity/v3/roles/aeb934369bad4b1ba89e5942be520ac0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:48.876788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:48.878225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:48.891114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac02062-edae-4726-8dfc-b98fbf4fb2ea tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:48.950775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e85852-2cd0-43d7-9079-7c8701044699 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:48.951717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e85852-2cd0-43d7-9079-7c8701044699 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:48.951999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e85852-2cd0-43d7-9079-7c8701044699 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:48.952307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e85852-2cd0-43d7-9079-7c8701044699 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/4de34ec25d0e4102a892d0e202751609` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:48.953840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e85852-2cd0-43d7-9079-7c8701044699 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4de34ec25d0e4102a892d0e202751609)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:48.955475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e85852-2cd0-43d7-9079-7c8701044699 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:48.992270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f8e85852-2cd0-43d7-9079-7c8701044699 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invalidating the token cache because role 4de34ec25d0e4102a892d0e202751609 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:48.992477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f8e85852-2cd0-43d7-9079-7c8701044699 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.993227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f8e85852-2cd0-43d7-9079-7c8701044699 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:48.995280 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4151/8264] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:48 2022] DELETE /identity/v3/roles/4de34ec25d0e4102a892d0e202751609 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:48.999566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb153b65-a8f7-4f37-b2cb-1b389d19951f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:49.001148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bb153b65-a8f7-4f37-b2cb-1b389d19951f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:49.014428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb153b65-a8f7-4f37-b2cb-1b389d19951f tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:49.090859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909ba8b-bfde-4c32-a0d5-78c37925a060 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6429b680465444f4aac946fb78777a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b788b2d48fda4a74a3e42b97c5aee09c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:49.092029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909ba8b-bfde-4c32-a0d5-78c37925a060 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:49.092347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909ba8b-bfde-4c32-a0d5-78c37925a060 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:49.092624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909ba8b-bfde-4c32-a0d5-78c37925a060 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] PATH_INFO: `/v3/roles/e460451f62974c51beec4af38e400225` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:49.094172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909ba8b-bfde-4c32-a0d5-78c37925a060 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e460451f62974c51beec4af38e400225)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:49.095811 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909ba8b-bfde-4c32-a0d5-78c37925a060 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:49.134584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f909ba8b-bfde-4c32-a0d5-78c37925a060 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invalidating the token cache because role e460451f62974c51beec4af38e400225 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:49.134983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f909ba8b-bfde-4c32-a0d5-78c37925a060 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:49.136226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-f909ba8b-bfde-4c32-a0d5-78c37925a060 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:49.139519 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4114/8265] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:48 2022] DELETE /identity/v3/roles/e460451f62974c51beec4af38e400225 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:49.145339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e85852-2cd0-43d7-9079-7c8701044699 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:49.147410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f8e85852-2cd0-43d7-9079-7c8701044699 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:49.205132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:49.230036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e85852-2cd0-43d7-9079-7c8701044699 tempest-RolesV3TestJSON-978523041 tempest-RolesV3TestJSON-978523041-project-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:49.287901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da0f8b-4c92-4b2a-b667-56fb640a214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:49.288739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da0f8b-4c92-4b2a-b667-56fb640a214c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:49.289021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da0f8b-4c92-4b2a-b667-56fb640a214c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:49.289297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da0f8b-4c92-4b2a-b667-56fb640a214c admin admin] PATH_INFO: `/v3/users/cf02a4dd2e9749adbd00ad430a25a039` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:49.290573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da0f8b-4c92-4b2a-b667-56fb640a214c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf02a4dd2e9749adbd00ad430a25a039)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:49.292564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da0f8b-4c92-4b2a-b667-56fb640a214c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:49.348363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-23da0f8b-4c92-4b2a-b667-56fb640a214c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf02a4dd2e9749adbd00ad430a25a039'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:49.357425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-23da0f8b-4c92-4b2a-b667-56fb640a214c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf02a4dd2e9749adbd00ad430a25a039'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:49.358068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-23da0f8b-4c92-4b2a-b667-56fb640a214c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf02a4dd2e9749adbd00ad430a25a039'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:49.358739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-23da0f8b-4c92-4b2a-b667-56fb640a214c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf02a4dd2e9749adbd00ad430a25a039'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:49.365793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-23da0f8b-4c92-4b2a-b667-56fb640a214c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf02a4dd2e9749adbd00ad430a25a039'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:49.383219 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4152/8266] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:49 2022] DELETE /identity/v3/users/cf02a4dd2e9749adbd00ad430a25a039 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:49.388065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ea627-4100-4696-a865-24b5885bcbe1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:49.388420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ea627-4100-4696-a865-24b5885bcbe1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:49.388698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ea627-4100-4696-a865-24b5885bcbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:49.406640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-705ea627-4100-4696-a865-24b5885bcbe1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:49.407833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-705ea627-4100-4696-a865-24b5885bcbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:49.434847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:49.477868 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4115/8267] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:49.488646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da0f8b-4c92-4b2a-b667-56fb640a214c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:49.490456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-23da0f8b-4c92-4b2a-b667-56fb640a214c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:49.557882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da0f8b-4c92-4b2a-b667-56fb640a214c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:49.562556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd74c39-014e-4057-a17d-a8677ccf7698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:49.563214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd74c39-014e-4057-a17d-a8677ccf7698 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:49.563497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd74c39-014e-4057-a17d-a8677ccf7698 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:49.563776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd74c39-014e-4057-a17d-a8677ccf7698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:49.573307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd74c39-014e-4057-a17d-a8677ccf7698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:49.574763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd74c39-014e-4057-a17d-a8677ccf7698 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:49.584684 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4153/8268] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:39:49.868220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ea627-4100-4696-a865-24b5885bcbe1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:49.869919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-705ea627-4100-4696-a865-24b5885bcbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:49.882552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ea627-4100-4696-a865-24b5885bcbe1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:49.887222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ac9bd-37c7-44f2-a4f8-d1e0bd0cd688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:49.888315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ac9bd-37c7-44f2-a4f8-d1e0bd0cd688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:49.888608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ac9bd-37c7-44f2-a4f8-d1e0bd0cd688 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:49.888883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ac9bd-37c7-44f2-a4f8-d1e0bd0cd688 admin admin] PATH_INFO: `/v3/projects/34acd883771b405d999cae4424a6e300` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:49.890103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ac9bd-37c7-44f2-a4f8-d1e0bd0cd688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34acd883771b405d999cae4424a6e300)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:49.892175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ac9bd-37c7-44f2-a4f8-d1e0bd0cd688 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:49.940425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7b6ac9bd-37c7-44f2-a4f8-d1e0bd0cd688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34acd883771b405d999cae4424a6e300', 'request_id': 'req-7b6ac9bd-37c7-44f2-a4f8-d1e0bd0cd688'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:49.946957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7b6ac9bd-37c7-44f2-a4f8-d1e0bd0cd688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34acd883771b405d999cae4424a6e300', 'request_id': 'req-7b6ac9bd-37c7-44f2-a4f8-d1e0bd0cd688'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:49.952956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7b6ac9bd-37c7-44f2-a4f8-d1e0bd0cd688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34acd883771b405d999cae4424a6e300', 'request_id': 'req-7b6ac9bd-37c7-44f2-a4f8-d1e0bd0cd688'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:49.966575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7b6ac9bd-37c7-44f2-a4f8-d1e0bd0cd688 admin admin] The token cache is being invalidate because project 34acd883771b405d999cae4424a6e300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:49.966862 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7b6ac9bd-37c7-44f2-a4f8-d1e0bd0cd688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:49.967478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7b6ac9bd-37c7-44f2-a4f8-d1e0bd0cd688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:49.969109 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4116/8269] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:39:49 2022] DELETE /identity/v3/projects/34acd883771b405d999cae4424a6e300 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:49.973318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd74c39-014e-4057-a17d-a8677ccf7698 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:49.983588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd74c39-014e-4057-a17d-a8677ccf7698 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:49.992245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:50.045546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e480cc7-82cd-48c7-8141-4054bc62c09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:50.046445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e480cc7-82cd-48c7-8141-4054bc62c09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:50.046864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e480cc7-82cd-48c7-8141-4054bc62c09f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:50.047149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e480cc7-82cd-48c7-8141-4054bc62c09f admin admin] PATH_INFO: `/v3/users/6429b680465444f4aac946fb78777a79` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:50.048823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e480cc7-82cd-48c7-8141-4054bc62c09f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6429b680465444f4aac946fb78777a79)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:50.050861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e480cc7-82cd-48c7-8141-4054bc62c09f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:50.100065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e480cc7-82cd-48c7-8141-4054bc62c09f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6429b680465444f4aac946fb78777a79'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:50.108954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e480cc7-82cd-48c7-8141-4054bc62c09f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6429b680465444f4aac946fb78777a79'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:50.109593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e480cc7-82cd-48c7-8141-4054bc62c09f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6429b680465444f4aac946fb78777a79'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:50.110268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e480cc7-82cd-48c7-8141-4054bc62c09f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6429b680465444f4aac946fb78777a79'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:50.117543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-9e480cc7-82cd-48c7-8141-4054bc62c09f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6429b680465444f4aac946fb78777a79'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:50.135337 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4154/8270] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:49 2022] DELETE /identity/v3/users/6429b680465444f4aac946fb78777a79 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:50.429982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ac9bd-37c7-44f2-a4f8-d1e0bd0cd688 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:50.431514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7b6ac9bd-37c7-44f2-a4f8-d1e0bd0cd688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:50.444829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ac9bd-37c7-44f2-a4f8-d1e0bd0cd688 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:50.502154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e5687-2c07-4709-b555-7bb33a6076cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:50.503043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e5687-2c07-4709-b555-7bb33a6076cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:50.503326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e5687-2c07-4709-b555-7bb33a6076cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:50.503603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e5687-2c07-4709-b555-7bb33a6076cf admin admin] PATH_INFO: `/v3/projects/b788b2d48fda4a74a3e42b97c5aee09c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:50.504840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e5687-2c07-4709-b555-7bb33a6076cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b788b2d48fda4a74a3e42b97c5aee09c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:50.506765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e5687-2c07-4709-b555-7bb33a6076cf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:50.559550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-635e5687-2c07-4709-b555-7bb33a6076cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b788b2d48fda4a74a3e42b97c5aee09c', 'request_id': 'req-635e5687-2c07-4709-b555-7bb33a6076cf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:50.566236 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-635e5687-2c07-4709-b555-7bb33a6076cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b788b2d48fda4a74a3e42b97c5aee09c', 'request_id': 'req-635e5687-2c07-4709-b555-7bb33a6076cf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:50.568300 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:50.573742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-635e5687-2c07-4709-b555-7bb33a6076cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b788b2d48fda4a74a3e42b97c5aee09c', 'request_id': 'req-635e5687-2c07-4709-b555-7bb33a6076cf'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:50.587452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-635e5687-2c07-4709-b555-7bb33a6076cf admin admin] The token cache is being invalidate because project b788b2d48fda4a74a3e42b97c5aee09c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:50.587742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-635e5687-2c07-4709-b555-7bb33a6076cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:50.588407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-635e5687-2c07-4709-b555-7bb33a6076cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:50.590230 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4117/8271] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:39:50 2022] DELETE /identity/v3/projects/b788b2d48fda4a74a3e42b97c5aee09c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:50.596078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6624981-d77d-4b11-8fb5-81a6e2f1c0f6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:50.596636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6624981-d77d-4b11-8fb5-81a6e2f1c0f6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:50.596636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6624981-d77d-4b11-8fb5-81a6e2f1c0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:50.615250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a6624981-d77d-4b11-8fb5-81a6e2f1c0f6 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:50.616514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a6624981-d77d-4b11-8fb5-81a6e2f1c0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:50.678042 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4155/8272] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:50.686970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27586c-9f31-4bc4-8cd3-4491ea06416b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:50.687420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27586c-9f31-4bc4-8cd3-4491ea06416b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:50.687702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27586c-9f31-4bc4-8cd3-4491ea06416b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:50.714559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-be27586c-9f31-4bc4-8cd3-4491ea06416b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:50.716215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-be27586c-9f31-4bc4-8cd3-4491ea06416b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:50.725086 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4118/8273] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:50.729533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6624981-d77d-4b11-8fb5-81a6e2f1c0f6 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:50.740298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6624981-d77d-4b11-8fb5-81a6e2f1c0f6 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:50.746201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c548a-1e3f-4bb9-bdde-a0f79a6ba1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:50.746893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c548a-1e3f-4bb9-bdde-a0f79a6ba1ed admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:50.747156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c548a-1e3f-4bb9-bdde-a0f79a6ba1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:50.747424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c548a-1e3f-4bb9-bdde-a0f79a6ba1ed admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:50.748287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c548a-1e3f-4bb9-bdde-a0f79a6ba1ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:39:50.748597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c548a-1e3f-4bb9-bdde-a0f79a6ba1ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:50.750227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c548a-1e3f-4bb9-bdde-a0f79a6ba1ed admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:50.762637 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4156/8274] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:50.767286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27586c-9f31-4bc4-8cd3-4491ea06416b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:50.776651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27586c-9f31-4bc4-8cd3-4491ea06416b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:50.782188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b4a4d-4dca-4fbb-a218-72bf95ca52e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:50.782847 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b4a4d-4dca-4fbb-a218-72bf95ca52e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:50.783130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b4a4d-4dca-4fbb-a218-72bf95ca52e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:50.783415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b4a4d-4dca-4fbb-a218-72bf95ca52e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:50.784161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b4a4d-4dca-4fbb-a218-72bf95ca52e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:50.786078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b4a4d-4dca-4fbb-a218-72bf95ca52e2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:50.812969 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4119/8275] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:39:50 2022] POST /identity/v3/projects => generated 359 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:50.817098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c548a-1e3f-4bb9-bdde-a0f79a6ba1ed admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:50.828222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c548a-1e3f-4bb9-bdde-a0f79a6ba1ed admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:50.840860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:50.891559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe6264-5071-498f-a49a-60da8559519d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:50.892280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe6264-5071-498f-a49a-60da8559519d admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:50.892565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe6264-5071-498f-a49a-60da8559519d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:50.892839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe6264-5071-498f-a49a-60da8559519d admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:50.893576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe6264-5071-498f-a49a-60da8559519d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:50.895533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe6264-5071-498f-a49a-60da8559519d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:50.918146 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4157/8276] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:50 2022] POST /identity/v3/users => generated 280 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:39:50.922836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b4a4d-4dca-4fbb-a218-72bf95ca52e2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:50.933499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b4a4d-4dca-4fbb-a218-72bf95ca52e2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:50.938237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5829963-f594-4baa-af25-901bd66518fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:50.938895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5829963-f594-4baa-af25-901bd66518fa admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:50.939177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5829963-f594-4baa-af25-901bd66518fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:50.939459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5829963-f594-4baa-af25-901bd66518fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:50.940217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5829963-f594-4baa-af25-901bd66518fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:50.941850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5829963-f594-4baa-af25-901bd66518fa admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:50.952758 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4120/8277] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:50.957257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe6264-5071-498f-a49a-60da8559519d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:50.967552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe6264-5071-498f-a49a-60da8559519d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:50.973013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2164f16-04f8-4131-8b3c-be1d075876cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:50.973705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2164f16-04f8-4131-8b3c-be1d075876cf admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:50.973988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2164f16-04f8-4131-8b3c-be1d075876cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:50.974265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2164f16-04f8-4131-8b3c-be1d075876cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:50.974977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2164f16-04f8-4131-8b3c-be1d075876cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:50.976621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2164f16-04f8-4131-8b3c-be1d075876cf admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:50.986745 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4158/8278] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:50.991035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5829963-f594-4baa-af25-901bd66518fa admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:51.001376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5829963-f594-4baa-af25-901bd66518fa admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:51.006499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0cc74-de46-413c-87d8-9647b4a83c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:51.007384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0cc74-de46-413c-87d8-9647b4a83c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:51.007693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0cc74-de46-413c-87d8-9647b4a83c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:51.007946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0cc74-de46-413c-87d8-9647b4a83c1e admin admin] PATH_INFO: `/v3/projects/d41a5927f0ab471d83285c32c9b16ba9/users/752d5b09ac924ea5a7cc3624729f08b4/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:51.024535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0cc74-de46-413c-87d8-9647b4a83c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41a5927f0ab471d83285c32c9b16ba9, user_id=752d5b09ac924ea5a7cc3624729f08b4, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:51.027197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0cc74-de46-413c-87d8-9647b4a83c1e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:51.046561 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4121/8279] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:50 2022] PUT /identity/v3/projects/d41a5927f0ab471d83285c32c9b16ba9/users/752d5b09ac924ea5a7cc3624729f08b4/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:51.059595 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f2057-1a30-49f1-96ed-c70390f50ad9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:51.059955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f2057-1a30-49f1-96ed-c70390f50ad9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:51.060408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f2057-1a30-49f1-96ed-c70390f50ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:51.093758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-352f2057-1a30-49f1-96ed-c70390f50ad9 None None] MFA Rules not processed for user `752d5b09ac924ea5a7cc3624729f08b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:51.094977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-352f2057-1a30-49f1-96ed-c70390f50ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:51.167945 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4159/8280] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:51 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:51.173849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d628389-1ed6-453a-9da7-08e64776950c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:51.174128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d628389-1ed6-453a-9da7-08e64776950c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:51.174405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d628389-1ed6-453a-9da7-08e64776950c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:51.192577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9d628389-1ed6-453a-9da7-08e64776950c None None] MFA Rules not processed for user `752d5b09ac924ea5a7cc3624729f08b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:51.193686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9d628389-1ed6-453a-9da7-08e64776950c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:51.197039 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4122/8281] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:51 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 21:39:51.202352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e033e3-910f-4e31-b991-a75ab8f837c1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:51.202634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e033e3-910f-4e31-b991-a75ab8f837c1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:51.202911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e033e3-910f-4e31-b991-a75ab8f837c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:51.219737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e5e033e3-910f-4e31-b991-a75ab8f837c1 None None] MFA Rules not processed for user `752d5b09ac924ea5a7cc3624729f08b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:51.220934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e5e033e3-910f-4e31-b991-a75ab8f837c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:51.224516 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4160/8282] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:51 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 21:39:51.228558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d628389-1ed6-453a-9da7-08e64776950c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:51.241031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d628389-1ed6-453a-9da7-08e64776950c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:51.246202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f852f5-f2af-48ed-861f-3cfc12c612b6 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752d5b09ac924ea5a7cc3624729f08b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41a5927f0ab471d83285c32c9b16ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:51.246844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f852f5-f2af-48ed-861f-3cfc12c612b6 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] REQUEST_METHOD: `HEAD` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:51.247130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f852f5-f2af-48ed-861f-3cfc12c612b6 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:51.247414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f852f5-f2af-48ed-861f-3cfc12c612b6 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:51.253979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f852f5-f2af-48ed-861f-3cfc12c612b6 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] RBAC: Authorizing `identity:check_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:51.255895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f852f5-f2af-48ed-861f-3cfc12c612b6 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:51.262081 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4123/8283] 10.222.0.43 () {56 vars in 1263 bytes} [Sat Jul 2 21:39:51 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Jul 02 21:39:51.265883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e033e3-910f-4e31-b991-a75ab8f837c1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:51.277996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e033e3-910f-4e31-b991-a75ab8f837c1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:51.282629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3586270-c27e-49ef-a2eb-26edd76e31f4 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752d5b09ac924ea5a7cc3624729f08b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41a5927f0ab471d83285c32c9b16ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:51.283308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3586270-c27e-49ef-a2eb-26edd76e31f4 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:51.283594 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3586270-c27e-49ef-a2eb-26edd76e31f4 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:51.283872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3586270-c27e-49ef-a2eb-26edd76e31f4 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:51.290384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3586270-c27e-49ef-a2eb-26edd76e31f4 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:51.292227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3586270-c27e-49ef-a2eb-26edd76e31f4 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:51.298687 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4161/8284] 10.222.0.43 () {56 vars in 1262 bytes} [Sat Jul 2 21:39:51 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 21:39:51.303512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f852f5-f2af-48ed-861f-3cfc12c612b6 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:51.318810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f852f5-f2af-48ed-861f-3cfc12c612b6 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:51.327737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88685382-6d98-4ac3-9e2e-40f14e3698cb tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752d5b09ac924ea5a7cc3624729f08b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41a5927f0ab471d83285c32c9b16ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:51.328813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88685382-6d98-4ac3-9e2e-40f14e3698cb tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:51.329265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88685382-6d98-4ac3-9e2e-40f14e3698cb tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:51.329688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88685382-6d98-4ac3-9e2e-40f14e3698cb tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:51.341310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88685382-6d98-4ac3-9e2e-40f14e3698cb tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:51.342941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88685382-6d98-4ac3-9e2e-40f14e3698cb tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:51.359627 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4124/8285] 10.222.0.43 () {56 vars in 1265 bytes} [Sat Jul 2 21:39:51 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:51.363949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3586270-c27e-49ef-a2eb-26edd76e31f4 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:51.373438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3586270-c27e-49ef-a2eb-26edd76e31f4 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:51.377886 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865c929-5aec-4963-9da3-2b5ec5335630 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752d5b09ac924ea5a7cc3624729f08b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41a5927f0ab471d83285c32c9b16ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:51.378544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865c929-5aec-4963-9da3-2b5ec5335630 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] REQUEST_METHOD: `HEAD` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:51.378827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865c929-5aec-4963-9da3-2b5ec5335630 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:51.379107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865c929-5aec-4963-9da3-2b5ec5335630 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:51.381018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4865c929-5aec-4963-9da3-2b5ec5335630 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:51.392824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-4865c929-5aec-4963-9da3-2b5ec5335630 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 02 21:39:51.392824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:51.392824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:39:51.392824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:39:51.392824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:39:51.392824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:39:51.392824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:39:51.392824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:39:51.392824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:39:51.392824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:39:51.392824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:39:51.392824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:39:51.392824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Jul 02 21:39:51.392824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Jul 02 21:39:51.392824 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 02 21:39:51.394227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 02 21:39:51.394227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 02 21:39:51.394227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 02 21:39:51.394227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:51.394227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:51.394227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 02 21:39:51.394227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 02 21:39:51.394227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 02 21:39:51.394227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 02 21:39:51.394227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:51.394227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:51.394227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 02 21:39:51.394227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 02 21:39:51.394227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:51.394227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:51.394227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 02 21:39:51.394227 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 02 21:39:51.395724 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:51.395724 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:51.395724 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 02 21:39:51.395724 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 02 21:39:51.395724 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 02 21:39:51.395724 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:39:51.395724 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4162/8286] 10.222.0.43 () {56 vars in 1263 bytes} [Sat Jul 2 21:39:51 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Jul 02 21:39:51.399548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b31668-5eac-49f6-aa45-8df23267fc96 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:51.399837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b31668-5eac-49f6-aa45-8df23267fc96 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:51.400158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b31668-5eac-49f6-aa45-8df23267fc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:51.417897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-11b31668-5eac-49f6-aa45-8df23267fc96 None None] MFA Rules not processed for user `752d5b09ac924ea5a7cc3624729f08b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:51.419166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-11b31668-5eac-49f6-aa45-8df23267fc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:51.423328 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4125/8287] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:51 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 21:39:51.427444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865c929-5aec-4963-9da3-2b5ec5335630 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:51.436830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865c929-5aec-4963-9da3-2b5ec5335630 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:51.441478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2dffde-6d28-4192-8ae2-06c6c4b7c023 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752d5b09ac924ea5a7cc3624729f08b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41a5927f0ab471d83285c32c9b16ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:51.442119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dffde-6d28-4192-8ae2-06c6c4b7c023 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:51.442410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dffde-6d28-4192-8ae2-06c6c4b7c023 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:51.442756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dffde-6d28-4192-8ae2-06c6c4b7c023 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:51.449340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2dffde-6d28-4192-8ae2-06c6c4b7c023 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:51.451292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2dffde-6d28-4192-8ae2-06c6c4b7c023 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:51.457333 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4163/8288] 10.222.0.43 () {56 vars in 1262 bytes} [Sat Jul 2 21:39:51 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 21:39:51.461200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b31668-5eac-49f6-aa45-8df23267fc96 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:51.472741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b31668-5eac-49f6-aa45-8df23267fc96 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:51.477536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c3880-d070-40fd-9d2e-54ff8c67d817 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752d5b09ac924ea5a7cc3624729f08b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41a5927f0ab471d83285c32c9b16ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:51.478180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c3880-d070-40fd-9d2e-54ff8c67d817 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:51.478465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c3880-d070-40fd-9d2e-54ff8c67d817 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:51.478739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c3880-d070-40fd-9d2e-54ff8c67d817 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:51.485743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c3880-d070-40fd-9d2e-54ff8c67d817 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:51.487291 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c3880-d070-40fd-9d2e-54ff8c67d817 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:51.504402 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4126/8289] 10.222.0.43 () {56 vars in 1265 bytes} [Sat Jul 2 21:39:51 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:51.508548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2dffde-6d28-4192-8ae2-06c6c4b7c023 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:51.518139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2dffde-6d28-4192-8ae2-06c6c4b7c023 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:51.523426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7dcd7-6f3f-400d-ab4b-d49e6155c512 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752d5b09ac924ea5a7cc3624729f08b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41a5927f0ab471d83285c32c9b16ba9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:51.524087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7dcd7-6f3f-400d-ab4b-d49e6155c512 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:51.524353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7dcd7-6f3f-400d-ab4b-d49e6155c512 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:51.524648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7dcd7-6f3f-400d-ab4b-d49e6155c512 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:51.526493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2ce7dcd7-6f3f-400d-ab4b-d49e6155c512 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:51.539092 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application [None req-2ce7dcd7-6f3f-400d-ab4b-d49e6155c512 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 02 21:39:51.539092 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:39:51.539092 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:39:51.539092 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:39:51.539092 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:39:51.539092 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:39:51.539092 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:39:51.539092 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:39:51.539092 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:39:51.539092 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:39:51.539092 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:39:51.539092 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:39:51.539092 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jul 02 21:39:51.539092 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jul 02 21:39:51.539092 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 02 21:39:51.541050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 02 21:39:51.541050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 02 21:39:51.541050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 02 21:39:51.541050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:51.541050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:51.541050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 02 21:39:51.541050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 02 21:39:51.541050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 02 21:39:51.541050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 02 21:39:51.541050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:51.541050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:51.541050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 02 21:39:51.541050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 02 21:39:51.541050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:51.541050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:51.541050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 02 21:39:51.541050 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 02 21:39:51.543087 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:39:51.543087 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:39:51.543087 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 02 21:39:51.543087 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 02 21:39:51.543087 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 02 21:39:51.543087 ncdv-master-1 devstack@keystone.service[91078]: ERROR keystone.server.flask.application Jul 02 21:39:51.543087 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4164/8290] 10.222.0.43 () {56 vars in 1262 bytes} [Sat Jul 2 21:39:51 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 21:39:51.545635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c3880-d070-40fd-9d2e-54ff8c67d817 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:51.619258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c3880-d070-40fd-9d2e-54ff8c67d817 tempest-TokensV3Test-917282618 tempest-TokensV3Test-917282618-project] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:51.626168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e2825-7c03-4596-aba0-7ffc8de38aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:51.627054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e2825-7c03-4596-aba0-7ffc8de38aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:51.627339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e2825-7c03-4596-aba0-7ffc8de38aec admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:51.627613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e2825-7c03-4596-aba0-7ffc8de38aec admin admin] PATH_INFO: `/v3/users/752d5b09ac924ea5a7cc3624729f08b4` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:51.629004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e2825-7c03-4596-aba0-7ffc8de38aec admin admin] RBAC: Authorizing `identity:delete_user(user_id=752d5b09ac924ea5a7cc3624729f08b4)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:51.630976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e2825-7c03-4596-aba0-7ffc8de38aec admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:51.648143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:51.682191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-518e2825-7c03-4596-aba0-7ffc8de38aec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '752d5b09ac924ea5a7cc3624729f08b4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:51.690190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-518e2825-7c03-4596-aba0-7ffc8de38aec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '752d5b09ac924ea5a7cc3624729f08b4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:51.697070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-518e2825-7c03-4596-aba0-7ffc8de38aec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '752d5b09ac924ea5a7cc3624729f08b4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:51.697658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-518e2825-7c03-4596-aba0-7ffc8de38aec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '752d5b09ac924ea5a7cc3624729f08b4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:51.698285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-518e2825-7c03-4596-aba0-7ffc8de38aec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '752d5b09ac924ea5a7cc3624729f08b4'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:51.717172 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4127/8291] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:51 2022] DELETE /identity/v3/users/752d5b09ac924ea5a7cc3624729f08b4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:39:51.721901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd0953-1f94-4189-93cf-442e7d087653 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:51.722415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd0953-1f94-4189-93cf-442e7d087653 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:51.722529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd0953-1f94-4189-93cf-442e7d087653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:51.740656 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-eccd0953-1f94-4189-93cf-442e7d087653 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:51.741872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-eccd0953-1f94-4189-93cf-442e7d087653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:51.775655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:51.812824 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4165/8292] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:51.822663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e2825-7c03-4596-aba0-7ffc8de38aec admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:51.824248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-518e2825-7c03-4596-aba0-7ffc8de38aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:51.886590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e2825-7c03-4596-aba0-7ffc8de38aec admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:51.891334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea24ebf-0a35-4657-b848-d034873a5d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:51.891991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea24ebf-0a35-4657-b848-d034873a5d2c service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:51.892316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea24ebf-0a35-4657-b848-d034873a5d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:51.892589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea24ebf-0a35-4657-b848-d034873a5d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:51.902973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea24ebf-0a35-4657-b848-d034873a5d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:51.904662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea24ebf-0a35-4657-b848-d034873a5d2c service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:51.914575 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4128/8293] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:39:52.202662 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd0953-1f94-4189-93cf-442e7d087653 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:52.204169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-eccd0953-1f94-4189-93cf-442e7d087653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:52.221639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd0953-1f94-4189-93cf-442e7d087653 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:52.227185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa007c-f18c-44e9-97a8-a8bd2c730efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:52.228140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa007c-f18c-44e9-97a8-a8bd2c730efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:52.228451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa007c-f18c-44e9-97a8-a8bd2c730efd admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:52.228731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa007c-f18c-44e9-97a8-a8bd2c730efd admin admin] PATH_INFO: `/v3/projects/d41a5927f0ab471d83285c32c9b16ba9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:52.230240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa007c-f18c-44e9-97a8-a8bd2c730efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d41a5927f0ab471d83285c32c9b16ba9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:52.232648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa007c-f18c-44e9-97a8-a8bd2c730efd admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:52.281478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3baa007c-f18c-44e9-97a8-a8bd2c730efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd41a5927f0ab471d83285c32c9b16ba9', 'request_id': 'req-3baa007c-f18c-44e9-97a8-a8bd2c730efd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:52.290069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3baa007c-f18c-44e9-97a8-a8bd2c730efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd41a5927f0ab471d83285c32c9b16ba9', 'request_id': 'req-3baa007c-f18c-44e9-97a8-a8bd2c730efd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:52.296794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3baa007c-f18c-44e9-97a8-a8bd2c730efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd41a5927f0ab471d83285c32c9b16ba9', 'request_id': 'req-3baa007c-f18c-44e9-97a8-a8bd2c730efd'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:52.311277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3baa007c-f18c-44e9-97a8-a8bd2c730efd admin admin] The token cache is being invalidate because project d41a5927f0ab471d83285c32c9b16ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:52.311566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3baa007c-f18c-44e9-97a8-a8bd2c730efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:52.312261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-3baa007c-f18c-44e9-97a8-a8bd2c730efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:52.313882 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4166/8294] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:39:52 2022] DELETE /identity/v3/projects/d41a5927f0ab471d83285c32c9b16ba9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:52.319415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca13cb9-f56f-429a-a386-d7fc9358a9f1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:52.319939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca13cb9-f56f-429a-a386-d7fc9358a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:52.319939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca13cb9-f56f-429a-a386-d7fc9358a9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:52.338035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-5ca13cb9-f56f-429a-a386-d7fc9358a9f1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:52.339294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5ca13cb9-f56f-429a-a386-d7fc9358a9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:52.403215 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4129/8295] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:52.411467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618c695-3154-4043-85bd-0a7497c05cdf None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:52.411754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618c695-3154-4043-85bd-0a7497c05cdf None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:52.412083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618c695-3154-4043-85bd-0a7497c05cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:52.431952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4618c695-3154-4043-85bd-0a7497c05cdf None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:52.433195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4618c695-3154-4043-85bd-0a7497c05cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:52.441887 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4167/8296] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:52.446131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca13cb9-f56f-429a-a386-d7fc9358a9f1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:52.456622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca13cb9-f56f-429a-a386-d7fc9358a9f1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:52.461999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7754ed6-568b-4da4-8c04-d18561244ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:52.462655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7754ed6-568b-4da4-8c04-d18561244ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:52.462937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7754ed6-568b-4da4-8c04-d18561244ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:52.463218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7754ed6-568b-4da4-8c04-d18561244ee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:52.463946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7754ed6-568b-4da4-8c04-d18561244ee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:39:52.464284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7754ed6-568b-4da4-8c04-d18561244ee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:52.465903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7754ed6-568b-4da4-8c04-d18561244ee9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:52.477927 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4130/8297] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:52.482203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618c695-3154-4043-85bd-0a7497c05cdf None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:52.491448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618c695-3154-4043-85bd-0a7497c05cdf None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:52.496501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08f3d4-dc9a-48d6-8941-1d745099f986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:52.497167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08f3d4-dc9a-48d6-8941-1d745099f986 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:52.497434 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08f3d4-dc9a-48d6-8941-1d745099f986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:52.497710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08f3d4-dc9a-48d6-8941-1d745099f986 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:52.498399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08f3d4-dc9a-48d6-8941-1d745099f986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:52.500312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08f3d4-dc9a-48d6-8941-1d745099f986 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:52.527350 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4168/8298] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:39:52 2022] POST /identity/v3/projects => generated 397 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:39:52.531689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7754ed6-568b-4da4-8c04-d18561244ee9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:52.542098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7754ed6-568b-4da4-8c04-d18561244ee9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:52.564578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:52.603312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b090aa-f36d-46d7-bdf9-a3b5c1e28a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:52.603980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b090aa-f36d-46d7-bdf9-a3b5c1e28a8d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:52.604289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b090aa-f36d-46d7-bdf9-a3b5c1e28a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:52.604577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b090aa-f36d-46d7-bdf9-a3b5c1e28a8d admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:52.605267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b090aa-f36d-46d7-bdf9-a3b5c1e28a8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:52.607259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b090aa-f36d-46d7-bdf9-a3b5c1e28a8d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:52.628824 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4131/8299] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:52 2022] POST /identity/v3/users => generated 305 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:39:52.633037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08f3d4-dc9a-48d6-8941-1d745099f986 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:52.643492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08f3d4-dc9a-48d6-8941-1d745099f986 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:52.651725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671b5d7-9184-4b2f-8fd6-5efd03b3ea7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:52.652769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671b5d7-9184-4b2f-8fd6-5efd03b3ea7c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:52.653145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671b5d7-9184-4b2f-8fd6-5efd03b3ea7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:52.653452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671b5d7-9184-4b2f-8fd6-5efd03b3ea7c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:52.654580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671b5d7-9184-4b2f-8fd6-5efd03b3ea7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:52.657160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671b5d7-9184-4b2f-8fd6-5efd03b3ea7c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:52.668952 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4169/8300] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:52.673964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b090aa-f36d-46d7-bdf9-a3b5c1e28a8d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:52.684860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b090aa-f36d-46d7-bdf9-a3b5c1e28a8d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:52.690626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff44c2-c7b2-4233-84ca-6985742cd614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:52.691550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff44c2-c7b2-4233-84ca-6985742cd614 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:52.691836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff44c2-c7b2-4233-84ca-6985742cd614 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:52.692149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff44c2-c7b2-4233-84ca-6985742cd614 admin admin] PATH_INFO: `/v3/projects/31a0cae5a2f24af8bde5ef379f91d0bb/users/91e4ec531b694c908a39e13ee5116a6b/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:52.708693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff44c2-c7b2-4233-84ca-6985742cd614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a0cae5a2f24af8bde5ef379f91d0bb, user_id=91e4ec531b694c908a39e13ee5116a6b, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:52.711355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff44c2-c7b2-4233-84ca-6985742cd614 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:52.726766 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4132/8301] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:52 2022] PUT /identity/v3/projects/31a0cae5a2f24af8bde5ef379f91d0bb/users/91e4ec531b694c908a39e13ee5116a6b/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:52.731026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671b5d7-9184-4b2f-8fd6-5efd03b3ea7c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:52.741573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671b5d7-9184-4b2f-8fd6-5efd03b3ea7c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:52.800199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd292b0-d71c-4732-b3c2-c908bb7ed400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:52.800800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd292b0-d71c-4732-b3c2-c908bb7ed400 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:52.801111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd292b0-d71c-4732-b3c2-c908bb7ed400 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:52.801387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd292b0-d71c-4732-b3c2-c908bb7ed400 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:52.802131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd292b0-d71c-4732-b3c2-c908bb7ed400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:52.803797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd292b0-d71c-4732-b3c2-c908bb7ed400 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:52.813729 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4170/8302] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:52.819651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff44c2-c7b2-4233-84ca-6985742cd614 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:52.831150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff44c2-c7b2-4233-84ca-6985742cd614 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:52.836207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da6ed2-8bae-43cd-afcb-0e5cb222cdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:52.837102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da6ed2-8bae-43cd-afcb-0e5cb222cdb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:52.837382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da6ed2-8bae-43cd-afcb-0e5cb222cdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:52.837655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da6ed2-8bae-43cd-afcb-0e5cb222cdb5 admin admin] PATH_INFO: `/v3/projects/31a0cae5a2f24af8bde5ef379f91d0bb/users/91e4ec531b694c908a39e13ee5116a6b/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:52.839634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da6ed2-8bae-43cd-afcb-0e5cb222cdb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a0cae5a2f24af8bde5ef379f91d0bb, user_id=91e4ec531b694c908a39e13ee5116a6b, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:52.842408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da6ed2-8bae-43cd-afcb-0e5cb222cdb5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:52.852840 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4133/8303] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:52 2022] PUT /identity/v3/projects/31a0cae5a2f24af8bde5ef379f91d0bb/users/91e4ec531b694c908a39e13ee5116a6b/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:52.863387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca6904-69d3-4ac6-8275-4c4c3e2c4182 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:52.863680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca6904-69d3-4ac6-8275-4c4c3e2c4182 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:52.863962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca6904-69d3-4ac6-8275-4c4c3e2c4182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:52.893489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-cdca6904-69d3-4ac6-8275-4c4c3e2c4182 None None] MFA Rules not processed for user `91e4ec531b694c908a39e13ee5116a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:52.894761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cdca6904-69d3-4ac6-8275-4c4c3e2c4182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:52.899298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:52.972073 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4171/8304] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:52.976687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da6ed2-8bae-43cd-afcb-0e5cb222cdb5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:53.040759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da6ed2-8bae-43cd-afcb-0e5cb222cdb5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:53.046630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba02954-1f50-46ea-9fab-32486bd98a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:53.047279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba02954-1f50-46ea-9fab-32486bd98a63 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:53.047915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba02954-1f50-46ea-9fab-32486bd98a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:53.048224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba02954-1f50-46ea-9fab-32486bd98a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:53.048900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba02954-1f50-46ea-9fab-32486bd98a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:53.050896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba02954-1f50-46ea-9fab-32486bd98a63 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:53.078826 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4134/8305] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:39:52 2022] POST /identity/v3/projects => generated 399 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:53.083847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca6904-69d3-4ac6-8275-4c4c3e2c4182 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:53.095202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca6904-69d3-4ac6-8275-4c4c3e2c4182 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:53.159626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99baf11-99b2-4676-a1df-489a95d03e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:53.160331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99baf11-99b2-4676-a1df-489a95d03e03 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:53.160619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99baf11-99b2-4676-a1df-489a95d03e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:53.160879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99baf11-99b2-4676-a1df-489a95d03e03 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:53.161589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99baf11-99b2-4676-a1df-489a95d03e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:53.163551 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99baf11-99b2-4676-a1df-489a95d03e03 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:53.185736 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4172/8306] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:53 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:53.189905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba02954-1f50-46ea-9fab-32486bd98a63 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:53.201312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba02954-1f50-46ea-9fab-32486bd98a63 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:53.206846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b023e1b-d340-4eb6-83d6-8122af66a140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:53.207517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b023e1b-d340-4eb6-83d6-8122af66a140 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:53.207803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b023e1b-d340-4eb6-83d6-8122af66a140 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:53.208067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b023e1b-d340-4eb6-83d6-8122af66a140 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:53.208846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b023e1b-d340-4eb6-83d6-8122af66a140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:53.210461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b023e1b-d340-4eb6-83d6-8122af66a140 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:53.221232 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4135/8307] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:53.225398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99baf11-99b2-4676-a1df-489a95d03e03 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:53.236283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99baf11-99b2-4676-a1df-489a95d03e03 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:53.242382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8feedb8-7c65-4adb-aa44-98772f4b70df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:53.243044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8feedb8-7c65-4adb-aa44-98772f4b70df admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:53.243329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8feedb8-7c65-4adb-aa44-98772f4b70df admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:53.243610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8feedb8-7c65-4adb-aa44-98772f4b70df admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:53.244345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8feedb8-7c65-4adb-aa44-98772f4b70df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:53.245964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8feedb8-7c65-4adb-aa44-98772f4b70df admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:53.256620 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4173/8308] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:53.260909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b023e1b-d340-4eb6-83d6-8122af66a140 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:53.271604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b023e1b-d340-4eb6-83d6-8122af66a140 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:53.277268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0e9bc-4819-450d-837c-5fda39a587bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:53.278178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0e9bc-4819-450d-837c-5fda39a587bf admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:53.278466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0e9bc-4819-450d-837c-5fda39a587bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:53.278740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0e9bc-4819-450d-837c-5fda39a587bf admin admin] PATH_INFO: `/v3/projects/b28655f1529046cdbf3113db9e13d009/users/431b4be29f4c4af4a31bf2447696a130/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:53.294241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0e9bc-4819-450d-837c-5fda39a587bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28655f1529046cdbf3113db9e13d009, user_id=431b4be29f4c4af4a31bf2447696a130, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:53.297013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0e9bc-4819-450d-837c-5fda39a587bf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:53.311770 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4136/8309] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:53 2022] PUT /identity/v3/projects/b28655f1529046cdbf3113db9e13d009/users/431b4be29f4c4af4a31bf2447696a130/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:53.327222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5fb5e-af2e-4d35-b02c-99f12643e7bf None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:53.327530 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5fb5e-af2e-4d35-b02c-99f12643e7bf None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:53.327789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5fb5e-af2e-4d35-b02c-99f12643e7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:53.357767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-dff5fb5e-af2e-4d35-b02c-99f12643e7bf None None] MFA Rules not processed for user `431b4be29f4c4af4a31bf2447696a130`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:53.359353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dff5fb5e-af2e-4d35-b02c-99f12643e7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:53.430828 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4174/8310] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:53.443393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0e9bc-4819-450d-837c-5fda39a587bf admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:53.445973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6ec0e9bc-4819-450d-837c-5fda39a587bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:53.479840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:53.510832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0e9bc-4819-450d-837c-5fda39a587bf admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:53.514979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea26426-8abc-4e0c-ac89-4a75bb11a306 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:53.515632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea26426-8abc-4e0c-ac89-4a75bb11a306 service glance] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:53.515912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea26426-8abc-4e0c-ac89-4a75bb11a306 service glance] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:53.516233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea26426-8abc-4e0c-ac89-4a75bb11a306 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:53.579695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea26426-8abc-4e0c-ac89-4a75bb11a306 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:53.581127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea26426-8abc-4e0c-ac89-4a75bb11a306 service glance] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:53.591315 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4137/8311] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:39:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:39:53.903899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5fb5e-af2e-4d35-b02c-99f12643e7bf None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:53.914428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:53.974536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5fb5e-af2e-4d35-b02c-99f12643e7bf None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:53.979940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2d040-8e4d-478b-9a42-a2b29dd6a0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:53.981419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d040-8e4d-478b-9a42-a2b29dd6a0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:53.981994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d040-8e4d-478b-9a42-a2b29dd6a0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:53.982237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d040-8e4d-478b-9a42-a2b29dd6a0b2 admin admin] PATH_INFO: `/v3/users/91e4ec531b694c908a39e13ee5116a6b` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:53.983715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2d040-8e4d-478b-9a42-a2b29dd6a0b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e4ec531b694c908a39e13ee5116a6b)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:53.985901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2d040-8e4d-478b-9a42-a2b29dd6a0b2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:54.035794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dec2d040-8e4d-478b-9a42-a2b29dd6a0b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e4ec531b694c908a39e13ee5116a6b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:54.045447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dec2d040-8e4d-478b-9a42-a2b29dd6a0b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e4ec531b694c908a39e13ee5116a6b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:54.045768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dec2d040-8e4d-478b-9a42-a2b29dd6a0b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e4ec531b694c908a39e13ee5116a6b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:54.046588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dec2d040-8e4d-478b-9a42-a2b29dd6a0b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e4ec531b694c908a39e13ee5116a6b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:54.054047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-dec2d040-8e4d-478b-9a42-a2b29dd6a0b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e4ec531b694c908a39e13ee5116a6b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:54.071491 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4175/8312] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:53 2022] DELETE /identity/v3/users/91e4ec531b694c908a39e13ee5116a6b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:54.076445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c842d-5fff-44dd-a4b9-a388ea045fb2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:54.076741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c842d-5fff-44dd-a4b9-a388ea045fb2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:54.077020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c842d-5fff-44dd-a4b9-a388ea045fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:54.095590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d16c842d-5fff-44dd-a4b9-a388ea045fb2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:54.096779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d16c842d-5fff-44dd-a4b9-a388ea045fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:54.159143 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4138/8313] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:54.171788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2d040-8e4d-478b-9a42-a2b29dd6a0b2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:54.173681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dec2d040-8e4d-478b-9a42-a2b29dd6a0b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:54.234975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2d040-8e4d-478b-9a42-a2b29dd6a0b2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:54.239034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c4efc-1e3e-4f44-9cc8-862f1b76cde7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:54.239715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c4efc-1e3e-4f44-9cc8-862f1b76cde7 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:54.240001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c4efc-1e3e-4f44-9cc8-862f1b76cde7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:54.240318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c4efc-1e3e-4f44-9cc8-862f1b76cde7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:54.250577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c4efc-1e3e-4f44-9cc8-862f1b76cde7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:54.252092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c4efc-1e3e-4f44-9cc8-862f1b76cde7 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:54.262509 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4176/8314] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:39:54.540802 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c842d-5fff-44dd-a4b9-a388ea045fb2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:54.542321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d16c842d-5fff-44dd-a4b9-a388ea045fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:54.555354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c842d-5fff-44dd-a4b9-a388ea045fb2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:54.561308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216b997-1fea-4f4e-8f22-78c97b016a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:54.562189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216b997-1fea-4f4e-8f22-78c97b016a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:54.562475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216b997-1fea-4f4e-8f22-78c97b016a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:54.562750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216b997-1fea-4f4e-8f22-78c97b016a3d admin admin] PATH_INFO: `/v3/projects/31a0cae5a2f24af8bde5ef379f91d0bb` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:54.564121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216b997-1fea-4f4e-8f22-78c97b016a3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=31a0cae5a2f24af8bde5ef379f91d0bb)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:54.566092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216b997-1fea-4f4e-8f22-78c97b016a3d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:54.614674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b216b997-1fea-4f4e-8f22-78c97b016a3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31a0cae5a2f24af8bde5ef379f91d0bb', 'request_id': 'req-b216b997-1fea-4f4e-8f22-78c97b016a3d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:54.621249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b216b997-1fea-4f4e-8f22-78c97b016a3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31a0cae5a2f24af8bde5ef379f91d0bb', 'request_id': 'req-b216b997-1fea-4f4e-8f22-78c97b016a3d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:54.627192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b216b997-1fea-4f4e-8f22-78c97b016a3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31a0cae5a2f24af8bde5ef379f91d0bb', 'request_id': 'req-b216b997-1fea-4f4e-8f22-78c97b016a3d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:54.638718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:54.641500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b216b997-1fea-4f4e-8f22-78c97b016a3d admin admin] The token cache is being invalidate because project 31a0cae5a2f24af8bde5ef379f91d0bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:54.641706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b216b997-1fea-4f4e-8f22-78c97b016a3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:54.642952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b216b997-1fea-4f4e-8f22-78c97b016a3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:54.644964 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4139/8315] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:39:54 2022] DELETE /identity/v3/projects/31a0cae5a2f24af8bde5ef379f91d0bb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:54.649528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c4efc-1e3e-4f44-9cc8-862f1b76cde7 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:54.660152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c4efc-1e3e-4f44-9cc8-862f1b76cde7 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:54.689833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:54.719628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef8312-10d5-49b2-92bb-0899d4446027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:54.720547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef8312-10d5-49b2-92bb-0899d4446027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:54.720824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef8312-10d5-49b2-92bb-0899d4446027 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:54.721096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef8312-10d5-49b2-92bb-0899d4446027 admin admin] PATH_INFO: `/v3/users/431b4be29f4c4af4a31bf2447696a130` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:54.722300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef8312-10d5-49b2-92bb-0899d4446027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=431b4be29f4c4af4a31bf2447696a130)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:54.724293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef8312-10d5-49b2-92bb-0899d4446027 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:54.771004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-65ef8312-10d5-49b2-92bb-0899d4446027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431b4be29f4c4af4a31bf2447696a130'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:54.779243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-65ef8312-10d5-49b2-92bb-0899d4446027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431b4be29f4c4af4a31bf2447696a130'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:54.779948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-65ef8312-10d5-49b2-92bb-0899d4446027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431b4be29f4c4af4a31bf2447696a130'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:54.780577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-65ef8312-10d5-49b2-92bb-0899d4446027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431b4be29f4c4af4a31bf2447696a130'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:54.787501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-65ef8312-10d5-49b2-92bb-0899d4446027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431b4be29f4c4af4a31bf2447696a130'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:54.805399 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4177/8316] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:54 2022] DELETE /identity/v3/users/431b4be29f4c4af4a31bf2447696a130 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:55.087436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216b997-1fea-4f4e-8f22-78c97b016a3d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:55.089084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b216b997-1fea-4f4e-8f22-78c97b016a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:55.107536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216b997-1fea-4f4e-8f22-78c97b016a3d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:55.165710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dd49e-8996-429a-947e-f240c7d4ce6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:55.166579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dd49e-8996-429a-947e-f240c7d4ce6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:55.166850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dd49e-8996-429a-947e-f240c7d4ce6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:55.167122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dd49e-8996-429a-947e-f240c7d4ce6a admin admin] PATH_INFO: `/v3/projects/b28655f1529046cdbf3113db9e13d009` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:55.168367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dd49e-8996-429a-947e-f240c7d4ce6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28655f1529046cdbf3113db9e13d009)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:55.170341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dd49e-8996-429a-947e-f240c7d4ce6a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:55.221799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-432dd49e-8996-429a-947e-f240c7d4ce6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28655f1529046cdbf3113db9e13d009', 'request_id': 'req-432dd49e-8996-429a-947e-f240c7d4ce6a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:55.228589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-432dd49e-8996-429a-947e-f240c7d4ce6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28655f1529046cdbf3113db9e13d009', 'request_id': 'req-432dd49e-8996-429a-947e-f240c7d4ce6a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:55.234451 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-432dd49e-8996-429a-947e-f240c7d4ce6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28655f1529046cdbf3113db9e13d009', 'request_id': 'req-432dd49e-8996-429a-947e-f240c7d4ce6a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:55.248929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-432dd49e-8996-429a-947e-f240c7d4ce6a admin admin] The token cache is being invalidate because project b28655f1529046cdbf3113db9e13d009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:55.249213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-432dd49e-8996-429a-947e-f240c7d4ce6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:55.249841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-432dd49e-8996-429a-947e-f240c7d4ce6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:55.251405 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4140/8317] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:39:55 2022] DELETE /identity/v3/projects/b28655f1529046cdbf3113db9e13d009 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:55.256636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69699f8-3d3d-4c35-ab69-1fc030336380 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:55.257183 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69699f8-3d3d-4c35-ab69-1fc030336380 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:55.257290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69699f8-3d3d-4c35-ab69-1fc030336380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:55.276094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f69699f8-3d3d-4c35-ab69-1fc030336380 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:55.277312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f69699f8-3d3d-4c35-ab69-1fc030336380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:55.343005 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4178/8318] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:55.351248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a9632-d159-4633-ae8d-aeee91979e29 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:55.351534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a9632-d159-4633-ae8d-aeee91979e29 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:55.351813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a9632-d159-4633-ae8d-aeee91979e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:55.371187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e41a9632-d159-4633-ae8d-aeee91979e29 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:55.372565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e41a9632-d159-4633-ae8d-aeee91979e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:55.381362 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4141/8319] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:55.385781 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69699f8-3d3d-4c35-ab69-1fc030336380 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:55.396097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69699f8-3d3d-4c35-ab69-1fc030336380 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:55.401658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf420c-fd8e-44f2-ba31-fe7403608aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:55.402321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf420c-fd8e-44f2-ba31-fe7403608aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:55.402607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf420c-fd8e-44f2-ba31-fe7403608aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:55.402908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf420c-fd8e-44f2-ba31-fe7403608aa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:55.403636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf420c-fd8e-44f2-ba31-fe7403608aa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:39:55.403941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf420c-fd8e-44f2-ba31-fe7403608aa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:55.406279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf420c-fd8e-44f2-ba31-fe7403608aa5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:55.419466 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4179/8320] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:55.426578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a9632-d159-4633-ae8d-aeee91979e29 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:55.441858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a9632-d159-4633-ae8d-aeee91979e29 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:55.450755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2865d8-f3e1-44de-864a-9d2d8c408a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:55.451556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2865d8-f3e1-44de-864a-9d2d8c408a5d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:55.451844 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2865d8-f3e1-44de-864a-9d2d8c408a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:55.452154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2865d8-f3e1-44de-864a-9d2d8c408a5d admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:55.452850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2865d8-f3e1-44de-864a-9d2d8c408a5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:55.454808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2865d8-f3e1-44de-864a-9d2d8c408a5d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:55.488731 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4142/8321] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:39:55 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:55.494638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf420c-fd8e-44f2-ba31-fe7403608aa5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:55.505360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf420c-fd8e-44f2-ba31-fe7403608aa5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:55.540517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:55.566291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06bb85-2b62-4d9f-9892-759c83af623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:55.566963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06bb85-2b62-4d9f-9892-759c83af623e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:55.567243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06bb85-2b62-4d9f-9892-759c83af623e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:55.567516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06bb85-2b62-4d9f-9892-759c83af623e admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:55.568227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06bb85-2b62-4d9f-9892-759c83af623e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:55.570162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06bb85-2b62-4d9f-9892-759c83af623e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:55.591871 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4180/8322] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:55 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:39:55.597637 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2865d8-f3e1-44de-864a-9d2d8c408a5d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:55.608418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2865d8-f3e1-44de-864a-9d2d8c408a5d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:55.613175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39f0b3-b2c5-489a-898c-1a8ec654d8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:55.613831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39f0b3-b2c5-489a-898c-1a8ec654d8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:55.614107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39f0b3-b2c5-489a-898c-1a8ec654d8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:55.614382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39f0b3-b2c5-489a-898c-1a8ec654d8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:55.615087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39f0b3-b2c5-489a-898c-1a8ec654d8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:55.616736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39f0b3-b2c5-489a-898c-1a8ec654d8a5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:55.627702 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4143/8323] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:55.631825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06bb85-2b62-4d9f-9892-759c83af623e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:55.642505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06bb85-2b62-4d9f-9892-759c83af623e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:55.647426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99270051-6e69-4129-8ec9-2908ff27546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:55.648349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99270051-6e69-4129-8ec9-2908ff27546a admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:55.648633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99270051-6e69-4129-8ec9-2908ff27546a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:55.648909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99270051-6e69-4129-8ec9-2908ff27546a admin admin] PATH_INFO: `/v3/projects/ec5d89400f184f7aaa37ee537834fb1a/users/7b48c31bbb2a407abab7ace425af3944/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:55.664260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99270051-6e69-4129-8ec9-2908ff27546a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5d89400f184f7aaa37ee537834fb1a, user_id=7b48c31bbb2a407abab7ace425af3944, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:55.666937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99270051-6e69-4129-8ec9-2908ff27546a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:55.681628 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4181/8324] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:55 2022] PUT /identity/v3/projects/ec5d89400f184f7aaa37ee537834fb1a/users/7b48c31bbb2a407abab7ace425af3944/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:55.685665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39f0b3-b2c5-489a-898c-1a8ec654d8a5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:55.696032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39f0b3-b2c5-489a-898c-1a8ec654d8a5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:55.748611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:55.762176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7075192-6c49-4d9b-b635-8c15e8431ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:55.762843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7075192-6c49-4d9b-b635-8c15e8431ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:55.763099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7075192-6c49-4d9b-b635-8c15e8431ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:55.763383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7075192-6c49-4d9b-b635-8c15e8431ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:55.764141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7075192-6c49-4d9b-b635-8c15e8431ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:55.765772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7075192-6c49-4d9b-b635-8c15e8431ff9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:55.776468 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4144/8325] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:39:55.781214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99270051-6e69-4129-8ec9-2908ff27546a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:55.792005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99270051-6e69-4129-8ec9-2908ff27546a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:55.798872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529fcf0-9a99-4517-aa46-05cd5b9149f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:55.799741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529fcf0-9a99-4517-aa46-05cd5b9149f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:55.800712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529fcf0-9a99-4517-aa46-05cd5b9149f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:55.800996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529fcf0-9a99-4517-aa46-05cd5b9149f2 admin admin] PATH_INFO: `/v3/projects/ec5d89400f184f7aaa37ee537834fb1a/users/7b48c31bbb2a407abab7ace425af3944/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:55.803502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529fcf0-9a99-4517-aa46-05cd5b9149f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5d89400f184f7aaa37ee537834fb1a, user_id=7b48c31bbb2a407abab7ace425af3944, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:55.806296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529fcf0-9a99-4517-aa46-05cd5b9149f2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:55.818659 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4182/8326] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:55 2022] PUT /identity/v3/projects/ec5d89400f184f7aaa37ee537834fb1a/users/7b48c31bbb2a407abab7ace425af3944/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:55.830148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6aaefe-97d4-4165-8d70-6699389ea5e6 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:55.830429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6aaefe-97d4-4165-8d70-6699389ea5e6 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:55.830688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6aaefe-97d4-4165-8d70-6699389ea5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:55.858491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ea6aaefe-97d4-4165-8d70-6699389ea5e6 None None] MFA Rules not processed for user `7b48c31bbb2a407abab7ace425af3944`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:55.859853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ea6aaefe-97d4-4165-8d70-6699389ea5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:55.933554 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4145/8327] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:55.938306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529fcf0-9a99-4517-aa46-05cd5b9149f2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:56.004150 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529fcf0-9a99-4517-aa46-05cd5b9149f2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:56.009673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f177bb4-3ca5-4eda-ab4d-76d592638c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:56.010336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f177bb4-3ca5-4eda-ab4d-76d592638c9f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:56.010600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f177bb4-3ca5-4eda-ab4d-76d592638c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:56.010872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f177bb4-3ca5-4eda-ab4d-76d592638c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:56.011564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f177bb4-3ca5-4eda-ab4d-76d592638c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:56.013553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f177bb4-3ca5-4eda-ab4d-76d592638c9f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:56.041102 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4183/8328] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:39:55 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:56.045249 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6aaefe-97d4-4165-8d70-6699389ea5e6 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:56.056721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6aaefe-97d4-4165-8d70-6699389ea5e6 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:56.117479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87093b4-78b7-4be0-85dc-cc66e8ea7e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:56.118159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87093b4-78b7-4be0-85dc-cc66e8ea7e0b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:56.118445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87093b4-78b7-4be0-85dc-cc66e8ea7e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:56.118721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87093b4-78b7-4be0-85dc-cc66e8ea7e0b admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:56.119414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87093b4-78b7-4be0-85dc-cc66e8ea7e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:56.121375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87093b4-78b7-4be0-85dc-cc66e8ea7e0b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:56.142515 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4146/8329] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:56 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:56.146674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f177bb4-3ca5-4eda-ab4d-76d592638c9f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:56.157893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f177bb4-3ca5-4eda-ab4d-76d592638c9f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:56.163295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ee7c9-7bab-4c35-a056-0e13ccb59d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:56.163960 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ee7c9-7bab-4c35-a056-0e13ccb59d04 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:56.164275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ee7c9-7bab-4c35-a056-0e13ccb59d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:56.164555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ee7c9-7bab-4c35-a056-0e13ccb59d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:56.165250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ee7c9-7bab-4c35-a056-0e13ccb59d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:56.166882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ee7c9-7bab-4c35-a056-0e13ccb59d04 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:56.177598 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4184/8330] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:56.181826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87093b4-78b7-4be0-85dc-cc66e8ea7e0b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:56.192162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87093b4-78b7-4be0-85dc-cc66e8ea7e0b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:56.197708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd0bf7-ec71-4350-aa4e-2276bce3900d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:56.198363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd0bf7-ec71-4350-aa4e-2276bce3900d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:56.198644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd0bf7-ec71-4350-aa4e-2276bce3900d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:56.198913 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd0bf7-ec71-4350-aa4e-2276bce3900d admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:56.199630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd0bf7-ec71-4350-aa4e-2276bce3900d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:56.201364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd0bf7-ec71-4350-aa4e-2276bce3900d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:56.211546 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4147/8331] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:39:56.215805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ee7c9-7bab-4c35-a056-0e13ccb59d04 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:56.226687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ee7c9-7bab-4c35-a056-0e13ccb59d04 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:56.232808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f69de-c39b-4488-acb2-c65dd4cd21c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:56.233700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f69de-c39b-4488-acb2-c65dd4cd21c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:56.233981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f69de-c39b-4488-acb2-c65dd4cd21c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:56.234312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f69de-c39b-4488-acb2-c65dd4cd21c6 admin admin] PATH_INFO: `/v3/projects/393c0c733a224ac6bd21447ae1c1f6ce/users/63f5b617d97f430a88ff3bff9c6c18e8/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:56.251209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f69de-c39b-4488-acb2-c65dd4cd21c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=393c0c733a224ac6bd21447ae1c1f6ce, user_id=63f5b617d97f430a88ff3bff9c6c18e8, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:56.253932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f69de-c39b-4488-acb2-c65dd4cd21c6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:56.269523 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4185/8332] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:56 2022] PUT /identity/v3/projects/393c0c733a224ac6bd21447ae1c1f6ce/users/63f5b617d97f430a88ff3bff9c6c18e8/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:56.362406 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f904c2-d9a1-4650-87f4-331a86c0f5bc None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:56.362706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f904c2-d9a1-4650-87f4-331a86c0f5bc None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:56.362954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f904c2-d9a1-4650-87f4-331a86c0f5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:56.396083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-85f904c2-d9a1-4650-87f4-331a86c0f5bc None None] MFA Rules not processed for user `63f5b617d97f430a88ff3bff9c6c18e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:56.397543 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-85f904c2-d9a1-4650-87f4-331a86c0f5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:56.439501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:56.465043 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4148/8333] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:56.478608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f69de-c39b-4488-acb2-c65dd4cd21c6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:56.480598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e66f69de-c39b-4488-acb2-c65dd4cd21c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:56.526000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:56.542989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f69de-c39b-4488-acb2-c65dd4cd21c6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:56.548201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6fd59-906d-47cf-8cf6-dab04b41caf2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:56.548894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6fd59-906d-47cf-8cf6-dab04b41caf2 service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:56.549175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6fd59-906d-47cf-8cf6-dab04b41caf2 service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:56.549449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6fd59-906d-47cf-8cf6-dab04b41caf2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:56.614020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6fd59-906d-47cf-8cf6-dab04b41caf2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:56.615537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6fd59-906d-47cf-8cf6-dab04b41caf2 service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:56.625457 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4186/8334] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:39:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:39:57.151517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f904c2-d9a1-4650-87f4-331a86c0f5bc None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:57.220742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f904c2-d9a1-4650-87f4-331a86c0f5bc None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:57.226622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11a6d7-c023-4543-8a8d-e828bc0b0dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:57.227507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11a6d7-c023-4543-8a8d-e828bc0b0dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:57.227829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11a6d7-c023-4543-8a8d-e828bc0b0dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:57.228131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11a6d7-c023-4543-8a8d-e828bc0b0dbb admin admin] PATH_INFO: `/v3/users/7b48c31bbb2a407abab7ace425af3944` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:57.230022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11a6d7-c023-4543-8a8d-e828bc0b0dbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b48c31bbb2a407abab7ace425af3944)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:57.232762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11a6d7-c023-4543-8a8d-e828bc0b0dbb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:57.284502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c11a6d7-c023-4543-8a8d-e828bc0b0dbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b48c31bbb2a407abab7ace425af3944'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:57.292881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c11a6d7-c023-4543-8a8d-e828bc0b0dbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b48c31bbb2a407abab7ace425af3944'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:57.300541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c11a6d7-c023-4543-8a8d-e828bc0b0dbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b48c31bbb2a407abab7ace425af3944'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:57.301226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c11a6d7-c023-4543-8a8d-e828bc0b0dbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b48c31bbb2a407abab7ace425af3944'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:57.301993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2c11a6d7-c023-4543-8a8d-e828bc0b0dbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b48c31bbb2a407abab7ace425af3944'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:57.319383 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4149/8335] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:57 2022] DELETE /identity/v3/users/7b48c31bbb2a407abab7ace425af3944 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:57.324810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e0731-33f3-4c97-bede-978e1ee308d1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:57.325324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e0731-33f3-4c97-bede-978e1ee308d1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:57.325324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e0731-33f3-4c97-bede-978e1ee308d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:57.342679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ab2e0731-33f3-4c97-bede-978e1ee308d1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:57.343867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ab2e0731-33f3-4c97-bede-978e1ee308d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:57.403879 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4187/8336] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:57.413940 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11a6d7-c023-4543-8a8d-e828bc0b0dbb admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:57.415533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2c11a6d7-c023-4543-8a8d-e828bc0b0dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:57.477181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11a6d7-c023-4543-8a8d-e828bc0b0dbb admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:57.481870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51494ae0-9a8e-46a7-990e-debb0643e2a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:57.482518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51494ae0-9a8e-46a7-990e-debb0643e2a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:57.482791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51494ae0-9a8e-46a7-990e-debb0643e2a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:57.483058 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51494ae0-9a8e-46a7-990e-debb0643e2a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:57.498080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51494ae0-9a8e-46a7-990e-debb0643e2a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:57.499587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51494ae0-9a8e-46a7-990e-debb0643e2a3 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:57.512162 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4150/8337] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:39:57.804913 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e0731-33f3-4c97-bede-978e1ee308d1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:57.806460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ab2e0731-33f3-4c97-bede-978e1ee308d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:57.821466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e0731-33f3-4c97-bede-978e1ee308d1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:57.828428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a56252-13f2-45e3-bdeb-13a5020d3ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:57.829399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a56252-13f2-45e3-bdeb-13a5020d3ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:57.829581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a56252-13f2-45e3-bdeb-13a5020d3ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:57.829849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a56252-13f2-45e3-bdeb-13a5020d3ff7 admin admin] PATH_INFO: `/v3/projects/ec5d89400f184f7aaa37ee537834fb1a` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:57.831126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a56252-13f2-45e3-bdeb-13a5020d3ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec5d89400f184f7aaa37ee537834fb1a)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:57.833111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a56252-13f2-45e3-bdeb-13a5020d3ff7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:57.883059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-52a56252-13f2-45e3-bdeb-13a5020d3ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec5d89400f184f7aaa37ee537834fb1a', 'request_id': 'req-52a56252-13f2-45e3-bdeb-13a5020d3ff7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:57.891202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-52a56252-13f2-45e3-bdeb-13a5020d3ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec5d89400f184f7aaa37ee537834fb1a', 'request_id': 'req-52a56252-13f2-45e3-bdeb-13a5020d3ff7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:57.897442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-52a56252-13f2-45e3-bdeb-13a5020d3ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec5d89400f184f7aaa37ee537834fb1a', 'request_id': 'req-52a56252-13f2-45e3-bdeb-13a5020d3ff7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:57.907687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-52a56252-13f2-45e3-bdeb-13a5020d3ff7 admin admin] The token cache is being invalidate because project ec5d89400f184f7aaa37ee537834fb1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:57.907979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-52a56252-13f2-45e3-bdeb-13a5020d3ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:57.908642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-52a56252-13f2-45e3-bdeb-13a5020d3ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:57.910346 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4188/8338] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:39:57 2022] DELETE /identity/v3/projects/ec5d89400f184f7aaa37ee537834fb1a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:57.914545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51494ae0-9a8e-46a7-990e-debb0643e2a3 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:57.919573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:57.927087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51494ae0-9a8e-46a7-990e-debb0643e2a3 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:57.984258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbfe99-67c9-411e-850e-a85d2b1b8f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:57.985139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbfe99-67c9-411e-850e-a85d2b1b8f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:57.985425 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbfe99-67c9-411e-850e-a85d2b1b8f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:57.985704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbfe99-67c9-411e-850e-a85d2b1b8f63 admin admin] PATH_INFO: `/v3/users/63f5b617d97f430a88ff3bff9c6c18e8` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:57.986995 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbfe99-67c9-411e-850e-a85d2b1b8f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f5b617d97f430a88ff3bff9c6c18e8)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:57.989012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbfe99-67c9-411e-850e-a85d2b1b8f63 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:58.038320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b4cbfe99-67c9-411e-850e-a85d2b1b8f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f5b617d97f430a88ff3bff9c6c18e8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:58.046145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b4cbfe99-67c9-411e-850e-a85d2b1b8f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f5b617d97f430a88ff3bff9c6c18e8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:58.053719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b4cbfe99-67c9-411e-850e-a85d2b1b8f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f5b617d97f430a88ff3bff9c6c18e8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:58.054299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b4cbfe99-67c9-411e-850e-a85d2b1b8f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f5b617d97f430a88ff3bff9c6c18e8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:58.054938 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-b4cbfe99-67c9-411e-850e-a85d2b1b8f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f5b617d97f430a88ff3bff9c6c18e8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:58.071966 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4151/8339] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:39:57 2022] DELETE /identity/v3/users/63f5b617d97f430a88ff3bff9c6c18e8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:58.358289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a56252-13f2-45e3-bdeb-13a5020d3ff7 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:58.359951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-52a56252-13f2-45e3-bdeb-13a5020d3ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:58.377883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a56252-13f2-45e3-bdeb-13a5020d3ff7 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:58.387566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:58.438145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c35736-463d-48c1-833f-a36f1dc41d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:58.439018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c35736-463d-48c1-833f-a36f1dc41d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:58.439294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c35736-463d-48c1-833f-a36f1dc41d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:58.439593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c35736-463d-48c1-833f-a36f1dc41d98 admin admin] PATH_INFO: `/v3/projects/393c0c733a224ac6bd21447ae1c1f6ce` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:58.440801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c35736-463d-48c1-833f-a36f1dc41d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=393c0c733a224ac6bd21447ae1c1f6ce)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:58.442741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c35736-463d-48c1-833f-a36f1dc41d98 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:58.491803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-82c35736-463d-48c1-833f-a36f1dc41d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '393c0c733a224ac6bd21447ae1c1f6ce', 'request_id': 'req-82c35736-463d-48c1-833f-a36f1dc41d98'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:58.499726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-82c35736-463d-48c1-833f-a36f1dc41d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '393c0c733a224ac6bd21447ae1c1f6ce', 'request_id': 'req-82c35736-463d-48c1-833f-a36f1dc41d98'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:58.505983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-82c35736-463d-48c1-833f-a36f1dc41d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '393c0c733a224ac6bd21447ae1c1f6ce', 'request_id': 'req-82c35736-463d-48c1-833f-a36f1dc41d98'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:58.516354 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-82c35736-463d-48c1-833f-a36f1dc41d98 admin admin] The token cache is being invalidate because project 393c0c733a224ac6bd21447ae1c1f6ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:39:58.516641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-82c35736-463d-48c1-833f-a36f1dc41d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:58.517287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-82c35736-463d-48c1-833f-a36f1dc41d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:39:58.518859 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4189/8340] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:39:58 2022] DELETE /identity/v3/projects/393c0c733a224ac6bd21447ae1c1f6ce => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:58.524412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ab1af-3629-42d8-a03a-a83802d6441c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:58.524941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ab1af-3629-42d8-a03a-a83802d6441c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:58.524941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ab1af-3629-42d8-a03a-a83802d6441c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:58.544189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-241ab1af-3629-42d8-a03a-a83802d6441c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:58.545457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-241ab1af-3629-42d8-a03a-a83802d6441c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:58.609527 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4152/8341] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:39:58.617772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83041-eb85-48ac-b214-7f4b45cca36b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:58.618060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83041-eb85-48ac-b214-7f4b45cca36b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:58.618333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83041-eb85-48ac-b214-7f4b45cca36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:58.637880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-91b83041-eb85-48ac-b214-7f4b45cca36b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:58.639127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-91b83041-eb85-48ac-b214-7f4b45cca36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:58.647592 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4190/8342] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:58.652203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ab1af-3629-42d8-a03a-a83802d6441c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:58.662834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ab1af-3629-42d8-a03a-a83802d6441c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:58.668242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d7674-b57f-4b5b-b324-807be8226102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:58.668897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d7674-b57f-4b5b-b324-807be8226102 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:58.669179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d7674-b57f-4b5b-b324-807be8226102 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:58.669549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d7674-b57f-4b5b-b324-807be8226102 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:58.670273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d7674-b57f-4b5b-b324-807be8226102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:39:58.670574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d7674-b57f-4b5b-b324-807be8226102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:58.672210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d7674-b57f-4b5b-b324-807be8226102 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:58.684656 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4153/8343] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:39:58.689057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b83041-eb85-48ac-b214-7f4b45cca36b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:58.698564 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b83041-eb85-48ac-b214-7f4b45cca36b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:58.704463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f6060-ada5-4c83-9cd5-749bf9b87006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:58.705116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f6060-ada5-4c83-9cd5-749bf9b87006 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:58.705386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f6060-ada5-4c83-9cd5-749bf9b87006 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:58.705651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f6060-ada5-4c83-9cd5-749bf9b87006 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:58.706342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f6060-ada5-4c83-9cd5-749bf9b87006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:58.708268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f6060-ada5-4c83-9cd5-749bf9b87006 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:58.736477 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4191/8344] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:39:58 2022] POST /identity/v3/projects => generated 411 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:58.740897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d7674-b57f-4b5b-b324-807be8226102 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:58.751310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d7674-b57f-4b5b-b324-807be8226102 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:58.756303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:58.809788 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d39ad8-bcd0-4536-a931-e89342df8ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:58.810498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d39ad8-bcd0-4536-a931-e89342df8ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:58.810775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d39ad8-bcd0-4536-a931-e89342df8ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:58.811047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d39ad8-bcd0-4536-a931-e89342df8ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:58.811721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d39ad8-bcd0-4536-a931-e89342df8ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:58.813677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d39ad8-bcd0-4536-a931-e89342df8ee0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:58.834042 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4154/8345] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:58 2022] POST /identity/v3/users => generated 306 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:58.838358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f6060-ada5-4c83-9cd5-749bf9b87006 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:58.849122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f6060-ada5-4c83-9cd5-749bf9b87006 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:58.854061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3d120-eb14-4c2d-acfc-3a59a0815fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:58.854721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3d120-eb14-4c2d-acfc-3a59a0815fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:58.855007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3d120-eb14-4c2d-acfc-3a59a0815fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:58.855309 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3d120-eb14-4c2d-acfc-3a59a0815fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:58.856022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3d120-eb14-4c2d-acfc-3a59a0815fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:58.857677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3d120-eb14-4c2d-acfc-3a59a0815fb2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:58.868913 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4192/8346] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:58.872906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d39ad8-bcd0-4536-a931-e89342df8ee0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:58.883408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d39ad8-bcd0-4536-a931-e89342df8ee0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:58.888343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e45ff3-cf68-4e59-8be7-ae87b7460164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:58.888981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e45ff3-cf68-4e59-8be7-ae87b7460164 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:58.889257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e45ff3-cf68-4e59-8be7-ae87b7460164 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:58.889525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e45ff3-cf68-4e59-8be7-ae87b7460164 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:58.890240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e45ff3-cf68-4e59-8be7-ae87b7460164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:58.891838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e45ff3-cf68-4e59-8be7-ae87b7460164 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:58.901862 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4155/8347] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:39:58.906747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3d120-eb14-4c2d-acfc-3a59a0815fb2 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:58.921296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3d120-eb14-4c2d-acfc-3a59a0815fb2 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:58.929106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99e793-a54f-4d7d-b208-259afb633a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:58.930267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99e793-a54f-4d7d-b208-259afb633a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:58.930621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99e793-a54f-4d7d-b208-259afb633a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:58.930938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99e793-a54f-4d7d-b208-259afb633a7e admin admin] PATH_INFO: `/v3/projects/13501e538fe24edb9b2df8376408076b/users/36e775c5979646e3b863bc021c06e6c4/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:58.947299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99e793-a54f-4d7d-b208-259afb633a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=13501e538fe24edb9b2df8376408076b, user_id=36e775c5979646e3b863bc021c06e6c4, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:58.950053 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99e793-a54f-4d7d-b208-259afb633a7e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:58.965245 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4193/8348] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:58 2022] PUT /identity/v3/projects/13501e538fe24edb9b2df8376408076b/users/36e775c5979646e3b863bc021c06e6c4/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:58.977109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9970ee-ec7e-48ad-8237-3622b11adea2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:58.977519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9970ee-ec7e-48ad-8237-3622b11adea2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:58.977806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9970ee-ec7e-48ad-8237-3622b11adea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:59.005327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bb9970ee-ec7e-48ad-8237-3622b11adea2 None None] MFA Rules not processed for user `36e775c5979646e3b863bc021c06e6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:59.006602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bb9970ee-ec7e-48ad-8237-3622b11adea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:59.074074 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4156/8349] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:58 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:59.078777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99e793-a54f-4d7d-b208-259afb633a7e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:59.129016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:59.152828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99e793-a54f-4d7d-b208-259afb633a7e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:59.158192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09d918-f232-42ea-bd51-551f34e8adba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:59.158860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09d918-f232-42ea-bd51-551f34e8adba admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:59.159141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09d918-f232-42ea-bd51-551f34e8adba admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:59.159417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09d918-f232-42ea-bd51-551f34e8adba admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:59.160133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09d918-f232-42ea-bd51-551f34e8adba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:59.162243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09d918-f232-42ea-bd51-551f34e8adba admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:59.190671 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4194/8350] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:39:59 2022] POST /identity/v3/projects => generated 409 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:39:59.195009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9970ee-ec7e-48ad-8237-3622b11adea2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:59.206188 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9970ee-ec7e-48ad-8237-3622b11adea2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:59.265586 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc272e28-6bfb-483c-a5db-d0c0662f7ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:59.266259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc272e28-6bfb-483c-a5db-d0c0662f7ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:59.266550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc272e28-6bfb-483c-a5db-d0c0662f7ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:59.266829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc272e28-6bfb-483c-a5db-d0c0662f7ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:59.267527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc272e28-6bfb-483c-a5db-d0c0662f7ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:59.269636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc272e28-6bfb-483c-a5db-d0c0662f7ed7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:59.293231 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4157/8351] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:39:59 2022] POST /identity/v3/users => generated 311 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:39:59.295974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09d918-f232-42ea-bd51-551f34e8adba admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:59.307391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09d918-f232-42ea-bd51-551f34e8adba admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:59.312172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a8e25-2444-47f6-b755-e90afb27ca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:59.312840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a8e25-2444-47f6-b755-e90afb27ca25 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:59.313125 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a8e25-2444-47f6-b755-e90afb27ca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:59.313406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a8e25-2444-47f6-b755-e90afb27ca25 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:59.314130 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a8e25-2444-47f6-b755-e90afb27ca25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:59.315779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a8e25-2444-47f6-b755-e90afb27ca25 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:59.326766 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4195/8352] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:39:59.331367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc272e28-6bfb-483c-a5db-d0c0662f7ed7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:59.342102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc272e28-6bfb-483c-a5db-d0c0662f7ed7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:59.348050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc1462-3282-4e10-b640-6c4d4ddf2637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:59.348998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc1462-3282-4e10-b640-6c4d4ddf2637 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:59.349240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc1462-3282-4e10-b640-6c4d4ddf2637 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:59.349567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc1462-3282-4e10-b640-6c4d4ddf2637 admin admin] PATH_INFO: `/v3/projects/495d8cb08166491ea609b52b508ec98d/users/55008967d4494275a99952e89fb8b91f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:59.352011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:59.366746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc1462-3282-4e10-b640-6c4d4ddf2637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=495d8cb08166491ea609b52b508ec98d, user_id=55008967d4494275a99952e89fb8b91f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:59.369482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc1462-3282-4e10-b640-6c4d4ddf2637 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:59.383909 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4158/8353] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:59 2022] PUT /identity/v3/projects/495d8cb08166491ea609b52b508ec98d/users/55008967d4494275a99952e89fb8b91f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:59.388099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a8e25-2444-47f6-b755-e90afb27ca25 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:59.398263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a8e25-2444-47f6-b755-e90afb27ca25 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:59.454285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf42287-690a-4637-a728-988133950d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:59.454962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf42287-690a-4637-a728-988133950d6d admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:59.455247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf42287-690a-4637-a728-988133950d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:59.455524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf42287-690a-4637-a728-988133950d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:59.456269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf42287-690a-4637-a728-988133950d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:59.457884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf42287-690a-4637-a728-988133950d6d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:59.468489 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4196/8354] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:39:59.474919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc1462-3282-4e10-b640-6c4d4ddf2637 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:59.488342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc1462-3282-4e10-b640-6c4d4ddf2637 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:59.494373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16507f5c-15e7-4a1b-a0bb-b161efb1be08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:59.495354 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16507f5c-15e7-4a1b-a0bb-b161efb1be08 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:59.495635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16507f5c-15e7-4a1b-a0bb-b161efb1be08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:59.495910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16507f5c-15e7-4a1b-a0bb-b161efb1be08 admin admin] PATH_INFO: `/v3/projects/495d8cb08166491ea609b52b508ec98d/users/55008967d4494275a99952e89fb8b91f/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:59.498079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16507f5c-15e7-4a1b-a0bb-b161efb1be08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=495d8cb08166491ea609b52b508ec98d, user_id=55008967d4494275a99952e89fb8b91f, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:59.500813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16507f5c-15e7-4a1b-a0bb-b161efb1be08 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:59.511396 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4159/8355] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:39:59 2022] PUT /identity/v3/projects/495d8cb08166491ea609b52b508ec98d/users/55008967d4494275a99952e89fb8b91f/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:39:59.522283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6211e-8e6d-4e1e-aed2-57ba9e5e8963 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:59.522606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6211e-8e6d-4e1e-aed2-57ba9e5e8963 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:59.522887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6211e-8e6d-4e1e-aed2-57ba9e5e8963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:59.559468 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-00f6211e-8e6d-4e1e-aed2-57ba9e5e8963 None None] MFA Rules not processed for user `55008967d4494275a99952e89fb8b91f`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:39:59.560894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-00f6211e-8e6d-4e1e-aed2-57ba9e5e8963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:59.644352 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4197/8356] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:39:59 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:39:59.655051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16507f5c-15e7-4a1b-a0bb-b161efb1be08 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:39:59.657240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-16507f5c-15e7-4a1b-a0bb-b161efb1be08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:39:59.731275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16507f5c-15e7-4a1b-a0bb-b161efb1be08 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:39:59.735710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31738e-0f32-4d6c-8c35-89c558c25ffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:39:59.736383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31738e-0f32-4d6c-8c35-89c558c25ffb service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:39:59.736665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31738e-0f32-4d6c-8c35-89c558c25ffb service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:39:59.736943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31738e-0f32-4d6c-8c35-89c558c25ffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:39:59.748271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31738e-0f32-4d6c-8c35-89c558c25ffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:39:59.749732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31738e-0f32-4d6c-8c35-89c558c25ffb service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:39:59.759776 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4160/8357] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:39:59 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:40:01.342219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6211e-8e6d-4e1e-aed2-57ba9e5e8963 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:01.381250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:01.406665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6211e-8e6d-4e1e-aed2-57ba9e5e8963 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:01.411990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8eb54-9e08-411a-ac87-3a10a7902cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:01.412908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8eb54-9e08-411a-ac87-3a10a7902cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:01.413196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8eb54-9e08-411a-ac87-3a10a7902cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:01.413462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8eb54-9e08-411a-ac87-3a10a7902cf0 admin admin] PATH_INFO: `/v3/users/36e775c5979646e3b863bc021c06e6c4` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:01.414702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8eb54-9e08-411a-ac87-3a10a7902cf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e775c5979646e3b863bc021c06e6c4)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:01.416680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8eb54-9e08-411a-ac87-3a10a7902cf0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:01.466950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-18a8eb54-9e08-411a-ac87-3a10a7902cf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e775c5979646e3b863bc021c06e6c4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:01.474864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-18a8eb54-9e08-411a-ac87-3a10a7902cf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e775c5979646e3b863bc021c06e6c4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:01.475498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-18a8eb54-9e08-411a-ac87-3a10a7902cf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e775c5979646e3b863bc021c06e6c4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:01.476164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-18a8eb54-9e08-411a-ac87-3a10a7902cf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e775c5979646e3b863bc021c06e6c4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:01.483525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-18a8eb54-9e08-411a-ac87-3a10a7902cf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e775c5979646e3b863bc021c06e6c4'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:01.500330 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4198/8358] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:40:01 2022] DELETE /identity/v3/users/36e775c5979646e3b863bc021c06e6c4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:01.505172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b9259-793d-4aac-9d72-b2478a2ca93e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:01.505686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b9259-793d-4aac-9d72-b2478a2ca93e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:01.505814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b9259-793d-4aac-9d72-b2478a2ca93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:01.523507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-513b9259-793d-4aac-9d72-b2478a2ca93e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:01.524689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-513b9259-793d-4aac-9d72-b2478a2ca93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:01.592336 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4161/8359] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:40:01.602538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8eb54-9e08-411a-ac87-3a10a7902cf0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:01.604090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-18a8eb54-9e08-411a-ac87-3a10a7902cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:01.665293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8eb54-9e08-411a-ac87-3a10a7902cf0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:01.669728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dd753-886f-42b5-83df-82421cbc842c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:01.670380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dd753-886f-42b5-83df-82421cbc842c service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:01.670674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dd753-886f-42b5-83df-82421cbc842c service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:01.670930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dd753-886f-42b5-83df-82421cbc842c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:01.683197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dd753-886f-42b5-83df-82421cbc842c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:01.684704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727dd753-886f-42b5-83df-82421cbc842c service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:01.694469 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4199/8360] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:40:01.976666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b9259-793d-4aac-9d72-b2478a2ca93e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:01.978213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-513b9259-793d-4aac-9d72-b2478a2ca93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:01.991522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b9259-793d-4aac-9d72-b2478a2ca93e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:01.997419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ab350-61cf-4f09-9094-d42485371a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:01.998310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ab350-61cf-4f09-9094-d42485371a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:01.998593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ab350-61cf-4f09-9094-d42485371a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:01.998872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ab350-61cf-4f09-9094-d42485371a99 admin admin] PATH_INFO: `/v3/projects/13501e538fe24edb9b2df8376408076b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:02.000327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ab350-61cf-4f09-9094-d42485371a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13501e538fe24edb9b2df8376408076b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:02.002385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ab350-61cf-4f09-9094-d42485371a99 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:02.061731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d16ab350-61cf-4f09-9094-d42485371a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13501e538fe24edb9b2df8376408076b', 'request_id': 'req-d16ab350-61cf-4f09-9094-d42485371a99'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:02.067781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d16ab350-61cf-4f09-9094-d42485371a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13501e538fe24edb9b2df8376408076b', 'request_id': 'req-d16ab350-61cf-4f09-9094-d42485371a99'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:02.073351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d16ab350-61cf-4f09-9094-d42485371a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13501e538fe24edb9b2df8376408076b', 'request_id': 'req-d16ab350-61cf-4f09-9094-d42485371a99'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:02.077290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:02.091761 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d16ab350-61cf-4f09-9094-d42485371a99 admin admin] The token cache is being invalidate because project 13501e538fe24edb9b2df8376408076b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:40:02.092069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d16ab350-61cf-4f09-9094-d42485371a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:02.092769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d16ab350-61cf-4f09-9094-d42485371a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:02.094418 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4162/8361] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:40:01 2022] DELETE /identity/v3/projects/13501e538fe24edb9b2df8376408076b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:02.098520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dd753-886f-42b5-83df-82421cbc842c service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:02.108670 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dd753-886f-42b5-83df-82421cbc842c service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:02.160455 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:02.167348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9bac6-2076-4a13-b574-25d17db47898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:02.168617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9bac6-2076-4a13-b574-25d17db47898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:02.168923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9bac6-2076-4a13-b574-25d17db47898 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:02.169506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9bac6-2076-4a13-b574-25d17db47898 admin admin] PATH_INFO: `/v3/users/55008967d4494275a99952e89fb8b91f` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:02.171116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9bac6-2076-4a13-b574-25d17db47898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55008967d4494275a99952e89fb8b91f)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:02.174098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9bac6-2076-4a13-b574-25d17db47898 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:02.222748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cbc9bac6-2076-4a13-b574-25d17db47898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55008967d4494275a99952e89fb8b91f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:02.231220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cbc9bac6-2076-4a13-b574-25d17db47898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55008967d4494275a99952e89fb8b91f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:02.231925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cbc9bac6-2076-4a13-b574-25d17db47898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55008967d4494275a99952e89fb8b91f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:02.232692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cbc9bac6-2076-4a13-b574-25d17db47898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55008967d4494275a99952e89fb8b91f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:02.240343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cbc9bac6-2076-4a13-b574-25d17db47898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55008967d4494275a99952e89fb8b91f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:02.259156 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4200/8362] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:40:02 2022] DELETE /identity/v3/users/55008967d4494275a99952e89fb8b91f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:40:02.445387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ab350-61cf-4f09-9094-d42485371a99 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:02.446889 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d16ab350-61cf-4f09-9094-d42485371a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:02.460467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ab350-61cf-4f09-9094-d42485371a99 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:02.519268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cea97-7baf-4683-9c8c-b095f8f42da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:02.520186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cea97-7baf-4683-9c8c-b095f8f42da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:02.520464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cea97-7baf-4683-9c8c-b095f8f42da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:02.520738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cea97-7baf-4683-9c8c-b095f8f42da7 admin admin] PATH_INFO: `/v3/projects/495d8cb08166491ea609b52b508ec98d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:02.521954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cea97-7baf-4683-9c8c-b095f8f42da7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=495d8cb08166491ea609b52b508ec98d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:02.523855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cea97-7baf-4683-9c8c-b095f8f42da7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:02.570306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ce2cea97-7baf-4683-9c8c-b095f8f42da7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495d8cb08166491ea609b52b508ec98d', 'request_id': 'req-ce2cea97-7baf-4683-9c8c-b095f8f42da7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:02.576242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ce2cea97-7baf-4683-9c8c-b095f8f42da7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495d8cb08166491ea609b52b508ec98d', 'request_id': 'req-ce2cea97-7baf-4683-9c8c-b095f8f42da7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:02.581742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ce2cea97-7baf-4683-9c8c-b095f8f42da7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495d8cb08166491ea609b52b508ec98d', 'request_id': 'req-ce2cea97-7baf-4683-9c8c-b095f8f42da7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:02.594963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ce2cea97-7baf-4683-9c8c-b095f8f42da7 admin admin] The token cache is being invalidate because project 495d8cb08166491ea609b52b508ec98d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:40:02.595220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ce2cea97-7baf-4683-9c8c-b095f8f42da7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:02.595868 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ce2cea97-7baf-4683-9c8c-b095f8f42da7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:02.597542 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4163/8363] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:40:02 2022] DELETE /identity/v3/projects/495d8cb08166491ea609b52b508ec98d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:02.603124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2986e7-6965-4f7d-82ce-9349aaf03a38 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:02.603642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2986e7-6965-4f7d-82ce-9349aaf03a38 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:02.603642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2986e7-6965-4f7d-82ce-9349aaf03a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:02.622658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3f2986e7-6965-4f7d-82ce-9349aaf03a38 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:02.624494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3f2986e7-6965-4f7d-82ce-9349aaf03a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:02.687646 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4201/8364] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:40:02.700266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9786b-1417-47b1-98b4-dbb84ccabd6c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:02.700687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9786b-1417-47b1-98b4-dbb84ccabd6c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:02.701111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9786b-1417-47b1-98b4-dbb84ccabd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:02.727474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d5f9786b-1417-47b1-98b4-dbb84ccabd6c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:02.728731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d5f9786b-1417-47b1-98b4-dbb84ccabd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:02.738350 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4164/8365] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:40:02.744383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2986e7-6965-4f7d-82ce-9349aaf03a38 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:02.754926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2986e7-6965-4f7d-82ce-9349aaf03a38 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:02.759809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088647ab-9893-4437-89e0-c7d346affce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:02.760496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088647ab-9893-4437-89e0-c7d346affce1 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:02.760775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088647ab-9893-4437-89e0-c7d346affce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:02.761050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088647ab-9893-4437-89e0-c7d346affce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:02.761776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088647ab-9893-4437-89e0-c7d346affce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:40:02.762233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088647ab-9893-4437-89e0-c7d346affce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:02.763813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088647ab-9893-4437-89e0-c7d346affce1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:02.775283 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4202/8366] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:40:02.779506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9786b-1417-47b1-98b4-dbb84ccabd6c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:02.789327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9786b-1417-47b1-98b4-dbb84ccabd6c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:02.795194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6e938-261a-45e7-bfc0-cff20ff06870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:02.795852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6e938-261a-45e7-bfc0-cff20ff06870 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:02.796179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6e938-261a-45e7-bfc0-cff20ff06870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:02.796456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6e938-261a-45e7-bfc0-cff20ff06870 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:02.797147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6e938-261a-45e7-bfc0-cff20ff06870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:02.799413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6e938-261a-45e7-bfc0-cff20ff06870 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:02.829596 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4165/8367] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:40:02 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:40:02.833682 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088647ab-9893-4437-89e0-c7d346affce1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:02.844088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088647ab-9893-4437-89e0-c7d346affce1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:02.910596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dd9f4-678d-4509-acd8-6d8d3d2b1bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:02.911332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dd9f4-678d-4509-acd8-6d8d3d2b1bde admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:02.911633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dd9f4-678d-4509-acd8-6d8d3d2b1bde admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:02.911894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dd9f4-678d-4509-acd8-6d8d3d2b1bde admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:02.912798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dd9f4-678d-4509-acd8-6d8d3d2b1bde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:02.914827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dd9f4-678d-4509-acd8-6d8d3d2b1bde admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:02.924110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:02.941688 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4203/8368] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:40:02 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:40:02.942880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6e938-261a-45e7-bfc0-cff20ff06870 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:02.953634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6e938-261a-45e7-bfc0-cff20ff06870 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:02.958500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5b241-1357-4d36-b49c-feac79966177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:02.959159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5b241-1357-4d36-b49c-feac79966177 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:02.959438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5b241-1357-4d36-b49c-feac79966177 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:02.959710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5b241-1357-4d36-b49c-feac79966177 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:02.960440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5b241-1357-4d36-b49c-feac79966177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:02.962067 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5b241-1357-4d36-b49c-feac79966177 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:02.972523 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4166/8369] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:40:02.976703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dd9f4-678d-4509-acd8-6d8d3d2b1bde admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:02.987086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dd9f4-678d-4509-acd8-6d8d3d2b1bde admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:02.992080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cc040-db8c-44d6-a35e-cd1f798dc2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:02.992765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cc040-db8c-44d6-a35e-cd1f798dc2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:02.993041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cc040-db8c-44d6-a35e-cd1f798dc2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:02.993320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cc040-db8c-44d6-a35e-cd1f798dc2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:02.994062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1cc040-db8c-44d6-a35e-cd1f798dc2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:02.995665 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1cc040-db8c-44d6-a35e-cd1f798dc2f8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:03.005878 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4204/8370] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:40:03.009974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5b241-1357-4d36-b49c-feac79966177 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:03.020848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5b241-1357-4d36-b49c-feac79966177 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:03.026093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc1294-a04d-48ab-9afe-1e631bd2d274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:03.026984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc1294-a04d-48ab-9afe-1e631bd2d274 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:03.027274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc1294-a04d-48ab-9afe-1e631bd2d274 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:03.027548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc1294-a04d-48ab-9afe-1e631bd2d274 admin admin] PATH_INFO: `/v3/projects/75290a8686764e16aad048aa94ca031e/users/37ba31957fe2475f9d99e8ce3850daf0/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:03.043384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc1294-a04d-48ab-9afe-1e631bd2d274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75290a8686764e16aad048aa94ca031e, user_id=37ba31957fe2475f9d99e8ce3850daf0, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:03.046243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc1294-a04d-48ab-9afe-1e631bd2d274 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:03.062190 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4167/8371] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:40:03 2022] PUT /identity/v3/projects/75290a8686764e16aad048aa94ca031e/users/37ba31957fe2475f9d99e8ce3850daf0/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:03.074529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a2896-98b2-4f3d-a1ae-def14a1fe27f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:03.074917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a2896-98b2-4f3d-a1ae-def14a1fe27f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:03.075202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a2896-98b2-4f3d-a1ae-def14a1fe27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:03.104561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d35a2896-98b2-4f3d-a1ae-def14a1fe27f None None] MFA Rules not processed for user `37ba31957fe2475f9d99e8ce3850daf0`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:03.105833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d35a2896-98b2-4f3d-a1ae-def14a1fe27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:03.174657 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4205/8372] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:40:03.179553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc1294-a04d-48ab-9afe-1e631bd2d274 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:03.205771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:03.245395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc1294-a04d-48ab-9afe-1e631bd2d274 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:03.250431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b5c2b-285d-4e74-bfe5-cbc518278ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:03.251075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b5c2b-285d-4e74-bfe5-cbc518278ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:03.251358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b5c2b-285d-4e74-bfe5-cbc518278ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:03.251632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b5c2b-285d-4e74-bfe5-cbc518278ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:03.252373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b5c2b-285d-4e74-bfe5-cbc518278ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:03.254259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b5c2b-285d-4e74-bfe5-cbc518278ca6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:03.281594 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4168/8373] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:40:03 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:40:03.285846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a2896-98b2-4f3d-a1ae-def14a1fe27f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:03.297044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a2896-98b2-4f3d-a1ae-def14a1fe27f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:03.356659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe65a4-198f-46ad-be38-6af661e77473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:03.357272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe65a4-198f-46ad-be38-6af661e77473 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:03.357548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe65a4-198f-46ad-be38-6af661e77473 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:03.357825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe65a4-198f-46ad-be38-6af661e77473 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:03.358506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe65a4-198f-46ad-be38-6af661e77473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:03.360481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe65a4-198f-46ad-be38-6af661e77473 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:03.382616 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4206/8374] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:40:03 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:40:03.386689 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b5c2b-285d-4e74-bfe5-cbc518278ca6 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:03.397462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b5c2b-285d-4e74-bfe5-cbc518278ca6 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:03.403055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332a5c4-cf3b-4f01-b99f-989977d63fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:03.403725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332a5c4-cf3b-4f01-b99f-989977d63fbb admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:03.404006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332a5c4-cf3b-4f01-b99f-989977d63fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:03.404318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332a5c4-cf3b-4f01-b99f-989977d63fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:03.405164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332a5c4-cf3b-4f01-b99f-989977d63fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:03.406776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332a5c4-cf3b-4f01-b99f-989977d63fbb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:03.418056 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4169/8375] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:40:03.422108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe65a4-198f-46ad-be38-6af661e77473 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:03.433410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe65a4-198f-46ad-be38-6af661e77473 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:03.439340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2301f7b-9746-481f-a6b3-65d0ae3ebda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:03.440274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2301f7b-9746-481f-a6b3-65d0ae3ebda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:03.440556 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2301f7b-9746-481f-a6b3-65d0ae3ebda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:03.440832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2301f7b-9746-481f-a6b3-65d0ae3ebda3 admin admin] PATH_INFO: `/v3/projects/f54c1b3e310a4b6c8121011788ca9136/users/1ba1744ed2e94ce180782984f6d0c3db/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:03.456233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2301f7b-9746-481f-a6b3-65d0ae3ebda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54c1b3e310a4b6c8121011788ca9136, user_id=1ba1744ed2e94ce180782984f6d0c3db, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:03.458918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2301f7b-9746-481f-a6b3-65d0ae3ebda3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:03.473938 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4207/8376] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:40:03 2022] PUT /identity/v3/projects/f54c1b3e310a4b6c8121011788ca9136/users/1ba1744ed2e94ce180782984f6d0c3db/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:03.478174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332a5c4-cf3b-4f01-b99f-989977d63fbb admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:03.488600 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332a5c4-cf3b-4f01-b99f-989977d63fbb admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:03.549070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98352ae5-588f-43b1-95d4-a71d38108b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:03.549789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98352ae5-588f-43b1-95d4-a71d38108b87 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:03.550015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98352ae5-588f-43b1-95d4-a71d38108b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:03.550289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98352ae5-588f-43b1-95d4-a71d38108b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:03.551000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98352ae5-588f-43b1-95d4-a71d38108b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:03.552699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98352ae5-588f-43b1-95d4-a71d38108b87 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:03.565637 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4170/8377] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:40:03.571001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2301f7b-9746-481f-a6b3-65d0ae3ebda3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:03.582478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2301f7b-9746-481f-a6b3-65d0ae3ebda3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:03.589278 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d8260-2a77-4b3d-abe9-f0e9b9c84057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:03.590176 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d8260-2a77-4b3d-abe9-f0e9b9c84057 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:03.590456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d8260-2a77-4b3d-abe9-f0e9b9c84057 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:03.590731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d8260-2a77-4b3d-abe9-f0e9b9c84057 admin admin] PATH_INFO: `/v3/projects/f54c1b3e310a4b6c8121011788ca9136/users/1ba1744ed2e94ce180782984f6d0c3db/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:03.593179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d8260-2a77-4b3d-abe9-f0e9b9c84057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54c1b3e310a4b6c8121011788ca9136, user_id=1ba1744ed2e94ce180782984f6d0c3db, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:03.595953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d8260-2a77-4b3d-abe9-f0e9b9c84057 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:03.607536 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4208/8378] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:40:03 2022] PUT /identity/v3/projects/f54c1b3e310a4b6c8121011788ca9136/users/1ba1744ed2e94ce180782984f6d0c3db/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:03.618043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde62414-c6ca-42d8-a738-0c4a43febd4f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:03.618332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde62414-c6ca-42d8-a738-0c4a43febd4f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:03.618614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde62414-c6ca-42d8-a738-0c4a43febd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:03.647749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-dde62414-c6ca-42d8-a738-0c4a43febd4f None None] MFA Rules not processed for user `1ba1744ed2e94ce180782984f6d0c3db`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:03.648873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dde62414-c6ca-42d8-a738-0c4a43febd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:03.718051 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4171/8379] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:40:03.728579 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d8260-2a77-4b3d-abe9-f0e9b9c84057 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:03.730655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e16d8260-2a77-4b3d-abe9-f0e9b9c84057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:03.768194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:03.804479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d8260-2a77-4b3d-abe9-f0e9b9c84057 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:03.809057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10f56b-5e1c-4830-be85-1a1bf6463df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:03.809708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10f56b-5e1c-4830-be85-1a1bf6463df4 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:03.809987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10f56b-5e1c-4830-be85-1a1bf6463df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:03.810235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10f56b-5e1c-4830-be85-1a1bf6463df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:03.821015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10f56b-5e1c-4830-be85-1a1bf6463df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:03.822520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10f56b-5e1c-4830-be85-1a1bf6463df4 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:03.832746 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4209/8380] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:40:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:40:06.109295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde62414-c6ca-42d8-a738-0c4a43febd4f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:06.129801 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:06.179703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde62414-c6ca-42d8-a738-0c4a43febd4f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:06.184490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932be711-ae0f-464d-bb66-3a81ac534af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:06.185380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932be711-ae0f-464d-bb66-3a81ac534af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:06.185698 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932be711-ae0f-464d-bb66-3a81ac534af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:06.185965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932be711-ae0f-464d-bb66-3a81ac534af7 admin admin] PATH_INFO: `/v3/users/37ba31957fe2475f9d99e8ce3850daf0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:06.187175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932be711-ae0f-464d-bb66-3a81ac534af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ba31957fe2475f9d99e8ce3850daf0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:06.189152 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932be711-ae0f-464d-bb66-3a81ac534af7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:06.238633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-932be711-ae0f-464d-bb66-3a81ac534af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ba31957fe2475f9d99e8ce3850daf0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:06.246248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-932be711-ae0f-464d-bb66-3a81ac534af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ba31957fe2475f9d99e8ce3850daf0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:06.253960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-932be711-ae0f-464d-bb66-3a81ac534af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ba31957fe2475f9d99e8ce3850daf0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:06.254588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-932be711-ae0f-464d-bb66-3a81ac534af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ba31957fe2475f9d99e8ce3850daf0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:06.255196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-932be711-ae0f-464d-bb66-3a81ac534af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ba31957fe2475f9d99e8ce3850daf0'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:06.272548 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4172/8381] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:40:06 2022] DELETE /identity/v3/users/37ba31957fe2475f9d99e8ce3850daf0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:06.277340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d43624-b807-4611-8dfb-67555f4ed2ca None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:06.277817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d43624-b807-4611-8dfb-67555f4ed2ca None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:06.277920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d43624-b807-4611-8dfb-67555f4ed2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:06.296783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-03d43624-b807-4611-8dfb-67555f4ed2ca None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:06.298363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-03d43624-b807-4611-8dfb-67555f4ed2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:06.371719 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4210/8382] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:40:06.386832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932be711-ae0f-464d-bb66-3a81ac534af7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:06.388470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-932be711-ae0f-464d-bb66-3a81ac534af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:06.450549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932be711-ae0f-464d-bb66-3a81ac534af7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:06.454594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bc450-01ba-4227-a08a-31ae9de4674f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:06.455229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bc450-01ba-4227-a08a-31ae9de4674f service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:06.455510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bc450-01ba-4227-a08a-31ae9de4674f service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:06.455779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bc450-01ba-4227-a08a-31ae9de4674f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:06.465460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bc450-01ba-4227-a08a-31ae9de4674f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:06.466941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bc450-01ba-4227-a08a-31ae9de4674f service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:06.477376 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4173/8383] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:40:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:40:06.756085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d43624-b807-4611-8dfb-67555f4ed2ca None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:06.757641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-03d43624-b807-4611-8dfb-67555f4ed2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:06.772442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d43624-b807-4611-8dfb-67555f4ed2ca None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:06.778840 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac056b-a5d1-4fa9-a678-e1d9d13f47e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:06.779788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac056b-a5d1-4fa9-a678-e1d9d13f47e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:06.779979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac056b-a5d1-4fa9-a678-e1d9d13f47e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:06.780317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac056b-a5d1-4fa9-a678-e1d9d13f47e9 admin admin] PATH_INFO: `/v3/projects/75290a8686764e16aad048aa94ca031e` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:06.781611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac056b-a5d1-4fa9-a678-e1d9d13f47e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75290a8686764e16aad048aa94ca031e)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:06.783537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac056b-a5d1-4fa9-a678-e1d9d13f47e9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:06.833650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-76ac056b-a5d1-4fa9-a678-e1d9d13f47e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75290a8686764e16aad048aa94ca031e', 'request_id': 'req-76ac056b-a5d1-4fa9-a678-e1d9d13f47e9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:06.841741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-76ac056b-a5d1-4fa9-a678-e1d9d13f47e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75290a8686764e16aad048aa94ca031e', 'request_id': 'req-76ac056b-a5d1-4fa9-a678-e1d9d13f47e9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:06.848385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-76ac056b-a5d1-4fa9-a678-e1d9d13f47e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75290a8686764e16aad048aa94ca031e', 'request_id': 'req-76ac056b-a5d1-4fa9-a678-e1d9d13f47e9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:06.859737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-76ac056b-a5d1-4fa9-a678-e1d9d13f47e9 admin admin] The token cache is being invalidate because project 75290a8686764e16aad048aa94ca031e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:40:06.860065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-76ac056b-a5d1-4fa9-a678-e1d9d13f47e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:06.860724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-76ac056b-a5d1-4fa9-a678-e1d9d13f47e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:06.863223 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4211/8384] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:40:06 2022] DELETE /identity/v3/projects/75290a8686764e16aad048aa94ca031e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:06.868989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bc450-01ba-4227-a08a-31ae9de4674f service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:06.883931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bc450-01ba-4227-a08a-31ae9de4674f service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:06.925025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:06.946466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b960ce-a3ec-4d25-867f-16a2581b0c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:06.947344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b960ce-a3ec-4d25-867f-16a2581b0c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:06.947627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b960ce-a3ec-4d25-867f-16a2581b0c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:06.947902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b960ce-a3ec-4d25-867f-16a2581b0c99 admin admin] PATH_INFO: `/v3/users/1ba1744ed2e94ce180782984f6d0c3db` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:06.949136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b960ce-a3ec-4d25-867f-16a2581b0c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ba1744ed2e94ce180782984f6d0c3db)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:06.951075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b960ce-a3ec-4d25-867f-16a2581b0c99 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:07.008047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a0b960ce-a3ec-4d25-867f-16a2581b0c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ba1744ed2e94ce180782984f6d0c3db'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:07.016849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a0b960ce-a3ec-4d25-867f-16a2581b0c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ba1744ed2e94ce180782984f6d0c3db'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:07.023629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a0b960ce-a3ec-4d25-867f-16a2581b0c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ba1744ed2e94ce180782984f6d0c3db'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:07.024400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a0b960ce-a3ec-4d25-867f-16a2581b0c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ba1744ed2e94ce180782984f6d0c3db'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:07.025148 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a0b960ce-a3ec-4d25-867f-16a2581b0c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ba1744ed2e94ce180782984f6d0c3db'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:07.044419 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4174/8385] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:40:06 2022] DELETE /identity/v3/users/1ba1744ed2e94ce180782984f6d0c3db => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:07.327897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac056b-a5d1-4fa9-a678-e1d9d13f47e9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:07.330287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-76ac056b-a5d1-4fa9-a678-e1d9d13f47e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:07.345395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac056b-a5d1-4fa9-a678-e1d9d13f47e9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:07.395352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:07.407478 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a36634-de26-45a0-bca0-c6adb0d80900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:07.408475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a36634-de26-45a0-bca0-c6adb0d80900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:07.408802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a36634-de26-45a0-bca0-c6adb0d80900 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:07.409265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a36634-de26-45a0-bca0-c6adb0d80900 admin admin] PATH_INFO: `/v3/projects/f54c1b3e310a4b6c8121011788ca9136` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:07.410442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a36634-de26-45a0-bca0-c6adb0d80900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f54c1b3e310a4b6c8121011788ca9136)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:07.412462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a36634-de26-45a0-bca0-c6adb0d80900 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:07.461859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a3a36634-de26-45a0-bca0-c6adb0d80900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f54c1b3e310a4b6c8121011788ca9136', 'request_id': 'req-a3a36634-de26-45a0-bca0-c6adb0d80900'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:07.469698 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a3a36634-de26-45a0-bca0-c6adb0d80900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f54c1b3e310a4b6c8121011788ca9136', 'request_id': 'req-a3a36634-de26-45a0-bca0-c6adb0d80900'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:07.475865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a3a36634-de26-45a0-bca0-c6adb0d80900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f54c1b3e310a4b6c8121011788ca9136', 'request_id': 'req-a3a36634-de26-45a0-bca0-c6adb0d80900'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:07.486196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a3a36634-de26-45a0-bca0-c6adb0d80900 admin admin] The token cache is being invalidate because project f54c1b3e310a4b6c8121011788ca9136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:40:07.486484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a3a36634-de26-45a0-bca0-c6adb0d80900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:07.487121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a3a36634-de26-45a0-bca0-c6adb0d80900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:07.488839 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4212/8386] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:40:07 2022] DELETE /identity/v3/projects/f54c1b3e310a4b6c8121011788ca9136 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:07.494012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7703ed-0924-4fe0-9dd1-0d79aa68b2d0 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:07.494541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7703ed-0924-4fe0-9dd1-0d79aa68b2d0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:07.494672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7703ed-0924-4fe0-9dd1-0d79aa68b2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:07.512899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fb7703ed-0924-4fe0-9dd1-0d79aa68b2d0 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:07.514186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fb7703ed-0924-4fe0-9dd1-0d79aa68b2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:07.575835 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4175/8387] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:40:07.583843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86302f2c-6170-42e5-b907-9b9cab269802 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:07.584166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86302f2c-6170-42e5-b907-9b9cab269802 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:07.584450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86302f2c-6170-42e5-b907-9b9cab269802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:07.602859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-86302f2c-6170-42e5-b907-9b9cab269802 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:07.604134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-86302f2c-6170-42e5-b907-9b9cab269802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:07.616213 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4213/8388] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:40:07.622620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7703ed-0924-4fe0-9dd1-0d79aa68b2d0 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:07.633011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7703ed-0924-4fe0-9dd1-0d79aa68b2d0 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:07.638295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4a241-a96e-417e-ab97-40b398ce667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:07.638985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4a241-a96e-417e-ab97-40b398ce667c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:07.639271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4a241-a96e-417e-ab97-40b398ce667c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:07.639552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4a241-a96e-417e-ab97-40b398ce667c admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:07.640311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4a241-a96e-417e-ab97-40b398ce667c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:40:07.640622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4a241-a96e-417e-ab97-40b398ce667c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:07.642232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4a241-a96e-417e-ab97-40b398ce667c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:07.654068 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4176/8389] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:40:07.658587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86302f2c-6170-42e5-b907-9b9cab269802 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:07.667982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86302f2c-6170-42e5-b907-9b9cab269802 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:07.673786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ae462-5ef2-4458-b987-56b4d4081d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:07.674437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ae462-5ef2-4458-b987-56b4d4081d93 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:07.674721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ae462-5ef2-4458-b987-56b4d4081d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:07.674999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ae462-5ef2-4458-b987-56b4d4081d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:07.675685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ae462-5ef2-4458-b987-56b4d4081d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:07.677640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ae462-5ef2-4458-b987-56b4d4081d93 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:07.706725 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4214/8390] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:40:07 2022] POST /identity/v3/projects => generated 407 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:40:07.711025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4a241-a96e-417e-ab97-40b398ce667c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:07.722106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4a241-a96e-417e-ab97-40b398ce667c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:07.769882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:07.784286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1edb21-12b2-4291-9882-ed5ccd93ed20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:07.784960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1edb21-12b2-4291-9882-ed5ccd93ed20 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:07.785272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1edb21-12b2-4291-9882-ed5ccd93ed20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:07.785546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1edb21-12b2-4291-9882-ed5ccd93ed20 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:07.786273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1edb21-12b2-4291-9882-ed5ccd93ed20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:07.788261 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1edb21-12b2-4291-9882-ed5ccd93ed20 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:07.813882 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4177/8391] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:40:07 2022] POST /identity/v3/users => generated 304 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:40:07.815113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ae462-5ef2-4458-b987-56b4d4081d93 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:07.825657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ae462-5ef2-4458-b987-56b4d4081d93 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:07.830837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947b95d-6f7b-4d1f-946b-661c42f897f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:07.831496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947b95d-6f7b-4d1f-946b-661c42f897f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:07.831776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947b95d-6f7b-4d1f-946b-661c42f897f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:07.832074 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947b95d-6f7b-4d1f-946b-661c42f897f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:07.832792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947b95d-6f7b-4d1f-946b-661c42f897f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:07.834413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947b95d-6f7b-4d1f-946b-661c42f897f4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:07.845425 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4215/8392] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:40:07.849381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1edb21-12b2-4291-9882-ed5ccd93ed20 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:07.859668 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1edb21-12b2-4291-9882-ed5ccd93ed20 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:07.866400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf00a4b-dea1-441b-a863-efaa2d67db13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:07.867062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf00a4b-dea1-441b-a863-efaa2d67db13 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:07.867374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf00a4b-dea1-441b-a863-efaa2d67db13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:07.867645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf00a4b-dea1-441b-a863-efaa2d67db13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:07.868402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf00a4b-dea1-441b-a863-efaa2d67db13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:07.870043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf00a4b-dea1-441b-a863-efaa2d67db13 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:07.881043 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4178/8393] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:40:07.885242 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947b95d-6f7b-4d1f-946b-661c42f897f4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:07.895620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947b95d-6f7b-4d1f-946b-661c42f897f4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:07.900714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9e1ee-ad5e-45e1-935f-6d2c0cd9e774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:07.901613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9e1ee-ad5e-45e1-935f-6d2c0cd9e774 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:07.901893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9e1ee-ad5e-45e1-935f-6d2c0cd9e774 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:07.902196 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9e1ee-ad5e-45e1-935f-6d2c0cd9e774 admin admin] PATH_INFO: `/v3/projects/8a6cd9b3cd3f49aea0f3f26bcf3d4300/users/190b93e34a5f44cbb8a91f6739e9de71/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:07.918030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9e1ee-ad5e-45e1-935f-6d2c0cd9e774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6cd9b3cd3f49aea0f3f26bcf3d4300, user_id=190b93e34a5f44cbb8a91f6739e9de71, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:07.920777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9e1ee-ad5e-45e1-935f-6d2c0cd9e774 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:07.937161 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4216/8394] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:40:07 2022] PUT /identity/v3/projects/8a6cd9b3cd3f49aea0f3f26bcf3d4300/users/190b93e34a5f44cbb8a91f6739e9de71/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:07.952518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191c202-059e-4e06-823f-3a6e02d85134 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:07.952812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191c202-059e-4e06-823f-3a6e02d85134 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:07.953111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191c202-059e-4e06-823f-3a6e02d85134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:07.981646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3191c202-059e-4e06-823f-3a6e02d85134 None None] MFA Rules not processed for user `190b93e34a5f44cbb8a91f6739e9de71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:07.982915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3191c202-059e-4e06-823f-3a6e02d85134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:08.049116 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4179/8395] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:40:08.054489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9e1ee-ad5e-45e1-935f-6d2c0cd9e774 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:08.124324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9e1ee-ad5e-45e1-935f-6d2c0cd9e774 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:08.129605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73220f-fe36-4887-bbba-ddc01ce2764b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:08.130295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73220f-fe36-4887-bbba-ddc01ce2764b admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:08.130576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73220f-fe36-4887-bbba-ddc01ce2764b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:08.130854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73220f-fe36-4887-bbba-ddc01ce2764b admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:08.131535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73220f-fe36-4887-bbba-ddc01ce2764b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:08.133510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73220f-fe36-4887-bbba-ddc01ce2764b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:08.161522 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4217/8396] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:40:08 2022] POST /identity/v3/projects => generated 407 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:40:08.167199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191c202-059e-4e06-823f-3a6e02d85134 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:08.179488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191c202-059e-4e06-823f-3a6e02d85134 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:08.239914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8be86a-7d4f-4df9-a9f4-16bea2489767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:08.240615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8be86a-7d4f-4df9-a9f4-16bea2489767 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:08.240901 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8be86a-7d4f-4df9-a9f4-16bea2489767 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:08.241178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8be86a-7d4f-4df9-a9f4-16bea2489767 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:08.241881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8be86a-7d4f-4df9-a9f4-16bea2489767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:08.243821 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8be86a-7d4f-4df9-a9f4-16bea2489767 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:08.264498 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4180/8397] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:40:08 2022] POST /identity/v3/users => generated 310 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:40:08.268644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73220f-fe36-4887-bbba-ddc01ce2764b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:08.274259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:08.280945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73220f-fe36-4887-bbba-ddc01ce2764b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:08.287285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fe4da-30da-436d-b6b8-c2b5315f91b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:08.287984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fe4da-30da-436d-b6b8-c2b5315f91b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:08.288381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fe4da-30da-436d-b6b8-c2b5315f91b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:08.288648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fe4da-30da-436d-b6b8-c2b5315f91b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:08.289387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fe4da-30da-436d-b6b8-c2b5315f91b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:08.291000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fe4da-30da-436d-b6b8-c2b5315f91b1 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:08.302393 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4218/8398] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:40:08.306731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8be86a-7d4f-4df9-a9f4-16bea2489767 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:08.317203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8be86a-7d4f-4df9-a9f4-16bea2489767 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:08.322412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62995356-69ca-4b94-b6aa-ab474631c9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:08.323298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62995356-69ca-4b94-b6aa-ab474631c9bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:08.323577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62995356-69ca-4b94-b6aa-ab474631c9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:08.323850 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62995356-69ca-4b94-b6aa-ab474631c9bc admin admin] PATH_INFO: `/v3/projects/e05c8f4e7af9483f9f29bc13572f47a1/users/1b3df2ce6387414399b6e8169094435d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:08.340247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62995356-69ca-4b94-b6aa-ab474631c9bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05c8f4e7af9483f9f29bc13572f47a1, user_id=1b3df2ce6387414399b6e8169094435d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:08.343027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62995356-69ca-4b94-b6aa-ab474631c9bc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:08.357957 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4181/8399] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:40:08 2022] PUT /identity/v3/projects/e05c8f4e7af9483f9f29bc13572f47a1/users/1b3df2ce6387414399b6e8169094435d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:08.361984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fe4da-30da-436d-b6b8-c2b5315f91b1 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:08.372576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fe4da-30da-436d-b6b8-c2b5315f91b1 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:08.432453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f9d22-f37d-4262-829d-1bb52e3067b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:08.433047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f9d22-f37d-4262-829d-1bb52e3067b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:08.433371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f9d22-f37d-4262-829d-1bb52e3067b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:08.433677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f9d22-f37d-4262-829d-1bb52e3067b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:08.434370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f9d22-f37d-4262-829d-1bb52e3067b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:08.436080 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f9d22-f37d-4262-829d-1bb52e3067b0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:08.446153 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4219/8400] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:40:08.450635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62995356-69ca-4b94-b6aa-ab474631c9bc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:08.461620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62995356-69ca-4b94-b6aa-ab474631c9bc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:08.467489 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88550367-06e1-449a-84d8-1ccdde2d7563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:08.468443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88550367-06e1-449a-84d8-1ccdde2d7563 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:08.468725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88550367-06e1-449a-84d8-1ccdde2d7563 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:08.469003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88550367-06e1-449a-84d8-1ccdde2d7563 admin admin] PATH_INFO: `/v3/projects/e05c8f4e7af9483f9f29bc13572f47a1/users/1b3df2ce6387414399b6e8169094435d/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:08.471262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88550367-06e1-449a-84d8-1ccdde2d7563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05c8f4e7af9483f9f29bc13572f47a1, user_id=1b3df2ce6387414399b6e8169094435d, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:08.473969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88550367-06e1-449a-84d8-1ccdde2d7563 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:08.485047 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4182/8401] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:40:08 2022] PUT /identity/v3/projects/e05c8f4e7af9483f9f29bc13572f47a1/users/1b3df2ce6387414399b6e8169094435d/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:40:08.495316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5e5bc-ac67-4568-a498-63a5fc945981 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:08.495609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5e5bc-ac67-4568-a498-63a5fc945981 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:08.495892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5e5bc-ac67-4568-a498-63a5fc945981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:08.522208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b4b5e5bc-ac67-4568-a498-63a5fc945981 None None] MFA Rules not processed for user `1b3df2ce6387414399b6e8169094435d`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:08.523416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b4b5e5bc-ac67-4568-a498-63a5fc945981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:08.594351 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4220/8402] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:08 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:40:08.604571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88550367-06e1-449a-84d8-1ccdde2d7563 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:08.606477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-88550367-06e1-449a-84d8-1ccdde2d7563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:08.617166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:08.670466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88550367-06e1-449a-84d8-1ccdde2d7563 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:08.674939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8d3a2-f741-48dd-9268-2fb1c2a5b083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:08.675603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8d3a2-f741-48dd-9268-2fb1c2a5b083 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:08.675885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8d3a2-f741-48dd-9268-2fb1c2a5b083 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:08.676308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8d3a2-f741-48dd-9268-2fb1c2a5b083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:08.735595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8d3a2-f741-48dd-9268-2fb1c2a5b083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:08.737020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8d3a2-f741-48dd-9268-2fb1c2a5b083 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:08.746222 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4183/8403] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:40:08 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:40:09.107896 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5e5bc-ac67-4568-a498-63a5fc945981 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:09.109310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b4b5e5bc-ac67-4568-a498-63a5fc945981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:09.190945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5e5bc-ac67-4568-a498-63a5fc945981 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:09.197113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97527c1-2e38-47c7-9516-5d5b9d389b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:09.197769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97527c1-2e38-47c7-9516-5d5b9d389b2d service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:09.198052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97527c1-2e38-47c7-9516-5d5b9d389b2d service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:09.198330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97527c1-2e38-47c7-9516-5d5b9d389b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:09.206804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97527c1-2e38-47c7-9516-5d5b9d389b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:09.208505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97527c1-2e38-47c7-9516-5d5b9d389b2d service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:09.212473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:09.219203 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4221/8404] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:40:09 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:40:14.027393 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8d3a2-f741-48dd-9268-2fb1c2a5b083 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:14.095651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8d3a2-f741-48dd-9268-2fb1c2a5b083 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:14.101153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84226ea4-323e-4d10-a3f0-a1e749242b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:14.102085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84226ea4-323e-4d10-a3f0-a1e749242b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:14.102394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84226ea4-323e-4d10-a3f0-a1e749242b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:14.102676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84226ea4-323e-4d10-a3f0-a1e749242b30 admin admin] PATH_INFO: `/v3/users/190b93e34a5f44cbb8a91f6739e9de71` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:14.103905 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84226ea4-323e-4d10-a3f0-a1e749242b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=190b93e34a5f44cbb8a91f6739e9de71)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:14.105894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84226ea4-323e-4d10-a3f0-a1e749242b30 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:14.155727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-84226ea4-323e-4d10-a3f0-a1e749242b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '190b93e34a5f44cbb8a91f6739e9de71'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:14.165387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-84226ea4-323e-4d10-a3f0-a1e749242b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '190b93e34a5f44cbb8a91f6739e9de71'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:14.173607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-84226ea4-323e-4d10-a3f0-a1e749242b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '190b93e34a5f44cbb8a91f6739e9de71'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:14.174277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-84226ea4-323e-4d10-a3f0-a1e749242b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '190b93e34a5f44cbb8a91f6739e9de71'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:14.174934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-84226ea4-323e-4d10-a3f0-a1e749242b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '190b93e34a5f44cbb8a91f6739e9de71'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:14.176118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:14.196773 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4184/8405] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:40:14 2022] DELETE /identity/v3/users/190b93e34a5f44cbb8a91f6739e9de71 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:14.201704 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a78de-236e-4c03-b10d-50f2725d9f24 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:14.202248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a78de-236e-4c03-b10d-50f2725d9f24 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:14.202248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a78de-236e-4c03-b10d-50f2725d9f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:14.221036 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3d8a78de-236e-4c03-b10d-50f2725d9f24 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:14.222262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3d8a78de-236e-4c03-b10d-50f2725d9f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:14.283204 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4222/8406] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:40:14.293358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84226ea4-323e-4d10-a3f0-a1e749242b30 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:14.295132 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-84226ea4-323e-4d10-a3f0-a1e749242b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:14.363224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84226ea4-323e-4d10-a3f0-a1e749242b30 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:14.367359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d987f-4bdd-4374-b1b4-4b5a846011b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:14.368019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d987f-4bdd-4374-b1b4-4b5a846011b8 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:14.368340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d987f-4bdd-4374-b1b4-4b5a846011b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:14.368616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d987f-4bdd-4374-b1b4-4b5a846011b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:14.379147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d987f-4bdd-4374-b1b4-4b5a846011b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:14.380620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d987f-4bdd-4374-b1b4-4b5a846011b8 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:14.391173 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4185/8407] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:40:14.578639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a78de-236e-4c03-b10d-50f2725d9f24 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:14.580400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3d8a78de-236e-4c03-b10d-50f2725d9f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:14.593376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a78de-236e-4c03-b10d-50f2725d9f24 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:14.599384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa24af4-7804-4819-844d-6d1007bf6812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:14.600318 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa24af4-7804-4819-844d-6d1007bf6812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:14.600602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa24af4-7804-4819-844d-6d1007bf6812 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:14.600964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa24af4-7804-4819-844d-6d1007bf6812 admin admin] PATH_INFO: `/v3/projects/8a6cd9b3cd3f49aea0f3f26bcf3d4300` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:14.602192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa24af4-7804-4819-844d-6d1007bf6812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a6cd9b3cd3f49aea0f3f26bcf3d4300)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:14.604213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa24af4-7804-4819-844d-6d1007bf6812 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:14.658496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ffa24af4-7804-4819-844d-6d1007bf6812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a6cd9b3cd3f49aea0f3f26bcf3d4300', 'request_id': 'req-ffa24af4-7804-4819-844d-6d1007bf6812'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:14.668442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ffa24af4-7804-4819-844d-6d1007bf6812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a6cd9b3cd3f49aea0f3f26bcf3d4300', 'request_id': 'req-ffa24af4-7804-4819-844d-6d1007bf6812'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:14.675540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ffa24af4-7804-4819-844d-6d1007bf6812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a6cd9b3cd3f49aea0f3f26bcf3d4300', 'request_id': 'req-ffa24af4-7804-4819-844d-6d1007bf6812'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:14.686103 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ffa24af4-7804-4819-844d-6d1007bf6812 admin admin] The token cache is being invalidate because project 8a6cd9b3cd3f49aea0f3f26bcf3d4300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:40:14.686391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ffa24af4-7804-4819-844d-6d1007bf6812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:14.687044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-ffa24af4-7804-4819-844d-6d1007bf6812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:14.688692 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4223/8408] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:40:14 2022] DELETE /identity/v3/projects/8a6cd9b3cd3f49aea0f3f26bcf3d4300 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:14.692894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d987f-4bdd-4374-b1b4-4b5a846011b8 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:14.703111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d987f-4bdd-4374-b1b4-4b5a846011b8 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:14.762229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24349ec8-8980-40f3-8727-68b4f738ad55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:14.763112 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24349ec8-8980-40f3-8727-68b4f738ad55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:14.763396 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24349ec8-8980-40f3-8727-68b4f738ad55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:14.763706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24349ec8-8980-40f3-8727-68b4f738ad55 admin admin] PATH_INFO: `/v3/users/1b3df2ce6387414399b6e8169094435d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:14.764942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24349ec8-8980-40f3-8727-68b4f738ad55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b3df2ce6387414399b6e8169094435d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:14.766875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24349ec8-8980-40f3-8727-68b4f738ad55 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:14.814750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24349ec8-8980-40f3-8727-68b4f738ad55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b3df2ce6387414399b6e8169094435d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:14.823771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24349ec8-8980-40f3-8727-68b4f738ad55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b3df2ce6387414399b6e8169094435d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:14.831156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24349ec8-8980-40f3-8727-68b4f738ad55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b3df2ce6387414399b6e8169094435d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:14.831826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24349ec8-8980-40f3-8727-68b4f738ad55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b3df2ce6387414399b6e8169094435d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:14.832488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-24349ec8-8980-40f3-8727-68b4f738ad55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b3df2ce6387414399b6e8169094435d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:14.851024 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4186/8409] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:40:14 2022] DELETE /identity/v3/users/1b3df2ce6387414399b6e8169094435d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:40:15.033703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa24af4-7804-4819-844d-6d1007bf6812 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:15.035279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ffa24af4-7804-4819-844d-6d1007bf6812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:15.051878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa24af4-7804-4819-844d-6d1007bf6812 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:15.112458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efba1d9-317a-4e63-8ea1-8c7ce4f8311b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:15.113339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efba1d9-317a-4e63-8ea1-8c7ce4f8311b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:15.113619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efba1d9-317a-4e63-8ea1-8c7ce4f8311b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:15.113892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efba1d9-317a-4e63-8ea1-8c7ce4f8311b admin admin] PATH_INFO: `/v3/projects/e05c8f4e7af9483f9f29bc13572f47a1` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:15.115068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efba1d9-317a-4e63-8ea1-8c7ce4f8311b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e05c8f4e7af9483f9f29bc13572f47a1)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:15.117041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efba1d9-317a-4e63-8ea1-8c7ce4f8311b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:15.141024 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:15.167941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6efba1d9-317a-4e63-8ea1-8c7ce4f8311b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e05c8f4e7af9483f9f29bc13572f47a1', 'request_id': 'req-6efba1d9-317a-4e63-8ea1-8c7ce4f8311b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:15.177779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6efba1d9-317a-4e63-8ea1-8c7ce4f8311b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e05c8f4e7af9483f9f29bc13572f47a1', 'request_id': 'req-6efba1d9-317a-4e63-8ea1-8c7ce4f8311b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:15.184334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6efba1d9-317a-4e63-8ea1-8c7ce4f8311b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e05c8f4e7af9483f9f29bc13572f47a1', 'request_id': 'req-6efba1d9-317a-4e63-8ea1-8c7ce4f8311b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:15.194696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6efba1d9-317a-4e63-8ea1-8c7ce4f8311b admin admin] The token cache is being invalidate because project e05c8f4e7af9483f9f29bc13572f47a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:40:15.194986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6efba1d9-317a-4e63-8ea1-8c7ce4f8311b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:15.195653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6efba1d9-317a-4e63-8ea1-8c7ce4f8311b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:15.197298 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4224/8410] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:40:15 2022] DELETE /identity/v3/projects/e05c8f4e7af9483f9f29bc13572f47a1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:15.202418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f79aa-1935-4354-a1ee-c0cadbbdb4d2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:15.202924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f79aa-1935-4354-a1ee-c0cadbbdb4d2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:15.203040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f79aa-1935-4354-a1ee-c0cadbbdb4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:15.209414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:15.223464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-655f79aa-1935-4354-a1ee-c0cadbbdb4d2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:15.224729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-655f79aa-1935-4354-a1ee-c0cadbbdb4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:15.295509 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4187/8411] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:40:15.307598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6852d31-5c35-4138-89ba-59cf8ca56409 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:15.308298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6852d31-5c35-4138-89ba-59cf8ca56409 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:15.308298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6852d31-5c35-4138-89ba-59cf8ca56409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:15.328224 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f6852d31-5c35-4138-89ba-59cf8ca56409 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:15.329435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f6852d31-5c35-4138-89ba-59cf8ca56409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:15.338882 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4225/8412] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:40:15.343375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f79aa-1935-4354-a1ee-c0cadbbdb4d2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:15.353353 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f79aa-1935-4354-a1ee-c0cadbbdb4d2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:15.358553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f889e3b-25df-49af-840e-aba04cda70a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:15.359206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f889e3b-25df-49af-840e-aba04cda70a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:15.359490 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f889e3b-25df-49af-840e-aba04cda70a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:15.359750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f889e3b-25df-49af-840e-aba04cda70a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:15.360509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f889e3b-25df-49af-840e-aba04cda70a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:40:15.360816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f889e3b-25df-49af-840e-aba04cda70a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:15.362431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f889e3b-25df-49af-840e-aba04cda70a9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:15.374574 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4188/8413] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:40:15.378748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6852d31-5c35-4138-89ba-59cf8ca56409 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:15.388737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6852d31-5c35-4138-89ba-59cf8ca56409 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:15.394724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd466860-5ea7-4dc9-9000-8e66ff4ed97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:15.395407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd466860-5ea7-4dc9-9000-8e66ff4ed97f admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:15.395691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd466860-5ea7-4dc9-9000-8e66ff4ed97f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:15.395966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd466860-5ea7-4dc9-9000-8e66ff4ed97f admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:15.396700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd466860-5ea7-4dc9-9000-8e66ff4ed97f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:15.398640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd466860-5ea7-4dc9-9000-8e66ff4ed97f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:15.428441 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4226/8414] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:40:15 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:40:15.434048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f889e3b-25df-49af-840e-aba04cda70a9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:15.445263 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f889e3b-25df-49af-840e-aba04cda70a9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:15.505789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740d6f7-b493-4acb-9ef2-a4e98befa943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:15.506398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740d6f7-b493-4acb-9ef2-a4e98befa943 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:15.506679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740d6f7-b493-4acb-9ef2-a4e98befa943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:15.506953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740d6f7-b493-4acb-9ef2-a4e98befa943 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:15.507667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740d6f7-b493-4acb-9ef2-a4e98befa943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:15.509640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740d6f7-b493-4acb-9ef2-a4e98befa943 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:15.531237 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4189/8415] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:40:15 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:40:15.535538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd466860-5ea7-4dc9-9000-8e66ff4ed97f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:15.546396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd466860-5ea7-4dc9-9000-8e66ff4ed97f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:15.552253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908adf74-e018-43d1-ba16-227c8be26d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:15.552915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908adf74-e018-43d1-ba16-227c8be26d04 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:15.553195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908adf74-e018-43d1-ba16-227c8be26d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:15.553795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908adf74-e018-43d1-ba16-227c8be26d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:15.554177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908adf74-e018-43d1-ba16-227c8be26d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:15.555829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908adf74-e018-43d1-ba16-227c8be26d04 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:15.567179 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4227/8416] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:40:15.571047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740d6f7-b493-4acb-9ef2-a4e98befa943 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:15.581729 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740d6f7-b493-4acb-9ef2-a4e98befa943 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:15.586930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f9960-020a-4861-9c1b-12ecdbf58fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:15.587589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f9960-020a-4861-9c1b-12ecdbf58fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:15.587875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f9960-020a-4861-9c1b-12ecdbf58fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:15.588196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f9960-020a-4861-9c1b-12ecdbf58fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:15.588957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f9960-020a-4861-9c1b-12ecdbf58fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:15.590554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f9960-020a-4861-9c1b-12ecdbf58fe3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:15.600910 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4190/8417] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:40:15.605147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908adf74-e018-43d1-ba16-227c8be26d04 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:15.615500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908adf74-e018-43d1-ba16-227c8be26d04 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:15.620525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09919911-2cba-4164-96ae-1658cd6ed37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:15.621398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09919911-2cba-4164-96ae-1658cd6ed37b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:15.621683 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09919911-2cba-4164-96ae-1658cd6ed37b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:15.622082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09919911-2cba-4164-96ae-1658cd6ed37b admin admin] PATH_INFO: `/v3/projects/c5d9ff296eb7460f9f340e7710db59aa/users/f9a31618f915485682e058614548aedc/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:15.637199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09919911-2cba-4164-96ae-1658cd6ed37b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d9ff296eb7460f9f340e7710db59aa, user_id=f9a31618f915485682e058614548aedc, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:15.640070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09919911-2cba-4164-96ae-1658cd6ed37b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:15.656800 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4228/8418] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:40:15 2022] PUT /identity/v3/projects/c5d9ff296eb7460f9f340e7710db59aa/users/f9a31618f915485682e058614548aedc/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:15.667140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578c2b8-81d9-4d09-bc04-559141804b1b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:15.667433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578c2b8-81d9-4d09-bc04-559141804b1b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:15.667706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578c2b8-81d9-4d09-bc04-559141804b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:15.698678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b578c2b8-81d9-4d09-bc04-559141804b1b None None] MFA Rules not processed for user `f9a31618f915485682e058614548aedc`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:15.699920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b578c2b8-81d9-4d09-bc04-559141804b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:15.764419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:15.770369 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4191/8419] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:40:15.780600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09919911-2cba-4164-96ae-1658cd6ed37b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:15.782423 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-09919911-2cba-4164-96ae-1658cd6ed37b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:15.846026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09919911-2cba-4164-96ae-1658cd6ed37b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:15.850345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accac78-1c24-45b5-bd2d-1a372fe70c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:15.850990 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accac78-1c24-45b5-bd2d-1a372fe70c3b service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:15.851283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accac78-1c24-45b5-bd2d-1a372fe70c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:15.851542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accac78-1c24-45b5-bd2d-1a372fe70c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:15.860859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accac78-1c24-45b5-bd2d-1a372fe70c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:15.862324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4accac78-1c24-45b5-bd2d-1a372fe70c3b service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:15.871734 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4229/8420] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:40:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:40:20.312837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578c2b8-81d9-4d09-bc04-559141804b1b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:20.379776 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578c2b8-81d9-4d09-bc04-559141804b1b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:20.384444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f315c02-959b-470c-88f0-2e9d32ae44bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:20.385325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f315c02-959b-470c-88f0-2e9d32ae44bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:20.385610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f315c02-959b-470c-88f0-2e9d32ae44bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:20.385888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f315c02-959b-470c-88f0-2e9d32ae44bb admin admin] PATH_INFO: `/v3/users/f9a31618f915485682e058614548aedc` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:20.387095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f315c02-959b-470c-88f0-2e9d32ae44bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a31618f915485682e058614548aedc)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:20.389234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f315c02-959b-470c-88f0-2e9d32ae44bb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:20.442488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2f315c02-959b-470c-88f0-2e9d32ae44bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a31618f915485682e058614548aedc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:20.451337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2f315c02-959b-470c-88f0-2e9d32ae44bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a31618f915485682e058614548aedc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:20.458771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2f315c02-959b-470c-88f0-2e9d32ae44bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a31618f915485682e058614548aedc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:20.459439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2f315c02-959b-470c-88f0-2e9d32ae44bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a31618f915485682e058614548aedc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:20.460075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-2f315c02-959b-470c-88f0-2e9d32ae44bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a31618f915485682e058614548aedc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:20.478429 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4192/8421] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:40:20 2022] DELETE /identity/v3/users/f9a31618f915485682e058614548aedc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:20.483237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1b57c-e6e8-43a1-9f18-3bb4fe97401f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:20.483773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1b57c-e6e8-43a1-9f18-3bb4fe97401f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:20.483773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1b57c-e6e8-43a1-9f18-3bb4fe97401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:20.502430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8aa1b57c-e6e8-43a1-9f18-3bb4fe97401f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:20.503599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8aa1b57c-e6e8-43a1-9f18-3bb4fe97401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:20.562136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:20.579386 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4230/8422] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:40:20.589290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f315c02-959b-470c-88f0-2e9d32ae44bb admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:20.590897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2f315c02-959b-470c-88f0-2e9d32ae44bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:20.653232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f315c02-959b-470c-88f0-2e9d32ae44bb admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:20.657415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cf3e2-99ca-4736-b792-c43e98e61c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:20.658062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cf3e2-99ca-4736-b792-c43e98e61c0c service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:20.658346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cf3e2-99ca-4736-b792-c43e98e61c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:20.658623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cf3e2-99ca-4736-b792-c43e98e61c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:20.668914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cf3e2-99ca-4736-b792-c43e98e61c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:20.670414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cf3e2-99ca-4736-b792-c43e98e61c0c service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:20.680584 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4193/8423] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:40:20.857516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1b57c-e6e8-43a1-9f18-3bb4fe97401f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:20.859129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8aa1b57c-e6e8-43a1-9f18-3bb4fe97401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:20.873482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1b57c-e6e8-43a1-9f18-3bb4fe97401f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:20.879026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f5a53-c8cf-4738-bb6b-c449f2026b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:20.880012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f5a53-c8cf-4738-bb6b-c449f2026b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:20.880387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f5a53-c8cf-4738-bb6b-c449f2026b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:20.880722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f5a53-c8cf-4738-bb6b-c449f2026b3c admin admin] PATH_INFO: `/v3/projects/c5d9ff296eb7460f9f340e7710db59aa` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:20.882115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f5a53-c8cf-4738-bb6b-c449f2026b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5d9ff296eb7460f9f340e7710db59aa)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:20.884170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f5a53-c8cf-4738-bb6b-c449f2026b3c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:20.934547 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f61f5a53-c8cf-4738-bb6b-c449f2026b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5d9ff296eb7460f9f340e7710db59aa', 'request_id': 'req-f61f5a53-c8cf-4738-bb6b-c449f2026b3c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:20.942451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f61f5a53-c8cf-4738-bb6b-c449f2026b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5d9ff296eb7460f9f340e7710db59aa', 'request_id': 'req-f61f5a53-c8cf-4738-bb6b-c449f2026b3c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:20.948991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f61f5a53-c8cf-4738-bb6b-c449f2026b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5d9ff296eb7460f9f340e7710db59aa', 'request_id': 'req-f61f5a53-c8cf-4738-bb6b-c449f2026b3c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:20.959654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f61f5a53-c8cf-4738-bb6b-c449f2026b3c admin admin] The token cache is being invalidate because project c5d9ff296eb7460f9f340e7710db59aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:40:20.959944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f61f5a53-c8cf-4738-bb6b-c449f2026b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:20.960644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f61f5a53-c8cf-4738-bb6b-c449f2026b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:20.962232 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4231/8424] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:40:20 2022] DELETE /identity/v3/projects/c5d9ff296eb7460f9f340e7710db59aa => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:20.967457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc28c59-d2ea-4b49-aaac-4254ece93410 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:20.967749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc28c59-d2ea-4b49-aaac-4254ece93410 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:20.968073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc28c59-d2ea-4b49-aaac-4254ece93410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:20.987119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ccc28c59-d2ea-4b49-aaac-4254ece93410 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:20.988413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ccc28c59-d2ea-4b49-aaac-4254ece93410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:21.002191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:21.057604 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4194/8425] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:40:21.066050 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212e36a-d085-485c-8d32-c028cc97ac97 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:21.066335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212e36a-d085-485c-8d32-c028cc97ac97 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:21.066614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212e36a-d085-485c-8d32-c028cc97ac97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:21.085988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7212e36a-d085-485c-8d32-c028cc97ac97 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:21.087307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7212e36a-d085-485c-8d32-c028cc97ac97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:21.096230 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4232/8426] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:40:21.101271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc28c59-d2ea-4b49-aaac-4254ece93410 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:21.114048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc28c59-d2ea-4b49-aaac-4254ece93410 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:21.121059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a37fb-af5d-48e5-86ac-8aae1f361dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:21.122027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a37fb-af5d-48e5-86ac-8aae1f361dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:21.122381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a37fb-af5d-48e5-86ac-8aae1f361dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:21.122707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a37fb-af5d-48e5-86ac-8aae1f361dd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:21.123730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a37fb-af5d-48e5-86ac-8aae1f361dd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:40:21.124198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a37fb-af5d-48e5-86ac-8aae1f361dd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:21.126657 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a37fb-af5d-48e5-86ac-8aae1f361dd4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:21.140512 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4195/8427] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:40:21.145043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212e36a-d085-485c-8d32-c028cc97ac97 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:21.155925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212e36a-d085-485c-8d32-c028cc97ac97 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:21.162007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e286e-28b0-4ede-9162-72bfd1a01d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:21.162663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e286e-28b0-4ede-9162-72bfd1a01d08 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:21.162944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e286e-28b0-4ede-9162-72bfd1a01d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:21.163209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e286e-28b0-4ede-9162-72bfd1a01d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:21.163926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e286e-28b0-4ede-9162-72bfd1a01d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:21.165891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e286e-28b0-4ede-9162-72bfd1a01d08 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:21.194740 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4233/8428] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:40:21 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:40:21.198968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a37fb-af5d-48e5-86ac-8aae1f361dd4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:21.209109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a37fb-af5d-48e5-86ac-8aae1f361dd4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:21.270767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3392d-65f8-4826-af33-367c64a2bfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:21.271443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3392d-65f8-4826-af33-367c64a2bfd9 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:21.271731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3392d-65f8-4826-af33-367c64a2bfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:21.272007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3392d-65f8-4826-af33-367c64a2bfd9 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:21.272743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3392d-65f8-4826-af33-367c64a2bfd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:21.274683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3392d-65f8-4826-af33-367c64a2bfd9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:21.295676 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4196/8429] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:40:21 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:40:21.302310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e286e-28b0-4ede-9162-72bfd1a01d08 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:21.317120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e286e-28b0-4ede-9162-72bfd1a01d08 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:21.322517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b377e-c460-4cf6-b433-93a05c1f4e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:21.323193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b377e-c460-4cf6-b433-93a05c1f4e98 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:21.323479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b377e-c460-4cf6-b433-93a05c1f4e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:21.323756 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b377e-c460-4cf6-b433-93a05c1f4e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:21.324519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b377e-c460-4cf6-b433-93a05c1f4e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:21.326168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b377e-c460-4cf6-b433-93a05c1f4e98 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:21.337276 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4234/8430] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:40:21.341577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3392d-65f8-4826-af33-367c64a2bfd9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:21.353248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3392d-65f8-4826-af33-367c64a2bfd9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:21.358622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f0bcb-a6f4-4710-9b1f-0be4fa931bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:21.359344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f0bcb-a6f4-4710-9b1f-0be4fa931bbf admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:21.359629 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f0bcb-a6f4-4710-9b1f-0be4fa931bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:21.360080 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f0bcb-a6f4-4710-9b1f-0be4fa931bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:21.360826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f0bcb-a6f4-4710-9b1f-0be4fa931bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:21.362436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f0bcb-a6f4-4710-9b1f-0be4fa931bbf admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:21.373473 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4197/8431] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:40:21.377982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b377e-c460-4cf6-b433-93a05c1f4e98 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:21.388598 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b377e-c460-4cf6-b433-93a05c1f4e98 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:21.394051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7ead8-b582-4d6d-991b-39a3b79fbfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:21.394923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7ead8-b582-4d6d-991b-39a3b79fbfa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:21.395202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7ead8-b582-4d6d-991b-39a3b79fbfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:21.395479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7ead8-b582-4d6d-991b-39a3b79fbfa8 admin admin] PATH_INFO: `/v3/projects/9f24c6b6ed2b432b9b25b85e65eab938/users/4873c956bf574189964e76bfa3c23a86/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:21.410679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7ead8-b582-4d6d-991b-39a3b79fbfa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f24c6b6ed2b432b9b25b85e65eab938, user_id=4873c956bf574189964e76bfa3c23a86, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:21.413381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7ead8-b582-4d6d-991b-39a3b79fbfa8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:21.429244 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4235/8432] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:40:21 2022] PUT /identity/v3/projects/9f24c6b6ed2b432b9b25b85e65eab938/users/4873c956bf574189964e76bfa3c23a86/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:21.440710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30de788-1e63-4e89-a8d2-2cf1e2814b1e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:21.441030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30de788-1e63-4e89-a8d2-2cf1e2814b1e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:21.441313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30de788-1e63-4e89-a8d2-2cf1e2814b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:21.472664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d30de788-1e63-4e89-a8d2-2cf1e2814b1e None None] MFA Rules not processed for user `4873c956bf574189964e76bfa3c23a86`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:21.473861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d30de788-1e63-4e89-a8d2-2cf1e2814b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:21.556541 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4198/8433] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:40:21.568064 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7ead8-b582-4d6d-991b-39a3b79fbfa8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:21.570153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-63f7ead8-b582-4d6d-991b-39a3b79fbfa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:21.644412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7ead8-b582-4d6d-991b-39a3b79fbfa8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:21.648497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c26915-cae2-49bf-a1cd-d3e3f3a7cfa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:21.649188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c26915-cae2-49bf-a1cd-d3e3f3a7cfa0 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:21.649471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c26915-cae2-49bf-a1cd-d3e3f3a7cfa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:21.649745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c26915-cae2-49bf-a1cd-d3e3f3a7cfa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:21.658967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c26915-cae2-49bf-a1cd-d3e3f3a7cfa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:21.660458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c26915-cae2-49bf-a1cd-d3e3f3a7cfa0 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:21.669370 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4236/8434] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:40:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:40:25.034218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30de788-1e63-4e89-a8d2-2cf1e2814b1e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:25.035866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d30de788-1e63-4e89-a8d2-2cf1e2814b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:25.055753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:25.119194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30de788-1e63-4e89-a8d2-2cf1e2814b1e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:25.124882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24921aa-850c-47f0-b057-e623923a7d01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:25.125529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24921aa-850c-47f0-b057-e623923a7d01 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:25.125812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24921aa-850c-47f0-b057-e623923a7d01 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:25.126085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24921aa-850c-47f0-b057-e623923a7d01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:25.127899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f24921aa-850c-47f0-b057-e623923a7d01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:25.142017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24921aa-850c-47f0-b057-e623923a7d01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:25.143590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24921aa-850c-47f0-b057-e623923a7d01 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:25.156480 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4199/8435] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:40:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:40:27.163215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c26915-cae2-49bf-a1cd-d3e3f3a7cfa0 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:27.166909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-90c26915-cae2-49bf-a1cd-d3e3f3a7cfa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:27.200310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c26915-cae2-49bf-a1cd-d3e3f3a7cfa0 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:27.206284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37c45c-1611-4b05-afa4-1f08a0371e61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:27.207068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37c45c-1611-4b05-afa4-1f08a0371e61 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:27.207443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37c45c-1611-4b05-afa4-1f08a0371e61 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:27.207790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37c45c-1611-4b05-afa4-1f08a0371e61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:27.209891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3a37c45c-1611-4b05-afa4-1f08a0371e61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:27.226497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37c45c-1611-4b05-afa4-1f08a0371e61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:27.228268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37c45c-1611-4b05-afa4-1f08a0371e61 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:27.236857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:27.245948 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4237/8436] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:40:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:40:35.149521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=25 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:45.218733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24921aa-850c-47f0-b057-e623923a7d01 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:45.283231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24921aa-850c-47f0-b057-e623923a7d01 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:45.288134 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c6aae-da4a-4be3-9d9f-5fc58d78a727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:45.289022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c6aae-da4a-4be3-9d9f-5fc58d78a727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:45.289305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c6aae-da4a-4be3-9d9f-5fc58d78a727 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:45.289572 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c6aae-da4a-4be3-9d9f-5fc58d78a727 admin admin] PATH_INFO: `/v3/users/4873c956bf574189964e76bfa3c23a86` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:45.290771 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c6aae-da4a-4be3-9d9f-5fc58d78a727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4873c956bf574189964e76bfa3c23a86)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:45.292740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c6aae-da4a-4be3-9d9f-5fc58d78a727 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:45.339851 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-581c6aae-da4a-4be3-9d9f-5fc58d78a727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4873c956bf574189964e76bfa3c23a86'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:45.348454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-581c6aae-da4a-4be3-9d9f-5fc58d78a727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4873c956bf574189964e76bfa3c23a86'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:45.356311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-581c6aae-da4a-4be3-9d9f-5fc58d78a727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4873c956bf574189964e76bfa3c23a86'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:45.356980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-581c6aae-da4a-4be3-9d9f-5fc58d78a727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4873c956bf574189964e76bfa3c23a86'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:45.357650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-581c6aae-da4a-4be3-9d9f-5fc58d78a727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4873c956bf574189964e76bfa3c23a86'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:45.375853 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4200/8437] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:40:45 2022] DELETE /identity/v3/users/4873c956bf574189964e76bfa3c23a86 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:45.380801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2322ca-58fe-44ea-b7f2-a72888376482 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:45.381321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2322ca-58fe-44ea-b7f2-a72888376482 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:45.381321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2322ca-58fe-44ea-b7f2-a72888376482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:45.399613 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-be2322ca-58fe-44ea-b7f2-a72888376482 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:45.400884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-be2322ca-58fe-44ea-b7f2-a72888376482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:45.462582 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4238/8438] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:40:45.473314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c6aae-da4a-4be3-9d9f-5fc58d78a727 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:45.474774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-581c6aae-da4a-4be3-9d9f-5fc58d78a727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:45.542033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c6aae-da4a-4be3-9d9f-5fc58d78a727 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:45.546990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62a816-b1f6-471f-a989-3fda45084564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:45.547650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62a816-b1f6-471f-a989-3fda45084564 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:45.547933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62a816-b1f6-471f-a989-3fda45084564 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:45.548245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62a816-b1f6-471f-a989-3fda45084564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:45.561064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62a816-b1f6-471f-a989-3fda45084564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:45.563075 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62a816-b1f6-471f-a989-3fda45084564 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:45.574716 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4201/8439] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:40:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:40:45.756454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2322ca-58fe-44ea-b7f2-a72888376482 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:45.758142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-be2322ca-58fe-44ea-b7f2-a72888376482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:45.771488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2322ca-58fe-44ea-b7f2-a72888376482 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:45.777179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bda3ed-fdaa-4942-bcb4-5610aa10cd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:45.778243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bda3ed-fdaa-4942-bcb4-5610aa10cd83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:45.778527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bda3ed-fdaa-4942-bcb4-5610aa10cd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:45.778804 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bda3ed-fdaa-4942-bcb4-5610aa10cd83 admin admin] PATH_INFO: `/v3/projects/9f24c6b6ed2b432b9b25b85e65eab938` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:45.780022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bda3ed-fdaa-4942-bcb4-5610aa10cd83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f24c6b6ed2b432b9b25b85e65eab938)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:45.781984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bda3ed-fdaa-4942-bcb4-5610aa10cd83 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:45.830413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d4bda3ed-fdaa-4942-bcb4-5610aa10cd83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f24c6b6ed2b432b9b25b85e65eab938', 'request_id': 'req-d4bda3ed-fdaa-4942-bcb4-5610aa10cd83'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:45.839100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d4bda3ed-fdaa-4942-bcb4-5610aa10cd83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f24c6b6ed2b432b9b25b85e65eab938', 'request_id': 'req-d4bda3ed-fdaa-4942-bcb4-5610aa10cd83'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:45.845688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d4bda3ed-fdaa-4942-bcb4-5610aa10cd83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f24c6b6ed2b432b9b25b85e65eab938', 'request_id': 'req-d4bda3ed-fdaa-4942-bcb4-5610aa10cd83'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:45.856984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d4bda3ed-fdaa-4942-bcb4-5610aa10cd83 admin admin] The token cache is being invalidate because project 9f24c6b6ed2b432b9b25b85e65eab938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:40:45.857420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d4bda3ed-fdaa-4942-bcb4-5610aa10cd83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:45.858184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-d4bda3ed-fdaa-4942-bcb4-5610aa10cd83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:40:45.859983 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4239/8440] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:40:45 2022] DELETE /identity/v3/projects/9f24c6b6ed2b432b9b25b85e65eab938 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:45.866117 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9159a-5d25-432b-a830-be5aaa08b7b4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:45.866645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9159a-5d25-432b-a830-be5aaa08b7b4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:45.867114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9159a-5d25-432b-a830-be5aaa08b7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:45.886312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bae9159a-5d25-432b-a830-be5aaa08b7b4 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:45.887680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bae9159a-5d25-432b-a830-be5aaa08b7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:45.905076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:45.950427 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4202/8441] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:40:45.958758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc004762-de28-48cb-aa67-241bed8352a8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:45.959046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc004762-de28-48cb-aa67-241bed8352a8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:45.959324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc004762-de28-48cb-aa67-241bed8352a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:45.979909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-cc004762-de28-48cb-aa67-241bed8352a8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:45.981237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cc004762-de28-48cb-aa67-241bed8352a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:45.991693 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4240/8442] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:40:45.996430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9159a-5d25-432b-a830-be5aaa08b7b4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:46.007087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9159a-5d25-432b-a830-be5aaa08b7b4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:46.012692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e147a-f6d0-4e7c-bc0d-a7bc4d1e78fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:46.013347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e147a-f6d0-4e7c-bc0d-a7bc4d1e78fc admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:46.013623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e147a-f6d0-4e7c-bc0d-a7bc4d1e78fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:46.013891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e147a-f6d0-4e7c-bc0d-a7bc4d1e78fc admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:46.014615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e147a-f6d0-4e7c-bc0d-a7bc4d1e78fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:40:46.014916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e147a-f6d0-4e7c-bc0d-a7bc4d1e78fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:46.016666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e147a-f6d0-4e7c-bc0d-a7bc4d1e78fc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:46.028927 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4203/8443] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:40:46.033352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc004762-de28-48cb-aa67-241bed8352a8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:46.043310 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc004762-de28-48cb-aa67-241bed8352a8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:46.049505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8e8b6-83f0-4aa4-a3be-090a2b023c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:46.050160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8e8b6-83f0-4aa4-a3be-090a2b023c30 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:46.050447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8e8b6-83f0-4aa4-a3be-090a2b023c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:46.050726 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8e8b6-83f0-4aa4-a3be-090a2b023c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:46.051419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8e8b6-83f0-4aa4-a3be-090a2b023c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:46.053376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8e8b6-83f0-4aa4-a3be-090a2b023c30 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:46.087119 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4241/8444] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:40:46 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:40:46.092078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e147a-f6d0-4e7c-bc0d-a7bc4d1e78fc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:46.102643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e147a-f6d0-4e7c-bc0d-a7bc4d1e78fc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:46.160359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25387b-c112-4a8b-bc5e-9bfaaf3b5216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:46.161028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25387b-c112-4a8b-bc5e-9bfaaf3b5216 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:46.161320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25387b-c112-4a8b-bc5e-9bfaaf3b5216 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:46.161595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25387b-c112-4a8b-bc5e-9bfaaf3b5216 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:46.162299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25387b-c112-4a8b-bc5e-9bfaaf3b5216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:46.164264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25387b-c112-4a8b-bc5e-9bfaaf3b5216 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:46.186477 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4204/8445] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:40:46 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:40:46.190930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8e8b6-83f0-4aa4-a3be-090a2b023c30 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:46.201962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8e8b6-83f0-4aa4-a3be-090a2b023c30 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:46.206780 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c016f98-0ec4-408a-ba36-bd75b4cd455f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:46.207437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c016f98-0ec4-408a-ba36-bd75b4cd455f admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:46.207716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c016f98-0ec4-408a-ba36-bd75b4cd455f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:46.207988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c016f98-0ec4-408a-ba36-bd75b4cd455f admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:46.208731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c016f98-0ec4-408a-ba36-bd75b4cd455f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:46.210365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c016f98-0ec4-408a-ba36-bd75b4cd455f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:46.220843 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4242/8446] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:40:46.224878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25387b-c112-4a8b-bc5e-9bfaaf3b5216 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:46.235747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25387b-c112-4a8b-bc5e-9bfaaf3b5216 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:46.241824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c24cf-9d3e-49e3-92f5-95ddc3b053a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:46.242461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c24cf-9d3e-49e3-92f5-95ddc3b053a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:46.242744 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c24cf-9d3e-49e3-92f5-95ddc3b053a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:46.243001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c24cf-9d3e-49e3-92f5-95ddc3b053a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:46.243757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c24cf-9d3e-49e3-92f5-95ddc3b053a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:46.245431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c24cf-9d3e-49e3-92f5-95ddc3b053a1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:46.255934 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4205/8447] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:40:46.260057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c016f98-0ec4-408a-ba36-bd75b4cd455f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:46.270467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c016f98-0ec4-408a-ba36-bd75b4cd455f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:46.275694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbdd81-54d4-44d1-bf42-99d041b36380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:46.276631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbdd81-54d4-44d1-bf42-99d041b36380 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:46.276915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbdd81-54d4-44d1-bf42-99d041b36380 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:46.277184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbdd81-54d4-44d1-bf42-99d041b36380 admin admin] PATH_INFO: `/v3/projects/80737541d6d549bd95ae3a574a8d63b8/users/e9b1497e8f414029b3324ef05a0e6c80/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:46.292486 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbdd81-54d4-44d1-bf42-99d041b36380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80737541d6d549bd95ae3a574a8d63b8, user_id=e9b1497e8f414029b3324ef05a0e6c80, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:46.295123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbdd81-54d4-44d1-bf42-99d041b36380 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:46.311378 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4243/8448] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:40:46 2022] PUT /identity/v3/projects/80737541d6d549bd95ae3a574a8d63b8/users/e9b1497e8f414029b3324ef05a0e6c80/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:40:46.321400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b80c-18b1-4e67-801a-288c4d1ac615 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:46.321701 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b80c-18b1-4e67-801a-288c4d1ac615 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:46.321988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b80c-18b1-4e67-801a-288c4d1ac615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:46.351231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-0280b80c-18b1-4e67-801a-288c4d1ac615 None None] MFA Rules not processed for user `e9b1497e8f414029b3324ef05a0e6c80`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:40:46.352427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0280b80c-18b1-4e67-801a-288c4d1ac615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:46.422108 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4206/8449] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:40:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:40:46.432933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbdd81-54d4-44d1-bf42-99d041b36380 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:40:46.434859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-78fbdd81-54d4-44d1-bf42-99d041b36380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:40:46.460718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:46.501764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbdd81-54d4-44d1-bf42-99d041b36380 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:40:46.505634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d1e17-5ff7-4b83-b912-7c9444916989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:40:46.506280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d1e17-5ff7-4b83-b912-7c9444916989 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:40:46.506544 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d1e17-5ff7-4b83-b912-7c9444916989 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:40:46.506839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d1e17-5ff7-4b83-b912-7c9444916989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:40:46.515410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d1e17-5ff7-4b83-b912-7c9444916989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:40:46.516901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d1e17-5ff7-4b83-b912-7c9444916989 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:40:46.525906 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4244/8450] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:40:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:40:56.418589 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:56.521732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=17 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:36.318787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280b80c-18b1-4e67-801a-288c4d1ac615 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:36.320414 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0280b80c-18b1-4e67-801a-288c4d1ac615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:36.461025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280b80c-18b1-4e67-801a-288c4d1ac615 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:36.466713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e26d7-35c5-499f-92b7-486a5458b50b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:36.467419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e26d7-35c5-499f-92b7-486a5458b50b service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:36.467703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e26d7-35c5-499f-92b7-486a5458b50b service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:36.467966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e26d7-35c5-499f-92b7-486a5458b50b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:36.470144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ac9e26d7-35c5-499f-92b7-486a5458b50b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:36.485671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e26d7-35c5-499f-92b7-486a5458b50b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:36.487278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e26d7-35c5-499f-92b7-486a5458b50b service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:36.500456 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4207/8451] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:41:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:41:44.053742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d1e17-5ff7-4b83-b912-7c9444916989 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:44.154958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d1e17-5ff7-4b83-b912-7c9444916989 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:44.161887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f03dc-c568-450b-aaeb-445bfcd95d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:44.162905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f03dc-c568-450b-aaeb-445bfcd95d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:44.163298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f03dc-c568-450b-aaeb-445bfcd95d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:44.163676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f03dc-c568-450b-aaeb-445bfcd95d8f admin admin] PATH_INFO: `/v3/users/e9b1497e8f414029b3324ef05a0e6c80` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:44.164971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f03dc-c568-450b-aaeb-445bfcd95d8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9b1497e8f414029b3324ef05a0e6c80)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:44.166977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f03dc-c568-450b-aaeb-445bfcd95d8f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:44.219481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-929f03dc-c568-450b-aaeb-445bfcd95d8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9b1497e8f414029b3324ef05a0e6c80'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:44.229338 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-929f03dc-c568-450b-aaeb-445bfcd95d8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9b1497e8f414029b3324ef05a0e6c80'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:44.229984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-929f03dc-c568-450b-aaeb-445bfcd95d8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9b1497e8f414029b3324ef05a0e6c80'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:44.230725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-929f03dc-c568-450b-aaeb-445bfcd95d8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9b1497e8f414029b3324ef05a0e6c80'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:44.239265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-929f03dc-c568-450b-aaeb-445bfcd95d8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9b1497e8f414029b3324ef05a0e6c80'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:44.258659 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4245/8452] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:41:44 2022] DELETE /identity/v3/users/e9b1497e8f414029b3324ef05a0e6c80 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:44.263402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5e364-0def-4845-b6dc-d75877e04452 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:44.263903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5e364-0def-4845-b6dc-d75877e04452 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:44.264296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5e364-0def-4845-b6dc-d75877e04452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:44.303931 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ffa5e364-0def-4845-b6dc-d75877e04452 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:44.305109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ffa5e364-0def-4845-b6dc-d75877e04452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:44.368022 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4208/8453] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:41:44.379302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f03dc-c568-450b-aaeb-445bfcd95d8f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:44.380713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-929f03dc-c568-450b-aaeb-445bfcd95d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:44.440177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:44.456070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f03dc-c568-450b-aaeb-445bfcd95d8f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:44.459744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cc340-2bee-45e3-9eaa-a41af57a3ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:44.460457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc340-2bee-45e3-9eaa-a41af57a3ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:44.460850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc340-2bee-45e3-9eaa-a41af57a3ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:44.461135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc340-2bee-45e3-9eaa-a41af57a3ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:44.470129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cc340-2bee-45e3-9eaa-a41af57a3ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:44.471621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cc340-2bee-45e3-9eaa-a41af57a3ea2 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:44.481140 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4246/8454] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:41:44.663092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5e364-0def-4845-b6dc-d75877e04452 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:44.664748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ffa5e364-0def-4845-b6dc-d75877e04452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:44.679254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5e364-0def-4845-b6dc-d75877e04452 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:44.686150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a63db7-80f1-4aa8-aa1d-6f79611175d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:44.687171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a63db7-80f1-4aa8-aa1d-6f79611175d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:44.687610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a63db7-80f1-4aa8-aa1d-6f79611175d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:44.687953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a63db7-80f1-4aa8-aa1d-6f79611175d7 admin admin] PATH_INFO: `/v3/projects/80737541d6d549bd95ae3a574a8d63b8` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:44.696773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a63db7-80f1-4aa8-aa1d-6f79611175d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80737541d6d549bd95ae3a574a8d63b8)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:44.698753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a63db7-80f1-4aa8-aa1d-6f79611175d7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:44.721032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:44.752029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-88a63db7-80f1-4aa8-aa1d-6f79611175d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80737541d6d549bd95ae3a574a8d63b8', 'request_id': 'req-88a63db7-80f1-4aa8-aa1d-6f79611175d7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:44.764863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-88a63db7-80f1-4aa8-aa1d-6f79611175d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80737541d6d549bd95ae3a574a8d63b8', 'request_id': 'req-88a63db7-80f1-4aa8-aa1d-6f79611175d7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:44.773053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-88a63db7-80f1-4aa8-aa1d-6f79611175d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80737541d6d549bd95ae3a574a8d63b8', 'request_id': 'req-88a63db7-80f1-4aa8-aa1d-6f79611175d7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:44.789513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-88a63db7-80f1-4aa8-aa1d-6f79611175d7 admin admin] The token cache is being invalidate because project 80737541d6d549bd95ae3a574a8d63b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:41:44.789884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-88a63db7-80f1-4aa8-aa1d-6f79611175d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:44.790826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-88a63db7-80f1-4aa8-aa1d-6f79611175d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:44.793211 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4209/8455] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:41:44 2022] DELETE /identity/v3/projects/80737541d6d549bd95ae3a574a8d63b8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:44.798689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff67d9-7759-4022-8283-033f4aeaabf2 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:44.798986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff67d9-7759-4022-8283-033f4aeaabf2 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:44.799268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff67d9-7759-4022-8283-033f4aeaabf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:44.847510 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-03ff67d9-7759-4022-8283-033f4aeaabf2 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:44.848696 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-03ff67d9-7759-4022-8283-033f4aeaabf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:44.913802 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4247/8456] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:41:44.923086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ea27b-3c3b-42e4-90d8-5dace2f652f5 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:44.923368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ea27b-3c3b-42e4-90d8-5dace2f652f5 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:44.923647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ea27b-3c3b-42e4-90d8-5dace2f652f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:44.942213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-424ea27b-3c3b-42e4-90d8-5dace2f652f5 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:44.943410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-424ea27b-3c3b-42e4-90d8-5dace2f652f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:44.951623 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4210/8457] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:41:44.955788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff67d9-7759-4022-8283-033f4aeaabf2 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:44.965952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff67d9-7759-4022-8283-033f4aeaabf2 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:44.973835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac0f74-15d8-4628-8c6c-e9dc1ba5ade8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:44.974800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0f74-15d8-4628-8c6c-e9dc1ba5ade8 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:44.975167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0f74-15d8-4628-8c6c-e9dc1ba5ade8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:44.975477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0f74-15d8-4628-8c6c-e9dc1ba5ade8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:44.976454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac0f74-15d8-4628-8c6c-e9dc1ba5ade8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:41:44.976850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac0f74-15d8-4628-8c6c-e9dc1ba5ade8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:44.979373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac0f74-15d8-4628-8c6c-e9dc1ba5ade8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:44.996718 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4248/8458] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:41:45.001281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ea27b-3c3b-42e4-90d8-5dace2f652f5 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:45.010955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ea27b-3c3b-42e4-90d8-5dace2f652f5 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:45.017076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9eb48e-98f0-457c-9f99-e780b8ec2ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:45.017731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9eb48e-98f0-457c-9f99-e780b8ec2ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:45.018012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9eb48e-98f0-457c-9f99-e780b8ec2ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:45.018279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9eb48e-98f0-457c-9f99-e780b8ec2ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:45.018963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9eb48e-98f0-457c-9f99-e780b8ec2ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:45.020934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9eb48e-98f0-457c-9f99-e780b8ec2ce5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:45.048456 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4211/8459] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:41:45 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:41:45.052644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac0f74-15d8-4628-8c6c-e9dc1ba5ade8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:45.063140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac0f74-15d8-4628-8c6c-e9dc1ba5ade8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:45.122505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4369b-6f68-46a1-ba9d-dca52eadec1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:45.123188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4369b-6f68-46a1-ba9d-dca52eadec1b admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:45.123471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4369b-6f68-46a1-ba9d-dca52eadec1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:45.123745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4369b-6f68-46a1-ba9d-dca52eadec1b admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:45.124482 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4369b-6f68-46a1-ba9d-dca52eadec1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:45.126484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4369b-6f68-46a1-ba9d-dca52eadec1b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:45.149769 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4249/8460] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:41:45 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:41:45.154153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9eb48e-98f0-457c-9f99-e780b8ec2ce5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:45.164859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9eb48e-98f0-457c-9f99-e780b8ec2ce5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:45.169812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563528e9-51fe-4fb2-9ba9-ccf383409f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:45.170834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563528e9-51fe-4fb2-9ba9-ccf383409f21 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:45.171118 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563528e9-51fe-4fb2-9ba9-ccf383409f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:45.171395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563528e9-51fe-4fb2-9ba9-ccf383409f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:45.172177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563528e9-51fe-4fb2-9ba9-ccf383409f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:45.173780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563528e9-51fe-4fb2-9ba9-ccf383409f21 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:45.184513 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4212/8461] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:41:45.189810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4369b-6f68-46a1-ba9d-dca52eadec1b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:45.200205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4369b-6f68-46a1-ba9d-dca52eadec1b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:45.205116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470cab0-2f36-488b-ac9a-ad2bbf7e76f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:45.205760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470cab0-2f36-488b-ac9a-ad2bbf7e76f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:45.206041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470cab0-2f36-488b-ac9a-ad2bbf7e76f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:45.206484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470cab0-2f36-488b-ac9a-ad2bbf7e76f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:45.207028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470cab0-2f36-488b-ac9a-ad2bbf7e76f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:45.208671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470cab0-2f36-488b-ac9a-ad2bbf7e76f8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:45.219072 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4250/8462] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:41:45.223251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563528e9-51fe-4fb2-9ba9-ccf383409f21 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:45.233763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563528e9-51fe-4fb2-9ba9-ccf383409f21 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:45.238574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1917a35-857d-48f5-9212-5fc27ceb8be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:45.239454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1917a35-857d-48f5-9212-5fc27ceb8be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:45.239734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1917a35-857d-48f5-9212-5fc27ceb8be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:45.240005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1917a35-857d-48f5-9212-5fc27ceb8be5 admin admin] PATH_INFO: `/v3/projects/5a04b50f0eb1475f964846c1ab5f6fa0/users/472516e7892a4c34a24171e23fc029f9/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:45.254820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1917a35-857d-48f5-9212-5fc27ceb8be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a04b50f0eb1475f964846c1ab5f6fa0, user_id=472516e7892a4c34a24171e23fc029f9, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:45.257540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1917a35-857d-48f5-9212-5fc27ceb8be5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:45.272494 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4213/8463] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:41:45 2022] PUT /identity/v3/projects/5a04b50f0eb1475f964846c1ab5f6fa0/users/472516e7892a4c34a24171e23fc029f9/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:45.282725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f66ef-9db3-4699-b753-5db6ebe15e88 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:45.283014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f66ef-9db3-4699-b753-5db6ebe15e88 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:45.283296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f66ef-9db3-4699-b753-5db6ebe15e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:45.311637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9a0f66ef-9db3-4699-b753-5db6ebe15e88 None None] MFA Rules not processed for user `472516e7892a4c34a24171e23fc029f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:45.313245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9a0f66ef-9db3-4699-b753-5db6ebe15e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:45.326260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:45.384231 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4251/8464] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:41:45.395025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1917a35-857d-48f5-9212-5fc27ceb8be5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:45.396848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d1917a35-857d-48f5-9212-5fc27ceb8be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:45.459073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1917a35-857d-48f5-9212-5fc27ceb8be5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:45.462853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7d7a3-fca1-4abf-91d6-3e5c4c57926b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:45.463495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7d7a3-fca1-4abf-91d6-3e5c4c57926b service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:45.463779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7d7a3-fca1-4abf-91d6-3e5c4c57926b service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:45.464066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7d7a3-fca1-4abf-91d6-3e5c4c57926b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:45.473625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7d7a3-fca1-4abf-91d6-3e5c4c57926b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:45.475082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7d7a3-fca1-4abf-91d6-3e5c4c57926b service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:45.484731 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4214/8465] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:41:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:41:45.498609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f66ef-9db3-4699-b753-5db6ebe15e88 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:45.564480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f66ef-9db3-4699-b753-5db6ebe15e88 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:45.570028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12459b-9918-4836-8556-d2757d0ee024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:45.570918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12459b-9918-4836-8556-d2757d0ee024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:45.571200 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12459b-9918-4836-8556-d2757d0ee024 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:45.571496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12459b-9918-4836-8556-d2757d0ee024 admin admin] PATH_INFO: `/v3/users/472516e7892a4c34a24171e23fc029f9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:45.572818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12459b-9918-4836-8556-d2757d0ee024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=472516e7892a4c34a24171e23fc029f9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:45.574857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12459b-9918-4836-8556-d2757d0ee024 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:45.629753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-da12459b-9918-4836-8556-d2757d0ee024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '472516e7892a4c34a24171e23fc029f9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:45.637754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-da12459b-9918-4836-8556-d2757d0ee024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '472516e7892a4c34a24171e23fc029f9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:45.638307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-da12459b-9918-4836-8556-d2757d0ee024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '472516e7892a4c34a24171e23fc029f9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:45.638916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-da12459b-9918-4836-8556-d2757d0ee024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '472516e7892a4c34a24171e23fc029f9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:45.646092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-da12459b-9918-4836-8556-d2757d0ee024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '472516e7892a4c34a24171e23fc029f9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:45.663918 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4252/8466] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:41:45 2022] DELETE /identity/v3/users/472516e7892a4c34a24171e23fc029f9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:45.668873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcb86c-11ae-4eb8-a420-33b5b39edf5b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:45.669267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcb86c-11ae-4eb8-a420-33b5b39edf5b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:45.669621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcb86c-11ae-4eb8-a420-33b5b39edf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:45.688386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bbbcb86c-11ae-4eb8-a420-33b5b39edf5b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:45.689605 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bbbcb86c-11ae-4eb8-a420-33b5b39edf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:45.733224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:45.753453 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4215/8467] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:41:45.763419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12459b-9918-4836-8556-d2757d0ee024 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:45.765034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-da12459b-9918-4836-8556-d2757d0ee024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:45.811241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:45.836418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12459b-9918-4836-8556-d2757d0ee024 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:45.840422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287867c-6c78-4388-86a2-54693d0c47a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:45.841073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287867c-6c78-4388-86a2-54693d0c47a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:45.841355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287867c-6c78-4388-86a2-54693d0c47a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:45.841637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287867c-6c78-4388-86a2-54693d0c47a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:45.852359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287867c-6c78-4388-86a2-54693d0c47a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:45.853842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287867c-6c78-4388-86a2-54693d0c47a8 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:45.864722 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4253/8468] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:41:46.147826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcb86c-11ae-4eb8-a420-33b5b39edf5b None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:46.149593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bbbcb86c-11ae-4eb8-a420-33b5b39edf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:46.163767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcb86c-11ae-4eb8-a420-33b5b39edf5b None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:46.169472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58931c-b2a2-408d-8c8f-f22f913c87ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:46.170819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58931c-b2a2-408d-8c8f-f22f913c87ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:46.171107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58931c-b2a2-408d-8c8f-f22f913c87ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:46.171401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58931c-b2a2-408d-8c8f-f22f913c87ac admin admin] PATH_INFO: `/v3/projects/5a04b50f0eb1475f964846c1ab5f6fa0` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:46.172724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58931c-b2a2-408d-8c8f-f22f913c87ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a04b50f0eb1475f964846c1ab5f6fa0)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:46.174934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58931c-b2a2-408d-8c8f-f22f913c87ac admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:46.225608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4a58931c-b2a2-408d-8c8f-f22f913c87ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a04b50f0eb1475f964846c1ab5f6fa0', 'request_id': 'req-4a58931c-b2a2-408d-8c8f-f22f913c87ac'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:46.231922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4a58931c-b2a2-408d-8c8f-f22f913c87ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a04b50f0eb1475f964846c1ab5f6fa0', 'request_id': 'req-4a58931c-b2a2-408d-8c8f-f22f913c87ac'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:46.237484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4a58931c-b2a2-408d-8c8f-f22f913c87ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a04b50f0eb1475f964846c1ab5f6fa0', 'request_id': 'req-4a58931c-b2a2-408d-8c8f-f22f913c87ac'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:46.250544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4a58931c-b2a2-408d-8c8f-f22f913c87ac admin admin] The token cache is being invalidate because project 5a04b50f0eb1475f964846c1ab5f6fa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:41:46.250833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4a58931c-b2a2-408d-8c8f-f22f913c87ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:46.251469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4a58931c-b2a2-408d-8c8f-f22f913c87ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:46.253061 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4216/8469] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:41:46 2022] DELETE /identity/v3/projects/5a04b50f0eb1475f964846c1ab5f6fa0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:46.258193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834a375-5bb2-4ece-91da-05440cc91fb1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:46.258688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834a375-5bb2-4ece-91da-05440cc91fb1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:46.258813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834a375-5bb2-4ece-91da-05440cc91fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:46.277588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0834a375-5bb2-4ece-91da-05440cc91fb1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:46.278848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0834a375-5bb2-4ece-91da-05440cc91fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:46.343843 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4254/8470] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:41:46.351651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5000e6b-c872-46b3-b8af-f6e0130b1e2a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:46.352208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5000e6b-c872-46b3-b8af-f6e0130b1e2a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:46.352208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5000e6b-c872-46b3-b8af-f6e0130b1e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:46.371514 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a5000e6b-c872-46b3-b8af-f6e0130b1e2a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:46.372872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a5000e6b-c872-46b3-b8af-f6e0130b1e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:46.381098 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4217/8471] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:41:46.385325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834a375-5bb2-4ece-91da-05440cc91fb1 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:46.398361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834a375-5bb2-4ece-91da-05440cc91fb1 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:46.405307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b807ce-e7b6-4ea8-a763-2db0f8c00fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:46.405968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b807ce-e7b6-4ea8-a763-2db0f8c00fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:46.406248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b807ce-e7b6-4ea8-a763-2db0f8c00fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:46.406527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b807ce-e7b6-4ea8-a763-2db0f8c00fa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:46.407247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b807ce-e7b6-4ea8-a763-2db0f8c00fa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:41:46.407581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b807ce-e7b6-4ea8-a763-2db0f8c00fa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:46.409239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b807ce-e7b6-4ea8-a763-2db0f8c00fa4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:46.422093 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4255/8472] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:41:46.426611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5000e6b-c872-46b3-b8af-f6e0130b1e2a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:46.436870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5000e6b-c872-46b3-b8af-f6e0130b1e2a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:46.443086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf1481-263b-40f9-bf95-862221fc0799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:46.443748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf1481-263b-40f9-bf95-862221fc0799 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:46.444032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf1481-263b-40f9-bf95-862221fc0799 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:46.444330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf1481-263b-40f9-bf95-862221fc0799 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:46.445035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf1481-263b-40f9-bf95-862221fc0799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:46.447002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf1481-263b-40f9-bf95-862221fc0799 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:46.475703 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4218/8473] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:41:46 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:41:46.480028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b807ce-e7b6-4ea8-a763-2db0f8c00fa4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:46.490230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b807ce-e7b6-4ea8-a763-2db0f8c00fa4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:46.549740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a86eb3-a4b8-4939-90cc-2cb0828480d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:46.550412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a86eb3-a4b8-4939-90cc-2cb0828480d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:46.550693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a86eb3-a4b8-4939-90cc-2cb0828480d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:46.550969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a86eb3-a4b8-4939-90cc-2cb0828480d8 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:46.551652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a86eb3-a4b8-4939-90cc-2cb0828480d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:46.553621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a86eb3-a4b8-4939-90cc-2cb0828480d8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:46.575966 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4256/8474] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:41:46 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:41:46.582278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf1481-263b-40f9-bf95-862221fc0799 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:46.596003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf1481-263b-40f9-bf95-862221fc0799 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:46.601349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661338cb-bc19-48b5-a980-fcd3c8a868fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:46.602007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661338cb-bc19-48b5-a980-fcd3c8a868fe admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:46.602286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661338cb-bc19-48b5-a980-fcd3c8a868fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:46.602560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661338cb-bc19-48b5-a980-fcd3c8a868fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:46.603276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661338cb-bc19-48b5-a980-fcd3c8a868fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:46.604923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661338cb-bc19-48b5-a980-fcd3c8a868fe admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:46.616894 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4219/8475] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:41:46.621089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a86eb3-a4b8-4939-90cc-2cb0828480d8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:46.632246 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a86eb3-a4b8-4939-90cc-2cb0828480d8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:46.637727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1891b5-7414-46a0-bfb3-b18b05ca635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:46.638407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1891b5-7414-46a0-bfb3-b18b05ca635e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:46.638689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1891b5-7414-46a0-bfb3-b18b05ca635e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:46.638958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1891b5-7414-46a0-bfb3-b18b05ca635e admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:46.639676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1891b5-7414-46a0-bfb3-b18b05ca635e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:46.641321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1891b5-7414-46a0-bfb3-b18b05ca635e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:46.651468 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4257/8476] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:41:46.657694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661338cb-bc19-48b5-a980-fcd3c8a868fe admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:46.674223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661338cb-bc19-48b5-a980-fcd3c8a868fe admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:46.682613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97114cc6-7f8a-4e51-a689-9c1289464e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:46.683731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97114cc6-7f8a-4e51-a689-9c1289464e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:46.684013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97114cc6-7f8a-4e51-a689-9c1289464e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:46.684323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97114cc6-7f8a-4e51-a689-9c1289464e65 admin admin] PATH_INFO: `/v3/projects/fb9644c734a740969ad0ab4bc4757d58/users/97e298fc6a28429484d662c56718f4a8/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:46.700962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97114cc6-7f8a-4e51-a689-9c1289464e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb9644c734a740969ad0ab4bc4757d58, user_id=97e298fc6a28429484d662c56718f4a8, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:46.703638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97114cc6-7f8a-4e51-a689-9c1289464e65 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:46.720348 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4220/8477] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:41:46 2022] PUT /identity/v3/projects/fb9644c734a740969ad0ab4bc4757d58/users/97e298fc6a28429484d662c56718f4a8/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:46.725749 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446a9c1-2195-4d10-a920-beb624ff07ce None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:46.726052 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446a9c1-2195-4d10-a920-beb624ff07ce None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:46.726331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446a9c1-2195-4d10-a920-beb624ff07ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:46.745892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c446a9c1-2195-4d10-a920-beb624ff07ce None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:46.747104 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c446a9c1-2195-4d10-a920-beb624ff07ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:46.789454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:46.812511 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4258/8478] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:41:46.822660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97114cc6-7f8a-4e51-a689-9c1289464e65 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:46.824674 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-97114cc6-7f8a-4e51-a689-9c1289464e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:46.895404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97114cc6-7f8a-4e51-a689-9c1289464e65 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:46.899508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b9059-2816-4d32-8f5e-ff7a7aa4ab79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:46.900195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b9059-2816-4d32-8f5e-ff7a7aa4ab79 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:46.900483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b9059-2816-4d32-8f5e-ff7a7aa4ab79 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:46.900736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b9059-2816-4d32-8f5e-ff7a7aa4ab79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:46.910582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b9059-2816-4d32-8f5e-ff7a7aa4ab79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:46.912030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b9059-2816-4d32-8f5e-ff7a7aa4ab79 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:46.922385 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4221/8479] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:41:47.604868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1de4c-dd7a-45a5-8fe4-177a51cd117b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:47.605605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1de4c-dd7a-45a5-8fe4-177a51cd117b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:47.605605 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1de4c-dd7a-45a5-8fe4-177a51cd117b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:47.634030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-63f1de4c-dd7a-45a5-8fe4-177a51cd117b None None] MFA Rules not processed for user `97e298fc6a28429484d662c56718f4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:47.635765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-63f1de4c-dd7a-45a5-8fe4-177a51cd117b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:47.705773 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4259/8480] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:41:47.710439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b9059-2816-4d32-8f5e-ff7a7aa4ab79 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:47.720494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b9059-2816-4d32-8f5e-ff7a7aa4ab79 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:47.725221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf2f00-6edc-4bc3-9250-41961f8fb2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:47.725814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf2f00-6edc-4bc3-9250-41961f8fb2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:47.726101 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf2f00-6edc-4bc3-9250-41961f8fb2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:47.726377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf2f00-6edc-4bc3-9250-41961f8fb2a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:47.727062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf2f00-6edc-4bc3-9250-41961f8fb2a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:47.729007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf2f00-6edc-4bc3-9250-41961f8fb2a0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:47.733527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:47.762430 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4222/8481] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:41:47 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:41:47.763660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1de4c-dd7a-45a5-8fe4-177a51cd117b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:47.775081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1de4c-dd7a-45a5-8fe4-177a51cd117b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:47.840722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407b550-5e92-42a8-8679-577d3950d0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:47.841400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407b550-5e92-42a8-8679-577d3950d0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:47.841685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407b550-5e92-42a8-8679-577d3950d0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:47.841961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407b550-5e92-42a8-8679-577d3950d0d0 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:47.842650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407b550-5e92-42a8-8679-577d3950d0d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:47.844673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407b550-5e92-42a8-8679-577d3950d0d0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:47.870815 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4260/8482] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:41:47 2022] POST /identity/v3/users => generated 309 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:41:47.875266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf2f00-6edc-4bc3-9250-41961f8fb2a0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:47.886434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf2f00-6edc-4bc3-9250-41961f8fb2a0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:47.891240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33308223-000e-4e79-89d6-2b6d3415cfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:47.891906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33308223-000e-4e79-89d6-2b6d3415cfac admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:47.892245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33308223-000e-4e79-89d6-2b6d3415cfac admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:47.892544 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33308223-000e-4e79-89d6-2b6d3415cfac admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:47.893272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33308223-000e-4e79-89d6-2b6d3415cfac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:47.894891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33308223-000e-4e79-89d6-2b6d3415cfac admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:47.906380 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4223/8483] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:41:47.910735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407b550-5e92-42a8-8679-577d3950d0d0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:47.921575 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407b550-5e92-42a8-8679-577d3950d0d0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:47.926608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1d45f-611d-4b86-b253-10fc8e94f438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:47.927495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1d45f-611d-4b86-b253-10fc8e94f438 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:47.927776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1d45f-611d-4b86-b253-10fc8e94f438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:47.928069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1d45f-611d-4b86-b253-10fc8e94f438 admin admin] PATH_INFO: `/v3/projects/df61a5a3ed7b467ebd27e015a845327d/users/6b73ed4130d0495a840a6c1552afadd5/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:47.943180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1d45f-611d-4b86-b253-10fc8e94f438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df61a5a3ed7b467ebd27e015a845327d, user_id=6b73ed4130d0495a840a6c1552afadd5, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:47.945944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1d45f-611d-4b86-b253-10fc8e94f438 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:47.961375 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4261/8484] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:41:47 2022] PUT /identity/v3/projects/df61a5a3ed7b467ebd27e015a845327d/users/6b73ed4130d0495a840a6c1552afadd5/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:47.965741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33308223-000e-4e79-89d6-2b6d3415cfac admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:47.976341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33308223-000e-4e79-89d6-2b6d3415cfac admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:48.039838 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50560518-9d60-427b-8944-18228fc33a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:48.040548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50560518-9d60-427b-8944-18228fc33a4e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:48.040854 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50560518-9d60-427b-8944-18228fc33a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:48.041135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50560518-9d60-427b-8944-18228fc33a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:48.041865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50560518-9d60-427b-8944-18228fc33a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:48.043590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50560518-9d60-427b-8944-18228fc33a4e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:48.054213 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4224/8485] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:41:48.058900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1d45f-611d-4b86-b253-10fc8e94f438 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:48.070097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1d45f-611d-4b86-b253-10fc8e94f438 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:48.076065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68073874-1106-4ce8-9854-c5e0ed908f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:48.076963 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68073874-1106-4ce8-9854-c5e0ed908f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:48.077243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68073874-1106-4ce8-9854-c5e0ed908f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:48.077515 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68073874-1106-4ce8-9854-c5e0ed908f81 admin admin] PATH_INFO: `/v3/projects/df61a5a3ed7b467ebd27e015a845327d/users/6b73ed4130d0495a840a6c1552afadd5/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:48.079761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68073874-1106-4ce8-9854-c5e0ed908f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df61a5a3ed7b467ebd27e015a845327d, user_id=6b73ed4130d0495a840a6c1552afadd5, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:48.082531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68073874-1106-4ce8-9854-c5e0ed908f81 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:48.094136 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4262/8486] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:41:48 2022] PUT /identity/v3/projects/df61a5a3ed7b467ebd27e015a845327d/users/6b73ed4130d0495a840a6c1552afadd5/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:48.751096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26657bf7-dc73-4d1c-98a7-8dee0411c79f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:48.751666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26657bf7-dc73-4d1c-98a7-8dee0411c79f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:48.751666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26657bf7-dc73-4d1c-98a7-8dee0411c79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:48.778863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-26657bf7-dc73-4d1c-98a7-8dee0411c79f None None] MFA Rules not processed for user `6b73ed4130d0495a840a6c1552afadd5`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:48.780209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-26657bf7-dc73-4d1c-98a7-8dee0411c79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:48.852289 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4225/8487] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:41:49.924796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68073874-1106-4ce8-9854-c5e0ed908f81 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:49.956078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:49.991003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68073874-1106-4ce8-9854-c5e0ed908f81 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:49.995872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871e465-dce0-4d15-8241-918770ec7f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:49.996791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871e465-dce0-4d15-8241-918770ec7f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:49.997072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871e465-dce0-4d15-8241-918770ec7f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:49.997347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871e465-dce0-4d15-8241-918770ec7f27 admin admin] PATH_INFO: `/v3/users/97e298fc6a28429484d662c56718f4a8` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:49.998609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871e465-dce0-4d15-8241-918770ec7f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e298fc6a28429484d662c56718f4a8)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:50.000589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871e465-dce0-4d15-8241-918770ec7f27 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:50.048448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1871e465-dce0-4d15-8241-918770ec7f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e298fc6a28429484d662c56718f4a8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.057202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1871e465-dce0-4d15-8241-918770ec7f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e298fc6a28429484d662c56718f4a8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.057806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1871e465-dce0-4d15-8241-918770ec7f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e298fc6a28429484d662c56718f4a8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.058406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1871e465-dce0-4d15-8241-918770ec7f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e298fc6a28429484d662c56718f4a8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.067117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-1871e465-dce0-4d15-8241-918770ec7f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e298fc6a28429484d662c56718f4a8'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.094283 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4263/8488] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:41:49 2022] DELETE /identity/v3/users/97e298fc6a28429484d662c56718f4a8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:50.273151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26657bf7-dc73-4d1c-98a7-8dee0411c79f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:50.284331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26657bf7-dc73-4d1c-98a7-8dee0411c79f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:50.341853 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:50.348571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c3a18-80e2-4186-9ad7-9bc444ef4f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:50.349413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c3a18-80e2-4186-9ad7-9bc444ef4f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:50.349900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c3a18-80e2-4186-9ad7-9bc444ef4f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:50.350209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c3a18-80e2-4186-9ad7-9bc444ef4f7f admin admin] PATH_INFO: `/v3/projects/fb9644c734a740969ad0ab4bc4757d58` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:50.351736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c3a18-80e2-4186-9ad7-9bc444ef4f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb9644c734a740969ad0ab4bc4757d58)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:50.353704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c3a18-80e2-4186-9ad7-9bc444ef4f7f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:50.399963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5a9c3a18-80e2-4186-9ad7-9bc444ef4f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb9644c734a740969ad0ab4bc4757d58', 'request_id': 'req-5a9c3a18-80e2-4186-9ad7-9bc444ef4f7f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.408245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5a9c3a18-80e2-4186-9ad7-9bc444ef4f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb9644c734a740969ad0ab4bc4757d58', 'request_id': 'req-5a9c3a18-80e2-4186-9ad7-9bc444ef4f7f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.414055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5a9c3a18-80e2-4186-9ad7-9bc444ef4f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb9644c734a740969ad0ab4bc4757d58', 'request_id': 'req-5a9c3a18-80e2-4186-9ad7-9bc444ef4f7f'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.427970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5a9c3a18-80e2-4186-9ad7-9bc444ef4f7f admin admin] The token cache is being invalidate because project fb9644c734a740969ad0ab4bc4757d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:41:50.428292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5a9c3a18-80e2-4186-9ad7-9bc444ef4f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.428946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-5a9c3a18-80e2-4186-9ad7-9bc444ef4f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.430604 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4226/8489] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:41:50 2022] DELETE /identity/v3/projects/fb9644c734a740969ad0ab4bc4757d58 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:50.434748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871e465-dce0-4d15-8241-918770ec7f27 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:50.436250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1871e465-dce0-4d15-8241-918770ec7f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:50.450408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871e465-dce0-4d15-8241-918770ec7f27 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:50.509952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912a3ce-fc39-415f-bdbe-9b219522c412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:50.510827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912a3ce-fc39-415f-bdbe-9b219522c412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:50.511111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912a3ce-fc39-415f-bdbe-9b219522c412 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:50.511431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912a3ce-fc39-415f-bdbe-9b219522c412 admin admin] PATH_INFO: `/v3/users/6b73ed4130d0495a840a6c1552afadd5` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:50.512681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912a3ce-fc39-415f-bdbe-9b219522c412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b73ed4130d0495a840a6c1552afadd5)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:50.514712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912a3ce-fc39-415f-bdbe-9b219522c412 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:50.571054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a912a3ce-fc39-415f-bdbe-9b219522c412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b73ed4130d0495a840a6c1552afadd5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.572732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:50.579349 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a912a3ce-fc39-415f-bdbe-9b219522c412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b73ed4130d0495a840a6c1552afadd5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.580386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a912a3ce-fc39-415f-bdbe-9b219522c412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b73ed4130d0495a840a6c1552afadd5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.581347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a912a3ce-fc39-415f-bdbe-9b219522c412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b73ed4130d0495a840a6c1552afadd5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.588475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-a912a3ce-fc39-415f-bdbe-9b219522c412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b73ed4130d0495a840a6c1552afadd5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.605540 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4264/8490] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:41:50 2022] DELETE /identity/v3/users/6b73ed4130d0495a840a6c1552afadd5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:50.786986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c3a18-80e2-4186-9ad7-9bc444ef4f7f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:50.788517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-5a9c3a18-80e2-4186-9ad7-9bc444ef4f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:50.802782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c3a18-80e2-4186-9ad7-9bc444ef4f7f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:50.866951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a38b5-e426-4b11-8038-f8c7b77c55c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:50.867703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a38b5-e426-4b11-8038-f8c7b77c55c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:50.868005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a38b5-e426-4b11-8038-f8c7b77c55c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:50.868318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a38b5-e426-4b11-8038-f8c7b77c55c2 admin admin] PATH_INFO: `/v3/projects/df61a5a3ed7b467ebd27e015a845327d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:50.869527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a38b5-e426-4b11-8038-f8c7b77c55c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df61a5a3ed7b467ebd27e015a845327d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:50.871511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a38b5-e426-4b11-8038-f8c7b77c55c2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:50.918048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f1a38b5-e426-4b11-8038-f8c7b77c55c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df61a5a3ed7b467ebd27e015a845327d', 'request_id': 'req-3f1a38b5-e426-4b11-8038-f8c7b77c55c2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.924658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f1a38b5-e426-4b11-8038-f8c7b77c55c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df61a5a3ed7b467ebd27e015a845327d', 'request_id': 'req-3f1a38b5-e426-4b11-8038-f8c7b77c55c2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.930718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f1a38b5-e426-4b11-8038-f8c7b77c55c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df61a5a3ed7b467ebd27e015a845327d', 'request_id': 'req-3f1a38b5-e426-4b11-8038-f8c7b77c55c2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.945517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f1a38b5-e426-4b11-8038-f8c7b77c55c2 admin admin] The token cache is being invalidate because project df61a5a3ed7b467ebd27e015a845327d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:41:50.945804 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f1a38b5-e426-4b11-8038-f8c7b77c55c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.946450 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-3f1a38b5-e426-4b11-8038-f8c7b77c55c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:50.948063 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4227/8491] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:41:50 2022] DELETE /identity/v3/projects/df61a5a3ed7b467ebd27e015a845327d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:50.953457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0584fa7-7e92-48f0-9b8c-309d48cbf68a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:50.953961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0584fa7-7e92-48f0-9b8c-309d48cbf68a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:50.954091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0584fa7-7e92-48f0-9b8c-309d48cbf68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:50.973512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c0584fa7-7e92-48f0-9b8c-309d48cbf68a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:50.974751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c0584fa7-7e92-48f0-9b8c-309d48cbf68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:51.040323 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4265/8492] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:41:51.051237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1db3b2-465f-4505-ae13-16e03ef05880 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:51.051535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1db3b2-465f-4505-ae13-16e03ef05880 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:51.051810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1db3b2-465f-4505-ae13-16e03ef05880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:51.071421 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6e1db3b2-465f-4505-ae13-16e03ef05880 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:51.072687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6e1db3b2-465f-4505-ae13-16e03ef05880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:51.081437 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4228/8493] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:41:51.085661 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0584fa7-7e92-48f0-9b8c-309d48cbf68a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:51.095950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0584fa7-7e92-48f0-9b8c-309d48cbf68a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:51.100921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc264c-c21d-4228-8152-7468fd096fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:51.101584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc264c-c21d-4228-8152-7468fd096fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:51.101869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc264c-c21d-4228-8152-7468fd096fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:51.102149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc264c-c21d-4228-8152-7468fd096fc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:51.102875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc264c-c21d-4228-8152-7468fd096fc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:41:51.103177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc264c-c21d-4228-8152-7468fd096fc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:51.104957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc264c-c21d-4228-8152-7468fd096fc0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:51.117149 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4266/8494] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:41:51.121651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1db3b2-465f-4505-ae13-16e03ef05880 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:51.131171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1db3b2-465f-4505-ae13-16e03ef05880 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:51.136609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f7ba0-3aa4-4e59-9b71-c42edac90613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:51.137272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f7ba0-3aa4-4e59-9b71-c42edac90613 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:51.137547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f7ba0-3aa4-4e59-9b71-c42edac90613 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:51.137843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f7ba0-3aa4-4e59-9b71-c42edac90613 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:51.138552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f7ba0-3aa4-4e59-9b71-c42edac90613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:51.140532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f7ba0-3aa4-4e59-9b71-c42edac90613 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:51.149044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:51.171568 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4229/8495] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:41:51 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:41:51.175908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc264c-c21d-4228-8152-7468fd096fc0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:51.186584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc264c-c21d-4228-8152-7468fd096fc0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:51.242792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f8b93-84f1-423d-b0ae-272b51dfe2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:51.243460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f8b93-84f1-423d-b0ae-272b51dfe2ec admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:51.243742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f8b93-84f1-423d-b0ae-272b51dfe2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:51.244022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f8b93-84f1-423d-b0ae-272b51dfe2ec admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:51.244751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f8b93-84f1-423d-b0ae-272b51dfe2ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:51.246746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f8b93-84f1-423d-b0ae-272b51dfe2ec admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:51.268704 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4267/8496] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:41:51 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:41:51.273020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f7ba0-3aa4-4e59-9b71-c42edac90613 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:51.283929 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f7ba0-3aa4-4e59-9b71-c42edac90613 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:51.288658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84108c45-f9a0-45fa-9931-a8c829c966c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:51.289317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84108c45-f9a0-45fa-9931-a8c829c966c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:51.289591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84108c45-f9a0-45fa-9931-a8c829c966c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:51.289894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84108c45-f9a0-45fa-9931-a8c829c966c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:51.290597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84108c45-f9a0-45fa-9931-a8c829c966c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:51.292220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84108c45-f9a0-45fa-9931-a8c829c966c4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:51.302826 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4230/8497] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:41:51.306787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f8b93-84f1-423d-b0ae-272b51dfe2ec admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:51.317624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f8b93-84f1-423d-b0ae-272b51dfe2ec admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:51.323480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f85222-9679-40bd-ac2f-d577305d86be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:51.324294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85222-9679-40bd-ac2f-d577305d86be admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:51.324588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85222-9679-40bd-ac2f-d577305d86be admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:51.324861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85222-9679-40bd-ac2f-d577305d86be admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:51.325586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f85222-9679-40bd-ac2f-d577305d86be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:51.327204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f85222-9679-40bd-ac2f-d577305d86be admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:51.337649 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4268/8498] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:41:51.342094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84108c45-f9a0-45fa-9931-a8c829c966c4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:51.352547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84108c45-f9a0-45fa-9931-a8c829c966c4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:51.357638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b8ec5-a2aa-4c81-9625-9b6f9f8066c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:51.358526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b8ec5-a2aa-4c81-9625-9b6f9f8066c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:51.358806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b8ec5-a2aa-4c81-9625-9b6f9f8066c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:51.359085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b8ec5-a2aa-4c81-9625-9b6f9f8066c2 admin admin] PATH_INFO: `/v3/projects/096a90475dd2461c958b34aa62647874/users/dab7acf47bba4fa088da01d7e2e5da91/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:51.374389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b8ec5-a2aa-4c81-9625-9b6f9f8066c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=096a90475dd2461c958b34aa62647874, user_id=dab7acf47bba4fa088da01d7e2e5da91, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:51.376992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b8ec5-a2aa-4c81-9625-9b6f9f8066c2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:51.392216 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4231/8499] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:41:51 2022] PUT /identity/v3/projects/096a90475dd2461c958b34aa62647874/users/dab7acf47bba4fa088da01d7e2e5da91/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:51.403389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d782372-c8c5-4afc-98b1-f2656bf95145 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:51.403684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d782372-c8c5-4afc-98b1-f2656bf95145 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:51.403964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d782372-c8c5-4afc-98b1-f2656bf95145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:51.432178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7d782372-c8c5-4afc-98b1-f2656bf95145 None None] MFA Rules not processed for user `dab7acf47bba4fa088da01d7e2e5da91`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:51.433408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7d782372-c8c5-4afc-98b1-f2656bf95145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:51.453628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:51.503261 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4269/8500] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:41:51.507920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b8ec5-a2aa-4c81-9625-9b6f9f8066c2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:51.578679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b8ec5-a2aa-4c81-9625-9b6f9f8066c2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:51.584073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9b969-37f3-42e1-9bb8-35a60232826e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:51.584728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9b969-37f3-42e1-9bb8-35a60232826e admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:51.585008 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9b969-37f3-42e1-9bb8-35a60232826e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:51.585281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9b969-37f3-42e1-9bb8-35a60232826e admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:51.585962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9b969-37f3-42e1-9bb8-35a60232826e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:51.587883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9b969-37f3-42e1-9bb8-35a60232826e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:51.616893 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4232/8501] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:41:51 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:41:51.620912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d782372-c8c5-4afc-98b1-f2656bf95145 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:51.632132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d782372-c8c5-4afc-98b1-f2656bf95145 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:51.696644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e2cf4-b246-4988-a9be-5454b77f2082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:51.697341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e2cf4-b246-4988-a9be-5454b77f2082 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:51.697607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e2cf4-b246-4988-a9be-5454b77f2082 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:51.697882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e2cf4-b246-4988-a9be-5454b77f2082 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:51.698587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e2cf4-b246-4988-a9be-5454b77f2082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:51.700597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e2cf4-b246-4988-a9be-5454b77f2082 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:51.721728 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4270/8502] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:41:51 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:41:51.725912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9b969-37f3-42e1-9bb8-35a60232826e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:51.736501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9b969-37f3-42e1-9bb8-35a60232826e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:51.742040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c19fb-ddac-4b8b-93ab-6bf6b42c5043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:51.742696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c19fb-ddac-4b8b-93ab-6bf6b42c5043 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:51.742973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c19fb-ddac-4b8b-93ab-6bf6b42c5043 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:51.743243 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c19fb-ddac-4b8b-93ab-6bf6b42c5043 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:51.743955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c19fb-ddac-4b8b-93ab-6bf6b42c5043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:51.745578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c19fb-ddac-4b8b-93ab-6bf6b42c5043 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:51.756482 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4233/8503] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:41:51.760998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e2cf4-b246-4988-a9be-5454b77f2082 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:51.771549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e2cf4-b246-4988-a9be-5454b77f2082 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:51.776745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e166259-33b4-4794-8e9b-0ddd1285874f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:51.777768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e166259-33b4-4794-8e9b-0ddd1285874f admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:51.778127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e166259-33b4-4794-8e9b-0ddd1285874f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:51.778443 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e166259-33b4-4794-8e9b-0ddd1285874f admin admin] PATH_INFO: `/v3/projects/e8dcd1ed88c64df4a75355eba19af56e/users/f0a025ed02bf4b0ebe5cf44106842569/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:51.793364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e166259-33b4-4794-8e9b-0ddd1285874f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8dcd1ed88c64df4a75355eba19af56e, user_id=f0a025ed02bf4b0ebe5cf44106842569, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:51.796475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e166259-33b4-4794-8e9b-0ddd1285874f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:51.811108 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4271/8504] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:41:51 2022] PUT /identity/v3/projects/e8dcd1ed88c64df4a75355eba19af56e/users/f0a025ed02bf4b0ebe5cf44106842569/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:51.815057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c19fb-ddac-4b8b-93ab-6bf6b42c5043 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:51.825439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c19fb-ddac-4b8b-93ab-6bf6b42c5043 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:51.886297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0222ee4-0fbd-4933-9acc-4bbca9b3ef32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:51.886933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0222ee4-0fbd-4933-9acc-4bbca9b3ef32 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:51.887221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0222ee4-0fbd-4933-9acc-4bbca9b3ef32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:51.887500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0222ee4-0fbd-4933-9acc-4bbca9b3ef32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:51.888250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0222ee4-0fbd-4933-9acc-4bbca9b3ef32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:51.890225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0222ee4-0fbd-4933-9acc-4bbca9b3ef32 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:51.900245 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4234/8505] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:41:51.904593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e166259-33b4-4794-8e9b-0ddd1285874f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:51.915241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e166259-33b4-4794-8e9b-0ddd1285874f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:51.920980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3ab6e-a07e-470a-a169-8a3817c6154b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:51.921898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3ab6e-a07e-470a-a169-8a3817c6154b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:51.922173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3ab6e-a07e-470a-a169-8a3817c6154b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:51.922563 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3ab6e-a07e-470a-a169-8a3817c6154b admin admin] PATH_INFO: `/v3/projects/e8dcd1ed88c64df4a75355eba19af56e/users/f0a025ed02bf4b0ebe5cf44106842569/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:51.924648 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3ab6e-a07e-470a-a169-8a3817c6154b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8dcd1ed88c64df4a75355eba19af56e, user_id=f0a025ed02bf4b0ebe5cf44106842569, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:51.927370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3ab6e-a07e-470a-a169-8a3817c6154b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:51.937992 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4272/8506] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:41:51 2022] PUT /identity/v3/projects/e8dcd1ed88c64df4a75355eba19af56e/users/f0a025ed02bf4b0ebe5cf44106842569/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:51.947833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e21ac-3b3e-4721-9737-945a60237d8d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:51.948163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e21ac-3b3e-4721-9737-945a60237d8d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:51.948442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e21ac-3b3e-4721-9737-945a60237d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:51.975077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-342e21ac-3b3e-4721-9737-945a60237d8d None None] MFA Rules not processed for user `f0a025ed02bf4b0ebe5cf44106842569`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:51.976232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-342e21ac-3b3e-4721-9737-945a60237d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:51.988337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:52.047994 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4235/8507] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:41:52.060678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3ab6e-a07e-470a-a169-8a3817c6154b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:52.062655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9dc3ab6e-a07e-470a-a169-8a3817c6154b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:52.155060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3ab6e-a07e-470a-a169-8a3817c6154b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:52.159538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9062b5-90f2-498b-8bec-b86d36b53e90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:52.160240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9062b5-90f2-498b-8bec-b86d36b53e90 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:52.160502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9062b5-90f2-498b-8bec-b86d36b53e90 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:52.160783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9062b5-90f2-498b-8bec-b86d36b53e90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:52.168646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:52.171440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9062b5-90f2-498b-8bec-b86d36b53e90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:52.173226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9062b5-90f2-498b-8bec-b86d36b53e90 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:52.183729 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4273/8508] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:41:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:41:52.259054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e21ac-3b3e-4721-9737-945a60237d8d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:52.273094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e21ac-3b3e-4721-9737-945a60237d8d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:52.277710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ce37a-707f-489d-9408-0022bfd55d3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:52.278718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ce37a-707f-489d-9408-0022bfd55d3f service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:52.279126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ce37a-707f-489d-9408-0022bfd55d3f service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:52.279438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ce37a-707f-489d-9408-0022bfd55d3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:52.347059 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ce37a-707f-489d-9408-0022bfd55d3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:52.348577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ce37a-707f-489d-9408-0022bfd55d3f service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:52.358079 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4236/8509] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:41:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:41:53.805113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9062b5-90f2-498b-8bec-b86d36b53e90 service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:53.872198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9062b5-90f2-498b-8bec-b86d36b53e90 service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:53.879439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a213099-2ef0-4db1-84bd-63d633e09682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:53.882539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a213099-2ef0-4db1-84bd-63d633e09682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:53.882827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a213099-2ef0-4db1-84bd-63d633e09682 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:53.883102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a213099-2ef0-4db1-84bd-63d633e09682 admin admin] PATH_INFO: `/v3/users/dab7acf47bba4fa088da01d7e2e5da91` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:53.886555 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a213099-2ef0-4db1-84bd-63d633e09682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab7acf47bba4fa088da01d7e2e5da91)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:53.888550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a213099-2ef0-4db1-84bd-63d633e09682 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:53.942220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7a213099-2ef0-4db1-84bd-63d633e09682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab7acf47bba4fa088da01d7e2e5da91'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:53.949829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7a213099-2ef0-4db1-84bd-63d633e09682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab7acf47bba4fa088da01d7e2e5da91'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:53.950477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7a213099-2ef0-4db1-84bd-63d633e09682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab7acf47bba4fa088da01d7e2e5da91'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:53.951108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7a213099-2ef0-4db1-84bd-63d633e09682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab7acf47bba4fa088da01d7e2e5da91'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:53.958283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7a213099-2ef0-4db1-84bd-63d633e09682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab7acf47bba4fa088da01d7e2e5da91'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:53.975599 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4274/8510] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:41:53 2022] DELETE /identity/v3/users/dab7acf47bba4fa088da01d7e2e5da91 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:53.980815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467923b9-1580-454c-91e3-2769b91fbadd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:53.981357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467923b9-1580-454c-91e3-2769b91fbadd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:53.981357 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467923b9-1580-454c-91e3-2769b91fbadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:53.999023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-467923b9-1580-454c-91e3-2769b91fbadd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:54.000260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-467923b9-1580-454c-91e3-2769b91fbadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:54.061538 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4237/8511] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:41:54.071560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a213099-2ef0-4db1-84bd-63d633e09682 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:54.073225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7a213099-2ef0-4db1-84bd-63d633e09682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:54.142715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a213099-2ef0-4db1-84bd-63d633e09682 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:54.149067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3990c0-e70d-492d-aa1f-06962e70cecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:54.150009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3990c0-e70d-492d-aa1f-06962e70cecc service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:54.150352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3990c0-e70d-492d-aa1f-06962e70cecc service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:54.150735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3990c0-e70d-492d-aa1f-06962e70cecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:54.162314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3990c0-e70d-492d-aa1f-06962e70cecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:54.163776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3990c0-e70d-492d-aa1f-06962e70cecc service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:54.175064 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4275/8512] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:41:54.502210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467923b9-1580-454c-91e3-2769b91fbadd None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:54.503661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-467923b9-1580-454c-91e3-2769b91fbadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:54.516497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467923b9-1580-454c-91e3-2769b91fbadd None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:54.521763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f115132-5cdc-4e04-8004-4982b150e9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:54.522642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f115132-5cdc-4e04-8004-4982b150e9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:54.522926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f115132-5cdc-4e04-8004-4982b150e9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:54.523181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f115132-5cdc-4e04-8004-4982b150e9bb admin admin] PATH_INFO: `/v3/projects/096a90475dd2461c958b34aa62647874` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:54.524580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f115132-5cdc-4e04-8004-4982b150e9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=096a90475dd2461c958b34aa62647874)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:54.526492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f115132-5cdc-4e04-8004-4982b150e9bb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:54.575042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:54.579464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0f115132-5cdc-4e04-8004-4982b150e9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '096a90475dd2461c958b34aa62647874', 'request_id': 'req-0f115132-5cdc-4e04-8004-4982b150e9bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:54.585991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0f115132-5cdc-4e04-8004-4982b150e9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '096a90475dd2461c958b34aa62647874', 'request_id': 'req-0f115132-5cdc-4e04-8004-4982b150e9bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:54.591812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0f115132-5cdc-4e04-8004-4982b150e9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '096a90475dd2461c958b34aa62647874', 'request_id': 'req-0f115132-5cdc-4e04-8004-4982b150e9bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:54.607911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0f115132-5cdc-4e04-8004-4982b150e9bb admin admin] The token cache is being invalidate because project 096a90475dd2461c958b34aa62647874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:41:54.608242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0f115132-5cdc-4e04-8004-4982b150e9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:54.609326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0f115132-5cdc-4e04-8004-4982b150e9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:54.611897 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4238/8513] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:41:54 2022] DELETE /identity/v3/projects/096a90475dd2461c958b34aa62647874 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:41:54.616184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3990c0-e70d-492d-aa1f-06962e70cecc service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:54.626305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3990c0-e70d-492d-aa1f-06962e70cecc service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:54.639298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:54.688805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622d4ea-167c-4c8d-86cb-642a596481f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:54.689627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622d4ea-167c-4c8d-86cb-642a596481f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:54.689910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622d4ea-167c-4c8d-86cb-642a596481f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:54.690190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622d4ea-167c-4c8d-86cb-642a596481f2 admin admin] PATH_INFO: `/v3/users/f0a025ed02bf4b0ebe5cf44106842569` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:54.691419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622d4ea-167c-4c8d-86cb-642a596481f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a025ed02bf4b0ebe5cf44106842569)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:54.693419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622d4ea-167c-4c8d-86cb-642a596481f2 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:54.742762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7622d4ea-167c-4c8d-86cb-642a596481f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a025ed02bf4b0ebe5cf44106842569'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:54.751208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7622d4ea-167c-4c8d-86cb-642a596481f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a025ed02bf4b0ebe5cf44106842569'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:54.751878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7622d4ea-167c-4c8d-86cb-642a596481f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a025ed02bf4b0ebe5cf44106842569'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:54.752532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7622d4ea-167c-4c8d-86cb-642a596481f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a025ed02bf4b0ebe5cf44106842569'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:54.759492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7622d4ea-167c-4c8d-86cb-642a596481f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a025ed02bf4b0ebe5cf44106842569'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:54.776442 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4276/8514] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:41:54 2022] DELETE /identity/v3/users/f0a025ed02bf4b0ebe5cf44106842569 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:55.058024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f115132-5cdc-4e04-8004-4982b150e9bb admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:55.059601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0f115132-5cdc-4e04-8004-4982b150e9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:55.073200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f115132-5cdc-4e04-8004-4982b150e9bb admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:55.137197 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30273d8-6f10-45c0-844e-e9e276e986dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:55.138098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30273d8-6f10-45c0-844e-e9e276e986dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:55.138446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30273d8-6f10-45c0-844e-e9e276e986dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:55.138721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30273d8-6f10-45c0-844e-e9e276e986dc admin admin] PATH_INFO: `/v3/projects/e8dcd1ed88c64df4a75355eba19af56e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:55.139934 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30273d8-6f10-45c0-844e-e9e276e986dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8dcd1ed88c64df4a75355eba19af56e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:55.141883 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30273d8-6f10-45c0-844e-e9e276e986dc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:55.192226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d30273d8-6f10-45c0-844e-e9e276e986dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8dcd1ed88c64df4a75355eba19af56e', 'request_id': 'req-d30273d8-6f10-45c0-844e-e9e276e986dc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:55.198842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d30273d8-6f10-45c0-844e-e9e276e986dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8dcd1ed88c64df4a75355eba19af56e', 'request_id': 'req-d30273d8-6f10-45c0-844e-e9e276e986dc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:55.204547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d30273d8-6f10-45c0-844e-e9e276e986dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8dcd1ed88c64df4a75355eba19af56e', 'request_id': 'req-d30273d8-6f10-45c0-844e-e9e276e986dc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:55.221164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d30273d8-6f10-45c0-844e-e9e276e986dc admin admin] The token cache is being invalidate because project e8dcd1ed88c64df4a75355eba19af56e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:41:55.221482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d30273d8-6f10-45c0-844e-e9e276e986dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:55.222114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d30273d8-6f10-45c0-844e-e9e276e986dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:55.223710 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4239/8515] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:41:55 2022] DELETE /identity/v3/projects/e8dcd1ed88c64df4a75355eba19af56e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:55.228966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f590961-5e1a-4354-9313-27165e70895f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:55.229445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f590961-5e1a-4354-9313-27165e70895f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:55.229557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f590961-5e1a-4354-9313-27165e70895f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:55.247841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0f590961-5e1a-4354-9313-27165e70895f None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:55.249054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0f590961-5e1a-4354-9313-27165e70895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:55.311235 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4277/8516] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:41:55.320333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b63ffb-4a57-41c7-8fc3-0da723090b50 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:55.320622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b63ffb-4a57-41c7-8fc3-0da723090b50 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:55.320900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b63ffb-4a57-41c7-8fc3-0da723090b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:55.340672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a4b63ffb-4a57-41c7-8fc3-0da723090b50 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:55.341961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a4b63ffb-4a57-41c7-8fc3-0da723090b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:55.350447 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4240/8517] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:41:55.354947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f590961-5e1a-4354-9313-27165e70895f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:55.365288 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f590961-5e1a-4354-9313-27165e70895f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:55.371185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd1eb3-8f32-42ce-b752-a125aa475a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:55.371846 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd1eb3-8f32-42ce-b752-a125aa475a26 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:55.372160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd1eb3-8f32-42ce-b752-a125aa475a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:55.372441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd1eb3-8f32-42ce-b752-a125aa475a26 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:55.373220 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd1eb3-8f32-42ce-b752-a125aa475a26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:41:55.373526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd1eb3-8f32-42ce-b752-a125aa475a26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:55.375154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd1eb3-8f32-42ce-b752-a125aa475a26 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:55.387577 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4278/8518] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:41:55.391994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b63ffb-4a57-41c7-8fc3-0da723090b50 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:55.401764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b63ffb-4a57-41c7-8fc3-0da723090b50 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:55.406787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd23ffd-a8c0-42af-8499-2c50875830e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:55.407441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd23ffd-a8c0-42af-8499-2c50875830e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:55.407711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd23ffd-a8c0-42af-8499-2c50875830e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:55.407987 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd23ffd-a8c0-42af-8499-2c50875830e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:55.408731 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd23ffd-a8c0-42af-8499-2c50875830e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:55.410646 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd23ffd-a8c0-42af-8499-2c50875830e4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:55.441374 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4241/8519] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:41:55 2022] POST /identity/v3/projects => generated 409 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:41:55.442548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd1eb3-8f32-42ce-b752-a125aa475a26 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:55.453106 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd1eb3-8f32-42ce-b752-a125aa475a26 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:55.473818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:55.521536 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95273f4-4bae-452e-a24a-10e88a52ac16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:55.522136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95273f4-4bae-452e-a24a-10e88a52ac16 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:55.522462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95273f4-4bae-452e-a24a-10e88a52ac16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:55.522731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95273f4-4bae-452e-a24a-10e88a52ac16 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:55.523436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95273f4-4bae-452e-a24a-10e88a52ac16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:55.525449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95273f4-4bae-452e-a24a-10e88a52ac16 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:55.547188 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4279/8520] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:41:55 2022] POST /identity/v3/users => generated 305 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:41:55.551578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd23ffd-a8c0-42af-8499-2c50875830e4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:55.562010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd23ffd-a8c0-42af-8499-2c50875830e4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:55.567064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc46c6-fa96-4e9b-a616-4a5ab0da4df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:55.567719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc46c6-fa96-4e9b-a616-4a5ab0da4df2 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:55.568009 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc46c6-fa96-4e9b-a616-4a5ab0da4df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:55.568312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc46c6-fa96-4e9b-a616-4a5ab0da4df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:55.569037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc46c6-fa96-4e9b-a616-4a5ab0da4df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:55.570633 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc46c6-fa96-4e9b-a616-4a5ab0da4df2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:55.581349 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4242/8521] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:41:55.585514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95273f4-4bae-452e-a24a-10e88a52ac16 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:55.595880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95273f4-4bae-452e-a24a-10e88a52ac16 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:55.600884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d51c64-d570-4937-9146-7cae16c03ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:55.601520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d51c64-d570-4937-9146-7cae16c03ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:55.601801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d51c64-d570-4937-9146-7cae16c03ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:55.602072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d51c64-d570-4937-9146-7cae16c03ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:55.602782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d51c64-d570-4937-9146-7cae16c03ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:55.604432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d51c64-d570-4937-9146-7cae16c03ab5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:55.614425 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4280/8522] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:41:55.618675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc46c6-fa96-4e9b-a616-4a5ab0da4df2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:55.628688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc46c6-fa96-4e9b-a616-4a5ab0da4df2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:55.633746 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffcf85-a1a6-4863-9714-f931dfbcc8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:55.634676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffcf85-a1a6-4863-9714-f931dfbcc8a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:55.634910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffcf85-a1a6-4863-9714-f931dfbcc8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:55.635185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffcf85-a1a6-4863-9714-f931dfbcc8a1 admin admin] PATH_INFO: `/v3/projects/48033add8a504dbf9bff683da9edaeaa/users/f19bee8512fe4c70a9aa93b405133ef0/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:55.650718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffcf85-a1a6-4863-9714-f931dfbcc8a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48033add8a504dbf9bff683da9edaeaa, user_id=f19bee8512fe4c70a9aa93b405133ef0, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:55.653549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffcf85-a1a6-4863-9714-f931dfbcc8a1 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:55.663608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:55.671477 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4243/8523] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:41:55 2022] PUT /identity/v3/projects/48033add8a504dbf9bff683da9edaeaa/users/f19bee8512fe4c70a9aa93b405133ef0/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:41:55.685697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18ff23-01a7-4cb2-bcc0-2e2d4ce8828d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:55.685988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18ff23-01a7-4cb2-bcc0-2e2d4ce8828d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:55.686275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18ff23-01a7-4cb2-bcc0-2e2d4ce8828d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:55.715345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ef18ff23-01a7-4cb2-bcc0-2e2d4ce8828d None None] MFA Rules not processed for user `f19bee8512fe4c70a9aa93b405133ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:55.716678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ef18ff23-01a7-4cb2-bcc0-2e2d4ce8828d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:55.790578 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4281/8524] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:55 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:41:55.797167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffcf85-a1a6-4863-9714-f931dfbcc8a1 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:55.864706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffcf85-a1a6-4863-9714-f931dfbcc8a1 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:55.869730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5594f8-ab16-49d8-a45f-95ed9cdb02f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:55.870457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5594f8-ab16-49d8-a45f-95ed9cdb02f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:55.870742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5594f8-ab16-49d8-a45f-95ed9cdb02f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:55.871017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5594f8-ab16-49d8-a45f-95ed9cdb02f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:55.871722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5594f8-ab16-49d8-a45f-95ed9cdb02f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:55.873757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5594f8-ab16-49d8-a45f-95ed9cdb02f2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:55.915377 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4244/8525] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:41:55 2022] POST /identity/v3/projects => generated 407 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:41:55.922000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18ff23-01a7-4cb2-bcc0-2e2d4ce8828d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:55.939139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18ff23-01a7-4cb2-bcc0-2e2d4ce8828d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:56.006492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2971b-1ec6-4f5e-8794-995e40483447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:56.007174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2971b-1ec6-4f5e-8794-995e40483447 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:56.007464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2971b-1ec6-4f5e-8794-995e40483447 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:56.007734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2971b-1ec6-4f5e-8794-995e40483447 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:56.008453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2971b-1ec6-4f5e-8794-995e40483447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:56.010387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2971b-1ec6-4f5e-8794-995e40483447 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:56.032138 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4282/8526] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:41:55 2022] POST /identity/v3/users => generated 310 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:41:56.036308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5594f8-ab16-49d8-a45f-95ed9cdb02f2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:56.047143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5594f8-ab16-49d8-a45f-95ed9cdb02f2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:56.052144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba538c5-d081-49a1-b55b-6c61d1c1a1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:56.052808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba538c5-d081-49a1-b55b-6c61d1c1a1df admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:56.053085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba538c5-d081-49a1-b55b-6c61d1c1a1df admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:56.053370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba538c5-d081-49a1-b55b-6c61d1c1a1df admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:56.054087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba538c5-d081-49a1-b55b-6c61d1c1a1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:56.055690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba538c5-d081-49a1-b55b-6c61d1c1a1df admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:56.066741 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4245/8527] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:41:56.070843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2971b-1ec6-4f5e-8794-995e40483447 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:56.081218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2971b-1ec6-4f5e-8794-995e40483447 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:56.086370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98589e2-7ecf-4054-897d-05988a185b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:56.087294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98589e2-7ecf-4054-897d-05988a185b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:56.087758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98589e2-7ecf-4054-897d-05988a185b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:56.087758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98589e2-7ecf-4054-897d-05988a185b32 admin admin] PATH_INFO: `/v3/projects/c621c69ea8b44c7ca1cddd9e23defc7d/users/b5255acc551c44b7b2877f030de3f3c1/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:56.104965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98589e2-7ecf-4054-897d-05988a185b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c621c69ea8b44c7ca1cddd9e23defc7d, user_id=b5255acc551c44b7b2877f030de3f3c1, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:56.107675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98589e2-7ecf-4054-897d-05988a185b32 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:56.117322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:56.123660 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4283/8528] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:41:56 2022] PUT /identity/v3/projects/c621c69ea8b44c7ca1cddd9e23defc7d/users/b5255acc551c44b7b2877f030de3f3c1/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:56.127817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba538c5-d081-49a1-b55b-6c61d1c1a1df admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:56.138297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba538c5-d081-49a1-b55b-6c61d1c1a1df admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:56.204991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4b417-cf2f-45cd-a12a-c2ad4e17e5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:56.205682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b417-cf2f-45cd-a12a-c2ad4e17e5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:56.205968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b417-cf2f-45cd-a12a-c2ad4e17e5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:56.206246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b417-cf2f-45cd-a12a-c2ad4e17e5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:56.206979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4b417-cf2f-45cd-a12a-c2ad4e17e5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:56.208638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4b417-cf2f-45cd-a12a-c2ad4e17e5e5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:56.219894 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4246/8529] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:41:56.224393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98589e2-7ecf-4054-897d-05988a185b32 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:56.235552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98589e2-7ecf-4054-897d-05988a185b32 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:56.241202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3807f89-cfb2-4116-b39b-38efd4f3823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:56.242154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3807f89-cfb2-4116-b39b-38efd4f3823b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:56.242439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3807f89-cfb2-4116-b39b-38efd4f3823b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:56.242717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3807f89-cfb2-4116-b39b-38efd4f3823b admin admin] PATH_INFO: `/v3/projects/c621c69ea8b44c7ca1cddd9e23defc7d/users/b5255acc551c44b7b2877f030de3f3c1/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:56.244796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3807f89-cfb2-4116-b39b-38efd4f3823b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c621c69ea8b44c7ca1cddd9e23defc7d, user_id=b5255acc551c44b7b2877f030de3f3c1, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:56.247520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3807f89-cfb2-4116-b39b-38efd4f3823b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:56.258310 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4284/8530] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:41:56 2022] PUT /identity/v3/projects/c621c69ea8b44c7ca1cddd9e23defc7d/users/b5255acc551c44b7b2877f030de3f3c1/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:41:56.268707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906215a-60fa-4ad4-bfca-926ad5f65e67 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:56.269137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906215a-60fa-4ad4-bfca-926ad5f65e67 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:56.269621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906215a-60fa-4ad4-bfca-926ad5f65e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:56.302670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2906215a-60fa-4ad4-bfca-926ad5f65e67 None None] MFA Rules not processed for user `b5255acc551c44b7b2877f030de3f3c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:56.304454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2906215a-60fa-4ad4-bfca-926ad5f65e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:56.371082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:56.382561 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4247/8531] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:56 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:41:56.393408 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3807f89-cfb2-4116-b39b-38efd4f3823b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:56.395250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d3807f89-cfb2-4116-b39b-38efd4f3823b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:56.460755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3807f89-cfb2-4116-b39b-38efd4f3823b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:56.466110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc1b4a-d8e8-451b-918f-a2178cd25f95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:56.467065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc1b4a-d8e8-451b-918f-a2178cd25f95 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:56.467433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc1b4a-d8e8-451b-918f-a2178cd25f95 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:56.467782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc1b4a-d8e8-451b-918f-a2178cd25f95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:56.483509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc1b4a-d8e8-451b-918f-a2178cd25f95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:56.485010 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc1b4a-d8e8-451b-918f-a2178cd25f95 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:56.494937 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4285/8532] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:41:56 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:41:56.650780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906215a-60fa-4ad4-bfca-926ad5f65e67 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:56.663650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906215a-60fa-4ad4-bfca-926ad5f65e67 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:56.667846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0c969-0922-4c37-afb2-4e75c60fae53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:56.668519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0c969-0922-4c37-afb2-4e75c60fae53 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:56.668805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0c969-0922-4c37-afb2-4e75c60fae53 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:56.669084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0c969-0922-4c37-afb2-4e75c60fae53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:56.732395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0c969-0922-4c37-afb2-4e75c60fae53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:56.733852 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0c969-0922-4c37-afb2-4e75c60fae53 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:56.743080 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4248/8533] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:41:56 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:41:58.410941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc1b4a-d8e8-451b-918f-a2178cd25f95 service cinder] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:58.479211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc1b4a-d8e8-451b-918f-a2178cd25f95 service cinder] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:58.484858 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a28011-5490-4d8c-b4ad-2854f8b88ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:58.485738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a28011-5490-4d8c-b4ad-2854f8b88ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:58.486014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a28011-5490-4d8c-b4ad-2854f8b88ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:58.486287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a28011-5490-4d8c-b4ad-2854f8b88ee9 admin admin] PATH_INFO: `/v3/users/f19bee8512fe4c70a9aa93b405133ef0` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:58.487569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a28011-5490-4d8c-b4ad-2854f8b88ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f19bee8512fe4c70a9aa93b405133ef0)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:58.489549 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a28011-5490-4d8c-b4ad-2854f8b88ee9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:58.542660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f2a28011-5490-4d8c-b4ad-2854f8b88ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f19bee8512fe4c70a9aa93b405133ef0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:58.551776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f2a28011-5490-4d8c-b4ad-2854f8b88ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f19bee8512fe4c70a9aa93b405133ef0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:58.552416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f2a28011-5490-4d8c-b4ad-2854f8b88ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f19bee8512fe4c70a9aa93b405133ef0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:58.553022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f2a28011-5490-4d8c-b4ad-2854f8b88ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f19bee8512fe4c70a9aa93b405133ef0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:58.560026 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f2a28011-5490-4d8c-b4ad-2854f8b88ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f19bee8512fe4c70a9aa93b405133ef0'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:58.578953 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4286/8534] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:41:58 2022] DELETE /identity/v3/users/f19bee8512fe4c70a9aa93b405133ef0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:58.583602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12309330-e527-4e80-842f-78d92922f82d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:58.584124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12309330-e527-4e80-842f-78d92922f82d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:58.584321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12309330-e527-4e80-842f-78d92922f82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:58.601968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-12309330-e527-4e80-842f-78d92922f82d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:58.603155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-12309330-e527-4e80-842f-78d92922f82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:58.668556 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4249/8535] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:41:58.679658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a28011-5490-4d8c-b4ad-2854f8b88ee9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:58.681329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f2a28011-5490-4d8c-b4ad-2854f8b88ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:58.692538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:58.747095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a28011-5490-4d8c-b4ad-2854f8b88ee9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:58.751181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c9be2-df1c-4e5b-80ff-8a08ffc079cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:58.751826 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c9be2-df1c-4e5b-80ff-8a08ffc079cb service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:58.752110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c9be2-df1c-4e5b-80ff-8a08ffc079cb service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:58.752407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c9be2-df1c-4e5b-80ff-8a08ffc079cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:58.762086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c9be2-df1c-4e5b-80ff-8a08ffc079cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:58.763541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c9be2-df1c-4e5b-80ff-8a08ffc079cb service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:58.773493 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4287/8536] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:41:59.061777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12309330-e527-4e80-842f-78d92922f82d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:59.063269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-12309330-e527-4e80-842f-78d92922f82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:59.075667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12309330-e527-4e80-842f-78d92922f82d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:59.081420 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a41d8-8aa2-4696-9bd4-9e34cadcfad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:59.082342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a41d8-8aa2-4696-9bd4-9e34cadcfad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:59.082626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a41d8-8aa2-4696-9bd4-9e34cadcfad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:59.082858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a41d8-8aa2-4696-9bd4-9e34cadcfad2 admin admin] PATH_INFO: `/v3/projects/48033add8a504dbf9bff683da9edaeaa` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:59.084272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a41d8-8aa2-4696-9bd4-9e34cadcfad2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48033add8a504dbf9bff683da9edaeaa)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:59.086242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a41d8-8aa2-4696-9bd4-9e34cadcfad2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:59.140816 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-016a41d8-8aa2-4696-9bd4-9e34cadcfad2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48033add8a504dbf9bff683da9edaeaa', 'request_id': 'req-016a41d8-8aa2-4696-9bd4-9e34cadcfad2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:59.146999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-016a41d8-8aa2-4696-9bd4-9e34cadcfad2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48033add8a504dbf9bff683da9edaeaa', 'request_id': 'req-016a41d8-8aa2-4696-9bd4-9e34cadcfad2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:59.152780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-016a41d8-8aa2-4696-9bd4-9e34cadcfad2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48033add8a504dbf9bff683da9edaeaa', 'request_id': 'req-016a41d8-8aa2-4696-9bd4-9e34cadcfad2'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:59.167172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-016a41d8-8aa2-4696-9bd4-9e34cadcfad2 admin admin] The token cache is being invalidate because project 48033add8a504dbf9bff683da9edaeaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:41:59.167488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-016a41d8-8aa2-4696-9bd4-9e34cadcfad2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:59.168294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-016a41d8-8aa2-4696-9bd4-9e34cadcfad2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:59.170017 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4250/8537] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:41:59 2022] DELETE /identity/v3/projects/48033add8a504dbf9bff683da9edaeaa => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:59.174766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c9be2-df1c-4e5b-80ff-8a08ffc079cb service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:59.184705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c9be2-df1c-4e5b-80ff-8a08ffc079cb service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:59.241241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea84e93-61e4-48d7-9d53-f6ce0566258a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:59.242114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea84e93-61e4-48d7-9d53-f6ce0566258a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:59.242385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea84e93-61e4-48d7-9d53-f6ce0566258a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:59.242651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea84e93-61e4-48d7-9d53-f6ce0566258a admin admin] PATH_INFO: `/v3/users/b5255acc551c44b7b2877f030de3f3c1` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:59.243828 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea84e93-61e4-48d7-9d53-f6ce0566258a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5255acc551c44b7b2877f030de3f3c1)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:59.245800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea84e93-61e4-48d7-9d53-f6ce0566258a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:59.293079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2ea84e93-61e4-48d7-9d53-f6ce0566258a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5255acc551c44b7b2877f030de3f3c1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:59.300934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2ea84e93-61e4-48d7-9d53-f6ce0566258a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5255acc551c44b7b2877f030de3f3c1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:59.301554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2ea84e93-61e4-48d7-9d53-f6ce0566258a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5255acc551c44b7b2877f030de3f3c1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:59.302152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2ea84e93-61e4-48d7-9d53-f6ce0566258a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5255acc551c44b7b2877f030de3f3c1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:59.309121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2ea84e93-61e4-48d7-9d53-f6ce0566258a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5255acc551c44b7b2877f030de3f3c1'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:59.327149 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4288/8538] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:41:59 2022] DELETE /identity/v3/users/b5255acc551c44b7b2877f030de3f3c1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:59.624723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a41d8-8aa2-4696-9bd4-9e34cadcfad2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:59.626199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-016a41d8-8aa2-4696-9bd4-9e34cadcfad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:59.640220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a41d8-8aa2-4696-9bd4-9e34cadcfad2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:59.654482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:59.709846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cdd81-e30b-4845-a7cd-1e751119fed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:59.711119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cdd81-e30b-4845-a7cd-1e751119fed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:59.711500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cdd81-e30b-4845-a7cd-1e751119fed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:59.711825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cdd81-e30b-4845-a7cd-1e751119fed6 admin admin] PATH_INFO: `/v3/projects/c621c69ea8b44c7ca1cddd9e23defc7d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:59.713707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cdd81-e30b-4845-a7cd-1e751119fed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c621c69ea8b44c7ca1cddd9e23defc7d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:59.716745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cdd81-e30b-4845-a7cd-1e751119fed6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:59.776205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0c1cdd81-e30b-4845-a7cd-1e751119fed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c621c69ea8b44c7ca1cddd9e23defc7d', 'request_id': 'req-0c1cdd81-e30b-4845-a7cd-1e751119fed6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:59.784380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0c1cdd81-e30b-4845-a7cd-1e751119fed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c621c69ea8b44c7ca1cddd9e23defc7d', 'request_id': 'req-0c1cdd81-e30b-4845-a7cd-1e751119fed6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:59.790232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0c1cdd81-e30b-4845-a7cd-1e751119fed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c621c69ea8b44c7ca1cddd9e23defc7d', 'request_id': 'req-0c1cdd81-e30b-4845-a7cd-1e751119fed6'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:59.804182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0c1cdd81-e30b-4845-a7cd-1e751119fed6 admin admin] The token cache is being invalidate because project c621c69ea8b44c7ca1cddd9e23defc7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:41:59.804372 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0c1cdd81-e30b-4845-a7cd-1e751119fed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:59.804999 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-0c1cdd81-e30b-4845-a7cd-1e751119fed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:41:59.806553 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4251/8539] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:41:59 2022] DELETE /identity/v3/projects/c621c69ea8b44c7ca1cddd9e23defc7d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:41:59.816277 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744ee83-ecf0-4276-ada8-c4e32507265e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:59.816803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744ee83-ecf0-4276-ada8-c4e32507265e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:59.816914 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744ee83-ecf0-4276-ada8-c4e32507265e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:59.836316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d744ee83-ecf0-4276-ada8-c4e32507265e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:59.837577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d744ee83-ecf0-4276-ada8-c4e32507265e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:59.865923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:41:59.904671 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4289/8540] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:41:59.913989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3422f7e-3801-447b-836c-75a2c9676023 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:59.914298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3422f7e-3801-447b-836c-75a2c9676023 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:59.914594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3422f7e-3801-447b-836c-75a2c9676023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:59.933942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c3422f7e-3801-447b-836c-75a2c9676023 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:41:59.935166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c3422f7e-3801-447b-836c-75a2c9676023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:41:59.944747 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4252/8541] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:41:59.949129 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744ee83-ecf0-4276-ada8-c4e32507265e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:59.959255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744ee83-ecf0-4276-ada8-c4e32507265e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:41:59.965063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6200618-6da4-4f9f-b096-1574d379837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:41:59.965884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6200618-6da4-4f9f-b096-1574d379837b admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:41:59.966165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6200618-6da4-4f9f-b096-1574d379837b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:41:59.966439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6200618-6da4-4f9f-b096-1574d379837b admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:41:59.967169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6200618-6da4-4f9f-b096-1574d379837b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:41:59.967474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6200618-6da4-4f9f-b096-1574d379837b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:41:59.971506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6200618-6da4-4f9f-b096-1574d379837b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:41:59.984672 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4290/8542] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:41:59.989274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3422f7e-3801-447b-836c-75a2c9676023 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:41:59.999093 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3422f7e-3801-447b-836c-75a2c9676023 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:00.004149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69cee6-9322-480f-948e-a80deafbe287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:00.004796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69cee6-9322-480f-948e-a80deafbe287 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:00.005083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69cee6-9322-480f-948e-a80deafbe287 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:00.005376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69cee6-9322-480f-948e-a80deafbe287 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:00.006069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69cee6-9322-480f-948e-a80deafbe287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:00.008002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69cee6-9322-480f-948e-a80deafbe287 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:00.047998 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4253/8543] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:41:59 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:42:00.054385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6200618-6da4-4f9f-b096-1574d379837b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:00.068995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6200618-6da4-4f9f-b096-1574d379837b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:00.130128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e46c6-066c-4653-839a-5f8f570a40c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:00.130802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e46c6-066c-4653-839a-5f8f570a40c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:00.131088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e46c6-066c-4653-839a-5f8f570a40c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:00.131370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e46c6-066c-4653-839a-5f8f570a40c6 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:00.132070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e46c6-066c-4653-839a-5f8f570a40c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:00.134008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e46c6-066c-4653-839a-5f8f570a40c6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:00.155622 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4291/8544] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:42:00 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:42:00.160151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69cee6-9322-480f-948e-a80deafbe287 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:00.171636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69cee6-9322-480f-948e-a80deafbe287 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:00.177017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebebbe-50c8-4a52-88cd-8e9e6cd9d392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:00.177683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebebbe-50c8-4a52-88cd-8e9e6cd9d392 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:00.177968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebebbe-50c8-4a52-88cd-8e9e6cd9d392 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:00.178244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebebbe-50c8-4a52-88cd-8e9e6cd9d392 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:00.178979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebebbe-50c8-4a52-88cd-8e9e6cd9d392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:00.180636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebebbe-50c8-4a52-88cd-8e9e6cd9d392 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:00.191503 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4254/8545] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:42:00.195472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e46c6-066c-4653-839a-5f8f570a40c6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:00.207047 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e46c6-066c-4653-839a-5f8f570a40c6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:00.212371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0650a-1eb9-42fa-8fce-cc99f8c5338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:00.213102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0650a-1eb9-42fa-8fce-cc99f8c5338e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:00.213614 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0650a-1eb9-42fa-8fce-cc99f8c5338e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:00.213894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0650a-1eb9-42fa-8fce-cc99f8c5338e admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:00.214631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0650a-1eb9-42fa-8fce-cc99f8c5338e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:00.216330 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0650a-1eb9-42fa-8fce-cc99f8c5338e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:00.228147 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4292/8546] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:42:00.297762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebebbe-50c8-4a52-88cd-8e9e6cd9d392 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:00.312289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebebbe-50c8-4a52-88cd-8e9e6cd9d392 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:00.318183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf44fb9-f305-4e28-bdb3-1636f409057f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:00.319084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf44fb9-f305-4e28-bdb3-1636f409057f admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:00.319360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf44fb9-f305-4e28-bdb3-1636f409057f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:00.319627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf44fb9-f305-4e28-bdb3-1636f409057f admin admin] PATH_INFO: `/v3/projects/ef9a80f4ed3d4fdba7b1abf03eb11017/users/754a8000903b4364bf38030b34b550d9/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:00.335630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf44fb9-f305-4e28-bdb3-1636f409057f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef9a80f4ed3d4fdba7b1abf03eb11017, user_id=754a8000903b4364bf38030b34b550d9, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:00.338316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf44fb9-f305-4e28-bdb3-1636f409057f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:00.352818 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4255/8547] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:42:00 2022] PUT /identity/v3/projects/ef9a80f4ed3d4fdba7b1abf03eb11017/users/754a8000903b4364bf38030b34b550d9/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:00.363943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dfdfd-c94e-46fc-8c5f-9656b2aff582 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:00.364369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dfdfd-c94e-46fc-8c5f-9656b2aff582 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:00.364773 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dfdfd-c94e-46fc-8c5f-9656b2aff582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:00.401321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fc1dfdfd-c94e-46fc-8c5f-9656b2aff582 None None] MFA Rules not processed for user `754a8000903b4364bf38030b34b550d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:00.402565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fc1dfdfd-c94e-46fc-8c5f-9656b2aff582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:00.466610 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4293/8548] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:00.478154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf44fb9-f305-4e28-bdb3-1636f409057f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:00.479975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9cf44fb9-f305-4e28-bdb3-1636f409057f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:00.530882 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:00.548294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf44fb9-f305-4e28-bdb3-1636f409057f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:00.552442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace540c-fc89-40ac-ad0f-594981f64f42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:00.553098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace540c-fc89-40ac-ad0f-594981f64f42 service cinder] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:00.553502 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace540c-fc89-40ac-ad0f-594981f64f42 service cinder] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:00.553789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace540c-fc89-40ac-ad0f-594981f64f42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:00.562857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace540c-fc89-40ac-ad0f-594981f64f42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:00.564302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace540c-fc89-40ac-ad0f-594981f64f42 service cinder] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:00.573571 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4256/8549] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:42:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:42:00.593095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dfdfd-c94e-46fc-8c5f-9656b2aff582 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:00.622558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:00.661352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dfdfd-c94e-46fc-8c5f-9656b2aff582 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:00.666534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1a27f-4a19-445c-ad2e-48fa71df18e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:00.667416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1a27f-4a19-445c-ad2e-48fa71df18e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:00.667702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1a27f-4a19-445c-ad2e-48fa71df18e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:00.667979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1a27f-4a19-445c-ad2e-48fa71df18e3 admin admin] PATH_INFO: `/v3/users/754a8000903b4364bf38030b34b550d9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:00.669256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1a27f-4a19-445c-ad2e-48fa71df18e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=754a8000903b4364bf38030b34b550d9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:00.671624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1a27f-4a19-445c-ad2e-48fa71df18e3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:00.720307 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-87a1a27f-4a19-445c-ad2e-48fa71df18e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '754a8000903b4364bf38030b34b550d9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:00.727915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-87a1a27f-4a19-445c-ad2e-48fa71df18e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '754a8000903b4364bf38030b34b550d9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:00.728669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-87a1a27f-4a19-445c-ad2e-48fa71df18e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '754a8000903b4364bf38030b34b550d9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:00.729276 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-87a1a27f-4a19-445c-ad2e-48fa71df18e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '754a8000903b4364bf38030b34b550d9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:00.736291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-87a1a27f-4a19-445c-ad2e-48fa71df18e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '754a8000903b4364bf38030b34b550d9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:00.755047 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4294/8550] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:42:00 2022] DELETE /identity/v3/users/754a8000903b4364bf38030b34b550d9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:00.759932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d97e39-3414-49c5-b771-037b8e2649c7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:00.760464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d97e39-3414-49c5-b771-037b8e2649c7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:00.760588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d97e39-3414-49c5-b771-037b8e2649c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:00.778949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-73d97e39-3414-49c5-b771-037b8e2649c7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:00.780198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-73d97e39-3414-49c5-b771-037b8e2649c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:00.841731 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4257/8551] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:00.852128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1a27f-4a19-445c-ad2e-48fa71df18e3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:00.853668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-87a1a27f-4a19-445c-ad2e-48fa71df18e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:00.914394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1a27f-4a19-445c-ad2e-48fa71df18e3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:00.918625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e4b0c-e1ba-4a5b-9c69-ae936fc6c6c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:00.919252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e4b0c-e1ba-4a5b-9c69-ae936fc6c6c4 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:00.919532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e4b0c-e1ba-4a5b-9c69-ae936fc6c6c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:00.919809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e4b0c-e1ba-4a5b-9c69-ae936fc6c6c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:00.931292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e4b0c-e1ba-4a5b-9c69-ae936fc6c6c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:00.933122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e4b0c-e1ba-4a5b-9c69-ae936fc6c6c4 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:00.943962 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4295/8552] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:42:01.226153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d97e39-3414-49c5-b771-037b8e2649c7 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:01.227830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-73d97e39-3414-49c5-b771-037b8e2649c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:01.242763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d97e39-3414-49c5-b771-037b8e2649c7 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:01.248287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a802b-ed4c-4e9f-8b1f-2b8651aee2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:01.249452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a802b-ed4c-4e9f-8b1f-2b8651aee2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:01.249879 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a802b-ed4c-4e9f-8b1f-2b8651aee2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:01.250324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a802b-ed4c-4e9f-8b1f-2b8651aee2bb admin admin] PATH_INFO: `/v3/projects/ef9a80f4ed3d4fdba7b1abf03eb11017` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:01.251648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a802b-ed4c-4e9f-8b1f-2b8651aee2bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef9a80f4ed3d4fdba7b1abf03eb11017)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:01.253803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a802b-ed4c-4e9f-8b1f-2b8651aee2bb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:01.303386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-816a802b-ed4c-4e9f-8b1f-2b8651aee2bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef9a80f4ed3d4fdba7b1abf03eb11017', 'request_id': 'req-816a802b-ed4c-4e9f-8b1f-2b8651aee2bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:01.309608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-816a802b-ed4c-4e9f-8b1f-2b8651aee2bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef9a80f4ed3d4fdba7b1abf03eb11017', 'request_id': 'req-816a802b-ed4c-4e9f-8b1f-2b8651aee2bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:01.316162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-816a802b-ed4c-4e9f-8b1f-2b8651aee2bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef9a80f4ed3d4fdba7b1abf03eb11017', 'request_id': 'req-816a802b-ed4c-4e9f-8b1f-2b8651aee2bb'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:01.329047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-816a802b-ed4c-4e9f-8b1f-2b8651aee2bb admin admin] The token cache is being invalidate because project ef9a80f4ed3d4fdba7b1abf03eb11017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:42:01.329343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-816a802b-ed4c-4e9f-8b1f-2b8651aee2bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:01.329994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-816a802b-ed4c-4e9f-8b1f-2b8651aee2bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:01.331596 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4258/8553] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:42:01 2022] DELETE /identity/v3/projects/ef9a80f4ed3d4fdba7b1abf03eb11017 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:01.336739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee8057-a914-4f77-877a-4f7f423ea9ff None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:01.337032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee8057-a914-4f77-877a-4f7f423ea9ff None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:01.337305 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee8057-a914-4f77-877a-4f7f423ea9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:01.355504 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-56ee8057-a914-4f77-877a-4f7f423ea9ff None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:01.356714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-56ee8057-a914-4f77-877a-4f7f423ea9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:01.407869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:01.428073 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4296/8554] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:01.436078 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5c387-8c9f-46cd-b936-bbe4db4be251 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:01.436449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5c387-8c9f-46cd-b936-bbe4db4be251 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:01.436936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5c387-8c9f-46cd-b936-bbe4db4be251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:01.455772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a8f5c387-8c9f-46cd-b936-bbe4db4be251 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:01.457050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a8f5c387-8c9f-46cd-b936-bbe4db4be251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:01.470404 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4259/8555] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:42:01.475503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee8057-a914-4f77-877a-4f7f423ea9ff None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:01.490976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee8057-a914-4f77-877a-4f7f423ea9ff None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:01.498673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52584212-a81e-4fc1-93ad-95090e945781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:01.499327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52584212-a81e-4fc1-93ad-95090e945781 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:01.499717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52584212-a81e-4fc1-93ad-95090e945781 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:01.499977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52584212-a81e-4fc1-93ad-95090e945781 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:01.500743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52584212-a81e-4fc1-93ad-95090e945781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:42:01.501055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52584212-a81e-4fc1-93ad-95090e945781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:01.502686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52584212-a81e-4fc1-93ad-95090e945781 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:01.515995 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4297/8556] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:42:01.520769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5c387-8c9f-46cd-b936-bbe4db4be251 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:01.530806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5c387-8c9f-46cd-b936-bbe4db4be251 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:01.537020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22978a0c-169b-4bcd-a34b-bbcec0442fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:01.537677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22978a0c-169b-4bcd-a34b-bbcec0442fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:01.537960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22978a0c-169b-4bcd-a34b-bbcec0442fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:01.538237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22978a0c-169b-4bcd-a34b-bbcec0442fd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:01.538923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22978a0c-169b-4bcd-a34b-bbcec0442fd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:01.540874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22978a0c-169b-4bcd-a34b-bbcec0442fd2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:01.568866 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4260/8557] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:42:01 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:42:01.573230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52584212-a81e-4fc1-93ad-95090e945781 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:01.583855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52584212-a81e-4fc1-93ad-95090e945781 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:01.644876 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd8928-d134-4a22-a011-d9ff62bbed46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:01.645492 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd8928-d134-4a22-a011-d9ff62bbed46 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:01.645782 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd8928-d134-4a22-a011-d9ff62bbed46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:01.646054 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd8928-d134-4a22-a011-d9ff62bbed46 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:01.646757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd8928-d134-4a22-a011-d9ff62bbed46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:01.648855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd8928-d134-4a22-a011-d9ff62bbed46 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:01.671052 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4298/8558] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:42:01 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:42:01.675416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22978a0c-169b-4bcd-a34b-bbcec0442fd2 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:01.686022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22978a0c-169b-4bcd-a34b-bbcec0442fd2 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:01.690996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc81ad1-864a-478d-90b5-84869d08a9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:01.691647 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc81ad1-864a-478d-90b5-84869d08a9ac admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:01.691927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc81ad1-864a-478d-90b5-84869d08a9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:01.692232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc81ad1-864a-478d-90b5-84869d08a9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:01.692967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc81ad1-864a-478d-90b5-84869d08a9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:01.694555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc81ad1-864a-478d-90b5-84869d08a9ac admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:01.705260 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4261/8559] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:42:01.709545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd8928-d134-4a22-a011-d9ff62bbed46 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:01.720680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd8928-d134-4a22-a011-d9ff62bbed46 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:01.725697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f6b35-1658-42c1-948b-da05d309bf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:01.726342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f6b35-1658-42c1-948b-da05d309bf4c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:01.726621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f6b35-1658-42c1-948b-da05d309bf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:01.726901 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f6b35-1658-42c1-948b-da05d309bf4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:01.727600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f6b35-1658-42c1-948b-da05d309bf4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:01.729251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f6b35-1658-42c1-948b-da05d309bf4c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:01.739349 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4299/8560] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:42:01.743428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc81ad1-864a-478d-90b5-84869d08a9ac admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:01.753661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc81ad1-864a-478d-90b5-84869d08a9ac admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:01.758745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ea81a-ca15-4c4b-856f-1d13d8144d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:01.759618 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ea81a-ca15-4c4b-856f-1d13d8144d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:01.759869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ea81a-ca15-4c4b-856f-1d13d8144d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:01.760202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ea81a-ca15-4c4b-856f-1d13d8144d53 admin admin] PATH_INFO: `/v3/projects/a32f6c8f4e5b4b3ca6161b7c57dc1fc2/users/e0e9890a826749d28608a43d858850d7/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:01.775347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ea81a-ca15-4c4b-856f-1d13d8144d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32f6c8f4e5b4b3ca6161b7c57dc1fc2, user_id=e0e9890a826749d28608a43d858850d7, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:01.777975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ea81a-ca15-4c4b-856f-1d13d8144d53 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:01.793345 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4262/8561] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:42:01 2022] PUT /identity/v3/projects/a32f6c8f4e5b4b3ca6161b7c57dc1fc2/users/e0e9890a826749d28608a43d858850d7/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:01.804815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4563a3-7650-47f2-8973-507f04a4c774 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:01.805105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4563a3-7650-47f2-8973-507f04a4c774 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:01.805382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4563a3-7650-47f2-8973-507f04a4c774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:01.832031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1a4563a3-7650-47f2-8973-507f04a4c774 None None] MFA Rules not processed for user `e0e9890a826749d28608a43d858850d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:01.833268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1a4563a3-7650-47f2-8973-507f04a4c774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:01.904120 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4300/8562] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:01.909584 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ea81a-ca15-4c4b-856f-1d13d8144d53 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:01.916613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:01.977320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ea81a-ca15-4c4b-856f-1d13d8144d53 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:01.982360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ffa36-9e30-4bfa-8e65-5f1040d0ee7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:01.983022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ffa36-9e30-4bfa-8e65-5f1040d0ee7a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:01.983306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ffa36-9e30-4bfa-8e65-5f1040d0ee7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:01.983590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ffa36-9e30-4bfa-8e65-5f1040d0ee7a admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:01.984359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ffa36-9e30-4bfa-8e65-5f1040d0ee7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:01.986281 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ffa36-9e30-4bfa-8e65-5f1040d0ee7a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:02.014818 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4263/8563] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:42:01 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:42:02.019746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4563a3-7650-47f2-8973-507f04a4c774 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:02.032076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4563a3-7650-47f2-8973-507f04a4c774 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:02.074630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:02.095972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c58de3-3861-4756-9fa9-b81791016d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:02.096892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c58de3-3861-4756-9fa9-b81791016d8a admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:02.097002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c58de3-3861-4756-9fa9-b81791016d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:02.097315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c58de3-3861-4756-9fa9-b81791016d8a admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:02.098014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c58de3-3861-4756-9fa9-b81791016d8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:02.100059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c58de3-3861-4756-9fa9-b81791016d8a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:02.120527 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4301/8564] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:42:02 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:42:02.124979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ffa36-9e30-4bfa-8e65-5f1040d0ee7a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:02.135549 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ffa36-9e30-4bfa-8e65-5f1040d0ee7a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:02.140835 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33455d3-6e59-4c48-8a97-94dc5fab86b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:02.141492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33455d3-6e59-4c48-8a97-94dc5fab86b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:02.141774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33455d3-6e59-4c48-8a97-94dc5fab86b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:02.142052 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33455d3-6e59-4c48-8a97-94dc5fab86b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:02.142773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33455d3-6e59-4c48-8a97-94dc5fab86b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:02.144419 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33455d3-6e59-4c48-8a97-94dc5fab86b4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:02.155093 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4264/8565] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:42:02.159329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c58de3-3861-4756-9fa9-b81791016d8a admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:02.170025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c58de3-3861-4756-9fa9-b81791016d8a admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:02.175776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d529de-33d1-4e52-b63a-adbd41eae80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:02.176712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d529de-33d1-4e52-b63a-adbd41eae80b admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:02.176995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d529de-33d1-4e52-b63a-adbd41eae80b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:02.177286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d529de-33d1-4e52-b63a-adbd41eae80b admin admin] PATH_INFO: `/v3/projects/2a79c6b19b59449888f82c7b07085bdd/users/f082140884e240caa4e45e1ee5c59780/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:02.192458 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d529de-33d1-4e52-b63a-adbd41eae80b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a79c6b19b59449888f82c7b07085bdd, user_id=f082140884e240caa4e45e1ee5c59780, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:02.195161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d529de-33d1-4e52-b63a-adbd41eae80b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:02.210693 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4302/8566] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:42:02 2022] PUT /identity/v3/projects/2a79c6b19b59449888f82c7b07085bdd/users/f082140884e240caa4e45e1ee5c59780/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:42:02.214860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33455d3-6e59-4c48-8a97-94dc5fab86b4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:02.225168 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33455d3-6e59-4c48-8a97-94dc5fab86b4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:02.284063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b9053-bfdd-47f9-8592-ab5f29857844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:02.284757 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b9053-bfdd-47f9-8592-ab5f29857844 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:02.285039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b9053-bfdd-47f9-8592-ab5f29857844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:02.285311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b9053-bfdd-47f9-8592-ab5f29857844 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:02.286029 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b9053-bfdd-47f9-8592-ab5f29857844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:02.287625 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b9053-bfdd-47f9-8592-ab5f29857844 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:02.297925 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4265/8567] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:42:02.302210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d529de-33d1-4e52-b63a-adbd41eae80b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:02.313403 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d529de-33d1-4e52-b63a-adbd41eae80b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:02.318580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9dc6b-b98b-49e3-840c-25cd5c0b0cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:02.319487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9dc6b-b98b-49e3-840c-25cd5c0b0cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:02.319768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9dc6b-b98b-49e3-840c-25cd5c0b0cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:02.320063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9dc6b-b98b-49e3-840c-25cd5c0b0cd4 admin admin] PATH_INFO: `/v3/projects/2a79c6b19b59449888f82c7b07085bdd/users/f082140884e240caa4e45e1ee5c59780/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:02.322160 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9dc6b-b98b-49e3-840c-25cd5c0b0cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a79c6b19b59449888f82c7b07085bdd, user_id=f082140884e240caa4e45e1ee5c59780, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:02.324904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9dc6b-b98b-49e3-840c-25cd5c0b0cd4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:02.335799 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4303/8568] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:42:02 2022] PUT /identity/v3/projects/2a79c6b19b59449888f82c7b07085bdd/users/f082140884e240caa4e45e1ee5c59780/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:02.346571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33898ccb-da76-4bec-9448-e14116b9d20e None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:02.346875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33898ccb-da76-4bec-9448-e14116b9d20e None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:02.347175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33898ccb-da76-4bec-9448-e14116b9d20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:02.374992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-33898ccb-da76-4bec-9448-e14116b9d20e None None] MFA Rules not processed for user `f082140884e240caa4e45e1ee5c59780`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:02.376241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-33898ccb-da76-4bec-9448-e14116b9d20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:02.446663 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:02.450961 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4266/8569] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:02.462742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9dc6b-b98b-49e3-840c-25cd5c0b0cd4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:02.467644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-24b9dc6b-b98b-49e3-840c-25cd5c0b0cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:02.531138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9dc6b-b98b-49e3-840c-25cd5c0b0cd4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:02.534741 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d1637-c461-4db6-9ec2-105f62a05904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ea416fd4d4420b9112507ef1a68bf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:02.535426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d1637-c461-4db6-9ec2-105f62a05904 service cinder] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:02.535680 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d1637-c461-4db6-9ec2-105f62a05904 service cinder] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:02.535957 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d1637-c461-4db6-9ec2-105f62a05904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:02.604933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d1637-c461-4db6-9ec2-105f62a05904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:02.606681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d1637-c461-4db6-9ec2-105f62a05904 service cinder] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:02.616673 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4304/8570] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:42:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:42:04.133360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33898ccb-da76-4bec-9448-e14116b9d20e None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:04.199055 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33898ccb-da76-4bec-9448-e14116b9d20e None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:04.203989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193f6d-1ba3-49a7-9e7a-2521601a7aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:04.204909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193f6d-1ba3-49a7-9e7a-2521601a7aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:04.205191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193f6d-1ba3-49a7-9e7a-2521601a7aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:04.205468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193f6d-1ba3-49a7-9e7a-2521601a7aa8 admin admin] PATH_INFO: `/v3/users/e0e9890a826749d28608a43d858850d7` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:04.206695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90193f6d-1ba3-49a7-9e7a-2521601a7aa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e9890a826749d28608a43d858850d7)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:04.208710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90193f6d-1ba3-49a7-9e7a-2521601a7aa8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:04.256382 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-90193f6d-1ba3-49a7-9e7a-2521601a7aa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e9890a826749d28608a43d858850d7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:04.264136 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-90193f6d-1ba3-49a7-9e7a-2521601a7aa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e9890a826749d28608a43d858850d7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:04.271105 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-90193f6d-1ba3-49a7-9e7a-2521601a7aa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e9890a826749d28608a43d858850d7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:04.271759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-90193f6d-1ba3-49a7-9e7a-2521601a7aa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e9890a826749d28608a43d858850d7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:04.272387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-90193f6d-1ba3-49a7-9e7a-2521601a7aa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e9890a826749d28608a43d858850d7'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:04.290380 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4267/8571] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:42:04 2022] DELETE /identity/v3/users/e0e9890a826749d28608a43d858850d7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:04.295512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c704964-bf34-4ff0-8127-2db411e5dd3a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:04.296071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c704964-bf34-4ff0-8127-2db411e5dd3a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:04.296204 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c704964-bf34-4ff0-8127-2db411e5dd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:04.314948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3c704964-bf34-4ff0-8127-2db411e5dd3a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:04.316285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3c704964-bf34-4ff0-8127-2db411e5dd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:04.362091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:04.378677 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4305/8572] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:04.388992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193f6d-1ba3-49a7-9e7a-2521601a7aa8 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:04.390576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-90193f6d-1ba3-49a7-9e7a-2521601a7aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:04.455028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193f6d-1ba3-49a7-9e7a-2521601a7aa8 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:04.459390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6b468-5f44-4994-9587-a963dea172f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:04.460111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6b468-5f44-4994-9587-a963dea172f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:04.460399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6b468-5f44-4994-9587-a963dea172f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:04.460682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6b468-5f44-4994-9587-a963dea172f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:04.470810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6b468-5f44-4994-9587-a963dea172f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:04.472307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6b468-5f44-4994-9587-a963dea172f8 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:04.482651 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4268/8573] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:42:04.770803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c704964-bf34-4ff0-8127-2db411e5dd3a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:04.772722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3c704964-bf34-4ff0-8127-2db411e5dd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:04.791126 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c704964-bf34-4ff0-8127-2db411e5dd3a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:04.799803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82c6f8-d7f8-4acc-a646-3cc86fa86d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:04.801055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82c6f8-d7f8-4acc-a646-3cc86fa86d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:04.801748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82c6f8-d7f8-4acc-a646-3cc86fa86d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:04.802153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82c6f8-d7f8-4acc-a646-3cc86fa86d58 admin admin] PATH_INFO: `/v3/projects/a32f6c8f4e5b4b3ca6161b7c57dc1fc2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:04.803601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82c6f8-d7f8-4acc-a646-3cc86fa86d58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32f6c8f4e5b4b3ca6161b7c57dc1fc2)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:04.805735 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82c6f8-d7f8-4acc-a646-3cc86fa86d58 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:04.866500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fe82c6f8-d7f8-4acc-a646-3cc86fa86d58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32f6c8f4e5b4b3ca6161b7c57dc1fc2', 'request_id': 'req-fe82c6f8-d7f8-4acc-a646-3cc86fa86d58'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:04.875342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fe82c6f8-d7f8-4acc-a646-3cc86fa86d58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32f6c8f4e5b4b3ca6161b7c57dc1fc2', 'request_id': 'req-fe82c6f8-d7f8-4acc-a646-3cc86fa86d58'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:04.882190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fe82c6f8-d7f8-4acc-a646-3cc86fa86d58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32f6c8f4e5b4b3ca6161b7c57dc1fc2', 'request_id': 'req-fe82c6f8-d7f8-4acc-a646-3cc86fa86d58'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:04.892898 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fe82c6f8-d7f8-4acc-a646-3cc86fa86d58 admin admin] The token cache is being invalidate because project a32f6c8f4e5b4b3ca6161b7c57dc1fc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:42:04.893195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fe82c6f8-d7f8-4acc-a646-3cc86fa86d58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:04.893859 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-fe82c6f8-d7f8-4acc-a646-3cc86fa86d58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:04.895499 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4306/8574] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:42:04 2022] DELETE /identity/v3/projects/a32f6c8f4e5b4b3ca6161b7c57dc1fc2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:04.899783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6b468-5f44-4994-9587-a963dea172f8 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:04.910438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6b468-5f44-4994-9587-a963dea172f8 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:04.929937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:04.973942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81055e-b257-494d-84f5-763c7c344d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:04.974767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81055e-b257-494d-84f5-763c7c344d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:04.975048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81055e-b257-494d-84f5-763c7c344d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:04.975327 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81055e-b257-494d-84f5-763c7c344d9a admin admin] PATH_INFO: `/v3/users/f082140884e240caa4e45e1ee5c59780` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:04.976681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81055e-b257-494d-84f5-763c7c344d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f082140884e240caa4e45e1ee5c59780)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:04.978654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81055e-b257-494d-84f5-763c7c344d9a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:05.028501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1a81055e-b257-494d-84f5-763c7c344d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f082140884e240caa4e45e1ee5c59780'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:05.036596 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1a81055e-b257-494d-84f5-763c7c344d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f082140884e240caa4e45e1ee5c59780'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:05.044260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1a81055e-b257-494d-84f5-763c7c344d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f082140884e240caa4e45e1ee5c59780'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:05.044975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1a81055e-b257-494d-84f5-763c7c344d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f082140884e240caa4e45e1ee5c59780'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:05.046087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1a81055e-b257-494d-84f5-763c7c344d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f082140884e240caa4e45e1ee5c59780'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:05.063658 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4269/8575] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:42:04 2022] DELETE /identity/v3/users/f082140884e240caa4e45e1ee5c59780 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:05.358986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82c6f8-d7f8-4acc-a646-3cc86fa86d58 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:05.360539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fe82c6f8-d7f8-4acc-a646-3cc86fa86d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:05.374897 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82c6f8-d7f8-4acc-a646-3cc86fa86d58 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:05.436552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e81b60-c33d-49fa-9bd4-09bdd5768da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:05.437466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e81b60-c33d-49fa-9bd4-09bdd5768da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:05.437748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e81b60-c33d-49fa-9bd4-09bdd5768da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:05.438029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e81b60-c33d-49fa-9bd4-09bdd5768da7 admin admin] PATH_INFO: `/v3/projects/2a79c6b19b59449888f82c7b07085bdd` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:05.439286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e81b60-c33d-49fa-9bd4-09bdd5768da7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a79c6b19b59449888f82c7b07085bdd)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:05.441284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e81b60-c33d-49fa-9bd4-09bdd5768da7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:05.492159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-94e81b60-c33d-49fa-9bd4-09bdd5768da7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a79c6b19b59449888f82c7b07085bdd', 'request_id': 'req-94e81b60-c33d-49fa-9bd4-09bdd5768da7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:05.500772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-94e81b60-c33d-49fa-9bd4-09bdd5768da7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a79c6b19b59449888f82c7b07085bdd', 'request_id': 'req-94e81b60-c33d-49fa-9bd4-09bdd5768da7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:05.507337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-94e81b60-c33d-49fa-9bd4-09bdd5768da7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a79c6b19b59449888f82c7b07085bdd', 'request_id': 'req-94e81b60-c33d-49fa-9bd4-09bdd5768da7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:05.520260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-94e81b60-c33d-49fa-9bd4-09bdd5768da7 admin admin] The token cache is being invalidate because project 2a79c6b19b59449888f82c7b07085bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:42:05.520545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-94e81b60-c33d-49fa-9bd4-09bdd5768da7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:05.521201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-94e81b60-c33d-49fa-9bd4-09bdd5768da7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:05.523088 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4307/8576] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:42:05 2022] DELETE /identity/v3/projects/2a79c6b19b59449888f82c7b07085bdd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:05.532060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20f2ef-8728-48f6-9ac1-4891d8b0308d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:05.532553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20f2ef-8728-48f6-9ac1-4891d8b0308d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:05.532664 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20f2ef-8728-48f6-9ac1-4891d8b0308d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:05.551763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4d20f2ef-8728-48f6-9ac1-4891d8b0308d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:05.553018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4d20f2ef-8728-48f6-9ac1-4891d8b0308d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:05.629094 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4270/8577] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:05.637992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303393ca-ddfd-4aab-b9ad-b4f61b169b93 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:05.638255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303393ca-ddfd-4aab-b9ad-b4f61b169b93 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:05.638619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303393ca-ddfd-4aab-b9ad-b4f61b169b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:05.646526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:05.661161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-303393ca-ddfd-4aab-b9ad-b4f61b169b93 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:05.662375 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-303393ca-ddfd-4aab-b9ad-b4f61b169b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:05.672383 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4308/8578] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:05.676797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20f2ef-8728-48f6-9ac1-4891d8b0308d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:05.686979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20f2ef-8728-48f6-9ac1-4891d8b0308d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:05.692023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850cd7f-5c46-4305-9b4a-ddde04ee0687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:05.692720 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850cd7f-5c46-4305-9b4a-ddde04ee0687 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:05.693005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850cd7f-5c46-4305-9b4a-ddde04ee0687 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:05.693289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850cd7f-5c46-4305-9b4a-ddde04ee0687 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:05.694039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850cd7f-5c46-4305-9b4a-ddde04ee0687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:42:05.694349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850cd7f-5c46-4305-9b4a-ddde04ee0687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:05.695953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850cd7f-5c46-4305-9b4a-ddde04ee0687 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:05.707989 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4271/8579] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:42:05.712477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303393ca-ddfd-4aab-b9ad-b4f61b169b93 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:05.722282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303393ca-ddfd-4aab-b9ad-b4f61b169b93 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:05.727889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d24922-0bcc-4e77-9ad0-ec08bd6bbe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:05.728694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d24922-0bcc-4e77-9ad0-ec08bd6bbe6c admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:05.728982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d24922-0bcc-4e77-9ad0-ec08bd6bbe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:05.729260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d24922-0bcc-4e77-9ad0-ec08bd6bbe6c admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:05.729952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d24922-0bcc-4e77-9ad0-ec08bd6bbe6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:05.731921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d24922-0bcc-4e77-9ad0-ec08bd6bbe6c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:05.760696 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4309/8580] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:42:05 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:42:05.764789 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850cd7f-5c46-4305-9b4a-ddde04ee0687 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:05.775433 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850cd7f-5c46-4305-9b4a-ddde04ee0687 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:05.804269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:05.840374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e57fb1-e80e-4a26-8770-275a4c7440df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:05.841040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e57fb1-e80e-4a26-8770-275a4c7440df admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:05.841324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e57fb1-e80e-4a26-8770-275a4c7440df admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:05.841599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e57fb1-e80e-4a26-8770-275a4c7440df admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:05.842301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e57fb1-e80e-4a26-8770-275a4c7440df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:05.844385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e57fb1-e80e-4a26-8770-275a4c7440df admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:05.866829 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4272/8581] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:42:05 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:42:05.871191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d24922-0bcc-4e77-9ad0-ec08bd6bbe6c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:05.882020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d24922-0bcc-4e77-9ad0-ec08bd6bbe6c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:05.887477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dfe2f-2322-4fc8-aa09-fdec37dfcb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:05.888174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dfe2f-2322-4fc8-aa09-fdec37dfcb70 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:05.888457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dfe2f-2322-4fc8-aa09-fdec37dfcb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:05.888764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dfe2f-2322-4fc8-aa09-fdec37dfcb70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:05.889498 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dfe2f-2322-4fc8-aa09-fdec37dfcb70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:05.891112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dfe2f-2322-4fc8-aa09-fdec37dfcb70 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:05.901963 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4310/8582] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:42:05.906217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e57fb1-e80e-4a26-8770-275a4c7440df admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:05.916440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e57fb1-e80e-4a26-8770-275a4c7440df admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:05.921472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa28a2d-bc1d-47b9-9554-f93628b0e149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:05.922190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa28a2d-bc1d-47b9-9554-f93628b0e149 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:05.922470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa28a2d-bc1d-47b9-9554-f93628b0e149 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:05.922748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa28a2d-bc1d-47b9-9554-f93628b0e149 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:05.923504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa28a2d-bc1d-47b9-9554-f93628b0e149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:05.925159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa28a2d-bc1d-47b9-9554-f93628b0e149 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:05.936152 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4273/8583] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:42:05.940703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dfe2f-2322-4fc8-aa09-fdec37dfcb70 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:05.953037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dfe2f-2322-4fc8-aa09-fdec37dfcb70 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:05.958765 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56daec2-bf30-442a-ab49-2b8f4188c3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:05.959664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56daec2-bf30-442a-ab49-2b8f4188c3d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:05.959949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56daec2-bf30-442a-ab49-2b8f4188c3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:05.960263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56daec2-bf30-442a-ab49-2b8f4188c3d9 admin admin] PATH_INFO: `/v3/projects/75097c361e094fe88f84a9d03313f5da/users/f502b1b9ff834aa1a2e7b7c82a65f958/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:05.976815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56daec2-bf30-442a-ab49-2b8f4188c3d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75097c361e094fe88f84a9d03313f5da, user_id=f502b1b9ff834aa1a2e7b7c82a65f958, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:05.979531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56daec2-bf30-442a-ab49-2b8f4188c3d9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:05.993424 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4311/8584] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:42:05 2022] PUT /identity/v3/projects/75097c361e094fe88f84a9d03313f5da/users/f502b1b9ff834aa1a2e7b7c82a65f958/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:06.005169 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbf803-40ad-47ef-a84f-c92042410867 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:06.005460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbf803-40ad-47ef-a84f-c92042410867 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:06.005762 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbf803-40ad-47ef-a84f-c92042410867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:06.034915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-48bbf803-40ad-47ef-a84f-c92042410867 None None] MFA Rules not processed for user `f502b1b9ff834aa1a2e7b7c82a65f958`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:06.036108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-48bbf803-40ad-47ef-a84f-c92042410867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:06.106807 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4274/8585] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:06.119319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56daec2-bf30-442a-ab49-2b8f4188c3d9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:06.121353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b56daec2-bf30-442a-ab49-2b8f4188c3d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:06.183057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56daec2-bf30-442a-ab49-2b8f4188c3d9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:06.187239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284d3a1-bff6-4846-9cc4-b43163f0161e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:06.187877 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284d3a1-bff6-4846-9cc4-b43163f0161e service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:06.188368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284d3a1-bff6-4846-9cc4-b43163f0161e service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:06.188651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284d3a1-bff6-4846-9cc4-b43163f0161e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:06.197505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284d3a1-bff6-4846-9cc4-b43163f0161e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:06.198947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284d3a1-bff6-4846-9cc4-b43163f0161e service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:06.208032 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4312/8586] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:42:06 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:42:09.322397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbf803-40ad-47ef-a84f-c92042410867 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:09.388924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbf803-40ad-47ef-a84f-c92042410867 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:09.395632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7e465-d27b-4907-baf8-deff2970d93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:09.397017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7e465-d27b-4907-baf8-deff2970d93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:09.397349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7e465-d27b-4907-baf8-deff2970d93f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:09.397711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7e465-d27b-4907-baf8-deff2970d93f admin admin] PATH_INFO: `/v3/users/f502b1b9ff834aa1a2e7b7c82a65f958` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:09.399648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7e465-d27b-4907-baf8-deff2970d93f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f502b1b9ff834aa1a2e7b7c82a65f958)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:09.402556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7e465-d27b-4907-baf8-deff2970d93f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:09.449392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:09.456108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ace7e465-d27b-4907-baf8-deff2970d93f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f502b1b9ff834aa1a2e7b7c82a65f958'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:09.464222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ace7e465-d27b-4907-baf8-deff2970d93f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f502b1b9ff834aa1a2e7b7c82a65f958'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:09.471365 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ace7e465-d27b-4907-baf8-deff2970d93f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f502b1b9ff834aa1a2e7b7c82a65f958'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:09.472017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ace7e465-d27b-4907-baf8-deff2970d93f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f502b1b9ff834aa1a2e7b7c82a65f958'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:09.472655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ace7e465-d27b-4907-baf8-deff2970d93f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f502b1b9ff834aa1a2e7b7c82a65f958'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:09.490862 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4275/8587] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:42:09 2022] DELETE /identity/v3/users/f502b1b9ff834aa1a2e7b7c82a65f958 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:09.495578 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78377dcc-034b-48aa-b8e8-ebdf9cc4e08d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:09.496101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78377dcc-034b-48aa-b8e8-ebdf9cc4e08d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:09.496215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78377dcc-034b-48aa-b8e8-ebdf9cc4e08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:09.514003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-78377dcc-034b-48aa-b8e8-ebdf9cc4e08d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:09.515223 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-78377dcc-034b-48aa-b8e8-ebdf9cc4e08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:09.579118 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4313/8588] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:42:09.593021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7e465-d27b-4907-baf8-deff2970d93f admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:09.594671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ace7e465-d27b-4907-baf8-deff2970d93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:09.660231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7e465-d27b-4907-baf8-deff2970d93f admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:09.664227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5712e7-e5fb-434f-8555-9a85ee241142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:09.664907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5712e7-e5fb-434f-8555-9a85ee241142 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:09.665190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5712e7-e5fb-434f-8555-9a85ee241142 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:09.665468 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5712e7-e5fb-434f-8555-9a85ee241142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:09.675244 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5712e7-e5fb-434f-8555-9a85ee241142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:09.676747 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5712e7-e5fb-434f-8555-9a85ee241142 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:09.686355 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4276/8589] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:42:09.979385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78377dcc-034b-48aa-b8e8-ebdf9cc4e08d None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:09.980992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-78377dcc-034b-48aa-b8e8-ebdf9cc4e08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:09.993496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78377dcc-034b-48aa-b8e8-ebdf9cc4e08d None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:09.998158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb09909-7eda-403c-b51e-31b4242dc323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:09.999077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb09909-7eda-403c-b51e-31b4242dc323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:09.999367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb09909-7eda-403c-b51e-31b4242dc323 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:09.999643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb09909-7eda-403c-b51e-31b4242dc323 admin admin] PATH_INFO: `/v3/projects/75097c361e094fe88f84a9d03313f5da` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:10.001193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb09909-7eda-403c-b51e-31b4242dc323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75097c361e094fe88f84a9d03313f5da)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:10.002825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb09909-7eda-403c-b51e-31b4242dc323 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:10.042545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:10.054051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0cb09909-7eda-403c-b51e-31b4242dc323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75097c361e094fe88f84a9d03313f5da', 'request_id': 'req-0cb09909-7eda-403c-b51e-31b4242dc323'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:10.061699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0cb09909-7eda-403c-b51e-31b4242dc323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75097c361e094fe88f84a9d03313f5da', 'request_id': 'req-0cb09909-7eda-403c-b51e-31b4242dc323'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:10.072377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0cb09909-7eda-403c-b51e-31b4242dc323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75097c361e094fe88f84a9d03313f5da', 'request_id': 'req-0cb09909-7eda-403c-b51e-31b4242dc323'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:10.084446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0cb09909-7eda-403c-b51e-31b4242dc323 admin admin] The token cache is being invalidate because project 75097c361e094fe88f84a9d03313f5da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:42:10.084737 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0cb09909-7eda-403c-b51e-31b4242dc323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:10.085491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-0cb09909-7eda-403c-b51e-31b4242dc323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:10.087189 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4314/8590] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:42:09 2022] DELETE /identity/v3/projects/75097c361e094fe88f84a9d03313f5da => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:10.092345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeb051-4f96-4979-877a-f47e6626d2b9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:10.092638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeb051-4f96-4979-877a-f47e6626d2b9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:10.092927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeb051-4f96-4979-877a-f47e6626d2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:10.111953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-52eeb051-4f96-4979-877a-f47e6626d2b9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:10.113224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-52eeb051-4f96-4979-877a-f47e6626d2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:10.184642 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4277/8591] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:10.192740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd45ab4-5784-413a-9ad3-af1c8ff6ae2c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:10.193060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd45ab4-5784-413a-9ad3-af1c8ff6ae2c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:10.193317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd45ab4-5784-413a-9ad3-af1c8ff6ae2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:10.214833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4dd45ab4-5784-413a-9ad3-af1c8ff6ae2c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:10.216077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4dd45ab4-5784-413a-9ad3-af1c8ff6ae2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:10.226015 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4315/8592] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:10.230960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eeb051-4f96-4979-877a-f47e6626d2b9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:10.244469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eeb051-4f96-4979-877a-f47e6626d2b9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:10.252190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102f58b-29d1-41d7-b0fc-9410b040b1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:10.252857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102f58b-29d1-41d7-b0fc-9410b040b1dc admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:10.253158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102f58b-29d1-41d7-b0fc-9410b040b1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:10.253460 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102f58b-29d1-41d7-b0fc-9410b040b1dc admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:10.254211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102f58b-29d1-41d7-b0fc-9410b040b1dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:42:10.254520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102f58b-29d1-41d7-b0fc-9410b040b1dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:10.256221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102f58b-29d1-41d7-b0fc-9410b040b1dc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:10.269980 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4278/8593] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:42:10.274554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd45ab4-5784-413a-9ad3-af1c8ff6ae2c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:10.284769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd45ab4-5784-413a-9ad3-af1c8ff6ae2c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:10.291483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b10d69-41de-4074-9611-198c20514733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:10.292182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b10d69-41de-4074-9611-198c20514733 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:10.292484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b10d69-41de-4074-9611-198c20514733 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:10.292835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b10d69-41de-4074-9611-198c20514733 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:10.293471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b10d69-41de-4074-9611-198c20514733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:10.295772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b10d69-41de-4074-9611-198c20514733 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:10.328432 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4316/8594] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:42:10 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:42:10.333832 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102f58b-29d1-41d7-b0fc-9410b040b1dc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:10.349769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102f58b-29d1-41d7-b0fc-9410b040b1dc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:10.396402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:10.411343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d5eb4-09bb-48b0-95b3-59dfcf345dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:10.412024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d5eb4-09bb-48b0-95b3-59dfcf345dfd admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:10.412346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d5eb4-09bb-48b0-95b3-59dfcf345dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:10.412628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d5eb4-09bb-48b0-95b3-59dfcf345dfd admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:10.413333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d5eb4-09bb-48b0-95b3-59dfcf345dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:10.415306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d5eb4-09bb-48b0-95b3-59dfcf345dfd admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:10.437262 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4279/8595] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:42:10 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:42:10.441491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b10d69-41de-4074-9611-198c20514733 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:10.452480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b10d69-41de-4074-9611-198c20514733 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:10.457543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccce57a-39da-49ab-9d0d-27e228d39c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:10.458209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccce57a-39da-49ab-9d0d-27e228d39c62 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:10.458495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccce57a-39da-49ab-9d0d-27e228d39c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:10.458776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccce57a-39da-49ab-9d0d-27e228d39c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:10.459669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccce57a-39da-49ab-9d0d-27e228d39c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:10.461326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccce57a-39da-49ab-9d0d-27e228d39c62 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:10.472009 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4317/8596] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:42:10.475904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d5eb4-09bb-48b0-95b3-59dfcf345dfd admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:10.486162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d5eb4-09bb-48b0-95b3-59dfcf345dfd admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:10.491344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa046e00-6674-497a-97f2-f487200799b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:10.491989 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa046e00-6674-497a-97f2-f487200799b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:10.492299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa046e00-6674-497a-97f2-f487200799b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:10.492570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa046e00-6674-497a-97f2-f487200799b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:10.493283 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa046e00-6674-497a-97f2-f487200799b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:10.495121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa046e00-6674-497a-97f2-f487200799b8 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:10.505362 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4280/8597] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:42:10.509582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccce57a-39da-49ab-9d0d-27e228d39c62 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:10.520524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccce57a-39da-49ab-9d0d-27e228d39c62 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:10.526261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126440d-ddef-45a8-96ac-6804ad7abe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:10.527182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126440d-ddef-45a8-96ac-6804ad7abe8f admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:10.527449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126440d-ddef-45a8-96ac-6804ad7abe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:10.527740 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126440d-ddef-45a8-96ac-6804ad7abe8f admin admin] PATH_INFO: `/v3/projects/edb2a5910eb04623bb47ab18226f51d2/users/bd6d8214cf274e198771f8c5f9c6dc6d/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:10.543149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126440d-ddef-45a8-96ac-6804ad7abe8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb2a5910eb04623bb47ab18226f51d2, user_id=bd6d8214cf274e198771f8c5f9c6dc6d, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:10.546215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126440d-ddef-45a8-96ac-6804ad7abe8f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:10.560696 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4318/8598] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:42:10 2022] PUT /identity/v3/projects/edb2a5910eb04623bb47ab18226f51d2/users/bd6d8214cf274e198771f8c5f9c6dc6d/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:10.567926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734756d-41c9-4422-9070-61b53f652a46 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:10.568245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734756d-41c9-4422-9070-61b53f652a46 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:10.568530 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734756d-41c9-4422-9070-61b53f652a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:10.587175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-7734756d-41c9-4422-9070-61b53f652a46 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:10.588452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7734756d-41c9-4422-9070-61b53f652a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:10.657277 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4281/8599] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:10.667217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126440d-ddef-45a8-96ac-6804ad7abe8f admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:10.669415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f126440d-ddef-45a8-96ac-6804ad7abe8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:10.737447 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126440d-ddef-45a8-96ac-6804ad7abe8f admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:10.741534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e44ba-ff00-457e-9840-71545e5b848d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:10.742179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e44ba-ff00-457e-9840-71545e5b848d service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:10.742467 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e44ba-ff00-457e-9840-71545e5b848d service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:10.742867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e44ba-ff00-457e-9840-71545e5b848d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:10.752814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e44ba-ff00-457e-9840-71545e5b848d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:10.758617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e44ba-ff00-457e-9840-71545e5b848d service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:10.769327 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4319/8600] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:42:11.419076 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84478c4-5c7a-4973-a79a-801c818d89f3 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:11.419635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84478c4-5c7a-4973-a79a-801c818d89f3 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:11.419736 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84478c4-5c7a-4973-a79a-801c818d89f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:11.447356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d84478c4-5c7a-4973-a79a-801c818d89f3 None None] MFA Rules not processed for user `bd6d8214cf274e198771f8c5f9c6dc6d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:11.448673 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d84478c4-5c7a-4973-a79a-801c818d89f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:11.514884 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4282/8601] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:11.519732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e44ba-ff00-457e-9840-71545e5b848d service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:11.529879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e44ba-ff00-457e-9840-71545e5b848d service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:11.534926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a89462-6c1f-4fe6-b4a1-ded95a26b8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:11.535583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a89462-6c1f-4fe6-b4a1-ded95a26b8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:11.535867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a89462-6c1f-4fe6-b4a1-ded95a26b8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:11.536212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a89462-6c1f-4fe6-b4a1-ded95a26b8a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:11.536918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a89462-6c1f-4fe6-b4a1-ded95a26b8a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:11.538856 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a89462-6c1f-4fe6-b4a1-ded95a26b8a5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:11.567147 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4320/8602] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:42:11 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:42:11.571215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84478c4-5c7a-4973-a79a-801c818d89f3 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:11.582317 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84478c4-5c7a-4973-a79a-801c818d89f3 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:11.639200 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:11.648108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2baf3e8-8f87-4f5f-8ca3-7f04157f7f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:11.648823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2baf3e8-8f87-4f5f-8ca3-7f04157f7f3a admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:11.649108 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2baf3e8-8f87-4f5f-8ca3-7f04157f7f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:11.649392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2baf3e8-8f87-4f5f-8ca3-7f04157f7f3a admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:11.650084 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2baf3e8-8f87-4f5f-8ca3-7f04157f7f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:11.652066 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2baf3e8-8f87-4f5f-8ca3-7f04157f7f3a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:11.674807 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4283/8603] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:42:11 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:42:11.678216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a89462-6c1f-4fe6-b4a1-ded95a26b8a5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:11.688917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a89462-6c1f-4fe6-b4a1-ded95a26b8a5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:11.694391 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8aaf2-c9fa-48b1-98c2-8f72a8b130e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:11.695048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8aaf2-c9fa-48b1-98c2-8f72a8b130e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:11.695327 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8aaf2-c9fa-48b1-98c2-8f72a8b130e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:11.695600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8aaf2-c9fa-48b1-98c2-8f72a8b130e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:11.696352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8aaf2-c9fa-48b1-98c2-8f72a8b130e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:11.697952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8aaf2-c9fa-48b1-98c2-8f72a8b130e9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:11.710335 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4321/8604] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:42:11.714703 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2baf3e8-8f87-4f5f-8ca3-7f04157f7f3a admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:11.725085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2baf3e8-8f87-4f5f-8ca3-7f04157f7f3a admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:11.730226 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70418457-48e4-4f81-8bab-0d5842a2e820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:11.731137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70418457-48e4-4f81-8bab-0d5842a2e820 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:11.731413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70418457-48e4-4f81-8bab-0d5842a2e820 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:11.731688 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70418457-48e4-4f81-8bab-0d5842a2e820 admin admin] PATH_INFO: `/v3/projects/30ba2837c1d842758dd71c43341dbb80/users/072aaaef211e45eaab91d5565f321b2b/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:11.748227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70418457-48e4-4f81-8bab-0d5842a2e820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ba2837c1d842758dd71c43341dbb80, user_id=072aaaef211e45eaab91d5565f321b2b, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:11.750923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70418457-48e4-4f81-8bab-0d5842a2e820 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:11.765754 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4284/8605] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:42:11 2022] PUT /identity/v3/projects/30ba2837c1d842758dd71c43341dbb80/users/072aaaef211e45eaab91d5565f321b2b/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:11.770339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8aaf2-c9fa-48b1-98c2-8f72a8b130e9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:11.784763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8aaf2-c9fa-48b1-98c2-8f72a8b130e9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:11.815023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:11.844586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fd011-3be2-4a56-8f7f-d7d891a5432a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:11.845284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fd011-3be2-4a56-8f7f-d7d891a5432a admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:11.845561 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fd011-3be2-4a56-8f7f-d7d891a5432a admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:11.845837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fd011-3be2-4a56-8f7f-d7d891a5432a admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:11.846514 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fd011-3be2-4a56-8f7f-d7d891a5432a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:11.848178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fd011-3be2-4a56-8f7f-d7d891a5432a admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:11.858095 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4322/8606] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:42:11.862695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70418457-48e4-4f81-8bab-0d5842a2e820 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:11.875318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70418457-48e4-4f81-8bab-0d5842a2e820 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:11.880727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f81683-39e5-4917-b1ed-3650c2cad0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:11.881671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f81683-39e5-4917-b1ed-3650c2cad0c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:11.881949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f81683-39e5-4917-b1ed-3650c2cad0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:11.882221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f81683-39e5-4917-b1ed-3650c2cad0c2 admin admin] PATH_INFO: `/v3/projects/30ba2837c1d842758dd71c43341dbb80/users/072aaaef211e45eaab91d5565f321b2b/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:11.884344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f81683-39e5-4917-b1ed-3650c2cad0c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ba2837c1d842758dd71c43341dbb80, user_id=072aaaef211e45eaab91d5565f321b2b, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:11.886978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f81683-39e5-4917-b1ed-3650c2cad0c2 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:11.900370 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4285/8607] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:42:11 2022] PUT /identity/v3/projects/30ba2837c1d842758dd71c43341dbb80/users/072aaaef211e45eaab91d5565f321b2b/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:12.556686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806aa6c-4738-4ccd-acf2-f5abb2b0f4b8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:12.557232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806aa6c-4738-4ccd-acf2-f5abb2b0f4b8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:12.557232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806aa6c-4738-4ccd-acf2-f5abb2b0f4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:12.586750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3806aa6c-4738-4ccd-acf2-f5abb2b0f4b8 None None] MFA Rules not processed for user `072aaaef211e45eaab91d5565f321b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:12.588165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3806aa6c-4738-4ccd-acf2-f5abb2b0f4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:12.675076 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4323/8608] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:12.677026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfad9c2-d292-4179-839f-45d89f80fc51 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:12.677501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfad9c2-d292-4179-839f-45d89f80fc51 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:12.677501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfad9c2-d292-4179-839f-45d89f80fc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:12.697413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-fdfad9c2-d292-4179-839f-45d89f80fc51 None None] MFA Rules not processed for user `bd6d8214cf274e198771f8c5f9c6dc6d`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:12.699100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fdfad9c2-d292-4179-839f-45d89f80fc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:12.757472 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4286/8609] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:12.773918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806aa6c-4738-4ccd-acf2-f5abb2b0f4b8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:12.775806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3806aa6c-4738-4ccd-acf2-f5abb2b0f4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:12.886487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806aa6c-4738-4ccd-acf2-f5abb2b0f4b8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:12.893247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f0da6-c209-4f8e-baeb-aaac98b42923 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:12.893894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f0da6-c209-4f8e-baeb-aaac98b42923 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:12.894171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f0da6-c209-4f8e-baeb-aaac98b42923 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:12.894440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f0da6-c209-4f8e-baeb-aaac98b42923 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:12.902753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f0da6-c209-4f8e-baeb-aaac98b42923 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:12.904386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f0da6-c209-4f8e-baeb-aaac98b42923 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:12.913369 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4324/8610] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:42:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:42:12.946416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfad9c2-d292-4179-839f-45d89f80fc51 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:12.947952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-fdfad9c2-d292-4179-839f-45d89f80fc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:13.006726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfad9c2-d292-4179-839f-45d89f80fc51 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:13.010540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d78a0-01b5-46df-ad9c-491af687ffa0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:13.011180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d78a0-01b5-46df-ad9c-491af687ffa0 service glance] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:13.011496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d78a0-01b5-46df-ad9c-491af687ffa0 service glance] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:13.011769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d78a0-01b5-46df-ad9c-491af687ffa0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:13.013681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-633d78a0-01b5-46df-ad9c-491af687ffa0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:13.030065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d78a0-01b5-46df-ad9c-491af687ffa0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:13.031558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d78a0-01b5-46df-ad9c-491af687ffa0 service glance] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:13.045688 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4287/8611] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:42:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:42:13.323502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f0da6-c209-4f8e-baeb-aaac98b42923 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:13.325055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b18f0da6-c209-4f8e-baeb-aaac98b42923 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:13.351034 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:13.396475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f0da6-c209-4f8e-baeb-aaac98b42923 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:13.400501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f336e2-c389-4342-8894-b746eac03b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:13.401153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f336e2-c389-4342-8894-b746eac03b77 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:13.401441 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f336e2-c389-4342-8894-b746eac03b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:13.401722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f336e2-c389-4342-8894-b746eac03b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:13.403813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-63f336e2-c389-4342-8894-b746eac03b77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:13.416493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f336e2-c389-4342-8894-b746eac03b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:13.417941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f336e2-c389-4342-8894-b746eac03b77 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:13.428965 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4325/8612] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:42:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:42:13.772287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d78a0-01b5-46df-ad9c-491af687ffa0 service glance] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:13.784694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d78a0-01b5-46df-ad9c-491af687ffa0 service glance] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:13.788662 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7fa13-d378-48ef-9d81-5224913d96fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:13.789332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7fa13-d378-48ef-9d81-5224913d96fc service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:13.789611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7fa13-d378-48ef-9d81-5224913d96fc service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:13.789886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7fa13-d378-48ef-9d81-5224913d96fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:13.791796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e5d7fa13-d378-48ef-9d81-5224913d96fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:13.808866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7fa13-d378-48ef-9d81-5224913d96fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:13.810299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7fa13-d378-48ef-9d81-5224913d96fc service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:13.823841 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4288/8613] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:42:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:42:20.294629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f336e2-c389-4342-8894-b746eac03b77 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:20.296593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-63f336e2-c389-4342-8894-b746eac03b77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:20.317301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f336e2-c389-4342-8894-b746eac03b77 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:20.323235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e78f15-3bd9-4831-a4da-ddcb083a51ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:20.323917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e78f15-3bd9-4831-a4da-ddcb083a51ff service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:20.324233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e78f15-3bd9-4831-a4da-ddcb083a51ff service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:20.324518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e78f15-3bd9-4831-a4da-ddcb083a51ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:20.326333 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b7e78f15-3bd9-4831-a4da-ddcb083a51ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:20.343189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e78f15-3bd9-4831-a4da-ddcb083a51ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:20.344875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e78f15-3bd9-4831-a4da-ddcb083a51ff service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:20.359526 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4326/8614] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:42:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:42:23.816755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=76,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:30.353705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=23 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:39.927577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7fa13-d378-48ef-9d81-5224913d96fc service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:39.994616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7fa13-d378-48ef-9d81-5224913d96fc service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:39.999713 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6a09f-dc54-4fbf-b68e-6d30ce3bcdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:40.000694 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6a09f-dc54-4fbf-b68e-6d30ce3bcdd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:40.000958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6a09f-dc54-4fbf-b68e-6d30ce3bcdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:40.001256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6a09f-dc54-4fbf-b68e-6d30ce3bcdd9 admin admin] PATH_INFO: `/v3/users/bd6d8214cf274e198771f8c5f9c6dc6d` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:40.002473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6a09f-dc54-4fbf-b68e-6d30ce3bcdd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd6d8214cf274e198771f8c5f9c6dc6d)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:40.004518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6a09f-dc54-4fbf-b68e-6d30ce3bcdd9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:40.053362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1fd6a09f-dc54-4fbf-b68e-6d30ce3bcdd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd6d8214cf274e198771f8c5f9c6dc6d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.062374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1fd6a09f-dc54-4fbf-b68e-6d30ce3bcdd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd6d8214cf274e198771f8c5f9c6dc6d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.069457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1fd6a09f-dc54-4fbf-b68e-6d30ce3bcdd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd6d8214cf274e198771f8c5f9c6dc6d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.070115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1fd6a09f-dc54-4fbf-b68e-6d30ce3bcdd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd6d8214cf274e198771f8c5f9c6dc6d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.070749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-1fd6a09f-dc54-4fbf-b68e-6d30ce3bcdd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd6d8214cf274e198771f8c5f9c6dc6d'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.091524 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4289/8615] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:42:39 2022] DELETE /identity/v3/users/bd6d8214cf274e198771f8c5f9c6dc6d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:40.277644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e78f15-3bd9-4831-a4da-ddcb083a51ff service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:40.291205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e78f15-3bd9-4831-a4da-ddcb083a51ff service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:40.351159 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d60f-d33e-42ea-9c7e-9077732b5368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:40.352135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d60f-d33e-42ea-9c7e-9077732b5368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:40.352381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d60f-d33e-42ea-9c7e-9077732b5368 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:40.352653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d60f-d33e-42ea-9c7e-9077732b5368 admin admin] PATH_INFO: `/v3/projects/edb2a5910eb04623bb47ab18226f51d2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:40.353869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d60f-d33e-42ea-9c7e-9077732b5368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edb2a5910eb04623bb47ab18226f51d2)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:40.355787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d60f-d33e-42ea-9c7e-9077732b5368 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:40.405834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2a43d60f-d33e-42ea-9c7e-9077732b5368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edb2a5910eb04623bb47ab18226f51d2', 'request_id': 'req-2a43d60f-d33e-42ea-9c7e-9077732b5368'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.414585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2a43d60f-d33e-42ea-9c7e-9077732b5368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edb2a5910eb04623bb47ab18226f51d2', 'request_id': 'req-2a43d60f-d33e-42ea-9c7e-9077732b5368'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.421512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2a43d60f-d33e-42ea-9c7e-9077732b5368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edb2a5910eb04623bb47ab18226f51d2', 'request_id': 'req-2a43d60f-d33e-42ea-9c7e-9077732b5368'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.431885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2a43d60f-d33e-42ea-9c7e-9077732b5368 admin admin] The token cache is being invalidate because project edb2a5910eb04623bb47ab18226f51d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:42:40.432214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2a43d60f-d33e-42ea-9c7e-9077732b5368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.432890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-2a43d60f-d33e-42ea-9c7e-9077732b5368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.434501 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4327/8616] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:42:40 2022] DELETE /identity/v3/projects/edb2a5910eb04623bb47ab18226f51d2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:40.438981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6a09f-dc54-4fbf-b68e-6d30ce3bcdd9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:40.440556 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1fd6a09f-dc54-4fbf-b68e-6d30ce3bcdd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:40.455306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6a09f-dc54-4fbf-b68e-6d30ce3bcdd9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:40.515516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7c440-d2d8-489f-be4b-90e5224f0cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:40.516426 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7c440-d2d8-489f-be4b-90e5224f0cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:40.516724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7c440-d2d8-489f-be4b-90e5224f0cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:40.516997 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7c440-d2d8-489f-be4b-90e5224f0cfa admin admin] PATH_INFO: `/v3/users/072aaaef211e45eaab91d5565f321b2b` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:40.518213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7c440-d2d8-489f-be4b-90e5224f0cfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=072aaaef211e45eaab91d5565f321b2b)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:40.520217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7c440-d2d8-489f-be4b-90e5224f0cfa admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:40.545914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:40.579097 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbd7c440-d2d8-489f-be4b-90e5224f0cfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '072aaaef211e45eaab91d5565f321b2b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.588151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbd7c440-d2d8-489f-be4b-90e5224f0cfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '072aaaef211e45eaab91d5565f321b2b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.595548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbd7c440-d2d8-489f-be4b-90e5224f0cfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '072aaaef211e45eaab91d5565f321b2b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.596224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbd7c440-d2d8-489f-be4b-90e5224f0cfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '072aaaef211e45eaab91d5565f321b2b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.596837 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-fbd7c440-d2d8-489f-be4b-90e5224f0cfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '072aaaef211e45eaab91d5565f321b2b'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.614244 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4290/8617] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:42:40 2022] DELETE /identity/v3/users/072aaaef211e45eaab91d5565f321b2b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:42:40.794927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d60f-d33e-42ea-9c7e-9077732b5368 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:40.796476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2a43d60f-d33e-42ea-9c7e-9077732b5368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:40.814795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d60f-d33e-42ea-9c7e-9077732b5368 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:40.872633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8878ef5-1a14-4362-b6a6-1990f1e6a0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:40.873503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8878ef5-1a14-4362-b6a6-1990f1e6a0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:40.873814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8878ef5-1a14-4362-b6a6-1990f1e6a0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:40.874095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8878ef5-1a14-4362-b6a6-1990f1e6a0cc admin admin] PATH_INFO: `/v3/projects/30ba2837c1d842758dd71c43341dbb80` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:40.875326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8878ef5-1a14-4362-b6a6-1990f1e6a0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ba2837c1d842758dd71c43341dbb80)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:40.877293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8878ef5-1a14-4362-b6a6-1990f1e6a0cc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:40.915546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:40.932178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c8878ef5-1a14-4362-b6a6-1990f1e6a0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ba2837c1d842758dd71c43341dbb80', 'request_id': 'req-c8878ef5-1a14-4362-b6a6-1990f1e6a0cc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.940852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c8878ef5-1a14-4362-b6a6-1990f1e6a0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ba2837c1d842758dd71c43341dbb80', 'request_id': 'req-c8878ef5-1a14-4362-b6a6-1990f1e6a0cc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.947642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c8878ef5-1a14-4362-b6a6-1990f1e6a0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ba2837c1d842758dd71c43341dbb80', 'request_id': 'req-c8878ef5-1a14-4362-b6a6-1990f1e6a0cc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.960117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c8878ef5-1a14-4362-b6a6-1990f1e6a0cc admin admin] The token cache is being invalidate because project 30ba2837c1d842758dd71c43341dbb80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:42:40.960431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c8878ef5-1a14-4362-b6a6-1990f1e6a0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.961173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c8878ef5-1a14-4362-b6a6-1990f1e6a0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:40.963444 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4328/8618] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:42:40 2022] DELETE /identity/v3/projects/30ba2837c1d842758dd71c43341dbb80 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:40.971004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edde9f6-3efd-4564-936a-714147bde5ed None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:40.971518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edde9f6-3efd-4564-936a-714147bde5ed None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:40.971628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edde9f6-3efd-4564-936a-714147bde5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:40.995982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8edde9f6-3efd-4564-936a-714147bde5ed None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:40.997229 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8edde9f6-3efd-4564-936a-714147bde5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:41.063230 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4291/8619] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:41.071904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dafc43-6640-4b98-b131-dbf48b96b3ea None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:41.072225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dafc43-6640-4b98-b131-dbf48b96b3ea None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:41.072505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dafc43-6640-4b98-b131-dbf48b96b3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:41.091435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a1dafc43-6640-4b98-b131-dbf48b96b3ea None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:41.092686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a1dafc43-6640-4b98-b131-dbf48b96b3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:41.101550 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4329/8620] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:41.106073 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edde9f6-3efd-4564-936a-714147bde5ed None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:41.116336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edde9f6-3efd-4564-936a-714147bde5ed None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:41.121483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a705b-1174-4042-8d09-3d8f40583bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:41.122143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a705b-1174-4042-8d09-3d8f40583bde admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:41.122427 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a705b-1174-4042-8d09-3d8f40583bde admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:41.122754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a705b-1174-4042-8d09-3d8f40583bde admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:41.123485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a705b-1174-4042-8d09-3d8f40583bde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:42:41.123782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a705b-1174-4042-8d09-3d8f40583bde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:41.125475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a705b-1174-4042-8d09-3d8f40583bde admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:41.137375 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4292/8621] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:42:41.141752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dafc43-6640-4b98-b131-dbf48b96b3ea None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:41.151366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dafc43-6640-4b98-b131-dbf48b96b3ea None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:41.156837 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae8b8a-4d6d-4d7e-931c-59c933921f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:41.157491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae8b8a-4d6d-4d7e-931c-59c933921f89 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:41.157799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae8b8a-4d6d-4d7e-931c-59c933921f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:41.158066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae8b8a-4d6d-4d7e-931c-59c933921f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:41.158761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae8b8a-4d6d-4d7e-931c-59c933921f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:41.160699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae8b8a-4d6d-4d7e-931c-59c933921f89 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:41.194129 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4330/8622] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:42:41 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:42:41.194914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a705b-1174-4042-8d09-3d8f40583bde admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:41.205322 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a705b-1174-4042-8d09-3d8f40583bde admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:41.264374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4e9e2-9bb2-44b5-81dc-6ed60daaf601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:41.265081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4e9e2-9bb2-44b5-81dc-6ed60daaf601 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:41.265362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4e9e2-9bb2-44b5-81dc-6ed60daaf601 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:41.265638 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4e9e2-9bb2-44b5-81dc-6ed60daaf601 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:41.266319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4e9e2-9bb2-44b5-81dc-6ed60daaf601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:41.268314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4e9e2-9bb2-44b5-81dc-6ed60daaf601 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:41.289812 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4293/8623] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:42:41 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:42:41.294028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae8b8a-4d6d-4d7e-931c-59c933921f89 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:41.304908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae8b8a-4d6d-4d7e-931c-59c933921f89 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:41.309637 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e07eb-8cf5-4a6c-b345-040a172b33b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:41.310295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e07eb-8cf5-4a6c-b345-040a172b33b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:41.310574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e07eb-8cf5-4a6c-b345-040a172b33b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:41.310847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e07eb-8cf5-4a6c-b345-040a172b33b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:41.311550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e07eb-8cf5-4a6c-b345-040a172b33b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:41.313198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e07eb-8cf5-4a6c-b345-040a172b33b8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:41.324648 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4331/8624] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:42:41.328819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4e9e2-9bb2-44b5-81dc-6ed60daaf601 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:41.339248 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4e9e2-9bb2-44b5-81dc-6ed60daaf601 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:41.344208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9748e-d62d-4bd0-a9ec-8ed678d5dc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:41.344874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9748e-d62d-4bd0-a9ec-8ed678d5dc4f admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:41.345208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9748e-d62d-4bd0-a9ec-8ed678d5dc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:41.345582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9748e-d62d-4bd0-a9ec-8ed678d5dc4f admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:41.346364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9748e-d62d-4bd0-a9ec-8ed678d5dc4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:41.347957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9748e-d62d-4bd0-a9ec-8ed678d5dc4f admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:41.358212 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4294/8625] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:42:41.362694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e07eb-8cf5-4a6c-b345-040a172b33b8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:41.373147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e07eb-8cf5-4a6c-b345-040a172b33b8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:41.378237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1d52e-3d1f-4052-889b-552eb8a8c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:41.379122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1d52e-3d1f-4052-889b-552eb8a8c078 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:41.379384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1d52e-3d1f-4052-889b-552eb8a8c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:41.379660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1d52e-3d1f-4052-889b-552eb8a8c078 admin admin] PATH_INFO: `/v3/projects/a3750a23429f4c6fb0f735136f429186/users/b11f2bbd284d4cfdbc078878518dbb47/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:41.395888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1d52e-3d1f-4052-889b-552eb8a8c078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3750a23429f4c6fb0f735136f429186, user_id=b11f2bbd284d4cfdbc078878518dbb47, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:41.398585 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1d52e-3d1f-4052-889b-552eb8a8c078 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:41.414762 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4332/8626] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:42:41 2022] PUT /identity/v3/projects/a3750a23429f4c6fb0f735136f429186/users/b11f2bbd284d4cfdbc078878518dbb47/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:41.422177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e455a-ef89-4ed8-9077-4caa3c128287 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:41.422467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e455a-ef89-4ed8-9077-4caa3c128287 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:41.422743 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e455a-ef89-4ed8-9077-4caa3c128287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:41.430196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:41.442682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f66e455a-ef89-4ed8-9077-4caa3c128287 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:41.444849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f66e455a-ef89-4ed8-9077-4caa3c128287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:41.504902 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4295/8627] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:41.514917 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1d52e-3d1f-4052-889b-552eb8a8c078 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:41.517017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-52d1d52e-3d1f-4052-889b-552eb8a8c078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:41.578148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1d52e-3d1f-4052-889b-552eb8a8c078 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:41.582660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43efe33-3327-4c91-91b7-2f4bb161fce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:41.583299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43efe33-3327-4c91-91b7-2f4bb161fce0 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:41.583596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43efe33-3327-4c91-91b7-2f4bb161fce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:41.583855 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43efe33-3327-4c91-91b7-2f4bb161fce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:41.594676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43efe33-3327-4c91-91b7-2f4bb161fce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:41.596188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43efe33-3327-4c91-91b7-2f4bb161fce0 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:41.607022 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4333/8628] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:42:45.453161 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d56f22-8a87-44fe-9f9f-4823d7313a56 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:45.453645 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d56f22-8a87-44fe-9f9f-4823d7313a56 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:45.453748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d56f22-8a87-44fe-9f9f-4823d7313a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:45.481336 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-12d56f22-8a87-44fe-9f9f-4823d7313a56 None None] MFA Rules not processed for user `b11f2bbd284d4cfdbc078878518dbb47`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:45.482627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-12d56f22-8a87-44fe-9f9f-4823d7313a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:45.548998 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4296/8629] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:42:45.553777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43efe33-3327-4c91-91b7-2f4bb161fce0 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:45.563791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43efe33-3327-4c91-91b7-2f4bb161fce0 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:45.568566 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a87d17-e140-47b9-b6ba-f7bd3f3e6219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:45.569226 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a87d17-e140-47b9-b6ba-f7bd3f3e6219 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:45.569508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a87d17-e140-47b9-b6ba-f7bd3f3e6219 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:45.569784 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a87d17-e140-47b9-b6ba-f7bd3f3e6219 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:45.570520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a87d17-e140-47b9-b6ba-f7bd3f3e6219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:45.572466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a87d17-e140-47b9-b6ba-f7bd3f3e6219 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:45.596073 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4334/8630] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:42:45 2022] POST /identity/v3/users => generated 288 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:42:45.597700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d56f22-8a87-44fe-9f9f-4823d7313a56 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:45.608973 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d56f22-8a87-44fe-9f9f-4823d7313a56 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:45.614231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4959bb8-3564-410b-a2f8-6270e8349969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:45.615091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4959bb8-3564-410b-a2f8-6270e8349969 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:45.615429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4959bb8-3564-410b-a2f8-6270e8349969 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:45.615429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4959bb8-3564-410b-a2f8-6270e8349969 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:45.616594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4959bb8-3564-410b-a2f8-6270e8349969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:45.618255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4959bb8-3564-410b-a2f8-6270e8349969 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:45.632109 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4297/8631] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:42:45.633377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a87d17-e140-47b9-b6ba-f7bd3f3e6219 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:45.644055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a87d17-e140-47b9-b6ba-f7bd3f3e6219 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:45.649152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad34ed-c431-4325-af90-2826d7d37ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:45.650057 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad34ed-c431-4325-af90-2826d7d37ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:45.650367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad34ed-c431-4325-af90-2826d7d37ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:45.650689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad34ed-c431-4325-af90-2826d7d37ceb admin admin] PATH_INFO: `/v3/system/users/6e90c46f96d541d3a975c242b2602c2c/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:45.667321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad34ed-c431-4325-af90-2826d7d37ceb admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6e90c46f96d541d3a975c242b2602c2c, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:45.668406 ncdv-master-1 devstack@keystone.service[91078]: WARNING py.warnings [None req-c2ad34ed-c431-4325-af90-2826d7d37ceb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:42:45.668406 ncdv-master-1 devstack@keystone.service[91078]: warnings.warn(msg) Jul 02 21:42:45.668406 ncdv-master-1 devstack@keystone.service[91078]: Jul 02 21:42:45.669692 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad34ed-c431-4325-af90-2826d7d37ceb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:45.677719 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4335/8632] 10.222.0.43 () {60 vars in 1377 bytes} [Sat Jul 2 21:42:45 2022] PUT /identity/v3/system/users/6e90c46f96d541d3a975c242b2602c2c/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:42:45.688332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b5d36-5411-410e-ba43-aba7419d15ea None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:45.688654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b5d36-5411-410e-ba43-aba7419d15ea None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:45.688962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b5d36-5411-410e-ba43-aba7419d15ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:45.715578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-364b5d36-5411-410e-ba43-aba7419d15ea None None] MFA Rules not processed for user `6e90c46f96d541d3a975c242b2602c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:42:45.716834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-364b5d36-5411-410e-ba43-aba7419d15ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:45.792891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:45.805603 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4298/8633] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:42:45 2022] POST /identity/v3/auth/tokens => generated 2405 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 21:42:45.810285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad34ed-c431-4325-af90-2826d7d37ceb admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:45.837373 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=5,keystone:INSERT=7 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:45.941790 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad34ed-c431-4325-af90-2826d7d37ceb admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:45.980284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616caeee-5bf1-49b8-b08a-9d1aeaa57ed6 None tempest-ImageQuotaTest-1508224679-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e90c46f96d541d3a975c242b2602c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:45.980976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616caeee-5bf1-49b8-b08a-9d1aeaa57ed6 None tempest-ImageQuotaTest-1508224679-system-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:45.981259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616caeee-5bf1-49b8-b08a-9d1aeaa57ed6 None tempest-ImageQuotaTest-1508224679-system-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:45.981535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616caeee-5bf1-49b8-b08a-9d1aeaa57ed6 None tempest-ImageQuotaTest-1508224679-system-admin] PATH_INFO: `/v3/services` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:45.982225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616caeee-5bf1-49b8-b08a-9d1aeaa57ed6 None tempest-ImageQuotaTest-1508224679-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:45.983646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616caeee-5bf1-49b8-b08a-9d1aeaa57ed6 None tempest-ImageQuotaTest-1508224679-system-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:45.992924 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4336/8634] 10.222.0.43 () {58 vars in 1109 bytes} [Sat Jul 2 21:42:45 2022] GET /identity/v3/services => generated 2191 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:42:45.997465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b5d36-5411-410e-ba43-aba7419d15ea None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:46.140296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b5d36-5411-410e-ba43-aba7419d15ea None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:46.181456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8b53d-2ef9-4477-a1af-42df196732d2 None tempest-ImageQuotaTest-1508224679-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e90c46f96d541d3a975c242b2602c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:46.182241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8b53d-2ef9-4477-a1af-42df196732d2 None tempest-ImageQuotaTest-1508224679-system-admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:46.182619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8b53d-2ef9-4477-a1af-42df196732d2 None tempest-ImageQuotaTest-1508224679-system-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:46.182967 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8b53d-2ef9-4477-a1af-42df196732d2 None tempest-ImageQuotaTest-1508224679-system-admin] PATH_INFO: `/v3/limits` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:46.183773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8b53d-2ef9-4477-a1af-42df196732d2 None tempest-ImageQuotaTest-1508224679-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:46.185358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8b53d-2ef9-4477-a1af-42df196732d2 None tempest-ImageQuotaTest-1508224679-system-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:46.236799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-aeb8b53d-2ef9-4477-a1af-42df196732d2 None tempest-ImageQuotaTest-1508224679-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jul 02 21:42:46.236799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:42:46.236799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:42:46.236799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:42:46.236799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:42:46.236799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:42:46.236799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:42:46.236799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:42:46.236799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:42:46.236799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:42:46.236799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:42:46.236799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:42:46.236799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Jul 02 21:42:46.236799 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Jul 02 21:42:46.237781 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:42:46.237781 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:42:46.237781 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Jul 02 21:42:46.237781 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Jul 02 21:42:46.237781 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 02 21:42:46.237781 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 02 21:42:46.237781 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Jul 02 21:42:46.237781 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Jul 02 21:42:46.237781 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Jul 02 21:42:46.237781 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.NoLimitReference Jul 02 21:42:46.237781 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jul 02 21:42:46.237781 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:42:46.239551 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4299/8635] 10.222.0.43 () {60 vars in 1125 bytes} [Sat Jul 2 21:42:45 2022] POST /identity/v3/limits => generated 124 bytes in 242 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 02 21:42:46.245102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616caeee-5bf1-49b8-b08a-9d1aeaa57ed6 None tempest-ImageQuotaTest-1508224679-system-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:46.342128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:46.358541 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616caeee-5bf1-49b8-b08a-9d1aeaa57ed6 None tempest-ImageQuotaTest-1508224679-system-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:46.393955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47de9a4-e727-41f9-829d-5c0c1ad3d197 None tempest-ImageQuotaTest-1508224679-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e90c46f96d541d3a975c242b2602c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:46.394650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47de9a4-e727-41f9-829d-5c0c1ad3d197 None tempest-ImageQuotaTest-1508224679-system-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:46.394934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47de9a4-e727-41f9-829d-5c0c1ad3d197 None tempest-ImageQuotaTest-1508224679-system-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:46.395205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47de9a4-e727-41f9-829d-5c0c1ad3d197 None tempest-ImageQuotaTest-1508224679-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:46.395889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47de9a4-e727-41f9-829d-5c0c1ad3d197 None tempest-ImageQuotaTest-1508224679-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:46.397151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47de9a4-e727-41f9-829d-5c0c1ad3d197 None tempest-ImageQuotaTest-1508224679-system-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:46.404062 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4337/8636] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:42:46 2022] GET /identity/v3/registered_limits => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:42:46.410205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8b53d-2ef9-4477-a1af-42df196732d2 None tempest-ImageQuotaTest-1508224679-system-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:46.466507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:46.519174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8b53d-2ef9-4477-a1af-42df196732d2 None tempest-ImageQuotaTest-1508224679-system-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:46.582107 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a9766-8a43-4e08-bd60-2985d6ad92c4 None tempest-ImageQuotaTest-1508224679-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e90c46f96d541d3a975c242b2602c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:46.582824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a9766-8a43-4e08-bd60-2985d6ad92c4 None tempest-ImageQuotaTest-1508224679-system-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:46.583103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a9766-8a43-4e08-bd60-2985d6ad92c4 None tempest-ImageQuotaTest-1508224679-system-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:46.583371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a9766-8a43-4e08-bd60-2985d6ad92c4 None tempest-ImageQuotaTest-1508224679-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:46.584179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a9766-8a43-4e08-bd60-2985d6ad92c4 None tempest-ImageQuotaTest-1508224679-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:46.585265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a9766-8a43-4e08-bd60-2985d6ad92c4 None tempest-ImageQuotaTest-1508224679-system-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:46.591309 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4300/8637] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:42:46 2022] GET /identity/v3/registered_limits => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:42:49.872466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47de9a4-e727-41f9-829d-5c0c1ad3d197 None tempest-ImageQuotaTest-1508224679-system-admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:49.884121 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47de9a4-e727-41f9-829d-5c0c1ad3d197 None tempest-ImageQuotaTest-1508224679-system-admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:49.889136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828d1aa-47c1-496d-84a9-a0d751cc3839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:49.890020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828d1aa-47c1-496d-84a9-a0d751cc3839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:49.890301 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828d1aa-47c1-496d-84a9-a0d751cc3839 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:49.890581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828d1aa-47c1-496d-84a9-a0d751cc3839 admin admin] PATH_INFO: `/v3/users/b11f2bbd284d4cfdbc078878518dbb47` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:49.891844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828d1aa-47c1-496d-84a9-a0d751cc3839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b11f2bbd284d4cfdbc078878518dbb47)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:49.893825 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828d1aa-47c1-496d-84a9-a0d751cc3839 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:49.941197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c828d1aa-47c1-496d-84a9-a0d751cc3839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b11f2bbd284d4cfdbc078878518dbb47'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:49.949394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c828d1aa-47c1-496d-84a9-a0d751cc3839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b11f2bbd284d4cfdbc078878518dbb47'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:49.950570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c828d1aa-47c1-496d-84a9-a0d751cc3839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b11f2bbd284d4cfdbc078878518dbb47'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:49.951261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c828d1aa-47c1-496d-84a9-a0d751cc3839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b11f2bbd284d4cfdbc078878518dbb47'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:49.958694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-c828d1aa-47c1-496d-84a9-a0d751cc3839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b11f2bbd284d4cfdbc078878518dbb47'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:49.977525 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4338/8638] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:42:49 2022] DELETE /identity/v3/users/b11f2bbd284d4cfdbc078878518dbb47 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:50.170594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a9766-8a43-4e08-bd60-2985d6ad92c4 None tempest-ImageQuotaTest-1508224679-system-admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:50.173397 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-139a9766-8a43-4e08-bd60-2985d6ad92c4 None tempest-ImageQuotaTest-1508224679-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:50.249376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a9766-8a43-4e08-bd60-2985d6ad92c4 None tempest-ImageQuotaTest-1508224679-system-admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:50.254267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cd5cb-ed8c-4e87-9459-96fc253bf960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:50.255387 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cd5cb-ed8c-4e87-9459-96fc253bf960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:50.255711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cd5cb-ed8c-4e87-9459-96fc253bf960 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:50.256158 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cd5cb-ed8c-4e87-9459-96fc253bf960 admin admin] PATH_INFO: `/v3/projects/a3750a23429f4c6fb0f735136f429186` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:50.257488 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cd5cb-ed8c-4e87-9459-96fc253bf960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3750a23429f4c6fb0f735136f429186)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:50.259601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5cd5cb-ed8c-4e87-9459-96fc253bf960 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:50.308205 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee5cd5cb-ed8c-4e87-9459-96fc253bf960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3750a23429f4c6fb0f735136f429186', 'request_id': 'req-ee5cd5cb-ed8c-4e87-9459-96fc253bf960'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:50.314515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee5cd5cb-ed8c-4e87-9459-96fc253bf960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3750a23429f4c6fb0f735136f429186', 'request_id': 'req-ee5cd5cb-ed8c-4e87-9459-96fc253bf960'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:50.320696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee5cd5cb-ed8c-4e87-9459-96fc253bf960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3750a23429f4c6fb0f735136f429186', 'request_id': 'req-ee5cd5cb-ed8c-4e87-9459-96fc253bf960'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:50.329386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:50.336380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee5cd5cb-ed8c-4e87-9459-96fc253bf960 admin admin] The token cache is being invalidate because project a3750a23429f4c6fb0f735136f429186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:42:50.336691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee5cd5cb-ed8c-4e87-9459-96fc253bf960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:50.337459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ee5cd5cb-ed8c-4e87-9459-96fc253bf960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:50.339234 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4301/8639] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:42:50 2022] DELETE /identity/v3/projects/a3750a23429f4c6fb0f735136f429186 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:50.343718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828d1aa-47c1-496d-84a9-a0d751cc3839 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:50.354619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828d1aa-47c1-496d-84a9-a0d751cc3839 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:50.417808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92910df-2164-4358-96f3-ae3110e445fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:50.418761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92910df-2164-4358-96f3-ae3110e445fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:50.419040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92910df-2164-4358-96f3-ae3110e445fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:50.419674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92910df-2164-4358-96f3-ae3110e445fc admin admin] PATH_INFO: `/v3/users/6e90c46f96d541d3a975c242b2602c2c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:50.420970 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92910df-2164-4358-96f3-ae3110e445fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e90c46f96d541d3a975c242b2602c2c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:50.422935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92910df-2164-4358-96f3-ae3110e445fc admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:50.439162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:50.484793 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b92910df-2164-4358-96f3-ae3110e445fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e90c46f96d541d3a975c242b2602c2c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:50.492620 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b92910df-2164-4358-96f3-ae3110e445fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e90c46f96d541d3a975c242b2602c2c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:50.493516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b92910df-2164-4358-96f3-ae3110e445fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e90c46f96d541d3a975c242b2602c2c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:50.494072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b92910df-2164-4358-96f3-ae3110e445fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e90c46f96d541d3a975c242b2602c2c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:50.501078 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-b92910df-2164-4358-96f3-ae3110e445fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e90c46f96d541d3a975c242b2602c2c'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:42:50.521839 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4339/8640] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:42:50 2022] DELETE /identity/v3/users/6e90c46f96d541d3a975c242b2602c2c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:42:50.830923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cd5cb-ed8c-4e87-9459-96fc253bf960 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:42:50.832792 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ee5cd5cb-ed8c-4e87-9459-96fc253bf960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:42:50.847196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5cd5cb-ed8c-4e87-9459-96fc253bf960 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:42:50.906042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea814eae-3331-448c-939e-ca19ff755c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:42:50.906885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea814eae-3331-448c-939e-ca19ff755c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:42:50.907172 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea814eae-3331-448c-939e-ca19ff755c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:42:50.907608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea814eae-3331-448c-939e-ca19ff755c72 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:42:50.914696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea814eae-3331-448c-939e-ca19ff755c72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:42:50.916634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea814eae-3331-448c-939e-ca19ff755c72 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:42:50.930809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application [None req-ea814eae-3331-448c-939e-ca19ff755c72 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Jul 02 21:42:50.930809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 21:42:50.930809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 21:42:50.930809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 21:42:50.930809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 21:42:50.930809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 21:42:50.930809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 21:42:50.930809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 21:42:50.930809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 21:42:50.930809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 21:42:50.930809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 21:42:50.930809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 21:42:50.930809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 02 21:42:50.930809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 02 21:42:50.930809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 21:42:50.930809 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 21:42:50.931800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 02 21:42:50.931800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 02 21:42:50.931800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 21:42:50.931800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 21:42:50.931800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 21:42:50.931800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 21:42:50.931800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Jul 02 21:42:50.931800 ncdv-master-1 devstack@keystone.service[91077]: ERROR keystone.server.flask.application Jul 02 21:42:50.932276 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4302/8641] 10.222.0.43 () {58 vars in 1148 bytes} [Sat Jul 2 21:42:50 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 21:43:00.514887 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:DELETE=10,keystone:SELECT=24,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:00.919581 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=31 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:01.191926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc80ba-f11e-4379-b11d-6dee527a401c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:01.192221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc80ba-f11e-4379-b11d-6dee527a401c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:01.192502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc80ba-f11e-4379-b11d-6dee527a401c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:01.213727 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3fdc80ba-f11e-4379-b11d-6dee527a401c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:43:01.214944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3fdc80ba-f11e-4379-b11d-6dee527a401c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:01.223691 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4340/8642] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:43:01.233840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a516b54-7d62-47d4-9e21-3b2f6a770def None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:01.234181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a516b54-7d62-47d4-9e21-3b2f6a770def None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:01.234580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a516b54-7d62-47d4-9e21-3b2f6a770def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:01.256606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-7a516b54-7d62-47d4-9e21-3b2f6a770def None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:43:01.258523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7a516b54-7d62-47d4-9e21-3b2f6a770def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:01.268842 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4303/8643] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:43:01.274861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc80ba-f11e-4379-b11d-6dee527a401c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:01.285795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc80ba-f11e-4379-b11d-6dee527a401c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:01.291157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4ad95-83fb-4be6-b3f9-c4b1361252b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:01.291844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4ad95-83fb-4be6-b3f9-c4b1361252b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:01.292186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4ad95-83fb-4be6-b3f9-c4b1361252b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:01.292465 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4ad95-83fb-4be6-b3f9-c4b1361252b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:01.293189 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4ad95-83fb-4be6-b3f9-c4b1361252b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:43:01.293496 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4ad95-83fb-4be6-b3f9-c4b1361252b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:01.295472 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4ad95-83fb-4be6-b3f9-c4b1361252b4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:01.309258 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4341/8644] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:43:01.321095 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a516b54-7d62-47d4-9e21-3b2f6a770def None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:01.335174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a516b54-7d62-47d4-9e21-3b2f6a770def None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:01.340993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01f14a-063b-41d1-a37b-1c04e0881313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:01.341727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01f14a-063b-41d1-a37b-1c04e0881313 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:01.342048 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01f14a-063b-41d1-a37b-1c04e0881313 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:01.342363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01f14a-063b-41d1-a37b-1c04e0881313 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:01.343156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01f14a-063b-41d1-a37b-1c04e0881313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:01.345279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01f14a-063b-41d1-a37b-1c04e0881313 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:01.375917 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4304/8645] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:43:01 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:43:01.380313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4ad95-83fb-4be6-b3f9-c4b1361252b4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:01.390533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4ad95-83fb-4be6-b3f9-c4b1361252b4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:01.450747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2283ad2-fa2f-4c91-9aa2-edbf2c71f947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:01.451619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2283ad2-fa2f-4c91-9aa2-edbf2c71f947 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:01.451929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2283ad2-fa2f-4c91-9aa2-edbf2c71f947 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:01.452259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2283ad2-fa2f-4c91-9aa2-edbf2c71f947 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:01.453249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2283ad2-fa2f-4c91-9aa2-edbf2c71f947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:01.456282 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2283ad2-fa2f-4c91-9aa2-edbf2c71f947 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:01.484768 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4342/8646] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:43:01 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:43:01.488936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01f14a-063b-41d1-a37b-1c04e0881313 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:01.499727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01f14a-063b-41d1-a37b-1c04e0881313 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:01.505624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433e993-1247-4797-9e4a-6169ff0b5d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:01.506287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433e993-1247-4797-9e4a-6169ff0b5d4c admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:01.506566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433e993-1247-4797-9e4a-6169ff0b5d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:01.506840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433e993-1247-4797-9e4a-6169ff0b5d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:01.507562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433e993-1247-4797-9e4a-6169ff0b5d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:01.509210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433e993-1247-4797-9e4a-6169ff0b5d4c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:01.519510 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4305/8647] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:43:01.523518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2283ad2-fa2f-4c91-9aa2-edbf2c71f947 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:01.533967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2283ad2-fa2f-4c91-9aa2-edbf2c71f947 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:01.539646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26d44e-aa26-4658-b12d-c53f8b7a380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:01.540328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26d44e-aa26-4658-b12d-c53f8b7a380e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:01.540617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26d44e-aa26-4658-b12d-c53f8b7a380e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:01.540884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26d44e-aa26-4658-b12d-c53f8b7a380e admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:01.541596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26d44e-aa26-4658-b12d-c53f8b7a380e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:01.543198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26d44e-aa26-4658-b12d-c53f8b7a380e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:01.555411 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4343/8648] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:43:01.559654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433e993-1247-4797-9e4a-6169ff0b5d4c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:01.570040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433e993-1247-4797-9e4a-6169ff0b5d4c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:01.575312 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ad7db-a279-441d-a4c3-a049997e02e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:01.576239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ad7db-a279-441d-a4c3-a049997e02e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:01.576524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ad7db-a279-441d-a4c3-a049997e02e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:01.576803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ad7db-a279-441d-a4c3-a049997e02e9 admin admin] PATH_INFO: `/v3/projects/237fdb950d1d477fadba51149c76c201/users/df426b59e996478083e92098ec70b244/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:01.591910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ad7db-a279-441d-a4c3-a049997e02e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=237fdb950d1d477fadba51149c76c201, user_id=df426b59e996478083e92098ec70b244, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:01.594658 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ad7db-a279-441d-a4c3-a049997e02e9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:01.609129 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4306/8649] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:43:01 2022] PUT /identity/v3/projects/237fdb950d1d477fadba51149c76c201/users/df426b59e996478083e92098ec70b244/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:43:01.622526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a9bcf-eba4-4520-9577-b1098e184a24 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:01.622818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a9bcf-eba4-4520-9577-b1098e184a24 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:01.623118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a9bcf-eba4-4520-9577-b1098e184a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:01.651586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f90a9bcf-eba4-4520-9577-b1098e184a24 None None] MFA Rules not processed for user `df426b59e996478083e92098ec70b244`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:43:01.652864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f90a9bcf-eba4-4520-9577-b1098e184a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:01.728666 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4344/8650] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:43:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:43:01.733432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ad7db-a279-441d-a4c3-a049997e02e9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:01.797684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ad7db-a279-441d-a4c3-a049997e02e9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:01.803163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d566cdf-75f1-4c4e-b653-5841c79b7b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:01.803829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d566cdf-75f1-4c4e-b653-5841c79b7b88 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:01.804144 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d566cdf-75f1-4c4e-b653-5841c79b7b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:01.804424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d566cdf-75f1-4c4e-b653-5841c79b7b88 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:01.805129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d566cdf-75f1-4c4e-b653-5841c79b7b88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:01.807047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d566cdf-75f1-4c4e-b653-5841c79b7b88 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:01.834648 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4307/8651] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:43:01 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:43:01.838868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a9bcf-eba4-4520-9577-b1098e184a24 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:01.849943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a9bcf-eba4-4520-9577-b1098e184a24 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:01.895358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:01.908803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14ca78-3ea9-4ee2-9749-c07c926ddc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:01.909490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14ca78-3ea9-4ee2-9749-c07c926ddc87 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:01.909787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14ca78-3ea9-4ee2-9749-c07c926ddc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:01.910056 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14ca78-3ea9-4ee2-9749-c07c926ddc87 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:01.910747 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14ca78-3ea9-4ee2-9749-c07c926ddc87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:01.912738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14ca78-3ea9-4ee2-9749-c07c926ddc87 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:01.934518 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4345/8652] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:43:01 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:43:01.938594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d566cdf-75f1-4c4e-b653-5841c79b7b88 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:01.949592 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d566cdf-75f1-4c4e-b653-5841c79b7b88 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:01.955258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb7789-720a-428b-92cf-6ccdeb2a714b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:01.955953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb7789-720a-428b-92cf-6ccdeb2a714b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:01.956265 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb7789-720a-428b-92cf-6ccdeb2a714b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:01.956554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb7789-720a-428b-92cf-6ccdeb2a714b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:01.957273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb7789-720a-428b-92cf-6ccdeb2a714b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:01.958994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb7789-720a-428b-92cf-6ccdeb2a714b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:01.970342 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4308/8653] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:43:01.974829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14ca78-3ea9-4ee2-9749-c07c926ddc87 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:01.985300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14ca78-3ea9-4ee2-9749-c07c926ddc87 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:01.991101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e126018-f634-49d2-a42f-a9a1d54df555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:01.991996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e126018-f634-49d2-a42f-a9a1d54df555 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:01.992313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e126018-f634-49d2-a42f-a9a1d54df555 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:01.992591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e126018-f634-49d2-a42f-a9a1d54df555 admin admin] PATH_INFO: `/v3/projects/5b2d9b803e34402e94d8ef6d847357b5/users/ec917e25e6d440248410efacbaf8b6d8/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:02.008133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e126018-f634-49d2-a42f-a9a1d54df555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2d9b803e34402e94d8ef6d847357b5, user_id=ec917e25e6d440248410efacbaf8b6d8, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:02.010816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e126018-f634-49d2-a42f-a9a1d54df555 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:02.026083 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4346/8654] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:43:01 2022] PUT /identity/v3/projects/5b2d9b803e34402e94d8ef6d847357b5/users/ec917e25e6d440248410efacbaf8b6d8/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:43:02.031565 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb7789-720a-428b-92cf-6ccdeb2a714b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:02.042479 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb7789-720a-428b-92cf-6ccdeb2a714b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:02.106621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf980fb5-6d38-4051-92d7-1df0839c7752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:02.107957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf980fb5-6d38-4051-92d7-1df0839c7752 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:02.108338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf980fb5-6d38-4051-92d7-1df0839c7752 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:02.108684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf980fb5-6d38-4051-92d7-1df0839c7752 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:02.109473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf980fb5-6d38-4051-92d7-1df0839c7752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:02.111458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf980fb5-6d38-4051-92d7-1df0839c7752 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:02.122463 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4309/8655] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:43:02.126803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e126018-f634-49d2-a42f-a9a1d54df555 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:02.137746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e126018-f634-49d2-a42f-a9a1d54df555 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:02.143701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474ff9d-8b81-41ca-9934-4a93acde5d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:02.144621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474ff9d-8b81-41ca-9934-4a93acde5d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:02.144899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474ff9d-8b81-41ca-9934-4a93acde5d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:02.145156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474ff9d-8b81-41ca-9934-4a93acde5d42 admin admin] PATH_INFO: `/v3/projects/5b2d9b803e34402e94d8ef6d847357b5/users/ec917e25e6d440248410efacbaf8b6d8/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:02.147507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474ff9d-8b81-41ca-9934-4a93acde5d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2d9b803e34402e94d8ef6d847357b5, user_id=ec917e25e6d440248410efacbaf8b6d8, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:02.150198 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474ff9d-8b81-41ca-9934-4a93acde5d42 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:02.160975 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4347/8656] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:43:02 2022] PUT /identity/v3/projects/5b2d9b803e34402e94d8ef6d847357b5/users/ec917e25e6d440248410efacbaf8b6d8/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:43:02.171724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73ee0e-20f9-4716-9ccb-8ecfc0d66efd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:02.172003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73ee0e-20f9-4716-9ccb-8ecfc0d66efd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:02.172310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73ee0e-20f9-4716-9ccb-8ecfc0d66efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:02.185666 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:02.202969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ef73ee0e-20f9-4716-9ccb-8ecfc0d66efd None None] MFA Rules not processed for user `ec917e25e6d440248410efacbaf8b6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:43:02.204282 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ef73ee0e-20f9-4716-9ccb-8ecfc0d66efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:02.287298 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4310/8657] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:43:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:43:02.300093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5625f28-3605-43a3-8f28-ead1fafcf3df None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:02.300401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5625f28-3605-43a3-8f28-ead1fafcf3df None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:02.300679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5625f28-3605-43a3-8f28-ead1fafcf3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:02.318642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a5625f28-3605-43a3-8f28-ead1fafcf3df None None] MFA Rules not processed for user `df426b59e996478083e92098ec70b244`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:43:02.319871 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a5625f28-3605-43a3-8f28-ead1fafcf3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:02.378883 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4348/8658] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:43:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:43:02.393984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73ee0e-20f9-4716-9ccb-8ecfc0d66efd None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:02.395610 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ef73ee0e-20f9-4716-9ccb-8ecfc0d66efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:02.477693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73ee0e-20f9-4716-9ccb-8ecfc0d66efd None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:02.484019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f369c-fb95-4452-af79-8becf574368f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:02.484709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f369c-fb95-4452-af79-8becf574368f service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:02.484991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f369c-fb95-4452-af79-8becf574368f service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:02.485264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f369c-fb95-4452-af79-8becf574368f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:02.493497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f369c-fb95-4452-af79-8becf574368f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:02.495109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f369c-fb95-4452-af79-8becf574368f service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:02.503898 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4311/8659] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:43:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:43:03.998857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5625f28-3605-43a3-8f28-ead1fafcf3df None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:04.001239 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a5625f28-3605-43a3-8f28-ead1fafcf3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:04.096105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5625f28-3605-43a3-8f28-ead1fafcf3df None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:04.101977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac265be3-6126-443d-b0ed-0815b2aad0c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:04.102668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac265be3-6126-443d-b0ed-0815b2aad0c8 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:04.102951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac265be3-6126-443d-b0ed-0815b2aad0c8 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:04.103227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac265be3-6126-443d-b0ed-0815b2aad0c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:04.105295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ac265be3-6126-443d-b0ed-0815b2aad0c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:04.119591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac265be3-6126-443d-b0ed-0815b2aad0c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:04.121214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac265be3-6126-443d-b0ed-0815b2aad0c8 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:04.133654 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4349/8660] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:43:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:43:09.108289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f369c-fb95-4452-af79-8becf574368f service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:09.110004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8e2f369c-fb95-4452-af79-8becf574368f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:09.177541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f369c-fb95-4452-af79-8becf574368f service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:09.181210 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d632ad-cbcf-43ac-968c-a086ce5a3d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:09.181870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d632ad-cbcf-43ac-968c-a086ce5a3d96 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:09.182308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d632ad-cbcf-43ac-968c-a086ce5a3d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:09.182614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d632ad-cbcf-43ac-968c-a086ce5a3d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:09.184459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e0d632ad-cbcf-43ac-968c-a086ce5a3d96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:09.197953 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d632ad-cbcf-43ac-968c-a086ce5a3d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:09.199402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d632ad-cbcf-43ac-968c-a086ce5a3d96 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:09.210070 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4312/8661] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:43:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:43:14.127013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=84,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:14.654461 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac265be3-6126-443d-b0ed-0815b2aad0c8 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:14.671096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac265be3-6126-443d-b0ed-0815b2aad0c8 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:14.680586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b28d4-e68e-4695-bd35-e8cae26d75f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:14.681611 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b28d4-e68e-4695-bd35-e8cae26d75f1 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:14.681999 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b28d4-e68e-4695-bd35-e8cae26d75f1 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:14.683361 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b28d4-e68e-4695-bd35-e8cae26d75f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:14.685232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-522b28d4-e68e-4695-bd35-e8cae26d75f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:14.702625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b28d4-e68e-4695-bd35-e8cae26d75f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:14.704477 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b28d4-e68e-4695-bd35-e8cae26d75f1 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:14.731456 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4350/8662] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:43:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:43:17.112482 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d632ad-cbcf-43ac-968c-a086ce5a3d96 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:17.114001 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e0d632ad-cbcf-43ac-968c-a086ce5a3d96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:17.133693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d632ad-cbcf-43ac-968c-a086ce5a3d96 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:17.142400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1fb26-1137-495a-b85b-98a94f45e66d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:17.143378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1fb26-1137-495a-b85b-98a94f45e66d service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:17.143764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1fb26-1137-495a-b85b-98a94f45e66d service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:17.144100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1fb26-1137-495a-b85b-98a94f45e66d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:17.157642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1fb26-1137-495a-b85b-98a94f45e66d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:17.159978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1fb26-1137-495a-b85b-98a94f45e66d service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:17.171695 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4313/8663] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:43:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:43:17.185335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ef6c5-0219-46cd-9dc8-7dc1435e6e5a None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:17.185829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ef6c5-0219-46cd-9dc8-7dc1435e6e5a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:17.185829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ef6c5-0219-46cd-9dc8-7dc1435e6e5a None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:17.187264 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4351/8664] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:43:17.192444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1fb26-1137-495a-b85b-98a94f45e66d service nova] Authenticating service token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:43:17.209138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1fb26-1137-495a-b85b-98a94f45e66d service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:17.214754 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:17.221614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1fb26-1137-495a-b85b-98a94f45e66d service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:17.227384 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ea365-4369-4291-ac2c-80ec6fdd7340 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec917e25e6d440248410efacbaf8b6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b2d9b803e34402e94d8ef6d847357b5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:17.228326 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ea365-4369-4291-ac2c-80ec6fdd7340 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:17.228613 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ea365-4369-4291-ac2c-80ec6fdd7340 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:17.228897 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ea365-4369-4291-ac2c-80ec6fdd7340 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] PATH_INFO: `/v3/projects/5b2d9b803e34402e94d8ef6d847357b5` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:17.230145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ea365-4369-4291-ac2c-80ec6fdd7340 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] RBAC: Authorizing `identity:get_project(project_id=5b2d9b803e34402e94d8ef6d847357b5)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:17.232018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ea365-4369-4291-ac2c-80ec6fdd7340 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:17.233828 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4314/8665] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:43:17 2022] GET /identity/v3/projects/5b2d9b803e34402e94d8ef6d847357b5 => generated 393 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:43:17.386140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ef6c5-0219-46cd-9dc8-7dc1435e6e5a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:17.388165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e62ef6c5-0219-46cd-9dc8-7dc1435e6e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:17.409069 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ef6c5-0219-46cd-9dc8-7dc1435e6e5a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:17.416903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95b8cf-3c0a-4f83-a4c5-928825cf63f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:17.417653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95b8cf-3c0a-4f83-a4c5-928825cf63f7 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:17.418140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95b8cf-3c0a-4f83-a4c5-928825cf63f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:17.418545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95b8cf-3c0a-4f83-a4c5-928825cf63f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:17.421798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9d95b8cf-3c0a-4f83-a4c5-928825cf63f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:17.437093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95b8cf-3c0a-4f83-a4c5-928825cf63f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:17.438552 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95b8cf-3c0a-4f83-a4c5-928825cf63f7 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:17.450269 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4352/8666] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:43:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:43:17.611386 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd93ef-9ab7-4e6a-9b8b-7006b02116fa None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:17.611679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd93ef-9ab7-4e6a-9b8b-7006b02116fa None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:17.611957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd93ef-9ab7-4e6a-9b8b-7006b02116fa None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:17.613426 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4315/8667] 10.222.0.43 () {54 vars in 912 bytes} [Sat Jul 2 21:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:43:17.618593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95b8cf-3c0a-4f83-a4c5-928825cf63f7 service neutron] Authenticating service token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 02 21:43:17.635677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95b8cf-3c0a-4f83-a4c5-928825cf63f7 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:17.645920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95b8cf-3c0a-4f83-a4c5-928825cf63f7 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:17.651526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32aa913-7bb1-4130-a308-08ef5d98551a tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec917e25e6d440248410efacbaf8b6d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b2d9b803e34402e94d8ef6d847357b5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:17.652425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32aa913-7bb1-4130-a308-08ef5d98551a tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:17.652707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32aa913-7bb1-4130-a308-08ef5d98551a tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:17.652985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32aa913-7bb1-4130-a308-08ef5d98551a tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] PATH_INFO: `/v3/projects/5b2d9b803e34402e94d8ef6d847357b5` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:17.654295 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32aa913-7bb1-4130-a308-08ef5d98551a tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] RBAC: Authorizing `identity:get_project(project_id=5b2d9b803e34402e94d8ef6d847357b5)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:17.656123 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32aa913-7bb1-4130-a308-08ef5d98551a tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:17.657880 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4353/8668] 10.222.0.43 () {58 vars in 1443 bytes} [Sat Jul 2 21:43:17 2022] GET /identity/v3/projects/5b2d9b803e34402e94d8ef6d847357b5 => generated 393 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:43:21.597519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd93ef-9ab7-4e6a-9b8b-7006b02116fa None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:21.668890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd93ef-9ab7-4e6a-9b8b-7006b02116fa None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:21.673918 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8366721-13ed-46cd-98d7-6feb07a7cde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:21.674815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8366721-13ed-46cd-98d7-6feb07a7cde0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:21.675092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8366721-13ed-46cd-98d7-6feb07a7cde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:21.675363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8366721-13ed-46cd-98d7-6feb07a7cde0 admin admin] PATH_INFO: `/v3/users/df426b59e996478083e92098ec70b244` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:21.676734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8366721-13ed-46cd-98d7-6feb07a7cde0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df426b59e996478083e92098ec70b244)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:21.678684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8366721-13ed-46cd-98d7-6feb07a7cde0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:21.728398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a8366721-13ed-46cd-98d7-6feb07a7cde0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df426b59e996478083e92098ec70b244'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:21.737126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a8366721-13ed-46cd-98d7-6feb07a7cde0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df426b59e996478083e92098ec70b244'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:21.745285 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a8366721-13ed-46cd-98d7-6feb07a7cde0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df426b59e996478083e92098ec70b244'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:21.746025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a8366721-13ed-46cd-98d7-6feb07a7cde0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df426b59e996478083e92098ec70b244'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:21.746745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-a8366721-13ed-46cd-98d7-6feb07a7cde0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df426b59e996478083e92098ec70b244'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:21.765942 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4316/8669] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:43:21 2022] DELETE /identity/v3/users/df426b59e996478083e92098ec70b244 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:43:21.770852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b1d9c-0177-4786-95b4-0a61f2325ef8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:21.771345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b1d9c-0177-4786-95b4-0a61f2325ef8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:21.771463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b1d9c-0177-4786-95b4-0a61f2325ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:21.790133 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-392b1d9c-0177-4786-95b4-0a61f2325ef8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:43:21.791377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-392b1d9c-0177-4786-95b4-0a61f2325ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:21.852967 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4354/8670] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:43:21.862998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8366721-13ed-46cd-98d7-6feb07a7cde0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:21.864517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a8366721-13ed-46cd-98d7-6feb07a7cde0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:21.926833 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8366721-13ed-46cd-98d7-6feb07a7cde0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:21.930992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf9480-7f9b-41ff-9f23-c6cf9d299d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:21.931632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf9480-7f9b-41ff-9f23-c6cf9d299d89 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:21.931923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf9480-7f9b-41ff-9f23-c6cf9d299d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:21.932240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf9480-7f9b-41ff-9f23-c6cf9d299d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:21.942656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf9480-7f9b-41ff-9f23-c6cf9d299d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:21.944217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf9480-7f9b-41ff-9f23-c6cf9d299d89 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:21.954503 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4317/8671] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:43:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:43:22.140398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b1d9c-0177-4786-95b4-0a61f2325ef8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:22.142098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-392b1d9c-0177-4786-95b4-0a61f2325ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:22.157532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b1d9c-0177-4786-95b4-0a61f2325ef8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:22.163452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cd1f4-0544-4112-a3c2-b866160a2874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:22.164456 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cd1f4-0544-4112-a3c2-b866160a2874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:22.164650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cd1f4-0544-4112-a3c2-b866160a2874 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:22.164928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cd1f4-0544-4112-a3c2-b866160a2874 admin admin] PATH_INFO: `/v3/projects/237fdb950d1d477fadba51149c76c201` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:22.166778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cd1f4-0544-4112-a3c2-b866160a2874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=237fdb950d1d477fadba51149c76c201)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:22.169593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cd1f4-0544-4112-a3c2-b866160a2874 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:22.218488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-779cd1f4-0544-4112-a3c2-b866160a2874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '237fdb950d1d477fadba51149c76c201', 'request_id': 'req-779cd1f4-0544-4112-a3c2-b866160a2874'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:22.227138 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-779cd1f4-0544-4112-a3c2-b866160a2874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '237fdb950d1d477fadba51149c76c201', 'request_id': 'req-779cd1f4-0544-4112-a3c2-b866160a2874'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:22.233809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-779cd1f4-0544-4112-a3c2-b866160a2874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '237fdb950d1d477fadba51149c76c201', 'request_id': 'req-779cd1f4-0544-4112-a3c2-b866160a2874'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:22.244937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-779cd1f4-0544-4112-a3c2-b866160a2874 admin admin] The token cache is being invalidate because project 237fdb950d1d477fadba51149c76c201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:43:22.245245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-779cd1f4-0544-4112-a3c2-b866160a2874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:22.245950 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-779cd1f4-0544-4112-a3c2-b866160a2874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:22.247636 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4355/8672] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:43:22 2022] DELETE /identity/v3/projects/237fdb950d1d477fadba51149c76c201 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:43:22.251813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf9480-7f9b-41ff-9f23-c6cf9d299d89 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:22.262280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf9480-7f9b-41ff-9f23-c6cf9d299d89 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:22.280474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:22.331311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101992e9-5c9a-48f3-a09f-416f8bcb0753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:22.332239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101992e9-5c9a-48f3-a09f-416f8bcb0753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:22.332523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101992e9-5c9a-48f3-a09f-416f8bcb0753 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:22.332798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101992e9-5c9a-48f3-a09f-416f8bcb0753 admin admin] PATH_INFO: `/v3/users/ec917e25e6d440248410efacbaf8b6d8` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:22.334033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101992e9-5c9a-48f3-a09f-416f8bcb0753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec917e25e6d440248410efacbaf8b6d8)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:22.336321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101992e9-5c9a-48f3-a09f-416f8bcb0753 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:22.394756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-101992e9-5c9a-48f3-a09f-416f8bcb0753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec917e25e6d440248410efacbaf8b6d8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:22.403562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-101992e9-5c9a-48f3-a09f-416f8bcb0753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec917e25e6d440248410efacbaf8b6d8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:22.412082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-101992e9-5c9a-48f3-a09f-416f8bcb0753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec917e25e6d440248410efacbaf8b6d8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:22.412775 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-101992e9-5c9a-48f3-a09f-416f8bcb0753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec917e25e6d440248410efacbaf8b6d8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:22.413390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-101992e9-5c9a-48f3-a09f-416f8bcb0753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec917e25e6d440248410efacbaf8b6d8'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:22.432782 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4318/8673] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:43:22 2022] DELETE /identity/v3/users/ec917e25e6d440248410efacbaf8b6d8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:43:22.713216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cd1f4-0544-4112-a3c2-b866160a2874 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:22.715029 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-779cd1f4-0544-4112-a3c2-b866160a2874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:22.728948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cd1f4-0544-4112-a3c2-b866160a2874 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:22.776267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:22.789985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95affe2e-b750-49d2-b1d3-4dc5c5c5fc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:22.790861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95affe2e-b750-49d2-b1d3-4dc5c5c5fc31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:22.791139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95affe2e-b750-49d2-b1d3-4dc5c5c5fc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:22.791432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95affe2e-b750-49d2-b1d3-4dc5c5c5fc31 admin admin] PATH_INFO: `/v3/projects/5b2d9b803e34402e94d8ef6d847357b5` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:22.792627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95affe2e-b750-49d2-b1d3-4dc5c5c5fc31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2d9b803e34402e94d8ef6d847357b5)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:22.794924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95affe2e-b750-49d2-b1d3-4dc5c5c5fc31 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:22.842872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-95affe2e-b750-49d2-b1d3-4dc5c5c5fc31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2d9b803e34402e94d8ef6d847357b5', 'request_id': 'req-95affe2e-b750-49d2-b1d3-4dc5c5c5fc31'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:22.850927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-95affe2e-b750-49d2-b1d3-4dc5c5c5fc31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2d9b803e34402e94d8ef6d847357b5', 'request_id': 'req-95affe2e-b750-49d2-b1d3-4dc5c5c5fc31'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:22.857438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-95affe2e-b750-49d2-b1d3-4dc5c5c5fc31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2d9b803e34402e94d8ef6d847357b5', 'request_id': 'req-95affe2e-b750-49d2-b1d3-4dc5c5c5fc31'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:22.868972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-95affe2e-b750-49d2-b1d3-4dc5c5c5fc31 admin admin] The token cache is being invalidate because project 5b2d9b803e34402e94d8ef6d847357b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:43:22.869260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-95affe2e-b750-49d2-b1d3-4dc5c5c5fc31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:22.869986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-95affe2e-b750-49d2-b1d3-4dc5c5c5fc31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:43:22.871658 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4356/8674] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:43:22 2022] DELETE /identity/v3/projects/5b2d9b803e34402e94d8ef6d847357b5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:43:22.877961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c4761-f442-4a03-9a5b-4277cc697ede None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:22.878449 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c4761-f442-4a03-9a5b-4277cc697ede None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:22.878535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c4761-f442-4a03-9a5b-4277cc697ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:22.897683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-169c4761-f442-4a03-9a5b-4277cc697ede None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:43:22.898979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-169c4761-f442-4a03-9a5b-4277cc697ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:22.961467 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4319/8675] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:43:22.969809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce0d81-20e9-4401-93ee-48d0a4400031 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:22.970099 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce0d81-20e9-4401-93ee-48d0a4400031 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:22.970382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce0d81-20e9-4401-93ee-48d0a4400031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:22.989952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f5ce0d81-20e9-4401-93ee-48d0a4400031 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:43:22.991178 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f5ce0d81-20e9-4401-93ee-48d0a4400031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:23.000742 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4357/8676] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:43:23.005799 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c4761-f442-4a03-9a5b-4277cc697ede None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:23.021503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c4761-f442-4a03-9a5b-4277cc697ede None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:23.028340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846d8d5-1d61-448a-a27c-5574b9f4491e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:23.029018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846d8d5-1d61-448a-a27c-5574b9f4491e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:23.029302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846d8d5-1d61-448a-a27c-5574b9f4491e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:23.029580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846d8d5-1d61-448a-a27c-5574b9f4491e admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:23.030301 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846d8d5-1d61-448a-a27c-5574b9f4491e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:43:23.030611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846d8d5-1d61-448a-a27c-5574b9f4491e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:23.032262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846d8d5-1d61-448a-a27c-5574b9f4491e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:23.045240 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4320/8677] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:43:23.049734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce0d81-20e9-4401-93ee-48d0a4400031 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:23.059801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce0d81-20e9-4401-93ee-48d0a4400031 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:23.065542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915e675-2720-4a5e-b46b-cbd8e04a67ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:23.066208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915e675-2720-4a5e-b46b-cbd8e04a67ec admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:23.066480 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915e675-2720-4a5e-b46b-cbd8e04a67ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:23.066752 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915e675-2720-4a5e-b46b-cbd8e04a67ec admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:23.067438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915e675-2720-4a5e-b46b-cbd8e04a67ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:23.069396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915e675-2720-4a5e-b46b-cbd8e04a67ec admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:23.101784 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4358/8678] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:43:23 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:43:23.103063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846d8d5-1d61-448a-a27c-5574b9f4491e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:23.113914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846d8d5-1d61-448a-a27c-5574b9f4491e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:23.140378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:23.177051 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd4bef-ae1c-43c2-8b4e-bdd0cc71eb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:23.177725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd4bef-ae1c-43c2-8b4e-bdd0cc71eb07 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:23.178007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd4bef-ae1c-43c2-8b4e-bdd0cc71eb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:23.178284 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd4bef-ae1c-43c2-8b4e-bdd0cc71eb07 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:23.178970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd4bef-ae1c-43c2-8b4e-bdd0cc71eb07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:23.180930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd4bef-ae1c-43c2-8b4e-bdd0cc71eb07 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:23.202173 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4321/8679] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:43:23 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:43:23.206462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915e675-2720-4a5e-b46b-cbd8e04a67ec admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:23.216895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915e675-2720-4a5e-b46b-cbd8e04a67ec admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:23.221450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b7788-809f-4b00-9128-ac49bd87eb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:23.222105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b7788-809f-4b00-9128-ac49bd87eb2e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:23.222387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b7788-809f-4b00-9128-ac49bd87eb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:23.222664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b7788-809f-4b00-9128-ac49bd87eb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:23.223382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b7788-809f-4b00-9128-ac49bd87eb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:23.225040 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b7788-809f-4b00-9128-ac49bd87eb2e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:23.235536 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4359/8680] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:43:23.239624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd4bef-ae1c-43c2-8b4e-bdd0cc71eb07 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:23.250827 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd4bef-ae1c-43c2-8b4e-bdd0cc71eb07 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:23.257133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19299405-0fb4-4345-b45b-b8d8374a0f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:23.257794 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19299405-0fb4-4345-b45b-b8d8374a0f7b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:23.258166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19299405-0fb4-4345-b45b-b8d8374a0f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:23.258454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19299405-0fb4-4345-b45b-b8d8374a0f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:23.259176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19299405-0fb4-4345-b45b-b8d8374a0f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:23.260830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19299405-0fb4-4345-b45b-b8d8374a0f7b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:23.271230 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4322/8681] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:43:23.275483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b7788-809f-4b00-9128-ac49bd87eb2e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:23.285974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b7788-809f-4b00-9128-ac49bd87eb2e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:23.292066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce21f0b-c84f-403f-bc9c-941a946eac95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:23.292966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce21f0b-c84f-403f-bc9c-941a946eac95 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:23.293249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce21f0b-c84f-403f-bc9c-941a946eac95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:23.293874 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce21f0b-c84f-403f-bc9c-941a946eac95 admin admin] PATH_INFO: `/v3/projects/61edc6aa7303432cbe3b5bdc5bc64584/users/3034eabff02e4bb99a9a1b73fddc51f9/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:23.309803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce21f0b-c84f-403f-bc9c-941a946eac95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61edc6aa7303432cbe3b5bdc5bc64584, user_id=3034eabff02e4bb99a9a1b73fddc51f9, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:23.312525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce21f0b-c84f-403f-bc9c-941a946eac95 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:23.327786 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4360/8682] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:43:23 2022] PUT /identity/v3/projects/61edc6aa7303432cbe3b5bdc5bc64584/users/3034eabff02e4bb99a9a1b73fddc51f9/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:43:23.332951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecd959-1798-43e9-af3f-ddb2c4fe71dd None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:23.333241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecd959-1798-43e9-af3f-ddb2c4fe71dd None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:23.333570 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecd959-1798-43e9-af3f-ddb2c4fe71dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:23.352193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1fecd959-1798-43e9-af3f-ddb2c4fe71dd None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:43:23.353457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1fecd959-1798-43e9-af3f-ddb2c4fe71dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:23.417389 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4323/8683] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:43:23.427921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce21f0b-c84f-403f-bc9c-941a946eac95 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:23.429905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fce21f0b-c84f-403f-bc9c-941a946eac95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:23.494337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce21f0b-c84f-403f-bc9c-941a946eac95 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:23.498285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2d145-70ce-483b-8407-da6d44ad83c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:23.498931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2d145-70ce-483b-8407-da6d44ad83c3 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:23.499212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2d145-70ce-483b-8407-da6d44ad83c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:23.499483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2d145-70ce-483b-8407-da6d44ad83c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:23.508759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2d145-70ce-483b-8407-da6d44ad83c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:23.510248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2d145-70ce-483b-8407-da6d44ad83c3 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:23.519820 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4361/8684] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:43:27.798643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a674a-149f-4b97-af31-5d4364814d41 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:27.799128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a674a-149f-4b97-af31-5d4364814d41 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:27.799216 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a674a-149f-4b97-af31-5d4364814d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:27.840177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-322a674a-149f-4b97-af31-5d4364814d41 None None] MFA Rules not processed for user `3034eabff02e4bb99a9a1b73fddc51f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:43:27.841428 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-322a674a-149f-4b97-af31-5d4364814d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:27.914319 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4324/8685] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:43:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:43:27.927339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8d095-225d-4ec1-99db-0fc00336c063 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:27.927863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8d095-225d-4ec1-99db-0fc00336c063 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:27.927863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8d095-225d-4ec1-99db-0fc00336c063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:27.948655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-4ad8d095-225d-4ec1-99db-0fc00336c063 None None] MFA Rules not processed for user `3034eabff02e4bb99a9a1b73fddc51f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:43:27.949888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4ad8d095-225d-4ec1-99db-0fc00336c063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:27.958130 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4362/8686] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:43:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:43:27.983726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a674a-149f-4b97-af31-5d4364814d41 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:27.985849 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-322a674a-149f-4b97-af31-5d4364814d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:28.034994 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:28.074062 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a674a-149f-4b97-af31-5d4364814d41 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:28.085474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd74f9-0666-4f70-ba96-c6b15b0adaff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:28.086230 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd74f9-0666-4f70-ba96-c6b15b0adaff service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:28.086511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd74f9-0666-4f70-ba96-c6b15b0adaff service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:28.086787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd74f9-0666-4f70-ba96-c6b15b0adaff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:28.097691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd74f9-0666-4f70-ba96-c6b15b0adaff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:28.099302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd74f9-0666-4f70-ba96-c6b15b0adaff service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:28.110726 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4325/8687] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:43:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:43:37.943321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:38.106465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=18 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:38.679860 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8d095-225d-4ec1-99db-0fc00336c063 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:38.693098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8d095-225d-4ec1-99db-0fc00336c063 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:38.697720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd3cd2-9f6c-4812-9cce-6b17d7a622f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:38.698619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd3cd2-9f6c-4812-9cce-6b17d7a622f9 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:38.699041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd3cd2-9f6c-4812-9cce-6b17d7a622f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:38.699501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd3cd2-9f6c-4812-9cce-6b17d7a622f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:38.702114 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e5fd3cd2-9f6c-4812-9cce-6b17d7a622f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:38.716136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd3cd2-9f6c-4812-9cce-6b17d7a622f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:38.717955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd3cd2-9f6c-4812-9cce-6b17d7a622f9 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:38.729437 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4363/8688] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:43:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:43:38.823877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924da4e9-8d4e-455f-a6ca-806447448917 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:38.823877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924da4e9-8d4e-455f-a6ca-806447448917 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:38.823877 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924da4e9-8d4e-455f-a6ca-806447448917 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:38.825652 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4326/8689] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:43:38.830806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cb0bc-e800-4828-904a-b60ff8a38806 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:38.831265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cb0bc-e800-4828-904a-b60ff8a38806 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:38.831715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cb0bc-e800-4828-904a-b60ff8a38806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:38.885699 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d98cb0bc-e800-4828-904a-b60ff8a38806 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:43:38.886925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d98cb0bc-e800-4828-904a-b60ff8a38806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:38.962145 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4364/8690] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:43:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:43:38.983082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924da4e9-8d4e-455f-a6ca-806447448917 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:38.985669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-924da4e9-8d4e-455f-a6ca-806447448917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:39.006783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924da4e9-8d4e-455f-a6ca-806447448917 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:39.012733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c65d5-a8f1-4361-898f-0160449f8881 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:39.013314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c65d5-a8f1-4361-898f-0160449f8881 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:39.013593 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c65d5-a8f1-4361-898f-0160449f8881 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:39.013864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c65d5-a8f1-4361-898f-0160449f8881 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:39.023178 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c65d5-a8f1-4361-898f-0160449f8881 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:39.024815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c65d5-a8f1-4361-898f-0160449f8881 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:39.035277 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4327/8691] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:43:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:43:39.211207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cb0bc-e800-4828-904a-b60ff8a38806 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:43:39.224179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cb0bc-e800-4828-904a-b60ff8a38806 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:43:39.228684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabe66b-50c6-4e36-8e4f-537541721b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:43:39.229335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabe66b-50c6-4e36-8e4f-537541721b24 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:43:39.229616 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabe66b-50c6-4e36-8e4f-537541721b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:43:39.229889 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabe66b-50c6-4e36-8e4f-537541721b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:43:39.231746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cdabe66b-50c6-4e36-8e4f-537541721b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:43:39.249341 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabe66b-50c6-4e36-8e4f-537541721b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:43:39.250799 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabe66b-50c6-4e36-8e4f-537541721b24 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:43:39.268241 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4365/8692] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:43:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:43:49.030857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:49.256991 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=51 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:44:13.217346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c65d5-a8f1-4361-898f-0160449f8881 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:44:13.218968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-158c65d5-a8f1-4361-898f-0160449f8881 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:44:13.234288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c65d5-a8f1-4361-898f-0160449f8881 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:44:13.238692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea92ec-d997-49b9-a9c3-53e1500fd3d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:44:13.239344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea92ec-d997-49b9-a9c3-53e1500fd3d5 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:13.239632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea92ec-d997-49b9-a9c3-53e1500fd3d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:13.239902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea92ec-d997-49b9-a9c3-53e1500fd3d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:13.241970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f7ea92ec-d997-49b9-a9c3-53e1500fd3d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:44:13.257855 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea92ec-d997-49b9-a9c3-53e1500fd3d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:44:13.259389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea92ec-d997-49b9-a9c3-53e1500fd3d5 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:44:13.270931 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4328/8693] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:44:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:44:13.810262 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabe66b-50c6-4e36-8e4f-537541721b24 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:44:13.811806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cdabe66b-50c6-4e36-8e4f-537541721b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:44:13.829297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabe66b-50c6-4e36-8e4f-537541721b24 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:44:13.835823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170034a-683e-4686-a896-c72f0ed6a088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:44:13.836524 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170034a-683e-4686-a896-c72f0ed6a088 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:13.836810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170034a-683e-4686-a896-c72f0ed6a088 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:13.837094 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170034a-683e-4686-a896-c72f0ed6a088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:13.839006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d170034a-683e-4686-a896-c72f0ed6a088 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:44:13.855267 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170034a-683e-4686-a896-c72f0ed6a088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:44:13.858066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170034a-683e-4686-a896-c72f0ed6a088 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:44:13.876357 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4366/8694] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:44:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:44:19.037305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea92ec-d997-49b9-a9c3-53e1500fd3d5 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:44:19.039432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f7ea92ec-d997-49b9-a9c3-53e1500fd3d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:44:19.061693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea92ec-d997-49b9-a9c3-53e1500fd3d5 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:44:19.066888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b9ea3-f49c-4fd7-895f-1fc0764bd6d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:44:19.067669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b9ea3-f49c-4fd7-895f-1fc0764bd6d8 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:19.067859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b9ea3-f49c-4fd7-895f-1fc0764bd6d8 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:19.068124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b9ea3-f49c-4fd7-895f-1fc0764bd6d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:19.069963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-375b9ea3-f49c-4fd7-895f-1fc0764bd6d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:44:19.086843 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b9ea3-f49c-4fd7-895f-1fc0764bd6d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:44:19.088639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b9ea3-f49c-4fd7-895f-1fc0764bd6d8 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:44:19.102806 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4329/8695] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:44:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:44:23.867713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:44:26.388691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170034a-683e-4686-a896-c72f0ed6a088 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:44:26.400722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170034a-683e-4686-a896-c72f0ed6a088 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:44:26.406157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356e69d-e007-4aba-b5f0-1c8b55e7b918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:44:26.407116 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356e69d-e007-4aba-b5f0-1c8b55e7b918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:26.407396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356e69d-e007-4aba-b5f0-1c8b55e7b918 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:26.407769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356e69d-e007-4aba-b5f0-1c8b55e7b918 admin admin] PATH_INFO: `/v3/users/3034eabff02e4bb99a9a1b73fddc51f9` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:26.409113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356e69d-e007-4aba-b5f0-1c8b55e7b918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3034eabff02e4bb99a9a1b73fddc51f9)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:44:26.411096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356e69d-e007-4aba-b5f0-1c8b55e7b918 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:44:26.462416 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f356e69d-e007-4aba-b5f0-1c8b55e7b918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3034eabff02e4bb99a9a1b73fddc51f9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:44:26.479868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f356e69d-e007-4aba-b5f0-1c8b55e7b918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3034eabff02e4bb99a9a1b73fddc51f9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:44:26.480533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f356e69d-e007-4aba-b5f0-1c8b55e7b918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3034eabff02e4bb99a9a1b73fddc51f9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:44:26.481199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f356e69d-e007-4aba-b5f0-1c8b55e7b918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3034eabff02e4bb99a9a1b73fddc51f9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:44:26.488850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-f356e69d-e007-4aba-b5f0-1c8b55e7b918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3034eabff02e4bb99a9a1b73fddc51f9'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:44:26.506673 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4367/8696] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:44:26 2022] DELETE /identity/v3/users/3034eabff02e4bb99a9a1b73fddc51f9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:44:26.695012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b9ea3-f49c-4fd7-895f-1fc0764bd6d8 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:44:26.708719 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b9ea3-f49c-4fd7-895f-1fc0764bd6d8 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:44:26.768632 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ef000-8b41-4418-850c-60976675f962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:44:26.769474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ef000-8b41-4418-850c-60976675f962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:26.769786 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ef000-8b41-4418-850c-60976675f962 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:26.770060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ef000-8b41-4418-850c-60976675f962 admin admin] PATH_INFO: `/v3/projects/61edc6aa7303432cbe3b5bdc5bc64584` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:26.771373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ef000-8b41-4418-850c-60976675f962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61edc6aa7303432cbe3b5bdc5bc64584)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:44:26.773337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ef000-8b41-4418-850c-60976675f962 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:44:26.830135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-122ef000-8b41-4418-850c-60976675f962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61edc6aa7303432cbe3b5bdc5bc64584', 'request_id': 'req-122ef000-8b41-4418-850c-60976675f962'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:44:26.836510 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-122ef000-8b41-4418-850c-60976675f962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61edc6aa7303432cbe3b5bdc5bc64584', 'request_id': 'req-122ef000-8b41-4418-850c-60976675f962'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:44:26.842457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-122ef000-8b41-4418-850c-60976675f962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61edc6aa7303432cbe3b5bdc5bc64584', 'request_id': 'req-122ef000-8b41-4418-850c-60976675f962'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:44:26.856270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-122ef000-8b41-4418-850c-60976675f962 admin admin] The token cache is being invalidate because project 61edc6aa7303432cbe3b5bdc5bc64584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:44:26.856560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-122ef000-8b41-4418-850c-60976675f962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:44:26.857201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-122ef000-8b41-4418-850c-60976675f962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:44:26.858779 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4330/8697] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:44:26 2022] DELETE /identity/v3/projects/61edc6aa7303432cbe3b5bdc5bc64584 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:44:26.864172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0abd30-3653-4819-a042-a88297ffaa29 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:26.864409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0abd30-3653-4819-a042-a88297ffaa29 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:26.864688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0abd30-3653-4819-a042-a88297ffaa29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:26.883599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7c0abd30-3653-4819-a042-a88297ffaa29 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:44:26.884861 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7c0abd30-3653-4819-a042-a88297ffaa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:44:26.945929 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4368/8698] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:44:26.954472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3907903-ae42-4b3c-877c-bcec0301e88d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:26.954773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3907903-ae42-4b3c-877c-bcec0301e88d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:26.955053 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3907903-ae42-4b3c-877c-bcec0301e88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:26.975791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e3907903-ae42-4b3c-877c-bcec0301e88d None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:44:26.977071 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e3907903-ae42-4b3c-877c-bcec0301e88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:44:26.986464 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4331/8699] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:44:26.990834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0abd30-3653-4819-a042-a88297ffaa29 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:44:27.001466 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0abd30-3653-4819-a042-a88297ffaa29 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:44:27.007460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e24e3-a3f8-4069-8939-ec46a5b1a5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:44:27.008161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e24e3-a3f8-4069-8939-ec46a5b1a5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:27.008448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e24e3-a3f8-4069-8939-ec46a5b1a5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:27.008715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e24e3-a3f8-4069-8939-ec46a5b1a5b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:27.009437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e24e3-a3f8-4069-8939-ec46a5b1a5b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:44:27.009742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e24e3-a3f8-4069-8939-ec46a5b1a5b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:44:27.011376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e24e3-a3f8-4069-8939-ec46a5b1a5b8 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:44:27.023699 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4369/8700] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:44:27.027839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3907903-ae42-4b3c-877c-bcec0301e88d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:44:27.038227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3907903-ae42-4b3c-877c-bcec0301e88d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:44:27.044018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40836789-0993-4b26-983c-6f64b336f0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:44:27.044712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40836789-0993-4b26-983c-6f64b336f0ec admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:27.044991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40836789-0993-4b26-983c-6f64b336f0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:27.045271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40836789-0993-4b26-983c-6f64b336f0ec admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:27.045968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40836789-0993-4b26-983c-6f64b336f0ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:44:27.047881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40836789-0993-4b26-983c-6f64b336f0ec admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:44:27.076641 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4332/8701] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:44:27 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:44:27.083801 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e24e3-a3f8-4069-8939-ec46a5b1a5b8 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:44:27.094945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e24e3-a3f8-4069-8939-ec46a5b1a5b8 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:44:27.152678 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7945e-ccfc-431d-a49d-a3cd3e906a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:44:27.153280 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7945e-ccfc-431d-a49d-a3cd3e906a07 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:27.153560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7945e-ccfc-431d-a49d-a3cd3e906a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:27.153818 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7945e-ccfc-431d-a49d-a3cd3e906a07 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:27.154502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7945e-ccfc-431d-a49d-a3cd3e906a07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:44:27.156491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7945e-ccfc-431d-a49d-a3cd3e906a07 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:44:27.163706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:44:27.180967 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4370/8702] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:44:27 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:44:27.185914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40836789-0993-4b26-983c-6f64b336f0ec admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:44:27.200398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40836789-0993-4b26-983c-6f64b336f0ec admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:44:27.206294 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed0f50-b925-4d9b-95d8-3a1cbbbb5451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:44:27.206962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed0f50-b925-4d9b-95d8-3a1cbbbb5451 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:27.207246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed0f50-b925-4d9b-95d8-3a1cbbbb5451 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:27.207521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed0f50-b925-4d9b-95d8-3a1cbbbb5451 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:27.208278 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed0f50-b925-4d9b-95d8-3a1cbbbb5451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:44:27.209903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed0f50-b925-4d9b-95d8-3a1cbbbb5451 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:44:27.222393 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4333/8703] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:44:27.226824 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7945e-ccfc-431d-a49d-a3cd3e906a07 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:44:27.237797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7945e-ccfc-431d-a49d-a3cd3e906a07 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:44:27.244187 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f43a86-19c8-4f2c-85cc-33c985839321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:44:27.244848 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f43a86-19c8-4f2c-85cc-33c985839321 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:27.245124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f43a86-19c8-4f2c-85cc-33c985839321 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:27.245402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f43a86-19c8-4f2c-85cc-33c985839321 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:27.246112 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f43a86-19c8-4f2c-85cc-33c985839321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:44:27.247734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f43a86-19c8-4f2c-85cc-33c985839321 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:44:27.260487 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4371/8704] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:44:27.265120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed0f50-b925-4d9b-95d8-3a1cbbbb5451 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:44:27.276179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed0f50-b925-4d9b-95d8-3a1cbbbb5451 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:44:27.281772 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ef2f1-3f0c-497c-94c1-a0dcd788bf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:44:27.282717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ef2f1-3f0c-497c-94c1-a0dcd788bf36 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:27.283028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ef2f1-3f0c-497c-94c1-a0dcd788bf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:27.283399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ef2f1-3f0c-497c-94c1-a0dcd788bf36 admin admin] PATH_INFO: `/v3/projects/a9cfe7f066614ef9a09226654bd28c58/users/dde1c0b088674b45b74dff3367a491d1/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:27.299875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ef2f1-3f0c-497c-94c1-a0dcd788bf36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9cfe7f066614ef9a09226654bd28c58, user_id=dde1c0b088674b45b74dff3367a491d1, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:44:27.302578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ef2f1-3f0c-497c-94c1-a0dcd788bf36 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:44:27.314909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:44:27.321210 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4334/8705] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:44:27 2022] PUT /identity/v3/projects/a9cfe7f066614ef9a09226654bd28c58/users/dde1c0b088674b45b74dff3367a491d1/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:44:27.327993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fae4d5-5073-4da3-84c6-95c8b24a54f3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:27.328485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fae4d5-5073-4da3-84c6-95c8b24a54f3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:27.329363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fae4d5-5073-4da3-84c6-95c8b24a54f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:27.347852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c5fae4d5-5073-4da3-84c6-95c8b24a54f3 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:44:27.349105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c5fae4d5-5073-4da3-84c6-95c8b24a54f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:44:27.410704 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4372/8706] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:44:27.420914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ef2f1-3f0c-497c-94c1-a0dcd788bf36 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:44:27.422642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-856ef2f1-3f0c-497c-94c1-a0dcd788bf36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:44:27.483919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ef2f1-3f0c-497c-94c1-a0dcd788bf36 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:44:27.488173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1372068-f72a-4abe-b1f3-9eb334441803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:44:27.488813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1372068-f72a-4abe-b1f3-9eb334441803 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:27.489100 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1372068-f72a-4abe-b1f3-9eb334441803 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:27.489374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1372068-f72a-4abe-b1f3-9eb334441803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:27.499111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1372068-f72a-4abe-b1f3-9eb334441803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:44:27.500588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1372068-f72a-4abe-b1f3-9eb334441803 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:44:27.510977 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4335/8707] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:44:31.721350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e2d08-c888-4610-a104-532a366cc148 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:31.721835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e2d08-c888-4610-a104-532a366cc148 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:31.721942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e2d08-c888-4610-a104-532a366cc148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:31.748955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d87e2d08-c888-4610-a104-532a366cc148 None None] MFA Rules not processed for user `dde1c0b088674b45b74dff3367a491d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:44:31.750436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d87e2d08-c888-4610-a104-532a366cc148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:44:31.825604 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4373/8708] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:44:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:44:31.836162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd68ab-0db2-4751-979a-5af490a22d78 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:31.836626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd68ab-0db2-4751-979a-5af490a22d78 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:31.836734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd68ab-0db2-4751-979a-5af490a22d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:31.854461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4dbd68ab-0db2-4751-979a-5af490a22d78 None None] MFA Rules not processed for user `dde1c0b088674b45b74dff3367a491d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:44:31.855725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4dbd68ab-0db2-4751-979a-5af490a22d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:44:31.863219 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4336/8709] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:44:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:44:31.875156 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e2d08-c888-4610-a104-532a366cc148 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:44:31.876815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d87e2d08-c888-4610-a104-532a366cc148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:44:31.972353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e2d08-c888-4610-a104-532a366cc148 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:44:31.978256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee26f2-a814-49d5-baea-670dfe141499 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:44:31.978912 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee26f2-a814-49d5-baea-670dfe141499 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:31.979190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee26f2-a814-49d5-baea-670dfe141499 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:31.979463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee26f2-a814-49d5-baea-670dfe141499 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:31.984231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:44:31.993642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee26f2-a814-49d5-baea-670dfe141499 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:44:31.995686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee26f2-a814-49d5-baea-670dfe141499 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:44:32.006898 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4374/8710] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:44:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:44:41.806781 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c945c-293d-448d-9d74-4649d7d335d0 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:41.807328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c945c-293d-448d-9d74-4649d7d335d0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:41.807328 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c945c-293d-448d-9d74-4649d7d335d0 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:41.808709 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4337/8711] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:44:41.813550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63488292-a3e5-4dcf-b2c6-8bac9ba6b64d None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:41.813994 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63488292-a3e5-4dcf-b2c6-8bac9ba6b64d None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:41.814110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63488292-a3e5-4dcf-b2c6-8bac9ba6b64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:41.832854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-63488292-a3e5-4dcf-b2c6-8bac9ba6b64d None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:44:41.834081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-63488292-a3e5-4dcf-b2c6-8bac9ba6b64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:44:41.849311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=29 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:44:41.899110 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4375/8712] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:44:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:44:41.919992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c945c-293d-448d-9d74-4649d7d335d0 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:44:41.921834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ae0c945c-293d-448d-9d74-4649d7d335d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:44:41.941785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c945c-293d-448d-9d74-4649d7d335d0 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:44:41.946800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771acb5f-c623-47c3-88bd-28d34e0d69e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:44:41.947443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771acb5f-c623-47c3-88bd-28d34e0d69e6 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:44:41.947758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771acb5f-c623-47c3-88bd-28d34e0d69e6 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:44:41.948024 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771acb5f-c623-47c3-88bd-28d34e0d69e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:44:41.957235 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771acb5f-c623-47c3-88bd-28d34e0d69e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:44:41.958806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771acb5f-c623-47c3-88bd-28d34e0d69e6 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:44:41.968887 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4338/8713] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:44:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:44:51.890609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=32 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:44:51.964795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:45:19.858161 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98721c65-2716-4baa-a3b3-b772da4cbd9f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:45:19.858772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98721c65-2716-4baa-a3b3-b772da4cbd9f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:45:19.858772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98721c65-2716-4baa-a3b3-b772da4cbd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:45:19.876891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-98721c65-2716-4baa-a3b3-b772da4cbd9f None None] MFA Rules not processed for user `dde1c0b088674b45b74dff3367a491d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:45:19.878132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-98721c65-2716-4baa-a3b3-b772da4cbd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:45:19.885541 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4376/8714] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:45:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:45:29.871543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:45:31.571043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdaa0b-4ce1-4a3f-aad2-6263077f55ce None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:45:31.571606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdaa0b-4ce1-4a3f-aad2-6263077f55ce None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:45:31.571606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdaa0b-4ce1-4a3f-aad2-6263077f55ce None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:45:31.573067 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4339/8715] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:45:31.578592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f78f5-2757-4c49-beb7-37ff5d105dfe None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:45:31.579083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f78f5-2757-4c49-beb7-37ff5d105dfe None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:45:31.579440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f78f5-2757-4c49-beb7-37ff5d105dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:45:31.598647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-1d7f78f5-2757-4c49-beb7-37ff5d105dfe None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:45:31.599955 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1d7f78f5-2757-4c49-beb7-37ff5d105dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:45:31.609781 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4377/8716] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:45:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:45:31.630587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdaa0b-4ce1-4a3f-aad2-6263077f55ce None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:45:31.646969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdaa0b-4ce1-4a3f-aad2-6263077f55ce None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:45:31.652056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619cbdf-345b-4ad4-8048-70ce9d0a4001 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:45:31.652704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619cbdf-345b-4ad4-8048-70ce9d0a4001 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:45:31.652984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619cbdf-345b-4ad4-8048-70ce9d0a4001 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:45:31.653286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619cbdf-345b-4ad4-8048-70ce9d0a4001 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:45:31.662378 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619cbdf-345b-4ad4-8048-70ce9d0a4001 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:45:31.663959 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619cbdf-345b-4ad4-8048-70ce9d0a4001 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:45:31.674488 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4340/8717] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:45:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:45:32.236542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f78f5-2757-4c49-beb7-37ff5d105dfe None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:45:32.238253 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1d7f78f5-2757-4c49-beb7-37ff5d105dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:45:32.254248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f78f5-2757-4c49-beb7-37ff5d105dfe None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:45:32.259763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbea82-2df6-42d6-84f0-03167d08d765 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:45:32.260449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbea82-2df6-42d6-84f0-03167d08d765 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:45:32.260711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbea82-2df6-42d6-84f0-03167d08d765 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:45:32.260993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbea82-2df6-42d6-84f0-03167d08d765 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:45:32.263065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-86bbea82-2df6-42d6-84f0-03167d08d765 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:45:32.278250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbea82-2df6-42d6-84f0-03167d08d765 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:45:32.279867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbea82-2df6-42d6-84f0-03167d08d765 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:45:32.293215 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4378/8718] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:45:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:45:41.670498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:45:42.285927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=9 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:46:14.282742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619cbdf-345b-4ad4-8048-70ce9d0a4001 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:46:14.297800 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619cbdf-345b-4ad4-8048-70ce9d0a4001 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:46:14.303242 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087ba63-f9d5-4ea3-9e31-582e57e20e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:46:14.304495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087ba63-f9d5-4ea3-9e31-582e57e20e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:46:14.305531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087ba63-f9d5-4ea3-9e31-582e57e20e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:46:14.305998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087ba63-f9d5-4ea3-9e31-582e57e20e50 admin admin] PATH_INFO: `/v3/users/dde1c0b088674b45b74dff3367a491d1` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:46:14.307252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087ba63-f9d5-4ea3-9e31-582e57e20e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde1c0b088674b45b74dff3367a491d1)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:46:14.309444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087ba63-f9d5-4ea3-9e31-582e57e20e50 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:46:14.362503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8087ba63-f9d5-4ea3-9e31-582e57e20e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde1c0b088674b45b74dff3367a491d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:46:14.370344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8087ba63-f9d5-4ea3-9e31-582e57e20e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde1c0b088674b45b74dff3367a491d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:46:14.377567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8087ba63-f9d5-4ea3-9e31-582e57e20e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde1c0b088674b45b74dff3367a491d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:46:14.378206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8087ba63-f9d5-4ea3-9e31-582e57e20e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde1c0b088674b45b74dff3367a491d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:46:14.378872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8087ba63-f9d5-4ea3-9e31-582e57e20e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde1c0b088674b45b74dff3367a491d1'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:46:14.401377 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4341/8719] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:46:14 2022] DELETE /identity/v3/users/dde1c0b088674b45b74dff3367a491d1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:46:14.592017 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbea82-2df6-42d6-84f0-03167d08d765 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:46:14.603519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbea82-2df6-42d6-84f0-03167d08d765 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:46:14.667061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b32058-a45b-487a-b91e-86eafc9bb4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:46:14.667972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b32058-a45b-487a-b91e-86eafc9bb4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:46:14.668290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b32058-a45b-487a-b91e-86eafc9bb4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:46:14.668567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b32058-a45b-487a-b91e-86eafc9bb4fb admin admin] PATH_INFO: `/v3/projects/a9cfe7f066614ef9a09226654bd28c58` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:46:14.669814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b32058-a45b-487a-b91e-86eafc9bb4fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9cfe7f066614ef9a09226654bd28c58)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:46:14.671796 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b32058-a45b-487a-b91e-86eafc9bb4fb admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:46:14.721291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-23b32058-a45b-487a-b91e-86eafc9bb4fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9cfe7f066614ef9a09226654bd28c58', 'request_id': 'req-23b32058-a45b-487a-b91e-86eafc9bb4fb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:46:14.728977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-23b32058-a45b-487a-b91e-86eafc9bb4fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9cfe7f066614ef9a09226654bd28c58', 'request_id': 'req-23b32058-a45b-487a-b91e-86eafc9bb4fb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:46:14.735418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-23b32058-a45b-487a-b91e-86eafc9bb4fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9cfe7f066614ef9a09226654bd28c58', 'request_id': 'req-23b32058-a45b-487a-b91e-86eafc9bb4fb'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:46:14.745971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-23b32058-a45b-487a-b91e-86eafc9bb4fb admin admin] The token cache is being invalidate because project a9cfe7f066614ef9a09226654bd28c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:46:14.746261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-23b32058-a45b-487a-b91e-86eafc9bb4fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:46:14.746899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-23b32058-a45b-487a-b91e-86eafc9bb4fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:46:14.748531 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4379/8720] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:46:14 2022] DELETE /identity/v3/projects/a9cfe7f066614ef9a09226654bd28c58 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:46:14.753710 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ec1ef-0cb3-4b70-8439-4727cd8c24fe None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:46:14.754007 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ec1ef-0cb3-4b70-8439-4727cd8c24fe None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:46:14.754290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ec1ef-0cb3-4b70-8439-4727cd8c24fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:46:14.773902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e93ec1ef-0cb3-4b70-8439-4727cd8c24fe None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:46:14.775121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e93ec1ef-0cb3-4b70-8439-4727cd8c24fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:46:14.840972 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4342/8721] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:46:14.848940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bb1bc-e680-4547-9338-3f2a582470c9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:46:14.849230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bb1bc-e680-4547-9338-3f2a582470c9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:46:14.849513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bb1bc-e680-4547-9338-3f2a582470c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:46:14.868410 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e90bb1bc-e680-4547-9338-3f2a582470c9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:46:14.869631 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e90bb1bc-e680-4547-9338-3f2a582470c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:46:14.878239 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4380/8722] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:46:14.883554 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ec1ef-0cb3-4b70-8439-4727cd8c24fe None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:46:14.893723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ec1ef-0cb3-4b70-8439-4727cd8c24fe None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:46:14.899250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976137b8-55ba-46fc-a1f3-7f66d5a9cbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:46:14.899965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976137b8-55ba-46fc-a1f3-7f66d5a9cbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:46:14.900471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976137b8-55ba-46fc-a1f3-7f66d5a9cbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:46:14.900926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976137b8-55ba-46fc-a1f3-7f66d5a9cbf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:46:14.902034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976137b8-55ba-46fc-a1f3-7f66d5a9cbf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:46:14.902498 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976137b8-55ba-46fc-a1f3-7f66d5a9cbf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:46:14.905063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976137b8-55ba-46fc-a1f3-7f66d5a9cbf3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:46:14.918319 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4343/8723] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:46:14.923058 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bb1bc-e680-4547-9338-3f2a582470c9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:46:14.932385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bb1bc-e680-4547-9338-3f2a582470c9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:46:14.937539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13577a28-e4b7-4479-8d3f-957d644e69b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:46:14.938181 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13577a28-e4b7-4479-8d3f-957d644e69b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:46:14.938463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13577a28-e4b7-4479-8d3f-957d644e69b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:46:14.938734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13577a28-e4b7-4479-8d3f-957d644e69b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:46:14.939414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13577a28-e4b7-4479-8d3f-957d644e69b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:46:14.941374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13577a28-e4b7-4479-8d3f-957d644e69b4 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:46:14.969134 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4381/8724] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:46:14 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:46:14.973680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976137b8-55ba-46fc-a1f3-7f66d5a9cbf3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:46:14.984292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976137b8-55ba-46fc-a1f3-7f66d5a9cbf3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:46:15.045288 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24898e-acd7-45e9-b164-f60377c5ac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:46:15.045986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24898e-acd7-45e9-b164-f60377c5ac3e admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:46:15.046250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24898e-acd7-45e9-b164-f60377c5ac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:46:15.046496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24898e-acd7-45e9-b164-f60377c5ac3e admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:46:15.047196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24898e-acd7-45e9-b164-f60377c5ac3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:46:15.049143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24898e-acd7-45e9-b164-f60377c5ac3e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:46:15.055944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:46:15.073461 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4344/8725] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:46:14 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:46:15.077145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13577a28-e4b7-4479-8d3f-957d644e69b4 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:46:15.088513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13577a28-e4b7-4479-8d3f-957d644e69b4 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:46:15.093673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16ac39-b6ef-4845-808c-5886a95494f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:46:15.094285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16ac39-b6ef-4845-808c-5886a95494f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:46:15.094606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16ac39-b6ef-4845-808c-5886a95494f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:46:15.094888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16ac39-b6ef-4845-808c-5886a95494f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:46:15.095650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16ac39-b6ef-4845-808c-5886a95494f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:46:15.097232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16ac39-b6ef-4845-808c-5886a95494f3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:46:15.109938 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4382/8726] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:46:15.114373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24898e-acd7-45e9-b164-f60377c5ac3e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:46:15.125447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24898e-acd7-45e9-b164-f60377c5ac3e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:46:15.131289 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb517f2f-baf2-4d5a-930b-6bcae66f8c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:46:15.131956 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb517f2f-baf2-4d5a-930b-6bcae66f8c1b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:46:15.132272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb517f2f-baf2-4d5a-930b-6bcae66f8c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:46:15.132550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb517f2f-baf2-4d5a-930b-6bcae66f8c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:46:15.133269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb517f2f-baf2-4d5a-930b-6bcae66f8c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:46:15.134880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb517f2f-baf2-4d5a-930b-6bcae66f8c1b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:46:15.145609 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4345/8727] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:46:15.149905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16ac39-b6ef-4845-808c-5886a95494f3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:46:15.160139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16ac39-b6ef-4845-808c-5886a95494f3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:46:15.165446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9cc1b-fbc9-43fa-a449-a63708b8c843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:46:15.166326 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9cc1b-fbc9-43fa-a449-a63708b8c843 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:46:15.166600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9cc1b-fbc9-43fa-a449-a63708b8c843 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:46:15.166868 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9cc1b-fbc9-43fa-a449-a63708b8c843 admin admin] PATH_INFO: `/v3/projects/9b8a33f323614b27850f584b9600f12d/users/9d9fe7d5b9094981a3ee9ab8456cc467/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:46:15.181926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9cc1b-fbc9-43fa-a449-a63708b8c843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b8a33f323614b27850f584b9600f12d, user_id=9d9fe7d5b9094981a3ee9ab8456cc467, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:46:15.184619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9cc1b-fbc9-43fa-a449-a63708b8c843 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:46:15.199575 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4383/8728] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:46:15 2022] PUT /identity/v3/projects/9b8a33f323614b27850f584b9600f12d/users/9d9fe7d5b9094981a3ee9ab8456cc467/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:46:15.204841 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6beca-a1c7-4816-be58-25bfe63218a7 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:46:15.205135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6beca-a1c7-4816-be58-25bfe63218a7 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:46:15.205409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6beca-a1c7-4816-be58-25bfe63218a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:46:15.224470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6fb6beca-a1c7-4816-be58-25bfe63218a7 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:46:15.225672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6fb6beca-a1c7-4816-be58-25bfe63218a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:46:15.292226 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4346/8729] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:46:15.303293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9cc1b-fbc9-43fa-a449-a63708b8c843 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:46:15.305283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-04d9cc1b-fbc9-43fa-a449-a63708b8c843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:46:15.338495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:46:15.371374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9cc1b-fbc9-43fa-a449-a63708b8c843 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:46:15.375989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe649962-d318-452b-8e4e-cbf70e046aa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:46:15.376675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe649962-d318-452b-8e4e-cbf70e046aa8 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:46:15.376951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe649962-d318-452b-8e4e-cbf70e046aa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:46:15.377227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe649962-d318-452b-8e4e-cbf70e046aa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:46:15.386844 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe649962-d318-452b-8e4e-cbf70e046aa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:46:15.388325 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe649962-d318-452b-8e4e-cbf70e046aa8 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:46:15.398559 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4384/8730] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:46:19.912241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d634e-d4cf-4189-92dc-966b40ba4853 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:46:19.913540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d634e-d4cf-4189-92dc-966b40ba4853 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:46:19.914223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d634e-d4cf-4189-92dc-966b40ba4853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:46:19.948319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e91d634e-d4cf-4189-92dc-966b40ba4853 None None] MFA Rules not processed for user `9d9fe7d5b9094981a3ee9ab8456cc467`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:46:19.949574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e91d634e-d4cf-4189-92dc-966b40ba4853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:46:20.013853 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4347/8731] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:46:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:46:20.027850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe649962-d318-452b-8e4e-cbf70e046aa8 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:46:20.029925 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fe649962-d318-452b-8e4e-cbf70e046aa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:46:20.122404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe649962-d318-452b-8e4e-cbf70e046aa8 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:46:20.128426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1246f1c-0037-4bfa-8d16-8734bd801b2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:46:20.129082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1246f1c-0037-4bfa-8d16-8734bd801b2f service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:46:20.129362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1246f1c-0037-4bfa-8d16-8734bd801b2f service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:46:20.129634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1246f1c-0037-4bfa-8d16-8734bd801b2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:46:20.138002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1246f1c-0037-4bfa-8d16-8734bd801b2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:46:20.139600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1246f1c-0037-4bfa-8d16-8734bd801b2f service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:46:20.149868 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4385/8732] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:46:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:46:21.506373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439552d7-ed4e-44e0-82e4-b9dc9251f14b None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:46:21.507340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439552d7-ed4e-44e0-82e4-b9dc9251f14b None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:46:21.507677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439552d7-ed4e-44e0-82e4-b9dc9251f14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:46:21.527537 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-439552d7-ed4e-44e0-82e4-b9dc9251f14b None None] MFA Rules not processed for user `9d9fe7d5b9094981a3ee9ab8456cc467`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:46:21.529957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-439552d7-ed4e-44e0-82e4-b9dc9251f14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:46:21.544618 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4348/8733] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:46:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:46:30.145600 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=48 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:46:31.521033 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:47:12.261146 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e07f0-3599-41c4-83ee-c96e2b7ca4b8 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:47:12.261706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e07f0-3599-41c4-83ee-c96e2b7ca4b8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:47:12.261706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e07f0-3599-41c4-83ee-c96e2b7ca4b8 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:47:12.263023 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4386/8734] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:47:12.268150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253b4c4-e43a-4ab7-a148-7998920c6934 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:47:12.268624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253b4c4-e43a-4ab7-a148-7998920c6934 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:47:12.268725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253b4c4-e43a-4ab7-a148-7998920c6934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:47:12.286702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b253b4c4-e43a-4ab7-a148-7998920c6934 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:47:12.287927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b253b4c4-e43a-4ab7-a148-7998920c6934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:47:12.353490 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4349/8735] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:47:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:47:12.374676 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e07f0-3599-41c4-83ee-c96e2b7ca4b8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:47:12.376586 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2b6e07f0-3599-41c4-83ee-c96e2b7ca4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:47:12.397883 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e07f0-3599-41c4-83ee-c96e2b7ca4b8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:47:12.403502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9a3cf-30cf-438a-a466-b7aacb116620 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:47:12.404172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9a3cf-30cf-438a-a466-b7aacb116620 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:47:12.404449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9a3cf-30cf-438a-a466-b7aacb116620 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:47:12.404693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9a3cf-30cf-438a-a466-b7aacb116620 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:47:12.413431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9a3cf-30cf-438a-a466-b7aacb116620 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:47:12.415394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9a3cf-30cf-438a-a466-b7aacb116620 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:47:12.425491 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4387/8736] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:47:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:47:13.364439 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253b4c4-e43a-4ab7-a148-7998920c6934 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:47:13.366054 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b253b4c4-e43a-4ab7-a148-7998920c6934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:47:13.380634 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253b4c4-e43a-4ab7-a148-7998920c6934 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:47:13.384335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9324acc-0a14-4865-8fe2-b558f09c3f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:47:13.384981 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9324acc-0a14-4865-8fe2-b558f09c3f03 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:47:13.385268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9324acc-0a14-4865-8fe2-b558f09c3f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:47:13.385540 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9324acc-0a14-4865-8fe2-b558f09c3f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:47:13.387324 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d9324acc-0a14-4865-8fe2-b558f09c3f03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:47:13.403784 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9324acc-0a14-4865-8fe2-b558f09c3f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:47:13.405271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9324acc-0a14-4865-8fe2-b558f09c3f03 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:47:13.420197 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4350/8737] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:47:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:47:14.613759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9a3cf-30cf-438a-a466-b7aacb116620 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:47:14.626503 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9a3cf-30cf-438a-a466-b7aacb116620 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:47:14.631398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96195904-080d-4387-b867-8d9b1a8d966e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:47:14.632083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96195904-080d-4387-b867-8d9b1a8d966e service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:47:14.632362 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96195904-080d-4387-b867-8d9b1a8d966e service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:47:14.632641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96195904-080d-4387-b867-8d9b1a8d966e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:47:14.634675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-96195904-080d-4387-b867-8d9b1a8d966e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:47:14.652537 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96195904-080d-4387-b867-8d9b1a8d966e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:47:14.653981 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96195904-080d-4387-b867-8d9b1a8d966e service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:47:14.667767 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4388/8738] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:47:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:47:23.412163 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=35 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:47:24.660517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=12 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:47:42.390399 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030f9b0-eebd-4d39-af62-cad3152787b8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:47:42.390986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030f9b0-eebd-4d39-af62-cad3152787b8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:47:42.390986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030f9b0-eebd-4d39-af62-cad3152787b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:47:42.409444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-a030f9b0-eebd-4d39-af62-cad3152787b8 None None] MFA Rules not processed for user `9d9fe7d5b9094981a3ee9ab8456cc467`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:47:42.410826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-a030f9b0-eebd-4d39-af62-cad3152787b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:47:42.418884 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4351/8739] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:47:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:47:52.404536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:47:55.285972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96195904-080d-4387-b867-8d9b1a8d966e service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:47:55.313350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96195904-080d-4387-b867-8d9b1a8d966e service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:47:55.320940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcab19-30f1-44ab-95c5-17a05a0e912f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:47:55.321888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcab19-30f1-44ab-95c5-17a05a0e912f service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:47:55.322324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcab19-30f1-44ab-95c5-17a05a0e912f service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:47:55.322767 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcab19-30f1-44ab-95c5-17a05a0e912f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:47:55.325015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-80bcab19-30f1-44ab-95c5-17a05a0e912f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:47:55.343378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcab19-30f1-44ab-95c5-17a05a0e912f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:47:55.345372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcab19-30f1-44ab-95c5-17a05a0e912f service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:47:55.363050 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4389/8740] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:47:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:48:05.356609 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=10 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:49:17.295251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56c53d-6604-42af-a187-5bbbbcc5ea4a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:49:17.295911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56c53d-6604-42af-a187-5bbbbcc5ea4a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:49:17.296343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56c53d-6604-42af-a187-5bbbbcc5ea4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:49:17.339960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-ac56c53d-6604-42af-a187-5bbbbcc5ea4a None None] MFA Rules not processed for user `684732cf5a004fb084ce0e523398c970`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:49:17.341251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ac56c53d-6604-42af-a187-5bbbbcc5ea4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:49:17.367038 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4352/8741] 10.222.0.43 () {58 vars in 1061 bytes} [Sat Jul 2 21:49:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:49:17.368459 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcab19-30f1-44ab-95c5-17a05a0e912f service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:49:17.378209 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcab19-30f1-44ab-95c5-17a05a0e912f service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:49:17.382172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f0e3f-53bb-4d34-acbe-bb0c86be3b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:49:17.382851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f0e3f-53bb-4d34-acbe-bb0c86be3b3b service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:49:17.383134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f0e3f-53bb-4d34-acbe-bb0c86be3b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:49:17.383420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f0e3f-53bb-4d34-acbe-bb0c86be3b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:49:17.385235 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b26f0e3f-53bb-4d34-acbe-bb0c86be3b3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:49:17.398590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f0e3f-53bb-4d34-acbe-bb0c86be3b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:49:17.400066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f0e3f-53bb-4d34-acbe-bb0c86be3b3b service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:49:17.411714 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4390/8742] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:49:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:49:17.489942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9fd6f-5430-435a-a911-1be838e642f1 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:49:17.490313 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9fd6f-5430-435a-a911-1be838e642f1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:49:17.490601 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9fd6f-5430-435a-a911-1be838e642f1 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:49:17.492018 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4353/8743] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:49:17.497348 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511a072-b761-46f9-beba-afadb959f006 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:49:17.497583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511a072-b761-46f9-beba-afadb959f006 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:49:17.497865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511a072-b761-46f9-beba-afadb959f006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:49:17.516906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e511a072-b761-46f9-beba-afadb959f006 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:49:17.518170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e511a072-b761-46f9-beba-afadb959f006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:49:17.539130 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4391/8744] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:49:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:49:17.561520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9fd6f-5430-435a-a911-1be838e642f1 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:49:17.563598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-eff9fd6f-5430-435a-a911-1be838e642f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:49:17.587176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9fd6f-5430-435a-a911-1be838e642f1 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:49:17.592649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7056043-1811-4564-aa59-15c9df373734 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:49:17.593298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7056043-1811-4564-aa59-15c9df373734 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:49:17.593577 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7056043-1811-4564-aa59-15c9df373734 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:49:17.593848 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7056043-1811-4564-aa59-15c9df373734 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:49:17.602759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7056043-1811-4564-aa59-15c9df373734 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:49:17.604552 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7056043-1811-4564-aa59-15c9df373734 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:49:17.614860 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4354/8745] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:49:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:49:17.795885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511a072-b761-46f9-beba-afadb959f006 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:49:17.805618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511a072-b761-46f9-beba-afadb959f006 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:49:17.809744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab05823-c4c9-46bc-a4da-635d498856bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:49:17.810385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab05823-c4c9-46bc-a4da-635d498856bc service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:49:17.810666 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab05823-c4c9-46bc-a4da-635d498856bc service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:49:17.810938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab05823-c4c9-46bc-a4da-635d498856bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:49:17.813154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7ab05823-c4c9-46bc-a4da-635d498856bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:49:17.830583 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab05823-c4c9-46bc-a4da-635d498856bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:49:17.832067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab05823-c4c9-46bc-a4da-635d498856bc service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:49:17.846267 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4392/8746] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:49:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:49:17.901774 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888e4ce-c8f7-42a2-8884-f2d85ab723cf None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:49:17.902094 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888e4ce-c8f7-42a2-8884-f2d85ab723cf None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:49:17.902376 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888e4ce-c8f7-42a2-8884-f2d85ab723cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:49:17.921982 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6888e4ce-c8f7-42a2-8884-f2d85ab723cf None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:49:17.923269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6888e4ce-c8f7-42a2-8884-f2d85ab723cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:49:17.932361 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4355/8747] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:49:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:49:17.943797 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab05823-c4c9-46bc-a4da-635d498856bc service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:49:17.958432 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab05823-c4c9-46bc-a4da-635d498856bc service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:49:17.964742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a905b6-a172-45d6-94cd-b97c9fc83d0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:49:17.965387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a905b6-a172-45d6-94cd-b97c9fc83d0a service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:49:17.965668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a905b6-a172-45d6-94cd-b97c9fc83d0a service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:49:17.965948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a905b6-a172-45d6-94cd-b97c9fc83d0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:49:17.975173 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a905b6-a172-45d6-94cd-b97c9fc83d0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:49:17.976931 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a905b6-a172-45d6-94cd-b97c9fc83d0a service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:49:17.987075 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4393/8748] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:49:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:49:19.046653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ea1fe-26b5-4b03-a3d8-21ffdce1ffdc None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:49:19.047257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ea1fe-26b5-4b03-a3d8-21ffdce1ffdc None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:49:19.047257 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ea1fe-26b5-4b03-a3d8-21ffdce1ffdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:49:19.067037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-785ea1fe-26b5-4b03-a3d8-21ffdce1ffdc None None] MFA Rules not processed for user `684732cf5a004fb084ce0e523398c970`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:49:19.068296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-785ea1fe-26b5-4b03-a3d8-21ffdce1ffdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:49:19.075896 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4356/8749] 10.222.0.43 () {58 vars in 1061 bytes} [Sat Jul 2 21:49:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:49:19.082210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a905b6-a172-45d6-94cd-b97c9fc83d0a service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:49:19.093002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a905b6-a172-45d6-94cd-b97c9fc83d0a service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:49:19.097297 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e600ff8-b99e-468f-97bc-367859e23830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:49:19.097944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e600ff8-b99e-468f-97bc-367859e23830 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:49:19.098218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e600ff8-b99e-468f-97bc-367859e23830 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:49:19.098494 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e600ff8-b99e-468f-97bc-367859e23830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:49:19.100418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1e600ff8-b99e-468f-97bc-367859e23830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:49:19.112980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e600ff8-b99e-468f-97bc-367859e23830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:49:19.114414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e600ff8-b99e-468f-97bc-367859e23830 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:49:19.124796 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4394/8750] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:49:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:49:21.928115 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ea1fe-26b5-4b03-a3d8-21ffdce1ffdc None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:49:21.937606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ea1fe-26b5-4b03-a3d8-21ffdce1ffdc None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:49:21.942283 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e600ff8-b99e-468f-97bc-367859e23830 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:49:21.942745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b55ac2-9ad1-4e87-ad63-e6df0a555771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:49:21.942930 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b55ac2-9ad1-4e87-ad63-e6df0a555771 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:49:21.943240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b55ac2-9ad1-4e87-ad63-e6df0a555771 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:49:21.943512 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b55ac2-9ad1-4e87-ad63-e6df0a555771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:49:21.945389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e7b55ac2-9ad1-4e87-ad63-e6df0a555771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:49:21.957534 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e600ff8-b99e-468f-97bc-367859e23830 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:49:21.958140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b55ac2-9ad1-4e87-ad63-e6df0a555771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:49:21.959590 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b55ac2-9ad1-4e87-ad63-e6df0a555771 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:49:21.963072 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21498f2-51e5-46da-baa2-f0093285eabb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:49:21.963731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21498f2-51e5-46da-baa2-f0093285eabb service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:49:21.964011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21498f2-51e5-46da-baa2-f0093285eabb service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:49:21.964346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21498f2-51e5-46da-baa2-f0093285eabb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:49:21.966139 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e21498f2-51e5-46da-baa2-f0093285eabb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:49:21.971342 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4357/8751] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:49:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:49:21.981292 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21498f2-51e5-46da-baa2-f0093285eabb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:49:21.982927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21498f2-51e5-46da-baa2-f0093285eabb service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:49:22.003672 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4395/8752] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:49:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:49:28.324190 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b55ac2-9ad1-4e87-ad63-e6df0a555771 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:49:28.342006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b55ac2-9ad1-4e87-ad63-e6df0a555771 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:49:28.349675 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111aad7-f88f-48a9-955f-b4ee28ba8079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:49:28.350341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111aad7-f88f-48a9-955f-b4ee28ba8079 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:49:28.350621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111aad7-f88f-48a9-955f-b4ee28ba8079 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:49:28.350893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111aad7-f88f-48a9-955f-b4ee28ba8079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:49:28.353223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2111aad7-f88f-48a9-955f-b4ee28ba8079 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:49:28.369526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111aad7-f88f-48a9-955f-b4ee28ba8079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:49:28.371239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111aad7-f88f-48a9-955f-b4ee28ba8079 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:49:28.388778 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4358/8753] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:49:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:49:31.996260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=37 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:49:33.771562 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fbdc0-fc06-4bab-9fc9-538e1301adaf None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:49:33.772217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fbdc0-fc06-4bab-9fc9-538e1301adaf None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:49:33.772217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fbdc0-fc06-4bab-9fc9-538e1301adaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:49:33.791234 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f74fbdc0-fc06-4bab-9fc9-538e1301adaf None None] MFA Rules not processed for user `9d9fe7d5b9094981a3ee9ab8456cc467`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:49:33.792508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f74fbdc0-fc06-4bab-9fc9-538e1301adaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:49:33.800430 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4396/8754] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:49:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:49:34.116846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111aad7-f88f-48a9-955f-b4ee28ba8079 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:49:34.127936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111aad7-f88f-48a9-955f-b4ee28ba8079 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:49:34.133334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7700a31-9390-4501-b841-350641b22f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:49:34.133983 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7700a31-9390-4501-b841-350641b22f49 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:49:34.134267 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7700a31-9390-4501-b841-350641b22f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:49:34.134667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7700a31-9390-4501-b841-350641b22f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:49:34.137018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f7700a31-9390-4501-b841-350641b22f49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:49:34.150670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7700a31-9390-4501-b841-350641b22f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:49:34.152159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7700a31-9390-4501-b841-350641b22f49 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:49:34.163591 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4359/8755] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:49:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:49:34.473102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5242ab-0bdf-4c1c-bfe8-9ff77ed70dcf None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:49:34.473396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5242ab-0bdf-4c1c-bfe8-9ff77ed70dcf None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:49:34.473705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5242ab-0bdf-4c1c-bfe8-9ff77ed70dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:49:34.493599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2f5242ab-0bdf-4c1c-bfe8-9ff77ed70dcf None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:49:34.494835 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2f5242ab-0bdf-4c1c-bfe8-9ff77ed70dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:49:34.503879 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4397/8756] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:49:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:49:34.515933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7700a31-9390-4501-b841-350641b22f49 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:49:34.534184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7700a31-9390-4501-b841-350641b22f49 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:49:34.539644 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a692e1c-c697-40d2-b809-3b9a70b026fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:49:34.540334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a692e1c-c697-40d2-b809-3b9a70b026fa service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:49:34.540621 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a692e1c-c697-40d2-b809-3b9a70b026fa service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:49:34.540899 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a692e1c-c697-40d2-b809-3b9a70b026fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:49:34.549474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a692e1c-c697-40d2-b809-3b9a70b026fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:49:34.551064 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a692e1c-c697-40d2-b809-3b9a70b026fa service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:49:34.560719 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4360/8757] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:49:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:49:37.407210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5242ab-0bdf-4c1c-bfe8-9ff77ed70dcf None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:49:37.411892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2f5242ab-0bdf-4c1c-bfe8-9ff77ed70dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:49:37.435584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5242ab-0bdf-4c1c-bfe8-9ff77ed70dcf None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:49:37.442702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95847c27-5837-44e8-becd-f29d02db99c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:49:37.444190 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95847c27-5837-44e8-becd-f29d02db99c5 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:49:37.444629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95847c27-5837-44e8-becd-f29d02db99c5 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:49:37.445042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95847c27-5837-44e8-becd-f29d02db99c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:49:37.447356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-95847c27-5837-44e8-becd-f29d02db99c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:49:37.463706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95847c27-5837-44e8-becd-f29d02db99c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:49:37.465386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95847c27-5837-44e8-becd-f29d02db99c5 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:49:37.480899 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4398/8758] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:49:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:49:44.556946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=49 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:49:47.472567 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=12 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:50:36.007182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a692e1c-c697-40d2-b809-3b9a70b026fa service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:50:36.021143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a692e1c-c697-40d2-b809-3b9a70b026fa service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:50:36.027245 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d26160-2fed-4782-b154-7f41343e11bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:50:36.027885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d26160-2fed-4782-b154-7f41343e11bf service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:50:36.028198 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d26160-2fed-4782-b154-7f41343e11bf service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:50:36.028469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d26160-2fed-4782-b154-7f41343e11bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:50:36.030767 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f1d26160-2fed-4782-b154-7f41343e11bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:50:36.045978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d26160-2fed-4782-b154-7f41343e11bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:50:36.047566 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d26160-2fed-4782-b154-7f41343e11bf service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:50:36.060550 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4361/8759] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:50:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:50:46.053742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:50:58.480346 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39eb05-b703-4ccb-9ec6-7200f4421879 None None] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:50:58.480936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39eb05-b703-4ccb-9ec6-7200f4421879 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:50:58.480936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39eb05-b703-4ccb-9ec6-7200f4421879 None None] PATH_INFO: `/` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:50:58.482330 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4399/8760] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 21:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 21:50:58.487316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b290e-3945-40c1-a070-1e581b1d7257 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:50:58.487766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b290e-3945-40c1-a070-1e581b1d7257 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:50:58.487870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b290e-3945-40c1-a070-1e581b1d7257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:50:58.506472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d35b290e-3945-40c1-a070-1e581b1d7257 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:50:58.507695 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d35b290e-3945-40c1-a070-1e581b1d7257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:50:58.517036 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4362/8761] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:50:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:50:58.537143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39eb05-b703-4ccb-9ec6-7200f4421879 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:50:58.553714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39eb05-b703-4ccb-9ec6-7200f4421879 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:50:58.558628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef0d1e-ca18-4f55-a211-9fcdef49f05b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:50:58.559265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef0d1e-ca18-4f55-a211-9fcdef49f05b service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:50:58.559557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef0d1e-ca18-4f55-a211-9fcdef49f05b service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:50:58.559832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef0d1e-ca18-4f55-a211-9fcdef49f05b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:50:58.568218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef0d1e-ca18-4f55-a211-9fcdef49f05b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:50:58.569849 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef0d1e-ca18-4f55-a211-9fcdef49f05b service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:50:58.580118 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4400/8762] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:50:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:51:08.501155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:51:08.575926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:51:20.173102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b290e-3945-40c1-a070-1e581b1d7257 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:51:20.197329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b290e-3945-40c1-a070-1e581b1d7257 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:51:20.202865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa042f2-c806-463c-94da-7c53d4acb922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:51:20.203529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa042f2-c806-463c-94da-7c53d4acb922 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:51:20.203813 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa042f2-c806-463c-94da-7c53d4acb922 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:51:20.204119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa042f2-c806-463c-94da-7c53d4acb922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:51:20.213042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa042f2-c806-463c-94da-7c53d4acb922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:51:20.214640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa042f2-c806-463c-94da-7c53d4acb922 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:51:20.224066 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4363/8763] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:51:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:51:29.354244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637e437-7beb-458c-9be6-159e86498d55 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:51:29.354770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637e437-7beb-458c-9be6-159e86498d55 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:51:29.354770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637e437-7beb-458c-9be6-159e86498d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:51:29.373721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0637e437-7beb-458c-9be6-159e86498d55 None None] MFA Rules not processed for user `9d9fe7d5b9094981a3ee9ab8456cc467`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:51:29.374926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0637e437-7beb-458c-9be6-159e86498d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:51:29.383528 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4401/8764] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:51:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:51:30.219630 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:51:39.367845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:22.791002 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa042f2-c806-463c-94da-7c53d4acb922 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:52:22.812976 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa042f2-c806-463c-94da-7c53d4acb922 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:52:22.817513 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d109e-2235-44d3-9b23-111e6dfbf0a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:52:22.818156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d109e-2235-44d3-9b23-111e6dfbf0a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:22.818437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d109e-2235-44d3-9b23-111e6dfbf0a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:22.818716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d109e-2235-44d3-9b23-111e6dfbf0a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:22.862706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d109e-2235-44d3-9b23-111e6dfbf0a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:52:22.864194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d109e-2235-44d3-9b23-111e6dfbf0a8 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:52:22.878378 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4364/8765] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:52:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:52:24.531022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637e437-7beb-458c-9be6-159e86498d55 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:52:24.545691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637e437-7beb-458c-9be6-159e86498d55 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:52:24.550019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9ef96-53d6-48ee-bfa1-1d275bc4735f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:52:24.550677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9ef96-53d6-48ee-bfa1-1d275bc4735f service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:24.550964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9ef96-53d6-48ee-bfa1-1d275bc4735f service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:24.551244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9ef96-53d6-48ee-bfa1-1d275bc4735f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:24.565008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9ef96-53d6-48ee-bfa1-1d275bc4735f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:52:24.566489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9ef96-53d6-48ee-bfa1-1d275bc4735f service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:52:24.580337 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4402/8766] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:52:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:52:28.761782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d109e-2235-44d3-9b23-111e6dfbf0a8 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:52:28.770793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d109e-2235-44d3-9b23-111e6dfbf0a8 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:52:28.774812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdfee9-e586-426f-a778-e55380469152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:52:28.775456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdfee9-e586-426f-a778-e55380469152 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:28.775738 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdfee9-e586-426f-a778-e55380469152 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:28.776011 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdfee9-e586-426f-a778-e55380469152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:28.785829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffdfee9-e586-426f-a778-e55380469152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:52:28.787320 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffdfee9-e586-426f-a778-e55380469152 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:52:28.816472 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4365/8767] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:52:32.007120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9ef96-53d6-48ee-bfa1-1d275bc4735f service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:52:32.021018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9ef96-53d6-48ee-bfa1-1d275bc4735f service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:52:32.026736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e684a9-5b77-4d41-b465-0eba3eda49b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:52:32.027527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e684a9-5b77-4d41-b465-0eba3eda49b0 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:32.027810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e684a9-5b77-4d41-b465-0eba3eda49b0 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:32.028117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e684a9-5b77-4d41-b465-0eba3eda49b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:32.030264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-57e684a9-5b77-4d41-b465-0eba3eda49b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:52:32.072921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e684a9-5b77-4d41-b465-0eba3eda49b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:52:32.074581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e684a9-5b77-4d41-b465-0eba3eda49b0 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:52:32.090738 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4403/8768] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:52:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:52:32.098894 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdfee9-e586-426f-a778-e55380469152 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:52:32.115081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdfee9-e586-426f-a778-e55380469152 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:52:32.119840 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582d97b-ac97-4b6b-8226-14aa144b69e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:52:32.120780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582d97b-ac97-4b6b-8226-14aa144b69e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:32.121061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582d97b-ac97-4b6b-8226-14aa144b69e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:32.121335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582d97b-ac97-4b6b-8226-14aa144b69e6 admin admin] PATH_INFO: `/v3/users/9d9fe7d5b9094981a3ee9ab8456cc467` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:32.122553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582d97b-ac97-4b6b-8226-14aa144b69e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d9fe7d5b9094981a3ee9ab8456cc467)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:52:32.124648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582d97b-ac97-4b6b-8226-14aa144b69e6 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:52:32.177344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c582d97b-ac97-4b6b-8226-14aa144b69e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d9fe7d5b9094981a3ee9ab8456cc467'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:52:32.185567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c582d97b-ac97-4b6b-8226-14aa144b69e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d9fe7d5b9094981a3ee9ab8456cc467'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:52:32.192438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c582d97b-ac97-4b6b-8226-14aa144b69e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d9fe7d5b9094981a3ee9ab8456cc467'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:52:32.193042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c582d97b-ac97-4b6b-8226-14aa144b69e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d9fe7d5b9094981a3ee9ab8456cc467'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:52:32.193635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-c582d97b-ac97-4b6b-8226-14aa144b69e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d9fe7d5b9094981a3ee9ab8456cc467'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:52:32.210572 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4366/8769] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:52:32 2022] DELETE /identity/v3/users/9d9fe7d5b9094981a3ee9ab8456cc467 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:52:32.387202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e684a9-5b77-4d41-b465-0eba3eda49b0 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:52:32.400677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e684a9-5b77-4d41-b465-0eba3eda49b0 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:52:32.467591 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca28cc8-9e54-4f1b-a5ba-5daf17e9a031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:52:32.468501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca28cc8-9e54-4f1b-a5ba-5daf17e9a031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:32.468779 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca28cc8-9e54-4f1b-a5ba-5daf17e9a031 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:32.469051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca28cc8-9e54-4f1b-a5ba-5daf17e9a031 admin admin] PATH_INFO: `/v3/projects/9b8a33f323614b27850f584b9600f12d` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:32.470218 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca28cc8-9e54-4f1b-a5ba-5daf17e9a031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b8a33f323614b27850f584b9600f12d)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:52:32.472177 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca28cc8-9e54-4f1b-a5ba-5daf17e9a031 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:52:32.519596 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5ca28cc8-9e54-4f1b-a5ba-5daf17e9a031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b8a33f323614b27850f584b9600f12d', 'request_id': 'req-5ca28cc8-9e54-4f1b-a5ba-5daf17e9a031'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:52:32.526722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5ca28cc8-9e54-4f1b-a5ba-5daf17e9a031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b8a33f323614b27850f584b9600f12d', 'request_id': 'req-5ca28cc8-9e54-4f1b-a5ba-5daf17e9a031'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:52:32.533910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5ca28cc8-9e54-4f1b-a5ba-5daf17e9a031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b8a33f323614b27850f584b9600f12d', 'request_id': 'req-5ca28cc8-9e54-4f1b-a5ba-5daf17e9a031'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:52:32.556066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5ca28cc8-9e54-4f1b-a5ba-5daf17e9a031 admin admin] The token cache is being invalidate because project 9b8a33f323614b27850f584b9600f12d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:52:32.556384 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5ca28cc8-9e54-4f1b-a5ba-5daf17e9a031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:52:32.557079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-5ca28cc8-9e54-4f1b-a5ba-5daf17e9a031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:52:32.558701 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4404/8770] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:52:32 2022] DELETE /identity/v3/projects/9b8a33f323614b27850f584b9600f12d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:52:32.563971 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6dea2-1f11-4a14-b054-4f73e4c430cf None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:32.564295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6dea2-1f11-4a14-b054-4f73e4c430cf None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:32.564567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6dea2-1f11-4a14-b054-4f73e4c430cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:32.622864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-80c6dea2-1f11-4a14-b054-4f73e4c430cf None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:52:32.624114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-80c6dea2-1f11-4a14-b054-4f73e4c430cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:52:32.641560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:32.687619 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4367/8771] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:52:32.695644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fd155-53c6-4800-a4a0-a80f95e21244 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:32.695964 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fd155-53c6-4800-a4a0-a80f95e21244 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:32.696272 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fd155-53c6-4800-a4a0-a80f95e21244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:32.714334 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-e18fd155-53c6-4800-a4a0-a80f95e21244 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:52:32.715535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-e18fd155-53c6-4800-a4a0-a80f95e21244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:52:32.724189 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4405/8772] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:52:32.728440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6dea2-1f11-4a14-b054-4f73e4c430cf None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:52:32.738459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6dea2-1f11-4a14-b054-4f73e4c430cf None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:52:32.743624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a592b76-7f2b-4159-b2d9-aa9cab5a81ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:52:32.744315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a592b76-7f2b-4159-b2d9-aa9cab5a81ba admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:32.744597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a592b76-7f2b-4159-b2d9-aa9cab5a81ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:32.744872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a592b76-7f2b-4159-b2d9-aa9cab5a81ba admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:32.745603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a592b76-7f2b-4159-b2d9-aa9cab5a81ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:52:32.745903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a592b76-7f2b-4159-b2d9-aa9cab5a81ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:52:32.747503 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a592b76-7f2b-4159-b2d9-aa9cab5a81ba admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:52:32.762905 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4368/8773] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:52:32.767100 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fd155-53c6-4800-a4a0-a80f95e21244 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:52:32.776532 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fd155-53c6-4800-a4a0-a80f95e21244 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:52:32.782041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5e4d4-8864-4a43-8a21-a455f40e879e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:52:32.782679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5e4d4-8864-4a43-8a21-a455f40e879e admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:32.782953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5e4d4-8864-4a43-8a21-a455f40e879e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:32.783227 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5e4d4-8864-4a43-8a21-a455f40e879e admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:32.783899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5e4d4-8864-4a43-8a21-a455f40e879e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:52:32.785842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5e4d4-8864-4a43-8a21-a455f40e879e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:52:32.809500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:32.825633 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4406/8774] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:52:32 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:52:32.829932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a592b76-7f2b-4159-b2d9-aa9cab5a81ba admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:52:32.840750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a592b76-7f2b-4159-b2d9-aa9cab5a81ba admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:52:32.902475 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f84e1-e516-40d3-8420-17d7192bd05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:52:32.903142 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f84e1-e516-40d3-8420-17d7192bd05b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:32.903429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f84e1-e516-40d3-8420-17d7192bd05b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:32.903711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f84e1-e516-40d3-8420-17d7192bd05b admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:32.904430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f84e1-e516-40d3-8420-17d7192bd05b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:52:32.906344 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f84e1-e516-40d3-8420-17d7192bd05b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:52:32.928549 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4369/8775] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:52:32 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:52:32.934525 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5e4d4-8864-4a43-8a21-a455f40e879e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:52:32.950910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5e4d4-8864-4a43-8a21-a455f40e879e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:52:32.955941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3551c-6652-4667-b832-54042ff8d6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:52:32.956647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3551c-6652-4667-b832-54042ff8d6ee admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:32.956932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3551c-6652-4667-b832-54042ff8d6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:32.957208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3551c-6652-4667-b832-54042ff8d6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:32.957929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3551c-6652-4667-b832-54042ff8d6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:52:32.959553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3551c-6652-4667-b832-54042ff8d6ee admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:52:32.969545 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4407/8776] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:52:32.973551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f84e1-e516-40d3-8420-17d7192bd05b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:52:32.984023 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f84e1-e516-40d3-8420-17d7192bd05b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:52:32.989135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba40b4f-71a5-47f9-bc14-0a4962cd8fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:52:32.989763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba40b4f-71a5-47f9-bc14-0a4962cd8fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:32.990045 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba40b4f-71a5-47f9-bc14-0a4962cd8fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:32.990319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba40b4f-71a5-47f9-bc14-0a4962cd8fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:32.991040 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba40b4f-71a5-47f9-bc14-0a4962cd8fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:52:32.992678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba40b4f-71a5-47f9-bc14-0a4962cd8fe9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:52:33.004515 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4370/8777] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:52:33.008766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3551c-6652-4667-b832-54042ff8d6ee admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:52:33.019329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3551c-6652-4667-b832-54042ff8d6ee admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:52:33.024335 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c443c6-8d85-4c06-92ff-1635aec65caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:52:33.025215 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c443c6-8d85-4c06-92ff-1635aec65caa admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:33.025491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c443c6-8d85-4c06-92ff-1635aec65caa admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:33.025758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c443c6-8d85-4c06-92ff-1635aec65caa admin admin] PATH_INFO: `/v3/projects/c721294324ba42ddabb84b33a06e03ee/users/6d35b509fd734cb1bbcc4fdd3b4c9def/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:33.041128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c443c6-8d85-4c06-92ff-1635aec65caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c721294324ba42ddabb84b33a06e03ee, user_id=6d35b509fd734cb1bbcc4fdd3b4c9def, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:52:33.043808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c443c6-8d85-4c06-92ff-1635aec65caa admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:52:33.059049 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4408/8778] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:52:33 2022] PUT /identity/v3/projects/c721294324ba42ddabb84b33a06e03ee/users/6d35b509fd734cb1bbcc4fdd3b4c9def/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:52:33.064487 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a07542-d5e0-4517-840a-1e3b3e9c61ad None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:33.064782 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a07542-d5e0-4517-840a-1e3b3e9c61ad None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:33.065056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a07542-d5e0-4517-840a-1e3b3e9c61ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:33.083607 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b3a07542-d5e0-4517-840a-1e3b3e9c61ad None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:52:33.084886 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b3a07542-d5e0-4517-840a-1e3b3e9c61ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:52:33.147564 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4371/8779] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:52:33.157949 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c443c6-8d85-4c06-92ff-1635aec65caa admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:52:33.159711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-30c443c6-8d85-4c06-92ff-1635aec65caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:52:33.234831 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c443c6-8d85-4c06-92ff-1635aec65caa admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:52:33.238997 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e8939-811a-4206-9224-49558e074a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:52:33.239652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e8939-811a-4206-9224-49558e074a84 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:33.239935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e8939-811a-4206-9224-49558e074a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:33.240256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e8939-811a-4206-9224-49558e074a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:33.250157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e8939-811a-4206-9224-49558e074a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:52:33.251610 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e8939-811a-4206-9224-49558e074a84 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:52:33.261405 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4409/8780] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:52:37.054070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4681d0-9bf0-40ca-b135-de8b3ae8689d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:37.054560 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4681d0-9bf0-40ca-b135-de8b3ae8689d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:37.054649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4681d0-9bf0-40ca-b135-de8b3ae8689d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:37.082323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8e4681d0-9bf0-40ca-b135-de8b3ae8689d None None] MFA Rules not processed for user `6d35b509fd734cb1bbcc4fdd3b4c9def`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:52:37.083874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8e4681d0-9bf0-40ca-b135-de8b3ae8689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:52:37.103133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:37.155577 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4372/8781] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:52:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:52:37.224851 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b5bb9-3af1-4c87-abd1-47948fd4599c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:37.225417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b5bb9-3af1-4c87-abd1-47948fd4599c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:37.225417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b5bb9-3af1-4c87-abd1-47948fd4599c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:37.244918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-b66b5bb9-3af1-4c87-abd1-47948fd4599c None None] MFA Rules not processed for user `6d35b509fd734cb1bbcc4fdd3b4c9def`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:52:37.246186 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b66b5bb9-3af1-4c87-abd1-47948fd4599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:52:37.254625 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4410/8782] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:52:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:52:37.268533 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4681d0-9bf0-40ca-b135-de8b3ae8689d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:52:37.270741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8e4681d0-9bf0-40ca-b135-de8b3ae8689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:52:37.369231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4681d0-9bf0-40ca-b135-de8b3ae8689d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:52:37.375337 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0994fe0-f74d-4de4-adb1-402bf1916e09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:52:37.375996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0994fe0-f74d-4de4-adb1-402bf1916e09 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:37.376511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0994fe0-f74d-4de4-adb1-402bf1916e09 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:37.376793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0994fe0-f74d-4de4-adb1-402bf1916e09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:37.385380 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0994fe0-f74d-4de4-adb1-402bf1916e09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:52:37.387413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0994fe0-f74d-4de4-adb1-402bf1916e09 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:52:37.397617 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4373/8783] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:52:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:52:47.238911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=2,keystone:SELECT=51 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:47.396568 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=58 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:47.590814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad48af5-9fc2-4cfd-b2eb-c2bacdc41463 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:52:47.591073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad48af5-9fc2-4cfd-b2eb-c2bacdc41463 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:52:47.591382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad48af5-9fc2-4cfd-b2eb-c2bacdc41463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:52:47.609948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-aad48af5-9fc2-4cfd-b2eb-c2bacdc41463 None None] MFA Rules not processed for user `6d35b509fd734cb1bbcc4fdd3b4c9def`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:52:47.611214 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-aad48af5-9fc2-4cfd-b2eb-c2bacdc41463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:52:47.619366 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4411/8784] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:52:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:52:57.604581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:06.048623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0994fe0-f74d-4de4-adb1-402bf1916e09 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:06.050500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b0994fe0-f74d-4de4-adb1-402bf1916e09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:06.069965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0994fe0-f74d-4de4-adb1-402bf1916e09 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:06.083030 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d3313-2e9f-4b5a-936a-5da1edb587cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:06.083716 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d3313-2e9f-4b5a-936a-5da1edb587cd service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:06.084000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d3313-2e9f-4b5a-936a-5da1edb587cd service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:06.084350 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d3313-2e9f-4b5a-936a-5da1edb587cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:06.094506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7a7d3313-2e9f-4b5a-936a-5da1edb587cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:06.112305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d3313-2e9f-4b5a-936a-5da1edb587cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:06.114196 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d3313-2e9f-4b5a-936a-5da1edb587cd service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:06.134176 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4374/8785] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:53:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:53:10.511028 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad48af5-9fc2-4cfd-b2eb-c2bacdc41463 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:10.512795 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-aad48af5-9fc2-4cfd-b2eb-c2bacdc41463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:10.590777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d3313-2e9f-4b5a-936a-5da1edb587cd service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:10.602370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d3313-2e9f-4b5a-936a-5da1edb587cd service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:10.612299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630c2fb-9fe8-461b-b0dc-17d7be625802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:10.613222 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630c2fb-9fe8-461b-b0dc-17d7be625802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:10.613497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630c2fb-9fe8-461b-b0dc-17d7be625802 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:10.613765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630c2fb-9fe8-461b-b0dc-17d7be625802 admin admin] PATH_INFO: `/v3/users/6d35b509fd734cb1bbcc4fdd3b4c9def` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:10.617050 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630c2fb-9fe8-461b-b0dc-17d7be625802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d35b509fd734cb1bbcc4fdd3b4c9def)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:10.619342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630c2fb-9fe8-461b-b0dc-17d7be625802 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:10.620429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad48af5-9fc2-4cfd-b2eb-c2bacdc41463 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:10.625448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a20b3-e620-4a1a-a4dc-1b9175ed25e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:10.626098 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a20b3-e620-4a1a-a4dc-1b9175ed25e7 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:10.626376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a20b3-e620-4a1a-a4dc-1b9175ed25e7 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:10.626651 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a20b3-e620-4a1a-a4dc-1b9175ed25e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:10.628428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-887a20b3-e620-4a1a-a4dc-1b9175ed25e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:10.642813 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a20b3-e620-4a1a-a4dc-1b9175ed25e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:10.644452 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a20b3-e620-4a1a-a4dc-1b9175ed25e7 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:10.660235 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4412/8786] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:53:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:53:10.674153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7630c2fb-9fe8-461b-b0dc-17d7be625802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d35b509fd734cb1bbcc4fdd3b4c9def'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:10.685239 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7630c2fb-9fe8-461b-b0dc-17d7be625802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d35b509fd734cb1bbcc4fdd3b4c9def'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:10.695264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7630c2fb-9fe8-461b-b0dc-17d7be625802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d35b509fd734cb1bbcc4fdd3b4c9def'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:10.696069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7630c2fb-9fe8-461b-b0dc-17d7be625802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d35b509fd734cb1bbcc4fdd3b4c9def'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:10.696741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-7630c2fb-9fe8-461b-b0dc-17d7be625802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d35b509fd734cb1bbcc4fdd3b4c9def'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:10.717881 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4375/8787] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:53:10 2022] DELETE /identity/v3/users/6d35b509fd734cb1bbcc4fdd3b4c9def => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:53:10.908658 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a20b3-e620-4a1a-a4dc-1b9175ed25e7 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:10.920319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a20b3-e620-4a1a-a4dc-1b9175ed25e7 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:10.980519 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9eeca5-2611-4f24-bbb0-bb5416d8a09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:10.981493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9eeca5-2611-4f24-bbb0-bb5416d8a09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:10.981783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9eeca5-2611-4f24-bbb0-bb5416d8a09f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:10.982062 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9eeca5-2611-4f24-bbb0-bb5416d8a09f admin admin] PATH_INFO: `/v3/projects/c721294324ba42ddabb84b33a06e03ee` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:10.983300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9eeca5-2611-4f24-bbb0-bb5416d8a09f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c721294324ba42ddabb84b33a06e03ee)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:10.985808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9eeca5-2611-4f24-bbb0-bb5416d8a09f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:11.035095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7c9eeca5-2611-4f24-bbb0-bb5416d8a09f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c721294324ba42ddabb84b33a06e03ee', 'request_id': 'req-7c9eeca5-2611-4f24-bbb0-bb5416d8a09f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:11.043260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7c9eeca5-2611-4f24-bbb0-bb5416d8a09f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c721294324ba42ddabb84b33a06e03ee', 'request_id': 'req-7c9eeca5-2611-4f24-bbb0-bb5416d8a09f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:11.049476 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7c9eeca5-2611-4f24-bbb0-bb5416d8a09f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c721294324ba42ddabb84b33a06e03ee', 'request_id': 'req-7c9eeca5-2611-4f24-bbb0-bb5416d8a09f'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:11.059570 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7c9eeca5-2611-4f24-bbb0-bb5416d8a09f admin admin] The token cache is being invalidate because project c721294324ba42ddabb84b33a06e03ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:53:11.059852 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7c9eeca5-2611-4f24-bbb0-bb5416d8a09f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:11.060559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-7c9eeca5-2611-4f24-bbb0-bb5416d8a09f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:11.062184 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4413/8788] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:53:10 2022] DELETE /identity/v3/projects/c721294324ba42ddabb84b33a06e03ee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:53:11.067423 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c186-529a-4091-a7b5-be4cf816fbcc None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:11.067655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c186-529a-4091-a7b5-be4cf816fbcc None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:11.067941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c186-529a-4091-a7b5-be4cf816fbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:11.086555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6050c186-529a-4091-a7b5-be4cf816fbcc None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:53:11.088224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6050c186-529a-4091-a7b5-be4cf816fbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:11.154292 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4376/8789] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:53:11.166364 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6888b-64ab-447c-b340-22fb965f5699 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:11.166654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6888b-64ab-447c-b340-22fb965f5699 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:11.166930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6888b-64ab-447c-b340-22fb965f5699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:11.187424 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-74e6888b-64ab-447c-b340-22fb965f5699 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:53:11.188721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-74e6888b-64ab-447c-b340-22fb965f5699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:11.196967 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4414/8790] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:53:11.201642 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050c186-529a-4091-a7b5-be4cf816fbcc None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:11.212457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050c186-529a-4091-a7b5-be4cf816fbcc None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:11.217506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cc9a5-8b06-45bf-af19-f7b93cc09098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:11.218166 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cc9a5-8b06-45bf-af19-f7b93cc09098 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:11.218445 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cc9a5-8b06-45bf-af19-f7b93cc09098 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:11.218714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cc9a5-8b06-45bf-af19-f7b93cc09098 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:11.219461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cc9a5-8b06-45bf-af19-f7b93cc09098 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:53:11.219764 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cc9a5-8b06-45bf-af19-f7b93cc09098 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:11.221437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cc9a5-8b06-45bf-af19-f7b93cc09098 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:11.233985 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4377/8791] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:53:11.238713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6888b-64ab-447c-b340-22fb965f5699 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:11.243250 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:11.249404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6888b-64ab-447c-b340-22fb965f5699 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:11.257992 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf20ea6-ea2c-409c-8802-d7bfcfad993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:11.258944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf20ea6-ea2c-409c-8802-d7bfcfad993b admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:11.259356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf20ea6-ea2c-409c-8802-d7bfcfad993b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:11.259754 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf20ea6-ea2c-409c-8802-d7bfcfad993b admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:11.260847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf20ea6-ea2c-409c-8802-d7bfcfad993b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:11.263716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf20ea6-ea2c-409c-8802-d7bfcfad993b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:11.292698 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4415/8792] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:53:11 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:53:11.297083 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cc9a5-8b06-45bf-af19-f7b93cc09098 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:11.307733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cc9a5-8b06-45bf-af19-f7b93cc09098 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:11.359146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:11.375486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f44d8-ae2a-41ee-a998-77c07c77e8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:11.376232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f44d8-ae2a-41ee-a998-77c07c77e8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:11.376520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f44d8-ae2a-41ee-a998-77c07c77e8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:11.376797 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f44d8-ae2a-41ee-a998-77c07c77e8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:11.377497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f44d8-ae2a-41ee-a998-77c07c77e8a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:11.379464 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f44d8-ae2a-41ee-a998-77c07c77e8a9 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:11.401507 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4378/8793] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:53:11 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 21:53:11.406381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf20ea6-ea2c-409c-8802-d7bfcfad993b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:11.416921 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf20ea6-ea2c-409c-8802-d7bfcfad993b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:11.422763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ad303-c29c-4855-9883-ad2233c4b288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:11.423428 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ad303-c29c-4855-9883-ad2233c4b288 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:11.423707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ad303-c29c-4855-9883-ad2233c4b288 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:11.424014 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ad303-c29c-4855-9883-ad2233c4b288 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:11.424769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ad303-c29c-4855-9883-ad2233c4b288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:11.426433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ad303-c29c-4855-9883-ad2233c4b288 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:11.437563 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4416/8794] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:53:11.441573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f44d8-ae2a-41ee-a998-77c07c77e8a9 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:11.451941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f44d8-ae2a-41ee-a998-77c07c77e8a9 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:11.458364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3828de-b60a-40ed-b8dd-3ad88f0f65f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:11.459019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3828de-b60a-40ed-b8dd-3ad88f0f65f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:11.459299 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3828de-b60a-40ed-b8dd-3ad88f0f65f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:11.459575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3828de-b60a-40ed-b8dd-3ad88f0f65f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:11.460345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3828de-b60a-40ed-b8dd-3ad88f0f65f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:11.461954 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3828de-b60a-40ed-b8dd-3ad88f0f65f0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:11.472583 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4379/8795] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 21:53:11.476893 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ad303-c29c-4855-9883-ad2233c4b288 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:11.487143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ad303-c29c-4855-9883-ad2233c4b288 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:11.492488 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388f34c-2da1-48e2-9340-c369310455df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:11.493389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388f34c-2da1-48e2-9340-c369310455df admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:11.493647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388f34c-2da1-48e2-9340-c369310455df admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:11.493923 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388f34c-2da1-48e2-9340-c369310455df admin admin] PATH_INFO: `/v3/projects/45c8c1fdefa246809dded496b0584cda/users/420d55920873471eb74a484c9d0c2805/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:11.508993 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388f34c-2da1-48e2-9340-c369310455df admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c8c1fdefa246809dded496b0584cda, user_id=420d55920873471eb74a484c9d0c2805, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:11.511685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388f34c-2da1-48e2-9340-c369310455df admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:11.526283 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4417/8796] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:53:11 2022] PUT /identity/v3/projects/45c8c1fdefa246809dded496b0584cda/users/420d55920873471eb74a484c9d0c2805/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:53:11.538860 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241556ae-6ce1-4fe2-9604-00c885c73a0c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:11.539180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241556ae-6ce1-4fe2-9604-00c885c73a0c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:11.539497 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241556ae-6ce1-4fe2-9604-00c885c73a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:11.567478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-241556ae-6ce1-4fe2-9604-00c885c73a0c None None] MFA Rules not processed for user `420d55920873471eb74a484c9d0c2805`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:53:11.568718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-241556ae-6ce1-4fe2-9604-00c885c73a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:11.636823 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4380/8797] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:53:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:53:11.649934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388f34c-2da1-48e2-9340-c369310455df admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:11.653248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f388f34c-2da1-48e2-9340-c369310455df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:11.716311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388f34c-2da1-48e2-9340-c369310455df admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:11.721113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6de651-7b94-488f-b00c-b0e547bc6013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:11.721748 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6de651-7b94-488f-b00c-b0e547bc6013 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:11.722038 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6de651-7b94-488f-b00c-b0e547bc6013 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:11.722343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6de651-7b94-488f-b00c-b0e547bc6013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:11.731500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6de651-7b94-488f-b00c-b0e547bc6013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:11.732966 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6de651-7b94-488f-b00c-b0e547bc6013 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:11.742000 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4418/8798] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:53:11 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:53:21.632958 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:21.737847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:22.543585 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241556ae-6ce1-4fe2-9604-00c885c73a0c None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:22.613680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241556ae-6ce1-4fe2-9604-00c885c73a0c None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:22.618447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118c31f-c63b-41d2-844c-aa0203f10087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:22.619332 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118c31f-c63b-41d2-844c-aa0203f10087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:22.619619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118c31f-c63b-41d2-844c-aa0203f10087 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:22.619898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118c31f-c63b-41d2-844c-aa0203f10087 admin admin] PATH_INFO: `/v3/users/420d55920873471eb74a484c9d0c2805` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:22.621173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118c31f-c63b-41d2-844c-aa0203f10087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=420d55920873471eb74a484c9d0c2805)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:22.623125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118c31f-c63b-41d2-844c-aa0203f10087 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:22.678448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e118c31f-c63b-41d2-844c-aa0203f10087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '420d55920873471eb74a484c9d0c2805'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:22.689165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e118c31f-c63b-41d2-844c-aa0203f10087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '420d55920873471eb74a484c9d0c2805'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:22.696202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e118c31f-c63b-41d2-844c-aa0203f10087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '420d55920873471eb74a484c9d0c2805'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:22.696845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e118c31f-c63b-41d2-844c-aa0203f10087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '420d55920873471eb74a484c9d0c2805'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:22.697452 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-e118c31f-c63b-41d2-844c-aa0203f10087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '420d55920873471eb74a484c9d0c2805'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:22.715836 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4381/8799] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:53:22 2022] DELETE /identity/v3/users/420d55920873471eb74a484c9d0c2805 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:53:22.720988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7aeb7-fcb2-4782-aac8-d7d6f190f957 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:22.721286 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7aeb7-fcb2-4782-aac8-d7d6f190f957 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:22.721568 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7aeb7-fcb2-4782-aac8-d7d6f190f957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:22.739407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ebe7aeb7-fcb2-4782-aac8-d7d6f190f957 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:53:22.740659 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ebe7aeb7-fcb2-4782-aac8-d7d6f190f957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:22.803787 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4419/8800] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:53:22.815974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118c31f-c63b-41d2-844c-aa0203f10087 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:22.817599 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e118c31f-c63b-41d2-844c-aa0203f10087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:22.873947 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118c31f-c63b-41d2-844c-aa0203f10087 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:22.878154 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f4f59-7f1b-49f3-b626-88c9546bf10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:22.878796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f4f59-7f1b-49f3-b626-88c9546bf10b service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:22.879077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f4f59-7f1b-49f3-b626-88c9546bf10b service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:22.879356 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f4f59-7f1b-49f3-b626-88c9546bf10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:22.890069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f4f59-7f1b-49f3-b626-88c9546bf10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:22.891550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f4f59-7f1b-49f3-b626-88c9546bf10b service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:22.901357 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4382/8801] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:53:23.087433 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7aeb7-fcb2-4782-aac8-d7d6f190f957 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:23.095365 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ebe7aeb7-fcb2-4782-aac8-d7d6f190f957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:23.114117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7aeb7-fcb2-4782-aac8-d7d6f190f957 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:23.119203 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03669c40-51dc-4e18-a2a7-6eaf63d81e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:23.120108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03669c40-51dc-4e18-a2a7-6eaf63d81e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:23.120418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03669c40-51dc-4e18-a2a7-6eaf63d81e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:23.120694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03669c40-51dc-4e18-a2a7-6eaf63d81e25 admin admin] PATH_INFO: `/v3/projects/45c8c1fdefa246809dded496b0584cda` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:23.121890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03669c40-51dc-4e18-a2a7-6eaf63d81e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45c8c1fdefa246809dded496b0584cda)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:23.123857 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03669c40-51dc-4e18-a2a7-6eaf63d81e25 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:23.172497 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-03669c40-51dc-4e18-a2a7-6eaf63d81e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45c8c1fdefa246809dded496b0584cda', 'request_id': 'req-03669c40-51dc-4e18-a2a7-6eaf63d81e25'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:23.181191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-03669c40-51dc-4e18-a2a7-6eaf63d81e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45c8c1fdefa246809dded496b0584cda', 'request_id': 'req-03669c40-51dc-4e18-a2a7-6eaf63d81e25'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:23.187728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-03669c40-51dc-4e18-a2a7-6eaf63d81e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45c8c1fdefa246809dded496b0584cda', 'request_id': 'req-03669c40-51dc-4e18-a2a7-6eaf63d81e25'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:23.198032 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-03669c40-51dc-4e18-a2a7-6eaf63d81e25 admin admin] The token cache is being invalidate because project 45c8c1fdefa246809dded496b0584cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:53:23.198316 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-03669c40-51dc-4e18-a2a7-6eaf63d81e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:23.198954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-03669c40-51dc-4e18-a2a7-6eaf63d81e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:23.200561 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4420/8802] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:53:23 2022] DELETE /identity/v3/projects/45c8c1fdefa246809dded496b0584cda => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:53:23.206140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9c2de-3207-4e9c-a9cf-572e481e1f06 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:23.206437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9c2de-3207-4e9c-a9cf-572e481e1f06 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:23.206745 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9c2de-3207-4e9c-a9cf-572e481e1f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:23.224711 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-37e9c2de-3207-4e9c-a9cf-572e481e1f06 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:53:23.225924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-37e9c2de-3207-4e9c-a9cf-572e481e1f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:23.244722 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:23.291925 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4383/8803] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:53:23.299850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271aa1c-5389-434d-99d7-c921e73eb241 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:23.300165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271aa1c-5389-434d-99d7-c921e73eb241 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:23.300440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271aa1c-5389-434d-99d7-c921e73eb241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:23.320201 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f271aa1c-5389-434d-99d7-c921e73eb241 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:53:23.321417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f271aa1c-5389-434d-99d7-c921e73eb241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:23.331116 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4421/8804] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:53:23.337873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9c2de-3207-4e9c-a9cf-572e481e1f06 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:23.353164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9c2de-3207-4e9c-a9cf-572e481e1f06 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:23.361032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e3a32-6994-4db2-87af-28393bf04ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:23.361693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e3a32-6994-4db2-87af-28393bf04ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:23.361979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e3a32-6994-4db2-87af-28393bf04ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:23.362311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e3a32-6994-4db2-87af-28393bf04ae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:23.363056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e3a32-6994-4db2-87af-28393bf04ae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:53:23.363369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e3a32-6994-4db2-87af-28393bf04ae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:23.365234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e3a32-6994-4db2-87af-28393bf04ae4 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:23.378258 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4384/8805] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 21:53:23.383353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271aa1c-5389-434d-99d7-c921e73eb241 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:23.397171 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271aa1c-5389-434d-99d7-c921e73eb241 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:23.402812 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefed6a-9c5d-46e8-90f1-182865db317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:23.403499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefed6a-9c5d-46e8-90f1-182865db317d admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:23.403783 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefed6a-9c5d-46e8-90f1-182865db317d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:23.404073 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefed6a-9c5d-46e8-90f1-182865db317d admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:23.404772 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefed6a-9c5d-46e8-90f1-182865db317d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:23.407119 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefed6a-9c5d-46e8-90f1-182865db317d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:23.435619 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4422/8806] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:53:23 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:53:23.440114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e3a32-6994-4db2-87af-28393bf04ae4 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:23.450998 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e3a32-6994-4db2-87af-28393bf04ae4 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:23.511217 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cdab6-77fd-4557-8d57-74e5aebbdcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:23.511887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cdab6-77fd-4557-8d57-74e5aebbdcc5 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:23.512225 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cdab6-77fd-4557-8d57-74e5aebbdcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:23.512500 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cdab6-77fd-4557-8d57-74e5aebbdcc5 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:23.513193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cdab6-77fd-4557-8d57-74e5aebbdcc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:23.515149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cdab6-77fd-4557-8d57-74e5aebbdcc5 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:23.537602 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4385/8807] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:53:23 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:53:23.541794 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefed6a-9c5d-46e8-90f1-182865db317d admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:23.552268 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefed6a-9c5d-46e8-90f1-182865db317d admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:23.557306 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c4b79-bd44-4bcf-b7e1-4c74066c7eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:23.557967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c4b79-bd44-4bcf-b7e1-4c74066c7eca admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:23.558255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c4b79-bd44-4bcf-b7e1-4c74066c7eca admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:23.558535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c4b79-bd44-4bcf-b7e1-4c74066c7eca admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:23.559256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c4b79-bd44-4bcf-b7e1-4c74066c7eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:23.560928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c4b79-bd44-4bcf-b7e1-4c74066c7eca admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:23.571659 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4423/8808] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:53:23.575750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cdab6-77fd-4557-8d57-74e5aebbdcc5 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:23.587121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cdab6-77fd-4557-8d57-74e5aebbdcc5 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:23.593220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761ad93-5fb6-420a-9981-8cba3a129499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:23.593880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761ad93-5fb6-420a-9981-8cba3a129499 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:23.594160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761ad93-5fb6-420a-9981-8cba3a129499 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:23.594446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761ad93-5fb6-420a-9981-8cba3a129499 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:23.595237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761ad93-5fb6-420a-9981-8cba3a129499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:23.596872 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761ad93-5fb6-420a-9981-8cba3a129499 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:23.607277 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4386/8809] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:53:23.611820 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c4b79-bd44-4bcf-b7e1-4c74066c7eca admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:23.622604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c4b79-bd44-4bcf-b7e1-4c74066c7eca admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:23.627836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe38c5-1df9-4923-804d-c8baa02dc98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:23.628763 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe38c5-1df9-4923-804d-c8baa02dc98e admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:23.629039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe38c5-1df9-4923-804d-c8baa02dc98e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:23.629328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe38c5-1df9-4923-804d-c8baa02dc98e admin admin] PATH_INFO: `/v3/projects/c1b6cccfe4dc4e8a8acd26157ecd1715/users/9af93eb29aee498f91b55e45efea7e8a/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:23.644576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe38c5-1df9-4923-804d-c8baa02dc98e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b6cccfe4dc4e8a8acd26157ecd1715, user_id=9af93eb29aee498f91b55e45efea7e8a, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:23.647244 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe38c5-1df9-4923-804d-c8baa02dc98e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:23.662148 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4424/8810] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:53:23 2022] PUT /identity/v3/projects/c1b6cccfe4dc4e8a8acd26157ecd1715/users/9af93eb29aee498f91b55e45efea7e8a/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:53:23.672469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d98794-f075-4e00-aecc-6ae794f49cfb None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:23.672760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d98794-f075-4e00-aecc-6ae794f49cfb None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:23.673034 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d98794-f075-4e00-aecc-6ae794f49cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:23.700921 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-24d98794-f075-4e00-aecc-6ae794f49cfb None None] MFA Rules not processed for user `9af93eb29aee498f91b55e45efea7e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:53:23.702146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-24d98794-f075-4e00-aecc-6ae794f49cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:23.771249 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4387/8811] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:53:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:53:23.784169 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe38c5-1df9-4923-804d-c8baa02dc98e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:23.786279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9abe38c5-1df9-4923-804d-c8baa02dc98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:23.809345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:23.848558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe38c5-1df9-4923-804d-c8baa02dc98e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:23.853396 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459b6fa-3d5f-41ee-be47-d71eb103c39f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:23.854051 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459b6fa-3d5f-41ee-be47-d71eb103c39f service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:23.854332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459b6fa-3d5f-41ee-be47-d71eb103c39f service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:23.854606 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459b6fa-3d5f-41ee-be47-d71eb103c39f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:23.863934 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459b6fa-3d5f-41ee-be47-d71eb103c39f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:23.865429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459b6fa-3d5f-41ee-be47-d71eb103c39f service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:23.874742 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4425/8812] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:53:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:53:28.129057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d98794-f075-4e00-aecc-6ae794f49cfb None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:28.149111 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:28.195707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d98794-f075-4e00-aecc-6ae794f49cfb None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:28.200333 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c916b9e-5ebf-410a-9c53-292d08244e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:28.201207 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c916b9e-5ebf-410a-9c53-292d08244e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:28.201486 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c916b9e-5ebf-410a-9c53-292d08244e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:28.201755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c916b9e-5ebf-410a-9c53-292d08244e68 admin admin] PATH_INFO: `/v3/users/9af93eb29aee498f91b55e45efea7e8a` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:28.202926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c916b9e-5ebf-410a-9c53-292d08244e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af93eb29aee498f91b55e45efea7e8a)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:28.204907 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c916b9e-5ebf-410a-9c53-292d08244e68 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:28.251569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4c916b9e-5ebf-410a-9c53-292d08244e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af93eb29aee498f91b55e45efea7e8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:28.258591 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4c916b9e-5ebf-410a-9c53-292d08244e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af93eb29aee498f91b55e45efea7e8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:28.265611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4c916b9e-5ebf-410a-9c53-292d08244e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af93eb29aee498f91b55e45efea7e8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:28.266275 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4c916b9e-5ebf-410a-9c53-292d08244e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af93eb29aee498f91b55e45efea7e8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:28.266887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-4c916b9e-5ebf-410a-9c53-292d08244e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af93eb29aee498f91b55e45efea7e8a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:28.284081 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4388/8813] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:53:28 2022] DELETE /identity/v3/users/9af93eb29aee498f91b55e45efea7e8a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:53:28.288761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2c3f5-7bf4-4cdb-a4a2-066ae6227268 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:28.289271 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2c3f5-7bf4-4cdb-a4a2-066ae6227268 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:28.289363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2c3f5-7bf4-4cdb-a4a2-066ae6227268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:28.308415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-2ac2c3f5-7bf4-4cdb-a4a2-066ae6227268 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:53:28.309641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2ac2c3f5-7bf4-4cdb-a4a2-066ae6227268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:28.374774 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4426/8814] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:53:28.384831 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c916b9e-5ebf-410a-9c53-292d08244e68 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:28.386315 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4c916b9e-5ebf-410a-9c53-292d08244e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:28.448146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c916b9e-5ebf-410a-9c53-292d08244e68 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:28.452006 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9ea5f-7178-421c-b8d8-06d7dd597a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:28.452690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9ea5f-7178-421c-b8d8-06d7dd597a07 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:28.452970 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9ea5f-7178-421c-b8d8-06d7dd597a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:28.453247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9ea5f-7178-421c-b8d8-06d7dd597a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:28.463135 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9ea5f-7178-421c-b8d8-06d7dd597a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:28.464712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9ea5f-7178-421c-b8d8-06d7dd597a07 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:28.474706 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4389/8815] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:53:28.653679 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2c3f5-7bf4-4cdb-a4a2-066ae6227268 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:28.655167 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-2ac2c3f5-7bf4-4cdb-a4a2-066ae6227268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:28.670101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2c3f5-7bf4-4cdb-a4a2-066ae6227268 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:28.675557 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c31e99-472a-496f-9b6d-8ba5fd1ec903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:28.676647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c31e99-472a-496f-9b6d-8ba5fd1ec903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:28.676885 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c31e99-472a-496f-9b6d-8ba5fd1ec903 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:28.677199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c31e99-472a-496f-9b6d-8ba5fd1ec903 admin admin] PATH_INFO: `/v3/projects/c1b6cccfe4dc4e8a8acd26157ecd1715` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:28.678429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c31e99-472a-496f-9b6d-8ba5fd1ec903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b6cccfe4dc4e8a8acd26157ecd1715)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:28.680409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c31e99-472a-496f-9b6d-8ba5fd1ec903 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:28.730092 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-20c31e99-472a-496f-9b6d-8ba5fd1ec903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b6cccfe4dc4e8a8acd26157ecd1715', 'request_id': 'req-20c31e99-472a-496f-9b6d-8ba5fd1ec903'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:28.738540 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-20c31e99-472a-496f-9b6d-8ba5fd1ec903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b6cccfe4dc4e8a8acd26157ecd1715', 'request_id': 'req-20c31e99-472a-496f-9b6d-8ba5fd1ec903'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:28.745148 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-20c31e99-472a-496f-9b6d-8ba5fd1ec903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b6cccfe4dc4e8a8acd26157ecd1715', 'request_id': 'req-20c31e99-472a-496f-9b6d-8ba5fd1ec903'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:28.756076 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-20c31e99-472a-496f-9b6d-8ba5fd1ec903 admin admin] The token cache is being invalidate because project c1b6cccfe4dc4e8a8acd26157ecd1715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:53:28.756380 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-20c31e99-472a-496f-9b6d-8ba5fd1ec903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:28.757023 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-20c31e99-472a-496f-9b6d-8ba5fd1ec903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:53:28.758636 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4427/8816] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:53:28 2022] DELETE /identity/v3/projects/c1b6cccfe4dc4e8a8acd26157ecd1715 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:53:28.764830 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323c9ee-75e3-461b-a9dd-d3a436b4176a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:28.765122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323c9ee-75e3-461b-a9dd-d3a436b4176a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:28.765398 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323c9ee-75e3-461b-a9dd-d3a436b4176a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:28.785919 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8323c9ee-75e3-461b-a9dd-d3a436b4176a None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:53:28.787146 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8323c9ee-75e3-461b-a9dd-d3a436b4176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:28.824993 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:28.853148 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4390/8817] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:53:28.862115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a46c8-1271-4fb4-9478-6af4e2713c1b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:28.862402 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a46c8-1271-4fb4-9478-6af4e2713c1b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:28.862685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a46c8-1271-4fb4-9478-6af4e2713c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:28.881967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-156a46c8-1271-4fb4-9478-6af4e2713c1b None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:53:28.883170 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-156a46c8-1271-4fb4-9478-6af4e2713c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:28.892836 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4428/8818] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:53:28.897254 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323c9ee-75e3-461b-a9dd-d3a436b4176a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:28.908185 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323c9ee-75e3-461b-a9dd-d3a436b4176a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:28.914079 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f64128-4af4-47a0-955c-e499aff58d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:28.914737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f64128-4af4-47a0-955c-e499aff58d6e admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:28.915041 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f64128-4af4-47a0-955c-e499aff58d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:28.915308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f64128-4af4-47a0-955c-e499aff58d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:28.916032 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f64128-4af4-47a0-955c-e499aff58d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:53:28.916364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f64128-4af4-47a0-955c-e499aff58d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:28.917996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f64128-4af4-47a0-955c-e499aff58d6e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:28.930445 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4391/8819] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:53:28.935008 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a46c8-1271-4fb4-9478-6af4e2713c1b None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:28.945005 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a46c8-1271-4fb4-9478-6af4e2713c1b None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:28.950481 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49b3fa-f2a8-4531-a402-732ed1bb0113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:28.951135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49b3fa-f2a8-4531-a402-732ed1bb0113 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:28.951450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49b3fa-f2a8-4531-a402-732ed1bb0113 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:28.951728 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49b3fa-f2a8-4531-a402-732ed1bb0113 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:28.952449 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49b3fa-f2a8-4531-a402-732ed1bb0113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:28.954404 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49b3fa-f2a8-4531-a402-732ed1bb0113 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:28.982446 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4429/8820] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:53:28 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:53:28.986725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f64128-4af4-47a0-955c-e499aff58d6e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:28.997155 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f64128-4af4-47a0-955c-e499aff58d6e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:29.056454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4df0d4-8077-482c-8136-bf02d40e3ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:29.057128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4df0d4-8077-482c-8136-bf02d40e3ced admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:29.057407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4df0d4-8077-482c-8136-bf02d40e3ced admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:29.057681 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4df0d4-8077-482c-8136-bf02d40e3ced admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:29.058363 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4df0d4-8077-482c-8136-bf02d40e3ced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:29.060323 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4df0d4-8077-482c-8136-bf02d40e3ced admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:29.089860 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4392/8821] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:53:28 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:53:29.090063 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49b3fa-f2a8-4531-a402-732ed1bb0113 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:29.100004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49b3fa-f2a8-4531-a402-732ed1bb0113 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:29.105045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327bb9a-219e-4e82-8a54-da6680854d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:29.105717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327bb9a-219e-4e82-8a54-da6680854d4c admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:29.106000 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327bb9a-219e-4e82-8a54-da6680854d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:29.106308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327bb9a-219e-4e82-8a54-da6680854d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:29.107037 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327bb9a-219e-4e82-8a54-da6680854d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:29.108751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327bb9a-219e-4e82-8a54-da6680854d4c admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:29.120019 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4430/8822] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:53:29.124437 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4df0d4-8077-482c-8136-bf02d40e3ced admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:29.134785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4df0d4-8077-482c-8136-bf02d40e3ced admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:29.139708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f324a77-1a5f-41b8-8d60-a7204f081178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:29.140442 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f324a77-1a5f-41b8-8d60-a7204f081178 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:29.140759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f324a77-1a5f-41b8-8d60-a7204f081178 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:29.141036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f324a77-1a5f-41b8-8d60-a7204f081178 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:29.142370 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f324a77-1a5f-41b8-8d60-a7204f081178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:29.144305 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f324a77-1a5f-41b8-8d60-a7204f081178 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:29.157913 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4393/8823] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:53:29.162269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327bb9a-219e-4e82-8a54-da6680854d4c admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:29.173097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327bb9a-219e-4e82-8a54-da6680854d4c admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:29.178830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f73efb-fd6f-496a-ac2a-981dada51d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:29.179710 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f73efb-fd6f-496a-ac2a-981dada51d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:29.179988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f73efb-fd6f-496a-ac2a-981dada51d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:29.180287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f73efb-fd6f-496a-ac2a-981dada51d9e admin admin] PATH_INFO: `/v3/projects/77b8740a1b5c40aa90dc3c6a72fed1f5/users/4e7c01edc3ee499f9e6aa1003dce77dc/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:29.182743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:29.199132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f73efb-fd6f-496a-ac2a-981dada51d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b8740a1b5c40aa90dc3c6a72fed1f5, user_id=4e7c01edc3ee499f9e6aa1003dce77dc, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:29.201908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f73efb-fd6f-496a-ac2a-981dada51d9e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:29.216487 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4431/8824] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:53:29 2022] PUT /identity/v3/projects/77b8740a1b5c40aa90dc3c6a72fed1f5/users/4e7c01edc3ee499f9e6aa1003dce77dc/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:53:29.221779 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d924677-9f06-4f01-a44f-70c8469849b1 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:29.222070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d924677-9f06-4f01-a44f-70c8469849b1 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:29.222347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d924677-9f06-4f01-a44f-70c8469849b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:29.240648 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-4d924677-9f06-4f01-a44f-70c8469849b1 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:53:29.241818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4d924677-9f06-4f01-a44f-70c8469849b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:29.304438 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4394/8825] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:53:29.314444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f73efb-fd6f-496a-ac2a-981dada51d9e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:29.316406 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-48f73efb-fd6f-496a-ac2a-981dada51d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:29.377377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f73efb-fd6f-496a-ac2a-981dada51d9e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:29.381319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fc20c-62e2-4481-9f22-4ca10e504fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:29.381962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fc20c-62e2-4481-9f22-4ca10e504fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:29.382360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fc20c-62e2-4481-9f22-4ca10e504fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:29.382641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fc20c-62e2-4481-9f22-4ca10e504fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:29.392377 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269fc20c-62e2-4481-9f22-4ca10e504fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:29.394009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269fc20c-62e2-4481-9f22-4ca10e504fb3 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:29.404502 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4432/8826] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:53:33.180316 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771faa1-d8de-435f-8aa5-dec75392445f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:33.180817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771faa1-d8de-435f-8aa5-dec75392445f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:33.180949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771faa1-d8de-435f-8aa5-dec75392445f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:33.210174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8771faa1-d8de-435f-8aa5-dec75392445f None None] MFA Rules not processed for user `4e7c01edc3ee499f9e6aa1003dce77dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:53:33.211417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8771faa1-d8de-435f-8aa5-dec75392445f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:33.250506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:33.289528 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4395/8827] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:53:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:53:33.290766 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fc20c-62e2-4481-9f22-4ca10e504fb3 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:33.301298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fc20c-62e2-4481-9f22-4ca10e504fb3 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:33.306236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc74217-0062-4911-ab7a-f00f3c7de321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:33.306940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc74217-0062-4911-ab7a-f00f3c7de321 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:33.307398 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc74217-0062-4911-ab7a-f00f3c7de321 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:33.307490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc74217-0062-4911-ab7a-f00f3c7de321 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:33.308212 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc74217-0062-4911-ab7a-f00f3c7de321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:33.310314 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc74217-0062-4911-ab7a-f00f3c7de321 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:33.340153 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4433/8828] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:53:33 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:53:33.344511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771faa1-d8de-435f-8aa5-dec75392445f None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:33.356153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771faa1-d8de-435f-8aa5-dec75392445f None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:33.418511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6f90b-d489-4a54-a39c-f22752f5296b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:33.419192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6f90b-d489-4a54-a39c-f22752f5296b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:33.419471 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6f90b-d489-4a54-a39c-f22752f5296b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:33.419741 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6f90b-d489-4a54-a39c-f22752f5296b admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:33.420472 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6f90b-d489-4a54-a39c-f22752f5296b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:33.422462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6f90b-d489-4a54-a39c-f22752f5296b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:33.444171 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4396/8829] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:53:33 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:53:33.448071 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc74217-0062-4911-ab7a-f00f3c7de321 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:33.459290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc74217-0062-4911-ab7a-f00f3c7de321 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:33.464367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cbbe9-0d0b-4ba9-ba2e-f943ae8f1881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:33.465042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cbbe9-0d0b-4ba9-ba2e-f943ae8f1881 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:33.465323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cbbe9-0d0b-4ba9-ba2e-f943ae8f1881 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:33.465622 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cbbe9-0d0b-4ba9-ba2e-f943ae8f1881 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:33.466363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cbbe9-0d0b-4ba9-ba2e-f943ae8f1881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:33.467965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cbbe9-0d0b-4ba9-ba2e-f943ae8f1881 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:33.480837 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4434/8830] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:53:33.485325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6f90b-d489-4a54-a39c-f22752f5296b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:33.495732 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6f90b-d489-4a54-a39c-f22752f5296b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:33.500740 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ebba1-28f7-4ee7-aae1-61945496ffe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:33.501672 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ebba1-28f7-4ee7-aae1-61945496ffe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:33.501945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ebba1-28f7-4ee7-aae1-61945496ffe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:33.502223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ebba1-28f7-4ee7-aae1-61945496ffe0 admin admin] PATH_INFO: `/v3/projects/eca6485419d24ecb853f458ad827e43e/users/8bfd36bbb0844308a4bd7d157199a3f2/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:33.518908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ebba1-28f7-4ee7-aae1-61945496ffe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca6485419d24ecb853f458ad827e43e, user_id=8bfd36bbb0844308a4bd7d157199a3f2, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:33.521641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ebba1-28f7-4ee7-aae1-61945496ffe0 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:33.537835 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4397/8831] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:53:33 2022] PUT /identity/v3/projects/eca6485419d24ecb853f458ad827e43e/users/8bfd36bbb0844308a4bd7d157199a3f2/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:53:33.542208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cbbe9-0d0b-4ba9-ba2e-f943ae8f1881 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:33.556762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cbbe9-0d0b-4ba9-ba2e-f943ae8f1881 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:33.623399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7605f-6956-4be2-b675-eaa0a99fd521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:33.624118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7605f-6956-4be2-b675-eaa0a99fd521 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:33.624539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7605f-6956-4be2-b675-eaa0a99fd521 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:33.624694 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7605f-6956-4be2-b675-eaa0a99fd521 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:33.625462 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7605f-6956-4be2-b675-eaa0a99fd521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:33.627090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7605f-6956-4be2-b675-eaa0a99fd521 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:33.638902 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4435/8832] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:53:33.643628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ebba1-28f7-4ee7-aae1-61945496ffe0 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:33.654714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ebba1-28f7-4ee7-aae1-61945496ffe0 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:33.659876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04850d-16a1-4664-aa5a-90e82042d67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:33.660798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04850d-16a1-4664-aa5a-90e82042d67e admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:33.661082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04850d-16a1-4664-aa5a-90e82042d67e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:33.661361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04850d-16a1-4664-aa5a-90e82042d67e admin admin] PATH_INFO: `/v3/projects/eca6485419d24ecb853f458ad827e43e/users/8bfd36bbb0844308a4bd7d157199a3f2/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:33.663361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04850d-16a1-4664-aa5a-90e82042d67e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca6485419d24ecb853f458ad827e43e, user_id=8bfd36bbb0844308a4bd7d157199a3f2, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:33.666065 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04850d-16a1-4664-aa5a-90e82042d67e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:33.676548 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4398/8833] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:53:33 2022] PUT /identity/v3/projects/eca6485419d24ecb853f458ad827e43e/users/8bfd36bbb0844308a4bd7d157199a3f2/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 21:53:38.379834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b458c8e-5fcd-463b-985f-9e8275741a43 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:38.380337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b458c8e-5fcd-463b-985f-9e8275741a43 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:38.380571 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b458c8e-5fcd-463b-985f-9e8275741a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:38.442134 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-7b458c8e-5fcd-463b-985f-9e8275741a43 None None] MFA Rules not processed for user `8bfd36bbb0844308a4bd7d157199a3f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:53:38.443298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7b458c8e-5fcd-463b-985f-9e8275741a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:38.506745 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:38.555498 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4436/8834] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:53:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:53:38.590303 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3683f1-1bd4-452a-b94d-aca5e15e5233 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:38.591000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3683f1-1bd4-452a-b94d-aca5e15e5233 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:38.591292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3683f1-1bd4-452a-b94d-aca5e15e5233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:38.645069 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-7a3683f1-1bd4-452a-b94d-aca5e15e5233 None None] MFA Rules not processed for user `3de168a603b0478fa8de67f6d206e1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:53:38.646308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7a3683f1-1bd4-452a-b94d-aca5e15e5233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:38.721288 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4399/8835] 10.222.0.43 () {58 vars in 1059 bytes} [Sat Jul 2 21:53:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:53:38.727969 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b458c8e-5fcd-463b-985f-9e8275741a43 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:38.738943 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b458c8e-5fcd-463b-985f-9e8275741a43 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:38.742775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c60e8-8899-450d-9047-403dc3a67723 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:38.743442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c60e8-8899-450d-9047-403dc3a67723 service glance] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:38.743724 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c60e8-8899-450d-9047-403dc3a67723 service glance] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:38.744004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c60e8-8899-450d-9047-403dc3a67723 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:38.814293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c60e8-8899-450d-9047-403dc3a67723 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:38.816655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c60e8-8899-450d-9047-403dc3a67723 service glance] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:38.827036 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4437/8836] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:53:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:53:38.950923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f474197-2d9a-4b86-8abf-12c82f63358d None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:38.951214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f474197-2d9a-4b86-8abf-12c82f63358d None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:38.951495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f474197-2d9a-4b86-8abf-12c82f63358d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:38.957927 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:39.032367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1f474197-2d9a-4b86-8abf-12c82f63358d None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:53:39.034092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1f474197-2d9a-4b86-8abf-12c82f63358d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:39.122071 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4400/8837] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:53:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:53:39.170965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf54f4a-5877-46f3-9731-fe3b87fd2193 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:39.171252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf54f4a-5877-46f3-9731-fe3b87fd2193 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:39.171527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf54f4a-5877-46f3-9731-fe3b87fd2193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:39.224131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0bf54f4a-5877-46f3-9731-fe3b87fd2193 None None] MFA Rules not processed for user `55367f643da048c5ab61ab6325552256`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:53:39.225363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0bf54f4a-5877-46f3-9731-fe3b87fd2193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:39.298490 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4438/8838] 10.222.0.43 () {58 vars in 1039 bytes} [Sat Jul 2 21:53:39 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:53:39.307655 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f474197-2d9a-4b86-8abf-12c82f63358d None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:39.322394 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f474197-2d9a-4b86-8abf-12c82f63358d None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:39.328412 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae870f9-a4db-4c04-8cc4-e00f0d35084c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:39.329061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae870f9-a4db-4c04-8cc4-e00f0d35084c service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:39.329338 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae870f9-a4db-4c04-8cc4-e00f0d35084c service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:39.329616 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae870f9-a4db-4c04-8cc4-e00f0d35084c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:39.338795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae870f9-a4db-4c04-8cc4-e00f0d35084c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:39.340408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae870f9-a4db-4c04-8cc4-e00f0d35084c service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:39.349181 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4401/8839] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:53:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:53:47.871275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26e053-1438-465d-8641-01e661bfcbe6 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:47.871836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26e053-1438-465d-8641-01e661bfcbe6 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:47.871936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26e053-1438-465d-8641-01e661bfcbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:47.890604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-dc26e053-1438-465d-8641-01e661bfcbe6 None None] MFA Rules not processed for user `4e7c01edc3ee499f9e6aa1003dce77dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:53:47.891854 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-dc26e053-1438-465d-8641-01e661bfcbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:47.899957 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4439/8840] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:53:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:53:48.169228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae870f9-a4db-4c04-8cc4-e00f0d35084c service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:48.170834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4ae870f9-a4db-4c04-8cc4-e00f0d35084c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:48.237763 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae870f9-a4db-4c04-8cc4-e00f0d35084c service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:48.244279 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b380b2-b5ec-4d4e-9c87-5b5560690f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:48.245232 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b380b2-b5ec-4d4e-9c87-5b5560690f89 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:48.245611 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b380b2-b5ec-4d4e-9c87-5b5560690f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:48.245980 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b380b2-b5ec-4d4e-9c87-5b5560690f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:48.248881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d4b380b2-b5ec-4d4e-9c87-5b5560690f89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:48.262241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b380b2-b5ec-4d4e-9c87-5b5560690f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:48.263685 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b380b2-b5ec-4d4e-9c87-5b5560690f89 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:48.278142 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4402/8841] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:53:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 21:53:50.235460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1805533-cf03-44c5-9015-02cd32a601eb None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:50.235982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1805533-cf03-44c5-9015-02cd32a601eb None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:50.236202 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1805533-cf03-44c5-9015-02cd32a601eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:50.254400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d1805533-cf03-44c5-9015-02cd32a601eb None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:53:50.255697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d1805533-cf03-44c5-9015-02cd32a601eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:53:50.263084 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4440/8842] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:53:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:53:50.277194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b380b2-b5ec-4d4e-9c87-5b5560690f89 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:53:50.292845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b380b2-b5ec-4d4e-9c87-5b5560690f89 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:53:50.298606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7f0ac-201e-4483-b54e-c8ceb6b0f857 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:53:50.299192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7f0ac-201e-4483-b54e-c8ceb6b0f857 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:53:50.299506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7f0ac-201e-4483-b54e-c8ceb6b0f857 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:53:50.299839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7f0ac-201e-4483-b54e-c8ceb6b0f857 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:53:50.310206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7f0ac-201e-4483-b54e-c8ceb6b0f857 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:53:50.311817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7f0ac-201e-4483-b54e-c8ceb6b0f857 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:53:50.322419 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4403/8843] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:53:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 02 21:54:00.249143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=90 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:00.317424 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=80 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:11.192184 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ed4e8-98f9-43dc-9216-9105420663dc None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:11.192650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ed4e8-98f9-43dc-9216-9105420663dc None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:11.192753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ed4e8-98f9-43dc-9216-9105420663dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:11.210878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9f8ed4e8-98f9-43dc-9216-9105420663dc None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:54:11.212087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9f8ed4e8-98f9-43dc-9216-9105420663dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:54:11.219194 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4441/8844] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:54:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:54:11.231546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7f0ac-201e-4483-b54e-c8ceb6b0f857 service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:11.242271 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7f0ac-201e-4483-b54e-c8ceb6b0f857 service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:11.248579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb10993-e99e-4132-9dd2-0253b61f2bc3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:11.249212 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb10993-e99e-4132-9dd2-0253b61f2bc3 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:11.249491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb10993-e99e-4132-9dd2-0253b61f2bc3 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:11.249769 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb10993-e99e-4132-9dd2-0253b61f2bc3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:11.258003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb10993-e99e-4132-9dd2-0253b61f2bc3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:11.259575 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb10993-e99e-4132-9dd2-0253b61f2bc3 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:11.267411 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4404/8845] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:54:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:54:11.733915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b3473-1c31-44b5-b0f2-d77e84fd548f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:11.734197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b3473-1c31-44b5-b0f2-d77e84fd548f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:11.734470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b3473-1c31-44b5-b0f2-d77e84fd548f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:11.753608 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-444b3473-1c31-44b5-b0f2-d77e84fd548f None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:54:11.754845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-444b3473-1c31-44b5-b0f2-d77e84fd548f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:54:11.763431 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4442/8846] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:54:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:54:11.776415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb10993-e99e-4132-9dd2-0253b61f2bc3 service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:11.788227 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb10993-e99e-4132-9dd2-0253b61f2bc3 service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:11.793917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecdbe3-9335-43f9-8bed-b16f965b2c15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:11.794628 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecdbe3-9335-43f9-8bed-b16f965b2c15 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:11.794911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecdbe3-9335-43f9-8bed-b16f965b2c15 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:11.795184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecdbe3-9335-43f9-8bed-b16f965b2c15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:11.804351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecdbe3-9335-43f9-8bed-b16f965b2c15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:11.805949 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecdbe3-9335-43f9-8bed-b16f965b2c15 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:11.815381 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4405/8847] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:54:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:54:20.023559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125d455-ffdf-42e1-8dea-362bec3fe7c5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:20.024090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125d455-ffdf-42e1-8dea-362bec3fe7c5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:20.024216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125d455-ffdf-42e1-8dea-362bec3fe7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:20.044304 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0125d455-ffdf-42e1-8dea-362bec3fe7c5 None None] MFA Rules not processed for user `4e7c01edc3ee499f9e6aa1003dce77dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:54:20.045238 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0125d455-ffdf-42e1-8dea-362bec3fe7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:54:20.053345 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4443/8848] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:54:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:54:21.811614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=12 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:21.874223 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779dcf2-74da-4fa0-bf2c-1d40ac6769ae None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:21.874506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779dcf2-74da-4fa0-bf2c-1d40ac6769ae None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:21.874790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779dcf2-74da-4fa0-bf2c-1d40ac6769ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:21.894127 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9779dcf2-74da-4fa0-bf2c-1d40ac6769ae None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:54:21.895364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9779dcf2-74da-4fa0-bf2c-1d40ac6769ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:54:21.903335 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4406/8849] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:54:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:54:21.917572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125d455-ffdf-42e1-8dea-362bec3fe7c5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:21.930489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125d455-ffdf-42e1-8dea-362bec3fe7c5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:21.935685 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bd83f-127c-4321-b33d-daacf0f0569d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:21.936372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bd83f-127c-4321-b33d-daacf0f0569d service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:21.936652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bd83f-127c-4321-b33d-daacf0f0569d service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:21.936927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bd83f-127c-4321-b33d-daacf0f0569d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:21.945976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bd83f-127c-4321-b33d-daacf0f0569d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:21.947675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bd83f-127c-4321-b33d-daacf0f0569d service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:21.956623 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4444/8850] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:54:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:54:30.279461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779dcf2-74da-4fa0-bf2c-1d40ac6769ae None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:30.293469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779dcf2-74da-4fa0-bf2c-1d40ac6769ae None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:30.297818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7235e4-437d-495b-82f0-924db08c0f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:30.298617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7235e4-437d-495b-82f0-924db08c0f3e service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:30.298891 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7235e4-437d-495b-82f0-924db08c0f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:30.299157 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7235e4-437d-495b-82f0-924db08c0f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:30.301331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bc7235e4-437d-495b-82f0-924db08c0f3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:54:30.316330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7235e4-437d-495b-82f0-924db08c0f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:30.317950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7235e4-437d-495b-82f0-924db08c0f3e service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:30.329239 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4407/8851] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:54:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:54:30.703757 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bd83f-127c-4321-b33d-daacf0f0569d service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:30.705815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1b1bd83f-127c-4321-b33d-daacf0f0569d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:54:30.799961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bd83f-127c-4321-b33d-daacf0f0569d service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:30.806039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0eb535-8a26-430f-89a7-5ebe6b2acf73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:30.806717 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0eb535-8a26-430f-89a7-5ebe6b2acf73 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:30.807004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0eb535-8a26-430f-89a7-5ebe6b2acf73 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:30.807308 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0eb535-8a26-430f-89a7-5ebe6b2acf73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:30.809894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ac0eb535-8a26-430f-89a7-5ebe6b2acf73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:54:30.825115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0eb535-8a26-430f-89a7-5ebe6b2acf73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:30.827429 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0eb535-8a26-430f-89a7-5ebe6b2acf73 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:30.841346 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4445/8852] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:54:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:54:37.710714 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7235e4-437d-495b-82f0-924db08c0f3e service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:37.712400 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bc7235e4-437d-495b-82f0-924db08c0f3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:54:37.794874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7235e4-437d-495b-82f0-924db08c0f3e service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:37.800693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc11bf-c4ad-4b55-86b2-84c700a893e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:37.801343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc11bf-c4ad-4b55-86b2-84c700a893e5 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:37.801631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc11bf-c4ad-4b55-86b2-84c700a893e5 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:37.801906 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc11bf-c4ad-4b55-86b2-84c700a893e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:37.803805 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-54fc11bf-c4ad-4b55-86b2-84c700a893e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:54:37.818555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc11bf-c4ad-4b55-86b2-84c700a893e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:37.820215 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc11bf-c4ad-4b55-86b2-84c700a893e5 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:37.833454 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4408/8853] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:54:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:54:40.834166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=47 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:45.162042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f198f-5f62-46d2-8a79-6a7daafafbe5 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:45.162639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f198f-5f62-46d2-8a79-6a7daafafbe5 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:45.162639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f198f-5f62-46d2-8a79-6a7daafafbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:45.180513 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-8a7f198f-5f62-46d2-8a79-6a7daafafbe5 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:54:45.181750 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8a7f198f-5f62-46d2-8a79-6a7daafafbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:54:45.189286 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4446/8854] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 21:54:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:54:45.210858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc11bf-c4ad-4b55-86b2-84c700a893e5 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:45.222609 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc11bf-c4ad-4b55-86b2-84c700a893e5 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:45.228819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032b9af-aec6-4d4c-8476-c802c52365d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:45.229448 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032b9af-aec6-4d4c-8476-c802c52365d1 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:45.229718 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032b9af-aec6-4d4c-8476-c802c52365d1 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:45.230164 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032b9af-aec6-4d4c-8476-c802c52365d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:45.239192 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032b9af-aec6-4d4c-8476-c802c52365d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:45.240829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032b9af-aec6-4d4c-8476-c802c52365d1 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:45.249230 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4409/8855] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 21:54:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 21:54:51.915157 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f198f-5f62-46d2-8a79-6a7daafafbe5 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:51.980255 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f198f-5f62-46d2-8a79-6a7daafafbe5 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:51.985163 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ad1bc-a0b7-406c-ad98-0f671de5be1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:51.986044 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ad1bc-a0b7-406c-ad98-0f671de5be1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:51.986324 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ad1bc-a0b7-406c-ad98-0f671de5be1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:51.986597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ad1bc-a0b7-406c-ad98-0f671de5be1b admin admin] PATH_INFO: `/v3/users/4e7c01edc3ee499f9e6aa1003dce77dc` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:51.987836 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ad1bc-a0b7-406c-ad98-0f671de5be1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e7c01edc3ee499f9e6aa1003dce77dc)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:51.989850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ad1bc-a0b7-406c-ad98-0f671de5be1b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:52.042442 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-159ad1bc-a0b7-406c-ad98-0f671de5be1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e7c01edc3ee499f9e6aa1003dce77dc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.050971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-159ad1bc-a0b7-406c-ad98-0f671de5be1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e7c01edc3ee499f9e6aa1003dce77dc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.051599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-159ad1bc-a0b7-406c-ad98-0f671de5be1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e7c01edc3ee499f9e6aa1003dce77dc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.052233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-159ad1bc-a0b7-406c-ad98-0f671de5be1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e7c01edc3ee499f9e6aa1003dce77dc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.059601 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-159ad1bc-a0b7-406c-ad98-0f671de5be1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e7c01edc3ee499f9e6aa1003dce77dc'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.078701 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4447/8856] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:54:51 2022] DELETE /identity/v3/users/4e7c01edc3ee499f9e6aa1003dce77dc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:54:52.265737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032b9af-aec6-4d4c-8476-c802c52365d1 service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:52.271459 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=50 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:52.279529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032b9af-aec6-4d4c-8476-c802c52365d1 service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:52.344369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce855b4e-493a-4289-8783-b11cfeff2cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:52.345277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce855b4e-493a-4289-8783-b11cfeff2cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:52.345559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce855b4e-493a-4289-8783-b11cfeff2cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:52.345836 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce855b4e-493a-4289-8783-b11cfeff2cfc admin admin] PATH_INFO: `/v3/projects/77b8740a1b5c40aa90dc3c6a72fed1f5` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:52.347021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce855b4e-493a-4289-8783-b11cfeff2cfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=77b8740a1b5c40aa90dc3c6a72fed1f5)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:52.348992 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce855b4e-493a-4289-8783-b11cfeff2cfc admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:52.397791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ce855b4e-493a-4289-8783-b11cfeff2cfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'request_id': 'req-ce855b4e-493a-4289-8783-b11cfeff2cfc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.405478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ce855b4e-493a-4289-8783-b11cfeff2cfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'request_id': 'req-ce855b4e-493a-4289-8783-b11cfeff2cfc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.412003 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ce855b4e-493a-4289-8783-b11cfeff2cfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'request_id': 'req-ce855b4e-493a-4289-8783-b11cfeff2cfc'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.426466 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ce855b4e-493a-4289-8783-b11cfeff2cfc admin admin] The token cache is being invalidate because project 77b8740a1b5c40aa90dc3c6a72fed1f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:54:52.426758 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ce855b4e-493a-4289-8783-b11cfeff2cfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.428147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-ce855b4e-493a-4289-8783-b11cfeff2cfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.429910 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4410/8857] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:54:52 2022] DELETE /identity/v3/projects/77b8740a1b5c40aa90dc3c6a72fed1f5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:54:52.434042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ad1bc-a0b7-406c-ad98-0f671de5be1b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:52.435602 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-159ad1bc-a0b7-406c-ad98-0f671de5be1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:54:52.448759 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ad1bc-a0b7-406c-ad98-0f671de5be1b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:52.509059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b30b8-095f-4700-9124-24001a0d8659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:52.510055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b30b8-095f-4700-9124-24001a0d8659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:52.510336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b30b8-095f-4700-9124-24001a0d8659 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:52.510612 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b30b8-095f-4700-9124-24001a0d8659 admin admin] PATH_INFO: `/v3/users/8bfd36bbb0844308a4bd7d157199a3f2` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:52.511879 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b30b8-095f-4700-9124-24001a0d8659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bfd36bbb0844308a4bd7d157199a3f2)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:52.513902 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b30b8-095f-4700-9124-24001a0d8659 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:52.527636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:52.563550 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-395b30b8-095f-4700-9124-24001a0d8659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bfd36bbb0844308a4bd7d157199a3f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.571624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-395b30b8-095f-4700-9124-24001a0d8659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bfd36bbb0844308a4bd7d157199a3f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.572448 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-395b30b8-095f-4700-9124-24001a0d8659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bfd36bbb0844308a4bd7d157199a3f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.573075 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-395b30b8-095f-4700-9124-24001a0d8659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bfd36bbb0844308a4bd7d157199a3f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.580132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-395b30b8-095f-4700-9124-24001a0d8659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bfd36bbb0844308a4bd7d157199a3f2'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.597132 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4448/8858] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:54:52 2022] DELETE /identity/v3/users/8bfd36bbb0844308a4bd7d157199a3f2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:54:52.781759 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce855b4e-493a-4289-8783-b11cfeff2cfc admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:52.783319 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ce855b4e-493a-4289-8783-b11cfeff2cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:54:52.797573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce855b4e-493a-4289-8783-b11cfeff2cfc admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:52.865270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5155db-49f8-4e27-9893-8bb9e3a9a508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:52.866149 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5155db-49f8-4e27-9893-8bb9e3a9a508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:52.866430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5155db-49f8-4e27-9893-8bb9e3a9a508 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:52.866707 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5155db-49f8-4e27-9893-8bb9e3a9a508 admin admin] PATH_INFO: `/v3/projects/eca6485419d24ecb853f458ad827e43e` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:52.867908 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5155db-49f8-4e27-9893-8bb9e3a9a508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eca6485419d24ecb853f458ad827e43e)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:52.869961 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5155db-49f8-4e27-9893-8bb9e3a9a508 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:52.908669 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:52.920325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9f5155db-49f8-4e27-9893-8bb9e3a9a508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eca6485419d24ecb853f458ad827e43e', 'request_id': 'req-9f5155db-49f8-4e27-9893-8bb9e3a9a508'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.926550 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9f5155db-49f8-4e27-9893-8bb9e3a9a508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eca6485419d24ecb853f458ad827e43e', 'request_id': 'req-9f5155db-49f8-4e27-9893-8bb9e3a9a508'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.933347 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9f5155db-49f8-4e27-9893-8bb9e3a9a508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eca6485419d24ecb853f458ad827e43e', 'request_id': 'req-9f5155db-49f8-4e27-9893-8bb9e3a9a508'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.946985 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9f5155db-49f8-4e27-9893-8bb9e3a9a508 admin admin] The token cache is being invalidate because project eca6485419d24ecb853f458ad827e43e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 21:54:52.947274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9f5155db-49f8-4e27-9893-8bb9e3a9a508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.947969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9f5155db-49f8-4e27-9893-8bb9e3a9a508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 21:54:52.949688 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4411/8859] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:54:52 2022] DELETE /identity/v3/projects/eca6485419d24ecb853f458ad827e43e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:54:52.955194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faacaf-078e-440e-91c5-a6ed9dcf669e None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:52.955708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faacaf-078e-440e-91c5-a6ed9dcf669e None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:52.955806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faacaf-078e-440e-91c5-a6ed9dcf669e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:52.974776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f9faacaf-078e-440e-91c5-a6ed9dcf669e None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:54:52.975989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f9faacaf-078e-440e-91c5-a6ed9dcf669e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:54:53.048991 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4449/8860] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:54:53.057467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd76c8-ebec-4c41-a5bd-abc33b0f8113 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:53.057803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd76c8-ebec-4c41-a5bd-abc33b0f8113 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:53.058090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd76c8-ebec-4c41-a5bd-abc33b0f8113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:53.077693 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-e4dd76c8-ebec-4c41-a5bd-abc33b0f8113 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:54:53.078923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e4dd76c8-ebec-4c41-a5bd-abc33b0f8113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:54:53.087642 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4412/8861] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:54:53.092302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faacaf-078e-440e-91c5-a6ed9dcf669e None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:53.102888 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faacaf-078e-440e-91c5-a6ed9dcf669e None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:53.108988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc125992-7001-4d1a-a848-d6d997a995f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:53.109663 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc125992-7001-4d1a-a848-d6d997a995f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:53.109945 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc125992-7001-4d1a-a848-d6d997a995f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:53.110233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc125992-7001-4d1a-a848-d6d997a995f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:53.110959 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc125992-7001-4d1a-a848-d6d997a995f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 21:54:53.111296 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc125992-7001-4d1a-a848-d6d997a995f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:53.113002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc125992-7001-4d1a-a848-d6d997a995f3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:53.125590 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4450/8862] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 21:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 21:54:53.130162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd76c8-ebec-4c41-a5bd-abc33b0f8113 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:53.139900 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd76c8-ebec-4c41-a5bd-abc33b0f8113 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:53.145120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b574e22-1ee1-4a10-b293-629efb73a7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:53.145773 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b574e22-1ee1-4a10-b293-629efb73a7cb admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:53.146056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b574e22-1ee1-4a10-b293-629efb73a7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:53.146335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b574e22-1ee1-4a10-b293-629efb73a7cb admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:53.147039 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b574e22-1ee1-4a10-b293-629efb73a7cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:53.149165 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b574e22-1ee1-4a10-b293-629efb73a7cb admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:53.179378 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4413/8863] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:54:53 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:54:53.185385 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc125992-7001-4d1a-a848-d6d997a995f3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:53.196786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc125992-7001-4d1a-a848-d6d997a995f3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:53.258352 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e782f36-02c6-4081-a70d-31ad04f0b0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:53.259042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e782f36-02c6-4081-a70d-31ad04f0b0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:53.259357 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e782f36-02c6-4081-a70d-31ad04f0b0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:53.259635 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e782f36-02c6-4081-a70d-31ad04f0b0d6 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:53.260353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e782f36-02c6-4081-a70d-31ad04f0b0d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:53.262419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e782f36-02c6-4081-a70d-31ad04f0b0d6 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:53.283438 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4451/8864] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:54:53 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:54:53.287783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b574e22-1ee1-4a10-b293-629efb73a7cb admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:53.298809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b574e22-1ee1-4a10-b293-629efb73a7cb admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:53.304137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09b557-fcc9-44fc-99fc-f810f01e9c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:53.304807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09b557-fcc9-44fc-99fc-f810f01e9c19 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:53.305091 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09b557-fcc9-44fc-99fc-f810f01e9c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:53.305359 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09b557-fcc9-44fc-99fc-f810f01e9c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:53.306098 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09b557-fcc9-44fc-99fc-f810f01e9c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:53.307712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09b557-fcc9-44fc-99fc-f810f01e9c19 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:53.318921 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4414/8865] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:54:53.322850 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e782f36-02c6-4081-a70d-31ad04f0b0d6 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:53.335891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e782f36-02c6-4081-a70d-31ad04f0b0d6 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:53.344640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff5366-7ce5-4cba-86f4-22736bbb0b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:53.345520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff5366-7ce5-4cba-86f4-22736bbb0b19 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:53.345884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff5366-7ce5-4cba-86f4-22736bbb0b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:53.346245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff5366-7ce5-4cba-86f4-22736bbb0b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:53.347299 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff5366-7ce5-4cba-86f4-22736bbb0b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:53.349894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff5366-7ce5-4cba-86f4-22736bbb0b19 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:53.352972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:53.364095 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4452/8866] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:54:53.368457 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09b557-fcc9-44fc-99fc-f810f01e9c19 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:53.378606 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09b557-fcc9-44fc-99fc-f810f01e9c19 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:53.383348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998ced6-a871-4fdc-824e-4456b78d383c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:53.384268 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998ced6-a871-4fdc-824e-4456b78d383c admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:53.384548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998ced6-a871-4fdc-824e-4456b78d383c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:53.384823 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998ced6-a871-4fdc-824e-4456b78d383c admin admin] PATH_INFO: `/v3/projects/339472a22c2447d4a8174ce682d2e2ed/users/54f87aa5ec014141901ea0c2f1994cde/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:53.399438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998ced6-a871-4fdc-824e-4456b78d383c admin admin] RBAC: Authorizing `identity:create_grant(project_id=339472a22c2447d4a8174ce682d2e2ed, user_id=54f87aa5ec014141901ea0c2f1994cde, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:53.402147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998ced6-a871-4fdc-824e-4456b78d383c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:53.415277 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4415/8867] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:54:53 2022] PUT /identity/v3/projects/339472a22c2447d4a8174ce682d2e2ed/users/54f87aa5ec014141901ea0c2f1994cde/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:54:53.425657 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff2998-d767-415c-bf19-073c51254019 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:53.425951 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff2998-d767-415c-bf19-073c51254019 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:53.426231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff2998-d767-415c-bf19-073c51254019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:53.453501 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d1ff2998-d767-415c-bf19-073c51254019 None None] MFA Rules not processed for user `54f87aa5ec014141901ea0c2f1994cde`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:54:53.454653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d1ff2998-d767-415c-bf19-073c51254019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:54:53.522307 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4453/8868] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:54:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:54:53.527373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998ced6-a871-4fdc-824e-4456b78d383c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:53.595440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998ced6-a871-4fdc-824e-4456b78d383c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:53.603559 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad5758-b90d-4e65-945a-1d111ef51e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:53.604515 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad5758-b90d-4e65-945a-1d111ef51e4b admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:53.604857 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad5758-b90d-4e65-945a-1d111ef51e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:53.605213 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad5758-b90d-4e65-945a-1d111ef51e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:53.606138 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad5758-b90d-4e65-945a-1d111ef51e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:53.609106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad5758-b90d-4e65-945a-1d111ef51e4b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:53.640181 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4416/8869] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 21:54:53 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:54:53.644493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff2998-d767-415c-bf19-073c51254019 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:53.655712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff2998-d767-415c-bf19-073c51254019 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:53.716131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf53dd6-8c62-46ff-b52e-d9e8c48939e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:53.716744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf53dd6-8c62-46ff-b52e-d9e8c48939e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:53.717045 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf53dd6-8c62-46ff-b52e-d9e8c48939e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:53.717323 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf53dd6-8c62-46ff-b52e-d9e8c48939e0 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:53.717995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf53dd6-8c62-46ff-b52e-d9e8c48939e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:53.719928 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf53dd6-8c62-46ff-b52e-d9e8c48939e0 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:53.741640 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4454/8870] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 21:54:53 2022] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 21:54:53.745941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad5758-b90d-4e65-945a-1d111ef51e4b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:53.756922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad5758-b90d-4e65-945a-1d111ef51e4b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:53.762649 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314a886-bf00-49ad-9a00-3945e4e7605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:53.763348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314a886-bf00-49ad-9a00-3945e4e7605b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:53.763631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314a886-bf00-49ad-9a00-3945e4e7605b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:53.763909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314a886-bf00-49ad-9a00-3945e4e7605b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:53.764671 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314a886-bf00-49ad-9a00-3945e4e7605b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:53.766321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314a886-bf00-49ad-9a00-3945e4e7605b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:53.777471 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4417/8871] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:54:53.783627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf53dd6-8c62-46ff-b52e-d9e8c48939e0 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:53.794382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf53dd6-8c62-46ff-b52e-d9e8c48939e0 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:53.799833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5035f9-38af-480c-bb4e-c8ffa3e16a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:53.800775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5035f9-38af-480c-bb4e-c8ffa3e16a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:53.801084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5035f9-38af-480c-bb4e-c8ffa3e16a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:53.801360 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5035f9-38af-480c-bb4e-c8ffa3e16a67 admin admin] PATH_INFO: `/v3/projects/4fd0626950d342d4994b67014e9ac323/users/10b15c72ab1f4c5f8f0d546b8f7dde13/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:53.817185 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5035f9-38af-480c-bb4e-c8ffa3e16a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd0626950d342d4994b67014e9ac323, user_id=10b15c72ab1f4c5f8f0d546b8f7dde13, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:53.819884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5035f9-38af-480c-bb4e-c8ffa3e16a67 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:53.834936 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4455/8872] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:54:53 2022] PUT /identity/v3/projects/4fd0626950d342d4994b67014e9ac323/users/10b15c72ab1f4c5f8f0d546b8f7dde13/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:54:53.839292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314a886-bf00-49ad-9a00-3945e4e7605b admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:53.849866 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314a886-bf00-49ad-9a00-3945e4e7605b admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:53.881561 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:53.913984 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598a67d-d1a4-4f23-b10d-01dd045704af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:53.914942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598a67d-d1a4-4f23-b10d-01dd045704af admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:53.915258 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598a67d-d1a4-4f23-b10d-01dd045704af admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:53.915603 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598a67d-d1a4-4f23-b10d-01dd045704af admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:53.916734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598a67d-d1a4-4f23-b10d-01dd045704af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:53.918474 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598a67d-d1a4-4f23-b10d-01dd045704af admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:53.929224 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4418/8873] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 21:54:53.933719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5035f9-38af-480c-bb4e-c8ffa3e16a67 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:53.944987 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5035f9-38af-480c-bb4e-c8ffa3e16a67 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:53.950839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35117e22-61aa-4022-85be-c43cb3297487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:53.951732 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35117e22-61aa-4022-85be-c43cb3297487 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:53.952013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35117e22-61aa-4022-85be-c43cb3297487 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:53.952320 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35117e22-61aa-4022-85be-c43cb3297487 admin admin] PATH_INFO: `/v3/projects/4fd0626950d342d4994b67014e9ac323/users/10b15c72ab1f4c5f8f0d546b8f7dde13/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:53.954509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35117e22-61aa-4022-85be-c43cb3297487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd0626950d342d4994b67014e9ac323, user_id=10b15c72ab1f4c5f8f0d546b8f7dde13, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:53.957225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35117e22-61aa-4022-85be-c43cb3297487 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:53.968300 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4456/8874] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 21:54:53 2022] PUT /identity/v3/projects/4fd0626950d342d4994b67014e9ac323/users/10b15c72ab1f4c5f8f0d546b8f7dde13/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 21:54:53.979504 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf385b9d-0383-4e0e-ad9e-766d6e08c768 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:53.979806 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf385b9d-0383-4e0e-ad9e-766d6e08c768 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:53.980092 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf385b9d-0383-4e0e-ad9e-766d6e08c768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:54.007523 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-bf385b9d-0383-4e0e-ad9e-766d6e08c768 None None] MFA Rules not processed for user `10b15c72ab1f4c5f8f0d546b8f7dde13`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:54:54.008780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bf385b9d-0383-4e0e-ad9e-766d6e08c768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:54:54.081333 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4419/8875] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:54:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:54:54.099572 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35117e22-61aa-4022-85be-c43cb3297487 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:54.101604 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-35117e22-61aa-4022-85be-c43cb3297487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:54:54.151016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:54.186533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35117e22-61aa-4022-85be-c43cb3297487 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:54.193674 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066099c-6eec-4e77-be8d-912c035722c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:54.194353 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066099c-6eec-4e77-be8d-912c035722c0 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:54.194633 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066099c-6eec-4e77-be8d-912c035722c0 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:54.194891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066099c-6eec-4e77-be8d-912c035722c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:54.256021 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066099c-6eec-4e77-be8d-912c035722c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:54.257607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066099c-6eec-4e77-be8d-912c035722c0 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:54.267255 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4457/8876] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:54:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:54:57.043255 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf385b9d-0383-4e0e-ad9e-766d6e08c768 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:54:57.044819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bf385b9d-0383-4e0e-ad9e-766d6e08c768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:54:57.106564 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf385b9d-0383-4e0e-ad9e-766d6e08c768 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:54:57.110787 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e93e8e-d28e-4cc3-a0af-3a047e3fc8c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:54:57.111441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e93e8e-d28e-4cc3-a0af-3a047e3fc8c0 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:54:57.111728 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e93e8e-d28e-4cc3-a0af-3a047e3fc8c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:54:57.112004 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e93e8e-d28e-4cc3-a0af-3a047e3fc8c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:54:57.121594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e93e8e-d28e-4cc3-a0af-3a047e3fc8c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:54:57.123081 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e93e8e-d28e-4cc3-a0af-3a047e3fc8c0 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:54:57.136109 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4420/8877] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:54:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:55:00.101808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254304c9-f98d-49ba-a53e-2839d25a307a None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:55:00.102279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254304c9-f98d-49ba-a53e-2839d25a307a None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:55:00.102493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254304c9-f98d-49ba-a53e-2839d25a307a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:55:00.122090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-254304c9-f98d-49ba-a53e-2839d25a307a None None] MFA Rules not processed for user `54f87aa5ec014141901ea0c2f1994cde`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:55:00.123350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-254304c9-f98d-49ba-a53e-2839d25a307a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:55:00.131533 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4458/8878] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:55:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:55:00.875817 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e93e8e-d28e-4cc3-a0af-3a047e3fc8c0 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:55:00.877480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-30e93e8e-d28e-4cc3-a0af-3a047e3fc8c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:55:00.970876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:55:00.989036 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e93e8e-d28e-4cc3-a0af-3a047e3fc8c0 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:55:01.010020 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5e518-73a4-42b6-8c59-0b4ef4d6a4e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:55:01.010650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5e518-73a4-42b6-8c59-0b4ef4d6a4e2 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:55:01.010939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5e518-73a4-42b6-8c59-0b4ef4d6a4e2 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:55:01.011218 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5e518-73a4-42b6-8c59-0b4ef4d6a4e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:55:01.013432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-efc5e518-73a4-42b6-8c59-0b4ef4d6a4e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:55:01.030582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc5e518-73a4-42b6-8c59-0b4ef4d6a4e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:55:01.032492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc5e518-73a4-42b6-8c59-0b4ef4d6a4e2 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:55:01.046397 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4421/8879] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:55:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:55:03.120910 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254304c9-f98d-49ba-a53e-2839d25a307a None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:55:03.123083 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-254304c9-f98d-49ba-a53e-2839d25a307a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:55:03.136926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254304c9-f98d-49ba-a53e-2839d25a307a None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:55:03.141048 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879389b0-275b-46eb-9927-f531ec1db395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:55:03.141764 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879389b0-275b-46eb-9927-f531ec1db395 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:55:03.142105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879389b0-275b-46eb-9927-f531ec1db395 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:55:03.142538 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879389b0-275b-46eb-9927-f531ec1db395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:55:03.145340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-879389b0-275b-46eb-9927-f531ec1db395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:55:03.170319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879389b0-275b-46eb-9927-f531ec1db395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:55:03.172222 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879389b0-275b-46eb-9927-f531ec1db395 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:55:03.189078 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4459/8880] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:55:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:55:03.938904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5e518-73a4-42b6-8c59-0b4ef4d6a4e2 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:55:03.941706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-efc5e518-73a4-42b6-8c59-0b4ef4d6a4e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:55:03.969202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5e518-73a4-42b6-8c59-0b4ef4d6a4e2 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:55:03.983352 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848de1e6-3c99-4217-b0ca-965ceb880339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:55:03.984276 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848de1e6-3c99-4217-b0ca-965ceb880339 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:55:03.984665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848de1e6-3c99-4217-b0ca-965ceb880339 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:55:03.985037 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848de1e6-3c99-4217-b0ca-965ceb880339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:55:03.987199 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-848de1e6-3c99-4217-b0ca-965ceb880339 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:55:04.007191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848de1e6-3c99-4217-b0ca-965ceb880339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:55:04.009875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848de1e6-3c99-4217-b0ca-965ceb880339 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:55:04.028376 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4422/8881] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:55:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:55:13.178041 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=47 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:55:14.019573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=12 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:55:38.989011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879389b0-275b-46eb-9927-f531ec1db395 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:55:38.990777 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-879389b0-275b-46eb-9927-f531ec1db395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:55:39.015711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879389b0-275b-46eb-9927-f531ec1db395 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:55:39.023259 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ece6b2-87a6-488f-9957-a3857ba31a16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:55:39.023953 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ece6b2-87a6-488f-9957-a3857ba31a16 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:55:39.024273 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ece6b2-87a6-488f-9957-a3857ba31a16 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:55:39.024545 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ece6b2-87a6-488f-9957-a3857ba31a16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:55:39.026668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-74ece6b2-87a6-488f-9957-a3857ba31a16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:55:39.041936 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ece6b2-87a6-488f-9957-a3857ba31a16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:55:39.043560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ece6b2-87a6-488f-9957-a3857ba31a16 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:55:39.057912 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4460/8882] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:55:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:55:49.049882 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:56:45.231013 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492610c-22e4-4204-9e53-710dcb0d335c None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:56:45.231598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492610c-22e4-4204-9e53-710dcb0d335c None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:56:45.231598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492610c-22e4-4204-9e53-710dcb0d335c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:56:45.249481 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1492610c-22e4-4204-9e53-710dcb0d335c None None] MFA Rules not processed for user `54f87aa5ec014141901ea0c2f1994cde`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:56:45.250704 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1492610c-22e4-4204-9e53-710dcb0d335c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:56:45.258228 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4423/8883] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:56:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:56:45.588120 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ece6b2-87a6-488f-9957-a3857ba31a16 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:56:45.598294 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ece6b2-87a6-488f-9957-a3857ba31a16 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:56:45.602195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7933a9c-db1a-4cfa-902f-f08ed6304ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:56:45.606216 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7933a9c-db1a-4cfa-902f-f08ed6304ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:56:45.606686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7933a9c-db1a-4cfa-902f-f08ed6304ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:56:45.607140 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7933a9c-db1a-4cfa-902f-f08ed6304ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:56:45.609464 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c7933a9c-db1a-4cfa-902f-f08ed6304ea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:56:45.623342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7933a9c-db1a-4cfa-902f-f08ed6304ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:56:45.624863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7933a9c-db1a-4cfa-902f-f08ed6304ea9 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:56:45.637209 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4461/8884] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:56:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:56:47.036133 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ede59a-04e8-4255-97c7-f159bb7d80a8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:56:47.036708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ede59a-04e8-4255-97c7-f159bb7d80a8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:56:47.036708 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ede59a-04e8-4255-97c7-f159bb7d80a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:56:47.109898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-24ede59a-04e8-4255-97c7-f159bb7d80a8 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:56:47.115939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-24ede59a-04e8-4255-97c7-f159bb7d80a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:56:47.133742 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4424/8885] 10.222.0.43 () {58 vars in 1057 bytes} [Sat Jul 2 21:56:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:56:47.141166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7933a9c-db1a-4cfa-902f-f08ed6304ea9 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:56:47.159042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7933a9c-db1a-4cfa-902f-f08ed6304ea9 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:56:47.164194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081c2b2-33cc-4191-83c5-ecb34c79e9cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:56:47.164853 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081c2b2-33cc-4191-83c5-ecb34c79e9cd service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:56:47.165145 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081c2b2-33cc-4191-83c5-ecb34c79e9cd service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:56:47.165407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081c2b2-33cc-4191-83c5-ecb34c79e9cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:56:47.167374 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6081c2b2-33cc-4191-83c5-ecb34c79e9cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:56:47.179671 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081c2b2-33cc-4191-83c5-ecb34c79e9cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:56:47.182413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081c2b2-33cc-4191-83c5-ecb34c79e9cd service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:56:47.194017 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4462/8886] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:56:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:56:47.709742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6102bf-b2ce-4c0d-86b5-4db104b325bf None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:56:47.710102 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6102bf-b2ce-4c0d-86b5-4db104b325bf None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:56:47.710381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6102bf-b2ce-4c0d-86b5-4db104b325bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:56:47.732381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-6f6102bf-b2ce-4c0d-86b5-4db104b325bf None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:56:47.733587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6f6102bf-b2ce-4c0d-86b5-4db104b325bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:56:47.742223 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4425/8887] 10.222.0.59 () {58 vars in 1015 bytes} [Sat Jul 2 21:56:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:56:47.754582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081c2b2-33cc-4191-83c5-ecb34c79e9cd service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:56:47.768343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081c2b2-33cc-4191-83c5-ecb34c79e9cd service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:56:47.773483 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4401d4d-07f2-47c6-9564-1121e4634b2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:56:47.774144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4401d4d-07f2-47c6-9564-1121e4634b2c service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:56:47.774427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4401d4d-07f2-47c6-9564-1121e4634b2c service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:56:47.774707 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4401d4d-07f2-47c6-9564-1121e4634b2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:56:47.784618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4401d4d-07f2-47c6-9564-1121e4634b2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:56:47.786372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4401d4d-07f2-47c6-9564-1121e4634b2c service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:56:47.797188 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4463/8888] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:56:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:56:57.726331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=15 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:56:57.792723 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=18 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:57:30.963957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5aacd-7261-4787-a2b6-aa9a08ac8b04 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:57:30.964635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5aacd-7261-4787-a2b6-aa9a08ac8b04 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:57:30.964635 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5aacd-7261-4787-a2b6-aa9a08ac8b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:57:30.984453 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-33d5aacd-7261-4787-a2b6-aa9a08ac8b04 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:57:30.985968 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-33d5aacd-7261-4787-a2b6-aa9a08ac8b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:57:30.995773 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4426/8889] 10.222.0.58 () {58 vars in 1015 bytes} [Sat Jul 2 21:57:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:57:31.010905 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4401d4d-07f2-47c6-9564-1121e4634b2c service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:57:31.022067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4401d4d-07f2-47c6-9564-1121e4634b2c service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:57:31.028162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ba6bc-29e7-444c-bb1c-db38f9b61ccc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:57:31.028806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ba6bc-29e7-444c-bb1c-db38f9b61ccc service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:57:31.029088 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ba6bc-29e7-444c-bb1c-db38f9b61ccc service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:57:31.029368 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ba6bc-29e7-444c-bb1c-db38f9b61ccc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:57:31.038291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ba6bc-29e7-444c-bb1c-db38f9b61ccc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:57:31.039894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ba6bc-29e7-444c-bb1c-db38f9b61ccc service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:57:31.049861 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4464/8890] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:57:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:57:40.979345 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:57:41.045621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:58:14.807331 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5aacd-7261-4787-a2b6-aa9a08ac8b04 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:58:14.817485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5aacd-7261-4787-a2b6-aa9a08ac8b04 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:58:14.821790 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa11e3-0276-4d53-9b53-b9b502c948e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:58:14.822444 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa11e3-0276-4d53-9b53-b9b502c948e3 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:58:14.822724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa11e3-0276-4d53-9b53-b9b502c948e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:58:14.823665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa11e3-0276-4d53-9b53-b9b502c948e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:58:14.825617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d8aa11e3-0276-4d53-9b53-b9b502c948e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:58:14.842509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa11e3-0276-4d53-9b53-b9b502c948e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:58:14.843950 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa11e3-0276-4d53-9b53-b9b502c948e3 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:58:14.867697 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4427/8891] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:58:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:58:16.129904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ba6bc-29e7-444c-bb1c-db38f9b61ccc service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:58:16.140351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ba6bc-29e7-444c-bb1c-db38f9b61ccc service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:58:16.145151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2c8a4-946e-4bf6-b79c-702b059c2948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:58:16.145788 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2c8a4-946e-4bf6-b79c-702b059c2948 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:58:16.146067 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2c8a4-946e-4bf6-b79c-702b059c2948 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:58:16.146407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2c8a4-946e-4bf6-b79c-702b059c2948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:58:16.148624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8cd2c8a4-946e-4bf6-b79c-702b059c2948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:58:16.165809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2c8a4-946e-4bf6-b79c-702b059c2948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:58:16.167168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2c8a4-946e-4bf6-b79c-702b059c2948 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:58:16.180759 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4465/8892] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:58:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:58:24.865130 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=10 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:58:26.173517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:59:30.216699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55de5d1-8eca-492c-8337-d6c1bca8f150 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:59:30.217321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55de5d1-8eca-492c-8337-d6c1bca8f150 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:59:30.217321 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55de5d1-8eca-492c-8337-d6c1bca8f150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:59:30.268650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-f55de5d1-8eca-492c-8337-d6c1bca8f150 None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:59:30.269911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f55de5d1-8eca-492c-8337-d6c1bca8f150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:59:30.280603 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4428/8893] 10.222.0.43 () {58 vars in 1058 bytes} [Sat Jul 2 21:59:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:59:30.287009 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d7190-d30c-4baf-af3e-3870def9be9b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:59:30.287569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d7190-d30c-4baf-af3e-3870def9be9b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:59:30.287569 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d7190-d30c-4baf-af3e-3870def9be9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:59:30.309839 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-3e9d7190-d30c-4baf-af3e-3870def9be9b None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:59:30.311055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-3e9d7190-d30c-4baf-af3e-3870def9be9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:59:30.320522 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4466/8894] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:59:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 21:59:30.331434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55de5d1-8eca-492c-8337-d6c1bca8f150 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:59:30.350955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55de5d1-8eca-492c-8337-d6c1bca8f150 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:59:30.354700 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cbe23-5772-4de1-8532-3320dc391dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:59:30.355343 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cbe23-5772-4de1-8532-3320dc391dff service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:59:30.355624 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cbe23-5772-4de1-8532-3320dc391dff service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:59:30.355898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cbe23-5772-4de1-8532-3320dc391dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:59:30.366650 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320cbe23-5772-4de1-8532-3320dc391dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:59:30.368090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320cbe23-5772-4de1-8532-3320dc391dff service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:59:30.378956 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4429/8895] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:59:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:59:31.567347 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace47810-de2b-40f3-8f25-9fc7cf13b9be None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:59:31.567842 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace47810-de2b-40f3-8f25-9fc7cf13b9be None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:59:31.567965 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace47810-de2b-40f3-8f25-9fc7cf13b9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:59:31.587642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ace47810-de2b-40f3-8f25-9fc7cf13b9be None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:59:31.588906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ace47810-de2b-40f3-8f25-9fc7cf13b9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:59:31.598688 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4467/8896] 10.222.0.43 () {58 vars in 1058 bytes} [Sat Jul 2 21:59:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:59:31.604912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6f1bc-9b5c-4b43-b715-844f1cf571df None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:59:31.605432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6f1bc-9b5c-4b43-b715-844f1cf571df None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:59:31.605546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6f1bc-9b5c-4b43-b715-844f1cf571df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:59:31.624150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-88f6f1bc-9b5c-4b43-b715-844f1cf571df None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:59:31.625367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-88f6f1bc-9b5c-4b43-b715-844f1cf571df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:59:31.634873 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4430/8897] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 21:59:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:59:31.655371 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace47810-de2b-40f3-8f25-9fc7cf13b9be None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:59:31.665065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace47810-de2b-40f3-8f25-9fc7cf13b9be None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:59:31.669653 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa201f-0e30-4c4a-a111-20f26f7f62d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:59:31.670409 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa201f-0e30-4c4a-a111-20f26f7f62d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:59:31.670695 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa201f-0e30-4c4a-a111-20f26f7f62d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:59:31.670979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa201f-0e30-4c4a-a111-20f26f7f62d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:59:31.682060 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa201f-0e30-4c4a-a111-20f26f7f62d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:59:31.683517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa201f-0e30-4c4a-a111-20f26f7f62d6 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:59:31.694144 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4468/8898] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:59:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:59:32.385441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056145d-5cd4-4ccf-bd34-a0d59e2c9ef9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:59:32.385737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056145d-5cd4-4ccf-bd34-a0d59e2c9ef9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:59:32.386156 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056145d-5cd4-4ccf-bd34-a0d59e2c9ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:59:32.405678 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-c056145d-5cd4-4ccf-bd34-a0d59e2c9ef9 None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:59:32.406904 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c056145d-5cd4-4ccf-bd34-a0d59e2c9ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:59:32.417855 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4431/8899] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:59:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:59:32.430475 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa201f-0e30-4c4a-a111-20f26f7f62d6 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:59:32.442155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa201f-0e30-4c4a-a111-20f26f7f62d6 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:59:32.447647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d0d28-a084-44ed-ac80-129ce4358b0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:59:32.448431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d0d28-a084-44ed-ac80-129ce4358b0b service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:59:32.448862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d0d28-a084-44ed-ac80-129ce4358b0b service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:59:32.449144 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d0d28-a084-44ed-ac80-129ce4358b0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:59:32.459690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d0d28-a084-44ed-ac80-129ce4358b0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:59:32.461343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d0d28-a084-44ed-ac80-129ce4358b0b service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:59:32.472116 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4469/8900] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:59:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:59:37.133206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056145d-5cd4-4ccf-bd34-a0d59e2c9ef9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:59:37.154737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056145d-5cd4-4ccf-bd34-a0d59e2c9ef9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:59:37.167043 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9799a0-c6da-49ce-b99f-a375ad89ab79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:59:37.168262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9799a0-c6da-49ce-b99f-a375ad89ab79 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:59:37.169724 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9799a0-c6da-49ce-b99f-a375ad89ab79 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:59:37.170269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9799a0-c6da-49ce-b99f-a375ad89ab79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:59:37.173368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2e9799a0-c6da-49ce-b99f-a375ad89ab79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:59:37.189355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9799a0-c6da-49ce-b99f-a375ad89ab79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:59:37.191176 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9799a0-c6da-49ce-b99f-a375ad89ab79 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:59:37.206513 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4432/8901] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:59:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:59:42.467582 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=18 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:59:43.305982 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3d82d-e4cd-49df-af8e-d3b94abf2a43 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:59:43.306275 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3d82d-e4cd-49df-af8e-d3b94abf2a43 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:59:43.306802 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3d82d-e4cd-49df-af8e-d3b94abf2a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:59:43.327085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-38d3d82d-e4cd-49df-af8e-d3b94abf2a43 None None] MFA Rules not processed for user `54f87aa5ec014141901ea0c2f1994cde`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:59:43.328920 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-38d3d82d-e4cd-49df-af8e-d3b94abf2a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:59:43.337045 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4470/8902] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 21:59:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:59:45.922402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5dfdc-319c-4803-9d71-5fb49a9e68a2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:59:45.922820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5dfdc-319c-4803-9d71-5fb49a9e68a2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:59:45.922978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5dfdc-319c-4803-9d71-5fb49a9e68a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:59:45.980990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-cef5dfdc-319c-4803-9d71-5fb49a9e68a2 None None] MFA Rules not processed for user `684732cf5a004fb084ce0e523398c970`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:59:45.982311 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-cef5dfdc-319c-4803-9d71-5fb49a9e68a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:59:45.989742 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4433/8903] 10.222.0.59 () {58 vars in 1015 bytes} [Sat Jul 2 21:59:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:59:46.011634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3d82d-e4cd-49df-af8e-d3b94abf2a43 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:59:46.022989 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3d82d-e4cd-49df-af8e-d3b94abf2a43 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:59:46.027182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf05fd2-0ced-4c6e-923f-d76c7c342b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:59:46.028013 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf05fd2-0ced-4c6e-923f-d76c7c342b47 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:59:46.028453 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf05fd2-0ced-4c6e-923f-d76c7c342b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:59:46.028821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf05fd2-0ced-4c6e-923f-d76c7c342b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:59:46.038240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf05fd2-0ced-4c6e-923f-d76c7c342b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:59:46.040188 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf05fd2-0ced-4c6e-923f-d76c7c342b47 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:59:46.051040 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4471/8904] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:59:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:59:53.340755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5dfdc-319c-4803-9d71-5fb49a9e68a2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:59:53.362298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5dfdc-319c-4803-9d71-5fb49a9e68a2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:59:53.370619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd3ad6-83d7-49a1-9144-279bd391a48c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:59:53.371405 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd3ad6-83d7-49a1-9144-279bd391a48c service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:59:53.371686 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd3ad6-83d7-49a1-9144-279bd391a48c service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:59:53.371962 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd3ad6-83d7-49a1-9144-279bd391a48c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:59:53.381602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd3ad6-83d7-49a1-9144-279bd391a48c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:59:53.383241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd3ad6-83d7-49a1-9144-279bd391a48c service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:59:53.392670 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4434/8905] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:59:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:59:54.522746 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e72e2-04f7-4302-a29e-af112513c556 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:59:54.523261 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e72e2-04f7-4302-a29e-af112513c556 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:59:54.523446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e72e2-04f7-4302-a29e-af112513c556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:59:54.543607 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-f68e72e2-04f7-4302-a29e-af112513c556 None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 21:59:54.544995 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f68e72e2-04f7-4302-a29e-af112513c556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:59:54.556811 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4472/8906] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 21:59:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 21:59:54.579367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd3ad6-83d7-49a1-9144-279bd391a48c service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:59:54.591944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd3ad6-83d7-49a1-9144-279bd391a48c service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:59:54.610447 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b218704-6744-414a-9cb0-d7b3c6b860f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:59:54.611209 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b218704-6744-414a-9cb0-d7b3c6b860f1 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:59:54.611555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b218704-6744-414a-9cb0-d7b3c6b860f1 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:59:54.611822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b218704-6744-414a-9cb0-d7b3c6b860f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:59:54.622478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b218704-6744-414a-9cb0-d7b3c6b860f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:59:54.624310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b218704-6744-414a-9cb0-d7b3c6b860f1 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:59:54.635402 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4435/8907] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:59:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:59:57.313270 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e72e2-04f7-4302-a29e-af112513c556 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:59:57.326399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e72e2-04f7-4302-a29e-af112513c556 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:59:57.330847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa35a4-9961-41ee-b1a8-7bc8d77c36fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:59:57.331487 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa35a4-9961-41ee-b1a8-7bc8d77c36fc service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:59:57.331769 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa35a4-9961-41ee-b1a8-7bc8d77c36fc service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:59:57.332077 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa35a4-9961-41ee-b1a8-7bc8d77c36fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:59:57.341721 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa35a4-9961-41ee-b1a8-7bc8d77c36fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:59:57.343175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa35a4-9961-41ee-b1a8-7bc8d77c36fc service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:59:57.352872 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4473/8908] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 21:59:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:00:04.630819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=56 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:00:07.348906 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=18 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:01:03.135750 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca27343-d235-421a-a354-19cf68f911c0 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:01:03.136431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca27343-d235-421a-a354-19cf68f911c0 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:01:03.136431 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca27343-d235-421a-a354-19cf68f911c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:01:03.156189 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8ca27343-d235-421a-a354-19cf68f911c0 None None] MFA Rules not processed for user `684732cf5a004fb084ce0e523398c970`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:01:03.157404 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8ca27343-d235-421a-a354-19cf68f911c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:01:03.164963 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4436/8909] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 22:01:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:01:03.178102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa35a4-9961-41ee-b1a8-7bc8d77c36fc service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:01:03.187350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa35a4-9961-41ee-b1a8-7bc8d77c36fc service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:01:03.192085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb291a-660b-4dd9-814f-61bd83a3bff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:01:03.192744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb291a-660b-4dd9-814f-61bd83a3bff9 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:01:03.193025 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb291a-660b-4dd9-814f-61bd83a3bff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:01:03.193302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb291a-660b-4dd9-814f-61bd83a3bff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:01:03.201436 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb291a-660b-4dd9-814f-61bd83a3bff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:01:03.202894 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb291a-660b-4dd9-814f-61bd83a3bff9 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:01:03.211579 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4474/8910] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:01:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:01:03.357875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98800d95-39fc-4905-9cb8-ac33283cf743 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:01:03.358129 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98800d95-39fc-4905-9cb8-ac33283cf743 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:01:03.358436 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98800d95-39fc-4905-9cb8-ac33283cf743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:01:03.377306 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-98800d95-39fc-4905-9cb8-ac33283cf743 None None] MFA Rules not processed for user `684732cf5a004fb084ce0e523398c970`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:01:03.378526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-98800d95-39fc-4905-9cb8-ac33283cf743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:01:03.385896 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4437/8911] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 22:01:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:01:03.398070 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb291a-660b-4dd9-814f-61bd83a3bff9 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:01:03.407413 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb291a-660b-4dd9-814f-61bd83a3bff9 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:01:03.411952 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93910a97-e5b1-439d-a3b4-0cccff335803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:01:03.412642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93910a97-e5b1-439d-a3b4-0cccff335803 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:01:03.412927 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93910a97-e5b1-439d-a3b4-0cccff335803 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:01:03.413199 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93910a97-e5b1-439d-a3b4-0cccff335803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:01:03.421817 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93910a97-e5b1-439d-a3b4-0cccff335803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:01:03.423285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93910a97-e5b1-439d-a3b4-0cccff335803 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:01:03.432373 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4475/8912] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:01:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:01:03.522923 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee0892-8470-4ba8-a7fb-f80a21ea17e9 None None] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:01:03.523211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee0892-8470-4ba8-a7fb-f80a21ea17e9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:01:03.523494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee0892-8470-4ba8-a7fb-f80a21ea17e9 None None] PATH_INFO: `/` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:01:03.524987 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4438/8913] 10.222.0.43 () {54 vars in 921 bytes} [Sat Jul 2 22:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 22:01:03.529926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f99532-4351-4244-8d13-d4a0f29cd1f3 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:01:03.530219 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f99532-4351-4244-8d13-d4a0f29cd1f3 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:01:03.530518 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f99532-4351-4244-8d13-d4a0f29cd1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:01:03.549701 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d9f99532-4351-4244-8d13-d4a0f29cd1f3 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:01:03.550958 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d9f99532-4351-4244-8d13-d4a0f29cd1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:01:03.562514 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4476/8914] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 22:01:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:01:03.582413 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee0892-8470-4ba8-a7fb-f80a21ea17e9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:01:03.596839 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee0892-8470-4ba8-a7fb-f80a21ea17e9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:01:03.602175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea782d81-1aca-4bad-b88c-ba212548b40c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:01:03.602814 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea782d81-1aca-4bad-b88c-ba212548b40c service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:01:03.603096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea782d81-1aca-4bad-b88c-ba212548b40c service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:01:03.603373 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea782d81-1aca-4bad-b88c-ba212548b40c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:01:03.612018 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea782d81-1aca-4bad-b88c-ba212548b40c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:01:03.613725 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea782d81-1aca-4bad-b88c-ba212548b40c service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:01:03.623573 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4439/8915] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:01:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:01:03.805976 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f99532-4351-4244-8d13-d4a0f29cd1f3 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:01:03.815755 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f99532-4351-4244-8d13-d4a0f29cd1f3 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:01:03.819776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df3bf8-b655-4a69-8f7c-22d6ca32a579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:01:03.820730 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df3bf8-b655-4a69-8f7c-22d6ca32a579 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:01:03.821018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df3bf8-b655-4a69-8f7c-22d6ca32a579 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:01:03.821287 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df3bf8-b655-4a69-8f7c-22d6ca32a579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:01:03.823155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-58df3bf8-b655-4a69-8f7c-22d6ca32a579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:01:03.840284 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df3bf8-b655-4a69-8f7c-22d6ca32a579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:01:03.841681 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df3bf8-b655-4a69-8f7c-22d6ca32a579 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:01:03.855382 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4477/8916] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:01:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:01:13.619480 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=12 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:01:13.848101 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=21 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:01:17.474756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f901e-73bc-40d9-ac25-5a4888bc1843 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:01:17.475361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f901e-73bc-40d9-ac25-5a4888bc1843 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:01:17.475361 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f901e-73bc-40d9-ac25-5a4888bc1843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:01:17.498604 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-9a8f901e-73bc-40d9-ac25-5a4888bc1843 None None] MFA Rules not processed for user `684732cf5a004fb084ce0e523398c970`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:01:17.499824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9a8f901e-73bc-40d9-ac25-5a4888bc1843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:01:17.507517 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4440/8917] 10.222.0.58 () {58 vars in 1015 bytes} [Sat Jul 2 22:01:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:01:17.525624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df3bf8-b655-4a69-8f7c-22d6ca32a579 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:01:17.535007 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df3bf8-b655-4a69-8f7c-22d6ca32a579 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:01:17.539687 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b8e9b-dfcb-4998-b21b-b3ee57f8b724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:01:17.540367 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b8e9b-dfcb-4998-b21b-b3ee57f8b724 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:01:17.540650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b8e9b-dfcb-4998-b21b-b3ee57f8b724 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:01:17.540926 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b8e9b-dfcb-4998-b21b-b3ee57f8b724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:01:17.549615 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b8e9b-dfcb-4998-b21b-b3ee57f8b724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:01:17.550968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b8e9b-dfcb-4998-b21b-b3ee57f8b724 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:01:17.559502 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4478/8918] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:01:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:01:27.493211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:01:27.555762 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:01:59.005842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd6107-8bbc-4722-b83b-a45bc86e497f None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:01:59.006410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd6107-8bbc-4722-b83b-a45bc86e497f None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:01:59.006410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd6107-8bbc-4722-b83b-a45bc86e497f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:01:59.027390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8afd6107-8bbc-4722-b83b-a45bc86e497f None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:01:59.029137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8afd6107-8bbc-4722-b83b-a45bc86e497f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:01:59.040010 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4441/8919] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 22:01:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:01:59.057691 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b8e9b-dfcb-4998-b21b-b3ee57f8b724 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:01:59.073697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b8e9b-dfcb-4998-b21b-b3ee57f8b724 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:01:59.086938 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f85ea-2465-492b-ab0f-7025948233b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:01:59.087619 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f85ea-2465-492b-ab0f-7025948233b4 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:01:59.087962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f85ea-2465-492b-ab0f-7025948233b4 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:01:59.093269 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f85ea-2465-492b-ab0f-7025948233b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:01:59.100019 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f85ea-2465-492b-ab0f-7025948233b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:01:59.101664 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f85ea-2465-492b-ab0f-7025948233b4 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:01:59.113172 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4479/8920] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:01:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:02:06.157484 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663ff3e-215c-4b02-b04e-457dc577c762 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:02:06.158031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663ff3e-215c-4b02-b04e-457dc577c762 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:02:06.158031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663ff3e-215c-4b02-b04e-457dc577c762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:02:06.178318 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d663ff3e-215c-4b02-b04e-457dc577c762 None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:02:06.179734 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d663ff3e-215c-4b02-b04e-457dc577c762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:02:06.189145 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4442/8921] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 22:02:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:02:06.203427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f85ea-2465-492b-ab0f-7025948233b4 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:02:06.215113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f85ea-2465-492b-ab0f-7025948233b4 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:02:06.223909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fbb97-3c58-4d72-8e3f-6b046cc963af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:02:06.223909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fbb97-3c58-4d72-8e3f-6b046cc963af service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:02:06.223909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fbb97-3c58-4d72-8e3f-6b046cc963af service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:02:06.223909 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fbb97-3c58-4d72-8e3f-6b046cc963af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:02:06.233499 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fbb97-3c58-4d72-8e3f-6b046cc963af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:02:06.235399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fbb97-3c58-4d72-8e3f-6b046cc963af service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:02:06.247244 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4480/8922] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:02:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:02:11.993010 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeae8e-7063-4579-9ad1-8755a9cc3e04 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:02:11.993462 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeae8e-7063-4579-9ad1-8755a9cc3e04 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:02:11.993683 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeae8e-7063-4579-9ad1-8755a9cc3e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:02:12.011996 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-49eeae8e-7063-4579-9ad1-8755a9cc3e04 None None] MFA Rules not processed for user `54f87aa5ec014141901ea0c2f1994cde`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:02:12.013262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-49eeae8e-7063-4579-9ad1-8755a9cc3e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:02:12.020891 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4443/8923] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 22:02:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:02:12.751712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fbb97-3c58-4d72-8e3f-6b046cc963af service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:02:12.764211 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fbb97-3c58-4d72-8e3f-6b046cc963af service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:02:12.770340 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45ca85-bd3e-4952-94c0-837af005ff8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:02:12.771590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45ca85-bd3e-4952-94c0-837af005ff8b service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:02:12.771891 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45ca85-bd3e-4952-94c0-837af005ff8b service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:02:12.772289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45ca85-bd3e-4952-94c0-837af005ff8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:02:12.786137 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45ca85-bd3e-4952-94c0-837af005ff8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:02:12.788744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45ca85-bd3e-4952-94c0-837af005ff8b service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:02:12.814385 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4481/8924] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:02:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:02:13.405290 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64453f44-f7cd-4b39-9ab3-7e833d979d5a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:02:13.405795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64453f44-f7cd-4b39-9ab3-7e833d979d5a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:02:13.405936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64453f44-f7cd-4b39-9ab3-7e833d979d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:02:13.429978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-64453f44-f7cd-4b39-9ab3-7e833d979d5a None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:02:13.431211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-64453f44-f7cd-4b39-9ab3-7e833d979d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:02:13.439874 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4444/8925] 10.222.0.43 () {58 vars in 1057 bytes} [Sat Jul 2 22:02:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:02:13.446182 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45ca85-bd3e-4952-94c0-837af005ff8b service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:02:13.458082 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45ca85-bd3e-4952-94c0-837af005ff8b service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:02:13.463389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd759b-97fd-438d-97b9-da0bd5c3da94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:02:13.464068 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd759b-97fd-438d-97b9-da0bd5c3da94 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:02:13.464344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd759b-97fd-438d-97b9-da0bd5c3da94 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:02:13.464646 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd759b-97fd-438d-97b9-da0bd5c3da94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:02:13.473469 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd759b-97fd-438d-97b9-da0bd5c3da94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:02:13.475095 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd759b-97fd-438d-97b9-da0bd5c3da94 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:02:13.486476 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4482/8926] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:02:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:02:23.424179 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=12 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:02:23.481444 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=24 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:02:37.989733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64453f44-f7cd-4b39-9ab3-7e833d979d5a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:02:38.034598 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64453f44-f7cd-4b39-9ab3-7e833d979d5a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:02:38.040478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1d939-88ef-40d5-803f-ef690898578d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:02:38.041125 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1d939-88ef-40d5-803f-ef690898578d service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:02:38.041416 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1d939-88ef-40d5-803f-ef690898578d service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:02:38.041687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1d939-88ef-40d5-803f-ef690898578d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:02:38.050979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1d939-88ef-40d5-803f-ef690898578d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:02:38.052602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1d939-88ef-40d5-803f-ef690898578d service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:02:38.062535 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4445/8927] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:02:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:02:48.058518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=20 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:04:47.662816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd759b-97fd-438d-97b9-da0bd5c3da94 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:04:47.687293 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd759b-97fd-438d-97b9-da0bd5c3da94 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:04:47.691381 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964f6e9-bca5-43ea-a390-484c2e9fb6d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:04:47.692180 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964f6e9-bca5-43ea-a390-484c2e9fb6d0 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:04:47.692526 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964f6e9-bca5-43ea-a390-484c2e9fb6d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:04:47.692864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964f6e9-bca5-43ea-a390-484c2e9fb6d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:04:47.701809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964f6e9-bca5-43ea-a390-484c2e9fb6d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:04:47.703823 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964f6e9-bca5-43ea-a390-484c2e9fb6d0 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:04:47.725987 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4483/8928] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:04:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:04:47.776371 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1d939-88ef-40d5-803f-ef690898578d service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:04:47.786329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1d939-88ef-40d5-803f-ef690898578d service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:04:47.789979 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292b8f5-3f97-4121-87dc-4fd10f51e57d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:04:47.790640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292b8f5-3f97-4121-87dc-4fd10f51e57d service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:04:47.790911 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292b8f5-3f97-4121-87dc-4fd10f51e57d service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:04:47.791186 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292b8f5-3f97-4121-87dc-4fd10f51e57d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:04:47.809917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292b8f5-3f97-4121-87dc-4fd10f51e57d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:04:47.811456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292b8f5-3f97-4121-87dc-4fd10f51e57d service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:04:47.823180 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4446/8929] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:04:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:04:49.010415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964f6e9-bca5-43ea-a390-484c2e9fb6d0 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:04:49.019252 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964f6e9-bca5-43ea-a390-484c2e9fb6d0 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:04:49.023379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740d5fc-cfc5-4017-b98c-9fe8d61898d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:04:49.024020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740d5fc-cfc5-4017-b98c-9fe8d61898d4 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:04:49.024400 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740d5fc-cfc5-4017-b98c-9fe8d61898d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:04:49.024673 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740d5fc-cfc5-4017-b98c-9fe8d61898d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:04:49.038105 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740d5fc-cfc5-4017-b98c-9fe8d61898d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:04:49.041015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740d5fc-cfc5-4017-b98c-9fe8d61898d4 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:04:49.054285 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4484/8930] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:04:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:04:50.492385 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292b8f5-3f97-4121-87dc-4fd10f51e57d service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:04:50.506260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292b8f5-3f97-4121-87dc-4fd10f51e57d service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:04:50.513496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b15c8-d210-4250-b2b2-ca07d84e4725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:04:50.514895 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b15c8-d210-4250-b2b2-ca07d84e4725 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:04:50.515391 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b15c8-d210-4250-b2b2-ca07d84e4725 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:04:50.515892 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b15c8-d210-4250-b2b2-ca07d84e4725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:04:50.528440 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b15c8-d210-4250-b2b2-ca07d84e4725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:04:50.530160 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b15c8-d210-4250-b2b2-ca07d84e4725 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:04:50.541660 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4447/8931] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:04:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:04:53.896892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740d5fc-cfc5-4017-b98c-9fe8d61898d4 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:04:53.906084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740d5fc-cfc5-4017-b98c-9fe8d61898d4 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:04:53.910321 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f2200-4d1a-4933-8e5f-8f547cc51328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:04:53.910977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f2200-4d1a-4933-8e5f-8f547cc51328 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:04:53.911257 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f2200-4d1a-4933-8e5f-8f547cc51328 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:04:53.911528 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f2200-4d1a-4933-8e5f-8f547cc51328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:04:53.913621 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-136f2200-4d1a-4933-8e5f-8f547cc51328 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:04:53.963932 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f2200-4d1a-4933-8e5f-8f547cc51328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:04:53.965337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f2200-4d1a-4933-8e5f-8f547cc51328 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:04:53.984511 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4485/8932] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:04:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:04:54.247119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4d7b6-925a-4833-8d98-2b0d16f269aa None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:04:54.247620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4d7b6-925a-4833-8d98-2b0d16f269aa None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:04:54.247869 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4d7b6-925a-4833-8d98-2b0d16f269aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:04:54.308969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-10b4d7b6-925a-4833-8d98-2b0d16f269aa None None] MFA Rules not processed for user `8d8de7334e054d53ab0c0e7dd7cb7c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:04:54.310456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-10b4d7b6-925a-4833-8d98-2b0d16f269aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:04:54.336388 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4448/8933] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 22:04:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:04:54.350638 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f2200-4d1a-4933-8e5f-8f547cc51328 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:04:54.365372 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f2200-4d1a-4933-8e5f-8f547cc51328 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:04:54.370751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665deee3-e963-40f6-91bd-528ed1a5633d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:04:54.371419 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665deee3-e963-40f6-91bd-528ed1a5633d service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:04:54.371706 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665deee3-e963-40f6-91bd-528ed1a5633d service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:04:54.371984 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665deee3-e963-40f6-91bd-528ed1a5633d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:04:54.385263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665deee3-e963-40f6-91bd-528ed1a5633d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:04:54.385263 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665deee3-e963-40f6-91bd-528ed1a5633d service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:04:54.401268 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4486/8934] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:04:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:04:57.546273 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4d7b6-925a-4833-8d98-2b0d16f269aa None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:04:57.604145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4d7b6-925a-4833-8d98-2b0d16f269aa None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:04:57.607893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8495e13-bdf2-4987-bd99-2318d844c9d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:04:57.608580 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8495e13-bdf2-4987-bd99-2318d844c9d9 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:04:57.608856 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8495e13-bdf2-4987-bd99-2318d844c9d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:04:57.609128 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8495e13-bdf2-4987-bd99-2318d844c9d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:04:57.611087 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c8495e13-bdf2-4987-bd99-2318d844c9d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:04:57.698274 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8495e13-bdf2-4987-bd99-2318d844c9d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:04:57.699641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8495e13-bdf2-4987-bd99-2318d844c9d9 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:04:57.719409 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4449/8935] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:04:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:05:00.269111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff34779-1603-43e9-a63d-c7e346e8a76c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:05:00.269641 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff34779-1603-43e9-a63d-c7e346e8a76c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:05:00.269878 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff34779-1603-43e9-a63d-c7e346e8a76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:05:00.299542 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fff34779-1603-43e9-a63d-c7e346e8a76c None None] MFA Rules not processed for user `54f87aa5ec014141901ea0c2f1994cde`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:05:00.301118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fff34779-1603-43e9-a63d-c7e346e8a76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:05:00.373569 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4487/8936] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 22:05:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:05:00.735375 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81752abe-bdc8-4fc2-9c73-8229f0dcfe9a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:05:00.735963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81752abe-bdc8-4fc2-9c73-8229f0dcfe9a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:05:00.735963 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81752abe-bdc8-4fc2-9c73-8229f0dcfe9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:05:00.748509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=100 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:05:00.781531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-81752abe-bdc8-4fc2-9c73-8229f0dcfe9a None None] MFA Rules not processed for user `684732cf5a004fb084ce0e523398c970`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:05:00.783170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-81752abe-bdc8-4fc2-9c73-8229f0dcfe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:05:00.790083 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4450/8937] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 22:05:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:05:00.803289 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff34779-1603-43e9-a63d-c7e346e8a76c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:05:00.814039 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff34779-1603-43e9-a63d-c7e346e8a76c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:05:00.820359 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f70c6-4596-486f-b5a6-5e6d4e787c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:05:00.821256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f70c6-4596-486f-b5a6-5e6d4e787c36 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:05:00.821573 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f70c6-4596-486f-b5a6-5e6d4e787c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:05:00.822096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f70c6-4596-486f-b5a6-5e6d4e787c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:05:00.831548 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f70c6-4596-486f-b5a6-5e6d4e787c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:05:00.833143 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f70c6-4596-486f-b5a6-5e6d4e787c36 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:05:00.849360 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4488/8938] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:05:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 22:05:01.240822 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81752abe-bdc8-4fc2-9c73-8229f0dcfe9a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:05:01.320815 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81752abe-bdc8-4fc2-9c73-8229f0dcfe9a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:05:01.325874 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4058dd-0f3f-43d4-876a-ef0b85131a29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:05:01.326535 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4058dd-0f3f-43d4-876a-ef0b85131a29 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:05:01.326824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4058dd-0f3f-43d4-876a-ef0b85131a29 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:05:01.327119 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4058dd-0f3f-43d4-876a-ef0b85131a29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:05:01.335810 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4058dd-0f3f-43d4-876a-ef0b85131a29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:05:01.337446 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4058dd-0f3f-43d4-876a-ef0b85131a29 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:05:01.347789 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4451/8939] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:05:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:05:10.215789 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f70c6-4596-486f-b5a6-5e6d4e787c36 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:05:10.278908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=100 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:05:10.305940 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f70c6-4596-486f-b5a6-5e6d4e787c36 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:05:10.311803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a7bcb-b0a9-481e-a9df-d3dfaaa3e48d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:05:10.312493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a7bcb-b0a9-481e-a9df-d3dfaaa3e48d service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:05:10.312776 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a7bcb-b0a9-481e-a9df-d3dfaaa3e48d service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:05:10.313087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a7bcb-b0a9-481e-a9df-d3dfaaa3e48d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:05:10.322093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a7bcb-b0a9-481e-a9df-d3dfaaa3e48d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:05:10.323675 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a7bcb-b0a9-481e-a9df-d3dfaaa3e48d service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:05:10.334500 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4489/8940] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:05:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:05:11.343594 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=38 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:05:20.330155 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=14 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:06:40.649430 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4058dd-0f3f-43d4-876a-ef0b85131a29 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:40.651159 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-4d4058dd-0f3f-43d4-876a-ef0b85131a29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:06:40.757978 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4058dd-0f3f-43d4-876a-ef0b85131a29 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:40.762807 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eb66c-f50d-4140-a05e-2f94112a0f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:40.763705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eb66c-f50d-4140-a05e-2f94112a0f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:40.763991 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eb66c-f50d-4140-a05e-2f94112a0f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:40.764310 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eb66c-f50d-4140-a05e-2f94112a0f15 admin admin] PATH_INFO: `/v3/users/54f87aa5ec014141901ea0c2f1994cde` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:40.765551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751eb66c-f50d-4140-a05e-2f94112a0f15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f87aa5ec014141901ea0c2f1994cde)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:40.768777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751eb66c-f50d-4140-a05e-2f94112a0f15 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:40.825803 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-751eb66c-f50d-4140-a05e-2f94112a0f15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f87aa5ec014141901ea0c2f1994cde'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:40.833518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-751eb66c-f50d-4140-a05e-2f94112a0f15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f87aa5ec014141901ea0c2f1994cde'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:40.840518 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-751eb66c-f50d-4140-a05e-2f94112a0f15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f87aa5ec014141901ea0c2f1994cde'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:40.841175 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-751eb66c-f50d-4140-a05e-2f94112a0f15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f87aa5ec014141901ea0c2f1994cde'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:40.841795 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-751eb66c-f50d-4140-a05e-2f94112a0f15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f87aa5ec014141901ea0c2f1994cde'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:40.859570 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4452/8941] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 22:06:40 2022] DELETE /identity/v3/users/54f87aa5ec014141901ea0c2f1994cde => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 22:06:40.864417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32cbe6-c7e0-4f45-9c54-a6b91589e87c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:40.864924 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32cbe6-c7e0-4f45-9c54-a6b91589e87c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:40.865022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32cbe6-c7e0-4f45-9c54-a6b91589e87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:40.896087 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fa32cbe6-c7e0-4f45-9c54-a6b91589e87c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:06:40.897356 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fa32cbe6-c7e0-4f45-9c54-a6b91589e87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:06:40.967528 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4490/8942] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 22:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:06:40.977622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eb66c-f50d-4140-a05e-2f94112a0f15 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:40.979124 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-751eb66c-f50d-4140-a05e-2f94112a0f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:06:41.041259 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eb66c-f50d-4140-a05e-2f94112a0f15 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:41.045260 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d81f7-7a32-444a-b401-da747a85f5e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:41.045912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d81f7-7a32-444a-b401-da747a85f5e4 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:41.046193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d81f7-7a32-444a-b401-da747a85f5e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:41.046496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d81f7-7a32-444a-b401-da747a85f5e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:41.052643 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:06:41.057193 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d81f7-7a32-444a-b401-da747a85f5e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:41.058915 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d81f7-7a32-444a-b401-da747a85f5e4 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:41.069018 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4453/8943] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:06:41.255363 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32cbe6-c7e0-4f45-9c54-a6b91589e87c None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:41.256933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fa32cbe6-c7e0-4f45-9c54-a6b91589e87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:06:41.270426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32cbe6-c7e0-4f45-9c54-a6b91589e87c None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:41.276059 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48ff03-79ca-4494-b7e2-a935663e696b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:41.276947 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48ff03-79ca-4494-b7e2-a935663e696b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:41.277228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48ff03-79ca-4494-b7e2-a935663e696b admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:41.277760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48ff03-79ca-4494-b7e2-a935663e696b admin admin] PATH_INFO: `/v3/projects/339472a22c2447d4a8174ce682d2e2ed` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:41.279117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48ff03-79ca-4494-b7e2-a935663e696b admin admin] RBAC: Authorizing `identity:delete_project(project_id=339472a22c2447d4a8174ce682d2e2ed)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:41.281113 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48ff03-79ca-4494-b7e2-a935663e696b admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:41.332128 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cf48ff03-79ca-4494-b7e2-a935663e696b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339472a22c2447d4a8174ce682d2e2ed', 'request_id': 'req-cf48ff03-79ca-4494-b7e2-a935663e696b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:41.341011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cf48ff03-79ca-4494-b7e2-a935663e696b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339472a22c2447d4a8174ce682d2e2ed', 'request_id': 'req-cf48ff03-79ca-4494-b7e2-a935663e696b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:41.347395 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cf48ff03-79ca-4494-b7e2-a935663e696b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339472a22c2447d4a8174ce682d2e2ed', 'request_id': 'req-cf48ff03-79ca-4494-b7e2-a935663e696b'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:41.358132 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cf48ff03-79ca-4494-b7e2-a935663e696b admin admin] The token cache is being invalidate because project 339472a22c2447d4a8174ce682d2e2ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 22:06:41.358427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cf48ff03-79ca-4494-b7e2-a935663e696b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:41.359228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-cf48ff03-79ca-4494-b7e2-a935663e696b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:41.360942 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4491/8944] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 22:06:41 2022] DELETE /identity/v3/projects/339472a22c2447d4a8174ce682d2e2ed => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 22:06:41.365167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d81f7-7a32-444a-b401-da747a85f5e4 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:41.375507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d81f7-7a32-444a-b401-da747a85f5e4 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:41.456362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06918f2c-dcf8-43c0-bfd1-80e0ca6e3009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:41.457272 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06918f2c-dcf8-43c0-bfd1-80e0ca6e3009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:41.457576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06918f2c-dcf8-43c0-bfd1-80e0ca6e3009 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:41.457845 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06918f2c-dcf8-43c0-bfd1-80e0ca6e3009 admin admin] PATH_INFO: `/v3/users/10b15c72ab1f4c5f8f0d546b8f7dde13` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:41.459182 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06918f2c-dcf8-43c0-bfd1-80e0ca6e3009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b15c72ab1f4c5f8f0d546b8f7dde13)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:41.461184 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06918f2c-dcf8-43c0-bfd1-80e0ca6e3009 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:41.512298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-06918f2c-dcf8-43c0-bfd1-80e0ca6e3009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b15c72ab1f4c5f8f0d546b8f7dde13'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:41.520687 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-06918f2c-dcf8-43c0-bfd1-80e0ca6e3009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b15c72ab1f4c5f8f0d546b8f7dde13'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:41.527579 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-06918f2c-dcf8-43c0-bfd1-80e0ca6e3009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b15c72ab1f4c5f8f0d546b8f7dde13'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:41.528238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-06918f2c-dcf8-43c0-bfd1-80e0ca6e3009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b15c72ab1f4c5f8f0d546b8f7dde13'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:41.528846 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-06918f2c-dcf8-43c0-bfd1-80e0ca6e3009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b15c72ab1f4c5f8f0d546b8f7dde13'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:41.546135 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4454/8945] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 22:06:41 2022] DELETE /identity/v3/users/10b15c72ab1f4c5f8f0d546b8f7dde13 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 22:06:41.829985 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48ff03-79ca-4494-b7e2-a935663e696b admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:41.831535 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-cf48ff03-79ca-4494-b7e2-a935663e696b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:06:41.846136 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48ff03-79ca-4494-b7e2-a935663e696b admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:41.906210 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07b0a1-8438-4ff2-8118-659efa7d81d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:41.907089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07b0a1-8438-4ff2-8118-659efa7d81d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:41.907370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07b0a1-8438-4ff2-8118-659efa7d81d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:41.907644 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07b0a1-8438-4ff2-8118-659efa7d81d7 admin admin] PATH_INFO: `/v3/projects/4fd0626950d342d4994b67014e9ac323` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:41.908986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07b0a1-8438-4ff2-8118-659efa7d81d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd0626950d342d4994b67014e9ac323)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:41.910929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07b0a1-8438-4ff2-8118-659efa7d81d7 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:41.933193 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:06:41.965241 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6f07b0a1-8438-4ff2-8118-659efa7d81d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd0626950d342d4994b67014e9ac323', 'request_id': 'req-6f07b0a1-8438-4ff2-8118-659efa7d81d7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:41.973016 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6f07b0a1-8438-4ff2-8118-659efa7d81d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd0626950d342d4994b67014e9ac323', 'request_id': 'req-6f07b0a1-8438-4ff2-8118-659efa7d81d7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:41.979379 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6f07b0a1-8438-4ff2-8118-659efa7d81d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd0626950d342d4994b67014e9ac323', 'request_id': 'req-6f07b0a1-8438-4ff2-8118-659efa7d81d7'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:41.990712 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6f07b0a1-8438-4ff2-8118-659efa7d81d7 admin admin] The token cache is being invalidate because project 4fd0626950d342d4994b67014e9ac323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91078) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 22:06:41.990996 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6f07b0a1-8438-4ff2-8118-659efa7d81d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:41.991715 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-6f07b0a1-8438-4ff2-8118-659efa7d81d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:06:41.993485 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4492/8946] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 22:06:41 2022] DELETE /identity/v3/projects/4fd0626950d342d4994b67014e9ac323 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 22:06:41.999220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aac41e-7f0c-4e12-bbfb-6f2ca91896d8 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:41.999705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aac41e-7f0c-4e12-bbfb-6f2ca91896d8 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:41.999824 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aac41e-7f0c-4e12-bbfb-6f2ca91896d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:42.038737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b7aac41e-7f0c-4e12-bbfb-6f2ca91896d8 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:06:42.039890 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b7aac41e-7f0c-4e12-bbfb-6f2ca91896d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:06:42.093960 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:06:42.105916 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4455/8947] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 22:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:06:42.114977 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce38ad-11ef-4c91-9977-f1470dc76327 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:42.115264 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce38ad-11ef-4c91-9977-f1470dc76327 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:42.115539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce38ad-11ef-4c91-9977-f1470dc76327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:42.134426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-fdce38ad-11ef-4c91-9977-f1470dc76327 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:06:42.135636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-fdce38ad-11ef-4c91-9977-f1470dc76327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:06:42.144709 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4493/8948] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 22:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:06:42.149355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aac41e-7f0c-4e12-bbfb-6f2ca91896d8 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:42.160293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aac41e-7f0c-4e12-bbfb-6f2ca91896d8 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:42.166355 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eabf63-7c0b-475a-9bde-b74c46ac6f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:42.167026 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eabf63-7c0b-475a-9bde-b74c46ac6f34 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:42.167307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eabf63-7c0b-475a-9bde-b74c46ac6f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:42.167587 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eabf63-7c0b-475a-9bde-b74c46ac6f34 admin admin] PATH_INFO: `/v3/domains` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:42.168348 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eabf63-7c0b-475a-9bde-b74c46ac6f34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91077) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 22:06:42.168653 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eabf63-7c0b-475a-9bde-b74c46ac6f34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:42.170256 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eabf63-7c0b-475a-9bde-b74c46ac6f34 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:42.183469 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4456/8949] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 22:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 22:06:42.187821 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce38ad-11ef-4c91-9977-f1470dc76327 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:42.197197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce38ad-11ef-4c91-9977-f1470dc76327 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:42.202640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67969c-726c-4ca1-8b04-f173d26e5e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:42.203313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67969c-726c-4ca1-8b04-f173d26e5e23 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:42.203592 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67969c-726c-4ca1-8b04-f173d26e5e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:42.203866 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67969c-726c-4ca1-8b04-f173d26e5e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:42.204584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67969c-726c-4ca1-8b04-f173d26e5e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:42.206500 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67969c-726c-4ca1-8b04-f173d26e5e23 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:42.250054 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4494/8950] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 22:06:42 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 22:06:42.254888 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eabf63-7c0b-475a-9bde-b74c46ac6f34 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:42.269277 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eabf63-7c0b-475a-9bde-b74c46ac6f34 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:42.329742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca07d79-769e-4299-ab75-21ca796b745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:42.330329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca07d79-769e-4299-ab75-21ca796b745d admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:42.330627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca07d79-769e-4299-ab75-21ca796b745d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:42.330910 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca07d79-769e-4299-ab75-21ca796b745d admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:42.331608 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca07d79-769e-4299-ab75-21ca796b745d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:42.333574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca07d79-769e-4299-ab75-21ca796b745d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:42.359673 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4457/8951] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 22:06:42 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 22:06:42.361124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67969c-726c-4ca1-8b04-f173d26e5e23 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:42.372191 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67969c-726c-4ca1-8b04-f173d26e5e23 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:42.378713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d8932-9073-4c0b-a595-642c46612a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:42.379382 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d8932-9073-4c0b-a595-642c46612a4e admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:42.379669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d8932-9073-4c0b-a595-642c46612a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:42.379942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d8932-9073-4c0b-a595-642c46612a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:42.380714 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d8932-9073-4c0b-a595-642c46612a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:42.382336 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d8932-9073-4c0b-a595-642c46612a4e admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:42.392826 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4495/8952] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 22:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 22:06:42.396966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca07d79-769e-4299-ab75-21ca796b745d admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:42.407499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca07d79-769e-4299-ab75-21ca796b745d admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:42.412351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6aff3a-62ba-48ad-b797-b7d52f07c81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:42.413015 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6aff3a-62ba-48ad-b797-b7d52f07c81b admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:42.413298 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6aff3a-62ba-48ad-b797-b7d52f07c81b admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:42.413574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6aff3a-62ba-48ad-b797-b7d52f07c81b admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:42.414295 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6aff3a-62ba-48ad-b797-b7d52f07c81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:42.415902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6aff3a-62ba-48ad-b797-b7d52f07c81b admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:42.426790 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4458/8953] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 22:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 22:06:42.431655 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d8932-9073-4c0b-a595-642c46612a4e admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:42.442369 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d8932-9073-4c0b-a595-642c46612a4e admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:42.447654 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1f186-e8e2-42ce-9679-3138744541ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:42.448697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1f186-e8e2-42ce-9679-3138744541ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:42.448974 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1f186-e8e2-42ce-9679-3138744541ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:42.449285 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1f186-e8e2-42ce-9679-3138744541ae admin admin] PATH_INFO: `/v3/projects/cba9051146cc4baa8e9ad5b1773bd2d4/users/5fdbc9c99f204d0bbb5f03771f5ff453/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:42.469300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1f186-e8e2-42ce-9679-3138744541ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba9051146cc4baa8e9ad5b1773bd2d4, user_id=5fdbc9c99f204d0bbb5f03771f5ff453, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:42.473599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1f186-e8e2-42ce-9679-3138744541ae admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:42.489470 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4496/8954] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 22:06:42 2022] PUT /identity/v3/projects/cba9051146cc4baa8e9ad5b1773bd2d4/users/5fdbc9c99f204d0bbb5f03771f5ff453/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 22:06:42.495654 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c8381-a386-4756-8e5f-f86c93309fea None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:42.496180 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c8381-a386-4756-8e5f-f86c93309fea None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:42.496528 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c8381-a386-4756-8e5f-f86c93309fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:42.515887 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-163c8381-a386-4756-8e5f-f86c93309fea None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:06:42.517140 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-163c8381-a386-4756-8e5f-f86c93309fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:06:42.591273 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4459/8955] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 22:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:06:42.601195 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1f186-e8e2-42ce-9679-3138744541ae admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:42.603213 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a8e1f186-e8e2-42ce-9679-3138744541ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:06:42.667420 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1f186-e8e2-42ce-9679-3138744541ae admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:42.671470 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6468fec-b4f1-4af5-a0bf-30c5a6988f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:42.672154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6468fec-b4f1-4af5-a0bf-30c5a6988f4d service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:42.672439 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6468fec-b4f1-4af5-a0bf-30c5a6988f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:42.672718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6468fec-b4f1-4af5-a0bf-30c5a6988f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:42.683001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6468fec-b4f1-4af5-a0bf-30c5a6988f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:42.684543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6468fec-b4f1-4af5-a0bf-30c5a6988f4d service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:42.694303 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4497/8956] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:06:46.790969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebafb41-ceb9-4f43-900f-66da63d7ab25 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:46.791465 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebafb41-ceb9-4f43-900f-66da63d7ab25 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:46.791597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebafb41-ceb9-4f43-900f-66da63d7ab25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:46.826441 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1ebafb41-ceb9-4f43-900f-66da63d7ab25 None None] MFA Rules not processed for user `5fdbc9c99f204d0bbb5f03771f5ff453`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:06:46.827791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1ebafb41-ceb9-4f43-900f-66da63d7ab25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:06:46.897103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:06:46.910824 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4460/8957] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 22:06:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:06:46.915713 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6468fec-b4f1-4af5-a0bf-30c5a6988f4d service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:46.930030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6468fec-b4f1-4af5-a0bf-30c5a6988f4d service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:46.935708 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1b7a2-1638-4574-bcf3-7420ab6d23a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:46.936509 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1b7a2-1638-4574-bcf3-7420ab6d23a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:46.936862 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1b7a2-1638-4574-bcf3-7420ab6d23a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:46.937329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1b7a2-1638-4574-bcf3-7420ab6d23a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:46.938108 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1b7a2-1638-4574-bcf3-7420ab6d23a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:46.940206 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1b7a2-1638-4574-bcf3-7420ab6d23a5 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:46.975867 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4498/8958] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 22:06:46 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 22:06:46.977195 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebafb41-ceb9-4f43-900f-66da63d7ab25 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:46.994147 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebafb41-ceb9-4f43-900f-66da63d7ab25 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:47.094948 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caac85c-744d-4bc9-87c8-61f3c95a03a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:47.095651 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caac85c-744d-4bc9-87c8-61f3c95a03a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:47.096019 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caac85c-744d-4bc9-87c8-61f3c95a03a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:47.096808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caac85c-744d-4bc9-87c8-61f3c95a03a7 admin admin] PATH_INFO: `/v3/users` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:47.097085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caac85c-744d-4bc9-87c8-61f3c95a03a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:47.099077 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caac85c-744d-4bc9-87c8-61f3c95a03a7 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:47.121629 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4461/8959] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 22:06:46 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 22:06:47.125942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1b7a2-1638-4574-bcf3-7420ab6d23a5 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:47.136832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1b7a2-1638-4574-bcf3-7420ab6d23a5 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:47.142339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56319042-7e2f-426e-a7fb-445b3fceca43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:47.143030 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56319042-7e2f-426e-a7fb-445b3fceca43 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:47.143313 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56319042-7e2f-426e-a7fb-445b3fceca43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:47.143590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56319042-7e2f-426e-a7fb-445b3fceca43 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:47.144378 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56319042-7e2f-426e-a7fb-445b3fceca43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:47.145998 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56319042-7e2f-426e-a7fb-445b3fceca43 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:47.160336 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4499/8960] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 22:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 22:06:47.162454 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caac85c-744d-4bc9-87c8-61f3c95a03a7 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:47.174516 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caac85c-744d-4bc9-87c8-61f3c95a03a7 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:47.179796 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e9b65-22aa-48a4-9180-0690adf4e42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:47.180818 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e9b65-22aa-48a4-9180-0690adf4e42e admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:47.181174 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e9b65-22aa-48a4-9180-0690adf4e42e admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:47.181520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e9b65-22aa-48a4-9180-0690adf4e42e admin admin] PATH_INFO: `/v3/projects/a5561412d95349739f974a7e3dfccf3f/users/3f1fa631bcd44ff9a4c5e6ce4db20405/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:47.198206 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e9b65-22aa-48a4-9180-0690adf4e42e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5561412d95349739f974a7e3dfccf3f, user_id=3f1fa631bcd44ff9a4c5e6ce4db20405, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:47.201234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e9b65-22aa-48a4-9180-0690adf4e42e admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:47.215905 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4462/8961] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 22:06:47 2022] PUT /identity/v3/projects/a5561412d95349739f974a7e3dfccf3f/users/3f1fa631bcd44ff9a4c5e6ce4db20405/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 22:06:47.220175 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56319042-7e2f-426e-a7fb-445b3fceca43 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:47.228281 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:06:47.233625 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56319042-7e2f-426e-a7fb-445b3fceca43 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:47.296415 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ced55-22ac-4255-86bb-cd04ce4b304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:47.297111 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ced55-22ac-4255-86bb-cd04ce4b304f admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:47.297393 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ced55-22ac-4255-86bb-cd04ce4b304f admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:47.297668 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ced55-22ac-4255-86bb-cd04ce4b304f admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:47.298394 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ced55-22ac-4255-86bb-cd04ce4b304f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:47.300079 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ced55-22ac-4255-86bb-cd04ce4b304f admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:47.311555 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4500/8962] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 22:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 22:06:47.315969 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e9b65-22aa-48a4-9180-0690adf4e42e admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:47.326955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e9b65-22aa-48a4-9180-0690adf4e42e admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:47.331939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ad673-e3b7-4380-aa1e-2b358d033d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:47.332881 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ad673-e3b7-4380-aa1e-2b358d033d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:47.333162 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ad673-e3b7-4380-aa1e-2b358d033d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:47.333438 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ad673-e3b7-4380-aa1e-2b358d033d15 admin admin] PATH_INFO: `/v3/projects/a5561412d95349739f974a7e3dfccf3f/users/3f1fa631bcd44ff9a4c5e6ce4db20405/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:47.335478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ad673-e3b7-4380-aa1e-2b358d033d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5561412d95349739f974a7e3dfccf3f, user_id=3f1fa631bcd44ff9a4c5e6ce4db20405, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:47.338141 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ad673-e3b7-4380-aa1e-2b358d033d15 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:47.349780 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4463/8963] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 22:06:47 2022] PUT /identity/v3/projects/a5561412d95349739f974a7e3dfccf3f/users/3f1fa631bcd44ff9a4c5e6ce4db20405/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 22:06:52.132834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998ecf7-8b2f-4115-9a02-25d229803c86 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:52.133358 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998ecf7-8b2f-4115-9a02-25d229803c86 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:52.133506 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998ecf7-8b2f-4115-9a02-25d229803c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:52.164162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-d998ecf7-8b2f-4115-9a02-25d229803c86 None None] MFA Rules not processed for user `3f1fa631bcd44ff9a4c5e6ce4db20405`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:06:52.165387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d998ecf7-8b2f-4115-9a02-25d229803c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:06:52.252558 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4501/8964] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 22:06:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:06:52.266314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ad673-e3b7-4380-aa1e-2b358d033d15 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:52.266314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-203ad673-e3b7-4380-aa1e-2b358d033d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:06:52.381478 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ad673-e3b7-4380-aa1e-2b358d033d15 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:52.387202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333e07e-b91a-4d33-8f45-58c67ad08de8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:52.387878 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333e07e-b91a-4d33-8f45-58c67ad08de8 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:52.388202 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333e07e-b91a-4d33-8f45-58c67ad08de8 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:52.388492 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333e07e-b91a-4d33-8f45-58c67ad08de8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:52.424012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:06:52.461946 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333e07e-b91a-4d33-8f45-58c67ad08de8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:52.463733 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333e07e-b91a-4d33-8f45-58c67ad08de8 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:52.474176 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4464/8965] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:06:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:06:53.520249 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568870f-16ed-496a-9f78-fb3d1c555b62 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:53.520808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568870f-16ed-496a-9f78-fb3d1c555b62 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:53.520808 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568870f-16ed-496a-9f78-fb3d1c555b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:53.544411 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6568870f-16ed-496a-9f78-fb3d1c555b62 None None] MFA Rules not processed for user `5fdbc9c99f204d0bbb5f03771f5ff453`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:06:53.545711 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6568870f-16ed-496a-9f78-fb3d1c555b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:06:53.553133 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4502/8966] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 22:06:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:06:53.884429 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333e07e-b91a-4d33-8f45-58c67ad08de8 service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:06:53.941777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333e07e-b91a-4d33-8f45-58c67ad08de8 service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:06:53.945496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039b342-1a4f-43cd-b813-117ae926f919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:06:53.946151 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039b342-1a4f-43cd-b813-117ae926f919 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:06:53.946434 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039b342-1a4f-43cd-b813-117ae926f919 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:06:53.946709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039b342-1a4f-43cd-b813-117ae926f919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:06:53.948636 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b039b342-1a4f-43cd-b813-117ae926f919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:06:53.959519 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039b342-1a4f-43cd-b813-117ae926f919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:06:53.960942 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039b342-1a4f-43cd-b813-117ae926f919 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:06:53.970037 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4465/8967] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:06:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:07:03.533863 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=64 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:07:03.966240 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=39 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:07:07.336980 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568870f-16ed-496a-9f78-fb3d1c555b62 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:07:07.338978 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6568870f-16ed-496a-9f78-fb3d1c555b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:07:07.354351 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568870f-16ed-496a-9f78-fb3d1c555b62 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:07:07.359131 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1b77b-397b-42d1-893c-03bf30170e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:07:07.359778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1b77b-397b-42d1-893c-03bf30170e9c service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:07:07.360142 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1b77b-397b-42d1-893c-03bf30170e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:07:07.360331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1b77b-397b-42d1-893c-03bf30170e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:07:07.370739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1b77b-397b-42d1-893c-03bf30170e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:07:07.372251 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1b77b-397b-42d1-893c-03bf30170e9c service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:07:07.382234 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4503/8968] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:07:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:07:17.377847 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:07:42.977726 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039b342-1a4f-43cd-b813-117ae926f919 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:07:42.979417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b039b342-1a4f-43cd-b813-117ae926f919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:07:43.052659 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039b342-1a4f-43cd-b813-117ae926f919 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:07:43.058483 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d681f-3d82-4977-8ccf-4dddd20077ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:07:43.059126 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d681f-3d82-4977-8ccf-4dddd20077ab service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:07:43.059409 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d681f-3d82-4977-8ccf-4dddd20077ab service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:07:43.059679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d681f-3d82-4977-8ccf-4dddd20077ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:07:43.062362 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9b1d681f-3d82-4977-8ccf-4dddd20077ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:07:43.077760 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d681f-3d82-4977-8ccf-4dddd20077ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:07:43.079392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d681f-3d82-4977-8ccf-4dddd20077ab service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:07:43.089961 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4466/8969] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:07:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:07:53.085742 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=32 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:07:54.014245 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1b77b-397b-42d1-893c-03bf30170e9c service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:07:54.015919 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-5da1b77b-397b-42d1-893c-03bf30170e9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:07:54.031972 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1b77b-397b-42d1-893c-03bf30170e9c service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:07:54.038230 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78eea2-a36b-4d4f-a5b6-985c33207101 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:07:54.038895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78eea2-a36b-4d4f-a5b6-985c33207101 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:07:54.039179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78eea2-a36b-4d4f-a5b6-985c33207101 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:07:54.039451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78eea2-a36b-4d4f-a5b6-985c33207101 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:07:54.041355 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-bb78eea2-a36b-4d4f-a5b6-985c33207101 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:07:54.052895 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78eea2-a36b-4d4f-a5b6-985c33207101 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:07:54.054864 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78eea2-a36b-4d4f-a5b6-985c33207101 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:07:54.064641 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4504/8970] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:07:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:08:04.060890 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:09:47.584335 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d681f-3d82-4977-8ccf-4dddd20077ab service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:09:47.605547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d681f-3d82-4977-8ccf-4dddd20077ab service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:09:47.610574 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4918a-e9a5-4cd4-b8ea-7ae744dc8b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:09:47.611220 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4918a-e9a5-4cd4-b8ea-7ae744dc8b32 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:09:47.611509 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4918a-e9a5-4cd4-b8ea-7ae744dc8b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:09:47.611780 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4918a-e9a5-4cd4-b8ea-7ae744dc8b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:09:47.614027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-f2a4918a-e9a5-4cd4-b8ea-7ae744dc8b32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:09:47.629307 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4918a-e9a5-4cd4-b8ea-7ae744dc8b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:09:47.630751 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4918a-e9a5-4cd4-b8ea-7ae744dc8b32 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:09:47.651738 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4467/8971] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:09:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:09:48.860086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78eea2-a36b-4d4f-a5b6-985c33207101 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:09:48.871426 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78eea2-a36b-4d4f-a5b6-985c33207101 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:09:48.876581 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55338f4c-bf2d-4897-a303-5da517d0f380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:09:48.877221 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55338f4c-bf2d-4897-a303-5da517d0f380 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:09:48.877502 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55338f4c-bf2d-4897-a303-5da517d0f380 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:09:48.877775 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55338f4c-bf2d-4897-a303-5da517d0f380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:09:48.879884 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-55338f4c-bf2d-4897-a303-5da517d0f380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:09:48.895002 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55338f4c-bf2d-4897-a303-5da517d0f380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:09:48.896489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55338f4c-bf2d-4897-a303-5da517d0f380 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:09:48.907452 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4505/8972] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:09:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:09:57.027944 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96f61d-4fcc-4dec-8bb5-006c985ca6b2 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:09:57.028692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96f61d-4fcc-4dec-8bb5-006c985ca6b2 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:09:57.028692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96f61d-4fcc-4dec-8bb5-006c985ca6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:09:57.083717 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-2a96f61d-4fcc-4dec-8bb5-006c985ca6b2 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:09:57.084951 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2a96f61d-4fcc-4dec-8bb5-006c985ca6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:09:57.160962 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4468/8973] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 22:09:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:09:57.209736 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55338f4c-bf2d-4897-a303-5da517d0f380 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:09:57.211516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-55338f4c-bf2d-4897-a303-5da517d0f380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:09:57.308576 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55338f4c-bf2d-4897-a303-5da517d0f380 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:09:57.314085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d669b-fe8a-46f3-af11-82d6b26a4050 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:09:57.314810 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d669b-fe8a-46f3-af11-82d6b26a4050 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:09:57.315205 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d669b-fe8a-46f3-af11-82d6b26a4050 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:09:57.315539 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d669b-fe8a-46f3-af11-82d6b26a4050 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:09:57.324725 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d669b-fe8a-46f3-af11-82d6b26a4050 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:09:57.326319 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d669b-fe8a-46f3-af11-82d6b26a4050 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:09:57.334826 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4506/8974] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 22:09:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 22:09:59.374682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96f61d-4fcc-4dec-8bb5-006c985ca6b2 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:09:59.384121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96f61d-4fcc-4dec-8bb5-006c985ca6b2 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:09:59.387793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf006e0-2213-4913-8aac-f444171dd664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:09:59.388569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf006e0-2213-4913-8aac-f444171dd664 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:09:59.388778 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf006e0-2213-4913-8aac-f444171dd664 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:09:59.389270 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf006e0-2213-4913-8aac-f444171dd664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:09:59.391046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6bf006e0-2213-4913-8aac-f444171dd664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:09:59.404965 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf006e0-2213-4913-8aac-f444171dd664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:09:59.406432 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf006e0-2213-4913-8aac-f444171dd664 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:09:59.415890 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4469/8975] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:09:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:10:07.331803 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=47 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:10:09.378115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31164e7-e025-4432-9886-7e1340579414 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:10:09.378778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31164e7-e025-4432-9886-7e1340579414 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:10:09.378778 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31164e7-e025-4432-9886-7e1340579414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:10:09.412582 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=60 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:10:09.422317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-a31164e7-e025-4432-9886-7e1340579414 None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:10:09.423719 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a31164e7-e025-4432-9886-7e1340579414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:10:09.438839 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4507/8976] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 22:10:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:10:09.453477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf006e0-2213-4913-8aac-f444171dd664 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:10:09.455545 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6bf006e0-2213-4913-8aac-f444171dd664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:10:09.540555 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf006e0-2213-4913-8aac-f444171dd664 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:10:09.544495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c5256-4221-441e-ac5e-e2de0bd4c8cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:10:09.545137 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c5256-4221-441e-ac5e-e2de0bd4c8cc service glance] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:10:09.545417 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c5256-4221-441e-ac5e-e2de0bd4c8cc service glance] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:10:09.545691 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c5256-4221-441e-ac5e-e2de0bd4c8cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:10:09.556297 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c5256-4221-441e-ac5e-e2de0bd4c8cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:10:09.557739 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c5256-4221-441e-ac5e-e2de0bd4c8cc service glance] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:10:09.568371 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4470/8977] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:10:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 22:10:09.637686 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31164e7-e025-4432-9886-7e1340579414 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:10:09.647688 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31164e7-e025-4432-9886-7e1340579414 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:10:09.652407 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a5c7c-8670-4b06-aa14-28b5739f4a1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:10:09.653065 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a5c7c-8670-4b06-aa14-28b5739f4a1b service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:10:09.653345 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a5c7c-8670-4b06-aa14-28b5739f4a1b service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:10:09.653618 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a5c7c-8670-4b06-aa14-28b5739f4a1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:10:09.655634 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-098a5c7c-8670-4b06-aa14-28b5739f4a1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:10:09.665770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a5c7c-8670-4b06-aa14-28b5739f4a1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:10:09.667233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a5c7c-8670-4b06-aa14-28b5739f4a1b service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:10:09.675524 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4508/8978] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:10:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:10:09.747809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0922c-acac-4612-8bb3-adf1b34bd143 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:10:09.748143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0922c-acac-4612-8bb3-adf1b34bd143 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:10:09.748408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0922c-acac-4612-8bb3-adf1b34bd143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:10:09.767325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-7ee0922c-acac-4612-8bb3-adf1b34bd143 None None] MFA Rules not processed for user `aa3e290fa5384f9bac3fec771cebf653`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:10:09.768511 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-7ee0922c-acac-4612-8bb3-adf1b34bd143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:10:09.779136 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4471/8979] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Jul 2 22:10:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:10:09.789720 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a5c7c-8670-4b06-aa14-28b5739f4a1b service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:10:09.802743 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a5c7c-8670-4b06-aa14-28b5739f4a1b service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:10:09.807739 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ea1b9-41d6-4266-96e8-9c688ac475c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:10:09.808417 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ea1b9-41d6-4266-96e8-9c688ac475c7 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:10:09.808697 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ea1b9-41d6-4266-96e8-9c688ac475c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:10:09.808968 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ea1b9-41d6-4266-96e8-9c688ac475c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:10:09.820629 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ea1b9-41d6-4266-96e8-9c688ac475c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:10:09.822081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ea1b9-41d6-4266-96e8-9c688ac475c7 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:10:09.833554 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4509/8980] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:10:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:10:09.897893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0922c-acac-4612-8bb3-adf1b34bd143 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:10:09.920612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0922c-acac-4612-8bb3-adf1b34bd143 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:10:09.926677 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb593c20-c46d-45bd-bd8a-b9ce4d022e73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:10:09.927314 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb593c20-c46d-45bd-bd8a-b9ce4d022e73 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:10:09.927602 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb593c20-c46d-45bd-bd8a-b9ce4d022e73 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:10:09.927875 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb593c20-c46d-45bd-bd8a-b9ce4d022e73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:10:09.930082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-eb593c20-c46d-45bd-bd8a-b9ce4d022e73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:10:09.942524 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb593c20-c46d-45bd-bd8a-b9ce4d022e73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:10:09.944170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb593c20-c46d-45bd-bd8a-b9ce4d022e73 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:10:09.954175 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4472/8981] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:10:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:10:11.460089 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06057463-f397-4028-aa37-b9445d5e46d8 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:10:11.460584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06057463-f397-4028-aa37-b9445d5e46d8 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:10:11.460690 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06057463-f397-4028-aa37-b9445d5e46d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:10:11.479760 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-06057463-f397-4028-aa37-b9445d5e46d8 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:10:11.481003 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-06057463-f397-4028-aa37-b9445d5e46d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:10:11.489973 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4510/8982] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 22:10:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:10:11.494377 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb593c20-c46d-45bd-bd8a-b9ce4d022e73 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:10:11.503337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06057463-f397-4028-aa37-b9445d5e46d8 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:10:11.509120 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb593c20-c46d-45bd-bd8a-b9ce4d022e73 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:10:11.520181 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e84ad-daf9-4f61-af07-e268a4219970 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:10:11.520499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e84ad-daf9-4f61-af07-e268a4219970 service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:10:11.520793 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e84ad-daf9-4f61-af07-e268a4219970 service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:10:11.521308 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e84ad-daf9-4f61-af07-e268a4219970 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:10:11.522122 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06057463-f397-4028-aa37-b9445d5e46d8 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:10:11.523569 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e99e84ad-daf9-4f61-af07-e268a4219970 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:10:11.528427 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f608655-a4b3-42ff-858c-2cd2207e6510 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:10:11.528643 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f608655-a4b3-42ff-858c-2cd2207e6510 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:10:11.528792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f608655-a4b3-42ff-858c-2cd2207e6510 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:10:11.529158 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f608655-a4b3-42ff-858c-2cd2207e6510 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:10:11.538302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e84ad-daf9-4f61-af07-e268a4219970 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:10:11.539884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e84ad-daf9-4f61-af07-e268a4219970 service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:10:11.541168 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f608655-a4b3-42ff-858c-2cd2207e6510 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:10:11.543090 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f608655-a4b3-42ff-858c-2cd2207e6510 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:10:11.551384 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4473/8983] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:10:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:10:11.552806 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4511/8984] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 22:10:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 02 22:10:21.546680 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=54 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:10:21.549445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=30 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:10:27.422573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a6e4a-cfea-4521-8a96-18efa526de03 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:10:27.423046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a6e4a-cfea-4521-8a96-18efa526de03 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:10:27.423143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a6e4a-cfea-4521-8a96-18efa526de03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:10:27.441507 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-b56a6e4a-cfea-4521-8a96-18efa526de03 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:10:27.442706 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b56a6e4a-cfea-4521-8a96-18efa526de03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:10:27.450960 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4474/8985] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 22:10:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:10:27.462903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f608655-a4b3-42ff-858c-2cd2207e6510 service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:10:27.473520 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f608655-a4b3-42ff-858c-2cd2207e6510 service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:10:27.478814 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d8ed4-6ee7-445c-9b8d-94708aabbfcb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:10:27.479451 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d8ed4-6ee7-445c-9b8d-94708aabbfcb service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:10:27.479734 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d8ed4-6ee7-445c-9b8d-94708aabbfcb service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:10:27.480011 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d8ed4-6ee7-445c-9b8d-94708aabbfcb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:10:27.488414 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d8ed4-6ee7-445c-9b8d-94708aabbfcb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:10:27.490066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d8ed4-6ee7-445c-9b8d-94708aabbfcb service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:10:27.498282 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4512/8986] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 22:10:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 22:10:37.436858 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=3 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:10:37.495231 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:15.888684 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a6e4a-cfea-4521-8a96-18efa526de03 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:15.903712 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a6e4a-cfea-4521-8a96-18efa526de03 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:15.908341 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e97fa-fbd5-40d9-af44-07bed60bee01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:15.909000 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e97fa-fbd5-40d9-af44-07bed60bee01 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:15.909286 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e97fa-fbd5-40d9-af44-07bed60bee01 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:15.909541 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e97fa-fbd5-40d9-af44-07bed60bee01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:15.919461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e97fa-fbd5-40d9-af44-07bed60bee01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:15.921408 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e97fa-fbd5-40d9-af44-07bed60bee01 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:15.932157 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4475/8987] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:12:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:12:16.807872 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d8ed4-6ee7-445c-9b8d-94708aabbfcb service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:16.821386 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d8ed4-6ee7-445c-9b8d-94708aabbfcb service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:16.827233 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b894705-fb5f-4f58-88d5-1164d73df669 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:16.827870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b894705-fb5f-4f58-88d5-1164d73df669 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:16.828350 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b894705-fb5f-4f58-88d5-1164d73df669 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:16.828792 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b894705-fb5f-4f58-88d5-1164d73df669 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:16.830816 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9b894705-fb5f-4f58-88d5-1164d73df669 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:16.844632 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b894705-fb5f-4f58-88d5-1164d73df669 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:16.846302 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b894705-fb5f-4f58-88d5-1164d73df669 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:16.858930 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4513/8988] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:12:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:12:19.120682 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e97fa-fbd5-40d9-af44-07bed60bee01 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:19.134204 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e97fa-fbd5-40d9-af44-07bed60bee01 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:19.140660 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47db07c-dfeb-4cba-bb0d-d465050d026f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:19.141401 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47db07c-dfeb-4cba-bb0d-d465050d026f service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:19.141755 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47db07c-dfeb-4cba-bb0d-d465050d026f service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:19.142109 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47db07c-dfeb-4cba-bb0d-d465050d026f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:19.144287 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-b47db07c-dfeb-4cba-bb0d-d465050d026f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:19.158573 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47db07c-dfeb-4cba-bb0d-d465050d026f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:19.160351 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47db07c-dfeb-4cba-bb0d-d465050d026f service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:19.171982 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4476/8989] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:12:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:12:23.695225 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e1245-392b-4c9f-8139-f5317f9372c7 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:23.695791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e1245-392b-4c9f-8139-f5317f9372c7 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:23.695791 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e1245-392b-4c9f-8139-f5317f9372c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:23.714096 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-771e1245-392b-4c9f-8139-f5317f9372c7 None None] MFA Rules not processed for user `5fdbc9c99f204d0bbb5f03771f5ff453`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:12:23.715342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-771e1245-392b-4c9f-8139-f5317f9372c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:23.722224 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4514/8990] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 22:12:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:12:25.609252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47db07c-dfeb-4cba-bb0d-d465050d026f service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:25.618870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47db07c-dfeb-4cba-bb0d-d465050d026f service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:25.622936 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7378876-dc49-4843-832e-c4cd414eedc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:25.623627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7378876-dc49-4843-832e-c4cd414eedc1 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:25.623912 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7378876-dc49-4843-832e-c4cd414eedc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:25.624221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7378876-dc49-4843-832e-c4cd414eedc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:25.686527 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7378876-dc49-4843-832e-c4cd414eedc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:25.687975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7378876-dc49-4843-832e-c4cd414eedc1 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:25.697716 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4477/8991] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:12:28.907154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e1245-392b-4c9f-8139-f5317f9372c7 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:28.920684 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e1245-392b-4c9f-8139-f5317f9372c7 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:28.926055 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ab924-004a-4ced-937f-fef250e50b08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:28.926702 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ab924-004a-4ced-937f-fef250e50b08 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:28.926986 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ab924-004a-4ced-937f-fef250e50b08 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:28.927248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ab924-004a-4ced-937f-fef250e50b08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:28.929097 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-f12ab924-004a-4ced-937f-fef250e50b08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:28.941337 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ab924-004a-4ced-937f-fef250e50b08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:28.942929 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ab924-004a-4ced-937f-fef250e50b08 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:28.954611 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4515/8992] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:12:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:12:32.179374 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7378876-dc49-4843-832e-c4cd414eedc1 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:32.194085 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7378876-dc49-4843-832e-c4cd414eedc1 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:32.199661 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffa41d-4d9d-41ec-af7a-f86db28027d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:32.200458 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffa41d-4d9d-41ec-af7a-f86db28027d7 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:32.200809 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffa41d-4d9d-41ec-af7a-f86db28027d7 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:32.201150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffa41d-4d9d-41ec-af7a-f86db28027d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:32.203021 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-59ffa41d-4d9d-41ec-af7a-f86db28027d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:32.216241 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffa41d-4d9d-41ec-af7a-f86db28027d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:32.218485 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffa41d-4d9d-41ec-af7a-f86db28027d7 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:32.230670 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4478/8993] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:12:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:12:32.240689 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ab924-004a-4ced-937f-fef250e50b08 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:32.253422 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ab924-004a-4ced-937f-fef250e50b08 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:32.262627 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95fa76-555e-4076-8352-37755ea02662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:32.263529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95fa76-555e-4076-8352-37755ea02662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:32.263809 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95fa76-555e-4076-8352-37755ea02662 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:32.264117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95fa76-555e-4076-8352-37755ea02662 admin admin] PATH_INFO: `/v3/users/5fdbc9c99f204d0bbb5f03771f5ff453` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:32.265328 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95fa76-555e-4076-8352-37755ea02662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fdbc9c99f204d0bbb5f03771f5ff453)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:32.267290 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95fa76-555e-4076-8352-37755ea02662 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:32.319256 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a95fa76-555e-4076-8352-37755ea02662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fdbc9c99f204d0bbb5f03771f5ff453'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:32.326738 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a95fa76-555e-4076-8352-37755ea02662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fdbc9c99f204d0bbb5f03771f5ff453'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:32.327484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a95fa76-555e-4076-8352-37755ea02662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fdbc9c99f204d0bbb5f03771f5ff453'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:32.328162 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a95fa76-555e-4076-8352-37755ea02662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fdbc9c99f204d0bbb5f03771f5ff453'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:32.335031 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-4a95fa76-555e-4076-8352-37755ea02662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fdbc9c99f204d0bbb5f03771f5ff453'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:32.358331 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4516/8994] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 22:12:32 2022] DELETE /identity/v3/users/5fdbc9c99f204d0bbb5f03771f5ff453 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 22:12:32.563012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffa41d-4d9d-41ec-af7a-f86db28027d7 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:32.574145 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffa41d-4d9d-41ec-af7a-f86db28027d7 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:32.631966 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22303ff2-6acd-4913-b7dd-121d8fb3a655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:32.632864 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22303ff2-6acd-4913-b7dd-121d8fb3a655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:32.633139 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22303ff2-6acd-4913-b7dd-121d8fb3a655 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:32.633402 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22303ff2-6acd-4913-b7dd-121d8fb3a655 admin admin] PATH_INFO: `/v3/projects/cba9051146cc4baa8e9ad5b1773bd2d4` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:32.634595 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22303ff2-6acd-4913-b7dd-121d8fb3a655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cba9051146cc4baa8e9ad5b1773bd2d4)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:32.636546 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22303ff2-6acd-4913-b7dd-121d8fb3a655 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:32.693656 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-22303ff2-6acd-4913-b7dd-121d8fb3a655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'request_id': 'req-22303ff2-6acd-4913-b7dd-121d8fb3a655'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:32.699903 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-22303ff2-6acd-4913-b7dd-121d8fb3a655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'request_id': 'req-22303ff2-6acd-4913-b7dd-121d8fb3a655'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:32.701926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:32.706863 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-22303ff2-6acd-4913-b7dd-121d8fb3a655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'request_id': 'req-22303ff2-6acd-4913-b7dd-121d8fb3a655'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:32.720228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-22303ff2-6acd-4913-b7dd-121d8fb3a655 admin admin] The token cache is being invalidate because project cba9051146cc4baa8e9ad5b1773bd2d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 22:12:32.720531 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-22303ff2-6acd-4913-b7dd-121d8fb3a655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:32.721173 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-22303ff2-6acd-4913-b7dd-121d8fb3a655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:32.722810 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4479/8995] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 22:12:32 2022] DELETE /identity/v3/projects/cba9051146cc4baa8e9ad5b1773bd2d4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 22:12:32.727164 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95fa76-555e-4076-8352-37755ea02662 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:32.728650 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-4a95fa76-555e-4076-8352-37755ea02662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:32.742640 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95fa76-555e-4076-8352-37755ea02662 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:32.806599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e788c-ba27-41ae-bc97-9e4d62b8406d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:32.807505 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e788c-ba27-41ae-bc97-9e4d62b8406d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:32.807833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e788c-ba27-41ae-bc97-9e4d62b8406d admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:32.808174 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e788c-ba27-41ae-bc97-9e4d62b8406d admin admin] PATH_INFO: `/v3/users/3f1fa631bcd44ff9a4c5e6ce4db20405` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:32.809489 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e788c-ba27-41ae-bc97-9e4d62b8406d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f1fa631bcd44ff9a4c5e6ce4db20405)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:32.811437 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e788c-ba27-41ae-bc97-9e4d62b8406d admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:32.856479 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:32.862243 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-560e788c-ba27-41ae-bc97-9e4d62b8406d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f1fa631bcd44ff9a4c5e6ce4db20405'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:32.870593 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-560e788c-ba27-41ae-bc97-9e4d62b8406d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f1fa631bcd44ff9a4c5e6ce4db20405'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:32.871300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-560e788c-ba27-41ae-bc97-9e4d62b8406d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f1fa631bcd44ff9a4c5e6ce4db20405'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:32.872004 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-560e788c-ba27-41ae-bc97-9e4d62b8406d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f1fa631bcd44ff9a4c5e6ce4db20405'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:32.879091 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-560e788c-ba27-41ae-bc97-9e4d62b8406d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f1fa631bcd44ff9a4c5e6ce4db20405'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:32.896194 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4517/8996] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 22:12:32 2022] DELETE /identity/v3/users/3f1fa631bcd44ff9a4c5e6ce4db20405 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 22:12:33.091201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22303ff2-6acd-4913-b7dd-121d8fb3a655 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:33.092696 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-22303ff2-6acd-4913-b7dd-121d8fb3a655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:33.114106 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22303ff2-6acd-4913-b7dd-121d8fb3a655 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:33.178280 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236648b-103c-491d-bac6-95a6af3a1c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:33.179177 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236648b-103c-491d-bac6-95a6af3a1c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:33.179461 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236648b-103c-491d-bac6-95a6af3a1c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:33.179986 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236648b-103c-491d-bac6-95a6af3a1c0a admin admin] PATH_INFO: `/v3/projects/a5561412d95349739f974a7e3dfccf3f` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:33.181392 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236648b-103c-491d-bac6-95a6af3a1c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5561412d95349739f974a7e3dfccf3f)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:33.183339 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236648b-103c-491d-bac6-95a6af3a1c0a admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:33.233237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8236648b-103c-491d-bac6-95a6af3a1c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5561412d95349739f974a7e3dfccf3f', 'request_id': 'req-8236648b-103c-491d-bac6-95a6af3a1c0a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:33.240250 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8236648b-103c-491d-bac6-95a6af3a1c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5561412d95349739f974a7e3dfccf3f', 'request_id': 'req-8236648b-103c-491d-bac6-95a6af3a1c0a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:33.246622 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8236648b-103c-491d-bac6-95a6af3a1c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5561412d95349739f974a7e3dfccf3f', 'request_id': 'req-8236648b-103c-491d-bac6-95a6af3a1c0a'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:33.260296 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8236648b-103c-491d-bac6-95a6af3a1c0a admin admin] The token cache is being invalidate because project a5561412d95349739f974a7e3dfccf3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 22:12:33.260588 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8236648b-103c-491d-bac6-95a6af3a1c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:33.261302 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-8236648b-103c-491d-bac6-95a6af3a1c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:12:33.263060 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4480/8997] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 22:12:33 2022] DELETE /identity/v3/projects/a5561412d95349739f974a7e3dfccf3f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 22:12:33.268431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534bc54-e72e-43e8-83e5-300c0e72c145 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:33.268911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534bc54-e72e-43e8-83e5-300c0e72c145 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:33.269012 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534bc54-e72e-43e8-83e5-300c0e72c145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:33.288584 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9534bc54-e72e-43e8-83e5-300c0e72c145 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:12:33.289798 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9534bc54-e72e-43e8-83e5-300c0e72c145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:33.353515 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4518/8998] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 22:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:12:33.361885 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5732d8-4e22-4172-9977-81cd16d0eda9 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:33.362086 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5732d8-4e22-4172-9977-81cd16d0eda9 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:33.362379 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5732d8-4e22-4172-9977-81cd16d0eda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:33.380727 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-8d5732d8-4e22-4172-9977-81cd16d0eda9 None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:12:33.381935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-8d5732d8-4e22-4172-9977-81cd16d0eda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:33.390533 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4481/8999] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 22:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:12:33.394911 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534bc54-e72e-43e8-83e5-300c0e72c145 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:33.405440 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534bc54-e72e-43e8-83e5-300c0e72c145 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:33.411636 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34530c4-6efb-4806-911e-f6b3ac15e997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:33.412342 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34530c4-6efb-4806-911e-f6b3ac15e997 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:33.412626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34530c4-6efb-4806-911e-f6b3ac15e997 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:33.412908 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34530c4-6efb-4806-911e-f6b3ac15e997 admin admin] PATH_INFO: `/v3/domains` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:33.413630 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34530c4-6efb-4806-911e-f6b3ac15e997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91078) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 22:12:33.413935 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34530c4-6efb-4806-911e-f6b3ac15e997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:33.415669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34530c4-6efb-4806-911e-f6b3ac15e997 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:33.428585 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4519/9000] 10.222.0.43 () {58 vars in 1152 bytes} [Sat Jul 2 22:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 22:12:33.433534 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5732d8-4e22-4172-9977-81cd16d0eda9 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:33.443214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5732d8-4e22-4172-9977-81cd16d0eda9 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:33.448418 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd67878-00d2-4c7a-9e3a-f1b3eee9eaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:33.449211 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd67878-00d2-4c7a-9e3a-f1b3eee9eaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:33.449495 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd67878-00d2-4c7a-9e3a-f1b3eee9eaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:33.449770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd67878-00d2-4c7a-9e3a-f1b3eee9eaa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:33.450477 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd67878-00d2-4c7a-9e3a-f1b3eee9eaa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:33.452410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd67878-00d2-4c7a-9e3a-f1b3eee9eaa3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:33.481273 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4482/9001] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 22:12:33 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 22:12:33.485580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34530c4-6efb-4806-911e-f6b3ac15e997 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:33.495948 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34530c4-6efb-4806-911e-f6b3ac15e997 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:33.556642 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d7bca-9726-43c3-91c2-7a2c0f0109b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:33.557339 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d7bca-9726-43c3-91c2-7a2c0f0109b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:33.557624 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d7bca-9726-43c3-91c2-7a2c0f0109b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:33.557904 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d7bca-9726-43c3-91c2-7a2c0f0109b9 admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:33.558705 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d7bca-9726-43c3-91c2-7a2c0f0109b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:33.560744 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d7bca-9726-43c3-91c2-7a2c0f0109b9 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:33.586806 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4520/9002] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 22:12:33 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 22:12:33.591812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd67878-00d2-4c7a-9e3a-f1b3eee9eaa3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:33.603721 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd67878-00d2-4c7a-9e3a-f1b3eee9eaa3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:33.609082 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bd454-cdd1-4e5e-b1dc-35f524f4ec53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:33.609770 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bd454-cdd1-4e5e-b1dc-35f524f4ec53 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:33.610035 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bd454-cdd1-4e5e-b1dc-35f524f4ec53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:33.610325 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bd454-cdd1-4e5e-b1dc-35f524f4ec53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:33.611214 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bd454-cdd1-4e5e-b1dc-35f524f4ec53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:33.612941 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bd454-cdd1-4e5e-b1dc-35f524f4ec53 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:33.624449 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4483/9003] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 22:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 22:12:33.628718 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d7bca-9726-43c3-91c2-7a2c0f0109b9 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:33.640022 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d7bca-9726-43c3-91c2-7a2c0f0109b9 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:33.645300 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148e8fa-72ba-4846-8672-e104f1ca3d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:33.646061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148e8fa-72ba-4846-8672-e104f1ca3d54 admin admin] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:33.646418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148e8fa-72ba-4846-8672-e104f1ca3d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:33.646786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148e8fa-72ba-4846-8672-e104f1ca3d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:33.647580 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148e8fa-72ba-4846-8672-e104f1ca3d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:33.649331 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148e8fa-72ba-4846-8672-e104f1ca3d54 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:33.663561 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4521/9004] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 22:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 22:12:33.664928 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bd454-cdd1-4e5e-b1dc-35f524f4ec53 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:33.675551 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bd454-cdd1-4e5e-b1dc-35f524f4ec53 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:33.681896 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13400c-b332-4d0b-8802-d602070ef089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:33.682943 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13400c-b332-4d0b-8802-d602070ef089 admin admin] REQUEST_METHOD: `PUT` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:33.683228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13400c-b332-4d0b-8802-d602070ef089 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:33.683526 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13400c-b332-4d0b-8802-d602070ef089 admin admin] PATH_INFO: `/v3/projects/11c2539cbdbb4e1abc2819a46eb87404/users/b6d022b31b82474ea335f541e7699b90/roles/dd546359e98c4932adc5eef83b817e81` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:33.700884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13400c-b332-4d0b-8802-d602070ef089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c2539cbdbb4e1abc2819a46eb87404, user_id=b6d022b31b82474ea335f541e7699b90, role_id=dd546359e98c4932adc5eef83b817e81)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:33.703665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13400c-b332-4d0b-8802-d602070ef089 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:33.717706 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4484/9005] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 22:12:33 2022] PUT /identity/v3/projects/11c2539cbdbb4e1abc2819a46eb87404/users/b6d022b31b82474ea335f541e7699b90/roles/dd546359e98c4932adc5eef83b817e81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 22:12:33.722937 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b5fd1-61db-4d67-b814-8b83d686535c None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:33.723232 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b5fd1-61db-4d67-b814-8b83d686535c None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:33.723517 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b5fd1-61db-4d67-b814-8b83d686535c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:33.741869 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-245b5fd1-61db-4d67-b814-8b83d686535c None None] MFA Rules not processed for user `a7a87f488da04c6c9c5276b1487113d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:12:33.743086 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-245b5fd1-61db-4d67-b814-8b83d686535c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:33.762529 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:33.809847 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4522/9006] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 22:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:12:33.819870 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13400c-b332-4d0b-8802-d602070ef089 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:33.821737 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-2b13400c-b332-4d0b-8802-d602070ef089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:33.836615 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:33.885521 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13400c-b332-4d0b-8802-d602070ef089 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:33.890150 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cdedb-169a-47e3-b966-2fe0a77f6f9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:33.890880 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cdedb-169a-47e3-b966-2fe0a77f6f9a service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:33.891070 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cdedb-169a-47e3-b966-2fe0a77f6f9a service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:33.891349 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cdedb-169a-47e3-b966-2fe0a77f6f9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:33.901702 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cdedb-169a-47e3-b966-2fe0a77f6f9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:33.903238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cdedb-169a-47e3-b966-2fe0a77f6f9a service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:33.912845 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4485/9007] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:12:38.071102 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8862eff-d746-4fd7-8ce9-4fdc83c20e37 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:38.071626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8862eff-d746-4fd7-8ce9-4fdc83c20e37 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:38.071626 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8862eff-d746-4fd7-8ce9-4fdc83c20e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:38.120412 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-c8862eff-d746-4fd7-8ce9-4fdc83c20e37 None None] MFA Rules not processed for user `b6d022b31b82474ea335f541e7699b90`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:12:38.121805 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-c8862eff-d746-4fd7-8ce9-4fdc83c20e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:38.209166 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4523/9008] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 22:12:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:12:38.213785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cdedb-169a-47e3-b966-2fe0a77f6f9a service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:38.246917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cdedb-169a-47e3-b966-2fe0a77f6f9a service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:38.251665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceae1f7-03df-4825-90f9-d0bf49bf304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:38.252383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceae1f7-03df-4825-90f9-d0bf49bf304c admin admin] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:38.252676 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceae1f7-03df-4825-90f9-d0bf49bf304c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:38.252955 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceae1f7-03df-4825-90f9-d0bf49bf304c admin admin] PATH_INFO: `/v3/projects` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:38.253749 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceae1f7-03df-4825-90f9-d0bf49bf304c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:38.256005 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceae1f7-03df-4825-90f9-d0bf49bf304c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:38.287602 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4486/9009] 10.222.0.43 () {60 vars in 1152 bytes} [Sat Jul 2 22:12:38 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 22:12:38.288903 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8862eff-d746-4fd7-8ce9-4fdc83c20e37 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:38.300389 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8862eff-d746-4fd7-8ce9-4fdc83c20e37 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:38.361154 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945185f-cd5f-4c3d-95a6-f9cfc0ecbaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:38.361867 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945185f-cd5f-4c3d-95a6-f9cfc0ecbaef admin admin] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:38.362151 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945185f-cd5f-4c3d-95a6-f9cfc0ecbaef admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:38.362430 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945185f-cd5f-4c3d-95a6-f9cfc0ecbaef admin admin] PATH_INFO: `/v3/users` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:38.363141 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945185f-cd5f-4c3d-95a6-f9cfc0ecbaef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:38.365152 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945185f-cd5f-4c3d-95a6-f9cfc0ecbaef admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:38.394199 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4524/9010] 10.222.0.43 () {60 vars in 1143 bytes} [Sat Jul 2 22:12:38 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 22:12:38.395467 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceae1f7-03df-4825-90f9-d0bf49bf304c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:38.408031 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceae1f7-03df-4825-90f9-d0bf49bf304c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:38.413473 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b36ccd-8f9f-4f3b-8e2b-8f2d2bb090a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:38.414171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b36ccd-8f9f-4f3b-8e2b-8f2d2bb090a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:38.414520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b36ccd-8f9f-4f3b-8e2b-8f2d2bb090a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:38.414798 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b36ccd-8f9f-4f3b-8e2b-8f2d2bb090a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:38.415525 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b36ccd-8f9f-4f3b-8e2b-8f2d2bb090a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:38.417201 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b36ccd-8f9f-4f3b-8e2b-8f2d2bb090a3 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:38.428427 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4487/9011] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 22:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 22:12:38.433115 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945185f-cd5f-4c3d-95a6-f9cfc0ecbaef admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:38.444315 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945185f-cd5f-4c3d-95a6-f9cfc0ecbaef admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:38.449370 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50c8d1-f06b-4a4a-8417-0e2abae25219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:38.450274 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50c8d1-f06b-4a4a-8417-0e2abae25219 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:38.450553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50c8d1-f06b-4a4a-8417-0e2abae25219 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:38.450834 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50c8d1-f06b-4a4a-8417-0e2abae25219 admin admin] PATH_INFO: `/v3/projects/0d908bd8fc2645f6be0abcf55a3039af/users/77c7c8e0a7e24f81a07ba364fd64b3e5/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:38.467435 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50c8d1-f06b-4a4a-8417-0e2abae25219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d908bd8fc2645f6be0abcf55a3039af, user_id=77c7c8e0a7e24f81a07ba364fd64b3e5, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:38.470165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50c8d1-f06b-4a4a-8417-0e2abae25219 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:38.485726 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4525/9012] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 22:12:38 2022] PUT /identity/v3/projects/0d908bd8fc2645f6be0abcf55a3039af/users/77c7c8e0a7e24f81a07ba364fd64b3e5/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 22:12:38.489812 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b36ccd-8f9f-4f3b-8e2b-8f2d2bb090a3 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:38.501576 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b36ccd-8f9f-4f3b-8e2b-8f2d2bb090a3 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:38.565522 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3ce05-1862-4209-b31e-9fd2a9be541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:38.566231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3ce05-1862-4209-b31e-9fd2a9be541d admin admin] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:38.566548 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3ce05-1862-4209-b31e-9fd2a9be541d admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:38.566826 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3ce05-1862-4209-b31e-9fd2a9be541d admin admin] PATH_INFO: `/v3/roles` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:38.567562 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3ce05-1862-4209-b31e-9fd2a9be541d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:38.569407 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3ce05-1862-4209-b31e-9fd2a9be541d admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:38.580757 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4488/9013] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 22:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 22:12:38.585179 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50c8d1-f06b-4a4a-8417-0e2abae25219 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:38.596344 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50c8d1-f06b-4a4a-8417-0e2abae25219 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:38.601061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d15975-16b2-4e17-92da-8dacdbb2d107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:38.601962 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d15975-16b2-4e17-92da-8dacdbb2d107 admin admin] REQUEST_METHOD: `PUT` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:38.602240 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d15975-16b2-4e17-92da-8dacdbb2d107 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:38.602512 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d15975-16b2-4e17-92da-8dacdbb2d107 admin admin] PATH_INFO: `/v3/projects/0d908bd8fc2645f6be0abcf55a3039af/users/77c7c8e0a7e24f81a07ba364fd64b3e5/roles/fbc5ccb2ed1447f0a3df77c23347d54c` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:38.604516 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d15975-16b2-4e17-92da-8dacdbb2d107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d908bd8fc2645f6be0abcf55a3039af, user_id=77c7c8e0a7e24f81a07ba364fd64b3e5, role_id=fbc5ccb2ed1447f0a3df77c23347d54c)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:38.607266 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d15975-16b2-4e17-92da-8dacdbb2d107 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:38.609787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:38.619623 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4526/9014] 10.222.0.43 () {60 vars in 1482 bytes} [Sat Jul 2 22:12:38 2022] PUT /identity/v3/projects/0d908bd8fc2645f6be0abcf55a3039af/users/77c7c8e0a7e24f81a07ba364fd64b3e5/roles/fbc5ccb2ed1447f0a3df77c23347d54c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 22:12:43.177057 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70c823-80d9-4663-8dca-5d61466dc487 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:43.177558 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70c823-80d9-4663-8dca-5d61466dc487 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:43.177679 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70c823-80d9-4663-8dca-5d61466dc487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:43.205952 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-3b70c823-80d9-4663-8dca-5d61466dc487 None None] MFA Rules not processed for user `77c7c8e0a7e24f81a07ba364fd64b3e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:12:43.207262 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-3b70c823-80d9-4663-8dca-5d61466dc487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:43.256264 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:43.281856 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4489/9015] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 22:12:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:12:43.300590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d15975-16b2-4e17-92da-8dacdbb2d107 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:43.304247 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-d6d15975-16b2-4e17-92da-8dacdbb2d107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:43.392599 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d15975-16b2-4e17-92da-8dacdbb2d107 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:43.399652 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bc995-2833-4fd4-b9cd-c88d3e8b6b5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:43.400463 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bc995-2833-4fd4-b9cd-c88d3e8b6b5b service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:43.400845 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bc995-2833-4fd4-b9cd-c88d3e8b6b5b service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:43.401135 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bc995-2833-4fd4-b9cd-c88d3e8b6b5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:43.478533 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bc995-2833-4fd4-b9cd-c88d3e8b6b5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:43.480376 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bc995-2833-4fd4-b9cd-c88d3e8b6b5b service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:43.490782 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4527/9016] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:12:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:12:44.562619 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042c4c8-a170-4c15-aa22-5926474bfadf None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:44.563170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042c4c8-a170-4c15-aa22-5926474bfadf None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:44.563170 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042c4c8-a170-4c15-aa22-5926474bfadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:44.582455 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-d042c4c8-a170-4c15-aa22-5926474bfadf None None] MFA Rules not processed for user `b6d022b31b82474ea335f541e7699b90`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:12:44.583783 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d042c4c8-a170-4c15-aa22-5926474bfadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:44.591158 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4490/9017] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 22:12:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:12:44.922900 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bc995-2833-4fd4-b9cd-c88d3e8b6b5b service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:44.984628 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bc995-2833-4fd4-b9cd-c88d3e8b6b5b service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:44.989208 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1263c1-7f0d-4ad8-bcd3-1ab7c933a6bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:44.989916 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1263c1-7f0d-4ad8-bcd3-1ab7c933a6bd service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:44.990217 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1263c1-7f0d-4ad8-bcd3-1ab7c933a6bd service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:44.990484 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1263c1-7f0d-4ad8-bcd3-1ab7c933a6bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:44.992639 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1a1263c1-7f0d-4ad8-bcd3-1ab7c933a6bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:45.002865 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1263c1-7f0d-4ad8-bcd3-1ab7c933a6bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:45.004383 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1263c1-7f0d-4ad8-bcd3-1ab7c933a6bd service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:45.012665 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4528/9018] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:12:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:12:45.355090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042c4c8-a170-4c15-aa22-5926474bfadf None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:45.357842 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d042c4c8-a170-4c15-aa22-5926474bfadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:45.446917 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042c4c8-a170-4c15-aa22-5926474bfadf None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:45.452143 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e1c0a-dde3-4687-88e8-8fa84774fe6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:45.452808 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e1c0a-dde3-4687-88e8-8fa84774fe6e service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:45.453090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e1c0a-dde3-4687-88e8-8fa84774fe6e service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:45.453364 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e1c0a-dde3-4687-88e8-8fa84774fe6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:45.455096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-472e1c0a-dde3-4687-88e8-8fa84774fe6e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:45.467612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e1c0a-dde3-4687-88e8-8fa84774fe6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:45.469330 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e1c0a-dde3-4687-88e8-8fa84774fe6e service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:45.479631 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4491/9019] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:12:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:12:45.993495 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1263c1-7f0d-4ad8-bcd3-1ab7c933a6bd service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:45.994967 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-1a1263c1-7f0d-4ad8-bcd3-1ab7c933a6bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:46.009806 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1263c1-7f0d-4ad8-bcd3-1ab7c933a6bd service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:46.015588 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26d6ee-fb35-4df7-a427-011b92a97071 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:46.016265 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26d6ee-fb35-4df7-a427-011b92a97071 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:46.016553 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26d6ee-fb35-4df7-a427-011b92a97071 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:46.016833 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26d6ee-fb35-4df7-a427-011b92a97071 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:46.018716 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-7a26d6ee-fb35-4df7-a427-011b92a97071 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:46.031558 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26d6ee-fb35-4df7-a427-011b92a97071 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:46.033490 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26d6ee-fb35-4df7-a427-011b92a97071 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:46.043859 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4529/9020] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:12:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:12:47.556884 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e1c0a-dde3-4687-88e8-8fa84774fe6e service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:47.571056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e1c0a-dde3-4687-88e8-8fa84774fe6e service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:47.576025 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537c8f4-e17f-4de5-9531-7d996074723b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:47.576753 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537c8f4-e17f-4de5-9531-7d996074723b service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:47.577228 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537c8f4-e17f-4de5-9531-7d996074723b service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:47.577506 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537c8f4-e17f-4de5-9531-7d996074723b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:47.580469 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-6537c8f4-e17f-4de5-9531-7d996074723b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:47.591829 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537c8f4-e17f-4de5-9531-7d996074723b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:47.593508 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537c8f4-e17f-4de5-9531-7d996074723b service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:47.604078 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4492/9021] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:12:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:12:56.039523 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:INSERT=1,keystone:SELECT=90 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:56.350020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26d6ee-fb35-4df7-a427-011b92a97071 service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:56.360387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26d6ee-fb35-4df7-a427-011b92a97071 service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:56.364942 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae975dd9-3a26-4b15-b891-3581710e24a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:56.365587 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae975dd9-3a26-4b15-b891-3581710e24a0 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:56.365870 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae975dd9-3a26-4b15-b891-3581710e24a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:56.366153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae975dd9-3a26-4b15-b891-3581710e24a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:56.376311 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae975dd9-3a26-4b15-b891-3581710e24a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:56.377768 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae975dd9-3a26-4b15-b891-3581710e24a0 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:56.387605 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4530/9022] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:12:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:12:56.903491 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537c8f4-e17f-4de5-9531-7d996074723b service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:12:56.916567 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537c8f4-e17f-4de5-9531-7d996074723b service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:12:56.923131 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329e483-c207-4d03-a3cd-3ceb5a24779a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:12:56.923861 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329e483-c207-4d03-a3cd-3ceb5a24779a service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:12:56.924238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329e483-c207-4d03-a3cd-3ceb5a24779a service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:12:56.924583 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329e483-c207-4d03-a3cd-3ceb5a24779a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:12:56.926547 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-c329e483-c207-4d03-a3cd-3ceb5a24779a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:12:56.939203 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329e483-c207-4d03-a3cd-3ceb5a24779a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:12:56.940933 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329e483-c207-4d03-a3cd-3ceb5a24779a service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:12:56.951007 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4493/9023] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:12:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:13:06.383493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=6 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:13:06.947027 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=55 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:14:56.292554 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59d6da-a1f2-4dfb-9b4d-316544c48c1b None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:14:56.293043 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59d6da-a1f2-4dfb-9b4d-316544c48c1b None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:14:56.293149 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59d6da-a1f2-4dfb-9b4d-316544c48c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:14:56.365973 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-ac59d6da-a1f2-4dfb-9b4d-316544c48c1b None None] MFA Rules not processed for user `3de168a603b0478fa8de67f6d206e1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:14:56.367085 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-ac59d6da-a1f2-4dfb-9b4d-316544c48c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:14:56.453208 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4531/9024] 10.222.0.43 () {58 vars in 1059 bytes} [Sat Jul 2 22:14:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:14:56.463266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329e483-c207-4d03-a3cd-3ceb5a24779a service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:14:56.487042 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329e483-c207-4d03-a3cd-3ceb5a24779a service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:14:56.491061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d19ae-09cd-4257-b2c4-1470590478ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3de168a603b0478fa8de67f6d206e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:14:56.491705 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d19ae-09cd-4257-b2c4-1470590478ef service glance] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:14:56.491988 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d19ae-09cd-4257-b2c4-1470590478ef service glance] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:14:56.492293 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d19ae-09cd-4257-b2c4-1470590478ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:14:56.494121 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ec4d19ae-09cd-4257-b2c4-1470590478ef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:14:56.520252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d19ae-09cd-4257-b2c4-1470590478ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:14:56.521699 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d19ae-09cd-4257-b2c4-1470590478ef service glance] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:14:56.533306 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4494/9025] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:14:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:15:00.833248 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199f5ef-16af-4ea0-b57f-84b63e5610a1 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:15:00.833758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199f5ef-16af-4ea0-b57f-84b63e5610a1 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:15:00.833758 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199f5ef-16af-4ea0-b57f-84b63e5610a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:15:00.853731 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-0199f5ef-16af-4ea0-b57f-84b63e5610a1 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:15:00.854954 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-0199f5ef-16af-4ea0-b57f-84b63e5610a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:15:00.917139 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4532/9026] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 22:15:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 22:15:00.969765 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d19ae-09cd-4257-b2c4-1470590478ef service glance] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:15:00.971224 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ec4d19ae-09cd-4257-b2c4-1470590478ef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:15:01.045046 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d19ae-09cd-4257-b2c4-1470590478ef service glance] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:15:01.052395 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c4478-aa3c-4bb1-9d8c-9854f4ebf926 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:15:01.053061 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c4478-aa3c-4bb1-9d8c-9854f4ebf926 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:15:01.053367 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c4478-aa3c-4bb1-9d8c-9854f4ebf926 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:15:01.053641 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c4478-aa3c-4bb1-9d8c-9854f4ebf926 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:15:01.063640 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c4478-aa3c-4bb1-9d8c-9854f4ebf926 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:15:01.065403 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c4478-aa3c-4bb1-9d8c-9854f4ebf926 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:15:01.074425 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4495/9027] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 22:15:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 22:15:10.303979 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dccb4-f6fc-4893-807f-e3d640a76843 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:15:10.304597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dccb4-f6fc-4893-807f-e3d640a76843 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:15:10.304597 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dccb4-f6fc-4893-807f-e3d640a76843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:15:10.322546 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-6b9dccb4-f6fc-4893-807f-e3d640a76843 None None] MFA Rules not processed for user `b6d022b31b82474ea335f541e7699b90`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:15:10.323753 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-6b9dccb4-f6fc-4893-807f-e3d640a76843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:15:10.330832 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4533/9028] 10.222.0.43 () {58 vars in 957 bytes} [Sat Jul 2 22:15:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:15:10.655252 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c4478-aa3c-4bb1-9d8c-9854f4ebf926 service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:15:10.665768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c4478-aa3c-4bb1-9d8c-9854f4ebf926 service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:15:10.670389 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4bca5-80e5-4ac4-a071-b06d3ce6a2b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:15:10.671028 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4bca5-80e5-4ac4-a071-b06d3ce6a2b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:15:10.671346 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4bca5-80e5-4ac4-a071-b06d3ce6a2b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:15:10.671620 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4bca5-80e5-4ac4-a071-b06d3ce6a2b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:15:10.673820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-bad4bca5-80e5-4ac4-a071-b06d3ce6a2b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:15:10.698056 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4bca5-80e5-4ac4-a071-b06d3ce6a2b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:15:10.699501 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4bca5-80e5-4ac4-a071-b06d3ce6a2b0 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:15:10.707576 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4496/9029] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:15:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:15:11.060787 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dccb4-f6fc-4893-807f-e3d640a76843 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:15:11.073829 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dccb4-f6fc-4893-807f-e3d640a76843 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:15:11.084944 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992c4cd-7858-47be-8c8d-c275a128f653 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:15:11.085496 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4bca5-80e5-4ac4-a071-b06d3ce6a2b0 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:15:11.085647 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992c4cd-7858-47be-8c8d-c275a128f653 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:15:11.085875 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992c4cd-7858-47be-8c8d-c275a128f653 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:15:11.086118 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992c4cd-7858-47be-8c8d-c275a128f653 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:15:11.088006 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-a992c4cd-7858-47be-8c8d-c275a128f653 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:15:11.097208 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4bca5-80e5-4ac4-a071-b06d3ce6a2b0 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:15:11.101060 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d3bc-771d-4130-bd4b-b7044cb4c068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:15:11.101626 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d3bc-771d-4130-bd4b-b7044cb4c068 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:15:11.101914 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d3bc-771d-4130-bd4b-b7044cb4c068 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:15:11.102187 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d3bc-771d-4130-bd4b-b7044cb4c068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:15:11.103974 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-e762d3bc-771d-4130-bd4b-b7044cb4c068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:15:11.112841 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992c4cd-7858-47be-8c8d-c275a128f653 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:15:11.114491 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992c4cd-7858-47be-8c8d-c275a128f653 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:15:11.117709 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762d3bc-771d-4130-bd4b-b7044cb4c068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:15:11.119233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762d3bc-771d-4130-bd4b-b7044cb4c068 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:15:11.125231 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4534/9030] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:15:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:15:11.130322 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4497/9031] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:15:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:15:12.383983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dc6c0-f8ae-4a63-9670-90bf1a6329e9 None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:15:12.383983 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dc6c0-f8ae-4a63-9670-90bf1a6329e9 None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:15:12.384590 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dc6c0-f8ae-4a63-9670-90bf1a6329e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:15:12.401660 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-667dc6c0-f8ae-4a63-9670-90bf1a6329e9 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:15:12.403001 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-667dc6c0-f8ae-4a63-9670-90bf1a6329e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:15:12.411161 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4535/9032] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 22:15:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:15:12.424652 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d3bc-771d-4130-bd4b-b7044cb4c068 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:15:12.437723 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d3bc-771d-4130-bd4b-b7044cb4c068 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:15:12.443865 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6894d-b2c4-4318-8239-83e2ad907f15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:15:12.444667 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6894d-b2c4-4318-8239-83e2ad907f15 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:15:12.444957 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6894d-b2c4-4318-8239-83e2ad907f15 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:15:12.445238 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6894d-b2c4-4318-8239-83e2ad907f15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:15:12.455617 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a6894d-b2c4-4318-8239-83e2ad907f15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:15:12.457231 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a6894d-b2c4-4318-8239-83e2ad907f15 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:15:12.466095 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4498/9033] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 22:15:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 22:15:15.167971 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dc6c0-f8ae-4a63-9670-90bf1a6329e9 None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:15:15.172046 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-667dc6c0-f8ae-4a63-9670-90bf1a6329e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:15:15.192915 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dc6c0-f8ae-4a63-9670-90bf1a6329e9 None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:15:15.199827 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70f25f-fe05-4896-ba53-ca492719a802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:15:15.200961 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70f25f-fe05-4896-ba53-ca492719a802 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:15:15.201493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70f25f-fe05-4896-ba53-ca492719a802 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:15:15.201830 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70f25f-fe05-4896-ba53-ca492719a802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:15:15.203761 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-8d70f25f-fe05-4896-ba53-ca492719a802 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:15:15.217418 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70f25f-fe05-4896-ba53-ca492719a802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:15:15.219387 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70f25f-fe05-4896-ba53-ca492719a802 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:15:15.231867 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4536/9034] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:15:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:15:22.462945 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=69 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:15:23.439368 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6894d-b2c4-4318-8239-83e2ad907f15 service swift] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:15:23.441153 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-76a6894d-b2c4-4318-8239-83e2ad907f15 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:15:23.454089 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6894d-b2c4-4318-8239-83e2ad907f15 service swift] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:15:23.457935 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97e897-6209-4e89-a4c7-66fe277e8638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:15:23.458553 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97e897-6209-4e89-a4c7-66fe277e8638 service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:15:23.458834 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97e897-6209-4e89-a4c7-66fe277e8638 service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:15:23.459103 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97e897-6209-4e89-a4c7-66fe277e8638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:15:23.461329 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-ac97e897-6209-4e89-a4c7-66fe277e8638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:15:23.471047 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97e897-6209-4e89-a4c7-66fe277e8638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:15:23.472532 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97e897-6209-4e89-a4c7-66fe277e8638 service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:15:23.480357 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4499/9035] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:15:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:15:25.226589 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=98 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:15:33.476932 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=6 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:17:49.052260 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70f25f-fe05-4896-ba53-ca492719a802 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:17:49.064033 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70f25f-fe05-4896-ba53-ca492719a802 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:17:49.070279 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181213a-69de-4090-bfec-c62716e806e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:17:49.070918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181213a-69de-4090-bfec-c62716e806e5 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:17:49.071228 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181213a-69de-4090-bfec-c62716e806e5 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:17:49.071508 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181213a-69de-4090-bfec-c62716e806e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:17:49.079899 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181213a-69de-4090-bfec-c62716e806e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:17:49.081559 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181213a-69de-4090-bfec-c62716e806e5 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:17:49.091902 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4537/9036] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:17:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:17:53.639251 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97e897-6209-4e89-a4c7-66fe277e8638 service neutron] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:17:53.648360 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97e897-6209-4e89-a4c7-66fe277e8638 service neutron] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:17:53.652859 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffab99a-0f40-4853-a452-f6b9a03d000e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:17:53.653499 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffab99a-0f40-4853-a452-f6b9a03d000e service neutron] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:17:53.653777 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffab99a-0f40-4853-a452-f6b9a03d000e service neutron] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:17:53.654044 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffab99a-0f40-4853-a452-f6b9a03d000e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:17:53.661456 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffab99a-0f40-4853-a452-f6b9a03d000e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:17:53.662898 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffab99a-0f40-4853-a452-f6b9a03d000e service neutron] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:17:53.670936 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4500/9037] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:17:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:17:54.700127 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181213a-69de-4090-bfec-c62716e806e5 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:17:54.712329 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181213a-69de-4090-bfec-c62716e806e5 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:17:54.718786 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df991ca2-fffa-4ce3-b1a9-6a02b434687d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:17:54.719454 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df991ca2-fffa-4ce3-b1a9-6a02b434687d service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:17:54.719742 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df991ca2-fffa-4ce3-b1a9-6a02b434687d service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:17:54.720018 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df991ca2-fffa-4ce3-b1a9-6a02b434687d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:17:54.729317 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df991ca2-fffa-4ce3-b1a9-6a02b434687d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:17:54.730930 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df991ca2-fffa-4ce3-b1a9-6a02b434687d service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:17:54.741393 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4538/9038] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:17:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:17:57.749292 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3e32e-a529-4970-8267-3e50dd5429f4 None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:17:57.749990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3e32e-a529-4970-8267-3e50dd5429f4 None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:17:57.749990 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3e32e-a529-4970-8267-3e50dd5429f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:17:57.769390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-96d3e32e-a529-4970-8267-3e50dd5429f4 None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:17:57.770692 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-96d3e32e-a529-4970-8267-3e50dd5429f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:17:57.779450 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4501/9039] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Jul 2 22:17:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 22:17:57.820543 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df991ca2-fffa-4ce3-b1a9-6a02b434687d service placement] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:17:57.832401 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df991ca2-fffa-4ce3-b1a9-6a02b434687d service placement] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:17:57.838800 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cde35-d287-4dd1-9c56-e735f10315a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:17:57.839431 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cde35-d287-4dd1-9c56-e735f10315a9 service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:17:57.839703 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cde35-d287-4dd1-9c56-e735f10315a9 service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:17:57.839975 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cde35-d287-4dd1-9c56-e735f10315a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:17:57.848446 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cde35-d287-4dd1-9c56-e735f10315a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:17:57.850107 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cde35-d287-4dd1-9c56-e735f10315a9 service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:17:57.858642 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4539/9040] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 22:17:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 22:18:03.953939 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3e32e-a529-4970-8267-3e50dd5429f4 None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:18:03.970237 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3e32e-a529-4970-8267-3e50dd5429f4 None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:18:03.975922 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af654a77-94d3-4ce6-ad5f-edfe78c85d3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:18:03.976623 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af654a77-94d3-4ce6-ad5f-edfe78c85d3b service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:18:03.976893 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af654a77-94d3-4ce6-ad5f-edfe78c85d3b service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:18:03.977171 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af654a77-94d3-4ce6-ad5f-edfe78c85d3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:18:03.990340 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af654a77-94d3-4ce6-ad5f-edfe78c85d3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:18:03.992247 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af654a77-94d3-4ce6-ad5f-edfe78c85d3b service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:18:04.003056 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4502/9041] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:18:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:18:06.996450 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd659b-61b3-4f4f-902d-e96f9a1e022f None None] REQUEST_METHOD: `POST` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:18:06.997020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd659b-61b3-4f4f-902d-e96f9a1e022f None None] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:18:06.997020 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd659b-61b3-4f4f-902d-e96f9a1e022f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:18:07.015197 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.auth.core [None req-9dcd659b-61b3-4f4f-902d-e96f9a1e022f None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91078) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:18:07.016445 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-9dcd659b-61b3-4f4f-902d-e96f9a1e022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:18:07.024339 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4540/9042] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 22:18:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:18:07.036756 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af654a77-94d3-4ce6-ad5f-edfe78c85d3b service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:18:07.048873 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af654a77-94d3-4ce6-ad5f-edfe78c85d3b service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:18:07.055390 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9623d-1023-4d25-92c4-f326d6ddb0c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:18:07.056063 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9623d-1023-4d25-92c4-f326d6ddb0c8 service swift] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:18:07.056358 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9623d-1023-4d25-92c4-f326d6ddb0c8 service swift] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:18:07.056639 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9623d-1023-4d25-92c4-f326d6ddb0c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:18:07.065246 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9623d-1023-4d25-92c4-f326d6ddb0c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:18:07.067090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9623d-1023-4d25-92c4-f326d6ddb0c8 service swift] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:18:07.075437 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4503/9043] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 22:18:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 22:18:08.303425 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd659b-61b3-4f4f-902d-e96f9a1e022f None None] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:18:08.322531 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd659b-61b3-4f4f-902d-e96f9a1e022f None None] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:18:08.329015 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1c1fd-4c80-4a25-8434-b1962468f7e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:18:08.330312 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1c1fd-4c80-4a25-8434-b1962468f7e4 service nova] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:18:08.330933 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1c1fd-4c80-4a25-8434-b1962468f7e4 service nova] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:18:08.331471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1c1fd-4c80-4a25-8434-b1962468f7e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:18:08.333918 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-b3f1c1fd-4c80-4a25-8434-b1962468f7e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:18:08.367124 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1c1fd-4c80-4a25-8434-b1962468f7e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:18:08.369332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1c1fd-4c80-4a25-8434-b1962468f7e4 service nova] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:18:08.382341 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4541/9044] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:18:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:18:12.023909 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09a1e8-368c-480d-a2fc-9f9d8512ac4a None None] REQUEST_METHOD: `POST` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:18:12.024415 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09a1e8-368c-480d-a2fc-9f9d8512ac4a None None] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:18:12.024517 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09a1e8-368c-480d-a2fc-9f9d8512ac4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:18:12.043342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.auth.core [None req-1c09a1e8-368c-480d-a2fc-9f9d8512ac4a None None] MFA Rules not processed for user `4d4bfe417b4c4896ae5f3fc23e03ef71`. Rule list: `[]` (Enabled: `True`). {{(pid=91077) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 22:18:12.044612 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-1c09a1e8-368c-480d-a2fc-9f9d8512ac4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:18:12.052489 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4504/9045] 10.222.0.43 () {58 vars in 967 bytes} [Sat Jul 2 22:18:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 22:18:12.065236 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1c1fd-4c80-4a25-8434-b1962468f7e4 service nova] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:18:12.077669 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1c1fd-4c80-4a25-8434-b1962468f7e4 service nova] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:18:12.083110 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c6f22-4a43-4ae7-8351-eb6cfcd4dced service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55367f643da048c5ab61ab6325552256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:18:12.083751 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c6f22-4a43-4ae7-8351-eb6cfcd4dced service swift] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:18:12.084084 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c6f22-4a43-4ae7-8351-eb6cfcd4dced service swift] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:18:12.084366 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c6f22-4a43-4ae7-8351-eb6cfcd4dced service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:18:12.093332 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c6f22-4a43-4ae7-8351-eb6cfcd4dced service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:18:12.094941 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c6f22-4a43-4ae7-8351-eb6cfcd4dced service swift] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:18:12.103540 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4542/9046] 10.222.0.43 () {60 vars in 1384 bytes} [Sat Jul 2 22:18:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 22:18:14.808017 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09a1e8-368c-480d-a2fc-9f9d8512ac4a None None] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:18:14.821022 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09a1e8-368c-480d-a2fc-9f9d8512ac4a None None] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:18:14.826876 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58fe2a-3df5-4f14-aae2-f2e5be09929c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3e290fa5384f9bac3fec771cebf653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:18:14.827536 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58fe2a-3df5-4f14-aae2-f2e5be09929c service nova] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:18:14.827819 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58fe2a-3df5-4f14-aae2-f2e5be09929c service nova] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:18:14.828114 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58fe2a-3df5-4f14-aae2-f2e5be09929c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:18:14.830191 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-0b58fe2a-3df5-4f14-aae2-f2e5be09929c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:18:14.849867 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58fe2a-3df5-4f14-aae2-f2e5be09929c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:18:14.851578 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58fe2a-3df5-4f14-aae2-f2e5be09929c service nova] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:18:14.867836 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4505/9047] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:18:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:18:16.155438 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c6f22-4a43-4ae7-8351-eb6cfcd4dced service swift] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:18:16.159892 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=39 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:18:16.167081 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c6f22-4a43-4ae7-8351-eb6cfcd4dced service swift] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:18:16.171473 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a82bcd-acb7-45f9-9693-23d818b97484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '684732cf5a004fb084ce0e523398c970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:18:16.172165 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a82bcd-acb7-45f9-9693-23d818b97484 service neutron] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:18:16.172493 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a82bcd-acb7-45f9-9693-23d818b97484 service neutron] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:18:16.172770 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a82bcd-acb7-45f9-9693-23d818b97484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:18:16.250042 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a82bcd-acb7-45f9-9693-23d818b97484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:18:16.252207 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a82bcd-acb7-45f9-9693-23d818b97484 service neutron] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:18:16.272909 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4543/9048] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:18:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:18:19.586631 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58fe2a-3df5-4f14-aae2-f2e5be09929c service nova] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:18:19.604494 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58fe2a-3df5-4f14-aae2-f2e5be09929c service nova] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:18:19.609529 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37603da8-b381-4fea-98bc-80ec75074dc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:18:19.610366 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37603da8-b381-4fea-98bc-80ec75074dc5 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:18:19.610820 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37603da8-b381-4fea-98bc-80ec75074dc5 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:18:19.611234 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37603da8-b381-4fea-98bc-80ec75074dc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:18:19.613571 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-37603da8-b381-4fea-98bc-80ec75074dc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:18:19.628443 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37603da8-b381-4fea-98bc-80ec75074dc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:18:19.630975 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37603da8-b381-4fea-98bc-80ec75074dc5 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:18:19.676386 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4506/9049] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:18:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:18:22.721153 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a82bcd-acb7-45f9-9693-23d818b97484 service neutron] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:18:22.731471 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a82bcd-acb7-45f9-9693-23d818b97484 service neutron] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:18:22.736843 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d16115-86c3-4f22-847a-6fc4afb2bc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:18:22.737832 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d16115-86c3-4f22-847a-6fc4afb2bc26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:18:22.738117 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d16115-86c3-4f22-847a-6fc4afb2bc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:18:22.738399 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d16115-86c3-4f22-847a-6fc4afb2bc26 admin admin] PATH_INFO: `/v3/users/b6d022b31b82474ea335f541e7699b90` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:18:22.739693 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d16115-86c3-4f22-847a-6fc4afb2bc26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d022b31b82474ea335f541e7699b90)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:18:22.748457 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d16115-86c3-4f22-847a-6fc4afb2bc26 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:18:22.789172 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-35d16115-86c3-4f22-847a-6fc4afb2bc26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d022b31b82474ea335f541e7699b90'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:22.796939 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-35d16115-86c3-4f22-847a-6fc4afb2bc26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d022b31b82474ea335f541e7699b90'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:22.797677 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-35d16115-86c3-4f22-847a-6fc4afb2bc26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d022b31b82474ea335f541e7699b90'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:22.798343 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-35d16115-86c3-4f22-847a-6fc4afb2bc26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d022b31b82474ea335f541e7699b90'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:22.805709 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-35d16115-86c3-4f22-847a-6fc4afb2bc26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d022b31b82474ea335f541e7699b90'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:22.822559 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4544/9050] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 22:18:22 2022] DELETE /identity/v3/users/b6d022b31b82474ea335f541e7699b90 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 22:18:23.007520 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37603da8-b381-4fea-98bc-80ec75074dc5 service placement] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:18:23.019369 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37603da8-b381-4fea-98bc-80ec75074dc5 service placement] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:18:23.081090 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a566203-395e-4265-959f-c2ea7ac97e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:18:23.081916 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a566203-395e-4265-959f-c2ea7ac97e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:18:23.082221 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a566203-395e-4265-959f-c2ea7ac97e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:18:23.082470 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a566203-395e-4265-959f-c2ea7ac97e9c admin admin] PATH_INFO: `/v3/projects/11c2539cbdbb4e1abc2819a46eb87404` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:18:23.083791 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a566203-395e-4265-959f-c2ea7ac97e9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c2539cbdbb4e1abc2819a46eb87404)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:18:23.085785 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a566203-395e-4265-959f-c2ea7ac97e9c admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:18:23.134381 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9a566203-395e-4265-959f-c2ea7ac97e9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c2539cbdbb4e1abc2819a46eb87404', 'request_id': 'req-9a566203-395e-4265-959f-c2ea7ac97e9c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:23.140597 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9a566203-395e-4265-959f-c2ea7ac97e9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c2539cbdbb4e1abc2819a46eb87404', 'request_id': 'req-9a566203-395e-4265-959f-c2ea7ac97e9c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:23.146665 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9a566203-395e-4265-959f-c2ea7ac97e9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c2539cbdbb4e1abc2819a46eb87404', 'request_id': 'req-9a566203-395e-4265-959f-c2ea7ac97e9c'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:23.171926 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:18:23.175167 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9a566203-395e-4265-959f-c2ea7ac97e9c admin admin] The token cache is being invalidate because project 11c2539cbdbb4e1abc2819a46eb87404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 22:18:23.175730 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9a566203-395e-4265-959f-c2ea7ac97e9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:23.176748 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-9a566203-395e-4265-959f-c2ea7ac97e9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:23.179194 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4507/9051] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 22:18:23 2022] DELETE /identity/v3/projects/11c2539cbdbb4e1abc2819a46eb87404 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 22:18:23.184066 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d16115-86c3-4f22-847a-6fc4afb2bc26 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:18:23.185565 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-35d16115-86c3-4f22-847a-6fc4afb2bc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:18:23.199700 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d16115-86c3-4f22-847a-6fc4afb2bc26 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:18:23.257291 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:18:23.269560 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2c317-720d-4491-99e8-9acc94caa0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:18:23.270460 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2c317-720d-4491-99e8-9acc94caa0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:18:23.270815 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2c317-720d-4491-99e8-9acc94caa0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:18:23.271093 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2c317-720d-4491-99e8-9acc94caa0e3 admin admin] PATH_INFO: `/v3/users/77c7c8e0a7e24f81a07ba364fd64b3e5` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:18:23.272527 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2c317-720d-4491-99e8-9acc94caa0e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c7c8e0a7e24f81a07ba364fd64b3e5)` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:18:23.274474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2c317-720d-4491-99e8-9acc94caa0e3 admin admin] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:18:23.324617 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-91a2c317-720d-4491-99e8-9acc94caa0e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c7c8e0a7e24f81a07ba364fd64b3e5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:23.333574 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-91a2c317-720d-4491-99e8-9acc94caa0e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c7c8e0a7e24f81a07ba364fd64b3e5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:23.334237 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-91a2c317-720d-4491-99e8-9acc94caa0e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c7c8e0a7e24f81a07ba364fd64b3e5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:23.334880 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-91a2c317-720d-4491-99e8-9acc94caa0e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c7c8e0a7e24f81a07ba364fd64b3e5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:23.342166 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.notifications [None req-91a2c317-720d-4491-99e8-9acc94caa0e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c7c8e0a7e24f81a07ba364fd64b3e5'} {{(pid=91078) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:23.363129 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4545/9052] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 22:18:23 2022] DELETE /identity/v3/users/77c7c8e0a7e24f81a07ba364fd64b3e5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 22:18:23.549269 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a566203-395e-4265-959f-c2ea7ac97e9c admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:18:23.550924 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-9a566203-395e-4265-959f-c2ea7ac97e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:18:23.565233 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a566203-395e-4265-959f-c2ea7ac97e9c admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:18:23.629505 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d97457-0e12-4fa8-88a7-38e326de5076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7a87f488da04c6c9c5276b1487113d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4c9de22f7474b6f9c2ca908dc6ecd1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:18:23.630342 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d97457-0e12-4fa8-88a7-38e326de5076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:18:23.630627 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d97457-0e12-4fa8-88a7-38e326de5076 admin admin] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:18:23.630902 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d97457-0e12-4fa8-88a7-38e326de5076 admin admin] PATH_INFO: `/v3/projects/0d908bd8fc2645f6be0abcf55a3039af` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:18:23.632122 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d97457-0e12-4fa8-88a7-38e326de5076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d908bd8fc2645f6be0abcf55a3039af)` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:18:23.634068 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d97457-0e12-4fa8-88a7-38e326de5076 admin admin] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:18:23.690099 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d6d97457-0e12-4fa8-88a7-38e326de5076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d908bd8fc2645f6be0abcf55a3039af', 'request_id': 'req-d6d97457-0e12-4fa8-88a7-38e326de5076'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:23.697614 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d6d97457-0e12-4fa8-88a7-38e326de5076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d908bd8fc2645f6be0abcf55a3039af', 'request_id': 'req-d6d97457-0e12-4fa8-88a7-38e326de5076'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:23.703768 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d6d97457-0e12-4fa8-88a7-38e326de5076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d908bd8fc2645f6be0abcf55a3039af', 'request_id': 'req-d6d97457-0e12-4fa8-88a7-38e326de5076'} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:23.717096 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d6d97457-0e12-4fa8-88a7-38e326de5076 admin admin] The token cache is being invalidate because project 0d908bd8fc2645f6be0abcf55a3039af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91077) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 22:18:23.717383 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d6d97457-0e12-4fa8-88a7-38e326de5076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:23.718012 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.notifications [None req-d6d97457-0e12-4fa8-88a7-38e326de5076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91077) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 22:18:23.719576 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4508/9053] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 22:18:23 2022] DELETE /identity/v3/projects/0d908bd8fc2645f6be0abcf55a3039af => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 22:18:33.359192 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=30,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:18:33.714183 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:22:56.911485 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2c317-720d-4491-99e8-9acc94caa0e3 admin admin] Authenticating user token {{(pid=91078) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:22:56.913147 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-91a2c317-720d-4491-99e8-9acc94caa0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:22:57.020194 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2c317-720d-4491-99e8-9acc94caa0e3 admin admin] Validating token access rules against request {{(pid=91078) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:22:57.091322 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3d173-c506-48c6-a531-655390640d22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91078) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:22:57.091988 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3d173-c506-48c6-a531-655390640d22 service placement] REQUEST_METHOD: `GET` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:22:57.092298 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3d173-c506-48c6-a531-655390640d22 service placement] SCRIPT_NAME: `/identity` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:22:57.092577 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3d173-c506-48c6-a531-655390640d22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91078) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:22:57.094474 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.fernet_utils [None req-73f3d173-c506-48c6-a531-655390640d22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91078) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:22:57.106061 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3d173-c506-48c6-a531-655390640d22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:22:57.107722 ncdv-master-1 devstack@keystone.service[91078]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3d173-c506-48c6-a531-655390640d22 service placement] RBAC: Authorization granted {{(pid=91078) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:22:57.117543 ncdv-master-1 devstack@keystone.service[91078]: [pid: 91078|app: 0|req: 4546/9054] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:22:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:23:07.113507 ncdv-master-1 devstack@keystone.service[91078]: DEBUG dbcounter [-] [91078] Writing DB stats keystone:SELECT=71 {{(pid=91078) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:23:10.944670 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d97457-0e12-4fa8-88a7-38e326de5076 admin admin] Authenticating user token {{(pid=91077) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 22:23:10.946266 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-d6d97457-0e12-4fa8-88a7-38e326de5076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:23:10.984194 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d97457-0e12-4fa8-88a7-38e326de5076 admin admin] Validating token access rules against request {{(pid=91077) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 22:23:10.989766 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd451191-f5ab-4b97-8e36-1d15418f87e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8de7334e054d53ab0c0e7dd7cb7c8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001bf63308784f4eb62e64d6f82c8354', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91077) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 22:23:10.990410 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd451191-f5ab-4b97-8e36-1d15418f87e4 service placement] REQUEST_METHOD: `GET` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 22:23:10.990690 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd451191-f5ab-4b97-8e36-1d15418f87e4 service placement] SCRIPT_NAME: `/identity` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 22:23:10.990964 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd451191-f5ab-4b97-8e36-1d15418f87e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91077) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 22:23:10.992937 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.fernet_utils [None req-dd451191-f5ab-4b97-8e36-1d15418f87e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91077) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 22:23:11.004334 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd451191-f5ab-4b97-8e36-1d15418f87e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 22:23:11.005920 ncdv-master-1 devstack@keystone.service[91077]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd451191-f5ab-4b97-8e36-1d15418f87e4 service placement] RBAC: Authorization granted {{(pid=91077) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 22:23:11.015857 ncdv-master-1 devstack@keystone.service[91077]: [pid: 91077|app: 0|req: 4509/9055] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Jul 2 22:23:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 22:23:21.011825 ncdv-master-1 devstack@keystone.service[91077]: DEBUG dbcounter [-] [91077] Writing DB stats keystone:SELECT=15 {{(pid=91077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}